2015-10-05T03:00:03.624+0100 [conn1418543] pid=1424 port=27017 64-bit host=402929-MYWAPP1 2015-10-05T03:00:03.624+0100 [conn1418543] db version v2.6.11 2015-10-05T03:00:03.625+0100 [conn1418543] git version: d00c1735675c457f75a12d530bee85421f0c5548 2015-10-05T03:00:03.625+0100 [conn1418543] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 2015-10-05T03:00:03.625+0100 [conn1418543] allocator: system 2015-10-05T03:00:03.625+0100 [conn1418543] options: { security: { keyFile: "C:\mongo\mongo_keyfile" }, service: true, sharding: { configDB: "mywdb7:27019,mywdb8:27019,mywdb9:27019" }, systemLog: { destination: "file", logAppend: true, path: "c:\mongo\data\log\mongos.log" } } 2015-10-05T03:00:03.626+0100 [conn1418543] end connection 127.0.0.1:52279 (400 connections now open) 2015-10-05T03:00:04.982+0100 [conn1418294] end connection 172.28.0.163:50609 (399 connections now open) 2015-10-05T03:00:04.982+0100 [conn1418527] end connection 172.28.0.163:52222 (399 connections now open) 2015-10-05T03:00:04.983+0100 [conn1418259] end connection 172.28.0.163:50299 (397 connections now open) 2015-10-05T03:00:04.983+0100 [conn1418377] end connection 172.28.0.163:51136 (396 connections now open) 2015-10-05T03:00:04.984+0100 [conn1418314] end connection 172.28.0.163:50806 (395 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418283] end connection 172.28.0.163:50502 (394 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418198] end connection 172.28.0.163:49899 (394 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418227] end connection 172.28.0.163:50067 (392 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418313] end connection 172.28.0.163:50805 (392 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418275] end connection 172.28.0.163:50395 (390 connections now open) 2015-10-05T03:00:04.985+0100 [conn1418226] end connection 172.28.0.163:50066 (391 connections now open) 2015-10-05T03:00:04.986+0100 [conn1418106] end connection 172.28.0.163:49359 (389 connections now open) 2015-10-05T03:00:05.240+0100 [conn1418115] end connection 172.28.0.164:58933 (387 connections now open) 2015-10-05T03:00:05.248+0100 [mongosMain] connection accepted from 172.28.0.164:61771 #1418544 (388 connections now open) 2015-10-05T03:00:05.250+0100 [conn1418544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:05.522+0100 [conn1418111] end connection 172.28.0.163:49388 (387 connections now open) 2015-10-05T03:00:05.522+0100 [conn1418149] end connection 172.28.0.163:49596 (387 connections now open) 2015-10-05T03:00:05.523+0100 [mongosMain] connection accepted from 172.28.0.163:52281 #1418545 (387 connections now open) 2015-10-05T03:00:05.524+0100 [mongosMain] connection accepted from 172.28.0.163:52282 #1418546 (388 connections now open) 2015-10-05T03:00:05.524+0100 [conn1418545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:05.525+0100 [conn1418546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:05.787+0100 [conn1418257] end connection 172.28.0.164:59864 (387 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418532] end connection 172.28.0.164:61728 (387 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418339] end connection 172.28.0.164:60458 (385 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418166] end connection 172.28.0.164:59219 (385 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418245] end connection 172.28.0.164:59740 (383 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418375] end connection 172.28.0.164:60699 (383 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418345] end connection 172.28.0.164:60516 (385 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418274] end connection 172.28.0.164:59957 (385 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418368] end connection 172.28.0.164:60688 (381 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418499] end connection 172.28.0.164:61532 (380 connections now open) 2015-10-05T03:00:05.787+0100 [conn1418310] end connection 172.28.0.164:60337 (385 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418431] end connection 172.28.0.164:61108 (377 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418184] end connection 172.28.0.164:59377 (377 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418273] end connection 172.28.0.164:59956 (376 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418209] end connection 172.28.0.164:59578 (374 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418306] end connection 172.28.0.164:60271 (375 connections now open) 2015-10-05T03:00:05.788+0100 [conn1418311] end connection 172.28.0.164:60338 (376 connections now open) 2015-10-05T03:00:05.789+0100 [conn1418523] end connection 172.28.0.164:61708 (370 connections now open) 2015-10-05T03:00:05.789+0100 [conn1418264] end connection 172.28.0.164:59908 (370 connections now open) 2015-10-05T03:00:05.789+0100 [conn1418159] end connection 172.28.0.164:59173 (369 connections now open) 2015-10-05T03:00:05.790+0100 [conn1418360] end connection 172.28.0.164:60668 (367 connections now open) 2015-10-05T03:00:05.790+0100 [conn1418231] end connection 172.28.0.164:59660 (367 connections now open) 2015-10-05T03:00:05.790+0100 [conn1418352] end connection 172.28.0.164:60589 (365 connections now open) 2015-10-05T03:00:05.790+0100 [conn1418204] end connection 172.28.0.164:59501 (364 connections now open) 2015-10-05T03:00:05.790+0100 [conn1418506] end connection 172.28.0.164:61580 (363 connections now open) 2015-10-05T03:00:05.803+0100 [conn1418403] end connection 172.28.0.164:60933 (362 connections now open) 2015-10-05T03:00:05.803+0100 [conn1418158] end connection 172.28.0.164:59171 (362 connections now open) 2015-10-05T03:00:05.803+0100 [conn1418430] end connection 172.28.0.164:61107 (362 connections now open) 2015-10-05T03:00:05.804+0100 [conn1418500] end connection 172.28.0.164:61533 (359 connections now open) 2015-10-05T03:00:05.804+0100 [conn1418135] end connection 172.28.0.164:59097 (358 connections now open) 2015-10-05T03:00:05.804+0100 [conn1418463] end connection 172.28.0.164:61314 (357 connections now open) 2015-10-05T03:00:05.805+0100 [conn1418524] end connection 172.28.0.164:61709 (356 connections now open) 2015-10-05T03:00:05.805+0100 [conn1418451] end connection 172.28.0.164:61214 (356 connections now open) 2015-10-05T03:00:05.805+0100 [conn1418152] end connection 172.28.0.164:59127 (354 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418507] end connection 172.28.0.164:61581 (353 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418388] end connection 172.28.0.164:60813 (352 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418515] end connection 172.28.0.164:61643 (352 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418318] end connection 172.28.0.164:60387 (351 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418225] end connection 172.28.0.164:59651 (352 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418444] end connection 172.28.0.164:61201 (350 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418484] end connection 172.28.0.164:61470 (350 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418136] end connection 172.28.0.164:59096 (350 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418112] end connection 172.28.0.164:58887 (352 connections now open) 2015-10-05T03:00:05.806+0100 [conn1418492] end connection 172.28.0.164:61484 (347 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418210] end connection 172.28.0.164:59580 (343 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418539] end connection 172.28.0.164:61738 (342 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418376] end connection 172.28.0.164:60701 (342 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418346] end connection 172.28.0.164:60515 (340 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418302] end connection 172.28.0.164:60210 (339 connections now open) 2015-10-05T03:00:05.807+0100 [conn1418277] end connection 172.28.0.164:60003 (338 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418409] end connection 172.28.0.164:60952 (337 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418477] end connection 172.28.0.164:61448 (337 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418224] end connection 172.28.0.164:59650 (336 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418485] end connection 172.28.0.164:61471 (334 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418145] end connection 172.28.0.164:59115 (333 connections now open) 2015-10-05T03:00:05.808+0100 [conn1418437] end connection 172.28.0.164:61177 (332 connections now open) 2015-10-05T03:00:05.809+0100 [conn1418244] end connection 172.28.0.164:59739 (331 connections now open) 2015-10-05T03:00:05.818+0100 [conn1418185] end connection 172.28.0.164:59378 (330 connections now open) 2015-10-05T03:00:05.818+0100 [conn1418326] end connection 172.28.0.164:60404 (330 connections now open) 2015-10-05T03:00:05.818+0100 [conn1418217] end connection 172.28.0.164:59636 (328 connections now open) 2015-10-05T03:00:05.818+0100 [conn1418389] end connection 172.28.0.164:60814 (327 connections now open) 2015-10-05T03:00:05.818+0100 [conn1418470] end connection 172.28.0.164:61392 (327 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418250] end connection 172.28.0.164:59799 (325 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418395] end connection 172.28.0.164:60883 (325 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418478] end connection 172.28.0.164:61449 (324 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418458] end connection 172.28.0.164:61256 (322 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418151] end connection 172.28.0.164:59126 (322 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418332] end connection 172.28.0.164:60415 (322 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418088] end connection 172.28.0.164:58813 (322 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418436] end connection 172.28.0.164:61176 (321 connections now open) 2015-10-05T03:00:05.819+0100 [conn1418402] end connection 172.28.0.164:60932 (319 connections now open) 2015-10-05T03:00:05.824+0100 [conn1418414] end connection 172.28.0.164:60963 (316 connections now open) 2015-10-05T03:00:05.824+0100 [conn1418443] end connection 172.28.0.164:61200 (316 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418269] end connection 172.28.0.164:59920 (314 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418190] end connection 172.28.0.164:59389 (314 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418196] end connection 172.28.0.164:59442 (312 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418127] end connection 172.28.0.164:59025 (311 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418216] end connection 172.28.0.164:59635 (310 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418144] end connection 172.28.0.164:59114 (309 connections now open) 2015-10-05T03:00:05.825+0100 [conn1418191] end connection 172.28.0.164:59390 (309 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418172] end connection 172.28.0.164:59299 (307 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418425] end connection 172.28.0.164:61042 (306 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418237] end connection 172.28.0.164:59698 (305 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418173] end connection 172.28.0.164:59300 (305 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418415] end connection 172.28.0.164:60965 (306 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418165] end connection 172.28.0.164:59218 (306 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418197] end connection 172.28.0.164:59443 (305 connections now open) 2015-10-05T03:00:05.826+0100 [conn1418514] end connection 172.28.0.164:61642 (300 connections now open) 2015-10-05T03:00:05.827+0100 [conn1418469] end connection 172.28.0.164:61391 (299 connections now open) 2015-10-05T03:00:05.827+0100 [conn1418424] end connection 172.28.0.164:61041 (298 connections now open) 2015-10-05T03:00:05.827+0100 [conn1418258] end connection 172.28.0.164:59863 (297 connections now open) 2015-10-05T03:00:05.828+0100 [conn1418533] end connection 172.28.0.164:61729 (296 connections now open) 2015-10-05T03:00:05.828+0100 [conn1418457] end connection 172.28.0.164:61255 (295 connections now open) 2015-10-05T03:00:05.828+0100 [conn1418408] end connection 172.28.0.164:60951 (294 connections now open) 2015-10-05T03:00:05.828+0100 [conn1418540] end connection 172.28.0.164:61739 (293 connections now open) 2015-10-05T03:00:05.828+0100 [conn1418319] end connection 172.28.0.164:60388 (293 connections now open) 2015-10-05T03:00:05.829+0100 [conn1418493] end connection 172.28.0.164:61483 (291 connections now open) 2015-10-05T03:00:05.829+0100 [conn1418359] end connection 172.28.0.164:60667 (290 connections now open) 2015-10-05T03:00:05.830+0100 [conn1418097] end connection 172.28.0.164:58833 (289 connections now open) 2015-10-05T03:00:05.830+0100 [conn1418367] end connection 172.28.0.164:60687 (288 connections now open) 2015-10-05T03:00:06.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9a65703b51053ea79bf 2015-10-05T03:00:06.486+0100 [conn1418354] end connection 172.28.0.163:51058 (287 connections now open) 2015-10-05T03:00:06.486+0100 [conn1418219] end connection 172.28.0.163:50049 (287 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418453] end connection 172.28.0.163:51713 (285 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418265] end connection 172.28.0.163:50327 (284 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418212] end connection 172.28.0.163:50004 (283 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418284] end connection 172.28.0.163:50503 (283 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418334] end connection 172.28.0.163:50876 (283 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418534] end connection 172.28.0.163:52240 (283 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418494] end connection 172.28.0.163:52008 (283 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418355] end connection 172.28.0.163:51059 (280 connections now open) 2015-10-05T03:00:06.487+0100 [conn1418107] end connection 172.28.0.163:49360 (280 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418464] end connection 172.28.0.163:51870 (276 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418340] end connection 172.28.0.163:50949 (275 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418502] end connection 172.28.0.163:52069 (275 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418239] end connection 172.28.0.163:50133 (273 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418160] end connection 172.28.0.163:49675 (273 connections now open) 2015-10-05T03:00:06.488+0100 [conn1418348] end connection 172.28.0.163:50998 (273 connections now open) 2015-10-05T03:00:06.489+0100 [conn1418130] end connection 172.28.0.163:49532 (270 connections now open) 2015-10-05T03:00:06.489+0100 [conn1418303] end connection 172.28.0.163:50689 (269 connections now open) 2015-10-05T03:00:06.489+0100 [conn1418473] end connection 172.28.0.163:51925 (269 connections now open) 2015-10-05T03:00:06.489+0100 [conn1418452] end connection 172.28.0.163:51712 (267 connections now open) 2015-10-05T03:00:06.489+0100 [conn1418252] end connection 172.28.0.163:50238 (266 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418138] end connection 172.28.0.163:49568 (265 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418232] end connection 172.28.0.163:50082 (264 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418480] end connection 172.28.0.163:51975 (263 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418459] end connection 172.28.0.163:51782 (262 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418321] end connection 172.28.0.163:50839 (262 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418260] end connection 172.28.0.163:50300 (260 connections now open) 2015-10-05T03:00:06.490+0100 [conn1418253] end connection 172.28.0.163:50239 (259 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418518] end connection 172.28.0.163:52176 (258 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418509] end connection 172.28.0.163:52119 (257 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418270] end connection 172.28.0.163:50341 (256 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418384] end connection 172.28.0.163:51193 (256 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418495] end connection 172.28.0.163:52009 (254 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418078] end connection 172.28.0.163:49221 (253 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418370] end connection 172.28.0.163:51121 (253 connections now open) 2015-10-05T03:00:06.491+0100 [conn1418362] end connection 172.28.0.163:51104 (252 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418178] end connection 172.28.0.163:49819 (250 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418481] end connection 172.28.0.163:51976 (249 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418486] end connection 172.28.0.163:51992 (248 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418426] end connection 172.28.0.163:51515 (248 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418129] end connection 172.28.0.163:49531 (247 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418439] end connection 172.28.0.163:51675 (245 connections now open) 2015-10-05T03:00:06.492+0100 [conn1418397] end connection 172.28.0.163:51333 (244 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418517] end connection 172.28.0.163:52175 (243 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418445] end connection 172.28.0.163:51694 (242 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418419] end connection 172.28.0.163:51461 (242 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418322] end connection 172.28.0.163:50840 (240 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418390] end connection 172.28.0.163:51261 (239 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418139] end connection 172.28.0.163:49569 (239 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418218] end connection 172.28.0.163:50048 (237 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418416] end connection 172.28.0.163:51400 (236 connections now open) 2015-10-05T03:00:06.493+0100 [conn1418391] end connection 172.28.0.163:51262 (236 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418383] end connection 172.28.0.163:51192 (234 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418199] end connection 172.28.0.163:49900 (233 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418487] end connection 172.28.0.163:51994 (232 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418246] end connection 172.28.0.163:50186 (231 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418153] end connection 172.28.0.163:49607 (230 connections now open) 2015-10-05T03:00:06.494+0100 [conn1418120] end connection 172.28.0.163:49470 (229 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418501] end connection 172.28.0.163:52068 (228 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418279] end connection 172.28.0.163:50445 (227 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418233] end connection 172.28.0.163:50083 (226 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418446] end connection 172.28.0.163:51695 (226 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418278] end connection 172.28.0.163:50444 (224 connections now open) 2015-10-05T03:00:06.495+0100 [conn1418167] end connection 172.28.0.163:49729 (223 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418404] end connection 172.28.0.163:51368 (222 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418465] end connection 172.28.0.163:51871 (222 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418238] end connection 172.28.0.163:50132 (220 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418327] end connection 172.28.0.163:50857 (220 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418341] end connection 172.28.0.163:50950 (218 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418058] end connection 172.28.0.163:65443 (217 connections now open) 2015-10-05T03:00:06.496+0100 [conn1418378] end connection 172.28.0.163:51137 (216 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418440] end connection 172.28.0.163:51676 (215 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418295] end connection 172.28.0.163:50611 (214 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418508] end connection 172.28.0.163:52118 (214 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418526] end connection 172.28.0.163:52221 (212 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418289] end connection 172.28.0.163:50588 (211 connections now open) 2015-10-05T03:00:06.497+0100 [conn1418299] end connection 172.28.0.163:50626 (210 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418369] end connection 172.28.0.163:51120 (209 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418361] end connection 172.28.0.163:51103 (209 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418347] end connection 172.28.0.163:50997 (208 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418146] end connection 172.28.0.163:49588 (207 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418328] end connection 172.28.0.163:50858 (206 connections now open) 2015-10-05T03:00:06.498+0100 [conn1418288] end connection 172.28.0.163:50587 (204 connections now open) 2015-10-05T03:00:06.499+0100 [conn1418472] end connection 172.28.0.163:51924 (203 connections now open) 2015-10-05T03:00:06.499+0100 [conn1418541] end connection 172.28.0.163:52261 (202 connections now open) 2015-10-05T03:00:06.499+0100 [conn1418410] end connection 172.28.0.163:51385 (202 connections now open) 2015-10-05T03:00:06.499+0100 [conn1418333] end connection 172.28.0.163:50874 (201 connections now open) 2015-10-05T03:00:06.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:11.684+0100 [conn1418154] end connection 172.28.0.164:59133 (199 connections now open) 2015-10-05T03:00:11.693+0100 [mongosMain] connection accepted from 172.28.0.164:61779 #1418547 (200 connections now open) 2015-10-05T03:00:11.695+0100 [conn1418547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:12.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9ac5703b51053ea79c0 2015-10-05T03:00:13.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:15.273+0100 [conn1418148] end connection 172.28.0.164:59123 (199 connections now open) 2015-10-05T03:00:15.273+0100 [mongosMain] connection accepted from 172.28.0.164:61782 #1418548 (200 connections now open) 2015-10-05T03:00:15.273+0100 [conn1418548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:15.570+0100 [conn1418133] end connection 172.28.0.163:49564 (199 connections now open) 2015-10-05T03:00:15.570+0100 [conn1418156] end connection 172.28.0.163:49643 (198 connections now open) 2015-10-05T03:00:15.570+0100 [mongosMain] connection accepted from 172.28.0.163:52308 #1418549 (199 connections now open) 2015-10-05T03:00:15.570+0100 [mongosMain] connection accepted from 172.28.0.163:52310 #1418550 (200 connections now open) 2015-10-05T03:00:15.570+0100 [conn1418549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:15.570+0100 [conn1418550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:19.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9b35703b51053ea79c2 2015-10-05T03:00:19.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:20.287+0100 [mongosMain] connection accepted from 172.28.0.164:61787 #1418551 (201 connections now open) 2015-10-05T03:00:20.370+0100 [conn1418551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.437+0100 [mongosMain] connection accepted from 172.28.0.164:61789 #1418552 (202 connections now open) 2015-10-05T03:00:20.438+0100 [mongosMain] connection accepted from 172.28.0.164:61791 #1418553 (203 connections now open) 2015-10-05T03:00:20.438+0100 [mongosMain] connection accepted from 172.28.0.164:61790 #1418554 (204 connections now open) 2015-10-05T03:00:20.439+0100 [mongosMain] connection accepted from 172.28.0.164:61792 #1418555 (205 connections now open) 2015-10-05T03:00:20.439+0100 [mongosMain] connection accepted from 172.28.0.164:61793 #1418556 (206 connections now open) 2015-10-05T03:00:20.439+0100 [mongosMain] connection accepted from 172.28.0.164:61794 #1418557 (207 connections now open) 2015-10-05T03:00:20.440+0100 [conn1418553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.440+0100 [mongosMain] connection accepted from 172.28.0.164:61795 #1418558 (208 connections now open) 2015-10-05T03:00:20.440+0100 [mongosMain] connection accepted from 172.28.0.164:61796 #1418559 (209 connections now open) 2015-10-05T03:00:20.440+0100 [conn1418554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.440+0100 [conn1418555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.440+0100 [mongosMain] connection accepted from 172.28.0.164:61797 #1418560 (210 connections now open) 2015-10-05T03:00:20.440+0100 [conn1418556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.441+0100 [mongosMain] connection accepted from 172.28.0.164:61798 #1418561 (211 connections now open) 2015-10-05T03:00:20.441+0100 [mongosMain] connection accepted from 172.28.0.164:61799 #1418562 (212 connections now open) 2015-10-05T03:00:20.441+0100 [conn1418557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.441+0100 [conn1418558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.448+0100 [conn1418552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.449+0100 [conn1418559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.450+0100 [conn1418560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.450+0100 [conn1418561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.452+0100 [mongosMain] connection accepted from 172.28.0.164:61800 #1418563 (213 connections now open) 2015-10-05T03:00:20.452+0100 [mongosMain] connection accepted from 172.28.0.164:61801 #1418564 (214 connections now open) 2015-10-05T03:00:20.452+0100 [mongosMain] connection accepted from 172.28.0.164:61803 #1418565 (215 connections now open) 2015-10-05T03:00:20.453+0100 [mongosMain] connection accepted from 172.28.0.164:61802 #1418566 (216 connections now open) 2015-10-05T03:00:20.454+0100 [conn1418563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.455+0100 [mongosMain] connection accepted from 172.28.0.164:61804 #1418567 (217 connections now open) 2015-10-05T03:00:20.457+0100 [conn1418564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.458+0100 [conn1418566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.458+0100 [conn1418565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.459+0100 [conn1418567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.464+0100 [conn1418562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.474+0100 [mongosMain] connection accepted from 172.28.0.164:61806 #1418568 (218 connections now open) 2015-10-05T03:00:20.474+0100 [mongosMain] connection accepted from 172.28.0.164:61805 #1418569 (219 connections now open) 2015-10-05T03:00:20.475+0100 [mongosMain] connection accepted from 172.28.0.164:61807 #1418570 (220 connections now open) 2015-10-05T03:00:20.475+0100 [mongosMain] connection accepted from 172.28.0.164:61808 #1418571 (221 connections now open) 2015-10-05T03:00:20.475+0100 [conn1418568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.476+0100 [mongosMain] connection accepted from 172.28.0.164:61809 #1418572 (222 connections now open) 2015-10-05T03:00:20.476+0100 [conn1418569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.495+0100 [conn1418572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.495+0100 [conn1418571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.496+0100 [conn1418570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.519+0100 [mongosMain] connection accepted from 172.28.0.164:61822 #1418573 (223 connections now open) 2015-10-05T03:00:20.524+0100 [conn1418573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.549+0100 [mongosMain] connection accepted from 172.28.0.164:61828 #1418574 (224 connections now open) 2015-10-05T03:00:20.550+0100 [mongosMain] connection accepted from 172.28.0.164:61829 #1418575 (225 connections now open) 2015-10-05T03:00:20.551+0100 [conn1418574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.551+0100 [conn1418575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:20.728+0100 [mongosMain] connection accepted from 172.28.0.164:61847 #1418576 (226 connections now open) 2015-10-05T03:00:20.729+0100 [conn1418576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:21.319+0100 [mongosMain] connection accepted from 172.28.0.164:61865 #1418577 (227 connections now open) 2015-10-05T03:00:21.320+0100 [conn1418577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:21.700+0100 [conn1418161] end connection 172.28.0.164:59188 (226 connections now open) 2015-10-05T03:00:21.705+0100 [mongosMain] connection accepted from 172.28.0.164:61868 #1418578 (227 connections now open) 2015-10-05T03:00:21.707+0100 [conn1418578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:25.257+0100 [conn1418132] end connection 172.28.0.164:59083 (226 connections now open) 2015-10-05T03:00:25.258+0100 [mongosMain] connection accepted from 172.28.0.164:61878 #1418579 (227 connections now open) 2015-10-05T03:00:25.260+0100 [conn1418579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:25.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9b95703b51053ea79c4 2015-10-05T03:00:25.526+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:25.538+0100 [conn1418142] end connection 172.28.0.163:49578 (226 connections now open) 2015-10-05T03:00:25.540+0100 [mongosMain] connection accepted from 172.28.0.163:52314 #1418580 (227 connections now open) 2015-10-05T03:00:25.541+0100 [conn1418164] end connection 172.28.0.163:49695 (226 connections now open) 2015-10-05T03:00:25.542+0100 [conn1418580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:25.543+0100 [mongosMain] connection accepted from 172.28.0.163:52316 #1418581 (227 connections now open) 2015-10-05T03:00:25.544+0100 [conn1418581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:27.473+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:00:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:00:28.645+0100 [mongosMain] connection accepted from 127.0.0.1:52318 #1418582 (228 connections now open) 2015-10-05T03:00:28.648+0100 [conn1418582] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:28.653+0100 [conn1418582] end connection 127.0.0.1:52318 (227 connections now open) 2015-10-05T03:00:30.445+0100 [mongosMain] connection accepted from 172.28.0.164:61884 #1418583 (228 connections now open) 2015-10-05T03:00:30.447+0100 [conn1418583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.449+0100 [mongosMain] connection accepted from 172.28.0.164:61885 #1418584 (229 connections now open) 2015-10-05T03:00:30.451+0100 [conn1418584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.453+0100 [mongosMain] connection accepted from 172.28.0.164:61886 #1418585 (230 connections now open) 2015-10-05T03:00:30.454+0100 [conn1418585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.456+0100 [mongosMain] connection accepted from 172.28.0.164:61887 #1418586 (231 connections now open) 2015-10-05T03:00:30.458+0100 [conn1418586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.460+0100 [mongosMain] connection accepted from 172.28.0.164:61888 #1418587 (232 connections now open) 2015-10-05T03:00:30.461+0100 [conn1418587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.463+0100 [mongosMain] connection accepted from 172.28.0.164:61889 #1418588 (233 connections now open) 2015-10-05T03:00:30.464+0100 [conn1418588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.466+0100 [mongosMain] connection accepted from 172.28.0.164:61890 #1418589 (234 connections now open) 2015-10-05T03:00:30.468+0100 [conn1418589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.470+0100 [mongosMain] connection accepted from 172.28.0.164:61891 #1418590 (235 connections now open) 2015-10-05T03:00:30.471+0100 [conn1418590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.473+0100 [mongosMain] connection accepted from 172.28.0.164:61892 #1418591 (236 connections now open) 2015-10-05T03:00:30.475+0100 [conn1418591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.477+0100 [mongosMain] connection accepted from 172.28.0.164:61893 #1418592 (237 connections now open) 2015-10-05T03:00:30.478+0100 [conn1418592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.480+0100 [mongosMain] connection accepted from 172.28.0.164:61894 #1418593 (238 connections now open) 2015-10-05T03:00:30.482+0100 [conn1418593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.483+0100 [mongosMain] connection accepted from 172.28.0.164:61895 #1418594 (239 connections now open) 2015-10-05T03:00:30.485+0100 [conn1418594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.494+0100 [mongosMain] connection accepted from 172.28.0.164:61896 #1418595 (240 connections now open) 2015-10-05T03:00:30.496+0100 [conn1418595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.498+0100 [mongosMain] connection accepted from 172.28.0.164:61897 #1418596 (241 connections now open) 2015-10-05T03:00:30.500+0100 [conn1418596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.501+0100 [mongosMain] connection accepted from 172.28.0.164:61898 #1418597 (242 connections now open) 2015-10-05T03:00:30.503+0100 [conn1418597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.505+0100 [mongosMain] connection accepted from 172.28.0.164:61899 #1418598 (243 connections now open) 2015-10-05T03:00:30.506+0100 [conn1418598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.508+0100 [mongosMain] connection accepted from 172.28.0.164:61900 #1418599 (244 connections now open) 2015-10-05T03:00:30.512+0100 [conn1418599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.514+0100 [mongosMain] connection accepted from 172.28.0.164:61902 #1418600 (245 connections now open) 2015-10-05T03:00:30.515+0100 [conn1418600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.516+0100 [mongosMain] connection accepted from 172.28.0.164:61906 #1418601 (246 connections now open) 2015-10-05T03:00:30.517+0100 [conn1418601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.519+0100 [mongosMain] connection accepted from 172.28.0.164:61909 #1418602 (247 connections now open) 2015-10-05T03:00:30.520+0100 [conn1418602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.521+0100 [mongosMain] connection accepted from 172.28.0.164:61911 #1418603 (248 connections now open) 2015-10-05T03:00:30.522+0100 [conn1418603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.523+0100 [mongosMain] connection accepted from 172.28.0.164:61915 #1418604 (249 connections now open) 2015-10-05T03:00:30.525+0100 [conn1418604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.526+0100 [mongosMain] connection accepted from 172.28.0.164:61918 #1418605 (250 connections now open) 2015-10-05T03:00:30.528+0100 [conn1418605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.529+0100 [mongosMain] connection accepted from 172.28.0.164:61921 #1418606 (251 connections now open) 2015-10-05T03:00:30.531+0100 [conn1418606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.532+0100 [mongosMain] connection accepted from 172.28.0.164:61924 #1418607 (252 connections now open) 2015-10-05T03:00:30.533+0100 [conn1418607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.748+0100 [mongosMain] connection accepted from 172.28.0.164:61939 #1418608 (253 connections now open) 2015-10-05T03:00:30.750+0100 [conn1418608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.751+0100 [mongosMain] connection accepted from 172.28.0.164:61940 #1418609 (254 connections now open) 2015-10-05T03:00:30.753+0100 [conn1418609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.755+0100 [mongosMain] connection accepted from 172.28.0.164:61941 #1418610 (255 connections now open) 2015-10-05T03:00:30.768+0100 [conn1418610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.770+0100 [mongosMain] connection accepted from 172.28.0.164:61942 #1418611 (256 connections now open) 2015-10-05T03:00:30.772+0100 [conn1418611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.774+0100 [mongosMain] connection accepted from 172.28.0.164:61943 #1418612 (257 connections now open) 2015-10-05T03:00:30.775+0100 [conn1418612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.777+0100 [mongosMain] connection accepted from 172.28.0.164:61944 #1418613 (258 connections now open) 2015-10-05T03:00:30.778+0100 [conn1418613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.780+0100 [mongosMain] connection accepted from 172.28.0.164:61947 #1418614 (259 connections now open) 2015-10-05T03:00:30.782+0100 [conn1418614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.783+0100 [mongosMain] connection accepted from 172.28.0.164:61951 #1418615 (260 connections now open) 2015-10-05T03:00:30.785+0100 [conn1418615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.786+0100 [mongosMain] connection accepted from 172.28.0.164:61954 #1418616 (261 connections now open) 2015-10-05T03:00:30.788+0100 [conn1418616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.789+0100 [mongosMain] connection accepted from 172.28.0.164:61958 #1418617 (262 connections now open) 2015-10-05T03:00:30.790+0100 [conn1418617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.792+0100 [mongosMain] connection accepted from 172.28.0.164:61961 #1418618 (263 connections now open) 2015-10-05T03:00:30.793+0100 [conn1418618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.794+0100 [mongosMain] connection accepted from 172.28.0.164:61964 #1418619 (264 connections now open) 2015-10-05T03:00:30.796+0100 [conn1418619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.797+0100 [mongosMain] connection accepted from 172.28.0.164:61967 #1418620 (265 connections now open) 2015-10-05T03:00:30.799+0100 [conn1418620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.803+0100 [mongosMain] connection accepted from 172.28.0.164:61974 #1418621 (266 connections now open) 2015-10-05T03:00:30.805+0100 [conn1418621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.806+0100 [mongosMain] connection accepted from 172.28.0.164:61977 #1418622 (267 connections now open) 2015-10-05T03:00:30.808+0100 [conn1418622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.809+0100 [mongosMain] connection accepted from 172.28.0.164:61980 #1418623 (268 connections now open) 2015-10-05T03:00:30.811+0100 [conn1418623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.813+0100 [mongosMain] connection accepted from 172.28.0.164:61983 #1418624 (269 connections now open) 2015-10-05T03:00:30.814+0100 [conn1418624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.815+0100 [mongosMain] connection accepted from 172.28.0.164:61985 #1418625 (270 connections now open) 2015-10-05T03:00:30.817+0100 [conn1418625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.818+0100 [mongosMain] connection accepted from 172.28.0.164:61988 #1418626 (271 connections now open) 2015-10-05T03:00:30.819+0100 [conn1418626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.821+0100 [mongosMain] connection accepted from 172.28.0.164:61991 #1418627 (272 connections now open) 2015-10-05T03:00:30.826+0100 [conn1418627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.828+0100 [mongosMain] connection accepted from 172.28.0.164:61997 #1418628 (273 connections now open) 2015-10-05T03:00:30.829+0100 [conn1418628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.831+0100 [mongosMain] connection accepted from 172.28.0.164:62000 #1418629 (274 connections now open) 2015-10-05T03:00:30.832+0100 [conn1418629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.834+0100 [mongosMain] connection accepted from 172.28.0.164:62003 #1418630 (275 connections now open) 2015-10-05T03:00:30.837+0100 [conn1418630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.838+0100 [mongosMain] connection accepted from 172.28.0.164:62007 #1418631 (276 connections now open) 2015-10-05T03:00:30.840+0100 [conn1418631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.841+0100 [mongosMain] connection accepted from 172.28.0.164:62011 #1418632 (277 connections now open) 2015-10-05T03:00:30.843+0100 [conn1418632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.844+0100 [mongosMain] connection accepted from 172.28.0.164:62013 #1418633 (278 connections now open) 2015-10-05T03:00:30.846+0100 [conn1418633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.847+0100 [mongosMain] connection accepted from 172.28.0.164:62014 #1418634 (279 connections now open) 2015-10-05T03:00:30.848+0100 [conn1418634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.850+0100 [mongosMain] connection accepted from 172.28.0.164:62015 #1418635 (280 connections now open) 2015-10-05T03:00:30.851+0100 [conn1418635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.853+0100 [mongosMain] connection accepted from 172.28.0.164:62016 #1418636 (281 connections now open) 2015-10-05T03:00:30.854+0100 [conn1418636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.856+0100 [mongosMain] connection accepted from 172.28.0.164:62017 #1418637 (282 connections now open) 2015-10-05T03:00:30.857+0100 [conn1418637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.859+0100 [mongosMain] connection accepted from 172.28.0.164:62018 #1418638 (283 connections now open) 2015-10-05T03:00:30.861+0100 [conn1418638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.862+0100 [mongosMain] connection accepted from 172.28.0.164:62019 #1418639 (284 connections now open) 2015-10-05T03:00:30.864+0100 [conn1418639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.865+0100 [mongosMain] connection accepted from 172.28.0.164:62020 #1418640 (285 connections now open) 2015-10-05T03:00:30.867+0100 [conn1418640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.869+0100 [mongosMain] connection accepted from 172.28.0.164:62021 #1418641 (286 connections now open) 2015-10-05T03:00:30.871+0100 [conn1418641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.872+0100 [mongosMain] connection accepted from 172.28.0.164:62022 #1418642 (287 connections now open) 2015-10-05T03:00:30.874+0100 [conn1418642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.876+0100 [mongosMain] connection accepted from 172.28.0.164:62023 #1418643 (288 connections now open) 2015-10-05T03:00:30.877+0100 [conn1418643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.879+0100 [mongosMain] connection accepted from 172.28.0.164:62024 #1418644 (289 connections now open) 2015-10-05T03:00:30.880+0100 [conn1418644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.882+0100 [mongosMain] connection accepted from 172.28.0.164:62025 #1418645 (290 connections now open) 2015-10-05T03:00:30.883+0100 [conn1418645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.885+0100 [mongosMain] connection accepted from 172.28.0.164:62026 #1418646 (291 connections now open) 2015-10-05T03:00:30.886+0100 [conn1418646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.888+0100 [mongosMain] connection accepted from 172.28.0.164:62027 #1418647 (292 connections now open) 2015-10-05T03:00:30.890+0100 [conn1418647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.893+0100 [mongosMain] connection accepted from 172.28.0.164:62028 #1418648 (293 connections now open) 2015-10-05T03:00:30.895+0100 [conn1418648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.897+0100 [mongosMain] connection accepted from 172.28.0.164:62029 #1418649 (294 connections now open) 2015-10-05T03:00:30.898+0100 [conn1418649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.900+0100 [mongosMain] connection accepted from 172.28.0.164:62030 #1418650 (295 connections now open) 2015-10-05T03:00:30.901+0100 [conn1418650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.902+0100 [mongosMain] connection accepted from 172.28.0.164:62031 #1418651 (296 connections now open) 2015-10-05T03:00:30.904+0100 [conn1418651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.905+0100 [mongosMain] connection accepted from 172.28.0.164:62032 #1418652 (297 connections now open) 2015-10-05T03:00:30.907+0100 [conn1418652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.909+0100 [mongosMain] connection accepted from 172.28.0.164:62033 #1418653 (298 connections now open) 2015-10-05T03:00:30.911+0100 [conn1418653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.913+0100 [mongosMain] connection accepted from 172.28.0.164:62034 #1418654 (299 connections now open) 2015-10-05T03:00:30.914+0100 [conn1418654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:30.916+0100 [mongosMain] connection accepted from 172.28.0.164:62035 #1418655 (300 connections now open) 2015-10-05T03:00:30.918+0100 [conn1418655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.450+0100 [mongosMain] connection accepted from 172.28.0.163:52322 #1418656 (301 connections now open) 2015-10-05T03:00:31.593+0100 [conn1418656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.687+0100 [mongosMain] connection accepted from 172.28.0.163:52323 #1418657 (302 connections now open) 2015-10-05T03:00:31.688+0100 [mongosMain] connection accepted from 172.28.0.163:52324 #1418658 (303 connections now open) 2015-10-05T03:00:31.688+0100 [conn1418657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.706+0100 [conn1418658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9bf5703b51053ea79c7 2015-10-05T03:00:31.707+0100 [mongosMain] connection accepted from 172.28.0.163:52325 #1418659 (304 connections now open) 2015-10-05T03:00:31.708+0100 [mongosMain] connection accepted from 172.28.0.163:52326 #1418660 (305 connections now open) 2015-10-05T03:00:31.708+0100 [mongosMain] connection accepted from 172.28.0.163:52327 #1418661 (306 connections now open) 2015-10-05T03:00:31.708+0100 [mongosMain] connection accepted from 172.28.0.163:52328 #1418662 (307 connections now open) 2015-10-05T03:00:31.709+0100 [mongosMain] connection accepted from 172.28.0.163:52329 #1418663 (308 connections now open) 2015-10-05T03:00:31.709+0100 [conn1418659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.709+0100 [mongosMain] connection accepted from 172.28.0.163:52330 #1418664 (309 connections now open) 2015-10-05T03:00:31.710+0100 [mongosMain] connection accepted from 172.28.0.163:52331 #1418665 (310 connections now open) 2015-10-05T03:00:31.710+0100 [mongosMain] connection accepted from 172.28.0.163:52332 #1418666 (311 connections now open) 2015-10-05T03:00:31.710+0100 [conn1418660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.710+0100 [mongosMain] connection accepted from 172.28.0.163:52333 #1418667 (312 connections now open) 2015-10-05T03:00:31.710+0100 [mongosMain] connection accepted from 172.28.0.163:52334 #1418668 (313 connections now open) 2015-10-05T03:00:31.711+0100 [conn1418664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.711+0100 [conn1418666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.712+0100 [conn1418662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.712+0100 [conn1418663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.712+0100 [conn1418668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.713+0100 [conn1418665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.729+0100 [mongosMain] connection accepted from 172.28.0.163:52335 #1418669 (314 connections now open) 2015-10-05T03:00:31.729+0100 [mongosMain] connection accepted from 172.28.0.163:52336 #1418670 (315 connections now open) 2015-10-05T03:00:31.729+0100 [conn1418669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.730+0100 [mongosMain] connection accepted from 172.28.0.163:52337 #1418671 (316 connections now open) 2015-10-05T03:00:31.730+0100 [mongosMain] connection accepted from 172.28.0.163:52338 #1418672 (317 connections now open) 2015-10-05T03:00:31.730+0100 [mongosMain] connection accepted from 172.28.0.163:52339 #1418673 (318 connections now open) 2015-10-05T03:00:31.731+0100 [mongosMain] connection accepted from 172.28.0.163:52340 #1418674 (319 connections now open) 2015-10-05T03:00:31.731+0100 [conn1418671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.731+0100 [mongosMain] connection accepted from 172.28.0.163:52341 #1418675 (320 connections now open) 2015-10-05T03:00:31.731+0100 [conn1418672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.731+0100 [mongosMain] connection accepted from 172.28.0.163:52342 #1418676 (321 connections now open) 2015-10-05T03:00:31.731+0100 [conn1418670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.731+0100 [mongosMain] connection accepted from 172.28.0.163:52343 #1418677 (322 connections now open) 2015-10-05T03:00:31.732+0100 [conn1418677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.732+0100 [conn1418675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.733+0100 [conn1418674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.733+0100 [conn1418676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.736+0100 [conn1418667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.736+0100 [mongosMain] connection accepted from 172.28.0.163:52345 #1418678 (323 connections now open) 2015-10-05T03:00:31.736+0100 [mongosMain] connection accepted from 172.28.0.163:52346 #1418679 (324 connections now open) 2015-10-05T03:00:31.737+0100 [mongosMain] connection accepted from 172.28.0.163:52347 #1418680 (325 connections now open) 2015-10-05T03:00:31.737+0100 [mongosMain] connection accepted from 172.28.0.163:52348 #1418681 (326 connections now open) 2015-10-05T03:00:31.737+0100 [mongosMain] connection accepted from 172.28.0.163:52349 #1418682 (327 connections now open) 2015-10-05T03:00:31.738+0100 [mongosMain] connection accepted from 172.28.0.163:52351 #1418683 (328 connections now open) 2015-10-05T03:00:31.739+0100 [conn1418678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.742+0100 [conn1418683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.743+0100 [conn1418679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.743+0100 [conn1418673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.746+0100 [conn1418661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.747+0100 [conn1418680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.748+0100 [conn1418682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.751+0100 [mongosMain] connection accepted from 172.28.0.163:52355 #1418684 (329 connections now open) 2015-10-05T03:00:31.751+0100 [mongosMain] connection accepted from 172.28.0.163:52356 #1418685 (330 connections now open) 2015-10-05T03:00:31.752+0100 [mongosMain] connection accepted from 172.28.0.163:52359 #1418686 (331 connections now open) 2015-10-05T03:00:31.752+0100 [mongosMain] connection accepted from 172.28.0.163:52360 #1418687 (332 connections now open) 2015-10-05T03:00:31.752+0100 [mongosMain] connection accepted from 172.28.0.163:52361 #1418688 (333 connections now open) 2015-10-05T03:00:31.752+0100 [conn1418685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.752+0100 [conn1418684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.753+0100 [mongosMain] connection accepted from 172.28.0.163:52362 #1418689 (334 connections now open) 2015-10-05T03:00:31.753+0100 [conn1418686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.753+0100 [mongosMain] connection accepted from 172.28.0.163:52363 #1418690 (335 connections now open) 2015-10-05T03:00:31.753+0100 [conn1418687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.753+0100 [conn1418689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.754+0100 [conn1418688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.754+0100 [conn1418681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.755+0100 [conn1418690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.761+0100 [mongosMain] connection accepted from 172.28.0.163:52364 #1418691 (336 connections now open) 2015-10-05T03:00:31.761+0100 [mongosMain] connection accepted from 172.28.0.163:52366 #1418692 (337 connections now open) 2015-10-05T03:00:31.762+0100 [conn1418691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.762+0100 [conn1418692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:31.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:32.592+0100 [mongosMain] connection accepted from 172.28.0.163:52428 #1418693 (338 connections now open) 2015-10-05T03:00:32.613+0100 [mongosMain] connection accepted from 172.28.0.163:52429 #1418694 (339 connections now open) 2015-10-05T03:00:32.716+0100 [conn1418693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:32.735+0100 [conn1418694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:35.272+0100 [conn1418101] end connection 172.28.0.164:58843 (338 connections now open) 2015-10-05T03:00:35.273+0100 [mongosMain] connection accepted from 172.28.0.164:62043 #1418695 (339 connections now open) 2015-10-05T03:00:35.277+0100 [conn1418695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:35.557+0100 [conn1418170] end connection 172.28.0.163:49759 (338 connections now open) 2015-10-05T03:00:35.559+0100 [conn1418150] end connection 172.28.0.163:49597 (337 connections now open) 2015-10-05T03:00:35.566+0100 [mongosMain] connection accepted from 172.28.0.163:52441 #1418696 (338 connections now open) 2015-10-05T03:00:35.566+0100 [mongosMain] connection accepted from 172.28.0.163:52442 #1418697 (339 connections now open) 2015-10-05T03:00:35.567+0100 [conn1418696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:35.570+0100 [conn1418697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:35.891+0100 [mongosMain] connection accepted from 172.28.0.163:52446 #1418698 (340 connections now open) 2015-10-05T03:00:35.903+0100 [conn1418698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:37.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9c55703b51053ea79cb 2015-10-05T03:00:38.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:39.967+0100 [mongosMain] connection accepted from 127.0.0.1:52465 #1418699 (341 connections now open) 2015-10-05T03:00:39.969+0100 [conn1418699] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:39.974+0100 [conn1418699] end connection 127.0.0.1:52465 (340 connections now open) 2015-10-05T03:00:41.714+0100 [conn1418168] end connection 172.28.0.164:59250 (339 connections now open) 2015-10-05T03:00:41.715+0100 [mongosMain] connection accepted from 172.28.0.163:52483 #1418700 (340 connections now open) 2015-10-05T03:00:41.715+0100 [mongosMain] connection accepted from 172.28.0.164:62082 #1418701 (341 connections now open) 2015-10-05T03:00:41.716+0100 [conn1418700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.717+0100 [conn1418701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.717+0100 [mongosMain] connection accepted from 172.28.0.163:52484 #1418702 (342 connections now open) 2015-10-05T03:00:41.718+0100 [conn1418702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.719+0100 [mongosMain] connection accepted from 172.28.0.163:52485 #1418703 (343 connections now open) 2015-10-05T03:00:41.719+0100 [conn1418703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.720+0100 [mongosMain] connection accepted from 172.28.0.163:52486 #1418704 (344 connections now open) 2015-10-05T03:00:41.721+0100 [conn1418704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.722+0100 [mongosMain] connection accepted from 172.28.0.163:52487 #1418705 (345 connections now open) 2015-10-05T03:00:41.723+0100 [conn1418705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.724+0100 [mongosMain] connection accepted from 172.28.0.163:52488 #1418706 (346 connections now open) 2015-10-05T03:00:41.725+0100 [conn1418706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.726+0100 [mongosMain] connection accepted from 172.28.0.163:52489 #1418707 (347 connections now open) 2015-10-05T03:00:41.726+0100 [conn1418707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.727+0100 [mongosMain] connection accepted from 172.28.0.163:52490 #1418708 (348 connections now open) 2015-10-05T03:00:41.728+0100 [conn1418708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.729+0100 [mongosMain] connection accepted from 172.28.0.163:52491 #1418709 (349 connections now open) 2015-10-05T03:00:41.730+0100 [conn1418709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.731+0100 [mongosMain] connection accepted from 172.28.0.163:52492 #1418710 (350 connections now open) 2015-10-05T03:00:41.731+0100 [conn1418710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.732+0100 [mongosMain] connection accepted from 172.28.0.163:52493 #1418711 (351 connections now open) 2015-10-05T03:00:41.733+0100 [conn1418711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.734+0100 [mongosMain] connection accepted from 172.28.0.163:52494 #1418712 (352 connections now open) 2015-10-05T03:00:41.735+0100 [conn1418712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.736+0100 [mongosMain] connection accepted from 172.28.0.163:52495 #1418713 (353 connections now open) 2015-10-05T03:00:41.737+0100 [conn1418713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.738+0100 [mongosMain] connection accepted from 172.28.0.163:52496 #1418714 (354 connections now open) 2015-10-05T03:00:41.738+0100 [conn1418714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.746+0100 [mongosMain] connection accepted from 172.28.0.163:52497 #1418715 (355 connections now open) 2015-10-05T03:00:41.747+0100 [conn1418715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.748+0100 [mongosMain] connection accepted from 172.28.0.163:52499 #1418716 (356 connections now open) 2015-10-05T03:00:41.748+0100 [conn1418716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.749+0100 [mongosMain] connection accepted from 172.28.0.163:52500 #1418717 (357 connections now open) 2015-10-05T03:00:41.750+0100 [conn1418717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.750+0100 [mongosMain] connection accepted from 172.28.0.163:52502 #1418718 (358 connections now open) 2015-10-05T03:00:41.751+0100 [conn1418718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.752+0100 [mongosMain] connection accepted from 172.28.0.163:52503 #1418719 (359 connections now open) 2015-10-05T03:00:41.752+0100 [conn1418719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.753+0100 [mongosMain] connection accepted from 172.28.0.163:52505 #1418720 (360 connections now open) 2015-10-05T03:00:41.754+0100 [conn1418720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.754+0100 [mongosMain] connection accepted from 172.28.0.163:52506 #1418721 (361 connections now open) 2015-10-05T03:00:41.755+0100 [conn1418721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.756+0100 [mongosMain] connection accepted from 172.28.0.163:52507 #1418722 (362 connections now open) 2015-10-05T03:00:41.757+0100 [conn1418722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.757+0100 [mongosMain] connection accepted from 172.28.0.163:52509 #1418723 (363 connections now open) 2015-10-05T03:00:41.758+0100 [conn1418723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.759+0100 [mongosMain] connection accepted from 172.28.0.163:52511 #1418724 (364 connections now open) 2015-10-05T03:00:41.760+0100 [conn1418724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.760+0100 [mongosMain] connection accepted from 172.28.0.163:52512 #1418725 (365 connections now open) 2015-10-05T03:00:41.761+0100 [conn1418725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.762+0100 [mongosMain] connection accepted from 172.28.0.163:52514 #1418726 (366 connections now open) 2015-10-05T03:00:41.763+0100 [conn1418726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.764+0100 [mongosMain] connection accepted from 172.28.0.163:52516 #1418727 (367 connections now open) 2015-10-05T03:00:41.764+0100 [conn1418727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.765+0100 [mongosMain] connection accepted from 172.28.0.163:52518 #1418728 (368 connections now open) 2015-10-05T03:00:41.766+0100 [conn1418728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.767+0100 [mongosMain] connection accepted from 172.28.0.163:52520 #1418729 (369 connections now open) 2015-10-05T03:00:41.768+0100 [conn1418729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.769+0100 [mongosMain] connection accepted from 172.28.0.163:52522 #1418730 (370 connections now open) 2015-10-05T03:00:41.770+0100 [conn1418730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.771+0100 [mongosMain] connection accepted from 172.28.0.163:52525 #1418731 (371 connections now open) 2015-10-05T03:00:41.771+0100 [conn1418731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.772+0100 [mongosMain] connection accepted from 172.28.0.163:52526 #1418732 (372 connections now open) 2015-10-05T03:00:41.773+0100 [conn1418732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.774+0100 [mongosMain] connection accepted from 172.28.0.163:52529 #1418733 (373 connections now open) 2015-10-05T03:00:41.775+0100 [conn1418733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.777+0100 [mongosMain] connection accepted from 172.28.0.163:52532 #1418734 (374 connections now open) 2015-10-05T03:00:41.781+0100 [conn1418734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.782+0100 [mongosMain] connection accepted from 172.28.0.163:52535 #1418735 (375 connections now open) 2015-10-05T03:00:41.782+0100 [conn1418735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.783+0100 [mongosMain] connection accepted from 172.28.0.163:52536 #1418736 (376 connections now open) 2015-10-05T03:00:41.784+0100 [conn1418736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.785+0100 [mongosMain] connection accepted from 172.28.0.163:52539 #1418737 (377 connections now open) 2015-10-05T03:00:41.785+0100 [conn1418737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.786+0100 [mongosMain] connection accepted from 172.28.0.163:52540 #1418738 (378 connections now open) 2015-10-05T03:00:41.787+0100 [conn1418738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.788+0100 [mongosMain] connection accepted from 172.28.0.163:52544 #1418739 (379 connections now open) 2015-10-05T03:00:41.789+0100 [conn1418739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.789+0100 [mongosMain] connection accepted from 172.28.0.163:52545 #1418740 (380 connections now open) 2015-10-05T03:00:41.790+0100 [conn1418740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.791+0100 [mongosMain] connection accepted from 172.28.0.163:52548 #1418741 (381 connections now open) 2015-10-05T03:00:41.792+0100 [conn1418741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.792+0100 [mongosMain] connection accepted from 172.28.0.163:52549 #1418742 (382 connections now open) 2015-10-05T03:00:41.793+0100 [conn1418742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.794+0100 [mongosMain] connection accepted from 172.28.0.163:52552 #1418743 (383 connections now open) 2015-10-05T03:00:41.795+0100 [conn1418743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.795+0100 [mongosMain] connection accepted from 172.28.0.163:52553 #1418744 (384 connections now open) 2015-10-05T03:00:41.796+0100 [conn1418744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.797+0100 [mongosMain] connection accepted from 172.28.0.163:52555 #1418745 (385 connections now open) 2015-10-05T03:00:41.798+0100 [conn1418745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.798+0100 [mongosMain] connection accepted from 172.28.0.163:52557 #1418746 (386 connections now open) 2015-10-05T03:00:41.799+0100 [conn1418746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.800+0100 [mongosMain] connection accepted from 172.28.0.163:52558 #1418747 (387 connections now open) 2015-10-05T03:00:41.801+0100 [conn1418747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.802+0100 [mongosMain] connection accepted from 172.28.0.163:52560 #1418748 (388 connections now open) 2015-10-05T03:00:41.802+0100 [conn1418748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.803+0100 [mongosMain] connection accepted from 172.28.0.163:52561 #1418749 (389 connections now open) 2015-10-05T03:00:41.804+0100 [conn1418749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.805+0100 [mongosMain] connection accepted from 172.28.0.163:52563 #1418750 (390 connections now open) 2015-10-05T03:00:41.806+0100 [conn1418750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.806+0100 [mongosMain] connection accepted from 172.28.0.163:52564 #1418751 (391 connections now open) 2015-10-05T03:00:41.807+0100 [conn1418751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.808+0100 [mongosMain] connection accepted from 172.28.0.163:52566 #1418752 (392 connections now open) 2015-10-05T03:00:41.809+0100 [conn1418752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.810+0100 [mongosMain] connection accepted from 172.28.0.163:52567 #1418753 (393 connections now open) 2015-10-05T03:00:41.811+0100 [conn1418753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.811+0100 [mongosMain] connection accepted from 172.28.0.163:52569 #1418754 (394 connections now open) 2015-10-05T03:00:41.812+0100 [conn1418754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.813+0100 [mongosMain] connection accepted from 172.28.0.163:52571 #1418755 (395 connections now open) 2015-10-05T03:00:41.814+0100 [conn1418755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.815+0100 [mongosMain] connection accepted from 172.28.0.163:52572 #1418756 (396 connections now open) 2015-10-05T03:00:41.816+0100 [conn1418756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.817+0100 [mongosMain] connection accepted from 172.28.0.163:52574 #1418757 (397 connections now open) 2015-10-05T03:00:41.818+0100 [conn1418757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.818+0100 [mongosMain] connection accepted from 172.28.0.163:52575 #1418758 (398 connections now open) 2015-10-05T03:00:41.819+0100 [conn1418758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.820+0100 [mongosMain] connection accepted from 172.28.0.163:52577 #1418759 (399 connections now open) 2015-10-05T03:00:41.821+0100 [conn1418759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:41.822+0100 [mongosMain] connection accepted from 172.28.0.163:52578 #1418760 (400 connections now open) 2015-10-05T03:00:41.823+0100 [conn1418760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:44.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9cc5703b51053ea79cf 2015-10-05T03:00:44.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:45.272+0100 [conn1418141] end connection 172.28.0.164:59108 (399 connections now open) 2015-10-05T03:00:45.273+0100 [mongosMain] connection accepted from 172.28.0.164:62098 #1418761 (400 connections now open) 2015-10-05T03:00:45.274+0100 [conn1418761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:45.555+0100 [conn1418176] end connection 172.28.0.163:49805 (399 connections now open) 2015-10-05T03:00:45.555+0100 [conn1418157] end connection 172.28.0.163:49644 (398 connections now open) 2015-10-05T03:00:45.556+0100 [mongosMain] connection accepted from 172.28.0.163:52638 #1418762 (399 connections now open) 2015-10-05T03:00:45.557+0100 [mongosMain] connection accepted from 172.28.0.163:52639 #1418763 (400 connections now open) 2015-10-05T03:00:45.557+0100 [conn1418762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:45.557+0100 [conn1418763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:50.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9d25703b51053ea79d1 2015-10-05T03:00:50.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:00:51.731+0100 [conn1418180] end connection 172.28.0.164:59365 (399 connections now open) 2015-10-05T03:00:51.732+0100 [mongosMain] connection accepted from 172.28.0.164:62130 #1418764 (400 connections now open) 2015-10-05T03:00:51.734+0100 [conn1418764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:55.272+0100 [conn1418155] end connection 172.28.0.164:59150 (399 connections now open) 2015-10-05T03:00:55.275+0100 [mongosMain] connection accepted from 172.28.0.164:62147 #1418765 (400 connections now open) 2015-10-05T03:00:55.277+0100 [conn1418765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:55.570+0100 [conn1418177] end connection 172.28.0.163:49806 (399 connections now open) 2015-10-05T03:00:55.570+0100 [conn1418183] end connection 172.28.0.163:49831 (399 connections now open) 2015-10-05T03:00:55.572+0100 [mongosMain] connection accepted from 172.28.0.163:52692 #1418766 (399 connections now open) 2015-10-05T03:00:55.572+0100 [mongosMain] connection accepted from 172.28.0.163:52693 #1418767 (400 connections now open) 2015-10-05T03:00:55.572+0100 [conn1418766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:55.573+0100 [conn1418767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:00:57.192+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:00:57.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:00:57.739+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:00:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:01:01.730+0100 [conn1418186] end connection 172.28.0.164:59381 (399 connections now open) 2015-10-05T03:01:01.731+0100 [mongosMain] connection accepted from 172.28.0.164:62161 #1418768 (400 connections now open) 2015-10-05T03:01:01.732+0100 [conn1418768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:05.288+0100 [conn1418162] end connection 172.28.0.164:59207 (399 connections now open) 2015-10-05T03:01:05.289+0100 [mongosMain] connection accepted from 172.28.0.164:62181 #1418769 (400 connections now open) 2015-10-05T03:01:05.291+0100 [conn1418769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:05.570+0100 [conn1418171] end connection 172.28.0.163:49760 (399 connections now open) 2015-10-05T03:01:05.571+0100 [conn1418189] end connection 172.28.0.163:49845 (399 connections now open) 2015-10-05T03:01:05.572+0100 [mongosMain] connection accepted from 172.28.0.163:52739 #1418770 (399 connections now open) 2015-10-05T03:01:05.572+0100 [mongosMain] connection accepted from 172.28.0.163:52741 #1418771 (400 connections now open) 2015-10-05T03:01:05.572+0100 [conn1418770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:05.573+0100 [conn1418771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:09.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9e55703b51053ea79e2 2015-10-05T03:01:09.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:11.746+0100 [conn1418192] end connection 172.28.0.164:59395 (399 connections now open) 2015-10-05T03:01:11.747+0100 [mongosMain] connection accepted from 172.28.0.164:62213 #1418772 (400 connections now open) 2015-10-05T03:01:11.748+0100 [conn1418772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:15.584+0100 [conn1418195] end connection 172.28.0.163:49878 (399 connections now open) 2015-10-05T03:01:15.585+0100 [conn1418163] end connection 172.28.0.163:49694 (398 connections now open) 2015-10-05T03:01:15.585+0100 [mongosMain] connection accepted from 172.28.0.163:52816 #1418773 (399 connections now open) 2015-10-05T03:01:15.585+0100 [mongosMain] connection accepted from 172.28.0.163:52817 #1418774 (400 connections now open) 2015-10-05T03:01:15.586+0100 [conn1418773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:15.586+0100 [conn1418774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:21.762+0100 [conn1418200] end connection 172.28.0.164:59465 (399 connections now open) 2015-10-05T03:01:21.764+0100 [mongosMain] connection accepted from 172.28.0.164:62254 #1418775 (400 connections now open) 2015-10-05T03:01:21.765+0100 [conn1418775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:21.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9f15703b51053ea7b60 2015-10-05T03:01:22.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:25.587+0100 [conn1418202] end connection 172.28.0.163:49922 (399 connections now open) 2015-10-05T03:01:25.588+0100 [mongosMain] connection accepted from 172.28.0.163:52861 #1418776 (400 connections now open) 2015-10-05T03:01:25.589+0100 [conn1418776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:27.995+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:01:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:01:28.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9f85703b51053ea7cac 2015-10-05T03:01:28.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:28.952+0100 [mongosMain] connection accepted from 127.0.0.1:52877 #1418777 (401 connections now open) 2015-10-05T03:01:28.954+0100 [conn1418777] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:28.960+0100 [conn1418777] end connection 127.0.0.1:52877 (400 connections now open) 2015-10-05T03:01:34.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611d9fe5703b51053ea7dd9 2015-10-05T03:01:34.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:35.601+0100 [conn1418182] end connection 172.28.0.163:49830 (399 connections now open) 2015-10-05T03:01:35.601+0100 [conn1418207] end connection 172.28.0.163:49980 (399 connections now open) 2015-10-05T03:01:35.602+0100 [mongosMain] connection accepted from 172.28.0.163:52919 #1418778 (399 connections now open) 2015-10-05T03:01:35.602+0100 [mongosMain] connection accepted from 172.28.0.163:52920 #1418779 (400 connections now open) 2015-10-05T03:01:35.603+0100 [conn1418778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:35.603+0100 [conn1418779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:39.292+0100 [mongosMain] connection accepted from 127.0.0.1:52945 #1418780 (401 connections now open) 2015-10-05T03:01:39.295+0100 [conn1418780] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:39.298+0100 [conn1418780] end connection 127.0.0.1:52945 (400 connections now open) 2015-10-05T03:01:41.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da045703b51053ea7f00 2015-10-05T03:01:41.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:45.617+0100 [conn1418188] end connection 172.28.0.163:49844 (399 connections now open) 2015-10-05T03:01:45.618+0100 [conn1418215] end connection 172.28.0.163:50038 (398 connections now open) 2015-10-05T03:01:45.619+0100 [mongosMain] connection accepted from 172.28.0.163:52985 #1418781 (399 connections now open) 2015-10-05T03:01:45.619+0100 [mongosMain] connection accepted from 172.28.0.163:52986 #1418782 (400 connections now open) 2015-10-05T03:01:45.620+0100 [conn1418781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:45.620+0100 [conn1418782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:48.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da0b5703b51053ea801b 2015-10-05T03:01:48.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:01:55.336+0100 [conn1418206] end connection 172.28.0.164:59554 (399 connections now open) 2015-10-05T03:01:55.337+0100 [mongosMain] connection accepted from 172.28.0.164:62441 #1418783 (400 connections now open) 2015-10-05T03:01:55.339+0100 [conn1418783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:55.618+0100 [conn1418223] end connection 172.28.0.163:50059 (399 connections now open) 2015-10-05T03:01:55.619+0100 [conn1418208] end connection 172.28.0.163:49981 (398 connections now open) 2015-10-05T03:01:55.620+0100 [mongosMain] connection accepted from 172.28.0.163:53034 #1418784 (399 connections now open) 2015-10-05T03:01:55.620+0100 [mongosMain] connection accepted from 172.28.0.163:53035 #1418785 (400 connections now open) 2015-10-05T03:01:55.621+0100 [conn1418784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:55.621+0100 [conn1418785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:01:58.160+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:01:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:02:01.809+0100 [conn1418205] end connection 172.28.0.164:59523 (399 connections now open) 2015-10-05T03:02:01.811+0100 [mongosMain] connection accepted from 172.28.0.164:62455 #1418786 (400 connections now open) 2015-10-05T03:02:01.812+0100 [conn1418786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:05.336+0100 [conn1418213] end connection 172.28.0.164:59620 (399 connections now open) 2015-10-05T03:02:05.337+0100 [mongosMain] connection accepted from 172.28.0.164:62472 #1418787 (400 connections now open) 2015-10-05T03:02:05.338+0100 [conn1418787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:05.633+0100 [conn1418194] end connection 172.28.0.163:49877 (399 connections now open) 2015-10-05T03:02:05.633+0100 [conn1418230] end connection 172.28.0.163:50074 (399 connections now open) 2015-10-05T03:02:05.634+0100 [mongosMain] connection accepted from 172.28.0.163:53085 #1418788 (399 connections now open) 2015-10-05T03:02:05.634+0100 [mongosMain] connection accepted from 172.28.0.163:53086 #1418789 (400 connections now open) 2015-10-05T03:02:05.635+0100 [conn1418788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:05.635+0100 [conn1418789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:07.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da1e5703b51053ea8357 2015-10-05T03:02:07.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:11.825+0100 [conn1418234] end connection 172.28.0.164:59665 (399 connections now open) 2015-10-05T03:02:11.826+0100 [mongosMain] connection accepted from 172.28.0.164:62508 #1418790 (400 connections now open) 2015-10-05T03:02:11.828+0100 [conn1418790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:15.351+0100 [conn1418169] end connection 172.28.0.164:59277 (399 connections now open) 2015-10-05T03:02:15.352+0100 [mongosMain] connection accepted from 172.28.0.164:62526 #1418791 (400 connections now open) 2015-10-05T03:02:15.353+0100 [conn1418791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:15.633+0100 [conn1418236] end connection 172.28.0.163:50104 (399 connections now open) 2015-10-05T03:02:15.633+0100 [conn1418203] end connection 172.28.0.163:49923 (399 connections now open) 2015-10-05T03:02:15.634+0100 [mongosMain] connection accepted from 172.28.0.163:53138 #1418792 (399 connections now open) 2015-10-05T03:02:15.634+0100 [mongosMain] connection accepted from 172.28.0.163:53139 #1418793 (400 connections now open) 2015-10-05T03:02:15.635+0100 [conn1418792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:15.635+0100 [conn1418793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:19.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da2b5703b51053ea8525 2015-10-05T03:02:19.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:21.825+0100 [conn1418240] end connection 172.28.0.164:59713 (399 connections now open) 2015-10-05T03:02:21.827+0100 [mongosMain] connection accepted from 172.28.0.164:62561 #1418794 (400 connections now open) 2015-10-05T03:02:21.829+0100 [conn1418794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:25.367+0100 [conn1418181] end connection 172.28.0.164:59371 (399 connections now open) 2015-10-05T03:02:25.369+0100 [mongosMain] connection accepted from 172.28.0.164:62585 #1418795 (400 connections now open) 2015-10-05T03:02:25.370+0100 [conn1418795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:25.649+0100 [conn1418214] end connection 172.28.0.163:50037 (399 connections now open) 2015-10-05T03:02:25.650+0100 [mongosMain] connection accepted from 172.28.0.163:53178 #1418796 (400 connections now open) 2015-10-05T03:02:25.651+0100 [conn1418796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:25.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da315703b51053ea861b 2015-10-05T03:02:26.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:28.434+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:02:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:02:29.150+0100 [mongosMain] connection accepted from 127.0.0.1:53199 #1418797 (401 connections now open) 2015-10-05T03:02:29.153+0100 [conn1418797] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:29.157+0100 [conn1418797] end connection 127.0.0.1:53199 (400 connections now open) 2015-10-05T03:02:31.841+0100 [conn1418247] end connection 172.28.0.164:59758 (399 connections now open) 2015-10-05T03:02:31.842+0100 [mongosMain] connection accepted from 172.28.0.164:62644 #1418798 (400 connections now open) 2015-10-05T03:02:31.845+0100 [conn1418798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:32.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da385703b51053ea8702 2015-10-05T03:02:32.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:35.367+0100 [conn1418221] end connection 172.28.0.164:59644 (399 connections now open) 2015-10-05T03:02:35.368+0100 [mongosMain] connection accepted from 172.28.0.164:62673 #1418799 (400 connections now open) 2015-10-05T03:02:35.370+0100 [conn1418799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:35.649+0100 [conn1418222] end connection 172.28.0.163:50058 (399 connections now open) 2015-10-05T03:02:35.650+0100 [conn1418243] end connection 172.28.0.163:50158 (399 connections now open) 2015-10-05T03:02:35.651+0100 [mongosMain] connection accepted from 172.28.0.163:53230 #1418800 (399 connections now open) 2015-10-05T03:02:35.651+0100 [mongosMain] connection accepted from 172.28.0.163:53231 #1418801 (400 connections now open) 2015-10-05T03:02:35.652+0100 [conn1418800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:35.652+0100 [conn1418801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:38.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da3e5703b51053ea87b8 2015-10-05T03:02:38.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:39.903+0100 [mongosMain] connection accepted from 127.0.0.1:53234 #1418802 (401 connections now open) 2015-10-05T03:02:39.906+0100 [conn1418802] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:39.911+0100 [conn1418802] end connection 127.0.0.1:53234 (400 connections now open) 2015-10-05T03:02:41.841+0100 [conn1418254] end connection 172.28.0.164:59817 (399 connections now open) 2015-10-05T03:02:41.842+0100 [mongosMain] connection accepted from 172.28.0.164:62684 #1418803 (400 connections now open) 2015-10-05T03:02:41.843+0100 [conn1418803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:45.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da445703b51053ea886d 2015-10-05T03:02:45.366+0100 [conn1418175] end connection 172.28.0.164:59347 (399 connections now open) 2015-10-05T03:02:45.367+0100 [mongosMain] connection accepted from 172.28.0.164:62690 #1418804 (400 connections now open) 2015-10-05T03:02:45.369+0100 [conn1418804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:45.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:45.664+0100 [conn1418242] end connection 172.28.0.163:50157 (399 connections now open) 2015-10-05T03:02:45.665+0100 [mongosMain] connection accepted from 172.28.0.163:53242 #1418805 (400 connections now open) 2015-10-05T03:02:45.666+0100 [conn1418805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:51.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da4b5703b51053ea893b 2015-10-05T03:02:51.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:51.855+0100 [conn1418262] end connection 172.28.0.164:59893 (399 connections now open) 2015-10-05T03:02:51.856+0100 [mongosMain] connection accepted from 172.28.0.164:62698 #1418806 (400 connections now open) 2015-10-05T03:02:51.858+0100 [conn1418806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:55.382+0100 [conn1418193] end connection 172.28.0.164:59419 (399 connections now open) 2015-10-05T03:02:55.383+0100 [mongosMain] connection accepted from 172.28.0.164:62703 #1418807 (400 connections now open) 2015-10-05T03:02:55.384+0100 [conn1418807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:02:58.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da515703b51053ea89fb 2015-10-05T03:02:58.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:02:58.614+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:02:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:03:01.872+0100 [conn1418266] end connection 172.28.0.164:59912 (399 connections now open) 2015-10-05T03:03:01.873+0100 [mongosMain] connection accepted from 172.28.0.164:62710 #1418808 (400 connections now open) 2015-10-05T03:03:01.876+0100 [conn1418808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:05.399+0100 [conn1418187] end connection 172.28.0.164:59386 (399 connections now open) 2015-10-05T03:03:05.400+0100 [mongosMain] connection accepted from 172.28.0.164:62722 #1418809 (400 connections now open) 2015-10-05T03:03:05.402+0100 [conn1418809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:10.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da5e5703b51053ea8b53 2015-10-05T03:03:10.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:03:15.398+0100 [conn1418201] end connection 172.28.0.164:59483 (399 connections now open) 2015-10-05T03:03:15.400+0100 [mongosMain] connection accepted from 172.28.0.164:62763 #1418810 (400 connections now open) 2015-10-05T03:03:15.401+0100 [conn1418810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:16.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da645703b51053ea8bf4 2015-10-05T03:03:17.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:03:23.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da6b5703b51053ea8c93 2015-10-05T03:03:23.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:03:25.429+0100 [conn1418228] end connection 172.28.0.164:59657 (399 connections now open) 2015-10-05T03:03:25.431+0100 [mongosMain] connection accepted from 172.28.0.164:62816 #1418811 (400 connections now open) 2015-10-05T03:03:25.433+0100 [conn1418811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:25.697+0100 [conn1418229] end connection 172.28.0.163:50073 (399 connections now open) 2015-10-05T03:03:25.698+0100 [mongosMain] connection accepted from 172.28.0.163:53385 #1418812 (400 connections now open) 2015-10-05T03:03:25.699+0100 [conn1418812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:28.896+0100 [mongosMain] connection accepted from 127.0.0.1:53405 #1418813 (401 connections now open) 2015-10-05T03:03:28.899+0100 [conn1418813] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:28.904+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:03:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:03:28.904+0100 [conn1418813] end connection 127.0.0.1:53405 (400 connections now open) 2015-10-05T03:03:35.447+0100 [conn1418235] end connection 172.28.0.164:59680 (399 connections now open) 2015-10-05T03:03:35.448+0100 [mongosMain] connection accepted from 172.28.0.164:62873 #1418814 (400 connections now open) 2015-10-05T03:03:35.451+0100 [conn1418814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:35.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da775703b51053ea8dc1 2015-10-05T03:03:35.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:03:35.711+0100 [conn1418268] end connection 172.28.0.163:50334 (399 connections now open) 2015-10-05T03:03:35.711+0100 [conn1418256] end connection 172.28.0.163:50266 (399 connections now open) 2015-10-05T03:03:35.712+0100 [mongosMain] connection accepted from 172.28.0.163:53435 #1418815 (399 connections now open) 2015-10-05T03:03:35.713+0100 [mongosMain] connection accepted from 172.28.0.163:53436 #1418816 (400 connections now open) 2015-10-05T03:03:35.713+0100 [conn1418815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:35.714+0100 [conn1418816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:39.254+0100 [mongosMain] connection accepted from 127.0.0.1:53453 #1418817 (401 connections now open) 2015-10-05T03:03:39.257+0100 [conn1418817] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:39.262+0100 [conn1418817] end connection 127.0.0.1:53453 (400 connections now open) 2015-10-05T03:03:41.950+0100 [conn1418271] end connection 172.28.0.164:59924 (399 connections now open) 2015-10-05T03:03:41.951+0100 [mongosMain] connection accepted from 172.28.0.164:62909 #1418818 (400 connections now open) 2015-10-05T03:03:41.952+0100 [conn1418818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:45.445+0100 [conn1418255] end connection 172.28.0.164:59846 (399 connections now open) 2015-10-05T03:03:45.446+0100 [mongosMain] connection accepted from 172.28.0.164:62916 #1418819 (400 connections now open) 2015-10-05T03:03:45.448+0100 [conn1418819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:45.712+0100 [conn1418287] end connection 172.28.0.163:50538 (399 connections now open) 2015-10-05T03:03:45.713+0100 [mongosMain] connection accepted from 172.28.0.163:53465 #1418820 (400 connections now open) 2015-10-05T03:03:45.714+0100 [conn1418820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:51.966+0100 [conn1418291] end connection 172.28.0.164:60139 (399 connections now open) 2015-10-05T03:03:51.967+0100 [mongosMain] connection accepted from 172.28.0.164:62922 #1418821 (400 connections now open) 2015-10-05T03:03:51.969+0100 [conn1418821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:53.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da895703b51053ea8f78 2015-10-05T03:03:53.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:03:55.461+0100 [conn1418248] end connection 172.28.0.164:59774 (399 connections now open) 2015-10-05T03:03:55.462+0100 [mongosMain] connection accepted from 172.28.0.164:62927 #1418822 (400 connections now open) 2015-10-05T03:03:55.464+0100 [conn1418822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:55.727+0100 [conn1418293] end connection 172.28.0.163:50600 (399 connections now open) 2015-10-05T03:03:55.729+0100 [mongosMain] connection accepted from 172.28.0.163:53478 #1418823 (400 connections now open) 2015-10-05T03:03:55.730+0100 [conn1418823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:03:59.194+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:03:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:04:00.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da8f5703b51053ea900d 2015-10-05T03:04:00.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:01.982+0100 [conn1418296] end connection 172.28.0.164:60154 (399 connections now open) 2015-10-05T03:04:01.982+0100 [mongosMain] connection accepted from 172.28.0.164:62933 #1418824 (400 connections now open) 2015-10-05T03:04:01.984+0100 [conn1418824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:05.461+0100 [conn1418241] end connection 172.28.0.164:59728 (399 connections now open) 2015-10-05T03:04:05.462+0100 [mongosMain] connection accepted from 172.28.0.164:62949 #1418825 (400 connections now open) 2015-10-05T03:04:05.464+0100 [conn1418825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:05.732+0100 [conn1418298] end connection 172.28.0.163:50619 (399 connections now open) 2015-10-05T03:04:05.732+0100 [conn1418281] end connection 172.28.0.163:50468 (399 connections now open) 2015-10-05T03:04:05.734+0100 [mongosMain] connection accepted from 172.28.0.163:53521 #1418826 (399 connections now open) 2015-10-05T03:04:05.734+0100 [mongosMain] connection accepted from 172.28.0.163:53522 #1418827 (400 connections now open) 2015-10-05T03:04:05.735+0100 [conn1418826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:05.735+0100 [conn1418827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:06.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da965703b51053ea90c5 2015-10-05T03:04:06.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:11.998+0100 [conn1418300] end connection 172.28.0.164:60168 (399 connections now open) 2015-10-05T03:04:12.000+0100 [mongosMain] connection accepted from 172.28.0.164:62977 #1418828 (400 connections now open) 2015-10-05T03:04:12.001+0100 [conn1418828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:13.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611da9c5703b51053ea9150 2015-10-05T03:04:13.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:15.477+0100 [conn1418263] end connection 172.28.0.164:59900 (399 connections now open) 2015-10-05T03:04:15.478+0100 [mongosMain] connection accepted from 172.28.0.164:62995 #1418829 (400 connections now open) 2015-10-05T03:04:15.480+0100 [conn1418829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:15.743+0100 [conn1418286] end connection 172.28.0.163:50537 (399 connections now open) 2015-10-05T03:04:15.743+0100 [conn1418301] end connection 172.28.0.163:50655 (399 connections now open) 2015-10-05T03:04:15.744+0100 [mongosMain] connection accepted from 172.28.0.163:53581 #1418830 (399 connections now open) 2015-10-05T03:04:15.745+0100 [mongosMain] connection accepted from 172.28.0.163:53582 #1418831 (400 connections now open) 2015-10-05T03:04:15.745+0100 [conn1418830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:15.745+0100 [conn1418831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:19.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611daa35703b51053ea91dc 2015-10-05T03:04:19.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:21.997+0100 [conn1418304] end connection 172.28.0.164:60230 (399 connections now open) 2015-10-05T03:04:21.998+0100 [mongosMain] connection accepted from 172.28.0.164:63028 #1418832 (400 connections now open) 2015-10-05T03:04:21.999+0100 [conn1418832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:25.477+0100 [conn1418267] end connection 172.28.0.164:59917 (399 connections now open) 2015-10-05T03:04:25.478+0100 [mongosMain] connection accepted from 172.28.0.164:63054 #1418833 (400 connections now open) 2015-10-05T03:04:25.479+0100 [conn1418833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:25.759+0100 [conn1418305] end connection 172.28.0.163:50721 (399 connections now open) 2015-10-05T03:04:25.761+0100 [mongosMain] connection accepted from 172.28.0.163:53637 #1418834 (400 connections now open) 2015-10-05T03:04:25.764+0100 [conn1418834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:26.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611daa95703b51053ea922c 2015-10-05T03:04:26.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:28.201+0100 [mongosMain] connection accepted from 127.0.0.1:53645 #1418835 (401 connections now open) 2015-10-05T03:04:28.203+0100 [conn1418835] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:28.208+0100 [conn1418835] end connection 127.0.0.1:53645 (400 connections now open) 2015-10-05T03:04:29.534+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:04:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:04:32.013+0100 [conn1418307] end connection 172.28.0.164:60291 (399 connections now open) 2015-10-05T03:04:32.014+0100 [mongosMain] connection accepted from 172.28.0.164:63082 #1418836 (400 connections now open) 2015-10-05T03:04:32.016+0100 [conn1418836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:32.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dab05703b51053ea926a 2015-10-05T03:04:32.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:35.493+0100 [conn1418285] end connection 172.28.0.164:60096 (399 connections now open) 2015-10-05T03:04:35.494+0100 [mongosMain] connection accepted from 172.28.0.164:63101 #1418837 (400 connections now open) 2015-10-05T03:04:35.496+0100 [conn1418837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:35.759+0100 [conn1418309] end connection 172.28.0.163:50774 (399 connections now open) 2015-10-05T03:04:35.759+0100 [conn1418297] end connection 172.28.0.163:50618 (399 connections now open) 2015-10-05T03:04:35.760+0100 [mongosMain] connection accepted from 172.28.0.163:53689 #1418838 (399 connections now open) 2015-10-05T03:04:35.760+0100 [mongosMain] connection accepted from 172.28.0.163:53690 #1418839 (400 connections now open) 2015-10-05T03:04:35.761+0100 [conn1418838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:35.762+0100 [conn1418839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:38.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dab65703b51053ea92ae 2015-10-05T03:04:38.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:40.227+0100 [mongosMain] connection accepted from 127.0.0.1:53699 #1418840 (401 connections now open) 2015-10-05T03:04:40.229+0100 [conn1418840] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:40.234+0100 [conn1418840] end connection 127.0.0.1:53699 (400 connections now open) 2015-10-05T03:04:42.029+0100 [conn1418315] end connection 172.28.0.164:60360 (399 connections now open) 2015-10-05T03:04:42.030+0100 [mongosMain] connection accepted from 172.28.0.164:63124 #1418841 (400 connections now open) 2015-10-05T03:04:42.032+0100 [conn1418841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:45.285+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dabd5703b51053ea9301 2015-10-05T03:04:45.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:45.492+0100 [conn1418272] end connection 172.28.0.164:59940 (399 connections now open) 2015-10-05T03:04:45.494+0100 [mongosMain] connection accepted from 172.28.0.164:63128 #1418842 (400 connections now open) 2015-10-05T03:04:45.495+0100 [conn1418842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:45.774+0100 [conn1418308] end connection 172.28.0.163:50773 (399 connections now open) 2015-10-05T03:04:45.775+0100 [conn1418317] end connection 172.28.0.163:50837 (398 connections now open) 2015-10-05T03:04:45.776+0100 [mongosMain] connection accepted from 172.28.0.163:53708 #1418843 (399 connections now open) 2015-10-05T03:04:45.776+0100 [mongosMain] connection accepted from 172.28.0.163:53710 #1418844 (400 connections now open) 2015-10-05T03:04:45.777+0100 [conn1418843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:45.778+0100 [conn1418844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:52.044+0100 [conn1418323] end connection 172.28.0.164:60395 (399 connections now open) 2015-10-05T03:04:52.045+0100 [mongosMain] connection accepted from 172.28.0.164:63137 #1418845 (400 connections now open) 2015-10-05T03:04:52.047+0100 [conn1418845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:55.775+0100 [conn1418324] end connection 172.28.0.163:50849 (399 connections now open) 2015-10-05T03:04:55.776+0100 [mongosMain] connection accepted from 172.28.0.163:53723 #1418846 (400 connections now open) 2015-10-05T03:04:55.777+0100 [conn1418846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:04:58.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dac95703b51053ea9398 2015-10-05T03:04:58.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:04:59.831+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:04:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:05:02.060+0100 [conn1418329] end connection 172.28.0.164:60409 (399 connections now open) 2015-10-05T03:05:02.061+0100 [mongosMain] connection accepted from 172.28.0.164:63151 #1418847 (400 connections now open) 2015-10-05T03:05:02.063+0100 [conn1418847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:04.440+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:05:04.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:05:05.524+0100 [conn1418276] end connection 172.28.0.164:59990 (399 connections now open) 2015-10-05T03:05:05.525+0100 [mongosMain] connection accepted from 172.28.0.164:63169 #1418848 (400 connections now open) 2015-10-05T03:05:05.526+0100 [conn1418848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:05.790+0100 [conn1418331] end connection 172.28.0.163:50867 (399 connections now open) 2015-10-05T03:05:05.791+0100 [mongosMain] connection accepted from 172.28.0.163:53760 #1418849 (400 connections now open) 2015-10-05T03:05:05.792+0100 [conn1418849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:10.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dad65703b51053ea9413 2015-10-05T03:05:10.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:12.076+0100 [conn1418335] end connection 172.28.0.164:60425 (399 connections now open) 2015-10-05T03:05:12.077+0100 [mongosMain] connection accepted from 172.28.0.164:63211 #1418850 (400 connections now open) 2015-10-05T03:05:12.078+0100 [conn1418850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:15.524+0100 [conn1418292] end connection 172.28.0.164:60145 (399 connections now open) 2015-10-05T03:05:15.526+0100 [mongosMain] connection accepted from 172.28.0.164:63227 #1418851 (400 connections now open) 2015-10-05T03:05:15.527+0100 [conn1418851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:15.791+0100 [conn1418338] end connection 172.28.0.163:50917 (399 connections now open) 2015-10-05T03:05:15.793+0100 [mongosMain] connection accepted from 172.28.0.163:53827 #1418852 (400 connections now open) 2015-10-05T03:05:15.794+0100 [conn1418852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:22.076+0100 [conn1418342] end connection 172.28.0.164:60477 (399 connections now open) 2015-10-05T03:05:22.077+0100 [mongosMain] connection accepted from 172.28.0.164:63259 #1418853 (400 connections now open) 2015-10-05T03:05:22.078+0100 [conn1418853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:23.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dae25703b51053ea946c 2015-10-05T03:05:23.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:25.540+0100 [conn1418336] end connection 172.28.0.164:60437 (399 connections now open) 2015-10-05T03:05:25.541+0100 [mongosMain] connection accepted from 172.28.0.164:63278 #1418854 (400 connections now open) 2015-10-05T03:05:25.542+0100 [conn1418854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:25.806+0100 [conn1418344] end connection 172.28.0.163:50975 (399 connections now open) 2015-10-05T03:05:25.808+0100 [mongosMain] connection accepted from 172.28.0.163:53882 #1418855 (400 connections now open) 2015-10-05T03:05:25.809+0100 [conn1418855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:28.636+0100 [mongosMain] connection accepted from 127.0.0.1:53906 #1418856 (401 connections now open) 2015-10-05T03:05:28.639+0100 [conn1418856] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:28.644+0100 [conn1418856] end connection 127.0.0.1:53906 (400 connections now open) 2015-10-05T03:05:29.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dae95703b51053ea948c 2015-10-05T03:05:29.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:30.097+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:05:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:05:32.076+0100 [conn1418349] end connection 172.28.0.164:60541 (399 connections now open) 2015-10-05T03:05:32.077+0100 [mongosMain] connection accepted from 172.28.0.164:63316 #1418857 (400 connections now open) 2015-10-05T03:05:32.080+0100 [conn1418857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:35.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611daef5703b51053ea94a3 2015-10-05T03:05:35.807+0100 [conn1418351] end connection 172.28.0.163:51028 (399 connections now open) 2015-10-05T03:05:35.807+0100 [conn1418249] end connection 172.28.0.163:50220 (399 connections now open) 2015-10-05T03:05:35.808+0100 [mongosMain] connection accepted from 172.28.0.163:53927 #1418858 (399 connections now open) 2015-10-05T03:05:35.808+0100 [mongosMain] connection accepted from 172.28.0.163:53928 #1418859 (400 connections now open) 2015-10-05T03:05:35.809+0100 [conn1418858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:35.809+0100 [conn1418859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:35.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:40.217+0100 [mongosMain] connection accepted from 127.0.0.1:53931 #1418860 (401 connections now open) 2015-10-05T03:05:40.220+0100 [conn1418860] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:40.224+0100 [conn1418860] end connection 127.0.0.1:53931 (400 connections now open) 2015-10-05T03:05:41.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611daf55703b51053ea94c2 2015-10-05T03:05:42.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:42.092+0100 [conn1418356] end connection 172.28.0.164:60616 (399 connections now open) 2015-10-05T03:05:42.093+0100 [mongosMain] connection accepted from 172.28.0.164:63340 #1418861 (400 connections now open) 2015-10-05T03:05:42.095+0100 [conn1418861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:45.823+0100 [conn1418330] end connection 172.28.0.163:50866 (399 connections now open) 2015-10-05T03:05:45.824+0100 [mongosMain] connection accepted from 172.28.0.163:53939 #1418862 (400 connections now open) 2015-10-05T03:05:45.825+0100 [conn1418862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:48.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dafc5703b51053ea94d5 2015-10-05T03:05:48.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:52.107+0100 [conn1418364] end connection 172.28.0.164:60674 (399 connections now open) 2015-10-05T03:05:52.108+0100 [mongosMain] connection accepted from 172.28.0.164:63351 #1418863 (400 connections now open) 2015-10-05T03:05:52.110+0100 [conn1418863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:54.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db025703b51053ea94e3 2015-10-05T03:05:54.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:05:55.571+0100 [conn1418280] end connection 172.28.0.164:60044 (399 connections now open) 2015-10-05T03:05:55.573+0100 [mongosMain] connection accepted from 172.28.0.164:63356 #1418864 (400 connections now open) 2015-10-05T03:05:55.574+0100 [conn1418864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:55.837+0100 [conn1418358] end connection 172.28.0.163:51091 (399 connections now open) 2015-10-05T03:05:55.837+0100 [conn1418337] end connection 172.28.0.163:50916 (399 connections now open) 2015-10-05T03:05:55.838+0100 [mongosMain] connection accepted from 172.28.0.163:53951 #1418865 (399 connections now open) 2015-10-05T03:05:55.838+0100 [mongosMain] connection accepted from 172.28.0.163:53950 #1418866 (400 connections now open) 2015-10-05T03:05:55.839+0100 [conn1418865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:05:55.839+0100 [conn1418866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:00.435+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:06:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:06:01.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db085703b51053ea94fa 2015-10-05T03:06:01.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:02.123+0100 [conn1418371] end connection 172.28.0.164:60691 (399 connections now open) 2015-10-05T03:06:02.124+0100 [mongosMain] connection accepted from 172.28.0.164:63366 #1418867 (400 connections now open) 2015-10-05T03:06:02.126+0100 [conn1418867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:05.571+0100 [conn1418343] end connection 172.28.0.164:60498 (399 connections now open) 2015-10-05T03:06:05.572+0100 [mongosMain] connection accepted from 172.28.0.164:63385 #1418868 (400 connections now open) 2015-10-05T03:06:05.574+0100 [conn1418868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:05.840+0100 [conn1418374] end connection 172.28.0.163:51131 (399 connections now open) 2015-10-05T03:06:05.840+0100 [conn1418325] end connection 172.28.0.163:50850 (399 connections now open) 2015-10-05T03:06:05.841+0100 [mongosMain] connection accepted from 172.28.0.163:53994 #1418869 (399 connections now open) 2015-10-05T03:06:05.841+0100 [mongosMain] connection accepted from 172.28.0.163:53995 #1418870 (400 connections now open) 2015-10-05T03:06:05.842+0100 [conn1418869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:05.842+0100 [conn1418870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:07.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db0f5703b51053ea9514 2015-10-05T03:06:07.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:12.123+0100 [conn1418379] end connection 172.28.0.164:60711 (399 connections now open) 2015-10-05T03:06:12.124+0100 [mongosMain] connection accepted from 172.28.0.164:63431 #1418871 (400 connections now open) 2015-10-05T03:06:12.126+0100 [conn1418871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:13.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db155703b51053ea952d 2015-10-05T03:06:13.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:15.587+0100 [conn1418365] end connection 172.28.0.164:60680 (399 connections now open) 2015-10-05T03:06:15.588+0100 [mongosMain] connection accepted from 172.28.0.164:63449 #1418872 (400 connections now open) 2015-10-05T03:06:15.589+0100 [conn1418872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:15.854+0100 [conn1418382] end connection 172.28.0.163:51161 (399 connections now open) 2015-10-05T03:06:15.855+0100 [mongosMain] connection accepted from 172.28.0.163:54041 #1418873 (400 connections now open) 2015-10-05T03:06:15.856+0100 [conn1418873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:20.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db1b5703b51053ea9548 2015-10-05T03:06:20.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:22.123+0100 [conn1418385] end connection 172.28.0.164:60772 (399 connections now open) 2015-10-05T03:06:22.124+0100 [mongosMain] connection accepted from 172.28.0.164:63489 #1418874 (400 connections now open) 2015-10-05T03:06:22.126+0100 [conn1418874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:25.602+0100 [conn1418350] end connection 172.28.0.164:60566 (399 connections now open) 2015-10-05T03:06:25.602+0100 [mongosMain] connection accepted from 172.28.0.164:63514 #1418875 (400 connections now open) 2015-10-05T03:06:25.604+0100 [conn1418875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:25.854+0100 [conn1418387] end connection 172.28.0.163:51229 (399 connections now open) 2015-10-05T03:06:25.854+0100 [mongosMain] connection accepted from 172.28.0.163:54092 #1418876 (400 connections now open) 2015-10-05T03:06:25.855+0100 [conn1418876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:26.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db225703b51053ea957b 2015-10-05T03:06:26.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:28.493+0100 [mongosMain] connection accepted from 127.0.0.1:54107 #1418877 (401 connections now open) 2015-10-05T03:06:28.495+0100 [conn1418877] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:28.501+0100 [conn1418877] end connection 127.0.0.1:54107 (400 connections now open) 2015-10-05T03:06:30.593+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:06:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:06:32.139+0100 [conn1418392] end connection 172.28.0.164:60840 (399 connections now open) 2015-10-05T03:06:32.140+0100 [mongosMain] connection accepted from 172.28.0.164:63561 #1418878 (400 connections now open) 2015-10-05T03:06:32.144+0100 [conn1418878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:32.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db285703b51053ea95ac 2015-10-05T03:06:32.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:35.618+0100 [conn1418357] end connection 172.28.0.164:60649 (399 connections now open) 2015-10-05T03:06:35.619+0100 [mongosMain] connection accepted from 172.28.0.164:63567 #1418879 (400 connections now open) 2015-10-05T03:06:35.622+0100 [conn1418879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:35.868+0100 [conn1418394] end connection 172.28.0.163:51299 (399 connections now open) 2015-10-05T03:06:35.868+0100 [conn1418316] end connection 172.28.0.163:50834 (399 connections now open) 2015-10-05T03:06:35.870+0100 [mongosMain] connection accepted from 172.28.0.163:54133 #1418880 (399 connections now open) 2015-10-05T03:06:35.870+0100 [mongosMain] connection accepted from 172.28.0.163:54134 #1418881 (400 connections now open) 2015-10-05T03:06:35.871+0100 [conn1418880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:35.872+0100 [conn1418881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:39.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db2e5703b51053ea95e4 2015-10-05T03:06:39.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:39.756+0100 [mongosMain] connection accepted from 127.0.0.1:54137 #1418882 (401 connections now open) 2015-10-05T03:06:39.759+0100 [conn1418882] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:39.764+0100 [conn1418882] end connection 127.0.0.1:54137 (400 connections now open) 2015-10-05T03:06:45.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db355703b51053ea9623 2015-10-05T03:06:45.633+0100 [conn1418372] end connection 172.28.0.164:60697 (399 connections now open) 2015-10-05T03:06:45.635+0100 [mongosMain] connection accepted from 172.28.0.164:63582 #1418883 (400 connections now open) 2015-10-05T03:06:45.636+0100 [conn1418883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:45.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:06:45.870+0100 [conn1418366] end connection 172.28.0.163:51114 (399 connections now open) 2015-10-05T03:06:45.871+0100 [mongosMain] connection accepted from 172.28.0.163:54145 #1418884 (400 connections now open) 2015-10-05T03:06:45.873+0100 [conn1418884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:52.170+0100 [conn1418398] end connection 172.28.0.164:60899 (399 connections now open) 2015-10-05T03:06:52.171+0100 [mongosMain] connection accepted from 172.28.0.164:63589 #1418885 (400 connections now open) 2015-10-05T03:06:52.173+0100 [conn1418885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:55.649+0100 [conn1418393] end connection 172.28.0.164:60863 (399 connections now open) 2015-10-05T03:06:55.650+0100 [mongosMain] connection accepted from 172.28.0.164:63594 #1418886 (400 connections now open) 2015-10-05T03:06:55.651+0100 [conn1418886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:55.883+0100 [conn1418373] end connection 172.28.0.163:51130 (399 connections now open) 2015-10-05T03:06:55.884+0100 [mongosMain] connection accepted from 172.28.0.163:54158 #1418887 (400 connections now open) 2015-10-05T03:06:55.885+0100 [conn1418887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:06:57.809+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db415703b51053ea9682 2015-10-05T03:06:57.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:00.758+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:07:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:07:04.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db475703b51053ea96b1 2015-10-05T03:07:04.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:05.664+0100 [conn1418380] end connection 172.28.0.164:60730 (399 connections now open) 2015-10-05T03:07:05.665+0100 [mongosMain] connection accepted from 172.28.0.164:63633 #1418888 (400 connections now open) 2015-10-05T03:07:05.667+0100 [conn1418888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:05.900+0100 [conn1418381] end connection 172.28.0.163:51162 (399 connections now open) 2015-10-05T03:07:05.902+0100 [mongosMain] connection accepted from 172.28.0.163:54193 #1418889 (400 connections now open) 2015-10-05T03:07:05.903+0100 [conn1418889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:10.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db4e5703b51053ea96ef 2015-10-05T03:07:10.525+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:12.203+0100 [conn1418411] end connection 172.28.0.164:60955 (399 connections now open) 2015-10-05T03:07:12.203+0100 [mongosMain] connection accepted from 172.28.0.164:63667 #1418890 (400 connections now open) 2015-10-05T03:07:12.205+0100 [conn1418890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:15.680+0100 [conn1418399] end connection 172.28.0.164:60924 (399 connections now open) 2015-10-05T03:07:15.682+0100 [mongosMain] connection accepted from 172.28.0.164:63687 #1418891 (400 connections now open) 2015-10-05T03:07:15.684+0100 [conn1418891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:15.903+0100 [conn1418407] end connection 172.28.0.163:51377 (399 connections now open) 2015-10-05T03:07:15.904+0100 [conn1418400] end connection 172.28.0.163:51365 (398 connections now open) 2015-10-05T03:07:15.904+0100 [mongosMain] connection accepted from 172.28.0.163:54252 #1418892 (399 connections now open) 2015-10-05T03:07:15.905+0100 [mongosMain] connection accepted from 172.28.0.163:54253 #1418893 (400 connections now open) 2015-10-05T03:07:15.905+0100 [conn1418892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:15.906+0100 [conn1418893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:22.224+0100 [conn1418420] end connection 172.28.0.164:61017 (399 connections now open) 2015-10-05T03:07:22.225+0100 [mongosMain] connection accepted from 172.28.0.164:63733 #1418894 (400 connections now open) 2015-10-05T03:07:22.228+0100 [conn1418894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:22.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db5a5703b51053ea9736 2015-10-05T03:07:22.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:25.696+0100 [conn1418386] end connection 172.28.0.164:60790 (399 connections now open) 2015-10-05T03:07:25.697+0100 [mongosMain] connection accepted from 172.28.0.164:63757 #1418895 (400 connections now open) 2015-10-05T03:07:25.699+0100 [conn1418895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:25.916+0100 [conn1418422] end connection 172.28.0.163:51488 (399 connections now open) 2015-10-05T03:07:25.916+0100 [conn1418423] end connection 172.28.0.163:51489 (398 connections now open) 2015-10-05T03:07:25.917+0100 [mongosMain] connection accepted from 172.28.0.163:54293 #1418896 (399 connections now open) 2015-10-05T03:07:25.917+0100 [mongosMain] connection accepted from 172.28.0.163:54294 #1418897 (400 connections now open) 2015-10-05T03:07:25.918+0100 [conn1418897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:25.918+0100 [conn1418896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:28.467+0100 [mongosMain] connection accepted from 127.0.0.1:54307 #1418898 (401 connections now open) 2015-10-05T03:07:28.470+0100 [conn1418898] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:28.476+0100 [conn1418898] end connection 127.0.0.1:54307 (400 connections now open) 2015-10-05T03:07:29.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db605703b51053ea975f 2015-10-05T03:07:29.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:31.035+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:07:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:07:32.232+0100 [conn1418427] end connection 172.28.0.164:61060 (399 connections now open) 2015-10-05T03:07:32.233+0100 [mongosMain] connection accepted from 172.28.0.164:63803 #1418899 (400 connections now open) 2015-10-05T03:07:32.235+0100 [conn1418899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:35.302+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db675703b51053ea9785 2015-10-05T03:07:35.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:35.712+0100 [conn1418412] end connection 172.28.0.164:60961 (399 connections now open) 2015-10-05T03:07:35.713+0100 [mongosMain] connection accepted from 172.28.0.164:63818 #1418900 (400 connections now open) 2015-10-05T03:07:35.715+0100 [conn1418900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:35.916+0100 [conn1418418] end connection 172.28.0.163:51431 (399 connections now open) 2015-10-05T03:07:35.916+0100 [conn1418429] end connection 172.28.0.163:51549 (399 connections now open) 2015-10-05T03:07:35.917+0100 [mongosMain] connection accepted from 172.28.0.163:54336 #1418901 (399 connections now open) 2015-10-05T03:07:35.917+0100 [mongosMain] connection accepted from 172.28.0.163:54337 #1418902 (400 connections now open) 2015-10-05T03:07:35.918+0100 [conn1418901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:35.918+0100 [conn1418902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:39.868+0100 [mongosMain] connection accepted from 127.0.0.1:54341 #1418903 (401 connections now open) 2015-10-05T03:07:39.870+0100 [conn1418903] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:39.874+0100 [conn1418903] end connection 127.0.0.1:54341 (400 connections now open) 2015-10-05T03:07:41.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db6d5703b51053ea97bd 2015-10-05T03:07:41.792+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:45.712+0100 [conn1418406] end connection 172.28.0.164:60943 (399 connections now open) 2015-10-05T03:07:45.712+0100 [mongosMain] connection accepted from 172.28.0.164:63834 #1418904 (400 connections now open) 2015-10-05T03:07:45.714+0100 [conn1418904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:45.931+0100 [conn1418401] end connection 172.28.0.163:51366 (399 connections now open) 2015-10-05T03:07:45.932+0100 [conn1418435] end connection 172.28.0.163:51645 (398 connections now open) 2015-10-05T03:07:45.933+0100 [mongosMain] connection accepted from 172.28.0.163:54349 #1418905 (399 connections now open) 2015-10-05T03:07:45.933+0100 [mongosMain] connection accepted from 172.28.0.163:54350 #1418906 (400 connections now open) 2015-10-05T03:07:45.934+0100 [conn1418905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:45.934+0100 [conn1418906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:48.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db735703b51053ea97f7 2015-10-05T03:07:48.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:07:52.249+0100 [conn1418433] end connection 172.28.0.164:61132 (399 connections now open) 2015-10-05T03:07:52.250+0100 [mongosMain] connection accepted from 172.28.0.164:63842 #1418907 (400 connections now open) 2015-10-05T03:07:52.252+0100 [conn1418907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:55.727+0100 [conn1418417] end connection 172.28.0.164:60985 (399 connections now open) 2015-10-05T03:07:55.729+0100 [mongosMain] connection accepted from 172.28.0.164:63847 #1418908 (400 connections now open) 2015-10-05T03:07:55.731+0100 [conn1418908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:07:55.932+0100 [conn1418442] end connection 172.28.0.163:51686 (399 connections now open) 2015-10-05T03:07:55.933+0100 [mongosMain] connection accepted from 172.28.0.163:54362 #1418909 (400 connections now open) 2015-10-05T03:07:55.934+0100 [conn1418909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:01.294+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:08:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:08:02.264+0100 [conn1418447] end connection 172.28.0.164:61205 (399 connections now open) 2015-10-05T03:08:02.265+0100 [mongosMain] connection accepted from 172.28.0.164:63859 #1418910 (400 connections now open) 2015-10-05T03:08:02.266+0100 [conn1418910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:06.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db865703b51053ea98d4 2015-10-05T03:08:06.448+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:12.282+0100 [conn1418454] end connection 172.28.0.164:61223 (399 connections now open) 2015-10-05T03:08:12.283+0100 [mongosMain] connection accepted from 172.28.0.164:63906 #1418911 (400 connections now open) 2015-10-05T03:08:12.286+0100 [conn1418911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:15.948+0100 [conn1418428] end connection 172.28.0.163:51548 (399 connections now open) 2015-10-05T03:08:15.949+0100 [conn1418450] end connection 172.28.0.163:51703 (398 connections now open) 2015-10-05T03:08:15.949+0100 [mongosMain] connection accepted from 172.28.0.163:54465 #1418912 (399 connections now open) 2015-10-05T03:08:15.950+0100 [mongosMain] connection accepted from 172.28.0.163:54466 #1418913 (400 connections now open) 2015-10-05T03:08:15.950+0100 [conn1418912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:15.951+0100 [conn1418913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:18.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db925703b51053ea9966 2015-10-05T03:08:18.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:22.296+0100 [conn1418460] end connection 172.28.0.164:61273 (399 connections now open) 2015-10-05T03:08:22.297+0100 [mongosMain] connection accepted from 172.28.0.164:63962 #1418914 (400 connections now open) 2015-10-05T03:08:22.300+0100 [conn1418914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:24.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db985703b51053ea99af 2015-10-05T03:08:24.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:25.963+0100 [conn1418413] end connection 172.28.0.163:51393 (399 connections now open) 2015-10-05T03:08:25.963+0100 [conn1418461] end connection 172.28.0.163:51837 (399 connections now open) 2015-10-05T03:08:25.965+0100 [mongosMain] connection accepted from 172.28.0.163:54526 #1418915 (399 connections now open) 2015-10-05T03:08:25.965+0100 [mongosMain] connection accepted from 172.28.0.163:54527 #1418916 (400 connections now open) 2015-10-05T03:08:25.966+0100 [conn1418915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:25.966+0100 [conn1418916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:28.202+0100 [mongosMain] connection accepted from 127.0.0.1:54546 #1418917 (401 connections now open) 2015-10-05T03:08:28.206+0100 [conn1418917] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:28.211+0100 [conn1418917] end connection 127.0.0.1:54546 (400 connections now open) 2015-10-05T03:08:31.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611db9e5703b51053ea99f7 2015-10-05T03:08:31.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:31.450+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:08:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:08:32.311+0100 [conn1418466] end connection 172.28.0.164:61338 (399 connections now open) 2015-10-05T03:08:32.312+0100 [mongosMain] connection accepted from 172.28.0.164:64026 #1418918 (400 connections now open) 2015-10-05T03:08:32.314+0100 [conn1418918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:35.979+0100 [conn1418434] end connection 172.28.0.163:51644 (399 connections now open) 2015-10-05T03:08:35.979+0100 [conn1418467] end connection 172.28.0.163:51897 (399 connections now open) 2015-10-05T03:08:35.980+0100 [mongosMain] connection accepted from 172.28.0.163:54589 #1418919 (399 connections now open) 2015-10-05T03:08:35.981+0100 [mongosMain] connection accepted from 172.28.0.163:54590 #1418920 (400 connections now open) 2015-10-05T03:08:35.981+0100 [conn1418919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:35.981+0100 [conn1418920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:37.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dba55703b51053ea9a46 2015-10-05T03:08:37.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:39.739+0100 [mongosMain] connection accepted from 127.0.0.1:54593 #1418921 (401 connections now open) 2015-10-05T03:08:39.742+0100 [conn1418921] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:39.746+0100 [conn1418921] end connection 127.0.0.1:54593 (400 connections now open) 2015-10-05T03:08:42.327+0100 [conn1418474] end connection 172.28.0.164:61415 (399 connections now open) 2015-10-05T03:08:42.333+0100 [mongosMain] connection accepted from 172.28.0.164:64055 #1418922 (400 connections now open) 2015-10-05T03:08:42.334+0100 [conn1418922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:45.983+0100 [conn1418456] end connection 172.28.0.163:51747 (399 connections now open) 2015-10-05T03:08:45.983+0100 [conn1418475] end connection 172.28.0.163:51953 (399 connections now open) 2015-10-05T03:08:45.984+0100 [mongosMain] connection accepted from 172.28.0.163:54600 #1418923 (399 connections now open) 2015-10-05T03:08:45.984+0100 [mongosMain] connection accepted from 172.28.0.163:54601 #1418924 (400 connections now open) 2015-10-05T03:08:45.985+0100 [conn1418923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:45.985+0100 [conn1418924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:49.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbb15703b51053ea9aed 2015-10-05T03:08:49.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:08:52.343+0100 [conn1418482] end connection 172.28.0.164:61457 (399 connections now open) 2015-10-05T03:08:52.344+0100 [mongosMain] connection accepted from 172.28.0.164:64067 #1418925 (400 connections now open) 2015-10-05T03:08:52.346+0100 [conn1418925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:55.790+0100 [conn1418455] end connection 172.28.0.164:61241 (399 connections now open) 2015-10-05T03:08:55.792+0100 [mongosMain] connection accepted from 172.28.0.164:64074 #1418926 (400 connections now open) 2015-10-05T03:08:55.793+0100 [conn1418926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:55.994+0100 [conn1418483] end connection 172.28.0.163:51984 (399 connections now open) 2015-10-05T03:08:55.994+0100 [conn1418441] end connection 172.28.0.163:51685 (399 connections now open) 2015-10-05T03:08:55.995+0100 [mongosMain] connection accepted from 172.28.0.163:54614 #1418927 (399 connections now open) 2015-10-05T03:08:55.995+0100 [mongosMain] connection accepted from 172.28.0.163:54615 #1418928 (400 connections now open) 2015-10-05T03:08:55.996+0100 [conn1418927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:55.996+0100 [conn1418928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:08:56.088+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:08:56.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:09:01.719+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:09:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:09:02.360+0100 [conn1418488] end connection 172.28.0.164:61474 (399 connections now open) 2015-10-05T03:09:02.360+0100 [mongosMain] connection accepted from 172.28.0.164:64083 #1418929 (400 connections now open) 2015-10-05T03:09:02.362+0100 [conn1418929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:02.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbbe5703b51053ea9b72 2015-10-05T03:09:02.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:05.807+0100 [conn1418421] end connection 172.28.0.164:61028 (399 connections now open) 2015-10-05T03:09:05.808+0100 [mongosMain] connection accepted from 172.28.0.164:64099 #1418930 (400 connections now open) 2015-10-05T03:09:05.810+0100 [conn1418930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:05.995+0100 [conn1418462] end connection 172.28.0.163:51838 (399 connections now open) 2015-10-05T03:09:05.995+0100 [conn1418490] end connection 172.28.0.163:52001 (399 connections now open) 2015-10-05T03:09:05.996+0100 [mongosMain] connection accepted from 172.28.0.163:54657 #1418931 (399 connections now open) 2015-10-05T03:09:05.997+0100 [mongosMain] connection accepted from 172.28.0.163:54658 #1418932 (400 connections now open) 2015-10-05T03:09:05.997+0100 [conn1418931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:05.998+0100 [conn1418932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:08.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbc45703b51053ea9bd9 2015-10-05T03:09:08.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:15.822+0100 [conn1418489] end connection 172.28.0.164:61480 (399 connections now open) 2015-10-05T03:09:15.824+0100 [mongosMain] connection accepted from 172.28.0.164:64142 #1418933 (400 connections now open) 2015-10-05T03:09:15.826+0100 [conn1418933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:16.010+0100 [conn1418449] end connection 172.28.0.163:51702 (399 connections now open) 2015-10-05T03:09:16.010+0100 [conn1418498] end connection 172.28.0.163:52043 (399 connections now open) 2015-10-05T03:09:16.011+0100 [mongosMain] connection accepted from 172.28.0.163:54716 #1418934 (399 connections now open) 2015-10-05T03:09:16.012+0100 [mongosMain] connection accepted from 172.28.0.163:54717 #1418935 (400 connections now open) 2015-10-05T03:09:16.012+0100 [conn1418934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:16.013+0100 [conn1418935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:21.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbd05703b51053ea9c46 2015-10-05T03:09:21.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:22.390+0100 [conn1418496] end connection 172.28.0.164:61492 (399 connections now open) 2015-10-05T03:09:22.391+0100 [mongosMain] connection accepted from 172.28.0.164:64182 #1418936 (400 connections now open) 2015-10-05T03:09:22.392+0100 [conn1418936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:26.011+0100 [conn1418504] end connection 172.28.0.163:52094 (399 connections now open) 2015-10-05T03:09:26.011+0100 [conn1418468] end connection 172.28.0.163:51898 (398 connections now open) 2015-10-05T03:09:26.012+0100 [mongosMain] connection accepted from 172.28.0.163:54780 #1418937 (399 connections now open) 2015-10-05T03:09:26.013+0100 [mongosMain] connection accepted from 172.28.0.163:54781 #1418938 (400 connections now open) 2015-10-05T03:09:26.013+0100 [conn1418937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:26.014+0100 [conn1418938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:27.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbd75703b51053ea9c77 2015-10-05T03:09:27.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:28.925+0100 [mongosMain] connection accepted from 127.0.0.1:54799 #1418939 (401 connections now open) 2015-10-05T03:09:28.928+0100 [conn1418939] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:28.934+0100 [conn1418939] end connection 127.0.0.1:54799 (400 connections now open) 2015-10-05T03:09:32.005+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:09:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:09:32.406+0100 [conn1418510] end connection 172.28.0.164:61604 (399 connections now open) 2015-10-05T03:09:32.407+0100 [mongosMain] connection accepted from 172.28.0.164:64245 #1418940 (400 connections now open) 2015-10-05T03:09:32.409+0100 [conn1418940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:35.853+0100 [conn1418511] end connection 172.28.0.164:61624 (399 connections now open) 2015-10-05T03:09:35.854+0100 [mongosMain] connection accepted from 172.28.0.164:64271 #1418941 (400 connections now open) 2015-10-05T03:09:35.856+0100 [conn1418941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:36.027+0100 [conn1418476] end connection 172.28.0.163:51954 (399 connections now open) 2015-10-05T03:09:36.027+0100 [conn1418512] end connection 172.28.0.163:52149 (398 connections now open) 2015-10-05T03:09:36.028+0100 [mongosMain] connection accepted from 172.28.0.163:54833 #1418942 (399 connections now open) 2015-10-05T03:09:36.028+0100 [mongosMain] connection accepted from 172.28.0.163:54834 #1418943 (400 connections now open) 2015-10-05T03:09:36.029+0100 [conn1418942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:36.029+0100 [conn1418943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:39.847+0100 [mongosMain] connection accepted from 127.0.0.1:54838 #1418944 (401 connections now open) 2015-10-05T03:09:39.850+0100 [conn1418944] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:39.854+0100 [conn1418944] end connection 127.0.0.1:54838 (400 connections now open) 2015-10-05T03:09:39.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbe35703b51053ea9cca 2015-10-05T03:09:40.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:42.421+0100 [conn1418519] end connection 172.28.0.164:61671 (399 connections now open) 2015-10-05T03:09:42.422+0100 [mongosMain] connection accepted from 172.28.0.164:64280 #1418945 (400 connections now open) 2015-10-05T03:09:42.423+0100 [conn1418945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:45.869+0100 [conn1418503] end connection 172.28.0.164:61567 (399 connections now open) 2015-10-05T03:09:45.870+0100 [mongosMain] connection accepted from 172.28.0.164:64286 #1418946 (400 connections now open) 2015-10-05T03:09:45.872+0100 [conn1418946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:46.026+0100 [conn1418521] end connection 172.28.0.163:52200 (399 connections now open) 2015-10-05T03:09:46.026+0100 [conn1418491] end connection 172.28.0.163:52000 (399 connections now open) 2015-10-05T03:09:46.028+0100 [mongosMain] connection accepted from 172.28.0.163:54847 #1418947 (399 connections now open) 2015-10-05T03:09:46.028+0100 [mongosMain] connection accepted from 172.28.0.163:54846 #1418948 (400 connections now open) 2015-10-05T03:09:46.029+0100 [conn1418948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:46.029+0100 [conn1418947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:46.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbea5703b51053ea9ce8 2015-10-05T03:09:46.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:09:52.422+0100 [conn1418528] end connection 172.28.0.164:61715 (399 connections now open) 2015-10-05T03:09:52.423+0100 [mongosMain] connection accepted from 172.28.0.164:64293 #1418949 (400 connections now open) 2015-10-05T03:09:52.424+0100 [conn1418949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:55.884+0100 [conn1418448] end connection 172.28.0.164:61211 (399 connections now open) 2015-10-05T03:09:55.885+0100 [mongosMain] connection accepted from 172.28.0.164:64296 #1418950 (400 connections now open) 2015-10-05T03:09:55.887+0100 [conn1418950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:56.041+0100 [conn1418530] end connection 172.28.0.163:52231 (399 connections now open) 2015-10-05T03:09:56.042+0100 [conn1418497] end connection 172.28.0.163:52042 (398 connections now open) 2015-10-05T03:09:56.043+0100 [mongosMain] connection accepted from 172.28.0.163:54860 #1418951 (399 connections now open) 2015-10-05T03:09:56.043+0100 [mongosMain] connection accepted from 172.28.0.163:54861 #1418952 (400 connections now open) 2015-10-05T03:09:56.044+0100 [conn1418952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:56.044+0100 [conn1418951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:09:58.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbf65703b51053ea9d23 2015-10-05T03:09:58.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:02.151+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:10:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:10:02.438+0100 [conn1418535] end connection 172.28.0.164:61732 (399 connections now open) 2015-10-05T03:10:02.439+0100 [mongosMain] connection accepted from 172.28.0.164:64306 #1418953 (400 connections now open) 2015-10-05T03:10:02.441+0100 [conn1418953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:04.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dbfc5703b51053ea9d44 2015-10-05T03:10:05.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:05.899+0100 [conn1418520] end connection 172.28.0.164:61686 (399 connections now open) 2015-10-05T03:10:05.900+0100 [mongosMain] connection accepted from 172.28.0.164:64324 #1418954 (400 connections now open) 2015-10-05T03:10:05.901+0100 [conn1418954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:06.059+0100 [conn1418537] end connection 172.28.0.163:52248 (399 connections now open) 2015-10-05T03:10:06.059+0100 [conn1418505] end connection 172.28.0.163:52095 (399 connections now open) 2015-10-05T03:10:06.060+0100 [mongosMain] connection accepted from 172.28.0.163:54912 #1418955 (399 connections now open) 2015-10-05T03:10:06.060+0100 [mongosMain] connection accepted from 172.28.0.163:54913 #1418956 (400 connections now open) 2015-10-05T03:10:06.061+0100 [conn1418955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:06.061+0100 [conn1418956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:11.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc035703b51053ea9d73 2015-10-05T03:10:11.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:12.453+0100 [conn1418542] end connection 172.28.0.164:61753 (399 connections now open) 2015-10-05T03:10:12.454+0100 [mongosMain] connection accepted from 172.28.0.164:64357 #1418957 (400 connections now open) 2015-10-05T03:10:12.456+0100 [conn1418957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:15.916+0100 [conn1418529] end connection 172.28.0.164:61721 (399 connections now open) 2015-10-05T03:10:15.917+0100 [mongosMain] connection accepted from 172.28.0.164:64374 #1418958 (400 connections now open) 2015-10-05T03:10:15.918+0100 [conn1418958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:16.062+0100 [conn1418545] end connection 172.28.0.163:52281 (399 connections now open) 2015-10-05T03:10:16.062+0100 [conn1418513] end connection 172.28.0.163:52151 (398 connections now open) 2015-10-05T03:10:16.063+0100 [mongosMain] connection accepted from 172.28.0.163:54965 #1418959 (399 connections now open) 2015-10-05T03:10:16.064+0100 [mongosMain] connection accepted from 172.28.0.163:54966 #1418960 (400 connections now open) 2015-10-05T03:10:16.064+0100 [conn1418959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:16.065+0100 [conn1418960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:21.097+0100 [conn1418568] end connection 172.28.0.164:61806 (399 connections now open) 2015-10-05T03:10:21.099+0100 [mongosMain] connection accepted from 172.28.0.164:64408 #1418961 (400 connections now open) 2015-10-05T03:10:21.100+0100 [conn1418961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:22.469+0100 [conn1418547] end connection 172.28.0.164:61779 (399 connections now open) 2015-10-05T03:10:22.471+0100 [mongosMain] connection accepted from 172.28.0.164:64418 #1418962 (400 connections now open) 2015-10-05T03:10:22.473+0100 [conn1418962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:23.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc0f5703b51053ea9da5 2015-10-05T03:10:23.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:25.932+0100 [conn1418536] end connection 172.28.0.164:61736 (399 connections now open) 2015-10-05T03:10:25.934+0100 [mongosMain] connection accepted from 172.28.0.164:64438 #1418963 (400 connections now open) 2015-10-05T03:10:25.936+0100 [conn1418963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:26.074+0100 [conn1418550] end connection 172.28.0.163:52310 (399 connections now open) 2015-10-05T03:10:26.074+0100 [conn1418522] end connection 172.28.0.163:52201 (399 connections now open) 2015-10-05T03:10:26.075+0100 [mongosMain] connection accepted from 172.28.0.163:55020 #1418964 (399 connections now open) 2015-10-05T03:10:26.076+0100 [mongosMain] connection accepted from 172.28.0.163:55021 #1418965 (400 connections now open) 2015-10-05T03:10:26.076+0100 [conn1418964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:26.077+0100 [conn1418965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:28.792+0100 [mongosMain] connection accepted from 127.0.0.1:55042 #1418966 (401 connections now open) 2015-10-05T03:10:28.795+0100 [conn1418966] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:28.800+0100 [conn1418966] end connection 127.0.0.1:55042 (400 connections now open) 2015-10-05T03:10:29.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc155703b51053ea9dc8 2015-10-05T03:10:29.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:31.112+0100 [conn1418572] end connection 172.28.0.164:61809 (399 connections now open) 2015-10-05T03:10:31.113+0100 [mongosMain] connection accepted from 172.28.0.164:64466 #1418967 (400 connections now open) 2015-10-05T03:10:31.115+0100 [conn1418967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:31.549+0100 [conn1418577] end connection 172.28.0.164:61865 (399 connections now open) 2015-10-05T03:10:31.550+0100 [mongosMain] connection accepted from 172.28.0.164:64471 #1418968 (400 connections now open) 2015-10-05T03:10:31.553+0100 [conn1418968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:32.282+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:10:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:10:32.364+0100 [conn1418669] end connection 172.28.0.163:52335 (399 connections now open) 2015-10-05T03:10:32.365+0100 [mongosMain] connection accepted from 172.28.0.163:55065 #1418969 (400 connections now open) 2015-10-05T03:10:32.366+0100 [conn1418969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:35.932+0100 [conn1418544] end connection 172.28.0.164:61771 (399 connections now open) 2015-10-05T03:10:35.933+0100 [mongosMain] connection accepted from 172.28.0.164:64498 #1418970 (400 connections now open) 2015-10-05T03:10:35.935+0100 [conn1418970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:36.075+0100 [conn1418581] end connection 172.28.0.163:52316 (399 connections now open) 2015-10-05T03:10:36.075+0100 [conn1418531] end connection 172.28.0.163:52232 (399 connections now open) 2015-10-05T03:10:36.076+0100 [mongosMain] connection accepted from 172.28.0.163:55078 #1418971 (399 connections now open) 2015-10-05T03:10:36.077+0100 [mongosMain] connection accepted from 172.28.0.163:55079 #1418972 (400 connections now open) 2015-10-05T03:10:36.077+0100 [conn1418971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:36.077+0100 [conn1418972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:39.654+0100 [mongosMain] connection accepted from 127.0.0.1:55082 #1418973 (401 connections now open) 2015-10-05T03:10:39.657+0100 [conn1418973] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:39.661+0100 [conn1418973] end connection 127.0.0.1:55082 (400 connections now open) 2015-10-05T03:10:41.127+0100 [conn1418571] end connection 172.28.0.164:61808 (399 connections now open) 2015-10-05T03:10:41.129+0100 [mongosMain] connection accepted from 172.28.0.164:64505 #1418974 (400 connections now open) 2015-10-05T03:10:41.130+0100 [conn1418974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:41.564+0100 [conn1418576] end connection 172.28.0.164:61847 (399 connections now open) 2015-10-05T03:10:41.565+0100 [mongosMain] connection accepted from 172.28.0.164:64507 #1418975 (400 connections now open) 2015-10-05T03:10:41.567+0100 [conn1418975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:42.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc225703b51053ea9e0e 2015-10-05T03:10:42.376+0100 [conn1418694] end connection 172.28.0.163:52429 (399 connections now open) 2015-10-05T03:10:42.376+0100 [conn1418670] end connection 172.28.0.163:52336 (398 connections now open) 2015-10-05T03:10:42.377+0100 [mongosMain] connection accepted from 172.28.0.163:55085 #1418976 (399 connections now open) 2015-10-05T03:10:42.378+0100 [mongosMain] connection accepted from 172.28.0.163:55086 #1418977 (400 connections now open) 2015-10-05T03:10:42.378+0100 [conn1418976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:42.379+0100 [conn1418977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:42.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:42.484+0100 [conn1418578] end connection 172.28.0.164:61868 (399 connections now open) 2015-10-05T03:10:42.485+0100 [mongosMain] connection accepted from 172.28.0.164:64510 #1418978 (400 connections now open) 2015-10-05T03:10:42.487+0100 [conn1418978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:45.947+0100 [conn1418548] end connection 172.28.0.164:61782 (399 connections now open) 2015-10-05T03:10:45.948+0100 [mongosMain] connection accepted from 172.28.0.164:64516 #1418979 (400 connections now open) 2015-10-05T03:10:45.950+0100 [conn1418979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:46.090+0100 [conn1418696] end connection 172.28.0.163:52441 (399 connections now open) 2015-10-05T03:10:46.090+0100 [conn1418538] end connection 172.28.0.163:52251 (398 connections now open) 2015-10-05T03:10:46.091+0100 [mongosMain] connection accepted from 172.28.0.163:55094 #1418980 (399 connections now open) 2015-10-05T03:10:46.091+0100 [mongosMain] connection accepted from 172.28.0.163:55093 #1418981 (400 connections now open) 2015-10-05T03:10:46.092+0100 [conn1418980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:46.093+0100 [conn1418981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:51.143+0100 [conn1418570] end connection 172.28.0.164:61807 (399 connections now open) 2015-10-05T03:10:51.144+0100 [mongosMain] connection accepted from 172.28.0.164:64520 #1418982 (400 connections now open) 2015-10-05T03:10:51.146+0100 [conn1418982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:51.579+0100 [conn1418608] end connection 172.28.0.164:61939 (399 connections now open) 2015-10-05T03:10:51.581+0100 [mongosMain] connection accepted from 172.28.0.164:64523 #1418983 (400 connections now open) 2015-10-05T03:10:51.582+0100 [conn1418983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:52.381+0100 [conn1418693] end connection 172.28.0.163:52428 (399 connections now open) 2015-10-05T03:10:52.381+0100 [conn1418672] end connection 172.28.0.163:52338 (399 connections now open) 2015-10-05T03:10:52.382+0100 [mongosMain] connection accepted from 172.28.0.163:55103 #1418984 (399 connections now open) 2015-10-05T03:10:52.383+0100 [mongosMain] connection accepted from 172.28.0.163:55104 #1418985 (400 connections now open) 2015-10-05T03:10:52.383+0100 [conn1418984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:52.384+0100 [conn1418985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:52.500+0100 [conn1418701] end connection 172.28.0.164:62082 (399 connections now open) 2015-10-05T03:10:52.501+0100 [mongosMain] connection accepted from 172.28.0.164:64527 #1418986 (400 connections now open) 2015-10-05T03:10:52.503+0100 [conn1418986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:54.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc2e5703b51053ea9e67 2015-10-05T03:10:54.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:10:55.963+0100 [conn1418579] end connection 172.28.0.164:61878 (399 connections now open) 2015-10-05T03:10:55.964+0100 [mongosMain] connection accepted from 172.28.0.164:64531 #1418987 (400 connections now open) 2015-10-05T03:10:55.966+0100 [conn1418987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:56.091+0100 [conn1418762] end connection 172.28.0.163:52638 (399 connections now open) 2015-10-05T03:10:56.091+0100 [conn1418546] end connection 172.28.0.163:52282 (399 connections now open) 2015-10-05T03:10:56.092+0100 [mongosMain] connection accepted from 172.28.0.163:55110 #1418988 (399 connections now open) 2015-10-05T03:10:56.092+0100 [mongosMain] connection accepted from 172.28.0.163:55111 #1418989 (400 connections now open) 2015-10-05T03:10:56.093+0100 [conn1418988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:10:56.093+0100 [conn1418989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:01.159+0100 [conn1418565] end connection 172.28.0.164:61803 (399 connections now open) 2015-10-05T03:11:01.160+0100 [mongosMain] connection accepted from 172.28.0.164:64533 #1418990 (400 connections now open) 2015-10-05T03:11:01.161+0100 [conn1418990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:01.594+0100 [conn1418609] end connection 172.28.0.164:61940 (399 connections now open) 2015-10-05T03:11:01.595+0100 [mongosMain] connection accepted from 172.28.0.164:64536 #1418991 (400 connections now open) 2015-10-05T03:11:01.596+0100 [conn1418991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:02.392+0100 [conn1418698] end connection 172.28.0.163:52446 (399 connections now open) 2015-10-05T03:11:02.393+0100 [conn1418683] end connection 172.28.0.163:52351 (398 connections now open) 2015-10-05T03:11:02.394+0100 [mongosMain] connection accepted from 172.28.0.163:55127 #1418992 (399 connections now open) 2015-10-05T03:11:02.394+0100 [mongosMain] connection accepted from 172.28.0.163:55128 #1418993 (400 connections now open) 2015-10-05T03:11:02.395+0100 [conn1418992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:02.395+0100 [conn1418993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:02.425+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:11:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:11:02.516+0100 [conn1418764] end connection 172.28.0.164:62130 (399 connections now open) 2015-10-05T03:11:02.517+0100 [mongosMain] connection accepted from 172.28.0.164:64544 #1418994 (400 connections now open) 2015-10-05T03:11:02.519+0100 [conn1418994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:06.106+0100 [conn1418549] end connection 172.28.0.163:52308 (399 connections now open) 2015-10-05T03:11:06.106+0100 [conn1418766] end connection 172.28.0.163:52692 (399 connections now open) 2015-10-05T03:11:06.107+0100 [mongosMain] connection accepted from 172.28.0.163:55155 #1418995 (399 connections now open) 2015-10-05T03:11:06.107+0100 [mongosMain] connection accepted from 172.28.0.163:55156 #1418996 (400 connections now open) 2015-10-05T03:11:06.107+0100 [conn1418995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:06.108+0100 [conn1418996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:11.176+0100 [conn1418559] end connection 172.28.0.164:61796 (399 connections now open) 2015-10-05T03:11:11.177+0100 [mongosMain] connection accepted from 172.28.0.164:64579 #1418997 (400 connections now open) 2015-10-05T03:11:11.180+0100 [conn1418997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:11.612+0100 [conn1418610] end connection 172.28.0.164:61941 (399 connections now open) 2015-10-05T03:11:11.613+0100 [mongosMain] connection accepted from 172.28.0.164:64583 #1418998 (400 connections now open) 2015-10-05T03:11:11.615+0100 [conn1418998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:12.392+0100 [conn1418679] end connection 172.28.0.163:52346 (399 connections now open) 2015-10-05T03:11:12.393+0100 [conn1418678] end connection 172.28.0.163:52345 (398 connections now open) 2015-10-05T03:11:12.394+0100 [mongosMain] connection accepted from 172.28.0.163:55183 #1418999 (399 connections now open) 2015-10-05T03:11:12.395+0100 [mongosMain] connection accepted from 172.28.0.163:55184 #1419000 (400 connections now open) 2015-10-05T03:11:12.395+0100 [conn1418999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:12.396+0100 [conn1419000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:12.516+0100 [conn1418768] end connection 172.28.0.164:62161 (399 connections now open) 2015-10-05T03:11:12.518+0100 [mongosMain] connection accepted from 172.28.0.164:64590 #1419001 (400 connections now open) 2015-10-05T03:11:12.519+0100 [conn1419001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:12.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc405703b51053ea9f1c 2015-10-05T03:11:13.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:11:16.107+0100 [conn1418771] end connection 172.28.0.163:52741 (399 connections now open) 2015-10-05T03:11:16.107+0100 [conn1418580] end connection 172.28.0.163:52314 (399 connections now open) 2015-10-05T03:11:16.108+0100 [mongosMain] connection accepted from 172.28.0.163:55201 #1419002 (399 connections now open) 2015-10-05T03:11:16.108+0100 [mongosMain] connection accepted from 172.28.0.163:55202 #1419003 (400 connections now open) 2015-10-05T03:11:16.109+0100 [conn1419002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:16.109+0100 [conn1419003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:19.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc475703b51053ea9f4d 2015-10-05T03:11:19.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:11:21.174+0100 [conn1418551] end connection 172.28.0.164:61787 (399 connections now open) 2015-10-05T03:11:21.176+0100 [mongosMain] connection accepted from 172.28.0.164:64633 #1419004 (400 connections now open) 2015-10-05T03:11:21.177+0100 [conn1419004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:21.627+0100 [conn1418611] end connection 172.28.0.164:61942 (399 connections now open) 2015-10-05T03:11:21.628+0100 [mongosMain] connection accepted from 172.28.0.164:64639 #1419005 (400 connections now open) 2015-10-05T03:11:21.630+0100 [conn1419005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:22.408+0100 [conn1418680] end connection 172.28.0.163:52347 (399 connections now open) 2015-10-05T03:11:22.408+0100 [conn1418715] end connection 172.28.0.163:52497 (399 connections now open) 2015-10-05T03:11:22.409+0100 [mongosMain] connection accepted from 172.28.0.163:55239 #1419006 (399 connections now open) 2015-10-05T03:11:22.409+0100 [mongosMain] connection accepted from 172.28.0.163:55240 #1419007 (400 connections now open) 2015-10-05T03:11:22.410+0100 [conn1419006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:22.410+0100 [conn1419007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:22.517+0100 [conn1418772] end connection 172.28.0.164:62213 (399 connections now open) 2015-10-05T03:11:22.517+0100 [mongosMain] connection accepted from 172.28.0.164:64649 #1419008 (400 connections now open) 2015-10-05T03:11:22.519+0100 [conn1419008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:26.123+0100 [conn1418773] end connection 172.28.0.163:52816 (399 connections now open) 2015-10-05T03:11:26.123+0100 [conn1418697] end connection 172.28.0.163:52442 (399 connections now open) 2015-10-05T03:11:26.124+0100 [mongosMain] connection accepted from 172.28.0.163:55259 #1419009 (399 connections now open) 2015-10-05T03:11:26.124+0100 [mongosMain] connection accepted from 172.28.0.163:55260 #1419010 (400 connections now open) 2015-10-05T03:11:26.125+0100 [conn1419009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:26.125+0100 [conn1419010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:28.852+0100 [mongosMain] connection accepted from 127.0.0.1:55282 #1419011 (401 connections now open) 2015-10-05T03:11:28.854+0100 [conn1419011] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:28.860+0100 [conn1419011] end connection 127.0.0.1:55282 (400 connections now open) 2015-10-05T03:11:31.176+0100 [conn1418554] end connection 172.28.0.164:61790 (399 connections now open) 2015-10-05T03:11:31.177+0100 [mongosMain] connection accepted from 172.28.0.164:64707 #1419012 (400 connections now open) 2015-10-05T03:11:31.179+0100 [conn1419012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:31.627+0100 [conn1418612] end connection 172.28.0.164:61943 (399 connections now open) 2015-10-05T03:11:31.628+0100 [mongosMain] connection accepted from 172.28.0.164:64712 #1419013 (400 connections now open) 2015-10-05T03:11:31.630+0100 [conn1419013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:32.410+0100 [conn1418682] end connection 172.28.0.163:52349 (399 connections now open) 2015-10-05T03:11:32.410+0100 [conn1418716] end connection 172.28.0.163:52499 (399 connections now open) 2015-10-05T03:11:32.411+0100 [mongosMain] connection accepted from 172.28.0.163:55305 #1419014 (399 connections now open) 2015-10-05T03:11:32.412+0100 [mongosMain] connection accepted from 172.28.0.163:55306 #1419015 (400 connections now open) 2015-10-05T03:11:32.412+0100 [conn1419014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:32.412+0100 [conn1419015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:32.682+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:11:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:11:36.137+0100 [conn1418763] end connection 172.28.0.163:52639 (399 connections now open) 2015-10-05T03:11:36.137+0100 [conn1418776] end connection 172.28.0.163:52861 (398 connections now open) 2015-10-05T03:11:36.139+0100 [mongosMain] connection accepted from 172.28.0.163:55313 #1419016 (399 connections now open) 2015-10-05T03:11:36.140+0100 [mongosMain] connection accepted from 172.28.0.163:55315 #1419017 (400 connections now open) 2015-10-05T03:11:36.140+0100 [conn1419016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:36.141+0100 [conn1419017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:37.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc595703b51053ea9fd5 2015-10-05T03:11:37.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:11:40.038+0100 [mongosMain] connection accepted from 127.0.0.1:55318 #1419018 (401 connections now open) 2015-10-05T03:11:40.041+0100 [conn1419018] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:40.046+0100 [conn1419018] end connection 127.0.0.1:55318 (400 connections now open) 2015-10-05T03:11:41.194+0100 [conn1418561] end connection 172.28.0.164:61798 (399 connections now open) 2015-10-05T03:11:41.195+0100 [mongosMain] connection accepted from 172.28.0.164:64735 #1419019 (400 connections now open) 2015-10-05T03:11:41.197+0100 [conn1419019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:41.643+0100 [conn1418613] end connection 172.28.0.164:61944 (399 connections now open) 2015-10-05T03:11:41.644+0100 [mongosMain] connection accepted from 172.28.0.164:64738 #1419020 (400 connections now open) 2015-10-05T03:11:41.646+0100 [conn1419020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:42.424+0100 [conn1418718] end connection 172.28.0.163:52502 (399 connections now open) 2015-10-05T03:11:42.424+0100 [conn1418675] end connection 172.28.0.163:52341 (398 connections now open) 2015-10-05T03:11:42.425+0100 [mongosMain] connection accepted from 172.28.0.163:55321 #1419021 (399 connections now open) 2015-10-05T03:11:42.427+0100 [conn1419021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:42.427+0100 [mongosMain] connection accepted from 172.28.0.163:55323 #1419022 (400 connections now open) 2015-10-05T03:11:42.429+0100 [conn1419022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:45.995+0100 [conn1418695] end connection 172.28.0.164:62043 (399 connections now open) 2015-10-05T03:11:45.996+0100 [mongosMain] connection accepted from 172.28.0.164:64746 #1419023 (400 connections now open) 2015-10-05T03:11:45.998+0100 [conn1419023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:46.138+0100 [conn1418779] end connection 172.28.0.163:52920 (399 connections now open) 2015-10-05T03:11:46.138+0100 [conn1418767] end connection 172.28.0.163:52693 (398 connections now open) 2015-10-05T03:11:46.140+0100 [mongosMain] connection accepted from 172.28.0.163:55331 #1419024 (399 connections now open) 2015-10-05T03:11:46.140+0100 [mongosMain] connection accepted from 172.28.0.163:55332 #1419025 (400 connections now open) 2015-10-05T03:11:46.142+0100 [conn1419025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:46.143+0100 [conn1419024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:50.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc655703b51053eaa025 2015-10-05T03:11:50.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:11:51.190+0100 [conn1418566] end connection 172.28.0.164:61802 (399 connections now open) 2015-10-05T03:11:51.192+0100 [mongosMain] connection accepted from 172.28.0.164:64750 #1419026 (400 connections now open) 2015-10-05T03:11:51.194+0100 [conn1419026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:51.642+0100 [conn1418614] end connection 172.28.0.164:61947 (399 connections now open) 2015-10-05T03:11:51.643+0100 [mongosMain] connection accepted from 172.28.0.164:64752 #1419027 (400 connections now open) 2015-10-05T03:11:51.645+0100 [conn1419027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:52.427+0100 [conn1418691] end connection 172.28.0.163:52364 (399 connections now open) 2015-10-05T03:11:52.427+0100 [conn1418717] end connection 172.28.0.163:52500 (399 connections now open) 2015-10-05T03:11:52.429+0100 [mongosMain] connection accepted from 172.28.0.163:55339 #1419028 (399 connections now open) 2015-10-05T03:11:52.429+0100 [mongosMain] connection accepted from 172.28.0.163:55340 #1419029 (400 connections now open) 2015-10-05T03:11:52.430+0100 [conn1419028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:52.430+0100 [conn1419029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:56.010+0100 [conn1418765] end connection 172.28.0.164:62147 (399 connections now open) 2015-10-05T03:11:56.012+0100 [mongosMain] connection accepted from 172.28.0.164:64760 #1419030 (400 connections now open) 2015-10-05T03:11:56.014+0100 [conn1419030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:56.153+0100 [conn1418770] end connection 172.28.0.163:52739 (399 connections now open) 2015-10-05T03:11:56.154+0100 [conn1418781] end connection 172.28.0.163:52985 (398 connections now open) 2015-10-05T03:11:56.155+0100 [mongosMain] connection accepted from 172.28.0.163:55347 #1419031 (399 connections now open) 2015-10-05T03:11:56.155+0100 [mongosMain] connection accepted from 172.28.0.163:55348 #1419032 (400 connections now open) 2015-10-05T03:11:56.156+0100 [conn1419031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:11:56.156+0100 [conn1419032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:01.217+0100 [conn1418558] end connection 172.28.0.164:61795 (399 connections now open) 2015-10-05T03:12:01.219+0100 [mongosMain] connection accepted from 172.28.0.164:64766 #1419033 (400 connections now open) 2015-10-05T03:12:01.221+0100 [conn1419033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:01.659+0100 [conn1418615] end connection 172.28.0.164:61951 (399 connections now open) 2015-10-05T03:12:01.660+0100 [mongosMain] connection accepted from 172.28.0.164:64770 #1419034 (400 connections now open) 2015-10-05T03:12:01.662+0100 [conn1419034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:02.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc725703b51053eaa072 2015-10-05T03:12:02.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:12:02.439+0100 [conn1418719] end connection 172.28.0.163:52503 (399 connections now open) 2015-10-05T03:12:02.440+0100 [mongosMain] connection accepted from 172.28.0.163:55370 #1419035 (400 connections now open) 2015-10-05T03:12:02.440+0100 [conn1418692] end connection 172.28.0.163:52366 (399 connections now open) 2015-10-05T03:12:02.441+0100 [conn1419035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:02.441+0100 [mongosMain] connection accepted from 172.28.0.163:55373 #1419036 (400 connections now open) 2015-10-05T03:12:02.442+0100 [conn1419036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:02.563+0100 [conn1418775] end connection 172.28.0.164:62254 (399 connections now open) 2015-10-05T03:12:02.564+0100 [mongosMain] connection accepted from 172.28.0.164:64778 #1419037 (400 connections now open) 2015-10-05T03:12:02.566+0100 [conn1419037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:02.843+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:12:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:12:06.012+0100 [conn1418769] end connection 172.28.0.164:62181 (399 connections now open) 2015-10-05T03:12:06.013+0100 [mongosMain] connection accepted from 172.28.0.164:64790 #1419038 (400 connections now open) 2015-10-05T03:12:06.016+0100 [conn1419038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:06.154+0100 [conn1418785] end connection 172.28.0.163:53035 (399 connections now open) 2015-10-05T03:12:06.154+0100 [conn1418774] end connection 172.28.0.163:52817 (399 connections now open) 2015-10-05T03:12:06.156+0100 [mongosMain] connection accepted from 172.28.0.163:55390 #1419039 (399 connections now open) 2015-10-05T03:12:06.156+0100 [mongosMain] connection accepted from 172.28.0.163:55389 #1419040 (400 connections now open) 2015-10-05T03:12:06.157+0100 [conn1419039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:06.157+0100 [conn1419040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:08.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc785703b51053eaa0b6 2015-10-05T03:12:08.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:12:11.222+0100 [conn1418552] end connection 172.28.0.164:61789 (399 connections now open) 2015-10-05T03:12:11.224+0100 [mongosMain] connection accepted from 172.28.0.164:64819 #1419041 (400 connections now open) 2015-10-05T03:12:11.225+0100 [conn1419041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:11.674+0100 [conn1418616] end connection 172.28.0.164:61954 (399 connections now open) 2015-10-05T03:12:11.675+0100 [mongosMain] connection accepted from 172.28.0.164:64822 #1419042 (400 connections now open) 2015-10-05T03:12:11.676+0100 [conn1419042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:12.455+0100 [conn1418664] end connection 172.28.0.163:52330 (399 connections now open) 2015-10-05T03:12:12.455+0100 [conn1418721] end connection 172.28.0.163:52506 (399 connections now open) 2015-10-05T03:12:12.457+0100 [mongosMain] connection accepted from 172.28.0.163:55432 #1419043 (399 connections now open) 2015-10-05T03:12:12.457+0100 [mongosMain] connection accepted from 172.28.0.163:55433 #1419044 (400 connections now open) 2015-10-05T03:12:12.458+0100 [conn1419043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:12.458+0100 [conn1419044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:12.564+0100 [conn1418786] end connection 172.28.0.164:62455 (399 connections now open) 2015-10-05T03:12:12.565+0100 [mongosMain] connection accepted from 172.28.0.164:64828 #1419045 (400 connections now open) 2015-10-05T03:12:12.566+0100 [conn1419045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:14.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc7e5703b51053eaa0ea 2015-10-05T03:12:15.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:12:16.027+0100 [conn1418761] end connection 172.28.0.164:62098 (399 connections now open) 2015-10-05T03:12:16.028+0100 [mongosMain] connection accepted from 172.28.0.164:64846 #1419046 (400 connections now open) 2015-10-05T03:12:16.029+0100 [conn1419046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:16.169+0100 [conn1418789] end connection 172.28.0.163:53086 (399 connections now open) 2015-10-05T03:12:16.170+0100 [conn1418778] end connection 172.28.0.163:52919 (398 connections now open) 2015-10-05T03:12:16.170+0100 [mongosMain] connection accepted from 172.28.0.163:55453 #1419047 (399 connections now open) 2015-10-05T03:12:16.171+0100 [mongosMain] connection accepted from 172.28.0.163:55454 #1419048 (400 connections now open) 2015-10-05T03:12:16.171+0100 [conn1419047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:16.172+0100 [conn1419048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:21.222+0100 [conn1418569] end connection 172.28.0.164:61805 (399 connections now open) 2015-10-05T03:12:21.224+0100 [mongosMain] connection accepted from 172.28.0.164:64879 #1419049 (400 connections now open) 2015-10-05T03:12:21.226+0100 [conn1419049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:21.707+0100 [conn1418617] end connection 172.28.0.164:61958 (399 connections now open) 2015-10-05T03:12:21.707+0100 [mongosMain] connection accepted from 172.28.0.164:64885 #1419050 (400 connections now open) 2015-10-05T03:12:21.707+0100 [conn1419050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:22.487+0100 [conn1418666] end connection 172.28.0.163:52332 (399 connections now open) 2015-10-05T03:12:22.487+0100 [conn1418720] end connection 172.28.0.163:52505 (399 connections now open) 2015-10-05T03:12:22.487+0100 [mongosMain] connection accepted from 172.28.0.163:55483 #1419051 (399 connections now open) 2015-10-05T03:12:22.487+0100 [mongosMain] connection accepted from 172.28.0.163:55484 #1419052 (400 connections now open) 2015-10-05T03:12:22.487+0100 [conn1419051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:22.487+0100 [conn1419052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:22.597+0100 [conn1418790] end connection 172.28.0.164:62508 (399 connections now open) 2015-10-05T03:12:22.597+0100 [mongosMain] connection accepted from 172.28.0.164:64892 #1419053 (400 connections now open) 2015-10-05T03:12:22.597+0100 [conn1419053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:26.042+0100 [conn1418783] end connection 172.28.0.164:62441 (399 connections now open) 2015-10-05T03:12:26.043+0100 [mongosMain] connection accepted from 172.28.0.164:64914 #1419054 (400 connections now open) 2015-10-05T03:12:26.045+0100 [conn1419054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:26.169+0100 [conn1418782] end connection 172.28.0.163:52986 (399 connections now open) 2015-10-05T03:12:26.170+0100 [mongosMain] connection accepted from 172.28.0.163:55496 #1419055 (400 connections now open) 2015-10-05T03:12:26.171+0100 [conn1419055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:27.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc8b5703b51053eaa14c 2015-10-05T03:12:27.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:12:28.728+0100 [mongosMain] connection accepted from 127.0.0.1:55511 #1419056 (401 connections now open) 2015-10-05T03:12:28.731+0100 [conn1419056] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:28.736+0100 [conn1419056] end connection 127.0.0.1:55511 (400 connections now open) 2015-10-05T03:12:31.238+0100 [conn1418563] end connection 172.28.0.164:61800 (399 connections now open) 2015-10-05T03:12:31.239+0100 [mongosMain] connection accepted from 172.28.0.164:64939 #1419057 (400 connections now open) 2015-10-05T03:12:31.240+0100 [conn1419057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:31.705+0100 [conn1418618] end connection 172.28.0.164:61961 (399 connections now open) 2015-10-05T03:12:31.707+0100 [mongosMain] connection accepted from 172.28.0.164:64942 #1419058 (400 connections now open) 2015-10-05T03:12:31.708+0100 [conn1419058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:32.472+0100 [conn1418673] end connection 172.28.0.163:52339 (399 connections now open) 2015-10-05T03:12:32.472+0100 [conn1418722] end connection 172.28.0.163:52507 (398 connections now open) 2015-10-05T03:12:32.473+0100 [mongosMain] connection accepted from 172.28.0.163:55526 #1419059 (399 connections now open) 2015-10-05T03:12:32.473+0100 [mongosMain] connection accepted from 172.28.0.163:55527 #1419060 (400 connections now open) 2015-10-05T03:12:32.474+0100 [conn1419059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:32.474+0100 [conn1419060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:32.595+0100 [conn1418794] end connection 172.28.0.164:62561 (399 connections now open) 2015-10-05T03:12:32.597+0100 [mongosMain] connection accepted from 172.28.0.164:64951 #1419061 (400 connections now open) 2015-10-05T03:12:32.598+0100 [conn1419061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:33.107+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:12:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:12:36.042+0100 [conn1418791] end connection 172.28.0.164:62526 (399 connections now open) 2015-10-05T03:12:36.043+0100 [mongosMain] connection accepted from 172.28.0.164:64971 #1419062 (400 connections now open) 2015-10-05T03:12:36.045+0100 [conn1419062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:36.184+0100 [conn1418784] end connection 172.28.0.163:53034 (399 connections now open) 2015-10-05T03:12:36.184+0100 [conn1418792] end connection 172.28.0.163:53138 (399 connections now open) 2015-10-05T03:12:36.185+0100 [mongosMain] connection accepted from 172.28.0.163:55542 #1419063 (399 connections now open) 2015-10-05T03:12:36.186+0100 [mongosMain] connection accepted from 172.28.0.163:55543 #1419064 (400 connections now open) 2015-10-05T03:12:36.186+0100 [conn1419063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:36.187+0100 [conn1419064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:39.293+0100 [mongosMain] connection accepted from 127.0.0.1:55560 #1419065 (401 connections now open) 2015-10-05T03:12:39.296+0100 [conn1419065] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:39.300+0100 [conn1419065] end connection 127.0.0.1:55560 (400 connections now open) 2015-10-05T03:12:41.238+0100 [conn1418553] end connection 172.28.0.164:61791 (399 connections now open) 2015-10-05T03:12:41.239+0100 [mongosMain] connection accepted from 172.28.0.164:64995 #1419066 (400 connections now open) 2015-10-05T03:12:41.241+0100 [conn1419066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:41.706+0100 [conn1418619] end connection 172.28.0.164:61964 (399 connections now open) 2015-10-05T03:12:41.707+0100 [mongosMain] connection accepted from 172.28.0.164:64998 #1419067 (400 connections now open) 2015-10-05T03:12:41.708+0100 [conn1419067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:42.472+0100 [conn1418668] end connection 172.28.0.163:52334 (399 connections now open) 2015-10-05T03:12:42.472+0100 [conn1418723] end connection 172.28.0.163:52509 (398 connections now open) 2015-10-05T03:12:42.473+0100 [mongosMain] connection accepted from 172.28.0.163:55571 #1419068 (399 connections now open) 2015-10-05T03:12:42.474+0100 [mongosMain] connection accepted from 172.28.0.163:55572 #1419069 (400 connections now open) 2015-10-05T03:12:42.475+0100 [conn1419068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:42.475+0100 [conn1419069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:42.595+0100 [conn1418798] end connection 172.28.0.164:62644 (399 connections now open) 2015-10-05T03:12:42.596+0100 [mongosMain] connection accepted from 172.28.0.164:65001 #1419070 (400 connections now open) 2015-10-05T03:12:42.598+0100 [conn1419070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:45.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dc9d5703b51053eaa1b7 2015-10-05T03:12:45.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:12:46.059+0100 [conn1418795] end connection 172.28.0.164:62585 (399 connections now open) 2015-10-05T03:12:46.060+0100 [mongosMain] connection accepted from 172.28.0.164:65006 #1419071 (400 connections now open) 2015-10-05T03:12:46.062+0100 [conn1419071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:51.254+0100 [conn1418606] end connection 172.28.0.164:61921 (399 connections now open) 2015-10-05T03:12:51.255+0100 [mongosMain] connection accepted from 172.28.0.164:65011 #1419072 (400 connections now open) 2015-10-05T03:12:51.258+0100 [conn1419072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:51.722+0100 [conn1418620] end connection 172.28.0.164:61967 (399 connections now open) 2015-10-05T03:12:51.723+0100 [mongosMain] connection accepted from 172.28.0.164:65014 #1419073 (400 connections now open) 2015-10-05T03:12:51.724+0100 [conn1419073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:52.487+0100 [conn1418724] end connection 172.28.0.163:52511 (399 connections now open) 2015-10-05T03:12:52.488+0100 [conn1418659] end connection 172.28.0.163:52325 (399 connections now open) 2015-10-05T03:12:52.489+0100 [mongosMain] connection accepted from 172.28.0.163:55586 #1419074 (399 connections now open) 2015-10-05T03:12:52.489+0100 [mongosMain] connection accepted from 172.28.0.163:55587 #1419075 (400 connections now open) 2015-10-05T03:12:52.490+0100 [conn1419074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:52.491+0100 [conn1419075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:52.611+0100 [conn1418803] end connection 172.28.0.164:62684 (399 connections now open) 2015-10-05T03:12:52.613+0100 [mongosMain] connection accepted from 172.28.0.164:65017 #1419076 (400 connections now open) 2015-10-05T03:12:52.615+0100 [conn1419076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:12:57.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dca95703b51053eaa213 2015-10-05T03:12:57.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:01.269+0100 [conn1418594] end connection 172.28.0.164:61895 (399 connections now open) 2015-10-05T03:13:01.271+0100 [mongosMain] connection accepted from 172.28.0.164:65028 #1419077 (400 connections now open) 2015-10-05T03:13:01.272+0100 [conn1419077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:01.738+0100 [conn1418621] end connection 172.28.0.164:61974 (399 connections now open) 2015-10-05T03:13:01.739+0100 [mongosMain] connection accepted from 172.28.0.164:65035 #1419078 (400 connections now open) 2015-10-05T03:13:01.741+0100 [conn1419078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:02.491+0100 [conn1418725] end connection 172.28.0.163:52512 (399 connections now open) 2015-10-05T03:13:02.491+0100 [conn1418676] end connection 172.28.0.163:52342 (399 connections now open) 2015-10-05T03:13:02.492+0100 [mongosMain] connection accepted from 172.28.0.163:55612 #1419079 (399 connections now open) 2015-10-05T03:13:02.492+0100 [mongosMain] connection accepted from 172.28.0.163:55613 #1419080 (400 connections now open) 2015-10-05T03:13:02.493+0100 [conn1419079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:02.493+0100 [conn1419080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:02.626+0100 [conn1418806] end connection 172.28.0.164:62698 (399 connections now open) 2015-10-05T03:13:02.627+0100 [mongosMain] connection accepted from 172.28.0.164:65044 #1419081 (400 connections now open) 2015-10-05T03:13:02.629+0100 [conn1419081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:03.235+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:13:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:13:04.021+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:13:04.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:13:06.074+0100 [conn1418799] end connection 172.28.0.164:62673 (399 connections now open) 2015-10-05T03:13:06.075+0100 [mongosMain] connection accepted from 172.28.0.164:65060 #1419082 (400 connections now open) 2015-10-05T03:13:06.077+0100 [conn1419082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:10.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcb65703b51053eaa271 2015-10-05T03:13:10.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:11.285+0100 [conn1418596] end connection 172.28.0.164:61897 (399 connections now open) 2015-10-05T03:13:11.286+0100 [mongosMain] connection accepted from 172.28.0.164:65095 #1419083 (400 connections now open) 2015-10-05T03:13:11.288+0100 [conn1419083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:11.738+0100 [conn1418622] end connection 172.28.0.164:61977 (399 connections now open) 2015-10-05T03:13:11.740+0100 [mongosMain] connection accepted from 172.28.0.164:65100 #1419084 (400 connections now open) 2015-10-05T03:13:11.741+0100 [conn1419084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:12.503+0100 [conn1418671] end connection 172.28.0.163:52337 (399 connections now open) 2015-10-05T03:13:12.503+0100 [conn1418726] end connection 172.28.0.163:52514 (399 connections now open) 2015-10-05T03:13:12.504+0100 [mongosMain] connection accepted from 172.28.0.163:55677 #1419085 (399 connections now open) 2015-10-05T03:13:12.505+0100 [mongosMain] connection accepted from 172.28.0.163:55678 #1419086 (400 connections now open) 2015-10-05T03:13:12.506+0100 [conn1419085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:12.506+0100 [conn1419086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:16.216+0100 [conn1418788] end connection 172.28.0.163:53085 (399 connections now open) 2015-10-05T03:13:16.217+0100 [mongosMain] connection accepted from 172.28.0.163:55705 #1419087 (400 connections now open) 2015-10-05T03:13:16.218+0100 [conn1419087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:16.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcbc5703b51053eaa280 2015-10-05T03:13:16.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:21.301+0100 [conn1418601] end connection 172.28.0.164:61906 (399 connections now open) 2015-10-05T03:13:21.302+0100 [mongosMain] connection accepted from 172.28.0.164:65147 #1419088 (400 connections now open) 2015-10-05T03:13:21.304+0100 [conn1419088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:21.753+0100 [conn1418623] end connection 172.28.0.164:61980 (399 connections now open) 2015-10-05T03:13:21.754+0100 [mongosMain] connection accepted from 172.28.0.164:65154 #1419089 (400 connections now open) 2015-10-05T03:13:21.756+0100 [conn1419089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:22.508+0100 [conn1418727] end connection 172.28.0.163:52516 (399 connections now open) 2015-10-05T03:13:22.508+0100 [conn1418657] end connection 172.28.0.163:52323 (399 connections now open) 2015-10-05T03:13:22.510+0100 [mongosMain] connection accepted from 172.28.0.163:55742 #1419090 (399 connections now open) 2015-10-05T03:13:22.510+0100 [mongosMain] connection accepted from 172.28.0.163:55743 #1419091 (400 connections now open) 2015-10-05T03:13:22.511+0100 [conn1419090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:22.511+0100 [conn1419091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:23.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcc25703b51053eaa28f 2015-10-05T03:13:23.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:26.105+0100 [conn1418809] end connection 172.28.0.164:62722 (399 connections now open) 2015-10-05T03:13:26.106+0100 [mongosMain] connection accepted from 172.28.0.164:65180 #1419092 (400 connections now open) 2015-10-05T03:13:26.108+0100 [conn1419092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:26.231+0100 [conn1418796] end connection 172.28.0.163:53178 (399 connections now open) 2015-10-05T03:13:26.232+0100 [mongosMain] connection accepted from 172.28.0.163:55763 #1419093 (400 connections now open) 2015-10-05T03:13:26.233+0100 [conn1419093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:28.913+0100 [mongosMain] connection accepted from 127.0.0.1:55778 #1419094 (401 connections now open) 2015-10-05T03:13:28.916+0100 [conn1419094] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:28.921+0100 [conn1419094] end connection 127.0.0.1:55778 (400 connections now open) 2015-10-05T03:13:29.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcc95703b51053eaa29f 2015-10-05T03:13:29.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:31.316+0100 [conn1418573] end connection 172.28.0.164:61822 (399 connections now open) 2015-10-05T03:13:31.317+0100 [mongosMain] connection accepted from 172.28.0.164:65205 #1419095 (400 connections now open) 2015-10-05T03:13:31.318+0100 [conn1419095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:31.769+0100 [conn1418624] end connection 172.28.0.164:61983 (399 connections now open) 2015-10-05T03:13:31.770+0100 [mongosMain] connection accepted from 172.28.0.164:65208 #1419096 (400 connections now open) 2015-10-05T03:13:31.772+0100 [conn1419096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:32.520+0100 [conn1418728] end connection 172.28.0.163:52518 (399 connections now open) 2015-10-05T03:13:32.520+0100 [conn1418661] end connection 172.28.0.163:52327 (399 connections now open) 2015-10-05T03:13:32.521+0100 [mongosMain] connection accepted from 172.28.0.163:55801 #1419097 (399 connections now open) 2015-10-05T03:13:32.521+0100 [mongosMain] connection accepted from 172.28.0.163:55802 #1419098 (400 connections now open) 2015-10-05T03:13:32.522+0100 [conn1419097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:32.522+0100 [conn1419098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:33.424+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:13:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:13:35.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dccf5703b51053eaa2b8 2015-10-05T03:13:35.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:36.121+0100 [conn1418810] end connection 172.28.0.164:62763 (399 connections now open) 2015-10-05T03:13:36.121+0100 [mongosMain] connection accepted from 172.28.0.164:65236 #1419099 (400 connections now open) 2015-10-05T03:13:36.123+0100 [conn1419099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:36.232+0100 [conn1418800] end connection 172.28.0.163:53230 (399 connections now open) 2015-10-05T03:13:36.232+0100 [conn1418793] end connection 172.28.0.163:53139 (398 connections now open) 2015-10-05T03:13:36.234+0100 [mongosMain] connection accepted from 172.28.0.163:55820 #1419100 (399 connections now open) 2015-10-05T03:13:36.234+0100 [mongosMain] connection accepted from 172.28.0.163:55821 #1419101 (400 connections now open) 2015-10-05T03:13:36.235+0100 [conn1419100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:36.235+0100 [conn1419101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:40.027+0100 [mongosMain] connection accepted from 127.0.0.1:55824 #1419102 (401 connections now open) 2015-10-05T03:13:40.030+0100 [conn1419102] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:40.035+0100 [conn1419102] end connection 127.0.0.1:55824 (400 connections now open) 2015-10-05T03:13:41.332+0100 [conn1418556] end connection 172.28.0.164:61793 (399 connections now open) 2015-10-05T03:13:41.333+0100 [mongosMain] connection accepted from 172.28.0.164:65244 #1419103 (400 connections now open) 2015-10-05T03:13:41.335+0100 [conn1419103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:41.769+0100 [conn1418625] end connection 172.28.0.164:61985 (399 connections now open) 2015-10-05T03:13:41.769+0100 [mongosMain] connection accepted from 172.28.0.164:65247 #1419104 (400 connections now open) 2015-10-05T03:13:41.771+0100 [conn1419104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:42.535+0100 [conn1418681] end connection 172.28.0.163:52348 (399 connections now open) 2015-10-05T03:13:42.535+0100 [conn1418729] end connection 172.28.0.163:52520 (399 connections now open) 2015-10-05T03:13:42.536+0100 [mongosMain] connection accepted from 172.28.0.163:55827 #1419105 (399 connections now open) 2015-10-05T03:13:42.537+0100 [mongosMain] connection accepted from 172.28.0.163:55828 #1419106 (400 connections now open) 2015-10-05T03:13:42.537+0100 [conn1419105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:42.537+0100 [conn1419106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:42.673+0100 [conn1418808] end connection 172.28.0.164:62710 (399 connections now open) 2015-10-05T03:13:42.675+0100 [mongosMain] connection accepted from 172.28.0.164:65250 #1419107 (400 connections now open) 2015-10-05T03:13:42.676+0100 [conn1419107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:46.137+0100 [conn1418804] end connection 172.28.0.164:62690 (399 connections now open) 2015-10-05T03:13:46.138+0100 [mongosMain] connection accepted from 172.28.0.164:65255 #1419108 (400 connections now open) 2015-10-05T03:13:46.140+0100 [conn1419108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:46.247+0100 [conn1418816] end connection 172.28.0.163:53436 (399 connections now open) 2015-10-05T03:13:46.247+0100 [conn1418805] end connection 172.28.0.163:53242 (398 connections now open) 2015-10-05T03:13:46.249+0100 [mongosMain] connection accepted from 172.28.0.163:55837 #1419109 (399 connections now open) 2015-10-05T03:13:46.249+0100 [mongosMain] connection accepted from 172.28.0.163:55838 #1419110 (400 connections now open) 2015-10-05T03:13:46.250+0100 [conn1419109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:46.251+0100 [conn1419110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:48.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcdc5703b51053eaa2d6 2015-10-05T03:13:48.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:13:51.348+0100 [conn1418564] end connection 172.28.0.164:61801 (399 connections now open) 2015-10-05T03:13:51.349+0100 [mongosMain] connection accepted from 172.28.0.164:65259 #1419111 (400 connections now open) 2015-10-05T03:13:51.351+0100 [conn1419111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:51.785+0100 [conn1418626] end connection 172.28.0.164:61988 (399 connections now open) 2015-10-05T03:13:51.786+0100 [mongosMain] connection accepted from 172.28.0.164:65262 #1419112 (400 connections now open) 2015-10-05T03:13:51.788+0100 [conn1419112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:52.537+0100 [conn1418662] end connection 172.28.0.163:52328 (399 connections now open) 2015-10-05T03:13:52.538+0100 [conn1418730] end connection 172.28.0.163:52522 (398 connections now open) 2015-10-05T03:13:52.539+0100 [mongosMain] connection accepted from 172.28.0.163:55848 #1419113 (399 connections now open) 2015-10-05T03:13:52.540+0100 [mongosMain] connection accepted from 172.28.0.163:55850 #1419114 (400 connections now open) 2015-10-05T03:13:52.541+0100 [conn1419113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:52.541+0100 [conn1419114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:52.673+0100 [conn1418818] end connection 172.28.0.164:62909 (399 connections now open) 2015-10-05T03:13:52.674+0100 [mongosMain] connection accepted from 172.28.0.164:65265 #1419115 (400 connections now open) 2015-10-05T03:13:52.676+0100 [conn1419115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:56.152+0100 [conn1418787] end connection 172.28.0.164:62472 (399 connections now open) 2015-10-05T03:13:56.153+0100 [mongosMain] connection accepted from 172.28.0.164:65270 #1419116 (400 connections now open) 2015-10-05T03:13:56.154+0100 [conn1419116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:56.248+0100 [conn1418820] end connection 172.28.0.163:53465 (399 connections now open) 2015-10-05T03:13:56.248+0100 [conn1418801] end connection 172.28.0.163:53231 (399 connections now open) 2015-10-05T03:13:56.249+0100 [mongosMain] connection accepted from 172.28.0.163:55856 #1419117 (399 connections now open) 2015-10-05T03:13:56.250+0100 [mongosMain] connection accepted from 172.28.0.163:55857 #1419118 (400 connections now open) 2015-10-05T03:13:56.250+0100 [conn1419117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:13:56.251+0100 [conn1419118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:00.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dce85703b51053eaa2f8 2015-10-05T03:14:00.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:14:01.364+0100 [conn1418590] end connection 172.28.0.164:61891 (399 connections now open) 2015-10-05T03:14:01.365+0100 [mongosMain] connection accepted from 172.28.0.164:65278 #1419119 (400 connections now open) 2015-10-05T03:14:01.367+0100 [conn1419119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:01.800+0100 [conn1418627] end connection 172.28.0.164:61991 (399 connections now open) 2015-10-05T03:14:01.801+0100 [mongosMain] connection accepted from 172.28.0.164:65281 #1419120 (400 connections now open) 2015-10-05T03:14:01.803+0100 [conn1419120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:02.550+0100 [conn1418731] end connection 172.28.0.163:52525 (399 connections now open) 2015-10-05T03:14:02.550+0100 [conn1418660] end connection 172.28.0.163:52326 (399 connections now open) 2015-10-05T03:14:02.551+0100 [mongosMain] connection accepted from 172.28.0.163:55876 #1419121 (399 connections now open) 2015-10-05T03:14:02.551+0100 [mongosMain] connection accepted from 172.28.0.163:55877 #1419122 (400 connections now open) 2015-10-05T03:14:02.552+0100 [conn1419121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:02.552+0100 [conn1419122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:02.690+0100 [conn1418821] end connection 172.28.0.164:62922 (399 connections now open) 2015-10-05T03:14:02.691+0100 [mongosMain] connection accepted from 172.28.0.164:65286 #1419123 (400 connections now open) 2015-10-05T03:14:02.692+0100 [conn1419123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:03.687+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:14:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:14:06.168+0100 [conn1418807] end connection 172.28.0.164:62703 (399 connections now open) 2015-10-05T03:14:06.169+0100 [mongosMain] connection accepted from 172.28.0.164:65303 #1419124 (400 connections now open) 2015-10-05T03:14:06.171+0100 [conn1419124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:06.263+0100 [conn1418815] end connection 172.28.0.163:53435 (399 connections now open) 2015-10-05T03:14:06.263+0100 [conn1418823] end connection 172.28.0.163:53478 (399 connections now open) 2015-10-05T03:14:06.264+0100 [mongosMain] connection accepted from 172.28.0.163:55900 #1419125 (399 connections now open) 2015-10-05T03:14:06.265+0100 [mongosMain] connection accepted from 172.28.0.163:55901 #1419126 (400 connections now open) 2015-10-05T03:14:06.265+0100 [conn1419125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:06.265+0100 [conn1419126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:11.363+0100 [conn1418587] end connection 172.28.0.164:61888 (399 connections now open) 2015-10-05T03:14:11.364+0100 [mongosMain] connection accepted from 172.28.0.164:65328 #1419127 (400 connections now open) 2015-10-05T03:14:11.366+0100 [conn1419127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:11.816+0100 [conn1418628] end connection 172.28.0.164:61997 (399 connections now open) 2015-10-05T03:14:11.817+0100 [mongosMain] connection accepted from 172.28.0.164:65335 #1419128 (400 connections now open) 2015-10-05T03:14:11.819+0100 [conn1419128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:12.552+0100 [conn1418732] end connection 172.28.0.163:52526 (399 connections now open) 2015-10-05T03:14:12.552+0100 [conn1418665] end connection 172.28.0.163:52331 (399 connections now open) 2015-10-05T03:14:12.553+0100 [mongosMain] connection accepted from 172.28.0.163:55933 #1419129 (399 connections now open) 2015-10-05T03:14:12.553+0100 [mongosMain] connection accepted from 172.28.0.163:55934 #1419130 (400 connections now open) 2015-10-05T03:14:12.553+0100 [conn1419129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:12.554+0100 [conn1419130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:12.705+0100 [conn1418824] end connection 172.28.0.164:62933 (399 connections now open) 2015-10-05T03:14:12.706+0100 [mongosMain] connection accepted from 172.28.0.164:65341 #1419131 (400 connections now open) 2015-10-05T03:14:12.708+0100 [conn1419131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:16.184+0100 [conn1418811] end connection 172.28.0.164:62816 (399 connections now open) 2015-10-05T03:14:16.186+0100 [mongosMain] connection accepted from 172.28.0.164:65360 #1419132 (400 connections now open) 2015-10-05T03:14:16.188+0100 [conn1419132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:16.279+0100 [conn1418826] end connection 172.28.0.163:53521 (399 connections now open) 2015-10-05T03:14:16.281+0100 [mongosMain] connection accepted from 172.28.0.163:55962 #1419133 (400 connections now open) 2015-10-05T03:14:16.281+0100 [conn1419133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:18.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dcfa5703b51053eaa340 2015-10-05T03:14:19.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:14:21.380+0100 [conn1418600] end connection 172.28.0.164:61902 (399 connections now open) 2015-10-05T03:14:21.381+0100 [mongosMain] connection accepted from 172.28.0.164:65387 #1419134 (400 connections now open) 2015-10-05T03:14:21.383+0100 [conn1419134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:21.832+0100 [conn1418629] end connection 172.28.0.164:62000 (399 connections now open) 2015-10-05T03:14:21.834+0100 [mongosMain] connection accepted from 172.28.0.164:65392 #1419135 (400 connections now open) 2015-10-05T03:14:21.836+0100 [conn1419135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:22.567+0100 [conn1418704] end connection 172.28.0.163:52486 (399 connections now open) 2015-10-05T03:14:22.567+0100 [conn1418733] end connection 172.28.0.163:52529 (399 connections now open) 2015-10-05T03:14:22.568+0100 [mongosMain] connection accepted from 172.28.0.163:55987 #1419136 (399 connections now open) 2015-10-05T03:14:22.568+0100 [mongosMain] connection accepted from 172.28.0.163:55988 #1419137 (400 connections now open) 2015-10-05T03:14:22.568+0100 [conn1419136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:22.569+0100 [conn1419137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:22.721+0100 [conn1418828] end connection 172.28.0.164:62977 (399 connections now open) 2015-10-05T03:14:22.722+0100 [mongosMain] connection accepted from 172.28.0.164:65401 #1419138 (400 connections now open) 2015-10-05T03:14:22.723+0100 [conn1419138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:25.386+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5611dd00d5de43e0ed5d2e7d') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444011265308), why: "doing balance round", ts: ObjectId('5611dd015703b51053eaa351') } } gle1: { lastOp: Timestamp 1444011258000|11, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1444011265000|2, connectionId: 5195, updatedExisting: true, n: 1, syncMillis: 0, writtenTo: null, err: null, waited: 0, ok: 1.0 } 2015-10-05T03:14:25.392+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T03:14:25.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd015703b51053eaa351 2015-10-05T03:14:25.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:14:26.199+0100 [conn1418825] end connection 172.28.0.164:62949 (399 connections now open) 2015-10-05T03:14:26.200+0100 [mongosMain] connection accepted from 172.28.0.164:65421 #1419139 (400 connections now open) 2015-10-05T03:14:26.202+0100 [conn1419139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:26.279+0100 [conn1418831] end connection 172.28.0.163:53582 (399 connections now open) 2015-10-05T03:14:26.280+0100 [mongosMain] connection accepted from 172.28.0.163:56001 #1419140 (400 connections now open) 2015-10-05T03:14:26.281+0100 [conn1419140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:28.212+0100 [mongosMain] connection accepted from 127.0.0.1:56012 #1419141 (401 connections now open) 2015-10-05T03:14:28.214+0100 [conn1419141] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:28.220+0100 [conn1419141] end connection 127.0.0.1:56012 (400 connections now open) 2015-10-05T03:14:31.396+0100 [conn1418602] end connection 172.28.0.164:61909 (399 connections now open) 2015-10-05T03:14:31.397+0100 [mongosMain] connection accepted from 172.28.0.164:65448 #1419142 (400 connections now open) 2015-10-05T03:14:31.399+0100 [conn1419142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:31.848+0100 [conn1418630] end connection 172.28.0.164:62003 (399 connections now open) 2015-10-05T03:14:31.849+0100 [mongosMain] connection accepted from 172.28.0.164:65454 #1419143 (400 connections now open) 2015-10-05T03:14:31.851+0100 [conn1419143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:32.567+0100 [conn1418685] end connection 172.28.0.163:52356 (399 connections now open) 2015-10-05T03:14:32.568+0100 [conn1418734] end connection 172.28.0.163:52532 (398 connections now open) 2015-10-05T03:14:32.569+0100 [mongosMain] connection accepted from 172.28.0.163:56032 #1419144 (399 connections now open) 2015-10-05T03:14:32.570+0100 [conn1419144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:32.570+0100 [mongosMain] connection accepted from 172.28.0.163:56033 #1419145 (400 connections now open) 2015-10-05T03:14:32.571+0100 [conn1419145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:32.736+0100 [conn1418832] end connection 172.28.0.164:63028 (399 connections now open) 2015-10-05T03:14:32.736+0100 [mongosMain] connection accepted from 172.28.0.164:65464 #1419146 (400 connections now open) 2015-10-05T03:14:32.738+0100 [conn1419146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:33.888+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:14:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:14:36.215+0100 [conn1418822] end connection 172.28.0.164:62927 (399 connections now open) 2015-10-05T03:14:36.216+0100 [mongosMain] connection accepted from 172.28.0.164:65495 #1419147 (400 connections now open) 2015-10-05T03:14:36.217+0100 [conn1419147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:36.294+0100 [conn1418834] end connection 172.28.0.163:53637 (399 connections now open) 2015-10-05T03:14:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:56055 #1419148 (400 connections now open) 2015-10-05T03:14:36.296+0100 [conn1419148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:37.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd0d5703b51053eaa37f 2015-10-05T03:14:37.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:14:39.278+0100 [mongosMain] connection accepted from 127.0.0.1:56077 #1419149 (401 connections now open) 2015-10-05T03:14:39.280+0100 [conn1419149] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:39.285+0100 [conn1419149] end connection 127.0.0.1:56077 (400 connections now open) 2015-10-05T03:14:41.410+0100 [conn1418597] end connection 172.28.0.164:61898 (399 connections now open) 2015-10-05T03:14:41.411+0100 [mongosMain] connection accepted from 172.28.0.164:65519 #1419150 (400 connections now open) 2015-10-05T03:14:41.413+0100 [conn1419150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:41.848+0100 [conn1418631] end connection 172.28.0.164:62007 (399 connections now open) 2015-10-05T03:14:41.849+0100 [mongosMain] connection accepted from 172.28.0.164:65521 #1419151 (400 connections now open) 2015-10-05T03:14:41.851+0100 [conn1419151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:42.582+0100 [conn1418714] end connection 172.28.0.163:52496 (399 connections now open) 2015-10-05T03:14:42.582+0100 [conn1418735] end connection 172.28.0.163:52535 (399 connections now open) 2015-10-05T03:14:42.583+0100 [mongosMain] connection accepted from 172.28.0.163:56082 #1419152 (399 connections now open) 2015-10-05T03:14:42.583+0100 [mongosMain] connection accepted from 172.28.0.163:56083 #1419153 (400 connections now open) 2015-10-05T03:14:42.584+0100 [conn1419152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:42.584+0100 [conn1419153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:42.752+0100 [conn1418836] end connection 172.28.0.164:63082 (399 connections now open) 2015-10-05T03:14:42.753+0100 [mongosMain] connection accepted from 172.28.0.164:65525 #1419154 (400 connections now open) 2015-10-05T03:14:42.755+0100 [conn1419154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:44.032+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:14:44.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:14:46.231+0100 [conn1418819] end connection 172.28.0.164:62916 (399 connections now open) 2015-10-05T03:14:46.232+0100 [mongosMain] connection accepted from 172.28.0.164:65531 #1419155 (400 connections now open) 2015-10-05T03:14:46.233+0100 [conn1419155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:46.295+0100 [conn1418838] end connection 172.28.0.163:53689 (399 connections now open) 2015-10-05T03:14:46.295+0100 [conn1418827] end connection 172.28.0.163:53522 (398 connections now open) 2015-10-05T03:14:46.296+0100 [mongosMain] connection accepted from 172.28.0.163:56090 #1419156 (399 connections now open) 2015-10-05T03:14:46.297+0100 [mongosMain] connection accepted from 172.28.0.163:56091 #1419157 (400 connections now open) 2015-10-05T03:14:46.298+0100 [conn1419156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:46.298+0100 [conn1419157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:50.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd1a5703b51053eaa3b7 2015-10-05T03:14:50.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:14:51.411+0100 [conn1418595] end connection 172.28.0.164:61896 (399 connections now open) 2015-10-05T03:14:51.412+0100 [mongosMain] connection accepted from 172.28.0.164:49157 #1419158 (400 connections now open) 2015-10-05T03:14:51.414+0100 [conn1419158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:51.863+0100 [conn1418632] end connection 172.28.0.164:62011 (399 connections now open) 2015-10-05T03:14:51.864+0100 [mongosMain] connection accepted from 172.28.0.164:49160 #1419159 (400 connections now open) 2015-10-05T03:14:51.867+0100 [conn1419159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:52.597+0100 [conn1418736] end connection 172.28.0.163:52536 (399 connections now open) 2015-10-05T03:14:52.597+0100 [conn1418702] end connection 172.28.0.163:52484 (398 connections now open) 2015-10-05T03:14:52.599+0100 [mongosMain] connection accepted from 172.28.0.163:56099 #1419160 (399 connections now open) 2015-10-05T03:14:52.599+0100 [mongosMain] connection accepted from 172.28.0.163:56098 #1419161 (400 connections now open) 2015-10-05T03:14:52.600+0100 [conn1419160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:52.600+0100 [conn1419161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:52.768+0100 [conn1418841] end connection 172.28.0.164:63124 (399 connections now open) 2015-10-05T03:14:52.769+0100 [mongosMain] connection accepted from 172.28.0.164:49163 #1419162 (400 connections now open) 2015-10-05T03:14:52.771+0100 [conn1419162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:56.252+0100 [conn1418829] end connection 172.28.0.164:62995 (399 connections now open) 2015-10-05T03:14:56.253+0100 [mongosMain] connection accepted from 172.28.0.164:49167 #1419163 (400 connections now open) 2015-10-05T03:14:56.255+0100 [conn1419163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:56.310+0100 [conn1418830] end connection 172.28.0.163:53581 (399 connections now open) 2015-10-05T03:14:56.310+0100 [conn1418844] end connection 172.28.0.163:53710 (398 connections now open) 2015-10-05T03:14:56.312+0100 [mongosMain] connection accepted from 172.28.0.163:56106 #1419164 (399 connections now open) 2015-10-05T03:14:56.312+0100 [conn1419164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:56.313+0100 [mongosMain] connection accepted from 172.28.0.163:56107 #1419165 (400 connections now open) 2015-10-05T03:14:56.314+0100 [conn1419165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:14:56.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd205703b51053eaa3e3 2015-10-05T03:14:56.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:15:01.427+0100 [conn1418575] end connection 172.28.0.164:61829 (399 connections now open) 2015-10-05T03:15:01.428+0100 [mongosMain] connection accepted from 172.28.0.164:49191 #1419166 (400 connections now open) 2015-10-05T03:15:01.429+0100 [conn1419166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:01.880+0100 [conn1418633] end connection 172.28.0.164:62013 (399 connections now open) 2015-10-05T03:15:01.881+0100 [mongosMain] connection accepted from 172.28.0.164:49204 #1419167 (400 connections now open) 2015-10-05T03:15:01.883+0100 [conn1419167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:02.600+0100 [conn1418708] end connection 172.28.0.163:52490 (399 connections now open) 2015-10-05T03:15:02.600+0100 [conn1418737] end connection 172.28.0.163:52539 (399 connections now open) 2015-10-05T03:15:02.600+0100 [mongosMain] connection accepted from 172.28.0.163:56130 #1419168 (399 connections now open) 2015-10-05T03:15:02.601+0100 [mongosMain] connection accepted from 172.28.0.163:56131 #1419169 (400 connections now open) 2015-10-05T03:15:02.602+0100 [conn1419168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:02.602+0100 [conn1419169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:02.768+0100 [conn1418845] end connection 172.28.0.164:63137 (399 connections now open) 2015-10-05T03:15:02.769+0100 [mongosMain] connection accepted from 172.28.0.164:49211 #1419170 (400 connections now open) 2015-10-05T03:15:02.771+0100 [conn1419170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:04.164+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:15:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:15:06.263+0100 [conn1418814] end connection 172.28.0.164:62873 (399 connections now open) 2015-10-05T03:15:06.264+0100 [mongosMain] connection accepted from 172.28.0.164:49225 #1419171 (400 connections now open) 2015-10-05T03:15:06.267+0100 [conn1419171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:06.311+0100 [conn1418843] end connection 172.28.0.163:53708 (399 connections now open) 2015-10-05T03:15:06.311+0100 [conn1418846] end connection 172.28.0.163:53723 (398 connections now open) 2015-10-05T03:15:06.312+0100 [mongosMain] connection accepted from 172.28.0.163:56154 #1419172 (399 connections now open) 2015-10-05T03:15:06.313+0100 [mongosMain] connection accepted from 172.28.0.163:56155 #1419173 (400 connections now open) 2015-10-05T03:15:06.313+0100 [conn1419172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:06.314+0100 [conn1419173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:08.945+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd2c5703b51053eaa419 2015-10-05T03:15:09.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:15:11.427+0100 [conn1418598] end connection 172.28.0.164:61899 (399 connections now open) 2015-10-05T03:15:11.429+0100 [mongosMain] connection accepted from 172.28.0.164:49245 #1419174 (400 connections now open) 2015-10-05T03:15:11.431+0100 [conn1419174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:11.894+0100 [conn1418634] end connection 172.28.0.164:62014 (399 connections now open) 2015-10-05T03:15:11.895+0100 [mongosMain] connection accepted from 172.28.0.164:49253 #1419175 (400 connections now open) 2015-10-05T03:15:11.897+0100 [conn1419175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:12.613+0100 [conn1418700] end connection 172.28.0.163:52483 (399 connections now open) 2015-10-05T03:15:12.614+0100 [conn1418738] end connection 172.28.0.163:52540 (398 connections now open) 2015-10-05T03:15:12.615+0100 [mongosMain] connection accepted from 172.28.0.163:56197 #1419176 (399 connections now open) 2015-10-05T03:15:12.616+0100 [mongosMain] connection accepted from 172.28.0.163:56196 #1419177 (400 connections now open) 2015-10-05T03:15:12.616+0100 [conn1419176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:12.617+0100 [conn1419177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:12.784+0100 [conn1418847] end connection 172.28.0.164:63151 (399 connections now open) 2015-10-05T03:15:12.785+0100 [mongosMain] connection accepted from 172.28.0.164:49258 #1419178 (400 connections now open) 2015-10-05T03:15:12.787+0100 [conn1419178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:16.278+0100 [conn1418833] end connection 172.28.0.164:63054 (399 connections now open) 2015-10-05T03:15:16.279+0100 [mongosMain] connection accepted from 172.28.0.164:49286 #1419179 (400 connections now open) 2015-10-05T03:15:16.281+0100 [conn1419179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:16.326+0100 [conn1418849] end connection 172.28.0.163:53760 (399 connections now open) 2015-10-05T03:15:16.326+0100 [conn1418812] end connection 172.28.0.163:53385 (399 connections now open) 2015-10-05T03:15:16.327+0100 [mongosMain] connection accepted from 172.28.0.163:56221 #1419180 (399 connections now open) 2015-10-05T03:15:16.327+0100 [mongosMain] connection accepted from 172.28.0.163:56222 #1419181 (400 connections now open) 2015-10-05T03:15:16.328+0100 [conn1419180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:16.328+0100 [conn1419181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:21.442+0100 [conn1418607] end connection 172.28.0.164:61924 (399 connections now open) 2015-10-05T03:15:21.443+0100 [mongosMain] connection accepted from 172.28.0.164:49326 #1419182 (400 connections now open) 2015-10-05T03:15:21.444+0100 [conn1419182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:21.910+0100 [conn1418635] end connection 172.28.0.164:62015 (399 connections now open) 2015-10-05T03:15:21.911+0100 [mongosMain] connection accepted from 172.28.0.164:49333 #1419183 (400 connections now open) 2015-10-05T03:15:21.913+0100 [conn1419183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:22.615+0100 [conn1418710] end connection 172.28.0.163:52492 (399 connections now open) 2015-10-05T03:15:22.615+0100 [conn1418739] end connection 172.28.0.163:52544 (399 connections now open) 2015-10-05T03:15:22.616+0100 [mongosMain] connection accepted from 172.28.0.163:56258 #1419184 (399 connections now open) 2015-10-05T03:15:22.617+0100 [mongosMain] connection accepted from 172.28.0.163:56259 #1419185 (400 connections now open) 2015-10-05T03:15:22.617+0100 [conn1419184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:22.617+0100 [conn1419185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:22.799+0100 [conn1418850] end connection 172.28.0.164:63211 (399 connections now open) 2015-10-05T03:15:22.801+0100 [mongosMain] connection accepted from 172.28.0.164:49342 #1419186 (400 connections now open) 2015-10-05T03:15:22.803+0100 [conn1419186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:26.326+0100 [conn1418852] end connection 172.28.0.163:53827 (399 connections now open) 2015-10-05T03:15:26.327+0100 [mongosMain] connection accepted from 172.28.0.163:56280 #1419187 (400 connections now open) 2015-10-05T03:15:26.329+0100 [conn1419187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:27.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd3f5703b51053eaa44f 2015-10-05T03:15:27.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:15:28.229+0100 [mongosMain] connection accepted from 127.0.0.1:56293 #1419188 (401 connections now open) 2015-10-05T03:15:28.231+0100 [conn1419188] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:28.238+0100 [conn1419188] end connection 127.0.0.1:56293 (400 connections now open) 2015-10-05T03:15:31.443+0100 [conn1418586] end connection 172.28.0.164:61887 (399 connections now open) 2015-10-05T03:15:31.444+0100 [mongosMain] connection accepted from 172.28.0.164:49390 #1419189 (400 connections now open) 2015-10-05T03:15:31.452+0100 [conn1419189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:31.910+0100 [conn1418636] end connection 172.28.0.164:62016 (399 connections now open) 2015-10-05T03:15:31.911+0100 [mongosMain] connection accepted from 172.28.0.164:49393 #1419190 (400 connections now open) 2015-10-05T03:15:31.913+0100 [conn1419190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:32.629+0100 [conn1418740] end connection 172.28.0.163:52545 (399 connections now open) 2015-10-05T03:15:32.629+0100 [conn1418656] end connection 172.28.0.163:52322 (399 connections now open) 2015-10-05T03:15:32.631+0100 [mongosMain] connection accepted from 172.28.0.163:56307 #1419191 (399 connections now open) 2015-10-05T03:15:32.631+0100 [mongosMain] connection accepted from 172.28.0.163:56308 #1419192 (400 connections now open) 2015-10-05T03:15:32.632+0100 [conn1419191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:32.632+0100 [conn1419192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:32.799+0100 [conn1418853] end connection 172.28.0.164:63259 (399 connections now open) 2015-10-05T03:15:32.800+0100 [mongosMain] connection accepted from 172.28.0.164:49399 #1419193 (400 connections now open) 2015-10-05T03:15:32.802+0100 [conn1419193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:34.407+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:15:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:15:36.342+0100 [conn1418855] end connection 172.28.0.163:53882 (399 connections now open) 2015-10-05T03:15:36.342+0100 [conn1418839] end connection 172.28.0.163:53690 (399 connections now open) 2015-10-05T03:15:36.343+0100 [mongosMain] connection accepted from 172.28.0.163:56330 #1419194 (399 connections now open) 2015-10-05T03:15:36.343+0100 [mongosMain] connection accepted from 172.28.0.163:56331 #1419195 (400 connections now open) 2015-10-05T03:15:36.344+0100 [conn1419195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:36.344+0100 [conn1419194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:39.294+0100 [mongosMain] connection accepted from 127.0.0.1:56333 #1419196 (401 connections now open) 2015-10-05T03:15:39.297+0100 [conn1419196] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:39.302+0100 [conn1419196] end connection 127.0.0.1:56333 (400 connections now open) 2015-10-05T03:15:39.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd4b5703b51053eaa47e 2015-10-05T03:15:39.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:15:41.458+0100 [conn1418599] end connection 172.28.0.164:61900 (399 connections now open) 2015-10-05T03:15:41.459+0100 [mongosMain] connection accepted from 172.28.0.164:49431 #1419197 (400 connections now open) 2015-10-05T03:15:41.461+0100 [conn1419197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:41.927+0100 [conn1418637] end connection 172.28.0.164:62017 (399 connections now open) 2015-10-05T03:15:41.928+0100 [mongosMain] connection accepted from 172.28.0.164:49434 #1419198 (400 connections now open) 2015-10-05T03:15:41.931+0100 [conn1419198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:42.630+0100 [conn1418741] end connection 172.28.0.163:52548 (399 connections now open) 2015-10-05T03:15:42.631+0100 [conn1418690] end connection 172.28.0.163:52363 (398 connections now open) 2015-10-05T03:15:42.631+0100 [mongosMain] connection accepted from 172.28.0.163:56336 #1419199 (399 connections now open) 2015-10-05T03:15:42.633+0100 [conn1419199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:42.633+0100 [mongosMain] connection accepted from 172.28.0.163:56337 #1419200 (400 connections now open) 2015-10-05T03:15:42.634+0100 [conn1419200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:42.818+0100 [conn1418857] end connection 172.28.0.164:63316 (399 connections now open) 2015-10-05T03:15:42.820+0100 [mongosMain] connection accepted from 172.28.0.164:49438 #1419201 (400 connections now open) 2015-10-05T03:15:42.822+0100 [conn1419201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:51.458+0100 [conn1418562] end connection 172.28.0.164:61799 (399 connections now open) 2015-10-05T03:15:51.459+0100 [mongosMain] connection accepted from 172.28.0.164:49446 #1419202 (400 connections now open) 2015-10-05T03:15:51.460+0100 [conn1419202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:51.926+0100 [conn1418638] end connection 172.28.0.164:62018 (399 connections now open) 2015-10-05T03:15:51.927+0100 [mongosMain] connection accepted from 172.28.0.164:49449 #1419203 (400 connections now open) 2015-10-05T03:15:51.929+0100 [conn1419203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:52.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd575703b51053eaa4a5 2015-10-05T03:15:52.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:15:52.646+0100 [conn1418712] end connection 172.28.0.163:52494 (399 connections now open) 2015-10-05T03:15:52.646+0100 [conn1418742] end connection 172.28.0.163:52549 (398 connections now open) 2015-10-05T03:15:52.647+0100 [mongosMain] connection accepted from 172.28.0.163:56353 #1419204 (399 connections now open) 2015-10-05T03:15:52.647+0100 [mongosMain] connection accepted from 172.28.0.163:56354 #1419205 (400 connections now open) 2015-10-05T03:15:52.648+0100 [conn1419204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:52.648+0100 [conn1419205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:52.815+0100 [conn1418861] end connection 172.28.0.164:63340 (399 connections now open) 2015-10-05T03:15:52.816+0100 [mongosMain] connection accepted from 172.28.0.164:49454 #1419206 (400 connections now open) 2015-10-05T03:15:52.818+0100 [conn1419206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:56.325+0100 [conn1418837] end connection 172.28.0.164:63101 (399 connections now open) 2015-10-05T03:15:56.326+0100 [mongosMain] connection accepted from 172.28.0.164:49458 #1419207 (400 connections now open) 2015-10-05T03:15:56.329+0100 [conn1419207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:56.358+0100 [conn1418858] end connection 172.28.0.163:53927 (399 connections now open) 2015-10-05T03:15:56.359+0100 [mongosMain] connection accepted from 172.28.0.163:56360 #1419208 (400 connections now open) 2015-10-05T03:15:56.360+0100 [conn1419208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:15:58.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd5e5703b51053eaa4b8 2015-10-05T03:15:58.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:01.474+0100 [conn1418592] end connection 172.28.0.164:61893 (399 connections now open) 2015-10-05T03:16:01.476+0100 [mongosMain] connection accepted from 172.28.0.164:49465 #1419209 (400 connections now open) 2015-10-05T03:16:01.478+0100 [conn1419209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:01.942+0100 [conn1418639] end connection 172.28.0.164:62019 (399 connections now open) 2015-10-05T03:16:01.943+0100 [mongosMain] connection accepted from 172.28.0.164:49468 #1419210 (400 connections now open) 2015-10-05T03:16:01.944+0100 [conn1419210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:02.649+0100 [conn1418688] end connection 172.28.0.163:52361 (399 connections now open) 2015-10-05T03:16:02.649+0100 [conn1418743] end connection 172.28.0.163:52552 (399 connections now open) 2015-10-05T03:16:02.650+0100 [mongosMain] connection accepted from 172.28.0.163:56380 #1419211 (399 connections now open) 2015-10-05T03:16:02.651+0100 [mongosMain] connection accepted from 172.28.0.163:56381 #1419212 (400 connections now open) 2015-10-05T03:16:02.651+0100 [conn1419211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:02.652+0100 [conn1419212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:02.831+0100 [conn1418863] end connection 172.28.0.164:63351 (399 connections now open) 2015-10-05T03:16:02.833+0100 [mongosMain] connection accepted from 172.28.0.164:49475 #1419213 (400 connections now open) 2015-10-05T03:16:02.834+0100 [conn1419213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:04.696+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:16:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:16:04.834+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd645703b51053eaa4e4 2015-10-05T03:16:04.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:06.341+0100 [conn1418842] end connection 172.28.0.164:63128 (399 connections now open) 2015-10-05T03:16:06.342+0100 [mongosMain] connection accepted from 172.28.0.164:49490 #1419214 (400 connections now open) 2015-10-05T03:16:06.344+0100 [conn1419214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:06.373+0100 [conn1418865] end connection 172.28.0.163:53951 (399 connections now open) 2015-10-05T03:16:06.374+0100 [mongosMain] connection accepted from 172.28.0.163:56414 #1419215 (400 connections now open) 2015-10-05T03:16:06.375+0100 [conn1419215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:11.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd6a5703b51053eaa4f6 2015-10-05T03:16:11.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:11.490+0100 [conn1418588] end connection 172.28.0.164:61889 (399 connections now open) 2015-10-05T03:16:11.491+0100 [mongosMain] connection accepted from 172.28.0.164:49520 #1419216 (400 connections now open) 2015-10-05T03:16:11.493+0100 [conn1419216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:11.957+0100 [conn1418640] end connection 172.28.0.164:62020 (399 connections now open) 2015-10-05T03:16:11.958+0100 [mongosMain] connection accepted from 172.28.0.164:49523 #1419217 (400 connections now open) 2015-10-05T03:16:11.960+0100 [conn1419217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:12.662+0100 [conn1418744] end connection 172.28.0.163:52553 (399 connections now open) 2015-10-05T03:16:12.662+0100 [conn1418663] end connection 172.28.0.163:52329 (399 connections now open) 2015-10-05T03:16:12.663+0100 [mongosMain] connection accepted from 172.28.0.163:56445 #1419218 (399 connections now open) 2015-10-05T03:16:12.664+0100 [mongosMain] connection accepted from 172.28.0.163:56446 #1419219 (400 connections now open) 2015-10-05T03:16:12.665+0100 [conn1419218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:12.665+0100 [conn1419219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:12.831+0100 [conn1418867] end connection 172.28.0.164:63366 (399 connections now open) 2015-10-05T03:16:12.832+0100 [mongosMain] connection accepted from 172.28.0.164:49531 #1419220 (400 connections now open) 2015-10-05T03:16:12.834+0100 [conn1419220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:16.357+0100 [conn1418848] end connection 172.28.0.164:63169 (399 connections now open) 2015-10-05T03:16:16.358+0100 [mongosMain] connection accepted from 172.28.0.164:49547 #1419221 (400 connections now open) 2015-10-05T03:16:16.360+0100 [conn1419221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:16.374+0100 [conn1418870] end connection 172.28.0.163:53995 (399 connections now open) 2015-10-05T03:16:16.375+0100 [mongosMain] connection accepted from 172.28.0.163:56466 #1419222 (400 connections now open) 2015-10-05T03:16:16.375+0100 [conn1419222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:17.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd715703b51053eaa506 2015-10-05T03:16:17.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:21.490+0100 [conn1418557] end connection 172.28.0.164:61794 (399 connections now open) 2015-10-05T03:16:21.491+0100 [mongosMain] connection accepted from 172.28.0.164:49575 #1419223 (400 connections now open) 2015-10-05T03:16:21.493+0100 [conn1419223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:21.958+0100 [conn1418641] end connection 172.28.0.164:62021 (399 connections now open) 2015-10-05T03:16:21.959+0100 [mongosMain] connection accepted from 172.28.0.164:49578 #1419224 (400 connections now open) 2015-10-05T03:16:21.960+0100 [conn1419224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:22.676+0100 [conn1418745] end connection 172.28.0.163:52555 (399 connections now open) 2015-10-05T03:16:22.676+0100 [conn1418687] end connection 172.28.0.163:52360 (399 connections now open) 2015-10-05T03:16:22.678+0100 [mongosMain] connection accepted from 172.28.0.163:56495 #1419225 (399 connections now open) 2015-10-05T03:16:22.678+0100 [mongosMain] connection accepted from 172.28.0.163:56498 #1419226 (400 connections now open) 2015-10-05T03:16:22.679+0100 [conn1419225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:22.679+0100 [conn1419226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:22.830+0100 [conn1418871] end connection 172.28.0.164:63431 (399 connections now open) 2015-10-05T03:16:22.831+0100 [mongosMain] connection accepted from 172.28.0.164:49584 #1419227 (400 connections now open) 2015-10-05T03:16:22.832+0100 [conn1419227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:23.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd775703b51053eaa523 2015-10-05T03:16:24.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:26.372+0100 [conn1418854] end connection 172.28.0.164:63278 (399 connections now open) 2015-10-05T03:16:26.373+0100 [mongosMain] connection accepted from 172.28.0.164:49608 #1419228 (400 connections now open) 2015-10-05T03:16:26.375+0100 [conn1419228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:26.389+0100 [conn1418873] end connection 172.28.0.163:54041 (399 connections now open) 2015-10-05T03:16:26.390+0100 [mongosMain] connection accepted from 172.28.0.163:56522 #1419229 (400 connections now open) 2015-10-05T03:16:26.392+0100 [conn1419229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:28.766+0100 [mongosMain] connection accepted from 127.0.0.1:56535 #1419230 (401 connections now open) 2015-10-05T03:16:28.769+0100 [conn1419230] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:28.774+0100 [conn1419230] end connection 127.0.0.1:56535 (400 connections now open) 2015-10-05T03:16:30.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd7e5703b51053eaa531 2015-10-05T03:16:30.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:31.490+0100 [conn1418574] end connection 172.28.0.164:61828 (399 connections now open) 2015-10-05T03:16:31.492+0100 [mongosMain] connection accepted from 172.28.0.164:49646 #1419231 (400 connections now open) 2015-10-05T03:16:31.493+0100 [conn1419231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:31.958+0100 [conn1418642] end connection 172.28.0.164:62022 (399 connections now open) 2015-10-05T03:16:31.959+0100 [mongosMain] connection accepted from 172.28.0.164:49650 #1419232 (400 connections now open) 2015-10-05T03:16:31.960+0100 [conn1419232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:32.677+0100 [conn1418684] end connection 172.28.0.163:52355 (399 connections now open) 2015-10-05T03:16:32.678+0100 [conn1418746] end connection 172.28.0.163:52557 (398 connections now open) 2015-10-05T03:16:32.679+0100 [mongosMain] connection accepted from 172.28.0.163:56552 #1419233 (399 connections now open) 2015-10-05T03:16:32.680+0100 [mongosMain] connection accepted from 172.28.0.163:56553 #1419234 (400 connections now open) 2015-10-05T03:16:32.680+0100 [conn1419233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:32.681+0100 [conn1419234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:32.847+0100 [conn1418874] end connection 172.28.0.164:63489 (399 connections now open) 2015-10-05T03:16:32.848+0100 [mongosMain] connection accepted from 172.28.0.164:49660 #1419235 (400 connections now open) 2015-10-05T03:16:32.849+0100 [conn1419235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:34.949+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:16:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:16:36.388+0100 [conn1418851] end connection 172.28.0.164:63227 (399 connections now open) 2015-10-05T03:16:36.389+0100 [conn1418859] end connection 172.28.0.163:53928 (398 connections now open) 2015-10-05T03:16:36.389+0100 [conn1418876] end connection 172.28.0.163:54092 (397 connections now open) 2015-10-05T03:16:36.390+0100 [mongosMain] connection accepted from 172.28.0.164:49683 #1419236 (398 connections now open) 2015-10-05T03:16:36.390+0100 [mongosMain] connection accepted from 172.28.0.163:56573 #1419237 (399 connections now open) 2015-10-05T03:16:36.391+0100 [mongosMain] connection accepted from 172.28.0.163:56574 #1419238 (400 connections now open) 2015-10-05T03:16:36.392+0100 [conn1419237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:36.392+0100 [conn1419236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:36.392+0100 [conn1419238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:39.748+0100 [mongosMain] connection accepted from 127.0.0.1:56578 #1419239 (401 connections now open) 2015-10-05T03:16:39.751+0100 [conn1419239] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:39.756+0100 [conn1419239] end connection 127.0.0.1:56578 (400 connections now open) 2015-10-05T03:16:41.505+0100 [conn1418604] end connection 172.28.0.164:61915 (399 connections now open) 2015-10-05T03:16:41.506+0100 [mongosMain] connection accepted from 172.28.0.164:49689 #1419240 (400 connections now open) 2015-10-05T03:16:41.508+0100 [conn1419240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:41.973+0100 [conn1418643] end connection 172.28.0.164:62023 (399 connections now open) 2015-10-05T03:16:41.975+0100 [mongosMain] connection accepted from 172.28.0.164:49691 #1419241 (400 connections now open) 2015-10-05T03:16:41.976+0100 [conn1419241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:42.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd8a5703b51053eaa55c 2015-10-05T03:16:42.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:42.692+0100 [conn1418747] end connection 172.28.0.163:52558 (399 connections now open) 2015-10-05T03:16:42.692+0100 [conn1418689] end connection 172.28.0.163:52362 (398 connections now open) 2015-10-05T03:16:42.693+0100 [mongosMain] connection accepted from 172.28.0.163:56581 #1419242 (399 connections now open) 2015-10-05T03:16:42.693+0100 [mongosMain] connection accepted from 172.28.0.163:56582 #1419243 (400 connections now open) 2015-10-05T03:16:42.694+0100 [conn1419242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:42.694+0100 [conn1419243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:46.405+0100 [conn1418862] end connection 172.28.0.163:53939 (399 connections now open) 2015-10-05T03:16:46.406+0100 [mongosMain] connection accepted from 172.28.0.163:56590 #1419244 (400 connections now open) 2015-10-05T03:16:46.407+0100 [conn1419244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:51.506+0100 [conn1418603] end connection 172.28.0.164:61911 (399 connections now open) 2015-10-05T03:16:51.507+0100 [mongosMain] connection accepted from 172.28.0.164:49703 #1419245 (400 connections now open) 2015-10-05T03:16:51.509+0100 [conn1419245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:51.973+0100 [conn1418644] end connection 172.28.0.164:62024 (399 connections now open) 2015-10-05T03:16:51.974+0100 [mongosMain] connection accepted from 172.28.0.164:49706 #1419246 (400 connections now open) 2015-10-05T03:16:51.976+0100 [conn1419246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:52.697+0100 [conn1418674] end connection 172.28.0.163:52340 (399 connections now open) 2015-10-05T03:16:52.697+0100 [conn1418748] end connection 172.28.0.163:52560 (399 connections now open) 2015-10-05T03:16:52.698+0100 [mongosMain] connection accepted from 172.28.0.163:56597 #1419247 (399 connections now open) 2015-10-05T03:16:52.699+0100 [mongosMain] connection accepted from 172.28.0.163:56598 #1419248 (400 connections now open) 2015-10-05T03:16:52.700+0100 [conn1419247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:52.700+0100 [conn1419248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:52.879+0100 [conn1418878] end connection 172.28.0.164:63561 (399 connections now open) 2015-10-05T03:16:52.880+0100 [mongosMain] connection accepted from 172.28.0.164:49710 #1419249 (400 connections now open) 2015-10-05T03:16:52.882+0100 [conn1419249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:54.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dd965703b51053eaa5a3 2015-10-05T03:16:54.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:16:56.404+0100 [conn1418868] end connection 172.28.0.164:63385 (399 connections now open) 2015-10-05T03:16:56.405+0100 [mongosMain] connection accepted from 172.28.0.164:49715 #1419250 (400 connections now open) 2015-10-05T03:16:56.407+0100 [conn1419250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:16:56.420+0100 [conn1418869] end connection 172.28.0.163:53994 (399 connections now open) 2015-10-05T03:16:56.422+0100 [mongosMain] connection accepted from 172.28.0.163:56605 #1419251 (400 connections now open) 2015-10-05T03:16:56.423+0100 [conn1419251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:00.869+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:17:00.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:17:01.989+0100 [conn1418645] end connection 172.28.0.164:62025 (399 connections now open) 2015-10-05T03:17:01.990+0100 [mongosMain] connection accepted from 172.28.0.164:49725 #1419252 (400 connections now open) 2015-10-05T03:17:01.992+0100 [conn1419252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:02.709+0100 [conn1418749] end connection 172.28.0.163:52561 (399 connections now open) 2015-10-05T03:17:02.709+0100 [conn1418706] end connection 172.28.0.163:52488 (399 connections now open) 2015-10-05T03:17:02.710+0100 [mongosMain] connection accepted from 172.28.0.163:56626 #1419253 (399 connections now open) 2015-10-05T03:17:02.710+0100 [mongosMain] connection accepted from 172.28.0.163:56627 #1419254 (400 connections now open) 2015-10-05T03:17:02.711+0100 [conn1419253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:02.711+0100 [conn1419254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:05.232+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:17:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:17:06.404+0100 [conn1418864] end connection 172.28.0.164:63356 (399 connections now open) 2015-10-05T03:17:06.405+0100 [mongosMain] connection accepted from 172.28.0.164:49748 #1419255 (400 connections now open) 2015-10-05T03:17:06.407+0100 [conn1419255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:06.421+0100 [conn1418866] end connection 172.28.0.163:53950 (399 connections now open) 2015-10-05T03:17:06.423+0100 [mongosMain] connection accepted from 172.28.0.163:56651 #1419256 (400 connections now open) 2015-10-05T03:17:06.424+0100 [conn1419256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:07.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dda25703b51053eaa5e1 2015-10-05T03:17:07.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:17:12.005+0100 [conn1418646] end connection 172.28.0.164:62026 (399 connections now open) 2015-10-05T03:17:12.007+0100 [mongosMain] connection accepted from 172.28.0.164:49775 #1419257 (400 connections now open) 2015-10-05T03:17:12.009+0100 [conn1419257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:12.708+0100 [conn1418750] end connection 172.28.0.163:52563 (399 connections now open) 2015-10-05T03:17:12.708+0100 [conn1418707] end connection 172.28.0.163:52489 (399 connections now open) 2015-10-05T03:17:12.710+0100 [mongosMain] connection accepted from 172.28.0.163:56695 #1419258 (399 connections now open) 2015-10-05T03:17:12.710+0100 [mongosMain] connection accepted from 172.28.0.163:56696 #1419259 (400 connections now open) 2015-10-05T03:17:12.711+0100 [conn1419258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:12.711+0100 [conn1419259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:12.910+0100 [conn1418885] end connection 172.28.0.164:63589 (399 connections now open) 2015-10-05T03:17:12.911+0100 [mongosMain] connection accepted from 172.28.0.164:49778 #1419260 (400 connections now open) 2015-10-05T03:17:12.913+0100 [conn1419260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:13.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dda95703b51053eaa5f5 2015-10-05T03:17:13.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:17:16.420+0100 [conn1418883] end connection 172.28.0.164:63582 (399 connections now open) 2015-10-05T03:17:16.421+0100 [mongosMain] connection accepted from 172.28.0.164:49804 #1419261 (400 connections now open) 2015-10-05T03:17:16.423+0100 [conn1419261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:16.436+0100 [conn1418881] end connection 172.28.0.163:54134 (399 connections now open) 2015-10-05T03:17:16.437+0100 [conn1418880] end connection 172.28.0.163:54133 (398 connections now open) 2015-10-05T03:17:16.437+0100 [mongosMain] connection accepted from 172.28.0.163:56717 #1419262 (399 connections now open) 2015-10-05T03:17:16.438+0100 [mongosMain] connection accepted from 172.28.0.163:56718 #1419263 (400 connections now open) 2015-10-05T03:17:16.438+0100 [conn1419262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:16.439+0100 [conn1419263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:22.021+0100 [conn1418647] end connection 172.28.0.164:62027 (399 connections now open) 2015-10-05T03:17:22.022+0100 [mongosMain] connection accepted from 172.28.0.164:49842 #1419264 (400 connections now open) 2015-10-05T03:17:22.024+0100 [conn1419264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:22.724+0100 [conn1418751] end connection 172.28.0.163:52564 (399 connections now open) 2015-10-05T03:17:22.724+0100 [conn1418711] end connection 172.28.0.163:52493 (399 connections now open) 2015-10-05T03:17:22.725+0100 [mongosMain] connection accepted from 172.28.0.163:56749 #1419265 (399 connections now open) 2015-10-05T03:17:22.725+0100 [mongosMain] connection accepted from 172.28.0.163:56750 #1419266 (400 connections now open) 2015-10-05T03:17:22.726+0100 [conn1419265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:22.727+0100 [conn1419266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:22.925+0100 [conn1418890] end connection 172.28.0.164:63667 (399 connections now open) 2015-10-05T03:17:22.926+0100 [mongosMain] connection accepted from 172.28.0.164:49852 #1419267 (400 connections now open) 2015-10-05T03:17:22.928+0100 [conn1419267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:26.435+0100 [conn1418872] end connection 172.28.0.164:63449 (399 connections now open) 2015-10-05T03:17:26.436+0100 [mongosMain] connection accepted from 172.28.0.164:49877 #1419268 (400 connections now open) 2015-10-05T03:17:26.437+0100 [conn1418893] end connection 172.28.0.163:54253 (399 connections now open) 2015-10-05T03:17:26.437+0100 [conn1418887] end connection 172.28.0.163:54158 (398 connections now open) 2015-10-05T03:17:26.438+0100 [conn1419268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:26.439+0100 [mongosMain] connection accepted from 172.28.0.163:56782 #1419269 (399 connections now open) 2015-10-05T03:17:26.439+0100 [mongosMain] connection accepted from 172.28.0.163:56783 #1419270 (400 connections now open) 2015-10-05T03:17:26.439+0100 [conn1419269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:26.440+0100 [conn1419270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:28.983+0100 [mongosMain] connection accepted from 127.0.0.1:56799 #1419271 (401 connections now open) 2015-10-05T03:17:28.986+0100 [conn1419271] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:28.991+0100 [conn1419271] end connection 127.0.0.1:56799 (400 connections now open) 2015-10-05T03:17:31.553+0100 [conn1418589] end connection 172.28.0.164:61890 (399 connections now open) 2015-10-05T03:17:31.555+0100 [mongosMain] connection accepted from 172.28.0.164:49917 #1419272 (400 connections now open) 2015-10-05T03:17:31.557+0100 [conn1419272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:31.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ddbb5703b51053eaa628 2015-10-05T03:17:31.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:17:32.020+0100 [conn1418648] end connection 172.28.0.164:62028 (399 connections now open) 2015-10-05T03:17:32.021+0100 [mongosMain] connection accepted from 172.28.0.164:49922 #1419273 (400 connections now open) 2015-10-05T03:17:32.023+0100 [conn1419273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:32.725+0100 [conn1418752] end connection 172.28.0.163:52566 (399 connections now open) 2015-10-05T03:17:32.727+0100 [mongosMain] connection accepted from 172.28.0.163:56835 #1419274 (400 connections now open) 2015-10-05T03:17:32.728+0100 [conn1419274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:32.901+0100 [conn1418686] end connection 172.28.0.163:52359 (399 connections now open) 2015-10-05T03:17:32.904+0100 [mongosMain] connection accepted from 172.28.0.163:56837 #1419275 (400 connections now open) 2015-10-05T03:17:32.907+0100 [conn1419275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:32.941+0100 [conn1418894] end connection 172.28.0.164:63733 (399 connections now open) 2015-10-05T03:17:32.942+0100 [mongosMain] connection accepted from 172.28.0.164:49930 #1419276 (400 connections now open) 2015-10-05T03:17:32.945+0100 [conn1419276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:35.509+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:17:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:17:36.451+0100 [conn1418879] end connection 172.28.0.164:63567 (399 connections now open) 2015-10-05T03:17:36.451+0100 [mongosMain] connection accepted from 172.28.0.164:49942 #1419277 (400 connections now open) 2015-10-05T03:17:36.452+0100 [conn1418896] end connection 172.28.0.163:54293 (399 connections now open) 2015-10-05T03:17:36.452+0100 [conn1418884] end connection 172.28.0.163:54145 (398 connections now open) 2015-10-05T03:17:36.454+0100 [mongosMain] connection accepted from 172.28.0.163:56845 #1419278 (399 connections now open) 2015-10-05T03:17:36.455+0100 [mongosMain] connection accepted from 172.28.0.163:56847 #1419279 (400 connections now open) 2015-10-05T03:17:36.455+0100 [conn1419277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:36.455+0100 [conn1419278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:36.456+0100 [conn1419279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:39.216+0100 [mongosMain] connection accepted from 127.0.0.1:56849 #1419280 (401 connections now open) 2015-10-05T03:17:39.219+0100 [conn1419280] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:39.223+0100 [conn1419280] end connection 127.0.0.1:56849 (400 connections now open) 2015-10-05T03:17:41.553+0100 [conn1418605] end connection 172.28.0.164:61918 (399 connections now open) 2015-10-05T03:17:41.554+0100 [mongosMain] connection accepted from 172.28.0.164:49948 #1419281 (400 connections now open) 2015-10-05T03:17:41.555+0100 [conn1419281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:42.021+0100 [conn1418649] end connection 172.28.0.164:62029 (399 connections now open) 2015-10-05T03:17:42.022+0100 [mongosMain] connection accepted from 172.28.0.164:49950 #1419282 (400 connections now open) 2015-10-05T03:17:42.024+0100 [conn1419282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:42.739+0100 [conn1418753] end connection 172.28.0.163:52567 (399 connections now open) 2015-10-05T03:17:42.740+0100 [mongosMain] connection accepted from 172.28.0.163:56852 #1419283 (400 connections now open) 2015-10-05T03:17:42.741+0100 [conn1419283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:44.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ddc75703b51053eaa64a 2015-10-05T03:17:44.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:17:46.451+0100 [conn1418886] end connection 172.28.0.164:63594 (399 connections now open) 2015-10-05T03:17:46.452+0100 [conn1418889] end connection 172.28.0.163:54193 (398 connections now open) 2015-10-05T03:17:46.452+0100 [conn1418901] end connection 172.28.0.163:54336 (397 connections now open) 2015-10-05T03:17:46.452+0100 [mongosMain] connection accepted from 172.28.0.164:49959 #1419284 (398 connections now open) 2015-10-05T03:17:46.454+0100 [mongosMain] connection accepted from 172.28.0.163:56858 #1419285 (399 connections now open) 2015-10-05T03:17:46.454+0100 [mongosMain] connection accepted from 172.28.0.163:56860 #1419286 (400 connections now open) 2015-10-05T03:17:46.454+0100 [conn1419284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:46.455+0100 [conn1419285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:46.455+0100 [conn1419286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:52.037+0100 [conn1418650] end connection 172.28.0.164:62030 (399 connections now open) 2015-10-05T03:17:52.038+0100 [mongosMain] connection accepted from 172.28.0.164:49965 #1419287 (400 connections now open) 2015-10-05T03:17:52.040+0100 [conn1419287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:52.755+0100 [conn1418754] end connection 172.28.0.163:52569 (399 connections now open) 2015-10-05T03:17:52.757+0100 [mongosMain] connection accepted from 172.28.0.163:56868 #1419288 (400 connections now open) 2015-10-05T03:17:52.757+0100 [conn1419288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:52.972+0100 [conn1418899] end connection 172.28.0.164:63803 (399 connections now open) 2015-10-05T03:17:52.973+0100 [mongosMain] connection accepted from 172.28.0.164:49969 #1419289 (400 connections now open) 2015-10-05T03:17:52.975+0100 [conn1419289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:56.451+0100 [conn1418875] end connection 172.28.0.164:63514 (399 connections now open) 2015-10-05T03:17:56.452+0100 [mongosMain] connection accepted from 172.28.0.164:49973 #1419290 (400 connections now open) 2015-10-05T03:17:56.454+0100 [conn1419290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:56.468+0100 [conn1418906] end connection 172.28.0.163:54350 (399 connections now open) 2015-10-05T03:17:56.468+0100 [conn1418892] end connection 172.28.0.163:54252 (398 connections now open) 2015-10-05T03:17:56.469+0100 [mongosMain] connection accepted from 172.28.0.163:56875 #1419291 (399 connections now open) 2015-10-05T03:17:56.469+0100 [mongosMain] connection accepted from 172.28.0.163:56876 #1419292 (400 connections now open) 2015-10-05T03:17:56.470+0100 [conn1419291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:56.470+0100 [conn1419292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:17:56.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ddd45703b51053eaa677 2015-10-05T03:17:56.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:18:02.053+0100 [conn1418655] end connection 172.28.0.164:62035 (399 connections now open) 2015-10-05T03:18:02.054+0100 [mongosMain] connection accepted from 172.28.0.164:49981 #1419293 (400 connections now open) 2015-10-05T03:18:02.055+0100 [conn1419293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:02.760+0100 [conn1418755] end connection 172.28.0.163:52571 (399 connections now open) 2015-10-05T03:18:02.761+0100 [mongosMain] connection accepted from 172.28.0.163:56899 #1419294 (400 connections now open) 2015-10-05T03:18:02.762+0100 [conn1419294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:02.988+0100 [conn1418907] end connection 172.28.0.164:63842 (399 connections now open) 2015-10-05T03:18:02.989+0100 [mongosMain] connection accepted from 172.28.0.164:49986 #1419295 (400 connections now open) 2015-10-05T03:18:02.991+0100 [conn1419295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:05.764+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:18:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:18:06.469+0100 [conn1418888] end connection 172.28.0.164:63633 (399 connections now open) 2015-10-05T03:18:06.470+0100 [mongosMain] connection accepted from 172.28.0.164:50005 #1419296 (400 connections now open) 2015-10-05T03:18:06.472+0100 [conn1419296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:08.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dde05703b51053eaa6b6 2015-10-05T03:18:08.990+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:18:12.771+0100 [conn1418756] end connection 172.28.0.163:52572 (399 connections now open) 2015-10-05T03:18:12.772+0100 [mongosMain] connection accepted from 172.28.0.163:56968 #1419297 (400 connections now open) 2015-10-05T03:18:12.773+0100 [conn1419297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:13.006+0100 [conn1418910] end connection 172.28.0.164:63859 (399 connections now open) 2015-10-05T03:18:13.008+0100 [mongosMain] connection accepted from 172.28.0.164:50035 #1419298 (400 connections now open) 2015-10-05T03:18:13.010+0100 [conn1419298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:16.482+0100 [conn1418900] end connection 172.28.0.164:63818 (399 connections now open) 2015-10-05T03:18:16.483+0100 [mongosMain] connection accepted from 172.28.0.164:50062 #1419299 (400 connections now open) 2015-10-05T03:18:16.484+0100 [conn1418909] end connection 172.28.0.163:54362 (399 connections now open) 2015-10-05T03:18:16.486+0100 [conn1419299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:16.486+0100 [mongosMain] connection accepted from 172.28.0.163:56991 #1419300 (400 connections now open) 2015-10-05T03:18:16.487+0100 [conn1419300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:21.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dded5703b51053eaa6e9 2015-10-05T03:18:21.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:18:23.004+0100 [conn1418911] end connection 172.28.0.164:63906 (399 connections now open) 2015-10-05T03:18:23.005+0100 [mongosMain] connection accepted from 172.28.0.164:50098 #1419301 (400 connections now open) 2015-10-05T03:18:23.007+0100 [conn1419301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:26.500+0100 [conn1418895] end connection 172.28.0.164:63757 (399 connections now open) 2015-10-05T03:18:26.500+0100 [mongosMain] connection accepted from 172.28.0.164:50118 #1419302 (400 connections now open) 2015-10-05T03:18:26.500+0100 [conn1419302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:26.531+0100 [conn1418913] end connection 172.28.0.163:54466 (399 connections now open) 2015-10-05T03:18:26.531+0100 [mongosMain] connection accepted from 172.28.0.163:57038 #1419303 (400 connections now open) 2015-10-05T03:18:26.531+0100 [conn1419303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:27.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ddf35703b51053eaa708 2015-10-05T03:18:27.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:18:28.513+0100 [mongosMain] connection accepted from 127.0.0.1:57053 #1419304 (401 connections now open) 2015-10-05T03:18:28.513+0100 [conn1419304] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:28.513+0100 [conn1419304] end connection 127.0.0.1:57053 (400 connections now open) 2015-10-05T03:18:33.005+0100 [conn1418914] end connection 172.28.0.164:63962 (399 connections now open) 2015-10-05T03:18:33.006+0100 [mongosMain] connection accepted from 172.28.0.164:50175 #1419305 (400 connections now open) 2015-10-05T03:18:33.007+0100 [conn1419305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:36.014+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:18:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:18:36.501+0100 [conn1418897] end connection 172.28.0.163:54294 (399 connections now open) 2015-10-05T03:18:36.501+0100 [conn1418915] end connection 172.28.0.163:54526 (398 connections now open) 2015-10-05T03:18:36.502+0100 [mongosMain] connection accepted from 172.28.0.163:57091 #1419306 (399 connections now open) 2015-10-05T03:18:36.502+0100 [mongosMain] connection accepted from 172.28.0.163:57092 #1419307 (400 connections now open) 2015-10-05T03:18:36.503+0100 [conn1419306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:36.503+0100 [conn1419307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:40.073+0100 [mongosMain] connection accepted from 127.0.0.1:57095 #1419308 (401 connections now open) 2015-10-05T03:18:40.075+0100 [conn1419308] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:40.079+0100 [conn1419308] end connection 127.0.0.1:57095 (400 connections now open) 2015-10-05T03:18:43.019+0100 [conn1418918] end connection 172.28.0.164:64026 (399 connections now open) 2015-10-05T03:18:43.020+0100 [mongosMain] connection accepted from 172.28.0.164:50206 #1419309 (400 connections now open) 2015-10-05T03:18:43.021+0100 [conn1419309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:46.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de055703b51053eaa752 2015-10-05T03:18:46.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:18:46.515+0100 [conn1418919] end connection 172.28.0.163:54589 (399 connections now open) 2015-10-05T03:18:46.515+0100 [conn1418905] end connection 172.28.0.163:54349 (398 connections now open) 2015-10-05T03:18:46.517+0100 [mongosMain] connection accepted from 172.28.0.163:57104 #1419310 (399 connections now open) 2015-10-05T03:18:46.517+0100 [mongosMain] connection accepted from 172.28.0.163:57105 #1419311 (400 connections now open) 2015-10-05T03:18:46.518+0100 [conn1419310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:46.519+0100 [conn1419311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:53.019+0100 [conn1418922] end connection 172.28.0.164:64055 (399 connections now open) 2015-10-05T03:18:53.020+0100 [mongosMain] connection accepted from 172.28.0.164:50217 #1419312 (400 connections now open) 2015-10-05T03:18:53.022+0100 [conn1419312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:56.516+0100 [conn1418924] end connection 172.28.0.163:54601 (399 connections now open) 2015-10-05T03:18:56.516+0100 [conn1418920] end connection 172.28.0.163:54590 (398 connections now open) 2015-10-05T03:18:56.518+0100 [mongosMain] connection accepted from 172.28.0.163:57118 #1419313 (399 connections now open) 2015-10-05T03:18:56.518+0100 [mongosMain] connection accepted from 172.28.0.163:57120 #1419314 (400 connections now open) 2015-10-05T03:18:56.519+0100 [conn1419313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:18:56.520+0100 [conn1419314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:03.035+0100 [conn1418925] end connection 172.28.0.164:64067 (399 connections now open) 2015-10-05T03:19:03.036+0100 [mongosMain] connection accepted from 172.28.0.164:50255 #1419315 (400 connections now open) 2015-10-05T03:19:03.037+0100 [conn1419315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:04.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de185703b51053eaa7af 2015-10-05T03:19:04.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:06.272+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:19:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:19:06.531+0100 [conn1418927] end connection 172.28.0.163:54614 (399 connections now open) 2015-10-05T03:19:06.531+0100 [conn1418902] end connection 172.28.0.163:54337 (398 connections now open) 2015-10-05T03:19:06.532+0100 [mongosMain] connection accepted from 172.28.0.163:57170 #1419316 (399 connections now open) 2015-10-05T03:19:06.533+0100 [mongosMain] connection accepted from 172.28.0.163:57172 #1419317 (400 connections now open) 2015-10-05T03:19:06.533+0100 [conn1419316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:06.534+0100 [conn1419317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:06.545+0100 [conn1418908] end connection 172.28.0.164:63847 (399 connections now open) 2015-10-05T03:19:06.546+0100 [mongosMain] connection accepted from 172.28.0.164:50277 #1419318 (400 connections now open) 2015-10-05T03:19:06.548+0100 [conn1419318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:10.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de1e5703b51053eaa7ca 2015-10-05T03:19:11.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:11.647+0100 [conn1418583] end connection 172.28.0.164:61884 (399 connections now open) 2015-10-05T03:19:11.648+0100 [mongosMain] connection accepted from 172.28.0.164:50337 #1419319 (400 connections now open) 2015-10-05T03:19:11.650+0100 [conn1419319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:12.818+0100 [conn1418758] end connection 172.28.0.163:52575 (399 connections now open) 2015-10-05T03:19:12.819+0100 [mongosMain] connection accepted from 172.28.0.163:57208 #1419320 (400 connections now open) 2015-10-05T03:19:12.821+0100 [conn1419320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:16.532+0100 [conn1418932] end connection 172.28.0.163:54658 (399 connections now open) 2015-10-05T03:19:16.532+0100 [conn1418912] end connection 172.28.0.163:54465 (398 connections now open) 2015-10-05T03:19:16.533+0100 [mongosMain] connection accepted from 172.28.0.163:57234 #1419321 (399 connections now open) 2015-10-05T03:19:16.533+0100 [mongosMain] connection accepted from 172.28.0.163:57235 #1419322 (400 connections now open) 2015-10-05T03:19:16.534+0100 [conn1419321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:16.534+0100 [conn1419322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:16.561+0100 [conn1418904] end connection 172.28.0.164:63834 (399 connections now open) 2015-10-05T03:19:16.563+0100 [mongosMain] connection accepted from 172.28.0.164:50407 #1419323 (400 connections now open) 2015-10-05T03:19:16.564+0100 [conn1419323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:17.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de255703b51053eaa7d8 2015-10-05T03:19:17.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:21.662+0100 [conn1418593] end connection 172.28.0.164:61894 (399 connections now open) 2015-10-05T03:19:21.664+0100 [mongosMain] connection accepted from 172.28.0.164:50483 #1419324 (400 connections now open) 2015-10-05T03:19:21.666+0100 [conn1419324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:22.114+0100 [conn1418651] end connection 172.28.0.164:62031 (399 connections now open) 2015-10-05T03:19:22.115+0100 [mongosMain] connection accepted from 172.28.0.164:50494 #1419325 (400 connections now open) 2015-10-05T03:19:22.116+0100 [conn1419325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:22.833+0100 [conn1418658] end connection 172.28.0.163:52324 (399 connections now open) 2015-10-05T03:19:22.834+0100 [mongosMain] connection accepted from 172.28.0.163:57281 #1419326 (400 connections now open) 2015-10-05T03:19:22.835+0100 [conn1419326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:23.066+0100 [conn1418929] end connection 172.28.0.164:64083 (399 connections now open) 2015-10-05T03:19:23.067+0100 [mongosMain] connection accepted from 172.28.0.164:50512 #1419327 (400 connections now open) 2015-10-05T03:19:23.068+0100 [conn1419327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:23.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de2b5703b51053eaa7e5 2015-10-05T03:19:23.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:26.548+0100 [conn1418931] end connection 172.28.0.163:54657 (399 connections now open) 2015-10-05T03:19:26.548+0100 [conn1418935] end connection 172.28.0.163:54717 (399 connections now open) 2015-10-05T03:19:26.548+0100 [mongosMain] connection accepted from 172.28.0.163:57299 #1419328 (399 connections now open) 2015-10-05T03:19:26.549+0100 [mongosMain] connection accepted from 172.28.0.163:57300 #1419329 (400 connections now open) 2015-10-05T03:19:26.550+0100 [conn1419328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:26.550+0100 [conn1419329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:26.561+0100 [conn1418891] end connection 172.28.0.164:63687 (399 connections now open) 2015-10-05T03:19:26.562+0100 [mongosMain] connection accepted from 172.28.0.164:50561 #1419330 (400 connections now open) 2015-10-05T03:19:26.564+0100 [conn1419330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:28.527+0100 [mongosMain] connection accepted from 127.0.0.1:57317 #1419331 (401 connections now open) 2015-10-05T03:19:28.529+0100 [conn1419331] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:28.535+0100 [conn1419331] end connection 127.0.0.1:57317 (400 connections now open) 2015-10-05T03:19:30.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de315703b51053eaa7fb 2015-10-05T03:19:30.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:31.678+0100 [conn1418567] end connection 172.28.0.164:61804 (399 connections now open) 2015-10-05T03:19:31.679+0100 [mongosMain] connection accepted from 172.28.0.164:50663 #1419332 (400 connections now open) 2015-10-05T03:19:31.681+0100 [conn1419332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:33.082+0100 [conn1418936] end connection 172.28.0.164:64182 (399 connections now open) 2015-10-05T03:19:33.090+0100 [mongosMain] connection accepted from 172.28.0.164:50668 #1419333 (400 connections now open) 2015-10-05T03:19:33.092+0100 [conn1419333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:36.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de385703b51053eaa80a 2015-10-05T03:19:36.424+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:19:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:19:36.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:36.547+0100 [conn1418937] end connection 172.28.0.163:54780 (399 connections now open) 2015-10-05T03:19:36.547+0100 [conn1418928] end connection 172.28.0.163:54615 (398 connections now open) 2015-10-05T03:19:36.549+0100 [mongosMain] connection accepted from 172.28.0.163:57337 #1419334 (399 connections now open) 2015-10-05T03:19:36.550+0100 [mongosMain] connection accepted from 172.28.0.163:57338 #1419335 (400 connections now open) 2015-10-05T03:19:36.551+0100 [conn1419335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:36.552+0100 [conn1419334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:36.577+0100 [conn1418930] end connection 172.28.0.164:64099 (399 connections now open) 2015-10-05T03:19:36.578+0100 [mongosMain] connection accepted from 172.28.0.164:50674 #1419336 (400 connections now open) 2015-10-05T03:19:36.580+0100 [conn1419336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:39.331+0100 [mongosMain] connection accepted from 127.0.0.1:57342 #1419337 (401 connections now open) 2015-10-05T03:19:39.333+0100 [conn1419337] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:39.338+0100 [conn1419337] end connection 127.0.0.1:57342 (400 connections now open) 2015-10-05T03:19:42.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de3e5703b51053eaa81f 2015-10-05T03:19:42.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:43.097+0100 [conn1418940] end connection 172.28.0.164:64245 (399 connections now open) 2015-10-05T03:19:43.098+0100 [mongosMain] connection accepted from 172.28.0.164:50686 #1419338 (400 connections now open) 2015-10-05T03:19:43.100+0100 [conn1419338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:46.563+0100 [conn1418916] end connection 172.28.0.163:54527 (399 connections now open) 2015-10-05T03:19:46.563+0100 [conn1418942] end connection 172.28.0.163:54833 (399 connections now open) 2015-10-05T03:19:46.565+0100 [mongosMain] connection accepted from 172.28.0.163:57351 #1419339 (399 connections now open) 2015-10-05T03:19:46.565+0100 [mongosMain] connection accepted from 172.28.0.163:57352 #1419340 (400 connections now open) 2015-10-05T03:19:46.566+0100 [conn1419339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:46.566+0100 [conn1419340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:46.592+0100 [conn1418933] end connection 172.28.0.164:64142 (399 connections now open) 2015-10-05T03:19:46.593+0100 [mongosMain] connection accepted from 172.28.0.164:50692 #1419341 (400 connections now open) 2015-10-05T03:19:46.595+0100 [conn1419341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:48.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de445703b51053eaa834 2015-10-05T03:19:49.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:53.098+0100 [conn1418945] end connection 172.28.0.164:64280 (399 connections now open) 2015-10-05T03:19:53.099+0100 [mongosMain] connection accepted from 172.28.0.164:50726 #1419342 (400 connections now open) 2015-10-05T03:19:53.101+0100 [conn1419342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:55.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de4b5703b51053eaa84c 2015-10-05T03:19:55.300+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:19:56.578+0100 [conn1418923] end connection 172.28.0.163:54600 (399 connections now open) 2015-10-05T03:19:56.578+0100 [conn1418947] end connection 172.28.0.163:54847 (399 connections now open) 2015-10-05T03:19:56.579+0100 [mongosMain] connection accepted from 172.28.0.163:57364 #1419343 (399 connections now open) 2015-10-05T03:19:56.579+0100 [mongosMain] connection accepted from 172.28.0.163:57365 #1419344 (400 connections now open) 2015-10-05T03:19:56.580+0100 [conn1419343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:56.580+0100 [conn1419344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:19:56.608+0100 [conn1418926] end connection 172.28.0.164:64074 (399 connections now open) 2015-10-05T03:19:56.622+0100 [mongosMain] connection accepted from 172.28.0.164:50740 #1419345 (400 connections now open) 2015-10-05T03:19:56.623+0100 [conn1419345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:01.584+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de515703b51053eaa85d 2015-10-05T03:20:01.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:20:03.113+0100 [conn1418949] end connection 172.28.0.164:64293 (399 connections now open) 2015-10-05T03:20:03.114+0100 [mongosMain] connection accepted from 172.28.0.164:50752 #1419346 (400 connections now open) 2015-10-05T03:20:03.116+0100 [conn1419346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:06.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:20:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:20:06.579+0100 [conn1418934] end connection 172.28.0.163:54716 (399 connections now open) 2015-10-05T03:20:06.579+0100 [conn1418951] end connection 172.28.0.163:54860 (399 connections now open) 2015-10-05T03:20:06.580+0100 [mongosMain] connection accepted from 172.28.0.163:57407 #1419347 (399 connections now open) 2015-10-05T03:20:06.580+0100 [mongosMain] connection accepted from 172.28.0.163:57408 #1419348 (400 connections now open) 2015-10-05T03:20:06.581+0100 [conn1419347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:06.582+0100 [conn1419348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:06.624+0100 [conn1418946] end connection 172.28.0.164:64286 (399 connections now open) 2015-10-05T03:20:06.625+0100 [mongosMain] connection accepted from 172.28.0.164:50770 #1419349 (400 connections now open) 2015-10-05T03:20:06.627+0100 [conn1419349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:13.129+0100 [conn1418953] end connection 172.28.0.164:64306 (399 connections now open) 2015-10-05T03:20:13.130+0100 [mongosMain] connection accepted from 172.28.0.164:50803 #1419350 (400 connections now open) 2015-10-05T03:20:13.132+0100 [conn1419350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:16.594+0100 [conn1418956] end connection 172.28.0.163:54913 (399 connections now open) 2015-10-05T03:20:16.594+0100 [conn1418948] end connection 172.28.0.163:54846 (399 connections now open) 2015-10-05T03:20:16.595+0100 [mongosMain] connection accepted from 172.28.0.163:57469 #1419351 (399 connections now open) 2015-10-05T03:20:16.595+0100 [mongosMain] connection accepted from 172.28.0.163:57470 #1419352 (400 connections now open) 2015-10-05T03:20:16.596+0100 [conn1419351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:16.596+0100 [conn1419352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:16.640+0100 [conn1418941] end connection 172.28.0.164:64271 (399 connections now open) 2015-10-05T03:20:16.642+0100 [mongosMain] connection accepted from 172.28.0.164:50828 #1419353 (400 connections now open) 2015-10-05T03:20:16.643+0100 [conn1419353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:22.881+0100 [conn1418713] end connection 172.28.0.163:52495 (399 connections now open) 2015-10-05T03:20:22.882+0100 [mongosMain] connection accepted from 172.28.0.163:57517 #1419354 (400 connections now open) 2015-10-05T03:20:22.884+0100 [conn1419354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:23.145+0100 [conn1418957] end connection 172.28.0.164:64357 (399 connections now open) 2015-10-05T03:20:23.146+0100 [mongosMain] connection accepted from 172.28.0.164:50880 #1419355 (400 connections now open) 2015-10-05T03:20:23.148+0100 [conn1419355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:26.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de695703b51053eaa8b3 2015-10-05T03:20:26.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:20:26.595+0100 [conn1418959] end connection 172.28.0.163:54965 (399 connections now open) 2015-10-05T03:20:26.597+0100 [mongosMain] connection accepted from 172.28.0.163:57535 #1419356 (400 connections now open) 2015-10-05T03:20:26.598+0100 [conn1419356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:26.656+0100 [conn1418950] end connection 172.28.0.164:64296 (399 connections now open) 2015-10-05T03:20:26.657+0100 [mongosMain] connection accepted from 172.28.0.164:50896 #1419357 (400 connections now open) 2015-10-05T03:20:26.658+0100 [conn1419357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:28.504+0100 [mongosMain] connection accepted from 127.0.0.1:57551 #1419358 (401 connections now open) 2015-10-05T03:20:28.507+0100 [conn1419358] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:28.513+0100 [conn1419358] end connection 127.0.0.1:57551 (400 connections now open) 2015-10-05T03:20:31.740+0100 [conn1418585] end connection 172.28.0.164:61886 (399 connections now open) 2015-10-05T03:20:31.741+0100 [mongosMain] connection accepted from 172.28.0.164:50939 #1419359 (400 connections now open) 2015-10-05T03:20:31.743+0100 [conn1419359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:32.896+0100 [conn1418760] end connection 172.28.0.163:52578 (399 connections now open) 2015-10-05T03:20:32.896+0100 [conn1418677] end connection 172.28.0.163:52343 (399 connections now open) 2015-10-05T03:20:32.897+0100 [mongosMain] connection accepted from 172.28.0.163:57571 #1419360 (399 connections now open) 2015-10-05T03:20:32.897+0100 [mongosMain] connection accepted from 172.28.0.163:57572 #1419361 (400 connections now open) 2015-10-05T03:20:32.898+0100 [conn1419360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:32.898+0100 [conn1419361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:36.611+0100 [conn1418964] end connection 172.28.0.163:55020 (399 connections now open) 2015-10-05T03:20:36.612+0100 [conn1418965] end connection 172.28.0.163:55021 (398 connections now open) 2015-10-05T03:20:36.613+0100 [mongosMain] connection accepted from 172.28.0.163:57574 #1419362 (399 connections now open) 2015-10-05T03:20:36.613+0100 [mongosMain] connection accepted from 172.28.0.163:57575 #1419363 (400 connections now open) 2015-10-05T03:20:36.614+0100 [conn1419362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:36.614+0100 [conn1419363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:36.693+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:20:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:20:38.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de765703b51053eaa8e7 2015-10-05T03:20:38.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:20:39.679+0100 [mongosMain] connection accepted from 127.0.0.1:57577 #1419364 (401 connections now open) 2015-10-05T03:20:39.681+0100 [conn1419364] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:39.686+0100 [conn1419364] end connection 127.0.0.1:57577 (400 connections now open) 2015-10-05T03:20:41.756+0100 [conn1418555] end connection 172.28.0.164:61792 (399 connections now open) 2015-10-05T03:20:41.758+0100 [mongosMain] connection accepted from 172.28.0.164:50957 #1419365 (400 connections now open) 2015-10-05T03:20:41.760+0100 [conn1419365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:42.209+0100 [conn1418654] end connection 172.28.0.164:62034 (399 connections now open) 2015-10-05T03:20:42.210+0100 [mongosMain] connection accepted from 172.28.0.164:50960 #1419366 (400 connections now open) 2015-10-05T03:20:42.212+0100 [conn1419366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:42.897+0100 [conn1418757] end connection 172.28.0.163:52574 (399 connections now open) 2015-10-05T03:20:42.897+0100 [conn1418709] end connection 172.28.0.163:52491 (398 connections now open) 2015-10-05T03:20:42.899+0100 [mongosMain] connection accepted from 172.28.0.163:57581 #1419367 (399 connections now open) 2015-10-05T03:20:42.899+0100 [mongosMain] connection accepted from 172.28.0.163:57580 #1419368 (400 connections now open) 2015-10-05T03:20:42.900+0100 [conn1419368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:42.900+0100 [conn1419367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:43.176+0100 [conn1418962] end connection 172.28.0.164:64418 (399 connections now open) 2015-10-05T03:20:43.177+0100 [mongosMain] connection accepted from 172.28.0.164:50963 #1419369 (400 connections now open) 2015-10-05T03:20:43.179+0100 [conn1419369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:44.578+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:20:44.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:20:46.610+0100 [conn1418972] end connection 172.28.0.163:55079 (399 connections now open) 2015-10-05T03:20:46.610+0100 [conn1418943] end connection 172.28.0.163:54834 (399 connections now open) 2015-10-05T03:20:46.611+0100 [mongosMain] connection accepted from 172.28.0.163:57589 #1419370 (399 connections now open) 2015-10-05T03:20:46.611+0100 [mongosMain] connection accepted from 172.28.0.163:57590 #1419371 (400 connections now open) 2015-10-05T03:20:46.612+0100 [conn1419370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:46.612+0100 [conn1419371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:46.686+0100 [conn1418963] end connection 172.28.0.164:64438 (399 connections now open) 2015-10-05T03:20:46.688+0100 [mongosMain] connection accepted from 172.28.0.164:50970 #1419372 (400 connections now open) 2015-10-05T03:20:46.689+0100 [conn1419372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:50.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de825703b51053eaa929 2015-10-05T03:20:50.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:20:51.757+0100 [conn1418967] end connection 172.28.0.164:64466 (399 connections now open) 2015-10-05T03:20:51.758+0100 [mongosMain] connection accepted from 172.28.0.164:50974 #1419373 (400 connections now open) 2015-10-05T03:20:51.760+0100 [conn1419373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:52.225+0100 [conn1418652] end connection 172.28.0.164:62032 (399 connections now open) 2015-10-05T03:20:52.226+0100 [mongosMain] connection accepted from 172.28.0.164:50976 #1419374 (400 connections now open) 2015-10-05T03:20:52.228+0100 [conn1419374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:52.912+0100 [conn1418969] end connection 172.28.0.163:55065 (399 connections now open) 2015-10-05T03:20:52.913+0100 [mongosMain] connection accepted from 172.28.0.163:57597 #1419375 (400 connections now open) 2015-10-05T03:20:52.914+0100 [conn1419375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:53.192+0100 [conn1418978] end connection 172.28.0.164:64510 (399 connections now open) 2015-10-05T03:20:53.193+0100 [mongosMain] connection accepted from 172.28.0.164:50980 #1419376 (400 connections now open) 2015-10-05T03:20:53.194+0100 [conn1419376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:56.626+0100 [conn1418938] end connection 172.28.0.163:54781 (399 connections now open) 2015-10-05T03:20:56.627+0100 [conn1418981] end connection 172.28.0.163:55093 (399 connections now open) 2015-10-05T03:20:56.627+0100 [mongosMain] connection accepted from 172.28.0.163:57602 #1419377 (399 connections now open) 2015-10-05T03:20:56.628+0100 [mongosMain] connection accepted from 172.28.0.163:57603 #1419378 (400 connections now open) 2015-10-05T03:20:56.628+0100 [conn1419377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:56.629+0100 [conn1419378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:56.703+0100 [conn1418958] end connection 172.28.0.164:64374 (399 connections now open) 2015-10-05T03:20:56.704+0100 [mongosMain] connection accepted from 172.28.0.164:50984 #1419379 (400 connections now open) 2015-10-05T03:20:56.706+0100 [conn1419379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:20:57.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de885703b51053eaa946 2015-10-05T03:20:57.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:01.772+0100 [conn1418560] end connection 172.28.0.164:61797 (399 connections now open) 2015-10-05T03:21:01.773+0100 [mongosMain] connection accepted from 172.28.0.164:51016 #1419380 (400 connections now open) 2015-10-05T03:21:01.775+0100 [conn1419380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:02.240+0100 [conn1418968] end connection 172.28.0.164:64471 (399 connections now open) 2015-10-05T03:21:02.242+0100 [mongosMain] connection accepted from 172.28.0.164:51019 #1419381 (400 connections now open) 2015-10-05T03:21:02.244+0100 [conn1419381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:02.914+0100 [conn1418993] end connection 172.28.0.163:55128 (399 connections now open) 2015-10-05T03:21:02.915+0100 [mongosMain] connection accepted from 172.28.0.163:57630 #1419382 (400 connections now open) 2015-10-05T03:21:02.916+0100 [conn1419382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:03.207+0100 [conn1418986] end connection 172.28.0.164:64527 (399 connections now open) 2015-10-05T03:21:03.208+0100 [mongosMain] connection accepted from 172.28.0.164:51024 #1419383 (400 connections now open) 2015-10-05T03:21:03.210+0100 [conn1419383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:03.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de8f5703b51053eaa96c 2015-10-05T03:21:03.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:06.642+0100 [conn1418989] end connection 172.28.0.163:55111 (399 connections now open) 2015-10-05T03:21:06.642+0100 [conn1418960] end connection 172.28.0.163:54966 (399 connections now open) 2015-10-05T03:21:06.643+0100 [mongosMain] connection accepted from 172.28.0.163:57648 #1419384 (399 connections now open) 2015-10-05T03:21:06.643+0100 [mongosMain] connection accepted from 172.28.0.163:57649 #1419385 (400 connections now open) 2015-10-05T03:21:06.644+0100 [conn1419384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:06.645+0100 [conn1419385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:06.820+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:21:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:21:09.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de955703b51053eaa99d 2015-10-05T03:21:09.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:11.772+0100 [conn1418584] end connection 172.28.0.164:61885 (399 connections now open) 2015-10-05T03:21:11.774+0100 [mongosMain] connection accepted from 172.28.0.164:51056 #1419386 (400 connections now open) 2015-10-05T03:21:11.775+0100 [conn1419386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:12.241+0100 [conn1418653] end connection 172.28.0.164:62033 (399 connections now open) 2015-10-05T03:21:12.242+0100 [mongosMain] connection accepted from 172.28.0.164:51061 #1419387 (400 connections now open) 2015-10-05T03:21:12.244+0100 [conn1419387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:12.929+0100 [conn1418976] end connection 172.28.0.163:55085 (399 connections now open) 2015-10-05T03:21:12.929+0100 [conn1418977] end connection 172.28.0.163:55086 (399 connections now open) 2015-10-05T03:21:12.930+0100 [mongosMain] connection accepted from 172.28.0.163:57683 #1419388 (399 connections now open) 2015-10-05T03:21:12.930+0100 [mongosMain] connection accepted from 172.28.0.163:57684 #1419389 (400 connections now open) 2015-10-05T03:21:12.931+0100 [conn1419388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:12.931+0100 [conn1419389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:13.227+0100 [conn1418994] end connection 172.28.0.164:64544 (399 connections now open) 2015-10-05T03:21:13.228+0100 [mongosMain] connection accepted from 172.28.0.164:51064 #1419390 (400 connections now open) 2015-10-05T03:21:13.230+0100 [conn1419390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:16.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611de9b5703b51053eaa9c5 2015-10-05T03:21:16.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:16.642+0100 [conn1418952] end connection 172.28.0.163:54861 (399 connections now open) 2015-10-05T03:21:16.642+0100 [conn1418995] end connection 172.28.0.163:55155 (399 connections now open) 2015-10-05T03:21:16.643+0100 [mongosMain] connection accepted from 172.28.0.163:57709 #1419391 (399 connections now open) 2015-10-05T03:21:16.644+0100 [mongosMain] connection accepted from 172.28.0.163:57710 #1419392 (400 connections now open) 2015-10-05T03:21:16.644+0100 [conn1419391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:16.644+0100 [conn1419392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:21.790+0100 [conn1418982] end connection 172.28.0.164:64520 (399 connections now open) 2015-10-05T03:21:21.790+0100 [mongosMain] connection accepted from 172.28.0.164:51106 #1419393 (400 connections now open) 2015-10-05T03:21:21.792+0100 [conn1419393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:22.256+0100 [conn1418983] end connection 172.28.0.164:64523 (399 connections now open) 2015-10-05T03:21:22.257+0100 [mongosMain] connection accepted from 172.28.0.164:51108 #1419394 (400 connections now open) 2015-10-05T03:21:22.259+0100 [conn1419394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:22.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dea25703b51053eaa9df 2015-10-05T03:21:22.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:22.936+0100 [conn1418992] end connection 172.28.0.163:55127 (399 connections now open) 2015-10-05T03:21:22.937+0100 [mongosMain] connection accepted from 172.28.0.163:57737 #1419395 (400 connections now open) 2015-10-05T03:21:22.938+0100 [conn1419395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:23.224+0100 [conn1419001] end connection 172.28.0.164:64590 (399 connections now open) 2015-10-05T03:21:23.225+0100 [mongosMain] connection accepted from 172.28.0.164:51116 #1419396 (400 connections now open) 2015-10-05T03:21:23.227+0100 [conn1419396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:26.658+0100 [conn1418955] end connection 172.28.0.163:54912 (399 connections now open) 2015-10-05T03:21:26.658+0100 [conn1419003] end connection 172.28.0.163:55202 (398 connections now open) 2015-10-05T03:21:26.659+0100 [mongosMain] connection accepted from 172.28.0.163:57749 #1419397 (399 connections now open) 2015-10-05T03:21:26.659+0100 [mongosMain] connection accepted from 172.28.0.163:57751 #1419398 (400 connections now open) 2015-10-05T03:21:26.660+0100 [conn1419397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:26.660+0100 [conn1419398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:28.847+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dea85703b51053eaa9ef 2015-10-05T03:21:28.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:29.138+0100 [mongosMain] connection accepted from 127.0.0.1:57765 #1419399 (401 connections now open) 2015-10-05T03:21:29.141+0100 [conn1419399] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:29.146+0100 [conn1419399] end connection 127.0.0.1:57765 (400 connections now open) 2015-10-05T03:21:31.804+0100 [conn1418990] end connection 172.28.0.164:64533 (399 connections now open) 2015-10-05T03:21:31.805+0100 [mongosMain] connection accepted from 172.28.0.164:51176 #1419400 (400 connections now open) 2015-10-05T03:21:31.807+0100 [conn1419400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:32.256+0100 [conn1418991] end connection 172.28.0.164:64536 (399 connections now open) 2015-10-05T03:21:32.257+0100 [mongosMain] connection accepted from 172.28.0.164:51183 #1419401 (400 connections now open) 2015-10-05T03:21:32.259+0100 [conn1419401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:32.944+0100 [conn1418985] end connection 172.28.0.163:55104 (399 connections now open) 2015-10-05T03:21:32.944+0100 [conn1418759] end connection 172.28.0.163:52577 (399 connections now open) 2015-10-05T03:21:32.945+0100 [mongosMain] connection accepted from 172.28.0.163:57782 #1419402 (399 connections now open) 2015-10-05T03:21:32.945+0100 [mongosMain] connection accepted from 172.28.0.163:57783 #1419403 (400 connections now open) 2015-10-05T03:21:32.946+0100 [conn1419402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:32.947+0100 [conn1419403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:35.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611deae5703b51053eaa9fe 2015-10-05T03:21:35.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:36.658+0100 [conn1419009] end connection 172.28.0.163:55259 (399 connections now open) 2015-10-05T03:21:36.658+0100 [conn1418980] end connection 172.28.0.163:55094 (399 connections now open) 2015-10-05T03:21:36.659+0100 [mongosMain] connection accepted from 172.28.0.163:57796 #1419404 (399 connections now open) 2015-10-05T03:21:36.659+0100 [mongosMain] connection accepted from 172.28.0.163:57797 #1419405 (400 connections now open) 2015-10-05T03:21:36.660+0100 [conn1419404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:36.661+0100 [conn1419405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:37.108+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:21:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:21:39.201+0100 [mongosMain] connection accepted from 127.0.0.1:57813 #1419406 (401 connections now open) 2015-10-05T03:21:39.203+0100 [conn1419406] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:39.208+0100 [conn1419406] end connection 127.0.0.1:57813 (400 connections now open) 2015-10-05T03:21:41.819+0100 [conn1418997] end connection 172.28.0.164:64579 (399 connections now open) 2015-10-05T03:21:41.820+0100 [mongosMain] connection accepted from 172.28.0.164:51226 #1419407 (400 connections now open) 2015-10-05T03:21:41.822+0100 [conn1419407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:42.271+0100 [conn1418998] end connection 172.28.0.164:64583 (399 connections now open) 2015-10-05T03:21:42.272+0100 [mongosMain] connection accepted from 172.28.0.164:51229 #1419408 (400 connections now open) 2015-10-05T03:21:42.274+0100 [conn1419408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:42.944+0100 [conn1419006] end connection 172.28.0.163:55239 (399 connections now open) 2015-10-05T03:21:42.944+0100 [conn1418667] end connection 172.28.0.163:52333 (398 connections now open) 2015-10-05T03:21:42.945+0100 [mongosMain] connection accepted from 172.28.0.163:57841 #1419409 (399 connections now open) 2015-10-05T03:21:42.947+0100 [conn1419409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:42.947+0100 [mongosMain] connection accepted from 172.28.0.163:57842 #1419410 (400 connections now open) 2015-10-05T03:21:42.948+0100 [conn1419410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:46.673+0100 [conn1418988] end connection 172.28.0.163:55110 (399 connections now open) 2015-10-05T03:21:46.673+0100 [conn1419017] end connection 172.28.0.163:55315 (399 connections now open) 2015-10-05T03:21:46.674+0100 [mongosMain] connection accepted from 172.28.0.163:57856 #1419411 (399 connections now open) 2015-10-05T03:21:46.674+0100 [mongosMain] connection accepted from 172.28.0.163:57857 #1419412 (400 connections now open) 2015-10-05T03:21:46.675+0100 [conn1419411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:46.675+0100 [conn1419412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:47.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611debb5703b51053eaaa29 2015-10-05T03:21:47.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:21:51.835+0100 [conn1418961] end connection 172.28.0.164:64408 (399 connections now open) 2015-10-05T03:21:51.836+0100 [mongosMain] connection accepted from 172.28.0.164:51250 #1419413 (400 connections now open) 2015-10-05T03:21:51.838+0100 [conn1419413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:52.272+0100 [conn1419005] end connection 172.28.0.164:64639 (399 connections now open) 2015-10-05T03:21:52.273+0100 [mongosMain] connection accepted from 172.28.0.164:51252 #1419414 (400 connections now open) 2015-10-05T03:21:52.274+0100 [conn1419414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:52.959+0100 [conn1418984] end connection 172.28.0.163:55103 (399 connections now open) 2015-10-05T03:21:52.960+0100 [conn1419007] end connection 172.28.0.163:55240 (398 connections now open) 2015-10-05T03:21:52.960+0100 [mongosMain] connection accepted from 172.28.0.163:57863 #1419415 (399 connections now open) 2015-10-05T03:21:52.961+0100 [mongosMain] connection accepted from 172.28.0.163:57864 #1419416 (400 connections now open) 2015-10-05T03:21:52.961+0100 [conn1419415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:52.962+0100 [conn1419416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:56.673+0100 [conn1419024] end connection 172.28.0.163:55331 (399 connections now open) 2015-10-05T03:21:56.673+0100 [conn1418971] end connection 172.28.0.163:55078 (398 connections now open) 2015-10-05T03:21:56.675+0100 [mongosMain] connection accepted from 172.28.0.163:57874 #1419417 (399 connections now open) 2015-10-05T03:21:56.675+0100 [mongosMain] connection accepted from 172.28.0.163:57875 #1419418 (400 connections now open) 2015-10-05T03:21:56.676+0100 [conn1419417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:56.677+0100 [conn1419418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:21:56.750+0100 [conn1418970] end connection 172.28.0.164:64498 (399 connections now open) 2015-10-05T03:21:56.751+0100 [mongosMain] connection accepted from 172.28.0.164:51259 #1419419 (400 connections now open) 2015-10-05T03:21:56.753+0100 [conn1419419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:01.851+0100 [conn1418974] end connection 172.28.0.164:64505 (399 connections now open) 2015-10-05T03:22:01.852+0100 [mongosMain] connection accepted from 172.28.0.164:51268 #1419420 (400 connections now open) 2015-10-05T03:22:01.855+0100 [conn1419420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:02.288+0100 [conn1418975] end connection 172.28.0.164:64507 (399 connections now open) 2015-10-05T03:22:02.289+0100 [mongosMain] connection accepted from 172.28.0.164:51273 #1419421 (400 connections now open) 2015-10-05T03:22:02.291+0100 [conn1419421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:02.975+0100 [conn1419000] end connection 172.28.0.163:55184 (399 connections now open) 2015-10-05T03:22:02.975+0100 [conn1419014] end connection 172.28.0.163:55305 (399 connections now open) 2015-10-05T03:22:02.976+0100 [mongosMain] connection accepted from 172.28.0.163:57894 #1419422 (399 connections now open) 2015-10-05T03:22:02.976+0100 [mongosMain] connection accepted from 172.28.0.163:57895 #1419423 (400 connections now open) 2015-10-05T03:22:02.977+0100 [conn1419422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:02.977+0100 [conn1419423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:03.287+0100 [conn1419008] end connection 172.28.0.164:64649 (399 connections now open) 2015-10-05T03:22:03.288+0100 [mongosMain] connection accepted from 172.28.0.164:51282 #1419424 (400 connections now open) 2015-10-05T03:22:03.289+0100 [conn1419424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:05.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611decd5703b51053eaaa66 2015-10-05T03:22:06.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:22:06.689+0100 [conn1419031] end connection 172.28.0.163:55347 (399 connections now open) 2015-10-05T03:22:06.690+0100 [conn1418996] end connection 172.28.0.163:55156 (398 connections now open) 2015-10-05T03:22:06.690+0100 [mongosMain] connection accepted from 172.28.0.163:57924 #1419425 (399 connections now open) 2015-10-05T03:22:06.691+0100 [mongosMain] connection accepted from 172.28.0.163:57925 #1419426 (400 connections now open) 2015-10-05T03:22:06.691+0100 [conn1419425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:06.692+0100 [conn1419426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:06.750+0100 [conn1418987] end connection 172.28.0.164:64531 (399 connections now open) 2015-10-05T03:22:06.751+0100 [mongosMain] connection accepted from 172.28.0.164:51300 #1419427 (400 connections now open) 2015-10-05T03:22:06.753+0100 [conn1419427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:07.306+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:22:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:22:11.854+0100 [conn1419012] end connection 172.28.0.164:64707 (399 connections now open) 2015-10-05T03:22:11.855+0100 [mongosMain] connection accepted from 172.28.0.164:51323 #1419428 (400 connections now open) 2015-10-05T03:22:11.857+0100 [conn1419428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:12.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ded45703b51053eaaa7b 2015-10-05T03:22:12.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:22:12.303+0100 [conn1419013] end connection 172.28.0.164:64712 (399 connections now open) 2015-10-05T03:22:12.305+0100 [mongosMain] connection accepted from 172.28.0.164:51328 #1419429 (400 connections now open) 2015-10-05T03:22:12.307+0100 [conn1419429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:12.975+0100 [conn1419015] end connection 172.28.0.163:55306 (399 connections now open) 2015-10-05T03:22:12.975+0100 [conn1418703] end connection 172.28.0.163:52485 (399 connections now open) 2015-10-05T03:22:12.976+0100 [mongosMain] connection accepted from 172.28.0.163:57959 #1419430 (399 connections now open) 2015-10-05T03:22:12.976+0100 [mongosMain] connection accepted from 172.28.0.163:57960 #1419431 (400 connections now open) 2015-10-05T03:22:12.977+0100 [conn1419431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:12.977+0100 [conn1419430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:13.302+0100 [conn1419037] end connection 172.28.0.164:64778 (399 connections now open) 2015-10-05T03:22:13.304+0100 [mongosMain] connection accepted from 172.28.0.164:51335 #1419432 (400 connections now open) 2015-10-05T03:22:13.305+0100 [conn1419432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:16.689+0100 [conn1419025] end connection 172.28.0.163:55332 (399 connections now open) 2015-10-05T03:22:16.690+0100 [conn1419040] end connection 172.28.0.163:55389 (398 connections now open) 2015-10-05T03:22:16.691+0100 [mongosMain] connection accepted from 172.28.0.163:57987 #1419433 (399 connections now open) 2015-10-05T03:22:16.691+0100 [mongosMain] connection accepted from 172.28.0.163:57988 #1419434 (400 connections now open) 2015-10-05T03:22:16.692+0100 [conn1419433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:16.692+0100 [conn1419434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:16.765+0100 [conn1419030] end connection 172.28.0.164:64760 (399 connections now open) 2015-10-05T03:22:16.767+0100 [mongosMain] connection accepted from 172.28.0.164:51358 #1419435 (400 connections now open) 2015-10-05T03:22:16.769+0100 [conn1419435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:22.320+0100 [conn1419034] end connection 172.28.0.164:64770 (399 connections now open) 2015-10-05T03:22:22.321+0100 [mongosMain] connection accepted from 172.28.0.164:51384 #1419436 (400 connections now open) 2015-10-05T03:22:22.322+0100 [conn1419436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:22.991+0100 [conn1419022] end connection 172.28.0.163:55323 (399 connections now open) 2015-10-05T03:22:22.991+0100 [conn1419035] end connection 172.28.0.163:55370 (399 connections now open) 2015-10-05T03:22:22.992+0100 [mongosMain] connection accepted from 172.28.0.163:58028 #1419437 (399 connections now open) 2015-10-05T03:22:22.993+0100 [mongosMain] connection accepted from 172.28.0.163:58029 #1419438 (400 connections now open) 2015-10-05T03:22:22.993+0100 [conn1419437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:22.993+0100 [conn1419438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:23.318+0100 [conn1419045] end connection 172.28.0.164:64828 (399 connections now open) 2015-10-05T03:22:23.319+0100 [mongosMain] connection accepted from 172.28.0.164:51391 #1419439 (400 connections now open) 2015-10-05T03:22:23.321+0100 [conn1419439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:26.704+0100 [conn1419002] end connection 172.28.0.163:55201 (399 connections now open) 2015-10-05T03:22:26.705+0100 [mongosMain] connection accepted from 172.28.0.163:58047 #1419440 (400 connections now open) 2015-10-05T03:22:26.706+0100 [conn1419440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:26.782+0100 [conn1418979] end connection 172.28.0.164:64516 (399 connections now open) 2015-10-05T03:22:26.783+0100 [mongosMain] connection accepted from 172.28.0.164:51412 #1419441 (400 connections now open) 2015-10-05T03:22:26.784+0100 [conn1419441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:28.297+0100 [mongosMain] connection accepted from 127.0.0.1:58054 #1419442 (401 connections now open) 2015-10-05T03:22:28.299+0100 [conn1419442] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:28.305+0100 [conn1419442] end connection 127.0.0.1:58054 (400 connections now open) 2015-10-05T03:22:30.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dee65703b51053eaaaba 2015-10-05T03:22:30.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:22:31.882+0100 [conn1419019] end connection 172.28.0.164:64735 (399 connections now open) 2015-10-05T03:22:31.883+0100 [mongosMain] connection accepted from 172.28.0.164:51437 #1419443 (400 connections now open) 2015-10-05T03:22:31.885+0100 [conn1419443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:32.335+0100 [conn1419042] end connection 172.28.0.164:64822 (399 connections now open) 2015-10-05T03:22:32.337+0100 [mongosMain] connection accepted from 172.28.0.164:51439 #1419444 (400 connections now open) 2015-10-05T03:22:32.339+0100 [conn1419444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:32.992+0100 [conn1419029] end connection 172.28.0.163:55340 (399 connections now open) 2015-10-05T03:22:32.993+0100 [conn1419028] end connection 172.28.0.163:55339 (399 connections now open) 2015-10-05T03:22:32.993+0100 [mongosMain] connection accepted from 172.28.0.163:58079 #1419445 (399 connections now open) 2015-10-05T03:22:32.994+0100 [mongosMain] connection accepted from 172.28.0.163:58080 #1419446 (400 connections now open) 2015-10-05T03:22:32.995+0100 [conn1419445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:32.995+0100 [conn1419446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:33.334+0100 [conn1419053] end connection 172.28.0.164:64892 (399 connections now open) 2015-10-05T03:22:33.336+0100 [mongosMain] connection accepted from 172.28.0.164:51446 #1419447 (400 connections now open) 2015-10-05T03:22:33.338+0100 [conn1419447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:36.720+0100 [conn1419047] end connection 172.28.0.163:55453 (399 connections now open) 2015-10-05T03:22:36.720+0100 [conn1419010] end connection 172.28.0.163:55260 (399 connections now open) 2015-10-05T03:22:36.721+0100 [mongosMain] connection accepted from 172.28.0.163:58098 #1419448 (399 connections now open) 2015-10-05T03:22:36.722+0100 [mongosMain] connection accepted from 172.28.0.163:58099 #1419449 (400 connections now open) 2015-10-05T03:22:36.723+0100 [conn1419448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:36.723+0100 [conn1419449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:36.781+0100 [conn1419023] end connection 172.28.0.164:64746 (399 connections now open) 2015-10-05T03:22:36.782+0100 [mongosMain] connection accepted from 172.28.0.164:51466 #1419450 (400 connections now open) 2015-10-05T03:22:36.784+0100 [conn1419450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:37.591+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:22:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:22:39.851+0100 [mongosMain] connection accepted from 127.0.0.1:58114 #1419451 (401 connections now open) 2015-10-05T03:22:39.854+0100 [conn1419451] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:39.858+0100 [conn1419451] end connection 127.0.0.1:58114 (400 connections now open) 2015-10-05T03:22:41.898+0100 [conn1419049] end connection 172.28.0.164:64879 (399 connections now open) 2015-10-05T03:22:41.899+0100 [mongosMain] connection accepted from 172.28.0.164:51490 #1419452 (400 connections now open) 2015-10-05T03:22:41.901+0100 [conn1419452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:42.350+0100 [conn1419027] end connection 172.28.0.164:64752 (399 connections now open) 2015-10-05T03:22:42.351+0100 [mongosMain] connection accepted from 172.28.0.164:51492 #1419453 (400 connections now open) 2015-10-05T03:22:42.352+0100 [conn1419453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:42.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611def25703b51053eaaae7 2015-10-05T03:22:43.007+0100 [conn1419044] end connection 172.28.0.163:55433 (399 connections now open) 2015-10-05T03:22:43.007+0100 [conn1419043] end connection 172.28.0.163:55432 (399 connections now open) 2015-10-05T03:22:43.008+0100 [mongosMain] connection accepted from 172.28.0.163:58118 #1419454 (399 connections now open) 2015-10-05T03:22:43.008+0100 [mongosMain] connection accepted from 172.28.0.163:58119 #1419455 (400 connections now open) 2015-10-05T03:22:43.009+0100 [conn1419455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:43.010+0100 [conn1419454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:43.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:22:43.350+0100 [conn1419061] end connection 172.28.0.164:64951 (399 connections now open) 2015-10-05T03:22:43.351+0100 [mongosMain] connection accepted from 172.28.0.164:51496 #1419456 (400 connections now open) 2015-10-05T03:22:43.353+0100 [conn1419456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:46.722+0100 [conn1419016] end connection 172.28.0.163:55313 (399 connections now open) 2015-10-05T03:22:46.723+0100 [mongosMain] connection accepted from 172.28.0.163:58126 #1419457 (400 connections now open) 2015-10-05T03:22:46.723+0100 [conn1419457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:46.797+0100 [conn1419046] end connection 172.28.0.164:64846 (399 connections now open) 2015-10-05T03:22:46.798+0100 [mongosMain] connection accepted from 172.28.0.164:51501 #1419458 (400 connections now open) 2015-10-05T03:22:46.800+0100 [conn1419458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:51.914+0100 [conn1419026] end connection 172.28.0.164:64750 (399 connections now open) 2015-10-05T03:22:51.915+0100 [mongosMain] connection accepted from 172.28.0.164:51507 #1419459 (400 connections now open) 2015-10-05T03:22:51.916+0100 [conn1419459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:52.366+0100 [conn1419050] end connection 172.28.0.164:64885 (399 connections now open) 2015-10-05T03:22:52.367+0100 [mongosMain] connection accepted from 172.28.0.164:51509 #1419460 (400 connections now open) 2015-10-05T03:22:52.369+0100 [conn1419460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:53.010+0100 [conn1419036] end connection 172.28.0.163:55373 (399 connections now open) 2015-10-05T03:22:53.010+0100 [conn1419060] end connection 172.28.0.163:55527 (399 connections now open) 2015-10-05T03:22:53.012+0100 [mongosMain] connection accepted from 172.28.0.163:58132 #1419461 (399 connections now open) 2015-10-05T03:22:53.012+0100 [mongosMain] connection accepted from 172.28.0.163:58133 #1419462 (400 connections now open) 2015-10-05T03:22:53.013+0100 [conn1419461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:53.013+0100 [conn1419462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:53.365+0100 [conn1419070] end connection 172.28.0.164:65001 (399 connections now open) 2015-10-05T03:22:53.366+0100 [mongosMain] connection accepted from 172.28.0.164:51513 #1419463 (400 connections now open) 2015-10-05T03:22:53.367+0100 [conn1419463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:55.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611deff5703b51053eaab2a 2015-10-05T03:22:55.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:22:56.736+0100 [conn1419032] end connection 172.28.0.163:55348 (399 connections now open) 2015-10-05T03:22:56.737+0100 [mongosMain] connection accepted from 172.28.0.163:58141 #1419464 (400 connections now open) 2015-10-05T03:22:56.738+0100 [conn1419464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:22:56.813+0100 [conn1418954] end connection 172.28.0.164:64324 (399 connections now open) 2015-10-05T03:22:56.814+0100 [mongosMain] connection accepted from 172.28.0.164:51517 #1419465 (400 connections now open) 2015-10-05T03:22:56.816+0100 [conn1419465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:01.929+0100 [conn1419057] end connection 172.28.0.164:64939 (399 connections now open) 2015-10-05T03:23:01.931+0100 [mongosMain] connection accepted from 172.28.0.164:51525 #1419466 (400 connections now open) 2015-10-05T03:23:01.932+0100 [conn1419466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:02.366+0100 [conn1419020] end connection 172.28.0.164:64738 (399 connections now open) 2015-10-05T03:23:02.367+0100 [mongosMain] connection accepted from 172.28.0.164:51530 #1419467 (400 connections now open) 2015-10-05T03:23:02.369+0100 [conn1419467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:03.023+0100 [conn1419051] end connection 172.28.0.163:55483 (399 connections now open) 2015-10-05T03:23:03.023+0100 [conn1419052] end connection 172.28.0.163:55484 (399 connections now open) 2015-10-05T03:23:03.024+0100 [mongosMain] connection accepted from 172.28.0.163:58163 #1419468 (399 connections now open) 2015-10-05T03:23:03.025+0100 [mongosMain] connection accepted from 172.28.0.163:58161 #1419469 (400 connections now open) 2015-10-05T03:23:03.026+0100 [conn1419468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:03.026+0100 [conn1419469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:03.381+0100 [conn1419076] end connection 172.28.0.164:65017 (399 connections now open) 2015-10-05T03:23:03.382+0100 [mongosMain] connection accepted from 172.28.0.164:51538 #1419470 (400 connections now open) 2015-10-05T03:23:03.384+0100 [conn1419470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:06.736+0100 [conn1419048] end connection 172.28.0.163:55454 (399 connections now open) 2015-10-05T03:23:06.737+0100 [mongosMain] connection accepted from 172.28.0.163:58184 #1419471 (400 connections now open) 2015-10-05T03:23:06.739+0100 [conn1419471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:06.830+0100 [conn1419038] end connection 172.28.0.164:64790 (399 connections now open) 2015-10-05T03:23:06.830+0100 [mongosMain] connection accepted from 172.28.0.164:51554 #1419472 (400 connections now open) 2015-10-05T03:23:06.832+0100 [conn1419472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:07.858+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:23:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:23:07.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df0b5703b51053eaab7f 2015-10-05T03:23:08.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:23:11.945+0100 [conn1419041] end connection 172.28.0.164:64819 (399 connections now open) 2015-10-05T03:23:11.946+0100 [mongosMain] connection accepted from 172.28.0.164:51575 #1419473 (400 connections now open) 2015-10-05T03:23:11.948+0100 [conn1419473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:12.381+0100 [conn1419073] end connection 172.28.0.164:65014 (399 connections now open) 2015-10-05T03:23:12.382+0100 [mongosMain] connection accepted from 172.28.0.164:51576 #1419474 (400 connections now open) 2015-10-05T03:23:12.384+0100 [conn1419474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:13.038+0100 [conn1418705] end connection 172.28.0.163:52487 (399 connections now open) 2015-10-05T03:23:13.038+0100 [conn1419075] end connection 172.28.0.163:55587 (398 connections now open) 2015-10-05T03:23:13.040+0100 [mongosMain] connection accepted from 172.28.0.163:58220 #1419475 (399 connections now open) 2015-10-05T03:23:13.040+0100 [mongosMain] connection accepted from 172.28.0.163:58219 #1419476 (400 connections now open) 2015-10-05T03:23:13.041+0100 [conn1419476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:13.041+0100 [conn1419475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:16.752+0100 [conn1419055] end connection 172.28.0.163:55496 (399 connections now open) 2015-10-05T03:23:16.753+0100 [mongosMain] connection accepted from 172.28.0.163:58247 #1419477 (400 connections now open) 2015-10-05T03:23:16.754+0100 [conn1419477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:16.845+0100 [conn1419054] end connection 172.28.0.164:64914 (399 connections now open) 2015-10-05T03:23:16.845+0100 [mongosMain] connection accepted from 172.28.0.164:51597 #1419478 (400 connections now open) 2015-10-05T03:23:16.847+0100 [conn1419478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:20.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df185703b51053eaab96 2015-10-05T03:23:20.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:23:21.960+0100 [conn1419004] end connection 172.28.0.164:64633 (399 connections now open) 2015-10-05T03:23:21.962+0100 [mongosMain] connection accepted from 172.28.0.164:51628 #1419479 (400 connections now open) 2015-10-05T03:23:21.963+0100 [conn1419479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:22.397+0100 [conn1419058] end connection 172.28.0.164:64942 (399 connections now open) 2015-10-05T03:23:22.398+0100 [mongosMain] connection accepted from 172.28.0.164:51630 #1419480 (400 connections now open) 2015-10-05T03:23:22.399+0100 [conn1419480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:23.042+0100 [conn1419079] end connection 172.28.0.163:55612 (399 connections now open) 2015-10-05T03:23:23.042+0100 [conn1419074] end connection 172.28.0.163:55586 (398 connections now open) 2015-10-05T03:23:23.044+0100 [mongosMain] connection accepted from 172.28.0.163:58284 #1419481 (399 connections now open) 2015-10-05T03:23:23.044+0100 [mongosMain] connection accepted from 172.28.0.163:58285 #1419482 (400 connections now open) 2015-10-05T03:23:23.045+0100 [conn1419481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:23.045+0100 [conn1419482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:26.753+0100 [conn1419039] end connection 172.28.0.163:55390 (399 connections now open) 2015-10-05T03:23:26.754+0100 [mongosMain] connection accepted from 172.28.0.163:58307 #1419483 (400 connections now open) 2015-10-05T03:23:26.755+0100 [conn1419483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:26.860+0100 [conn1419062] end connection 172.28.0.164:64971 (399 connections now open) 2015-10-05T03:23:26.861+0100 [mongosMain] connection accepted from 172.28.0.164:51655 #1419484 (400 connections now open) 2015-10-05T03:23:26.863+0100 [conn1419484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:27.926+0100 [mongosMain] connection accepted from 127.0.0.1:58315 #1419485 (401 connections now open) 2015-10-05T03:23:27.928+0100 [conn1419485] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:27.933+0100 [conn1419485] end connection 127.0.0.1:58315 (400 connections now open) 2015-10-05T03:23:29.168+0100 [mongosMain] connection accepted from 127.0.0.1:58322 #1419486 (401 connections now open) 2015-10-05T03:23:29.170+0100 [conn1419486] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:29.176+0100 [conn1419486] end connection 127.0.0.1:58322 (400 connections now open) 2015-10-05T03:23:29.362+0100 [mongosMain] connection accepted from 127.0.0.1:58324 #1419487 (401 connections now open) 2015-10-05T03:23:29.364+0100 [conn1419487] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:29.370+0100 [conn1419487] end connection 127.0.0.1:58324 (400 connections now open) 2015-10-05T03:23:31.976+0100 [conn1419083] end connection 172.28.0.164:65095 (399 connections now open) 2015-10-05T03:23:31.977+0100 [mongosMain] connection accepted from 172.28.0.164:51692 #1419488 (400 connections now open) 2015-10-05T03:23:31.979+0100 [conn1419488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:32.413+0100 [conn1419084] end connection 172.28.0.164:65100 (399 connections now open) 2015-10-05T03:23:32.415+0100 [mongosMain] connection accepted from 172.28.0.164:51695 #1419489 (400 connections now open) 2015-10-05T03:23:32.417+0100 [conn1419489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:33.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df245703b51053eaabaa 2015-10-05T03:23:33.076+0100 [conn1418999] end connection 172.28.0.163:55183 (399 connections now open) 2015-10-05T03:23:33.076+0100 [conn1419086] end connection 172.28.0.163:55678 (398 connections now open) 2015-10-05T03:23:33.077+0100 [mongosMain] connection accepted from 172.28.0.163:58350 #1419490 (399 connections now open) 2015-10-05T03:23:33.078+0100 [mongosMain] connection accepted from 172.28.0.163:58351 #1419491 (400 connections now open) 2015-10-05T03:23:33.079+0100 [conn1419490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:33.079+0100 [conn1419491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:33.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:23:36.767+0100 [conn1419064] end connection 172.28.0.163:55543 (399 connections now open) 2015-10-05T03:23:36.767+0100 [conn1419063] end connection 172.28.0.163:55542 (399 connections now open) 2015-10-05T03:23:36.768+0100 [mongosMain] connection accepted from 172.28.0.163:58370 #1419492 (399 connections now open) 2015-10-05T03:23:36.768+0100 [mongosMain] connection accepted from 172.28.0.163:58371 #1419493 (400 connections now open) 2015-10-05T03:23:36.769+0100 [conn1419492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:36.769+0100 [conn1419493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:36.860+0100 [conn1419082] end connection 172.28.0.164:65060 (399 connections now open) 2015-10-05T03:23:36.862+0100 [mongosMain] connection accepted from 172.28.0.164:51732 #1419494 (400 connections now open) 2015-10-05T03:23:36.863+0100 [conn1419494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:38.122+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:23:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:23:39.478+0100 [mongosMain] connection accepted from 127.0.0.1:58374 #1419495 (401 connections now open) 2015-10-05T03:23:39.481+0100 [conn1419495] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:39.485+0100 [conn1419495] end connection 127.0.0.1:58374 (400 connections now open) 2015-10-05T03:23:41.977+0100 [conn1419072] end connection 172.28.0.164:65011 (399 connections now open) 2015-10-05T03:23:41.978+0100 [mongosMain] connection accepted from 172.28.0.164:51739 #1419496 (400 connections now open) 2015-10-05T03:23:41.980+0100 [conn1419496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:42.429+0100 [conn1419089] end connection 172.28.0.164:65154 (399 connections now open) 2015-10-05T03:23:42.430+0100 [mongosMain] connection accepted from 172.28.0.164:51741 #1419497 (400 connections now open) 2015-10-05T03:23:42.432+0100 [conn1419497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:43.085+0100 [conn1419069] end connection 172.28.0.163:55572 (399 connections now open) 2015-10-05T03:23:43.085+0100 [conn1419091] end connection 172.28.0.163:55743 (398 connections now open) 2015-10-05T03:23:43.086+0100 [mongosMain] connection accepted from 172.28.0.163:58378 #1419498 (399 connections now open) 2015-10-05T03:23:43.087+0100 [mongosMain] connection accepted from 172.28.0.163:58379 #1419499 (400 connections now open) 2015-10-05T03:23:43.088+0100 [conn1419498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:43.088+0100 [conn1419499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:43.429+0100 [conn1419081] end connection 172.28.0.164:65044 (399 connections now open) 2015-10-05T03:23:43.430+0100 [mongosMain] connection accepted from 172.28.0.164:51746 #1419500 (400 connections now open) 2015-10-05T03:23:43.431+0100 [conn1419500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:45.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df315703b51053eaabc6 2015-10-05T03:23:45.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:23:46.768+0100 [conn1419101] end connection 172.28.0.163:55821 (399 connections now open) 2015-10-05T03:23:46.768+0100 [conn1419087] end connection 172.28.0.163:55705 (398 connections now open) 2015-10-05T03:23:46.769+0100 [mongosMain] connection accepted from 172.28.0.163:58386 #1419501 (399 connections now open) 2015-10-05T03:23:46.769+0100 [mongosMain] connection accepted from 172.28.0.163:58387 #1419502 (400 connections now open) 2015-10-05T03:23:46.770+0100 [conn1419501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:46.770+0100 [conn1419502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:46.876+0100 [conn1419071] end connection 172.28.0.164:65006 (399 connections now open) 2015-10-05T03:23:46.877+0100 [mongosMain] connection accepted from 172.28.0.164:51751 #1419503 (400 connections now open) 2015-10-05T03:23:46.879+0100 [conn1419503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:51.992+0100 [conn1419033] end connection 172.28.0.164:64766 (399 connections now open) 2015-10-05T03:23:51.993+0100 [mongosMain] connection accepted from 172.28.0.164:51756 #1419504 (400 connections now open) 2015-10-05T03:23:51.996+0100 [conn1419504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:52.444+0100 [conn1419078] end connection 172.28.0.164:65035 (399 connections now open) 2015-10-05T03:23:52.445+0100 [mongosMain] connection accepted from 172.28.0.164:51758 #1419505 (400 connections now open) 2015-10-05T03:23:52.447+0100 [conn1419505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:53.088+0100 [conn1419068] end connection 172.28.0.163:55571 (399 connections now open) 2015-10-05T03:23:53.088+0100 [conn1419059] end connection 172.28.0.163:55526 (399 connections now open) 2015-10-05T03:23:53.089+0100 [mongosMain] connection accepted from 172.28.0.163:58398 #1419506 (399 connections now open) 2015-10-05T03:23:53.090+0100 [mongosMain] connection accepted from 172.28.0.163:58397 #1419507 (400 connections now open) 2015-10-05T03:23:53.091+0100 [conn1419506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:53.091+0100 [conn1419507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:53.443+0100 [conn1419107] end connection 172.28.0.164:65250 (399 connections now open) 2015-10-05T03:23:53.445+0100 [mongosMain] connection accepted from 172.28.0.164:51762 #1419508 (400 connections now open) 2015-10-05T03:23:53.446+0100 [conn1419508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:56.783+0100 [conn1419110] end connection 172.28.0.163:55838 (399 connections now open) 2015-10-05T03:23:56.784+0100 [mongosMain] connection accepted from 172.28.0.163:58404 #1419509 (400 connections now open) 2015-10-05T03:23:56.785+0100 [conn1419509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:23:56.891+0100 [conn1419092] end connection 172.28.0.164:65180 (399 connections now open) 2015-10-05T03:23:56.892+0100 [mongosMain] connection accepted from 172.28.0.164:51766 #1419510 (400 connections now open) 2015-10-05T03:23:56.894+0100 [conn1419510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:02.008+0100 [conn1418591] end connection 172.28.0.164:61892 (399 connections now open) 2015-10-05T03:24:02.009+0100 [mongosMain] connection accepted from 172.28.0.164:51775 #1419511 (400 connections now open) 2015-10-05T03:24:02.011+0100 [conn1419511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:02.460+0100 [conn1419096] end connection 172.28.0.164:65208 (399 connections now open) 2015-10-05T03:24:02.462+0100 [mongosMain] connection accepted from 172.28.0.164:51778 #1419512 (400 connections now open) 2015-10-05T03:24:02.463+0100 [conn1419512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:03.101+0100 [conn1419080] end connection 172.28.0.163:55613 (399 connections now open) 2015-10-05T03:24:03.101+0100 [conn1419021] end connection 172.28.0.163:55321 (399 connections now open) 2015-10-05T03:24:03.101+0100 [mongosMain] connection accepted from 172.28.0.163:58423 #1419513 (399 connections now open) 2015-10-05T03:24:03.102+0100 [mongosMain] connection accepted from 172.28.0.163:58424 #1419514 (400 connections now open) 2015-10-05T03:24:03.102+0100 [conn1419513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:03.102+0100 [conn1419514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:03.459+0100 [conn1419115] end connection 172.28.0.164:65265 (399 connections now open) 2015-10-05T03:24:03.460+0100 [mongosMain] connection accepted from 172.28.0.164:51787 #1419515 (400 connections now open) 2015-10-05T03:24:03.462+0100 [conn1419515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:03.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df435703b51053eaabeb 2015-10-05T03:24:03.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:24:06.799+0100 [conn1419118] end connection 172.28.0.163:55857 (399 connections now open) 2015-10-05T03:24:06.800+0100 [mongosMain] connection accepted from 172.28.0.163:58461 #1419516 (400 connections now open) 2015-10-05T03:24:06.801+0100 [conn1419516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:06.907+0100 [conn1419116] end connection 172.28.0.164:65270 (399 connections now open) 2015-10-05T03:24:06.908+0100 [mongosMain] connection accepted from 172.28.0.164:51801 #1419517 (400 connections now open) 2015-10-05T03:24:06.909+0100 [conn1419517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:08.404+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:24:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:24:12.023+0100 [conn1419088] end connection 172.28.0.164:65147 (399 connections now open) 2015-10-05T03:24:12.025+0100 [mongosMain] connection accepted from 172.28.0.164:51829 #1419518 (400 connections now open) 2015-10-05T03:24:12.027+0100 [conn1419518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:12.476+0100 [conn1419067] end connection 172.28.0.164:64998 (399 connections now open) 2015-10-05T03:24:12.477+0100 [mongosMain] connection accepted from 172.28.0.164:51833 #1419519 (400 connections now open) 2015-10-05T03:24:12.478+0100 [conn1419519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:13.117+0100 [conn1419098] end connection 172.28.0.163:55802 (399 connections now open) 2015-10-05T03:24:13.117+0100 [conn1419114] end connection 172.28.0.163:55850 (399 connections now open) 2015-10-05T03:24:13.118+0100 [mongosMain] connection accepted from 172.28.0.163:58499 #1419520 (399 connections now open) 2015-10-05T03:24:13.119+0100 [mongosMain] connection accepted from 172.28.0.163:58500 #1419521 (400 connections now open) 2015-10-05T03:24:13.119+0100 [conn1419520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:13.119+0100 [conn1419521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:13.475+0100 [conn1419123] end connection 172.28.0.164:65286 (399 connections now open) 2015-10-05T03:24:13.476+0100 [mongosMain] connection accepted from 172.28.0.164:51840 #1419522 (400 connections now open) 2015-10-05T03:24:13.477+0100 [conn1419522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:16.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df4f5703b51053eaac22 2015-10-05T03:24:16.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:24:16.803+0100 [conn1419126] end connection 172.28.0.163:55901 (399 connections now open) 2015-10-05T03:24:16.805+0100 [mongosMain] connection accepted from 172.28.0.163:58519 #1419523 (400 connections now open) 2015-10-05T03:24:16.806+0100 [conn1419523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:22.039+0100 [conn1419095] end connection 172.28.0.164:65205 (399 connections now open) 2015-10-05T03:24:22.040+0100 [mongosMain] connection accepted from 172.28.0.164:51887 #1419524 (400 connections now open) 2015-10-05T03:24:22.042+0100 [conn1419524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:22.491+0100 [conn1419120] end connection 172.28.0.164:65281 (399 connections now open) 2015-10-05T03:24:22.492+0100 [mongosMain] connection accepted from 172.28.0.164:51893 #1419525 (400 connections now open) 2015-10-05T03:24:22.494+0100 [conn1419525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:23.121+0100 [conn1419113] end connection 172.28.0.163:55848 (399 connections now open) 2015-10-05T03:24:23.121+0100 [conn1419122] end connection 172.28.0.163:55877 (398 connections now open) 2015-10-05T03:24:23.122+0100 [mongosMain] connection accepted from 172.28.0.163:58553 #1419526 (399 connections now open) 2015-10-05T03:24:23.123+0100 [mongosMain] connection accepted from 172.28.0.163:58554 #1419527 (400 connections now open) 2015-10-05T03:24:23.123+0100 [conn1419526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:23.123+0100 [conn1419527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:23.475+0100 [conn1419131] end connection 172.28.0.164:65341 (399 connections now open) 2015-10-05T03:24:23.476+0100 [mongosMain] connection accepted from 172.28.0.164:51901 #1419528 (400 connections now open) 2015-10-05T03:24:23.478+0100 [conn1419528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:26.818+0100 [conn1419133] end connection 172.28.0.163:55962 (399 connections now open) 2015-10-05T03:24:26.819+0100 [mongosMain] connection accepted from 172.28.0.163:58576 #1419529 (400 connections now open) 2015-10-05T03:24:26.821+0100 [conn1419529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:26.938+0100 [conn1419132] end connection 172.28.0.164:65360 (399 connections now open) 2015-10-05T03:24:26.940+0100 [mongosMain] connection accepted from 172.28.0.164:51923 #1419530 (400 connections now open) 2015-10-05T03:24:26.942+0100 [conn1419530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:28.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df5c5703b51053eaac3f 2015-10-05T03:24:28.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:24:28.574+0100 [mongosMain] connection accepted from 127.0.0.1:58588 #1419531 (401 connections now open) 2015-10-05T03:24:28.577+0100 [conn1419531] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:28.582+0100 [conn1419531] end connection 127.0.0.1:58588 (400 connections now open) 2015-10-05T03:24:32.073+0100 [conn1419103] end connection 172.28.0.164:65244 (399 connections now open) 2015-10-05T03:24:32.073+0100 [mongosMain] connection accepted from 172.28.0.164:51964 #1419532 (400 connections now open) 2015-10-05T03:24:32.073+0100 [conn1419532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:32.510+0100 [conn1419104] end connection 172.28.0.164:65247 (399 connections now open) 2015-10-05T03:24:32.510+0100 [mongosMain] connection accepted from 172.28.0.164:51969 #1419533 (400 connections now open) 2015-10-05T03:24:32.510+0100 [conn1419533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:33.165+0100 [conn1419106] end connection 172.28.0.163:55828 (399 connections now open) 2015-10-05T03:24:33.165+0100 [conn1419090] end connection 172.28.0.163:55742 (398 connections now open) 2015-10-05T03:24:33.165+0100 [mongosMain] connection accepted from 172.28.0.163:58623 #1419534 (399 connections now open) 2015-10-05T03:24:33.165+0100 [mongosMain] connection accepted from 172.28.0.163:58624 #1419535 (400 connections now open) 2015-10-05T03:24:33.165+0100 [conn1419534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:33.165+0100 [conn1419535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:33.524+0100 [conn1419138] end connection 172.28.0.164:65401 (399 connections now open) 2015-10-05T03:24:33.524+0100 [mongosMain] connection accepted from 172.28.0.164:51977 #1419536 (400 connections now open) 2015-10-05T03:24:33.524+0100 [conn1419536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:34.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df625703b51053eaac52 2015-10-05T03:24:34.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:24:36.815+0100 [conn1419093] end connection 172.28.0.163:55763 (399 connections now open) 2015-10-05T03:24:36.815+0100 [conn1419140] end connection 172.28.0.163:56001 (398 connections now open) 2015-10-05T03:24:36.817+0100 [mongosMain] connection accepted from 172.28.0.163:58628 #1419537 (399 connections now open) 2015-10-05T03:24:36.817+0100 [mongosMain] connection accepted from 172.28.0.163:58629 #1419538 (400 connections now open) 2015-10-05T03:24:36.818+0100 [conn1419537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:36.818+0100 [conn1419538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:38.672+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:24:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:24:39.913+0100 [mongosMain] connection accepted from 127.0.0.1:58633 #1419539 (401 connections now open) 2015-10-05T03:24:39.916+0100 [conn1419539] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:39.920+0100 [conn1419539] end connection 127.0.0.1:58633 (400 connections now open) 2015-10-05T03:24:42.071+0100 [conn1419077] end connection 172.28.0.164:65028 (399 connections now open) 2015-10-05T03:24:42.073+0100 [mongosMain] connection accepted from 172.28.0.164:51989 #1419540 (400 connections now open) 2015-10-05T03:24:42.074+0100 [conn1419540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:42.507+0100 [conn1419128] end connection 172.28.0.164:65335 (399 connections now open) 2015-10-05T03:24:42.509+0100 [mongosMain] connection accepted from 172.28.0.164:51991 #1419541 (400 connections now open) 2015-10-05T03:24:42.510+0100 [conn1419541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:43.133+0100 [conn1419085] end connection 172.28.0.163:55677 (399 connections now open) 2015-10-05T03:24:43.133+0100 [conn1419137] end connection 172.28.0.163:55988 (399 connections now open) 2015-10-05T03:24:43.135+0100 [mongosMain] connection accepted from 172.28.0.163:58639 #1419542 (399 connections now open) 2015-10-05T03:24:43.135+0100 [mongosMain] connection accepted from 172.28.0.163:58638 #1419543 (400 connections now open) 2015-10-05T03:24:43.136+0100 [conn1419542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:43.136+0100 [conn1419543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:43.490+0100 [conn1419146] end connection 172.28.0.164:65464 (399 connections now open) 2015-10-05T03:24:43.491+0100 [mongosMain] connection accepted from 172.28.0.164:51995 #1419544 (400 connections now open) 2015-10-05T03:24:43.493+0100 [conn1419544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:46.831+0100 [conn1419148] end connection 172.28.0.163:56055 (399 connections now open) 2015-10-05T03:24:46.831+0100 [conn1419117] end connection 172.28.0.163:55856 (398 connections now open) 2015-10-05T03:24:46.833+0100 [mongosMain] connection accepted from 172.28.0.163:58646 #1419545 (399 connections now open) 2015-10-05T03:24:46.833+0100 [mongosMain] connection accepted from 172.28.0.163:58647 #1419546 (400 connections now open) 2015-10-05T03:24:46.834+0100 [conn1419546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:46.834+0100 [conn1419545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:46.954+0100 [conn1419124] end connection 172.28.0.164:65303 (399 connections now open) 2015-10-05T03:24:46.955+0100 [mongosMain] connection accepted from 172.28.0.164:52000 #1419547 (400 connections now open) 2015-10-05T03:24:46.959+0100 [conn1419547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:47.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df6e5703b51053eaac8a 2015-10-05T03:24:47.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:24:52.070+0100 [conn1419134] end connection 172.28.0.164:65387 (399 connections now open) 2015-10-05T03:24:52.072+0100 [mongosMain] connection accepted from 172.28.0.164:52006 #1419548 (400 connections now open) 2015-10-05T03:24:52.073+0100 [conn1419548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:52.523+0100 [conn1419112] end connection 172.28.0.164:65262 (399 connections now open) 2015-10-05T03:24:52.524+0100 [mongosMain] connection accepted from 172.28.0.164:52008 #1419549 (400 connections now open) 2015-10-05T03:24:52.526+0100 [conn1419549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:53.148+0100 [conn1419136] end connection 172.28.0.163:55987 (399 connections now open) 2015-10-05T03:24:53.148+0100 [conn1419145] end connection 172.28.0.163:56033 (398 connections now open) 2015-10-05T03:24:53.150+0100 [mongosMain] connection accepted from 172.28.0.163:58655 #1419550 (399 connections now open) 2015-10-05T03:24:53.150+0100 [mongosMain] connection accepted from 172.28.0.163:58656 #1419551 (400 connections now open) 2015-10-05T03:24:53.151+0100 [conn1419550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:53.151+0100 [conn1419551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:53.490+0100 [conn1419154] end connection 172.28.0.164:65525 (399 connections now open) 2015-10-05T03:24:53.491+0100 [mongosMain] connection accepted from 172.28.0.164:52012 #1419552 (400 connections now open) 2015-10-05T03:24:53.493+0100 [conn1419552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:56.831+0100 [conn1419156] end connection 172.28.0.163:56090 (399 connections now open) 2015-10-05T03:24:56.831+0100 [conn1419125] end connection 172.28.0.163:55900 (398 connections now open) 2015-10-05T03:24:56.833+0100 [mongosMain] connection accepted from 172.28.0.163:58664 #1419553 (399 connections now open) 2015-10-05T03:24:56.833+0100 [mongosMain] connection accepted from 172.28.0.163:58665 #1419554 (400 connections now open) 2015-10-05T03:24:56.834+0100 [conn1419553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:56.835+0100 [conn1419554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:24:56.970+0100 [conn1419099] end connection 172.28.0.164:65236 (399 connections now open) 2015-10-05T03:24:56.971+0100 [mongosMain] connection accepted from 172.28.0.164:52016 #1419555 (400 connections now open) 2015-10-05T03:24:56.973+0100 [conn1419555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:02.087+0100 [conn1419111] end connection 172.28.0.164:65259 (399 connections now open) 2015-10-05T03:25:02.088+0100 [mongosMain] connection accepted from 172.28.0.164:52030 #1419556 (400 connections now open) 2015-10-05T03:25:02.091+0100 [conn1419556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:02.539+0100 [conn1419143] end connection 172.28.0.164:65454 (399 connections now open) 2015-10-05T03:25:02.541+0100 [mongosMain] connection accepted from 172.28.0.164:52034 #1419557 (400 connections now open) 2015-10-05T03:25:02.543+0100 [conn1419557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:03.149+0100 [conn1419097] end connection 172.28.0.163:55801 (399 connections now open) 2015-10-05T03:25:03.149+0100 [conn1419121] end connection 172.28.0.163:55876 (399 connections now open) 2015-10-05T03:25:03.150+0100 [mongosMain] connection accepted from 172.28.0.163:58692 #1419558 (399 connections now open) 2015-10-05T03:25:03.150+0100 [mongosMain] connection accepted from 172.28.0.163:58693 #1419559 (400 connections now open) 2015-10-05T03:25:03.151+0100 [conn1419558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:03.151+0100 [conn1419559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:03.509+0100 [conn1419162] end connection 172.28.0.164:49163 (399 connections now open) 2015-10-05T03:25:03.511+0100 [mongosMain] connection accepted from 172.28.0.164:52041 #1419560 (400 connections now open) 2015-10-05T03:25:03.512+0100 [conn1419560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:06.846+0100 [conn1419100] end connection 172.28.0.163:55820 (399 connections now open) 2015-10-05T03:25:06.846+0100 [conn1419165] end connection 172.28.0.163:56107 (399 connections now open) 2015-10-05T03:25:06.847+0100 [mongosMain] connection accepted from 172.28.0.163:58716 #1419561 (399 connections now open) 2015-10-05T03:25:06.847+0100 [mongosMain] connection accepted from 172.28.0.163:58717 #1419562 (400 connections now open) 2015-10-05T03:25:06.848+0100 [conn1419561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:06.848+0100 [conn1419562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:06.970+0100 [conn1419139] end connection 172.28.0.164:65421 (399 connections now open) 2015-10-05T03:25:06.971+0100 [mongosMain] connection accepted from 172.28.0.164:52062 #1419563 (400 connections now open) 2015-10-05T03:25:06.972+0100 [conn1419563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:08.830+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:25:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:25:11.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df875703b51053eaacf7 2015-10-05T03:25:11.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:25:12.087+0100 [conn1419127] end connection 172.28.0.164:65328 (399 connections now open) 2015-10-05T03:25:12.089+0100 [mongosMain] connection accepted from 172.28.0.164:52092 #1419564 (400 connections now open) 2015-10-05T03:25:12.090+0100 [conn1419564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:12.554+0100 [conn1419135] end connection 172.28.0.164:65392 (399 connections now open) 2015-10-05T03:25:12.555+0100 [mongosMain] connection accepted from 172.28.0.164:52096 #1419565 (400 connections now open) 2015-10-05T03:25:12.557+0100 [conn1419565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:13.165+0100 [conn1419144] end connection 172.28.0.163:56032 (399 connections now open) 2015-10-05T03:25:13.165+0100 [conn1419130] end connection 172.28.0.163:55934 (398 connections now open) 2015-10-05T03:25:13.166+0100 [mongosMain] connection accepted from 172.28.0.163:58750 #1419566 (399 connections now open) 2015-10-05T03:25:13.166+0100 [mongosMain] connection accepted from 172.28.0.163:58751 #1419567 (400 connections now open) 2015-10-05T03:25:13.167+0100 [conn1419566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:13.168+0100 [conn1419567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:13.521+0100 [conn1419170] end connection 172.28.0.164:49211 (399 connections now open) 2015-10-05T03:25:13.522+0100 [mongosMain] connection accepted from 172.28.0.164:52103 #1419568 (400 connections now open) 2015-10-05T03:25:13.524+0100 [conn1419568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:16.863+0100 [conn1419172] end connection 172.28.0.163:56154 (399 connections now open) 2015-10-05T03:25:16.863+0100 [conn1419157] end connection 172.28.0.163:56091 (399 connections now open) 2015-10-05T03:25:16.864+0100 [mongosMain] connection accepted from 172.28.0.163:58772 #1419569 (399 connections now open) 2015-10-05T03:25:16.864+0100 [mongosMain] connection accepted from 172.28.0.163:58773 #1419570 (400 connections now open) 2015-10-05T03:25:16.865+0100 [conn1419569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:16.865+0100 [conn1419570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:16.986+0100 [conn1419163] end connection 172.28.0.164:49167 (399 connections now open) 2015-10-05T03:25:16.987+0100 [mongosMain] connection accepted from 172.28.0.164:52125 #1419571 (400 connections now open) 2015-10-05T03:25:16.989+0100 [conn1419571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:22.570+0100 [conn1419167] end connection 172.28.0.164:49204 (399 connections now open) 2015-10-05T03:25:22.572+0100 [mongosMain] connection accepted from 172.28.0.164:52166 #1419572 (400 connections now open) 2015-10-05T03:25:22.573+0100 [conn1419572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:23.171+0100 [conn1419153] end connection 172.28.0.163:56083 (399 connections now open) 2015-10-05T03:25:23.171+0100 [conn1419129] end connection 172.28.0.163:55933 (398 connections now open) 2015-10-05T03:25:23.172+0100 [mongosMain] connection accepted from 172.28.0.163:58809 #1419573 (399 connections now open) 2015-10-05T03:25:23.173+0100 [mongosMain] connection accepted from 172.28.0.163:58810 #1419574 (400 connections now open) 2015-10-05T03:25:23.173+0100 [conn1419573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:23.173+0100 [conn1419574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:23.537+0100 [conn1419178] end connection 172.28.0.164:49258 (399 connections now open) 2015-10-05T03:25:23.538+0100 [mongosMain] connection accepted from 172.28.0.164:52172 #1419575 (400 connections now open) 2015-10-05T03:25:23.540+0100 [conn1419575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:23.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df935703b51053eaad17 2015-10-05T03:25:23.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:25:26.862+0100 [conn1419180] end connection 172.28.0.163:56221 (399 connections now open) 2015-10-05T03:25:26.863+0100 [mongosMain] connection accepted from 172.28.0.163:58833 #1419576 (400 connections now open) 2015-10-05T03:25:26.864+0100 [conn1419576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:26.986+0100 [conn1419108] end connection 172.28.0.164:65255 (399 connections now open) 2015-10-05T03:25:26.987+0100 [mongosMain] connection accepted from 172.28.0.164:52197 #1419577 (400 connections now open) 2015-10-05T03:25:26.989+0100 [conn1419577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:28.261+0100 [mongosMain] connection accepted from 127.0.0.1:58839 #1419578 (401 connections now open) 2015-10-05T03:25:28.264+0100 [conn1419578] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:28.270+0100 [conn1419578] end connection 127.0.0.1:58839 (400 connections now open) 2015-10-05T03:25:29.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611df995703b51053eaad25 2015-10-05T03:25:29.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:25:32.118+0100 [conn1419119] end connection 172.28.0.164:65278 (399 connections now open) 2015-10-05T03:25:32.120+0100 [mongosMain] connection accepted from 172.28.0.164:52221 #1419579 (400 connections now open) 2015-10-05T03:25:32.122+0100 [conn1419579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:32.572+0100 [conn1419175] end connection 172.28.0.164:49253 (399 connections now open) 2015-10-05T03:25:32.573+0100 [mongosMain] connection accepted from 172.28.0.164:52223 #1419580 (400 connections now open) 2015-10-05T03:25:32.575+0100 [conn1419580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:33.180+0100 [conn1419169] end connection 172.28.0.163:56131 (399 connections now open) 2015-10-05T03:25:33.180+0100 [conn1419161] end connection 172.28.0.163:56098 (398 connections now open) 2015-10-05T03:25:33.181+0100 [mongosMain] connection accepted from 172.28.0.163:58881 #1419581 (399 connections now open) 2015-10-05T03:25:33.182+0100 [mongosMain] connection accepted from 172.28.0.163:58882 #1419582 (400 connections now open) 2015-10-05T03:25:33.183+0100 [conn1419581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:33.183+0100 [conn1419582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:33.537+0100 [conn1419186] end connection 172.28.0.164:49342 (399 connections now open) 2015-10-05T03:25:33.538+0100 [mongosMain] connection accepted from 172.28.0.164:52236 #1419583 (400 connections now open) 2015-10-05T03:25:33.539+0100 [conn1419583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:36.878+0100 [conn1419187] end connection 172.28.0.163:56280 (399 connections now open) 2015-10-05T03:25:36.879+0100 [mongosMain] connection accepted from 172.28.0.163:58896 #1419584 (400 connections now open) 2015-10-05T03:25:36.880+0100 [conn1419584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:39.091+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:25:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:25:39.480+0100 [mongosMain] connection accepted from 127.0.0.1:58898 #1419585 (401 connections now open) 2015-10-05T03:25:39.483+0100 [conn1419585] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:39.487+0100 [conn1419585] end connection 127.0.0.1:58898 (400 connections now open) 2015-10-05T03:25:42.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfa55703b51053eaad3b 2015-10-05T03:25:42.134+0100 [conn1419189] end connection 172.28.0.164:49390 (399 connections now open) 2015-10-05T03:25:42.135+0100 [mongosMain] connection accepted from 172.28.0.164:52257 #1419586 (400 connections now open) 2015-10-05T03:25:42.136+0100 [conn1419586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:42.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:25:42.590+0100 [conn1419159] end connection 172.28.0.164:49160 (399 connections now open) 2015-10-05T03:25:42.591+0100 [mongosMain] connection accepted from 172.28.0.164:52260 #1419587 (400 connections now open) 2015-10-05T03:25:42.593+0100 [conn1419587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:43.195+0100 [conn1419184] end connection 172.28.0.163:56258 (399 connections now open) 2015-10-05T03:25:43.195+0100 [conn1419185] end connection 172.28.0.163:56259 (399 connections now open) 2015-10-05T03:25:43.197+0100 [mongosMain] connection accepted from 172.28.0.163:58903 #1419588 (399 connections now open) 2015-10-05T03:25:43.197+0100 [mongosMain] connection accepted from 172.28.0.163:58904 #1419589 (400 connections now open) 2015-10-05T03:25:43.198+0100 [conn1419588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:43.198+0100 [conn1419589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:43.553+0100 [conn1419193] end connection 172.28.0.164:49399 (399 connections now open) 2015-10-05T03:25:43.554+0100 [mongosMain] connection accepted from 172.28.0.164:52265 #1419590 (400 connections now open) 2015-10-05T03:25:43.556+0100 [conn1419590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:52.150+0100 [conn1419166] end connection 172.28.0.164:49191 (399 connections now open) 2015-10-05T03:25:52.151+0100 [mongosMain] connection accepted from 172.28.0.164:52273 #1419591 (400 connections now open) 2015-10-05T03:25:52.153+0100 [conn1419591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:52.602+0100 [conn1419183] end connection 172.28.0.164:49333 (399 connections now open) 2015-10-05T03:25:52.603+0100 [mongosMain] connection accepted from 172.28.0.164:52275 #1419592 (400 connections now open) 2015-10-05T03:25:52.605+0100 [conn1419592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:53.196+0100 [conn1419160] end connection 172.28.0.163:56099 (399 connections now open) 2015-10-05T03:25:53.197+0100 [mongosMain] connection accepted from 172.28.0.163:58918 #1419593 (400 connections now open) 2015-10-05T03:25:53.198+0100 [conn1419593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:53.553+0100 [conn1419201] end connection 172.28.0.164:49438 (399 connections now open) 2015-10-05T03:25:53.554+0100 [mongosMain] connection accepted from 172.28.0.164:52279 #1419594 (400 connections now open) 2015-10-05T03:25:53.556+0100 [conn1419594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:54.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfb25703b51053eaad59 2015-10-05T03:25:54.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:25:56.897+0100 [conn1419194] end connection 172.28.0.163:56330 (399 connections now open) 2015-10-05T03:25:56.899+0100 [mongosMain] connection accepted from 172.28.0.163:58926 #1419595 (400 connections now open) 2015-10-05T03:25:56.901+0100 [conn1419595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:25:57.032+0100 [conn1419147] end connection 172.28.0.164:65495 (399 connections now open) 2015-10-05T03:25:57.034+0100 [mongosMain] connection accepted from 172.28.0.164:52283 #1419596 (400 connections now open) 2015-10-05T03:25:57.035+0100 [conn1419596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:00.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfb85703b51053eaad5f 2015-10-05T03:26:00.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:02.165+0100 [conn1419182] end connection 172.28.0.164:49326 (399 connections now open) 2015-10-05T03:26:02.166+0100 [mongosMain] connection accepted from 172.28.0.164:52296 #1419597 (400 connections now open) 2015-10-05T03:26:02.170+0100 [conn1419597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:02.601+0100 [conn1419151] end connection 172.28.0.164:65521 (399 connections now open) 2015-10-05T03:26:02.603+0100 [mongosMain] connection accepted from 172.28.0.164:52298 #1419598 (400 connections now open) 2015-10-05T03:26:02.605+0100 [conn1419598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:03.211+0100 [conn1419105] end connection 172.28.0.163:55827 (399 connections now open) 2015-10-05T03:26:03.211+0100 [conn1419191] end connection 172.28.0.163:56307 (399 connections now open) 2015-10-05T03:26:03.212+0100 [mongosMain] connection accepted from 172.28.0.163:58950 #1419599 (399 connections now open) 2015-10-05T03:26:03.213+0100 [mongosMain] connection accepted from 172.28.0.163:58952 #1419600 (400 connections now open) 2015-10-05T03:26:03.213+0100 [conn1419599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:03.213+0100 [conn1419600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:03.569+0100 [conn1419206] end connection 172.28.0.164:49454 (399 connections now open) 2015-10-05T03:26:03.570+0100 [mongosMain] connection accepted from 172.28.0.164:52304 #1419601 (400 connections now open) 2015-10-05T03:26:03.572+0100 [conn1419601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:06.895+0100 [conn1419208] end connection 172.28.0.163:56360 (399 connections now open) 2015-10-05T03:26:06.896+0100 [mongosMain] connection accepted from 172.28.0.163:58981 #1419602 (400 connections now open) 2015-10-05T03:26:06.897+0100 [conn1419602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:06.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfbe5703b51053eaad8b 2015-10-05T03:26:07.049+0100 [conn1419179] end connection 172.28.0.164:49286 (399 connections now open) 2015-10-05T03:26:07.050+0100 [mongosMain] connection accepted from 172.28.0.164:52319 #1419603 (400 connections now open) 2015-10-05T03:26:07.052+0100 [conn1419603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:07.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:09.360+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:26:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:26:12.165+0100 [conn1419150] end connection 172.28.0.164:65519 (399 connections now open) 2015-10-05T03:26:12.166+0100 [mongosMain] connection accepted from 172.28.0.164:52340 #1419604 (400 connections now open) 2015-10-05T03:26:12.168+0100 [conn1419604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:12.617+0100 [conn1419190] end connection 172.28.0.164:49393 (399 connections now open) 2015-10-05T03:26:12.619+0100 [mongosMain] connection accepted from 172.28.0.164:52343 #1419605 (400 connections now open) 2015-10-05T03:26:12.621+0100 [conn1419605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:13.212+0100 [conn1419204] end connection 172.28.0.163:56353 (399 connections now open) 2015-10-05T03:26:13.212+0100 [conn1419176] end connection 172.28.0.163:56197 (398 connections now open) 2015-10-05T03:26:13.213+0100 [mongosMain] connection accepted from 172.28.0.163:59018 #1419606 (399 connections now open) 2015-10-05T03:26:13.214+0100 [mongosMain] connection accepted from 172.28.0.163:59019 #1419607 (400 connections now open) 2015-10-05T03:26:13.215+0100 [conn1419606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:13.215+0100 [conn1419607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:13.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfc55703b51053eaad96 2015-10-05T03:26:13.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:13.585+0100 [conn1419213] end connection 172.28.0.164:49475 (399 connections now open) 2015-10-05T03:26:13.586+0100 [mongosMain] connection accepted from 172.28.0.164:52348 #1419608 (400 connections now open) 2015-10-05T03:26:13.587+0100 [conn1419608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:16.910+0100 [conn1419215] end connection 172.28.0.163:56414 (399 connections now open) 2015-10-05T03:26:16.911+0100 [mongosMain] connection accepted from 172.28.0.163:59040 #1419609 (400 connections now open) 2015-10-05T03:26:16.912+0100 [conn1419609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:17.064+0100 [conn1419155] end connection 172.28.0.164:65531 (399 connections now open) 2015-10-05T03:26:17.065+0100 [mongosMain] connection accepted from 172.28.0.164:52367 #1419610 (400 connections now open) 2015-10-05T03:26:17.067+0100 [conn1419610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:19.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfcb5703b51053eaada6 2015-10-05T03:26:19.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:22.181+0100 [conn1419174] end connection 172.28.0.164:49245 (399 connections now open) 2015-10-05T03:26:22.183+0100 [mongosMain] connection accepted from 172.28.0.164:52402 #1419611 (400 connections now open) 2015-10-05T03:26:22.184+0100 [conn1419611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:22.633+0100 [conn1419210] end connection 172.28.0.164:49468 (399 connections now open) 2015-10-05T03:26:22.635+0100 [mongosMain] connection accepted from 172.28.0.164:52407 #1419612 (400 connections now open) 2015-10-05T03:26:22.637+0100 [conn1419612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:23.227+0100 [conn1419199] end connection 172.28.0.163:56336 (399 connections now open) 2015-10-05T03:26:23.227+0100 [conn1419168] end connection 172.28.0.163:56130 (399 connections now open) 2015-10-05T03:26:23.228+0100 [mongosMain] connection accepted from 172.28.0.163:59076 #1419613 (399 connections now open) 2015-10-05T03:26:23.229+0100 [mongosMain] connection accepted from 172.28.0.163:59077 #1419614 (400 connections now open) 2015-10-05T03:26:23.229+0100 [conn1419613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:23.230+0100 [conn1419614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:23.601+0100 [conn1419220] end connection 172.28.0.164:49531 (399 connections now open) 2015-10-05T03:26:23.602+0100 [mongosMain] connection accepted from 172.28.0.164:52414 #1419615 (400 connections now open) 2015-10-05T03:26:23.603+0100 [conn1419615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:25.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfd15703b51053eaadb4 2015-10-05T03:26:25.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:26.910+0100 [conn1419109] end connection 172.28.0.163:55837 (399 connections now open) 2015-10-05T03:26:26.910+0100 [conn1419222] end connection 172.28.0.163:56466 (399 connections now open) 2015-10-05T03:26:26.911+0100 [mongosMain] connection accepted from 172.28.0.163:59106 #1419616 (399 connections now open) 2015-10-05T03:26:26.911+0100 [mongosMain] connection accepted from 172.28.0.163:59107 #1419617 (400 connections now open) 2015-10-05T03:26:26.912+0100 [conn1419616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:26.913+0100 [conn1419617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:27.080+0100 [conn1419171] end connection 172.28.0.164:49225 (399 connections now open) 2015-10-05T03:26:27.080+0100 [mongosMain] connection accepted from 172.28.0.164:52439 #1419618 (400 connections now open) 2015-10-05T03:26:27.082+0100 [conn1419618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:28.225+0100 [mongosMain] connection accepted from 127.0.0.1:59121 #1419619 (401 connections now open) 2015-10-05T03:26:28.228+0100 [conn1419619] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:28.233+0100 [conn1419619] end connection 127.0.0.1:59121 (400 connections now open) 2015-10-05T03:26:32.197+0100 [conn1419158] end connection 172.28.0.164:49157 (399 connections now open) 2015-10-05T03:26:32.198+0100 [mongosMain] connection accepted from 172.28.0.164:52469 #1419620 (400 connections now open) 2015-10-05T03:26:32.200+0100 [conn1419620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:32.649+0100 [conn1419198] end connection 172.28.0.164:49434 (399 connections now open) 2015-10-05T03:26:32.650+0100 [mongosMain] connection accepted from 172.28.0.164:52475 #1419621 (400 connections now open) 2015-10-05T03:26:32.652+0100 [conn1419621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:33.228+0100 [conn1419218] end connection 172.28.0.163:56445 (399 connections now open) 2015-10-05T03:26:33.228+0100 [conn1419192] end connection 172.28.0.163:56308 (398 connections now open) 2015-10-05T03:26:33.229+0100 [mongosMain] connection accepted from 172.28.0.163:59159 #1419622 (399 connections now open) 2015-10-05T03:26:33.229+0100 [mongosMain] connection accepted from 172.28.0.163:59160 #1419623 (400 connections now open) 2015-10-05T03:26:33.230+0100 [conn1419622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:33.231+0100 [conn1419623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:33.615+0100 [conn1419227] end connection 172.28.0.164:49584 (399 connections now open) 2015-10-05T03:26:33.616+0100 [mongosMain] connection accepted from 172.28.0.164:52486 #1419624 (400 connections now open) 2015-10-05T03:26:33.618+0100 [conn1419624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:36.925+0100 [conn1419229] end connection 172.28.0.163:56522 (399 connections now open) 2015-10-05T03:26:36.926+0100 [conn1419173] end connection 172.28.0.163:56155 (399 connections now open) 2015-10-05T03:26:36.927+0100 [mongosMain] connection accepted from 172.28.0.163:59167 #1419625 (399 connections now open) 2015-10-05T03:26:36.927+0100 [mongosMain] connection accepted from 172.28.0.163:59168 #1419626 (400 connections now open) 2015-10-05T03:26:36.928+0100 [conn1419625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:36.929+0100 [conn1419626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:37.097+0100 [conn1419214] end connection 172.28.0.164:49490 (399 connections now open) 2015-10-05T03:26:37.098+0100 [mongosMain] connection accepted from 172.28.0.164:52495 #1419627 (400 connections now open) 2015-10-05T03:26:37.100+0100 [conn1419627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:38.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfdd5703b51053eaadce 2015-10-05T03:26:38.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:39.630+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:26:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:26:39.938+0100 [mongosMain] connection accepted from 127.0.0.1:59171 #1419628 (401 connections now open) 2015-10-05T03:26:39.941+0100 [conn1419628] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:39.944+0100 [conn1419628] end connection 127.0.0.1:59171 (400 connections now open) 2015-10-05T03:26:42.665+0100 [conn1419203] end connection 172.28.0.164:49449 (399 connections now open) 2015-10-05T03:26:42.666+0100 [mongosMain] connection accepted from 172.28.0.164:52504 #1419629 (400 connections now open) 2015-10-05T03:26:42.668+0100 [conn1419629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:43.243+0100 [conn1419205] end connection 172.28.0.163:56354 (399 connections now open) 2015-10-05T03:26:43.243+0100 [conn1419152] end connection 172.28.0.163:56082 (398 connections now open) 2015-10-05T03:26:43.244+0100 [mongosMain] connection accepted from 172.28.0.163:59175 #1419630 (399 connections now open) 2015-10-05T03:26:43.245+0100 [mongosMain] connection accepted from 172.28.0.163:59176 #1419631 (400 connections now open) 2015-10-05T03:26:43.246+0100 [conn1419631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:43.246+0100 [conn1419630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:44.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfe45703b51053eaadf1 2015-10-05T03:26:44.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:46.942+0100 [conn1419195] end connection 172.28.0.163:56331 (399 connections now open) 2015-10-05T03:26:46.943+0100 [mongosMain] connection accepted from 172.28.0.163:59184 #1419632 (400 connections now open) 2015-10-05T03:26:46.943+0100 [conn1419632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:47.111+0100 [conn1419207] end connection 172.28.0.164:49458 (399 connections now open) 2015-10-05T03:26:47.112+0100 [mongosMain] connection accepted from 172.28.0.164:52512 #1419633 (400 connections now open) 2015-10-05T03:26:47.114+0100 [conn1419633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:50.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dfea5703b51053eaae09 2015-10-05T03:26:50.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:52.680+0100 [conn1419224] end connection 172.28.0.164:49578 (399 connections now open) 2015-10-05T03:26:52.681+0100 [mongosMain] connection accepted from 172.28.0.164:52518 #1419634 (400 connections now open) 2015-10-05T03:26:52.683+0100 [conn1419634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:53.248+0100 [conn1419226] end connection 172.28.0.163:56498 (399 connections now open) 2015-10-05T03:26:53.249+0100 [conn1419200] end connection 172.28.0.163:56337 (398 connections now open) 2015-10-05T03:26:53.250+0100 [mongosMain] connection accepted from 172.28.0.163:59193 #1419635 (399 connections now open) 2015-10-05T03:26:53.251+0100 [conn1419635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:53.252+0100 [mongosMain] connection accepted from 172.28.0.163:59194 #1419636 (400 connections now open) 2015-10-05T03:26:53.253+0100 [conn1419636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:53.634+0100 [conn1419235] end connection 172.28.0.164:49660 (399 connections now open) 2015-10-05T03:26:53.635+0100 [mongosMain] connection accepted from 172.28.0.164:52521 #1419637 (400 connections now open) 2015-10-05T03:26:53.637+0100 [conn1419637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:56.942+0100 [conn1419181] end connection 172.28.0.163:56222 (399 connections now open) 2015-10-05T03:26:56.943+0100 [mongosMain] connection accepted from 172.28.0.163:59201 #1419638 (400 connections now open) 2015-10-05T03:26:56.945+0100 [conn1419638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:26:56.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dff05703b51053eaae26 2015-10-05T03:26:57.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:26:57.127+0100 [conn1419221] end connection 172.28.0.164:49547 (399 connections now open) 2015-10-05T03:26:57.128+0100 [mongosMain] connection accepted from 172.28.0.164:52526 #1419639 (400 connections now open) 2015-10-05T03:26:57.131+0100 [conn1419639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:02.697+0100 [conn1419217] end connection 172.28.0.164:49523 (399 connections now open) 2015-10-05T03:27:02.698+0100 [mongosMain] connection accepted from 172.28.0.164:52546 #1419640 (400 connections now open) 2015-10-05T03:27:02.700+0100 [conn1419640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:03.260+0100 [conn1419211] end connection 172.28.0.163:56380 (399 connections now open) 2015-10-05T03:27:03.260+0100 [conn1419212] end connection 172.28.0.163:56381 (398 connections now open) 2015-10-05T03:27:03.261+0100 [mongosMain] connection accepted from 172.28.0.163:59224 #1419641 (399 connections now open) 2015-10-05T03:27:03.262+0100 [mongosMain] connection accepted from 172.28.0.163:59225 #1419642 (400 connections now open) 2015-10-05T03:27:03.262+0100 [conn1419641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:03.263+0100 [conn1419642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:03.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dff75703b51053eaae3c 2015-10-05T03:27:03.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:06.958+0100 [conn1419238] end connection 172.28.0.163:56574 (399 connections now open) 2015-10-05T03:27:06.959+0100 [mongosMain] connection accepted from 172.28.0.163:59274 #1419643 (400 connections now open) 2015-10-05T03:27:06.960+0100 [conn1419643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:09.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611dffd5703b51053eaae6c 2015-10-05T03:27:09.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:09.904+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:27:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:27:12.711+0100 [conn1419246] end connection 172.28.0.164:49706 (399 connections now open) 2015-10-05T03:27:12.713+0100 [mongosMain] connection accepted from 172.28.0.164:52600 #1419644 (400 connections now open) 2015-10-05T03:27:12.715+0100 [conn1419644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:13.274+0100 [conn1419233] end connection 172.28.0.163:56552 (399 connections now open) 2015-10-05T03:27:13.274+0100 [conn1419225] end connection 172.28.0.163:56495 (398 connections now open) 2015-10-05T03:27:13.275+0100 [mongosMain] connection accepted from 172.28.0.163:59331 #1419645 (399 connections now open) 2015-10-05T03:27:13.275+0100 [mongosMain] connection accepted from 172.28.0.163:59333 #1419646 (400 connections now open) 2015-10-05T03:27:13.276+0100 [conn1419646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:13.276+0100 [conn1419645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:13.647+0100 [conn1419249] end connection 172.28.0.164:49710 (399 connections now open) 2015-10-05T03:27:13.648+0100 [mongosMain] connection accepted from 172.28.0.164:52604 #1419647 (400 connections now open) 2015-10-05T03:27:13.650+0100 [conn1419647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:16.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0035703b51053eaae83 2015-10-05T03:27:16.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:16.957+0100 [conn1419164] end connection 172.28.0.163:56106 (399 connections now open) 2015-10-05T03:27:16.957+0100 [conn1419237] end connection 172.28.0.163:56573 (398 connections now open) 2015-10-05T03:27:16.958+0100 [mongosMain] connection accepted from 172.28.0.163:59368 #1419648 (399 connections now open) 2015-10-05T03:27:16.958+0100 [mongosMain] connection accepted from 172.28.0.163:59371 #1419649 (400 connections now open) 2015-10-05T03:27:16.959+0100 [conn1419648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:16.959+0100 [conn1419649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:17.158+0100 [conn1419228] end connection 172.28.0.164:49608 (399 connections now open) 2015-10-05T03:27:17.159+0100 [mongosMain] connection accepted from 172.28.0.164:52634 #1419650 (400 connections now open) 2015-10-05T03:27:17.161+0100 [conn1419650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:22.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e00a5703b51053eaae9d 2015-10-05T03:27:22.728+0100 [conn1419252] end connection 172.28.0.164:49725 (399 connections now open) 2015-10-05T03:27:22.729+0100 [mongosMain] connection accepted from 172.28.0.164:52676 #1419651 (400 connections now open) 2015-10-05T03:27:22.731+0100 [conn1419651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:22.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:23.277+0100 [conn1419177] end connection 172.28.0.163:56196 (399 connections now open) 2015-10-05T03:27:23.278+0100 [conn1419243] end connection 172.28.0.163:56582 (399 connections now open) 2015-10-05T03:27:23.278+0100 [mongosMain] connection accepted from 172.28.0.163:59433 #1419652 (399 connections now open) 2015-10-05T03:27:23.279+0100 [mongosMain] connection accepted from 172.28.0.163:59434 #1419653 (400 connections now open) 2015-10-05T03:27:23.279+0100 [conn1419652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:23.280+0100 [conn1419653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:23.648+0100 [conn1419260] end connection 172.28.0.164:49778 (399 connections now open) 2015-10-05T03:27:23.649+0100 [mongosMain] connection accepted from 172.28.0.164:52683 #1419654 (400 connections now open) 2015-10-05T03:27:23.651+0100 [conn1419654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:26.973+0100 [conn1419251] end connection 172.28.0.163:56605 (399 connections now open) 2015-10-05T03:27:26.973+0100 [conn1419263] end connection 172.28.0.163:56718 (399 connections now open) 2015-10-05T03:27:26.974+0100 [mongosMain] connection accepted from 172.28.0.163:59530 #1419655 (399 connections now open) 2015-10-05T03:27:26.975+0100 [mongosMain] connection accepted from 172.28.0.163:59532 #1419656 (400 connections now open) 2015-10-05T03:27:26.975+0100 [conn1419655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:26.976+0100 [conn1419656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:27.174+0100 [conn1419255] end connection 172.28.0.164:49748 (399 connections now open) 2015-10-05T03:27:27.175+0100 [mongosMain] connection accepted from 172.28.0.164:52709 #1419657 (400 connections now open) 2015-10-05T03:27:27.176+0100 [conn1419657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:28.868+0100 [mongosMain] connection accepted from 127.0.0.1:59546 #1419658 (401 connections now open) 2015-10-05T03:27:28.870+0100 [conn1419658] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:28.875+0100 [conn1419658] end connection 127.0.0.1:59546 (400 connections now open) 2015-10-05T03:27:29.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0105703b51053eaaeb3 2015-10-05T03:27:29.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:32.743+0100 [conn1419257] end connection 172.28.0.164:49775 (399 connections now open) 2015-10-05T03:27:32.744+0100 [mongosMain] connection accepted from 172.28.0.164:52765 #1419659 (400 connections now open) 2015-10-05T03:27:32.746+0100 [conn1419659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:33.290+0100 [conn1419247] end connection 172.28.0.163:56597 (399 connections now open) 2015-10-05T03:27:33.292+0100 [mongosMain] connection accepted from 172.28.0.163:59575 #1419660 (400 connections now open) 2015-10-05T03:27:33.294+0100 [conn1419660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:33.663+0100 [conn1419267] end connection 172.28.0.164:49852 (399 connections now open) 2015-10-05T03:27:33.664+0100 [mongosMain] connection accepted from 172.28.0.164:52782 #1419661 (400 connections now open) 2015-10-05T03:27:33.665+0100 [conn1419661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:35.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0175703b51053eaaec4 2015-10-05T03:27:35.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:36.973+0100 [conn1419269] end connection 172.28.0.163:56782 (399 connections now open) 2015-10-05T03:27:36.973+0100 [conn1419262] end connection 172.28.0.163:56717 (398 connections now open) 2015-10-05T03:27:36.975+0100 [mongosMain] connection accepted from 172.28.0.163:59578 #1419662 (399 connections now open) 2015-10-05T03:27:36.976+0100 [mongosMain] connection accepted from 172.28.0.163:59579 #1419663 (400 connections now open) 2015-10-05T03:27:36.977+0100 [conn1419662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:36.977+0100 [conn1419663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:37.174+0100 [conn1419250] end connection 172.28.0.164:49715 (399 connections now open) 2015-10-05T03:27:37.176+0100 [mongosMain] connection accepted from 172.28.0.164:52792 #1419664 (400 connections now open) 2015-10-05T03:27:37.178+0100 [conn1419664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:40.032+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:27:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:27:40.153+0100 [mongosMain] connection accepted from 127.0.0.1:59582 #1419665 (401 connections now open) 2015-10-05T03:27:40.156+0100 [conn1419665] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:40.160+0100 [conn1419665] end connection 127.0.0.1:59582 (400 connections now open) 2015-10-05T03:27:41.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e01d5703b51053eaaeca 2015-10-05T03:27:41.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:42.743+0100 [conn1419232] end connection 172.28.0.164:49650 (399 connections now open) 2015-10-05T03:27:42.744+0100 [mongosMain] connection accepted from 172.28.0.164:52801 #1419666 (400 connections now open) 2015-10-05T03:27:42.745+0100 [conn1419666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:43.291+0100 [conn1419259] end connection 172.28.0.163:56696 (399 connections now open) 2015-10-05T03:27:43.292+0100 [mongosMain] connection accepted from 172.28.0.163:59587 #1419667 (400 connections now open) 2015-10-05T03:27:43.293+0100 [conn1419667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:46.988+0100 [conn1419279] end connection 172.28.0.163:56847 (399 connections now open) 2015-10-05T03:27:46.988+0100 [conn1419278] end connection 172.28.0.163:56845 (398 connections now open) 2015-10-05T03:27:46.990+0100 [mongosMain] connection accepted from 172.28.0.163:59599 #1419668 (399 connections now open) 2015-10-05T03:27:46.990+0100 [mongosMain] connection accepted from 172.28.0.163:59600 #1419669 (400 connections now open) 2015-10-05T03:27:46.991+0100 [conn1419668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:46.991+0100 [conn1419669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:47.191+0100 [conn1419261] end connection 172.28.0.164:49804 (399 connections now open) 2015-10-05T03:27:47.192+0100 [mongosMain] connection accepted from 172.28.0.164:52810 #1419670 (400 connections now open) 2015-10-05T03:27:47.193+0100 [conn1419670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:48.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0235703b51053eaaede 2015-10-05T03:27:48.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:52.759+0100 [conn1419264] end connection 172.28.0.164:49842 (399 connections now open) 2015-10-05T03:27:52.760+0100 [mongosMain] connection accepted from 172.28.0.164:52817 #1419671 (400 connections now open) 2015-10-05T03:27:52.761+0100 [conn1419671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:53.306+0100 [conn1419265] end connection 172.28.0.163:56749 (399 connections now open) 2015-10-05T03:27:53.307+0100 [mongosMain] connection accepted from 172.28.0.163:59608 #1419672 (400 connections now open) 2015-10-05T03:27:53.308+0100 [conn1419672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:53.694+0100 [conn1419276] end connection 172.28.0.164:49930 (399 connections now open) 2015-10-05T03:27:53.696+0100 [mongosMain] connection accepted from 172.28.0.164:52825 #1419673 (400 connections now open) 2015-10-05T03:27:53.697+0100 [conn1419673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:54.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e02a5703b51053eaaeef 2015-10-05T03:27:54.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:27:56.988+0100 [conn1419285] end connection 172.28.0.163:56858 (399 connections now open) 2015-10-05T03:27:56.989+0100 [conn1419244] end connection 172.28.0.163:56590 (398 connections now open) 2015-10-05T03:27:56.991+0100 [mongosMain] connection accepted from 172.28.0.163:59617 #1419674 (399 connections now open) 2015-10-05T03:27:56.991+0100 [mongosMain] connection accepted from 172.28.0.163:59618 #1419675 (400 connections now open) 2015-10-05T03:27:56.992+0100 [conn1419674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:56.993+0100 [conn1419675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:27:57.189+0100 [conn1419236] end connection 172.28.0.164:49683 (399 connections now open) 2015-10-05T03:27:57.191+0100 [mongosMain] connection accepted from 172.28.0.164:52840 #1419676 (400 connections now open) 2015-10-05T03:27:57.192+0100 [conn1419676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:02.759+0100 [conn1419241] end connection 172.28.0.164:49691 (399 connections now open) 2015-10-05T03:28:02.762+0100 [mongosMain] connection accepted from 172.28.0.164:52862 #1419677 (400 connections now open) 2015-10-05T03:28:02.764+0100 [conn1419677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:03.308+0100 [conn1419274] end connection 172.28.0.163:56835 (399 connections now open) 2015-10-05T03:28:03.309+0100 [mongosMain] connection accepted from 172.28.0.163:59642 #1419678 (400 connections now open) 2015-10-05T03:28:03.310+0100 [conn1419678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:03.695+0100 [conn1419289] end connection 172.28.0.164:49969 (399 connections now open) 2015-10-05T03:28:03.696+0100 [mongosMain] connection accepted from 172.28.0.164:52869 #1419679 (400 connections now open) 2015-10-05T03:28:03.698+0100 [conn1419679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:06.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0365703b51053eaaf20 2015-10-05T03:28:07.004+0100 [conn1419256] end connection 172.28.0.163:56651 (399 connections now open) 2015-10-05T03:28:07.005+0100 [mongosMain] connection accepted from 172.28.0.163:59675 #1419680 (400 connections now open) 2015-10-05T03:28:07.006+0100 [conn1419680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:07.084+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:07.205+0100 [conn1419268] end connection 172.28.0.164:49877 (399 connections now open) 2015-10-05T03:28:07.207+0100 [mongosMain] connection accepted from 172.28.0.164:52885 #1419681 (400 connections now open) 2015-10-05T03:28:07.210+0100 [conn1419681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:10.362+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:28:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:28:13.232+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:28:13.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:28:13.322+0100 [conn1419253] end connection 172.28.0.163:56626 (399 connections now open) 2015-10-05T03:28:13.324+0100 [mongosMain] connection accepted from 172.28.0.163:59712 #1419682 (400 connections now open) 2015-10-05T03:28:13.325+0100 [conn1419682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:13.711+0100 [conn1419295] end connection 172.28.0.164:49986 (399 connections now open) 2015-10-05T03:28:13.714+0100 [mongosMain] connection accepted from 172.28.0.164:52909 #1419683 (400 connections now open) 2015-10-05T03:28:13.716+0100 [conn1419683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:17.020+0100 [conn1419291] end connection 172.28.0.163:56875 (399 connections now open) 2015-10-05T03:28:17.022+0100 [mongosMain] connection accepted from 172.28.0.163:59733 #1419684 (400 connections now open) 2015-10-05T03:28:17.023+0100 [conn1419684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:17.221+0100 [conn1419290] end connection 172.28.0.164:49973 (399 connections now open) 2015-10-05T03:28:17.222+0100 [mongosMain] connection accepted from 172.28.0.164:52934 #1419685 (400 connections now open) 2015-10-05T03:28:17.225+0100 [conn1419685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:22.338+0100 [conn1419209] end connection 172.28.0.164:49465 (399 connections now open) 2015-10-05T03:28:22.339+0100 [mongosMain] connection accepted from 172.28.0.164:52966 #1419686 (400 connections now open) 2015-10-05T03:28:22.341+0100 [conn1419686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:23.336+0100 [conn1419294] end connection 172.28.0.163:56899 (399 connections now open) 2015-10-05T03:28:23.337+0100 [mongosMain] connection accepted from 172.28.0.163:59763 #1419687 (400 connections now open) 2015-10-05T03:28:23.338+0100 [conn1419687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:23.711+0100 [conn1419298] end connection 172.28.0.164:50035 (399 connections now open) 2015-10-05T03:28:23.712+0100 [mongosMain] connection accepted from 172.28.0.164:52974 #1419688 (400 connections now open) 2015-10-05T03:28:23.714+0100 [conn1419688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:25.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0495703b51053eaaf63 2015-10-05T03:28:25.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:27.021+0100 [conn1419300] end connection 172.28.0.163:56991 (399 connections now open) 2015-10-05T03:28:27.023+0100 [mongosMain] connection accepted from 172.28.0.163:59786 #1419689 (400 connections now open) 2015-10-05T03:28:27.023+0100 [conn1419689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:27.222+0100 [conn1419284] end connection 172.28.0.164:49959 (399 connections now open) 2015-10-05T03:28:27.223+0100 [mongosMain] connection accepted from 172.28.0.164:53011 #1419690 (400 connections now open) 2015-10-05T03:28:27.225+0100 [conn1419690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:28.621+0100 [mongosMain] connection accepted from 127.0.0.1:59793 #1419691 (401 connections now open) 2015-10-05T03:28:28.624+0100 [conn1419691] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:28.630+0100 [conn1419691] end connection 127.0.0.1:59793 (400 connections now open) 2015-10-05T03:28:31.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e04f5703b51053eaaf79 2015-10-05T03:28:32.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:32.354+0100 [conn1419202] end connection 172.28.0.164:49446 (399 connections now open) 2015-10-05T03:28:32.355+0100 [mongosMain] connection accepted from 172.28.0.164:53049 #1419692 (400 connections now open) 2015-10-05T03:28:32.358+0100 [conn1419692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:33.339+0100 [conn1419275] end connection 172.28.0.163:56837 (399 connections now open) 2015-10-05T03:28:33.340+0100 [mongosMain] connection accepted from 172.28.0.163:59833 #1419693 (400 connections now open) 2015-10-05T03:28:33.341+0100 [conn1419693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:33.726+0100 [conn1419301] end connection 172.28.0.164:50098 (399 connections now open) 2015-10-05T03:28:33.727+0100 [mongosMain] connection accepted from 172.28.0.164:53060 #1419694 (400 connections now open) 2015-10-05T03:28:33.729+0100 [conn1419694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:37.035+0100 [conn1419303] end connection 172.28.0.163:57038 (399 connections now open) 2015-10-05T03:28:37.036+0100 [mongosMain] connection accepted from 172.28.0.163:59845 #1419695 (400 connections now open) 2015-10-05T03:28:37.037+0100 [conn1419695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:37.238+0100 [conn1419277] end connection 172.28.0.164:49942 (399 connections now open) 2015-10-05T03:28:37.239+0100 [mongosMain] connection accepted from 172.28.0.164:53068 #1419696 (400 connections now open) 2015-10-05T03:28:37.240+0100 [conn1419696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:38.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0565703b51053eaaf95 2015-10-05T03:28:38.714+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:39.953+0100 [mongosMain] connection accepted from 127.0.0.1:59893 #1419697 (401 connections now open) 2015-10-05T03:28:39.956+0100 [conn1419697] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:39.960+0100 [conn1419697] end connection 127.0.0.1:59893 (400 connections now open) 2015-10-05T03:28:40.630+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:28:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:28:42.354+0100 [conn1419142] end connection 172.28.0.164:65448 (399 connections now open) 2015-10-05T03:28:42.355+0100 [mongosMain] connection accepted from 172.28.0.164:53077 #1419698 (400 connections now open) 2015-10-05T03:28:42.356+0100 [conn1419698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:43.353+0100 [conn1419242] end connection 172.28.0.163:56581 (399 connections now open) 2015-10-05T03:28:43.354+0100 [mongosMain] connection accepted from 172.28.0.163:59924 #1419699 (400 connections now open) 2015-10-05T03:28:43.356+0100 [conn1419699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:43.742+0100 [conn1419305] end connection 172.28.0.164:50175 (399 connections now open) 2015-10-05T03:28:43.743+0100 [mongosMain] connection accepted from 172.28.0.164:53082 #1419700 (400 connections now open) 2015-10-05T03:28:43.744+0100 [conn1419700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:45.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e05c5703b51053eaafb6 2015-10-05T03:28:45.212+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:47.036+0100 [conn1419307] end connection 172.28.0.163:57092 (399 connections now open) 2015-10-05T03:28:47.038+0100 [mongosMain] connection accepted from 172.28.0.163:59929 #1419701 (400 connections now open) 2015-10-05T03:28:47.039+0100 [conn1419701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:51.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0635703b51053eaafd7 2015-10-05T03:28:51.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:28:52.369+0100 [conn1419216] end connection 172.28.0.164:49520 (399 connections now open) 2015-10-05T03:28:52.370+0100 [mongosMain] connection accepted from 172.28.0.164:53090 #1419702 (400 connections now open) 2015-10-05T03:28:52.372+0100 [conn1419702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:53.356+0100 [conn1419258] end connection 172.28.0.163:56695 (399 connections now open) 2015-10-05T03:28:53.357+0100 [mongosMain] connection accepted from 172.28.0.163:59938 #1419703 (400 connections now open) 2015-10-05T03:28:53.358+0100 [conn1419703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:53.758+0100 [conn1419309] end connection 172.28.0.164:50206 (399 connections now open) 2015-10-05T03:28:53.759+0100 [mongosMain] connection accepted from 172.28.0.164:53096 #1419704 (400 connections now open) 2015-10-05T03:28:53.760+0100 [conn1419704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:57.051+0100 [conn1419286] end connection 172.28.0.163:56860 (399 connections now open) 2015-10-05T03:28:57.051+0100 [conn1419311] end connection 172.28.0.163:57105 (398 connections now open) 2015-10-05T03:28:57.052+0100 [mongosMain] connection accepted from 172.28.0.163:59942 #1419705 (399 connections now open) 2015-10-05T03:28:57.052+0100 [mongosMain] connection accepted from 172.28.0.163:59943 #1419706 (400 connections now open) 2015-10-05T03:28:57.053+0100 [conn1419705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:57.053+0100 [conn1419706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:28:57.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0695703b51053eaafec 2015-10-05T03:28:57.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:03.369+0100 [conn1419283] end connection 172.28.0.163:56852 (399 connections now open) 2015-10-05T03:29:03.370+0100 [mongosMain] connection accepted from 172.28.0.163:59971 #1419707 (400 connections now open) 2015-10-05T03:29:03.372+0100 [conn1419707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:03.773+0100 [conn1419312] end connection 172.28.0.164:50217 (399 connections now open) 2015-10-05T03:29:03.774+0100 [mongosMain] connection accepted from 172.28.0.164:53119 #1419708 (400 connections now open) 2015-10-05T03:29:03.775+0100 [conn1419708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:03.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e06f5703b51053eab005 2015-10-05T03:29:04.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:07.053+0100 [conn1419313] end connection 172.28.0.163:57118 (399 connections now open) 2015-10-05T03:29:07.053+0100 [conn1419292] end connection 172.28.0.163:56876 (399 connections now open) 2015-10-05T03:29:07.053+0100 [mongosMain] connection accepted from 172.28.0.163:59990 #1419709 (399 connections now open) 2015-10-05T03:29:07.054+0100 [mongosMain] connection accepted from 172.28.0.163:59991 #1419710 (400 connections now open) 2015-10-05T03:29:07.055+0100 [conn1419709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:07.055+0100 [conn1419710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:07.285+0100 [conn1419302] end connection 172.28.0.164:50118 (399 connections now open) 2015-10-05T03:29:07.285+0100 [mongosMain] connection accepted from 172.28.0.164:53137 #1419711 (400 connections now open) 2015-10-05T03:29:07.287+0100 [conn1419711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:10.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0765703b51053eab029 2015-10-05T03:29:10.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:10.791+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:29:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:29:12.385+0100 [conn1419281] end connection 172.28.0.164:49948 (399 connections now open) 2015-10-05T03:29:12.387+0100 [mongosMain] connection accepted from 172.28.0.164:53155 #1419712 (400 connections now open) 2015-10-05T03:29:12.389+0100 [conn1419712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:16.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e07c5703b51053eab038 2015-10-05T03:29:16.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:17.068+0100 [conn1419310] end connection 172.28.0.163:57104 (399 connections now open) 2015-10-05T03:29:17.068+0100 [conn1419316] end connection 172.28.0.163:57170 (398 connections now open) 2015-10-05T03:29:17.069+0100 [mongosMain] connection accepted from 172.28.0.163:60035 #1419713 (399 connections now open) 2015-10-05T03:29:17.069+0100 [mongosMain] connection accepted from 172.28.0.163:60036 #1419714 (400 connections now open) 2015-10-05T03:29:17.070+0100 [conn1419713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:17.070+0100 [conn1419714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:22.385+0100 [conn1419223] end connection 172.28.0.164:49575 (399 connections now open) 2015-10-05T03:29:22.387+0100 [mongosMain] connection accepted from 172.28.0.164:53212 #1419715 (400 connections now open) 2015-10-05T03:29:22.388+0100 [conn1419715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:22.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0825703b51053eab050 2015-10-05T03:29:23.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:23.385+0100 [conn1419248] end connection 172.28.0.163:56598 (399 connections now open) 2015-10-05T03:29:23.386+0100 [mongosMain] connection accepted from 172.28.0.163:60080 #1419716 (400 connections now open) 2015-10-05T03:29:23.388+0100 [conn1419716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:23.790+0100 [conn1419315] end connection 172.28.0.164:50255 (399 connections now open) 2015-10-05T03:29:23.791+0100 [mongosMain] connection accepted from 172.28.0.164:53223 #1419717 (400 connections now open) 2015-10-05T03:29:23.793+0100 [conn1419717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:27.083+0100 [conn1419270] end connection 172.28.0.163:56783 (399 connections now open) 2015-10-05T03:29:27.083+0100 [conn1419322] end connection 172.28.0.163:57235 (398 connections now open) 2015-10-05T03:29:27.084+0100 [mongosMain] connection accepted from 172.28.0.163:60099 #1419718 (399 connections now open) 2015-10-05T03:29:27.085+0100 [mongosMain] connection accepted from 172.28.0.163:60100 #1419719 (400 connections now open) 2015-10-05T03:29:27.085+0100 [conn1419718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:27.086+0100 [conn1419719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:27.301+0100 [conn1419299] end connection 172.28.0.164:50062 (399 connections now open) 2015-10-05T03:29:27.302+0100 [mongosMain] connection accepted from 172.28.0.164:53243 #1419720 (400 connections now open) 2015-10-05T03:29:27.304+0100 [conn1419720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:29.069+0100 [mongosMain] connection accepted from 127.0.0.1:60109 #1419721 (401 connections now open) 2015-10-05T03:29:29.072+0100 [conn1419721] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:29.081+0100 [conn1419721] end connection 127.0.0.1:60109 (400 connections now open) 2015-10-05T03:29:29.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0895703b51053eab05b 2015-10-05T03:29:29.334+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:32.402+0100 [conn1419197] end connection 172.28.0.164:49431 (399 connections now open) 2015-10-05T03:29:32.403+0100 [mongosMain] connection accepted from 172.28.0.164:53275 #1419722 (400 connections now open) 2015-10-05T03:29:32.405+0100 [conn1419722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:32.869+0100 [conn1419287] end connection 172.28.0.164:49965 (399 connections now open) 2015-10-05T03:29:32.870+0100 [mongosMain] connection accepted from 172.28.0.164:53282 #1419723 (400 connections now open) 2015-10-05T03:29:32.874+0100 [conn1419723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:33.810+0100 [conn1419327] end connection 172.28.0.164:50512 (399 connections now open) 2015-10-05T03:29:33.811+0100 [mongosMain] connection accepted from 172.28.0.164:53290 #1419724 (400 connections now open) 2015-10-05T03:29:33.814+0100 [conn1419724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:35.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e08f5703b51053eab064 2015-10-05T03:29:35.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:37.083+0100 [conn1419306] end connection 172.28.0.163:57091 (399 connections now open) 2015-10-05T03:29:37.083+0100 [conn1419329] end connection 172.28.0.163:57300 (398 connections now open) 2015-10-05T03:29:37.085+0100 [mongosMain] connection accepted from 172.28.0.163:60132 #1419725 (399 connections now open) 2015-10-05T03:29:37.086+0100 [mongosMain] connection accepted from 172.28.0.163:60133 #1419726 (400 connections now open) 2015-10-05T03:29:37.087+0100 [conn1419725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:37.087+0100 [conn1419726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:37.321+0100 [conn1419318] end connection 172.28.0.164:50277 (399 connections now open) 2015-10-05T03:29:37.322+0100 [mongosMain] connection accepted from 172.28.0.164:53296 #1419727 (400 connections now open) 2015-10-05T03:29:37.324+0100 [conn1419727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:39.860+0100 [mongosMain] connection accepted from 127.0.0.1:60136 #1419728 (401 connections now open) 2015-10-05T03:29:39.863+0100 [conn1419728] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:39.867+0100 [conn1419728] end connection 127.0.0.1:60136 (400 connections now open) 2015-10-05T03:29:41.044+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:29:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:29:42.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0955703b51053eab06d 2015-10-05T03:29:42.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:42.401+0100 [conn1419240] end connection 172.28.0.164:49689 (399 connections now open) 2015-10-05T03:29:42.402+0100 [mongosMain] connection accepted from 172.28.0.164:53302 #1419729 (400 connections now open) 2015-10-05T03:29:42.403+0100 [conn1419729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:42.868+0100 [conn1419282] end connection 172.28.0.164:49950 (399 connections now open) 2015-10-05T03:29:42.870+0100 [mongosMain] connection accepted from 172.28.0.164:53304 #1419730 (400 connections now open) 2015-10-05T03:29:42.871+0100 [conn1419730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:43.820+0100 [conn1419333] end connection 172.28.0.164:50668 (399 connections now open) 2015-10-05T03:29:43.821+0100 [mongosMain] connection accepted from 172.28.0.164:53306 #1419731 (400 connections now open) 2015-10-05T03:29:43.823+0100 [conn1419731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:47.098+0100 [conn1419314] end connection 172.28.0.163:57120 (399 connections now open) 2015-10-05T03:29:47.098+0100 [conn1419334] end connection 172.28.0.163:57337 (399 connections now open) 2015-10-05T03:29:47.099+0100 [mongosMain] connection accepted from 172.28.0.163:60147 #1419732 (399 connections now open) 2015-10-05T03:29:47.099+0100 [mongosMain] connection accepted from 172.28.0.163:60148 #1419733 (400 connections now open) 2015-10-05T03:29:47.100+0100 [conn1419732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:47.100+0100 [conn1419733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:47.317+0100 [conn1419336] end connection 172.28.0.164:50674 (399 connections now open) 2015-10-05T03:29:47.318+0100 [mongosMain] connection accepted from 172.28.0.164:53312 #1419734 (400 connections now open) 2015-10-05T03:29:47.320+0100 [conn1419734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:48.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e09c5703b51053eab082 2015-10-05T03:29:48.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:53.837+0100 [conn1419338] end connection 172.28.0.164:50686 (399 connections now open) 2015-10-05T03:29:53.838+0100 [mongosMain] connection accepted from 172.28.0.164:53317 #1419735 (400 connections now open) 2015-10-05T03:29:53.840+0100 [conn1419735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:54.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0a25703b51053eab091 2015-10-05T03:29:54.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:29:57.100+0100 [conn1419317] end connection 172.28.0.163:57172 (399 connections now open) 2015-10-05T03:29:57.100+0100 [conn1419340] end connection 172.28.0.163:57352 (399 connections now open) 2015-10-05T03:29:57.100+0100 [mongosMain] connection accepted from 172.28.0.163:60159 #1419736 (399 connections now open) 2015-10-05T03:29:57.101+0100 [mongosMain] connection accepted from 172.28.0.163:60162 #1419737 (400 connections now open) 2015-10-05T03:29:57.101+0100 [conn1419736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:57.102+0100 [conn1419737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:29:57.332+0100 [conn1419323] end connection 172.28.0.164:50407 (399 connections now open) 2015-10-05T03:29:57.333+0100 [mongosMain] connection accepted from 172.28.0.164:53321 #1419738 (400 connections now open) 2015-10-05T03:29:57.335+0100 [conn1419738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:01.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0a85703b51053eab0a0 2015-10-05T03:30:01.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:03.852+0100 [conn1419342] end connection 172.28.0.164:50726 (399 connections now open) 2015-10-05T03:30:03.853+0100 [mongosMain] connection accepted from 172.28.0.164:53344 #1419739 (400 connections now open) 2015-10-05T03:30:03.854+0100 [conn1419739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:04.876+0100 [conn1419384] end connection 172.28.0.163:57648 (399 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419710] end connection 172.28.0.163:59991 (398 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419417] end connection 172.28.0.163:57874 (397 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419668] end connection 172.28.0.163:59599 (397 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419412] end connection 172.28.0.163:57857 (395 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419477] end connection 172.28.0.163:58247 (394 connections now open) 2015-10-05T03:30:04.877+0100 [conn1419348] end connection 172.28.0.163:57408 (393 connections now open) 2015-10-05T03:30:04.878+0100 [conn1419509] end connection 172.28.0.163:58404 (392 connections now open) 2015-10-05T03:30:04.878+0100 [conn1419464] end connection 172.28.0.163:58141 (392 connections now open) 2015-10-05T03:30:04.878+0100 [conn1419617] end connection 172.28.0.163:59107 (390 connections now open) 2015-10-05T03:30:04.878+0100 [conn1419643] end connection 172.28.0.163:59274 (390 connections now open) 2015-10-05T03:30:04.879+0100 [conn1419695] end connection 172.28.0.163:59845 (388 connections now open) 2015-10-05T03:30:04.879+0100 [conn1419701] end connection 172.28.0.163:59929 (387 connections now open) 2015-10-05T03:30:04.879+0100 [conn1419616] end connection 172.28.0.163:59106 (386 connections now open) 2015-10-05T03:30:04.879+0100 [conn1419321] end connection 172.28.0.163:57234 (386 connections now open) 2015-10-05T03:30:04.879+0100 [conn1419625] end connection 172.28.0.163:59167 (384 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419433] end connection 172.28.0.163:57987 (383 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419351] end connection 172.28.0.163:57469 (383 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419343] end connection 172.28.0.163:57364 (382 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419662] end connection 172.28.0.163:59578 (380 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419404] end connection 172.28.0.163:57796 (379 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419632] end connection 172.28.0.163:59184 (378 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419440] end connection 172.28.0.163:58047 (378 connections now open) 2015-10-05T03:30:04.880+0100 [conn1419602] end connection 172.28.0.163:58981 (377 connections now open) 2015-10-05T03:30:04.881+0100 [conn1419562] end connection 172.28.0.163:58717 (375 connections now open) 2015-10-05T03:30:04.881+0100 [conn1419483] end connection 172.28.0.163:58307 (374 connections now open) 2015-10-05T03:30:04.881+0100 [conn1419554] end connection 172.28.0.163:58665 (373 connections now open) 2015-10-05T03:30:05.310+0100 [conn1419555] end connection 172.28.0.164:52016 (372 connections now open) 2015-10-05T03:30:05.310+0100 [conn1419583] end connection 172.28.0.164:52236 (372 connections now open) 2015-10-05T03:30:05.310+0100 [conn1419465] end connection 172.28.0.164:51517 (370 connections now open) 2015-10-05T03:30:05.310+0100 [conn1419345] end connection 172.28.0.164:50740 (369 connections now open) 2015-10-05T03:30:05.311+0100 [conn1419441] end connection 172.28.0.164:51412 (368 connections now open) 2015-10-05T03:30:05.311+0100 [conn1419510] end connection 172.28.0.164:51766 (368 connections now open) 2015-10-05T03:30:05.311+0100 [conn1419458] end connection 172.28.0.164:51501 (366 connections now open) 2015-10-05T03:30:05.311+0100 [conn1419679] end connection 172.28.0.164:52869 (365 connections now open) 2015-10-05T03:30:05.311+0100 [conn1419603] end connection 172.28.0.164:52319 (364 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419508] end connection 172.28.0.164:51762 (363 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419517] end connection 172.28.0.164:51801 (363 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419355] end connection 172.28.0.164:50880 (361 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419530] end connection 172.28.0.164:51923 (361 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419661] end connection 172.28.0.164:52782 (361 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419571] end connection 172.28.0.164:52125 (361 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419590] end connection 172.28.0.164:52265 (358 connections now open) 2015-10-05T03:30:05.312+0100 [conn1419610] end connection 172.28.0.164:52367 (358 connections now open) 2015-10-05T03:30:05.313+0100 [conn1419633] end connection 172.28.0.164:52512 (355 connections now open) 2015-10-05T03:30:05.313+0100 [conn1419724] end connection 172.28.0.164:53290 (354 connections now open) 2015-10-05T03:30:05.313+0100 [conn1419568] end connection 172.28.0.164:52103 (354 connections now open) 2015-10-05T03:30:05.313+0100 [conn1419450] end connection 172.28.0.164:51466 (353 connections now open) 2015-10-05T03:30:05.313+0100 [conn1419330] end connection 172.28.0.164:50561 (351 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419696] end connection 172.28.0.164:53068 (351 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419396] end connection 172.28.0.164:51116 (349 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419447] end connection 172.28.0.164:51446 (349 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419515] end connection 172.28.0.164:51787 (349 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419624] end connection 172.28.0.164:52486 (349 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419601] end connection 172.28.0.164:52304 (349 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419627] end connection 172.28.0.164:52495 (345 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419346] end connection 172.28.0.164:50752 (344 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419608] end connection 172.28.0.164:52348 (343 connections now open) 2015-10-05T03:30:05.314+0100 [conn1419739] end connection 172.28.0.164:53344 (342 connections now open) 2015-10-05T03:30:06.381+0100 [conn1419377] end connection 172.28.0.163:57602 (340 connections now open) 2015-10-05T03:30:06.381+0100 [conn1419426] end connection 172.28.0.163:57925 (339 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419706] end connection 172.28.0.163:59943 (338 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419397] end connection 172.28.0.163:57749 (338 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419648] end connection 172.28.0.163:59368 (336 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419378] end connection 172.28.0.163:57603 (335 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419733] end connection 172.28.0.163:60148 (335 connections now open) 2015-10-05T03:30:06.382+0100 [conn1419709] end connection 172.28.0.163:59990 (335 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419363] end connection 172.28.0.163:57575 (333 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419418] end connection 172.28.0.163:57875 (333 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419411] end connection 172.28.0.163:57856 (330 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419493] end connection 172.28.0.163:58371 (329 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419655] end connection 172.28.0.163:59530 (328 connections now open) 2015-10-05T03:30:06.383+0100 [conn1419356] end connection 172.28.0.163:57535 (328 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419335] end connection 172.28.0.163:57338 (326 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419392] end connection 172.28.0.163:57710 (326 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419669] end connection 172.28.0.163:59600 (326 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419680] end connection 172.28.0.163:59675 (323 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419405] end connection 172.28.0.163:57797 (323 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419737] end connection 172.28.0.163:60162 (322 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419449] end connection 172.28.0.163:58099 (323 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419434] end connection 172.28.0.163:57988 (319 connections now open) 2015-10-05T03:30:06.384+0100 [conn1419501] end connection 172.28.0.163:58386 (318 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419448] end connection 172.28.0.163:58098 (317 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419656] end connection 172.28.0.163:59532 (316 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419584] end connection 172.28.0.163:58896 (316 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419545] end connection 172.28.0.163:58646 (314 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419675] end connection 172.28.0.163:59618 (313 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419516] end connection 172.28.0.163:58461 (312 connections now open) 2015-10-05T03:30:06.385+0100 [conn1419391] end connection 172.28.0.163:57709 (311 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419537] end connection 172.28.0.163:58628 (310 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419523] end connection 172.28.0.163:58519 (309 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419719] end connection 172.28.0.163:60100 (309 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419595] end connection 172.28.0.163:58926 (307 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419609] end connection 172.28.0.163:59040 (306 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419713] end connection 172.28.0.163:60035 (305 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419732] end connection 172.28.0.163:60147 (305 connections now open) 2015-10-05T03:30:06.386+0100 [conn1419398] end connection 172.28.0.163:57751 (303 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419370] end connection 172.28.0.163:57589 (302 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419347] end connection 172.28.0.163:57407 (301 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419718] end connection 172.28.0.163:60099 (300 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419705] end connection 172.28.0.163:59942 (299 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419425] end connection 172.28.0.163:57924 (298 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419684] end connection 172.28.0.163:59733 (298 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419725] end connection 172.28.0.163:60132 (297 connections now open) 2015-10-05T03:30:06.387+0100 [conn1419344] end connection 172.28.0.163:57365 (296 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419561] end connection 172.28.0.163:58716 (295 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419328] end connection 172.28.0.163:57299 (294 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419492] end connection 172.28.0.163:58370 (292 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419371] end connection 172.28.0.163:57590 (291 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419457] end connection 172.28.0.163:58126 (290 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419471] end connection 172.28.0.163:58184 (290 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419362] end connection 172.28.0.163:57574 (288 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419352] end connection 172.28.0.163:57470 (288 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419626] end connection 172.28.0.163:59168 (287 connections now open) 2015-10-05T03:30:06.388+0100 [conn1419385] end connection 172.28.0.163:57649 (285 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419570] end connection 172.28.0.163:58773 (284 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419689] end connection 172.28.0.163:59786 (283 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419576] end connection 172.28.0.163:58833 (282 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419546] end connection 172.28.0.163:58647 (281 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419569] end connection 172.28.0.163:58772 (281 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419538] end connection 172.28.0.163:58629 (280 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419529] end connection 172.28.0.163:58576 (279 connections now open) 2015-10-05T03:30:06.389+0100 [conn1419339] end connection 172.28.0.163:57351 (277 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419553] end connection 172.28.0.163:58664 (277 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419726] end connection 172.28.0.163:60133 (276 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419638] end connection 172.28.0.163:59201 (275 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419649] end connection 172.28.0.163:59371 (273 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419674] end connection 172.28.0.163:59617 (272 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419502] end connection 172.28.0.163:58387 (271 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419736] end connection 172.28.0.163:60159 (270 connections now open) 2015-10-05T03:30:06.390+0100 [conn1419663] end connection 172.28.0.163:59579 (269 connections now open) 2015-10-05T03:30:06.391+0100 [conn1419714] end connection 172.28.0.163:60036 (268 connections now open) 2015-10-05T03:30:06.940+0100 [conn1419296] end connection 172.28.0.164:50005 (267 connections now open) 2015-10-05T03:30:06.940+0100 [conn1419596] end connection 172.28.0.164:52283 (266 connections now open) 2015-10-05T03:30:06.940+0100 [conn1419470] end connection 172.28.0.164:51538 (265 connections now open) 2015-10-05T03:30:06.941+0100 [conn1419472] end connection 172.28.0.164:51554 (264 connections now open) 2015-10-05T03:30:06.941+0100 [conn1419720] end connection 172.28.0.164:53243 (263 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419383] end connection 172.28.0.164:51024 (262 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419435] end connection 172.28.0.164:51358 (262 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419349] end connection 172.28.0.164:50770 (260 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419372] end connection 172.28.0.164:50970 (260 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419353] end connection 172.28.0.164:50828 (258 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419681] end connection 172.28.0.164:52885 (260 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419484] end connection 172.28.0.164:51655 (257 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419688] end connection 172.28.0.164:52974 (258 connections now open) 2015-10-05T03:30:06.942+0100 [conn1419700] end connection 172.28.0.164:53082 (257 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419727] end connection 172.28.0.164:53296 (254 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419390] end connection 172.28.0.164:51064 (253 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419738] end connection 172.28.0.164:53321 (257 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419427] end connection 172.28.0.164:51300 (256 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419560] end connection 172.28.0.164:52041 (257 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419350] end connection 172.28.0.164:50803 (254 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419552] end connection 172.28.0.164:52012 (254 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419547] end connection 172.28.0.164:52000 (254 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419432] end connection 172.28.0.164:51335 (254 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419670] end connection 172.28.0.164:52810 (245 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419376] end connection 172.28.0.164:50980 (257 connections now open) 2015-10-05T03:30:06.943+0100 [conn1419575] end connection 172.28.0.164:52172 (253 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419536] end connection 172.28.0.164:51977 (242 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419647] end connection 172.28.0.164:52604 (241 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419708] end connection 172.28.0.164:53119 (239 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419563] end connection 172.28.0.164:52062 (239 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419639] end connection 172.28.0.164:52526 (239 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419341] end connection 172.28.0.164:50692 (239 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419664] end connection 172.28.0.164:52792 (236 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419711] end connection 172.28.0.164:53137 (234 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419544] end connection 172.28.0.164:51995 (234 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419478] end connection 172.28.0.164:51597 (233 connections now open) 2015-10-05T03:30:06.944+0100 [conn1419673] end connection 172.28.0.164:52825 (233 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419717] end connection 172.28.0.164:53223 (230 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419734] end connection 172.28.0.164:53312 (229 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419419] end connection 172.28.0.164:51259 (228 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419594] end connection 172.28.0.164:52279 (227 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419357] end connection 172.28.0.164:50896 (226 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419683] end connection 172.28.0.164:52909 (226 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419528] end connection 172.28.0.164:51901 (225 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419676] end connection 172.28.0.164:52840 (223 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419494] end connection 172.28.0.164:51732 (223 connections now open) 2015-10-05T03:30:06.945+0100 [conn1419685] end connection 172.28.0.164:52934 (221 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419577] end connection 172.28.0.164:52197 (220 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419650] end connection 172.28.0.164:52634 (219 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419637] end connection 172.28.0.164:52521 (218 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419735] end connection 172.28.0.164:53317 (218 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419704] end connection 172.28.0.164:53096 (216 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419657] end connection 172.28.0.164:52709 (215 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419522] end connection 172.28.0.164:51840 (215 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419690] end connection 172.28.0.164:53011 (214 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419618] end connection 172.28.0.164:52439 (212 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419369] end connection 172.28.0.164:50963 (212 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419463] end connection 172.28.0.164:51513 (210 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419615] end connection 172.28.0.164:52414 (209 connections now open) 2015-10-05T03:30:06.946+0100 [conn1419731] end connection 172.28.0.164:53306 (208 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419500] end connection 172.28.0.164:51746 (207 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419503] end connection 172.28.0.164:51751 (206 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419654] end connection 172.28.0.164:52683 (205 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419424] end connection 172.28.0.164:51282 (205 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419439] end connection 172.28.0.164:51391 (204 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419379] end connection 172.28.0.164:50984 (202 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419694] end connection 172.28.0.164:53060 (202 connections now open) 2015-10-05T03:30:06.947+0100 [conn1419456] end connection 172.28.0.164:51496 (201 connections now open) 2015-10-05T03:30:07.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0af5703b51053eab0c4 2015-10-05T03:30:07.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:10.347+0100 [mongosMain] connection accepted from 172.28.0.164:53369 #1419740 (201 connections now open) 2015-10-05T03:30:10.411+0100 [conn1419740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:10.926+0100 [mongosMain] connection accepted from 172.28.0.164:53377 #1419741 (202 connections now open) 2015-10-05T03:30:10.928+0100 [conn1419741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:11.191+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:30:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:30:11.526+0100 [mongosMain] connection accepted from 172.28.0.164:53381 #1419742 (203 connections now open) 2015-10-05T03:30:11.527+0100 [conn1419742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:11.660+0100 [mongosMain] connection accepted from 172.28.0.163:60233 #1419743 (204 connections now open) 2015-10-05T03:30:11.771+0100 [conn1419743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:11.916+0100 [mongosMain] connection accepted from 172.28.0.163:60235 #1419744 (205 connections now open) 2015-10-05T03:30:11.917+0100 [conn1419744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:11.938+0100 [mongosMain] connection accepted from 172.28.0.163:60236 #1419745 (206 connections now open) 2015-10-05T03:30:11.939+0100 [conn1419745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:12.513+0100 [mongosMain] connection accepted from 172.28.0.163:60243 #1419746 (207 connections now open) 2015-10-05T03:30:12.514+0100 [conn1419746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:13.432+0100 [conn1419288] end connection 172.28.0.163:56868 (206 connections now open) 2015-10-05T03:30:13.434+0100 [mongosMain] connection accepted from 172.28.0.163:60254 #1419747 (207 connections now open) 2015-10-05T03:30:13.435+0100 [conn1419747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:13.787+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:30:13.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:30:16.444+0100 [mongosMain] connection accepted from 172.28.0.164:53407 #1419748 (208 connections now open) 2015-10-05T03:30:16.446+0100 [conn1419748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:16.451+0100 [mongosMain] connection accepted from 172.28.0.164:53408 #1419749 (209 connections now open) 2015-10-05T03:30:16.453+0100 [conn1419749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0bb5703b51053eab11b 2015-10-05T03:30:20.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:20.469+0100 [mongosMain] connection accepted from 172.28.0.164:53436 #1419750 (210 connections now open) 2015-10-05T03:30:20.470+0100 [conn1419750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.472+0100 [mongosMain] connection accepted from 172.28.0.164:53442 #1419751 (211 connections now open) 2015-10-05T03:30:20.473+0100 [conn1419751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.474+0100 [mongosMain] connection accepted from 172.28.0.164:53445 #1419752 (212 connections now open) 2015-10-05T03:30:20.476+0100 [conn1419752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.477+0100 [mongosMain] connection accepted from 172.28.0.164:53448 #1419753 (213 connections now open) 2015-10-05T03:30:20.479+0100 [conn1419753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.480+0100 [mongosMain] connection accepted from 172.28.0.164:53452 #1419754 (214 connections now open) 2015-10-05T03:30:20.481+0100 [conn1419754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.483+0100 [mongosMain] connection accepted from 172.28.0.164:53455 #1419755 (215 connections now open) 2015-10-05T03:30:20.484+0100 [conn1419755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.486+0100 [mongosMain] connection accepted from 172.28.0.164:53458 #1419756 (216 connections now open) 2015-10-05T03:30:20.487+0100 [conn1419756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.488+0100 [mongosMain] connection accepted from 172.28.0.164:53462 #1419757 (217 connections now open) 2015-10-05T03:30:20.490+0100 [conn1419757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.491+0100 [mongosMain] connection accepted from 172.28.0.164:53465 #1419758 (218 connections now open) 2015-10-05T03:30:20.493+0100 [conn1419758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.494+0100 [mongosMain] connection accepted from 172.28.0.164:53469 #1419759 (219 connections now open) 2015-10-05T03:30:20.496+0100 [conn1419759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.497+0100 [mongosMain] connection accepted from 172.28.0.164:53473 #1419760 (220 connections now open) 2015-10-05T03:30:20.499+0100 [conn1419760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.501+0100 [mongosMain] connection accepted from 172.28.0.164:53476 #1419761 (221 connections now open) 2015-10-05T03:30:20.503+0100 [conn1419761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.505+0100 [mongosMain] connection accepted from 172.28.0.164:53479 #1419762 (222 connections now open) 2015-10-05T03:30:20.506+0100 [conn1419762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.507+0100 [mongosMain] connection accepted from 172.28.0.164:53483 #1419763 (223 connections now open) 2015-10-05T03:30:20.509+0100 [conn1419763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.510+0100 [mongosMain] connection accepted from 172.28.0.164:53486 #1419764 (224 connections now open) 2015-10-05T03:30:20.512+0100 [conn1419764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.513+0100 [mongosMain] connection accepted from 172.28.0.164:53490 #1419765 (225 connections now open) 2015-10-05T03:30:20.515+0100 [conn1419765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.516+0100 [mongosMain] connection accepted from 172.28.0.164:53493 #1419766 (226 connections now open) 2015-10-05T03:30:20.517+0100 [conn1419766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.519+0100 [mongosMain] connection accepted from 172.28.0.164:53496 #1419767 (227 connections now open) 2015-10-05T03:30:20.521+0100 [conn1419767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.522+0100 [mongosMain] connection accepted from 172.28.0.164:53500 #1419768 (228 connections now open) 2015-10-05T03:30:20.523+0100 [conn1419768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.525+0100 [mongosMain] connection accepted from 172.28.0.164:53503 #1419769 (229 connections now open) 2015-10-05T03:30:20.526+0100 [conn1419769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.528+0100 [mongosMain] connection accepted from 172.28.0.164:53504 #1419770 (230 connections now open) 2015-10-05T03:30:20.529+0100 [conn1419770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.530+0100 [mongosMain] connection accepted from 172.28.0.164:53505 #1419771 (231 connections now open) 2015-10-05T03:30:20.532+0100 [conn1419771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.533+0100 [mongosMain] connection accepted from 172.28.0.164:53506 #1419772 (232 connections now open) 2015-10-05T03:30:20.534+0100 [conn1419772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.535+0100 [mongosMain] connection accepted from 172.28.0.164:53507 #1419773 (233 connections now open) 2015-10-05T03:30:20.537+0100 [conn1419773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.538+0100 [mongosMain] connection accepted from 172.28.0.164:53508 #1419774 (234 connections now open) 2015-10-05T03:30:20.540+0100 [conn1419774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.542+0100 [mongosMain] connection accepted from 172.28.0.164:53509 #1419775 (235 connections now open) 2015-10-05T03:30:20.544+0100 [conn1419775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.545+0100 [mongosMain] connection accepted from 172.28.0.164:53510 #1419776 (236 connections now open) 2015-10-05T03:30:20.548+0100 [conn1419776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.550+0100 [mongosMain] connection accepted from 172.28.0.164:53511 #1419777 (237 connections now open) 2015-10-05T03:30:20.552+0100 [conn1419777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.554+0100 [mongosMain] connection accepted from 172.28.0.164:53512 #1419778 (238 connections now open) 2015-10-05T03:30:20.556+0100 [conn1419778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.558+0100 [mongosMain] connection accepted from 172.28.0.164:53513 #1419779 (239 connections now open) 2015-10-05T03:30:20.559+0100 [conn1419779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.561+0100 [mongosMain] connection accepted from 172.28.0.164:53514 #1419780 (240 connections now open) 2015-10-05T03:30:20.563+0100 [conn1419780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.565+0100 [mongosMain] connection accepted from 172.28.0.164:53515 #1419781 (241 connections now open) 2015-10-05T03:30:20.568+0100 [conn1419781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.569+0100 [mongosMain] connection accepted from 172.28.0.164:53516 #1419782 (242 connections now open) 2015-10-05T03:30:20.572+0100 [conn1419782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.573+0100 [mongosMain] connection accepted from 172.28.0.164:53517 #1419783 (243 connections now open) 2015-10-05T03:30:20.575+0100 [conn1419783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.577+0100 [mongosMain] connection accepted from 172.28.0.164:53518 #1419784 (244 connections now open) 2015-10-05T03:30:20.579+0100 [conn1419784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.580+0100 [mongosMain] connection accepted from 172.28.0.164:53519 #1419785 (245 connections now open) 2015-10-05T03:30:20.582+0100 [conn1419785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.584+0100 [mongosMain] connection accepted from 172.28.0.164:53520 #1419786 (246 connections now open) 2015-10-05T03:30:20.586+0100 [conn1419786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.587+0100 [mongosMain] connection accepted from 172.28.0.164:53521 #1419787 (247 connections now open) 2015-10-05T03:30:20.588+0100 [conn1419787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.590+0100 [mongosMain] connection accepted from 172.28.0.164:53522 #1419788 (248 connections now open) 2015-10-05T03:30:20.591+0100 [conn1419788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.592+0100 [mongosMain] connection accepted from 172.28.0.164:53523 #1419789 (249 connections now open) 2015-10-05T03:30:20.594+0100 [conn1419789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.595+0100 [mongosMain] connection accepted from 172.28.0.164:53524 #1419790 (250 connections now open) 2015-10-05T03:30:20.597+0100 [conn1419790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.599+0100 [mongosMain] connection accepted from 172.28.0.164:53525 #1419791 (251 connections now open) 2015-10-05T03:30:20.600+0100 [conn1419791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.601+0100 [mongosMain] connection accepted from 172.28.0.164:53526 #1419792 (252 connections now open) 2015-10-05T03:30:20.604+0100 [conn1419792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.611+0100 [mongosMain] connection accepted from 172.28.0.164:53528 #1419793 (253 connections now open) 2015-10-05T03:30:20.618+0100 [conn1419793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.619+0100 [mongosMain] connection accepted from 172.28.0.164:53529 #1419794 (254 connections now open) 2015-10-05T03:30:20.621+0100 [conn1419794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.622+0100 [mongosMain] connection accepted from 172.28.0.164:53530 #1419795 (255 connections now open) 2015-10-05T03:30:20.624+0100 [conn1419795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.936+0100 [mongosMain] connection accepted from 172.28.0.164:53535 #1419796 (256 connections now open) 2015-10-05T03:30:20.938+0100 [conn1419796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.940+0100 [mongosMain] connection accepted from 172.28.0.164:53538 #1419797 (257 connections now open) 2015-10-05T03:30:20.941+0100 [conn1419797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.944+0100 [mongosMain] connection accepted from 172.28.0.164:53541 #1419798 (258 connections now open) 2015-10-05T03:30:20.945+0100 [conn1419798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.946+0100 [mongosMain] connection accepted from 172.28.0.164:53545 #1419799 (259 connections now open) 2015-10-05T03:30:20.948+0100 [conn1419799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.949+0100 [mongosMain] connection accepted from 172.28.0.164:53548 #1419800 (260 connections now open) 2015-10-05T03:30:20.950+0100 [conn1419800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.951+0100 [mongosMain] connection accepted from 172.28.0.164:53552 #1419801 (261 connections now open) 2015-10-05T03:30:20.953+0100 [conn1419801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.954+0100 [mongosMain] connection accepted from 172.28.0.164:53555 #1419802 (262 connections now open) 2015-10-05T03:30:20.955+0100 [conn1419802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.957+0100 [mongosMain] connection accepted from 172.28.0.164:53558 #1419803 (263 connections now open) 2015-10-05T03:30:20.958+0100 [conn1419803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.959+0100 [mongosMain] connection accepted from 172.28.0.164:53561 #1419804 (264 connections now open) 2015-10-05T03:30:20.961+0100 [conn1419804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.962+0100 [mongosMain] connection accepted from 172.28.0.164:53565 #1419805 (265 connections now open) 2015-10-05T03:30:20.964+0100 [conn1419805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.965+0100 [mongosMain] connection accepted from 172.28.0.164:53568 #1419806 (266 connections now open) 2015-10-05T03:30:20.966+0100 [conn1419806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.968+0100 [mongosMain] connection accepted from 172.28.0.164:53571 #1419807 (267 connections now open) 2015-10-05T03:30:20.970+0100 [conn1419807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.971+0100 [mongosMain] connection accepted from 172.28.0.164:53575 #1419808 (268 connections now open) 2015-10-05T03:30:20.973+0100 [conn1419808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.975+0100 [mongosMain] connection accepted from 172.28.0.164:53579 #1419809 (269 connections now open) 2015-10-05T03:30:20.977+0100 [conn1419809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.978+0100 [mongosMain] connection accepted from 172.28.0.164:53583 #1419810 (270 connections now open) 2015-10-05T03:30:20.979+0100 [conn1419810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.981+0100 [mongosMain] connection accepted from 172.28.0.164:53586 #1419811 (271 connections now open) 2015-10-05T03:30:20.984+0100 [conn1419811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.986+0100 [mongosMain] connection accepted from 172.28.0.164:53592 #1419812 (272 connections now open) 2015-10-05T03:30:20.988+0100 [conn1419812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.989+0100 [mongosMain] connection accepted from 172.28.0.164:53596 #1419813 (273 connections now open) 2015-10-05T03:30:20.991+0100 [conn1419813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.992+0100 [mongosMain] connection accepted from 172.28.0.164:53600 #1419814 (274 connections now open) 2015-10-05T03:30:20.994+0100 [conn1419814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:20.996+0100 [mongosMain] connection accepted from 172.28.0.164:53602 #1419815 (275 connections now open) 2015-10-05T03:30:20.998+0100 [conn1419815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.000+0100 [mongosMain] connection accepted from 172.28.0.164:53603 #1419816 (276 connections now open) 2015-10-05T03:30:21.002+0100 [conn1419816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.003+0100 [mongosMain] connection accepted from 172.28.0.164:53604 #1419817 (277 connections now open) 2015-10-05T03:30:21.005+0100 [conn1419817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.006+0100 [mongosMain] connection accepted from 172.28.0.164:53605 #1419818 (278 connections now open) 2015-10-05T03:30:21.009+0100 [conn1419818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.010+0100 [mongosMain] connection accepted from 172.28.0.164:53606 #1419819 (279 connections now open) 2015-10-05T03:30:21.012+0100 [conn1419819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.013+0100 [mongosMain] connection accepted from 172.28.0.164:53607 #1419820 (280 connections now open) 2015-10-05T03:30:21.014+0100 [conn1419820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.016+0100 [mongosMain] connection accepted from 172.28.0.164:53608 #1419821 (281 connections now open) 2015-10-05T03:30:21.018+0100 [conn1419821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.019+0100 [mongosMain] connection accepted from 172.28.0.164:53609 #1419822 (282 connections now open) 2015-10-05T03:30:21.021+0100 [conn1419822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.023+0100 [mongosMain] connection accepted from 172.28.0.164:53610 #1419823 (283 connections now open) 2015-10-05T03:30:21.024+0100 [conn1419823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.026+0100 [mongosMain] connection accepted from 172.28.0.164:53611 #1419824 (284 connections now open) 2015-10-05T03:30:21.027+0100 [conn1419824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.029+0100 [mongosMain] connection accepted from 172.28.0.164:53612 #1419825 (285 connections now open) 2015-10-05T03:30:21.032+0100 [conn1419825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.034+0100 [mongosMain] connection accepted from 172.28.0.164:53613 #1419826 (286 connections now open) 2015-10-05T03:30:21.035+0100 [conn1419826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.037+0100 [mongosMain] connection accepted from 172.28.0.164:53614 #1419827 (287 connections now open) 2015-10-05T03:30:21.039+0100 [conn1419827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.041+0100 [mongosMain] connection accepted from 172.28.0.164:53615 #1419828 (288 connections now open) 2015-10-05T03:30:21.043+0100 [conn1419828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.045+0100 [mongosMain] connection accepted from 172.28.0.164:53616 #1419829 (289 connections now open) 2015-10-05T03:30:21.047+0100 [conn1419829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.049+0100 [mongosMain] connection accepted from 172.28.0.164:53617 #1419830 (290 connections now open) 2015-10-05T03:30:21.051+0100 [conn1419830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.053+0100 [mongosMain] connection accepted from 172.28.0.164:53618 #1419831 (291 connections now open) 2015-10-05T03:30:21.055+0100 [conn1419831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.056+0100 [mongosMain] connection accepted from 172.28.0.164:53619 #1419832 (292 connections now open) 2015-10-05T03:30:21.058+0100 [conn1419832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.061+0100 [mongosMain] connection accepted from 172.28.0.164:53620 #1419833 (293 connections now open) 2015-10-05T03:30:21.063+0100 [conn1419833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.064+0100 [mongosMain] connection accepted from 172.28.0.164:53621 #1419834 (294 connections now open) 2015-10-05T03:30:21.066+0100 [conn1419834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.068+0100 [mongosMain] connection accepted from 172.28.0.164:53622 #1419835 (295 connections now open) 2015-10-05T03:30:21.069+0100 [conn1419835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.071+0100 [mongosMain] connection accepted from 172.28.0.164:53623 #1419836 (296 connections now open) 2015-10-05T03:30:21.073+0100 [conn1419836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.075+0100 [mongosMain] connection accepted from 172.28.0.164:53624 #1419837 (297 connections now open) 2015-10-05T03:30:21.076+0100 [conn1419837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.078+0100 [mongosMain] connection accepted from 172.28.0.164:53625 #1419838 (298 connections now open) 2015-10-05T03:30:21.080+0100 [conn1419838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.082+0100 [mongosMain] connection accepted from 172.28.0.164:53626 #1419839 (299 connections now open) 2015-10-05T03:30:21.084+0100 [conn1419839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.085+0100 [mongosMain] connection accepted from 172.28.0.164:53628 #1419840 (300 connections now open) 2015-10-05T03:30:21.087+0100 [conn1419840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.089+0100 [mongosMain] connection accepted from 172.28.0.164:53629 #1419841 (301 connections now open) 2015-10-05T03:30:21.092+0100 [conn1419841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.095+0100 [mongosMain] connection accepted from 172.28.0.164:53630 #1419842 (302 connections now open) 2015-10-05T03:30:21.097+0100 [conn1419842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.099+0100 [mongosMain] connection accepted from 172.28.0.164:53631 #1419843 (303 connections now open) 2015-10-05T03:30:21.101+0100 [conn1419843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.103+0100 [mongosMain] connection accepted from 172.28.0.164:53632 #1419844 (304 connections now open) 2015-10-05T03:30:21.104+0100 [conn1419844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.873+0100 [mongosMain] connection accepted from 172.28.0.163:60311 #1419845 (305 connections now open) 2015-10-05T03:30:21.874+0100 [conn1419845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.876+0100 [mongosMain] connection accepted from 172.28.0.163:60313 #1419846 (306 connections now open) 2015-10-05T03:30:21.877+0100 [conn1419846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.878+0100 [mongosMain] connection accepted from 172.28.0.163:60314 #1419847 (307 connections now open) 2015-10-05T03:30:21.879+0100 [conn1419847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.879+0100 [mongosMain] connection accepted from 172.28.0.163:60316 #1419848 (308 connections now open) 2015-10-05T03:30:21.880+0100 [conn1419848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.882+0100 [mongosMain] connection accepted from 172.28.0.163:60317 #1419849 (309 connections now open) 2015-10-05T03:30:21.882+0100 [conn1419849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.884+0100 [mongosMain] connection accepted from 172.28.0.163:60319 #1419850 (310 connections now open) 2015-10-05T03:30:21.884+0100 [conn1419850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.885+0100 [mongosMain] connection accepted from 172.28.0.163:60320 #1419851 (311 connections now open) 2015-10-05T03:30:21.886+0100 [conn1419851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.887+0100 [mongosMain] connection accepted from 172.28.0.163:60322 #1419852 (312 connections now open) 2015-10-05T03:30:21.888+0100 [conn1419852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.888+0100 [mongosMain] connection accepted from 172.28.0.163:60323 #1419853 (313 connections now open) 2015-10-05T03:30:21.889+0100 [conn1419853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.890+0100 [mongosMain] connection accepted from 172.28.0.163:60325 #1419854 (314 connections now open) 2015-10-05T03:30:21.891+0100 [conn1419854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.891+0100 [mongosMain] connection accepted from 172.28.0.163:60326 #1419855 (315 connections now open) 2015-10-05T03:30:21.892+0100 [conn1419855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.893+0100 [mongosMain] connection accepted from 172.28.0.163:60327 #1419856 (316 connections now open) 2015-10-05T03:30:21.893+0100 [conn1419856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.894+0100 [mongosMain] connection accepted from 172.28.0.163:60329 #1419857 (317 connections now open) 2015-10-05T03:30:21.895+0100 [conn1419857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.896+0100 [mongosMain] connection accepted from 172.28.0.163:60330 #1419858 (318 connections now open) 2015-10-05T03:30:21.897+0100 [conn1419858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.898+0100 [mongosMain] connection accepted from 172.28.0.163:60332 #1419859 (319 connections now open) 2015-10-05T03:30:21.899+0100 [conn1419859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.899+0100 [mongosMain] connection accepted from 172.28.0.163:60333 #1419860 (320 connections now open) 2015-10-05T03:30:21.900+0100 [conn1419860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.901+0100 [mongosMain] connection accepted from 172.28.0.163:60335 #1419861 (321 connections now open) 2015-10-05T03:30:21.902+0100 [conn1419861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.903+0100 [mongosMain] connection accepted from 172.28.0.163:60336 #1419862 (322 connections now open) 2015-10-05T03:30:21.904+0100 [conn1419862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.905+0100 [mongosMain] connection accepted from 172.28.0.163:60339 #1419863 (323 connections now open) 2015-10-05T03:30:21.905+0100 [conn1419863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.906+0100 [mongosMain] connection accepted from 172.28.0.163:60340 #1419864 (324 connections now open) 2015-10-05T03:30:21.907+0100 [conn1419864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.908+0100 [mongosMain] connection accepted from 172.28.0.163:60342 #1419865 (325 connections now open) 2015-10-05T03:30:21.909+0100 [conn1419865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.910+0100 [mongosMain] connection accepted from 172.28.0.163:60343 #1419866 (326 connections now open) 2015-10-05T03:30:21.910+0100 [conn1419866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.911+0100 [mongosMain] connection accepted from 172.28.0.163:60345 #1419867 (327 connections now open) 2015-10-05T03:30:21.912+0100 [conn1419867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.913+0100 [mongosMain] connection accepted from 172.28.0.163:60347 #1419868 (328 connections now open) 2015-10-05T03:30:21.914+0100 [conn1419868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.915+0100 [mongosMain] connection accepted from 172.28.0.163:60348 #1419869 (329 connections now open) 2015-10-05T03:30:21.916+0100 [conn1419869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.917+0100 [mongosMain] connection accepted from 172.28.0.163:60350 #1419870 (330 connections now open) 2015-10-05T03:30:21.918+0100 [conn1419870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.919+0100 [mongosMain] connection accepted from 172.28.0.163:60351 #1419871 (331 connections now open) 2015-10-05T03:30:21.920+0100 [conn1419871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.921+0100 [mongosMain] connection accepted from 172.28.0.163:60353 #1419872 (332 connections now open) 2015-10-05T03:30:21.922+0100 [conn1419872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.922+0100 [mongosMain] connection accepted from 172.28.0.163:60354 #1419873 (333 connections now open) 2015-10-05T03:30:21.923+0100 [conn1419873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.924+0100 [mongosMain] connection accepted from 172.28.0.163:60355 #1419874 (334 connections now open) 2015-10-05T03:30:21.925+0100 [conn1419874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.926+0100 [mongosMain] connection accepted from 172.28.0.163:60357 #1419875 (335 connections now open) 2015-10-05T03:30:21.927+0100 [conn1419875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.928+0100 [mongosMain] connection accepted from 172.28.0.163:60358 #1419876 (336 connections now open) 2015-10-05T03:30:21.929+0100 [conn1419876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.930+0100 [mongosMain] connection accepted from 172.28.0.163:60359 #1419877 (337 connections now open) 2015-10-05T03:30:21.931+0100 [conn1419877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.932+0100 [mongosMain] connection accepted from 172.28.0.163:60361 #1419878 (338 connections now open) 2015-10-05T03:30:21.933+0100 [conn1419878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.934+0100 [mongosMain] connection accepted from 172.28.0.163:60362 #1419879 (339 connections now open) 2015-10-05T03:30:21.935+0100 [conn1419879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.936+0100 [mongosMain] connection accepted from 172.28.0.163:60364 #1419880 (340 connections now open) 2015-10-05T03:30:21.937+0100 [conn1419880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.938+0100 [mongosMain] connection accepted from 172.28.0.163:60365 #1419881 (341 connections now open) 2015-10-05T03:30:21.938+0100 [conn1419881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.939+0100 [mongosMain] connection accepted from 172.28.0.163:60367 #1419882 (342 connections now open) 2015-10-05T03:30:21.940+0100 [conn1419882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.941+0100 [mongosMain] connection accepted from 172.28.0.163:60368 #1419883 (343 connections now open) 2015-10-05T03:30:21.942+0100 [conn1419883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.943+0100 [mongosMain] connection accepted from 172.28.0.163:60370 #1419884 (344 connections now open) 2015-10-05T03:30:21.944+0100 [conn1419884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.945+0100 [mongosMain] connection accepted from 172.28.0.163:60371 #1419885 (345 connections now open) 2015-10-05T03:30:21.946+0100 [conn1419885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.947+0100 [mongosMain] connection accepted from 172.28.0.163:60372 #1419886 (346 connections now open) 2015-10-05T03:30:21.948+0100 [conn1419886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.948+0100 [mongosMain] connection accepted from 172.28.0.163:60374 #1419887 (347 connections now open) 2015-10-05T03:30:21.949+0100 [conn1419887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.950+0100 [mongosMain] connection accepted from 172.28.0.163:60375 #1419888 (348 connections now open) 2015-10-05T03:30:21.951+0100 [conn1419888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.952+0100 [mongosMain] connection accepted from 172.28.0.163:60377 #1419889 (349 connections now open) 2015-10-05T03:30:21.953+0100 [conn1419889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.954+0100 [mongosMain] connection accepted from 172.28.0.163:60378 #1419890 (350 connections now open) 2015-10-05T03:30:21.955+0100 [conn1419890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:21.956+0100 [mongosMain] connection accepted from 172.28.0.163:60380 #1419891 (351 connections now open) 2015-10-05T03:30:21.956+0100 [conn1419891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.528+0100 [mongosMain] connection accepted from 172.28.0.163:60406 #1419892 (352 connections now open) 2015-10-05T03:30:22.530+0100 [conn1419892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.531+0100 [mongosMain] connection accepted from 172.28.0.163:60408 #1419893 (353 connections now open) 2015-10-05T03:30:22.532+0100 [conn1419893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.533+0100 [mongosMain] connection accepted from 172.28.0.163:60409 #1419894 (354 connections now open) 2015-10-05T03:30:22.534+0100 [conn1419894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.535+0100 [mongosMain] connection accepted from 172.28.0.163:60411 #1419895 (355 connections now open) 2015-10-05T03:30:22.536+0100 [conn1419895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.538+0100 [mongosMain] connection accepted from 172.28.0.163:60412 #1419896 (356 connections now open) 2015-10-05T03:30:22.538+0100 [conn1419896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.540+0100 [mongosMain] connection accepted from 172.28.0.163:60414 #1419897 (357 connections now open) 2015-10-05T03:30:22.540+0100 [conn1419897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.541+0100 [mongosMain] connection accepted from 172.28.0.163:60415 #1419898 (358 connections now open) 2015-10-05T03:30:22.542+0100 [conn1419898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.543+0100 [mongosMain] connection accepted from 172.28.0.163:60417 #1419899 (359 connections now open) 2015-10-05T03:30:22.544+0100 [conn1419899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.545+0100 [mongosMain] connection accepted from 172.28.0.163:60418 #1419900 (360 connections now open) 2015-10-05T03:30:22.546+0100 [conn1419900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.547+0100 [mongosMain] connection accepted from 172.28.0.163:60419 #1419901 (361 connections now open) 2015-10-05T03:30:22.548+0100 [conn1419901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.549+0100 [mongosMain] connection accepted from 172.28.0.163:60421 #1419902 (362 connections now open) 2015-10-05T03:30:22.550+0100 [conn1419902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.551+0100 [mongosMain] connection accepted from 172.28.0.163:60422 #1419903 (363 connections now open) 2015-10-05T03:30:22.552+0100 [conn1419903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.553+0100 [mongosMain] connection accepted from 172.28.0.163:60424 #1419904 (364 connections now open) 2015-10-05T03:30:22.554+0100 [conn1419904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.555+0100 [mongosMain] connection accepted from 172.28.0.163:60425 #1419905 (365 connections now open) 2015-10-05T03:30:22.556+0100 [conn1419905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.557+0100 [mongosMain] connection accepted from 172.28.0.163:60427 #1419906 (366 connections now open) 2015-10-05T03:30:22.558+0100 [conn1419906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.559+0100 [mongosMain] connection accepted from 172.28.0.163:60428 #1419907 (367 connections now open) 2015-10-05T03:30:22.560+0100 [conn1419907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.561+0100 [mongosMain] connection accepted from 172.28.0.163:60430 #1419908 (368 connections now open) 2015-10-05T03:30:22.562+0100 [conn1419908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.563+0100 [mongosMain] connection accepted from 172.28.0.163:60431 #1419909 (369 connections now open) 2015-10-05T03:30:22.565+0100 [conn1419909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.566+0100 [mongosMain] connection accepted from 172.28.0.163:60433 #1419910 (370 connections now open) 2015-10-05T03:30:22.566+0100 [conn1419910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.568+0100 [mongosMain] connection accepted from 172.28.0.163:60435 #1419911 (371 connections now open) 2015-10-05T03:30:22.568+0100 [conn1419911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.569+0100 [mongosMain] connection accepted from 172.28.0.163:60436 #1419912 (372 connections now open) 2015-10-05T03:30:22.570+0100 [conn1419912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.571+0100 [mongosMain] connection accepted from 172.28.0.163:60438 #1419913 (373 connections now open) 2015-10-05T03:30:22.572+0100 [conn1419913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.573+0100 [mongosMain] connection accepted from 172.28.0.163:60439 #1419914 (374 connections now open) 2015-10-05T03:30:22.573+0100 [conn1419914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.575+0100 [mongosMain] connection accepted from 172.28.0.163:60442 #1419915 (375 connections now open) 2015-10-05T03:30:22.575+0100 [conn1419915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.577+0100 [mongosMain] connection accepted from 172.28.0.163:60443 #1419916 (376 connections now open) 2015-10-05T03:30:22.577+0100 [conn1419916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.579+0100 [mongosMain] connection accepted from 172.28.0.163:60445 #1419917 (377 connections now open) 2015-10-05T03:30:22.579+0100 [conn1419917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.580+0100 [mongosMain] connection accepted from 172.28.0.163:60447 #1419918 (378 connections now open) 2015-10-05T03:30:22.581+0100 [conn1419918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.582+0100 [mongosMain] connection accepted from 172.28.0.163:60448 #1419919 (379 connections now open) 2015-10-05T03:30:22.583+0100 [conn1419919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.584+0100 [mongosMain] connection accepted from 172.28.0.163:60450 #1419920 (380 connections now open) 2015-10-05T03:30:22.585+0100 [conn1419920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.586+0100 [mongosMain] connection accepted from 172.28.0.163:60451 #1419921 (381 connections now open) 2015-10-05T03:30:22.587+0100 [conn1419921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.588+0100 [mongosMain] connection accepted from 172.28.0.163:60453 #1419922 (382 connections now open) 2015-10-05T03:30:22.589+0100 [conn1419922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.590+0100 [mongosMain] connection accepted from 172.28.0.163:60454 #1419923 (383 connections now open) 2015-10-05T03:30:22.591+0100 [conn1419923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.592+0100 [mongosMain] connection accepted from 172.28.0.163:60456 #1419924 (384 connections now open) 2015-10-05T03:30:22.593+0100 [conn1419924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.594+0100 [mongosMain] connection accepted from 172.28.0.163:60457 #1419925 (385 connections now open) 2015-10-05T03:30:22.595+0100 [conn1419925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.596+0100 [mongosMain] connection accepted from 172.28.0.163:60459 #1419926 (386 connections now open) 2015-10-05T03:30:22.596+0100 [conn1419926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.597+0100 [mongosMain] connection accepted from 172.28.0.163:60460 #1419927 (387 connections now open) 2015-10-05T03:30:22.598+0100 [conn1419927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.599+0100 [mongosMain] connection accepted from 172.28.0.163:60462 #1419928 (388 connections now open) 2015-10-05T03:30:22.600+0100 [conn1419928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.601+0100 [mongosMain] connection accepted from 172.28.0.163:60464 #1419929 (389 connections now open) 2015-10-05T03:30:22.602+0100 [conn1419929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.602+0100 [mongosMain] connection accepted from 172.28.0.163:60465 #1419930 (390 connections now open) 2015-10-05T03:30:22.603+0100 [conn1419930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.604+0100 [mongosMain] connection accepted from 172.28.0.163:60467 #1419931 (391 connections now open) 2015-10-05T03:30:22.605+0100 [conn1419931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.606+0100 [mongosMain] connection accepted from 172.28.0.163:60468 #1419932 (392 connections now open) 2015-10-05T03:30:22.607+0100 [conn1419932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.608+0100 [mongosMain] connection accepted from 172.28.0.163:60470 #1419933 (393 connections now open) 2015-10-05T03:30:22.609+0100 [conn1419933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.610+0100 [mongosMain] connection accepted from 172.28.0.163:60471 #1419934 (394 connections now open) 2015-10-05T03:30:22.611+0100 [conn1419934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.612+0100 [mongosMain] connection accepted from 172.28.0.163:60473 #1419935 (395 connections now open) 2015-10-05T03:30:22.612+0100 [conn1419935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.613+0100 [mongosMain] connection accepted from 172.28.0.163:60475 #1419936 (396 connections now open) 2015-10-05T03:30:22.614+0100 [conn1419936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.615+0100 [mongosMain] connection accepted from 172.28.0.163:60476 #1419937 (397 connections now open) 2015-10-05T03:30:22.616+0100 [conn1419937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.617+0100 [mongosMain] connection accepted from 172.28.0.163:60478 #1419938 (398 connections now open) 2015-10-05T03:30:22.617+0100 [conn1419938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.619+0100 [mongosMain] connection accepted from 172.28.0.163:60480 #1419939 (399 connections now open) 2015-10-05T03:30:22.619+0100 [conn1419939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:22.620+0100 [mongosMain] connection accepted from 172.28.0.163:60481 #1419940 (400 connections now open) 2015-10-05T03:30:22.621+0100 [conn1419940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:26.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0c25703b51053eab13c 2015-10-05T03:30:26.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:28.398+0100 [mongosMain] connection accepted from 127.0.0.1:60531 #1419941 (401 connections now open) 2015-10-05T03:30:28.401+0100 [conn1419941] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:28.406+0100 [conn1419941] end connection 127.0.0.1:60531 (400 connections now open) 2015-10-05T03:30:32.448+0100 [conn1419231] end connection 172.28.0.164:49646 (399 connections now open) 2015-10-05T03:30:32.450+0100 [mongosMain] connection accepted from 172.28.0.164:53696 #1419942 (400 connections now open) 2015-10-05T03:30:32.452+0100 [conn1419942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:32.916+0100 [conn1419293] end connection 172.28.0.164:49981 (399 connections now open) 2015-10-05T03:30:32.918+0100 [mongosMain] connection accepted from 172.28.0.164:53698 #1419943 (400 connections now open) 2015-10-05T03:30:32.922+0100 [conn1419943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:33.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0c85703b51053eab165 2015-10-05T03:30:33.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:33.449+0100 [conn1419297] end connection 172.28.0.163:56968 (399 connections now open) 2015-10-05T03:30:33.449+0100 [conn1419254] end connection 172.28.0.163:56627 (398 connections now open) 2015-10-05T03:30:33.450+0100 [mongosMain] connection accepted from 172.28.0.163:60553 #1419944 (399 connections now open) 2015-10-05T03:30:33.450+0100 [mongosMain] connection accepted from 172.28.0.163:60554 #1419945 (400 connections now open) 2015-10-05T03:30:33.451+0100 [conn1419944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:33.451+0100 [conn1419945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:39.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0cf5703b51053eab187 2015-10-05T03:30:39.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:40.021+0100 [mongosMain] connection accepted from 127.0.0.1:60558 #1419946 (401 connections now open) 2015-10-05T03:30:40.023+0100 [conn1419946] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:40.027+0100 [conn1419946] end connection 127.0.0.1:60558 (400 connections now open) 2015-10-05T03:30:41.331+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:30:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:30:42.465+0100 [conn1419066] end connection 172.28.0.164:64995 (399 connections now open) 2015-10-05T03:30:42.466+0100 [mongosMain] connection accepted from 172.28.0.164:53712 #1419947 (400 connections now open) 2015-10-05T03:30:42.467+0100 [conn1419947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:42.933+0100 [conn1419325] end connection 172.28.0.164:50494 (399 connections now open) 2015-10-05T03:30:42.934+0100 [mongosMain] connection accepted from 172.28.0.164:53714 #1419948 (400 connections now open) 2015-10-05T03:30:42.936+0100 [conn1419948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:43.449+0100 [conn1419360] end connection 172.28.0.163:57571 (399 connections now open) 2015-10-05T03:30:43.449+0100 [conn1419266] end connection 172.28.0.163:56750 (399 connections now open) 2015-10-05T03:30:43.450+0100 [mongosMain] connection accepted from 172.28.0.163:60564 #1419949 (399 connections now open) 2015-10-05T03:30:43.450+0100 [mongosMain] connection accepted from 172.28.0.163:60565 #1419950 (400 connections now open) 2015-10-05T03:30:43.451+0100 [conn1419949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:43.451+0100 [conn1419950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:45.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0d55703b51053eab1af 2015-10-05T03:30:45.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:51.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0db5703b51053eab1d9 2015-10-05T03:30:52.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:30:52.464+0100 [conn1419319] end connection 172.28.0.164:50337 (399 connections now open) 2015-10-05T03:30:52.465+0100 [mongosMain] connection accepted from 172.28.0.164:53723 #1419951 (400 connections now open) 2015-10-05T03:30:52.468+0100 [conn1419951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:52.932+0100 [conn1419273] end connection 172.28.0.164:49922 (399 connections now open) 2015-10-05T03:30:52.933+0100 [mongosMain] connection accepted from 172.28.0.164:53726 #1419952 (400 connections now open) 2015-10-05T03:30:52.935+0100 [conn1419952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:53.464+0100 [conn1419234] end connection 172.28.0.163:56553 (399 connections now open) 2015-10-05T03:30:53.466+0100 [mongosMain] connection accepted from 172.28.0.163:60576 #1419953 (400 connections now open) 2015-10-05T03:30:53.466+0100 [conn1419953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:30:58.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0e25703b51053eab1fb 2015-10-05T03:30:58.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:02.480+0100 [conn1419272] end connection 172.28.0.164:49917 (399 connections now open) 2015-10-05T03:31:02.481+0100 [mongosMain] connection accepted from 172.28.0.164:53739 #1419954 (400 connections now open) 2015-10-05T03:31:02.483+0100 [conn1419954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:03.465+0100 [conn1419368] end connection 172.28.0.163:57580 (399 connections now open) 2015-10-05T03:31:03.467+0100 [mongosMain] connection accepted from 172.28.0.163:60606 #1419955 (400 connections now open) 2015-10-05T03:31:03.468+0100 [conn1419955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:04.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0e85703b51053eab234 2015-10-05T03:31:04.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:11.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0ee5703b51053eab25d 2015-10-05T03:31:11.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:11.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:31:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:31:12.480+0100 [conn1419324] end connection 172.28.0.164:50483 (399 connections now open) 2015-10-05T03:31:12.481+0100 [mongosMain] connection accepted from 172.28.0.164:53796 #1419956 (400 connections now open) 2015-10-05T03:31:12.483+0100 [conn1419956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:12.949+0100 [conn1419374] end connection 172.28.0.164:50976 (399 connections now open) 2015-10-05T03:31:12.951+0100 [mongosMain] connection accepted from 172.28.0.164:53800 #1419957 (400 connections now open) 2015-10-05T03:31:12.952+0100 [conn1419957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:17.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0f55703b51053eab281 2015-10-05T03:31:17.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:22.496+0100 [conn1419332] end connection 172.28.0.164:50663 (399 connections now open) 2015-10-05T03:31:22.498+0100 [mongosMain] connection accepted from 172.28.0.164:53856 #1419958 (400 connections now open) 2015-10-05T03:31:22.500+0100 [conn1419958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:22.964+0100 [conn1419387] end connection 172.28.0.164:51061 (399 connections now open) 2015-10-05T03:31:22.965+0100 [mongosMain] connection accepted from 172.28.0.164:53860 #1419959 (400 connections now open) 2015-10-05T03:31:22.968+0100 [conn1419959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:23.497+0100 [conn1419320] end connection 172.28.0.163:57208 (399 connections now open) 2015-10-05T03:31:23.498+0100 [mongosMain] connection accepted from 172.28.0.163:60736 #1419960 (400 connections now open) 2015-10-05T03:31:23.499+0100 [conn1419960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:23.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e0fb5703b51053eab2a5 2015-10-05T03:31:23.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:29.059+0100 [mongosMain] connection accepted from 127.0.0.1:60766 #1419961 (401 connections now open) 2015-10-05T03:31:29.062+0100 [conn1419961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:29.067+0100 [conn1419961] end connection 127.0.0.1:60766 (400 connections now open) 2015-10-05T03:31:30.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1015703b51053eab2c2 2015-10-05T03:31:30.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:32.496+0100 [conn1419245] end connection 172.28.0.164:49703 (399 connections now open) 2015-10-05T03:31:32.497+0100 [mongosMain] connection accepted from 172.28.0.164:53922 #1419962 (400 connections now open) 2015-10-05T03:31:32.499+0100 [conn1419962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:32.964+0100 [conn1419381] end connection 172.28.0.164:51019 (399 connections now open) 2015-10-05T03:31:32.965+0100 [mongosMain] connection accepted from 172.28.0.164:53927 #1419963 (400 connections now open) 2015-10-05T03:31:32.967+0100 [conn1419963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:36.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1085703b51053eab2d6 2015-10-05T03:31:36.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:39.208+0100 [mongosMain] connection accepted from 127.0.0.1:60805 #1419964 (401 connections now open) 2015-10-05T03:31:39.210+0100 [conn1419964] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:39.215+0100 [conn1419964] end connection 127.0.0.1:60805 (400 connections now open) 2015-10-05T03:31:41.872+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:31:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:31:42.512+0100 [conn1419365] end connection 172.28.0.164:50957 (399 connections now open) 2015-10-05T03:31:42.513+0100 [mongosMain] connection accepted from 172.28.0.164:53944 #1419965 (400 connections now open) 2015-10-05T03:31:42.515+0100 [conn1419965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:42.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e10e5703b51053eab2ec 2015-10-05T03:31:42.980+0100 [conn1419394] end connection 172.28.0.164:51108 (399 connections now open) 2015-10-05T03:31:42.982+0100 [mongosMain] connection accepted from 172.28.0.164:53949 #1419966 (400 connections now open) 2015-10-05T03:31:42.983+0100 [conn1419966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:43.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:43.512+0100 [conn1419367] end connection 172.28.0.163:57581 (399 connections now open) 2015-10-05T03:31:43.512+0100 [conn1419326] end connection 172.28.0.163:57281 (398 connections now open) 2015-10-05T03:31:43.513+0100 [mongosMain] connection accepted from 172.28.0.163:60809 #1419967 (399 connections now open) 2015-10-05T03:31:43.513+0100 [mongosMain] connection accepted from 172.28.0.163:60810 #1419968 (400 connections now open) 2015-10-05T03:31:43.514+0100 [conn1419968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:43.514+0100 [conn1419967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:49.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1155703b51053eab313 2015-10-05T03:31:49.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:31:52.511+0100 [conn1419393] end connection 172.28.0.164:51106 (399 connections now open) 2015-10-05T03:31:52.512+0100 [mongosMain] connection accepted from 172.28.0.164:53958 #1419969 (400 connections now open) 2015-10-05T03:31:52.514+0100 [conn1419969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:52.980+0100 [conn1419401] end connection 172.28.0.164:51183 (399 connections now open) 2015-10-05T03:31:52.982+0100 [mongosMain] connection accepted from 172.28.0.164:53960 #1419970 (400 connections now open) 2015-10-05T03:31:52.983+0100 [conn1419970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:53.519+0100 [conn1419382] end connection 172.28.0.163:57630 (399 connections now open) 2015-10-05T03:31:53.519+0100 [conn1419388] end connection 172.28.0.163:57683 (398 connections now open) 2015-10-05T03:31:53.521+0100 [mongosMain] connection accepted from 172.28.0.163:60825 #1419971 (399 connections now open) 2015-10-05T03:31:53.522+0100 [conn1419971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:53.524+0100 [mongosMain] connection accepted from 172.28.0.163:60826 #1419972 (400 connections now open) 2015-10-05T03:31:53.525+0100 [conn1419972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:31:55.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e11b5703b51053eab327 2015-10-05T03:31:55.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:02.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1215703b51053eab33e 2015-10-05T03:32:02.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:02.526+0100 [conn1419386] end connection 172.28.0.164:51056 (399 connections now open) 2015-10-05T03:32:02.527+0100 [mongosMain] connection accepted from 172.28.0.164:53977 #1419973 (400 connections now open) 2015-10-05T03:32:02.529+0100 [conn1419973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:02.996+0100 [conn1419366] end connection 172.28.0.164:50960 (399 connections now open) 2015-10-05T03:32:02.997+0100 [mongosMain] connection accepted from 172.28.0.164:53982 #1419974 (400 connections now open) 2015-10-05T03:32:02.999+0100 [conn1419974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:03.527+0100 [conn1419402] end connection 172.28.0.163:57782 (399 connections now open) 2015-10-05T03:32:03.527+0100 [conn1419395] end connection 172.28.0.163:57737 (398 connections now open) 2015-10-05T03:32:03.528+0100 [mongosMain] connection accepted from 172.28.0.163:60855 #1419975 (399 connections now open) 2015-10-05T03:32:03.528+0100 [mongosMain] connection accepted from 172.28.0.163:60856 #1419976 (400 connections now open) 2015-10-05T03:32:03.529+0100 [conn1419975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:03.529+0100 [conn1419976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:08.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1285703b51053eab360 2015-10-05T03:32:08.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:12.032+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:32:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:32:12.543+0100 [conn1419373] end connection 172.28.0.164:50974 (399 connections now open) 2015-10-05T03:32:12.545+0100 [mongosMain] connection accepted from 172.28.0.164:54038 #1419977 (400 connections now open) 2015-10-05T03:32:12.547+0100 [conn1419977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:13.011+0100 [conn1419414] end connection 172.28.0.164:51252 (399 connections now open) 2015-10-05T03:32:13.013+0100 [mongosMain] connection accepted from 172.28.0.164:54042 #1419978 (400 connections now open) 2015-10-05T03:32:13.015+0100 [conn1419978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:13.528+0100 [conn1419354] end connection 172.28.0.163:57517 (399 connections now open) 2015-10-05T03:32:13.528+0100 [conn1419403] end connection 172.28.0.163:57783 (399 connections now open) 2015-10-05T03:32:13.529+0100 [mongosMain] connection accepted from 172.28.0.163:60920 #1419979 (399 connections now open) 2015-10-05T03:32:13.530+0100 [mongosMain] connection accepted from 172.28.0.163:60921 #1419980 (400 connections now open) 2015-10-05T03:32:13.530+0100 [conn1419979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:13.531+0100 [conn1419980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:15.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e12e5703b51053eab377 2015-10-05T03:32:15.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:21.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1355703b51053eab394 2015-10-05T03:32:21.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:22.558+0100 [conn1419407] end connection 172.28.0.164:51226 (399 connections now open) 2015-10-05T03:32:22.560+0100 [mongosMain] connection accepted from 172.28.0.164:54099 #1419981 (400 connections now open) 2015-10-05T03:32:22.562+0100 [conn1419981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:23.012+0100 [conn1419408] end connection 172.28.0.164:51229 (399 connections now open) 2015-10-05T03:32:23.013+0100 [mongosMain] connection accepted from 172.28.0.164:54101 #1419982 (400 connections now open) 2015-10-05T03:32:23.015+0100 [conn1419982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:23.543+0100 [conn1419423] end connection 172.28.0.163:57895 (399 connections now open) 2015-10-05T03:32:23.543+0100 [conn1419389] end connection 172.28.0.163:57684 (399 connections now open) 2015-10-05T03:32:23.544+0100 [mongosMain] connection accepted from 172.28.0.163:60990 #1419983 (399 connections now open) 2015-10-05T03:32:23.545+0100 [mongosMain] connection accepted from 172.28.0.163:60991 #1419984 (400 connections now open) 2015-10-05T03:32:23.546+0100 [conn1419983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:23.546+0100 [conn1419984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:27.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e13b5703b51053eab3ba 2015-10-05T03:32:27.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:28.218+0100 [mongosMain] connection accepted from 127.0.0.1:61019 #1419985 (401 connections now open) 2015-10-05T03:32:28.220+0100 [conn1419985] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:28.226+0100 [conn1419985] end connection 127.0.0.1:61019 (400 connections now open) 2015-10-05T03:32:32.574+0100 [conn1419359] end connection 172.28.0.164:50939 (399 connections now open) 2015-10-05T03:32:32.575+0100 [mongosMain] connection accepted from 172.28.0.164:54164 #1419986 (400 connections now open) 2015-10-05T03:32:32.577+0100 [conn1419986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:33.028+0100 [conn1419421] end connection 172.28.0.164:51273 (399 connections now open) 2015-10-05T03:32:33.029+0100 [mongosMain] connection accepted from 172.28.0.164:54169 #1419987 (400 connections now open) 2015-10-05T03:32:33.031+0100 [conn1419987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:33.560+0100 [conn1419409] end connection 172.28.0.163:57841 (399 connections now open) 2015-10-05T03:32:33.560+0100 [conn1419361] end connection 172.28.0.163:57572 (399 connections now open) 2015-10-05T03:32:33.561+0100 [mongosMain] connection accepted from 172.28.0.163:61048 #1419988 (399 connections now open) 2015-10-05T03:32:33.561+0100 [mongosMain] connection accepted from 172.28.0.163:61049 #1419989 (400 connections now open) 2015-10-05T03:32:33.562+0100 [conn1419988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:33.562+0100 [conn1419989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:33.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1415703b51053eab3d0 2015-10-05T03:32:34.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:39.389+0100 [mongosMain] connection accepted from 127.0.0.1:61056 #1419990 (401 connections now open) 2015-10-05T03:32:39.392+0100 [conn1419990] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:39.397+0100 [conn1419990] end connection 127.0.0.1:61056 (400 connections now open) 2015-10-05T03:32:40.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1485703b51053eab3f0 2015-10-05T03:32:40.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:42.326+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:32:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:32:42.590+0100 [conn1419400] end connection 172.28.0.164:51176 (399 connections now open) 2015-10-05T03:32:42.591+0100 [mongosMain] connection accepted from 172.28.0.164:54188 #1419991 (400 connections now open) 2015-10-05T03:32:42.593+0100 [conn1419991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:43.043+0100 [conn1419436] end connection 172.28.0.164:51384 (399 connections now open) 2015-10-05T03:32:43.044+0100 [mongosMain] connection accepted from 172.28.0.164:54191 #1419992 (400 connections now open) 2015-10-05T03:32:43.046+0100 [conn1419992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:43.559+0100 [conn1419422] end connection 172.28.0.163:57894 (399 connections now open) 2015-10-05T03:32:43.559+0100 [conn1419430] end connection 172.28.0.163:57959 (399 connections now open) 2015-10-05T03:32:43.560+0100 [mongosMain] connection accepted from 172.28.0.163:61061 #1419993 (399 connections now open) 2015-10-05T03:32:43.560+0100 [mongosMain] connection accepted from 172.28.0.163:61062 #1419994 (400 connections now open) 2015-10-05T03:32:43.561+0100 [conn1419993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:43.561+0100 [conn1419994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:46.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e14e5703b51053eab40f 2015-10-05T03:32:46.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:53.043+0100 [conn1419429] end connection 172.28.0.164:51328 (399 connections now open) 2015-10-05T03:32:53.044+0100 [mongosMain] connection accepted from 172.28.0.164:54204 #1419995 (400 connections now open) 2015-10-05T03:32:53.046+0100 [conn1419995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:53.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1545703b51053eab430 2015-10-05T03:32:53.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:32:53.575+0100 [conn1419410] end connection 172.28.0.163:57842 (399 connections now open) 2015-10-05T03:32:53.575+0100 [conn1419438] end connection 172.28.0.163:58029 (399 connections now open) 2015-10-05T03:32:53.576+0100 [mongosMain] connection accepted from 172.28.0.163:61073 #1419996 (399 connections now open) 2015-10-05T03:32:53.576+0100 [mongosMain] connection accepted from 172.28.0.163:61074 #1419997 (400 connections now open) 2015-10-05T03:32:53.577+0100 [conn1419996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:53.578+0100 [conn1419997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:32:59.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e15b5703b51053eab44e 2015-10-05T03:32:59.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:03.576+0100 [conn1419446] end connection 172.28.0.163:58080 (399 connections now open) 2015-10-05T03:33:03.576+0100 [conn1419219] end connection 172.28.0.163:56446 (399 connections now open) 2015-10-05T03:33:03.577+0100 [mongosMain] connection accepted from 172.28.0.163:61107 #1419998 (399 connections now open) 2015-10-05T03:33:03.577+0100 [mongosMain] connection accepted from 172.28.0.163:61108 #1419999 (400 connections now open) 2015-10-05T03:33:03.578+0100 [conn1419998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:03.578+0100 [conn1419999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:05.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1615703b51053eab47b 2015-10-05T03:33:06.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:12.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1685703b51053eab494 2015-10-05T03:33:12.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:12.594+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:33:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:33:12.621+0100 [conn1419428] end connection 172.28.0.164:51323 (399 connections now open) 2015-10-05T03:33:12.622+0100 [mongosMain] connection accepted from 172.28.0.164:54257 #1420000 (400 connections now open) 2015-10-05T03:33:12.624+0100 [conn1420000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:13.075+0100 [conn1419444] end connection 172.28.0.164:51439 (399 connections now open) 2015-10-05T03:33:13.076+0100 [mongosMain] connection accepted from 172.28.0.164:54258 #1420001 (400 connections now open) 2015-10-05T03:33:13.078+0100 [conn1420001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:13.590+0100 [conn1419437] end connection 172.28.0.163:58028 (399 connections now open) 2015-10-05T03:33:13.590+0100 [conn1419416] end connection 172.28.0.163:57864 (398 connections now open) 2015-10-05T03:33:13.592+0100 [mongosMain] connection accepted from 172.28.0.163:61149 #1420002 (399 connections now open) 2015-10-05T03:33:13.592+0100 [mongosMain] connection accepted from 172.28.0.163:61150 #1420003 (400 connections now open) 2015-10-05T03:33:13.593+0100 [conn1420002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:13.593+0100 [conn1420003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:18.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e16e5703b51053eab4aa 2015-10-05T03:33:18.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:22.637+0100 [conn1419443] end connection 172.28.0.164:51437 (399 connections now open) 2015-10-05T03:33:22.638+0100 [mongosMain] connection accepted from 172.28.0.164:54306 #1420004 (400 connections now open) 2015-10-05T03:33:22.644+0100 [conn1420004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:23.090+0100 [conn1419467] end connection 172.28.0.164:51530 (399 connections now open) 2015-10-05T03:33:23.092+0100 [mongosMain] connection accepted from 172.28.0.164:54309 #1420005 (400 connections now open) 2015-10-05T03:33:23.094+0100 [conn1420005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:23.591+0100 [conn1419415] end connection 172.28.0.163:57863 (399 connections now open) 2015-10-05T03:33:23.591+0100 [conn1419468] end connection 172.28.0.163:58163 (399 connections now open) 2015-10-05T03:33:23.592+0100 [mongosMain] connection accepted from 172.28.0.163:61196 #1420006 (399 connections now open) 2015-10-05T03:33:23.592+0100 [mongosMain] connection accepted from 172.28.0.163:61197 #1420007 (400 connections now open) 2015-10-05T03:33:23.593+0100 [conn1420006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:23.593+0100 [conn1420007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:25.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1745703b51053eab4be 2015-10-05T03:33:25.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:28.620+0100 [mongosMain] connection accepted from 127.0.0.1:61234 #1420008 (401 connections now open) 2015-10-05T03:33:28.623+0100 [conn1420008] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:28.629+0100 [conn1420008] end connection 127.0.0.1:61234 (400 connections now open) 2015-10-05T03:33:31.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e17b5703b51053eab4d9 2015-10-05T03:33:31.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:32.652+0100 [conn1419466] end connection 172.28.0.164:51525 (399 connections now open) 2015-10-05T03:33:32.654+0100 [mongosMain] connection accepted from 172.28.0.164:54365 #1420009 (400 connections now open) 2015-10-05T03:33:32.655+0100 [conn1420009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:33.106+0100 [conn1419453] end connection 172.28.0.164:51492 (399 connections now open) 2015-10-05T03:33:33.107+0100 [mongosMain] connection accepted from 172.28.0.164:54371 #1420010 (400 connections now open) 2015-10-05T03:33:33.109+0100 [conn1420010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:33.606+0100 [conn1419445] end connection 172.28.0.163:58079 (399 connections now open) 2015-10-05T03:33:33.607+0100 [conn1419476] end connection 172.28.0.163:58219 (398 connections now open) 2015-10-05T03:33:33.608+0100 [mongosMain] connection accepted from 172.28.0.163:61260 #1420011 (399 connections now open) 2015-10-05T03:33:33.609+0100 [mongosMain] connection accepted from 172.28.0.163:61261 #1420012 (400 connections now open) 2015-10-05T03:33:33.610+0100 [conn1420012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:33.610+0100 [conn1420011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:37.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1815703b51053eab4e9 2015-10-05T03:33:37.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:39.759+0100 [mongosMain] connection accepted from 127.0.0.1:61294 #1420013 (401 connections now open) 2015-10-05T03:33:39.762+0100 [conn1420013] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:39.766+0100 [conn1420013] end connection 127.0.0.1:61294 (400 connections now open) 2015-10-05T03:33:42.669+0100 [conn1419380] end connection 172.28.0.164:51016 (399 connections now open) 2015-10-05T03:33:42.670+0100 [mongosMain] connection accepted from 172.28.0.164:54430 #1420014 (400 connections now open) 2015-10-05T03:33:42.671+0100 [conn1420014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:42.878+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:33:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:33:43.122+0100 [conn1419460] end connection 172.28.0.164:51509 (399 connections now open) 2015-10-05T03:33:43.123+0100 [mongosMain] connection accepted from 172.28.0.164:54432 #1420015 (400 connections now open) 2015-10-05T03:33:43.125+0100 [conn1420015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:43.607+0100 [conn1419469] end connection 172.28.0.163:58161 (399 connections now open) 2015-10-05T03:33:43.608+0100 [conn1419481] end connection 172.28.0.163:58284 (398 connections now open) 2015-10-05T03:33:43.609+0100 [mongosMain] connection accepted from 172.28.0.163:61312 #1420016 (399 connections now open) 2015-10-05T03:33:43.610+0100 [mongosMain] connection accepted from 172.28.0.163:61315 #1420017 (400 connections now open) 2015-10-05T03:33:43.610+0100 [conn1420016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:43.611+0100 [conn1420017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:44.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1875703b51053eab4fa 2015-10-05T03:33:44.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:50.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e18e5703b51053eab50c 2015-10-05T03:33:50.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:33:52.684+0100 [conn1419413] end connection 172.28.0.164:51250 (399 connections now open) 2015-10-05T03:33:52.685+0100 [mongosMain] connection accepted from 172.28.0.164:54441 #1420018 (400 connections now open) 2015-10-05T03:33:52.687+0100 [conn1420018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:53.122+0100 [conn1419489] end connection 172.28.0.164:51695 (399 connections now open) 2015-10-05T03:33:53.123+0100 [mongosMain] connection accepted from 172.28.0.164:54444 #1420019 (400 connections now open) 2015-10-05T03:33:53.125+0100 [conn1420019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:53.622+0100 [conn1419454] end connection 172.28.0.163:58118 (399 connections now open) 2015-10-05T03:33:53.622+0100 [conn1419375] end connection 172.28.0.163:57597 (398 connections now open) 2015-10-05T03:33:53.623+0100 [mongosMain] connection accepted from 172.28.0.163:61325 #1420020 (399 connections now open) 2015-10-05T03:33:53.624+0100 [conn1420020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:53.625+0100 [mongosMain] connection accepted from 172.28.0.163:61326 #1420021 (400 connections now open) 2015-10-05T03:33:53.626+0100 [conn1420021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:33:56.622+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:33:56.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:34:02.684+0100 [conn1419420] end connection 172.28.0.164:51268 (399 connections now open) 2015-10-05T03:34:02.685+0100 [mongosMain] connection accepted from 172.28.0.164:54460 #1420022 (400 connections now open) 2015-10-05T03:34:02.687+0100 [conn1420022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:02.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e19a5703b51053eab530 2015-10-05T03:34:03.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:03.137+0100 [conn1419474] end connection 172.28.0.164:51576 (399 connections now open) 2015-10-05T03:34:03.139+0100 [mongosMain] connection accepted from 172.28.0.164:54462 #1420023 (400 connections now open) 2015-10-05T03:34:03.140+0100 [conn1420023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:03.638+0100 [conn1419491] end connection 172.28.0.163:58351 (399 connections now open) 2015-10-05T03:34:03.638+0100 [conn1419490] end connection 172.28.0.163:58350 (398 connections now open) 2015-10-05T03:34:03.639+0100 [mongosMain] connection accepted from 172.28.0.163:61364 #1420024 (399 connections now open) 2015-10-05T03:34:03.640+0100 [mongosMain] connection accepted from 172.28.0.163:61365 #1420025 (400 connections now open) 2015-10-05T03:34:03.641+0100 [conn1420024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:03.641+0100 [conn1420025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:09.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1a15703b51053eab567 2015-10-05T03:34:09.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:12.700+0100 [conn1419473] end connection 172.28.0.164:51575 (399 connections now open) 2015-10-05T03:34:12.701+0100 [mongosMain] connection accepted from 172.28.0.164:54513 #1420026 (400 connections now open) 2015-10-05T03:34:12.704+0100 [conn1420026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:13.148+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:34:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:34:13.153+0100 [conn1419480] end connection 172.28.0.164:51630 (399 connections now open) 2015-10-05T03:34:13.154+0100 [mongosMain] connection accepted from 172.28.0.164:54516 #1420027 (400 connections now open) 2015-10-05T03:34:13.156+0100 [conn1420027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:13.638+0100 [conn1419461] end connection 172.28.0.163:58132 (399 connections now open) 2015-10-05T03:34:13.638+0100 [conn1419462] end connection 172.28.0.163:58133 (398 connections now open) 2015-10-05T03:34:13.639+0100 [mongosMain] connection accepted from 172.28.0.163:61420 #1420028 (399 connections now open) 2015-10-05T03:34:13.640+0100 [mongosMain] connection accepted from 172.28.0.163:61421 #1420029 (400 connections now open) 2015-10-05T03:34:13.641+0100 [conn1420028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:13.641+0100 [conn1420029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:15.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1a75703b51053eab580 2015-10-05T03:34:15.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:21.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1ad5703b51053eab598 2015-10-05T03:34:22.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:22.715+0100 [conn1419459] end connection 172.28.0.164:51507 (399 connections now open) 2015-10-05T03:34:22.717+0100 [mongosMain] connection accepted from 172.28.0.164:54564 #1420030 (400 connections now open) 2015-10-05T03:34:22.719+0100 [conn1420030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:23.169+0100 [conn1419497] end connection 172.28.0.164:51741 (399 connections now open) 2015-10-05T03:34:23.171+0100 [mongosMain] connection accepted from 172.28.0.164:54566 #1420031 (400 connections now open) 2015-10-05T03:34:23.173+0100 [conn1420031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:23.653+0100 [conn1419499] end connection 172.28.0.163:58379 (399 connections now open) 2015-10-05T03:34:23.653+0100 [conn1419475] end connection 172.28.0.163:58220 (399 connections now open) 2015-10-05T03:34:23.655+0100 [mongosMain] connection accepted from 172.28.0.163:61470 #1420032 (399 connections now open) 2015-10-05T03:34:23.655+0100 [mongosMain] connection accepted from 172.28.0.163:61471 #1420033 (400 connections now open) 2015-10-05T03:34:23.656+0100 [conn1420032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:23.656+0100 [conn1420033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:28.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1b45703b51053eab5b8 2015-10-05T03:34:28.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:28.593+0100 [mongosMain] connection accepted from 127.0.0.1:61501 #1420034 (401 connections now open) 2015-10-05T03:34:28.596+0100 [conn1420034] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:28.602+0100 [conn1420034] end connection 127.0.0.1:61501 (400 connections now open) 2015-10-05T03:34:32.731+0100 [conn1419452] end connection 172.28.0.164:51490 (399 connections now open) 2015-10-05T03:34:32.735+0100 [mongosMain] connection accepted from 172.28.0.164:54626 #1420035 (400 connections now open) 2015-10-05T03:34:32.738+0100 [conn1420035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:33.184+0100 [conn1419505] end connection 172.28.0.164:51758 (399 connections now open) 2015-10-05T03:34:33.186+0100 [mongosMain] connection accepted from 172.28.0.164:54630 #1420036 (400 connections now open) 2015-10-05T03:34:33.188+0100 [conn1420036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:33.654+0100 [conn1419507] end connection 172.28.0.163:58397 (399 connections now open) 2015-10-05T03:34:33.655+0100 [conn1419482] end connection 172.28.0.163:58285 (398 connections now open) 2015-10-05T03:34:33.656+0100 [mongosMain] connection accepted from 172.28.0.163:61533 #1420037 (399 connections now open) 2015-10-05T03:34:33.656+0100 [mongosMain] connection accepted from 172.28.0.163:61534 #1420038 (400 connections now open) 2015-10-05T03:34:33.657+0100 [conn1420037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:33.657+0100 [conn1420038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:34.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1ba5703b51053eab5d5 2015-10-05T03:34:34.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:40.071+0100 [mongosMain] connection accepted from 127.0.0.1:61553 #1420039 (401 connections now open) 2015-10-05T03:34:40.074+0100 [conn1420039] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:40.079+0100 [conn1420039] end connection 127.0.0.1:61553 (400 connections now open) 2015-10-05T03:34:41.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1c05703b51053eab5eb 2015-10-05T03:34:41.212+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:42.747+0100 [conn1419504] end connection 172.28.0.164:51756 (399 connections now open) 2015-10-05T03:34:42.748+0100 [mongosMain] connection accepted from 172.28.0.164:54671 #1420040 (400 connections now open) 2015-10-05T03:34:42.750+0100 [conn1420040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:43.200+0100 [conn1419512] end connection 172.28.0.164:51778 (399 connections now open) 2015-10-05T03:34:43.201+0100 [mongosMain] connection accepted from 172.28.0.164:54673 #1420041 (400 connections now open) 2015-10-05T03:34:43.203+0100 [conn1420041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:43.297+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:34:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:34:43.669+0100 [conn1419521] end connection 172.28.0.163:58500 (399 connections now open) 2015-10-05T03:34:43.669+0100 [conn1419455] end connection 172.28.0.163:58119 (399 connections now open) 2015-10-05T03:34:43.670+0100 [mongosMain] connection accepted from 172.28.0.163:61558 #1420042 (399 connections now open) 2015-10-05T03:34:43.670+0100 [mongosMain] connection accepted from 172.28.0.163:61559 #1420043 (400 connections now open) 2015-10-05T03:34:43.671+0100 [conn1420042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:43.671+0100 [conn1420043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:52.762+0100 [conn1419511] end connection 172.28.0.164:51775 (399 connections now open) 2015-10-05T03:34:52.764+0100 [mongosMain] connection accepted from 172.28.0.164:54686 #1420044 (400 connections now open) 2015-10-05T03:34:52.765+0100 [conn1420044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:53.201+0100 [conn1419525] end connection 172.28.0.164:51893 (399 connections now open) 2015-10-05T03:34:53.202+0100 [mongosMain] connection accepted from 172.28.0.164:54688 #1420045 (400 connections now open) 2015-10-05T03:34:53.204+0100 [conn1420045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:53.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1cd5703b51053eab638 2015-10-05T03:34:53.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:34:53.672+0100 [conn1419431] end connection 172.28.0.163:57960 (399 connections now open) 2015-10-05T03:34:53.672+0100 [conn1419527] end connection 172.28.0.163:58554 (399 connections now open) 2015-10-05T03:34:53.674+0100 [mongosMain] connection accepted from 172.28.0.163:61572 #1420046 (399 connections now open) 2015-10-05T03:34:53.674+0100 [mongosMain] connection accepted from 172.28.0.163:61573 #1420047 (400 connections now open) 2015-10-05T03:34:53.675+0100 [conn1420046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:34:53.675+0100 [conn1420047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:02.763+0100 [conn1419496] end connection 172.28.0.164:51739 (399 connections now open) 2015-10-05T03:35:02.764+0100 [mongosMain] connection accepted from 172.28.0.164:54709 #1420048 (400 connections now open) 2015-10-05T03:35:02.766+0100 [conn1420048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:03.216+0100 [conn1419549] end connection 172.28.0.164:52008 (399 connections now open) 2015-10-05T03:35:03.217+0100 [mongosMain] connection accepted from 172.28.0.164:54713 #1420049 (400 connections now open) 2015-10-05T03:35:03.219+0100 [conn1420049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:03.686+0100 [conn1419534] end connection 172.28.0.163:58623 (399 connections now open) 2015-10-05T03:35:03.686+0100 [conn1419498] end connection 172.28.0.163:58378 (398 connections now open) 2015-10-05T03:35:03.688+0100 [mongosMain] connection accepted from 172.28.0.163:61608 #1420050 (399 connections now open) 2015-10-05T03:35:03.688+0100 [mongosMain] connection accepted from 172.28.0.163:61609 #1420051 (400 connections now open) 2015-10-05T03:35:03.689+0100 [conn1420050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:03.689+0100 [conn1420051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:05.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1d95703b51053eab687 2015-10-05T03:35:05.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:12.778+0100 [conn1419518] end connection 172.28.0.164:51829 (399 connections now open) 2015-10-05T03:35:12.779+0100 [mongosMain] connection accepted from 172.28.0.164:54760 #1420052 (400 connections now open) 2015-10-05T03:35:12.781+0100 [conn1420052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:13.232+0100 [conn1419533] end connection 172.28.0.164:51969 (399 connections now open) 2015-10-05T03:35:13.233+0100 [mongosMain] connection accepted from 172.28.0.164:54765 #1420053 (400 connections now open) 2015-10-05T03:35:13.234+0100 [conn1420053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:13.595+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:35:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:35:13.687+0100 [conn1419514] end connection 172.28.0.163:58424 (399 connections now open) 2015-10-05T03:35:13.687+0100 [conn1419513] end connection 172.28.0.163:58423 (398 connections now open) 2015-10-05T03:35:13.688+0100 [mongosMain] connection accepted from 172.28.0.163:61668 #1420054 (399 connections now open) 2015-10-05T03:35:13.688+0100 [mongosMain] connection accepted from 172.28.0.163:61669 #1420055 (400 connections now open) 2015-10-05T03:35:13.689+0100 [conn1420054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:13.689+0100 [conn1420055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:18.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1e55703b51053eab6ae 2015-10-05T03:35:18.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:22.802+0100 [conn1419488] end connection 172.28.0.164:51692 (399 connections now open) 2015-10-05T03:35:22.803+0100 [mongosMain] connection accepted from 172.28.0.164:54823 #1420056 (400 connections now open) 2015-10-05T03:35:22.806+0100 [conn1420056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:23.247+0100 [conn1419519] end connection 172.28.0.164:51833 (399 connections now open) 2015-10-05T03:35:23.248+0100 [mongosMain] connection accepted from 172.28.0.164:54828 #1420057 (400 connections now open) 2015-10-05T03:35:23.250+0100 [conn1420057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:23.701+0100 [conn1419506] end connection 172.28.0.163:58398 (399 connections now open) 2015-10-05T03:35:23.701+0100 [conn1419559] end connection 172.28.0.163:58693 (399 connections now open) 2015-10-05T03:35:23.703+0100 [mongosMain] connection accepted from 172.28.0.163:61741 #1420058 (399 connections now open) 2015-10-05T03:35:23.703+0100 [mongosMain] connection accepted from 172.28.0.163:61742 #1420059 (400 connections now open) 2015-10-05T03:35:23.704+0100 [conn1420058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:23.704+0100 [conn1420059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:24.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1ec5703b51053eab6c5 2015-10-05T03:35:24.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:28.833+0100 [mongosMain] connection accepted from 127.0.0.1:61771 #1420060 (401 connections now open) 2015-10-05T03:35:28.836+0100 [conn1420060] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:28.841+0100 [conn1420060] end connection 127.0.0.1:61771 (400 connections now open) 2015-10-05T03:35:30.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1f25703b51053eab6d6 2015-10-05T03:35:31.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:32.801+0100 [conn1419540] end connection 172.28.0.164:51989 (399 connections now open) 2015-10-05T03:35:32.802+0100 [mongosMain] connection accepted from 172.28.0.164:54890 #1420061 (400 connections now open) 2015-10-05T03:35:32.803+0100 [conn1420061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:33.263+0100 [conn1419557] end connection 172.28.0.164:52034 (399 connections now open) 2015-10-05T03:35:33.264+0100 [mongosMain] connection accepted from 172.28.0.164:54894 #1420062 (400 connections now open) 2015-10-05T03:35:33.266+0100 [conn1420062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:33.716+0100 [conn1419526] end connection 172.28.0.163:58553 (399 connections now open) 2015-10-05T03:35:33.716+0100 [conn1419551] end connection 172.28.0.163:58656 (398 connections now open) 2015-10-05T03:35:33.717+0100 [mongosMain] connection accepted from 172.28.0.163:61799 #1420063 (399 connections now open) 2015-10-05T03:35:33.718+0100 [mongosMain] connection accepted from 172.28.0.163:61798 #1420064 (400 connections now open) 2015-10-05T03:35:33.718+0100 [conn1420063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:33.719+0100 [conn1420064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:37.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1f95703b51053eab6f7 2015-10-05T03:35:37.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:39.917+0100 [mongosMain] connection accepted from 127.0.0.1:61817 #1420065 (401 connections now open) 2015-10-05T03:35:39.920+0100 [conn1420065] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:39.925+0100 [conn1420065] end connection 127.0.0.1:61817 (400 connections now open) 2015-10-05T03:35:42.810+0100 [conn1419479] end connection 172.28.0.164:51628 (399 connections now open) 2015-10-05T03:35:42.811+0100 [mongosMain] connection accepted from 172.28.0.164:54919 #1420066 (400 connections now open) 2015-10-05T03:35:42.813+0100 [conn1420066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:43.278+0100 [conn1419565] end connection 172.28.0.164:52096 (399 connections now open) 2015-10-05T03:35:43.293+0100 [mongosMain] connection accepted from 172.28.0.164:54923 #1420067 (400 connections now open) 2015-10-05T03:35:43.295+0100 [conn1420067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:43.717+0100 [conn1419566] end connection 172.28.0.163:58750 (399 connections now open) 2015-10-05T03:35:43.718+0100 [conn1419558] end connection 172.28.0.163:58692 (398 connections now open) 2015-10-05T03:35:43.719+0100 [mongosMain] connection accepted from 172.28.0.163:61822 #1420068 (399 connections now open) 2015-10-05T03:35:43.721+0100 [mongosMain] connection accepted from 172.28.0.163:61825 #1420069 (400 connections now open) 2015-10-05T03:35:43.721+0100 [conn1420068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:43.721+0100 [conn1420069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:43.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e1ff5703b51053eab70e 2015-10-05T03:35:43.882+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:35:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:35:43.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:50.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2055703b51053eab72d 2015-10-05T03:35:50.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:35:52.810+0100 [conn1419524] end connection 172.28.0.164:51887 (399 connections now open) 2015-10-05T03:35:52.811+0100 [mongosMain] connection accepted from 172.28.0.164:54932 #1420070 (400 connections now open) 2015-10-05T03:35:52.813+0100 [conn1420070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:53.295+0100 [conn1419580] end connection 172.28.0.164:52223 (399 connections now open) 2015-10-05T03:35:53.297+0100 [mongosMain] connection accepted from 172.28.0.164:54934 #1420071 (400 connections now open) 2015-10-05T03:35:53.300+0100 [conn1420071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:53.732+0100 [conn1419535] end connection 172.28.0.163:58624 (399 connections now open) 2015-10-05T03:35:53.732+0100 [conn1419573] end connection 172.28.0.163:58809 (399 connections now open) 2015-10-05T03:35:53.733+0100 [mongosMain] connection accepted from 172.28.0.163:61838 #1420072 (399 connections now open) 2015-10-05T03:35:53.734+0100 [mongosMain] connection accepted from 172.28.0.163:61837 #1420073 (400 connections now open) 2015-10-05T03:35:53.735+0100 [conn1420072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:53.735+0100 [conn1420073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:35:56.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e20c5703b51053eab743 2015-10-05T03:35:56.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:02.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2125703b51053eab74d 2015-10-05T03:36:02.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:02.810+0100 [conn1419532] end connection 172.28.0.164:51964 (399 connections now open) 2015-10-05T03:36:02.812+0100 [mongosMain] connection accepted from 172.28.0.164:54949 #1420074 (400 connections now open) 2015-10-05T03:36:02.813+0100 [conn1420074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:03.310+0100 [conn1419541] end connection 172.28.0.164:51991 (399 connections now open) 2015-10-05T03:36:03.311+0100 [mongosMain] connection accepted from 172.28.0.164:54956 #1420075 (400 connections now open) 2015-10-05T03:36:03.313+0100 [conn1420075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:03.733+0100 [conn1419542] end connection 172.28.0.163:58639 (399 connections now open) 2015-10-05T03:36:03.733+0100 [conn1419567] end connection 172.28.0.163:58751 (398 connections now open) 2015-10-05T03:36:03.734+0100 [mongosMain] connection accepted from 172.28.0.163:61867 #1420076 (399 connections now open) 2015-10-05T03:36:03.734+0100 [mongosMain] connection accepted from 172.28.0.163:61868 #1420077 (400 connections now open) 2015-10-05T03:36:03.735+0100 [conn1420076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:03.735+0100 [conn1420077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:08.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2185703b51053eab792 2015-10-05T03:36:08.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:12.826+0100 [conn1419564] end connection 172.28.0.164:52092 (399 connections now open) 2015-10-05T03:36:12.827+0100 [mongosMain] connection accepted from 172.28.0.164:55011 #1420078 (400 connections now open) 2015-10-05T03:36:12.829+0100 [conn1420078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:13.325+0100 [conn1419572] end connection 172.28.0.164:52166 (399 connections now open) 2015-10-05T03:36:13.327+0100 [mongosMain] connection accepted from 172.28.0.164:55014 #1420079 (400 connections now open) 2015-10-05T03:36:13.329+0100 [conn1420079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:13.748+0100 [conn1419543] end connection 172.28.0.163:58638 (399 connections now open) 2015-10-05T03:36:13.748+0100 [conn1419581] end connection 172.28.0.163:58881 (399 connections now open) 2015-10-05T03:36:13.749+0100 [mongosMain] connection accepted from 172.28.0.163:61934 #1420080 (399 connections now open) 2015-10-05T03:36:13.749+0100 [mongosMain] connection accepted from 172.28.0.163:61935 #1420081 (400 connections now open) 2015-10-05T03:36:13.750+0100 [conn1420080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:13.750+0100 [conn1420081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:14.156+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:36:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:36:15.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e21e5703b51053eab7b8 2015-10-05T03:36:15.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:21.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2255703b51053eab7eb 2015-10-05T03:36:21.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:22.826+0100 [conn1419611] end connection 172.28.0.164:52402 (399 connections now open) 2015-10-05T03:36:22.828+0100 [mongosMain] connection accepted from 172.28.0.164:55066 #1420082 (400 connections now open) 2015-10-05T03:36:22.829+0100 [conn1420082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:23.326+0100 [conn1419598] end connection 172.28.0.164:52298 (399 connections now open) 2015-10-05T03:36:23.327+0100 [mongosMain] connection accepted from 172.28.0.164:55071 #1420083 (400 connections now open) 2015-10-05T03:36:23.329+0100 [conn1420083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:23.750+0100 [conn1419588] end connection 172.28.0.163:58903 (399 connections now open) 2015-10-05T03:36:23.750+0100 [conn1419593] end connection 172.28.0.163:58918 (399 connections now open) 2015-10-05T03:36:23.751+0100 [mongosMain] connection accepted from 172.28.0.163:61998 #1420084 (399 connections now open) 2015-10-05T03:36:23.752+0100 [mongosMain] connection accepted from 172.28.0.163:61999 #1420085 (400 connections now open) 2015-10-05T03:36:23.753+0100 [conn1420084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:23.753+0100 [conn1420085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:27.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e22b5703b51053eab818 2015-10-05T03:36:27.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:28.780+0100 [mongosMain] connection accepted from 127.0.0.1:62032 #1420086 (401 connections now open) 2015-10-05T03:36:28.783+0100 [conn1420086] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:28.788+0100 [conn1420086] end connection 127.0.0.1:62032 (400 connections now open) 2015-10-05T03:36:32.841+0100 [conn1419597] end connection 172.28.0.164:52296 (399 connections now open) 2015-10-05T03:36:32.843+0100 [mongosMain] connection accepted from 172.28.0.164:55130 #1420087 (400 connections now open) 2015-10-05T03:36:32.844+0100 [conn1420087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:33.341+0100 [conn1419592] end connection 172.28.0.164:52275 (399 connections now open) 2015-10-05T03:36:33.342+0100 [mongosMain] connection accepted from 172.28.0.164:55136 #1420088 (400 connections now open) 2015-10-05T03:36:33.344+0100 [conn1420088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:33.764+0100 [conn1419589] end connection 172.28.0.163:58904 (399 connections now open) 2015-10-05T03:36:33.764+0100 [conn1419550] end connection 172.28.0.163:58655 (399 connections now open) 2015-10-05T03:36:33.765+0100 [mongosMain] connection accepted from 172.28.0.163:62064 #1420089 (399 connections now open) 2015-10-05T03:36:33.766+0100 [mongosMain] connection accepted from 172.28.0.163:62065 #1420090 (400 connections now open) 2015-10-05T03:36:33.766+0100 [conn1420089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:33.767+0100 [conn1420090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:39.490+0100 [mongosMain] connection accepted from 127.0.0.1:62071 #1420091 (401 connections now open) 2015-10-05T03:36:39.490+0100 [conn1420091] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:39.490+0100 [conn1420091] end connection 127.0.0.1:62071 (400 connections now open) 2015-10-05T03:36:40.067+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2375703b51053eab86a 2015-10-05T03:36:40.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:43.357+0100 [conn1419605] end connection 172.28.0.164:52343 (399 connections now open) 2015-10-05T03:36:43.358+0100 [mongosMain] connection accepted from 172.28.0.164:55155 #1420092 (400 connections now open) 2015-10-05T03:36:43.360+0100 [conn1420092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:43.780+0100 [conn1419600] end connection 172.28.0.163:58952 (399 connections now open) 2015-10-05T03:36:43.780+0100 [conn1419606] end connection 172.28.0.163:59018 (399 connections now open) 2015-10-05T03:36:43.781+0100 [mongosMain] connection accepted from 172.28.0.163:62076 #1420093 (399 connections now open) 2015-10-05T03:36:43.782+0100 [mongosMain] connection accepted from 172.28.0.163:62077 #1420094 (400 connections now open) 2015-10-05T03:36:43.783+0100 [conn1420093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:43.783+0100 [conn1420094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:44.309+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:36:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:36:52.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2445703b51053eab89b 2015-10-05T03:36:52.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:36:53.357+0100 [conn1419587] end connection 172.28.0.164:52260 (399 connections now open) 2015-10-05T03:36:53.359+0100 [mongosMain] connection accepted from 172.28.0.164:55166 #1420095 (400 connections now open) 2015-10-05T03:36:53.360+0100 [conn1420095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:53.782+0100 [conn1419574] end connection 172.28.0.163:58810 (399 connections now open) 2015-10-05T03:36:53.782+0100 [conn1419614] end connection 172.28.0.163:59077 (399 connections now open) 2015-10-05T03:36:53.783+0100 [mongosMain] connection accepted from 172.28.0.163:62090 #1420096 (399 connections now open) 2015-10-05T03:36:53.784+0100 [mongosMain] connection accepted from 172.28.0.163:62091 #1420097 (400 connections now open) 2015-10-05T03:36:53.784+0100 [conn1420096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:36:53.785+0100 [conn1420097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:03.373+0100 [conn1419612] end connection 172.28.0.164:52407 (399 connections now open) 2015-10-05T03:37:03.374+0100 [mongosMain] connection accepted from 172.28.0.164:55185 #1420098 (400 connections now open) 2015-10-05T03:37:03.376+0100 [conn1420098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:03.795+0100 [conn1419599] end connection 172.28.0.163:58950 (399 connections now open) 2015-10-05T03:37:03.795+0100 [conn1419582] end connection 172.28.0.163:58882 (399 connections now open) 2015-10-05T03:37:03.797+0100 [mongosMain] connection accepted from 172.28.0.163:62119 #1420099 (399 connections now open) 2015-10-05T03:37:03.797+0100 [mongosMain] connection accepted from 172.28.0.163:62120 #1420100 (400 connections now open) 2015-10-05T03:37:03.798+0100 [conn1420099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:03.798+0100 [conn1420100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:04.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2505703b51053eab8ec 2015-10-05T03:37:04.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:13.372+0100 [conn1419621] end connection 172.28.0.164:52475 (399 connections now open) 2015-10-05T03:37:13.373+0100 [mongosMain] connection accepted from 172.28.0.164:55229 #1420101 (400 connections now open) 2015-10-05T03:37:13.375+0100 [conn1420101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:13.799+0100 [conn1419622] end connection 172.28.0.163:59159 (399 connections now open) 2015-10-05T03:37:13.799+0100 [conn1419623] end connection 172.28.0.163:59160 (398 connections now open) 2015-10-05T03:37:13.801+0100 [mongosMain] connection accepted from 172.28.0.163:62160 #1420102 (399 connections now open) 2015-10-05T03:37:13.801+0100 [mongosMain] connection accepted from 172.28.0.163:62161 #1420103 (400 connections now open) 2015-10-05T03:37:13.802+0100 [conn1420102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:13.802+0100 [conn1420103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:14.577+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:37:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:37:17.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e25c5703b51053eab933 2015-10-05T03:37:17.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:23.388+0100 [conn1419629] end connection 172.28.0.164:52504 (399 connections now open) 2015-10-05T03:37:23.389+0100 [mongosMain] connection accepted from 172.28.0.164:55295 #1420104 (400 connections now open) 2015-10-05T03:37:23.391+0100 [conn1420104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:23.811+0100 [conn1419646] end connection 172.28.0.163:59333 (399 connections now open) 2015-10-05T03:37:23.811+0100 [conn1419642] end connection 172.28.0.163:59225 (399 connections now open) 2015-10-05T03:37:23.813+0100 [mongosMain] connection accepted from 172.28.0.163:62211 #1420105 (399 connections now open) 2015-10-05T03:37:23.813+0100 [mongosMain] connection accepted from 172.28.0.163:62212 #1420106 (400 connections now open) 2015-10-05T03:37:23.814+0100 [conn1420105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:23.814+0100 [conn1420106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:28.775+0100 [mongosMain] connection accepted from 127.0.0.1:62245 #1420107 (401 connections now open) 2015-10-05T03:37:28.777+0100 [conn1420107] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:28.783+0100 [conn1420107] end connection 127.0.0.1:62245 (400 connections now open) 2015-10-05T03:37:29.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2695703b51053eab9a1 2015-10-05T03:37:29.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:33.388+0100 [conn1419651] end connection 172.28.0.164:52676 (399 connections now open) 2015-10-05T03:37:33.389+0100 [mongosMain] connection accepted from 172.28.0.164:55354 #1420108 (400 connections now open) 2015-10-05T03:37:33.390+0100 [conn1420108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:33.812+0100 [conn1419631] end connection 172.28.0.163:59176 (399 connections now open) 2015-10-05T03:37:33.812+0100 [conn1419635] end connection 172.28.0.163:59193 (399 connections now open) 2015-10-05T03:37:33.813+0100 [mongosMain] connection accepted from 172.28.0.163:62277 #1420109 (399 connections now open) 2015-10-05T03:37:33.813+0100 [mongosMain] connection accepted from 172.28.0.163:62278 #1420110 (400 connections now open) 2015-10-05T03:37:33.814+0100 [conn1420109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:33.814+0100 [conn1420110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:35.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e26f5703b51053eab9cb 2015-10-05T03:37:35.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:40.151+0100 [mongosMain] connection accepted from 127.0.0.1:62293 #1420111 (401 connections now open) 2015-10-05T03:37:40.153+0100 [conn1420111] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:40.158+0100 [conn1420111] end connection 127.0.0.1:62293 (400 connections now open) 2015-10-05T03:37:41.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2755703b51053eab9f0 2015-10-05T03:37:42.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:43.403+0100 [conn1419644] end connection 172.28.0.164:52600 (399 connections now open) 2015-10-05T03:37:43.404+0100 [mongosMain] connection accepted from 172.28.0.164:55376 #1420112 (400 connections now open) 2015-10-05T03:37:43.406+0100 [conn1420112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:43.827+0100 [conn1419645] end connection 172.28.0.163:59331 (399 connections now open) 2015-10-05T03:37:43.828+0100 [mongosMain] connection accepted from 172.28.0.163:62297 #1420113 (400 connections now open) 2015-10-05T03:37:43.829+0100 [conn1420113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:44.731+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:37:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:37:48.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e27c5703b51053eaba0d 2015-10-05T03:37:48.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:37:53.404+0100 [conn1419640] end connection 172.28.0.164:52546 (399 connections now open) 2015-10-05T03:37:53.405+0100 [mongosMain] connection accepted from 172.28.0.164:55388 #1420114 (400 connections now open) 2015-10-05T03:37:53.407+0100 [conn1420114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:53.830+0100 [conn1419630] end connection 172.28.0.163:59175 (399 connections now open) 2015-10-05T03:37:53.832+0100 [mongosMain] connection accepted from 172.28.0.163:62310 #1420115 (400 connections now open) 2015-10-05T03:37:53.833+0100 [conn1420115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:37:54.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2825703b51053eaba31 2015-10-05T03:37:54.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:00.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2885703b51053eaba4c 2015-10-05T03:38:01.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:03.419+0100 [conn1419634] end connection 172.28.0.164:52518 (399 connections now open) 2015-10-05T03:38:03.421+0100 [mongosMain] connection accepted from 172.28.0.164:55406 #1420116 (400 connections now open) 2015-10-05T03:38:03.423+0100 [conn1420116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:03.843+0100 [conn1419653] end connection 172.28.0.163:59434 (399 connections now open) 2015-10-05T03:38:03.844+0100 [mongosMain] connection accepted from 172.28.0.163:62335 #1420117 (400 connections now open) 2015-10-05T03:38:03.845+0100 [conn1420117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:07.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e28f5703b51053eaba8e 2015-10-05T03:38:07.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:13.526+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2955703b51053eabac5 2015-10-05T03:38:13.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:13.858+0100 [conn1419660] end connection 172.28.0.163:59575 (399 connections now open) 2015-10-05T03:38:13.859+0100 [mongosMain] connection accepted from 172.28.0.163:62401 #1420118 (400 connections now open) 2015-10-05T03:38:13.860+0100 [conn1420118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:14.868+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:38:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:38:19.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e29b5703b51053eabafb 2015-10-05T03:38:20.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:22.936+0100 [conn1419591] end connection 172.28.0.164:52273 (399 connections now open) 2015-10-05T03:38:22.938+0100 [mongosMain] connection accepted from 172.28.0.164:55500 #1420119 (400 connections now open) 2015-10-05T03:38:22.939+0100 [conn1420119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:23.435+0100 [conn1419671] end connection 172.28.0.164:52817 (399 connections now open) 2015-10-05T03:38:23.436+0100 [mongosMain] connection accepted from 172.28.0.164:55503 #1420120 (400 connections now open) 2015-10-05T03:38:23.438+0100 [conn1420120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:23.860+0100 [conn1419672] end connection 172.28.0.163:59608 (399 connections now open) 2015-10-05T03:38:23.861+0100 [mongosMain] connection accepted from 172.28.0.163:62461 #1420121 (400 connections now open) 2015-10-05T03:38:23.862+0100 [conn1420121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:26.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2a25703b51053eabb20 2015-10-05T03:38:26.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:28.669+0100 [mongosMain] connection accepted from 127.0.0.1:62493 #1420122 (401 connections now open) 2015-10-05T03:38:28.672+0100 [conn1420122] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:28.678+0100 [conn1420122] end connection 127.0.0.1:62493 (400 connections now open) 2015-10-05T03:38:32.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2a85703b51053eabb47 2015-10-05T03:38:32.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:32.954+0100 [conn1419548] end connection 172.28.0.164:52006 (399 connections now open) 2015-10-05T03:38:32.956+0100 [mongosMain] connection accepted from 172.28.0.164:55557 #1420123 (400 connections now open) 2015-10-05T03:38:32.957+0100 [conn1420123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:33.874+0100 [conn1419520] end connection 172.28.0.163:58499 (399 connections now open) 2015-10-05T03:38:33.874+0100 [conn1419667] end connection 172.28.0.163:59587 (399 connections now open) 2015-10-05T03:38:33.875+0100 [mongosMain] connection accepted from 172.28.0.163:62516 #1420124 (399 connections now open) 2015-10-05T03:38:33.876+0100 [mongosMain] connection accepted from 172.28.0.163:62517 #1420125 (400 connections now open) 2015-10-05T03:38:33.876+0100 [conn1420124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:33.877+0100 [conn1420125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:38.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2ae5703b51053eabb71 2015-10-05T03:38:38.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:40.013+0100 [mongosMain] connection accepted from 127.0.0.1:62538 #1420126 (401 connections now open) 2015-10-05T03:38:40.016+0100 [conn1420126] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:40.021+0100 [conn1420126] end connection 127.0.0.1:62538 (400 connections now open) 2015-10-05T03:38:42.952+0100 [conn1419604] end connection 172.28.0.164:52340 (399 connections now open) 2015-10-05T03:38:42.952+0100 [mongosMain] connection accepted from 172.28.0.164:55596 #1420127 (400 connections now open) 2015-10-05T03:38:42.955+0100 [conn1420127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:43.875+0100 [conn1419678] end connection 172.28.0.163:59642 (399 connections now open) 2015-10-05T03:38:43.875+0100 [conn1419652] end connection 172.28.0.163:59433 (399 connections now open) 2015-10-05T03:38:43.876+0100 [mongosMain] connection accepted from 172.28.0.163:62543 #1420128 (399 connections now open) 2015-10-05T03:38:43.876+0100 [mongosMain] connection accepted from 172.28.0.163:62544 #1420129 (400 connections now open) 2015-10-05T03:38:43.877+0100 [conn1420128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:43.877+0100 [conn1420129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:45.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2b45703b51053eabba0 2015-10-05T03:38:45.132+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:38:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:38:45.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:51.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2bb5703b51053eabbce 2015-10-05T03:38:51.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:38:52.969+0100 [conn1419556] end connection 172.28.0.164:52030 (399 connections now open) 2015-10-05T03:38:52.970+0100 [mongosMain] connection accepted from 172.28.0.164:55606 #1420130 (400 connections now open) 2015-10-05T03:38:52.971+0100 [conn1420130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:53.890+0100 [conn1419607] end connection 172.28.0.163:59019 (399 connections now open) 2015-10-05T03:38:53.892+0100 [mongosMain] connection accepted from 172.28.0.163:62566 #1420131 (400 connections now open) 2015-10-05T03:38:53.893+0100 [conn1420131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:38:57.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2c15703b51053eabc04 2015-10-05T03:38:57.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:02.983+0100 [conn1419686] end connection 172.28.0.164:52966 (399 connections now open) 2015-10-05T03:39:02.984+0100 [mongosMain] connection accepted from 172.28.0.164:55621 #1420132 (400 connections now open) 2015-10-05T03:39:02.986+0100 [conn1420132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:03.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2c75703b51053eabc3e 2015-10-05T03:39:04.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:10.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2ce5703b51053eabc77 2015-10-05T03:39:10.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:13.000+0100 [conn1419620] end connection 172.28.0.164:52469 (399 connections now open) 2015-10-05T03:39:13.001+0100 [mongosMain] connection accepted from 172.28.0.164:55672 #1420133 (400 connections now open) 2015-10-05T03:39:13.002+0100 [conn1420133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:15.436+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:39:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:39:16.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2d45703b51053eabc96 2015-10-05T03:39:16.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:23.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2da5703b51053eabcc5 2015-10-05T03:39:23.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:23.445+0100 [conn1419692] end connection 172.28.0.164:53049 (399 connections now open) 2015-10-05T03:39:23.447+0100 [mongosMain] connection accepted from 172.28.0.164:55725 #1420134 (400 connections now open) 2015-10-05T03:39:23.449+0100 [conn1420134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:28.963+0100 [mongosMain] connection accepted from 127.0.0.1:62716 #1420135 (401 connections now open) 2015-10-05T03:39:28.966+0100 [conn1420135] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:28.971+0100 [conn1420135] end connection 127.0.0.1:62716 (400 connections now open) 2015-10-05T03:39:29.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2e15703b51053eabcdf 2015-10-05T03:39:29.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:33.030+0100 [conn1419702] end connection 172.28.0.164:53090 (399 connections now open) 2015-10-05T03:39:33.031+0100 [mongosMain] connection accepted from 172.28.0.164:55776 #1420136 (400 connections now open) 2015-10-05T03:39:33.034+0100 [conn1420136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:33.500+0100 [conn1419666] end connection 172.28.0.164:52801 (399 connections now open) 2015-10-05T03:39:33.501+0100 [mongosMain] connection accepted from 172.28.0.164:55781 #1420137 (400 connections now open) 2015-10-05T03:39:33.503+0100 [conn1420137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:33.922+0100 [conn1419687] end connection 172.28.0.163:59763 (399 connections now open) 2015-10-05T03:39:33.923+0100 [conn1419636] end connection 172.28.0.163:59194 (398 connections now open) 2015-10-05T03:39:33.924+0100 [mongosMain] connection accepted from 172.28.0.163:62735 #1420138 (399 connections now open) 2015-10-05T03:39:33.924+0100 [mongosMain] connection accepted from 172.28.0.163:62736 #1420139 (400 connections now open) 2015-10-05T03:39:33.925+0100 [conn1420138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:33.925+0100 [conn1420139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:35.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2e75703b51053eabce5 2015-10-05T03:39:36.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:39.663+0100 [mongosMain] connection accepted from 127.0.0.1:62768 #1420140 (401 connections now open) 2015-10-05T03:39:39.666+0100 [conn1420140] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:39.671+0100 [conn1420140] end connection 127.0.0.1:62768 (400 connections now open) 2015-10-05T03:39:42.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2ee5703b51053eabcec 2015-10-05T03:39:42.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:39:43.515+0100 [conn1419659] end connection 172.28.0.164:52765 (399 connections now open) 2015-10-05T03:39:43.517+0100 [mongosMain] connection accepted from 172.28.0.164:55821 #1420141 (400 connections now open) 2015-10-05T03:39:43.518+0100 [conn1420141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:39:45.711+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:39:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:39:48.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e2f45703b51053eabd05 2015-10-05T03:39:48.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:00.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3005703b51053eabd1c 2015-10-05T03:40:01.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:13.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e30d5703b51053eabd3c 2015-10-05T03:40:13.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:13.954+0100 [conn1419613] end connection 172.28.0.163:59076 (399 connections now open) 2015-10-05T03:40:13.955+0100 [mongosMain] connection accepted from 172.28.0.163:62871 #1420142 (400 connections now open) 2015-10-05T03:40:13.956+0100 [conn1420142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:15.919+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:40:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:40:19.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3135703b51053eabd55 2015-10-05T03:40:19.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:21.081+0100 [conn1419740] end connection 172.28.0.164:53369 (399 connections now open) 2015-10-05T03:40:21.082+0100 [mongosMain] connection accepted from 172.28.0.164:55923 #1420143 (400 connections now open) 2015-10-05T03:40:21.083+0100 [conn1420143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:21.549+0100 [conn1419741] end connection 172.28.0.164:53377 (399 connections now open) 2015-10-05T03:40:21.550+0100 [mongosMain] connection accepted from 172.28.0.164:55929 #1420144 (400 connections now open) 2015-10-05T03:40:21.552+0100 [conn1420144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:22.410+0100 [conn1419745] end connection 172.28.0.163:60236 (399 connections now open) 2015-10-05T03:40:22.411+0100 [mongosMain] connection accepted from 172.28.0.163:62916 #1420145 (400 connections now open) 2015-10-05T03:40:22.412+0100 [conn1420145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:23.063+0100 [conn1419746] end connection 172.28.0.163:60243 (399 connections now open) 2015-10-05T03:40:23.064+0100 [mongosMain] connection accepted from 172.28.0.163:62917 #1420146 (400 connections now open) 2015-10-05T03:40:23.065+0100 [conn1420146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:23.969+0100 [conn1419716] end connection 172.28.0.163:60080 (399 connections now open) 2015-10-05T03:40:23.969+0100 [conn1419707] end connection 172.28.0.163:59971 (399 connections now open) 2015-10-05T03:40:23.970+0100 [mongosMain] connection accepted from 172.28.0.163:62923 #1420147 (399 connections now open) 2015-10-05T03:40:23.970+0100 [mongosMain] connection accepted from 172.28.0.163:62924 #1420148 (400 connections now open) 2015-10-05T03:40:23.971+0100 [conn1420147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:23.971+0100 [conn1420148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:26.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3195703b51053eabd63 2015-10-05T03:40:26.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:28.205+0100 [mongosMain] connection accepted from 127.0.0.1:62943 #1420149 (401 connections now open) 2015-10-05T03:40:28.208+0100 [conn1420149] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:28.214+0100 [conn1420149] end connection 127.0.0.1:62943 (400 connections now open) 2015-10-05T03:40:31.097+0100 [conn1419742] end connection 172.28.0.164:53381 (399 connections now open) 2015-10-05T03:40:31.098+0100 [mongosMain] connection accepted from 172.28.0.164:55998 #1420150 (400 connections now open) 2015-10-05T03:40:31.100+0100 [conn1420150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:31.549+0100 [conn1419796] end connection 172.28.0.164:53535 (399 connections now open) 2015-10-05T03:40:31.551+0100 [mongosMain] connection accepted from 172.28.0.164:56003 #1420151 (400 connections now open) 2015-10-05T03:40:31.552+0100 [conn1420151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:32.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3205703b51053eabd7c 2015-10-05T03:40:32.410+0100 [conn1419744] end connection 172.28.0.163:60235 (399 connections now open) 2015-10-05T03:40:32.411+0100 [mongosMain] connection accepted from 172.28.0.163:62971 #1420152 (400 connections now open) 2015-10-05T03:40:32.412+0100 [conn1420152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:32.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:33.064+0100 [conn1419892] end connection 172.28.0.163:60406 (399 connections now open) 2015-10-05T03:40:33.067+0100 [mongosMain] connection accepted from 172.28.0.163:62974 #1420153 (400 connections now open) 2015-10-05T03:40:33.068+0100 [conn1420153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:33.109+0100 [conn1419586] end connection 172.28.0.164:52257 (399 connections now open) 2015-10-05T03:40:33.111+0100 [mongosMain] connection accepted from 172.28.0.164:56015 #1420154 (400 connections now open) 2015-10-05T03:40:33.112+0100 [conn1420154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:33.578+0100 [conn1419677] end connection 172.28.0.164:52862 (399 connections now open) 2015-10-05T03:40:33.579+0100 [mongosMain] connection accepted from 172.28.0.164:56019 #1420155 (400 connections now open) 2015-10-05T03:40:33.580+0100 [conn1420155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:33.971+0100 [conn1419747] end connection 172.28.0.163:60254 (399 connections now open) 2015-10-05T03:40:33.971+0100 [conn1419693] end connection 172.28.0.163:59833 (399 connections now open) 2015-10-05T03:40:33.972+0100 [mongosMain] connection accepted from 172.28.0.163:62980 #1420156 (399 connections now open) 2015-10-05T03:40:33.972+0100 [mongosMain] connection accepted from 172.28.0.163:62981 #1420157 (400 connections now open) 2015-10-05T03:40:33.973+0100 [conn1420156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:33.973+0100 [conn1420157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:38.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3265703b51053eabd9a 2015-10-05T03:40:38.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:39.946+0100 [mongosMain] connection accepted from 127.0.0.1:63016 #1420158 (401 connections now open) 2015-10-05T03:40:39.949+0100 [conn1420158] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:39.953+0100 [conn1420158] end connection 127.0.0.1:63016 (400 connections now open) 2015-10-05T03:40:41.113+0100 [conn1419749] end connection 172.28.0.164:53408 (399 connections now open) 2015-10-05T03:40:41.114+0100 [mongosMain] connection accepted from 172.28.0.164:56060 #1420159 (400 connections now open) 2015-10-05T03:40:41.116+0100 [conn1420159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:41.564+0100 [conn1419797] end connection 172.28.0.164:53538 (399 connections now open) 2015-10-05T03:40:41.565+0100 [mongosMain] connection accepted from 172.28.0.164:56062 #1420160 (400 connections now open) 2015-10-05T03:40:41.567+0100 [conn1420160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:42.424+0100 [conn1419743] end connection 172.28.0.163:60233 (399 connections now open) 2015-10-05T03:40:42.425+0100 [mongosMain] connection accepted from 172.28.0.163:63022 #1420161 (400 connections now open) 2015-10-05T03:40:42.426+0100 [conn1420161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:43.079+0100 [conn1419893] end connection 172.28.0.163:60408 (399 connections now open) 2015-10-05T03:40:43.080+0100 [mongosMain] connection accepted from 172.28.0.163:63024 #1420162 (400 connections now open) 2015-10-05T03:40:43.081+0100 [conn1420162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:43.125+0100 [conn1419722] end connection 172.28.0.164:53275 (399 connections now open) 2015-10-05T03:40:43.126+0100 [mongosMain] connection accepted from 172.28.0.164:56065 #1420163 (400 connections now open) 2015-10-05T03:40:43.127+0100 [conn1420163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:43.593+0100 [conn1419730] end connection 172.28.0.164:53304 (399 connections now open) 2015-10-05T03:40:43.595+0100 [mongosMain] connection accepted from 172.28.0.164:56068 #1420164 (400 connections now open) 2015-10-05T03:40:43.597+0100 [conn1420164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:43.985+0100 [conn1419703] end connection 172.28.0.163:59938 (399 connections now open) 2015-10-05T03:40:43.986+0100 [mongosMain] connection accepted from 172.28.0.163:63027 #1420165 (400 connections now open) 2015-10-05T03:40:43.988+0100 [conn1420165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:45.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e32c5703b51053eabdb4 2015-10-05T03:40:45.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:40:46.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:40:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:40:51.128+0100 [conn1419748] end connection 172.28.0.164:53407 (399 connections now open) 2015-10-05T03:40:51.129+0100 [mongosMain] connection accepted from 172.28.0.164:56077 #1420166 (400 connections now open) 2015-10-05T03:40:51.130+0100 [conn1420166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:51.581+0100 [conn1419798] end connection 172.28.0.164:53541 (399 connections now open) 2015-10-05T03:40:51.582+0100 [mongosMain] connection accepted from 172.28.0.164:56079 #1420167 (400 connections now open) 2015-10-05T03:40:51.583+0100 [conn1420167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:52.439+0100 [conn1419845] end connection 172.28.0.163:60311 (399 connections now open) 2015-10-05T03:40:52.440+0100 [mongosMain] connection accepted from 172.28.0.163:63036 #1420168 (400 connections now open) 2015-10-05T03:40:52.441+0100 [conn1420168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:53.079+0100 [conn1419894] end connection 172.28.0.163:60409 (399 connections now open) 2015-10-05T03:40:53.080+0100 [mongosMain] connection accepted from 172.28.0.163:63039 #1420169 (400 connections now open) 2015-10-05T03:40:53.081+0100 [conn1420169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:53.124+0100 [conn1419698] end connection 172.28.0.164:53077 (399 connections now open) 2015-10-05T03:40:53.125+0100 [mongosMain] connection accepted from 172.28.0.164:56083 #1420170 (400 connections now open) 2015-10-05T03:40:53.127+0100 [conn1420170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:53.593+0100 [conn1419723] end connection 172.28.0.164:53282 (399 connections now open) 2015-10-05T03:40:53.594+0100 [mongosMain] connection accepted from 172.28.0.164:56086 #1420171 (400 connections now open) 2015-10-05T03:40:53.596+0100 [conn1420171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:40:57.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3395703b51053eabde7 2015-10-05T03:40:57.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:41:01.128+0100 [conn1419750] end connection 172.28.0.164:53436 (399 connections now open) 2015-10-05T03:41:01.129+0100 [mongosMain] connection accepted from 172.28.0.164:56095 #1420172 (400 connections now open) 2015-10-05T03:41:01.130+0100 [conn1420172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:01.595+0100 [conn1419799] end connection 172.28.0.164:53545 (399 connections now open) 2015-10-05T03:41:01.597+0100 [mongosMain] connection accepted from 172.28.0.164:56097 #1420173 (400 connections now open) 2015-10-05T03:41:01.598+0100 [conn1420173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:02.440+0100 [conn1419846] end connection 172.28.0.163:60313 (399 connections now open) 2015-10-05T03:41:02.441+0100 [mongosMain] connection accepted from 172.28.0.163:63066 #1420174 (400 connections now open) 2015-10-05T03:41:02.442+0100 [conn1420174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:03.095+0100 [conn1419895] end connection 172.28.0.163:60411 (399 connections now open) 2015-10-05T03:41:03.096+0100 [mongosMain] connection accepted from 172.28.0.163:63071 #1420175 (400 connections now open) 2015-10-05T03:41:03.097+0100 [conn1420175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:03.125+0100 [conn1419729] end connection 172.28.0.164:53302 (399 connections now open) 2015-10-05T03:41:03.127+0100 [mongosMain] connection accepted from 172.28.0.164:56104 #1420176 (400 connections now open) 2015-10-05T03:41:03.129+0100 [conn1420176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:11.144+0100 [conn1419751] end connection 172.28.0.164:53442 (399 connections now open) 2015-10-05T03:41:11.145+0100 [mongosMain] connection accepted from 172.28.0.164:56130 #1420177 (400 connections now open) 2015-10-05T03:41:11.147+0100 [conn1420177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:11.613+0100 [conn1419800] end connection 172.28.0.164:53548 (399 connections now open) 2015-10-05T03:41:11.613+0100 [mongosMain] connection accepted from 172.28.0.164:56138 #1420178 (400 connections now open) 2015-10-05T03:41:11.615+0100 [conn1420178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:12.456+0100 [conn1419847] end connection 172.28.0.163:60314 (399 connections now open) 2015-10-05T03:41:12.457+0100 [mongosMain] connection accepted from 172.28.0.163:63119 #1420179 (400 connections now open) 2015-10-05T03:41:12.458+0100 [conn1420179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:13.095+0100 [conn1419896] end connection 172.28.0.163:60412 (399 connections now open) 2015-10-05T03:41:13.096+0100 [mongosMain] connection accepted from 172.28.0.163:63125 #1420180 (400 connections now open) 2015-10-05T03:41:13.096+0100 [conn1420180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:13.157+0100 [conn1419712] end connection 172.28.0.164:53155 (399 connections now open) 2015-10-05T03:41:13.158+0100 [mongosMain] connection accepted from 172.28.0.164:56154 #1420181 (400 connections now open) 2015-10-05T03:41:13.159+0100 [conn1420181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:13.609+0100 [conn1419943] end connection 172.28.0.164:53698 (399 connections now open) 2015-10-05T03:41:13.610+0100 [mongosMain] connection accepted from 172.28.0.164:56157 #1420182 (400 connections now open) 2015-10-05T03:41:13.612+0100 [conn1420182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:16.429+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:41:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:41:21.145+0100 [conn1419752] end connection 172.28.0.164:53445 (399 connections now open) 2015-10-05T03:41:21.146+0100 [mongosMain] connection accepted from 172.28.0.164:56191 #1420183 (400 connections now open) 2015-10-05T03:41:21.148+0100 [conn1420183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:21.612+0100 [conn1419801] end connection 172.28.0.164:53552 (399 connections now open) 2015-10-05T03:41:21.614+0100 [mongosMain] connection accepted from 172.28.0.164:56197 #1420184 (400 connections now open) 2015-10-05T03:41:21.616+0100 [conn1420184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:21.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3515703b51053eabe69 2015-10-05T03:41:22.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:41:22.463+0100 [conn1419848] end connection 172.28.0.163:60316 (399 connections now open) 2015-10-05T03:41:22.465+0100 [mongosMain] connection accepted from 172.28.0.163:63183 #1420185 (400 connections now open) 2015-10-05T03:41:22.466+0100 [conn1420185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:23.111+0100 [conn1419897] end connection 172.28.0.163:60414 (399 connections now open) 2015-10-05T03:41:23.112+0100 [mongosMain] connection accepted from 172.28.0.163:63190 #1420186 (400 connections now open) 2015-10-05T03:41:23.113+0100 [conn1420186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:23.156+0100 [conn1419954] end connection 172.28.0.164:53739 (399 connections now open) 2015-10-05T03:41:23.158+0100 [mongosMain] connection accepted from 172.28.0.164:56210 #1420187 (400 connections now open) 2015-10-05T03:41:23.159+0100 [conn1420187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:23.625+0100 [conn1419952] end connection 172.28.0.164:53726 (399 connections now open) 2015-10-05T03:41:23.626+0100 [mongosMain] connection accepted from 172.28.0.164:56216 #1420188 (400 connections now open) 2015-10-05T03:41:23.628+0100 [conn1420188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:26.200+0100 [conn1419945] end connection 172.28.0.163:60554 (399 connections now open) 2015-10-05T03:41:26.201+0100 [mongosMain] connection accepted from 172.28.0.163:63206 #1420189 (400 connections now open) 2015-10-05T03:41:26.203+0100 [conn1420189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:28.567+0100 [mongosMain] connection accepted from 127.0.0.1:63221 #1420190 (401 connections now open) 2015-10-05T03:41:28.569+0100 [conn1420190] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:28.578+0100 [conn1420190] end connection 127.0.0.1:63221 (400 connections now open) 2015-10-05T03:41:31.160+0100 [conn1419753] end connection 172.28.0.164:53448 (399 connections now open) 2015-10-05T03:41:31.163+0100 [mongosMain] connection accepted from 172.28.0.164:56263 #1420191 (400 connections now open) 2015-10-05T03:41:31.164+0100 [conn1420191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:31.629+0100 [conn1419802] end connection 172.28.0.164:53555 (399 connections now open) 2015-10-05T03:41:31.630+0100 [mongosMain] connection accepted from 172.28.0.164:56268 #1420192 (400 connections now open) 2015-10-05T03:41:31.633+0100 [conn1420192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:32.471+0100 [conn1419849] end connection 172.28.0.163:60317 (399 connections now open) 2015-10-05T03:41:32.472+0100 [mongosMain] connection accepted from 172.28.0.163:63243 #1420193 (400 connections now open) 2015-10-05T03:41:32.474+0100 [conn1420193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:33.111+0100 [conn1419898] end connection 172.28.0.163:60415 (399 connections now open) 2015-10-05T03:41:33.112+0100 [mongosMain] connection accepted from 172.28.0.163:63250 #1420194 (400 connections now open) 2015-10-05T03:41:33.113+0100 [conn1420194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:33.157+0100 [conn1419715] end connection 172.28.0.164:53212 (399 connections now open) 2015-10-05T03:41:33.158+0100 [mongosMain] connection accepted from 172.28.0.164:56279 #1420195 (400 connections now open) 2015-10-05T03:41:33.160+0100 [conn1420195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:33.625+0100 [conn1419957] end connection 172.28.0.164:53800 (399 connections now open) 2015-10-05T03:41:33.626+0100 [mongosMain] connection accepted from 172.28.0.164:56282 #1420196 (400 connections now open) 2015-10-05T03:41:33.628+0100 [conn1420196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:34.289+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:41:34.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:41:36.222+0100 [conn1419955] end connection 172.28.0.163:60606 (399 connections now open) 2015-10-05T03:41:36.222+0100 [conn1419960] end connection 172.28.0.163:60736 (399 connections now open) 2015-10-05T03:41:36.223+0100 [mongosMain] connection accepted from 172.28.0.163:63271 #1420197 (399 connections now open) 2015-10-05T03:41:36.223+0100 [mongosMain] connection accepted from 172.28.0.163:63272 #1420198 (400 connections now open) 2015-10-05T03:41:36.224+0100 [conn1420197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:36.224+0100 [conn1420198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:39.971+0100 [mongosMain] connection accepted from 127.0.0.1:63284 #1420199 (401 connections now open) 2015-10-05T03:41:39.974+0100 [conn1420199] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:39.978+0100 [conn1420199] end connection 127.0.0.1:63284 (400 connections now open) 2015-10-05T03:41:40.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3645703b51053eabea8 2015-10-05T03:41:40.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:41:41.160+0100 [conn1419754] end connection 172.28.0.164:53452 (399 connections now open) 2015-10-05T03:41:41.163+0100 [mongosMain] connection accepted from 172.28.0.164:56309 #1420200 (400 connections now open) 2015-10-05T03:41:41.166+0100 [conn1420200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:41.628+0100 [conn1419803] end connection 172.28.0.164:53558 (399 connections now open) 2015-10-05T03:41:41.629+0100 [mongosMain] connection accepted from 172.28.0.164:56312 #1420201 (400 connections now open) 2015-10-05T03:41:41.631+0100 [conn1420201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:42.472+0100 [conn1419850] end connection 172.28.0.163:60319 (399 connections now open) 2015-10-05T03:41:42.473+0100 [mongosMain] connection accepted from 172.28.0.163:63288 #1420202 (400 connections now open) 2015-10-05T03:41:42.474+0100 [conn1420202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:43.126+0100 [conn1419899] end connection 172.28.0.163:60417 (399 connections now open) 2015-10-05T03:41:43.127+0100 [mongosMain] connection accepted from 172.28.0.163:63290 #1420203 (400 connections now open) 2015-10-05T03:41:43.128+0100 [conn1420203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:43.174+0100 [conn1419579] end connection 172.28.0.164:52221 (399 connections now open) 2015-10-05T03:41:43.175+0100 [mongosMain] connection accepted from 172.28.0.164:56314 #1420204 (400 connections now open) 2015-10-05T03:41:43.176+0100 [conn1420204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:43.644+0100 [conn1419959] end connection 172.28.0.164:53860 (399 connections now open) 2015-10-05T03:41:43.647+0100 [mongosMain] connection accepted from 172.28.0.164:56316 #1420205 (400 connections now open) 2015-10-05T03:41:43.649+0100 [conn1420205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:46.216+0100 [conn1419950] end connection 172.28.0.163:60565 (399 connections now open) 2015-10-05T03:41:46.216+0100 [conn1419944] end connection 172.28.0.163:60553 (399 connections now open) 2015-10-05T03:41:46.217+0100 [mongosMain] connection accepted from 172.28.0.163:63295 #1420206 (399 connections now open) 2015-10-05T03:41:46.218+0100 [mongosMain] connection accepted from 172.28.0.163:63296 #1420207 (400 connections now open) 2015-10-05T03:41:46.218+0100 [conn1420206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:46.219+0100 [conn1420207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:46.727+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:41:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:41:47.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e36a5703b51053eabec7 2015-10-05T03:41:47.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:41:51.175+0100 [conn1419755] end connection 172.28.0.164:53455 (399 connections now open) 2015-10-05T03:41:51.176+0100 [mongosMain] connection accepted from 172.28.0.164:56326 #1420208 (400 connections now open) 2015-10-05T03:41:51.178+0100 [conn1420208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:51.643+0100 [conn1419804] end connection 172.28.0.164:53561 (399 connections now open) 2015-10-05T03:41:51.644+0100 [mongosMain] connection accepted from 172.28.0.164:56328 #1420209 (400 connections now open) 2015-10-05T03:41:51.645+0100 [conn1420209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:52.487+0100 [conn1419851] end connection 172.28.0.163:60320 (399 connections now open) 2015-10-05T03:41:52.488+0100 [mongosMain] connection accepted from 172.28.0.163:63305 #1420210 (400 connections now open) 2015-10-05T03:41:52.489+0100 [conn1420210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:53.142+0100 [conn1419900] end connection 172.28.0.163:60418 (399 connections now open) 2015-10-05T03:41:53.143+0100 [mongosMain] connection accepted from 172.28.0.163:63307 #1420211 (400 connections now open) 2015-10-05T03:41:53.144+0100 [conn1420211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:53.172+0100 [conn1419947] end connection 172.28.0.164:53712 (399 connections now open) 2015-10-05T03:41:53.173+0100 [mongosMain] connection accepted from 172.28.0.164:56331 #1420212 (400 connections now open) 2015-10-05T03:41:53.175+0100 [conn1420212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:53.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3715703b51053eabedc 2015-10-05T03:41:53.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:41:53.641+0100 [conn1419963] end connection 172.28.0.164:53927 (399 connections now open) 2015-10-05T03:41:53.643+0100 [mongosMain] connection accepted from 172.28.0.164:56334 #1420213 (400 connections now open) 2015-10-05T03:41:53.644+0100 [conn1420213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:56.224+0100 [conn1419641] end connection 172.28.0.163:59224 (399 connections now open) 2015-10-05T03:41:56.225+0100 [mongosMain] connection accepted from 172.28.0.163:63313 #1420214 (400 connections now open) 2015-10-05T03:41:56.227+0100 [conn1420214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:41:59.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3775703b51053eabeeb 2015-10-05T03:41:59.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:42:01.182+0100 [conn1419756] end connection 172.28.0.164:53458 (399 connections now open) 2015-10-05T03:42:01.182+0100 [mongosMain] connection accepted from 172.28.0.164:56345 #1420215 (400 connections now open) 2015-10-05T03:42:01.184+0100 [conn1420215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:01.651+0100 [conn1419805] end connection 172.28.0.164:53565 (399 connections now open) 2015-10-05T03:42:01.652+0100 [mongosMain] connection accepted from 172.28.0.164:56350 #1420216 (400 connections now open) 2015-10-05T03:42:01.653+0100 [conn1420216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:02.479+0100 [conn1419852] end connection 172.28.0.163:60322 (399 connections now open) 2015-10-05T03:42:02.480+0100 [mongosMain] connection accepted from 172.28.0.163:63327 #1420217 (400 connections now open) 2015-10-05T03:42:02.481+0100 [conn1420217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:03.134+0100 [conn1419901] end connection 172.28.0.163:60419 (399 connections now open) 2015-10-05T03:42:03.135+0100 [mongosMain] connection accepted from 172.28.0.163:63330 #1420218 (400 connections now open) 2015-10-05T03:42:03.136+0100 [conn1420218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:03.180+0100 [conn1419942] end connection 172.28.0.164:53696 (399 connections now open) 2015-10-05T03:42:03.181+0100 [mongosMain] connection accepted from 172.28.0.164:56360 #1420219 (400 connections now open) 2015-10-05T03:42:03.182+0100 [conn1420219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:03.648+0100 [conn1419948] end connection 172.28.0.164:53714 (399 connections now open) 2015-10-05T03:42:03.649+0100 [mongosMain] connection accepted from 172.28.0.164:56364 #1420220 (400 connections now open) 2015-10-05T03:42:03.651+0100 [conn1420220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:06.224+0100 [conn1419968] end connection 172.28.0.163:60810 (399 connections now open) 2015-10-05T03:42:06.224+0100 [conn1419699] end connection 172.28.0.163:59924 (398 connections now open) 2015-10-05T03:42:06.225+0100 [mongosMain] connection accepted from 172.28.0.163:63348 #1420221 (399 connections now open) 2015-10-05T03:42:06.226+0100 [mongosMain] connection accepted from 172.28.0.163:63349 #1420222 (400 connections now open) 2015-10-05T03:42:06.227+0100 [conn1420221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:06.227+0100 [conn1420222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:11.182+0100 [conn1419757] end connection 172.28.0.164:53462 (399 connections now open) 2015-10-05T03:42:11.183+0100 [mongosMain] connection accepted from 172.28.0.164:56393 #1420223 (400 connections now open) 2015-10-05T03:42:11.184+0100 [conn1420223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:11.651+0100 [conn1419806] end connection 172.28.0.164:53568 (399 connections now open) 2015-10-05T03:42:11.652+0100 [mongosMain] connection accepted from 172.28.0.164:56396 #1420224 (400 connections now open) 2015-10-05T03:42:11.653+0100 [conn1420224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:11.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3835703b51053eabf39 2015-10-05T03:42:11.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:42:12.494+0100 [conn1419853] end connection 172.28.0.163:60323 (399 connections now open) 2015-10-05T03:42:12.495+0100 [mongosMain] connection accepted from 172.28.0.163:63381 #1420225 (400 connections now open) 2015-10-05T03:42:12.496+0100 [conn1420225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:13.150+0100 [conn1419902] end connection 172.28.0.163:60421 (399 connections now open) 2015-10-05T03:42:13.151+0100 [mongosMain] connection accepted from 172.28.0.163:63386 #1420226 (400 connections now open) 2015-10-05T03:42:13.152+0100 [conn1420226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:13.180+0100 [conn1419962] end connection 172.28.0.164:53922 (399 connections now open) 2015-10-05T03:42:13.181+0100 [mongosMain] connection accepted from 172.28.0.164:56403 #1420227 (400 connections now open) 2015-10-05T03:42:13.182+0100 [conn1420227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:13.648+0100 [conn1419970] end connection 172.28.0.164:53960 (399 connections now open) 2015-10-05T03:42:13.649+0100 [mongosMain] connection accepted from 172.28.0.164:56407 #1420228 (400 connections now open) 2015-10-05T03:42:13.651+0100 [conn1420228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:16.238+0100 [conn1419972] end connection 172.28.0.163:60826 (399 connections now open) 2015-10-05T03:42:16.240+0100 [mongosMain] connection accepted from 172.28.0.163:63401 #1420229 (400 connections now open) 2015-10-05T03:42:16.241+0100 [conn1420229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:16.853+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:42:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:42:21.198+0100 [conn1419758] end connection 172.28.0.164:53465 (399 connections now open) 2015-10-05T03:42:21.199+0100 [mongosMain] connection accepted from 172.28.0.164:56446 #1420230 (400 connections now open) 2015-10-05T03:42:21.201+0100 [conn1420230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:21.666+0100 [conn1419807] end connection 172.28.0.164:53571 (399 connections now open) 2015-10-05T03:42:21.667+0100 [mongosMain] connection accepted from 172.28.0.164:56452 #1420231 (400 connections now open) 2015-10-05T03:42:21.669+0100 [conn1420231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:22.510+0100 [conn1419854] end connection 172.28.0.163:60325 (399 connections now open) 2015-10-05T03:42:22.511+0100 [mongosMain] connection accepted from 172.28.0.163:63436 #1420232 (400 connections now open) 2015-10-05T03:42:22.512+0100 [conn1420232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:23.150+0100 [conn1419903] end connection 172.28.0.163:60422 (399 connections now open) 2015-10-05T03:42:23.151+0100 [mongosMain] connection accepted from 172.28.0.163:63440 #1420233 (400 connections now open) 2015-10-05T03:42:23.152+0100 [conn1420233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:23.195+0100 [conn1419956] end connection 172.28.0.164:53796 (399 connections now open) 2015-10-05T03:42:23.197+0100 [mongosMain] connection accepted from 172.28.0.164:56463 #1420234 (400 connections now open) 2015-10-05T03:42:23.199+0100 [conn1420234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:23.663+0100 [conn1419974] end connection 172.28.0.164:53982 (399 connections now open) 2015-10-05T03:42:23.664+0100 [mongosMain] connection accepted from 172.28.0.164:56466 #1420235 (400 connections now open) 2015-10-05T03:42:23.666+0100 [conn1420235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:23.975+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e38f5703b51053eabf69 2015-10-05T03:42:24.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:42:26.254+0100 [conn1419949] end connection 172.28.0.163:60564 (399 connections now open) 2015-10-05T03:42:26.254+0100 [conn1419682] end connection 172.28.0.163:59712 (399 connections now open) 2015-10-05T03:42:26.255+0100 [mongosMain] connection accepted from 172.28.0.163:63454 #1420236 (399 connections now open) 2015-10-05T03:42:26.255+0100 [mongosMain] connection accepted from 172.28.0.163:63455 #1420237 (400 connections now open) 2015-10-05T03:42:26.256+0100 [conn1420236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:26.256+0100 [conn1420237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:28.766+0100 [mongosMain] connection accepted from 127.0.0.1:63478 #1420238 (401 connections now open) 2015-10-05T03:42:28.768+0100 [conn1420238] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:28.773+0100 [conn1420238] end connection 127.0.0.1:63478 (400 connections now open) 2015-10-05T03:42:30.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3965703b51053eabf7e 2015-10-05T03:42:30.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:42:31.213+0100 [conn1419759] end connection 172.28.0.164:53469 (399 connections now open) 2015-10-05T03:42:31.214+0100 [mongosMain] connection accepted from 172.28.0.164:56519 #1420239 (400 connections now open) 2015-10-05T03:42:31.216+0100 [conn1420239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:31.682+0100 [conn1419808] end connection 172.28.0.164:53575 (399 connections now open) 2015-10-05T03:42:31.683+0100 [mongosMain] connection accepted from 172.28.0.164:56525 #1420240 (400 connections now open) 2015-10-05T03:42:31.685+0100 [conn1420240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:32.511+0100 [conn1419855] end connection 172.28.0.163:60326 (399 connections now open) 2015-10-05T03:42:32.512+0100 [mongosMain] connection accepted from 172.28.0.163:63499 #1420241 (400 connections now open) 2015-10-05T03:42:32.513+0100 [conn1420241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:33.165+0100 [conn1419904] end connection 172.28.0.163:60424 (399 connections now open) 2015-10-05T03:42:33.167+0100 [mongosMain] connection accepted from 172.28.0.163:63504 #1420242 (400 connections now open) 2015-10-05T03:42:33.168+0100 [conn1420242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:33.196+0100 [conn1419965] end connection 172.28.0.164:53944 (399 connections now open) 2015-10-05T03:42:33.197+0100 [mongosMain] connection accepted from 172.28.0.164:56538 #1420243 (400 connections now open) 2015-10-05T03:42:33.199+0100 [conn1420243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:36.269+0100 [conn1419983] end connection 172.28.0.163:60990 (399 connections now open) 2015-10-05T03:42:36.269+0100 [conn1419967] end connection 172.28.0.163:60809 (399 connections now open) 2015-10-05T03:42:36.270+0100 [mongosMain] connection accepted from 172.28.0.163:63522 #1420244 (399 connections now open) 2015-10-05T03:42:36.271+0100 [mongosMain] connection accepted from 172.28.0.163:63523 #1420245 (400 connections now open) 2015-10-05T03:42:36.271+0100 [conn1420244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:36.272+0100 [conn1420245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:39.382+0100 [mongosMain] connection accepted from 127.0.0.1:63532 #1420246 (401 connections now open) 2015-10-05T03:42:39.384+0100 [conn1420246] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:39.389+0100 [conn1420246] end connection 127.0.0.1:63532 (400 connections now open) 2015-10-05T03:42:41.230+0100 [conn1419760] end connection 172.28.0.164:53473 (399 connections now open) 2015-10-05T03:42:41.230+0100 [mongosMain] connection accepted from 172.28.0.164:56581 #1420247 (400 connections now open) 2015-10-05T03:42:41.230+0100 [conn1420247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:41.698+0100 [conn1419809] end connection 172.28.0.164:53579 (399 connections now open) 2015-10-05T03:42:41.714+0100 [mongosMain] connection accepted from 172.28.0.164:56584 #1420248 (400 connections now open) 2015-10-05T03:42:41.714+0100 [conn1420248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:42.556+0100 [conn1419856] end connection 172.28.0.163:60327 (399 connections now open) 2015-10-05T03:42:42.556+0100 [mongosMain] connection accepted from 172.28.0.163:63536 #1420249 (400 connections now open) 2015-10-05T03:42:42.556+0100 [conn1420249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:43.212+0100 [conn1419905] end connection 172.28.0.163:60425 (399 connections now open) 2015-10-05T03:42:43.212+0100 [mongosMain] connection accepted from 172.28.0.163:63539 #1420250 (400 connections now open) 2015-10-05T03:42:43.212+0100 [conn1420250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:43.227+0100 [conn1419969] end connection 172.28.0.164:53958 (399 connections now open) 2015-10-05T03:42:43.227+0100 [mongosMain] connection accepted from 172.28.0.164:56587 #1420251 (400 connections now open) 2015-10-05T03:42:43.243+0100 [conn1420251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:43.695+0100 [conn1419982] end connection 172.28.0.164:54101 (399 connections now open) 2015-10-05T03:42:43.695+0100 [mongosMain] connection accepted from 172.28.0.164:56589 #1420252 (400 connections now open) 2015-10-05T03:42:43.711+0100 [conn1420252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:46.270+0100 [conn1419975] end connection 172.28.0.163:60855 (399 connections now open) 2015-10-05T03:42:46.270+0100 [conn1419979] end connection 172.28.0.163:60920 (399 connections now open) 2015-10-05T03:42:46.271+0100 [mongosMain] connection accepted from 172.28.0.163:63546 #1420253 (399 connections now open) 2015-10-05T03:42:46.272+0100 [mongosMain] connection accepted from 172.28.0.163:63547 #1420254 (400 connections now open) 2015-10-05T03:42:46.273+0100 [conn1420253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:46.273+0100 [conn1420254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:46.988+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:42:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:42:48.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3a85703b51053eabfbb 2015-10-05T03:42:48.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:42:51.214+0100 [conn1419761] end connection 172.28.0.164:53476 (399 connections now open) 2015-10-05T03:42:51.215+0100 [mongosMain] connection accepted from 172.28.0.164:56599 #1420255 (400 connections now open) 2015-10-05T03:42:51.217+0100 [conn1420255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:51.682+0100 [conn1419810] end connection 172.28.0.164:53583 (399 connections now open) 2015-10-05T03:42:51.683+0100 [mongosMain] connection accepted from 172.28.0.164:56601 #1420256 (400 connections now open) 2015-10-05T03:42:51.684+0100 [conn1420256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:52.533+0100 [conn1419857] end connection 172.28.0.163:60329 (399 connections now open) 2015-10-05T03:42:52.534+0100 [mongosMain] connection accepted from 172.28.0.163:63557 #1420257 (400 connections now open) 2015-10-05T03:42:52.535+0100 [conn1420257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:53.188+0100 [conn1419906] end connection 172.28.0.163:60427 (399 connections now open) 2015-10-05T03:42:53.189+0100 [mongosMain] connection accepted from 172.28.0.163:63559 #1420258 (400 connections now open) 2015-10-05T03:42:53.190+0100 [conn1420258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:53.210+0100 [conn1419958] end connection 172.28.0.164:53856 (399 connections now open) 2015-10-05T03:42:53.211+0100 [mongosMain] connection accepted from 172.28.0.164:56604 #1420259 (400 connections now open) 2015-10-05T03:42:53.213+0100 [conn1420259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:53.694+0100 [conn1419966] end connection 172.28.0.164:53949 (399 connections now open) 2015-10-05T03:42:53.695+0100 [mongosMain] connection accepted from 172.28.0.164:56606 #1420260 (400 connections now open) 2015-10-05T03:42:53.697+0100 [conn1420260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:56.277+0100 [conn1419976] end connection 172.28.0.163:60856 (399 connections now open) 2015-10-05T03:42:56.277+0100 [conn1419980] end connection 172.28.0.163:60921 (398 connections now open) 2015-10-05T03:42:56.278+0100 [mongosMain] connection accepted from 172.28.0.163:63564 #1420261 (399 connections now open) 2015-10-05T03:42:56.279+0100 [mongosMain] connection accepted from 172.28.0.163:63565 #1420262 (400 connections now open) 2015-10-05T03:42:56.280+0100 [conn1420261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:42:56.280+0100 [conn1420262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:01.230+0100 [conn1419762] end connection 172.28.0.164:53479 (399 connections now open) 2015-10-05T03:43:01.231+0100 [mongosMain] connection accepted from 172.28.0.164:56612 #1420263 (400 connections now open) 2015-10-05T03:43:01.233+0100 [conn1420263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:01.697+0100 [conn1419811] end connection 172.28.0.164:53586 (399 connections now open) 2015-10-05T03:43:01.699+0100 [mongosMain] connection accepted from 172.28.0.164:56616 #1420264 (400 connections now open) 2015-10-05T03:43:01.700+0100 [conn1420264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:02.541+0100 [conn1419858] end connection 172.28.0.163:60330 (399 connections now open) 2015-10-05T03:43:02.542+0100 [mongosMain] connection accepted from 172.28.0.163:63588 #1420265 (400 connections now open) 2015-10-05T03:43:02.545+0100 [conn1420265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:03.181+0100 [conn1419907] end connection 172.28.0.163:60428 (399 connections now open) 2015-10-05T03:43:03.182+0100 [mongosMain] connection accepted from 172.28.0.163:63590 #1420266 (400 connections now open) 2015-10-05T03:43:03.184+0100 [conn1420266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:03.226+0100 [conn1419973] end connection 172.28.0.164:53977 (399 connections now open) 2015-10-05T03:43:03.228+0100 [mongosMain] connection accepted from 172.28.0.164:56622 #1420267 (400 connections now open) 2015-10-05T03:43:03.229+0100 [conn1420267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:03.694+0100 [conn1419978] end connection 172.28.0.164:54042 (399 connections now open) 2015-10-05T03:43:03.695+0100 [mongosMain] connection accepted from 172.28.0.164:56625 #1420268 (400 connections now open) 2015-10-05T03:43:03.697+0100 [conn1420268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:06.286+0100 [conn1419988] end connection 172.28.0.163:61048 (399 connections now open) 2015-10-05T03:43:06.286+0100 [conn1419971] end connection 172.28.0.163:60825 (399 connections now open) 2015-10-05T03:43:06.287+0100 [mongosMain] connection accepted from 172.28.0.163:63608 #1420269 (399 connections now open) 2015-10-05T03:43:06.288+0100 [mongosMain] connection accepted from 172.28.0.163:63609 #1420270 (400 connections now open) 2015-10-05T03:43:06.289+0100 [conn1420269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:06.289+0100 [conn1420270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:06.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3ba5703b51053eac020 2015-10-05T03:43:07.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:43:11.245+0100 [conn1419763] end connection 172.28.0.164:53483 (399 connections now open) 2015-10-05T03:43:11.247+0100 [mongosMain] connection accepted from 172.28.0.164:56657 #1420271 (400 connections now open) 2015-10-05T03:43:11.248+0100 [conn1420271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:11.713+0100 [conn1419812] end connection 172.28.0.164:53592 (399 connections now open) 2015-10-05T03:43:11.714+0100 [mongosMain] connection accepted from 172.28.0.164:56661 #1420272 (400 connections now open) 2015-10-05T03:43:11.715+0100 [conn1420272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:12.541+0100 [conn1419859] end connection 172.28.0.163:60332 (399 connections now open) 2015-10-05T03:43:12.542+0100 [mongosMain] connection accepted from 172.28.0.163:63636 #1420273 (400 connections now open) 2015-10-05T03:43:12.543+0100 [conn1420273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:13.196+0100 [conn1419908] end connection 172.28.0.163:60430 (399 connections now open) 2015-10-05T03:43:13.197+0100 [mongosMain] connection accepted from 172.28.0.163:63639 #1420274 (400 connections now open) 2015-10-05T03:43:13.198+0100 [conn1420274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:13.242+0100 [conn1419986] end connection 172.28.0.164:54164 (399 connections now open) 2015-10-05T03:43:13.243+0100 [mongosMain] connection accepted from 172.28.0.164:56667 #1420275 (400 connections now open) 2015-10-05T03:43:13.245+0100 [conn1420275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:13.710+0100 [conn1419992] end connection 172.28.0.164:54191 (399 connections now open) 2015-10-05T03:43:13.711+0100 [mongosMain] connection accepted from 172.28.0.164:56670 #1420276 (400 connections now open) 2015-10-05T03:43:13.713+0100 [conn1420276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:16.290+0100 [conn1419997] end connection 172.28.0.163:61074 (399 connections now open) 2015-10-05T03:43:16.290+0100 [conn1419953] end connection 172.28.0.163:60576 (399 connections now open) 2015-10-05T03:43:16.291+0100 [mongosMain] connection accepted from 172.28.0.163:63654 #1420277 (399 connections now open) 2015-10-05T03:43:16.291+0100 [mongosMain] connection accepted from 172.28.0.163:63655 #1420278 (400 connections now open) 2015-10-05T03:43:16.292+0100 [conn1420277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:16.292+0100 [conn1420278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:17.125+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:43:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:43:19.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3c75703b51053eac047 2015-10-05T03:43:19.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:43:21.245+0100 [conn1419764] end connection 172.28.0.164:53486 (399 connections now open) 2015-10-05T03:43:21.246+0100 [mongosMain] connection accepted from 172.28.0.164:56703 #1420279 (400 connections now open) 2015-10-05T03:43:21.248+0100 [conn1420279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:21.714+0100 [conn1419813] end connection 172.28.0.164:53596 (399 connections now open) 2015-10-05T03:43:21.715+0100 [mongosMain] connection accepted from 172.28.0.164:56705 #1420280 (400 connections now open) 2015-10-05T03:43:21.716+0100 [conn1420280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:22.557+0100 [conn1419860] end connection 172.28.0.163:60333 (399 connections now open) 2015-10-05T03:43:22.558+0100 [mongosMain] connection accepted from 172.28.0.163:63682 #1420281 (400 connections now open) 2015-10-05T03:43:22.559+0100 [conn1420281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:23.212+0100 [conn1419909] end connection 172.28.0.163:60431 (399 connections now open) 2015-10-05T03:43:23.213+0100 [mongosMain] connection accepted from 172.28.0.163:63687 #1420282 (400 connections now open) 2015-10-05T03:43:23.214+0100 [conn1420282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:23.710+0100 [conn1419987] end connection 172.28.0.164:54169 (399 connections now open) 2015-10-05T03:43:23.711+0100 [mongosMain] connection accepted from 172.28.0.164:56723 #1420283 (400 connections now open) 2015-10-05T03:43:23.713+0100 [conn1420283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:26.301+0100 [conn1419984] end connection 172.28.0.163:60991 (399 connections now open) 2015-10-05T03:43:26.301+0100 [conn1419999] end connection 172.28.0.163:61108 (398 connections now open) 2015-10-05T03:43:26.302+0100 [mongosMain] connection accepted from 172.28.0.163:63704 #1420284 (399 connections now open) 2015-10-05T03:43:26.302+0100 [mongosMain] connection accepted from 172.28.0.163:63705 #1420285 (400 connections now open) 2015-10-05T03:43:26.306+0100 [conn1420285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:26.306+0100 [conn1420284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:28.631+0100 [mongosMain] connection accepted from 127.0.0.1:63718 #1420286 (401 connections now open) 2015-10-05T03:43:28.633+0100 [conn1420286] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:28.638+0100 [conn1420286] end connection 127.0.0.1:63718 (400 connections now open) 2015-10-05T03:43:31.260+0100 [conn1419765] end connection 172.28.0.164:53490 (399 connections now open) 2015-10-05T03:43:31.261+0100 [mongosMain] connection accepted from 172.28.0.164:56769 #1420287 (400 connections now open) 2015-10-05T03:43:31.263+0100 [conn1420287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:31.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3d35703b51053eac063 2015-10-05T03:43:31.729+0100 [conn1419814] end connection 172.28.0.164:53600 (399 connections now open) 2015-10-05T03:43:31.730+0100 [mongosMain] connection accepted from 172.28.0.164:56773 #1420288 (400 connections now open) 2015-10-05T03:43:31.732+0100 [conn1420288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:31.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:43:32.558+0100 [conn1419861] end connection 172.28.0.163:60335 (399 connections now open) 2015-10-05T03:43:32.560+0100 [mongosMain] connection accepted from 172.28.0.163:63736 #1420289 (400 connections now open) 2015-10-05T03:43:32.560+0100 [conn1420289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:33.213+0100 [conn1419910] end connection 172.28.0.163:60433 (399 connections now open) 2015-10-05T03:43:33.215+0100 [mongosMain] connection accepted from 172.28.0.163:63741 #1420290 (400 connections now open) 2015-10-05T03:43:33.216+0100 [conn1420290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:33.258+0100 [conn1419951] end connection 172.28.0.164:53723 (399 connections now open) 2015-10-05T03:43:33.259+0100 [mongosMain] connection accepted from 172.28.0.164:56782 #1420291 (400 connections now open) 2015-10-05T03:43:33.260+0100 [conn1420291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:33.725+0100 [conn1420001] end connection 172.28.0.164:54258 (399 connections now open) 2015-10-05T03:43:33.727+0100 [mongosMain] connection accepted from 172.28.0.164:56787 #1420292 (400 connections now open) 2015-10-05T03:43:33.729+0100 [conn1420292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:36.302+0100 [conn1419996] end connection 172.28.0.163:61073 (399 connections now open) 2015-10-05T03:43:36.302+0100 [conn1420007] end connection 172.28.0.163:61197 (399 connections now open) 2015-10-05T03:43:36.303+0100 [mongosMain] connection accepted from 172.28.0.163:63757 #1420293 (399 connections now open) 2015-10-05T03:43:36.303+0100 [mongosMain] connection accepted from 172.28.0.163:63758 #1420294 (400 connections now open) 2015-10-05T03:43:36.304+0100 [conn1420293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:36.304+0100 [conn1420294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:39.214+0100 [mongosMain] connection accepted from 127.0.0.1:63787 #1420295 (401 connections now open) 2015-10-05T03:43:39.217+0100 [conn1420295] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:39.222+0100 [conn1420295] end connection 127.0.0.1:63787 (400 connections now open) 2015-10-05T03:43:41.277+0100 [conn1419766] end connection 172.28.0.164:53493 (399 connections now open) 2015-10-05T03:43:41.278+0100 [mongosMain] connection accepted from 172.28.0.164:56834 #1420296 (400 connections now open) 2015-10-05T03:43:41.280+0100 [conn1420296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:41.745+0100 [conn1419815] end connection 172.28.0.164:53602 (399 connections now open) 2015-10-05T03:43:41.746+0100 [mongosMain] connection accepted from 172.28.0.164:56837 #1420297 (400 connections now open) 2015-10-05T03:43:41.747+0100 [conn1420297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:42.572+0100 [conn1419862] end connection 172.28.0.163:60336 (399 connections now open) 2015-10-05T03:43:42.573+0100 [mongosMain] connection accepted from 172.28.0.163:63803 #1420298 (400 connections now open) 2015-10-05T03:43:42.574+0100 [conn1420298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:43.228+0100 [conn1419911] end connection 172.28.0.163:60435 (399 connections now open) 2015-10-05T03:43:43.229+0100 [mongosMain] connection accepted from 172.28.0.163:63806 #1420299 (400 connections now open) 2015-10-05T03:43:43.230+0100 [conn1420299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:43.273+0100 [conn1419981] end connection 172.28.0.164:54099 (399 connections now open) 2015-10-05T03:43:43.275+0100 [mongosMain] connection accepted from 172.28.0.164:56840 #1420300 (400 connections now open) 2015-10-05T03:43:43.276+0100 [conn1420300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:43.741+0100 [conn1420005] end connection 172.28.0.164:54309 (399 connections now open) 2015-10-05T03:43:43.742+0100 [mongosMain] connection accepted from 172.28.0.164:56843 #1420301 (400 connections now open) 2015-10-05T03:43:43.744+0100 [conn1420301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:44.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3df5703b51053eac09e 2015-10-05T03:43:44.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:43:46.318+0100 [conn1419998] end connection 172.28.0.163:61107 (399 connections now open) 2015-10-05T03:43:46.318+0100 [conn1419994] end connection 172.28.0.163:61062 (399 connections now open) 2015-10-05T03:43:46.319+0100 [mongosMain] connection accepted from 172.28.0.163:63812 #1420302 (399 connections now open) 2015-10-05T03:43:46.320+0100 [mongosMain] connection accepted from 172.28.0.163:63813 #1420303 (400 connections now open) 2015-10-05T03:43:46.320+0100 [conn1420302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:46.321+0100 [conn1420303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:47.393+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:43:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:43:51.277+0100 [conn1419767] end connection 172.28.0.164:53496 (399 connections now open) 2015-10-05T03:43:51.278+0100 [mongosMain] connection accepted from 172.28.0.164:56854 #1420304 (400 connections now open) 2015-10-05T03:43:51.279+0100 [conn1420304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:51.745+0100 [conn1419816] end connection 172.28.0.164:53603 (399 connections now open) 2015-10-05T03:43:51.746+0100 [mongosMain] connection accepted from 172.28.0.164:56856 #1420305 (400 connections now open) 2015-10-05T03:43:51.747+0100 [conn1420305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:52.588+0100 [conn1419863] end connection 172.28.0.163:60339 (399 connections now open) 2015-10-05T03:43:52.589+0100 [mongosMain] connection accepted from 172.28.0.163:63822 #1420306 (400 connections now open) 2015-10-05T03:43:52.590+0100 [conn1420306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:53.228+0100 [conn1419912] end connection 172.28.0.163:60436 (399 connections now open) 2015-10-05T03:43:53.229+0100 [mongosMain] connection accepted from 172.28.0.163:63825 #1420307 (400 connections now open) 2015-10-05T03:43:53.230+0100 [conn1420307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:53.274+0100 [conn1420009] end connection 172.28.0.164:54365 (399 connections now open) 2015-10-05T03:43:53.275+0100 [mongosMain] connection accepted from 172.28.0.164:56858 #1420308 (400 connections now open) 2015-10-05T03:43:53.276+0100 [conn1420308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:53.757+0100 [conn1420010] end connection 172.28.0.164:54371 (399 connections now open) 2015-10-05T03:43:53.761+0100 [mongosMain] connection accepted from 172.28.0.164:56859 #1420309 (400 connections now open) 2015-10-05T03:43:53.762+0100 [conn1420309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:56.333+0100 [conn1420002] end connection 172.28.0.163:61149 (399 connections now open) 2015-10-05T03:43:56.333+0100 [conn1419993] end connection 172.28.0.163:61061 (399 connections now open) 2015-10-05T03:43:56.335+0100 [mongosMain] connection accepted from 172.28.0.163:63830 #1420310 (399 connections now open) 2015-10-05T03:43:56.336+0100 [mongosMain] connection accepted from 172.28.0.163:63831 #1420311 (400 connections now open) 2015-10-05T03:43:56.336+0100 [conn1420310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:56.337+0100 [conn1420311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:43:56.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3ec5703b51053eac0c3 2015-10-05T03:43:56.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:01.294+0100 [conn1419768] end connection 172.28.0.164:53500 (399 connections now open) 2015-10-05T03:44:01.295+0100 [mongosMain] connection accepted from 172.28.0.164:56866 #1420312 (400 connections now open) 2015-10-05T03:44:01.297+0100 [conn1420312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:01.760+0100 [conn1419817] end connection 172.28.0.164:53604 (399 connections now open) 2015-10-05T03:44:01.761+0100 [mongosMain] connection accepted from 172.28.0.164:56870 #1420313 (400 connections now open) 2015-10-05T03:44:01.763+0100 [conn1420313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:02.589+0100 [conn1419864] end connection 172.28.0.163:60340 (399 connections now open) 2015-10-05T03:44:02.590+0100 [mongosMain] connection accepted from 172.28.0.163:63844 #1420314 (400 connections now open) 2015-10-05T03:44:02.591+0100 [conn1420314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:03.243+0100 [conn1419913] end connection 172.28.0.163:60438 (399 connections now open) 2015-10-05T03:44:03.244+0100 [mongosMain] connection accepted from 172.28.0.163:63851 #1420315 (400 connections now open) 2015-10-05T03:44:03.246+0100 [conn1420315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:03.289+0100 [conn1419991] end connection 172.28.0.164:54188 (399 connections now open) 2015-10-05T03:44:03.290+0100 [mongosMain] connection accepted from 172.28.0.164:56878 #1420316 (400 connections now open) 2015-10-05T03:44:03.292+0100 [conn1420316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:03.773+0100 [conn1419995] end connection 172.28.0.164:54204 (399 connections now open) 2015-10-05T03:44:03.774+0100 [mongosMain] connection accepted from 172.28.0.164:56889 #1420317 (400 connections now open) 2015-10-05T03:44:03.776+0100 [conn1420317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:06.333+0100 [conn1420012] end connection 172.28.0.163:61261 (399 connections now open) 2015-10-05T03:44:06.333+0100 [conn1420011] end connection 172.28.0.163:61260 (398 connections now open) 2015-10-05T03:44:06.334+0100 [mongosMain] connection accepted from 172.28.0.163:63876 #1420318 (399 connections now open) 2015-10-05T03:44:06.335+0100 [mongosMain] connection accepted from 172.28.0.163:63877 #1420319 (400 connections now open) 2015-10-05T03:44:06.335+0100 [conn1420318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:06.335+0100 [conn1420319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:08.847+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3f85703b51053eac0fb 2015-10-05T03:44:08.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:11.293+0100 [conn1419769] end connection 172.28.0.164:53503 (399 connections now open) 2015-10-05T03:44:11.294+0100 [mongosMain] connection accepted from 172.28.0.164:56933 #1420320 (400 connections now open) 2015-10-05T03:44:11.295+0100 [conn1420320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:11.760+0100 [conn1419818] end connection 172.28.0.164:53605 (399 connections now open) 2015-10-05T03:44:11.761+0100 [mongosMain] connection accepted from 172.28.0.164:56939 #1420321 (400 connections now open) 2015-10-05T03:44:11.764+0100 [conn1420321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:12.604+0100 [conn1419865] end connection 172.28.0.163:60342 (399 connections now open) 2015-10-05T03:44:12.605+0100 [mongosMain] connection accepted from 172.28.0.163:63919 #1420322 (400 connections now open) 2015-10-05T03:44:12.606+0100 [conn1420322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:13.244+0100 [conn1419914] end connection 172.28.0.163:60439 (399 connections now open) 2015-10-05T03:44:13.245+0100 [mongosMain] connection accepted from 172.28.0.163:63928 #1420323 (400 connections now open) 2015-10-05T03:44:13.246+0100 [conn1420323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:13.774+0100 [conn1420023] end connection 172.28.0.164:54462 (399 connections now open) 2015-10-05T03:44:13.775+0100 [mongosMain] connection accepted from 172.28.0.164:56948 #1420324 (400 connections now open) 2015-10-05T03:44:13.777+0100 [conn1420324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:15.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e3fe5703b51053eac10d 2015-10-05T03:44:15.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:16.360+0100 [conn1420017] end connection 172.28.0.163:61315 (399 connections now open) 2015-10-05T03:44:16.361+0100 [conn1420003] end connection 172.28.0.163:61150 (399 connections now open) 2015-10-05T03:44:16.361+0100 [mongosMain] connection accepted from 172.28.0.163:63940 #1420325 (399 connections now open) 2015-10-05T03:44:16.362+0100 [mongosMain] connection accepted from 172.28.0.163:63942 #1420326 (400 connections now open) 2015-10-05T03:44:16.363+0100 [conn1420325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:16.363+0100 [conn1420326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:17.672+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:44:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:44:21.308+0100 [conn1419770] end connection 172.28.0.164:53504 (399 connections now open) 2015-10-05T03:44:21.310+0100 [mongosMain] connection accepted from 172.28.0.164:56995 #1420327 (400 connections now open) 2015-10-05T03:44:21.312+0100 [conn1420327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:21.783+0100 [conn1419819] end connection 172.28.0.164:53606 (399 connections now open) 2015-10-05T03:44:21.784+0100 [mongosMain] connection accepted from 172.28.0.164:57002 #1420328 (400 connections now open) 2015-10-05T03:44:21.786+0100 [conn1420328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:22.608+0100 [conn1419866] end connection 172.28.0.163:60343 (399 connections now open) 2015-10-05T03:44:22.610+0100 [mongosMain] connection accepted from 172.28.0.163:63975 #1420329 (400 connections now open) 2015-10-05T03:44:22.611+0100 [conn1420329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:23.259+0100 [conn1419915] end connection 172.28.0.163:60442 (399 connections now open) 2015-10-05T03:44:23.260+0100 [mongosMain] connection accepted from 172.28.0.163:63980 #1420330 (400 connections now open) 2015-10-05T03:44:23.261+0100 [conn1420330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:23.305+0100 [conn1420014] end connection 172.28.0.164:54430 (399 connections now open) 2015-10-05T03:44:23.307+0100 [mongosMain] connection accepted from 172.28.0.164:57012 #1420331 (400 connections now open) 2015-10-05T03:44:23.308+0100 [conn1420331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:23.788+0100 [conn1420015] end connection 172.28.0.164:54432 (399 connections now open) 2015-10-05T03:44:23.790+0100 [mongosMain] connection accepted from 172.28.0.164:57016 #1420332 (400 connections now open) 2015-10-05T03:44:23.791+0100 [conn1420332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:26.351+0100 [conn1420016] end connection 172.28.0.163:61312 (399 connections now open) 2015-10-05T03:44:26.351+0100 [conn1420029] end connection 172.28.0.163:61421 (398 connections now open) 2015-10-05T03:44:26.352+0100 [mongosMain] connection accepted from 172.28.0.163:63996 #1420333 (399 connections now open) 2015-10-05T03:44:26.353+0100 [mongosMain] connection accepted from 172.28.0.163:63997 #1420334 (400 connections now open) 2015-10-05T03:44:26.353+0100 [conn1420333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:26.354+0100 [conn1420334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:28.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e40b5703b51053eac12c 2015-10-05T03:44:28.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:28.975+0100 [mongosMain] connection accepted from 127.0.0.1:64013 #1420335 (401 connections now open) 2015-10-05T03:44:28.978+0100 [conn1420335] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:28.983+0100 [conn1420335] end connection 127.0.0.1:64013 (400 connections now open) 2015-10-05T03:44:31.324+0100 [conn1419771] end connection 172.28.0.164:53505 (399 connections now open) 2015-10-05T03:44:31.325+0100 [mongosMain] connection accepted from 172.28.0.164:57057 #1420336 (400 connections now open) 2015-10-05T03:44:31.326+0100 [conn1420336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:31.776+0100 [conn1419820] end connection 172.28.0.164:53607 (399 connections now open) 2015-10-05T03:44:31.777+0100 [mongosMain] connection accepted from 172.28.0.164:57061 #1420337 (400 connections now open) 2015-10-05T03:44:31.779+0100 [conn1420337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:32.621+0100 [conn1419867] end connection 172.28.0.163:60345 (399 connections now open) 2015-10-05T03:44:32.622+0100 [mongosMain] connection accepted from 172.28.0.163:64035 #1420338 (400 connections now open) 2015-10-05T03:44:32.623+0100 [conn1420338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:33.275+0100 [conn1419916] end connection 172.28.0.163:60443 (399 connections now open) 2015-10-05T03:44:33.277+0100 [mongosMain] connection accepted from 172.28.0.163:64042 #1420339 (400 connections now open) 2015-10-05T03:44:33.278+0100 [conn1420339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:33.306+0100 [conn1420000] end connection 172.28.0.164:54257 (399 connections now open) 2015-10-05T03:44:33.307+0100 [mongosMain] connection accepted from 172.28.0.164:57075 #1420340 (400 connections now open) 2015-10-05T03:44:33.308+0100 [conn1420340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:33.805+0100 [conn1420027] end connection 172.28.0.164:54516 (399 connections now open) 2015-10-05T03:44:33.806+0100 [mongosMain] connection accepted from 172.28.0.164:57079 #1420341 (400 connections now open) 2015-10-05T03:44:33.808+0100 [conn1420341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:36.365+0100 [conn1420020] end connection 172.28.0.163:61325 (399 connections now open) 2015-10-05T03:44:36.365+0100 [conn1420032] end connection 172.28.0.163:61470 (398 connections now open) 2015-10-05T03:44:36.366+0100 [mongosMain] connection accepted from 172.28.0.163:64057 #1420342 (399 connections now open) 2015-10-05T03:44:36.366+0100 [mongosMain] connection accepted from 172.28.0.163:64058 #1420343 (400 connections now open) 2015-10-05T03:44:36.367+0100 [conn1420342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:36.368+0100 [conn1420343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:39.931+0100 [mongosMain] connection accepted from 127.0.0.1:64061 #1420344 (401 connections now open) 2015-10-05T03:44:39.934+0100 [conn1420344] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:39.938+0100 [conn1420344] end connection 127.0.0.1:64061 (400 connections now open) 2015-10-05T03:44:40.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4185703b51053eac14c 2015-10-05T03:44:40.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:41.339+0100 [conn1419772] end connection 172.28.0.164:53506 (399 connections now open) 2015-10-05T03:44:41.340+0100 [mongosMain] connection accepted from 172.28.0.164:57098 #1420345 (400 connections now open) 2015-10-05T03:44:41.342+0100 [conn1420345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:41.792+0100 [conn1419821] end connection 172.28.0.164:53608 (399 connections now open) 2015-10-05T03:44:41.793+0100 [mongosMain] connection accepted from 172.28.0.164:57100 #1420346 (400 connections now open) 2015-10-05T03:44:41.794+0100 [conn1420346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:42.620+0100 [conn1419868] end connection 172.28.0.163:60347 (399 connections now open) 2015-10-05T03:44:42.621+0100 [mongosMain] connection accepted from 172.28.0.163:64066 #1420347 (400 connections now open) 2015-10-05T03:44:42.626+0100 [conn1420347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:43.275+0100 [conn1419917] end connection 172.28.0.163:60445 (399 connections now open) 2015-10-05T03:44:43.277+0100 [mongosMain] connection accepted from 172.28.0.163:64068 #1420348 (400 connections now open) 2015-10-05T03:44:43.277+0100 [conn1420348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:43.321+0100 [conn1420026] end connection 172.28.0.164:54513 (399 connections now open) 2015-10-05T03:44:43.322+0100 [mongosMain] connection accepted from 172.28.0.164:57102 #1420349 (400 connections now open) 2015-10-05T03:44:43.323+0100 [conn1420349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:43.820+0100 [conn1420031] end connection 172.28.0.164:54566 (399 connections now open) 2015-10-05T03:44:43.821+0100 [mongosMain] connection accepted from 172.28.0.164:57105 #1420350 (400 connections now open) 2015-10-05T03:44:43.823+0100 [conn1420350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:46.366+0100 [conn1420021] end connection 172.28.0.163:61326 (399 connections now open) 2015-10-05T03:44:46.367+0100 [mongosMain] connection accepted from 172.28.0.163:64073 #1420351 (400 connections now open) 2015-10-05T03:44:46.368+0100 [conn1420351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:46.520+0100 [conn1420006] end connection 172.28.0.163:61196 (399 connections now open) 2015-10-05T03:44:46.521+0100 [mongosMain] connection accepted from 172.28.0.163:64075 #1420352 (400 connections now open) 2015-10-05T03:44:46.521+0100 [conn1420352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:46.619+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:44:46.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:44:47.813+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:44:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:44:51.355+0100 [conn1419773] end connection 172.28.0.164:53507 (399 connections now open) 2015-10-05T03:44:51.356+0100 [mongosMain] connection accepted from 172.28.0.164:57117 #1420353 (400 connections now open) 2015-10-05T03:44:51.358+0100 [conn1420353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:51.808+0100 [conn1419822] end connection 172.28.0.164:53609 (399 connections now open) 2015-10-05T03:44:51.809+0100 [mongosMain] connection accepted from 172.28.0.164:57119 #1420354 (400 connections now open) 2015-10-05T03:44:51.810+0100 [conn1420354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:52.636+0100 [conn1419869] end connection 172.28.0.163:60348 (399 connections now open) 2015-10-05T03:44:52.637+0100 [mongosMain] connection accepted from 172.28.0.163:64083 #1420355 (400 connections now open) 2015-10-05T03:44:52.639+0100 [conn1420355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:52.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4245703b51053eac181 2015-10-05T03:44:53.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:44:53.291+0100 [conn1419918] end connection 172.28.0.163:60447 (399 connections now open) 2015-10-05T03:44:53.292+0100 [mongosMain] connection accepted from 172.28.0.163:64085 #1420356 (400 connections now open) 2015-10-05T03:44:53.293+0100 [conn1420356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:53.321+0100 [conn1420030] end connection 172.28.0.164:54564 (399 connections now open) 2015-10-05T03:44:53.322+0100 [mongosMain] connection accepted from 172.28.0.164:57122 #1420357 (400 connections now open) 2015-10-05T03:44:53.324+0100 [conn1420357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:53.835+0100 [conn1420019] end connection 172.28.0.164:54444 (399 connections now open) 2015-10-05T03:44:53.837+0100 [mongosMain] connection accepted from 172.28.0.164:57125 #1420358 (400 connections now open) 2015-10-05T03:44:53.838+0100 [conn1420358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:56.380+0100 [conn1420028] end connection 172.28.0.163:61420 (399 connections now open) 2015-10-05T03:44:56.380+0100 [conn1420037] end connection 172.28.0.163:61533 (399 connections now open) 2015-10-05T03:44:56.381+0100 [mongosMain] connection accepted from 172.28.0.163:64092 #1420359 (399 connections now open) 2015-10-05T03:44:56.381+0100 [mongosMain] connection accepted from 172.28.0.163:64094 #1420360 (400 connections now open) 2015-10-05T03:44:56.382+0100 [conn1420359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:44:56.383+0100 [conn1420360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:01.355+0100 [conn1419774] end connection 172.28.0.164:53508 (399 connections now open) 2015-10-05T03:45:01.357+0100 [mongosMain] connection accepted from 172.28.0.164:57137 #1420361 (400 connections now open) 2015-10-05T03:45:01.358+0100 [conn1420361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:01.823+0100 [conn1419823] end connection 172.28.0.164:53610 (399 connections now open) 2015-10-05T03:45:01.824+0100 [mongosMain] connection accepted from 172.28.0.164:57141 #1420362 (400 connections now open) 2015-10-05T03:45:01.826+0100 [conn1420362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:02.651+0100 [conn1419870] end connection 172.28.0.163:60350 (399 connections now open) 2015-10-05T03:45:02.653+0100 [mongosMain] connection accepted from 172.28.0.163:64113 #1420363 (400 connections now open) 2015-10-05T03:45:02.654+0100 [conn1420363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:03.291+0100 [conn1419919] end connection 172.28.0.163:60448 (399 connections now open) 2015-10-05T03:45:03.292+0100 [mongosMain] connection accepted from 172.28.0.163:64118 #1420364 (400 connections now open) 2015-10-05T03:45:03.293+0100 [conn1420364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:03.337+0100 [conn1420018] end connection 172.28.0.164:54441 (399 connections now open) 2015-10-05T03:45:03.338+0100 [mongosMain] connection accepted from 172.28.0.164:57149 #1420365 (400 connections now open) 2015-10-05T03:45:03.340+0100 [conn1420365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:03.851+0100 [conn1420036] end connection 172.28.0.164:54630 (399 connections now open) 2015-10-05T03:45:03.852+0100 [mongosMain] connection accepted from 172.28.0.164:57151 #1420366 (400 connections now open) 2015-10-05T03:45:03.854+0100 [conn1420366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:06.382+0100 [conn1420024] end connection 172.28.0.163:61364 (399 connections now open) 2015-10-05T03:45:06.382+0100 [conn1420025] end connection 172.28.0.163:61365 (399 connections now open) 2015-10-05T03:45:06.383+0100 [mongosMain] connection accepted from 172.28.0.163:64135 #1420367 (399 connections now open) 2015-10-05T03:45:06.383+0100 [mongosMain] connection accepted from 172.28.0.163:64136 #1420368 (400 connections now open) 2015-10-05T03:45:06.384+0100 [conn1420367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:06.384+0100 [conn1420368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:11.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4375703b51053eac1de 2015-10-05T03:45:11.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:45:11.372+0100 [conn1419775] end connection 172.28.0.164:53509 (399 connections now open) 2015-10-05T03:45:11.373+0100 [mongosMain] connection accepted from 172.28.0.164:57190 #1420369 (400 connections now open) 2015-10-05T03:45:11.375+0100 [conn1420369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:11.839+0100 [conn1419824] end connection 172.28.0.164:53611 (399 connections now open) 2015-10-05T03:45:11.840+0100 [mongosMain] connection accepted from 172.28.0.164:57196 #1420370 (400 connections now open) 2015-10-05T03:45:11.842+0100 [conn1420370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:12.652+0100 [conn1419871] end connection 172.28.0.163:60351 (399 connections now open) 2015-10-05T03:45:12.654+0100 [mongosMain] connection accepted from 172.28.0.163:64179 #1420371 (400 connections now open) 2015-10-05T03:45:12.655+0100 [conn1420371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:13.306+0100 [conn1419920] end connection 172.28.0.163:60450 (399 connections now open) 2015-10-05T03:45:13.307+0100 [mongosMain] connection accepted from 172.28.0.163:64184 #1420372 (400 connections now open) 2015-10-05T03:45:13.309+0100 [conn1420372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:13.352+0100 [conn1420044] end connection 172.28.0.164:54686 (399 connections now open) 2015-10-05T03:45:13.354+0100 [mongosMain] connection accepted from 172.28.0.164:57203 #1420373 (400 connections now open) 2015-10-05T03:45:13.355+0100 [conn1420373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:16.396+0100 [conn1420046] end connection 172.28.0.163:61572 (399 connections now open) 2015-10-05T03:45:16.397+0100 [conn1420033] end connection 172.28.0.163:61471 (398 connections now open) 2015-10-05T03:45:16.397+0100 [mongosMain] connection accepted from 172.28.0.163:64207 #1420374 (399 connections now open) 2015-10-05T03:45:16.398+0100 [mongosMain] connection accepted from 172.28.0.163:64208 #1420375 (400 connections now open) 2015-10-05T03:45:16.398+0100 [conn1420374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:16.399+0100 [conn1420375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:18.092+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:45:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:45:21.371+0100 [conn1419776] end connection 172.28.0.164:53510 (399 connections now open) 2015-10-05T03:45:21.373+0100 [mongosMain] connection accepted from 172.28.0.164:57255 #1420376 (400 connections now open) 2015-10-05T03:45:21.375+0100 [conn1420376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:21.839+0100 [conn1419825] end connection 172.28.0.164:53612 (399 connections now open) 2015-10-05T03:45:21.840+0100 [mongosMain] connection accepted from 172.28.0.164:57264 #1420377 (400 connections now open) 2015-10-05T03:45:21.842+0100 [conn1420377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:22.667+0100 [conn1419872] end connection 172.28.0.163:60353 (399 connections now open) 2015-10-05T03:45:22.668+0100 [mongosMain] connection accepted from 172.28.0.163:64243 #1420378 (400 connections now open) 2015-10-05T03:45:22.669+0100 [conn1420378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:23.307+0100 [conn1419921] end connection 172.28.0.163:60451 (399 connections now open) 2015-10-05T03:45:23.308+0100 [mongosMain] connection accepted from 172.28.0.163:64247 #1420379 (400 connections now open) 2015-10-05T03:45:23.309+0100 [conn1420379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:23.367+0100 [conn1420040] end connection 172.28.0.164:54671 (399 connections now open) 2015-10-05T03:45:23.368+0100 [mongosMain] connection accepted from 172.28.0.164:57272 #1420380 (400 connections now open) 2015-10-05T03:45:23.370+0100 [conn1420380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:23.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4435703b51053eac1ee 2015-10-05T03:45:23.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:45:23.883+0100 [conn1420053] end connection 172.28.0.164:54765 (399 connections now open) 2015-10-05T03:45:23.884+0100 [mongosMain] connection accepted from 172.28.0.164:57278 #1420381 (400 connections now open) 2015-10-05T03:45:23.886+0100 [conn1420381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:26.413+0100 [conn1420047] end connection 172.28.0.163:61573 (399 connections now open) 2015-10-05T03:45:26.413+0100 [conn1420050] end connection 172.28.0.163:61608 (399 connections now open) 2015-10-05T03:45:26.414+0100 [mongosMain] connection accepted from 172.28.0.163:64260 #1420382 (399 connections now open) 2015-10-05T03:45:26.414+0100 [mongosMain] connection accepted from 172.28.0.163:64261 #1420383 (400 connections now open) 2015-10-05T03:45:26.415+0100 [conn1420383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:26.415+0100 [conn1420382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:28.907+0100 [mongosMain] connection accepted from 127.0.0.1:64273 #1420384 (401 connections now open) 2015-10-05T03:45:28.910+0100 [conn1420384] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:28.914+0100 [conn1420384] end connection 127.0.0.1:64273 (400 connections now open) 2015-10-05T03:45:29.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4495703b51053eac1ff 2015-10-05T03:45:30.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:45:31.387+0100 [conn1419777] end connection 172.28.0.164:53511 (399 connections now open) 2015-10-05T03:45:31.388+0100 [mongosMain] connection accepted from 172.28.0.164:57315 #1420385 (400 connections now open) 2015-10-05T03:45:31.389+0100 [conn1420385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:31.855+0100 [conn1419826] end connection 172.28.0.164:53613 (399 connections now open) 2015-10-05T03:45:31.856+0100 [mongosMain] connection accepted from 172.28.0.164:57321 #1420386 (400 connections now open) 2015-10-05T03:45:31.858+0100 [conn1420386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:32.668+0100 [conn1419873] end connection 172.28.0.163:60354 (399 connections now open) 2015-10-05T03:45:32.670+0100 [mongosMain] connection accepted from 172.28.0.163:64295 #1420387 (400 connections now open) 2015-10-05T03:45:32.671+0100 [conn1420387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:33.322+0100 [conn1419922] end connection 172.28.0.163:60453 (399 connections now open) 2015-10-05T03:45:33.323+0100 [mongosMain] connection accepted from 172.28.0.163:64302 #1420388 (400 connections now open) 2015-10-05T03:45:33.325+0100 [conn1420388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:33.384+0100 [conn1419977] end connection 172.28.0.164:54038 (399 connections now open) 2015-10-05T03:45:33.385+0100 [mongosMain] connection accepted from 172.28.0.164:57329 #1420389 (400 connections now open) 2015-10-05T03:45:33.386+0100 [conn1420389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:33.883+0100 [conn1420041] end connection 172.28.0.164:54673 (399 connections now open) 2015-10-05T03:45:33.885+0100 [mongosMain] connection accepted from 172.28.0.164:57334 #1420390 (400 connections now open) 2015-10-05T03:45:33.886+0100 [conn1420390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:36.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4505703b51053eac213 2015-10-05T03:45:36.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:45:36.412+0100 [conn1420059] end connection 172.28.0.163:61742 (399 connections now open) 2015-10-05T03:45:36.412+0100 [conn1420054] end connection 172.28.0.163:61668 (399 connections now open) 2015-10-05T03:45:36.414+0100 [mongosMain] connection accepted from 172.28.0.163:64309 #1420391 (399 connections now open) 2015-10-05T03:45:36.415+0100 [mongosMain] connection accepted from 172.28.0.163:64310 #1420392 (400 connections now open) 2015-10-05T03:45:36.415+0100 [conn1420391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:36.416+0100 [conn1420392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:40.065+0100 [mongosMain] connection accepted from 127.0.0.1:64314 #1420393 (401 connections now open) 2015-10-05T03:45:40.068+0100 [conn1420393] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:40.072+0100 [conn1420393] end connection 127.0.0.1:64314 (400 connections now open) 2015-10-05T03:45:41.402+0100 [conn1419778] end connection 172.28.0.164:53512 (399 connections now open) 2015-10-05T03:45:41.403+0100 [mongosMain] connection accepted from 172.28.0.164:57352 #1420394 (400 connections now open) 2015-10-05T03:45:41.405+0100 [conn1420394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:41.870+0100 [conn1419827] end connection 172.28.0.164:53614 (399 connections now open) 2015-10-05T03:45:41.871+0100 [mongosMain] connection accepted from 172.28.0.164:57354 #1420395 (400 connections now open) 2015-10-05T03:45:41.873+0100 [conn1420395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:42.683+0100 [conn1419874] end connection 172.28.0.163:60355 (399 connections now open) 2015-10-05T03:45:42.685+0100 [mongosMain] connection accepted from 172.28.0.163:64318 #1420396 (400 connections now open) 2015-10-05T03:45:42.687+0100 [conn1420396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:43.323+0100 [conn1419923] end connection 172.28.0.163:60454 (399 connections now open) 2015-10-05T03:45:43.324+0100 [mongosMain] connection accepted from 172.28.0.163:64320 #1420397 (400 connections now open) 2015-10-05T03:45:43.325+0100 [conn1420397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:43.399+0100 [conn1420056] end connection 172.28.0.164:54823 (399 connections now open) 2015-10-05T03:45:43.400+0100 [mongosMain] connection accepted from 172.28.0.164:57356 #1420398 (400 connections now open) 2015-10-05T03:45:43.402+0100 [conn1420398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:43.900+0100 [conn1420057] end connection 172.28.0.164:54828 (399 connections now open) 2015-10-05T03:45:43.901+0100 [mongosMain] connection accepted from 172.28.0.164:57359 #1420399 (400 connections now open) 2015-10-05T03:45:43.903+0100 [conn1420399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:46.428+0100 [conn1420042] end connection 172.28.0.163:61558 (399 connections now open) 2015-10-05T03:45:46.428+0100 [conn1420055] end connection 172.28.0.163:61669 (399 connections now open) 2015-10-05T03:45:46.429+0100 [mongosMain] connection accepted from 172.28.0.163:64326 #1420400 (399 connections now open) 2015-10-05T03:45:46.430+0100 [mongosMain] connection accepted from 172.28.0.163:64327 #1420401 (400 connections now open) 2015-10-05T03:45:46.430+0100 [conn1420400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:46.431+0100 [conn1420401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:48.375+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:45:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:45:51.402+0100 [conn1419779] end connection 172.28.0.164:53513 (399 connections now open) 2015-10-05T03:45:51.403+0100 [mongosMain] connection accepted from 172.28.0.164:57367 #1420402 (400 connections now open) 2015-10-05T03:45:51.405+0100 [conn1420402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:51.870+0100 [conn1419828] end connection 172.28.0.164:53615 (399 connections now open) 2015-10-05T03:45:51.874+0100 [mongosMain] connection accepted from 172.28.0.164:57369 #1420403 (400 connections now open) 2015-10-05T03:45:51.876+0100 [conn1420403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:52.686+0100 [conn1419875] end connection 172.28.0.163:60357 (399 connections now open) 2015-10-05T03:45:52.688+0100 [mongosMain] connection accepted from 172.28.0.163:64338 #1420404 (400 connections now open) 2015-10-05T03:45:52.689+0100 [conn1420404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:53.338+0100 [conn1419924] end connection 172.28.0.163:60456 (399 connections now open) 2015-10-05T03:45:53.339+0100 [mongosMain] connection accepted from 172.28.0.163:64340 #1420405 (400 connections now open) 2015-10-05T03:45:53.341+0100 [conn1420405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:53.400+0100 [conn1420035] end connection 172.28.0.164:54626 (399 connections now open) 2015-10-05T03:45:53.401+0100 [mongosMain] connection accepted from 172.28.0.164:57372 #1420406 (400 connections now open) 2015-10-05T03:45:53.404+0100 [conn1420406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:53.899+0100 [conn1420049] end connection 172.28.0.164:54713 (399 connections now open) 2015-10-05T03:45:53.901+0100 [mongosMain] connection accepted from 172.28.0.164:57374 #1420407 (400 connections now open) 2015-10-05T03:45:53.903+0100 [conn1420407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:54.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4625703b51053eac23e 2015-10-05T03:45:54.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:45:56.429+0100 [conn1420038] end connection 172.28.0.163:61534 (399 connections now open) 2015-10-05T03:45:56.429+0100 [conn1420043] end connection 172.28.0.163:61559 (399 connections now open) 2015-10-05T03:45:56.430+0100 [mongosMain] connection accepted from 172.28.0.163:64346 #1420408 (399 connections now open) 2015-10-05T03:45:56.431+0100 [mongosMain] connection accepted from 172.28.0.163:64347 #1420409 (400 connections now open) 2015-10-05T03:45:56.432+0100 [conn1420408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:45:56.432+0100 [conn1420409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:01.419+0100 [conn1419780] end connection 172.28.0.164:53514 (399 connections now open) 2015-10-05T03:46:01.420+0100 [mongosMain] connection accepted from 172.28.0.164:57387 #1420410 (400 connections now open) 2015-10-05T03:46:01.422+0100 [conn1420410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:01.887+0100 [conn1419829] end connection 172.28.0.164:53616 (399 connections now open) 2015-10-05T03:46:01.887+0100 [mongosMain] connection accepted from 172.28.0.164:57390 #1420411 (400 connections now open) 2015-10-05T03:46:01.890+0100 [conn1420411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:02.700+0100 [conn1419876] end connection 172.28.0.163:60358 (399 connections now open) 2015-10-05T03:46:02.701+0100 [mongosMain] connection accepted from 172.28.0.163:64367 #1420412 (400 connections now open) 2015-10-05T03:46:02.702+0100 [conn1420412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:03.354+0100 [conn1419925] end connection 172.28.0.163:60457 (399 connections now open) 2015-10-05T03:46:03.355+0100 [mongosMain] connection accepted from 172.28.0.163:64372 #1420413 (400 connections now open) 2015-10-05T03:46:03.356+0100 [conn1420413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:03.415+0100 [conn1420052] end connection 172.28.0.164:54760 (399 connections now open) 2015-10-05T03:46:03.416+0100 [mongosMain] connection accepted from 172.28.0.164:57395 #1420414 (400 connections now open) 2015-10-05T03:46:03.418+0100 [conn1420414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:03.915+0100 [conn1420062] end connection 172.28.0.164:54894 (399 connections now open) 2015-10-05T03:46:03.915+0100 [mongosMain] connection accepted from 172.28.0.164:57401 #1420415 (400 connections now open) 2015-10-05T03:46:03.918+0100 [conn1420415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:06.443+0100 [conn1420051] end connection 172.28.0.163:61609 (399 connections now open) 2015-10-05T03:46:06.443+0100 [conn1420064] end connection 172.28.0.163:61798 (399 connections now open) 2015-10-05T03:46:06.444+0100 [mongosMain] connection accepted from 172.28.0.163:64388 #1420416 (399 connections now open) 2015-10-05T03:46:06.444+0100 [mongosMain] connection accepted from 172.28.0.163:64389 #1420417 (400 connections now open) 2015-10-05T03:46:06.445+0100 [conn1420416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:06.445+0100 [conn1420417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:11.434+0100 [conn1419781] end connection 172.28.0.164:53515 (399 connections now open) 2015-10-05T03:46:11.435+0100 [mongosMain] connection accepted from 172.28.0.164:57440 #1420418 (400 connections now open) 2015-10-05T03:46:11.437+0100 [conn1420418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:11.902+0100 [conn1419830] end connection 172.28.0.164:53617 (399 connections now open) 2015-10-05T03:46:11.903+0100 [mongosMain] connection accepted from 172.28.0.164:57443 #1420419 (400 connections now open) 2015-10-05T03:46:11.905+0100 [conn1420419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:12.699+0100 [conn1419877] end connection 172.28.0.163:60359 (399 connections now open) 2015-10-05T03:46:12.700+0100 [mongosMain] connection accepted from 172.28.0.163:64421 #1420420 (400 connections now open) 2015-10-05T03:46:12.701+0100 [conn1420420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:12.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4745703b51053eac278 2015-10-05T03:46:13.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:46:13.354+0100 [conn1419926] end connection 172.28.0.163:60459 (399 connections now open) 2015-10-05T03:46:13.356+0100 [mongosMain] connection accepted from 172.28.0.163:64425 #1420421 (400 connections now open) 2015-10-05T03:46:13.357+0100 [conn1420421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:13.431+0100 [conn1420061] end connection 172.28.0.164:54890 (399 connections now open) 2015-10-05T03:46:13.432+0100 [mongosMain] connection accepted from 172.28.0.164:57452 #1420422 (400 connections now open) 2015-10-05T03:46:13.434+0100 [conn1420422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:13.931+0100 [conn1420045] end connection 172.28.0.164:54688 (399 connections now open) 2015-10-05T03:46:13.933+0100 [mongosMain] connection accepted from 172.28.0.164:57455 #1420423 (400 connections now open) 2015-10-05T03:46:13.935+0100 [conn1420423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:16.445+0100 [conn1420072] end connection 172.28.0.163:61838 (399 connections now open) 2015-10-05T03:46:16.446+0100 [mongosMain] connection accepted from 172.28.0.163:64447 #1420424 (400 connections now open) 2015-10-05T03:46:16.447+0100 [conn1420424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:18.503+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:46:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:46:19.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e47b5703b51053eac291 2015-10-05T03:46:19.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:46:21.449+0100 [conn1419782] end connection 172.28.0.164:53516 (399 connections now open) 2015-10-05T03:46:21.450+0100 [mongosMain] connection accepted from 172.28.0.164:57492 #1420425 (400 connections now open) 2015-10-05T03:46:21.452+0100 [conn1420425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:21.903+0100 [conn1419831] end connection 172.28.0.164:53618 (399 connections now open) 2015-10-05T03:46:21.904+0100 [mongosMain] connection accepted from 172.28.0.164:57500 #1420426 (400 connections now open) 2015-10-05T03:46:21.906+0100 [conn1420426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:22.714+0100 [conn1419878] end connection 172.28.0.163:60361 (399 connections now open) 2015-10-05T03:46:22.715+0100 [mongosMain] connection accepted from 172.28.0.163:64482 #1420427 (400 connections now open) 2015-10-05T03:46:22.716+0100 [conn1420427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:23.370+0100 [conn1419927] end connection 172.28.0.163:60460 (399 connections now open) 2015-10-05T03:46:23.371+0100 [mongosMain] connection accepted from 172.28.0.163:64488 #1420428 (400 connections now open) 2015-10-05T03:46:23.372+0100 [conn1420428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:23.446+0100 [conn1420048] end connection 172.28.0.164:54709 (399 connections now open) 2015-10-05T03:46:23.448+0100 [mongosMain] connection accepted from 172.28.0.164:57510 #1420429 (400 connections now open) 2015-10-05T03:46:23.450+0100 [conn1420429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:23.931+0100 [conn1420067] end connection 172.28.0.164:54923 (399 connections now open) 2015-10-05T03:46:23.933+0100 [mongosMain] connection accepted from 172.28.0.164:57515 #1420430 (400 connections now open) 2015-10-05T03:46:23.934+0100 [conn1420430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:25.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4815703b51053eac2b0 2015-10-05T03:46:25.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:46:26.459+0100 [conn1420069] end connection 172.28.0.163:61825 (399 connections now open) 2015-10-05T03:46:26.459+0100 [conn1420076] end connection 172.28.0.163:61867 (399 connections now open) 2015-10-05T03:46:26.460+0100 [mongosMain] connection accepted from 172.28.0.163:64502 #1420431 (399 connections now open) 2015-10-05T03:46:26.460+0100 [mongosMain] connection accepted from 172.28.0.163:64503 #1420432 (400 connections now open) 2015-10-05T03:46:26.461+0100 [conn1420431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:26.461+0100 [conn1420432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:28.623+0100 [mongosMain] connection accepted from 127.0.0.1:64516 #1420433 (401 connections now open) 2015-10-05T03:46:28.626+0100 [conn1420433] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:28.631+0100 [conn1420433] end connection 127.0.0.1:64516 (400 connections now open) 2015-10-05T03:46:31.465+0100 [conn1419783] end connection 172.28.0.164:53517 (399 connections now open) 2015-10-05T03:46:31.466+0100 [mongosMain] connection accepted from 172.28.0.164:57559 #1420434 (400 connections now open) 2015-10-05T03:46:31.467+0100 [conn1420434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:31.918+0100 [conn1419832] end connection 172.28.0.164:53619 (399 connections now open) 2015-10-05T03:46:31.919+0100 [mongosMain] connection accepted from 172.28.0.164:57563 #1420435 (400 connections now open) 2015-10-05T03:46:31.921+0100 [conn1420435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:32.730+0100 [conn1419879] end connection 172.28.0.163:60362 (399 connections now open) 2015-10-05T03:46:32.732+0100 [mongosMain] connection accepted from 172.28.0.163:64534 #1420436 (400 connections now open) 2015-10-05T03:46:32.733+0100 [conn1420436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:33.370+0100 [conn1419928] end connection 172.28.0.163:60462 (399 connections now open) 2015-10-05T03:46:33.371+0100 [mongosMain] connection accepted from 172.28.0.163:64536 #1420437 (400 connections now open) 2015-10-05T03:46:33.373+0100 [conn1420437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:33.462+0100 [conn1420082] end connection 172.28.0.164:55066 (399 connections now open) 2015-10-05T03:46:33.464+0100 [mongosMain] connection accepted from 172.28.0.164:57574 #1420438 (400 connections now open) 2015-10-05T03:46:33.465+0100 [conn1420438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:33.947+0100 [conn1420071] end connection 172.28.0.164:54934 (399 connections now open) 2015-10-05T03:46:33.948+0100 [mongosMain] connection accepted from 172.28.0.164:57578 #1420439 (400 connections now open) 2015-10-05T03:46:33.950+0100 [conn1420439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:36.475+0100 [conn1420085] end connection 172.28.0.163:61999 (399 connections now open) 2015-10-05T03:46:36.475+0100 [conn1420073] end connection 172.28.0.163:61837 (399 connections now open) 2015-10-05T03:46:36.476+0100 [mongosMain] connection accepted from 172.28.0.163:64550 #1420440 (399 connections now open) 2015-10-05T03:46:36.476+0100 [mongosMain] connection accepted from 172.28.0.163:64551 #1420441 (400 connections now open) 2015-10-05T03:46:36.477+0100 [conn1420440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:36.477+0100 [conn1420441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:37.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e48d5703b51053eac2d6 2015-10-05T03:46:37.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:46:39.651+0100 [mongosMain] connection accepted from 127.0.0.1:64564 #1420442 (401 connections now open) 2015-10-05T03:46:39.653+0100 [conn1420442] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:39.657+0100 [conn1420442] end connection 127.0.0.1:64564 (400 connections now open) 2015-10-05T03:46:41.481+0100 [conn1419784] end connection 172.28.0.164:53518 (399 connections now open) 2015-10-05T03:46:41.482+0100 [mongosMain] connection accepted from 172.28.0.164:57605 #1420443 (400 connections now open) 2015-10-05T03:46:41.484+0100 [conn1420443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:41.934+0100 [conn1419833] end connection 172.28.0.164:53620 (399 connections now open) 2015-10-05T03:46:41.935+0100 [mongosMain] connection accepted from 172.28.0.164:57608 #1420444 (400 connections now open) 2015-10-05T03:46:41.937+0100 [conn1420444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:42.731+0100 [conn1419880] end connection 172.28.0.163:60364 (399 connections now open) 2015-10-05T03:46:42.732+0100 [mongosMain] connection accepted from 172.28.0.163:64567 #1420445 (400 connections now open) 2015-10-05T03:46:42.733+0100 [conn1420445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:43.385+0100 [conn1419929] end connection 172.28.0.163:60464 (399 connections now open) 2015-10-05T03:46:43.386+0100 [mongosMain] connection accepted from 172.28.0.163:64571 #1420446 (400 connections now open) 2015-10-05T03:46:43.387+0100 [conn1420446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:43.962+0100 [conn1420079] end connection 172.28.0.164:55014 (399 connections now open) 2015-10-05T03:46:43.963+0100 [mongosMain] connection accepted from 172.28.0.164:57612 #1420447 (400 connections now open) 2015-10-05T03:46:43.964+0100 [conn1420447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:46.475+0100 [conn1420058] end connection 172.28.0.163:61741 (399 connections now open) 2015-10-05T03:46:46.475+0100 [conn1420080] end connection 172.28.0.163:61934 (399 connections now open) 2015-10-05T03:46:46.476+0100 [mongosMain] connection accepted from 172.28.0.163:64576 #1420448 (399 connections now open) 2015-10-05T03:46:46.477+0100 [mongosMain] connection accepted from 172.28.0.163:64577 #1420449 (400 connections now open) 2015-10-05T03:46:46.477+0100 [conn1420448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:46.477+0100 [conn1420449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:48.788+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:46:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:46:50.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4995703b51053eac2fb 2015-10-05T03:46:50.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:46:51.481+0100 [conn1419785] end connection 172.28.0.164:53519 (399 connections now open) 2015-10-05T03:46:51.483+0100 [mongosMain] connection accepted from 172.28.0.164:57620 #1420450 (400 connections now open) 2015-10-05T03:46:51.486+0100 [conn1420450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:51.951+0100 [conn1419834] end connection 172.28.0.164:53621 (399 connections now open) 2015-10-05T03:46:51.952+0100 [mongosMain] connection accepted from 172.28.0.164:57623 #1420451 (400 connections now open) 2015-10-05T03:46:51.953+0100 [conn1420451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:52.746+0100 [conn1419881] end connection 172.28.0.163:60365 (399 connections now open) 2015-10-05T03:46:52.747+0100 [mongosMain] connection accepted from 172.28.0.163:64586 #1420452 (400 connections now open) 2015-10-05T03:46:52.748+0100 [conn1420452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:53.386+0100 [conn1419930] end connection 172.28.0.163:60465 (399 connections now open) 2015-10-05T03:46:53.388+0100 [mongosMain] connection accepted from 172.28.0.163:64588 #1420453 (400 connections now open) 2015-10-05T03:46:53.389+0100 [conn1420453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:53.978+0100 [conn1420083] end connection 172.28.0.164:55071 (399 connections now open) 2015-10-05T03:46:53.980+0100 [mongosMain] connection accepted from 172.28.0.164:57627 #1420454 (400 connections now open) 2015-10-05T03:46:53.982+0100 [conn1420454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:56.492+0100 [conn1420068] end connection 172.28.0.163:61822 (399 connections now open) 2015-10-05T03:46:56.492+0100 [conn1420077] end connection 172.28.0.163:61868 (399 connections now open) 2015-10-05T03:46:56.493+0100 [mongosMain] connection accepted from 172.28.0.163:64593 #1420455 (399 connections now open) 2015-10-05T03:46:56.494+0100 [mongosMain] connection accepted from 172.28.0.163:64594 #1420456 (400 connections now open) 2015-10-05T03:46:56.494+0100 [conn1420455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:46:56.494+0100 [conn1420456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:01.497+0100 [conn1419786] end connection 172.28.0.164:53520 (399 connections now open) 2015-10-05T03:47:01.498+0100 [mongosMain] connection accepted from 172.28.0.164:57638 #1420457 (400 connections now open) 2015-10-05T03:47:01.500+0100 [conn1420457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:01.964+0100 [conn1419835] end connection 172.28.0.164:53622 (399 connections now open) 2015-10-05T03:47:01.965+0100 [mongosMain] connection accepted from 172.28.0.164:57642 #1420458 (400 connections now open) 2015-10-05T03:47:01.967+0100 [conn1420458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:02.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4a65703b51053eac334 2015-10-05T03:47:02.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:02.746+0100 [conn1419882] end connection 172.28.0.163:60367 (399 connections now open) 2015-10-05T03:47:02.746+0100 [mongosMain] connection accepted from 172.28.0.163:64609 #1420459 (400 connections now open) 2015-10-05T03:47:02.747+0100 [conn1420459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:03.401+0100 [conn1419931] end connection 172.28.0.163:60467 (399 connections now open) 2015-10-05T03:47:03.402+0100 [mongosMain] connection accepted from 172.28.0.163:64613 #1420460 (400 connections now open) 2015-10-05T03:47:03.403+0100 [conn1420460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:06.493+0100 [conn1419989] end connection 172.28.0.163:61049 (399 connections now open) 2015-10-05T03:47:06.494+0100 [mongosMain] connection accepted from 172.28.0.163:64635 #1420461 (400 connections now open) 2015-10-05T03:47:06.495+0100 [conn1420461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:08.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4ac5703b51053eac35d 2015-10-05T03:47:09.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:11.512+0100 [conn1419787] end connection 172.28.0.164:53521 (399 connections now open) 2015-10-05T03:47:11.513+0100 [mongosMain] connection accepted from 172.28.0.164:57679 #1420462 (400 connections now open) 2015-10-05T03:47:11.515+0100 [conn1420462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:11.980+0100 [conn1419836] end connection 172.28.0.164:53623 (399 connections now open) 2015-10-05T03:47:11.982+0100 [mongosMain] connection accepted from 172.28.0.164:57683 #1420463 (400 connections now open) 2015-10-05T03:47:11.983+0100 [conn1420463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:12.763+0100 [conn1419883] end connection 172.28.0.163:60368 (399 connections now open) 2015-10-05T03:47:12.764+0100 [mongosMain] connection accepted from 172.28.0.163:64658 #1420464 (400 connections now open) 2015-10-05T03:47:12.764+0100 [conn1420464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:13.402+0100 [conn1419932] end connection 172.28.0.163:60468 (399 connections now open) 2015-10-05T03:47:13.403+0100 [mongosMain] connection accepted from 172.28.0.163:64660 #1420465 (400 connections now open) 2015-10-05T03:47:13.404+0100 [conn1420465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:13.994+0100 [conn1420075] end connection 172.28.0.164:54956 (399 connections now open) 2015-10-05T03:47:13.995+0100 [mongosMain] connection accepted from 172.28.0.164:57693 #1420466 (400 connections now open) 2015-10-05T03:47:13.997+0100 [conn1420466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:15.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4b35703b51053eac366 2015-10-05T03:47:15.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:16.506+0100 [conn1420090] end connection 172.28.0.163:62065 (399 connections now open) 2015-10-05T03:47:16.506+0100 [conn1420096] end connection 172.28.0.163:62090 (399 connections now open) 2015-10-05T03:47:16.507+0100 [mongosMain] connection accepted from 172.28.0.163:64677 #1420467 (399 connections now open) 2015-10-05T03:47:16.508+0100 [mongosMain] connection accepted from 172.28.0.163:64678 #1420468 (400 connections now open) 2015-10-05T03:47:16.509+0100 [conn1420468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:16.509+0100 [conn1420467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:19.074+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:47:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:47:21.529+0100 [conn1419788] end connection 172.28.0.164:53522 (399 connections now open) 2015-10-05T03:47:21.530+0100 [mongosMain] connection accepted from 172.28.0.164:57729 #1420469 (400 connections now open) 2015-10-05T03:47:21.532+0100 [conn1420469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:21.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4b95703b51053eac379 2015-10-05T03:47:21.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:21.982+0100 [conn1419837] end connection 172.28.0.164:53624 (399 connections now open) 2015-10-05T03:47:21.983+0100 [mongosMain] connection accepted from 172.28.0.164:57735 #1420470 (400 connections now open) 2015-10-05T03:47:21.984+0100 [conn1420470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:22.762+0100 [conn1419884] end connection 172.28.0.163:60370 (399 connections now open) 2015-10-05T03:47:22.763+0100 [mongosMain] connection accepted from 172.28.0.163:64719 #1420471 (400 connections now open) 2015-10-05T03:47:22.765+0100 [conn1420471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:23.418+0100 [conn1419933] end connection 172.28.0.163:60470 (399 connections now open) 2015-10-05T03:47:23.419+0100 [mongosMain] connection accepted from 172.28.0.163:64724 #1420472 (400 connections now open) 2015-10-05T03:47:23.419+0100 [conn1420472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:24.010+0100 [conn1420101] end connection 172.28.0.164:55229 (399 connections now open) 2015-10-05T03:47:24.011+0100 [mongosMain] connection accepted from 172.28.0.164:57745 #1420473 (400 connections now open) 2015-10-05T03:47:24.013+0100 [conn1420473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:26.507+0100 [conn1420084] end connection 172.28.0.163:61998 (399 connections now open) 2015-10-05T03:47:26.508+0100 [conn1420093] end connection 172.28.0.163:62076 (398 connections now open) 2015-10-05T03:47:26.509+0100 [mongosMain] connection accepted from 172.28.0.163:64738 #1420474 (399 connections now open) 2015-10-05T03:47:26.510+0100 [mongosMain] connection accepted from 172.28.0.163:64739 #1420475 (400 connections now open) 2015-10-05T03:47:26.510+0100 [conn1420474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:26.511+0100 [conn1420475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:28.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4bf5703b51053eac38e 2015-10-05T03:47:28.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:28.440+0100 [mongosMain] connection accepted from 127.0.0.1:64751 #1420476 (401 connections now open) 2015-10-05T03:47:28.443+0100 [conn1420476] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:28.449+0100 [conn1420476] end connection 127.0.0.1:64751 (400 connections now open) 2015-10-05T03:47:31.544+0100 [conn1419790] end connection 172.28.0.164:53524 (399 connections now open) 2015-10-05T03:47:31.545+0100 [mongosMain] connection accepted from 172.28.0.164:57801 #1420477 (400 connections now open) 2015-10-05T03:47:31.547+0100 [conn1420477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:31.996+0100 [conn1419838] end connection 172.28.0.164:53625 (399 connections now open) 2015-10-05T03:47:31.997+0100 [mongosMain] connection accepted from 172.28.0.164:57807 #1420478 (400 connections now open) 2015-10-05T03:47:31.999+0100 [conn1420478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:32.777+0100 [conn1419885] end connection 172.28.0.163:60371 (399 connections now open) 2015-10-05T03:47:32.778+0100 [mongosMain] connection accepted from 172.28.0.163:64779 #1420479 (400 connections now open) 2015-10-05T03:47:32.779+0100 [conn1420479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:33.434+0100 [conn1419934] end connection 172.28.0.163:60471 (399 connections now open) 2015-10-05T03:47:33.434+0100 [mongosMain] connection accepted from 172.28.0.163:64786 #1420480 (400 connections now open) 2015-10-05T03:47:33.435+0100 [conn1420480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:34.025+0100 [conn1420092] end connection 172.28.0.164:55155 (399 connections now open) 2015-10-05T03:47:34.026+0100 [mongosMain] connection accepted from 172.28.0.164:57818 #1420481 (400 connections now open) 2015-10-05T03:47:34.028+0100 [conn1420481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:34.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4c65703b51053eac3ac 2015-10-05T03:47:34.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:36.522+0100 [conn1420097] end connection 172.28.0.163:62091 (399 connections now open) 2015-10-05T03:47:36.522+0100 [conn1420103] end connection 172.28.0.163:62161 (398 connections now open) 2015-10-05T03:47:36.523+0100 [mongosMain] connection accepted from 172.28.0.163:64804 #1420482 (399 connections now open) 2015-10-05T03:47:36.524+0100 [mongosMain] connection accepted from 172.28.0.163:64805 #1420483 (400 connections now open) 2015-10-05T03:47:36.525+0100 [conn1420482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:36.525+0100 [conn1420483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:39.949+0100 [mongosMain] connection accepted from 127.0.0.1:64811 #1420484 (401 connections now open) 2015-10-05T03:47:39.951+0100 [conn1420484] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:39.955+0100 [conn1420484] end connection 127.0.0.1:64811 (400 connections now open) 2015-10-05T03:47:40.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4cc5703b51053eac3b4 2015-10-05T03:47:40.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:42.012+0100 [conn1419839] end connection 172.28.0.164:53626 (399 connections now open) 2015-10-05T03:47:42.014+0100 [mongosMain] connection accepted from 172.28.0.164:57863 #1420485 (400 connections now open) 2015-10-05T03:47:42.015+0100 [conn1420485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:42.778+0100 [conn1419888] end connection 172.28.0.163:60375 (399 connections now open) 2015-10-05T03:47:42.779+0100 [mongosMain] connection accepted from 172.28.0.163:64814 #1420486 (400 connections now open) 2015-10-05T03:47:42.780+0100 [conn1420486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:43.433+0100 [conn1419935] end connection 172.28.0.163:60473 (399 connections now open) 2015-10-05T03:47:43.434+0100 [mongosMain] connection accepted from 172.28.0.163:64818 #1420487 (400 connections now open) 2015-10-05T03:47:43.435+0100 [conn1420487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:44.041+0100 [conn1420098] end connection 172.28.0.164:55185 (399 connections now open) 2015-10-05T03:47:44.042+0100 [mongosMain] connection accepted from 172.28.0.164:57866 #1420488 (400 connections now open) 2015-10-05T03:47:44.045+0100 [conn1420488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:46.523+0100 [conn1420106] end connection 172.28.0.163:62212 (399 connections now open) 2015-10-05T03:47:46.523+0100 [conn1420094] end connection 172.28.0.163:62077 (398 connections now open) 2015-10-05T03:47:46.524+0100 [mongosMain] connection accepted from 172.28.0.163:64822 #1420489 (399 connections now open) 2015-10-05T03:47:46.525+0100 [mongosMain] connection accepted from 172.28.0.163:64823 #1420490 (400 connections now open) 2015-10-05T03:47:46.525+0100 [conn1420489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:46.526+0100 [conn1420490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:47.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4d25703b51053eac3c1 2015-10-05T03:47:47.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:49.330+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:47:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:47:52.028+0100 [conn1419840] end connection 172.28.0.164:53628 (399 connections now open) 2015-10-05T03:47:52.031+0100 [mongosMain] connection accepted from 172.28.0.164:57876 #1420491 (400 connections now open) 2015-10-05T03:47:52.035+0100 [conn1420491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:52.793+0100 [conn1419886] end connection 172.28.0.163:60372 (399 connections now open) 2015-10-05T03:47:52.794+0100 [mongosMain] connection accepted from 172.28.0.163:64832 #1420492 (400 connections now open) 2015-10-05T03:47:52.796+0100 [conn1420492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:53.448+0100 [conn1419936] end connection 172.28.0.163:60475 (399 connections now open) 2015-10-05T03:47:53.449+0100 [mongosMain] connection accepted from 172.28.0.163:64834 #1420493 (400 connections now open) 2015-10-05T03:47:53.450+0100 [conn1420493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:53.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4d95703b51053eac3d4 2015-10-05T03:47:53.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:47:54.056+0100 [conn1420104] end connection 172.28.0.164:55295 (399 connections now open) 2015-10-05T03:47:54.058+0100 [mongosMain] connection accepted from 172.28.0.164:57879 #1420494 (400 connections now open) 2015-10-05T03:47:54.059+0100 [conn1420494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:47:56.538+0100 [conn1420089] end connection 172.28.0.163:62064 (399 connections now open) 2015-10-05T03:47:56.539+0100 [mongosMain] connection accepted from 172.28.0.163:64839 #1420495 (400 connections now open) 2015-10-05T03:47:56.540+0100 [conn1420495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:00.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4df5703b51053eac3e1 2015-10-05T03:48:00.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:02.043+0100 [conn1419841] end connection 172.28.0.164:53629 (399 connections now open) 2015-10-05T03:48:02.044+0100 [mongosMain] connection accepted from 172.28.0.164:57890 #1420496 (400 connections now open) 2015-10-05T03:48:02.046+0100 [conn1420496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:03.449+0100 [conn1419937] end connection 172.28.0.163:60476 (399 connections now open) 2015-10-05T03:48:03.451+0100 [mongosMain] connection accepted from 172.28.0.163:64864 #1420497 (400 connections now open) 2015-10-05T03:48:03.452+0100 [conn1420497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:04.073+0100 [conn1420088] end connection 172.28.0.164:55136 (399 connections now open) 2015-10-05T03:48:04.074+0100 [mongosMain] connection accepted from 172.28.0.164:57904 #1420498 (400 connections now open) 2015-10-05T03:48:04.076+0100 [conn1420498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:06.554+0100 [conn1420099] end connection 172.28.0.163:62119 (399 connections now open) 2015-10-05T03:48:06.556+0100 [mongosMain] connection accepted from 172.28.0.163:64887 #1420499 (400 connections now open) 2015-10-05T03:48:06.558+0100 [conn1420499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:06.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4e65703b51053eac414 2015-10-05T03:48:06.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:12.059+0100 [conn1419842] end connection 172.28.0.164:53630 (399 connections now open) 2015-10-05T03:48:12.061+0100 [mongosMain] connection accepted from 172.28.0.164:57949 #1420500 (400 connections now open) 2015-10-05T03:48:12.063+0100 [conn1420500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:13.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4ec5703b51053eac424 2015-10-05T03:48:13.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:13.464+0100 [conn1419938] end connection 172.28.0.163:60478 (399 connections now open) 2015-10-05T03:48:13.465+0100 [mongosMain] connection accepted from 172.28.0.163:64931 #1420501 (400 connections now open) 2015-10-05T03:48:13.466+0100 [conn1420501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:13.557+0100 [conn1420070] end connection 172.28.0.164:54932 (399 connections now open) 2015-10-05T03:48:13.558+0100 [mongosMain] connection accepted from 172.28.0.164:57954 #1420502 (400 connections now open) 2015-10-05T03:48:13.561+0100 [conn1420502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:14.090+0100 [conn1420108] end connection 172.28.0.164:55354 (399 connections now open) 2015-10-05T03:48:14.091+0100 [mongosMain] connection accepted from 172.28.0.164:57956 #1420503 (400 connections now open) 2015-10-05T03:48:14.093+0100 [conn1420503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:16.557+0100 [conn1420115] end connection 172.28.0.163:62310 (399 connections now open) 2015-10-05T03:48:16.558+0100 [mongosMain] connection accepted from 172.28.0.163:64952 #1420504 (400 connections now open) 2015-10-05T03:48:16.559+0100 [conn1420504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:19.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4f35703b51053eac43d 2015-10-05T03:48:19.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:19.468+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:48:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:48:22.060+0100 [conn1419843] end connection 172.28.0.164:53631 (399 connections now open) 2015-10-05T03:48:22.060+0100 [mongosMain] connection accepted from 172.28.0.164:57997 #1420505 (400 connections now open) 2015-10-05T03:48:22.063+0100 [conn1420505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:23.465+0100 [conn1419940] end connection 172.28.0.163:60481 (399 connections now open) 2015-10-05T03:48:23.466+0100 [mongosMain] connection accepted from 172.28.0.163:65000 #1420506 (400 connections now open) 2015-10-05T03:48:23.468+0100 [conn1420506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:24.089+0100 [conn1420116] end connection 172.28.0.164:55406 (399 connections now open) 2015-10-05T03:48:24.090+0100 [mongosMain] connection accepted from 172.28.0.164:58008 #1420507 (400 connections now open) 2015-10-05T03:48:24.092+0100 [conn1420507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:25.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4f95703b51053eac458 2015-10-05T03:48:25.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:26.569+0100 [conn1420113] end connection 172.28.0.163:62297 (399 connections now open) 2015-10-05T03:48:26.571+0100 [mongosMain] connection accepted from 172.28.0.163:65017 #1420508 (400 connections now open) 2015-10-05T03:48:26.572+0100 [conn1420508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:28.708+0100 [mongosMain] connection accepted from 127.0.0.1:65028 #1420509 (401 connections now open) 2015-10-05T03:48:28.711+0100 [conn1420509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:28.716+0100 [conn1420509] end connection 127.0.0.1:65028 (400 connections now open) 2015-10-05T03:48:31.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e4ff5703b51053eac46f 2015-10-05T03:48:31.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:34.105+0100 [conn1420112] end connection 172.28.0.164:55376 (399 connections now open) 2015-10-05T03:48:34.106+0100 [mongosMain] connection accepted from 172.28.0.164:58073 #1420510 (400 connections now open) 2015-10-05T03:48:34.108+0100 [conn1420510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:36.573+0100 [conn1420118] end connection 172.28.0.163:62401 (399 connections now open) 2015-10-05T03:48:36.574+0100 [mongosMain] connection accepted from 172.28.0.163:65062 #1420511 (400 connections now open) 2015-10-05T03:48:36.575+0100 [conn1420511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:38.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5055703b51053eac487 2015-10-05T03:48:38.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:39.352+0100 [mongosMain] connection accepted from 127.0.0.1:65063 #1420512 (401 connections now open) 2015-10-05T03:48:39.355+0100 [conn1420512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:39.359+0100 [conn1420512] end connection 127.0.0.1:65063 (400 connections now open) 2015-10-05T03:48:44.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e50c5703b51053eac4ae 2015-10-05T03:48:44.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:46.615+0100 [conn1420121] end connection 172.28.0.163:62461 (399 connections now open) 2015-10-05T03:48:46.615+0100 [mongosMain] connection accepted from 172.28.0.163:65072 #1420513 (400 connections now open) 2015-10-05T03:48:46.615+0100 [conn1420513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:48:49.769+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:48:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:48:50.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5125703b51053eac4d2 2015-10-05T03:48:50.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:48:56.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5185703b51053eac4ec 2015-10-05T03:48:56.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:03.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e51e5703b51053eac507 2015-10-05T03:49:03.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:09.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5255703b51053eac52d 2015-10-05T03:49:09.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:16.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e52b5703b51053eac535 2015-10-05T03:49:16.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:16.601+0100 [conn1420081] end connection 172.28.0.163:61935 (399 connections now open) 2015-10-05T03:49:16.601+0100 [conn1420110] end connection 172.28.0.163:62278 (399 connections now open) 2015-10-05T03:49:16.602+0100 [mongosMain] connection accepted from 172.28.0.163:65188 #1420514 (399 connections now open) 2015-10-05T03:49:16.603+0100 [mongosMain] connection accepted from 172.28.0.163:65189 #1420515 (400 connections now open) 2015-10-05T03:49:16.603+0100 [conn1420514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:16.604+0100 [conn1420515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:19.911+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:49:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:49:22.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5325703b51053eac544 2015-10-05T03:49:22.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:23.620+0100 [conn1420132] end connection 172.28.0.164:55621 (399 connections now open) 2015-10-05T03:49:23.622+0100 [mongosMain] connection accepted from 172.28.0.164:58205 #1420516 (400 connections now open) 2015-10-05T03:49:23.623+0100 [conn1420516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:29.002+0100 [mongosMain] connection accepted from 127.0.0.1:65251 #1420517 (401 connections now open) 2015-10-05T03:49:29.015+0100 [conn1420517] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:29.020+0100 [conn1420517] end connection 127.0.0.1:65251 (400 connections now open) 2015-10-05T03:49:29.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5385703b51053eac558 2015-10-05T03:49:29.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:33.636+0100 [conn1420087] end connection 172.28.0.164:55130 (399 connections now open) 2015-10-05T03:49:33.637+0100 [mongosMain] connection accepted from 172.28.0.164:58281 #1420518 (400 connections now open) 2015-10-05T03:49:33.639+0100 [conn1420518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:34.183+0100 [conn1420095] end connection 172.28.0.164:55166 (399 connections now open) 2015-10-05T03:49:34.184+0100 [mongosMain] connection accepted from 172.28.0.164:58283 #1420519 (400 connections now open) 2015-10-05T03:49:34.186+0100 [conn1420519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:35.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e53f5703b51053eac563 2015-10-05T03:49:35.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:36.632+0100 [conn1420124] end connection 172.28.0.163:62516 (399 connections now open) 2015-10-05T03:49:36.636+0100 [mongosMain] connection accepted from 172.28.0.163:65276 #1420520 (400 connections now open) 2015-10-05T03:49:36.637+0100 [conn1420520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:40.142+0100 [mongosMain] connection accepted from 127.0.0.1:65278 #1420521 (401 connections now open) 2015-10-05T03:49:40.145+0100 [conn1420521] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:40.149+0100 [conn1420521] end connection 127.0.0.1:65278 (400 connections now open) 2015-10-05T03:49:41.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5455703b51053eac578 2015-10-05T03:49:41.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:43.635+0100 [conn1420074] end connection 172.28.0.164:54949 (399 connections now open) 2015-10-05T03:49:43.637+0100 [mongosMain] connection accepted from 172.28.0.164:58296 #1420522 (400 connections now open) 2015-10-05T03:49:43.639+0100 [conn1420522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:44.182+0100 [conn1420120] end connection 172.28.0.164:55503 (399 connections now open) 2015-10-05T03:49:44.183+0100 [mongosMain] connection accepted from 172.28.0.164:58299 #1420523 (400 connections now open) 2015-10-05T03:49:44.184+0100 [conn1420523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:46.633+0100 [conn1420131] end connection 172.28.0.163:62566 (399 connections now open) 2015-10-05T03:49:46.634+0100 [mongosMain] connection accepted from 172.28.0.163:65287 #1420524 (400 connections now open) 2015-10-05T03:49:46.635+0100 [conn1420524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:47.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e54b5703b51053eac58c 2015-10-05T03:49:47.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:49:50.197+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:49:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:49:52.904+0100 [conn1419891] end connection 172.28.0.163:60380 (399 connections now open) 2015-10-05T03:49:52.905+0100 [mongosMain] connection accepted from 172.28.0.163:65295 #1420525 (400 connections now open) 2015-10-05T03:49:52.907+0100 [conn1420525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:53.652+0100 [conn1420130] end connection 172.28.0.164:55606 (399 connections now open) 2015-10-05T03:49:53.653+0100 [mongosMain] connection accepted from 172.28.0.164:58307 #1420526 (400 connections now open) 2015-10-05T03:49:53.655+0100 [conn1420526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:49:56.648+0100 [conn1420105] end connection 172.28.0.163:62211 (399 connections now open) 2015-10-05T03:49:56.649+0100 [mongosMain] connection accepted from 172.28.0.163:65302 #1420527 (400 connections now open) 2015-10-05T03:49:56.650+0100 [conn1420527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:00.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5575703b51053eac5a6 2015-10-05T03:50:00.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:12.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5645703b51053eac5e0 2015-10-05T03:50:12.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:20.459+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:50:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:50:21.785+0100 [conn1419791] end connection 172.28.0.164:53525 (399 connections now open) 2015-10-05T03:50:21.786+0100 [mongosMain] connection accepted from 172.28.0.164:58424 #1420528 (400 connections now open) 2015-10-05T03:50:21.789+0100 [conn1420528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:22.170+0100 [conn1419844] end connection 172.28.0.164:53632 (399 connections now open) 2015-10-05T03:50:22.172+0100 [mongosMain] connection accepted from 172.28.0.164:58429 #1420529 (400 connections now open) 2015-10-05T03:50:22.173+0100 [conn1420529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:23.575+0100 [conn1419939] end connection 172.28.0.163:60480 (399 connections now open) 2015-10-05T03:50:23.576+0100 [mongosMain] connection accepted from 172.28.0.163:65420 #1420530 (400 connections now open) 2015-10-05T03:50:23.578+0100 [conn1420530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:24.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5705703b51053eac608 2015-10-05T03:50:24.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:26.666+0100 [conn1420138] end connection 172.28.0.163:62735 (399 connections now open) 2015-10-05T03:50:26.667+0100 [mongosMain] connection accepted from 172.28.0.163:65436 #1420531 (400 connections now open) 2015-10-05T03:50:26.668+0100 [conn1420531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:28.513+0100 [mongosMain] connection accepted from 127.0.0.1:65453 #1420532 (401 connections now open) 2015-10-05T03:50:28.516+0100 [conn1420532] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:28.522+0100 [conn1420532] end connection 127.0.0.1:65453 (400 connections now open) 2015-10-05T03:50:31.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5765703b51053eac611 2015-10-05T03:50:31.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:31.702+0100 [conn1419792] end connection 172.28.0.164:53526 (399 connections now open) 2015-10-05T03:50:31.703+0100 [mongosMain] connection accepted from 172.28.0.164:58493 #1420533 (400 connections now open) 2015-10-05T03:50:31.705+0100 [conn1420533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:32.170+0100 [conn1420144] end connection 172.28.0.164:55929 (399 connections now open) 2015-10-05T03:50:32.171+0100 [mongosMain] connection accepted from 172.28.0.164:58500 #1420534 (400 connections now open) 2015-10-05T03:50:32.172+0100 [conn1420534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:32.936+0100 [conn1419887] end connection 172.28.0.163:60374 (399 connections now open) 2015-10-05T03:50:32.937+0100 [mongosMain] connection accepted from 172.28.0.163:65477 #1420535 (400 connections now open) 2015-10-05T03:50:32.939+0100 [conn1420535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:33.591+0100 [conn1420146] end connection 172.28.0.163:62917 (399 connections now open) 2015-10-05T03:50:33.593+0100 [mongosMain] connection accepted from 172.28.0.163:65480 #1420536 (400 connections now open) 2015-10-05T03:50:33.594+0100 [conn1420536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:34.229+0100 [conn1420137] end connection 172.28.0.164:55781 (399 connections now open) 2015-10-05T03:50:34.231+0100 [mongosMain] connection accepted from 172.28.0.164:58514 #1420537 (400 connections now open) 2015-10-05T03:50:34.233+0100 [conn1420537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:37.381+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:50:37.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:50:39.869+0100 [mongosMain] connection accepted from 127.0.0.1:65487 #1420538 (401 connections now open) 2015-10-05T03:50:39.871+0100 [conn1420538] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:39.876+0100 [conn1420538] end connection 127.0.0.1:65487 (400 connections now open) 2015-10-05T03:50:41.718+0100 [conn1419794] end connection 172.28.0.164:53529 (399 connections now open) 2015-10-05T03:50:41.719+0100 [mongosMain] connection accepted from 172.28.0.164:58530 #1420539 (400 connections now open) 2015-10-05T03:50:41.721+0100 [conn1420539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:42.186+0100 [conn1420151] end connection 172.28.0.164:56003 (399 connections now open) 2015-10-05T03:50:42.188+0100 [mongosMain] connection accepted from 172.28.0.164:58532 #1420540 (400 connections now open) 2015-10-05T03:50:42.189+0100 [conn1420540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:42.951+0100 [conn1419890] end connection 172.28.0.163:60378 (399 connections now open) 2015-10-05T03:50:42.952+0100 [mongosMain] connection accepted from 172.28.0.163:65491 #1420541 (400 connections now open) 2015-10-05T03:50:42.953+0100 [conn1420541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:43.592+0100 [conn1420153] end connection 172.28.0.163:62974 (399 connections now open) 2015-10-05T03:50:43.593+0100 [mongosMain] connection accepted from 172.28.0.163:65493 #1420542 (400 connections now open) 2015-10-05T03:50:43.594+0100 [conn1420542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:43.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5835703b51053eac634 2015-10-05T03:50:43.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:44.245+0100 [conn1420155] end connection 172.28.0.164:56019 (399 connections now open) 2015-10-05T03:50:44.246+0100 [mongosMain] connection accepted from 172.28.0.164:58536 #1420543 (400 connections now open) 2015-10-05T03:50:44.248+0100 [conn1420543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:50.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5895703b51053eac644 2015-10-05T03:50:50.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:50:50.736+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:50:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:50:51.733+0100 [conn1419795] end connection 172.28.0.164:53530 (399 connections now open) 2015-10-05T03:50:51.735+0100 [mongosMain] connection accepted from 172.28.0.164:58545 #1420544 (400 connections now open) 2015-10-05T03:50:51.736+0100 [conn1420544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:52.202+0100 [conn1420160] end connection 172.28.0.164:56062 (399 connections now open) 2015-10-05T03:50:52.203+0100 [mongosMain] connection accepted from 172.28.0.164:58549 #1420545 (400 connections now open) 2015-10-05T03:50:52.204+0100 [conn1420545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:52.955+0100 [conn1419889] end connection 172.28.0.163:60377 (399 connections now open) 2015-10-05T03:50:52.956+0100 [mongosMain] connection accepted from 172.28.0.163:65506 #1420546 (400 connections now open) 2015-10-05T03:50:52.958+0100 [conn1420546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:53.607+0100 [conn1420162] end connection 172.28.0.163:63024 (399 connections now open) 2015-10-05T03:50:53.608+0100 [mongosMain] connection accepted from 172.28.0.163:65509 #1420547 (400 connections now open) 2015-10-05T03:50:53.611+0100 [conn1420547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:54.245+0100 [conn1420141] end connection 172.28.0.164:55821 (399 connections now open) 2015-10-05T03:50:54.246+0100 [mongosMain] connection accepted from 172.28.0.164:58552 #1420548 (400 connections now open) 2015-10-05T03:50:54.250+0100 [conn1420548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:50:56.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5905703b51053eac658 2015-10-05T03:50:56.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:01.749+0100 [conn1420143] end connection 172.28.0.164:55923 (399 connections now open) 2015-10-05T03:51:01.750+0100 [mongosMain] connection accepted from 172.28.0.164:58560 #1420549 (400 connections now open) 2015-10-05T03:51:01.752+0100 [conn1420549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:02.202+0100 [conn1420167] end connection 172.28.0.164:56079 (399 connections now open) 2015-10-05T03:51:02.204+0100 [mongosMain] connection accepted from 172.28.0.164:58565 #1420550 (400 connections now open) 2015-10-05T03:51:02.205+0100 [conn1420550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:02.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5965703b51053eac664 2015-10-05T03:51:02.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:02.967+0100 [conn1420152] end connection 172.28.0.163:62971 (399 connections now open) 2015-10-05T03:51:02.968+0100 [mongosMain] connection accepted from 172.28.0.163:65528 #1420551 (400 connections now open) 2015-10-05T03:51:02.970+0100 [conn1420551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:03.607+0100 [conn1420169] end connection 172.28.0.163:63039 (399 connections now open) 2015-10-05T03:51:03.609+0100 [mongosMain] connection accepted from 172.28.0.163:65532 #1420552 (400 connections now open) 2015-10-05T03:51:03.610+0100 [conn1420552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:03.761+0100 [conn1420066] end connection 172.28.0.164:54919 (399 connections now open) 2015-10-05T03:51:03.762+0100 [mongosMain] connection accepted from 172.28.0.164:58575 #1420553 (400 connections now open) 2015-10-05T03:51:03.764+0100 [conn1420553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:06.711+0100 [conn1420102] end connection 172.28.0.163:62160 (399 connections now open) 2015-10-05T03:51:06.712+0100 [mongosMain] connection accepted from 172.28.0.163:49167 #1420554 (400 connections now open) 2015-10-05T03:51:06.713+0100 [conn1420554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:11.765+0100 [conn1419789] end connection 172.28.0.164:53523 (399 connections now open) 2015-10-05T03:51:11.766+0100 [mongosMain] connection accepted from 172.28.0.164:58616 #1420555 (400 connections now open) 2015-10-05T03:51:11.767+0100 [conn1420555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:12.217+0100 [conn1420173] end connection 172.28.0.164:56097 (399 connections now open) 2015-10-05T03:51:12.218+0100 [mongosMain] connection accepted from 172.28.0.164:58620 #1420556 (400 connections now open) 2015-10-05T03:51:12.221+0100 [conn1420556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:12.968+0100 [conn1420145] end connection 172.28.0.163:62916 (399 connections now open) 2015-10-05T03:51:12.969+0100 [mongosMain] connection accepted from 172.28.0.163:49229 #1420557 (400 connections now open) 2015-10-05T03:51:12.971+0100 [conn1420557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:13.622+0100 [conn1420175] end connection 172.28.0.163:63071 (399 connections now open) 2015-10-05T03:51:13.623+0100 [mongosMain] connection accepted from 172.28.0.163:49232 #1420558 (400 connections now open) 2015-10-05T03:51:13.625+0100 [conn1420558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:13.777+0100 [conn1420133] end connection 172.28.0.164:55672 (399 connections now open) 2015-10-05T03:51:13.778+0100 [mongosMain] connection accepted from 172.28.0.164:58626 #1420559 (400 connections now open) 2015-10-05T03:51:13.780+0100 [conn1420559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:14.276+0100 [conn1420164] end connection 172.28.0.164:56068 (399 connections now open) 2015-10-05T03:51:14.277+0100 [mongosMain] connection accepted from 172.28.0.164:58629 #1420560 (400 connections now open) 2015-10-05T03:51:14.279+0100 [conn1420560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:14.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5a25703b51053eac68e 2015-10-05T03:51:15.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:16.712+0100 [conn1420109] end connection 172.28.0.163:62277 (399 connections now open) 2015-10-05T03:51:16.714+0100 [mongosMain] connection accepted from 172.28.0.163:49251 #1420561 (400 connections now open) 2015-10-05T03:51:16.715+0100 [conn1420561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:20.996+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:51:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:51:21.781+0100 [conn1420150] end connection 172.28.0.164:55998 (399 connections now open) 2015-10-05T03:51:21.783+0100 [mongosMain] connection accepted from 172.28.0.164:58666 #1420562 (400 connections now open) 2015-10-05T03:51:21.784+0100 [conn1420562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:22.233+0100 [conn1420178] end connection 172.28.0.164:56138 (399 connections now open) 2015-10-05T03:51:22.234+0100 [mongosMain] connection accepted from 172.28.0.164:58671 #1420563 (400 connections now open) 2015-10-05T03:51:22.236+0100 [conn1420563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:22.983+0100 [conn1420161] end connection 172.28.0.163:63022 (399 connections now open) 2015-10-05T03:51:22.984+0100 [mongosMain] connection accepted from 172.28.0.163:49289 #1420564 (400 connections now open) 2015-10-05T03:51:22.985+0100 [conn1420564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:23.623+0100 [conn1420180] end connection 172.28.0.163:63125 (399 connections now open) 2015-10-05T03:51:23.624+0100 [mongosMain] connection accepted from 172.28.0.163:49293 #1420565 (400 connections now open) 2015-10-05T03:51:23.626+0100 [conn1420565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:23.925+0100 [conn1420022] end connection 172.28.0.164:54460 (399 connections now open) 2015-10-05T03:51:23.926+0100 [mongosMain] connection accepted from 172.28.0.164:58682 #1420566 (400 connections now open) 2015-10-05T03:51:23.928+0100 [conn1420566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:24.292+0100 [conn1420182] end connection 172.28.0.164:56157 (399 connections now open) 2015-10-05T03:51:24.293+0100 [mongosMain] connection accepted from 172.28.0.164:58683 #1420567 (400 connections now open) 2015-10-05T03:51:24.295+0100 [conn1420567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:26.727+0100 [conn1420148] end connection 172.28.0.163:62924 (399 connections now open) 2015-10-05T03:51:26.727+0100 [conn1420156] end connection 172.28.0.163:62980 (399 connections now open) 2015-10-05T03:51:26.728+0100 [mongosMain] connection accepted from 172.28.0.163:49310 #1420568 (399 connections now open) 2015-10-05T03:51:26.729+0100 [mongosMain] connection accepted from 172.28.0.163:49311 #1420569 (400 connections now open) 2015-10-05T03:51:26.729+0100 [conn1420568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:26.730+0100 [conn1420569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:27.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5af5703b51053eac6a9 2015-10-05T03:51:27.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:28.239+0100 [mongosMain] connection accepted from 127.0.0.1:49322 #1420570 (401 connections now open) 2015-10-05T03:51:28.242+0100 [conn1420570] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:28.247+0100 [conn1420570] end connection 127.0.0.1:49322 (400 connections now open) 2015-10-05T03:51:31.781+0100 [conn1420166] end connection 172.28.0.164:56077 (399 connections now open) 2015-10-05T03:51:31.782+0100 [mongosMain] connection accepted from 172.28.0.164:58736 #1420571 (400 connections now open) 2015-10-05T03:51:31.783+0100 [conn1420571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:32.249+0100 [conn1420184] end connection 172.28.0.164:56197 (399 connections now open) 2015-10-05T03:51:32.250+0100 [mongosMain] connection accepted from 172.28.0.164:58740 #1420572 (400 connections now open) 2015-10-05T03:51:32.252+0100 [conn1420572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:32.984+0100 [conn1420174] end connection 172.28.0.163:63066 (399 connections now open) 2015-10-05T03:51:32.986+0100 [mongosMain] connection accepted from 172.28.0.163:49344 #1420573 (400 connections now open) 2015-10-05T03:51:32.987+0100 [conn1420573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:33.425+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:51:33.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:51:33.638+0100 [conn1420186] end connection 172.28.0.163:63190 (399 connections now open) 2015-10-05T03:51:33.639+0100 [mongosMain] connection accepted from 172.28.0.163:49348 #1420574 (400 connections now open) 2015-10-05T03:51:33.640+0100 [conn1420574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:33.793+0100 [conn1420078] end connection 172.28.0.164:55011 (399 connections now open) 2015-10-05T03:51:33.794+0100 [mongosMain] connection accepted from 172.28.0.164:58752 #1420575 (400 connections now open) 2015-10-05T03:51:33.796+0100 [conn1420575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:34.307+0100 [conn1420114] end connection 172.28.0.164:55388 (399 connections now open) 2015-10-05T03:51:34.309+0100 [mongosMain] connection accepted from 172.28.0.164:58756 #1420576 (400 connections now open) 2015-10-05T03:51:34.310+0100 [conn1420576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:36.734+0100 [conn1420157] end connection 172.28.0.163:62981 (399 connections now open) 2015-10-05T03:51:36.736+0100 [mongosMain] connection accepted from 172.28.0.163:49355 #1420577 (400 connections now open) 2015-10-05T03:51:36.736+0100 [conn1420165] end connection 172.28.0.163:63027 (398 connections now open) 2015-10-05T03:51:36.737+0100 [mongosMain] connection accepted from 172.28.0.163:49357 #1420578 (400 connections now open) 2015-10-05T03:51:36.737+0100 [conn1420577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:36.738+0100 [conn1420578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:39.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5bb5703b51053eac6c6 2015-10-05T03:51:39.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:40.164+0100 [mongosMain] connection accepted from 127.0.0.1:49384 #1420579 (401 connections now open) 2015-10-05T03:51:40.166+0100 [conn1420579] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:40.171+0100 [conn1420579] end connection 127.0.0.1:49384 (400 connections now open) 2015-10-05T03:51:41.796+0100 [conn1420159] end connection 172.28.0.164:56060 (399 connections now open) 2015-10-05T03:51:41.798+0100 [mongosMain] connection accepted from 172.28.0.164:58807 #1420580 (400 connections now open) 2015-10-05T03:51:41.799+0100 [conn1420580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:42.264+0100 [conn1420192] end connection 172.28.0.164:56268 (399 connections now open) 2015-10-05T03:51:42.265+0100 [mongosMain] connection accepted from 172.28.0.164:58810 #1420581 (400 connections now open) 2015-10-05T03:51:42.267+0100 [conn1420581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:42.999+0100 [conn1420179] end connection 172.28.0.163:63119 (399 connections now open) 2015-10-05T03:51:43.000+0100 [mongosMain] connection accepted from 172.28.0.163:49392 #1420582 (400 connections now open) 2015-10-05T03:51:43.001+0100 [conn1420582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:43.654+0100 [conn1420194] end connection 172.28.0.163:63250 (399 connections now open) 2015-10-05T03:51:43.655+0100 [mongosMain] connection accepted from 172.28.0.163:49394 #1420583 (400 connections now open) 2015-10-05T03:51:43.656+0100 [conn1420583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:43.793+0100 [conn1420163] end connection 172.28.0.164:56065 (399 connections now open) 2015-10-05T03:51:43.794+0100 [mongosMain] connection accepted from 172.28.0.164:58813 #1420584 (400 connections now open) 2015-10-05T03:51:43.796+0100 [conn1420584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:44.323+0100 [conn1420171] end connection 172.28.0.164:56086 (399 connections now open) 2015-10-05T03:51:44.324+0100 [mongosMain] connection accepted from 172.28.0.164:58815 #1420585 (400 connections now open) 2015-10-05T03:51:44.326+0100 [conn1420585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:46.742+0100 [conn1420128] end connection 172.28.0.163:62543 (399 connections now open) 2015-10-05T03:51:46.742+0100 [conn1420100] end connection 172.28.0.163:62120 (398 connections now open) 2015-10-05T03:51:46.743+0100 [mongosMain] connection accepted from 172.28.0.163:49400 #1420586 (399 connections now open) 2015-10-05T03:51:46.744+0100 [mongosMain] connection accepted from 172.28.0.163:49401 #1420587 (400 connections now open) 2015-10-05T03:51:46.745+0100 [conn1420586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:46.746+0100 [conn1420587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:51.180+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:51:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:51:51.812+0100 [conn1420172] end connection 172.28.0.164:56095 (399 connections now open) 2015-10-05T03:51:51.813+0100 [mongosMain] connection accepted from 172.28.0.164:58826 #1420588 (400 connections now open) 2015-10-05T03:51:51.814+0100 [conn1420588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:52.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5c75703b51053eac6d2 2015-10-05T03:51:52.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:51:52.280+0100 [conn1420201] end connection 172.28.0.164:56312 (399 connections now open) 2015-10-05T03:51:52.281+0100 [mongosMain] connection accepted from 172.28.0.164:58829 #1420589 (400 connections now open) 2015-10-05T03:51:52.283+0100 [conn1420589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:53.004+0100 [conn1420168] end connection 172.28.0.163:63036 (399 connections now open) 2015-10-05T03:51:53.005+0100 [mongosMain] connection accepted from 172.28.0.163:49410 #1420590 (400 connections now open) 2015-10-05T03:51:53.006+0100 [conn1420590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:53.659+0100 [conn1420203] end connection 172.28.0.163:63290 (399 connections now open) 2015-10-05T03:51:53.661+0100 [mongosMain] connection accepted from 172.28.0.163:49413 #1420591 (400 connections now open) 2015-10-05T03:51:53.661+0100 [conn1420591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:53.809+0100 [conn1420154] end connection 172.28.0.164:56015 (399 connections now open) 2015-10-05T03:51:53.810+0100 [mongosMain] connection accepted from 172.28.0.164:58832 #1420592 (400 connections now open) 2015-10-05T03:51:53.812+0100 [conn1420592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:54.324+0100 [conn1420188] end connection 172.28.0.164:56216 (399 connections now open) 2015-10-05T03:51:54.325+0100 [mongosMain] connection accepted from 172.28.0.164:58834 #1420593 (400 connections now open) 2015-10-05T03:51:54.327+0100 [conn1420593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:56.745+0100 [conn1420142] end connection 172.28.0.163:62871 (399 connections now open) 2015-10-05T03:51:56.746+0100 [conn1420189] end connection 172.28.0.163:63206 (398 connections now open) 2015-10-05T03:51:56.747+0100 [mongosMain] connection accepted from 172.28.0.163:49417 #1420594 (399 connections now open) 2015-10-05T03:51:56.748+0100 [conn1420594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:56.748+0100 [mongosMain] connection accepted from 172.28.0.163:49418 #1420595 (400 connections now open) 2015-10-05T03:51:56.749+0100 [conn1420595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:51:58.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5ce5703b51053eac6e0 2015-10-05T03:51:58.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:01.812+0100 [conn1420177] end connection 172.28.0.164:56130 (399 connections now open) 2015-10-05T03:52:01.813+0100 [mongosMain] connection accepted from 172.28.0.164:58844 #1420596 (400 connections now open) 2015-10-05T03:52:01.815+0100 [conn1420596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:02.280+0100 [conn1420209] end connection 172.28.0.164:56328 (399 connections now open) 2015-10-05T03:52:02.281+0100 [mongosMain] connection accepted from 172.28.0.164:58848 #1420597 (400 connections now open) 2015-10-05T03:52:02.283+0100 [conn1420597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:03.014+0100 [conn1420185] end connection 172.28.0.163:63183 (399 connections now open) 2015-10-05T03:52:03.016+0100 [mongosMain] connection accepted from 172.28.0.163:49442 #1420598 (400 connections now open) 2015-10-05T03:52:03.017+0100 [conn1420598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:03.670+0100 [conn1420211] end connection 172.28.0.163:63307 (399 connections now open) 2015-10-05T03:52:03.671+0100 [mongosMain] connection accepted from 172.28.0.163:49448 #1420599 (400 connections now open) 2015-10-05T03:52:03.672+0100 [conn1420599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:03.824+0100 [conn1420004] end connection 172.28.0.164:54306 (399 connections now open) 2015-10-05T03:52:03.825+0100 [mongosMain] connection accepted from 172.28.0.164:58865 #1420600 (400 connections now open) 2015-10-05T03:52:03.826+0100 [conn1420600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:04.339+0100 [conn1420205] end connection 172.28.0.164:56316 (399 connections now open) 2015-10-05T03:52:04.340+0100 [mongosMain] connection accepted from 172.28.0.164:58868 #1420601 (400 connections now open) 2015-10-05T03:52:04.341+0100 [conn1420601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:06.758+0100 [conn1420117] end connection 172.28.0.163:62335 (399 connections now open) 2015-10-05T03:52:06.758+0100 [conn1420139] end connection 172.28.0.163:62736 (399 connections now open) 2015-10-05T03:52:06.759+0100 [mongosMain] connection accepted from 172.28.0.163:49462 #1420602 (399 connections now open) 2015-10-05T03:52:06.760+0100 [mongosMain] connection accepted from 172.28.0.163:49463 #1420603 (400 connections now open) 2015-10-05T03:52:06.760+0100 [conn1420602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:06.760+0100 [conn1420603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:11.812+0100 [conn1419793] end connection 172.28.0.164:53528 (399 connections now open) 2015-10-05T03:52:11.813+0100 [mongosMain] connection accepted from 172.28.0.164:58907 #1420604 (400 connections now open) 2015-10-05T03:52:11.815+0100 [conn1420604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:12.280+0100 [conn1420216] end connection 172.28.0.164:56350 (399 connections now open) 2015-10-05T03:52:12.281+0100 [mongosMain] connection accepted from 172.28.0.164:58911 #1420605 (400 connections now open) 2015-10-05T03:52:12.283+0100 [conn1420605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:13.030+0100 [conn1420193] end connection 172.28.0.163:63243 (399 connections now open) 2015-10-05T03:52:13.032+0100 [mongosMain] connection accepted from 172.28.0.163:49505 #1420606 (400 connections now open) 2015-10-05T03:52:13.033+0100 [conn1420606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:13.670+0100 [conn1420218] end connection 172.28.0.163:63330 (399 connections now open) 2015-10-05T03:52:13.671+0100 [mongosMain] connection accepted from 172.28.0.163:49507 #1420607 (400 connections now open) 2015-10-05T03:52:13.673+0100 [conn1420607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:13.840+0100 [conn1420123] end connection 172.28.0.164:55557 (399 connections now open) 2015-10-05T03:52:13.841+0100 [mongosMain] connection accepted from 172.28.0.164:58914 #1420608 (400 connections now open) 2015-10-05T03:52:13.843+0100 [conn1420608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:14.355+0100 [conn1420196] end connection 172.28.0.164:56282 (399 connections now open) 2015-10-05T03:52:14.357+0100 [mongosMain] connection accepted from 172.28.0.164:58918 #1420609 (400 connections now open) 2015-10-05T03:52:14.359+0100 [conn1420609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:16.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5e05703b51053eac705 2015-10-05T03:52:16.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:16.774+0100 [conn1420129] end connection 172.28.0.163:62544 (399 connections now open) 2015-10-05T03:52:16.774+0100 [conn1420198] end connection 172.28.0.163:63272 (399 connections now open) 2015-10-05T03:52:16.775+0100 [mongosMain] connection accepted from 172.28.0.163:49532 #1420610 (399 connections now open) 2015-10-05T03:52:16.775+0100 [mongosMain] connection accepted from 172.28.0.163:49533 #1420611 (400 connections now open) 2015-10-05T03:52:16.775+0100 [conn1420610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:16.776+0100 [conn1420611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:21.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:52:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:52:21.828+0100 [conn1420191] end connection 172.28.0.164:56263 (399 connections now open) 2015-10-05T03:52:21.829+0100 [mongosMain] connection accepted from 172.28.0.164:58952 #1420612 (400 connections now open) 2015-10-05T03:52:21.830+0100 [conn1420612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:22.296+0100 [conn1420224] end connection 172.28.0.164:56396 (399 connections now open) 2015-10-05T03:52:22.297+0100 [mongosMain] connection accepted from 172.28.0.164:58956 #1420613 (400 connections now open) 2015-10-05T03:52:22.299+0100 [conn1420613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:22.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5e65703b51053eac718 2015-10-05T03:52:23.030+0100 [conn1420202] end connection 172.28.0.163:63288 (399 connections now open) 2015-10-05T03:52:23.031+0100 [mongosMain] connection accepted from 172.28.0.163:49565 #1420614 (400 connections now open) 2015-10-05T03:52:23.033+0100 [conn1420614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:23.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:23.685+0100 [conn1420226] end connection 172.28.0.163:63386 (399 connections now open) 2015-10-05T03:52:23.686+0100 [mongosMain] connection accepted from 172.28.0.163:49569 #1420615 (400 connections now open) 2015-10-05T03:52:23.687+0100 [conn1420615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:23.856+0100 [conn1420170] end connection 172.28.0.164:56083 (399 connections now open) 2015-10-05T03:52:23.857+0100 [mongosMain] connection accepted from 172.28.0.164:58970 #1420616 (400 connections now open) 2015-10-05T03:52:23.859+0100 [conn1420616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:24.370+0100 [conn1420213] end connection 172.28.0.164:56334 (399 connections now open) 2015-10-05T03:52:24.372+0100 [mongosMain] connection accepted from 172.28.0.164:58975 #1420617 (400 connections now open) 2015-10-05T03:52:24.373+0100 [conn1420617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:26.777+0100 [conn1420207] end connection 172.28.0.163:63296 (399 connections now open) 2015-10-05T03:52:26.777+0100 [conn1420147] end connection 172.28.0.163:62923 (399 connections now open) 2015-10-05T03:52:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:49583 #1420618 (399 connections now open) 2015-10-05T03:52:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:49584 #1420619 (400 connections now open) 2015-10-05T03:52:26.780+0100 [conn1420618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:26.780+0100 [conn1420619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:28.291+0100 [mongosMain] connection accepted from 127.0.0.1:49596 #1420620 (401 connections now open) 2015-10-05T03:52:28.293+0100 [conn1420620] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:28.298+0100 [conn1420620] end connection 127.0.0.1:49596 (400 connections now open) 2015-10-05T03:52:29.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5ed5703b51053eac729 2015-10-05T03:52:29.541+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:31.844+0100 [conn1420183] end connection 172.28.0.164:56191 (399 connections now open) 2015-10-05T03:52:31.845+0100 [mongosMain] connection accepted from 172.28.0.164:59019 #1420621 (400 connections now open) 2015-10-05T03:52:31.847+0100 [conn1420621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:32.312+0100 [conn1420231] end connection 172.28.0.164:56452 (399 connections now open) 2015-10-05T03:52:32.313+0100 [mongosMain] connection accepted from 172.28.0.164:59024 #1420622 (400 connections now open) 2015-10-05T03:52:32.315+0100 [conn1420622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:33.046+0100 [conn1420210] end connection 172.28.0.163:63305 (399 connections now open) 2015-10-05T03:52:33.047+0100 [mongosMain] connection accepted from 172.28.0.163:49624 #1420623 (400 connections now open) 2015-10-05T03:52:33.048+0100 [conn1420623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:33.686+0100 [conn1420233] end connection 172.28.0.163:63440 (399 connections now open) 2015-10-05T03:52:33.687+0100 [mongosMain] connection accepted from 172.28.0.163:49630 #1420624 (400 connections now open) 2015-10-05T03:52:33.688+0100 [conn1420624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:33.871+0100 [conn1420134] end connection 172.28.0.164:55725 (399 connections now open) 2015-10-05T03:52:33.873+0100 [mongosMain] connection accepted from 172.28.0.164:59038 #1420625 (400 connections now open) 2015-10-05T03:52:33.875+0100 [conn1420625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:35.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5f35703b51053eac73f 2015-10-05T03:52:35.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:36.791+0100 [conn1420206] end connection 172.28.0.163:63295 (399 connections now open) 2015-10-05T03:52:36.791+0100 [conn1420236] end connection 172.28.0.163:63454 (399 connections now open) 2015-10-05T03:52:36.792+0100 [mongosMain] connection accepted from 172.28.0.163:49650 #1420626 (399 connections now open) 2015-10-05T03:52:36.792+0100 [mongosMain] connection accepted from 172.28.0.163:49651 #1420627 (400 connections now open) 2015-10-05T03:52:36.793+0100 [conn1420626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:36.793+0100 [conn1420627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:39.822+0100 [mongosMain] connection accepted from 127.0.0.1:49668 #1420628 (401 connections now open) 2015-10-05T03:52:39.825+0100 [conn1420628] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:39.830+0100 [conn1420628] end connection 127.0.0.1:49668 (400 connections now open) 2015-10-05T03:52:41.843+0100 [conn1420215] end connection 172.28.0.164:56345 (399 connections now open) 2015-10-05T03:52:41.844+0100 [mongosMain] connection accepted from 172.28.0.164:59086 #1420629 (400 connections now open) 2015-10-05T03:52:41.846+0100 [conn1420629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:42.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e5f95703b51053eac759 2015-10-05T03:52:42.312+0100 [conn1420240] end connection 172.28.0.164:56525 (399 connections now open) 2015-10-05T03:52:42.313+0100 [mongosMain] connection accepted from 172.28.0.164:59088 #1420630 (400 connections now open) 2015-10-05T03:52:42.315+0100 [conn1420630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:42.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:43.047+0100 [conn1420225] end connection 172.28.0.163:63381 (399 connections now open) 2015-10-05T03:52:43.048+0100 [mongosMain] connection accepted from 172.28.0.163:49672 #1420631 (400 connections now open) 2015-10-05T03:52:43.048+0100 [conn1420631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:43.701+0100 [conn1420242] end connection 172.28.0.163:63504 (399 connections now open) 2015-10-05T03:52:43.703+0100 [mongosMain] connection accepted from 172.28.0.163:49674 #1420632 (400 connections now open) 2015-10-05T03:52:43.704+0100 [conn1420632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:43.887+0100 [conn1420136] end connection 172.28.0.164:55776 (399 connections now open) 2015-10-05T03:52:43.888+0100 [mongosMain] connection accepted from 172.28.0.164:59090 #1420633 (400 connections now open) 2015-10-05T03:52:43.890+0100 [conn1420633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:44.402+0100 [conn1420235] end connection 172.28.0.164:56466 (399 connections now open) 2015-10-05T03:52:44.404+0100 [mongosMain] connection accepted from 172.28.0.164:59093 #1420634 (400 connections now open) 2015-10-05T03:52:44.406+0100 [conn1420634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:46.790+0100 [conn1420221] end connection 172.28.0.163:63348 (399 connections now open) 2015-10-05T03:52:46.791+0100 [conn1420063] end connection 172.28.0.163:61799 (398 connections now open) 2015-10-05T03:52:46.792+0100 [mongosMain] connection accepted from 172.28.0.163:49679 #1420635 (399 connections now open) 2015-10-05T03:52:46.792+0100 [mongosMain] connection accepted from 172.28.0.163:49680 #1420636 (400 connections now open) 2015-10-05T03:52:46.793+0100 [conn1420636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:46.793+0100 [conn1420635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:48.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6005703b51053eac770 2015-10-05T03:52:48.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:51.738+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:52:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:52:51.844+0100 [conn1420208] end connection 172.28.0.164:56326 (399 connections now open) 2015-10-05T03:52:51.845+0100 [mongosMain] connection accepted from 172.28.0.164:59103 #1420637 (400 connections now open) 2015-10-05T03:52:51.846+0100 [conn1420637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:52.312+0100 [conn1420248] end connection 172.28.0.164:56584 (399 connections now open) 2015-10-05T03:52:52.313+0100 [mongosMain] connection accepted from 172.28.0.164:59107 #1420638 (400 connections now open) 2015-10-05T03:52:52.315+0100 [conn1420638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:53.062+0100 [conn1420217] end connection 172.28.0.163:63327 (399 connections now open) 2015-10-05T03:52:53.063+0100 [mongosMain] connection accepted from 172.28.0.163:49689 #1420639 (400 connections now open) 2015-10-05T03:52:53.064+0100 [conn1420639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:53.702+0100 [conn1420250] end connection 172.28.0.163:63539 (399 connections now open) 2015-10-05T03:52:53.703+0100 [mongosMain] connection accepted from 172.28.0.163:49691 #1420640 (400 connections now open) 2015-10-05T03:52:53.704+0100 [conn1420640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:53.903+0100 [conn1420181] end connection 172.28.0.164:56154 (399 connections now open) 2015-10-05T03:52:53.904+0100 [mongosMain] connection accepted from 172.28.0.164:59109 #1420641 (400 connections now open) 2015-10-05T03:52:53.906+0100 [conn1420641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:54.418+0100 [conn1420220] end connection 172.28.0.164:56364 (399 connections now open) 2015-10-05T03:52:54.418+0100 [mongosMain] connection accepted from 172.28.0.164:59112 #1420642 (400 connections now open) 2015-10-05T03:52:54.420+0100 [conn1420642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:54.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6065703b51053eac780 2015-10-05T03:52:55.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:52:56.806+0100 [conn1420214] end connection 172.28.0.163:63313 (399 connections now open) 2015-10-05T03:52:56.806+0100 [conn1420244] end connection 172.28.0.163:63522 (399 connections now open) 2015-10-05T03:52:56.807+0100 [mongosMain] connection accepted from 172.28.0.163:49697 #1420643 (399 connections now open) 2015-10-05T03:52:56.807+0100 [mongosMain] connection accepted from 172.28.0.163:49696 #1420644 (400 connections now open) 2015-10-05T03:52:56.808+0100 [conn1420643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:52:56.808+0100 [conn1420644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:01.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e60d5703b51053eac78d 2015-10-05T03:53:01.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:01.859+0100 [conn1420200] end connection 172.28.0.164:56309 (399 connections now open) 2015-10-05T03:53:01.860+0100 [mongosMain] connection accepted from 172.28.0.164:59124 #1420645 (400 connections now open) 2015-10-05T03:53:01.862+0100 [conn1420645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:02.328+0100 [conn1420256] end connection 172.28.0.164:56601 (399 connections now open) 2015-10-05T03:53:02.329+0100 [mongosMain] connection accepted from 172.28.0.164:59127 #1420646 (400 connections now open) 2015-10-05T03:53:02.330+0100 [conn1420646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:03.062+0100 [conn1420232] end connection 172.28.0.163:63436 (399 connections now open) 2015-10-05T03:53:03.063+0100 [mongosMain] connection accepted from 172.28.0.163:49723 #1420647 (400 connections now open) 2015-10-05T03:53:03.064+0100 [conn1420647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:03.717+0100 [conn1420258] end connection 172.28.0.163:63559 (399 connections now open) 2015-10-05T03:53:03.718+0100 [mongosMain] connection accepted from 172.28.0.163:49727 #1420648 (400 connections now open) 2015-10-05T03:53:03.720+0100 [conn1420648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:03.919+0100 [conn1420187] end connection 172.28.0.164:56210 (399 connections now open) 2015-10-05T03:53:03.920+0100 [mongosMain] connection accepted from 172.28.0.164:59135 #1420649 (400 connections now open) 2015-10-05T03:53:03.922+0100 [conn1420649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:04.434+0100 [conn1420228] end connection 172.28.0.164:56407 (399 connections now open) 2015-10-05T03:53:04.436+0100 [mongosMain] connection accepted from 172.28.0.164:59139 #1420650 (400 connections now open) 2015-10-05T03:53:04.437+0100 [conn1420650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:06.806+0100 [conn1420229] end connection 172.28.0.163:63401 (399 connections now open) 2015-10-05T03:53:06.806+0100 [conn1420197] end connection 172.28.0.163:63271 (398 connections now open) 2015-10-05T03:53:06.807+0100 [mongosMain] connection accepted from 172.28.0.163:49745 #1420651 (399 connections now open) 2015-10-05T03:53:06.808+0100 [mongosMain] connection accepted from 172.28.0.163:49746 #1420652 (400 connections now open) 2015-10-05T03:53:06.808+0100 [conn1420651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:06.809+0100 [conn1420652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:07.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6135703b51053eac7c7 2015-10-05T03:53:07.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:11.875+0100 [conn1420230] end connection 172.28.0.164:56446 (399 connections now open) 2015-10-05T03:53:11.876+0100 [mongosMain] connection accepted from 172.28.0.164:59182 #1420653 (400 connections now open) 2015-10-05T03:53:11.877+0100 [conn1420653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:12.343+0100 [conn1420264] end connection 172.28.0.164:56616 (399 connections now open) 2015-10-05T03:53:12.344+0100 [mongosMain] connection accepted from 172.28.0.164:59187 #1420654 (400 connections now open) 2015-10-05T03:53:12.345+0100 [conn1420654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:13.078+0100 [conn1420241] end connection 172.28.0.163:63499 (399 connections now open) 2015-10-05T03:53:13.079+0100 [mongosMain] connection accepted from 172.28.0.163:49790 #1420655 (400 connections now open) 2015-10-05T03:53:13.081+0100 [conn1420655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:13.733+0100 [conn1420266] end connection 172.28.0.163:63590 (399 connections now open) 2015-10-05T03:53:13.735+0100 [mongosMain] connection accepted from 172.28.0.163:49793 #1420656 (400 connections now open) 2015-10-05T03:53:13.736+0100 [conn1420656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:13.919+0100 [conn1420127] end connection 172.28.0.164:55596 (399 connections now open) 2015-10-05T03:53:13.920+0100 [mongosMain] connection accepted from 172.28.0.164:59195 #1420657 (400 connections now open) 2015-10-05T03:53:13.922+0100 [conn1420657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:14.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6195703b51053eac7de 2015-10-05T03:53:14.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:14.449+0100 [conn1420260] end connection 172.28.0.164:56606 (399 connections now open) 2015-10-05T03:53:14.450+0100 [mongosMain] connection accepted from 172.28.0.164:59198 #1420658 (400 connections now open) 2015-10-05T03:53:14.452+0100 [conn1420658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:16.821+0100 [conn1420269] end connection 172.28.0.163:63608 (399 connections now open) 2015-10-05T03:53:16.821+0100 [conn1420222] end connection 172.28.0.163:63349 (399 connections now open) 2015-10-05T03:53:16.823+0100 [mongosMain] connection accepted from 172.28.0.163:49815 #1420659 (399 connections now open) 2015-10-05T03:53:16.824+0100 [mongosMain] connection accepted from 172.28.0.163:49816 #1420660 (400 connections now open) 2015-10-05T03:53:16.824+0100 [conn1420659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:16.825+0100 [conn1420660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:20.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6205703b51053eac7e6 2015-10-05T03:53:20.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:21.875+0100 [conn1420223] end connection 172.28.0.164:56393 (399 connections now open) 2015-10-05T03:53:21.877+0100 [mongosMain] connection accepted from 172.28.0.164:59241 #1420661 (400 connections now open) 2015-10-05T03:53:21.879+0100 [conn1420661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:22.015+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:53:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:53:22.343+0100 [conn1420272] end connection 172.28.0.164:56661 (399 connections now open) 2015-10-05T03:53:22.344+0100 [mongosMain] connection accepted from 172.28.0.164:59246 #1420662 (400 connections now open) 2015-10-05T03:53:22.345+0100 [conn1420662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:23.093+0100 [conn1420249] end connection 172.28.0.163:63536 (399 connections now open) 2015-10-05T03:53:23.095+0100 [mongosMain] connection accepted from 172.28.0.163:49846 #1420663 (400 connections now open) 2015-10-05T03:53:23.096+0100 [conn1420663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:23.733+0100 [conn1420274] end connection 172.28.0.163:63639 (399 connections now open) 2015-10-05T03:53:23.734+0100 [mongosMain] connection accepted from 172.28.0.163:49851 #1420664 (400 connections now open) 2015-10-05T03:53:23.736+0100 [conn1420664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:23.934+0100 [conn1420195] end connection 172.28.0.164:56279 (399 connections now open) 2015-10-05T03:53:23.936+0100 [mongosMain] connection accepted from 172.28.0.164:59257 #1420665 (400 connections now open) 2015-10-05T03:53:23.937+0100 [conn1420665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:26.826+0100 [conn1420262] end connection 172.28.0.163:63565 (399 connections now open) 2015-10-05T03:53:26.826+0100 [conn1420125] end connection 172.28.0.163:62517 (399 connections now open) 2015-10-05T03:53:26.827+0100 [mongosMain] connection accepted from 172.28.0.163:49867 #1420666 (399 connections now open) 2015-10-05T03:53:26.827+0100 [mongosMain] connection accepted from 172.28.0.163:49868 #1420667 (400 connections now open) 2015-10-05T03:53:26.828+0100 [conn1420666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:26.829+0100 [conn1420667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:26.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6265703b51053eac7fc 2015-10-05T03:53:26.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:28.638+0100 [mongosMain] connection accepted from 127.0.0.1:49878 #1420668 (401 connections now open) 2015-10-05T03:53:28.641+0100 [conn1420668] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:28.646+0100 [conn1420668] end connection 127.0.0.1:49878 (400 connections now open) 2015-10-05T03:53:31.891+0100 [conn1420247] end connection 172.28.0.164:56581 (399 connections now open) 2015-10-05T03:53:31.892+0100 [mongosMain] connection accepted from 172.28.0.164:59317 #1420669 (400 connections now open) 2015-10-05T03:53:31.893+0100 [conn1420669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:32.359+0100 [conn1420280] end connection 172.28.0.164:56705 (399 connections now open) 2015-10-05T03:53:32.360+0100 [mongosMain] connection accepted from 172.28.0.164:59320 #1420670 (400 connections now open) 2015-10-05T03:53:32.361+0100 [conn1420670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:33.094+0100 [conn1420265] end connection 172.28.0.163:63588 (399 connections now open) 2015-10-05T03:53:33.096+0100 [mongosMain] connection accepted from 172.28.0.163:49901 #1420671 (400 connections now open) 2015-10-05T03:53:33.096+0100 [conn1420671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:33.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e62c5703b51053eac816 2015-10-05T03:53:33.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:33.748+0100 [conn1420282] end connection 172.28.0.163:63687 (399 connections now open) 2015-10-05T03:53:33.749+0100 [mongosMain] connection accepted from 172.28.0.163:49906 #1420672 (400 connections now open) 2015-10-05T03:53:33.750+0100 [conn1420672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:33.935+0100 [conn1420176] end connection 172.28.0.164:56104 (399 connections now open) 2015-10-05T03:53:33.935+0100 [mongosMain] connection accepted from 172.28.0.164:59332 #1420673 (400 connections now open) 2015-10-05T03:53:33.937+0100 [conn1420673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:34.466+0100 [conn1420283] end connection 172.28.0.164:56723 (399 connections now open) 2015-10-05T03:53:34.467+0100 [mongosMain] connection accepted from 172.28.0.164:59334 #1420674 (400 connections now open) 2015-10-05T03:53:34.469+0100 [conn1420674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:36.837+0100 [conn1420284] end connection 172.28.0.163:63704 (399 connections now open) 2015-10-05T03:53:36.837+0100 [conn1420254] end connection 172.28.0.163:63547 (399 connections now open) 2015-10-05T03:53:36.838+0100 [mongosMain] connection accepted from 172.28.0.163:49908 #1420675 (399 connections now open) 2015-10-05T03:53:36.839+0100 [mongosMain] connection accepted from 172.28.0.163:49909 #1420676 (400 connections now open) 2015-10-05T03:53:36.839+0100 [conn1420675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:36.840+0100 [conn1420676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:39.462+0100 [mongosMain] connection accepted from 127.0.0.1:49913 #1420677 (401 connections now open) 2015-10-05T03:53:39.465+0100 [conn1420677] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:39.470+0100 [conn1420677] end connection 127.0.0.1:49913 (400 connections now open) 2015-10-05T03:53:39.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6335703b51053eac828 2015-10-05T03:53:39.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:41.891+0100 [conn1420255] end connection 172.28.0.164:56599 (399 connections now open) 2015-10-05T03:53:41.892+0100 [mongosMain] connection accepted from 172.28.0.164:59348 #1420678 (400 connections now open) 2015-10-05T03:53:41.894+0100 [conn1420678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:42.359+0100 [conn1420288] end connection 172.28.0.164:56773 (399 connections now open) 2015-10-05T03:53:42.360+0100 [mongosMain] connection accepted from 172.28.0.164:59350 #1420679 (400 connections now open) 2015-10-05T03:53:42.362+0100 [conn1420679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:43.109+0100 [conn1420257] end connection 172.28.0.163:63557 (399 connections now open) 2015-10-05T03:53:43.110+0100 [mongosMain] connection accepted from 172.28.0.163:49917 #1420680 (400 connections now open) 2015-10-05T03:53:43.112+0100 [conn1420680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:43.749+0100 [conn1420290] end connection 172.28.0.163:63741 (399 connections now open) 2015-10-05T03:53:43.750+0100 [mongosMain] connection accepted from 172.28.0.163:49920 #1420681 (400 connections now open) 2015-10-05T03:53:43.751+0100 [conn1420681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:43.950+0100 [conn1420219] end connection 172.28.0.164:56360 (399 connections now open) 2015-10-05T03:53:43.952+0100 [mongosMain] connection accepted from 172.28.0.164:59353 #1420682 (400 connections now open) 2015-10-05T03:53:43.954+0100 [conn1420682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:44.480+0100 [conn1420268] end connection 172.28.0.164:56625 (399 connections now open) 2015-10-05T03:53:44.482+0100 [mongosMain] connection accepted from 172.28.0.164:59355 #1420683 (400 connections now open) 2015-10-05T03:53:44.483+0100 [conn1420683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:46.853+0100 [conn1420261] end connection 172.28.0.163:63564 (399 connections now open) 2015-10-05T03:53:46.853+0100 [conn1420293] end connection 172.28.0.163:63757 (398 connections now open) 2015-10-05T03:53:46.855+0100 [mongosMain] connection accepted from 172.28.0.163:49926 #1420684 (399 connections now open) 2015-10-05T03:53:46.856+0100 [mongosMain] connection accepted from 172.28.0.163:49927 #1420685 (400 connections now open) 2015-10-05T03:53:46.856+0100 [conn1420684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:46.857+0100 [conn1420685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:51.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e63f5703b51053eac847 2015-10-05T03:53:51.906+0100 [conn1420271] end connection 172.28.0.164:56657 (399 connections now open) 2015-10-05T03:53:51.907+0100 [mongosMain] connection accepted from 172.28.0.164:59365 #1420686 (400 connections now open) 2015-10-05T03:53:51.909+0100 [conn1420686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:51.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:53:52.272+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:53:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:53:52.375+0100 [conn1420297] end connection 172.28.0.164:56837 (399 connections now open) 2015-10-05T03:53:52.376+0100 [mongosMain] connection accepted from 172.28.0.164:59367 #1420687 (400 connections now open) 2015-10-05T03:53:52.377+0100 [conn1420687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:53.109+0100 [conn1420273] end connection 172.28.0.163:63636 (399 connections now open) 2015-10-05T03:53:53.111+0100 [mongosMain] connection accepted from 172.28.0.163:49936 #1420688 (400 connections now open) 2015-10-05T03:53:53.112+0100 [conn1420688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:53.764+0100 [conn1420299] end connection 172.28.0.163:63806 (399 connections now open) 2015-10-05T03:53:53.765+0100 [mongosMain] connection accepted from 172.28.0.163:49940 #1420689 (400 connections now open) 2015-10-05T03:53:53.766+0100 [conn1420689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:53.966+0100 [conn1420119] end connection 172.28.0.164:55500 (399 connections now open) 2015-10-05T03:53:53.967+0100 [mongosMain] connection accepted from 172.28.0.164:59370 #1420690 (400 connections now open) 2015-10-05T03:53:53.969+0100 [conn1420690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:54.481+0100 [conn1420276] end connection 172.28.0.164:56670 (399 connections now open) 2015-10-05T03:53:54.482+0100 [mongosMain] connection accepted from 172.28.0.164:59373 #1420691 (400 connections now open) 2015-10-05T03:53:54.484+0100 [conn1420691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:56.858+0100 [conn1420253] end connection 172.28.0.163:63546 (399 connections now open) 2015-10-05T03:53:56.858+0100 [conn1420270] end connection 172.28.0.163:63609 (399 connections now open) 2015-10-05T03:53:56.859+0100 [mongosMain] connection accepted from 172.28.0.163:49946 #1420692 (399 connections now open) 2015-10-05T03:53:56.859+0100 [mongosMain] connection accepted from 172.28.0.163:49947 #1420693 (400 connections now open) 2015-10-05T03:53:56.860+0100 [conn1420692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:56.860+0100 [conn1420693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:53:58.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6465703b51053eac854 2015-10-05T03:53:58.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:01.906+0100 [conn1420263] end connection 172.28.0.164:56612 (399 connections now open) 2015-10-05T03:54:01.907+0100 [mongosMain] connection accepted from 172.28.0.164:59389 #1420694 (400 connections now open) 2015-10-05T03:54:01.908+0100 [conn1420694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:02.375+0100 [conn1420305] end connection 172.28.0.164:56856 (399 connections now open) 2015-10-05T03:54:02.376+0100 [mongosMain] connection accepted from 172.28.0.164:59393 #1420695 (400 connections now open) 2015-10-05T03:54:02.378+0100 [conn1420695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:03.125+0100 [conn1420281] end connection 172.28.0.163:63682 (399 connections now open) 2015-10-05T03:54:03.127+0100 [mongosMain] connection accepted from 172.28.0.163:49972 #1420696 (400 connections now open) 2015-10-05T03:54:03.128+0100 [conn1420696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:03.765+0100 [conn1420307] end connection 172.28.0.163:63825 (399 connections now open) 2015-10-05T03:54:03.766+0100 [mongosMain] connection accepted from 172.28.0.163:49978 #1420697 (400 connections now open) 2015-10-05T03:54:03.767+0100 [conn1420697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:03.981+0100 [conn1420204] end connection 172.28.0.164:56314 (399 connections now open) 2015-10-05T03:54:03.982+0100 [mongosMain] connection accepted from 172.28.0.164:59400 #1420698 (400 connections now open) 2015-10-05T03:54:03.984+0100 [conn1420698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:04.496+0100 [conn1420252] end connection 172.28.0.164:56589 (399 connections now open) 2015-10-05T03:54:04.497+0100 [mongosMain] connection accepted from 172.28.0.164:59403 #1420699 (400 connections now open) 2015-10-05T03:54:04.498+0100 [conn1420699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:04.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e64c5703b51053eac87b 2015-10-05T03:54:04.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:06.869+0100 [conn1420245] end connection 172.28.0.163:63523 (399 connections now open) 2015-10-05T03:54:06.869+0100 [conn1420277] end connection 172.28.0.163:63654 (399 connections now open) 2015-10-05T03:54:06.870+0100 [mongosMain] connection accepted from 172.28.0.163:50000 #1420700 (399 connections now open) 2015-10-05T03:54:06.871+0100 [mongosMain] connection accepted from 172.28.0.163:50001 #1420701 (400 connections now open) 2015-10-05T03:54:06.871+0100 [conn1420700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:06.872+0100 [conn1420701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:11.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6525703b51053eac89a 2015-10-05T03:54:11.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:11.923+0100 [conn1420279] end connection 172.28.0.164:56703 (399 connections now open) 2015-10-05T03:54:11.924+0100 [mongosMain] connection accepted from 172.28.0.164:59438 #1420702 (400 connections now open) 2015-10-05T03:54:11.926+0100 [conn1420702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:12.391+0100 [conn1420313] end connection 172.28.0.164:56870 (399 connections now open) 2015-10-05T03:54:12.392+0100 [mongosMain] connection accepted from 172.28.0.164:59444 #1420703 (400 connections now open) 2015-10-05T03:54:12.393+0100 [conn1420703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:13.125+0100 [conn1420289] end connection 172.28.0.163:63736 (399 connections now open) 2015-10-05T03:54:13.126+0100 [mongosMain] connection accepted from 172.28.0.163:50043 #1420704 (400 connections now open) 2015-10-05T03:54:13.127+0100 [conn1420704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:13.780+0100 [conn1420315] end connection 172.28.0.163:63851 (399 connections now open) 2015-10-05T03:54:13.781+0100 [mongosMain] connection accepted from 172.28.0.163:50046 #1420705 (400 connections now open) 2015-10-05T03:54:13.782+0100 [conn1420705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:13.982+0100 [conn1420251] end connection 172.28.0.164:56587 (399 connections now open) 2015-10-05T03:54:13.984+0100 [mongosMain] connection accepted from 172.28.0.164:59448 #1420706 (400 connections now open) 2015-10-05T03:54:13.985+0100 [conn1420706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:14.512+0100 [conn1420309] end connection 172.28.0.164:56859 (399 connections now open) 2015-10-05T03:54:14.514+0100 [mongosMain] connection accepted from 172.28.0.164:59452 #1420707 (400 connections now open) 2015-10-05T03:54:14.515+0100 [conn1420707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:16.869+0100 [conn1420278] end connection 172.28.0.163:63655 (399 connections now open) 2015-10-05T03:54:16.870+0100 [conn1420303] end connection 172.28.0.163:63813 (399 connections now open) 2015-10-05T03:54:16.871+0100 [mongosMain] connection accepted from 172.28.0.163:50064 #1420708 (399 connections now open) 2015-10-05T03:54:16.871+0100 [mongosMain] connection accepted from 172.28.0.163:50065 #1420709 (400 connections now open) 2015-10-05T03:54:16.872+0100 [conn1420708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:16.872+0100 [conn1420709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:17.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6595703b51053eac8ab 2015-10-05T03:54:17.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:21.923+0100 [conn1420239] end connection 172.28.0.164:56519 (399 connections now open) 2015-10-05T03:54:21.924+0100 [mongosMain] connection accepted from 172.28.0.164:59505 #1420710 (400 connections now open) 2015-10-05T03:54:21.926+0100 [conn1420710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:22.390+0100 [conn1420321] end connection 172.28.0.164:56939 (399 connections now open) 2015-10-05T03:54:22.391+0100 [mongosMain] connection accepted from 172.28.0.164:59510 #1420711 (400 connections now open) 2015-10-05T03:54:22.393+0100 [conn1420711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:22.544+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:54:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:54:23.141+0100 [conn1420306] end connection 172.28.0.163:63822 (399 connections now open) 2015-10-05T03:54:23.142+0100 [mongosMain] connection accepted from 172.28.0.163:50095 #1420712 (400 connections now open) 2015-10-05T03:54:23.143+0100 [conn1420712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:23.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e65f5703b51053eac8b7 2015-10-05T03:54:23.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:23.796+0100 [conn1420323] end connection 172.28.0.163:63928 (399 connections now open) 2015-10-05T03:54:23.797+0100 [mongosMain] connection accepted from 172.28.0.163:50101 #1420713 (400 connections now open) 2015-10-05T03:54:23.799+0100 [conn1420713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:23.982+0100 [conn1420267] end connection 172.28.0.164:56622 (399 connections now open) 2015-10-05T03:54:23.983+0100 [mongosMain] connection accepted from 172.28.0.164:59522 #1420714 (400 connections now open) 2015-10-05T03:54:23.985+0100 [conn1420714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:24.528+0100 [conn1420324] end connection 172.28.0.164:56948 (399 connections now open) 2015-10-05T03:54:24.529+0100 [mongosMain] connection accepted from 172.28.0.164:59530 #1420715 (400 connections now open) 2015-10-05T03:54:24.531+0100 [conn1420715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:26.884+0100 [conn1420310] end connection 172.28.0.163:63830 (399 connections now open) 2015-10-05T03:54:26.884+0100 [conn1420294] end connection 172.28.0.163:63758 (399 connections now open) 2015-10-05T03:54:26.885+0100 [mongosMain] connection accepted from 172.28.0.163:50122 #1420716 (399 connections now open) 2015-10-05T03:54:26.886+0100 [mongosMain] connection accepted from 172.28.0.163:50123 #1420717 (400 connections now open) 2015-10-05T03:54:26.886+0100 [conn1420716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:26.886+0100 [conn1420717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:28.624+0100 [mongosMain] connection accepted from 127.0.0.1:50136 #1420718 (401 connections now open) 2015-10-05T03:54:28.628+0100 [conn1420718] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:28.633+0100 [conn1420718] end connection 127.0.0.1:50136 (400 connections now open) 2015-10-05T03:54:30.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6655703b51053eac8cb 2015-10-05T03:54:30.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:31.938+0100 [conn1420296] end connection 172.28.0.164:56834 (399 connections now open) 2015-10-05T03:54:31.940+0100 [mongosMain] connection accepted from 172.28.0.164:59586 #1420719 (400 connections now open) 2015-10-05T03:54:31.941+0100 [conn1420719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:32.406+0100 [conn1420328] end connection 172.28.0.164:57002 (399 connections now open) 2015-10-05T03:54:32.407+0100 [mongosMain] connection accepted from 172.28.0.164:59592 #1420720 (400 connections now open) 2015-10-05T03:54:32.409+0100 [conn1420720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:33.141+0100 [conn1420298] end connection 172.28.0.163:63803 (399 connections now open) 2015-10-05T03:54:33.142+0100 [mongosMain] connection accepted from 172.28.0.163:50166 #1420721 (400 connections now open) 2015-10-05T03:54:33.143+0100 [conn1420721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:33.796+0100 [conn1420330] end connection 172.28.0.163:63980 (399 connections now open) 2015-10-05T03:54:33.797+0100 [mongosMain] connection accepted from 172.28.0.163:50172 #1420722 (400 connections now open) 2015-10-05T03:54:33.798+0100 [conn1420722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:33.998+0100 [conn1420259] end connection 172.28.0.164:56604 (399 connections now open) 2015-10-05T03:54:34.004+0100 [mongosMain] connection accepted from 172.28.0.164:59602 #1420723 (400 connections now open) 2015-10-05T03:54:34.006+0100 [conn1420723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:34.543+0100 [conn1420317] end connection 172.28.0.164:56889 (399 connections now open) 2015-10-05T03:54:34.544+0100 [mongosMain] connection accepted from 172.28.0.164:59612 #1420724 (400 connections now open) 2015-10-05T03:54:34.546+0100 [conn1420724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:36.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e66c5703b51053eac8dc 2015-10-05T03:54:36.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:36.885+0100 [conn1420333] end connection 172.28.0.163:63996 (399 connections now open) 2015-10-05T03:54:36.885+0100 [conn1420237] end connection 172.28.0.163:63455 (399 connections now open) 2015-10-05T03:54:36.886+0100 [mongosMain] connection accepted from 172.28.0.163:50183 #1420725 (399 connections now open) 2015-10-05T03:54:36.887+0100 [mongosMain] connection accepted from 172.28.0.163:50184 #1420726 (400 connections now open) 2015-10-05T03:54:36.887+0100 [conn1420725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:36.887+0100 [conn1420726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:40.091+0100 [mongosMain] connection accepted from 127.0.0.1:50187 #1420727 (401 connections now open) 2015-10-05T03:54:40.094+0100 [conn1420727] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:40.099+0100 [conn1420727] end connection 127.0.0.1:50187 (400 connections now open) 2015-10-05T03:54:41.939+0100 [conn1420304] end connection 172.28.0.164:56854 (399 connections now open) 2015-10-05T03:54:41.940+0100 [mongosMain] connection accepted from 172.28.0.164:59629 #1420728 (400 connections now open) 2015-10-05T03:54:41.942+0100 [conn1420728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:42.406+0100 [conn1420337] end connection 172.28.0.164:57061 (399 connections now open) 2015-10-05T03:54:42.407+0100 [mongosMain] connection accepted from 172.28.0.164:59631 #1420729 (400 connections now open) 2015-10-05T03:54:42.409+0100 [conn1420729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:42.775+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6725703b51053eac8fc 2015-10-05T03:54:42.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:43.156+0100 [conn1420322] end connection 172.28.0.163:63919 (399 connections now open) 2015-10-05T03:54:43.157+0100 [mongosMain] connection accepted from 172.28.0.163:50192 #1420730 (400 connections now open) 2015-10-05T03:54:43.158+0100 [conn1420730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:43.813+0100 [conn1420339] end connection 172.28.0.163:64042 (399 connections now open) 2015-10-05T03:54:43.814+0100 [mongosMain] connection accepted from 172.28.0.163:50194 #1420731 (400 connections now open) 2015-10-05T03:54:43.815+0100 [conn1420731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:43.998+0100 [conn1420243] end connection 172.28.0.164:56538 (399 connections now open) 2015-10-05T03:54:43.999+0100 [mongosMain] connection accepted from 172.28.0.164:59634 #1420732 (400 connections now open) 2015-10-05T03:54:44.001+0100 [conn1420732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:44.544+0100 [conn1420332] end connection 172.28.0.164:57016 (399 connections now open) 2015-10-05T03:54:44.545+0100 [mongosMain] connection accepted from 172.28.0.164:59637 #1420733 (400 connections now open) 2015-10-05T03:54:44.547+0100 [conn1420733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:46.900+0100 [conn1420318] end connection 172.28.0.163:63876 (399 connections now open) 2015-10-05T03:54:46.900+0100 [conn1420334] end connection 172.28.0.163:63997 (399 connections now open) 2015-10-05T03:54:46.901+0100 [mongosMain] connection accepted from 172.28.0.163:50199 #1420734 (399 connections now open) 2015-10-05T03:54:46.901+0100 [mongosMain] connection accepted from 172.28.0.163:50200 #1420735 (400 connections now open) 2015-10-05T03:54:46.902+0100 [conn1420734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:46.902+0100 [conn1420735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:49.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6785703b51053eac91e 2015-10-05T03:54:49.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:54:51.953+0100 [conn1420287] end connection 172.28.0.164:56769 (399 connections now open) 2015-10-05T03:54:51.954+0100 [mongosMain] connection accepted from 172.28.0.164:59647 #1420736 (400 connections now open) 2015-10-05T03:54:51.956+0100 [conn1420736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:52.421+0100 [conn1420346] end connection 172.28.0.164:57100 (399 connections now open) 2015-10-05T03:54:52.422+0100 [mongosMain] connection accepted from 172.28.0.164:59649 #1420737 (400 connections now open) 2015-10-05T03:54:52.424+0100 [conn1420737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:52.820+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:54:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:54:53.171+0100 [conn1420314] end connection 172.28.0.163:63844 (399 connections now open) 2015-10-05T03:54:53.172+0100 [mongosMain] connection accepted from 172.28.0.163:50210 #1420738 (400 connections now open) 2015-10-05T03:54:53.173+0100 [conn1420738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:53.811+0100 [conn1420348] end connection 172.28.0.163:64068 (399 connections now open) 2015-10-05T03:54:53.812+0100 [mongosMain] connection accepted from 172.28.0.163:50212 #1420739 (400 connections now open) 2015-10-05T03:54:53.813+0100 [conn1420739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:54.013+0100 [conn1420291] end connection 172.28.0.164:56782 (399 connections now open) 2015-10-05T03:54:54.014+0100 [mongosMain] connection accepted from 172.28.0.164:59651 #1420740 (400 connections now open) 2015-10-05T03:54:54.016+0100 [conn1420740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:54.558+0100 [conn1420301] end connection 172.28.0.164:56843 (399 connections now open) 2015-10-05T03:54:54.560+0100 [mongosMain] connection accepted from 172.28.0.164:59655 #1420741 (400 connections now open) 2015-10-05T03:54:54.562+0100 [conn1420741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:56.916+0100 [conn1420285] end connection 172.28.0.163:63705 (399 connections now open) 2015-10-05T03:54:56.916+0100 [conn1420325] end connection 172.28.0.163:63940 (398 connections now open) 2015-10-05T03:54:56.917+0100 [mongosMain] connection accepted from 172.28.0.163:50218 #1420742 (399 connections now open) 2015-10-05T03:54:56.918+0100 [mongosMain] connection accepted from 172.28.0.163:50219 #1420743 (400 connections now open) 2015-10-05T03:54:56.918+0100 [conn1420742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:54:56.920+0100 [conn1420743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:01.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6855703b51053eac940 2015-10-05T03:55:01.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:02.437+0100 [conn1420354] end connection 172.28.0.164:57119 (399 connections now open) 2015-10-05T03:55:02.438+0100 [mongosMain] connection accepted from 172.28.0.164:59669 #1420744 (400 connections now open) 2015-10-05T03:55:02.439+0100 [conn1420744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:03.172+0100 [conn1420329] end connection 172.28.0.163:63975 (399 connections now open) 2015-10-05T03:55:03.173+0100 [mongosMain] connection accepted from 172.28.0.163:50249 #1420745 (400 connections now open) 2015-10-05T03:55:03.175+0100 [conn1420745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:03.827+0100 [conn1420356] end connection 172.28.0.163:64085 (399 connections now open) 2015-10-05T03:55:03.828+0100 [mongosMain] connection accepted from 172.28.0.163:50253 #1420746 (400 connections now open) 2015-10-05T03:55:03.829+0100 [conn1420746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:04.028+0100 [conn1420227] end connection 172.28.0.164:56403 (399 connections now open) 2015-10-05T03:55:04.030+0100 [mongosMain] connection accepted from 172.28.0.164:59678 #1420747 (400 connections now open) 2015-10-05T03:55:04.031+0100 [conn1420747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:04.574+0100 [conn1420341] end connection 172.28.0.164:57079 (399 connections now open) 2015-10-05T03:55:04.575+0100 [mongosMain] connection accepted from 172.28.0.164:59683 #1420748 (400 connections now open) 2015-10-05T03:55:04.577+0100 [conn1420748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:06.918+0100 [conn1420311] end connection 172.28.0.163:63831 (399 connections now open) 2015-10-05T03:55:06.918+0100 [conn1420343] end connection 172.28.0.163:64058 (398 connections now open) 2015-10-05T03:55:06.920+0100 [mongosMain] connection accepted from 172.28.0.163:50277 #1420749 (399 connections now open) 2015-10-05T03:55:06.921+0100 [mongosMain] connection accepted from 172.28.0.163:50276 #1420750 (400 connections now open) 2015-10-05T03:55:06.921+0100 [conn1420750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:06.922+0100 [conn1420749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:08.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e68b5703b51053eac97d 2015-10-05T03:55:08.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:11.985+0100 [conn1420345] end connection 172.28.0.164:57098 (399 connections now open) 2015-10-05T03:55:11.986+0100 [mongosMain] connection accepted from 172.28.0.164:59718 #1420751 (400 connections now open) 2015-10-05T03:55:11.988+0100 [conn1420751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:12.452+0100 [conn1420362] end connection 172.28.0.164:57141 (399 connections now open) 2015-10-05T03:55:12.454+0100 [mongosMain] connection accepted from 172.28.0.164:59724 #1420752 (400 connections now open) 2015-10-05T03:55:12.456+0100 [conn1420752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:13.187+0100 [conn1420338] end connection 172.28.0.163:64035 (399 connections now open) 2015-10-05T03:55:13.189+0100 [mongosMain] connection accepted from 172.28.0.163:50316 #1420753 (400 connections now open) 2015-10-05T03:55:13.190+0100 [conn1420753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:13.827+0100 [conn1420364] end connection 172.28.0.163:64118 (399 connections now open) 2015-10-05T03:55:13.828+0100 [mongosMain] connection accepted from 172.28.0.163:50319 #1420754 (400 connections now open) 2015-10-05T03:55:13.829+0100 [conn1420754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:14.044+0100 [conn1420316] end connection 172.28.0.164:56878 (399 connections now open) 2015-10-05T03:55:14.045+0100 [mongosMain] connection accepted from 172.28.0.164:59727 #1420755 (400 connections now open) 2015-10-05T03:55:14.046+0100 [conn1420755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:14.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6925703b51053eac992 2015-10-05T03:55:14.574+0100 [conn1420358] end connection 172.28.0.164:57125 (399 connections now open) 2015-10-05T03:55:14.575+0100 [mongosMain] connection accepted from 172.28.0.164:59730 #1420756 (400 connections now open) 2015-10-05T03:55:14.577+0100 [conn1420756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:14.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:16.932+0100 [conn1420359] end connection 172.28.0.163:64092 (399 connections now open) 2015-10-05T03:55:16.932+0100 [conn1420326] end connection 172.28.0.163:63942 (399 connections now open) 2015-10-05T03:55:16.933+0100 [mongosMain] connection accepted from 172.28.0.163:50347 #1420757 (399 connections now open) 2015-10-05T03:55:16.934+0100 [mongosMain] connection accepted from 172.28.0.163:50348 #1420758 (400 connections now open) 2015-10-05T03:55:16.935+0100 [conn1420757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:16.935+0100 [conn1420758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:20.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6985703b51053eac9a2 2015-10-05T03:55:21.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:21.985+0100 [conn1420312] end connection 172.28.0.164:56866 (399 connections now open) 2015-10-05T03:55:21.986+0100 [mongosMain] connection accepted from 172.28.0.164:59772 #1420759 (400 connections now open) 2015-10-05T03:55:21.987+0100 [conn1420759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:22.453+0100 [conn1420370] end connection 172.28.0.164:57196 (399 connections now open) 2015-10-05T03:55:22.453+0100 [mongosMain] connection accepted from 172.28.0.164:59775 #1420760 (400 connections now open) 2015-10-05T03:55:22.455+0100 [conn1420760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:23.095+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:55:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:55:23.188+0100 [conn1420347] end connection 172.28.0.163:64066 (399 connections now open) 2015-10-05T03:55:23.189+0100 [mongosMain] connection accepted from 172.28.0.163:50381 #1420761 (400 connections now open) 2015-10-05T03:55:23.190+0100 [conn1420761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:23.842+0100 [conn1420372] end connection 172.28.0.163:64184 (399 connections now open) 2015-10-05T03:55:23.844+0100 [mongosMain] connection accepted from 172.28.0.163:50387 #1420762 (400 connections now open) 2015-10-05T03:55:23.844+0100 [conn1420762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:24.059+0100 [conn1420275] end connection 172.28.0.164:56667 (399 connections now open) 2015-10-05T03:55:24.061+0100 [mongosMain] connection accepted from 172.28.0.164:59784 #1420763 (400 connections now open) 2015-10-05T03:55:24.062+0100 [conn1420763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:24.590+0100 [conn1420292] end connection 172.28.0.164:56787 (399 connections now open) 2015-10-05T03:55:24.591+0100 [mongosMain] connection accepted from 172.28.0.164:59792 #1420764 (400 connections now open) 2015-10-05T03:55:24.593+0100 [conn1420764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:26.935+0100 [conn1420368] end connection 172.28.0.163:64136 (399 connections now open) 2015-10-05T03:55:26.935+0100 [conn1420302] end connection 172.28.0.163:63812 (398 connections now open) 2015-10-05T03:55:26.937+0100 [mongosMain] connection accepted from 172.28.0.163:50402 #1420765 (399 connections now open) 2015-10-05T03:55:26.937+0100 [mongosMain] connection accepted from 172.28.0.163:50403 #1420766 (400 connections now open) 2015-10-05T03:55:26.938+0100 [conn1420765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:26.938+0100 [conn1420766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:27.160+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:55:27.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:55:28.421+0100 [mongosMain] connection accepted from 127.0.0.1:50413 #1420767 (401 connections now open) 2015-10-05T03:55:28.423+0100 [conn1420767] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:28.429+0100 [conn1420767] end connection 127.0.0.1:50413 (400 connections now open) 2015-10-05T03:55:31.985+0100 [conn1420320] end connection 172.28.0.164:56933 (399 connections now open) 2015-10-05T03:55:31.986+0100 [mongosMain] connection accepted from 172.28.0.164:59848 #1420768 (400 connections now open) 2015-10-05T03:55:31.987+0100 [conn1420768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:32.453+0100 [conn1420377] end connection 172.28.0.164:57264 (399 connections now open) 2015-10-05T03:55:32.454+0100 [mongosMain] connection accepted from 172.28.0.164:59853 #1420769 (400 connections now open) 2015-10-05T03:55:32.456+0100 [conn1420769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:33.204+0100 [conn1420355] end connection 172.28.0.163:64083 (399 connections now open) 2015-10-05T03:55:33.204+0100 [mongosMain] connection accepted from 172.28.0.163:50448 #1420770 (400 connections now open) 2015-10-05T03:55:33.206+0100 [conn1420770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:33.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6a55703b51053eac9e1 2015-10-05T03:55:33.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:33.844+0100 [conn1420379] end connection 172.28.0.163:64247 (399 connections now open) 2015-10-05T03:55:33.845+0100 [mongosMain] connection accepted from 172.28.0.163:50453 #1420771 (400 connections now open) 2015-10-05T03:55:33.846+0100 [conn1420771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:34.076+0100 [conn1420340] end connection 172.28.0.164:57075 (399 connections now open) 2015-10-05T03:55:34.076+0100 [mongosMain] connection accepted from 172.28.0.164:59866 #1420772 (400 connections now open) 2015-10-05T03:55:34.079+0100 [conn1420772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:34.606+0100 [conn1420350] end connection 172.28.0.164:57105 (399 connections now open) 2015-10-05T03:55:34.607+0100 [mongosMain] connection accepted from 172.28.0.164:59870 #1420773 (400 connections now open) 2015-10-05T03:55:34.609+0100 [conn1420773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:36.949+0100 [conn1420351] end connection 172.28.0.163:64073 (399 connections now open) 2015-10-05T03:55:36.949+0100 [conn1420319] end connection 172.28.0.163:63877 (398 connections now open) 2015-10-05T03:55:36.951+0100 [mongosMain] connection accepted from 172.28.0.163:50461 #1420774 (399 connections now open) 2015-10-05T03:55:36.952+0100 [conn1420774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:36.953+0100 [mongosMain] connection accepted from 172.28.0.163:50463 #1420775 (400 connections now open) 2015-10-05T03:55:36.954+0100 [conn1420775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:39.916+0100 [mongosMain] connection accepted from 127.0.0.1:50464 #1420776 (401 connections now open) 2015-10-05T03:55:39.919+0100 [conn1420776] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:39.924+0100 [conn1420776] end connection 127.0.0.1:50464 (400 connections now open) 2015-10-05T03:55:42.001+0100 [conn1420336] end connection 172.28.0.164:57057 (399 connections now open) 2015-10-05T03:55:42.002+0100 [mongosMain] connection accepted from 172.28.0.164:59883 #1420777 (400 connections now open) 2015-10-05T03:55:42.004+0100 [conn1420777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:42.469+0100 [conn1420386] end connection 172.28.0.164:57321 (399 connections now open) 2015-10-05T03:55:42.470+0100 [mongosMain] connection accepted from 172.28.0.164:59885 #1420778 (400 connections now open) 2015-10-05T03:55:42.476+0100 [conn1420778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:43.203+0100 [conn1420378] end connection 172.28.0.163:64243 (399 connections now open) 2015-10-05T03:55:43.204+0100 [mongosMain] connection accepted from 172.28.0.163:50468 #1420779 (400 connections now open) 2015-10-05T03:55:43.205+0100 [conn1420779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:43.858+0100 [conn1420388] end connection 172.28.0.163:64302 (399 connections now open) 2015-10-05T03:55:43.859+0100 [mongosMain] connection accepted from 172.28.0.163:50470 #1420780 (400 connections now open) 2015-10-05T03:55:43.860+0100 [conn1420780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:44.081+0100 [conn1420308] end connection 172.28.0.164:56858 (399 connections now open) 2015-10-05T03:55:44.082+0100 [mongosMain] connection accepted from 172.28.0.164:59888 #1420781 (400 connections now open) 2015-10-05T03:55:44.100+0100 [conn1420781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:44.606+0100 [conn1420381] end connection 172.28.0.164:57278 (399 connections now open) 2015-10-05T03:55:44.607+0100 [mongosMain] connection accepted from 172.28.0.164:59891 #1420782 (400 connections now open) 2015-10-05T03:55:44.609+0100 [conn1420782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:45.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6b15703b51053eaca0f 2015-10-05T03:55:45.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:46.949+0100 [conn1420342] end connection 172.28.0.163:64057 (399 connections now open) 2015-10-05T03:55:46.950+0100 [conn1420374] end connection 172.28.0.163:64207 (398 connections now open) 2015-10-05T03:55:46.950+0100 [mongosMain] connection accepted from 172.28.0.163:50477 #1420783 (399 connections now open) 2015-10-05T03:55:46.951+0100 [mongosMain] connection accepted from 172.28.0.163:50478 #1420784 (400 connections now open) 2015-10-05T03:55:46.952+0100 [conn1420783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:46.952+0100 [conn1420784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:52.016+0100 [conn1420353] end connection 172.28.0.164:57117 (399 connections now open) 2015-10-05T03:55:52.017+0100 [mongosMain] connection accepted from 172.28.0.164:59900 #1420785 (400 connections now open) 2015-10-05T03:55:52.019+0100 [conn1420785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:52.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6b75703b51053eaca2d 2015-10-05T03:55:52.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:55:52.485+0100 [conn1420395] end connection 172.28.0.164:57354 (399 connections now open) 2015-10-05T03:55:52.486+0100 [mongosMain] connection accepted from 172.28.0.164:59902 #1420786 (400 connections now open) 2015-10-05T03:55:52.488+0100 [conn1420786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:53.219+0100 [conn1420363] end connection 172.28.0.163:64113 (399 connections now open) 2015-10-05T03:55:53.220+0100 [mongosMain] connection accepted from 172.28.0.163:50487 #1420787 (400 connections now open) 2015-10-05T03:55:53.221+0100 [conn1420787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:53.400+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:55:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:55:53.874+0100 [conn1420397] end connection 172.28.0.163:64320 (399 connections now open) 2015-10-05T03:55:53.875+0100 [mongosMain] connection accepted from 172.28.0.163:50489 #1420788 (400 connections now open) 2015-10-05T03:55:53.876+0100 [conn1420788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:54.091+0100 [conn1420331] end connection 172.28.0.164:57012 (399 connections now open) 2015-10-05T03:55:54.092+0100 [mongosMain] connection accepted from 172.28.0.164:59905 #1420789 (400 connections now open) 2015-10-05T03:55:54.095+0100 [conn1420789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:54.622+0100 [conn1420390] end connection 172.28.0.164:57334 (399 connections now open) 2015-10-05T03:55:54.624+0100 [mongosMain] connection accepted from 172.28.0.164:59908 #1420790 (400 connections now open) 2015-10-05T03:55:54.626+0100 [conn1420790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:56.964+0100 [conn1420360] end connection 172.28.0.163:64094 (399 connections now open) 2015-10-05T03:55:56.964+0100 [conn1420383] end connection 172.28.0.163:64261 (398 connections now open) 2015-10-05T03:55:56.965+0100 [mongosMain] connection accepted from 172.28.0.163:50495 #1420791 (399 connections now open) 2015-10-05T03:55:56.967+0100 [conn1420791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:55:56.967+0100 [mongosMain] connection accepted from 172.28.0.163:50497 #1420792 (400 connections now open) 2015-10-05T03:55:56.968+0100 [conn1420792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:02.017+0100 [conn1420361] end connection 172.28.0.164:57137 (399 connections now open) 2015-10-05T03:56:02.018+0100 [mongosMain] connection accepted from 172.28.0.164:59916 #1420793 (400 connections now open) 2015-10-05T03:56:02.022+0100 [conn1420793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:02.485+0100 [conn1420403] end connection 172.28.0.164:57369 (399 connections now open) 2015-10-05T03:56:02.486+0100 [mongosMain] connection accepted from 172.28.0.164:59919 #1420794 (400 connections now open) 2015-10-05T03:56:02.488+0100 [conn1420794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:03.223+0100 [conn1420371] end connection 172.28.0.163:64179 (399 connections now open) 2015-10-05T03:56:03.223+0100 [mongosMain] connection accepted from 172.28.0.163:50518 #1420795 (400 connections now open) 2015-10-05T03:56:03.225+0100 [conn1420795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:03.877+0100 [conn1420405] end connection 172.28.0.163:64340 (399 connections now open) 2015-10-05T03:56:03.878+0100 [mongosMain] connection accepted from 172.28.0.163:50523 #1420796 (400 connections now open) 2015-10-05T03:56:03.880+0100 [conn1420796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:04.107+0100 [conn1420212] end connection 172.28.0.164:56331 (399 connections now open) 2015-10-05T03:56:04.109+0100 [mongosMain] connection accepted from 172.28.0.164:59928 #1420797 (400 connections now open) 2015-10-05T03:56:04.110+0100 [conn1420797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:04.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6c45703b51053eaca6a 2015-10-05T03:56:04.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:56:04.621+0100 [conn1420399] end connection 172.28.0.164:57359 (399 connections now open) 2015-10-05T03:56:04.623+0100 [mongosMain] connection accepted from 172.28.0.164:59932 #1420798 (400 connections now open) 2015-10-05T03:56:04.624+0100 [conn1420798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:06.965+0100 [conn1420391] end connection 172.28.0.163:64309 (399 connections now open) 2015-10-05T03:56:06.965+0100 [conn1420382] end connection 172.28.0.163:64260 (399 connections now open) 2015-10-05T03:56:06.966+0100 [mongosMain] connection accepted from 172.28.0.163:50538 #1420799 (399 connections now open) 2015-10-05T03:56:06.967+0100 [mongosMain] connection accepted from 172.28.0.163:50539 #1420800 (400 connections now open) 2015-10-05T03:56:06.967+0100 [conn1420799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:06.968+0100 [conn1420800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:12.032+0100 [conn1420376] end connection 172.28.0.164:57255 (399 connections now open) 2015-10-05T03:56:12.033+0100 [mongosMain] connection accepted from 172.28.0.164:59973 #1420801 (400 connections now open) 2015-10-05T03:56:12.035+0100 [conn1420801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:12.501+0100 [conn1420411] end connection 172.28.0.164:57390 (399 connections now open) 2015-10-05T03:56:12.502+0100 [mongosMain] connection accepted from 172.28.0.164:59978 #1420802 (400 connections now open) 2015-10-05T03:56:12.504+0100 [conn1420802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:13.235+0100 [conn1420387] end connection 172.28.0.163:64295 (399 connections now open) 2015-10-05T03:56:13.236+0100 [mongosMain] connection accepted from 172.28.0.163:50573 #1420803 (400 connections now open) 2015-10-05T03:56:13.237+0100 [conn1420803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:13.891+0100 [conn1420413] end connection 172.28.0.163:64372 (399 connections now open) 2015-10-05T03:56:13.892+0100 [mongosMain] connection accepted from 172.28.0.163:50576 #1420804 (400 connections now open) 2015-10-05T03:56:13.893+0100 [conn1420804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:14.122+0100 [conn1420357] end connection 172.28.0.164:57122 (399 connections now open) 2015-10-05T03:56:14.123+0100 [mongosMain] connection accepted from 172.28.0.164:59987 #1420805 (400 connections now open) 2015-10-05T03:56:14.124+0100 [conn1420805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:14.638+0100 [conn1420366] end connection 172.28.0.164:57151 (399 connections now open) 2015-10-05T03:56:14.640+0100 [mongosMain] connection accepted from 172.28.0.164:59992 #1420806 (400 connections now open) 2015-10-05T03:56:14.642+0100 [conn1420806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:16.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6d05703b51053eacaa1 2015-10-05T03:56:16.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:56:16.979+0100 [conn1420401] end connection 172.28.0.163:64327 (399 connections now open) 2015-10-05T03:56:16.979+0100 [conn1420352] end connection 172.28.0.163:64075 (399 connections now open) 2015-10-05T03:56:16.980+0100 [mongosMain] connection accepted from 172.28.0.163:50598 #1420807 (399 connections now open) 2015-10-05T03:56:16.980+0100 [mongosMain] connection accepted from 172.28.0.163:50599 #1420808 (400 connections now open) 2015-10-05T03:56:16.981+0100 [conn1420807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:16.981+0100 [conn1420808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:22.032+0100 [conn1420327] end connection 172.28.0.164:56995 (399 connections now open) 2015-10-05T03:56:22.034+0100 [mongosMain] connection accepted from 172.28.0.164:60031 #1420809 (400 connections now open) 2015-10-05T03:56:22.036+0100 [conn1420809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:22.500+0100 [conn1420419] end connection 172.28.0.164:57443 (399 connections now open) 2015-10-05T03:56:22.501+0100 [mongosMain] connection accepted from 172.28.0.164:60034 #1420810 (400 connections now open) 2015-10-05T03:56:22.503+0100 [conn1420810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:23.250+0100 [conn1420396] end connection 172.28.0.163:64318 (399 connections now open) 2015-10-05T03:56:23.251+0100 [mongosMain] connection accepted from 172.28.0.163:50633 #1420811 (400 connections now open) 2015-10-05T03:56:23.252+0100 [conn1420811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:23.553+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:56:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:56:23.890+0100 [conn1420421] end connection 172.28.0.163:64425 (399 connections now open) 2015-10-05T03:56:23.891+0100 [mongosMain] connection accepted from 172.28.0.163:50638 #1420812 (400 connections now open) 2015-10-05T03:56:23.893+0100 [conn1420812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:24.138+0100 [conn1420349] end connection 172.28.0.164:57102 (399 connections now open) 2015-10-05T03:56:24.140+0100 [mongosMain] connection accepted from 172.28.0.164:60047 #1420813 (400 connections now open) 2015-10-05T03:56:24.142+0100 [conn1420813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:24.637+0100 [conn1420407] end connection 172.28.0.164:57374 (399 connections now open) 2015-10-05T03:56:24.639+0100 [mongosMain] connection accepted from 172.28.0.164:60053 #1420814 (400 connections now open) 2015-10-05T03:56:24.640+0100 [conn1420814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:26.995+0100 [conn1420417] end connection 172.28.0.163:64389 (399 connections now open) 2015-10-05T03:56:26.995+0100 [conn1420400] end connection 172.28.0.163:64326 (398 connections now open) 2015-10-05T03:56:26.996+0100 [mongosMain] connection accepted from 172.28.0.163:50657 #1420815 (399 connections now open) 2015-10-05T03:56:26.996+0100 [mongosMain] connection accepted from 172.28.0.163:50658 #1420816 (400 connections now open) 2015-10-05T03:56:26.997+0100 [conn1420815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:26.998+0100 [conn1420816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:28.966+0100 [mongosMain] connection accepted from 127.0.0.1:50676 #1420817 (401 connections now open) 2015-10-05T03:56:28.969+0100 [conn1420817] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:28.975+0100 [conn1420817] end connection 127.0.0.1:50676 (400 connections now open) 2015-10-05T03:56:29.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6dc5703b51053eacad8 2015-10-05T03:56:29.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:56:32.048+0100 [conn1420369] end connection 172.28.0.164:57190 (399 connections now open) 2015-10-05T03:56:32.050+0100 [mongosMain] connection accepted from 172.28.0.164:60101 #1420818 (400 connections now open) 2015-10-05T03:56:32.052+0100 [conn1420818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:32.516+0100 [conn1420426] end connection 172.28.0.164:57500 (399 connections now open) 2015-10-05T03:56:32.518+0100 [mongosMain] connection accepted from 172.28.0.164:60107 #1420819 (400 connections now open) 2015-10-05T03:56:32.519+0100 [conn1420819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:33.251+0100 [conn1420404] end connection 172.28.0.163:64338 (399 connections now open) 2015-10-05T03:56:33.252+0100 [mongosMain] connection accepted from 172.28.0.163:50702 #1420820 (400 connections now open) 2015-10-05T03:56:33.254+0100 [conn1420820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:33.905+0100 [conn1420428] end connection 172.28.0.163:64488 (399 connections now open) 2015-10-05T03:56:33.906+0100 [mongosMain] connection accepted from 172.28.0.163:50708 #1420821 (400 connections now open) 2015-10-05T03:56:33.907+0100 [conn1420821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:34.187+0100 [conn1420373] end connection 172.28.0.164:57203 (399 connections now open) 2015-10-05T03:56:34.189+0100 [mongosMain] connection accepted from 172.28.0.164:60118 #1420822 (400 connections now open) 2015-10-05T03:56:34.190+0100 [conn1420822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:34.653+0100 [conn1420430] end connection 172.28.0.164:57515 (399 connections now open) 2015-10-05T03:56:34.654+0100 [mongosMain] connection accepted from 172.28.0.164:60124 #1420823 (400 connections now open) 2015-10-05T03:56:34.655+0100 [conn1420823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:36.997+0100 [conn1420424] end connection 172.28.0.163:64447 (399 connections now open) 2015-10-05T03:56:36.997+0100 [conn1420409] end connection 172.28.0.163:64347 (399 connections now open) 2015-10-05T03:56:36.998+0100 [mongosMain] connection accepted from 172.28.0.163:50730 #1420824 (399 connections now open) 2015-10-05T03:56:36.998+0100 [mongosMain] connection accepted from 172.28.0.163:50729 #1420825 (400 connections now open) 2015-10-05T03:56:36.999+0100 [conn1420824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:36.999+0100 [conn1420825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:39.629+0100 [mongosMain] connection accepted from 127.0.0.1:50733 #1420826 (401 connections now open) 2015-10-05T03:56:39.631+0100 [conn1420826] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:39.636+0100 [conn1420826] end connection 127.0.0.1:50733 (400 connections now open) 2015-10-05T03:56:42.064+0100 [conn1420394] end connection 172.28.0.164:57352 (399 connections now open) 2015-10-05T03:56:42.065+0100 [mongosMain] connection accepted from 172.28.0.164:60147 #1420827 (400 connections now open) 2015-10-05T03:56:42.067+0100 [conn1420827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:42.533+0100 [conn1420435] end connection 172.28.0.164:57563 (399 connections now open) 2015-10-05T03:56:42.534+0100 [mongosMain] connection accepted from 172.28.0.164:60150 #1420828 (400 connections now open) 2015-10-05T03:56:42.535+0100 [conn1420828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:43.266+0100 [conn1420420] end connection 172.28.0.163:64421 (399 connections now open) 2015-10-05T03:56:43.267+0100 [mongosMain] connection accepted from 172.28.0.163:50739 #1420829 (400 connections now open) 2015-10-05T03:56:43.269+0100 [conn1420829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:43.906+0100 [conn1420437] end connection 172.28.0.163:64536 (399 connections now open) 2015-10-05T03:56:43.907+0100 [mongosMain] connection accepted from 172.28.0.163:50741 #1420830 (400 connections now open) 2015-10-05T03:56:43.908+0100 [conn1420830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:44.186+0100 [conn1420300] end connection 172.28.0.164:56840 (399 connections now open) 2015-10-05T03:56:44.188+0100 [mongosMain] connection accepted from 172.28.0.164:60152 #1420831 (400 connections now open) 2015-10-05T03:56:44.189+0100 [conn1420831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:44.669+0100 [conn1420423] end connection 172.28.0.164:57455 (399 connections now open) 2015-10-05T03:56:44.670+0100 [mongosMain] connection accepted from 172.28.0.164:60156 #1420832 (400 connections now open) 2015-10-05T03:56:44.671+0100 [conn1420832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:47.012+0100 [conn1420441] end connection 172.28.0.163:64551 (399 connections now open) 2015-10-05T03:56:47.012+0100 [conn1420367] end connection 172.28.0.163:64135 (398 connections now open) 2015-10-05T03:56:47.013+0100 [mongosMain] connection accepted from 172.28.0.163:50747 #1420833 (399 connections now open) 2015-10-05T03:56:47.014+0100 [mongosMain] connection accepted from 172.28.0.163:50748 #1420834 (400 connections now open) 2015-10-05T03:56:47.015+0100 [conn1420833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:47.015+0100 [conn1420834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:52.064+0100 [conn1420418] end connection 172.28.0.164:57440 (399 connections now open) 2015-10-05T03:56:52.066+0100 [mongosMain] connection accepted from 172.28.0.164:60165 #1420835 (400 connections now open) 2015-10-05T03:56:52.068+0100 [conn1420835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:52.532+0100 [conn1420444] end connection 172.28.0.164:57608 (399 connections now open) 2015-10-05T03:56:52.534+0100 [mongosMain] connection accepted from 172.28.0.164:60168 #1420836 (400 connections now open) 2015-10-05T03:56:52.536+0100 [conn1420836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:53.266+0100 [conn1420412] end connection 172.28.0.163:64367 (399 connections now open) 2015-10-05T03:56:53.267+0100 [mongosMain] connection accepted from 172.28.0.163:50757 #1420837 (400 connections now open) 2015-10-05T03:56:53.268+0100 [conn1420837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:53.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6f55703b51053eacb5c 2015-10-05T03:56:53.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:56:53.738+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:56:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:56:53.921+0100 [conn1420446] end connection 172.28.0.163:64571 (399 connections now open) 2015-10-05T03:56:53.922+0100 [mongosMain] connection accepted from 172.28.0.163:50759 #1420838 (400 connections now open) 2015-10-05T03:56:53.924+0100 [conn1420838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:54.186+0100 [conn1420406] end connection 172.28.0.164:57372 (399 connections now open) 2015-10-05T03:56:54.187+0100 [mongosMain] connection accepted from 172.28.0.164:60171 #1420839 (400 connections now open) 2015-10-05T03:56:54.188+0100 [conn1420839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:54.686+0100 [conn1420439] end connection 172.28.0.164:57578 (399 connections now open) 2015-10-05T03:56:54.688+0100 [mongosMain] connection accepted from 172.28.0.164:60174 #1420840 (400 connections now open) 2015-10-05T03:56:54.690+0100 [conn1420840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:57.012+0100 [conn1420432] end connection 172.28.0.163:64503 (399 connections now open) 2015-10-05T03:56:57.012+0100 [conn1420431] end connection 172.28.0.163:64502 (399 connections now open) 2015-10-05T03:56:57.013+0100 [mongosMain] connection accepted from 172.28.0.163:50766 #1420841 (399 connections now open) 2015-10-05T03:56:57.014+0100 [mongosMain] connection accepted from 172.28.0.163:50767 #1420842 (400 connections now open) 2015-10-05T03:56:57.014+0100 [conn1420841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:57.015+0100 [conn1420842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:56:59.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e6fb5703b51053eacb7b 2015-10-05T03:56:59.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:02.079+0100 [conn1420410] end connection 172.28.0.164:57387 (399 connections now open) 2015-10-05T03:57:02.083+0100 [mongosMain] connection accepted from 172.28.0.164:60184 #1420843 (400 connections now open) 2015-10-05T03:57:02.084+0100 [conn1420843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:02.548+0100 [conn1420451] end connection 172.28.0.164:57623 (399 connections now open) 2015-10-05T03:57:02.549+0100 [mongosMain] connection accepted from 172.28.0.164:60191 #1420844 (400 connections now open) 2015-10-05T03:57:02.550+0100 [conn1420844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:03.282+0100 [conn1420427] end connection 172.28.0.163:64482 (399 connections now open) 2015-10-05T03:57:03.283+0100 [mongosMain] connection accepted from 172.28.0.163:50786 #1420845 (400 connections now open) 2015-10-05T03:57:03.284+0100 [conn1420845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:03.922+0100 [conn1420453] end connection 172.28.0.163:64588 (399 connections now open) 2015-10-05T03:57:03.923+0100 [mongosMain] connection accepted from 172.28.0.163:50792 #1420846 (400 connections now open) 2015-10-05T03:57:03.924+0100 [conn1420846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:04.203+0100 [conn1420380] end connection 172.28.0.164:57272 (399 connections now open) 2015-10-05T03:57:04.204+0100 [mongosMain] connection accepted from 172.28.0.164:60200 #1420847 (400 connections now open) 2015-10-05T03:57:04.206+0100 [conn1420847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:04.700+0100 [conn1420447] end connection 172.28.0.164:57612 (399 connections now open) 2015-10-05T03:57:04.702+0100 [mongosMain] connection accepted from 172.28.0.164:60203 #1420848 (400 connections now open) 2015-10-05T03:57:04.704+0100 [conn1420848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:07.027+0100 [conn1420408] end connection 172.28.0.163:64346 (399 connections now open) 2015-10-05T03:57:07.027+0100 [conn1420392] end connection 172.28.0.163:64310 (398 connections now open) 2015-10-05T03:57:07.028+0100 [mongosMain] connection accepted from 172.28.0.163:50811 #1420849 (399 connections now open) 2015-10-05T03:57:07.028+0100 [mongosMain] connection accepted from 172.28.0.163:50812 #1420850 (400 connections now open) 2015-10-05T03:57:07.029+0100 [conn1420849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:07.029+0100 [conn1420850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:12.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7075703b51053eacbc8 2015-10-05T03:57:12.095+0100 [conn1420385] end connection 172.28.0.164:57315 (399 connections now open) 2015-10-05T03:57:12.097+0100 [mongosMain] connection accepted from 172.28.0.164:60244 #1420851 (400 connections now open) 2015-10-05T03:57:12.098+0100 [conn1420851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:12.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:12.563+0100 [conn1420458] end connection 172.28.0.164:57642 (399 connections now open) 2015-10-05T03:57:12.564+0100 [mongosMain] connection accepted from 172.28.0.164:60248 #1420852 (400 connections now open) 2015-10-05T03:57:12.566+0100 [conn1420852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:13.282+0100 [conn1420436] end connection 172.28.0.163:64534 (399 connections now open) 2015-10-05T03:57:13.284+0100 [mongosMain] connection accepted from 172.28.0.163:50848 #1420853 (400 connections now open) 2015-10-05T03:57:13.285+0100 [conn1420853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:13.937+0100 [conn1420460] end connection 172.28.0.163:64613 (399 connections now open) 2015-10-05T03:57:13.938+0100 [mongosMain] connection accepted from 172.28.0.163:50853 #1420854 (400 connections now open) 2015-10-05T03:57:13.940+0100 [conn1420854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:14.219+0100 [conn1420365] end connection 172.28.0.164:57149 (399 connections now open) 2015-10-05T03:57:14.220+0100 [mongosMain] connection accepted from 172.28.0.164:60255 #1420855 (400 connections now open) 2015-10-05T03:57:14.223+0100 [conn1420855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:14.717+0100 [conn1420454] end connection 172.28.0.164:57627 (399 connections now open) 2015-10-05T03:57:14.718+0100 [mongosMain] connection accepted from 172.28.0.164:60259 #1420856 (400 connections now open) 2015-10-05T03:57:14.721+0100 [conn1420856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:22.112+0100 [conn1420425] end connection 172.28.0.164:57492 (399 connections now open) 2015-10-05T03:57:22.113+0100 [mongosMain] connection accepted from 172.28.0.164:60311 #1420857 (400 connections now open) 2015-10-05T03:57:22.115+0100 [conn1420857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:22.563+0100 [conn1420463] end connection 172.28.0.164:57683 (399 connections now open) 2015-10-05T03:57:22.564+0100 [mongosMain] connection accepted from 172.28.0.164:60316 #1420858 (400 connections now open) 2015-10-05T03:57:22.566+0100 [conn1420858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:23.298+0100 [conn1420445] end connection 172.28.0.163:64567 (399 connections now open) 2015-10-05T03:57:23.299+0100 [mongosMain] connection accepted from 172.28.0.163:50909 #1420859 (400 connections now open) 2015-10-05T03:57:23.300+0100 [conn1420859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:23.953+0100 [conn1420465] end connection 172.28.0.163:64660 (399 connections now open) 2015-10-05T03:57:23.954+0100 [mongosMain] connection accepted from 172.28.0.163:50912 #1420860 (400 connections now open) 2015-10-05T03:57:23.955+0100 [conn1420860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:24.023+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:57:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:57:24.232+0100 [conn1420414] end connection 172.28.0.164:57395 (399 connections now open) 2015-10-05T03:57:24.234+0100 [mongosMain] connection accepted from 172.28.0.164:60332 #1420861 (400 connections now open) 2015-10-05T03:57:24.236+0100 [conn1420861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:27.042+0100 [conn1420440] end connection 172.28.0.163:64550 (399 connections now open) 2015-10-05T03:57:27.042+0100 [conn1420468] end connection 172.28.0.163:64678 (398 connections now open) 2015-10-05T03:57:27.043+0100 [mongosMain] connection accepted from 172.28.0.163:50926 #1420862 (399 connections now open) 2015-10-05T03:57:27.044+0100 [mongosMain] connection accepted from 172.28.0.163:50927 #1420863 (400 connections now open) 2015-10-05T03:57:27.045+0100 [conn1420862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:27.045+0100 [conn1420863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:28.528+0100 [mongosMain] connection accepted from 127.0.0.1:50936 #1420864 (401 connections now open) 2015-10-05T03:57:28.531+0100 [conn1420864] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:28.536+0100 [conn1420864] end connection 127.0.0.1:50936 (400 connections now open) 2015-10-05T03:57:30.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e71a5703b51053eacc3e 2015-10-05T03:57:30.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:32.126+0100 [conn1420434] end connection 172.28.0.164:57559 (399 connections now open) 2015-10-05T03:57:32.128+0100 [mongosMain] connection accepted from 172.28.0.164:60389 #1420865 (400 connections now open) 2015-10-05T03:57:32.129+0100 [conn1420865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:32.580+0100 [conn1420470] end connection 172.28.0.164:57735 (399 connections now open) 2015-10-05T03:57:32.581+0100 [mongosMain] connection accepted from 172.28.0.164:60395 #1420866 (400 connections now open) 2015-10-05T03:57:32.583+0100 [conn1420866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:33.313+0100 [conn1420459] end connection 172.28.0.163:64609 (399 connections now open) 2015-10-05T03:57:33.315+0100 [mongosMain] connection accepted from 172.28.0.163:50963 #1420867 (400 connections now open) 2015-10-05T03:57:33.316+0100 [conn1420867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:33.953+0100 [conn1420472] end connection 172.28.0.163:64724 (399 connections now open) 2015-10-05T03:57:33.954+0100 [mongosMain] connection accepted from 172.28.0.163:50969 #1420868 (400 connections now open) 2015-10-05T03:57:33.956+0100 [conn1420868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:34.748+0100 [conn1420415] end connection 172.28.0.164:57401 (399 connections now open) 2015-10-05T03:57:34.749+0100 [mongosMain] connection accepted from 172.28.0.164:60414 #1420869 (400 connections now open) 2015-10-05T03:57:34.751+0100 [conn1420869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:37.044+0100 [conn1420416] end connection 172.28.0.163:64388 (399 connections now open) 2015-10-05T03:57:37.045+0100 [conn1420456] end connection 172.28.0.163:64594 (398 connections now open) 2015-10-05T03:57:37.046+0100 [mongosMain] connection accepted from 172.28.0.163:50978 #1420870 (399 connections now open) 2015-10-05T03:57:37.047+0100 [mongosMain] connection accepted from 172.28.0.163:50979 #1420871 (400 connections now open) 2015-10-05T03:57:37.047+0100 [conn1420870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:37.048+0100 [conn1420871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:39.477+0100 [mongosMain] connection accepted from 127.0.0.1:50982 #1420872 (401 connections now open) 2015-10-05T03:57:39.480+0100 [conn1420872] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:39.485+0100 [conn1420872] end connection 127.0.0.1:50982 (400 connections now open) 2015-10-05T03:57:42.142+0100 [conn1420443] end connection 172.28.0.164:57605 (399 connections now open) 2015-10-05T03:57:42.144+0100 [mongosMain] connection accepted from 172.28.0.164:60428 #1420873 (400 connections now open) 2015-10-05T03:57:42.146+0100 [conn1420873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:42.595+0100 [conn1420478] end connection 172.28.0.164:57807 (399 connections now open) 2015-10-05T03:57:42.596+0100 [mongosMain] connection accepted from 172.28.0.164:60431 #1420874 (400 connections now open) 2015-10-05T03:57:42.598+0100 [conn1420874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:42.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7265703b51053eacc6c 2015-10-05T03:57:42.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:43.314+0100 [conn1420464] end connection 172.28.0.163:64658 (399 connections now open) 2015-10-05T03:57:43.315+0100 [mongosMain] connection accepted from 172.28.0.163:50986 #1420875 (400 connections now open) 2015-10-05T03:57:43.317+0100 [conn1420875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:43.969+0100 [conn1420480] end connection 172.28.0.163:64786 (399 connections now open) 2015-10-05T03:57:43.970+0100 [mongosMain] connection accepted from 172.28.0.163:50989 #1420876 (400 connections now open) 2015-10-05T03:57:43.971+0100 [conn1420876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:44.763+0100 [conn1420473] end connection 172.28.0.164:57745 (399 connections now open) 2015-10-05T03:57:44.764+0100 [mongosMain] connection accepted from 172.28.0.164:60434 #1420877 (400 connections now open) 2015-10-05T03:57:44.765+0100 [conn1420877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:47.058+0100 [conn1420448] end connection 172.28.0.163:64576 (399 connections now open) 2015-10-05T03:57:47.059+0100 [mongosMain] connection accepted from 172.28.0.163:50994 #1420878 (400 connections now open) 2015-10-05T03:57:47.060+0100 [conn1420878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:49.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e72c5703b51053eacc86 2015-10-05T03:57:49.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:52.142+0100 [conn1420457] end connection 172.28.0.164:57638 (399 connections now open) 2015-10-05T03:57:52.144+0100 [mongosMain] connection accepted from 172.28.0.164:60443 #1420879 (400 connections now open) 2015-10-05T03:57:52.145+0100 [conn1420879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:52.611+0100 [conn1420485] end connection 172.28.0.164:57863 (399 connections now open) 2015-10-05T03:57:52.612+0100 [mongosMain] connection accepted from 172.28.0.164:60445 #1420880 (400 connections now open) 2015-10-05T03:57:52.620+0100 [conn1420880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:53.969+0100 [conn1420487] end connection 172.28.0.163:64818 (399 connections now open) 2015-10-05T03:57:53.970+0100 [mongosMain] connection accepted from 172.28.0.163:51005 #1420881 (400 connections now open) 2015-10-05T03:57:53.971+0100 [conn1420881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:54.294+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:57:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:57:54.763+0100 [conn1420481] end connection 172.28.0.164:57818 (399 connections now open) 2015-10-05T03:57:54.764+0100 [mongosMain] connection accepted from 172.28.0.164:60448 #1420882 (400 connections now open) 2015-10-05T03:57:54.765+0100 [conn1420882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:57:55.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7335703b51053eaccac 2015-10-05T03:57:55.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:57:57.074+0100 [conn1420482] end connection 172.28.0.163:64804 (399 connections now open) 2015-10-05T03:57:57.075+0100 [mongosMain] connection accepted from 172.28.0.163:51010 #1420883 (400 connections now open) 2015-10-05T03:57:57.076+0100 [conn1420883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:02.626+0100 [conn1420491] end connection 172.28.0.164:57876 (399 connections now open) 2015-10-05T03:58:02.627+0100 [mongosMain] connection accepted from 172.28.0.164:60463 #1420884 (400 connections now open) 2015-10-05T03:58:02.629+0100 [conn1420884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:03.985+0100 [conn1420493] end connection 172.28.0.163:64834 (399 connections now open) 2015-10-05T03:58:03.986+0100 [mongosMain] connection accepted from 172.28.0.163:51034 #1420885 (400 connections now open) 2015-10-05T03:58:03.987+0100 [conn1420885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:04.778+0100 [conn1420466] end connection 172.28.0.164:57693 (399 connections now open) 2015-10-05T03:58:04.779+0100 [mongosMain] connection accepted from 172.28.0.164:60477 #1420886 (400 connections now open) 2015-10-05T03:58:04.781+0100 [conn1420886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:07.074+0100 [conn1420461] end connection 172.28.0.163:64635 (399 connections now open) 2015-10-05T03:58:07.075+0100 [conn1420475] end connection 172.28.0.163:64739 (398 connections now open) 2015-10-05T03:58:07.076+0100 [mongosMain] connection accepted from 172.28.0.163:51049 #1420887 (399 connections now open) 2015-10-05T03:58:07.076+0100 [mongosMain] connection accepted from 172.28.0.163:51050 #1420888 (400 connections now open) 2015-10-05T03:58:07.077+0100 [conn1420887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:07.077+0100 [conn1420888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:12.641+0100 [conn1420496] end connection 172.28.0.164:57890 (399 connections now open) 2015-10-05T03:58:12.642+0100 [mongosMain] connection accepted from 172.28.0.164:60521 #1420889 (400 connections now open) 2015-10-05T03:58:12.643+0100 [conn1420889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:13.985+0100 [conn1420497] end connection 172.28.0.163:64864 (399 connections now open) 2015-10-05T03:58:13.985+0100 [mongosMain] connection accepted from 172.28.0.163:51086 #1420890 (400 connections now open) 2015-10-05T03:58:13.986+0100 [conn1420890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:14.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7455703b51053eacd46 2015-10-05T03:58:14.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:58:14.296+0100 [conn1420389] end connection 172.28.0.164:57329 (399 connections now open) 2015-10-05T03:58:14.298+0100 [mongosMain] connection accepted from 172.28.0.164:60525 #1420891 (400 connections now open) 2015-10-05T03:58:14.301+0100 [conn1420891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:14.794+0100 [conn1420488] end connection 172.28.0.164:57866 (399 connections now open) 2015-10-05T03:58:14.795+0100 [mongosMain] connection accepted from 172.28.0.164:60529 #1420892 (400 connections now open) 2015-10-05T03:58:14.798+0100 [conn1420892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:17.090+0100 [conn1420449] end connection 172.28.0.163:64577 (399 connections now open) 2015-10-05T03:58:17.090+0100 [conn1420489] end connection 172.28.0.163:64822 (399 connections now open) 2015-10-05T03:58:17.091+0100 [mongosMain] connection accepted from 172.28.0.163:51109 #1420893 (399 connections now open) 2015-10-05T03:58:17.092+0100 [mongosMain] connection accepted from 172.28.0.163:51110 #1420894 (400 connections now open) 2015-10-05T03:58:17.093+0100 [conn1420893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:17.093+0100 [conn1420894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:22.642+0100 [conn1420500] end connection 172.28.0.164:57949 (399 connections now open) 2015-10-05T03:58:22.643+0100 [mongosMain] connection accepted from 172.28.0.164:60558 #1420895 (400 connections now open) 2015-10-05T03:58:22.645+0100 [conn1420895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:24.000+0100 [conn1420501] end connection 172.28.0.163:64931 (399 connections now open) 2015-10-05T03:58:24.001+0100 [mongosMain] connection accepted from 172.28.0.163:51138 #1420896 (400 connections now open) 2015-10-05T03:58:24.002+0100 [conn1420896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:24.312+0100 [conn1420422] end connection 172.28.0.164:57452 (399 connections now open) 2015-10-05T03:58:24.313+0100 [mongosMain] connection accepted from 172.28.0.164:60571 #1420897 (400 connections now open) 2015-10-05T03:58:24.315+0100 [conn1420897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:24.439+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:58:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:58:24.812+0100 [conn1420498] end connection 172.28.0.164:57904 (399 connections now open) 2015-10-05T03:58:24.813+0100 [mongosMain] connection accepted from 172.28.0.164:60576 #1420898 (400 connections now open) 2015-10-05T03:58:24.815+0100 [conn1420898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:26.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7525703b51053eacd9d 2015-10-05T03:58:26.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:58:27.095+0100 [conn1420495] end connection 172.28.0.163:64839 (399 connections now open) 2015-10-05T03:58:27.095+0100 [conn1420490] end connection 172.28.0.163:64823 (398 connections now open) 2015-10-05T03:58:27.096+0100 [mongosMain] connection accepted from 172.28.0.163:51148 #1420899 (399 connections now open) 2015-10-05T03:58:27.097+0100 [mongosMain] connection accepted from 172.28.0.163:51149 #1420900 (400 connections now open) 2015-10-05T03:58:27.097+0100 [conn1420899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:27.098+0100 [conn1420900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:28.885+0100 [mongosMain] connection accepted from 127.0.0.1:51159 #1420901 (401 connections now open) 2015-10-05T03:58:28.889+0100 [conn1420901] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:28.894+0100 [conn1420901] end connection 127.0.0.1:51159 (400 connections now open) 2015-10-05T03:58:32.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7585703b51053eacdce 2015-10-05T03:58:32.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:58:34.826+0100 [conn1420507] end connection 172.28.0.164:58008 (399 connections now open) 2015-10-05T03:58:34.827+0100 [mongosMain] connection accepted from 172.28.0.164:60637 #1420902 (400 connections now open) 2015-10-05T03:58:34.829+0100 [conn1420902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:37.105+0100 [conn1420499] end connection 172.28.0.163:64887 (399 connections now open) 2015-10-05T03:58:37.105+0100 [mongosMain] connection accepted from 172.28.0.163:51178 #1420903 (400 connections now open) 2015-10-05T03:58:37.106+0100 [conn1420903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:39.740+0100 [mongosMain] connection accepted from 127.0.0.1:51179 #1420904 (401 connections now open) 2015-10-05T03:58:39.743+0100 [conn1420904] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:39.748+0100 [conn1420904] end connection 127.0.0.1:51179 (400 connections now open) 2015-10-05T03:58:45.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7645703b51053eace3c 2015-10-05T03:58:45.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:58:47.107+0100 [conn1420508] end connection 172.28.0.163:65017 (399 connections now open) 2015-10-05T03:58:47.108+0100 [mongosMain] connection accepted from 172.28.0.163:51187 #1420905 (400 connections now open) 2015-10-05T03:58:47.109+0100 [conn1420905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:58:54.702+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:58:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:58:57.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7715703b51053eace9c 2015-10-05T03:58:57.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:09.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e77d5703b51053eacef6 2015-10-05T03:59:09.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:16.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7835703b51053eacf31 2015-10-05T03:59:16.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:17.143+0100 [conn1420504] end connection 172.28.0.163:64952 (399 connections now open) 2015-10-05T03:59:17.145+0100 [mongosMain] connection accepted from 172.28.0.163:51292 #1420906 (400 connections now open) 2015-10-05T03:59:17.146+0100 [conn1420906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:22.237+0100 [conn1420469] end connection 172.28.0.164:57729 (399 connections now open) 2015-10-05T03:59:22.238+0100 [mongosMain] connection accepted from 172.28.0.164:60788 #1420907 (400 connections now open) 2015-10-05T03:59:22.240+0100 [conn1420907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:22.872+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T03:59:22.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T03:59:24.953+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:59:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T03:59:27.154+0100 [conn1420474] end connection 172.28.0.163:64738 (399 connections now open) 2015-10-05T03:59:27.155+0100 [mongosMain] connection accepted from 172.28.0.163:51340 #1420908 (400 connections now open) 2015-10-05T03:59:27.156+0100 [conn1420908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:28.788+0100 [mongosMain] connection accepted from 127.0.0.1:51349 #1420909 (401 connections now open) 2015-10-05T03:59:28.791+0100 [conn1420909] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:28.795+0100 [conn1420909] end connection 127.0.0.1:51349 (400 connections now open) 2015-10-05T03:59:29.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7905703b51053eacfac 2015-10-05T03:59:29.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:34.375+0100 [conn1420502] end connection 172.28.0.164:57954 (399 connections now open) 2015-10-05T03:59:34.376+0100 [mongosMain] connection accepted from 172.28.0.164:60861 #1420910 (400 connections now open) 2015-10-05T03:59:34.378+0100 [conn1420910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:34.920+0100 [conn1420510] end connection 172.28.0.164:58073 (399 connections now open) 2015-10-05T03:59:34.922+0100 [mongosMain] connection accepted from 172.28.0.164:60863 #1420911 (400 connections now open) 2015-10-05T03:59:34.924+0100 [conn1420911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:35.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7975703b51053eacffd 2015-10-05T03:59:35.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:37.154+0100 [conn1420513] end connection 172.28.0.163:65072 (399 connections now open) 2015-10-05T03:59:37.154+0100 [conn1420375] end connection 172.28.0.163:64208 (398 connections now open) 2015-10-05T03:59:37.155+0100 [mongosMain] connection accepted from 172.28.0.163:51370 #1420912 (399 connections now open) 2015-10-05T03:59:37.155+0100 [mongosMain] connection accepted from 172.28.0.163:51371 #1420913 (400 connections now open) 2015-10-05T03:59:37.156+0100 [conn1420912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:37.156+0100 [conn1420913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:39.606+0100 [mongosMain] connection accepted from 127.0.0.1:51373 #1420914 (401 connections now open) 2015-10-05T03:59:39.608+0100 [conn1420914] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:39.612+0100 [conn1420914] end connection 127.0.0.1:51373 (400 connections now open) 2015-10-05T03:59:44.389+0100 [conn1420398] end connection 172.28.0.164:57356 (399 connections now open) 2015-10-05T03:59:44.391+0100 [mongosMain] connection accepted from 172.28.0.164:60876 #1420915 (400 connections now open) 2015-10-05T03:59:44.392+0100 [conn1420915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:44.936+0100 [conn1420503] end connection 172.28.0.164:57956 (399 connections now open) 2015-10-05T03:59:44.938+0100 [mongosMain] connection accepted from 172.28.0.164:60878 #1420916 (400 connections now open) 2015-10-05T03:59:44.940+0100 [conn1420916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:47.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7a35703b51053ead08f 2015-10-05T03:59:48.011+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T03:59:52.270+0100 [conn1420462] end connection 172.28.0.164:57679 (399 connections now open) 2015-10-05T03:59:52.272+0100 [mongosMain] connection accepted from 172.28.0.164:60884 #1420917 (400 connections now open) 2015-10-05T03:59:52.275+0100 [conn1420917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:53.424+0100 [conn1420471] end connection 172.28.0.163:64719 (399 connections now open) 2015-10-05T03:59:53.426+0100 [mongosMain] connection accepted from 172.28.0.163:51391 #1420918 (400 connections now open) 2015-10-05T03:59:53.427+0100 [conn1420918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T03:59:55.148+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 03:59:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:00:00.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7b05703b51053ead109 2015-10-05T04:00:00.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:02.268+0100 [conn1420450] end connection 172.28.0.164:57620 (399 connections now open) 2015-10-05T04:00:02.269+0100 [mongosMain] connection accepted from 172.28.0.164:60915 #1420919 (400 connections now open) 2015-10-05T04:00:02.270+0100 [conn1420919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:03.439+0100 [conn1420479] end connection 172.28.0.163:64779 (399 connections now open) 2015-10-05T04:00:03.440+0100 [mongosMain] connection accepted from 172.28.0.163:51430 #1420920 (400 connections now open) 2015-10-05T04:00:03.441+0100 [conn1420920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:06.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7b65703b51053ead158 2015-10-05T04:00:06.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:12.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7bc5703b51053ead1d6 2015-10-05T04:00:12.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:17.436+0100 [conn1420515] end connection 172.28.0.163:65189 (399 connections now open) 2015-10-05T04:00:17.437+0100 [mongosMain] connection accepted from 172.28.0.163:51486 #1420921 (400 connections now open) 2015-10-05T04:00:17.438+0100 [conn1420921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:22.284+0100 [conn1420402] end connection 172.28.0.164:57367 (399 connections now open) 2015-10-05T04:00:22.285+0100 [mongosMain] connection accepted from 172.28.0.164:60987 #1420922 (400 connections now open) 2015-10-05T04:00:22.287+0100 [conn1420922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:22.753+0100 [conn1420505] end connection 172.28.0.164:57997 (399 connections now open) 2015-10-05T04:00:22.754+0100 [mongosMain] connection accepted from 172.28.0.164:60991 #1420923 (400 connections now open) 2015-10-05T04:00:22.755+0100 [conn1420923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:23.455+0100 [conn1420492] end connection 172.28.0.163:64832 (399 connections now open) 2015-10-05T04:00:23.456+0100 [mongosMain] connection accepted from 172.28.0.163:51512 #1420924 (400 connections now open) 2015-10-05T04:00:23.457+0100 [conn1420924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:24.110+0100 [conn1420506] end connection 172.28.0.163:65000 (399 connections now open) 2015-10-05T04:00:24.111+0100 [mongosMain] connection accepted from 172.28.0.163:51514 #1420925 (400 connections now open) 2015-10-05T04:00:24.112+0100 [conn1420925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:25.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7c85703b51053ead4de 2015-10-05T04:00:25.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:25.303+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:00:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:00:25.468+0100 [conn1420429] end connection 172.28.0.164:57510 (399 connections now open) 2015-10-05T04:00:25.469+0100 [mongosMain] connection accepted from 172.28.0.164:60995 #1420926 (400 connections now open) 2015-10-05T04:00:25.471+0100 [conn1420926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:28.311+0100 [mongosMain] connection accepted from 127.0.0.1:51523 #1420927 (401 connections now open) 2015-10-05T04:00:28.314+0100 [conn1420927] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:28.319+0100 [conn1420927] end connection 127.0.0.1:51523 (400 connections now open) 2015-10-05T04:00:31.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7cf5703b51053ead6d4 2015-10-05T04:00:31.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:32.299+0100 [conn1420477] end connection 172.28.0.164:57801 (399 connections now open) 2015-10-05T04:00:32.301+0100 [mongosMain] connection accepted from 172.28.0.164:61005 #1420928 (400 connections now open) 2015-10-05T04:00:32.302+0100 [conn1420928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:32.769+0100 [conn1420529] end connection 172.28.0.164:58429 (399 connections now open) 2015-10-05T04:00:32.770+0100 [mongosMain] connection accepted from 172.28.0.164:61008 #1420929 (400 connections now open) 2015-10-05T04:00:32.771+0100 [conn1420929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:33.471+0100 [conn1420525] end connection 172.28.0.163:65295 (399 connections now open) 2015-10-05T04:00:33.472+0100 [mongosMain] connection accepted from 172.28.0.163:51526 #1420930 (400 connections now open) 2015-10-05T04:00:33.473+0100 [conn1420930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:34.111+0100 [conn1420530] end connection 172.28.0.163:65420 (399 connections now open) 2015-10-05T04:00:34.113+0100 [mongosMain] connection accepted from 172.28.0.163:51527 #1420931 (400 connections now open) 2015-10-05T04:00:34.114+0100 [conn1420931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:35.483+0100 [conn1420523] end connection 172.28.0.164:58299 (399 connections now open) 2015-10-05T04:00:35.484+0100 [conn1420526] end connection 172.28.0.164:58307 (398 connections now open) 2015-10-05T04:00:35.484+0100 [mongosMain] connection accepted from 172.28.0.164:61014 #1420932 (399 connections now open) 2015-10-05T04:00:35.484+0100 [mongosMain] connection accepted from 172.28.0.164:61015 #1420933 (400 connections now open) 2015-10-05T04:00:35.486+0100 [conn1420933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:35.486+0100 [conn1420932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:37.451+0100 [conn1420514] end connection 172.28.0.163:65188 (399 connections now open) 2015-10-05T04:00:37.452+0100 [mongosMain] connection accepted from 172.28.0.163:51529 #1420934 (400 connections now open) 2015-10-05T04:00:37.453+0100 [conn1420934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:39.952+0100 [mongosMain] connection accepted from 127.0.0.1:51531 #1420935 (401 connections now open) 2015-10-05T04:00:39.954+0100 [conn1420935] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:39.959+0100 [conn1420935] end connection 127.0.0.1:51531 (400 connections now open) 2015-10-05T04:00:42.300+0100 [conn1420528] end connection 172.28.0.164:58424 (399 connections now open) 2015-10-05T04:00:42.301+0100 [mongosMain] connection accepted from 172.28.0.164:61026 #1420936 (400 connections now open) 2015-10-05T04:00:42.303+0100 [conn1420936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:42.767+0100 [conn1420534] end connection 172.28.0.164:58500 (399 connections now open) 2015-10-05T04:00:42.768+0100 [mongosMain] connection accepted from 172.28.0.164:61028 #1420937 (400 connections now open) 2015-10-05T04:00:42.769+0100 [conn1420937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:43.471+0100 [conn1420452] end connection 172.28.0.163:64586 (399 connections now open) 2015-10-05T04:00:43.472+0100 [mongosMain] connection accepted from 172.28.0.163:51536 #1420938 (400 connections now open) 2015-10-05T04:00:43.473+0100 [conn1420938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:43.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7db5703b51053eada21 2015-10-05T04:00:43.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:00:44.126+0100 [conn1420536] end connection 172.28.0.163:65480 (399 connections now open) 2015-10-05T04:00:44.128+0100 [mongosMain] connection accepted from 172.28.0.163:51538 #1420939 (400 connections now open) 2015-10-05T04:00:44.129+0100 [conn1420939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:45.483+0100 [conn1420519] end connection 172.28.0.164:58283 (399 connections now open) 2015-10-05T04:00:45.484+0100 [conn1420234] end connection 172.28.0.164:56463 (398 connections now open) 2015-10-05T04:00:45.484+0100 [mongosMain] connection accepted from 172.28.0.164:61034 #1420940 (399 connections now open) 2015-10-05T04:00:45.485+0100 [mongosMain] connection accepted from 172.28.0.164:61033 #1420941 (400 connections now open) 2015-10-05T04:00:45.486+0100 [conn1420941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:45.487+0100 [conn1420940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:52.345+0100 [conn1420533] end connection 172.28.0.164:58493 (399 connections now open) 2015-10-05T04:00:52.345+0100 [mongosMain] connection accepted from 172.28.0.164:61042 #1420942 (400 connections now open) 2015-10-05T04:00:52.345+0100 [conn1420942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:52.813+0100 [conn1420540] end connection 172.28.0.164:58532 (399 connections now open) 2015-10-05T04:00:52.813+0100 [mongosMain] connection accepted from 172.28.0.164:61047 #1420943 (400 connections now open) 2015-10-05T04:00:52.813+0100 [conn1420943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:53.515+0100 [conn1420535] end connection 172.28.0.163:65477 (399 connections now open) 2015-10-05T04:00:53.515+0100 [mongosMain] connection accepted from 172.28.0.163:51551 #1420944 (400 connections now open) 2015-10-05T04:00:53.515+0100 [conn1420944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:54.170+0100 [conn1420542] end connection 172.28.0.163:65493 (399 connections now open) 2015-10-05T04:00:54.170+0100 [mongosMain] connection accepted from 172.28.0.163:51553 #1420945 (400 connections now open) 2015-10-05T04:00:54.170+0100 [conn1420945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:55.668+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:00:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:00:56.027+0100 [conn1420494] end connection 172.28.0.164:57879 (399 connections now open) 2015-10-05T04:00:56.027+0100 [mongosMain] connection accepted from 172.28.0.164:61051 #1420946 (400 connections now open) 2015-10-05T04:00:56.027+0100 [conn1420516] end connection 172.28.0.164:58205 (399 connections now open) 2015-10-05T04:00:56.027+0100 [mongosMain] connection accepted from 172.28.0.164:61053 #1420947 (400 connections now open) 2015-10-05T04:00:56.027+0100 [conn1420946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:56.027+0100 [conn1420947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:00:56.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7e85703b51053eadccd 2015-10-05T04:00:56.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:01:02.315+0100 [conn1420539] end connection 172.28.0.164:58530 (399 connections now open) 2015-10-05T04:01:02.317+0100 [mongosMain] connection accepted from 172.28.0.164:61068 #1420948 (400 connections now open) 2015-10-05T04:01:02.318+0100 [conn1420948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:02.784+0100 [conn1420545] end connection 172.28.0.164:58549 (399 connections now open) 2015-10-05T04:01:02.785+0100 [mongosMain] connection accepted from 172.28.0.164:61072 #1420949 (400 connections now open) 2015-10-05T04:01:02.786+0100 [conn1420949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:02.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e7ee5703b51053eade4d 2015-10-05T04:01:03.006+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:01:03.487+0100 [conn1420486] end connection 172.28.0.163:64814 (399 connections now open) 2015-10-05T04:01:03.488+0100 [mongosMain] connection accepted from 172.28.0.163:51575 #1420950 (400 connections now open) 2015-10-05T04:01:03.489+0100 [conn1420950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:04.142+0100 [conn1420547] end connection 172.28.0.163:65509 (399 connections now open) 2015-10-05T04:01:04.143+0100 [mongosMain] connection accepted from 172.28.0.163:51580 #1420951 (400 connections now open) 2015-10-05T04:01:04.144+0100 [conn1420951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:12.330+0100 [conn1420544] end connection 172.28.0.164:58545 (399 connections now open) 2015-10-05T04:01:12.331+0100 [mongosMain] connection accepted from 172.28.0.164:61117 #1420952 (400 connections now open) 2015-10-05T04:01:12.332+0100 [conn1420952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:12.799+0100 [conn1420550] end connection 172.28.0.164:58565 (399 connections now open) 2015-10-05T04:01:12.800+0100 [mongosMain] connection accepted from 172.28.0.164:61122 #1420953 (400 connections now open) 2015-10-05T04:01:12.802+0100 [conn1420953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:13.503+0100 [conn1420551] end connection 172.28.0.163:65528 (399 connections now open) 2015-10-05T04:01:13.504+0100 [mongosMain] connection accepted from 172.28.0.163:51663 #1420954 (400 connections now open) 2015-10-05T04:01:13.505+0100 [conn1420954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:14.143+0100 [conn1420552] end connection 172.28.0.163:65532 (399 connections now open) 2015-10-05T04:01:14.144+0100 [mongosMain] connection accepted from 172.28.0.163:51665 #1420955 (400 connections now open) 2015-10-05T04:01:14.145+0100 [conn1420955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:16.029+0100 [conn1420548] end connection 172.28.0.164:58552 (399 connections now open) 2015-10-05T04:01:16.030+0100 [mongosMain] connection accepted from 172.28.0.164:61131 #1420956 (400 connections now open) 2015-10-05T04:01:16.032+0100 [conn1420956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:21.302+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8015703b51053eae33b 2015-10-05T04:01:21.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:01:22.347+0100 [conn1420549] end connection 172.28.0.164:58560 (399 connections now open) 2015-10-05T04:01:22.347+0100 [mongosMain] connection accepted from 172.28.0.164:61140 #1420957 (400 connections now open) 2015-10-05T04:01:22.349+0100 [conn1420957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:22.815+0100 [conn1420556] end connection 172.28.0.164:58620 (399 connections now open) 2015-10-05T04:01:22.817+0100 [mongosMain] connection accepted from 172.28.0.164:61142 #1420958 (400 connections now open) 2015-10-05T04:01:22.818+0100 [conn1420958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:23.504+0100 [conn1420557] end connection 172.28.0.163:49229 (399 connections now open) 2015-10-05T04:01:23.504+0100 [mongosMain] connection accepted from 172.28.0.163:51675 #1420959 (400 connections now open) 2015-10-05T04:01:23.505+0100 [conn1420959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:24.157+0100 [conn1420558] end connection 172.28.0.163:49232 (399 connections now open) 2015-10-05T04:01:24.158+0100 [mongosMain] connection accepted from 172.28.0.163:51676 #1420960 (400 connections now open) 2015-10-05T04:01:24.159+0100 [conn1420960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:25.907+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:01:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:01:26.090+0100 [conn1420543] end connection 172.28.0.164:58536 (399 connections now open) 2015-10-05T04:01:26.091+0100 [conn1420553] end connection 172.28.0.164:58575 (398 connections now open) 2015-10-05T04:01:26.092+0100 [mongosMain] connection accepted from 172.28.0.164:61147 #1420961 (399 connections now open) 2015-10-05T04:01:26.092+0100 [mongosMain] connection accepted from 172.28.0.164:61149 #1420962 (400 connections now open) 2015-10-05T04:01:26.095+0100 [conn1420961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:26.095+0100 [conn1420962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:27.482+0100 [conn1420524] end connection 172.28.0.163:65287 (399 connections now open) 2015-10-05T04:01:27.482+0100 [conn1420531] end connection 172.28.0.163:65436 (399 connections now open) 2015-10-05T04:01:27.482+0100 [mongosMain] connection accepted from 172.28.0.163:51679 #1420963 (399 connections now open) 2015-10-05T04:01:27.483+0100 [mongosMain] connection accepted from 172.28.0.163:51680 #1420964 (400 connections now open) 2015-10-05T04:01:27.483+0100 [conn1420963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:27.484+0100 [conn1420964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:28.243+0100 [mongosMain] connection accepted from 127.0.0.1:51682 #1420965 (401 connections now open) 2015-10-05T04:01:28.246+0100 [conn1420965] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:28.251+0100 [conn1420965] end connection 127.0.0.1:51682 (400 connections now open) 2015-10-05T04:01:32.831+0100 [conn1420563] end connection 172.28.0.164:58671 (399 connections now open) 2015-10-05T04:01:32.833+0100 [mongosMain] connection accepted from 172.28.0.164:61161 #1420966 (400 connections now open) 2015-10-05T04:01:32.834+0100 [conn1420966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:33.519+0100 [conn1420546] end connection 172.28.0.163:65506 (399 connections now open) 2015-10-05T04:01:33.520+0100 [mongosMain] connection accepted from 172.28.0.163:51683 #1420967 (400 connections now open) 2015-10-05T04:01:33.521+0100 [conn1420967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:33.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e80d5703b51053eae5bc 2015-10-05T04:01:33.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:01:34.174+0100 [conn1420565] end connection 172.28.0.163:49293 (399 connections now open) 2015-10-05T04:01:34.175+0100 [mongosMain] connection accepted from 172.28.0.163:51685 #1420968 (400 connections now open) 2015-10-05T04:01:34.176+0100 [conn1420968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:36.091+0100 [conn1420559] end connection 172.28.0.164:58626 (399 connections now open) 2015-10-05T04:01:36.092+0100 [mongosMain] connection accepted from 172.28.0.164:61168 #1420969 (400 connections now open) 2015-10-05T04:01:36.092+0100 [conn1420560] end connection 172.28.0.164:58629 (398 connections now open) 2015-10-05T04:01:36.093+0100 [mongosMain] connection accepted from 172.28.0.164:61169 #1420970 (400 connections now open) 2015-10-05T04:01:36.094+0100 [conn1420969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:36.094+0100 [conn1420970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:37.497+0100 [conn1420527] end connection 172.28.0.163:65302 (399 connections now open) 2015-10-05T04:01:37.497+0100 [conn1420520] end connection 172.28.0.163:65276 (399 connections now open) 2015-10-05T04:01:37.498+0100 [mongosMain] connection accepted from 172.28.0.163:51688 #1420971 (399 connections now open) 2015-10-05T04:01:37.499+0100 [mongosMain] connection accepted from 172.28.0.163:51689 #1420972 (400 connections now open) 2015-10-05T04:01:37.499+0100 [conn1420971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:37.499+0100 [conn1420972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:39.592+0100 [mongosMain] connection accepted from 127.0.0.1:51691 #1420973 (401 connections now open) 2015-10-05T04:01:39.594+0100 [conn1420973] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:39.599+0100 [conn1420973] end connection 127.0.0.1:51691 (400 connections now open) 2015-10-05T04:01:39.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8135703b51053eae6bf 2015-10-05T04:01:40.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:01:42.363+0100 [conn1420571] end connection 172.28.0.164:58736 (399 connections now open) 2015-10-05T04:01:42.364+0100 [mongosMain] connection accepted from 172.28.0.164:61180 #1420974 (400 connections now open) 2015-10-05T04:01:42.366+0100 [conn1420974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:42.833+0100 [conn1420572] end connection 172.28.0.164:58740 (399 connections now open) 2015-10-05T04:01:42.834+0100 [mongosMain] connection accepted from 172.28.0.164:61182 #1420975 (400 connections now open) 2015-10-05T04:01:42.836+0100 [conn1420975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:43.520+0100 [conn1420541] end connection 172.28.0.163:65491 (399 connections now open) 2015-10-05T04:01:43.521+0100 [mongosMain] connection accepted from 172.28.0.163:51697 #1420976 (400 connections now open) 2015-10-05T04:01:43.522+0100 [conn1420976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:44.175+0100 [conn1420574] end connection 172.28.0.163:49348 (399 connections now open) 2015-10-05T04:01:44.176+0100 [mongosMain] connection accepted from 172.28.0.163:51699 #1420977 (400 connections now open) 2015-10-05T04:01:44.177+0100 [conn1420977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:46.107+0100 [conn1420567] end connection 172.28.0.164:58683 (399 connections now open) 2015-10-05T04:01:46.108+0100 [conn1420522] end connection 172.28.0.164:58296 (398 connections now open) 2015-10-05T04:01:46.109+0100 [mongosMain] connection accepted from 172.28.0.164:61190 #1420978 (399 connections now open) 2015-10-05T04:01:46.109+0100 [mongosMain] connection accepted from 172.28.0.164:61191 #1420979 (400 connections now open) 2015-10-05T04:01:46.111+0100 [conn1420978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:46.111+0100 [conn1420979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:47.505+0100 [conn1420511] end connection 172.28.0.163:65062 (399 connections now open) 2015-10-05T04:01:47.505+0100 [conn1420467] end connection 172.28.0.163:64677 (399 connections now open) 2015-10-05T04:01:47.507+0100 [mongosMain] connection accepted from 172.28.0.163:51707 #1420980 (399 connections now open) 2015-10-05T04:01:47.507+0100 [mongosMain] connection accepted from 172.28.0.163:51708 #1420981 (400 connections now open) 2015-10-05T04:01:47.508+0100 [conn1420980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:47.508+0100 [conn1420981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:52.847+0100 [conn1420581] end connection 172.28.0.164:58810 (399 connections now open) 2015-10-05T04:01:52.849+0100 [mongosMain] connection accepted from 172.28.0.164:61198 #1420982 (400 connections now open) 2015-10-05T04:01:52.852+0100 [conn1420982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:53.535+0100 [conn1420564] end connection 172.28.0.163:49289 (399 connections now open) 2015-10-05T04:01:53.536+0100 [mongosMain] connection accepted from 172.28.0.163:51717 #1420983 (400 connections now open) 2015-10-05T04:01:53.537+0100 [conn1420983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:54.190+0100 [conn1420583] end connection 172.28.0.163:49394 (399 connections now open) 2015-10-05T04:01:54.191+0100 [mongosMain] connection accepted from 172.28.0.163:51719 #1420984 (400 connections now open) 2015-10-05T04:01:54.192+0100 [conn1420984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:56.123+0100 [conn1420518] end connection 172.28.0.164:58281 (399 connections now open) 2015-10-05T04:01:56.125+0100 [conn1420537] end connection 172.28.0.164:58514 (398 connections now open) 2015-10-05T04:01:56.125+0100 [mongosMain] connection accepted from 172.28.0.164:61205 #1420985 (399 connections now open) 2015-10-05T04:01:56.125+0100 [mongosMain] connection accepted from 172.28.0.164:61206 #1420986 (400 connections now open) 2015-10-05T04:01:56.127+0100 [conn1420986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:56.127+0100 [conn1420985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:56.183+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:01:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:01:57.514+0100 [conn1420577] end connection 172.28.0.163:49355 (399 connections now open) 2015-10-05T04:01:57.514+0100 [conn1420455] end connection 172.28.0.163:64593 (398 connections now open) 2015-10-05T04:01:57.515+0100 [mongosMain] connection accepted from 172.28.0.163:51724 #1420987 (399 connections now open) 2015-10-05T04:01:57.515+0100 [mongosMain] connection accepted from 172.28.0.163:51726 #1420988 (400 connections now open) 2015-10-05T04:01:57.516+0100 [conn1420987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:57.516+0100 [conn1420988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:01:58.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8265703b51053eae9a4 2015-10-05T04:01:58.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:02.847+0100 [conn1420589] end connection 172.28.0.164:58829 (399 connections now open) 2015-10-05T04:02:02.848+0100 [mongosMain] connection accepted from 172.28.0.164:61225 #1420989 (400 connections now open) 2015-10-05T04:02:02.850+0100 [conn1420989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:03.550+0100 [conn1420573] end connection 172.28.0.163:49344 (399 connections now open) 2015-10-05T04:02:03.552+0100 [mongosMain] connection accepted from 172.28.0.163:51744 #1420990 (400 connections now open) 2015-10-05T04:02:03.553+0100 [conn1420990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:04.190+0100 [conn1420591] end connection 172.28.0.163:49413 (399 connections now open) 2015-10-05T04:02:04.191+0100 [mongosMain] connection accepted from 172.28.0.163:51752 #1420991 (400 connections now open) 2015-10-05T04:02:04.192+0100 [conn1420991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:06.139+0100 [conn1420566] end connection 172.28.0.164:58682 (399 connections now open) 2015-10-05T04:02:06.140+0100 [conn1420593] end connection 172.28.0.164:58834 (398 connections now open) 2015-10-05T04:02:06.141+0100 [mongosMain] connection accepted from 172.28.0.164:61243 #1420992 (399 connections now open) 2015-10-05T04:02:06.141+0100 [mongosMain] connection accepted from 172.28.0.164:61244 #1420993 (400 connections now open) 2015-10-05T04:02:06.142+0100 [conn1420992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:06.142+0100 [conn1420993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:07.528+0100 [conn1420568] end connection 172.28.0.163:49310 (399 connections now open) 2015-10-05T04:02:07.528+0100 [conn1420569] end connection 172.28.0.163:49311 (399 connections now open) 2015-10-05T04:02:07.530+0100 [mongosMain] connection accepted from 172.28.0.163:51770 #1420994 (399 connections now open) 2015-10-05T04:02:07.530+0100 [mongosMain] connection accepted from 172.28.0.163:51771 #1420995 (400 connections now open) 2015-10-05T04:02:07.530+0100 [conn1420994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:07.531+0100 [conn1420995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:12.863+0100 [conn1420597] end connection 172.28.0.164:58848 (399 connections now open) 2015-10-05T04:02:12.865+0100 [mongosMain] connection accepted from 172.28.0.164:61275 #1420996 (400 connections now open) 2015-10-05T04:02:12.866+0100 [conn1420996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:13.551+0100 [conn1420590] end connection 172.28.0.163:49410 (399 connections now open) 2015-10-05T04:02:13.553+0100 [mongosMain] connection accepted from 172.28.0.163:51827 #1420997 (400 connections now open) 2015-10-05T04:02:13.554+0100 [conn1420997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:14.206+0100 [conn1420599] end connection 172.28.0.163:49448 (399 connections now open) 2015-10-05T04:02:14.207+0100 [mongosMain] connection accepted from 172.28.0.163:51829 #1420998 (400 connections now open) 2015-10-05T04:02:14.208+0100 [conn1420998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:16.155+0100 [conn1420576] end connection 172.28.0.164:58756 (399 connections now open) 2015-10-05T04:02:16.155+0100 [conn1420438] end connection 172.28.0.164:57574 (398 connections now open) 2015-10-05T04:02:16.156+0100 [mongosMain] connection accepted from 172.28.0.164:61295 #1420999 (399 connections now open) 2015-10-05T04:02:16.156+0100 [mongosMain] connection accepted from 172.28.0.164:61296 #1421000 (400 connections now open) 2015-10-05T04:02:16.158+0100 [conn1420999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:16.158+0100 [conn1421000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:16.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8385703b51053eaec48 2015-10-05T04:02:16.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:17.529+0100 [conn1420554] end connection 172.28.0.163:49167 (399 connections now open) 2015-10-05T04:02:17.529+0100 [conn1420587] end connection 172.28.0.163:49401 (399 connections now open) 2015-10-05T04:02:17.529+0100 [mongosMain] connection accepted from 172.28.0.163:51842 #1421001 (399 connections now open) 2015-10-05T04:02:17.530+0100 [mongosMain] connection accepted from 172.28.0.163:51843 #1421002 (400 connections now open) 2015-10-05T04:02:17.531+0100 [conn1421001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:17.531+0100 [conn1421002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:22.425+0100 [conn1420555] end connection 172.28.0.164:58616 (399 connections now open) 2015-10-05T04:02:22.426+0100 [mongosMain] connection accepted from 172.28.0.164:61304 #1421003 (400 connections now open) 2015-10-05T04:02:22.428+0100 [conn1421003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:22.879+0100 [conn1420605] end connection 172.28.0.164:58911 (399 connections now open) 2015-10-05T04:02:22.880+0100 [mongosMain] connection accepted from 172.28.0.164:61307 #1421004 (400 connections now open) 2015-10-05T04:02:22.882+0100 [conn1421004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:23.566+0100 [conn1420582] end connection 172.28.0.163:49392 (399 connections now open) 2015-10-05T04:02:23.567+0100 [mongosMain] connection accepted from 172.28.0.163:51848 #1421005 (400 connections now open) 2015-10-05T04:02:23.568+0100 [conn1421005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:24.206+0100 [conn1420607] end connection 172.28.0.163:49507 (399 connections now open) 2015-10-05T04:02:24.207+0100 [mongosMain] connection accepted from 172.28.0.163:51850 #1421006 (400 connections now open) 2015-10-05T04:02:24.208+0100 [conn1421006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:26.170+0100 [conn1420601] end connection 172.28.0.164:58868 (399 connections now open) 2015-10-05T04:02:26.171+0100 [mongosMain] connection accepted from 172.28.0.164:61312 #1421007 (400 connections now open) 2015-10-05T04:02:26.173+0100 [conn1421007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:26.456+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:02:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:02:27.545+0100 [conn1420595] end connection 172.28.0.163:49418 (399 connections now open) 2015-10-05T04:02:27.545+0100 [conn1420561] end connection 172.28.0.163:49251 (399 connections now open) 2015-10-05T04:02:27.546+0100 [mongosMain] connection accepted from 172.28.0.163:51852 #1421008 (399 connections now open) 2015-10-05T04:02:27.546+0100 [mongosMain] connection accepted from 172.28.0.163:51853 #1421009 (400 connections now open) 2015-10-05T04:02:27.547+0100 [conn1421008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:27.548+0100 [conn1421009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:29.011+0100 [mongosMain] connection accepted from 127.0.0.1:51856 #1421010 (401 connections now open) 2015-10-05T04:02:29.014+0100 [conn1421010] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:29.019+0100 [conn1421010] end connection 127.0.0.1:51856 (400 connections now open) 2015-10-05T04:02:29.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8445703b51053eaed84 2015-10-05T04:02:29.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:32.441+0100 [conn1420562] end connection 172.28.0.164:58666 (399 connections now open) 2015-10-05T04:02:32.442+0100 [mongosMain] connection accepted from 172.28.0.164:61320 #1421011 (400 connections now open) 2015-10-05T04:02:32.444+0100 [conn1421011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:32.895+0100 [conn1420613] end connection 172.28.0.164:58956 (399 connections now open) 2015-10-05T04:02:32.896+0100 [mongosMain] connection accepted from 172.28.0.164:61323 #1421012 (400 connections now open) 2015-10-05T04:02:32.897+0100 [conn1421012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:33.567+0100 [conn1420598] end connection 172.28.0.163:49442 (399 connections now open) 2015-10-05T04:02:33.569+0100 [mongosMain] connection accepted from 172.28.0.163:51858 #1421013 (400 connections now open) 2015-10-05T04:02:33.570+0100 [conn1421013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:34.222+0100 [conn1420615] end connection 172.28.0.163:49569 (399 connections now open) 2015-10-05T04:02:34.224+0100 [mongosMain] connection accepted from 172.28.0.163:51860 #1421014 (400 connections now open) 2015-10-05T04:02:34.225+0100 [conn1421014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:35.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e84b5703b51053eaee22 2015-10-05T04:02:35.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:36.170+0100 [conn1420617] end connection 172.28.0.164:58975 (399 connections now open) 2015-10-05T04:02:36.170+0100 [conn1420608] end connection 172.28.0.164:58914 (399 connections now open) 2015-10-05T04:02:36.171+0100 [mongosMain] connection accepted from 172.28.0.164:61329 #1421015 (399 connections now open) 2015-10-05T04:02:36.172+0100 [mongosMain] connection accepted from 172.28.0.164:61330 #1421016 (400 connections now open) 2015-10-05T04:02:36.173+0100 [conn1421015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:36.173+0100 [conn1421016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:37.548+0100 [conn1420602] end connection 172.28.0.163:49462 (399 connections now open) 2015-10-05T04:02:37.548+0100 [conn1420586] end connection 172.28.0.163:49400 (398 connections now open) 2015-10-05T04:02:37.549+0100 [mongosMain] connection accepted from 172.28.0.163:51864 #1421017 (399 connections now open) 2015-10-05T04:02:37.549+0100 [mongosMain] connection accepted from 172.28.0.163:51865 #1421018 (400 connections now open) 2015-10-05T04:02:37.550+0100 [conn1421017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:37.550+0100 [conn1421018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:39.571+0100 [mongosMain] connection accepted from 127.0.0.1:51868 #1421019 (401 connections now open) 2015-10-05T04:02:39.573+0100 [conn1421019] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:39.577+0100 [conn1421019] end connection 127.0.0.1:51868 (400 connections now open) 2015-10-05T04:02:41.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8515703b51053eaeeb6 2015-10-05T04:02:41.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:42.441+0100 [conn1420588] end connection 172.28.0.164:58826 (399 connections now open) 2015-10-05T04:02:42.442+0100 [mongosMain] connection accepted from 172.28.0.164:61340 #1421020 (400 connections now open) 2015-10-05T04:02:42.443+0100 [conn1421020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:42.910+0100 [conn1420622] end connection 172.28.0.164:59024 (399 connections now open) 2015-10-05T04:02:42.912+0100 [mongosMain] connection accepted from 172.28.0.164:61342 #1421021 (400 connections now open) 2015-10-05T04:02:42.914+0100 [conn1421021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:43.582+0100 [conn1420606] end connection 172.28.0.163:49505 (399 connections now open) 2015-10-05T04:02:43.584+0100 [mongosMain] connection accepted from 172.28.0.163:51872 #1421022 (400 connections now open) 2015-10-05T04:02:43.585+0100 [conn1421022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:44.237+0100 [conn1420624] end connection 172.28.0.163:49630 (399 connections now open) 2015-10-05T04:02:44.238+0100 [mongosMain] connection accepted from 172.28.0.163:51875 #1421023 (400 connections now open) 2015-10-05T04:02:44.239+0100 [conn1421023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:46.186+0100 [conn1420609] end connection 172.28.0.164:58918 (399 connections now open) 2015-10-05T04:02:46.186+0100 [conn1420616] end connection 172.28.0.164:58970 (398 connections now open) 2015-10-05T04:02:46.187+0100 [mongosMain] connection accepted from 172.28.0.164:61349 #1421024 (399 connections now open) 2015-10-05T04:02:46.187+0100 [mongosMain] connection accepted from 172.28.0.164:61348 #1421025 (400 connections now open) 2015-10-05T04:02:46.189+0100 [conn1421024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:46.189+0100 [conn1421025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:47.560+0100 [conn1420611] end connection 172.28.0.163:49533 (399 connections now open) 2015-10-05T04:02:47.560+0100 [conn1420578] end connection 172.28.0.163:49357 (399 connections now open) 2015-10-05T04:02:47.561+0100 [mongosMain] connection accepted from 172.28.0.163:51882 #1421026 (399 connections now open) 2015-10-05T04:02:47.562+0100 [mongosMain] connection accepted from 172.28.0.163:51883 #1421027 (400 connections now open) 2015-10-05T04:02:47.563+0100 [conn1421026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:47.563+0100 [conn1421027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:52.457+0100 [conn1420596] end connection 172.28.0.164:58844 (399 connections now open) 2015-10-05T04:02:52.458+0100 [mongosMain] connection accepted from 172.28.0.164:61358 #1421028 (400 connections now open) 2015-10-05T04:02:52.459+0100 [conn1421028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:52.926+0100 [conn1420630] end connection 172.28.0.164:59088 (399 connections now open) 2015-10-05T04:02:52.927+0100 [mongosMain] connection accepted from 172.28.0.164:61360 #1421029 (400 connections now open) 2015-10-05T04:02:52.928+0100 [conn1421029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:53.586+0100 [conn1420623] end connection 172.28.0.163:49624 (399 connections now open) 2015-10-05T04:02:53.587+0100 [mongosMain] connection accepted from 172.28.0.163:51892 #1421030 (400 connections now open) 2015-10-05T04:02:53.588+0100 [conn1421030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:54.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e85d5703b51053eaeff3 2015-10-05T04:02:54.241+0100 [conn1420632] end connection 172.28.0.163:49674 (399 connections now open) 2015-10-05T04:02:54.242+0100 [mongosMain] connection accepted from 172.28.0.163:51894 #1421031 (400 connections now open) 2015-10-05T04:02:54.243+0100 [conn1421031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:54.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:02:56.201+0100 [conn1420592] end connection 172.28.0.164:58832 (399 connections now open) 2015-10-05T04:02:56.202+0100 [mongosMain] connection accepted from 172.28.0.164:61365 #1421032 (400 connections now open) 2015-10-05T04:02:56.203+0100 [conn1421032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:56.637+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:02:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:02:57.570+0100 [conn1420618] end connection 172.28.0.163:49583 (399 connections now open) 2015-10-05T04:02:57.570+0100 [conn1420627] end connection 172.28.0.163:49651 (398 connections now open) 2015-10-05T04:02:57.571+0100 [mongosMain] connection accepted from 172.28.0.163:51901 #1421033 (399 connections now open) 2015-10-05T04:02:57.572+0100 [mongosMain] connection accepted from 172.28.0.163:51902 #1421034 (400 connections now open) 2015-10-05T04:02:57.572+0100 [conn1421033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:02:57.573+0100 [conn1421034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:00.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8645703b51053eaf08c 2015-10-05T04:03:00.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:02.475+0100 [conn1420580] end connection 172.28.0.164:58807 (399 connections now open) 2015-10-05T04:03:02.477+0100 [mongosMain] connection accepted from 172.28.0.164:61378 #1421035 (400 connections now open) 2015-10-05T04:03:02.478+0100 [conn1421035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:02.926+0100 [conn1420638] end connection 172.28.0.164:59107 (399 connections now open) 2015-10-05T04:03:02.928+0100 [mongosMain] connection accepted from 172.28.0.164:61385 #1421036 (400 connections now open) 2015-10-05T04:03:02.930+0100 [conn1421036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:03.598+0100 [conn1420614] end connection 172.28.0.163:49565 (399 connections now open) 2015-10-05T04:03:03.599+0100 [mongosMain] connection accepted from 172.28.0.163:51931 #1421037 (400 connections now open) 2015-10-05T04:03:03.600+0100 [conn1421037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:04.253+0100 [conn1420640] end connection 172.28.0.163:49691 (399 connections now open) 2015-10-05T04:03:04.254+0100 [mongosMain] connection accepted from 172.28.0.163:51936 #1421038 (400 connections now open) 2015-10-05T04:03:04.256+0100 [conn1421038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:06.218+0100 [conn1420625] end connection 172.28.0.164:59038 (399 connections now open) 2015-10-05T04:03:06.219+0100 [conn1420634] end connection 172.28.0.164:59093 (398 connections now open) 2015-10-05T04:03:06.220+0100 [mongosMain] connection accepted from 172.28.0.164:61406 #1421039 (399 connections now open) 2015-10-05T04:03:06.220+0100 [mongosMain] connection accepted from 172.28.0.164:61407 #1421040 (400 connections now open) 2015-10-05T04:03:06.221+0100 [conn1421039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:06.222+0100 [conn1421040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:06.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e86a5703b51053eaf13c 2015-10-05T04:03:07.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:07.576+0100 [conn1420594] end connection 172.28.0.163:49417 (399 connections now open) 2015-10-05T04:03:07.577+0100 [conn1420643] end connection 172.28.0.163:49697 (399 connections now open) 2015-10-05T04:03:07.578+0100 [mongosMain] connection accepted from 172.28.0.163:51955 #1421041 (399 connections now open) 2015-10-05T04:03:07.578+0100 [mongosMain] connection accepted from 172.28.0.163:51956 #1421042 (400 connections now open) 2015-10-05T04:03:07.578+0100 [conn1421041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:07.579+0100 [conn1421042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:12.488+0100 [conn1420604] end connection 172.28.0.164:58907 (399 connections now open) 2015-10-05T04:03:12.489+0100 [mongosMain] connection accepted from 172.28.0.164:61439 #1421043 (400 connections now open) 2015-10-05T04:03:12.491+0100 [conn1421043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:12.941+0100 [conn1420646] end connection 172.28.0.164:59127 (399 connections now open) 2015-10-05T04:03:12.944+0100 [mongosMain] connection accepted from 172.28.0.164:61441 #1421044 (400 connections now open) 2015-10-05T04:03:12.946+0100 [conn1421044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:13.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8715703b51053eaf1c9 2015-10-05T04:03:13.300+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:13.614+0100 [conn1420631] end connection 172.28.0.163:49672 (399 connections now open) 2015-10-05T04:03:13.615+0100 [mongosMain] connection accepted from 172.28.0.163:51986 #1421045 (400 connections now open) 2015-10-05T04:03:13.616+0100 [conn1421045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:14.254+0100 [conn1420648] end connection 172.28.0.163:49727 (399 connections now open) 2015-10-05T04:03:14.255+0100 [mongosMain] connection accepted from 172.28.0.163:51989 #1421046 (400 connections now open) 2015-10-05T04:03:14.256+0100 [conn1421046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:16.233+0100 [conn1420650] end connection 172.28.0.164:59139 (399 connections now open) 2015-10-05T04:03:16.233+0100 [conn1420600] end connection 172.28.0.164:58865 (398 connections now open) 2015-10-05T04:03:16.234+0100 [mongosMain] connection accepted from 172.28.0.164:61445 #1421047 (399 connections now open) 2015-10-05T04:03:16.235+0100 [mongosMain] connection accepted from 172.28.0.164:61446 #1421048 (400 connections now open) 2015-10-05T04:03:16.236+0100 [conn1421047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:16.237+0100 [conn1421048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:17.578+0100 [conn1420619] end connection 172.28.0.163:49584 (399 connections now open) 2015-10-05T04:03:17.578+0100 [conn1420626] end connection 172.28.0.163:49650 (399 connections now open) 2015-10-05T04:03:17.579+0100 [mongosMain] connection accepted from 172.28.0.163:51994 #1421049 (399 connections now open) 2015-10-05T04:03:17.579+0100 [mongosMain] connection accepted from 172.28.0.163:51995 #1421050 (400 connections now open) 2015-10-05T04:03:17.580+0100 [conn1421049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:17.580+0100 [conn1421050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:19.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8775703b51053eaf24e 2015-10-05T04:03:19.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:22.506+0100 [conn1420612] end connection 172.28.0.164:58952 (399 connections now open) 2015-10-05T04:03:22.507+0100 [mongosMain] connection accepted from 172.28.0.164:61453 #1421051 (400 connections now open) 2015-10-05T04:03:22.509+0100 [conn1421051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:22.958+0100 [conn1420654] end connection 172.28.0.164:59187 (399 connections now open) 2015-10-05T04:03:22.959+0100 [mongosMain] connection accepted from 172.28.0.164:61456 #1421052 (400 connections now open) 2015-10-05T04:03:22.961+0100 [conn1421052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:24.269+0100 [conn1420656] end connection 172.28.0.163:49793 (399 connections now open) 2015-10-05T04:03:24.271+0100 [mongosMain] connection accepted from 172.28.0.163:52001 #1421053 (400 connections now open) 2015-10-05T04:03:24.272+0100 [conn1421053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:25.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e87d5703b51053eaf2dc 2015-10-05T04:03:25.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:26.250+0100 [conn1420641] end connection 172.28.0.164:59109 (399 connections now open) 2015-10-05T04:03:26.250+0100 [conn1420585] end connection 172.28.0.164:58815 (398 connections now open) 2015-10-05T04:03:26.252+0100 [mongosMain] connection accepted from 172.28.0.164:61462 #1421054 (399 connections now open) 2015-10-05T04:03:26.252+0100 [mongosMain] connection accepted from 172.28.0.164:61463 #1421055 (400 connections now open) 2015-10-05T04:03:26.253+0100 [conn1421054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:26.254+0100 [conn1421055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:26.785+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:03:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:03:27.591+0100 [conn1420659] end connection 172.28.0.163:49815 (399 connections now open) 2015-10-05T04:03:27.591+0100 [conn1420652] end connection 172.28.0.163:49746 (398 connections now open) 2015-10-05T04:03:27.592+0100 [mongosMain] connection accepted from 172.28.0.163:52003 #1421056 (399 connections now open) 2015-10-05T04:03:27.592+0100 [mongosMain] connection accepted from 172.28.0.163:52004 #1421057 (400 connections now open) 2015-10-05T04:03:27.593+0100 [conn1421056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:27.594+0100 [conn1421057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:29.022+0100 [mongosMain] connection accepted from 127.0.0.1:52007 #1421058 (401 connections now open) 2015-10-05T04:03:29.027+0100 [conn1421058] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:29.033+0100 [conn1421058] end connection 127.0.0.1:52007 (400 connections now open) 2015-10-05T04:03:32.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8835703b51053eaf367 2015-10-05T04:03:32.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:32.520+0100 [conn1420645] end connection 172.28.0.164:59124 (399 connections now open) 2015-10-05T04:03:32.521+0100 [mongosMain] connection accepted from 172.28.0.164:61470 #1421059 (400 connections now open) 2015-10-05T04:03:32.522+0100 [conn1421059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:32.973+0100 [conn1420662] end connection 172.28.0.164:59246 (399 connections now open) 2015-10-05T04:03:32.974+0100 [mongosMain] connection accepted from 172.28.0.164:61473 #1421060 (400 connections now open) 2015-10-05T04:03:32.975+0100 [conn1421060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:33.629+0100 [conn1420647] end connection 172.28.0.163:49723 (399 connections now open) 2015-10-05T04:03:33.630+0100 [mongosMain] connection accepted from 172.28.0.163:52008 #1421061 (400 connections now open) 2015-10-05T04:03:33.632+0100 [conn1421061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:34.269+0100 [conn1420664] end connection 172.28.0.163:49851 (399 connections now open) 2015-10-05T04:03:34.271+0100 [mongosMain] connection accepted from 172.28.0.163:52010 #1421062 (400 connections now open) 2015-10-05T04:03:34.272+0100 [conn1421062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:36.265+0100 [conn1420575] end connection 172.28.0.164:58752 (399 connections now open) 2015-10-05T04:03:36.265+0100 [conn1420658] end connection 172.28.0.164:59198 (398 connections now open) 2015-10-05T04:03:36.266+0100 [mongosMain] connection accepted from 172.28.0.164:61479 #1421063 (399 connections now open) 2015-10-05T04:03:36.266+0100 [mongosMain] connection accepted from 172.28.0.164:61480 #1421064 (400 connections now open) 2015-10-05T04:03:36.268+0100 [conn1421063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:36.268+0100 [conn1421064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:37.607+0100 [conn1420635] end connection 172.28.0.163:49679 (399 connections now open) 2015-10-05T04:03:37.608+0100 [mongosMain] connection accepted from 172.28.0.163:52014 #1421065 (400 connections now open) 2015-10-05T04:03:37.608+0100 [conn1420636] end connection 172.28.0.163:49680 (399 connections now open) 2015-10-05T04:03:37.609+0100 [mongosMain] connection accepted from 172.28.0.163:52016 #1421066 (400 connections now open) 2015-10-05T04:03:37.615+0100 [conn1421065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:37.615+0100 [conn1421066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:38.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e88a5703b51053eaf3e5 2015-10-05T04:03:38.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:39.505+0100 [mongosMain] connection accepted from 127.0.0.1:52018 #1421067 (401 connections now open) 2015-10-05T04:03:39.507+0100 [conn1421067] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:39.511+0100 [conn1421067] end connection 127.0.0.1:52018 (400 connections now open) 2015-10-05T04:03:42.519+0100 [conn1420629] end connection 172.28.0.164:59086 (399 connections now open) 2015-10-05T04:03:42.520+0100 [mongosMain] connection accepted from 172.28.0.164:61491 #1421068 (400 connections now open) 2015-10-05T04:03:42.523+0100 [conn1421068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:42.988+0100 [conn1420670] end connection 172.28.0.164:59320 (399 connections now open) 2015-10-05T04:03:42.989+0100 [mongosMain] connection accepted from 172.28.0.164:61493 #1421069 (400 connections now open) 2015-10-05T04:03:42.991+0100 [conn1421069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:43.630+0100 [conn1420655] end connection 172.28.0.163:49790 (399 connections now open) 2015-10-05T04:03:43.631+0100 [mongosMain] connection accepted from 172.28.0.163:52022 #1421070 (400 connections now open) 2015-10-05T04:03:43.632+0100 [conn1421070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:44.285+0100 [conn1420672] end connection 172.28.0.163:49906 (399 connections now open) 2015-10-05T04:03:44.287+0100 [mongosMain] connection accepted from 172.28.0.163:52025 #1421071 (400 connections now open) 2015-10-05T04:03:44.288+0100 [conn1421071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:45.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8905703b51053eaf46d 2015-10-05T04:03:45.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:46.280+0100 [conn1420642] end connection 172.28.0.164:59112 (399 connections now open) 2015-10-05T04:03:46.280+0100 [conn1420633] end connection 172.28.0.164:59090 (398 connections now open) 2015-10-05T04:03:46.282+0100 [mongosMain] connection accepted from 172.28.0.164:61500 #1421072 (399 connections now open) 2015-10-05T04:03:46.282+0100 [mongosMain] connection accepted from 172.28.0.164:61501 #1421073 (400 connections now open) 2015-10-05T04:03:46.284+0100 [conn1421072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:46.284+0100 [conn1421073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:47.608+0100 [conn1420651] end connection 172.28.0.163:49745 (399 connections now open) 2015-10-05T04:03:47.608+0100 [conn1420610] end connection 172.28.0.163:49532 (398 connections now open) 2015-10-05T04:03:47.610+0100 [mongosMain] connection accepted from 172.28.0.163:52032 #1421074 (399 connections now open) 2015-10-05T04:03:47.610+0100 [mongosMain] connection accepted from 172.28.0.163:52033 #1421075 (400 connections now open) 2015-10-05T04:03:47.611+0100 [conn1421074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:47.611+0100 [conn1421075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:51.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8975703b51053eaf4e3 2015-10-05T04:03:51.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:03:52.520+0100 [conn1420621] end connection 172.28.0.164:59019 (399 connections now open) 2015-10-05T04:03:52.521+0100 [mongosMain] connection accepted from 172.28.0.164:61507 #1421076 (400 connections now open) 2015-10-05T04:03:52.523+0100 [conn1421076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:52.988+0100 [conn1420679] end connection 172.28.0.164:59350 (399 connections now open) 2015-10-05T04:03:52.989+0100 [mongosMain] connection accepted from 172.28.0.164:61509 #1421077 (400 connections now open) 2015-10-05T04:03:52.991+0100 [conn1421077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:53.645+0100 [conn1420639] end connection 172.28.0.163:49689 (399 connections now open) 2015-10-05T04:03:53.646+0100 [mongosMain] connection accepted from 172.28.0.163:52043 #1421078 (400 connections now open) 2015-10-05T04:03:53.647+0100 [conn1421078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:54.285+0100 [conn1420681] end connection 172.28.0.163:49920 (399 connections now open) 2015-10-05T04:03:54.287+0100 [mongosMain] connection accepted from 172.28.0.163:52045 #1421079 (400 connections now open) 2015-10-05T04:03:54.288+0100 [conn1421079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:56.296+0100 [conn1420657] end connection 172.28.0.164:59195 (399 connections now open) 2015-10-05T04:03:56.297+0100 [mongosMain] connection accepted from 172.28.0.164:61515 #1421080 (400 connections now open) 2015-10-05T04:03:56.298+0100 [conn1421080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:57.055+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:03:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:03:57.624+0100 [conn1420667] end connection 172.28.0.163:49868 (399 connections now open) 2015-10-05T04:03:57.624+0100 [conn1420603] end connection 172.28.0.163:49463 (398 connections now open) 2015-10-05T04:03:57.625+0100 [mongosMain] connection accepted from 172.28.0.163:52051 #1421081 (399 connections now open) 2015-10-05T04:03:57.626+0100 [mongosMain] connection accepted from 172.28.0.163:52052 #1421082 (400 connections now open) 2015-10-05T04:03:57.626+0100 [conn1421081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:57.627+0100 [conn1421082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:03:57.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e89d5703b51053eaf554 2015-10-05T04:03:57.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:02.536+0100 [conn1420653] end connection 172.28.0.164:59182 (399 connections now open) 2015-10-05T04:04:02.537+0100 [mongosMain] connection accepted from 172.28.0.164:61529 #1421083 (400 connections now open) 2015-10-05T04:04:02.538+0100 [conn1421083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:03.005+0100 [conn1420687] end connection 172.28.0.164:59367 (399 connections now open) 2015-10-05T04:04:03.006+0100 [mongosMain] connection accepted from 172.28.0.164:61535 #1421084 (400 connections now open) 2015-10-05T04:04:03.008+0100 [conn1421084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:03.645+0100 [conn1420671] end connection 172.28.0.163:49901 (399 connections now open) 2015-10-05T04:04:03.646+0100 [mongosMain] connection accepted from 172.28.0.163:52082 #1421085 (400 connections now open) 2015-10-05T04:04:03.647+0100 [conn1421085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:04.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8a35703b51053eaf5d5 2015-10-05T04:04:04.299+0100 [conn1420689] end connection 172.28.0.163:49940 (399 connections now open) 2015-10-05T04:04:04.300+0100 [mongosMain] connection accepted from 172.28.0.163:52086 #1421086 (400 connections now open) 2015-10-05T04:04:04.301+0100 [conn1421086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:04.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:06.311+0100 [conn1420691] end connection 172.28.0.164:59373 (399 connections now open) 2015-10-05T04:04:06.312+0100 [conn1420584] end connection 172.28.0.164:58813 (398 connections now open) 2015-10-05T04:04:06.313+0100 [mongosMain] connection accepted from 172.28.0.164:61552 #1421087 (399 connections now open) 2015-10-05T04:04:06.313+0100 [mongosMain] connection accepted from 172.28.0.164:61553 #1421088 (400 connections now open) 2015-10-05T04:04:06.314+0100 [conn1421087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:06.314+0100 [conn1421088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:07.626+0100 [conn1420483] end connection 172.28.0.163:64805 (399 connections now open) 2015-10-05T04:04:07.626+0100 [conn1420676] end connection 172.28.0.163:49909 (399 connections now open) 2015-10-05T04:04:07.626+0100 [mongosMain] connection accepted from 172.28.0.163:52109 #1421089 (399 connections now open) 2015-10-05T04:04:07.627+0100 [mongosMain] connection accepted from 172.28.0.163:52110 #1421090 (400 connections now open) 2015-10-05T04:04:07.627+0100 [conn1421089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:07.628+0100 [conn1421090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:10.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8aa5703b51053eaf665 2015-10-05T04:04:10.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:12.551+0100 [conn1420637] end connection 172.28.0.164:59103 (399 connections now open) 2015-10-05T04:04:12.552+0100 [mongosMain] connection accepted from 172.28.0.164:61586 #1421091 (400 connections now open) 2015-10-05T04:04:12.554+0100 [conn1421091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:13.020+0100 [conn1420695] end connection 172.28.0.164:59393 (399 connections now open) 2015-10-05T04:04:13.021+0100 [mongosMain] connection accepted from 172.28.0.164:61588 #1421092 (400 connections now open) 2015-10-05T04:04:13.022+0100 [conn1421092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:13.661+0100 [conn1420663] end connection 172.28.0.163:49846 (399 connections now open) 2015-10-05T04:04:13.662+0100 [mongosMain] connection accepted from 172.28.0.163:52139 #1421093 (400 connections now open) 2015-10-05T04:04:13.664+0100 [conn1421093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:14.316+0100 [conn1420697] end connection 172.28.0.163:49978 (399 connections now open) 2015-10-05T04:04:14.317+0100 [mongosMain] connection accepted from 172.28.0.163:52141 #1421094 (400 connections now open) 2015-10-05T04:04:14.319+0100 [conn1421094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:16.311+0100 [conn1420683] end connection 172.28.0.164:59355 (399 connections now open) 2015-10-05T04:04:16.312+0100 [conn1420682] end connection 172.28.0.164:59353 (398 connections now open) 2015-10-05T04:04:16.313+0100 [mongosMain] connection accepted from 172.28.0.164:61593 #1421095 (399 connections now open) 2015-10-05T04:04:16.313+0100 [mongosMain] connection accepted from 172.28.0.164:61592 #1421096 (400 connections now open) 2015-10-05T04:04:16.314+0100 [conn1421095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:16.315+0100 [conn1421096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:16.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8b05703b51053eaf6d6 2015-10-05T04:04:16.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:17.639+0100 [conn1420685] end connection 172.28.0.163:49927 (399 connections now open) 2015-10-05T04:04:17.639+0100 [conn1420692] end connection 172.28.0.163:49946 (399 connections now open) 2015-10-05T04:04:17.640+0100 [mongosMain] connection accepted from 172.28.0.163:52147 #1421097 (399 connections now open) 2015-10-05T04:04:17.641+0100 [mongosMain] connection accepted from 172.28.0.163:52148 #1421098 (400 connections now open) 2015-10-05T04:04:17.641+0100 [conn1421097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:17.641+0100 [conn1421098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:22.551+0100 [conn1420661] end connection 172.28.0.164:59241 (399 connections now open) 2015-10-05T04:04:22.553+0100 [mongosMain] connection accepted from 172.28.0.164:61602 #1421099 (400 connections now open) 2015-10-05T04:04:22.554+0100 [conn1421099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:23.020+0100 [conn1420703] end connection 172.28.0.164:59444 (399 connections now open) 2015-10-05T04:04:23.021+0100 [mongosMain] connection accepted from 172.28.0.164:61605 #1421100 (400 connections now open) 2015-10-05T04:04:23.023+0100 [conn1421100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:23.133+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8b65703b51053eaf726 2015-10-05T04:04:23.269+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:23.661+0100 [conn1420688] end connection 172.28.0.163:49936 (399 connections now open) 2015-10-05T04:04:23.662+0100 [mongosMain] connection accepted from 172.28.0.163:52152 #1421101 (400 connections now open) 2015-10-05T04:04:23.663+0100 [conn1421101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:24.316+0100 [conn1420705] end connection 172.28.0.163:50046 (399 connections now open) 2015-10-05T04:04:24.317+0100 [mongosMain] connection accepted from 172.28.0.163:52154 #1421102 (400 connections now open) 2015-10-05T04:04:24.318+0100 [conn1421102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:26.328+0100 [conn1420707] end connection 172.28.0.164:59452 (399 connections now open) 2015-10-05T04:04:26.328+0100 [conn1420649] end connection 172.28.0.164:59135 (398 connections now open) 2015-10-05T04:04:26.333+0100 [mongosMain] connection accepted from 172.28.0.164:61611 #1421103 (399 connections now open) 2015-10-05T04:04:26.333+0100 [mongosMain] connection accepted from 172.28.0.164:61612 #1421104 (400 connections now open) 2015-10-05T04:04:26.335+0100 [conn1421103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:26.335+0100 [conn1421104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:27.333+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:04:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:04:27.641+0100 [conn1420709] end connection 172.28.0.163:50065 (399 connections now open) 2015-10-05T04:04:27.641+0100 [conn1420666] end connection 172.28.0.163:49867 (398 connections now open) 2015-10-05T04:04:27.642+0100 [mongosMain] connection accepted from 172.28.0.163:52156 #1421105 (399 connections now open) 2015-10-05T04:04:27.642+0100 [mongosMain] connection accepted from 172.28.0.163:52157 #1421106 (400 connections now open) 2015-10-05T04:04:27.643+0100 [conn1421105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:27.643+0100 [conn1421106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:29.130+0100 [mongosMain] connection accepted from 127.0.0.1:52161 #1421107 (401 connections now open) 2015-10-05T04:04:29.133+0100 [conn1421107] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:29.138+0100 [conn1421107] end connection 127.0.0.1:52161 (400 connections now open) 2015-10-05T04:04:29.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8bd5703b51053eaf77e 2015-10-05T04:04:29.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:32.567+0100 [conn1420669] end connection 172.28.0.164:59317 (399 connections now open) 2015-10-05T04:04:32.568+0100 [mongosMain] connection accepted from 172.28.0.164:61621 #1421108 (400 connections now open) 2015-10-05T04:04:32.570+0100 [conn1421108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:33.036+0100 [conn1420711] end connection 172.28.0.164:59510 (399 connections now open) 2015-10-05T04:04:33.038+0100 [mongosMain] connection accepted from 172.28.0.164:61622 #1421109 (400 connections now open) 2015-10-05T04:04:33.040+0100 [conn1421109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:33.677+0100 [conn1420696] end connection 172.28.0.163:49972 (399 connections now open) 2015-10-05T04:04:33.678+0100 [mongosMain] connection accepted from 172.28.0.163:52162 #1421110 (400 connections now open) 2015-10-05T04:04:33.680+0100 [conn1421110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:34.332+0100 [conn1420713] end connection 172.28.0.163:50101 (399 connections now open) 2015-10-05T04:04:34.334+0100 [mongosMain] connection accepted from 172.28.0.163:52164 #1421111 (400 connections now open) 2015-10-05T04:04:34.335+0100 [conn1421111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:35.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8c35703b51053eaf7c6 2015-10-05T04:04:36.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:36.343+0100 [conn1420715] end connection 172.28.0.164:59530 (399 connections now open) 2015-10-05T04:04:36.343+0100 [conn1420698] end connection 172.28.0.164:59400 (398 connections now open) 2015-10-05T04:04:36.344+0100 [mongosMain] connection accepted from 172.28.0.164:61630 #1421112 (399 connections now open) 2015-10-05T04:04:36.344+0100 [mongosMain] connection accepted from 172.28.0.164:61631 #1421113 (400 connections now open) 2015-10-05T04:04:36.345+0100 [conn1421112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:36.345+0100 [conn1421113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:37.655+0100 [conn1420717] end connection 172.28.0.163:50123 (399 connections now open) 2015-10-05T04:04:37.655+0100 [conn1420660] end connection 172.28.0.163:49816 (399 connections now open) 2015-10-05T04:04:37.656+0100 [mongosMain] connection accepted from 172.28.0.163:52166 #1421114 (399 connections now open) 2015-10-05T04:04:37.656+0100 [mongosMain] connection accepted from 172.28.0.163:52167 #1421115 (400 connections now open) 2015-10-05T04:04:37.657+0100 [conn1421114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:37.657+0100 [conn1421115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:39.573+0100 [mongosMain] connection accepted from 127.0.0.1:52171 #1421116 (401 connections now open) 2015-10-05T04:04:39.576+0100 [conn1421116] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:39.580+0100 [conn1421116] end connection 127.0.0.1:52171 (400 connections now open) 2015-10-05T04:04:42.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8ca5703b51053eaf813 2015-10-05T04:04:42.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:42.567+0100 [conn1420678] end connection 172.28.0.164:59348 (399 connections now open) 2015-10-05T04:04:42.568+0100 [mongosMain] connection accepted from 172.28.0.164:61641 #1421117 (400 connections now open) 2015-10-05T04:04:42.570+0100 [conn1421117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:43.036+0100 [conn1420720] end connection 172.28.0.164:59592 (399 connections now open) 2015-10-05T04:04:43.037+0100 [mongosMain] connection accepted from 172.28.0.164:61644 #1421118 (400 connections now open) 2015-10-05T04:04:43.039+0100 [conn1421118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:43.692+0100 [conn1420712] end connection 172.28.0.163:50095 (399 connections now open) 2015-10-05T04:04:43.693+0100 [mongosMain] connection accepted from 172.28.0.163:52176 #1421119 (400 connections now open) 2015-10-05T04:04:43.694+0100 [conn1421119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:44.332+0100 [conn1420722] end connection 172.28.0.163:50172 (399 connections now open) 2015-10-05T04:04:44.333+0100 [mongosMain] connection accepted from 172.28.0.163:52180 #1421120 (400 connections now open) 2015-10-05T04:04:44.334+0100 [conn1421120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:46.358+0100 [conn1420665] end connection 172.28.0.164:59257 (399 connections now open) 2015-10-05T04:04:46.358+0100 [conn1420674] end connection 172.28.0.164:59334 (398 connections now open) 2015-10-05T04:04:46.360+0100 [mongosMain] connection accepted from 172.28.0.164:61650 #1421121 (399 connections now open) 2015-10-05T04:04:46.360+0100 [mongosMain] connection accepted from 172.28.0.164:61651 #1421122 (400 connections now open) 2015-10-05T04:04:46.362+0100 [conn1421122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:46.362+0100 [conn1421121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:47.670+0100 [conn1420701] end connection 172.28.0.163:50001 (399 connections now open) 2015-10-05T04:04:47.671+0100 [conn1420675] end connection 172.28.0.163:49908 (398 connections now open) 2015-10-05T04:04:47.671+0100 [mongosMain] connection accepted from 172.28.0.163:52186 #1421123 (400 connections now open) 2015-10-05T04:04:47.672+0100 [mongosMain] connection accepted from 172.28.0.163:52187 #1421124 (400 connections now open) 2015-10-05T04:04:47.672+0100 [conn1421123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:47.673+0100 [conn1421124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:48.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8d05703b51053eaf869 2015-10-05T04:04:48.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:52.582+0100 [conn1420686] end connection 172.28.0.164:59365 (399 connections now open) 2015-10-05T04:04:52.583+0100 [mongosMain] connection accepted from 172.28.0.164:61660 #1421125 (400 connections now open) 2015-10-05T04:04:52.585+0100 [conn1421125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:53.051+0100 [conn1420729] end connection 172.28.0.164:59631 (399 connections now open) 2015-10-05T04:04:53.052+0100 [mongosMain] connection accepted from 172.28.0.164:61663 #1421126 (400 connections now open) 2015-10-05T04:04:53.054+0100 [conn1421126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:53.694+0100 [conn1420721] end connection 172.28.0.163:50166 (399 connections now open) 2015-10-05T04:04:53.695+0100 [mongosMain] connection accepted from 172.28.0.163:52196 #1421127 (400 connections now open) 2015-10-05T04:04:53.696+0100 [conn1421127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:54.349+0100 [conn1420731] end connection 172.28.0.163:50194 (399 connections now open) 2015-10-05T04:04:54.350+0100 [mongosMain] connection accepted from 172.28.0.163:52199 #1421128 (400 connections now open) 2015-10-05T04:04:54.351+0100 [conn1421128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:55.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8d65703b51053eaf8b9 2015-10-05T04:04:55.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:04:56.374+0100 [conn1420724] end connection 172.28.0.164:59612 (399 connections now open) 2015-10-05T04:04:56.374+0100 [conn1420673] end connection 172.28.0.164:59332 (398 connections now open) 2015-10-05T04:04:56.375+0100 [mongosMain] connection accepted from 172.28.0.164:61668 #1421129 (399 connections now open) 2015-10-05T04:04:56.375+0100 [mongosMain] connection accepted from 172.28.0.164:61669 #1421130 (400 connections now open) 2015-10-05T04:04:56.377+0100 [conn1421129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:56.377+0100 [conn1421130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:57.598+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:04:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:04:57.672+0100 [conn1420684] end connection 172.28.0.163:49926 (399 connections now open) 2015-10-05T04:04:57.672+0100 [conn1420708] end connection 172.28.0.163:50064 (399 connections now open) 2015-10-05T04:04:57.673+0100 [mongosMain] connection accepted from 172.28.0.163:52203 #1421131 (399 connections now open) 2015-10-05T04:04:57.674+0100 [mongosMain] connection accepted from 172.28.0.163:52204 #1421132 (400 connections now open) 2015-10-05T04:04:57.674+0100 [conn1421131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:04:57.675+0100 [conn1421132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:01.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8dd5703b51053eaf8f6 2015-10-05T04:05:01.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:02.583+0100 [conn1420694] end connection 172.28.0.164:59389 (399 connections now open) 2015-10-05T04:05:02.584+0100 [mongosMain] connection accepted from 172.28.0.164:61693 #1421133 (400 connections now open) 2015-10-05T04:05:02.586+0100 [conn1421133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:03.052+0100 [conn1420737] end connection 172.28.0.164:59649 (399 connections now open) 2015-10-05T04:05:03.053+0100 [mongosMain] connection accepted from 172.28.0.164:61695 #1421134 (400 connections now open) 2015-10-05T04:05:03.056+0100 [conn1421134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:03.708+0100 [conn1420680] end connection 172.28.0.163:49917 (399 connections now open) 2015-10-05T04:05:03.709+0100 [mongosMain] connection accepted from 172.28.0.163:52234 #1421135 (400 connections now open) 2015-10-05T04:05:03.710+0100 [conn1421135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:04.348+0100 [conn1420739] end connection 172.28.0.163:50212 (399 connections now open) 2015-10-05T04:05:04.350+0100 [mongosMain] connection accepted from 172.28.0.163:52242 #1421136 (400 connections now open) 2015-10-05T04:05:04.351+0100 [conn1421136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:06.390+0100 [conn1420741] end connection 172.28.0.164:59655 (399 connections now open) 2015-10-05T04:05:06.390+0100 [conn1420706] end connection 172.28.0.164:59448 (399 connections now open) 2015-10-05T04:05:06.391+0100 [mongosMain] connection accepted from 172.28.0.164:61714 #1421137 (399 connections now open) 2015-10-05T04:05:06.391+0100 [mongosMain] connection accepted from 172.28.0.164:61715 #1421138 (400 connections now open) 2015-10-05T04:05:06.392+0100 [conn1421137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:06.393+0100 [conn1421138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:07.686+0100 [conn1420700] end connection 172.28.0.163:50000 (399 connections now open) 2015-10-05T04:05:07.688+0100 [mongosMain] connection accepted from 172.28.0.163:52270 #1421139 (400 connections now open) 2015-10-05T04:05:07.689+0100 [conn1421139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:07.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8e35703b51053eaf952 2015-10-05T04:05:07.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:12.599+0100 [conn1420710] end connection 172.28.0.164:59505 (399 connections now open) 2015-10-05T04:05:12.600+0100 [mongosMain] connection accepted from 172.28.0.164:61741 #1421140 (400 connections now open) 2015-10-05T04:05:12.603+0100 [conn1421140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:13.067+0100 [conn1420744] end connection 172.28.0.164:59669 (399 connections now open) 2015-10-05T04:05:13.068+0100 [mongosMain] connection accepted from 172.28.0.164:61743 #1421141 (400 connections now open) 2015-10-05T04:05:13.070+0100 [conn1421141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:13.708+0100 [conn1420704] end connection 172.28.0.163:50043 (399 connections now open) 2015-10-05T04:05:13.709+0100 [mongosMain] connection accepted from 172.28.0.163:52309 #1421142 (400 connections now open) 2015-10-05T04:05:13.711+0100 [conn1421142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:14.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8e95703b51053eaf98f 2015-10-05T04:05:14.363+0100 [conn1420746] end connection 172.28.0.163:50253 (399 connections now open) 2015-10-05T04:05:14.364+0100 [mongosMain] connection accepted from 172.28.0.163:52312 #1421143 (400 connections now open) 2015-10-05T04:05:14.365+0100 [conn1421143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:14.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:16.406+0100 [conn1420714] end connection 172.28.0.164:59522 (399 connections now open) 2015-10-05T04:05:16.406+0100 [conn1420699] end connection 172.28.0.164:59403 (398 connections now open) 2015-10-05T04:05:16.407+0100 [mongosMain] connection accepted from 172.28.0.164:61748 #1421144 (399 connections now open) 2015-10-05T04:05:16.407+0100 [mongosMain] connection accepted from 172.28.0.164:61749 #1421145 (400 connections now open) 2015-10-05T04:05:16.409+0100 [conn1421144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:16.410+0100 [conn1421145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:17.692+0100 [conn1420742] end connection 172.28.0.163:50218 (399 connections now open) 2015-10-05T04:05:17.694+0100 [mongosMain] connection accepted from 172.28.0.163:52316 #1421146 (400 connections now open) 2015-10-05T04:05:17.695+0100 [conn1421146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:20.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8f05703b51053eaf9e0 2015-10-05T04:05:20.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:22.598+0100 [conn1420719] end connection 172.28.0.164:59586 (399 connections now open) 2015-10-05T04:05:22.600+0100 [mongosMain] connection accepted from 172.28.0.164:61758 #1421147 (400 connections now open) 2015-10-05T04:05:22.601+0100 [conn1421147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:23.068+0100 [conn1420752] end connection 172.28.0.164:59724 (399 connections now open) 2015-10-05T04:05:23.069+0100 [mongosMain] connection accepted from 172.28.0.164:61760 #1421148 (400 connections now open) 2015-10-05T04:05:23.071+0100 [conn1421148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:23.724+0100 [conn1420730] end connection 172.28.0.163:50192 (399 connections now open) 2015-10-05T04:05:23.725+0100 [mongosMain] connection accepted from 172.28.0.163:52322 #1421149 (400 connections now open) 2015-10-05T04:05:23.726+0100 [conn1421149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:24.365+0100 [conn1420754] end connection 172.28.0.163:50319 (399 connections now open) 2015-10-05T04:05:24.366+0100 [mongosMain] connection accepted from 172.28.0.163:52324 #1421150 (400 connections now open) 2015-10-05T04:05:24.367+0100 [conn1421150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:26.422+0100 [conn1420756] end connection 172.28.0.164:59730 (399 connections now open) 2015-10-05T04:05:26.424+0100 [mongosMain] connection accepted from 172.28.0.164:61767 #1421151 (400 connections now open) 2015-10-05T04:05:26.426+0100 [conn1421151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:27.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8f65703b51053eafa31 2015-10-05T04:05:27.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:27.702+0100 [conn1420726] end connection 172.28.0.163:50184 (399 connections now open) 2015-10-05T04:05:27.702+0100 [conn1420735] end connection 172.28.0.163:50200 (399 connections now open) 2015-10-05T04:05:27.703+0100 [mongosMain] connection accepted from 172.28.0.163:52326 #1421152 (399 connections now open) 2015-10-05T04:05:27.704+0100 [mongosMain] connection accepted from 172.28.0.163:52327 #1421153 (400 connections now open) 2015-10-05T04:05:27.704+0100 [conn1421152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:27.705+0100 [conn1421153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:27.852+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:05:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:05:28.979+0100 [mongosMain] connection accepted from 127.0.0.1:52333 #1421154 (401 connections now open) 2015-10-05T04:05:28.981+0100 [conn1421154] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:28.986+0100 [conn1421154] end connection 127.0.0.1:52333 (400 connections now open) 2015-10-05T04:05:32.614+0100 [conn1420728] end connection 172.28.0.164:59629 (399 connections now open) 2015-10-05T04:05:32.615+0100 [mongosMain] connection accepted from 172.28.0.164:61779 #1421155 (400 connections now open) 2015-10-05T04:05:32.617+0100 [conn1421155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:33.083+0100 [conn1420760] end connection 172.28.0.164:59775 (399 connections now open) 2015-10-05T04:05:33.084+0100 [mongosMain] connection accepted from 172.28.0.164:61782 #1421156 (400 connections now open) 2015-10-05T04:05:33.086+0100 [conn1421156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:33.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e8fd5703b51053eafa75 2015-10-05T04:05:33.620+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:33.724+0100 [conn1420745] end connection 172.28.0.163:50249 (399 connections now open) 2015-10-05T04:05:33.725+0100 [mongosMain] connection accepted from 172.28.0.163:52336 #1421157 (400 connections now open) 2015-10-05T04:05:33.726+0100 [conn1421157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:34.379+0100 [conn1420762] end connection 172.28.0.163:50387 (399 connections now open) 2015-10-05T04:05:34.380+0100 [mongosMain] connection accepted from 172.28.0.163:52338 #1421158 (400 connections now open) 2015-10-05T04:05:34.382+0100 [conn1421158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:36.438+0100 [conn1420755] end connection 172.28.0.164:59727 (399 connections now open) 2015-10-05T04:05:36.438+0100 [conn1420748] end connection 172.28.0.164:59683 (399 connections now open) 2015-10-05T04:05:36.439+0100 [mongosMain] connection accepted from 172.28.0.164:61789 #1421159 (399 connections now open) 2015-10-05T04:05:36.439+0100 [mongosMain] connection accepted from 172.28.0.164:61790 #1421160 (400 connections now open) 2015-10-05T04:05:36.441+0100 [conn1421160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:36.441+0100 [conn1421159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:37.703+0100 [conn1420757] end connection 172.28.0.163:50347 (399 connections now open) 2015-10-05T04:05:37.703+0100 [conn1420734] end connection 172.28.0.163:50199 (399 connections now open) 2015-10-05T04:05:37.704+0100 [mongosMain] connection accepted from 172.28.0.163:52342 #1421161 (399 connections now open) 2015-10-05T04:05:37.705+0100 [mongosMain] connection accepted from 172.28.0.163:52343 #1421162 (400 connections now open) 2015-10-05T04:05:37.705+0100 [conn1421161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:37.706+0100 [conn1421162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:39.579+0100 [mongosMain] connection accepted from 127.0.0.1:52346 #1421163 (401 connections now open) 2015-10-05T04:05:39.581+0100 [conn1421163] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:39.586+0100 [conn1421163] end connection 127.0.0.1:52346 (400 connections now open) 2015-10-05T04:05:42.615+0100 [conn1420736] end connection 172.28.0.164:59647 (399 connections now open) 2015-10-05T04:05:42.616+0100 [mongosMain] connection accepted from 172.28.0.164:61800 #1421164 (400 connections now open) 2015-10-05T04:05:42.618+0100 [conn1421164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:43.084+0100 [conn1420769] end connection 172.28.0.164:59853 (399 connections now open) 2015-10-05T04:05:43.085+0100 [mongosMain] connection accepted from 172.28.0.164:61803 #1421165 (400 connections now open) 2015-10-05T04:05:43.087+0100 [conn1421165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:43.740+0100 [conn1420761] end connection 172.28.0.163:50381 (399 connections now open) 2015-10-05T04:05:43.741+0100 [mongosMain] connection accepted from 172.28.0.163:52353 #1421166 (400 connections now open) 2015-10-05T04:05:43.743+0100 [conn1421166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:44.395+0100 [conn1420771] end connection 172.28.0.163:50453 (399 connections now open) 2015-10-05T04:05:44.396+0100 [mongosMain] connection accepted from 172.28.0.163:52355 #1421167 (400 connections now open) 2015-10-05T04:05:44.398+0100 [conn1421167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:45.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9095703b51053eafad9 2015-10-05T04:05:46.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:05:46.438+0100 [conn1420723] end connection 172.28.0.164:59602 (399 connections now open) 2015-10-05T04:05:46.438+0100 [conn1420733] end connection 172.28.0.164:59637 (398 connections now open) 2015-10-05T04:05:46.439+0100 [mongosMain] connection accepted from 172.28.0.164:61809 #1421168 (399 connections now open) 2015-10-05T04:05:46.439+0100 [mongosMain] connection accepted from 172.28.0.164:61810 #1421169 (400 connections now open) 2015-10-05T04:05:46.440+0100 [conn1421168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:46.441+0100 [conn1421169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:47.717+0100 [conn1420725] end connection 172.28.0.163:50183 (399 connections now open) 2015-10-05T04:05:47.717+0100 [conn1420766] end connection 172.28.0.163:50403 (398 connections now open) 2015-10-05T04:05:47.718+0100 [mongosMain] connection accepted from 172.28.0.163:52361 #1421170 (399 connections now open) 2015-10-05T04:05:47.719+0100 [mongosMain] connection accepted from 172.28.0.163:52362 #1421171 (400 connections now open) 2015-10-05T04:05:47.720+0100 [conn1421170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:47.720+0100 [conn1421171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:52.630+0100 [conn1420751] end connection 172.28.0.164:59718 (399 connections now open) 2015-10-05T04:05:52.633+0100 [mongosMain] connection accepted from 172.28.0.164:61830 #1421172 (400 connections now open) 2015-10-05T04:05:52.635+0100 [conn1421172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:53.099+0100 [conn1420778] end connection 172.28.0.164:59885 (399 connections now open) 2015-10-05T04:05:53.100+0100 [mongosMain] connection accepted from 172.28.0.164:61833 #1421173 (400 connections now open) 2015-10-05T04:05:53.104+0100 [conn1421173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:53.742+0100 [conn1420753] end connection 172.28.0.163:50316 (399 connections now open) 2015-10-05T04:05:53.743+0100 [mongosMain] connection accepted from 172.28.0.163:52374 #1421174 (400 connections now open) 2015-10-05T04:05:53.744+0100 [conn1421174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:54.397+0100 [conn1420780] end connection 172.28.0.163:50470 (399 connections now open) 2015-10-05T04:05:54.398+0100 [mongosMain] connection accepted from 172.28.0.163:52376 #1421175 (400 connections now open) 2015-10-05T04:05:54.400+0100 [conn1421175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:56.453+0100 [conn1420740] end connection 172.28.0.164:59651 (399 connections now open) 2015-10-05T04:05:56.453+0100 [conn1420764] end connection 172.28.0.164:59792 (398 connections now open) 2015-10-05T04:05:56.454+0100 [mongosMain] connection accepted from 172.28.0.164:61838 #1421176 (399 connections now open) 2015-10-05T04:05:56.455+0100 [mongosMain] connection accepted from 172.28.0.164:61839 #1421177 (400 connections now open) 2015-10-05T04:05:56.457+0100 [conn1421177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:56.457+0100 [conn1421176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:57.722+0100 [conn1420750] end connection 172.28.0.163:50276 (399 connections now open) 2015-10-05T04:05:57.722+0100 [conn1420693] end connection 172.28.0.163:49947 (398 connections now open) 2015-10-05T04:05:57.723+0100 [mongosMain] connection accepted from 172.28.0.163:52382 #1421178 (399 connections now open) 2015-10-05T04:05:57.723+0100 [mongosMain] connection accepted from 172.28.0.163:52383 #1421179 (400 connections now open) 2015-10-05T04:05:57.724+0100 [conn1421178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:57.724+0100 [conn1421179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:05:58.137+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:05:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:06:02.646+0100 [conn1420759] end connection 172.28.0.164:59772 (399 connections now open) 2015-10-05T04:06:02.647+0100 [mongosMain] connection accepted from 172.28.0.164:61870 #1421180 (400 connections now open) 2015-10-05T04:06:02.648+0100 [conn1421180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:03.114+0100 [conn1420786] end connection 172.28.0.164:59902 (399 connections now open) 2015-10-05T04:06:03.115+0100 [mongosMain] connection accepted from 172.28.0.164:61875 #1421181 (400 connections now open) 2015-10-05T04:06:03.116+0100 [conn1421181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:03.755+0100 [conn1420779] end connection 172.28.0.163:50468 (399 connections now open) 2015-10-05T04:06:03.757+0100 [mongosMain] connection accepted from 172.28.0.163:52449 #1421182 (400 connections now open) 2015-10-05T04:06:03.758+0100 [conn1421182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:04.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e91c5703b51053eafb6d 2015-10-05T04:06:04.411+0100 [conn1420788] end connection 172.28.0.163:50489 (399 connections now open) 2015-10-05T04:06:04.413+0100 [mongosMain] connection accepted from 172.28.0.163:52454 #1421183 (400 connections now open) 2015-10-05T04:06:04.414+0100 [conn1421183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:04.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:06.469+0100 [conn1420773] end connection 172.28.0.164:59870 (399 connections now open) 2015-10-05T04:06:06.469+0100 [mongosMain] connection accepted from 172.28.0.164:61890 #1421184 (400 connections now open) 2015-10-05T04:06:06.471+0100 [conn1421184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:07.734+0100 [conn1420758] end connection 172.28.0.163:50348 (399 connections now open) 2015-10-05T04:06:07.734+0100 [conn1420749] end connection 172.28.0.163:50277 (399 connections now open) 2015-10-05T04:06:07.735+0100 [mongosMain] connection accepted from 172.28.0.163:52473 #1421185 (399 connections now open) 2015-10-05T04:06:07.735+0100 [mongosMain] connection accepted from 172.28.0.163:52474 #1421186 (400 connections now open) 2015-10-05T04:06:07.736+0100 [conn1421185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:07.736+0100 [conn1421186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:10.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9225703b51053eafb9d 2015-10-05T04:06:10.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:12.661+0100 [conn1420777] end connection 172.28.0.164:59883 (399 connections now open) 2015-10-05T04:06:12.663+0100 [mongosMain] connection accepted from 172.28.0.164:61915 #1421187 (400 connections now open) 2015-10-05T04:06:12.665+0100 [conn1421187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:13.130+0100 [conn1420794] end connection 172.28.0.164:59919 (399 connections now open) 2015-10-05T04:06:13.132+0100 [mongosMain] connection accepted from 172.28.0.164:61917 #1421188 (400 connections now open) 2015-10-05T04:06:13.133+0100 [conn1421188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:13.771+0100 [conn1420738] end connection 172.28.0.163:50210 (399 connections now open) 2015-10-05T04:06:13.772+0100 [mongosMain] connection accepted from 172.28.0.163:52506 #1421189 (400 connections now open) 2015-10-05T04:06:13.773+0100 [conn1421189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:14.411+0100 [conn1420796] end connection 172.28.0.163:50523 (399 connections now open) 2015-10-05T04:06:14.413+0100 [mongosMain] connection accepted from 172.28.0.163:52508 #1421190 (400 connections now open) 2015-10-05T04:06:14.416+0100 [conn1421190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:16.484+0100 [conn1420790] end connection 172.28.0.164:59908 (399 connections now open) 2015-10-05T04:06:16.485+0100 [mongosMain] connection accepted from 172.28.0.164:61922 #1421191 (400 connections now open) 2015-10-05T04:06:16.487+0100 [conn1421191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:17.749+0100 [conn1420775] end connection 172.28.0.163:50463 (399 connections now open) 2015-10-05T04:06:17.749+0100 [conn1420716] end connection 172.28.0.163:50122 (398 connections now open) 2015-10-05T04:06:17.750+0100 [mongosMain] connection accepted from 172.28.0.163:52513 #1421192 (399 connections now open) 2015-10-05T04:06:17.751+0100 [mongosMain] connection accepted from 172.28.0.163:52514 #1421193 (400 connections now open) 2015-10-05T04:06:17.751+0100 [conn1421192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:17.751+0100 [conn1421193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:22.662+0100 [conn1420702] end connection 172.28.0.164:59438 (399 connections now open) 2015-10-05T04:06:22.665+0100 [mongosMain] connection accepted from 172.28.0.164:61930 #1421194 (400 connections now open) 2015-10-05T04:06:22.667+0100 [conn1421194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:22.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e92e5703b51053eafbf1 2015-10-05T04:06:23.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:23.130+0100 [conn1420802] end connection 172.28.0.164:59978 (399 connections now open) 2015-10-05T04:06:23.131+0100 [mongosMain] connection accepted from 172.28.0.164:61933 #1421195 (400 connections now open) 2015-10-05T04:06:23.132+0100 [conn1421195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:23.772+0100 [conn1420770] end connection 172.28.0.163:50448 (399 connections now open) 2015-10-05T04:06:23.774+0100 [mongosMain] connection accepted from 172.28.0.163:52519 #1421196 (400 connections now open) 2015-10-05T04:06:23.775+0100 [conn1421196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:24.426+0100 [conn1420804] end connection 172.28.0.163:50576 (399 connections now open) 2015-10-05T04:06:24.428+0100 [mongosMain] connection accepted from 172.28.0.163:52521 #1421197 (400 connections now open) 2015-10-05T04:06:24.429+0100 [conn1421197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:26.500+0100 [conn1420782] end connection 172.28.0.164:59891 (399 connections now open) 2015-10-05T04:06:26.500+0100 [conn1420747] end connection 172.28.0.164:59678 (398 connections now open) 2015-10-05T04:06:26.503+0100 [mongosMain] connection accepted from 172.28.0.164:61941 #1421198 (399 connections now open) 2015-10-05T04:06:26.503+0100 [mongosMain] connection accepted from 172.28.0.164:61940 #1421199 (400 connections now open) 2015-10-05T04:06:26.505+0100 [conn1421198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:26.505+0100 [conn1421199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:27.752+0100 [conn1420792] end connection 172.28.0.163:50497 (399 connections now open) 2015-10-05T04:06:27.752+0100 [conn1420807] end connection 172.28.0.163:50598 (398 connections now open) 2015-10-05T04:06:27.753+0100 [mongosMain] connection accepted from 172.28.0.163:52523 #1421200 (399 connections now open) 2015-10-05T04:06:27.754+0100 [mongosMain] connection accepted from 172.28.0.163:52524 #1421201 (400 connections now open) 2015-10-05T04:06:27.754+0100 [conn1421200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:27.755+0100 [conn1421201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:28.440+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:06:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:06:28.530+0100 [mongosMain] connection accepted from 127.0.0.1:52527 #1421202 (401 connections now open) 2015-10-05T04:06:28.533+0100 [conn1421202] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:28.538+0100 [conn1421202] end connection 127.0.0.1:52527 (400 connections now open) 2015-10-05T04:06:32.678+0100 [conn1420768] end connection 172.28.0.164:59848 (399 connections now open) 2015-10-05T04:06:32.680+0100 [mongosMain] connection accepted from 172.28.0.164:61947 #1421203 (400 connections now open) 2015-10-05T04:06:32.682+0100 [conn1421203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:33.146+0100 [conn1420810] end connection 172.28.0.164:60034 (399 connections now open) 2015-10-05T04:06:33.147+0100 [mongosMain] connection accepted from 172.28.0.164:61950 #1421204 (400 connections now open) 2015-10-05T04:06:33.149+0100 [conn1421204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:33.787+0100 [conn1420795] end connection 172.28.0.163:50518 (399 connections now open) 2015-10-05T04:06:33.788+0100 [mongosMain] connection accepted from 172.28.0.163:52530 #1421205 (400 connections now open) 2015-10-05T04:06:33.789+0100 [conn1421205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:34.431+0100 [conn1420812] end connection 172.28.0.163:50638 (399 connections now open) 2015-10-05T04:06:34.431+0100 [mongosMain] connection accepted from 172.28.0.163:52532 #1421206 (400 connections now open) 2015-10-05T04:06:34.432+0100 [conn1421206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:35.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e93b5703b51053eafc43 2015-10-05T04:06:35.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:36.515+0100 [conn1420798] end connection 172.28.0.164:59932 (399 connections now open) 2015-10-05T04:06:36.516+0100 [conn1420763] end connection 172.28.0.164:59784 (398 connections now open) 2015-10-05T04:06:36.517+0100 [mongosMain] connection accepted from 172.28.0.164:61956 #1421207 (399 connections now open) 2015-10-05T04:06:36.517+0100 [mongosMain] connection accepted from 172.28.0.164:61957 #1421208 (400 connections now open) 2015-10-05T04:06:36.518+0100 [conn1421207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:36.519+0100 [conn1421208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:37.765+0100 [conn1420808] end connection 172.28.0.163:50599 (399 connections now open) 2015-10-05T04:06:37.766+0100 [conn1420774] end connection 172.28.0.163:50461 (398 connections now open) 2015-10-05T04:06:37.766+0100 [mongosMain] connection accepted from 172.28.0.163:52534 #1421209 (399 connections now open) 2015-10-05T04:06:37.767+0100 [mongosMain] connection accepted from 172.28.0.163:52535 #1421210 (400 connections now open) 2015-10-05T04:06:37.768+0100 [conn1421209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:37.768+0100 [conn1421210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:39.696+0100 [mongosMain] connection accepted from 127.0.0.1:52538 #1421211 (401 connections now open) 2015-10-05T04:06:39.698+0100 [conn1421211] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:39.703+0100 [conn1421211] end connection 127.0.0.1:52538 (400 connections now open) 2015-10-05T04:06:42.677+0100 [conn1420801] end connection 172.28.0.164:59973 (399 connections now open) 2015-10-05T04:06:42.678+0100 [mongosMain] connection accepted from 172.28.0.164:61967 #1421212 (400 connections now open) 2015-10-05T04:06:42.680+0100 [conn1421212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:43.146+0100 [conn1420819] end connection 172.28.0.164:60107 (399 connections now open) 2015-10-05T04:06:43.147+0100 [mongosMain] connection accepted from 172.28.0.164:61969 #1421213 (400 connections now open) 2015-10-05T04:06:43.149+0100 [conn1421213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:43.787+0100 [conn1420787] end connection 172.28.0.163:50487 (399 connections now open) 2015-10-05T04:06:43.788+0100 [mongosMain] connection accepted from 172.28.0.163:52542 #1421214 (400 connections now open) 2015-10-05T04:06:43.790+0100 [conn1421214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:44.442+0100 [conn1420821] end connection 172.28.0.163:50708 (399 connections now open) 2015-10-05T04:06:44.443+0100 [mongosMain] connection accepted from 172.28.0.163:52546 #1421215 (400 connections now open) 2015-10-05T04:06:44.444+0100 [conn1421215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:46.531+0100 [conn1420806] end connection 172.28.0.164:59992 (399 connections now open) 2015-10-05T04:06:46.532+0100 [conn1420772] end connection 172.28.0.164:59866 (398 connections now open) 2015-10-05T04:06:46.533+0100 [mongosMain] connection accepted from 172.28.0.164:61976 #1421216 (399 connections now open) 2015-10-05T04:06:46.533+0100 [mongosMain] connection accepted from 172.28.0.164:61977 #1421217 (400 connections now open) 2015-10-05T04:06:46.535+0100 [conn1421216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:46.536+0100 [conn1421217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:47.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9475703b51053eafcb0 2015-10-05T04:06:47.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:47.766+0100 [conn1420816] end connection 172.28.0.163:50658 (399 connections now open) 2015-10-05T04:06:47.767+0100 [mongosMain] connection accepted from 172.28.0.163:52551 #1421218 (400 connections now open) 2015-10-05T04:06:47.768+0100 [conn1421218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:52.693+0100 [conn1420785] end connection 172.28.0.164:59900 (399 connections now open) 2015-10-05T04:06:52.694+0100 [mongosMain] connection accepted from 172.28.0.164:61984 #1421219 (400 connections now open) 2015-10-05T04:06:52.696+0100 [conn1421219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:53.161+0100 [conn1420828] end connection 172.28.0.164:60150 (399 connections now open) 2015-10-05T04:06:53.163+0100 [mongosMain] connection accepted from 172.28.0.164:61986 #1421220 (400 connections now open) 2015-10-05T04:06:53.164+0100 [conn1421220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:53.803+0100 [conn1420803] end connection 172.28.0.163:50573 (399 connections now open) 2015-10-05T04:06:53.804+0100 [mongosMain] connection accepted from 172.28.0.163:52561 #1421221 (400 connections now open) 2015-10-05T04:06:53.805+0100 [conn1421221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:54.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e94d5703b51053eafd07 2015-10-05T04:06:54.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:06:54.458+0100 [conn1420830] end connection 172.28.0.163:50741 (399 connections now open) 2015-10-05T04:06:54.459+0100 [mongosMain] connection accepted from 172.28.0.163:52564 #1421222 (400 connections now open) 2015-10-05T04:06:54.461+0100 [conn1421222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:56.547+0100 [conn1420732] end connection 172.28.0.164:59634 (399 connections now open) 2015-10-05T04:06:56.547+0100 [conn1420814] end connection 172.28.0.164:60053 (399 connections now open) 2015-10-05T04:06:56.549+0100 [mongosMain] connection accepted from 172.28.0.164:61991 #1421223 (399 connections now open) 2015-10-05T04:06:56.549+0100 [mongosMain] connection accepted from 172.28.0.164:61992 #1421224 (400 connections now open) 2015-10-05T04:06:56.551+0100 [conn1421223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:56.551+0100 [conn1421224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:57.823+0100 [conn1420799] end connection 172.28.0.163:50538 (399 connections now open) 2015-10-05T04:06:57.823+0100 [mongosMain] connection accepted from 172.28.0.163:52570 #1421225 (400 connections now open) 2015-10-05T04:06:57.823+0100 [conn1421225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:06:58.744+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:06:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:07:02.694+0100 [conn1420818] end connection 172.28.0.164:60101 (399 connections now open) 2015-10-05T04:07:02.695+0100 [mongosMain] connection accepted from 172.28.0.164:62002 #1421226 (400 connections now open) 2015-10-05T04:07:02.697+0100 [conn1421226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:03.162+0100 [conn1420836] end connection 172.28.0.164:60168 (399 connections now open) 2015-10-05T04:07:03.163+0100 [mongosMain] connection accepted from 172.28.0.164:62008 #1421227 (400 connections now open) 2015-10-05T04:07:03.165+0100 [conn1421227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:04.457+0100 [conn1420838] end connection 172.28.0.163:50759 (399 connections now open) 2015-10-05T04:07:04.458+0100 [mongosMain] connection accepted from 172.28.0.163:52597 #1421228 (400 connections now open) 2015-10-05T04:07:04.459+0100 [conn1421228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:06.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e95a5703b51053eafd89 2015-10-05T04:07:06.547+0100 [conn1420805] end connection 172.28.0.164:59987 (399 connections now open) 2015-10-05T04:07:06.547+0100 [conn1420832] end connection 172.28.0.164:60156 (398 connections now open) 2015-10-05T04:07:06.548+0100 [mongosMain] connection accepted from 172.28.0.164:62023 #1421229 (399 connections now open) 2015-10-05T04:07:06.549+0100 [mongosMain] connection accepted from 172.28.0.164:62024 #1421230 (400 connections now open) 2015-10-05T04:07:06.549+0100 [conn1421229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:06.550+0100 [conn1421230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:06.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:07:07.783+0100 [conn1420784] end connection 172.28.0.163:50478 (399 connections now open) 2015-10-05T04:07:07.785+0100 [mongosMain] connection accepted from 172.28.0.163:52618 #1421231 (400 connections now open) 2015-10-05T04:07:07.787+0100 [conn1421231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:12.693+0100 [conn1420793] end connection 172.28.0.164:59916 (399 connections now open) 2015-10-05T04:07:12.695+0100 [mongosMain] connection accepted from 172.28.0.164:62058 #1421232 (400 connections now open) 2015-10-05T04:07:12.697+0100 [conn1421232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:13.161+0100 [conn1420844] end connection 172.28.0.164:60191 (399 connections now open) 2015-10-05T04:07:13.163+0100 [mongosMain] connection accepted from 172.28.0.164:62063 #1421233 (400 connections now open) 2015-10-05T04:07:13.164+0100 [conn1421233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:13.819+0100 [conn1420811] end connection 172.28.0.163:50633 (399 connections now open) 2015-10-05T04:07:13.820+0100 [mongosMain] connection accepted from 172.28.0.163:52646 #1421234 (400 connections now open) 2015-10-05T04:07:13.821+0100 [conn1421234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:14.473+0100 [conn1420846] end connection 172.28.0.163:50792 (399 connections now open) 2015-10-05T04:07:14.474+0100 [mongosMain] connection accepted from 172.28.0.163:52652 #1421235 (400 connections now open) 2015-10-05T04:07:14.475+0100 [conn1421235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:16.564+0100 [conn1420823] end connection 172.28.0.164:60124 (399 connections now open) 2015-10-05T04:07:16.565+0100 [conn1420813] end connection 172.28.0.164:60047 (398 connections now open) 2015-10-05T04:07:16.565+0100 [mongosMain] connection accepted from 172.28.0.164:62069 #1421236 (399 connections now open) 2015-10-05T04:07:16.566+0100 [mongosMain] connection accepted from 172.28.0.164:62070 #1421237 (400 connections now open) 2015-10-05T04:07:16.567+0100 [conn1421236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:16.568+0100 [conn1421237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:17.797+0100 [conn1420842] end connection 172.28.0.163:50767 (399 connections now open) 2015-10-05T04:07:17.798+0100 [mongosMain] connection accepted from 172.28.0.163:52657 #1421238 (400 connections now open) 2015-10-05T04:07:17.799+0100 [conn1421238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:18.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9665703b51053eafde0 2015-10-05T04:07:19.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:07:22.709+0100 [conn1420809] end connection 172.28.0.164:60031 (399 connections now open) 2015-10-05T04:07:22.710+0100 [mongosMain] connection accepted from 172.28.0.164:62078 #1421239 (400 connections now open) 2015-10-05T04:07:22.712+0100 [conn1421239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:23.177+0100 [conn1420852] end connection 172.28.0.164:60248 (399 connections now open) 2015-10-05T04:07:23.179+0100 [mongosMain] connection accepted from 172.28.0.164:62080 #1421240 (400 connections now open) 2015-10-05T04:07:23.181+0100 [conn1421240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:23.833+0100 [conn1420820] end connection 172.28.0.163:50702 (399 connections now open) 2015-10-05T04:07:23.834+0100 [mongosMain] connection accepted from 172.28.0.163:52660 #1421241 (400 connections now open) 2015-10-05T04:07:23.835+0100 [conn1421241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:24.473+0100 [conn1420854] end connection 172.28.0.163:50853 (399 connections now open) 2015-10-05T04:07:24.474+0100 [mongosMain] connection accepted from 172.28.0.163:52662 #1421242 (400 connections now open) 2015-10-05T04:07:24.475+0100 [conn1421242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:26.563+0100 [conn1420840] end connection 172.28.0.164:60174 (399 connections now open) 2015-10-05T04:07:26.564+0100 [conn1420822] end connection 172.28.0.164:60118 (398 connections now open) 2015-10-05T04:07:26.564+0100 [mongosMain] connection accepted from 172.28.0.164:62086 #1421243 (399 connections now open) 2015-10-05T04:07:26.565+0100 [mongosMain] connection accepted from 172.28.0.164:62087 #1421244 (400 connections now open) 2015-10-05T04:07:26.567+0100 [conn1421243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:26.567+0100 [conn1421244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:27.799+0100 [conn1420849] end connection 172.28.0.163:50811 (399 connections now open) 2015-10-05T04:07:27.800+0100 [mongosMain] connection accepted from 172.28.0.163:52665 #1421245 (400 connections now open) 2015-10-05T04:07:27.802+0100 [conn1421245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:28.332+0100 [mongosMain] connection accepted from 127.0.0.1:52667 #1421246 (401 connections now open) 2015-10-05T04:07:28.335+0100 [conn1421246] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:28.340+0100 [conn1421246] end connection 127.0.0.1:52667 (400 connections now open) 2015-10-05T04:07:28.855+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:07:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:07:31.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9735703b51053eafe2d 2015-10-05T04:07:31.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:07:32.725+0100 [conn1420827] end connection 172.28.0.164:60147 (399 connections now open) 2015-10-05T04:07:32.726+0100 [mongosMain] connection accepted from 172.28.0.164:62094 #1421247 (400 connections now open) 2015-10-05T04:07:32.728+0100 [conn1421247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:33.193+0100 [conn1420858] end connection 172.28.0.164:60316 (399 connections now open) 2015-10-05T04:07:33.194+0100 [mongosMain] connection accepted from 172.28.0.164:62097 #1421248 (400 connections now open) 2015-10-05T04:07:33.196+0100 [conn1421248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:33.834+0100 [conn1420845] end connection 172.28.0.163:50786 (399 connections now open) 2015-10-05T04:07:33.835+0100 [mongosMain] connection accepted from 172.28.0.163:52668 #1421249 (400 connections now open) 2015-10-05T04:07:33.837+0100 [conn1421249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:34.489+0100 [conn1420860] end connection 172.28.0.163:50912 (399 connections now open) 2015-10-05T04:07:34.490+0100 [mongosMain] connection accepted from 172.28.0.163:52670 #1421250 (400 connections now open) 2015-10-05T04:07:34.491+0100 [conn1421250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:36.564+0100 [conn1420856] end connection 172.28.0.164:60259 (399 connections now open) 2015-10-05T04:07:36.564+0100 [conn1420781] end connection 172.28.0.164:59888 (398 connections now open) 2015-10-05T04:07:36.565+0100 [mongosMain] connection accepted from 172.28.0.164:62103 #1421251 (399 connections now open) 2015-10-05T04:07:36.565+0100 [mongosMain] connection accepted from 172.28.0.164:62104 #1421252 (400 connections now open) 2015-10-05T04:07:36.566+0100 [conn1421251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:36.567+0100 [conn1421252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:37.813+0100 [conn1420825] end connection 172.28.0.163:50729 (399 connections now open) 2015-10-05T04:07:37.814+0100 [mongosMain] connection accepted from 172.28.0.163:52673 #1421253 (400 connections now open) 2015-10-05T04:07:37.815+0100 [conn1421253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:39.190+0100 [mongosMain] connection accepted from 127.0.0.1:52675 #1421254 (401 connections now open) 2015-10-05T04:07:39.192+0100 [conn1421254] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:39.197+0100 [conn1421254] end connection 127.0.0.1:52675 (400 connections now open) 2015-10-05T04:07:42.725+0100 [conn1420835] end connection 172.28.0.164:60165 (399 connections now open) 2015-10-05T04:07:42.726+0100 [mongosMain] connection accepted from 172.28.0.164:62113 #1421255 (400 connections now open) 2015-10-05T04:07:42.727+0100 [conn1421255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:43.193+0100 [conn1420866] end connection 172.28.0.164:60395 (399 connections now open) 2015-10-05T04:07:43.195+0100 [mongosMain] connection accepted from 172.28.0.164:62115 #1421256 (400 connections now open) 2015-10-05T04:07:43.196+0100 [conn1421256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:43.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e97f5703b51053eafe7e 2015-10-05T04:07:43.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:07:43.849+0100 [conn1420837] end connection 172.28.0.163:50757 (399 connections now open) 2015-10-05T04:07:43.850+0100 [mongosMain] connection accepted from 172.28.0.163:52681 #1421257 (400 connections now open) 2015-10-05T04:07:43.851+0100 [conn1421257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:44.489+0100 [conn1420868] end connection 172.28.0.163:50969 (399 connections now open) 2015-10-05T04:07:44.490+0100 [mongosMain] connection accepted from 172.28.0.163:52683 #1421258 (400 connections now open) 2015-10-05T04:07:44.491+0100 [conn1421258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:46.584+0100 [conn1420848] end connection 172.28.0.164:60203 (399 connections now open) 2015-10-05T04:07:46.585+0100 [mongosMain] connection accepted from 172.28.0.164:62121 #1421259 (400 connections now open) 2015-10-05T04:07:46.586+0100 [conn1421259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:47.829+0100 [conn1420833] end connection 172.28.0.163:50747 (399 connections now open) 2015-10-05T04:07:47.830+0100 [mongosMain] connection accepted from 172.28.0.163:52689 #1421260 (400 connections now open) 2015-10-05T04:07:47.831+0100 [conn1421260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:52.741+0100 [conn1420843] end connection 172.28.0.164:60184 (399 connections now open) 2015-10-05T04:07:52.743+0100 [mongosMain] connection accepted from 172.28.0.164:62129 #1421261 (400 connections now open) 2015-10-05T04:07:52.745+0100 [conn1421261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:53.211+0100 [conn1420874] end connection 172.28.0.164:60431 (399 connections now open) 2015-10-05T04:07:53.212+0100 [mongosMain] connection accepted from 172.28.0.164:62131 #1421262 (400 connections now open) 2015-10-05T04:07:53.215+0100 [conn1421262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:53.850+0100 [conn1420853] end connection 172.28.0.163:50848 (399 connections now open) 2015-10-05T04:07:53.851+0100 [mongosMain] connection accepted from 172.28.0.163:52697 #1421263 (400 connections now open) 2015-10-05T04:07:53.852+0100 [conn1421263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:54.504+0100 [conn1420876] end connection 172.28.0.163:50989 (399 connections now open) 2015-10-05T04:07:54.505+0100 [mongosMain] connection accepted from 172.28.0.163:52699 #1421264 (400 connections now open) 2015-10-05T04:07:54.506+0100 [conn1421264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:55.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e98b5703b51053eafefc 2015-10-05T04:07:56.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:07:56.594+0100 [conn1420869] end connection 172.28.0.164:60414 (399 connections now open) 2015-10-05T04:07:56.596+0100 [mongosMain] connection accepted from 172.28.0.164:62134 #1421265 (400 connections now open) 2015-10-05T04:07:56.597+0100 [conn1421265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:57.831+0100 [conn1420863] end connection 172.28.0.163:50927 (399 connections now open) 2015-10-05T04:07:57.832+0100 [mongosMain] connection accepted from 172.28.0.163:52706 #1421266 (400 connections now open) 2015-10-05T04:07:57.833+0100 [conn1421266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:07:59.112+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:07:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:08:03.224+0100 [conn1420880] end connection 172.28.0.164:60445 (399 connections now open) 2015-10-05T04:08:03.226+0100 [mongosMain] connection accepted from 172.28.0.164:62154 #1421267 (400 connections now open) 2015-10-05T04:08:03.227+0100 [conn1421267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:04.505+0100 [conn1420881] end connection 172.28.0.163:51005 (399 connections now open) 2015-10-05T04:08:04.506+0100 [mongosMain] connection accepted from 172.28.0.163:52739 #1421268 (400 connections now open) 2015-10-05T04:08:04.508+0100 [conn1421268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:07.845+0100 [conn1420878] end connection 172.28.0.163:50994 (399 connections now open) 2015-10-05T04:08:07.846+0100 [mongosMain] connection accepted from 172.28.0.163:52770 #1421269 (400 connections now open) 2015-10-05T04:08:07.847+0100 [conn1421269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:08.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9985703b51053eaff99 2015-10-05T04:08:08.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:13.224+0100 [conn1420884] end connection 172.28.0.164:60463 (399 connections now open) 2015-10-05T04:08:13.226+0100 [mongosMain] connection accepted from 172.28.0.164:62189 #1421270 (400 connections now open) 2015-10-05T04:08:13.227+0100 [conn1421270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:14.467+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:08:14.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:08:14.520+0100 [conn1420885] end connection 172.28.0.163:51034 (399 connections now open) 2015-10-05T04:08:14.522+0100 [mongosMain] connection accepted from 172.28.0.163:52795 #1421271 (400 connections now open) 2015-10-05T04:08:14.522+0100 [conn1421271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:16.596+0100 [conn1420877] end connection 172.28.0.164:60434 (399 connections now open) 2015-10-05T04:08:16.597+0100 [mongosMain] connection accepted from 172.28.0.164:62192 #1421272 (400 connections now open) 2015-10-05T04:08:16.599+0100 [conn1421272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:17.847+0100 [conn1420887] end connection 172.28.0.163:51049 (399 connections now open) 2015-10-05T04:08:17.849+0100 [mongosMain] connection accepted from 172.28.0.163:52799 #1421273 (400 connections now open) 2015-10-05T04:08:17.850+0100 [conn1421273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:20.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9a45703b51053eb0033 2015-10-05T04:08:20.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:23.245+0100 [conn1420889] end connection 172.28.0.164:60521 (399 connections now open) 2015-10-05T04:08:23.246+0100 [mongosMain] connection accepted from 172.28.0.164:62202 #1421274 (400 connections now open) 2015-10-05T04:08:23.248+0100 [conn1421274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:26.611+0100 [conn1420882] end connection 172.28.0.164:60448 (399 connections now open) 2015-10-05T04:08:26.612+0100 [mongosMain] connection accepted from 172.28.0.164:62207 #1421275 (400 connections now open) 2015-10-05T04:08:26.614+0100 [conn1421275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:27.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9aa5703b51053eb0080 2015-10-05T04:08:27.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:27.860+0100 [conn1420871] end connection 172.28.0.163:50979 (399 connections now open) 2015-10-05T04:08:27.861+0100 [mongosMain] connection accepted from 172.28.0.163:52803 #1421276 (400 connections now open) 2015-10-05T04:08:27.862+0100 [conn1421276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:29.149+0100 [mongosMain] connection accepted from 127.0.0.1:52805 #1421277 (401 connections now open) 2015-10-05T04:08:29.151+0100 [conn1421277] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:29.156+0100 [conn1421277] end connection 127.0.0.1:52805 (400 connections now open) 2015-10-05T04:08:29.261+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:08:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:08:33.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9b15703b51053eb00d9 2015-10-05T04:08:33.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:37.860+0100 [conn1420900] end connection 172.28.0.163:51149 (399 connections now open) 2015-10-05T04:08:37.861+0100 [mongosMain] connection accepted from 172.28.0.163:52808 #1421278 (400 connections now open) 2015-10-05T04:08:37.863+0100 [conn1421278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:40.030+0100 [mongosMain] connection accepted from 127.0.0.1:52809 #1421279 (401 connections now open) 2015-10-05T04:08:40.033+0100 [conn1421279] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:40.037+0100 [conn1421279] end connection 127.0.0.1:52809 (400 connections now open) 2015-10-05T04:08:45.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9bd5703b51053eb018a 2015-10-05T04:08:45.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:47.875+0100 [conn1420883] end connection 172.28.0.163:51010 (399 connections now open) 2015-10-05T04:08:47.876+0100 [mongosMain] connection accepted from 172.28.0.163:52818 #1421280 (400 connections now open) 2015-10-05T04:08:47.877+0100 [conn1421280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:08:57.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9c95703b51053eb0234 2015-10-05T04:08:57.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:08:59.557+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:08:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:09:02.804+0100 [conn1420851] end connection 172.28.0.164:60244 (399 connections now open) 2015-10-05T04:09:02.805+0100 [mongosMain] connection accepted from 172.28.0.164:62247 #1421281 (400 connections now open) 2015-10-05T04:09:02.807+0100 [conn1421281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:04.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9cf5703b51053eb028b 2015-10-05T04:09:04.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:10.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9d65703b51053eb02dc 2015-10-05T04:09:10.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:12.819+0100 [conn1420873] end connection 172.28.0.164:60428 (399 connections now open) 2015-10-05T04:09:12.820+0100 [mongosMain] connection accepted from 172.28.0.164:62312 #1421282 (400 connections now open) 2015-10-05T04:09:12.822+0100 [conn1421282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:16.689+0100 [conn1420902] end connection 172.28.0.164:60637 (399 connections now open) 2015-10-05T04:09:16.691+0100 [mongosMain] connection accepted from 172.28.0.164:62316 #1421283 (400 connections now open) 2015-10-05T04:09:16.693+0100 [conn1421283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:16.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9dc5703b51053eb0325 2015-10-05T04:09:16.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:23.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9e25703b51053eb036e 2015-10-05T04:09:23.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:28.928+0100 [mongosMain] connection accepted from 127.0.0.1:52916 #1421284 (401 connections now open) 2015-10-05T04:09:28.931+0100 [conn1421284] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:28.936+0100 [conn1421284] end connection 127.0.0.1:52916 (400 connections now open) 2015-10-05T04:09:29.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9e95703b51053eb03c3 2015-10-05T04:09:29.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:29.836+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:09:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:09:36.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9ef5703b51053eb0412 2015-10-05T04:09:36.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:36.705+0100 [conn1420892] end connection 172.28.0.164:60529 (399 connections now open) 2015-10-05T04:09:36.706+0100 [mongosMain] connection accepted from 172.28.0.164:62338 #1421285 (400 connections now open) 2015-10-05T04:09:36.708+0100 [conn1421285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:39.479+0100 [mongosMain] connection accepted from 127.0.0.1:52919 #1421286 (401 connections now open) 2015-10-05T04:09:39.482+0100 [conn1421286] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:39.487+0100 [conn1421286] end connection 127.0.0.1:52919 (400 connections now open) 2015-10-05T04:09:42.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9f65703b51053eb0458 2015-10-05T04:09:42.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:46.720+0100 [conn1420898] end connection 172.28.0.164:60576 (399 connections now open) 2015-10-05T04:09:46.722+0100 [mongosMain] connection accepted from 172.28.0.164:62351 #1421287 (400 connections now open) 2015-10-05T04:09:46.723+0100 [conn1421287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:48.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611e9fc5703b51053eb0497 2015-10-05T04:09:48.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:09:53.960+0100 [conn1420875] end connection 172.28.0.163:50986 (399 connections now open) 2015-10-05T04:09:53.961+0100 [mongosMain] connection accepted from 172.28.0.163:52936 #1421288 (400 connections now open) 2015-10-05T04:09:53.962+0100 [conn1421288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:09:55.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea025703b51053eb04e7 2015-10-05T04:09:55.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:00.121+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:09:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:10:01.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea095703b51053eb053a 2015-10-05T04:10:01.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:02.882+0100 [conn1420865] end connection 172.28.0.164:60389 (399 connections now open) 2015-10-05T04:10:02.883+0100 [mongosMain] connection accepted from 172.28.0.164:62376 #1421289 (400 connections now open) 2015-10-05T04:10:02.885+0100 [conn1421289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:03.961+0100 [conn1420867] end connection 172.28.0.163:50963 (399 connections now open) 2015-10-05T04:10:03.962+0100 [mongosMain] connection accepted from 172.28.0.163:52965 #1421290 (400 connections now open) 2015-10-05T04:10:03.964+0100 [conn1421290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:07.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea0f5703b51053eb0595 2015-10-05T04:10:08.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:13.975+0100 [conn1420859] end connection 172.28.0.163:50909 (399 connections now open) 2015-10-05T04:10:13.976+0100 [mongosMain] connection accepted from 172.28.0.163:53013 #1421291 (400 connections now open) 2015-10-05T04:10:13.977+0100 [conn1421291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:14.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea165703b51053eb05e5 2015-10-05T04:10:14.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:14.631+0100 [conn1420890] end connection 172.28.0.163:51086 (399 connections now open) 2015-10-05T04:10:14.632+0100 [mongosMain] connection accepted from 172.28.0.163:53016 #1421292 (400 connections now open) 2015-10-05T04:10:14.633+0100 [conn1421292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:17.955+0100 [conn1420893] end connection 172.28.0.163:51109 (399 connections now open) 2015-10-05T04:10:17.956+0100 [mongosMain] connection accepted from 172.28.0.163:53020 #1421293 (400 connections now open) 2015-10-05T04:10:17.957+0100 [conn1421293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:20.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea1c5703b51053eb0630 2015-10-05T04:10:20.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:22.898+0100 [conn1420857] end connection 172.28.0.164:60311 (399 connections now open) 2015-10-05T04:10:22.899+0100 [mongosMain] connection accepted from 172.28.0.164:62434 #1421294 (400 connections now open) 2015-10-05T04:10:22.901+0100 [conn1421294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:23.366+0100 [conn1420895] end connection 172.28.0.164:60558 (399 connections now open) 2015-10-05T04:10:23.367+0100 [mongosMain] connection accepted from 172.28.0.164:62436 #1421295 (400 connections now open) 2015-10-05T04:10:23.369+0100 [conn1421295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:24.631+0100 [conn1420896] end connection 172.28.0.163:51138 (399 connections now open) 2015-10-05T04:10:24.632+0100 [mongosMain] connection accepted from 172.28.0.163:53025 #1421296 (400 connections now open) 2015-10-05T04:10:24.634+0100 [conn1421296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:26.752+0100 [conn1420916] end connection 172.28.0.164:60878 (399 connections now open) 2015-10-05T04:10:26.753+0100 [conn1420855] end connection 172.28.0.164:60255 (398 connections now open) 2015-10-05T04:10:26.754+0100 [mongosMain] connection accepted from 172.28.0.164:62442 #1421297 (399 connections now open) 2015-10-05T04:10:26.754+0100 [mongosMain] connection accepted from 172.28.0.164:62443 #1421298 (400 connections now open) 2015-10-05T04:10:26.756+0100 [conn1421298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:26.756+0100 [conn1421297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:26.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea225703b51053eb067c 2015-10-05T04:10:27.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:28.922+0100 [mongosMain] connection accepted from 127.0.0.1:53028 #1421299 (401 connections now open) 2015-10-05T04:10:28.925+0100 [conn1421299] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:28.930+0100 [conn1421299] end connection 127.0.0.1:53028 (400 connections now open) 2015-10-05T04:10:30.395+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:10:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:10:32.914+0100 [conn1420907] end connection 172.28.0.164:60788 (399 connections now open) 2015-10-05T04:10:32.915+0100 [mongosMain] connection accepted from 172.28.0.164:62449 #1421300 (400 connections now open) 2015-10-05T04:10:32.916+0100 [conn1421300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:33.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea295703b51053eb06c7 2015-10-05T04:10:33.381+0100 [conn1420923] end connection 172.28.0.164:60991 (399 connections now open) 2015-10-05T04:10:33.383+0100 [mongosMain] connection accepted from 172.28.0.164:62451 #1421301 (400 connections now open) 2015-10-05T04:10:33.384+0100 [conn1421301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:33.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:34.646+0100 [conn1420925] end connection 172.28.0.163:51514 (399 connections now open) 2015-10-05T04:10:34.647+0100 [mongosMain] connection accepted from 172.28.0.163:53031 #1421302 (400 connections now open) 2015-10-05T04:10:34.648+0100 [conn1421302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:36.752+0100 [conn1420797] end connection 172.28.0.164:59928 (399 connections now open) 2015-10-05T04:10:36.752+0100 [conn1420886] end connection 172.28.0.164:60477 (398 connections now open) 2015-10-05T04:10:36.753+0100 [mongosMain] connection accepted from 172.28.0.164:62456 #1421303 (399 connections now open) 2015-10-05T04:10:36.754+0100 [mongosMain] connection accepted from 172.28.0.164:62457 #1421304 (400 connections now open) 2015-10-05T04:10:36.755+0100 [conn1421303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:36.755+0100 [conn1421304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:39.571+0100 [mongosMain] connection accepted from 127.0.0.1:53034 #1421305 (401 connections now open) 2015-10-05T04:10:39.574+0100 [conn1421305] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:39.579+0100 [conn1421305] end connection 127.0.0.1:53034 (400 connections now open) 2015-10-05T04:10:39.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea2f5703b51053eb0718 2015-10-05T04:10:39.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:42.929+0100 [conn1420919] end connection 172.28.0.164:60915 (399 connections now open) 2015-10-05T04:10:42.930+0100 [mongosMain] connection accepted from 172.28.0.164:62467 #1421306 (400 connections now open) 2015-10-05T04:10:42.932+0100 [conn1421306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:43.397+0100 [conn1420929] end connection 172.28.0.164:61008 (399 connections now open) 2015-10-05T04:10:43.398+0100 [mongosMain] connection accepted from 172.28.0.164:62470 #1421307 (400 connections now open) 2015-10-05T04:10:43.400+0100 [conn1421307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:44.647+0100 [conn1420931] end connection 172.28.0.163:51527 (399 connections now open) 2015-10-05T04:10:44.648+0100 [mongosMain] connection accepted from 172.28.0.163:53040 #1421308 (400 connections now open) 2015-10-05T04:10:44.649+0100 [conn1421308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:46.767+0100 [conn1420839] end connection 172.28.0.164:60171 (399 connections now open) 2015-10-05T04:10:46.768+0100 [mongosMain] connection accepted from 172.28.0.164:62474 #1421309 (400 connections now open) 2015-10-05T04:10:46.770+0100 [conn1421309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:47.986+0100 [conn1420888] end connection 172.28.0.163:51050 (399 connections now open) 2015-10-05T04:10:47.987+0100 [mongosMain] connection accepted from 172.28.0.163:53045 #1421310 (400 connections now open) 2015-10-05T04:10:47.989+0100 [conn1421310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:52.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea3c5703b51053eb07c4 2015-10-05T04:10:52.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:10:53.397+0100 [conn1420937] end connection 172.28.0.164:61028 (399 connections now open) 2015-10-05T04:10:53.398+0100 [mongosMain] connection accepted from 172.28.0.164:62482 #1421311 (400 connections now open) 2015-10-05T04:10:53.400+0100 [conn1421311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:54.007+0100 [conn1420918] end connection 172.28.0.163:51391 (399 connections now open) 2015-10-05T04:10:54.008+0100 [mongosMain] connection accepted from 172.28.0.163:53052 #1421312 (400 connections now open) 2015-10-05T04:10:54.009+0100 [conn1421312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:54.662+0100 [conn1420939] end connection 172.28.0.163:51538 (399 connections now open) 2015-10-05T04:10:54.664+0100 [mongosMain] connection accepted from 172.28.0.163:53055 #1421313 (400 connections now open) 2015-10-05T04:10:54.665+0100 [conn1421313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:56.769+0100 [conn1420861] end connection 172.28.0.164:60332 (399 connections now open) 2015-10-05T04:10:56.770+0100 [mongosMain] connection accepted from 172.28.0.164:62488 #1421314 (400 connections now open) 2015-10-05T04:10:56.772+0100 [conn1421314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:10:57.992+0100 [conn1420783] end connection 172.28.0.163:50477 (399 connections now open) 2015-10-05T04:10:57.993+0100 [mongosMain] connection accepted from 172.28.0.163:53062 #1421315 (400 connections now open) 2015-10-05T04:10:57.994+0100 [conn1421315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:00.677+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:11:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:11:03.413+0100 [conn1420943] end connection 172.28.0.164:61047 (399 connections now open) 2015-10-05T04:11:03.414+0100 [mongosMain] connection accepted from 172.28.0.164:62501 #1421316 (400 connections now open) 2015-10-05T04:11:03.417+0100 [conn1421316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:04.023+0100 [conn1420938] end connection 172.28.0.163:51536 (399 connections now open) 2015-10-05T04:11:04.024+0100 [mongosMain] connection accepted from 172.28.0.163:53086 #1421317 (400 connections now open) 2015-10-05T04:11:04.025+0100 [conn1421317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:04.678+0100 [conn1420945] end connection 172.28.0.163:51553 (399 connections now open) 2015-10-05T04:11:04.680+0100 [mongosMain] connection accepted from 172.28.0.163:53091 #1421318 (400 connections now open) 2015-10-05T04:11:04.681+0100 [conn1421318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:04.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea485703b51053eb0861 2015-10-05T04:11:04.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:06.785+0100 [conn1420847] end connection 172.28.0.164:60200 (399 connections now open) 2015-10-05T04:11:06.786+0100 [mongosMain] connection accepted from 172.28.0.164:62511 #1421319 (400 connections now open) 2015-10-05T04:11:06.789+0100 [conn1421319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:08.001+0100 [conn1420791] end connection 172.28.0.163:50495 (399 connections now open) 2015-10-05T04:11:08.001+0100 [conn1420906] end connection 172.28.0.163:51292 (399 connections now open) 2015-10-05T04:11:08.002+0100 [mongosMain] connection accepted from 172.28.0.163:53107 #1421320 (399 connections now open) 2015-10-05T04:11:08.002+0100 [mongosMain] connection accepted from 172.28.0.163:53108 #1421321 (400 connections now open) 2015-10-05T04:11:08.003+0100 [conn1421320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:08.003+0100 [conn1421321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:12.977+0100 [conn1420922] end connection 172.28.0.164:60987 (399 connections now open) 2015-10-05T04:11:12.978+0100 [mongosMain] connection accepted from 172.28.0.164:62541 #1421322 (400 connections now open) 2015-10-05T04:11:12.980+0100 [conn1421322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:13.429+0100 [conn1420949] end connection 172.28.0.164:61072 (399 connections now open) 2015-10-05T04:11:13.431+0100 [mongosMain] connection accepted from 172.28.0.164:62544 #1421323 (400 connections now open) 2015-10-05T04:11:13.432+0100 [conn1421323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:14.023+0100 [conn1420924] end connection 172.28.0.163:51512 (399 connections now open) 2015-10-05T04:11:14.024+0100 [mongosMain] connection accepted from 172.28.0.163:53146 #1421324 (400 connections now open) 2015-10-05T04:11:14.025+0100 [conn1421324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:14.678+0100 [conn1420951] end connection 172.28.0.163:51580 (399 connections now open) 2015-10-05T04:11:14.679+0100 [mongosMain] connection accepted from 172.28.0.163:53151 #1421325 (400 connections now open) 2015-10-05T04:11:14.680+0100 [conn1421325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:16.799+0100 [conn1420933] end connection 172.28.0.164:61015 (399 connections now open) 2015-10-05T04:11:16.799+0100 [conn1420911] end connection 172.28.0.164:60863 (399 connections now open) 2015-10-05T04:11:16.800+0100 [mongosMain] connection accepted from 172.28.0.164:62550 #1421326 (399 connections now open) 2015-10-05T04:11:16.801+0100 [mongosMain] connection accepted from 172.28.0.164:62551 #1421327 (400 connections now open) 2015-10-05T04:11:16.802+0100 [conn1421326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:16.802+0100 [conn1421327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:17.154+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea545703b51053eb08fb 2015-10-05T04:11:17.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:18.004+0100 [conn1420743] end connection 172.28.0.163:50219 (399 connections now open) 2015-10-05T04:11:18.004+0100 [conn1420912] end connection 172.28.0.163:51370 (398 connections now open) 2015-10-05T04:11:18.005+0100 [mongosMain] connection accepted from 172.28.0.163:53155 #1421328 (399 connections now open) 2015-10-05T04:11:18.006+0100 [mongosMain] connection accepted from 172.28.0.163:53156 #1421329 (400 connections now open) 2015-10-05T04:11:18.007+0100 [conn1421328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:18.008+0100 [conn1421329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:22.976+0100 [conn1420942] end connection 172.28.0.164:61042 (399 connections now open) 2015-10-05T04:11:22.977+0100 [mongosMain] connection accepted from 172.28.0.164:62560 #1421330 (400 connections now open) 2015-10-05T04:11:22.979+0100 [conn1421330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:23.444+0100 [conn1420953] end connection 172.28.0.164:61122 (399 connections now open) 2015-10-05T04:11:23.446+0100 [mongosMain] connection accepted from 172.28.0.164:62562 #1421331 (400 connections now open) 2015-10-05T04:11:23.447+0100 [conn1421331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:23.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea5b5703b51053eb093f 2015-10-05T04:11:23.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:24.038+0100 [conn1420920] end connection 172.28.0.163:51430 (399 connections now open) 2015-10-05T04:11:24.040+0100 [mongosMain] connection accepted from 172.28.0.163:53162 #1421332 (400 connections now open) 2015-10-05T04:11:24.041+0100 [conn1421332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:24.693+0100 [conn1420955] end connection 172.28.0.163:51665 (399 connections now open) 2015-10-05T04:11:24.695+0100 [mongosMain] connection accepted from 172.28.0.163:53163 #1421333 (400 connections now open) 2015-10-05T04:11:24.696+0100 [conn1421333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:26.815+0100 [conn1420831] end connection 172.28.0.164:60152 (399 connections now open) 2015-10-05T04:11:26.815+0100 [conn1420947] end connection 172.28.0.164:61053 (398 connections now open) 2015-10-05T04:11:26.816+0100 [mongosMain] connection accepted from 172.28.0.164:62568 #1421334 (399 connections now open) 2015-10-05T04:11:26.816+0100 [mongosMain] connection accepted from 172.28.0.164:62569 #1421335 (400 connections now open) 2015-10-05T04:11:26.818+0100 [conn1421334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:26.818+0100 [conn1421335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:28.029+0100 [conn1420934] end connection 172.28.0.163:51529 (399 connections now open) 2015-10-05T04:11:28.029+0100 [conn1420644] end connection 172.28.0.163:49696 (398 connections now open) 2015-10-05T04:11:28.030+0100 [mongosMain] connection accepted from 172.28.0.163:53165 #1421336 (399 connections now open) 2015-10-05T04:11:28.030+0100 [mongosMain] connection accepted from 172.28.0.163:53168 #1421337 (400 connections now open) 2015-10-05T04:11:28.031+0100 [conn1421336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:28.031+0100 [conn1421337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:28.523+0100 [mongosMain] connection accepted from 127.0.0.1:53169 #1421338 (401 connections now open) 2015-10-05T04:11:28.526+0100 [conn1421338] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:28.531+0100 [conn1421338] end connection 127.0.0.1:53169 (400 connections now open) 2015-10-05T04:11:29.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea615703b51053eb097a 2015-10-05T04:11:30.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:30.934+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:11:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:11:32.992+0100 [conn1420948] end connection 172.28.0.164:61068 (399 connections now open) 2015-10-05T04:11:32.993+0100 [mongosMain] connection accepted from 172.28.0.164:62576 #1421339 (400 connections now open) 2015-10-05T04:11:32.995+0100 [conn1421339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:33.460+0100 [conn1420958] end connection 172.28.0.164:61142 (399 connections now open) 2015-10-05T04:11:33.461+0100 [mongosMain] connection accepted from 172.28.0.164:62580 #1421340 (400 connections now open) 2015-10-05T04:11:33.463+0100 [conn1421340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:34.054+0100 [conn1420930] end connection 172.28.0.163:51526 (399 connections now open) 2015-10-05T04:11:34.055+0100 [mongosMain] connection accepted from 172.28.0.163:53172 #1421341 (400 connections now open) 2015-10-05T04:11:34.056+0100 [conn1421341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:34.694+0100 [conn1420960] end connection 172.28.0.163:51676 (399 connections now open) 2015-10-05T04:11:34.695+0100 [mongosMain] connection accepted from 172.28.0.163:53173 #1421342 (400 connections now open) 2015-10-05T04:11:34.697+0100 [conn1421342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:36.404+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea685703b51053eb09b3 2015-10-05T04:11:36.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:36.830+0100 [conn1420932] end connection 172.28.0.164:61014 (399 connections now open) 2015-10-05T04:11:36.831+0100 [conn1420910] end connection 172.28.0.164:60861 (398 connections now open) 2015-10-05T04:11:36.832+0100 [mongosMain] connection accepted from 172.28.0.164:62586 #1421343 (399 connections now open) 2015-10-05T04:11:36.832+0100 [mongosMain] connection accepted from 172.28.0.164:62585 #1421344 (400 connections now open) 2015-10-05T04:11:36.834+0100 [conn1421343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:36.834+0100 [conn1421344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:38.019+0100 [conn1420908] end connection 172.28.0.163:51340 (399 connections now open) 2015-10-05T04:11:38.019+0100 [conn1420905] end connection 172.28.0.163:51187 (399 connections now open) 2015-10-05T04:11:38.020+0100 [mongosMain] connection accepted from 172.28.0.163:53176 #1421345 (399 connections now open) 2015-10-05T04:11:38.020+0100 [mongosMain] connection accepted from 172.28.0.163:53177 #1421346 (400 connections now open) 2015-10-05T04:11:38.021+0100 [conn1421345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:38.021+0100 [conn1421346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:39.273+0100 [mongosMain] connection accepted from 127.0.0.1:53180 #1421347 (401 connections now open) 2015-10-05T04:11:39.275+0100 [conn1421347] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:39.279+0100 [conn1421347] end connection 127.0.0.1:53180 (400 connections now open) 2015-10-05T04:11:42.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea6e5703b51053eb09f3 2015-10-05T04:11:42.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:43.008+0100 [conn1420928] end connection 172.28.0.164:61005 (399 connections now open) 2015-10-05T04:11:43.009+0100 [mongosMain] connection accepted from 172.28.0.164:62598 #1421348 (400 connections now open) 2015-10-05T04:11:43.011+0100 [conn1421348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:43.476+0100 [conn1420966] end connection 172.28.0.164:61161 (399 connections now open) 2015-10-05T04:11:43.477+0100 [mongosMain] connection accepted from 172.28.0.164:62601 #1421349 (400 connections now open) 2015-10-05T04:11:43.478+0100 [conn1421349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:44.054+0100 [conn1420829] end connection 172.28.0.163:50739 (399 connections now open) 2015-10-05T04:11:44.055+0100 [mongosMain] connection accepted from 172.28.0.163:53185 #1421350 (400 connections now open) 2015-10-05T04:11:44.056+0100 [conn1421350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:44.709+0100 [conn1420968] end connection 172.28.0.163:51685 (399 connections now open) 2015-10-05T04:11:44.710+0100 [mongosMain] connection accepted from 172.28.0.163:53189 #1421351 (400 connections now open) 2015-10-05T04:11:44.711+0100 [conn1421351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:46.846+0100 [conn1420941] end connection 172.28.0.164:61033 (399 connections now open) 2015-10-05T04:11:46.847+0100 [conn1420690] end connection 172.28.0.164:59370 (398 connections now open) 2015-10-05T04:11:46.847+0100 [mongosMain] connection accepted from 172.28.0.164:62607 #1421352 (399 connections now open) 2015-10-05T04:11:46.848+0100 [mongosMain] connection accepted from 172.28.0.164:62606 #1421353 (400 connections now open) 2015-10-05T04:11:46.849+0100 [conn1421352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:46.849+0100 [conn1421353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:48.033+0100 [conn1420800] end connection 172.28.0.163:50539 (399 connections now open) 2015-10-05T04:11:48.034+0100 [mongosMain] connection accepted from 172.28.0.163:53194 #1421354 (400 connections now open) 2015-10-05T04:11:48.035+0100 [conn1421354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:49.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea745703b51053eb0a1f 2015-10-05T04:11:49.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:53.008+0100 [conn1420879] end connection 172.28.0.164:60443 (399 connections now open) 2015-10-05T04:11:53.009+0100 [mongosMain] connection accepted from 172.28.0.164:62615 #1421355 (400 connections now open) 2015-10-05T04:11:53.010+0100 [conn1421355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:53.476+0100 [conn1420975] end connection 172.28.0.164:61182 (399 connections now open) 2015-10-05T04:11:53.477+0100 [mongosMain] connection accepted from 172.28.0.164:62618 #1421356 (400 connections now open) 2015-10-05T04:11:53.479+0100 [conn1421356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:54.070+0100 [conn1420944] end connection 172.28.0.163:51551 (399 connections now open) 2015-10-05T04:11:54.072+0100 [mongosMain] connection accepted from 172.28.0.163:53201 #1421357 (400 connections now open) 2015-10-05T04:11:54.073+0100 [conn1421357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:54.710+0100 [conn1420977] end connection 172.28.0.163:51699 (399 connections now open) 2015-10-05T04:11:54.711+0100 [mongosMain] connection accepted from 172.28.0.163:53202 #1421358 (400 connections now open) 2015-10-05T04:11:54.712+0100 [conn1421358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:55.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea7b5703b51053eb0a5b 2015-10-05T04:11:55.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:11:56.862+0100 [conn1420956] end connection 172.28.0.164:61131 (399 connections now open) 2015-10-05T04:11:56.862+0100 [conn1420940] end connection 172.28.0.164:61034 (398 connections now open) 2015-10-05T04:11:56.864+0100 [mongosMain] connection accepted from 172.28.0.164:62624 #1421359 (399 connections now open) 2015-10-05T04:11:56.864+0100 [mongosMain] connection accepted from 172.28.0.164:62625 #1421360 (400 connections now open) 2015-10-05T04:11:56.866+0100 [conn1421359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:56.866+0100 [conn1421360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:11:58.064+0100 [conn1420894] end connection 172.28.0.163:51110 (399 connections now open) 2015-10-05T04:11:58.065+0100 [mongosMain] connection accepted from 172.28.0.163:53209 #1421361 (400 connections now open) 2015-10-05T04:11:58.066+0100 [conn1421361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:01.217+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:12:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:12:02.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea815703b51053eb0a9c 2015-10-05T04:12:02.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:03.008+0100 [conn1420936] end connection 172.28.0.164:61026 (399 connections now open) 2015-10-05T04:12:03.008+0100 [mongosMain] connection accepted from 172.28.0.164:62645 #1421362 (400 connections now open) 2015-10-05T04:12:03.010+0100 [conn1421362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:03.476+0100 [conn1420982] end connection 172.28.0.164:61198 (399 connections now open) 2015-10-05T04:12:03.477+0100 [mongosMain] connection accepted from 172.28.0.164:62650 #1421363 (400 connections now open) 2015-10-05T04:12:03.478+0100 [conn1421363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:04.070+0100 [conn1420950] end connection 172.28.0.163:51575 (399 connections now open) 2015-10-05T04:12:04.071+0100 [mongosMain] connection accepted from 172.28.0.163:53235 #1421364 (400 connections now open) 2015-10-05T04:12:04.072+0100 [conn1421364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:04.725+0100 [conn1420984] end connection 172.28.0.163:51719 (399 connections now open) 2015-10-05T04:12:04.727+0100 [mongosMain] connection accepted from 172.28.0.163:53244 #1421365 (400 connections now open) 2015-10-05T04:12:04.728+0100 [conn1421365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:06.861+0100 [conn1420978] end connection 172.28.0.164:61190 (399 connections now open) 2015-10-05T04:12:06.862+0100 [conn1420891] end connection 172.28.0.164:60525 (398 connections now open) 2015-10-05T04:12:06.863+0100 [mongosMain] connection accepted from 172.28.0.164:62680 #1421366 (399 connections now open) 2015-10-05T04:12:06.863+0100 [mongosMain] connection accepted from 172.28.0.164:62679 #1421367 (400 connections now open) 2015-10-05T04:12:06.864+0100 [conn1421366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:06.865+0100 [conn1421367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:08.080+0100 [conn1420850] end connection 172.28.0.163:50812 (399 connections now open) 2015-10-05T04:12:08.081+0100 [mongosMain] connection accepted from 172.28.0.163:53269 #1421368 (400 connections now open) 2015-10-05T04:12:08.083+0100 [conn1421368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:08.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea885703b51053eb0ae7 2015-10-05T04:12:08.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:13.491+0100 [conn1420989] end connection 172.28.0.164:61225 (399 connections now open) 2015-10-05T04:12:13.492+0100 [mongosMain] connection accepted from 172.28.0.164:62701 #1421369 (400 connections now open) 2015-10-05T04:12:13.494+0100 [conn1421369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:14.086+0100 [conn1420954] end connection 172.28.0.163:51663 (399 connections now open) 2015-10-05T04:12:14.087+0100 [mongosMain] connection accepted from 172.28.0.163:53288 #1421370 (400 connections now open) 2015-10-05T04:12:14.088+0100 [conn1421370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:14.726+0100 [conn1420991] end connection 172.28.0.163:51752 (399 connections now open) 2015-10-05T04:12:14.727+0100 [mongosMain] connection accepted from 172.28.0.163:53291 #1421371 (400 connections now open) 2015-10-05T04:12:14.728+0100 [conn1421371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:14.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea8e5703b51053eb0b27 2015-10-05T04:12:14.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:16.877+0100 [conn1420993] end connection 172.28.0.164:61244 (399 connections now open) 2015-10-05T04:12:16.878+0100 [conn1420926] end connection 172.28.0.164:60995 (398 connections now open) 2015-10-05T04:12:16.879+0100 [mongosMain] connection accepted from 172.28.0.164:62707 #1421372 (399 connections now open) 2015-10-05T04:12:16.880+0100 [mongosMain] connection accepted from 172.28.0.164:62708 #1421373 (400 connections now open) 2015-10-05T04:12:16.881+0100 [conn1421372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:16.882+0100 [conn1421373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:18.081+0100 [conn1420987] end connection 172.28.0.163:51724 (399 connections now open) 2015-10-05T04:12:18.081+0100 [conn1420815] end connection 172.28.0.163:50657 (399 connections now open) 2015-10-05T04:12:18.082+0100 [mongosMain] connection accepted from 172.28.0.163:53306 #1421374 (399 connections now open) 2015-10-05T04:12:18.083+0100 [mongosMain] connection accepted from 172.28.0.163:53307 #1421375 (400 connections now open) 2015-10-05T04:12:18.083+0100 [conn1421374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:18.083+0100 [conn1421375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:21.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea945703b51053eb0b5b 2015-10-05T04:12:21.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:23.492+0100 [conn1420996] end connection 172.28.0.164:61275 (399 connections now open) 2015-10-05T04:12:23.493+0100 [mongosMain] connection accepted from 172.28.0.164:62730 #1421376 (400 connections now open) 2015-10-05T04:12:23.495+0100 [conn1421376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:24.086+0100 [conn1420959] end connection 172.28.0.163:51675 (399 connections now open) 2015-10-05T04:12:24.088+0100 [mongosMain] connection accepted from 172.28.0.163:53311 #1421377 (400 connections now open) 2015-10-05T04:12:24.089+0100 [conn1421377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:24.741+0100 [conn1420998] end connection 172.28.0.163:51829 (399 connections now open) 2015-10-05T04:12:24.743+0100 [mongosMain] connection accepted from 172.28.0.163:53313 #1421378 (400 connections now open) 2015-10-05T04:12:24.744+0100 [conn1421378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:26.878+0100 [conn1420986] end connection 172.28.0.164:61206 (399 connections now open) 2015-10-05T04:12:26.878+0100 [conn1420789] end connection 172.28.0.164:59905 (398 connections now open) 2015-10-05T04:12:26.879+0100 [mongosMain] connection accepted from 172.28.0.164:62736 #1421379 (399 connections now open) 2015-10-05T04:12:26.880+0100 [mongosMain] connection accepted from 172.28.0.164:62737 #1421380 (400 connections now open) 2015-10-05T04:12:26.881+0100 [conn1421379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:26.882+0100 [conn1421380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:27.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ea9b5703b51053eb0b9d 2015-10-05T04:12:27.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:28.096+0100 [conn1420899] end connection 172.28.0.163:51148 (399 connections now open) 2015-10-05T04:12:28.096+0100 [conn1420994] end connection 172.28.0.163:51770 (399 connections now open) 2015-10-05T04:12:28.097+0100 [mongosMain] connection accepted from 172.28.0.163:53315 #1421381 (399 connections now open) 2015-10-05T04:12:28.097+0100 [mongosMain] connection accepted from 172.28.0.163:53316 #1421382 (400 connections now open) 2015-10-05T04:12:28.098+0100 [conn1421381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:28.098+0100 [conn1421382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:28.202+0100 [mongosMain] connection accepted from 127.0.0.1:53319 #1421383 (401 connections now open) 2015-10-05T04:12:28.204+0100 [conn1421383] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:28.209+0100 [conn1421383] end connection 127.0.0.1:53319 (400 connections now open) 2015-10-05T04:12:31.501+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:12:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:12:33.040+0100 [conn1420957] end connection 172.28.0.164:61140 (399 connections now open) 2015-10-05T04:12:33.041+0100 [mongosMain] connection accepted from 172.28.0.164:62746 #1421384 (400 connections now open) 2015-10-05T04:12:33.043+0100 [conn1421384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:33.507+0100 [conn1421004] end connection 172.28.0.164:61307 (399 connections now open) 2015-10-05T04:12:33.508+0100 [mongosMain] connection accepted from 172.28.0.164:62748 #1421385 (400 connections now open) 2015-10-05T04:12:33.510+0100 [conn1421385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:33.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eaa15703b51053eb0bd0 2015-10-05T04:12:34.101+0100 [conn1420967] end connection 172.28.0.163:51683 (399 connections now open) 2015-10-05T04:12:34.102+0100 [mongosMain] connection accepted from 172.28.0.163:53321 #1421386 (400 connections now open) 2015-10-05T04:12:34.103+0100 [conn1421386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:34.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:34.757+0100 [conn1421006] end connection 172.28.0.163:51850 (399 connections now open) 2015-10-05T04:12:34.758+0100 [mongosMain] connection accepted from 172.28.0.163:53323 #1421387 (400 connections now open) 2015-10-05T04:12:34.759+0100 [conn1421387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:36.893+0100 [conn1420961] end connection 172.28.0.164:61147 (399 connections now open) 2015-10-05T04:12:36.894+0100 [conn1420962] end connection 172.28.0.164:61149 (398 connections now open) 2015-10-05T04:12:36.894+0100 [mongosMain] connection accepted from 172.28.0.164:62757 #1421388 (399 connections now open) 2015-10-05T04:12:36.895+0100 [mongosMain] connection accepted from 172.28.0.164:62758 #1421389 (400 connections now open) 2015-10-05T04:12:36.896+0100 [conn1421388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:36.897+0100 [conn1421389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:38.111+0100 [conn1420963] end connection 172.28.0.163:51679 (399 connections now open) 2015-10-05T04:12:38.111+0100 [conn1420765] end connection 172.28.0.163:50402 (399 connections now open) 2015-10-05T04:12:38.112+0100 [mongosMain] connection accepted from 172.28.0.163:53325 #1421390 (399 connections now open) 2015-10-05T04:12:38.113+0100 [mongosMain] connection accepted from 172.28.0.163:53326 #1421391 (400 connections now open) 2015-10-05T04:12:38.113+0100 [conn1421390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:38.113+0100 [conn1421391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:40.190+0100 [mongosMain] connection accepted from 127.0.0.1:53329 #1421392 (401 connections now open) 2015-10-05T04:12:40.192+0100 [conn1421392] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:40.196+0100 [conn1421392] end connection 127.0.0.1:53329 (400 connections now open) 2015-10-05T04:12:40.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eaa85703b51053eb0bfa 2015-10-05T04:12:40.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:43.040+0100 [conn1421003] end connection 172.28.0.164:61304 (399 connections now open) 2015-10-05T04:12:43.041+0100 [mongosMain] connection accepted from 172.28.0.164:62766 #1421393 (400 connections now open) 2015-10-05T04:12:43.043+0100 [conn1421393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:43.508+0100 [conn1421012] end connection 172.28.0.164:61323 (399 connections now open) 2015-10-05T04:12:43.509+0100 [mongosMain] connection accepted from 172.28.0.164:62768 #1421394 (400 connections now open) 2015-10-05T04:12:43.510+0100 [conn1421394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:44.102+0100 [conn1420976] end connection 172.28.0.163:51697 (399 connections now open) 2015-10-05T04:12:44.103+0100 [mongosMain] connection accepted from 172.28.0.163:53335 #1421395 (400 connections now open) 2015-10-05T04:12:44.105+0100 [conn1421395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:44.757+0100 [conn1421014] end connection 172.28.0.163:51860 (399 connections now open) 2015-10-05T04:12:44.758+0100 [mongosMain] connection accepted from 172.28.0.163:53339 #1421396 (400 connections now open) 2015-10-05T04:12:44.759+0100 [conn1421396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:46.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eaae5703b51053eb0c30 2015-10-05T04:12:46.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:46.895+0100 [conn1420946] end connection 172.28.0.164:61051 (399 connections now open) 2015-10-05T04:12:46.895+0100 [conn1420999] end connection 172.28.0.164:61295 (398 connections now open) 2015-10-05T04:12:46.896+0100 [mongosMain] connection accepted from 172.28.0.164:62776 #1421397 (399 connections now open) 2015-10-05T04:12:46.897+0100 [mongosMain] connection accepted from 172.28.0.164:62777 #1421398 (400 connections now open) 2015-10-05T04:12:46.898+0100 [conn1421397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:46.899+0100 [conn1421398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:48.112+0100 [conn1420972] end connection 172.28.0.163:51689 (399 connections now open) 2015-10-05T04:12:48.112+0100 [conn1420824] end connection 172.28.0.163:50730 (398 connections now open) 2015-10-05T04:12:48.114+0100 [mongosMain] connection accepted from 172.28.0.163:53347 #1421399 (399 connections now open) 2015-10-05T04:12:48.114+0100 [mongosMain] connection accepted from 172.28.0.163:53346 #1421400 (400 connections now open) 2015-10-05T04:12:48.115+0100 [conn1421400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:48.115+0100 [conn1421399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:53.055+0100 [conn1420917] end connection 172.28.0.164:60884 (399 connections now open) 2015-10-05T04:12:53.056+0100 [mongosMain] connection accepted from 172.28.0.164:62784 #1421401 (400 connections now open) 2015-10-05T04:12:53.058+0100 [conn1421401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:53.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eab45703b51053eb0c5d 2015-10-05T04:12:53.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:12:53.523+0100 [conn1421021] end connection 172.28.0.164:61342 (399 connections now open) 2015-10-05T04:12:53.525+0100 [mongosMain] connection accepted from 172.28.0.164:62786 #1421402 (400 connections now open) 2015-10-05T04:12:53.527+0100 [conn1421402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:54.117+0100 [conn1420990] end connection 172.28.0.163:51744 (399 connections now open) 2015-10-05T04:12:54.119+0100 [mongosMain] connection accepted from 172.28.0.163:53354 #1421403 (400 connections now open) 2015-10-05T04:12:54.120+0100 [conn1421403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:54.772+0100 [conn1421023] end connection 172.28.0.163:51875 (399 connections now open) 2015-10-05T04:12:54.773+0100 [mongosMain] connection accepted from 172.28.0.163:53358 #1421404 (400 connections now open) 2015-10-05T04:12:54.774+0100 [conn1421404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:56.909+0100 [conn1420915] end connection 172.28.0.164:60876 (399 connections now open) 2015-10-05T04:12:56.910+0100 [mongosMain] connection accepted from 172.28.0.164:62790 #1421405 (400 connections now open) 2015-10-05T04:12:56.912+0100 [conn1421405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:58.127+0100 [conn1420980] end connection 172.28.0.163:51707 (399 connections now open) 2015-10-05T04:12:58.127+0100 [conn1420913] end connection 172.28.0.163:51371 (399 connections now open) 2015-10-05T04:12:58.128+0100 [mongosMain] connection accepted from 172.28.0.163:53363 #1421406 (399 connections now open) 2015-10-05T04:12:58.128+0100 [mongosMain] connection accepted from 172.28.0.163:53364 #1421407 (400 connections now open) 2015-10-05T04:12:58.129+0100 [conn1421406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:58.130+0100 [conn1421407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:12:59.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eabb5703b51053eb0c83 2015-10-05T04:12:59.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:01.788+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:13:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:13:03.083+0100 [conn1420974] end connection 172.28.0.164:61180 (399 connections now open) 2015-10-05T04:13:03.083+0100 [mongosMain] connection accepted from 172.28.0.164:62810 #1421408 (400 connections now open) 2015-10-05T04:13:03.083+0100 [conn1421408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:03.551+0100 [conn1421029] end connection 172.28.0.164:61360 (399 connections now open) 2015-10-05T04:13:03.551+0100 [mongosMain] connection accepted from 172.28.0.164:62815 #1421409 (400 connections now open) 2015-10-05T04:13:03.551+0100 [conn1421409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:04.175+0100 [conn1420983] end connection 172.28.0.163:51717 (399 connections now open) 2015-10-05T04:13:04.175+0100 [mongosMain] connection accepted from 172.28.0.163:53390 #1421410 (400 connections now open) 2015-10-05T04:13:04.175+0100 [conn1421410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:04.830+0100 [conn1421031] end connection 172.28.0.163:51894 (399 connections now open) 2015-10-05T04:13:04.830+0100 [mongosMain] connection accepted from 172.28.0.163:53397 #1421411 (400 connections now open) 2015-10-05T04:13:04.830+0100 [conn1421411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:05.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eac15703b51053eb0cc6 2015-10-05T04:13:06.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:06.909+0100 [conn1421024] end connection 172.28.0.164:61349 (399 connections now open) 2015-10-05T04:13:06.909+0100 [conn1420897] end connection 172.28.0.164:60571 (399 connections now open) 2015-10-05T04:13:06.910+0100 [mongosMain] connection accepted from 172.28.0.164:62834 #1421412 (399 connections now open) 2015-10-05T04:13:06.911+0100 [mongosMain] connection accepted from 172.28.0.164:62835 #1421413 (400 connections now open) 2015-10-05T04:13:06.912+0100 [conn1421412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:06.912+0100 [conn1421413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:08.128+0100 [conn1420834] end connection 172.28.0.163:50748 (399 connections now open) 2015-10-05T04:13:08.128+0100 [conn1420903] end connection 172.28.0.163:51178 (399 connections now open) 2015-10-05T04:13:08.129+0100 [mongosMain] connection accepted from 172.28.0.163:53415 #1421414 (399 connections now open) 2015-10-05T04:13:08.129+0100 [mongosMain] connection accepted from 172.28.0.163:53416 #1421415 (400 connections now open) 2015-10-05T04:13:08.130+0100 [conn1421414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:08.130+0100 [conn1421415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:12.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eac85703b51053eb0cf1 2015-10-05T04:13:12.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:13.071+0100 [conn1420952] end connection 172.28.0.164:61117 (399 connections now open) 2015-10-05T04:13:13.072+0100 [mongosMain] connection accepted from 172.28.0.164:62864 #1421416 (400 connections now open) 2015-10-05T04:13:13.074+0100 [conn1421416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:13.539+0100 [conn1421036] end connection 172.28.0.164:61385 (399 connections now open) 2015-10-05T04:13:13.540+0100 [mongosMain] connection accepted from 172.28.0.164:62866 #1421417 (400 connections now open) 2015-10-05T04:13:13.541+0100 [conn1421417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:14.133+0100 [conn1421013] end connection 172.28.0.163:51858 (399 connections now open) 2015-10-05T04:13:14.135+0100 [mongosMain] connection accepted from 172.28.0.163:53446 #1421418 (400 connections now open) 2015-10-05T04:13:14.136+0100 [conn1421418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:14.788+0100 [conn1421038] end connection 172.28.0.163:51936 (399 connections now open) 2015-10-05T04:13:14.789+0100 [mongosMain] connection accepted from 172.28.0.163:53449 #1421419 (400 connections now open) 2015-10-05T04:13:14.790+0100 [conn1421419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:16.925+0100 [conn1421007] end connection 172.28.0.164:61312 (399 connections now open) 2015-10-05T04:13:16.925+0100 [conn1420969] end connection 172.28.0.164:61168 (398 connections now open) 2015-10-05T04:13:16.927+0100 [mongosMain] connection accepted from 172.28.0.164:62872 #1421420 (399 connections now open) 2015-10-05T04:13:16.927+0100 [mongosMain] connection accepted from 172.28.0.164:62873 #1421421 (400 connections now open) 2015-10-05T04:13:16.929+0100 [conn1421420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:16.929+0100 [conn1421421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:18.143+0100 [conn1421009] end connection 172.28.0.163:51853 (399 connections now open) 2015-10-05T04:13:18.144+0100 [conn1420862] end connection 172.28.0.163:50926 (398 connections now open) 2015-10-05T04:13:18.145+0100 [mongosMain] connection accepted from 172.28.0.163:53453 #1421422 (399 connections now open) 2015-10-05T04:13:18.145+0100 [mongosMain] connection accepted from 172.28.0.163:53454 #1421423 (400 connections now open) 2015-10-05T04:13:18.146+0100 [conn1421422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:18.146+0100 [conn1421423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:18.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eace5703b51053eb0d1f 2015-10-05T04:13:18.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:23.071+0100 [conn1421020] end connection 172.28.0.164:61340 (399 connections now open) 2015-10-05T04:13:23.072+0100 [mongosMain] connection accepted from 172.28.0.164:62881 #1421424 (400 connections now open) 2015-10-05T04:13:23.074+0100 [conn1421424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:23.539+0100 [conn1421044] end connection 172.28.0.164:61441 (399 connections now open) 2015-10-05T04:13:23.540+0100 [mongosMain] connection accepted from 172.28.0.164:62884 #1421425 (400 connections now open) 2015-10-05T04:13:23.542+0100 [conn1421425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:24.149+0100 [conn1420997] end connection 172.28.0.163:51827 (399 connections now open) 2015-10-05T04:13:24.150+0100 [mongosMain] connection accepted from 172.28.0.163:53458 #1421426 (400 connections now open) 2015-10-05T04:13:24.152+0100 [conn1421426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:24.789+0100 [conn1421046] end connection 172.28.0.163:51989 (399 connections now open) 2015-10-05T04:13:24.790+0100 [mongosMain] connection accepted from 172.28.0.163:53460 #1421427 (400 connections now open) 2015-10-05T04:13:24.791+0100 [conn1421427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:25.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ead45703b51053eb0d41 2015-10-05T04:13:25.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:26.925+0100 [conn1421040] end connection 172.28.0.164:61407 (399 connections now open) 2015-10-05T04:13:26.925+0100 [conn1421025] end connection 172.28.0.164:61348 (398 connections now open) 2015-10-05T04:13:26.926+0100 [mongosMain] connection accepted from 172.28.0.164:62890 #1421428 (399 connections now open) 2015-10-05T04:13:26.927+0100 [mongosMain] connection accepted from 172.28.0.164:62891 #1421429 (400 connections now open) 2015-10-05T04:13:26.928+0100 [conn1421428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:26.928+0100 [conn1421429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:28.143+0100 [conn1420981] end connection 172.28.0.163:51708 (399 connections now open) 2015-10-05T04:13:28.143+0100 [conn1421017] end connection 172.28.0.163:51864 (399 connections now open) 2015-10-05T04:13:28.144+0100 [mongosMain] connection accepted from 172.28.0.163:53463 #1421430 (399 connections now open) 2015-10-05T04:13:28.144+0100 [mongosMain] connection accepted from 172.28.0.163:53464 #1421431 (400 connections now open) 2015-10-05T04:13:28.145+0100 [conn1421430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:28.146+0100 [conn1421431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:28.256+0100 [mongosMain] connection accepted from 127.0.0.1:53467 #1421432 (401 connections now open) 2015-10-05T04:13:28.259+0100 [conn1421432] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:28.263+0100 [conn1421432] end connection 127.0.0.1:53467 (400 connections now open) 2015-10-05T04:13:31.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eadb5703b51053eb0d5d 2015-10-05T04:13:31.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:32.018+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:13:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:13:33.087+0100 [conn1421011] end connection 172.28.0.164:61320 (399 connections now open) 2015-10-05T04:13:33.088+0100 [mongosMain] connection accepted from 172.28.0.164:62898 #1421433 (400 connections now open) 2015-10-05T04:13:33.089+0100 [conn1421433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:33.554+0100 [conn1421052] end connection 172.28.0.164:61456 (399 connections now open) 2015-10-05T04:13:33.555+0100 [mongosMain] connection accepted from 172.28.0.164:62900 #1421434 (400 connections now open) 2015-10-05T04:13:33.557+0100 [conn1421434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:34.149+0100 [conn1421030] end connection 172.28.0.163:51892 (399 connections now open) 2015-10-05T04:13:34.150+0100 [mongosMain] connection accepted from 172.28.0.163:53468 #1421435 (400 connections now open) 2015-10-05T04:13:34.151+0100 [conn1421435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:34.804+0100 [conn1421053] end connection 172.28.0.163:52001 (399 connections now open) 2015-10-05T04:13:34.805+0100 [mongosMain] connection accepted from 172.28.0.163:53470 #1421436 (400 connections now open) 2015-10-05T04:13:34.807+0100 [conn1421436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:36.940+0100 [conn1421015] end connection 172.28.0.164:61329 (399 connections now open) 2015-10-05T04:13:36.940+0100 [conn1420985] end connection 172.28.0.164:61205 (399 connections now open) 2015-10-05T04:13:36.942+0100 [mongosMain] connection accepted from 172.28.0.164:62908 #1421437 (399 connections now open) 2015-10-05T04:13:36.942+0100 [mongosMain] connection accepted from 172.28.0.164:62907 #1421438 (400 connections now open) 2015-10-05T04:13:36.943+0100 [conn1421437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:36.943+0100 [conn1421438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:37.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eae15703b51053eb0d73 2015-10-05T04:13:38.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:38.159+0100 [conn1421001] end connection 172.28.0.163:51842 (399 connections now open) 2015-10-05T04:13:38.159+0100 [conn1420841] end connection 172.28.0.163:50766 (399 connections now open) 2015-10-05T04:13:38.160+0100 [mongosMain] connection accepted from 172.28.0.163:53473 #1421439 (399 connections now open) 2015-10-05T04:13:38.161+0100 [mongosMain] connection accepted from 172.28.0.163:53474 #1421440 (400 connections now open) 2015-10-05T04:13:38.161+0100 [conn1421439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:38.161+0100 [conn1421440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:39.483+0100 [mongosMain] connection accepted from 127.0.0.1:53477 #1421441 (401 connections now open) 2015-10-05T04:13:39.486+0100 [conn1421441] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:39.490+0100 [conn1421441] end connection 127.0.0.1:53477 (400 connections now open) 2015-10-05T04:13:43.103+0100 [conn1421028] end connection 172.28.0.164:61358 (399 connections now open) 2015-10-05T04:13:43.104+0100 [mongosMain] connection accepted from 172.28.0.164:62919 #1421442 (400 connections now open) 2015-10-05T04:13:43.106+0100 [conn1421442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:43.570+0100 [conn1421060] end connection 172.28.0.164:61473 (399 connections now open) 2015-10-05T04:13:43.572+0100 [mongosMain] connection accepted from 172.28.0.164:62922 #1421443 (400 connections now open) 2015-10-05T04:13:43.574+0100 [conn1421443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:44.164+0100 [conn1421005] end connection 172.28.0.163:51848 (399 connections now open) 2015-10-05T04:13:44.165+0100 [mongosMain] connection accepted from 172.28.0.163:53482 #1421444 (400 connections now open) 2015-10-05T04:13:44.166+0100 [conn1421444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:44.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eae85703b51053eb0d8d 2015-10-05T04:13:44.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:44.804+0100 [conn1421062] end connection 172.28.0.163:52010 (399 connections now open) 2015-10-05T04:13:44.805+0100 [mongosMain] connection accepted from 172.28.0.163:53485 #1421445 (400 connections now open) 2015-10-05T04:13:44.806+0100 [conn1421445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:46.956+0100 [conn1421047] end connection 172.28.0.164:61445 (399 connections now open) 2015-10-05T04:13:46.956+0100 [conn1420979] end connection 172.28.0.164:61191 (398 connections now open) 2015-10-05T04:13:46.957+0100 [mongosMain] connection accepted from 172.28.0.164:62927 #1421446 (399 connections now open) 2015-10-05T04:13:46.957+0100 [mongosMain] connection accepted from 172.28.0.164:62928 #1421447 (400 connections now open) 2015-10-05T04:13:46.958+0100 [conn1421446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:46.959+0100 [conn1421447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:48.159+0100 [conn1421026] end connection 172.28.0.163:51882 (399 connections now open) 2015-10-05T04:13:48.159+0100 [conn1420971] end connection 172.28.0.163:51688 (398 connections now open) 2015-10-05T04:13:48.161+0100 [mongosMain] connection accepted from 172.28.0.163:53491 #1421448 (399 connections now open) 2015-10-05T04:13:48.161+0100 [mongosMain] connection accepted from 172.28.0.163:53492 #1421449 (400 connections now open) 2015-10-05T04:13:48.162+0100 [conn1421448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:48.162+0100 [conn1421449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:50.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eaee5703b51053eb0da1 2015-10-05T04:13:50.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:53.118+0100 [conn1421059] end connection 172.28.0.164:61470 (399 connections now open) 2015-10-05T04:13:53.119+0100 [mongosMain] connection accepted from 172.28.0.164:62935 #1421450 (400 connections now open) 2015-10-05T04:13:53.121+0100 [conn1421450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:53.586+0100 [conn1421069] end connection 172.28.0.164:61493 (399 connections now open) 2015-10-05T04:13:53.587+0100 [mongosMain] connection accepted from 172.28.0.164:62937 #1421451 (400 connections now open) 2015-10-05T04:13:53.588+0100 [conn1421451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:54.165+0100 [conn1421022] end connection 172.28.0.163:51872 (399 connections now open) 2015-10-05T04:13:54.167+0100 [mongosMain] connection accepted from 172.28.0.163:53501 #1421452 (400 connections now open) 2015-10-05T04:13:54.168+0100 [conn1421452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:54.820+0100 [conn1421071] end connection 172.28.0.163:52025 (399 connections now open) 2015-10-05T04:13:54.821+0100 [mongosMain] connection accepted from 172.28.0.163:53503 #1421453 (400 connections now open) 2015-10-05T04:13:54.822+0100 [conn1421453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:56.972+0100 [conn1420970] end connection 172.28.0.164:61169 (399 connections now open) 2015-10-05T04:13:56.972+0100 [conn1421000] end connection 172.28.0.164:61296 (398 connections now open) 2015-10-05T04:13:56.973+0100 [mongosMain] connection accepted from 172.28.0.164:62943 #1421454 (399 connections now open) 2015-10-05T04:13:56.974+0100 [mongosMain] connection accepted from 172.28.0.164:62944 #1421455 (400 connections now open) 2015-10-05T04:13:56.975+0100 [conn1421454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:56.975+0100 [conn1421455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:56.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eaf45703b51053eb0db8 2015-10-05T04:13:57.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:13:58.174+0100 [conn1421041] end connection 172.28.0.163:51955 (399 connections now open) 2015-10-05T04:13:58.174+0100 [conn1420921] end connection 172.28.0.163:51486 (398 connections now open) 2015-10-05T04:13:58.175+0100 [mongosMain] connection accepted from 172.28.0.163:53509 #1421456 (399 connections now open) 2015-10-05T04:13:58.176+0100 [mongosMain] connection accepted from 172.28.0.163:53510 #1421457 (400 connections now open) 2015-10-05T04:13:58.177+0100 [conn1421456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:13:58.177+0100 [conn1421457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:02.288+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:14:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:14:03.119+0100 [conn1421035] end connection 172.28.0.164:61378 (399 connections now open) 2015-10-05T04:14:03.120+0100 [mongosMain] connection accepted from 172.28.0.164:62958 #1421458 (400 connections now open) 2015-10-05T04:14:03.122+0100 [conn1421458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:03.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eafb5703b51053eb0de0 2015-10-05T04:14:03.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:03.587+0100 [conn1421077] end connection 172.28.0.164:61509 (399 connections now open) 2015-10-05T04:14:03.588+0100 [mongosMain] connection accepted from 172.28.0.164:62962 #1421459 (400 connections now open) 2015-10-05T04:14:03.590+0100 [conn1421459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:04.180+0100 [conn1421037] end connection 172.28.0.163:51931 (399 connections now open) 2015-10-05T04:14:04.181+0100 [mongosMain] connection accepted from 172.28.0.163:53538 #1421460 (400 connections now open) 2015-10-05T04:14:04.182+0100 [conn1421460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:04.835+0100 [conn1421079] end connection 172.28.0.163:52045 (399 connections now open) 2015-10-05T04:14:04.836+0100 [mongosMain] connection accepted from 172.28.0.163:53542 #1421461 (400 connections now open) 2015-10-05T04:14:04.837+0100 [conn1421461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:06.987+0100 [conn1421016] end connection 172.28.0.164:61330 (399 connections now open) 2015-10-05T04:14:06.988+0100 [conn1421064] end connection 172.28.0.164:61480 (398 connections now open) 2015-10-05T04:14:06.989+0100 [mongosMain] connection accepted from 172.28.0.164:62982 #1421462 (399 connections now open) 2015-10-05T04:14:06.989+0100 [mongosMain] connection accepted from 172.28.0.164:62983 #1421463 (400 connections now open) 2015-10-05T04:14:06.991+0100 [conn1421462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:06.991+0100 [conn1421463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:08.190+0100 [conn1420988] end connection 172.28.0.163:51726 (399 connections now open) 2015-10-05T04:14:08.190+0100 [conn1421034] end connection 172.28.0.163:51902 (398 connections now open) 2015-10-05T04:14:08.191+0100 [mongosMain] connection accepted from 172.28.0.163:53568 #1421464 (399 connections now open) 2015-10-05T04:14:08.191+0100 [mongosMain] connection accepted from 172.28.0.163:53569 #1421465 (400 connections now open) 2015-10-05T04:14:08.192+0100 [conn1421464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:08.192+0100 [conn1421465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:09.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb015703b51053eb0e1a 2015-10-05T04:14:09.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:13.135+0100 [conn1421051] end connection 172.28.0.164:61453 (399 connections now open) 2015-10-05T04:14:13.136+0100 [mongosMain] connection accepted from 172.28.0.164:63009 #1421466 (400 connections now open) 2015-10-05T04:14:13.137+0100 [conn1421466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:13.602+0100 [conn1421084] end connection 172.28.0.164:61535 (399 connections now open) 2015-10-05T04:14:13.603+0100 [mongosMain] connection accepted from 172.28.0.164:63011 #1421467 (400 connections now open) 2015-10-05T04:14:13.605+0100 [conn1421467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:14.181+0100 [conn1421045] end connection 172.28.0.163:51986 (399 connections now open) 2015-10-05T04:14:14.182+0100 [mongosMain] connection accepted from 172.28.0.163:53607 #1421468 (400 connections now open) 2015-10-05T04:14:14.184+0100 [conn1421468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:14.837+0100 [conn1421086] end connection 172.28.0.163:52086 (399 connections now open) 2015-10-05T04:14:14.838+0100 [mongosMain] connection accepted from 172.28.0.163:53613 #1421469 (400 connections now open) 2015-10-05T04:14:14.839+0100 [conn1421469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:15.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb075703b51053eb0e3d 2015-10-05T04:14:16.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:17.004+0100 [conn1421032] end connection 172.28.0.164:61365 (399 connections now open) 2015-10-05T04:14:17.004+0100 [conn1421055] end connection 172.28.0.164:61463 (398 connections now open) 2015-10-05T04:14:17.005+0100 [mongosMain] connection accepted from 172.28.0.164:63017 #1421470 (399 connections now open) 2015-10-05T04:14:17.006+0100 [mongosMain] connection accepted from 172.28.0.164:63018 #1421471 (400 connections now open) 2015-10-05T04:14:17.007+0100 [conn1421470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:17.008+0100 [conn1421471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:18.194+0100 [conn1420870] end connection 172.28.0.163:50978 (399 connections now open) 2015-10-05T04:14:18.194+0100 [conn1421057] end connection 172.28.0.163:52004 (398 connections now open) 2015-10-05T04:14:18.195+0100 [mongosMain] connection accepted from 172.28.0.163:53617 #1421472 (399 connections now open) 2015-10-05T04:14:18.195+0100 [mongosMain] connection accepted from 172.28.0.163:53618 #1421473 (400 connections now open) 2015-10-05T04:14:18.196+0100 [conn1421472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:18.196+0100 [conn1421473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:22.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb0e5703b51053eb0e6b 2015-10-05T04:14:22.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:23.150+0100 [conn1421076] end connection 172.28.0.164:61507 (399 connections now open) 2015-10-05T04:14:23.151+0100 [mongosMain] connection accepted from 172.28.0.164:63034 #1421474 (400 connections now open) 2015-10-05T04:14:23.152+0100 [conn1421474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:23.617+0100 [conn1421092] end connection 172.28.0.164:61588 (399 connections now open) 2015-10-05T04:14:23.618+0100 [mongosMain] connection accepted from 172.28.0.164:63036 #1421475 (400 connections now open) 2015-10-05T04:14:23.620+0100 [conn1421475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:24.196+0100 [conn1421078] end connection 172.28.0.163:52043 (399 connections now open) 2015-10-05T04:14:24.197+0100 [mongosMain] connection accepted from 172.28.0.163:53624 #1421476 (400 connections now open) 2015-10-05T04:14:24.198+0100 [conn1421476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:24.851+0100 [conn1421094] end connection 172.28.0.163:52141 (399 connections now open) 2015-10-05T04:14:24.852+0100 [mongosMain] connection accepted from 172.28.0.163:53626 #1421477 (400 connections now open) 2015-10-05T04:14:24.853+0100 [conn1421477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:27.019+0100 [conn1421087] end connection 172.28.0.164:61552 (399 connections now open) 2015-10-05T04:14:27.020+0100 [mongosMain] connection accepted from 172.28.0.164:63042 #1421478 (400 connections now open) 2015-10-05T04:14:27.021+0100 [conn1421048] end connection 172.28.0.164:61446 (399 connections now open) 2015-10-05T04:14:27.022+0100 [mongosMain] connection accepted from 172.28.0.164:63044 #1421479 (400 connections now open) 2015-10-05T04:14:27.022+0100 [conn1421478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:27.024+0100 [conn1421479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:28.206+0100 [conn1421049] end connection 172.28.0.163:51994 (399 connections now open) 2015-10-05T04:14:28.207+0100 [conn1421027] end connection 172.28.0.163:51883 (398 connections now open) 2015-10-05T04:14:28.209+0100 [mongosMain] connection accepted from 172.28.0.163:53628 #1421480 (399 connections now open) 2015-10-05T04:14:28.209+0100 [mongosMain] connection accepted from 172.28.0.163:53629 #1421481 (400 connections now open) 2015-10-05T04:14:28.210+0100 [conn1421480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:28.210+0100 [conn1421481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:28.573+0100 [mongosMain] connection accepted from 127.0.0.1:53632 #1421482 (401 connections now open) 2015-10-05T04:14:28.576+0100 [conn1421482] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:28.581+0100 [conn1421482] end connection 127.0.0.1:53632 (400 connections now open) 2015-10-05T04:14:32.548+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:14:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:14:33.166+0100 [conn1421083] end connection 172.28.0.164:61529 (399 connections now open) 2015-10-05T04:14:33.167+0100 [mongosMain] connection accepted from 172.28.0.164:63052 #1421483 (400 connections now open) 2015-10-05T04:14:33.169+0100 [conn1421483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:33.633+0100 [conn1421100] end connection 172.28.0.164:61605 (399 connections now open) 2015-10-05T04:14:33.635+0100 [mongosMain] connection accepted from 172.28.0.164:63054 #1421484 (400 connections now open) 2015-10-05T04:14:33.637+0100 [conn1421484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:34.212+0100 [conn1421061] end connection 172.28.0.163:52008 (399 connections now open) 2015-10-05T04:14:34.213+0100 [mongosMain] connection accepted from 172.28.0.163:53636 #1421485 (400 connections now open) 2015-10-05T04:14:34.214+0100 [conn1421485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:34.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb1a5703b51053eb0ea2 2015-10-05T04:14:34.856+0100 [conn1421102] end connection 172.28.0.163:52154 (399 connections now open) 2015-10-05T04:14:34.857+0100 [mongosMain] connection accepted from 172.28.0.163:53638 #1421486 (400 connections now open) 2015-10-05T04:14:34.859+0100 [conn1421486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:34.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:37.020+0100 [conn1420992] end connection 172.28.0.164:61243 (399 connections now open) 2015-10-05T04:14:37.020+0100 [conn1421072] end connection 172.28.0.164:61500 (399 connections now open) 2015-10-05T04:14:37.021+0100 [mongosMain] connection accepted from 172.28.0.164:63062 #1421487 (399 connections now open) 2015-10-05T04:14:37.021+0100 [mongosMain] connection accepted from 172.28.0.164:63063 #1421488 (400 connections now open) 2015-10-05T04:14:37.022+0100 [conn1421487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:37.022+0100 [conn1421488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:38.206+0100 [conn1420995] end connection 172.28.0.163:51771 (399 connections now open) 2015-10-05T04:14:38.206+0100 [conn1421065] end connection 172.28.0.163:52014 (398 connections now open) 2015-10-05T04:14:38.207+0100 [mongosMain] connection accepted from 172.28.0.163:53640 #1421489 (399 connections now open) 2015-10-05T04:14:38.207+0100 [mongosMain] connection accepted from 172.28.0.163:53641 #1421490 (400 connections now open) 2015-10-05T04:14:38.208+0100 [conn1421489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:38.208+0100 [conn1421490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:40.034+0100 [mongosMain] connection accepted from 127.0.0.1:53644 #1421491 (401 connections now open) 2015-10-05T04:14:40.037+0100 [conn1421491] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:40.041+0100 [conn1421491] end connection 127.0.0.1:53644 (400 connections now open) 2015-10-05T04:14:43.181+0100 [conn1421068] end connection 172.28.0.164:61491 (399 connections now open) 2015-10-05T04:14:43.182+0100 [mongosMain] connection accepted from 172.28.0.164:63071 #1421492 (400 connections now open) 2015-10-05T04:14:43.184+0100 [conn1421492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:43.649+0100 [conn1421109] end connection 172.28.0.164:61622 (399 connections now open) 2015-10-05T04:14:43.650+0100 [mongosMain] connection accepted from 172.28.0.164:63073 #1421493 (400 connections now open) 2015-10-05T04:14:43.652+0100 [conn1421493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:44.212+0100 [conn1421101] end connection 172.28.0.163:52152 (399 connections now open) 2015-10-05T04:14:44.213+0100 [mongosMain] connection accepted from 172.28.0.163:53650 #1421494 (400 connections now open) 2015-10-05T04:14:44.214+0100 [conn1421494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:44.867+0100 [conn1421111] end connection 172.28.0.163:52164 (399 connections now open) 2015-10-05T04:14:44.869+0100 [mongosMain] connection accepted from 172.28.0.163:53652 #1421495 (400 connections now open) 2015-10-05T04:14:44.870+0100 [conn1421495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:47.035+0100 [conn1421039] end connection 172.28.0.164:61406 (399 connections now open) 2015-10-05T04:14:47.035+0100 [conn1421096] end connection 172.28.0.164:61592 (398 connections now open) 2015-10-05T04:14:47.035+0100 [mongosMain] connection accepted from 172.28.0.164:63080 #1421496 (399 connections now open) 2015-10-05T04:14:47.036+0100 [mongosMain] connection accepted from 172.28.0.164:63081 #1421497 (400 connections now open) 2015-10-05T04:14:47.038+0100 [conn1421496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:47.038+0100 [conn1421497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:47.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb265703b51053eb0eef 2015-10-05T04:14:47.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:14:48.222+0100 [conn1421018] end connection 172.28.0.163:51865 (399 connections now open) 2015-10-05T04:14:48.222+0100 [conn1421089] end connection 172.28.0.163:52109 (399 connections now open) 2015-10-05T04:14:48.223+0100 [mongosMain] connection accepted from 172.28.0.163:53658 #1421498 (399 connections now open) 2015-10-05T04:14:48.223+0100 [mongosMain] connection accepted from 172.28.0.163:53659 #1421499 (400 connections now open) 2015-10-05T04:14:48.224+0100 [conn1421498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:48.224+0100 [conn1421499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:53.197+0100 [conn1421043] end connection 172.28.0.164:61439 (399 connections now open) 2015-10-05T04:14:53.198+0100 [mongosMain] connection accepted from 172.28.0.164:63090 #1421500 (400 connections now open) 2015-10-05T04:14:53.200+0100 [conn1421500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:53.350+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:14:53.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:14:53.665+0100 [conn1421118] end connection 172.28.0.164:61644 (399 connections now open) 2015-10-05T04:14:53.666+0100 [mongosMain] connection accepted from 172.28.0.164:63093 #1421501 (400 connections now open) 2015-10-05T04:14:53.668+0100 [conn1421501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:54.228+0100 [conn1421085] end connection 172.28.0.163:52082 (399 connections now open) 2015-10-05T04:14:54.229+0100 [mongosMain] connection accepted from 172.28.0.163:53667 #1421502 (400 connections now open) 2015-10-05T04:14:54.230+0100 [conn1421502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:54.867+0100 [conn1421120] end connection 172.28.0.163:52180 (399 connections now open) 2015-10-05T04:14:54.868+0100 [mongosMain] connection accepted from 172.28.0.163:53669 #1421503 (400 connections now open) 2015-10-05T04:14:54.869+0100 [conn1421503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:57.035+0100 [conn1421113] end connection 172.28.0.164:61631 (399 connections now open) 2015-10-05T04:14:57.036+0100 [conn1421073] end connection 172.28.0.164:61501 (398 connections now open) 2015-10-05T04:14:57.037+0100 [mongosMain] connection accepted from 172.28.0.164:63097 #1421504 (399 connections now open) 2015-10-05T04:14:57.038+0100 [mongosMain] connection accepted from 172.28.0.164:63098 #1421505 (400 connections now open) 2015-10-05T04:14:57.039+0100 [conn1421504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:57.039+0100 [conn1421505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:58.222+0100 [conn1421081] end connection 172.28.0.163:52051 (399 connections now open) 2015-10-05T04:14:58.222+0100 [conn1421033] end connection 172.28.0.163:51901 (398 connections now open) 2015-10-05T04:14:58.223+0100 [mongosMain] connection accepted from 172.28.0.163:53675 #1421506 (399 connections now open) 2015-10-05T04:14:58.223+0100 [mongosMain] connection accepted from 172.28.0.163:53676 #1421507 (400 connections now open) 2015-10-05T04:14:58.224+0100 [conn1421507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:58.224+0100 [conn1421506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:14:59.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb335703b51053eb0f31 2015-10-05T04:14:59.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:15:02.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:15:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:15:03.212+0100 [conn1421091] end connection 172.28.0.164:61586 (399 connections now open) 2015-10-05T04:15:03.213+0100 [mongosMain] connection accepted from 172.28.0.164:63116 #1421508 (400 connections now open) 2015-10-05T04:15:03.214+0100 [conn1421508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:03.665+0100 [conn1421126] end connection 172.28.0.164:61663 (399 connections now open) 2015-10-05T04:15:03.666+0100 [mongosMain] connection accepted from 172.28.0.164:63121 #1421509 (400 connections now open) 2015-10-05T04:15:03.668+0100 [conn1421509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:04.228+0100 [conn1421093] end connection 172.28.0.163:52139 (399 connections now open) 2015-10-05T04:15:04.229+0100 [mongosMain] connection accepted from 172.28.0.163:53710 #1421510 (400 connections now open) 2015-10-05T04:15:04.230+0100 [conn1421510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:04.883+0100 [conn1421128] end connection 172.28.0.163:52199 (399 connections now open) 2015-10-05T04:15:04.884+0100 [mongosMain] connection accepted from 172.28.0.163:53717 #1421511 (400 connections now open) 2015-10-05T04:15:04.885+0100 [conn1421511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:05.883+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:15:05.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:15:07.052+0100 [conn1421129] end connection 172.28.0.164:61668 (399 connections now open) 2015-10-05T04:15:07.052+0100 [conn1421088] end connection 172.28.0.164:61553 (398 connections now open) 2015-10-05T04:15:07.053+0100 [mongosMain] connection accepted from 172.28.0.164:63141 #1421512 (399 connections now open) 2015-10-05T04:15:07.053+0100 [mongosMain] connection accepted from 172.28.0.164:63142 #1421513 (400 connections now open) 2015-10-05T04:15:07.054+0100 [conn1421512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:07.055+0100 [conn1421513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:08.238+0100 [conn1421050] end connection 172.28.0.163:51995 (399 connections now open) 2015-10-05T04:15:08.239+0100 [conn1421074] end connection 172.28.0.163:52032 (398 connections now open) 2015-10-05T04:15:08.240+0100 [mongosMain] connection accepted from 172.28.0.163:53738 #1421514 (399 connections now open) 2015-10-05T04:15:08.241+0100 [mongosMain] connection accepted from 172.28.0.163:53739 #1421515 (400 connections now open) 2015-10-05T04:15:08.241+0100 [conn1421514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:08.242+0100 [conn1421515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:12.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb3f5703b51053eb0f96 2015-10-05T04:15:12.300+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:15:13.228+0100 [conn1421099] end connection 172.28.0.164:61602 (399 connections now open) 2015-10-05T04:15:13.229+0100 [mongosMain] connection accepted from 172.28.0.164:63175 #1421516 (400 connections now open) 2015-10-05T04:15:13.231+0100 [conn1421516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:13.681+0100 [conn1421134] end connection 172.28.0.164:61695 (399 connections now open) 2015-10-05T04:15:13.682+0100 [mongosMain] connection accepted from 172.28.0.164:63177 #1421517 (400 connections now open) 2015-10-05T04:15:13.684+0100 [conn1421517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:14.243+0100 [conn1421070] end connection 172.28.0.163:52022 (399 connections now open) 2015-10-05T04:15:14.244+0100 [mongosMain] connection accepted from 172.28.0.163:53772 #1421518 (400 connections now open) 2015-10-05T04:15:14.245+0100 [conn1421518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:14.889+0100 [conn1421136] end connection 172.28.0.163:52242 (399 connections now open) 2015-10-05T04:15:14.890+0100 [mongosMain] connection accepted from 172.28.0.163:53774 #1421519 (400 connections now open) 2015-10-05T04:15:14.891+0100 [conn1421519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:17.051+0100 [conn1421137] end connection 172.28.0.164:61714 (399 connections now open) 2015-10-05T04:15:17.051+0100 [conn1421080] end connection 172.28.0.164:61515 (398 connections now open) 2015-10-05T04:15:17.052+0100 [mongosMain] connection accepted from 172.28.0.164:63181 #1421520 (399 connections now open) 2015-10-05T04:15:17.053+0100 [mongosMain] connection accepted from 172.28.0.164:63182 #1421521 (400 connections now open) 2015-10-05T04:15:17.054+0100 [conn1421520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:17.055+0100 [conn1421521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:18.238+0100 [conn1421097] end connection 172.28.0.163:52147 (399 connections now open) 2015-10-05T04:15:18.238+0100 [conn1421008] end connection 172.28.0.163:51852 (398 connections now open) 2015-10-05T04:15:18.240+0100 [mongosMain] connection accepted from 172.28.0.163:53779 #1421522 (399 connections now open) 2015-10-05T04:15:18.240+0100 [mongosMain] connection accepted from 172.28.0.163:53780 #1421523 (400 connections now open) 2015-10-05T04:15:18.241+0100 [conn1421522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:18.242+0100 [conn1421523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:23.243+0100 [conn1421108] end connection 172.28.0.164:61621 (399 connections now open) 2015-10-05T04:15:23.245+0100 [mongosMain] connection accepted from 172.28.0.164:63191 #1421524 (400 connections now open) 2015-10-05T04:15:23.246+0100 [conn1421524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:23.697+0100 [conn1421141] end connection 172.28.0.164:61743 (399 connections now open) 2015-10-05T04:15:23.698+0100 [mongosMain] connection accepted from 172.28.0.164:63193 #1421525 (400 connections now open) 2015-10-05T04:15:23.700+0100 [conn1421525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:24.244+0100 [conn1421110] end connection 172.28.0.163:52162 (399 connections now open) 2015-10-05T04:15:24.244+0100 [mongosMain] connection accepted from 172.28.0.163:53785 #1421526 (400 connections now open) 2015-10-05T04:15:24.245+0100 [conn1421526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:24.898+0100 [conn1421143] end connection 172.28.0.163:52312 (399 connections now open) 2015-10-05T04:15:24.900+0100 [mongosMain] connection accepted from 172.28.0.163:53787 #1421527 (400 connections now open) 2015-10-05T04:15:24.901+0100 [conn1421527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:27.066+0100 [conn1421103] end connection 172.28.0.164:61611 (399 connections now open) 2015-10-05T04:15:27.067+0100 [mongosMain] connection accepted from 172.28.0.164:63200 #1421528 (400 connections now open) 2015-10-05T04:15:27.067+0100 [conn1421112] end connection 172.28.0.164:61630 (399 connections now open) 2015-10-05T04:15:27.068+0100 [mongosMain] connection accepted from 172.28.0.164:63201 #1421529 (400 connections now open) 2015-10-05T04:15:27.069+0100 [conn1421528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:27.070+0100 [conn1421529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:28.253+0100 [conn1421056] end connection 172.28.0.163:52003 (399 connections now open) 2015-10-05T04:15:28.253+0100 [conn1421106] end connection 172.28.0.163:52157 (399 connections now open) 2015-10-05T04:15:28.254+0100 [mongosMain] connection accepted from 172.28.0.163:53790 #1421530 (399 connections now open) 2015-10-05T04:15:28.255+0100 [mongosMain] connection accepted from 172.28.0.163:53791 #1421531 (400 connections now open) 2015-10-05T04:15:28.256+0100 [conn1421530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:28.256+0100 [conn1421531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:28.559+0100 [mongosMain] connection accepted from 127.0.0.1:53794 #1421532 (401 connections now open) 2015-10-05T04:15:28.562+0100 [conn1421532] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:28.567+0100 [conn1421532] end connection 127.0.0.1:53794 (400 connections now open) 2015-10-05T04:15:30.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb525703b51053eb0ff4 2015-10-05T04:15:30.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:15:33.236+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:15:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:15:33.244+0100 [conn1421140] end connection 172.28.0.164:61741 (399 connections now open) 2015-10-05T04:15:33.245+0100 [mongosMain] connection accepted from 172.28.0.164:63209 #1421533 (400 connections now open) 2015-10-05T04:15:33.246+0100 [conn1421533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:33.696+0100 [conn1421148] end connection 172.28.0.164:61760 (399 connections now open) 2015-10-05T04:15:33.697+0100 [mongosMain] connection accepted from 172.28.0.164:63211 #1421534 (400 connections now open) 2015-10-05T04:15:33.700+0100 [conn1421534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:34.259+0100 [conn1421119] end connection 172.28.0.163:52176 (399 connections now open) 2015-10-05T04:15:34.260+0100 [mongosMain] connection accepted from 172.28.0.163:53797 #1421535 (400 connections now open) 2015-10-05T04:15:34.261+0100 [conn1421535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:34.914+0100 [conn1421150] end connection 172.28.0.163:52324 (399 connections now open) 2015-10-05T04:15:34.915+0100 [mongosMain] connection accepted from 172.28.0.163:53799 #1421536 (400 connections now open) 2015-10-05T04:15:34.916+0100 [conn1421536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:37.083+0100 [conn1421063] end connection 172.28.0.164:61479 (399 connections now open) 2015-10-05T04:15:37.083+0100 [mongosMain] connection accepted from 172.28.0.164:63219 #1421537 (400 connections now open) 2015-10-05T04:15:37.084+0100 [conn1421145] end connection 172.28.0.164:61749 (399 connections now open) 2015-10-05T04:15:37.085+0100 [mongosMain] connection accepted from 172.28.0.164:63220 #1421538 (400 connections now open) 2015-10-05T04:15:37.085+0100 [conn1421537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:37.086+0100 [conn1421538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:38.269+0100 [conn1421115] end connection 172.28.0.163:52167 (399 connections now open) 2015-10-05T04:15:38.269+0100 [conn1421002] end connection 172.28.0.163:51843 (399 connections now open) 2015-10-05T04:15:38.270+0100 [mongosMain] connection accepted from 172.28.0.163:53802 #1421539 (399 connections now open) 2015-10-05T04:15:38.271+0100 [mongosMain] connection accepted from 172.28.0.163:53803 #1421540 (400 connections now open) 2015-10-05T04:15:38.271+0100 [conn1421539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:38.271+0100 [conn1421540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:39.936+0100 [mongosMain] connection accepted from 127.0.0.1:53806 #1421541 (401 connections now open) 2015-10-05T04:15:39.939+0100 [conn1421541] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:39.943+0100 [conn1421541] end connection 127.0.0.1:53806 (400 connections now open) 2015-10-05T04:15:42.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb5e5703b51053eb102c 2015-10-05T04:15:42.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:15:43.712+0100 [conn1421156] end connection 172.28.0.164:61782 (399 connections now open) 2015-10-05T04:15:43.713+0100 [mongosMain] connection accepted from 172.28.0.164:63232 #1421542 (400 connections now open) 2015-10-05T04:15:43.715+0100 [conn1421542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:44.275+0100 [conn1421135] end connection 172.28.0.163:52234 (399 connections now open) 2015-10-05T04:15:44.276+0100 [mongosMain] connection accepted from 172.28.0.163:53811 #1421543 (400 connections now open) 2015-10-05T04:15:44.277+0100 [conn1421543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:44.915+0100 [conn1421158] end connection 172.28.0.163:52338 (399 connections now open) 2015-10-05T04:15:44.916+0100 [mongosMain] connection accepted from 172.28.0.163:53815 #1421544 (400 connections now open) 2015-10-05T04:15:44.917+0100 [conn1421544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:47.098+0100 [conn1421095] end connection 172.28.0.164:61593 (399 connections now open) 2015-10-05T04:15:47.099+0100 [conn1421122] end connection 172.28.0.164:61651 (398 connections now open) 2015-10-05T04:15:47.100+0100 [mongosMain] connection accepted from 172.28.0.164:63238 #1421545 (399 connections now open) 2015-10-05T04:15:47.100+0100 [mongosMain] connection accepted from 172.28.0.164:63239 #1421546 (400 connections now open) 2015-10-05T04:15:47.101+0100 [conn1421545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:47.101+0100 [conn1421546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:48.271+0100 [conn1420964] end connection 172.28.0.163:51680 (399 connections now open) 2015-10-05T04:15:48.271+0100 [conn1421131] end connection 172.28.0.163:52203 (398 connections now open) 2015-10-05T04:15:48.272+0100 [mongosMain] connection accepted from 172.28.0.163:53820 #1421547 (399 connections now open) 2015-10-05T04:15:48.272+0100 [mongosMain] connection accepted from 172.28.0.163:53822 #1421548 (400 connections now open) 2015-10-05T04:15:48.273+0100 [conn1421547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:48.273+0100 [conn1421548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:49.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb645703b51053eb1055 2015-10-05T04:15:49.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:15:53.274+0100 [conn1421117] end connection 172.28.0.164:61641 (399 connections now open) 2015-10-05T04:15:53.275+0100 [mongosMain] connection accepted from 172.28.0.164:63246 #1421549 (400 connections now open) 2015-10-05T04:15:53.277+0100 [conn1421549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:53.728+0100 [conn1421165] end connection 172.28.0.164:61803 (399 connections now open) 2015-10-05T04:15:53.729+0100 [mongosMain] connection accepted from 172.28.0.164:63248 #1421550 (400 connections now open) 2015-10-05T04:15:53.731+0100 [conn1421550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:54.275+0100 [conn1421127] end connection 172.28.0.163:52196 (399 connections now open) 2015-10-05T04:15:54.277+0100 [mongosMain] connection accepted from 172.28.0.163:53829 #1421551 (400 connections now open) 2015-10-05T04:15:54.278+0100 [conn1421551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:54.930+0100 [conn1421167] end connection 172.28.0.163:52355 (399 connections now open) 2015-10-05T04:15:54.931+0100 [mongosMain] connection accepted from 172.28.0.163:53833 #1421552 (400 connections now open) 2015-10-05T04:15:54.933+0100 [conn1421552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:57.114+0100 [conn1421159] end connection 172.28.0.164:61789 (399 connections now open) 2015-10-05T04:15:57.115+0100 [conn1421104] end connection 172.28.0.164:61612 (398 connections now open) 2015-10-05T04:15:57.115+0100 [mongosMain] connection accepted from 172.28.0.164:63252 #1421553 (399 connections now open) 2015-10-05T04:15:57.116+0100 [mongosMain] connection accepted from 172.28.0.164:63253 #1421554 (400 connections now open) 2015-10-05T04:15:57.117+0100 [conn1421553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:57.118+0100 [conn1421554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:58.285+0100 [conn1421123] end connection 172.28.0.163:52186 (399 connections now open) 2015-10-05T04:15:58.285+0100 [conn1421090] end connection 172.28.0.163:52110 (399 connections now open) 2015-10-05T04:15:58.286+0100 [mongosMain] connection accepted from 172.28.0.163:53839 #1421555 (399 connections now open) 2015-10-05T04:15:58.286+0100 [mongosMain] connection accepted from 172.28.0.163:53840 #1421556 (400 connections now open) 2015-10-05T04:15:58.287+0100 [conn1421555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:15:58.287+0100 [conn1421556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:03.275+0100 [conn1421155] end connection 172.28.0.164:61779 (399 connections now open) 2015-10-05T04:16:03.276+0100 [mongosMain] connection accepted from 172.28.0.164:63271 #1421557 (400 connections now open) 2015-10-05T04:16:03.277+0100 [conn1421557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:03.496+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:16:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:16:03.744+0100 [conn1421173] end connection 172.28.0.164:61833 (399 connections now open) 2015-10-05T04:16:03.745+0100 [mongosMain] connection accepted from 172.28.0.164:63276 #1421558 (400 connections now open) 2015-10-05T04:16:03.747+0100 [conn1421558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:04.290+0100 [conn1421149] end connection 172.28.0.163:52322 (399 connections now open) 2015-10-05T04:16:04.291+0100 [mongosMain] connection accepted from 172.28.0.163:53868 #1421559 (400 connections now open) 2015-10-05T04:16:04.292+0100 [conn1421559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:04.930+0100 [conn1421175] end connection 172.28.0.163:52376 (399 connections now open) 2015-10-05T04:16:04.932+0100 [mongosMain] connection accepted from 172.28.0.163:53875 #1421560 (400 connections now open) 2015-10-05T04:16:04.933+0100 [conn1421560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:07.129+0100 [conn1421144] end connection 172.28.0.164:61748 (399 connections now open) 2015-10-05T04:16:07.129+0100 [conn1421151] end connection 172.28.0.164:61767 (399 connections now open) 2015-10-05T04:16:07.130+0100 [mongosMain] connection accepted from 172.28.0.164:63303 #1421561 (399 connections now open) 2015-10-05T04:16:07.131+0100 [mongosMain] connection accepted from 172.28.0.164:63304 #1421562 (400 connections now open) 2015-10-05T04:16:07.132+0100 [conn1421561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:07.132+0100 [conn1421562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:07.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb775703b51053eb10c6 2015-10-05T04:16:07.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:16:08.286+0100 [conn1421075] end connection 172.28.0.163:52033 (399 connections now open) 2015-10-05T04:16:08.286+0100 [conn1421146] end connection 172.28.0.163:52316 (399 connections now open) 2015-10-05T04:16:08.287+0100 [mongosMain] connection accepted from 172.28.0.163:53900 #1421563 (399 connections now open) 2015-10-05T04:16:08.287+0100 [mongosMain] connection accepted from 172.28.0.163:53901 #1421564 (400 connections now open) 2015-10-05T04:16:08.288+0100 [conn1421563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:08.288+0100 [conn1421564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:13.291+0100 [conn1421133] end connection 172.28.0.164:61693 (399 connections now open) 2015-10-05T04:16:13.292+0100 [mongosMain] connection accepted from 172.28.0.164:63339 #1421565 (400 connections now open) 2015-10-05T04:16:13.293+0100 [conn1421565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:13.759+0100 [conn1421181] end connection 172.28.0.164:61875 (399 connections now open) 2015-10-05T04:16:13.760+0100 [mongosMain] connection accepted from 172.28.0.164:63342 #1421566 (400 connections now open) 2015-10-05T04:16:13.762+0100 [conn1421566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:14.292+0100 [conn1421166] end connection 172.28.0.163:52353 (399 connections now open) 2015-10-05T04:16:14.293+0100 [mongosMain] connection accepted from 172.28.0.163:53926 #1421567 (400 connections now open) 2015-10-05T04:16:14.294+0100 [conn1421567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:14.946+0100 [conn1421183] end connection 172.28.0.163:52454 (399 connections now open) 2015-10-05T04:16:14.947+0100 [mongosMain] connection accepted from 172.28.0.163:53929 #1421568 (400 connections now open) 2015-10-05T04:16:14.948+0100 [conn1421568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:17.145+0100 [conn1421177] end connection 172.28.0.164:61839 (399 connections now open) 2015-10-05T04:16:17.145+0100 [conn1421121] end connection 172.28.0.164:61650 (398 connections now open) 2015-10-05T04:16:17.146+0100 [mongosMain] connection accepted from 172.28.0.164:63349 #1421569 (399 connections now open) 2015-10-05T04:16:17.147+0100 [mongosMain] connection accepted from 172.28.0.164:63350 #1421570 (400 connections now open) 2015-10-05T04:16:17.148+0100 [conn1421569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:17.149+0100 [conn1421570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:18.301+0100 [conn1421153] end connection 172.28.0.163:52327 (399 connections now open) 2015-10-05T04:16:18.301+0100 [conn1421066] end connection 172.28.0.163:52016 (398 connections now open) 2015-10-05T04:16:18.302+0100 [mongosMain] connection accepted from 172.28.0.163:53933 #1421571 (399 connections now open) 2015-10-05T04:16:18.303+0100 [mongosMain] connection accepted from 172.28.0.163:53934 #1421572 (400 connections now open) 2015-10-05T04:16:18.303+0100 [conn1421571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:18.304+0100 [conn1421572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:23.291+0100 [conn1421125] end connection 172.28.0.164:61660 (399 connections now open) 2015-10-05T04:16:23.292+0100 [mongosMain] connection accepted from 172.28.0.164:63359 #1421573 (400 connections now open) 2015-10-05T04:16:23.294+0100 [conn1421573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:23.759+0100 [conn1421188] end connection 172.28.0.164:61917 (399 connections now open) 2015-10-05T04:16:23.760+0100 [mongosMain] connection accepted from 172.28.0.164:63362 #1421574 (400 connections now open) 2015-10-05T04:16:23.762+0100 [conn1421574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:24.306+0100 [conn1421142] end connection 172.28.0.163:52309 (399 connections now open) 2015-10-05T04:16:24.307+0100 [mongosMain] connection accepted from 172.28.0.163:53940 #1421575 (400 connections now open) 2015-10-05T04:16:24.309+0100 [conn1421575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:24.946+0100 [conn1421190] end connection 172.28.0.163:52508 (399 connections now open) 2015-10-05T04:16:24.947+0100 [mongosMain] connection accepted from 172.28.0.163:53942 #1421576 (400 connections now open) 2015-10-05T04:16:24.948+0100 [conn1421576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:26.125+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb895703b51053eb1116 2015-10-05T04:16:26.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:16:27.161+0100 [conn1421169] end connection 172.28.0.164:61810 (399 connections now open) 2015-10-05T04:16:27.161+0100 [conn1421138] end connection 172.28.0.164:61715 (398 connections now open) 2015-10-05T04:16:27.163+0100 [mongosMain] connection accepted from 172.28.0.164:63368 #1421577 (399 connections now open) 2015-10-05T04:16:27.164+0100 [mongosMain] connection accepted from 172.28.0.164:63369 #1421578 (400 connections now open) 2015-10-05T04:16:27.165+0100 [conn1421577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:27.166+0100 [conn1421578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:28.316+0100 [conn1421162] end connection 172.28.0.163:52343 (399 connections now open) 2015-10-05T04:16:28.316+0100 [conn1421082] end connection 172.28.0.163:52052 (399 connections now open) 2015-10-05T04:16:28.318+0100 [mongosMain] connection accepted from 172.28.0.163:53944 #1421579 (399 connections now open) 2015-10-05T04:16:28.318+0100 [mongosMain] connection accepted from 172.28.0.163:53945 #1421580 (400 connections now open) 2015-10-05T04:16:28.319+0100 [conn1421579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:28.319+0100 [conn1421580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:28.323+0100 [mongosMain] connection accepted from 127.0.0.1:53948 #1421581 (401 connections now open) 2015-10-05T04:16:28.325+0100 [conn1421581] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:28.329+0100 [conn1421581] end connection 127.0.0.1:53948 (400 connections now open) 2015-10-05T04:16:33.307+0100 [conn1421147] end connection 172.28.0.164:61758 (399 connections now open) 2015-10-05T04:16:33.308+0100 [mongosMain] connection accepted from 172.28.0.164:63377 #1421582 (400 connections now open) 2015-10-05T04:16:33.310+0100 [conn1421582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:33.758+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:16:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:16:33.775+0100 [conn1421195] end connection 172.28.0.164:61933 (399 connections now open) 2015-10-05T04:16:33.777+0100 [mongosMain] connection accepted from 172.28.0.164:63380 #1421583 (400 connections now open) 2015-10-05T04:16:33.779+0100 [conn1421583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:34.308+0100 [conn1421182] end connection 172.28.0.163:52449 (399 connections now open) 2015-10-05T04:16:34.309+0100 [mongosMain] connection accepted from 172.28.0.163:53949 #1421584 (400 connections now open) 2015-10-05T04:16:34.310+0100 [conn1421584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:34.962+0100 [conn1421197] end connection 172.28.0.163:52521 (399 connections now open) 2015-10-05T04:16:34.963+0100 [mongosMain] connection accepted from 172.28.0.163:53952 #1421585 (400 connections now open) 2015-10-05T04:16:34.964+0100 [conn1421585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:37.177+0100 [conn1421176] end connection 172.28.0.164:61838 (399 connections now open) 2015-10-05T04:16:37.177+0100 [conn1421184] end connection 172.28.0.164:61890 (398 connections now open) 2015-10-05T04:16:37.178+0100 [mongosMain] connection accepted from 172.28.0.164:63388 #1421586 (399 connections now open) 2015-10-05T04:16:37.178+0100 [mongosMain] connection accepted from 172.28.0.164:63389 #1421587 (400 connections now open) 2015-10-05T04:16:37.179+0100 [conn1421586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:37.179+0100 [conn1421587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:38.316+0100 [conn1421114] end connection 172.28.0.163:52166 (399 connections now open) 2015-10-05T04:16:38.316+0100 [conn1421171] end connection 172.28.0.163:52362 (398 connections now open) 2015-10-05T04:16:38.317+0100 [mongosMain] connection accepted from 172.28.0.163:53955 #1421588 (399 connections now open) 2015-10-05T04:16:38.318+0100 [mongosMain] connection accepted from 172.28.0.163:53956 #1421589 (400 connections now open) 2015-10-05T04:16:38.319+0100 [conn1421588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:38.319+0100 [conn1421589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:38.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eb965703b51053eb114a 2015-10-05T04:16:38.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:16:39.537+0100 [mongosMain] connection accepted from 127.0.0.1:53959 #1421590 (401 connections now open) 2015-10-05T04:16:39.540+0100 [conn1421590] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:39.544+0100 [conn1421590] end connection 127.0.0.1:53959 (400 connections now open) 2015-10-05T04:16:43.307+0100 [conn1421172] end connection 172.28.0.164:61830 (399 connections now open) 2015-10-05T04:16:43.308+0100 [mongosMain] connection accepted from 172.28.0.164:63397 #1421591 (400 connections now open) 2015-10-05T04:16:43.309+0100 [conn1421591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:43.774+0100 [conn1421204] end connection 172.28.0.164:61950 (399 connections now open) 2015-10-05T04:16:43.775+0100 [mongosMain] connection accepted from 172.28.0.164:63399 #1421592 (400 connections now open) 2015-10-05T04:16:43.777+0100 [conn1421592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:44.322+0100 [conn1421189] end connection 172.28.0.163:52506 (399 connections now open) 2015-10-05T04:16:44.323+0100 [mongosMain] connection accepted from 172.28.0.163:53964 #1421593 (400 connections now open) 2015-10-05T04:16:44.325+0100 [conn1421593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:44.977+0100 [conn1421206] end connection 172.28.0.163:52532 (399 connections now open) 2015-10-05T04:16:44.978+0100 [mongosMain] connection accepted from 172.28.0.163:53967 #1421594 (400 connections now open) 2015-10-05T04:16:44.979+0100 [conn1421594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:47.176+0100 [conn1421191] end connection 172.28.0.164:61922 (399 connections now open) 2015-10-05T04:16:47.177+0100 [conn1421160] end connection 172.28.0.164:61790 (398 connections now open) 2015-10-05T04:16:47.178+0100 [mongosMain] connection accepted from 172.28.0.164:63407 #1421595 (399 connections now open) 2015-10-05T04:16:47.178+0100 [mongosMain] connection accepted from 172.28.0.164:63408 #1421596 (400 connections now open) 2015-10-05T04:16:47.179+0100 [conn1421595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:47.180+0100 [conn1421596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:48.317+0100 [conn1421139] end connection 172.28.0.163:52270 (399 connections now open) 2015-10-05T04:16:48.318+0100 [conn1421185] end connection 172.28.0.163:52473 (398 connections now open) 2015-10-05T04:16:48.318+0100 [mongosMain] connection accepted from 172.28.0.163:53972 #1421597 (399 connections now open) 2015-10-05T04:16:48.319+0100 [mongosMain] connection accepted from 172.28.0.163:53973 #1421598 (400 connections now open) 2015-10-05T04:16:48.319+0100 [conn1421597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:48.320+0100 [conn1421598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:50.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eba25703b51053eb1191 2015-10-05T04:16:50.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:16:53.323+0100 [conn1421164] end connection 172.28.0.164:61800 (399 connections now open) 2015-10-05T04:16:53.324+0100 [mongosMain] connection accepted from 172.28.0.164:63413 #1421599 (400 connections now open) 2015-10-05T04:16:53.326+0100 [conn1421599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:53.790+0100 [conn1421213] end connection 172.28.0.164:61969 (399 connections now open) 2015-10-05T04:16:53.791+0100 [mongosMain] connection accepted from 172.28.0.164:63415 #1421600 (400 connections now open) 2015-10-05T04:16:53.793+0100 [conn1421600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:54.324+0100 [conn1421196] end connection 172.28.0.163:52519 (399 connections now open) 2015-10-05T04:16:54.325+0100 [mongosMain] connection accepted from 172.28.0.163:53981 #1421601 (400 connections now open) 2015-10-05T04:16:54.326+0100 [conn1421601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:54.978+0100 [conn1421215] end connection 172.28.0.163:52546 (399 connections now open) 2015-10-05T04:16:54.979+0100 [mongosMain] connection accepted from 172.28.0.163:53983 #1421602 (400 connections now open) 2015-10-05T04:16:54.981+0100 [conn1421602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:57.192+0100 [conn1421054] end connection 172.28.0.164:61462 (399 connections now open) 2015-10-05T04:16:57.192+0100 [conn1421207] end connection 172.28.0.164:61956 (399 connections now open) 2015-10-05T04:16:57.193+0100 [mongosMain] connection accepted from 172.28.0.164:63420 #1421603 (399 connections now open) 2015-10-05T04:16:57.193+0100 [mongosMain] connection accepted from 172.28.0.164:63421 #1421604 (400 connections now open) 2015-10-05T04:16:57.195+0100 [conn1421603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:57.195+0100 [conn1421604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:58.332+0100 [conn1421124] end connection 172.28.0.163:52187 (399 connections now open) 2015-10-05T04:16:58.332+0100 [conn1421193] end connection 172.28.0.163:52514 (399 connections now open) 2015-10-05T04:16:58.333+0100 [mongosMain] connection accepted from 172.28.0.163:53991 #1421605 (399 connections now open) 2015-10-05T04:16:58.334+0100 [mongosMain] connection accepted from 172.28.0.163:53992 #1421606 (400 connections now open) 2015-10-05T04:16:58.334+0100 [conn1421605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:16:58.335+0100 [conn1421606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:03.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebae5703b51053eb11cc 2015-10-05T04:17:03.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:03.322+0100 [conn1421187] end connection 172.28.0.164:61915 (399 connections now open) 2015-10-05T04:17:03.324+0100 [mongosMain] connection accepted from 172.28.0.164:63437 #1421607 (400 connections now open) 2015-10-05T04:17:03.325+0100 [conn1421607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:03.791+0100 [conn1421220] end connection 172.28.0.164:61986 (399 connections now open) 2015-10-05T04:17:03.792+0100 [mongosMain] connection accepted from 172.28.0.164:63443 #1421608 (400 connections now open) 2015-10-05T04:17:03.794+0100 [conn1421608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:04.011+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:17:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:17:04.339+0100 [conn1421214] end connection 172.28.0.163:52542 (399 connections now open) 2015-10-05T04:17:04.340+0100 [mongosMain] connection accepted from 172.28.0.163:54024 #1421609 (400 connections now open) 2015-10-05T04:17:04.341+0100 [conn1421609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:04.993+0100 [conn1421222] end connection 172.28.0.163:52564 (399 connections now open) 2015-10-05T04:17:04.994+0100 [mongosMain] connection accepted from 172.28.0.163:54031 #1421610 (400 connections now open) 2015-10-05T04:17:04.996+0100 [conn1421610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:07.208+0100 [conn1421216] end connection 172.28.0.164:61976 (399 connections now open) 2015-10-05T04:17:07.209+0100 [conn1421130] end connection 172.28.0.164:61669 (398 connections now open) 2015-10-05T04:17:07.209+0100 [mongosMain] connection accepted from 172.28.0.164:63469 #1421611 (399 connections now open) 2015-10-05T04:17:07.210+0100 [mongosMain] connection accepted from 172.28.0.164:63470 #1421612 (400 connections now open) 2015-10-05T04:17:07.211+0100 [conn1421611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:07.212+0100 [conn1421612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:08.349+0100 [conn1421132] end connection 172.28.0.163:52204 (399 connections now open) 2015-10-05T04:17:08.349+0100 [conn1421179] end connection 172.28.0.163:52383 (399 connections now open) 2015-10-05T04:17:08.350+0100 [mongosMain] connection accepted from 172.28.0.163:54048 #1421613 (399 connections now open) 2015-10-05T04:17:08.350+0100 [mongosMain] connection accepted from 172.28.0.163:54049 #1421614 (400 connections now open) 2015-10-05T04:17:08.351+0100 [conn1421613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:08.351+0100 [conn1421614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:13.338+0100 [conn1421180] end connection 172.28.0.164:61870 (399 connections now open) 2015-10-05T04:17:13.340+0100 [mongosMain] connection accepted from 172.28.0.164:63492 #1421615 (400 connections now open) 2015-10-05T04:17:13.342+0100 [conn1421615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:13.806+0100 [conn1421227] end connection 172.28.0.164:62008 (399 connections now open) 2015-10-05T04:17:13.807+0100 [mongosMain] connection accepted from 172.28.0.164:63494 #1421616 (400 connections now open) 2015-10-05T04:17:13.809+0100 [conn1421616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:14.354+0100 [conn1421157] end connection 172.28.0.163:52336 (399 connections now open) 2015-10-05T04:17:14.355+0100 [mongosMain] connection accepted from 172.28.0.163:54068 #1421617 (400 connections now open) 2015-10-05T04:17:14.357+0100 [conn1421617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:14.994+0100 [conn1421228] end connection 172.28.0.163:52597 (399 connections now open) 2015-10-05T04:17:14.995+0100 [mongosMain] connection accepted from 172.28.0.163:54071 #1421618 (400 connections now open) 2015-10-05T04:17:14.997+0100 [conn1421618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:17.223+0100 [conn1421199] end connection 172.28.0.164:61940 (399 connections now open) 2015-10-05T04:17:17.224+0100 [conn1421224] end connection 172.28.0.164:61992 (398 connections now open) 2015-10-05T04:17:17.225+0100 [mongosMain] connection accepted from 172.28.0.164:63498 #1421619 (399 connections now open) 2015-10-05T04:17:17.225+0100 [mongosMain] connection accepted from 172.28.0.164:63499 #1421620 (400 connections now open) 2015-10-05T04:17:17.226+0100 [conn1421619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:17.227+0100 [conn1421620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:18.348+0100 [conn1421200] end connection 172.28.0.163:52523 (399 connections now open) 2015-10-05T04:17:18.348+0100 [conn1421042] end connection 172.28.0.163:51956 (398 connections now open) 2015-10-05T04:17:18.349+0100 [mongosMain] connection accepted from 172.28.0.163:54075 #1421621 (399 connections now open) 2015-10-05T04:17:18.350+0100 [mongosMain] connection accepted from 172.28.0.163:54076 #1421622 (400 connections now open) 2015-10-05T04:17:18.351+0100 [conn1421622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:18.351+0100 [conn1421621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:21.570+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebc15703b51053eb1221 2015-10-05T04:17:21.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:23.339+0100 [conn1421194] end connection 172.28.0.164:61930 (399 connections now open) 2015-10-05T04:17:23.340+0100 [mongosMain] connection accepted from 172.28.0.164:63512 #1421623 (400 connections now open) 2015-10-05T04:17:23.342+0100 [conn1421623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:23.806+0100 [conn1421233] end connection 172.28.0.164:62063 (399 connections now open) 2015-10-05T04:17:23.807+0100 [mongosMain] connection accepted from 172.28.0.164:63514 #1421624 (400 connections now open) 2015-10-05T04:17:23.809+0100 [conn1421624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:24.354+0100 [conn1421174] end connection 172.28.0.163:52374 (399 connections now open) 2015-10-05T04:17:24.355+0100 [mongosMain] connection accepted from 172.28.0.163:54081 #1421625 (400 connections now open) 2015-10-05T04:17:24.356+0100 [conn1421625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:25.009+0100 [conn1421235] end connection 172.28.0.163:52652 (399 connections now open) 2015-10-05T04:17:25.010+0100 [mongosMain] connection accepted from 172.28.0.163:54083 #1421626 (400 connections now open) 2015-10-05T04:17:25.011+0100 [conn1421626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:27.239+0100 [conn1421230] end connection 172.28.0.164:62024 (399 connections now open) 2015-10-05T04:17:27.240+0100 [mongosMain] connection accepted from 172.28.0.164:63521 #1421627 (400 connections now open) 2015-10-05T04:17:27.242+0100 [conn1421627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:28.364+0100 [conn1421218] end connection 172.28.0.163:52551 (399 connections now open) 2015-10-05T04:17:28.364+0100 [conn1421152] end connection 172.28.0.163:52326 (399 connections now open) 2015-10-05T04:17:28.366+0100 [mongosMain] connection accepted from 172.28.0.163:54086 #1421628 (399 connections now open) 2015-10-05T04:17:28.366+0100 [mongosMain] connection accepted from 172.28.0.163:54088 #1421629 (400 connections now open) 2015-10-05T04:17:28.367+0100 [conn1421628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:28.367+0100 [conn1421629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:28.537+0100 [mongosMain] connection accepted from 127.0.0.1:54090 #1421630 (401 connections now open) 2015-10-05T04:17:28.540+0100 [conn1421630] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:28.545+0100 [conn1421630] end connection 127.0.0.1:54090 (400 connections now open) 2015-10-05T04:17:33.354+0100 [conn1421203] end connection 172.28.0.164:61947 (399 connections now open) 2015-10-05T04:17:33.355+0100 [mongosMain] connection accepted from 172.28.0.164:63529 #1421631 (400 connections now open) 2015-10-05T04:17:33.357+0100 [conn1421631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:33.822+0100 [conn1421240] end connection 172.28.0.164:62080 (399 connections now open) 2015-10-05T04:17:33.823+0100 [mongosMain] connection accepted from 172.28.0.164:63531 #1421632 (400 connections now open) 2015-10-05T04:17:33.824+0100 [conn1421632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:33.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebcd5703b51053eb124b 2015-10-05T04:17:34.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:34.278+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:17:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:17:34.369+0100 [conn1421221] end connection 172.28.0.163:52561 (399 connections now open) 2015-10-05T04:17:34.370+0100 [mongosMain] connection accepted from 172.28.0.163:54092 #1421633 (400 connections now open) 2015-10-05T04:17:34.371+0100 [conn1421633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:35.009+0100 [conn1421242] end connection 172.28.0.163:52662 (399 connections now open) 2015-10-05T04:17:35.010+0100 [mongosMain] connection accepted from 172.28.0.163:54094 #1421634 (400 connections now open) 2015-10-05T04:17:35.012+0100 [conn1421634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:37.255+0100 [conn1421223] end connection 172.28.0.164:61991 (399 connections now open) 2015-10-05T04:17:37.256+0100 [mongosMain] connection accepted from 172.28.0.164:63539 #1421635 (400 connections now open) 2015-10-05T04:17:37.258+0100 [conn1421635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:38.369+0100 [conn1421209] end connection 172.28.0.163:52534 (399 connections now open) 2015-10-05T04:17:38.370+0100 [conn1421161] end connection 172.28.0.163:52342 (398 connections now open) 2015-10-05T04:17:38.371+0100 [mongosMain] connection accepted from 172.28.0.163:54097 #1421636 (399 connections now open) 2015-10-05T04:17:38.371+0100 [mongosMain] connection accepted from 172.28.0.163:54098 #1421637 (400 connections now open) 2015-10-05T04:17:38.372+0100 [conn1421636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:38.372+0100 [conn1421637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:39.447+0100 [mongosMain] connection accepted from 127.0.0.1:54101 #1421638 (401 connections now open) 2015-10-05T04:17:39.450+0100 [conn1421638] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:39.454+0100 [conn1421638] end connection 127.0.0.1:54101 (400 connections now open) 2015-10-05T04:17:40.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebd45703b51053eb1264 2015-10-05T04:17:40.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:43.354+0100 [conn1421212] end connection 172.28.0.164:61967 (399 connections now open) 2015-10-05T04:17:43.355+0100 [mongosMain] connection accepted from 172.28.0.164:63549 #1421639 (400 connections now open) 2015-10-05T04:17:43.357+0100 [conn1421639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:43.822+0100 [conn1421248] end connection 172.28.0.164:62097 (399 connections now open) 2015-10-05T04:17:43.823+0100 [mongosMain] connection accepted from 172.28.0.164:63551 #1421640 (400 connections now open) 2015-10-05T04:17:43.825+0100 [conn1421640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:44.370+0100 [conn1421234] end connection 172.28.0.163:52646 (399 connections now open) 2015-10-05T04:17:44.371+0100 [mongosMain] connection accepted from 172.28.0.163:54106 #1421641 (400 connections now open) 2015-10-05T04:17:44.372+0100 [conn1421641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:45.026+0100 [conn1421250] end connection 172.28.0.163:52670 (399 connections now open) 2015-10-05T04:17:45.027+0100 [mongosMain] connection accepted from 172.28.0.163:54109 #1421642 (400 connections now open) 2015-10-05T04:17:45.031+0100 [conn1421642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:46.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebda5703b51053eb127a 2015-10-05T04:17:46.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:47.255+0100 [conn1421236] end connection 172.28.0.164:62069 (399 connections now open) 2015-10-05T04:17:47.257+0100 [mongosMain] connection accepted from 172.28.0.164:63558 #1421643 (400 connections now open) 2015-10-05T04:17:47.258+0100 [conn1421643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:48.379+0100 [conn1421225] end connection 172.28.0.163:52570 (399 connections now open) 2015-10-05T04:17:48.379+0100 [conn1421186] end connection 172.28.0.163:52474 (399 connections now open) 2015-10-05T04:17:48.380+0100 [mongosMain] connection accepted from 172.28.0.163:54115 #1421644 (399 connections now open) 2015-10-05T04:17:48.380+0100 [mongosMain] connection accepted from 172.28.0.163:54116 #1421645 (400 connections now open) 2015-10-05T04:17:48.381+0100 [conn1421644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:48.381+0100 [conn1421645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:53.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebe05703b51053eb1297 2015-10-05T04:17:53.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:17:53.370+0100 [conn1421219] end connection 172.28.0.164:61984 (399 connections now open) 2015-10-05T04:17:53.372+0100 [mongosMain] connection accepted from 172.28.0.164:63566 #1421646 (400 connections now open) 2015-10-05T04:17:53.374+0100 [conn1421646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:53.838+0100 [conn1421256] end connection 172.28.0.164:62115 (399 connections now open) 2015-10-05T04:17:53.839+0100 [mongosMain] connection accepted from 172.28.0.164:63568 #1421647 (400 connections now open) 2015-10-05T04:17:53.841+0100 [conn1421647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:54.385+0100 [conn1421249] end connection 172.28.0.163:52668 (399 connections now open) 2015-10-05T04:17:54.386+0100 [mongosMain] connection accepted from 172.28.0.163:54124 #1421648 (400 connections now open) 2015-10-05T04:17:54.387+0100 [conn1421648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:55.026+0100 [conn1421258] end connection 172.28.0.163:52683 (399 connections now open) 2015-10-05T04:17:55.027+0100 [mongosMain] connection accepted from 172.28.0.163:54126 #1421649 (400 connections now open) 2015-10-05T04:17:55.028+0100 [conn1421649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:58.380+0100 [conn1421231] end connection 172.28.0.163:52618 (399 connections now open) 2015-10-05T04:17:58.382+0100 [mongosMain] connection accepted from 172.28.0.163:54131 #1421650 (400 connections now open) 2015-10-05T04:17:58.383+0100 [conn1421650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:17:59.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebe75703b51053eb12ae 2015-10-05T04:17:59.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:03.838+0100 [conn1421262] end connection 172.28.0.164:62131 (399 connections now open) 2015-10-05T04:18:03.840+0100 [mongosMain] connection accepted from 172.28.0.164:63595 #1421651 (400 connections now open) 2015-10-05T04:18:03.842+0100 [conn1421651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:04.546+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:18:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:18:05.041+0100 [conn1421264] end connection 172.28.0.163:52699 (399 connections now open) 2015-10-05T04:18:05.043+0100 [mongosMain] connection accepted from 172.28.0.163:54166 #1421652 (400 connections now open) 2015-10-05T04:18:05.044+0100 [conn1421652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:05.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebed5703b51053eb12d9 2015-10-05T04:18:06.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:07.271+0100 [conn1421198] end connection 172.28.0.164:61941 (399 connections now open) 2015-10-05T04:18:07.272+0100 [conn1421243] end connection 172.28.0.164:62086 (399 connections now open) 2015-10-05T04:18:07.273+0100 [mongosMain] connection accepted from 172.28.0.164:63617 #1421653 (399 connections now open) 2015-10-05T04:18:07.273+0100 [mongosMain] connection accepted from 172.28.0.164:63618 #1421654 (400 connections now open) 2015-10-05T04:18:07.274+0100 [conn1421653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:07.275+0100 [conn1421654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:08.396+0100 [conn1421245] end connection 172.28.0.163:52665 (399 connections now open) 2015-10-05T04:18:08.397+0100 [mongosMain] connection accepted from 172.28.0.163:54185 #1421655 (400 connections now open) 2015-10-05T04:18:08.398+0100 [conn1421655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:12.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebf45703b51053eb12f1 2015-10-05T04:18:12.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:13.853+0100 [conn1421267] end connection 172.28.0.164:62154 (399 connections now open) 2015-10-05T04:18:13.854+0100 [mongosMain] connection accepted from 172.28.0.164:63650 #1421656 (400 connections now open) 2015-10-05T04:18:13.856+0100 [conn1421656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:15.057+0100 [conn1421268] end connection 172.28.0.163:52739 (399 connections now open) 2015-10-05T04:18:15.058+0100 [mongosMain] connection accepted from 172.28.0.163:54219 #1421657 (400 connections now open) 2015-10-05T04:18:15.059+0100 [conn1421657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:17.287+0100 [conn1421265] end connection 172.28.0.164:62134 (399 connections now open) 2015-10-05T04:18:17.288+0100 [mongosMain] connection accepted from 172.28.0.164:63653 #1421658 (400 connections now open) 2015-10-05T04:18:17.290+0100 [conn1421658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:18.411+0100 [conn1421266] end connection 172.28.0.163:52706 (399 connections now open) 2015-10-05T04:18:18.412+0100 [mongosMain] connection accepted from 172.28.0.163:54223 #1421659 (400 connections now open) 2015-10-05T04:18:18.413+0100 [conn1421659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:18.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ebfa5703b51053eb130f 2015-10-05T04:18:18.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:23.401+0100 [conn1421226] end connection 172.28.0.164:62002 (399 connections now open) 2015-10-05T04:18:23.402+0100 [mongosMain] connection accepted from 172.28.0.164:63661 #1421660 (400 connections now open) 2015-10-05T04:18:23.403+0100 [conn1421660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:23.869+0100 [conn1421270] end connection 172.28.0.164:62189 (399 connections now open) 2015-10-05T04:18:23.873+0100 [mongosMain] connection accepted from 172.28.0.164:63664 #1421661 (400 connections now open) 2015-10-05T04:18:23.875+0100 [conn1421661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:27.303+0100 [conn1421259] end connection 172.28.0.164:62121 (399 connections now open) 2015-10-05T04:18:27.304+0100 [mongosMain] connection accepted from 172.28.0.164:63668 #1421662 (400 connections now open) 2015-10-05T04:18:27.307+0100 [conn1421662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:28.414+0100 [conn1421260] end connection 172.28.0.163:52689 (399 connections now open) 2015-10-05T04:18:28.415+0100 [mongosMain] connection accepted from 172.28.0.163:54229 #1421663 (400 connections now open) 2015-10-05T04:18:28.416+0100 [conn1421663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:28.803+0100 [mongosMain] connection accepted from 127.0.0.1:54230 #1421664 (401 connections now open) 2015-10-05T04:18:28.806+0100 [conn1421664] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:28.812+0100 [conn1421664] end connection 127.0.0.1:54230 (400 connections now open) 2015-10-05T04:18:31.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec065703b51053eb1345 2015-10-05T04:18:31.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:33.417+0100 [conn1421239] end connection 172.28.0.164:62078 (399 connections now open) 2015-10-05T04:18:33.418+0100 [mongosMain] connection accepted from 172.28.0.164:63675 #1421665 (400 connections now open) 2015-10-05T04:18:33.421+0100 [conn1421665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:34.679+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:18:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:18:37.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec0d5703b51053eb135e 2015-10-05T04:18:37.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:38.427+0100 [conn1421269] end connection 172.28.0.163:52770 (399 connections now open) 2015-10-05T04:18:38.428+0100 [mongosMain] connection accepted from 172.28.0.163:54234 #1421666 (400 connections now open) 2015-10-05T04:18:38.429+0100 [conn1421666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:39.263+0100 [mongosMain] connection accepted from 127.0.0.1:54235 #1421667 (401 connections now open) 2015-10-05T04:18:39.266+0100 [conn1421667] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:39.270+0100 [conn1421667] end connection 127.0.0.1:54235 (400 connections now open) 2015-10-05T04:18:43.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec135703b51053eb138d 2015-10-05T04:18:43.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:48.427+0100 [conn1421238] end connection 172.28.0.163:52657 (399 connections now open) 2015-10-05T04:18:48.428+0100 [mongosMain] connection accepted from 172.28.0.163:54247 #1421668 (400 connections now open) 2015-10-05T04:18:48.429+0100 [conn1421668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:53.432+0100 [conn1421255] end connection 172.28.0.164:62113 (399 connections now open) 2015-10-05T04:18:53.433+0100 [mongosMain] connection accepted from 172.28.0.164:63697 #1421669 (400 connections now open) 2015-10-05T04:18:53.435+0100 [conn1421669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:18:56.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec1f5703b51053eb13f3 2015-10-05T04:18:56.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:18:58.442+0100 [conn1421253] end connection 172.28.0.163:52673 (399 connections now open) 2015-10-05T04:18:58.443+0100 [mongosMain] connection accepted from 172.28.0.163:54257 #1421670 (400 connections now open) 2015-10-05T04:18:58.444+0100 [conn1421670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:04.825+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:19:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:19:08.499+0100 [conn1421273] end connection 172.28.0.163:52799 (399 connections now open) 2015-10-05T04:19:08.499+0100 [mongosMain] connection accepted from 172.28.0.163:54318 #1421671 (400 connections now open) 2015-10-05T04:19:08.499+0100 [conn1421671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:08.499+0100 [conn1421105] end connection 172.28.0.163:52156 (399 connections now open) 2015-10-05T04:19:08.499+0100 [mongosMain] connection accepted from 172.28.0.163:54319 #1421672 (400 connections now open) 2015-10-05T04:19:08.499+0100 [conn1421672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:14.525+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec325703b51053eb1478 2015-10-05T04:19:14.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:17.365+0100 [conn1421272] end connection 172.28.0.164:62192 (399 connections now open) 2015-10-05T04:19:17.366+0100 [mongosMain] connection accepted from 172.28.0.164:63774 #1421673 (400 connections now open) 2015-10-05T04:19:17.368+0100 [conn1421673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:18.461+0100 [conn1421178] end connection 172.28.0.163:52382 (399 connections now open) 2015-10-05T04:19:18.462+0100 [mongosMain] connection accepted from 172.28.0.163:54350 #1421674 (400 connections now open) 2015-10-05T04:19:18.463+0100 [conn1421674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:21.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec385703b51053eb149c 2015-10-05T04:19:21.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:27.381+0100 [conn1421275] end connection 172.28.0.164:62207 (399 connections now open) 2015-10-05T04:19:27.382+0100 [mongosMain] connection accepted from 172.28.0.164:63785 #1421675 (400 connections now open) 2015-10-05T04:19:27.384+0100 [conn1421675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:27.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec3f5703b51053eb14c0 2015-10-05T04:19:27.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:28.984+0100 [mongosMain] connection accepted from 127.0.0.1:54354 #1421676 (401 connections now open) 2015-10-05T04:19:28.986+0100 [conn1421676] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:28.993+0100 [conn1421676] end connection 127.0.0.1:54354 (400 connections now open) 2015-10-05T04:19:34.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec455703b51053eb14dd 2015-10-05T04:19:34.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:35.023+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:19:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:19:37.396+0100 [conn1421252] end connection 172.28.0.164:62104 (399 connections now open) 2015-10-05T04:19:37.397+0100 [mongosMain] connection accepted from 172.28.0.164:63797 #1421677 (400 connections now open) 2015-10-05T04:19:37.399+0100 [conn1421677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:39.347+0100 [mongosMain] connection accepted from 127.0.0.1:54357 #1421678 (401 connections now open) 2015-10-05T04:19:39.350+0100 [conn1421678] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:39.354+0100 [conn1421678] end connection 127.0.0.1:54357 (400 connections now open) 2015-10-05T04:19:40.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec4c5703b51053eb14fb 2015-10-05T04:19:40.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:44.480+0100 [conn1421263] end connection 172.28.0.163:52697 (399 connections now open) 2015-10-05T04:19:44.481+0100 [mongosMain] connection accepted from 172.28.0.163:54367 #1421679 (400 connections now open) 2015-10-05T04:19:44.482+0100 [conn1421679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:46.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec525703b51053eb1511 2015-10-05T04:19:46.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:52.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec585703b51053eb152b 2015-10-05T04:19:53.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:19:54.496+0100 [conn1421205] end connection 172.28.0.163:52530 (399 connections now open) 2015-10-05T04:19:54.498+0100 [mongosMain] connection accepted from 172.28.0.163:54376 #1421680 (400 connections now open) 2015-10-05T04:19:54.498+0100 [conn1421680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:19:59.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec5f5703b51053eb153d 2015-10-05T04:19:59.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:03.527+0100 [conn1421232] end connection 172.28.0.164:62058 (399 connections now open) 2015-10-05T04:20:03.528+0100 [mongosMain] connection accepted from 172.28.0.164:63833 #1421681 (400 connections now open) 2015-10-05T04:20:03.530+0100 [conn1421681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:04.496+0100 [conn1421257] end connection 172.28.0.163:52681 (399 connections now open) 2015-10-05T04:20:04.497+0100 [mongosMain] connection accepted from 172.28.0.163:54407 #1421682 (400 connections now open) 2015-10-05T04:20:04.498+0100 [conn1421682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:05.186+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:20:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:20:05.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec655703b51053eb1565 2015-10-05T04:20:05.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:08.506+0100 [conn1421192] end connection 172.28.0.163:52513 (399 connections now open) 2015-10-05T04:20:08.508+0100 [mongosMain] connection accepted from 172.28.0.163:54432 #1421683 (400 connections now open) 2015-10-05T04:20:08.509+0100 [conn1421683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:11.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec6b5703b51053eb1585 2015-10-05T04:20:12.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:13.543+0100 [conn1421282] end connection 172.28.0.164:62312 (399 connections now open) 2015-10-05T04:20:13.544+0100 [mongosMain] connection accepted from 172.28.0.164:63879 #1421684 (400 connections now open) 2015-10-05T04:20:13.546+0100 [conn1421684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:15.151+0100 [conn1421271] end connection 172.28.0.163:52795 (399 connections now open) 2015-10-05T04:20:15.152+0100 [mongosMain] connection accepted from 172.28.0.163:54472 #1421685 (400 connections now open) 2015-10-05T04:20:15.153+0100 [conn1421685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:17.443+0100 [conn1421285] end connection 172.28.0.164:62338 (399 connections now open) 2015-10-05T04:20:17.444+0100 [mongosMain] connection accepted from 172.28.0.164:63884 #1421686 (400 connections now open) 2015-10-05T04:20:17.446+0100 [conn1421686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:18.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec725703b51053eb1596 2015-10-05T04:20:18.506+0100 [conn1421278] end connection 172.28.0.163:52808 (399 connections now open) 2015-10-05T04:20:18.507+0100 [mongosMain] connection accepted from 172.28.0.163:54475 #1421687 (400 connections now open) 2015-10-05T04:20:18.508+0100 [conn1421687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:18.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:23.558+0100 [conn1421247] end connection 172.28.0.164:62094 (399 connections now open) 2015-10-05T04:20:23.559+0100 [mongosMain] connection accepted from 172.28.0.164:63893 #1421688 (400 connections now open) 2015-10-05T04:20:23.561+0100 [conn1421688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:24.011+0100 [conn1421274] end connection 172.28.0.164:62202 (399 connections now open) 2015-10-05T04:20:24.012+0100 [mongosMain] connection accepted from 172.28.0.164:63896 #1421689 (400 connections now open) 2015-10-05T04:20:24.014+0100 [conn1421689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:24.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec785703b51053eb15ad 2015-10-05T04:20:24.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:25.167+0100 [conn1421292] end connection 172.28.0.163:53016 (399 connections now open) 2015-10-05T04:20:25.168+0100 [mongosMain] connection accepted from 172.28.0.163:54480 #1421690 (400 connections now open) 2015-10-05T04:20:25.170+0100 [conn1421690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:27.459+0100 [conn1421287] end connection 172.28.0.164:62351 (399 connections now open) 2015-10-05T04:20:27.461+0100 [mongosMain] connection accepted from 172.28.0.164:63901 #1421691 (400 connections now open) 2015-10-05T04:20:27.463+0100 [conn1421691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:28.249+0100 [mongosMain] connection accepted from 127.0.0.1:54485 #1421692 (401 connections now open) 2015-10-05T04:20:28.251+0100 [conn1421692] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:28.257+0100 [conn1421692] end connection 127.0.0.1:54485 (400 connections now open) 2015-10-05T04:20:31.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec7e5703b51053eb15cc 2015-10-05T04:20:31.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:34.027+0100 [conn1421295] end connection 172.28.0.164:62436 (399 connections now open) 2015-10-05T04:20:34.028+0100 [mongosMain] connection accepted from 172.28.0.164:63910 #1421693 (400 connections now open) 2015-10-05T04:20:34.030+0100 [conn1421693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:35.167+0100 [conn1421296] end connection 172.28.0.163:53025 (399 connections now open) 2015-10-05T04:20:35.168+0100 [mongosMain] connection accepted from 172.28.0.163:54490 #1421694 (400 connections now open) 2015-10-05T04:20:35.170+0100 [conn1421694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:35.366+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:20:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:20:37.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec855703b51053eb15ee 2015-10-05T04:20:37.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:37.458+0100 [conn1421229] end connection 172.28.0.164:62023 (399 connections now open) 2015-10-05T04:20:37.460+0100 [mongosMain] connection accepted from 172.28.0.164:63916 #1421695 (400 connections now open) 2015-10-05T04:20:37.461+0100 [conn1421695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:40.093+0100 [mongosMain] connection accepted from 127.0.0.1:54494 #1421696 (401 connections now open) 2015-10-05T04:20:40.096+0100 [conn1421696] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:40.100+0100 [conn1421696] end connection 127.0.0.1:54494 (400 connections now open) 2015-10-05T04:20:43.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec8b5703b51053eb1614 2015-10-05T04:20:43.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:44.042+0100 [conn1421301] end connection 172.28.0.164:62451 (399 connections now open) 2015-10-05T04:20:44.043+0100 [mongosMain] connection accepted from 172.28.0.164:63925 #1421697 (400 connections now open) 2015-10-05T04:20:44.048+0100 [conn1421697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:44.528+0100 [conn1421288] end connection 172.28.0.163:52936 (399 connections now open) 2015-10-05T04:20:44.529+0100 [mongosMain] connection accepted from 172.28.0.163:54500 #1421698 (400 connections now open) 2015-10-05T04:20:44.530+0100 [conn1421698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:45.182+0100 [conn1421302] end connection 172.28.0.163:53031 (399 connections now open) 2015-10-05T04:20:45.183+0100 [mongosMain] connection accepted from 172.28.0.163:54503 #1421699 (400 connections now open) 2015-10-05T04:20:45.184+0100 [conn1421699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:47.475+0100 [conn1421298] end connection 172.28.0.164:62443 (399 connections now open) 2015-10-05T04:20:47.476+0100 [mongosMain] connection accepted from 172.28.0.164:63932 #1421700 (400 connections now open) 2015-10-05T04:20:47.478+0100 [conn1421700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:48.537+0100 [conn1421170] end connection 172.28.0.163:52361 (399 connections now open) 2015-10-05T04:20:48.538+0100 [mongosMain] connection accepted from 172.28.0.163:54509 #1421701 (400 connections now open) 2015-10-05T04:20:48.539+0100 [conn1421701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:50.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec915703b51053eb1633 2015-10-05T04:20:50.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:53.590+0100 [conn1421294] end connection 172.28.0.164:62434 (399 connections now open) 2015-10-05T04:20:53.592+0100 [mongosMain] connection accepted from 172.28.0.164:63937 #1421702 (400 connections now open) 2015-10-05T04:20:53.594+0100 [conn1421702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:54.058+0100 [conn1421307] end connection 172.28.0.164:62470 (399 connections now open) 2015-10-05T04:20:54.059+0100 [mongosMain] connection accepted from 172.28.0.164:63940 #1421703 (400 connections now open) 2015-10-05T04:20:54.060+0100 [conn1421703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:54.543+0100 [conn1421290] end connection 172.28.0.163:52965 (399 connections now open) 2015-10-05T04:20:54.544+0100 [mongosMain] connection accepted from 172.28.0.163:54515 #1421704 (400 connections now open) 2015-10-05T04:20:54.545+0100 [conn1421704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:55.198+0100 [conn1421308] end connection 172.28.0.163:53040 (399 connections now open) 2015-10-05T04:20:55.199+0100 [mongosMain] connection accepted from 172.28.0.163:54518 #1421705 (400 connections now open) 2015-10-05T04:20:55.200+0100 [conn1421705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:20:56.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec985703b51053eb1654 2015-10-05T04:20:56.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:20:57.475+0100 [conn1421237] end connection 172.28.0.164:62070 (399 connections now open) 2015-10-05T04:20:57.476+0100 [mongosMain] connection accepted from 172.28.0.164:63945 #1421706 (400 connections now open) 2015-10-05T04:20:57.477+0100 [conn1421706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:02.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ec9e5703b51053eb166e 2015-10-05T04:21:03.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:03.591+0100 [conn1421300] end connection 172.28.0.164:62449 (399 connections now open) 2015-10-05T04:21:03.592+0100 [mongosMain] connection accepted from 172.28.0.164:63960 #1421707 (400 connections now open) 2015-10-05T04:21:03.593+0100 [conn1421707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:04.058+0100 [conn1421311] end connection 172.28.0.164:62482 (399 connections now open) 2015-10-05T04:21:04.059+0100 [mongosMain] connection accepted from 172.28.0.164:63963 #1421708 (400 connections now open) 2015-10-05T04:21:04.060+0100 [conn1421708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:04.543+0100 [conn1421241] end connection 172.28.0.163:52660 (399 connections now open) 2015-10-05T04:21:04.544+0100 [mongosMain] connection accepted from 172.28.0.163:54553 #1421709 (400 connections now open) 2015-10-05T04:21:04.545+0100 [conn1421709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:05.198+0100 [conn1421313] end connection 172.28.0.163:53055 (399 connections now open) 2015-10-05T04:21:05.199+0100 [mongosMain] connection accepted from 172.28.0.163:54561 #1421710 (400 connections now open) 2015-10-05T04:21:05.200+0100 [conn1421710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:05.559+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:21:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:21:07.491+0100 [conn1421244] end connection 172.28.0.164:62087 (399 connections now open) 2015-10-05T04:21:07.492+0100 [mongosMain] connection accepted from 172.28.0.164:63989 #1421711 (400 connections now open) 2015-10-05T04:21:07.494+0100 [conn1421711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:08.554+0100 [conn1421280] end connection 172.28.0.163:52818 (399 connections now open) 2015-10-05T04:21:08.555+0100 [mongosMain] connection accepted from 172.28.0.163:54587 #1421712 (400 connections now open) 2015-10-05T04:21:08.556+0100 [conn1421712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:09.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eca55703b51053eb16a1 2015-10-05T04:21:09.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:13.606+0100 [conn1421261] end connection 172.28.0.164:62129 (399 connections now open) 2015-10-05T04:21:13.607+0100 [mongosMain] connection accepted from 172.28.0.164:64009 #1421713 (400 connections now open) 2015-10-05T04:21:13.609+0100 [conn1421713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:14.078+0100 [conn1421316] end connection 172.28.0.164:62501 (399 connections now open) 2015-10-05T04:21:14.079+0100 [mongosMain] connection accepted from 172.28.0.164:64011 #1421714 (400 connections now open) 2015-10-05T04:21:14.081+0100 [conn1421714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:14.559+0100 [conn1421291] end connection 172.28.0.163:53013 (399 connections now open) 2015-10-05T04:21:14.560+0100 [mongosMain] connection accepted from 172.28.0.163:54609 #1421715 (400 connections now open) 2015-10-05T04:21:14.561+0100 [conn1421715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:15.214+0100 [conn1421318] end connection 172.28.0.163:53091 (399 connections now open) 2015-10-05T04:21:15.215+0100 [mongosMain] connection accepted from 172.28.0.163:54611 #1421716 (400 connections now open) 2015-10-05T04:21:15.216+0100 [conn1421716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:15.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecab5703b51053eb16b9 2015-10-05T04:21:15.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:17.506+0100 [conn1421208] end connection 172.28.0.164:61957 (399 connections now open) 2015-10-05T04:21:17.506+0100 [conn1421297] end connection 172.28.0.164:62442 (398 connections now open) 2015-10-05T04:21:17.508+0100 [mongosMain] connection accepted from 172.28.0.164:64015 #1421717 (399 connections now open) 2015-10-05T04:21:17.508+0100 [mongosMain] connection accepted from 172.28.0.164:64016 #1421718 (400 connections now open) 2015-10-05T04:21:17.509+0100 [conn1421717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:17.510+0100 [conn1421718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:18.569+0100 [conn1421293] end connection 172.28.0.163:53020 (399 connections now open) 2015-10-05T04:21:18.570+0100 [conn1421098] end connection 172.28.0.163:52148 (398 connections now open) 2015-10-05T04:21:18.572+0100 [mongosMain] connection accepted from 172.28.0.163:54615 #1421719 (399 connections now open) 2015-10-05T04:21:18.572+0100 [mongosMain] connection accepted from 172.28.0.163:54616 #1421720 (400 connections now open) 2015-10-05T04:21:18.573+0100 [conn1421720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:18.573+0100 [conn1421719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:22.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecb15703b51053eb16d1 2015-10-05T04:21:22.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:23.606+0100 [conn1421322] end connection 172.28.0.164:62541 (399 connections now open) 2015-10-05T04:21:23.607+0100 [mongosMain] connection accepted from 172.28.0.164:64025 #1421721 (400 connections now open) 2015-10-05T04:21:23.612+0100 [conn1421721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:24.075+0100 [conn1421323] end connection 172.28.0.164:62544 (399 connections now open) 2015-10-05T04:21:24.077+0100 [mongosMain] connection accepted from 172.28.0.164:64027 #1421722 (400 connections now open) 2015-10-05T04:21:24.078+0100 [conn1421722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:24.574+0100 [conn1421312] end connection 172.28.0.163:53052 (399 connections now open) 2015-10-05T04:21:24.575+0100 [mongosMain] connection accepted from 172.28.0.163:54622 #1421723 (400 connections now open) 2015-10-05T04:21:24.576+0100 [conn1421723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:25.214+0100 [conn1421325] end connection 172.28.0.163:53151 (399 connections now open) 2015-10-05T04:21:25.216+0100 [mongosMain] connection accepted from 172.28.0.163:54623 #1421724 (400 connections now open) 2015-10-05T04:21:25.217+0100 [conn1421724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:27.506+0100 [conn1421304] end connection 172.28.0.164:62457 (399 connections now open) 2015-10-05T04:21:27.506+0100 [conn1421309] end connection 172.28.0.164:62474 (398 connections now open) 2015-10-05T04:21:27.508+0100 [mongosMain] connection accepted from 172.28.0.164:64035 #1421725 (399 connections now open) 2015-10-05T04:21:27.508+0100 [mongosMain] connection accepted from 172.28.0.164:64034 #1421726 (400 connections now open) 2015-10-05T04:21:27.510+0100 [conn1421725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:27.510+0100 [conn1421726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:28.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecb85703b51053eb16ec 2015-10-05T04:21:28.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:28.487+0100 [mongosMain] connection accepted from 127.0.0.1:54625 #1421727 (401 connections now open) 2015-10-05T04:21:28.490+0100 [conn1421727] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:28.504+0100 [conn1421727] end connection 127.0.0.1:54625 (400 connections now open) 2015-10-05T04:21:28.569+0100 [conn1421276] end connection 172.28.0.163:52803 (399 connections now open) 2015-10-05T04:21:28.570+0100 [conn1421210] end connection 172.28.0.163:52535 (398 connections now open) 2015-10-05T04:21:28.571+0100 [mongosMain] connection accepted from 172.28.0.163:54626 #1421728 (399 connections now open) 2015-10-05T04:21:28.572+0100 [mongosMain] connection accepted from 172.28.0.163:54627 #1421729 (400 connections now open) 2015-10-05T04:21:28.573+0100 [conn1421728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:28.573+0100 [conn1421729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:33.621+0100 [conn1421281] end connection 172.28.0.164:62247 (399 connections now open) 2015-10-05T04:21:33.622+0100 [mongosMain] connection accepted from 172.28.0.164:64043 #1421730 (400 connections now open) 2015-10-05T04:21:33.624+0100 [conn1421730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:34.089+0100 [conn1421331] end connection 172.28.0.164:62562 (399 connections now open) 2015-10-05T04:21:34.091+0100 [mongosMain] connection accepted from 172.28.0.164:64045 #1421731 (400 connections now open) 2015-10-05T04:21:34.093+0100 [conn1421731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:34.575+0100 [conn1421317] end connection 172.28.0.163:53086 (399 connections now open) 2015-10-05T04:21:34.576+0100 [mongosMain] connection accepted from 172.28.0.163:54630 #1421732 (400 connections now open) 2015-10-05T04:21:34.577+0100 [conn1421732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:34.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecbe5703b51053eb16fc 2015-10-05T04:21:34.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:35.230+0100 [conn1421333] end connection 172.28.0.163:53163 (399 connections now open) 2015-10-05T04:21:35.231+0100 [mongosMain] connection accepted from 172.28.0.163:54632 #1421733 (400 connections now open) 2015-10-05T04:21:35.232+0100 [conn1421733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:35.824+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:21:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:21:37.522+0100 [conn1421283] end connection 172.28.0.164:62316 (399 connections now open) 2015-10-05T04:21:37.522+0100 [conn1421314] end connection 172.28.0.164:62488 (399 connections now open) 2015-10-05T04:21:37.523+0100 [mongosMain] connection accepted from 172.28.0.164:64052 #1421734 (399 connections now open) 2015-10-05T04:21:37.523+0100 [mongosMain] connection accepted from 172.28.0.164:64053 #1421735 (400 connections now open) 2015-10-05T04:21:37.524+0100 [conn1421734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:37.524+0100 [conn1421735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:38.585+0100 [conn1421321] end connection 172.28.0.163:53108 (399 connections now open) 2015-10-05T04:21:38.585+0100 [conn1421315] end connection 172.28.0.163:53062 (398 connections now open) 2015-10-05T04:21:38.586+0100 [mongosMain] connection accepted from 172.28.0.163:54635 #1421736 (399 connections now open) 2015-10-05T04:21:38.587+0100 [mongosMain] connection accepted from 172.28.0.163:54636 #1421737 (400 connections now open) 2015-10-05T04:21:38.587+0100 [conn1421736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:38.588+0100 [conn1421737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:40.144+0100 [mongosMain] connection accepted from 127.0.0.1:54638 #1421738 (401 connections now open) 2015-10-05T04:21:40.147+0100 [conn1421738] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:40.152+0100 [conn1421738] end connection 127.0.0.1:54638 (400 connections now open) 2015-10-05T04:21:41.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecc45703b51053eb171b 2015-10-05T04:21:41.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:43.622+0100 [conn1421289] end connection 172.28.0.164:62376 (399 connections now open) 2015-10-05T04:21:43.623+0100 [mongosMain] connection accepted from 172.28.0.164:64063 #1421739 (400 connections now open) 2015-10-05T04:21:43.625+0100 [conn1421739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:44.089+0100 [conn1421340] end connection 172.28.0.164:62580 (399 connections now open) 2015-10-05T04:21:44.091+0100 [mongosMain] connection accepted from 172.28.0.164:64065 #1421740 (400 connections now open) 2015-10-05T04:21:44.093+0100 [conn1421740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:44.590+0100 [conn1421324] end connection 172.28.0.163:53146 (399 connections now open) 2015-10-05T04:21:44.591+0100 [mongosMain] connection accepted from 172.28.0.163:54644 #1421741 (400 connections now open) 2015-10-05T04:21:44.592+0100 [conn1421741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:45.230+0100 [conn1421342] end connection 172.28.0.163:53173 (399 connections now open) 2015-10-05T04:21:45.231+0100 [mongosMain] connection accepted from 172.28.0.163:54647 #1421742 (400 connections now open) 2015-10-05T04:21:45.233+0100 [conn1421742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:47.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eccb5703b51053eb172d 2015-10-05T04:21:47.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:47.522+0100 [conn1421217] end connection 172.28.0.164:61977 (399 connections now open) 2015-10-05T04:21:47.522+0100 [conn1421327] end connection 172.28.0.164:62551 (398 connections now open) 2015-10-05T04:21:47.523+0100 [mongosMain] connection accepted from 172.28.0.164:64073 #1421743 (399 connections now open) 2015-10-05T04:21:47.524+0100 [mongosMain] connection accepted from 172.28.0.164:64074 #1421744 (400 connections now open) 2015-10-05T04:21:47.525+0100 [conn1421743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:47.525+0100 [conn1421744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:48.585+0100 [conn1421310] end connection 172.28.0.163:53045 (399 connections now open) 2015-10-05T04:21:48.586+0100 [mongosMain] connection accepted from 172.28.0.163:54653 #1421745 (400 connections now open) 2015-10-05T04:21:48.587+0100 [conn1421745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:53.638+0100 [conn1421306] end connection 172.28.0.164:62467 (399 connections now open) 2015-10-05T04:21:53.639+0100 [mongosMain] connection accepted from 172.28.0.164:64080 #1421746 (400 connections now open) 2015-10-05T04:21:53.641+0100 [conn1421746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:53.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecd15703b51053eb173b 2015-10-05T04:21:53.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:21:54.105+0100 [conn1421349] end connection 172.28.0.164:62601 (399 connections now open) 2015-10-05T04:21:54.106+0100 [mongosMain] connection accepted from 172.28.0.164:64082 #1421747 (400 connections now open) 2015-10-05T04:21:54.108+0100 [conn1421747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:54.591+0100 [conn1421332] end connection 172.28.0.163:53162 (399 connections now open) 2015-10-05T04:21:54.593+0100 [mongosMain] connection accepted from 172.28.0.163:54661 #1421748 (400 connections now open) 2015-10-05T04:21:54.594+0100 [conn1421748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:55.246+0100 [conn1421351] end connection 172.28.0.163:53189 (399 connections now open) 2015-10-05T04:21:55.247+0100 [mongosMain] connection accepted from 172.28.0.163:54664 #1421749 (400 connections now open) 2015-10-05T04:21:55.248+0100 [conn1421749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:21:57.538+0100 [conn1421303] end connection 172.28.0.164:62456 (399 connections now open) 2015-10-05T04:21:57.539+0100 [mongosMain] connection accepted from 172.28.0.164:64086 #1421750 (400 connections now open) 2015-10-05T04:21:57.540+0100 [conn1421750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:00.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecd75703b51053eb1755 2015-10-05T04:22:00.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:03.638+0100 [conn1421339] end connection 172.28.0.164:62576 (399 connections now open) 2015-10-05T04:22:03.639+0100 [mongosMain] connection accepted from 172.28.0.164:64101 #1421751 (400 connections now open) 2015-10-05T04:22:03.641+0100 [conn1421751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:04.105+0100 [conn1421356] end connection 172.28.0.164:62618 (399 connections now open) 2015-10-05T04:22:04.107+0100 [mongosMain] connection accepted from 172.28.0.164:64103 #1421752 (400 connections now open) 2015-10-05T04:22:04.108+0100 [conn1421752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:04.606+0100 [conn1421341] end connection 172.28.0.163:53172 (399 connections now open) 2015-10-05T04:22:04.607+0100 [mongosMain] connection accepted from 172.28.0.163:54699 #1421753 (400 connections now open) 2015-10-05T04:22:04.609+0100 [conn1421753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:05.246+0100 [conn1421358] end connection 172.28.0.163:53202 (399 connections now open) 2015-10-05T04:22:05.247+0100 [mongosMain] connection accepted from 172.28.0.163:54706 #1421754 (400 connections now open) 2015-10-05T04:22:05.248+0100 [conn1421754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:05.984+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:22:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:22:06.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecde5703b51053eb1783 2015-10-05T04:22:06.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:07.537+0100 [conn1421353] end connection 172.28.0.164:62606 (399 connections now open) 2015-10-05T04:22:07.537+0100 [conn1421168] end connection 172.28.0.164:61809 (398 connections now open) 2015-10-05T04:22:07.538+0100 [mongosMain] connection accepted from 172.28.0.164:64127 #1421755 (399 connections now open) 2015-10-05T04:22:07.539+0100 [mongosMain] connection accepted from 172.28.0.164:64126 #1421756 (400 connections now open) 2015-10-05T04:22:07.540+0100 [conn1421755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:07.540+0100 [conn1421756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:08.601+0100 [conn1421201] end connection 172.28.0.163:52524 (399 connections now open) 2015-10-05T04:22:08.601+0100 [conn1421336] end connection 172.28.0.163:53165 (398 connections now open) 2015-10-05T04:22:08.602+0100 [mongosMain] connection accepted from 172.28.0.163:54731 #1421757 (399 connections now open) 2015-10-05T04:22:08.602+0100 [mongosMain] connection accepted from 172.28.0.163:54732 #1421758 (400 connections now open) 2015-10-05T04:22:08.603+0100 [conn1421758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:08.604+0100 [conn1421757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:12.580+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ece45703b51053eb1797 2015-10-05T04:22:12.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:13.653+0100 [conn1421330] end connection 172.28.0.164:62560 (399 connections now open) 2015-10-05T04:22:13.654+0100 [mongosMain] connection accepted from 172.28.0.164:64162 #1421759 (400 connections now open) 2015-10-05T04:22:13.656+0100 [conn1421759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:14.121+0100 [conn1421363] end connection 172.28.0.164:62650 (399 connections now open) 2015-10-05T04:22:14.122+0100 [mongosMain] connection accepted from 172.28.0.164:64166 #1421760 (400 connections now open) 2015-10-05T04:22:14.124+0100 [conn1421760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:14.606+0100 [conn1421350] end connection 172.28.0.163:53185 (399 connections now open) 2015-10-05T04:22:14.607+0100 [mongosMain] connection accepted from 172.28.0.163:54761 #1421761 (400 connections now open) 2015-10-05T04:22:14.608+0100 [conn1421761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:15.261+0100 [conn1421365] end connection 172.28.0.163:53244 (399 connections now open) 2015-10-05T04:22:15.263+0100 [mongosMain] connection accepted from 172.28.0.163:54764 #1421762 (400 connections now open) 2015-10-05T04:22:15.264+0100 [conn1421762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:17.553+0100 [conn1421344] end connection 172.28.0.164:62585 (399 connections now open) 2015-10-05T04:22:17.554+0100 [mongosMain] connection accepted from 172.28.0.164:64170 #1421763 (400 connections now open) 2015-10-05T04:22:17.556+0100 [conn1421763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:17.573+0100 [conn1421334] end connection 172.28.0.164:62568 (399 connections now open) 2015-10-05T04:22:17.574+0100 [mongosMain] connection accepted from 172.28.0.164:64172 #1421764 (400 connections now open) 2015-10-05T04:22:17.575+0100 [conn1421764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:18.616+0100 [conn1421354] end connection 172.28.0.163:53194 (399 connections now open) 2015-10-05T04:22:18.617+0100 [conn1421346] end connection 172.28.0.163:53177 (398 connections now open) 2015-10-05T04:22:18.618+0100 [mongosMain] connection accepted from 172.28.0.163:54768 #1421765 (399 connections now open) 2015-10-05T04:22:18.619+0100 [mongosMain] connection accepted from 172.28.0.163:54769 #1421766 (400 connections now open) 2015-10-05T04:22:18.619+0100 [conn1421765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:18.620+0100 [conn1421766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:18.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecea5703b51053eb17b3 2015-10-05T04:22:19.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:24.121+0100 [conn1421369] end connection 172.28.0.164:62701 (399 connections now open) 2015-10-05T04:22:24.122+0100 [mongosMain] connection accepted from 172.28.0.164:64182 #1421767 (400 connections now open) 2015-10-05T04:22:24.123+0100 [conn1421767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:24.622+0100 [conn1421357] end connection 172.28.0.163:53201 (399 connections now open) 2015-10-05T04:22:24.623+0100 [mongosMain] connection accepted from 172.28.0.163:54774 #1421768 (400 connections now open) 2015-10-05T04:22:24.624+0100 [conn1421768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:25.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecf15703b51053eb17ce 2015-10-05T04:22:25.277+0100 [conn1421371] end connection 172.28.0.163:53291 (399 connections now open) 2015-10-05T04:22:25.278+0100 [mongosMain] connection accepted from 172.28.0.163:54775 #1421769 (400 connections now open) 2015-10-05T04:22:25.279+0100 [conn1421769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:25.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:27.553+0100 [conn1421319] end connection 172.28.0.164:62511 (399 connections now open) 2015-10-05T04:22:27.553+0100 [conn1421366] end connection 172.28.0.164:62680 (399 connections now open) 2015-10-05T04:22:27.554+0100 [mongosMain] connection accepted from 172.28.0.164:64188 #1421770 (399 connections now open) 2015-10-05T04:22:27.554+0100 [mongosMain] connection accepted from 172.28.0.164:64189 #1421771 (400 connections now open) 2015-10-05T04:22:27.557+0100 [conn1421770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:27.557+0100 [conn1421771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:28.632+0100 [conn1421337] end connection 172.28.0.163:53168 (399 connections now open) 2015-10-05T04:22:28.632+0100 [conn1421328] end connection 172.28.0.163:53155 (399 connections now open) 2015-10-05T04:22:28.634+0100 [mongosMain] connection accepted from 172.28.0.163:54777 #1421772 (399 connections now open) 2015-10-05T04:22:28.634+0100 [mongosMain] connection accepted from 172.28.0.163:54778 #1421773 (400 connections now open) 2015-10-05T04:22:28.635+0100 [conn1421772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:28.635+0100 [conn1421773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:29.176+0100 [mongosMain] connection accepted from 127.0.0.1:54781 #1421774 (401 connections now open) 2015-10-05T04:22:29.179+0100 [conn1421774] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:29.185+0100 [conn1421774] end connection 127.0.0.1:54781 (400 connections now open) 2015-10-05T04:22:31.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecf75703b51053eb17ed 2015-10-05T04:22:31.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:34.137+0100 [conn1421376] end connection 172.28.0.164:62730 (399 connections now open) 2015-10-05T04:22:34.138+0100 [mongosMain] connection accepted from 172.28.0.164:64198 #1421775 (400 connections now open) 2015-10-05T04:22:34.140+0100 [conn1421775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:34.624+0100 [conn1421364] end connection 172.28.0.163:53235 (399 connections now open) 2015-10-05T04:22:34.625+0100 [mongosMain] connection accepted from 172.28.0.163:54783 #1421776 (400 connections now open) 2015-10-05T04:22:34.626+0100 [conn1421776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:35.279+0100 [conn1421378] end connection 172.28.0.163:53313 (399 connections now open) 2015-10-05T04:22:35.280+0100 [mongosMain] connection accepted from 172.28.0.163:54785 #1421777 (400 connections now open) 2015-10-05T04:22:35.281+0100 [conn1421777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:36.127+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:22:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:22:37.568+0100 [conn1421359] end connection 172.28.0.164:62624 (399 connections now open) 2015-10-05T04:22:37.570+0100 [mongosMain] connection accepted from 172.28.0.164:64205 #1421778 (400 connections now open) 2015-10-05T04:22:37.571+0100 [conn1421778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:37.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ecfd5703b51053eb1804 2015-10-05T04:22:37.931+0100 [conn1421343] end connection 172.28.0.164:62586 (399 connections now open) 2015-10-05T04:22:37.936+0100 [mongosMain] connection accepted from 172.28.0.164:64207 #1421779 (400 connections now open) 2015-10-05T04:22:37.938+0100 [conn1421779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:37.975+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:38.633+0100 [conn1421374] end connection 172.28.0.163:53306 (399 connections now open) 2015-10-05T04:22:38.634+0100 [conn1421320] end connection 172.28.0.163:53107 (398 connections now open) 2015-10-05T04:22:38.635+0100 [mongosMain] connection accepted from 172.28.0.163:54787 #1421780 (399 connections now open) 2015-10-05T04:22:38.635+0100 [mongosMain] connection accepted from 172.28.0.163:54788 #1421781 (400 connections now open) 2015-10-05T04:22:38.636+0100 [conn1421780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:38.637+0100 [conn1421781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:40.110+0100 [mongosMain] connection accepted from 127.0.0.1:54791 #1421782 (401 connections now open) 2015-10-05T04:22:40.112+0100 [conn1421782] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:40.116+0100 [conn1421782] end connection 127.0.0.1:54791 (400 connections now open) 2015-10-05T04:22:43.685+0100 [conn1421355] end connection 172.28.0.164:62615 (399 connections now open) 2015-10-05T04:22:43.686+0100 [mongosMain] connection accepted from 172.28.0.164:64214 #1421783 (400 connections now open) 2015-10-05T04:22:43.687+0100 [conn1421783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:44.153+0100 [conn1421385] end connection 172.28.0.164:62748 (399 connections now open) 2015-10-05T04:22:44.154+0100 [mongosMain] connection accepted from 172.28.0.164:64217 #1421784 (400 connections now open) 2015-10-05T04:22:44.155+0100 [conn1421784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:44.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed035703b51053eb1825 2015-10-05T04:22:44.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:44.638+0100 [conn1421370] end connection 172.28.0.163:53288 (399 connections now open) 2015-10-05T04:22:44.639+0100 [mongosMain] connection accepted from 172.28.0.163:54797 #1421785 (400 connections now open) 2015-10-05T04:22:44.640+0100 [conn1421785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:45.293+0100 [conn1421387] end connection 172.28.0.163:53323 (399 connections now open) 2015-10-05T04:22:45.294+0100 [mongosMain] connection accepted from 172.28.0.163:54798 #1421786 (400 connections now open) 2015-10-05T04:22:45.295+0100 [conn1421786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:47.569+0100 [conn1421335] end connection 172.28.0.164:62569 (399 connections now open) 2015-10-05T04:22:47.569+0100 [conn1421352] end connection 172.28.0.164:62607 (398 connections now open) 2015-10-05T04:22:47.570+0100 [mongosMain] connection accepted from 172.28.0.164:64224 #1421787 (399 connections now open) 2015-10-05T04:22:47.570+0100 [mongosMain] connection accepted from 172.28.0.164:64225 #1421788 (400 connections now open) 2015-10-05T04:22:47.572+0100 [conn1421787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:47.572+0100 [conn1421788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:48.648+0100 [conn1421329] end connection 172.28.0.163:53156 (399 connections now open) 2015-10-05T04:22:48.648+0100 [conn1421382] end connection 172.28.0.163:53316 (399 connections now open) 2015-10-05T04:22:48.649+0100 [mongosMain] connection accepted from 172.28.0.163:54804 #1421789 (399 connections now open) 2015-10-05T04:22:48.650+0100 [mongosMain] connection accepted from 172.28.0.163:54805 #1421790 (400 connections now open) 2015-10-05T04:22:48.651+0100 [conn1421789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:48.651+0100 [conn1421790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:50.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed0a5703b51053eb1836 2015-10-05T04:22:50.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:53.700+0100 [conn1421348] end connection 172.28.0.164:62598 (399 connections now open) 2015-10-05T04:22:53.701+0100 [mongosMain] connection accepted from 172.28.0.164:64231 #1421791 (400 connections now open) 2015-10-05T04:22:53.702+0100 [conn1421791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:54.168+0100 [conn1421394] end connection 172.28.0.164:62768 (399 connections now open) 2015-10-05T04:22:54.170+0100 [mongosMain] connection accepted from 172.28.0.164:64234 #1421792 (400 connections now open) 2015-10-05T04:22:54.171+0100 [conn1421792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:54.653+0100 [conn1421377] end connection 172.28.0.163:53311 (399 connections now open) 2015-10-05T04:22:54.654+0100 [mongosMain] connection accepted from 172.28.0.163:54812 #1421793 (400 connections now open) 2015-10-05T04:22:54.655+0100 [conn1421793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:55.294+0100 [conn1421396] end connection 172.28.0.163:53339 (399 connections now open) 2015-10-05T04:22:55.295+0100 [mongosMain] connection accepted from 172.28.0.163:54816 #1421794 (400 connections now open) 2015-10-05T04:22:55.296+0100 [conn1421794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:56.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed105703b51053eb186a 2015-10-05T04:22:56.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:22:57.584+0100 [conn1421373] end connection 172.28.0.164:62708 (399 connections now open) 2015-10-05T04:22:57.585+0100 [conn1421372] end connection 172.28.0.164:62707 (398 connections now open) 2015-10-05T04:22:57.586+0100 [mongosMain] connection accepted from 172.28.0.164:64240 #1421795 (399 connections now open) 2015-10-05T04:22:57.587+0100 [mongosMain] connection accepted from 172.28.0.164:64241 #1421796 (400 connections now open) 2015-10-05T04:22:57.588+0100 [conn1421795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:57.588+0100 [conn1421796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:58.649+0100 [conn1421390] end connection 172.28.0.163:53325 (399 connections now open) 2015-10-05T04:22:58.649+0100 [conn1421345] end connection 172.28.0.163:53176 (398 connections now open) 2015-10-05T04:22:58.649+0100 [mongosMain] connection accepted from 172.28.0.163:54819 #1421797 (399 connections now open) 2015-10-05T04:22:58.650+0100 [mongosMain] connection accepted from 172.28.0.163:54820 #1421798 (400 connections now open) 2015-10-05T04:22:58.650+0100 [conn1421797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:22:58.651+0100 [conn1421798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:03.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed165703b51053eb1890 2015-10-05T04:23:03.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:03.716+0100 [conn1421362] end connection 172.28.0.164:62645 (399 connections now open) 2015-10-05T04:23:03.718+0100 [mongosMain] connection accepted from 172.28.0.164:64254 #1421799 (400 connections now open) 2015-10-05T04:23:03.720+0100 [conn1421799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:04.169+0100 [conn1421402] end connection 172.28.0.164:62786 (399 connections now open) 2015-10-05T04:23:04.170+0100 [mongosMain] connection accepted from 172.28.0.164:64258 #1421800 (400 connections now open) 2015-10-05T04:23:04.172+0100 [conn1421800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:04.655+0100 [conn1421395] end connection 172.28.0.163:53335 (399 connections now open) 2015-10-05T04:23:04.655+0100 [mongosMain] connection accepted from 172.28.0.163:54851 #1421801 (400 connections now open) 2015-10-05T04:23:04.657+0100 [conn1421801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:05.309+0100 [conn1421404] end connection 172.28.0.163:53358 (399 connections now open) 2015-10-05T04:23:05.310+0100 [mongosMain] connection accepted from 172.28.0.163:54857 #1421802 (400 connections now open) 2015-10-05T04:23:05.312+0100 [conn1421802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:06.286+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:23:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:23:07.601+0100 [conn1421360] end connection 172.28.0.164:62625 (399 connections now open) 2015-10-05T04:23:07.602+0100 [conn1421388] end connection 172.28.0.164:62757 (398 connections now open) 2015-10-05T04:23:07.603+0100 [mongosMain] connection accepted from 172.28.0.164:64282 #1421803 (399 connections now open) 2015-10-05T04:23:07.603+0100 [mongosMain] connection accepted from 172.28.0.164:64283 #1421804 (400 connections now open) 2015-10-05T04:23:07.605+0100 [conn1421803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:07.606+0100 [conn1421804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:08.664+0100 [conn1421375] end connection 172.28.0.163:53307 (399 connections now open) 2015-10-05T04:23:08.665+0100 [mongosMain] connection accepted from 172.28.0.163:54884 #1421805 (400 connections now open) 2015-10-05T04:23:08.666+0100 [conn1421805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:09.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed1d5703b51053eb18c7 2015-10-05T04:23:09.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:13.717+0100 [conn1421384] end connection 172.28.0.164:62746 (399 connections now open) 2015-10-05T04:23:13.718+0100 [mongosMain] connection accepted from 172.28.0.164:64312 #1421806 (400 connections now open) 2015-10-05T04:23:13.719+0100 [conn1421806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:14.183+0100 [conn1421409] end connection 172.28.0.164:62815 (399 connections now open) 2015-10-05T04:23:14.184+0100 [mongosMain] connection accepted from 172.28.0.164:64314 #1421807 (400 connections now open) 2015-10-05T04:23:14.186+0100 [conn1421807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:14.669+0100 [conn1421386] end connection 172.28.0.163:53321 (399 connections now open) 2015-10-05T04:23:14.670+0100 [mongosMain] connection accepted from 172.28.0.163:54907 #1421808 (400 connections now open) 2015-10-05T04:23:14.671+0100 [conn1421808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:15.309+0100 [conn1421411] end connection 172.28.0.163:53397 (399 connections now open) 2015-10-05T04:23:15.310+0100 [mongosMain] connection accepted from 172.28.0.163:54909 #1421809 (400 connections now open) 2015-10-05T04:23:15.311+0100 [conn1421809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:15.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed235703b51053eb18de 2015-10-05T04:23:15.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:17.616+0100 [conn1421380] end connection 172.28.0.164:62737 (399 connections now open) 2015-10-05T04:23:17.616+0100 [conn1421412] end connection 172.28.0.164:62834 (398 connections now open) 2015-10-05T04:23:17.618+0100 [mongosMain] connection accepted from 172.28.0.164:64318 #1421810 (399 connections now open) 2015-10-05T04:23:17.618+0100 [mongosMain] connection accepted from 172.28.0.164:64319 #1421811 (400 connections now open) 2015-10-05T04:23:17.620+0100 [conn1421810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:17.620+0100 [conn1421811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:18.664+0100 [conn1421381] end connection 172.28.0.163:53315 (399 connections now open) 2015-10-05T04:23:18.664+0100 [conn1421406] end connection 172.28.0.163:53363 (399 connections now open) 2015-10-05T04:23:18.665+0100 [mongosMain] connection accepted from 172.28.0.163:54913 #1421812 (399 connections now open) 2015-10-05T04:23:18.665+0100 [mongosMain] connection accepted from 172.28.0.163:54914 #1421813 (400 connections now open) 2015-10-05T04:23:18.666+0100 [conn1421812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:18.666+0100 [conn1421813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:22.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed295703b51053eb18ef 2015-10-05T04:23:22.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:23.716+0100 [conn1421393] end connection 172.28.0.164:62766 (399 connections now open) 2015-10-05T04:23:23.718+0100 [mongosMain] connection accepted from 172.28.0.164:64327 #1421814 (400 connections now open) 2015-10-05T04:23:23.720+0100 [conn1421814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:24.183+0100 [conn1421417] end connection 172.28.0.164:62866 (399 connections now open) 2015-10-05T04:23:24.184+0100 [mongosMain] connection accepted from 172.28.0.164:64330 #1421815 (400 connections now open) 2015-10-05T04:23:24.185+0100 [conn1421815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:24.669+0100 [conn1421410] end connection 172.28.0.163:53390 (399 connections now open) 2015-10-05T04:23:24.670+0100 [mongosMain] connection accepted from 172.28.0.163:54919 #1421816 (400 connections now open) 2015-10-05T04:23:24.671+0100 [conn1421816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:25.324+0100 [conn1421419] end connection 172.28.0.163:53449 (399 connections now open) 2015-10-05T04:23:25.325+0100 [mongosMain] connection accepted from 172.28.0.163:54921 #1421817 (400 connections now open) 2015-10-05T04:23:25.327+0100 [conn1421817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:27.632+0100 [conn1421379] end connection 172.28.0.164:62736 (399 connections now open) 2015-10-05T04:23:27.632+0100 [conn1421413] end connection 172.28.0.164:62835 (399 connections now open) 2015-10-05T04:23:27.633+0100 [mongosMain] connection accepted from 172.28.0.164:64338 #1421818 (399 connections now open) 2015-10-05T04:23:27.633+0100 [mongosMain] connection accepted from 172.28.0.164:64337 #1421819 (400 connections now open) 2015-10-05T04:23:27.634+0100 [conn1421818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:27.635+0100 [conn1421819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:28.485+0100 [mongosMain] connection accepted from 127.0.0.1:54923 #1421820 (401 connections now open) 2015-10-05T04:23:28.488+0100 [conn1421820] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:28.494+0100 [conn1421820] end connection 127.0.0.1:54923 (400 connections now open) 2015-10-05T04:23:28.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed305703b51053eb190e 2015-10-05T04:23:28.679+0100 [conn1421399] end connection 172.28.0.163:53347 (399 connections now open) 2015-10-05T04:23:28.679+0100 [conn1421407] end connection 172.28.0.163:53364 (398 connections now open) 2015-10-05T04:23:28.680+0100 [mongosMain] connection accepted from 172.28.0.163:54924 #1421821 (399 connections now open) 2015-10-05T04:23:28.681+0100 [mongosMain] connection accepted from 172.28.0.163:54925 #1421822 (400 connections now open) 2015-10-05T04:23:28.681+0100 [conn1421821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:28.682+0100 [conn1421822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:28.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:33.732+0100 [conn1421401] end connection 172.28.0.164:62784 (399 connections now open) 2015-10-05T04:23:33.733+0100 [mongosMain] connection accepted from 172.28.0.164:64344 #1421823 (400 connections now open) 2015-10-05T04:23:33.735+0100 [conn1421823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:34.200+0100 [conn1421425] end connection 172.28.0.164:62884 (399 connections now open) 2015-10-05T04:23:34.202+0100 [mongosMain] connection accepted from 172.28.0.164:64348 #1421824 (400 connections now open) 2015-10-05T04:23:34.204+0100 [conn1421824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:34.684+0100 [conn1421403] end connection 172.28.0.163:53354 (399 connections now open) 2015-10-05T04:23:34.686+0100 [mongosMain] connection accepted from 172.28.0.163:54928 #1421825 (400 connections now open) 2015-10-05T04:23:34.687+0100 [conn1421825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:35.325+0100 [conn1421427] end connection 172.28.0.163:53460 (399 connections now open) 2015-10-05T04:23:35.327+0100 [mongosMain] connection accepted from 172.28.0.163:54930 #1421826 (400 connections now open) 2015-10-05T04:23:35.328+0100 [conn1421826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:36.450+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:23:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:23:37.647+0100 [conn1421398] end connection 172.28.0.164:62777 (399 connections now open) 2015-10-05T04:23:37.647+0100 [conn1421397] end connection 172.28.0.164:62776 (398 connections now open) 2015-10-05T04:23:37.648+0100 [mongosMain] connection accepted from 172.28.0.164:64355 #1421827 (399 connections now open) 2015-10-05T04:23:37.649+0100 [mongosMain] connection accepted from 172.28.0.164:64356 #1421828 (400 connections now open) 2015-10-05T04:23:37.650+0100 [conn1421827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:37.650+0100 [conn1421828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:38.680+0100 [conn1421361] end connection 172.28.0.163:53209 (399 connections now open) 2015-10-05T04:23:38.681+0100 [conn1421415] end connection 172.28.0.163:53416 (398 connections now open) 2015-10-05T04:23:38.681+0100 [mongosMain] connection accepted from 172.28.0.163:54934 #1421829 (399 connections now open) 2015-10-05T04:23:38.682+0100 [mongosMain] connection accepted from 172.28.0.163:54935 #1421830 (400 connections now open) 2015-10-05T04:23:38.683+0100 [conn1421829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:38.683+0100 [conn1421830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:39.987+0100 [mongosMain] connection accepted from 127.0.0.1:54938 #1421831 (401 connections now open) 2015-10-05T04:23:39.990+0100 [conn1421831] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:39.995+0100 [conn1421831] end connection 127.0.0.1:54938 (400 connections now open) 2015-10-05T04:23:41.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed3c5703b51053eb1935 2015-10-05T04:23:41.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:43.732+0100 [conn1421408] end connection 172.28.0.164:62810 (399 connections now open) 2015-10-05T04:23:43.733+0100 [mongosMain] connection accepted from 172.28.0.164:64364 #1421832 (400 connections now open) 2015-10-05T04:23:43.735+0100 [conn1421832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:44.200+0100 [conn1421434] end connection 172.28.0.164:62900 (399 connections now open) 2015-10-05T04:23:44.201+0100 [mongosMain] connection accepted from 172.28.0.164:64367 #1421833 (400 connections now open) 2015-10-05T04:23:44.203+0100 [conn1421833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:44.685+0100 [conn1421418] end connection 172.28.0.163:53446 (399 connections now open) 2015-10-05T04:23:44.686+0100 [mongosMain] connection accepted from 172.28.0.163:54944 #1421834 (400 connections now open) 2015-10-05T04:23:44.687+0100 [conn1421834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:45.340+0100 [conn1421436] end connection 172.28.0.163:53470 (399 connections now open) 2015-10-05T04:23:45.341+0100 [mongosMain] connection accepted from 172.28.0.163:54946 #1421835 (400 connections now open) 2015-10-05T04:23:45.342+0100 [conn1421835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:47.663+0100 [conn1421420] end connection 172.28.0.164:62872 (399 connections now open) 2015-10-05T04:23:47.664+0100 [conn1421326] end connection 172.28.0.164:62550 (398 connections now open) 2015-10-05T04:23:47.665+0100 [mongosMain] connection accepted from 172.28.0.164:64373 #1421836 (399 connections now open) 2015-10-05T04:23:47.665+0100 [mongosMain] connection accepted from 172.28.0.164:64374 #1421837 (400 connections now open) 2015-10-05T04:23:47.667+0100 [conn1421836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:47.667+0100 [conn1421837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:48.695+0100 [conn1421423] end connection 172.28.0.163:53454 (399 connections now open) 2015-10-05T04:23:48.695+0100 [conn1421414] end connection 172.28.0.163:53415 (398 connections now open) 2015-10-05T04:23:48.697+0100 [mongosMain] connection accepted from 172.28.0.163:54954 #1421838 (399 connections now open) 2015-10-05T04:23:48.697+0100 [mongosMain] connection accepted from 172.28.0.163:54955 #1421839 (400 connections now open) 2015-10-05T04:23:48.698+0100 [conn1421838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:48.698+0100 [conn1421839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:53.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed495703b51053eb195f 2015-10-05T04:23:53.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:23:53.747+0100 [conn1421416] end connection 172.28.0.164:62864 (399 connections now open) 2015-10-05T04:23:53.749+0100 [mongosMain] connection accepted from 172.28.0.164:64381 #1421840 (400 connections now open) 2015-10-05T04:23:53.750+0100 [conn1421840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:54.216+0100 [conn1421443] end connection 172.28.0.164:62922 (399 connections now open) 2015-10-05T04:23:54.217+0100 [mongosMain] connection accepted from 172.28.0.164:64384 #1421841 (400 connections now open) 2015-10-05T04:23:54.219+0100 [conn1421841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:55.356+0100 [conn1421445] end connection 172.28.0.163:53485 (399 connections now open) 2015-10-05T04:23:55.358+0100 [mongosMain] connection accepted from 172.28.0.163:54966 #1421842 (400 connections now open) 2015-10-05T04:23:55.359+0100 [conn1421842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:55.560+0100 [conn1421426] end connection 172.28.0.163:53458 (399 connections now open) 2015-10-05T04:23:55.561+0100 [mongosMain] connection accepted from 172.28.0.163:54968 #1421843 (400 connections now open) 2015-10-05T04:23:55.562+0100 [conn1421843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:57.665+0100 [conn1421389] end connection 172.28.0.164:62758 (399 connections now open) 2015-10-05T04:23:57.665+0100 [conn1421428] end connection 172.28.0.164:62890 (399 connections now open) 2015-10-05T04:23:57.666+0100 [mongosMain] connection accepted from 172.28.0.164:64388 #1421844 (399 connections now open) 2015-10-05T04:23:57.667+0100 [mongosMain] connection accepted from 172.28.0.164:64389 #1421845 (400 connections now open) 2015-10-05T04:23:57.668+0100 [conn1421844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:57.668+0100 [conn1421845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:58.710+0100 [conn1421431] end connection 172.28.0.163:53464 (399 connections now open) 2015-10-05T04:23:58.711+0100 [mongosMain] connection accepted from 172.28.0.163:54971 #1421846 (400 connections now open) 2015-10-05T04:23:58.712+0100 [conn1421846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:23:58.718+0100 [conn1421391] end connection 172.28.0.163:53326 (399 connections now open) 2015-10-05T04:23:58.718+0100 [mongosMain] connection accepted from 172.28.0.163:54974 #1421847 (400 connections now open) 2015-10-05T04:23:58.719+0100 [conn1421847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:03.748+0100 [conn1421424] end connection 172.28.0.164:62881 (399 connections now open) 2015-10-05T04:24:03.749+0100 [mongosMain] connection accepted from 172.28.0.164:64408 #1421848 (400 connections now open) 2015-10-05T04:24:03.751+0100 [conn1421848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:04.216+0100 [conn1421451] end connection 172.28.0.164:62937 (399 connections now open) 2015-10-05T04:24:04.217+0100 [mongosMain] connection accepted from 172.28.0.164:64412 #1421849 (400 connections now open) 2015-10-05T04:24:04.218+0100 [conn1421849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:04.717+0100 [conn1421444] end connection 172.28.0.163:53482 (399 connections now open) 2015-10-05T04:24:04.718+0100 [mongosMain] connection accepted from 172.28.0.163:54996 #1421850 (400 connections now open) 2015-10-05T04:24:04.719+0100 [conn1421850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:05.356+0100 [conn1421453] end connection 172.28.0.163:53503 (399 connections now open) 2015-10-05T04:24:05.357+0100 [mongosMain] connection accepted from 172.28.0.163:55002 #1421851 (400 connections now open) 2015-10-05T04:24:05.358+0100 [conn1421851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:05.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed555703b51053eb19a4 2015-10-05T04:24:06.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:06.721+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:24:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:24:07.678+0100 [conn1421454] end connection 172.28.0.164:62943 (399 connections now open) 2015-10-05T04:24:07.679+0100 [conn1421251] end connection 172.28.0.164:62103 (398 connections now open) 2015-10-05T04:24:07.680+0100 [mongosMain] connection accepted from 172.28.0.164:64434 #1421852 (399 connections now open) 2015-10-05T04:24:07.680+0100 [mongosMain] connection accepted from 172.28.0.164:64436 #1421853 (400 connections now open) 2015-10-05T04:24:07.681+0100 [conn1421852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:07.682+0100 [conn1421853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:08.712+0100 [conn1421457] end connection 172.28.0.163:53510 (399 connections now open) 2015-10-05T04:24:08.713+0100 [conn1421430] end connection 172.28.0.163:53463 (398 connections now open) 2015-10-05T04:24:08.714+0100 [mongosMain] connection accepted from 172.28.0.163:55024 #1421854 (399 connections now open) 2015-10-05T04:24:08.714+0100 [mongosMain] connection accepted from 172.28.0.163:55025 #1421855 (400 connections now open) 2015-10-05T04:24:08.715+0100 [conn1421854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:08.715+0100 [conn1421855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:12.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed5c5703b51053eb19b3 2015-10-05T04:24:12.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:13.764+0100 [conn1421433] end connection 172.28.0.164:62898 (399 connections now open) 2015-10-05T04:24:13.765+0100 [mongosMain] connection accepted from 172.28.0.164:64463 #1421856 (400 connections now open) 2015-10-05T04:24:13.766+0100 [conn1421856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:14.232+0100 [conn1421459] end connection 172.28.0.164:62962 (399 connections now open) 2015-10-05T04:24:14.233+0100 [mongosMain] connection accepted from 172.28.0.164:64465 #1421857 (400 connections now open) 2015-10-05T04:24:14.235+0100 [conn1421857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:14.717+0100 [conn1421435] end connection 172.28.0.163:53468 (399 connections now open) 2015-10-05T04:24:14.719+0100 [mongosMain] connection accepted from 172.28.0.163:55052 #1421858 (400 connections now open) 2015-10-05T04:24:14.720+0100 [conn1421858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:15.372+0100 [conn1421461] end connection 172.28.0.163:53542 (399 connections now open) 2015-10-05T04:24:15.374+0100 [mongosMain] connection accepted from 172.28.0.163:55055 #1421859 (400 connections now open) 2015-10-05T04:24:15.375+0100 [conn1421859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:17.695+0100 [conn1421446] end connection 172.28.0.164:62927 (399 connections now open) 2015-10-05T04:24:17.696+0100 [conn1421447] end connection 172.28.0.164:62928 (398 connections now open) 2015-10-05T04:24:17.697+0100 [mongosMain] connection accepted from 172.28.0.164:64470 #1421860 (399 connections now open) 2015-10-05T04:24:17.698+0100 [mongosMain] connection accepted from 172.28.0.164:64471 #1421861 (400 connections now open) 2015-10-05T04:24:17.699+0100 [conn1421860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:17.700+0100 [conn1421861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:18.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed625703b51053eb19c1 2015-10-05T04:24:18.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:18.726+0100 [conn1421439] end connection 172.28.0.163:53473 (399 connections now open) 2015-10-05T04:24:18.727+0100 [mongosMain] connection accepted from 172.28.0.163:55059 #1421862 (400 connections now open) 2015-10-05T04:24:18.728+0100 [conn1421862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:23.764+0100 [conn1421466] end connection 172.28.0.164:63009 (399 connections now open) 2015-10-05T04:24:23.765+0100 [mongosMain] connection accepted from 172.28.0.164:64480 #1421863 (400 connections now open) 2015-10-05T04:24:23.766+0100 [conn1421863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:24.231+0100 [conn1421467] end connection 172.28.0.164:63011 (399 connections now open) 2015-10-05T04:24:24.232+0100 [mongosMain] connection accepted from 172.28.0.164:64484 #1421864 (400 connections now open) 2015-10-05T04:24:24.235+0100 [conn1421864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:24.732+0100 [conn1421460] end connection 172.28.0.163:53538 (399 connections now open) 2015-10-05T04:24:24.734+0100 [mongosMain] connection accepted from 172.28.0.163:55063 #1421865 (400 connections now open) 2015-10-05T04:24:24.735+0100 [conn1421865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:24.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed685703b51053eb19ca 2015-10-05T04:24:25.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:25.372+0100 [conn1421469] end connection 172.28.0.163:53613 (399 connections now open) 2015-10-05T04:24:25.374+0100 [mongosMain] connection accepted from 172.28.0.163:55065 #1421866 (400 connections now open) 2015-10-05T04:24:25.375+0100 [conn1421866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:27.710+0100 [conn1421437] end connection 172.28.0.164:62908 (399 connections now open) 2015-10-05T04:24:27.711+0100 [conn1421429] end connection 172.28.0.164:62891 (398 connections now open) 2015-10-05T04:24:27.711+0100 [mongosMain] connection accepted from 172.28.0.164:64490 #1421867 (399 connections now open) 2015-10-05T04:24:27.712+0100 [mongosMain] connection accepted from 172.28.0.164:64491 #1421868 (400 connections now open) 2015-10-05T04:24:27.713+0100 [conn1421867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:27.714+0100 [conn1421868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:28.255+0100 [mongosMain] connection accepted from 127.0.0.1:55067 #1421869 (401 connections now open) 2015-10-05T04:24:28.258+0100 [conn1421869] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:28.263+0100 [conn1421869] end connection 127.0.0.1:55067 (400 connections now open) 2015-10-05T04:24:28.727+0100 [conn1421465] end connection 172.28.0.163:53569 (399 connections now open) 2015-10-05T04:24:28.729+0100 [mongosMain] connection accepted from 172.28.0.163:55068 #1421870 (400 connections now open) 2015-10-05T04:24:28.730+0100 [conn1421870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:31.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed6f5703b51053eb19d8 2015-10-05T04:24:31.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:33.779+0100 [conn1421442] end connection 172.28.0.164:62919 (399 connections now open) 2015-10-05T04:24:33.781+0100 [mongosMain] connection accepted from 172.28.0.164:64498 #1421871 (400 connections now open) 2015-10-05T04:24:33.783+0100 [conn1421871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:34.248+0100 [conn1421475] end connection 172.28.0.164:63036 (399 connections now open) 2015-10-05T04:24:34.249+0100 [mongosMain] connection accepted from 172.28.0.164:64502 #1421872 (400 connections now open) 2015-10-05T04:24:34.250+0100 [conn1421872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:34.732+0100 [conn1421468] end connection 172.28.0.163:53607 (399 connections now open) 2015-10-05T04:24:34.733+0100 [mongosMain] connection accepted from 172.28.0.163:55071 #1421873 (400 connections now open) 2015-10-05T04:24:34.734+0100 [conn1421873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:35.387+0100 [conn1421477] end connection 172.28.0.163:53626 (399 connections now open) 2015-10-05T04:24:35.388+0100 [mongosMain] connection accepted from 172.28.0.163:55073 #1421874 (400 connections now open) 2015-10-05T04:24:35.389+0100 [conn1421874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:36.860+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:24:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:24:37.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed755703b51053eb19ec 2015-10-05T04:24:37.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:37.726+0100 [conn1421405] end connection 172.28.0.164:62790 (399 connections now open) 2015-10-05T04:24:37.727+0100 [conn1421463] end connection 172.28.0.164:62983 (398 connections now open) 2015-10-05T04:24:37.727+0100 [mongosMain] connection accepted from 172.28.0.164:64509 #1421875 (399 connections now open) 2015-10-05T04:24:37.728+0100 [mongosMain] connection accepted from 172.28.0.164:64510 #1421876 (400 connections now open) 2015-10-05T04:24:37.729+0100 [conn1421875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:37.729+0100 [conn1421876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:38.742+0100 [conn1421449] end connection 172.28.0.163:53492 (399 connections now open) 2015-10-05T04:24:38.742+0100 [conn1421400] end connection 172.28.0.163:53346 (398 connections now open) 2015-10-05T04:24:38.743+0100 [mongosMain] connection accepted from 172.28.0.163:55075 #1421877 (399 connections now open) 2015-10-05T04:24:38.743+0100 [mongosMain] connection accepted from 172.28.0.163:55076 #1421878 (400 connections now open) 2015-10-05T04:24:38.744+0100 [conn1421877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:38.744+0100 [conn1421878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:39.938+0100 [mongosMain] connection accepted from 127.0.0.1:55079 #1421879 (401 connections now open) 2015-10-05T04:24:39.941+0100 [conn1421879] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:39.945+0100 [conn1421879] end connection 127.0.0.1:55079 (400 connections now open) 2015-10-05T04:24:43.796+0100 [conn1421450] end connection 172.28.0.164:62935 (399 connections now open) 2015-10-05T04:24:43.797+0100 [mongosMain] connection accepted from 172.28.0.164:64517 #1421880 (400 connections now open) 2015-10-05T04:24:43.799+0100 [conn1421880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:43.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed7b5703b51053eb1a00 2015-10-05T04:24:43.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:44.263+0100 [conn1421484] end connection 172.28.0.164:63054 (399 connections now open) 2015-10-05T04:24:44.264+0100 [mongosMain] connection accepted from 172.28.0.164:64519 #1421881 (400 connections now open) 2015-10-05T04:24:44.266+0100 [conn1421881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:44.748+0100 [conn1421452] end connection 172.28.0.163:53501 (399 connections now open) 2015-10-05T04:24:44.749+0100 [mongosMain] connection accepted from 172.28.0.163:55086 #1421882 (400 connections now open) 2015-10-05T04:24:44.751+0100 [conn1421882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:45.388+0100 [conn1421486] end connection 172.28.0.163:53638 (399 connections now open) 2015-10-05T04:24:45.389+0100 [mongosMain] connection accepted from 172.28.0.163:55088 #1421883 (400 connections now open) 2015-10-05T04:24:45.391+0100 [conn1421883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:47.741+0100 [conn1421471] end connection 172.28.0.164:63018 (399 connections now open) 2015-10-05T04:24:47.742+0100 [conn1421438] end connection 172.28.0.164:62907 (398 connections now open) 2015-10-05T04:24:47.743+0100 [mongosMain] connection accepted from 172.28.0.164:64526 #1421884 (399 connections now open) 2015-10-05T04:24:47.744+0100 [mongosMain] connection accepted from 172.28.0.164:64527 #1421885 (400 connections now open) 2015-10-05T04:24:47.745+0100 [conn1421884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:47.746+0100 [conn1421885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:48.743+0100 [conn1421481] end connection 172.28.0.163:53629 (399 connections now open) 2015-10-05T04:24:48.743+0100 [conn1421473] end connection 172.28.0.163:53618 (398 connections now open) 2015-10-05T04:24:48.744+0100 [mongosMain] connection accepted from 172.28.0.163:55096 #1421886 (399 connections now open) 2015-10-05T04:24:48.744+0100 [mongosMain] connection accepted from 172.28.0.163:55097 #1421887 (400 connections now open) 2015-10-05T04:24:48.745+0100 [conn1421887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:48.745+0100 [conn1421886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:50.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed815703b51053eb1a17 2015-10-05T04:24:50.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:54.263+0100 [conn1421493] end connection 172.28.0.164:63073 (399 connections now open) 2015-10-05T04:24:54.265+0100 [mongosMain] connection accepted from 172.28.0.164:64536 #1421888 (400 connections now open) 2015-10-05T04:24:54.266+0100 [conn1421888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:54.748+0100 [conn1421476] end connection 172.28.0.163:53624 (399 connections now open) 2015-10-05T04:24:54.749+0100 [mongosMain] connection accepted from 172.28.0.163:55105 #1421889 (400 connections now open) 2015-10-05T04:24:54.751+0100 [conn1421889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:55.403+0100 [conn1421495] end connection 172.28.0.163:53652 (399 connections now open) 2015-10-05T04:24:55.405+0100 [mongosMain] connection accepted from 172.28.0.163:55107 #1421890 (400 connections now open) 2015-10-05T04:24:55.406+0100 [conn1421890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:56.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed885703b51053eb1a2f 2015-10-05T04:24:56.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:24:57.757+0100 [conn1421478] end connection 172.28.0.164:63042 (399 connections now open) 2015-10-05T04:24:57.758+0100 [conn1421367] end connection 172.28.0.164:62679 (399 connections now open) 2015-10-05T04:24:57.758+0100 [mongosMain] connection accepted from 172.28.0.164:64540 #1421891 (399 connections now open) 2015-10-05T04:24:57.759+0100 [mongosMain] connection accepted from 172.28.0.164:64541 #1421892 (400 connections now open) 2015-10-05T04:24:57.760+0100 [conn1421891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:57.761+0100 [conn1421892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:58.758+0100 [conn1421464] end connection 172.28.0.163:53568 (399 connections now open) 2015-10-05T04:24:58.758+0100 [conn1421480] end connection 172.28.0.163:53628 (398 connections now open) 2015-10-05T04:24:58.759+0100 [mongosMain] connection accepted from 172.28.0.163:55114 #1421893 (399 connections now open) 2015-10-05T04:24:58.760+0100 [mongosMain] connection accepted from 172.28.0.163:55115 #1421894 (400 connections now open) 2015-10-05T04:24:58.760+0100 [conn1421893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:24:58.761+0100 [conn1421894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:02.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed8e5703b51053eb1a38 2015-10-05T04:25:02.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:04.279+0100 [conn1421501] end connection 172.28.0.164:63093 (399 connections now open) 2015-10-05T04:25:04.280+0100 [mongosMain] connection accepted from 172.28.0.164:64565 #1421895 (400 connections now open) 2015-10-05T04:25:04.281+0100 [conn1421895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:04.764+0100 [conn1421494] end connection 172.28.0.163:53650 (399 connections now open) 2015-10-05T04:25:04.765+0100 [mongosMain] connection accepted from 172.28.0.163:55145 #1421896 (400 connections now open) 2015-10-05T04:25:04.766+0100 [conn1421896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:05.419+0100 [conn1421503] end connection 172.28.0.163:53669 (399 connections now open) 2015-10-05T04:25:05.420+0100 [mongosMain] connection accepted from 172.28.0.163:55148 #1421897 (400 connections now open) 2015-10-05T04:25:05.421+0100 [conn1421897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:06.991+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:25:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:25:07.757+0100 [conn1421470] end connection 172.28.0.164:63017 (399 connections now open) 2015-10-05T04:25:07.757+0100 [conn1421497] end connection 172.28.0.164:63081 (399 connections now open) 2015-10-05T04:25:07.758+0100 [mongosMain] connection accepted from 172.28.0.164:64587 #1421898 (399 connections now open) 2015-10-05T04:25:07.759+0100 [mongosMain] connection accepted from 172.28.0.164:64588 #1421899 (400 connections now open) 2015-10-05T04:25:07.760+0100 [conn1421898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:07.760+0100 [conn1421899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:08.758+0100 [conn1421368] end connection 172.28.0.163:53269 (399 connections now open) 2015-10-05T04:25:08.758+0100 [conn1421506] end connection 172.28.0.163:53675 (398 connections now open) 2015-10-05T04:25:08.759+0100 [mongosMain] connection accepted from 172.28.0.163:55170 #1421900 (399 connections now open) 2015-10-05T04:25:08.759+0100 [mongosMain] connection accepted from 172.28.0.163:55171 #1421901 (400 connections now open) 2015-10-05T04:25:08.760+0100 [conn1421900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:08.760+0100 [conn1421901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:09.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed945703b51053eb1a5c 2015-10-05T04:25:09.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:13.837+0100 [conn1421492] end connection 172.28.0.164:63071 (399 connections now open) 2015-10-05T04:25:13.837+0100 [mongosMain] connection accepted from 172.28.0.164:64607 #1421902 (400 connections now open) 2015-10-05T04:25:13.837+0100 [conn1421902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:14.305+0100 [conn1421509] end connection 172.28.0.164:63121 (399 connections now open) 2015-10-05T04:25:14.305+0100 [mongosMain] connection accepted from 172.28.0.164:64609 #1421903 (400 connections now open) 2015-10-05T04:25:14.305+0100 [conn1421903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:14.819+0100 [conn1421502] end connection 172.28.0.163:53667 (399 connections now open) 2015-10-05T04:25:14.819+0100 [mongosMain] connection accepted from 172.28.0.163:55189 #1421904 (400 connections now open) 2015-10-05T04:25:14.819+0100 [conn1421904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:15.431+0100 [conn1421511] end connection 172.28.0.163:53717 (399 connections now open) 2015-10-05T04:25:15.432+0100 [mongosMain] connection accepted from 172.28.0.163:55192 #1421905 (400 connections now open) 2015-10-05T04:25:15.433+0100 [conn1421905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:15.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ed9b5703b51053eb1a6e 2015-10-05T04:25:15.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:17.758+0100 [conn1421488] end connection 172.28.0.164:63063 (399 connections now open) 2015-10-05T04:25:17.759+0100 [conn1421421] end connection 172.28.0.164:62873 (398 connections now open) 2015-10-05T04:25:17.760+0100 [mongosMain] connection accepted from 172.28.0.164:64613 #1421906 (399 connections now open) 2015-10-05T04:25:17.760+0100 [mongosMain] connection accepted from 172.28.0.164:64614 #1421907 (400 connections now open) 2015-10-05T04:25:17.763+0100 [conn1421907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:17.763+0100 [conn1421906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:18.779+0100 [conn1421499] end connection 172.28.0.163:53659 (399 connections now open) 2015-10-05T04:25:18.779+0100 [conn1421472] end connection 172.28.0.163:53617 (399 connections now open) 2015-10-05T04:25:18.781+0100 [mongosMain] connection accepted from 172.28.0.163:55195 #1421908 (399 connections now open) 2015-10-05T04:25:18.781+0100 [mongosMain] connection accepted from 172.28.0.163:55196 #1421909 (400 connections now open) 2015-10-05T04:25:18.782+0100 [conn1421908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:18.782+0100 [conn1421909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:21.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eda15703b51053eb1a79 2015-10-05T04:25:21.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:23.827+0100 [conn1421500] end connection 172.28.0.164:63090 (399 connections now open) 2015-10-05T04:25:23.828+0100 [mongosMain] connection accepted from 172.28.0.164:64624 #1421910 (400 connections now open) 2015-10-05T04:25:23.829+0100 [conn1421910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:24.294+0100 [conn1421517] end connection 172.28.0.164:63177 (399 connections now open) 2015-10-05T04:25:24.295+0100 [mongosMain] connection accepted from 172.28.0.164:64626 #1421911 (400 connections now open) 2015-10-05T04:25:24.297+0100 [conn1421911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:24.780+0100 [conn1421485] end connection 172.28.0.163:53636 (399 connections now open) 2015-10-05T04:25:24.781+0100 [mongosMain] connection accepted from 172.28.0.163:55200 #1421912 (400 connections now open) 2015-10-05T04:25:24.782+0100 [conn1421912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:25.434+0100 [conn1421519] end connection 172.28.0.163:53774 (399 connections now open) 2015-10-05T04:25:25.435+0100 [mongosMain] connection accepted from 172.28.0.163:55202 #1421913 (400 connections now open) 2015-10-05T04:25:25.436+0100 [conn1421913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:27.774+0100 [conn1421513] end connection 172.28.0.164:63142 (399 connections now open) 2015-10-05T04:25:27.775+0100 [conn1421462] end connection 172.28.0.164:62982 (398 connections now open) 2015-10-05T04:25:27.775+0100 [mongosMain] connection accepted from 172.28.0.164:64632 #1421914 (399 connections now open) 2015-10-05T04:25:27.776+0100 [mongosMain] connection accepted from 172.28.0.164:64633 #1421915 (400 connections now open) 2015-10-05T04:25:27.777+0100 [conn1421914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:27.777+0100 [conn1421915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:28.244+0100 [mongosMain] connection accepted from 127.0.0.1:55204 #1421916 (401 connections now open) 2015-10-05T04:25:28.247+0100 [conn1421916] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:28.252+0100 [conn1421916] end connection 127.0.0.1:55204 (400 connections now open) 2015-10-05T04:25:28.789+0100 [conn1421515] end connection 172.28.0.163:53739 (399 connections now open) 2015-10-05T04:25:28.789+0100 [conn1421440] end connection 172.28.0.163:53474 (399 connections now open) 2015-10-05T04:25:28.817+0100 [mongosMain] connection accepted from 172.28.0.163:55206 #1421917 (399 connections now open) 2015-10-05T04:25:28.817+0100 [mongosMain] connection accepted from 172.28.0.163:55207 #1421918 (400 connections now open) 2015-10-05T04:25:28.818+0100 [conn1421917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:28.818+0100 [conn1421918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:33.842+0100 [conn1421508] end connection 172.28.0.164:63116 (399 connections now open) 2015-10-05T04:25:33.843+0100 [mongosMain] connection accepted from 172.28.0.164:64640 #1421919 (400 connections now open) 2015-10-05T04:25:33.845+0100 [conn1421919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:34.179+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edad5703b51053eb1aa3 2015-10-05T04:25:34.309+0100 [conn1421525] end connection 172.28.0.164:63193 (399 connections now open) 2015-10-05T04:25:34.310+0100 [mongosMain] connection accepted from 172.28.0.164:64644 #1421920 (400 connections now open) 2015-10-05T04:25:34.311+0100 [conn1421920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:34.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:34.795+0100 [conn1421518] end connection 172.28.0.163:53772 (399 connections now open) 2015-10-05T04:25:34.796+0100 [mongosMain] connection accepted from 172.28.0.163:55211 #1421921 (400 connections now open) 2015-10-05T04:25:34.798+0100 [conn1421921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:35.437+0100 [conn1421527] end connection 172.28.0.163:53787 (399 connections now open) 2015-10-05T04:25:35.438+0100 [mongosMain] connection accepted from 172.28.0.163:55213 #1421922 (400 connections now open) 2015-10-05T04:25:35.439+0100 [conn1421922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:37.255+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:25:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:25:37.774+0100 [conn1421504] end connection 172.28.0.164:63097 (399 connections now open) 2015-10-05T04:25:37.774+0100 [conn1421487] end connection 172.28.0.164:63062 (398 connections now open) 2015-10-05T04:25:37.775+0100 [mongosMain] connection accepted from 172.28.0.164:64650 #1421923 (399 connections now open) 2015-10-05T04:25:37.775+0100 [mongosMain] connection accepted from 172.28.0.164:64651 #1421924 (400 connections now open) 2015-10-05T04:25:37.776+0100 [conn1421923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:37.777+0100 [conn1421924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:38.796+0100 [conn1421448] end connection 172.28.0.163:53491 (399 connections now open) 2015-10-05T04:25:38.797+0100 [conn1421490] end connection 172.28.0.163:53641 (398 connections now open) 2015-10-05T04:25:38.798+0100 [mongosMain] connection accepted from 172.28.0.163:55216 #1421925 (399 connections now open) 2015-10-05T04:25:38.799+0100 [mongosMain] connection accepted from 172.28.0.163:55218 #1421926 (400 connections now open) 2015-10-05T04:25:38.799+0100 [conn1421925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:38.800+0100 [conn1421926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:39.297+0100 [mongosMain] connection accepted from 127.0.0.1:55220 #1421927 (401 connections now open) 2015-10-05T04:25:39.301+0100 [conn1421927] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:39.305+0100 [conn1421927] end connection 127.0.0.1:55220 (400 connections now open) 2015-10-05T04:25:43.842+0100 [conn1421474] end connection 172.28.0.164:63034 (399 connections now open) 2015-10-05T04:25:43.843+0100 [mongosMain] connection accepted from 172.28.0.164:64660 #1421928 (400 connections now open) 2015-10-05T04:25:43.845+0100 [conn1421928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:44.310+0100 [conn1421534] end connection 172.28.0.164:63211 (399 connections now open) 2015-10-05T04:25:44.311+0100 [mongosMain] connection accepted from 172.28.0.164:64662 #1421929 (400 connections now open) 2015-10-05T04:25:44.313+0100 [conn1421929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:44.795+0100 [conn1421510] end connection 172.28.0.163:53710 (399 connections now open) 2015-10-05T04:25:44.796+0100 [mongosMain] connection accepted from 172.28.0.163:55229 #1421930 (400 connections now open) 2015-10-05T04:25:44.797+0100 [conn1421930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:45.450+0100 [conn1421536] end connection 172.28.0.163:53799 (399 connections now open) 2015-10-05T04:25:45.451+0100 [mongosMain] connection accepted from 172.28.0.163:55231 #1421931 (400 connections now open) 2015-10-05T04:25:45.452+0100 [conn1421931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:46.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edba5703b51053eb1abb 2015-10-05T04:25:46.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:25:47.790+0100 [conn1421521] end connection 172.28.0.164:63182 (399 connections now open) 2015-10-05T04:25:47.791+0100 [conn1421520] end connection 172.28.0.164:63181 (398 connections now open) 2015-10-05T04:25:47.792+0100 [mongosMain] connection accepted from 172.28.0.164:64670 #1421932 (399 connections now open) 2015-10-05T04:25:47.792+0100 [mongosMain] connection accepted from 172.28.0.164:64669 #1421933 (400 connections now open) 2015-10-05T04:25:47.793+0100 [conn1421932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:47.793+0100 [conn1421933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:48.805+0100 [conn1421522] end connection 172.28.0.163:53779 (399 connections now open) 2015-10-05T04:25:48.806+0100 [conn1421422] end connection 172.28.0.163:53453 (398 connections now open) 2015-10-05T04:25:48.807+0100 [mongosMain] connection accepted from 172.28.0.163:55237 #1421934 (399 connections now open) 2015-10-05T04:25:48.808+0100 [mongosMain] connection accepted from 172.28.0.163:55239 #1421935 (400 connections now open) 2015-10-05T04:25:48.809+0100 [conn1421934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:48.810+0100 [conn1421935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:53.858+0100 [conn1421458] end connection 172.28.0.164:62958 (399 connections now open) 2015-10-05T04:25:53.859+0100 [mongosMain] connection accepted from 172.28.0.164:64676 #1421936 (400 connections now open) 2015-10-05T04:25:53.861+0100 [conn1421936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:54.326+0100 [conn1421542] end connection 172.28.0.164:63232 (399 connections now open) 2015-10-05T04:25:54.327+0100 [mongosMain] connection accepted from 172.28.0.164:64678 #1421937 (400 connections now open) 2015-10-05T04:25:54.329+0100 [conn1421937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:55.451+0100 [conn1421544] end connection 172.28.0.163:53815 (399 connections now open) 2015-10-05T04:25:55.452+0100 [mongosMain] connection accepted from 172.28.0.163:55247 #1421938 (400 connections now open) 2015-10-05T04:25:55.454+0100 [conn1421938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:57.806+0100 [conn1421528] end connection 172.28.0.164:63200 (399 connections now open) 2015-10-05T04:25:57.806+0100 [conn1421479] end connection 172.28.0.164:63044 (398 connections now open) 2015-10-05T04:25:57.807+0100 [mongosMain] connection accepted from 172.28.0.164:64682 #1421939 (399 connections now open) 2015-10-05T04:25:57.808+0100 [mongosMain] connection accepted from 172.28.0.164:64683 #1421940 (400 connections now open) 2015-10-05T04:25:57.809+0100 [conn1421939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:57.820+0100 [conn1421940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:58.806+0100 [conn1421531] end connection 172.28.0.163:53791 (399 connections now open) 2015-10-05T04:25:58.806+0100 [conn1421489] end connection 172.28.0.163:53640 (398 connections now open) 2015-10-05T04:25:58.807+0100 [mongosMain] connection accepted from 172.28.0.163:55253 #1421941 (399 connections now open) 2015-10-05T04:25:58.807+0100 [mongosMain] connection accepted from 172.28.0.163:55254 #1421942 (400 connections now open) 2015-10-05T04:25:58.808+0100 [conn1421941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:58.808+0100 [conn1421942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:25:58.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edc65703b51053eb1aca 2015-10-05T04:25:58.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:03.874+0100 [conn1421483] end connection 172.28.0.164:63052 (399 connections now open) 2015-10-05T04:26:03.875+0100 [mongosMain] connection accepted from 172.28.0.164:64698 #1421943 (400 connections now open) 2015-10-05T04:26:03.876+0100 [conn1421943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:04.326+0100 [conn1421550] end connection 172.28.0.164:63248 (399 connections now open) 2015-10-05T04:26:04.327+0100 [mongosMain] connection accepted from 172.28.0.164:64704 #1421944 (400 connections now open) 2015-10-05T04:26:04.329+0100 [conn1421944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:05.466+0100 [conn1421552] end connection 172.28.0.163:53833 (399 connections now open) 2015-10-05T04:26:05.467+0100 [mongosMain] connection accepted from 172.28.0.163:55287 #1421945 (400 connections now open) 2015-10-05T04:26:05.469+0100 [conn1421945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:07.422+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:26:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:26:07.805+0100 [conn1421455] end connection 172.28.0.164:62944 (399 connections now open) 2015-10-05T04:26:07.805+0100 [conn1421538] end connection 172.28.0.164:63220 (398 connections now open) 2015-10-05T04:26:07.806+0100 [mongosMain] connection accepted from 172.28.0.164:64721 #1421946 (399 connections now open) 2015-10-05T04:26:07.806+0100 [mongosMain] connection accepted from 172.28.0.164:64722 #1421947 (400 connections now open) 2015-10-05T04:26:07.807+0100 [conn1421946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:07.807+0100 [conn1421947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:08.821+0100 [conn1421540] end connection 172.28.0.163:53803 (399 connections now open) 2015-10-05T04:26:08.821+0100 [conn1421498] end connection 172.28.0.163:53658 (399 connections now open) 2015-10-05T04:26:08.822+0100 [mongosMain] connection accepted from 172.28.0.163:55307 #1421948 (399 connections now open) 2015-10-05T04:26:08.823+0100 [mongosMain] connection accepted from 172.28.0.163:55308 #1421949 (400 connections now open) 2015-10-05T04:26:08.824+0100 [conn1421949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:08.824+0100 [conn1421948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:11.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edd25703b51053eb1b10 2015-10-05T04:26:11.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:13.889+0100 [conn1421533] end connection 172.28.0.164:63209 (399 connections now open) 2015-10-05T04:26:13.891+0100 [mongosMain] connection accepted from 172.28.0.164:64752 #1421950 (400 connections now open) 2015-10-05T04:26:13.893+0100 [conn1421950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:14.344+0100 [conn1421558] end connection 172.28.0.164:63276 (399 connections now open) 2015-10-05T04:26:14.345+0100 [mongosMain] connection accepted from 172.28.0.164:64754 #1421951 (400 connections now open) 2015-10-05T04:26:14.347+0100 [conn1421951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:14.827+0100 [conn1421535] end connection 172.28.0.163:53797 (399 connections now open) 2015-10-05T04:26:14.828+0100 [mongosMain] connection accepted from 172.28.0.163:55335 #1421952 (400 connections now open) 2015-10-05T04:26:14.829+0100 [conn1421952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:15.467+0100 [conn1421560] end connection 172.28.0.163:53875 (399 connections now open) 2015-10-05T04:26:15.468+0100 [mongosMain] connection accepted from 172.28.0.163:55339 #1421953 (400 connections now open) 2015-10-05T04:26:15.469+0100 [conn1421953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:17.822+0100 [conn1421562] end connection 172.28.0.164:63304 (399 connections now open) 2015-10-05T04:26:17.822+0100 [conn1421512] end connection 172.28.0.164:63141 (399 connections now open) 2015-10-05T04:26:17.823+0100 [mongosMain] connection accepted from 172.28.0.164:64759 #1421954 (399 connections now open) 2015-10-05T04:26:17.823+0100 [mongosMain] connection accepted from 172.28.0.164:64760 #1421955 (400 connections now open) 2015-10-05T04:26:17.825+0100 [conn1421954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:17.825+0100 [conn1421955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:18.821+0100 [conn1421556] end connection 172.28.0.163:53840 (399 connections now open) 2015-10-05T04:26:18.821+0100 [conn1421523] end connection 172.28.0.163:53780 (399 connections now open) 2015-10-05T04:26:18.822+0100 [mongosMain] connection accepted from 172.28.0.163:55342 #1421956 (399 connections now open) 2015-10-05T04:26:18.822+0100 [mongosMain] connection accepted from 172.28.0.163:55343 #1421957 (400 connections now open) 2015-10-05T04:26:18.823+0100 [conn1421956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:18.823+0100 [conn1421957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:23.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eddf5703b51053eb1b49 2015-10-05T04:26:23.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:23.904+0100 [conn1421516] end connection 172.28.0.164:63175 (399 connections now open) 2015-10-05T04:26:23.905+0100 [mongosMain] connection accepted from 172.28.0.164:64768 #1421958 (400 connections now open) 2015-10-05T04:26:23.907+0100 [conn1421958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:24.357+0100 [conn1421566] end connection 172.28.0.164:63342 (399 connections now open) 2015-10-05T04:26:24.358+0100 [mongosMain] connection accepted from 172.28.0.164:64771 #1421959 (400 connections now open) 2015-10-05T04:26:24.360+0100 [conn1421959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:24.827+0100 [conn1421526] end connection 172.28.0.163:53785 (399 connections now open) 2015-10-05T04:26:24.828+0100 [mongosMain] connection accepted from 172.28.0.163:55349 #1421960 (400 connections now open) 2015-10-05T04:26:24.830+0100 [conn1421960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:25.482+0100 [conn1421568] end connection 172.28.0.163:53929 (399 connections now open) 2015-10-05T04:26:25.483+0100 [mongosMain] connection accepted from 172.28.0.163:55351 #1421961 (400 connections now open) 2015-10-05T04:26:25.484+0100 [conn1421961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:27.821+0100 [conn1421546] end connection 172.28.0.164:63239 (399 connections now open) 2015-10-05T04:26:27.823+0100 [mongosMain] connection accepted from 172.28.0.164:64777 #1421962 (400 connections now open) 2015-10-05T04:26:27.825+0100 [conn1421962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:28.837+0100 [conn1421548] end connection 172.28.0.163:53822 (399 connections now open) 2015-10-05T04:26:28.838+0100 [mongosMain] connection accepted from 172.28.0.163:55353 #1421963 (400 connections now open) 2015-10-05T04:26:28.839+0100 [conn1421963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:29.019+0100 [conn1421496] end connection 172.28.0.164:63080 (399 connections now open) 2015-10-05T04:26:29.021+0100 [mongosMain] connection accepted from 172.28.0.164:64779 #1421964 (400 connections now open) 2015-10-05T04:26:29.023+0100 [conn1421964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:29.026+0100 [conn1421456] end connection 172.28.0.163:53509 (399 connections now open) 2015-10-05T04:26:29.027+0100 [mongosMain] connection accepted from 172.28.0.163:55356 #1421965 (400 connections now open) 2015-10-05T04:26:29.028+0100 [conn1421965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:29.148+0100 [mongosMain] connection accepted from 127.0.0.1:55357 #1421966 (401 connections now open) 2015-10-05T04:26:29.151+0100 [conn1421966] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:29.157+0100 [conn1421966] end connection 127.0.0.1:55357 (400 connections now open) 2015-10-05T04:26:30.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ede55703b51053eb1b68 2015-10-05T04:26:30.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:33.921+0100 [conn1421524] end connection 172.28.0.164:63191 (399 connections now open) 2015-10-05T04:26:33.922+0100 [mongosMain] connection accepted from 172.28.0.164:64786 #1421967 (400 connections now open) 2015-10-05T04:26:33.923+0100 [conn1421967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:34.373+0100 [conn1421574] end connection 172.28.0.164:63362 (399 connections now open) 2015-10-05T04:26:34.374+0100 [mongosMain] connection accepted from 172.28.0.164:64788 #1421968 (400 connections now open) 2015-10-05T04:26:34.378+0100 [conn1421968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:34.842+0100 [conn1421543] end connection 172.28.0.163:53811 (399 connections now open) 2015-10-05T04:26:34.843+0100 [mongosMain] connection accepted from 172.28.0.163:55358 #1421969 (400 connections now open) 2015-10-05T04:26:34.844+0100 [conn1421969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:35.498+0100 [conn1421576] end connection 172.28.0.163:53942 (399 connections now open) 2015-10-05T04:26:35.500+0100 [mongosMain] connection accepted from 172.28.0.163:55360 #1421970 (400 connections now open) 2015-10-05T04:26:35.501+0100 [conn1421970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:36.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edec5703b51053eb1b76 2015-10-05T04:26:36.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:37.559+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:26:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:26:37.838+0100 [conn1421529] end connection 172.28.0.164:63201 (399 connections now open) 2015-10-05T04:26:37.838+0100 [conn1421553] end connection 172.28.0.164:63252 (398 connections now open) 2015-10-05T04:26:37.839+0100 [mongosMain] connection accepted from 172.28.0.164:64796 #1421971 (399 connections now open) 2015-10-05T04:26:37.839+0100 [mongosMain] connection accepted from 172.28.0.164:64797 #1421972 (400 connections now open) 2015-10-05T04:26:37.840+0100 [conn1421971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:37.841+0100 [conn1421972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:38.852+0100 [conn1421563] end connection 172.28.0.163:53900 (399 connections now open) 2015-10-05T04:26:38.853+0100 [conn1421507] end connection 172.28.0.163:53676 (398 connections now open) 2015-10-05T04:26:38.854+0100 [mongosMain] connection accepted from 172.28.0.163:55363 #1421973 (399 connections now open) 2015-10-05T04:26:38.854+0100 [mongosMain] connection accepted from 172.28.0.163:55364 #1421974 (400 connections now open) 2015-10-05T04:26:38.855+0100 [conn1421973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:38.855+0100 [conn1421974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:39.873+0100 [mongosMain] connection accepted from 127.0.0.1:55367 #1421975 (401 connections now open) 2015-10-05T04:26:39.876+0100 [conn1421975] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:39.880+0100 [conn1421975] end connection 127.0.0.1:55367 (400 connections now open) 2015-10-05T04:26:42.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edf25703b51053eb1b84 2015-10-05T04:26:42.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:43.921+0100 [conn1421565] end connection 172.28.0.164:63339 (399 connections now open) 2015-10-05T04:26:43.923+0100 [mongosMain] connection accepted from 172.28.0.164:64807 #1421976 (400 connections now open) 2015-10-05T04:26:43.924+0100 [conn1421976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:44.389+0100 [conn1421583] end connection 172.28.0.164:63380 (399 connections now open) 2015-10-05T04:26:44.390+0100 [mongosMain] connection accepted from 172.28.0.164:64810 #1421977 (400 connections now open) 2015-10-05T04:26:44.391+0100 [conn1421977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:44.843+0100 [conn1421559] end connection 172.28.0.163:53868 (399 connections now open) 2015-10-05T04:26:44.844+0100 [mongosMain] connection accepted from 172.28.0.163:55373 #1421978 (400 connections now open) 2015-10-05T04:26:44.846+0100 [conn1421978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:45.498+0100 [conn1421585] end connection 172.28.0.163:53952 (399 connections now open) 2015-10-05T04:26:45.499+0100 [mongosMain] connection accepted from 172.28.0.163:55376 #1421979 (400 connections now open) 2015-10-05T04:26:45.501+0100 [conn1421979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:47.838+0100 [conn1421561] end connection 172.28.0.164:63303 (399 connections now open) 2015-10-05T04:26:47.838+0100 [conn1421569] end connection 172.28.0.164:63349 (398 connections now open) 2015-10-05T04:26:47.839+0100 [mongosMain] connection accepted from 172.28.0.164:64815 #1421980 (399 connections now open) 2015-10-05T04:26:47.839+0100 [mongosMain] connection accepted from 172.28.0.164:64816 #1421981 (400 connections now open) 2015-10-05T04:26:47.840+0100 [conn1421980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:47.841+0100 [conn1421981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:48.812+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edf85703b51053eb1b8b 2015-10-05T04:26:48.853+0100 [conn1421579] end connection 172.28.0.163:53944 (399 connections now open) 2015-10-05T04:26:48.853+0100 [conn1421555] end connection 172.28.0.163:53839 (398 connections now open) 2015-10-05T04:26:48.854+0100 [mongosMain] connection accepted from 172.28.0.163:55381 #1421982 (399 connections now open) 2015-10-05T04:26:48.854+0100 [mongosMain] connection accepted from 172.28.0.163:55382 #1421983 (400 connections now open) 2015-10-05T04:26:48.855+0100 [conn1421982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:48.856+0100 [conn1421983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:48.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:53.936+0100 [conn1421557] end connection 172.28.0.164:63271 (399 connections now open) 2015-10-05T04:26:53.939+0100 [mongosMain] connection accepted from 172.28.0.164:64824 #1421984 (400 connections now open) 2015-10-05T04:26:53.941+0100 [conn1421984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:54.405+0100 [conn1421592] end connection 172.28.0.164:63399 (399 connections now open) 2015-10-05T04:26:54.406+0100 [mongosMain] connection accepted from 172.28.0.164:64826 #1421985 (400 connections now open) 2015-10-05T04:26:54.407+0100 [conn1421985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:54.859+0100 [conn1421551] end connection 172.28.0.163:53829 (399 connections now open) 2015-10-05T04:26:54.860+0100 [mongosMain] connection accepted from 172.28.0.163:55391 #1421986 (400 connections now open) 2015-10-05T04:26:54.861+0100 [conn1421986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:55.066+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611edfe5703b51053eb1b90 2015-10-05T04:26:55.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:26:55.513+0100 [conn1421594] end connection 172.28.0.163:53967 (399 connections now open) 2015-10-05T04:26:55.515+0100 [mongosMain] connection accepted from 172.28.0.163:55393 #1421987 (400 connections now open) 2015-10-05T04:26:55.516+0100 [conn1421987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:57.853+0100 [conn1421577] end connection 172.28.0.164:63368 (399 connections now open) 2015-10-05T04:26:57.853+0100 [conn1421505] end connection 172.28.0.164:63098 (399 connections now open) 2015-10-05T04:26:57.854+0100 [mongosMain] connection accepted from 172.28.0.164:64831 #1421988 (399 connections now open) 2015-10-05T04:26:57.854+0100 [mongosMain] connection accepted from 172.28.0.164:64832 #1421989 (400 connections now open) 2015-10-05T04:26:57.855+0100 [conn1421988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:57.857+0100 [conn1421989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:58.868+0100 [conn1421572] end connection 172.28.0.163:53934 (399 connections now open) 2015-10-05T04:26:58.868+0100 [conn1421530] end connection 172.28.0.163:53790 (399 connections now open) 2015-10-05T04:26:58.870+0100 [mongosMain] connection accepted from 172.28.0.163:55399 #1421990 (399 connections now open) 2015-10-05T04:26:58.870+0100 [mongosMain] connection accepted from 172.28.0.163:55400 #1421991 (400 connections now open) 2015-10-05T04:26:58.871+0100 [conn1421990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:26:58.871+0100 [conn1421991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:01.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee055703b51053eb1b9a 2015-10-05T04:27:01.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:03.937+0100 [conn1421591] end connection 172.28.0.164:63397 (399 connections now open) 2015-10-05T04:27:03.938+0100 [mongosMain] connection accepted from 172.28.0.164:64856 #1421992 (400 connections now open) 2015-10-05T04:27:03.940+0100 [conn1421992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:04.405+0100 [conn1421600] end connection 172.28.0.164:63415 (399 connections now open) 2015-10-05T04:27:04.406+0100 [mongosMain] connection accepted from 172.28.0.164:64861 #1421993 (400 connections now open) 2015-10-05T04:27:04.408+0100 [conn1421993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:04.874+0100 [conn1421575] end connection 172.28.0.163:53940 (399 connections now open) 2015-10-05T04:27:04.875+0100 [mongosMain] connection accepted from 172.28.0.163:55433 #1421994 (400 connections now open) 2015-10-05T04:27:04.876+0100 [conn1421994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:05.514+0100 [conn1421602] end connection 172.28.0.163:53983 (399 connections now open) 2015-10-05T04:27:05.515+0100 [mongosMain] connection accepted from 172.28.0.163:55438 #1421995 (400 connections now open) 2015-10-05T04:27:05.516+0100 [conn1421995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:07.840+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:27:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:27:07.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee0b5703b51053eb1ba1 2015-10-05T04:27:07.852+0100 [conn1421587] end connection 172.28.0.164:63389 (399 connections now open) 2015-10-05T04:27:07.853+0100 [conn1421570] end connection 172.28.0.164:63350 (398 connections now open) 2015-10-05T04:27:07.853+0100 [mongosMain] connection accepted from 172.28.0.164:64881 #1421996 (399 connections now open) 2015-10-05T04:27:07.854+0100 [mongosMain] connection accepted from 172.28.0.164:64882 #1421997 (400 connections now open) 2015-10-05T04:27:07.855+0100 [conn1421996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:07.856+0100 [conn1421997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:07.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:08.870+0100 [conn1421547] end connection 172.28.0.163:53820 (399 connections now open) 2015-10-05T04:27:08.870+0100 [conn1421597] end connection 172.28.0.163:53972 (398 connections now open) 2015-10-05T04:27:08.872+0100 [mongosMain] connection accepted from 172.28.0.163:55466 #1421998 (399 connections now open) 2015-10-05T04:27:08.872+0100 [mongosMain] connection accepted from 172.28.0.163:55467 #1421999 (400 connections now open) 2015-10-05T04:27:08.873+0100 [conn1421998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:08.873+0100 [conn1421999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:13.952+0100 [conn1421573] end connection 172.28.0.164:63359 (399 connections now open) 2015-10-05T04:27:13.953+0100 [mongosMain] connection accepted from 172.28.0.164:64902 #1422000 (400 connections now open) 2015-10-05T04:27:13.955+0100 [conn1422000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:14.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee115703b51053eb1ba2 2015-10-05T04:27:14.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:14.421+0100 [conn1421608] end connection 172.28.0.164:63443 (399 connections now open) 2015-10-05T04:27:14.422+0100 [mongosMain] connection accepted from 172.28.0.164:64903 #1422001 (400 connections now open) 2015-10-05T04:27:14.423+0100 [conn1422001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:14.874+0100 [conn1421567] end connection 172.28.0.163:53926 (399 connections now open) 2015-10-05T04:27:14.875+0100 [mongosMain] connection accepted from 172.28.0.163:55491 #1422002 (400 connections now open) 2015-10-05T04:27:14.876+0100 [conn1422002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:15.529+0100 [conn1421610] end connection 172.28.0.163:54031 (399 connections now open) 2015-10-05T04:27:15.530+0100 [mongosMain] connection accepted from 172.28.0.163:55495 #1422003 (400 connections now open) 2015-10-05T04:27:15.531+0100 [conn1422003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:17.869+0100 [conn1421586] end connection 172.28.0.164:63388 (399 connections now open) 2015-10-05T04:27:17.869+0100 [conn1421603] end connection 172.28.0.164:63420 (398 connections now open) 2015-10-05T04:27:17.870+0100 [mongosMain] connection accepted from 172.28.0.164:64908 #1422004 (399 connections now open) 2015-10-05T04:27:17.870+0100 [mongosMain] connection accepted from 172.28.0.164:64909 #1422005 (400 connections now open) 2015-10-05T04:27:17.872+0100 [conn1422004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:17.872+0100 [conn1422005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:18.884+0100 [conn1421539] end connection 172.28.0.163:53802 (399 connections now open) 2015-10-05T04:27:18.884+0100 [conn1421606] end connection 172.28.0.163:53992 (399 connections now open) 2015-10-05T04:27:18.885+0100 [mongosMain] connection accepted from 172.28.0.163:55498 #1422006 (399 connections now open) 2015-10-05T04:27:18.885+0100 [mongosMain] connection accepted from 172.28.0.163:55499 #1422007 (400 connections now open) 2015-10-05T04:27:18.886+0100 [conn1422006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:18.886+0100 [conn1422007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:20.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee185703b51053eb1baa 2015-10-05T04:27:20.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:23.952+0100 [conn1421549] end connection 172.28.0.164:63246 (399 connections now open) 2015-10-05T04:27:23.954+0100 [mongosMain] connection accepted from 172.28.0.164:64919 #1422008 (400 connections now open) 2015-10-05T04:27:23.955+0100 [conn1422008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:24.420+0100 [conn1421616] end connection 172.28.0.164:63494 (399 connections now open) 2015-10-05T04:27:24.421+0100 [mongosMain] connection accepted from 172.28.0.164:64923 #1422009 (400 connections now open) 2015-10-05T04:27:24.424+0100 [conn1422009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:24.890+0100 [conn1421593] end connection 172.28.0.163:53964 (399 connections now open) 2015-10-05T04:27:24.891+0100 [mongosMain] connection accepted from 172.28.0.163:55503 #1422010 (400 connections now open) 2015-10-05T04:27:24.892+0100 [conn1422010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:25.531+0100 [conn1421618] end connection 172.28.0.163:54071 (399 connections now open) 2015-10-05T04:27:25.532+0100 [mongosMain] connection accepted from 172.28.0.163:55506 #1422011 (400 connections now open) 2015-10-05T04:27:25.534+0100 [conn1422011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:27.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee1e5703b51053eb1bb9 2015-10-05T04:27:27.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:27.869+0100 [conn1421611] end connection 172.28.0.164:63469 (399 connections now open) 2015-10-05T04:27:27.869+0100 [conn1421554] end connection 172.28.0.164:63253 (398 connections now open) 2015-10-05T04:27:27.870+0100 [mongosMain] connection accepted from 172.28.0.164:64932 #1422012 (399 connections now open) 2015-10-05T04:27:27.870+0100 [mongosMain] connection accepted from 172.28.0.164:64933 #1422013 (400 connections now open) 2015-10-05T04:27:27.872+0100 [conn1422012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:27.872+0100 [conn1422013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:28.222+0100 [mongosMain] connection accepted from 127.0.0.1:55508 #1422014 (401 connections now open) 2015-10-05T04:27:28.225+0100 [conn1422014] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:28.230+0100 [conn1422014] end connection 127.0.0.1:55508 (400 connections now open) 2015-10-05T04:27:28.884+0100 [conn1421614] end connection 172.28.0.163:54049 (399 connections now open) 2015-10-05T04:27:28.885+0100 [conn1421571] end connection 172.28.0.163:53933 (398 connections now open) 2015-10-05T04:27:28.888+0100 [mongosMain] connection accepted from 172.28.0.163:55509 #1422015 (399 connections now open) 2015-10-05T04:27:28.888+0100 [conn1422015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:28.889+0100 [mongosMain] connection accepted from 172.28.0.163:55512 #1422016 (400 connections now open) 2015-10-05T04:27:28.890+0100 [conn1422016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:33.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee255703b51053eb1bcd 2015-10-05T04:27:33.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:33.968+0100 [conn1421582] end connection 172.28.0.164:63377 (399 connections now open) 2015-10-05T04:27:33.970+0100 [mongosMain] connection accepted from 172.28.0.164:64940 #1422017 (400 connections now open) 2015-10-05T04:27:33.971+0100 [conn1422017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:34.436+0100 [conn1421624] end connection 172.28.0.164:63514 (399 connections now open) 2015-10-05T04:27:34.437+0100 [mongosMain] connection accepted from 172.28.0.164:64942 #1422018 (400 connections now open) 2015-10-05T04:27:34.439+0100 [conn1422018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:34.890+0100 [conn1421584] end connection 172.28.0.163:53949 (399 connections now open) 2015-10-05T04:27:34.891+0100 [mongosMain] connection accepted from 172.28.0.163:55513 #1422019 (400 connections now open) 2015-10-05T04:27:34.892+0100 [conn1422019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:35.546+0100 [conn1421626] end connection 172.28.0.163:54083 (399 connections now open) 2015-10-05T04:27:35.547+0100 [mongosMain] connection accepted from 172.28.0.163:55516 #1422020 (400 connections now open) 2015-10-05T04:27:35.548+0100 [conn1422020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:37.884+0100 [conn1421595] end connection 172.28.0.164:63407 (399 connections now open) 2015-10-05T04:27:37.885+0100 [mongosMain] connection accepted from 172.28.0.164:64950 #1422021 (400 connections now open) 2015-10-05T04:27:37.887+0100 [conn1422021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:38.105+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:27:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:27:38.900+0100 [conn1421588] end connection 172.28.0.163:53955 (399 connections now open) 2015-10-05T04:27:38.901+0100 [conn1421514] end connection 172.28.0.163:53738 (398 connections now open) 2015-10-05T04:27:38.902+0100 [mongosMain] connection accepted from 172.28.0.163:55519 #1422022 (399 connections now open) 2015-10-05T04:27:38.902+0100 [mongosMain] connection accepted from 172.28.0.163:55520 #1422023 (400 connections now open) 2015-10-05T04:27:38.903+0100 [conn1422022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:38.905+0100 [conn1422023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:39.209+0100 [mongosMain] connection accepted from 127.0.0.1:55523 #1422024 (401 connections now open) 2015-10-05T04:27:39.212+0100 [conn1422024] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:39.217+0100 [conn1422024] end connection 127.0.0.1:55523 (400 connections now open) 2015-10-05T04:27:40.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee2b5703b51053eb1bd1 2015-10-05T04:27:40.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:43.969+0100 [conn1421599] end connection 172.28.0.164:63413 (399 connections now open) 2015-10-05T04:27:43.970+0100 [mongosMain] connection accepted from 172.28.0.164:64959 #1422025 (400 connections now open) 2015-10-05T04:27:43.971+0100 [conn1422025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:44.436+0100 [conn1421632] end connection 172.28.0.164:63531 (399 connections now open) 2015-10-05T04:27:44.437+0100 [mongosMain] connection accepted from 172.28.0.164:64961 #1422026 (400 connections now open) 2015-10-05T04:27:44.439+0100 [conn1422026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:44.905+0100 [conn1421601] end connection 172.28.0.163:53981 (399 connections now open) 2015-10-05T04:27:44.906+0100 [mongosMain] connection accepted from 172.28.0.163:55529 #1422027 (400 connections now open) 2015-10-05T04:27:44.907+0100 [conn1422027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:45.545+0100 [conn1421634] end connection 172.28.0.163:54094 (399 connections now open) 2015-10-05T04:27:45.546+0100 [mongosMain] connection accepted from 172.28.0.163:55533 #1422028 (400 connections now open) 2015-10-05T04:27:45.547+0100 [conn1422028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:46.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee325703b51053eb1bd4 2015-10-05T04:27:46.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:47.901+0100 [conn1421619] end connection 172.28.0.164:63498 (399 connections now open) 2015-10-05T04:27:47.902+0100 [mongosMain] connection accepted from 172.28.0.164:64968 #1422029 (400 connections now open) 2015-10-05T04:27:47.903+0100 [conn1422029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:48.900+0100 [conn1421621] end connection 172.28.0.163:54075 (399 connections now open) 2015-10-05T04:27:48.900+0100 [conn1421613] end connection 172.28.0.163:54048 (398 connections now open) 2015-10-05T04:27:48.901+0100 [mongosMain] connection accepted from 172.28.0.163:55538 #1422030 (399 connections now open) 2015-10-05T04:27:48.902+0100 [mongosMain] connection accepted from 172.28.0.163:55539 #1422031 (400 connections now open) 2015-10-05T04:27:48.902+0100 [conn1422030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:48.902+0100 [conn1422031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:52.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee385703b51053eb1be5 2015-10-05T04:27:52.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:27:53.983+0100 [conn1421607] end connection 172.28.0.164:63437 (399 connections now open) 2015-10-05T04:27:53.984+0100 [mongosMain] connection accepted from 172.28.0.164:64975 #1422032 (400 connections now open) 2015-10-05T04:27:53.986+0100 [conn1422032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:54.452+0100 [conn1421640] end connection 172.28.0.164:63551 (399 connections now open) 2015-10-05T04:27:54.453+0100 [mongosMain] connection accepted from 172.28.0.164:64977 #1422033 (400 connections now open) 2015-10-05T04:27:54.455+0100 [conn1422033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:54.906+0100 [conn1421609] end connection 172.28.0.163:54024 (399 connections now open) 2015-10-05T04:27:54.907+0100 [mongosMain] connection accepted from 172.28.0.163:55548 #1422034 (400 connections now open) 2015-10-05T04:27:54.908+0100 [conn1422034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:55.561+0100 [conn1421642] end connection 172.28.0.163:54109 (399 connections now open) 2015-10-05T04:27:55.562+0100 [mongosMain] connection accepted from 172.28.0.163:55550 #1422035 (400 connections now open) 2015-10-05T04:27:55.563+0100 [conn1422035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:58.915+0100 [conn1421628] end connection 172.28.0.163:54086 (399 connections now open) 2015-10-05T04:27:58.916+0100 [conn1421605] end connection 172.28.0.163:53991 (398 connections now open) 2015-10-05T04:27:58.917+0100 [mongosMain] connection accepted from 172.28.0.163:55555 #1422036 (399 connections now open) 2015-10-05T04:27:58.918+0100 [mongosMain] connection accepted from 172.28.0.163:55556 #1422037 (400 connections now open) 2015-10-05T04:27:58.919+0100 [conn1422036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:58.919+0100 [conn1422037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:27:59.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee3e5703b51053eb1bf7 2015-10-05T04:27:59.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:04.000+0100 [conn1421631] end connection 172.28.0.164:63529 (399 connections now open) 2015-10-05T04:28:04.001+0100 [mongosMain] connection accepted from 172.28.0.164:65001 #1422038 (400 connections now open) 2015-10-05T04:28:04.003+0100 [conn1422038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:04.452+0100 [conn1421647] end connection 172.28.0.164:63568 (399 connections now open) 2015-10-05T04:28:04.453+0100 [mongosMain] connection accepted from 172.28.0.164:65004 #1422039 (400 connections now open) 2015-10-05T04:28:04.455+0100 [conn1422039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:05.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee455703b51053eb1c1a 2015-10-05T04:28:05.576+0100 [conn1421649] end connection 172.28.0.163:54126 (399 connections now open) 2015-10-05T04:28:05.577+0100 [mongosMain] connection accepted from 172.28.0.163:55595 #1422040 (400 connections now open) 2015-10-05T04:28:05.578+0100 [conn1422040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:05.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:07.916+0100 [conn1421635] end connection 172.28.0.164:63539 (399 connections now open) 2015-10-05T04:28:07.917+0100 [mongosMain] connection accepted from 172.28.0.164:65023 #1422041 (400 connections now open) 2015-10-05T04:28:07.919+0100 [conn1422041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:08.366+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:28:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:28:08.931+0100 [conn1421636] end connection 172.28.0.163:54097 (399 connections now open) 2015-10-05T04:28:08.931+0100 [mongosMain] connection accepted from 172.28.0.163:55617 #1422042 (400 connections now open) 2015-10-05T04:28:08.933+0100 [conn1422042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:11.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee4b5703b51053eb1c2a 2015-10-05T04:28:12.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:14.000+0100 [conn1421623] end connection 172.28.0.164:63512 (399 connections now open) 2015-10-05T04:28:14.001+0100 [mongosMain] connection accepted from 172.28.0.164:65054 #1422043 (400 connections now open) 2015-10-05T04:28:14.002+0100 [conn1422043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:14.468+0100 [conn1421651] end connection 172.28.0.164:63595 (399 connections now open) 2015-10-05T04:28:14.469+0100 [mongosMain] connection accepted from 172.28.0.164:65056 #1422044 (400 connections now open) 2015-10-05T04:28:14.470+0100 [conn1422044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:15.577+0100 [conn1421652] end connection 172.28.0.163:54166 (399 connections now open) 2015-10-05T04:28:15.578+0100 [mongosMain] connection accepted from 172.28.0.163:55640 #1422045 (400 connections now open) 2015-10-05T04:28:15.579+0100 [conn1422045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:17.933+0100 [conn1421627] end connection 172.28.0.164:63521 (399 connections now open) 2015-10-05T04:28:17.934+0100 [mongosMain] connection accepted from 172.28.0.164:65060 #1422046 (400 connections now open) 2015-10-05T04:28:17.935+0100 [conn1422046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:18.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee525703b51053eb1c4a 2015-10-05T04:28:18.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:18.937+0100 [conn1421655] end connection 172.28.0.163:54185 (399 connections now open) 2015-10-05T04:28:18.938+0100 [mongosMain] connection accepted from 172.28.0.163:55644 #1422047 (400 connections now open) 2015-10-05T04:28:18.940+0100 [conn1422047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:24.468+0100 [conn1421656] end connection 172.28.0.164:63650 (399 connections now open) 2015-10-05T04:28:24.469+0100 [mongosMain] connection accepted from 172.28.0.164:65071 #1422048 (400 connections now open) 2015-10-05T04:28:24.471+0100 [conn1422048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:24.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee585703b51053eb1c56 2015-10-05T04:28:24.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:27.948+0100 [conn1421643] end connection 172.28.0.164:63558 (399 connections now open) 2015-10-05T04:28:27.949+0100 [mongosMain] connection accepted from 172.28.0.164:65077 #1422049 (400 connections now open) 2015-10-05T04:28:27.951+0100 [conn1422049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:28.947+0100 [conn1421650] end connection 172.28.0.163:54131 (399 connections now open) 2015-10-05T04:28:28.949+0100 [mongosMain] connection accepted from 172.28.0.163:55650 #1422050 (400 connections now open) 2015-10-05T04:28:28.949+0100 [conn1422050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:28.950+0100 [mongosMain] connection accepted from 127.0.0.1:55652 #1422051 (401 connections now open) 2015-10-05T04:28:28.953+0100 [conn1422051] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:28.959+0100 [conn1422051] end connection 127.0.0.1:55652 (400 connections now open) 2015-10-05T04:28:31.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee5e5703b51053eb1c68 2015-10-05T04:28:31.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:37.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee655703b51053eb1c7d 2015-10-05T04:28:37.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:38.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:28:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:28:38.947+0100 [conn1421644] end connection 172.28.0.163:54115 (399 connections now open) 2015-10-05T04:28:38.949+0100 [mongosMain] connection accepted from 172.28.0.163:55657 #1422052 (400 connections now open) 2015-10-05T04:28:38.950+0100 [conn1422052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:39.359+0100 [mongosMain] connection accepted from 127.0.0.1:55658 #1422053 (401 connections now open) 2015-10-05T04:28:39.362+0100 [conn1422053] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:39.366+0100 [conn1422053] end connection 127.0.0.1:55658 (400 connections now open) 2015-10-05T04:28:43.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee6b5703b51053eb1c9c 2015-10-05T04:28:44.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:48.963+0100 [conn1421659] end connection 172.28.0.163:54223 (399 connections now open) 2015-10-05T04:28:48.964+0100 [mongosMain] connection accepted from 172.28.0.163:55669 #1422054 (400 connections now open) 2015-10-05T04:28:48.965+0100 [conn1422054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:50.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee725703b51053eb1cbf 2015-10-05T04:28:50.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:54.031+0100 [conn1421615] end connection 172.28.0.164:63492 (399 connections now open) 2015-10-05T04:28:54.032+0100 [mongosMain] connection accepted from 172.28.0.164:65106 #1422055 (400 connections now open) 2015-10-05T04:28:54.034+0100 [conn1422055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:54.968+0100 [conn1421648] end connection 172.28.0.163:54124 (399 connections now open) 2015-10-05T04:28:54.969+0100 [mongosMain] connection accepted from 172.28.0.163:55676 #1422056 (400 connections now open) 2015-10-05T04:28:54.971+0100 [conn1422056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:28:56.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee785703b51053eb1ccd 2015-10-05T04:28:56.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:28:58.964+0100 [conn1421663] end connection 172.28.0.163:54229 (399 connections now open) 2015-10-05T04:28:58.969+0100 [mongosMain] connection accepted from 172.28.0.163:55682 #1422057 (400 connections now open) 2015-10-05T04:28:58.971+0100 [conn1422057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:04.031+0100 [conn1421639] end connection 172.28.0.164:63549 (399 connections now open) 2015-10-05T04:29:04.032+0100 [mongosMain] connection accepted from 172.28.0.164:65129 #1422058 (400 connections now open) 2015-10-05T04:29:04.034+0100 [conn1422058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:07.994+0100 [conn1421653] end connection 172.28.0.164:63617 (399 connections now open) 2015-10-05T04:29:07.995+0100 [mongosMain] connection accepted from 172.28.0.164:65149 #1422059 (400 connections now open) 2015-10-05T04:29:07.996+0100 [conn1422059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:08.722+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:29:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:29:08.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee845703b51053eb1d05 2015-10-05T04:29:08.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:29:08.979+0100 [conn1421629] end connection 172.28.0.163:54088 (399 connections now open) 2015-10-05T04:29:08.979+0100 [conn1421668] end connection 172.28.0.163:54247 (398 connections now open) 2015-10-05T04:29:08.981+0100 [mongosMain] connection accepted from 172.28.0.163:55736 #1422060 (399 connections now open) 2015-10-05T04:29:08.981+0100 [mongosMain] connection accepted from 172.28.0.163:55737 #1422061 (400 connections now open) 2015-10-05T04:29:08.982+0100 [conn1422060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:08.982+0100 [conn1422061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:14.047+0100 [conn1421665] end connection 172.28.0.164:63675 (399 connections now open) 2015-10-05T04:29:14.048+0100 [mongosMain] connection accepted from 172.28.0.164:65171 #1422062 (400 connections now open) 2015-10-05T04:29:14.050+0100 [conn1422062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:15.107+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:29:15.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:29:18.010+0100 [conn1421596] end connection 172.28.0.164:63408 (399 connections now open) 2015-10-05T04:29:18.011+0100 [mongosMain] connection accepted from 172.28.0.164:65173 #1422063 (400 connections now open) 2015-10-05T04:29:18.012+0100 [conn1421654] end connection 172.28.0.164:63618 (399 connections now open) 2015-10-05T04:29:18.013+0100 [mongosMain] connection accepted from 172.28.0.164:65174 #1422064 (400 connections now open) 2015-10-05T04:29:18.013+0100 [conn1422063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:18.014+0100 [conn1422064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:18.979+0100 [conn1421589] end connection 172.28.0.163:53956 (399 connections now open) 2015-10-05T04:29:18.980+0100 [mongosMain] connection accepted from 172.28.0.163:55765 #1422065 (400 connections now open) 2015-10-05T04:29:18.981+0100 [conn1422065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:21.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee915703b51053eb1d19 2015-10-05T04:29:21.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:29:27.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ee975703b51053eb1d30 2015-10-05T04:29:27.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:29:28.027+0100 [conn1421662] end connection 172.28.0.164:63668 (399 connections now open) 2015-10-05T04:29:28.028+0100 [mongosMain] connection accepted from 172.28.0.164:65191 #1422066 (400 connections now open) 2015-10-05T04:29:28.030+0100 [conn1422066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:28.525+0100 [mongosMain] connection accepted from 127.0.0.1:55769 #1422067 (401 connections now open) 2015-10-05T04:29:28.528+0100 [conn1422067] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:28.534+0100 [conn1422067] end connection 127.0.0.1:55769 (400 connections now open) 2015-10-05T04:29:28.995+0100 [conn1421637] end connection 172.28.0.163:54098 (399 connections now open) 2015-10-05T04:29:28.997+0100 [mongosMain] connection accepted from 172.28.0.163:55770 #1422068 (400 connections now open) 2015-10-05T04:29:28.998+0100 [conn1422068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:35.000+0100 [conn1421617] end connection 172.28.0.163:54068 (399 connections now open) 2015-10-05T04:29:35.001+0100 [mongosMain] connection accepted from 172.28.0.163:55772 #1422069 (400 connections now open) 2015-10-05T04:29:35.003+0100 [conn1422069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:38.855+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:29:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:29:39.010+0100 [conn1421564] end connection 172.28.0.163:53901 (399 connections now open) 2015-10-05T04:29:39.011+0100 [mongosMain] connection accepted from 172.28.0.163:55777 #1422070 (400 connections now open) 2015-10-05T04:29:39.012+0100 [conn1422070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:39.369+0100 [mongosMain] connection accepted from 127.0.0.1:55778 #1422071 (401 connections now open) 2015-10-05T04:29:39.372+0100 [conn1422071] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:39.377+0100 [conn1422071] end connection 127.0.0.1:55778 (400 connections now open) 2015-10-05T04:29:40.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eea35703b51053eb1d54 2015-10-05T04:29:40.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:29:52.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eeb05703b51053eb1d6f 2015-10-05T04:29:52.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:29:54.094+0100 [conn1421669] end connection 172.28.0.164:63697 (399 connections now open) 2015-10-05T04:29:54.095+0100 [mongosMain] connection accepted from 172.28.0.164:65219 #1422072 (400 connections now open) 2015-10-05T04:29:54.097+0100 [conn1422072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:55.016+0100 [conn1421625] end connection 172.28.0.163:54081 (399 connections now open) 2015-10-05T04:29:55.017+0100 [mongosMain] connection accepted from 172.28.0.163:55795 #1422073 (400 connections now open) 2015-10-05T04:29:55.018+0100 [conn1422073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:29:58.556+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:29:58.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:30:04.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eebc5703b51053eb1d99 2015-10-05T04:30:04.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:05.031+0100 [conn1421641] end connection 172.28.0.163:54106 (399 connections now open) 2015-10-05T04:30:05.033+0100 [mongosMain] connection accepted from 172.28.0.163:55838 #1422074 (400 connections now open) 2015-10-05T04:30:05.034+0100 [conn1422074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:09.026+0100 [conn1421674] end connection 172.28.0.163:54350 (399 connections now open) 2015-10-05T04:30:09.027+0100 [mongosMain] connection accepted from 172.28.0.163:55869 #1422075 (400 connections now open) 2015-10-05T04:30:09.028+0100 [conn1422075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:09.134+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:30:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:30:14.126+0100 [conn1421660] end connection 172.28.0.164:63661 (399 connections now open) 2015-10-05T04:30:14.127+0100 [mongosMain] connection accepted from 172.28.0.164:65283 #1422076 (400 connections now open) 2015-10-05T04:30:14.128+0100 [conn1422076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:15.032+0100 [conn1421679] end connection 172.28.0.163:54367 (399 connections now open) 2015-10-05T04:30:15.033+0100 [mongosMain] connection accepted from 172.28.0.163:55891 #1422077 (400 connections now open) 2015-10-05T04:30:15.034+0100 [conn1422077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:15.687+0100 [conn1421657] end connection 172.28.0.163:54219 (399 connections now open) 2015-10-05T04:30:15.688+0100 [mongosMain] connection accepted from 172.28.0.163:55892 #1422078 (400 connections now open) 2015-10-05T04:30:15.689+0100 [conn1422078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:17.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eec85703b51053eb1dc4 2015-10-05T04:30:17.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:18.058+0100 [conn1421578] end connection 172.28.0.164:63369 (399 connections now open) 2015-10-05T04:30:18.058+0100 [conn1421673] end connection 172.28.0.164:63774 (398 connections now open) 2015-10-05T04:30:18.059+0100 [mongosMain] connection accepted from 172.28.0.164:65287 #1422079 (399 connections now open) 2015-10-05T04:30:18.060+0100 [mongosMain] connection accepted from 172.28.0.164:65288 #1422080 (400 connections now open) 2015-10-05T04:30:18.061+0100 [conn1422079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:18.062+0100 [conn1422080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:19.042+0100 [conn1421666] end connection 172.28.0.163:54234 (399 connections now open) 2015-10-05T04:30:19.043+0100 [mongosMain] connection accepted from 172.28.0.163:55895 #1422081 (400 connections now open) 2015-10-05T04:30:19.044+0100 [conn1422081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:24.141+0100 [conn1421681] end connection 172.28.0.164:63833 (399 connections now open) 2015-10-05T04:30:24.142+0100 [mongosMain] connection accepted from 172.28.0.164:65298 #1422082 (400 connections now open) 2015-10-05T04:30:24.143+0100 [conn1422082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:24.594+0100 [conn1421661] end connection 172.28.0.164:63664 (399 connections now open) 2015-10-05T04:30:24.594+0100 [mongosMain] connection accepted from 172.28.0.164:65300 #1422083 (400 connections now open) 2015-10-05T04:30:24.596+0100 [conn1422083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:25.047+0100 [conn1421633] end connection 172.28.0.163:54092 (399 connections now open) 2015-10-05T04:30:25.048+0100 [mongosMain] connection accepted from 172.28.0.163:55898 #1422084 (400 connections now open) 2015-10-05T04:30:25.050+0100 [conn1422084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:25.687+0100 [conn1421685] end connection 172.28.0.163:54472 (399 connections now open) 2015-10-05T04:30:25.688+0100 [mongosMain] connection accepted from 172.28.0.163:55899 #1422085 (400 connections now open) 2015-10-05T04:30:25.689+0100 [conn1422085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:28.073+0100 [conn1421677] end connection 172.28.0.164:63797 (399 connections now open) 2015-10-05T04:30:28.074+0100 [mongosMain] connection accepted from 172.28.0.164:65306 #1422086 (400 connections now open) 2015-10-05T04:30:28.076+0100 [conn1422086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:28.858+0100 [mongosMain] connection accepted from 127.0.0.1:55901 #1422087 (401 connections now open) 2015-10-05T04:30:28.861+0100 [conn1422087] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:28.866+0100 [conn1422087] end connection 127.0.0.1:55901 (400 connections now open) 2015-10-05T04:30:29.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eed55703b51053eb1e1c 2015-10-05T04:30:29.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:34.610+0100 [conn1421689] end connection 172.28.0.164:63896 (399 connections now open) 2015-10-05T04:30:34.611+0100 [mongosMain] connection accepted from 172.28.0.164:65313 #1422088 (400 connections now open) 2015-10-05T04:30:34.613+0100 [conn1422088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:35.703+0100 [conn1421690] end connection 172.28.0.163:54480 (399 connections now open) 2015-10-05T04:30:35.704+0100 [mongosMain] connection accepted from 172.28.0.163:55907 #1422089 (400 connections now open) 2015-10-05T04:30:35.706+0100 [conn1422089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:35.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eedb5703b51053eb1e38 2015-10-05T04:30:36.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:38.073+0100 [conn1421675] end connection 172.28.0.164:63785 (399 connections now open) 2015-10-05T04:30:38.074+0100 [conn1421545] end connection 172.28.0.164:63238 (398 connections now open) 2015-10-05T04:30:38.074+0100 [mongosMain] connection accepted from 172.28.0.164:65320 #1422090 (399 connections now open) 2015-10-05T04:30:38.075+0100 [mongosMain] connection accepted from 172.28.0.164:65321 #1422091 (400 connections now open) 2015-10-05T04:30:38.077+0100 [conn1422090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:38.077+0100 [conn1422091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:39.277+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:30:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:30:39.903+0100 [mongosMain] connection accepted from 127.0.0.1:55910 #1422092 (401 connections now open) 2015-10-05T04:30:39.906+0100 [conn1422092] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:39.911+0100 [conn1422092] end connection 127.0.0.1:55910 (400 connections now open) 2015-10-05T04:30:44.157+0100 [conn1421646] end connection 172.28.0.164:63566 (399 connections now open) 2015-10-05T04:30:44.158+0100 [mongosMain] connection accepted from 172.28.0.164:65332 #1422093 (400 connections now open) 2015-10-05T04:30:44.160+0100 [conn1422093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:44.625+0100 [conn1421693] end connection 172.28.0.164:63910 (399 connections now open) 2015-10-05T04:30:44.626+0100 [mongosMain] connection accepted from 172.28.0.164:65335 #1422094 (400 connections now open) 2015-10-05T04:30:44.628+0100 [conn1422094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:45.718+0100 [conn1421694] end connection 172.28.0.163:54490 (399 connections now open) 2015-10-05T04:30:45.719+0100 [mongosMain] connection accepted from 172.28.0.163:55916 #1422095 (400 connections now open) 2015-10-05T04:30:45.720+0100 [conn1422095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:48.089+0100 [conn1421620] end connection 172.28.0.164:63499 (399 connections now open) 2015-10-05T04:30:48.090+0100 [mongosMain] connection accepted from 172.28.0.164:65340 #1422096 (400 connections now open) 2015-10-05T04:30:48.092+0100 [conn1422096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:48.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eee85703b51053eb1e7e 2015-10-05T04:30:48.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:54.173+0100 [conn1421688] end connection 172.28.0.164:63893 (399 connections now open) 2015-10-05T04:30:54.176+0100 [mongosMain] connection accepted from 172.28.0.164:65345 #1422097 (400 connections now open) 2015-10-05T04:30:54.177+0100 [conn1422097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:54.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eeee5703b51053eb1e9d 2015-10-05T04:30:54.640+0100 [conn1421697] end connection 172.28.0.164:63925 (399 connections now open) 2015-10-05T04:30:54.642+0100 [mongosMain] connection accepted from 172.28.0.164:65349 #1422098 (400 connections now open) 2015-10-05T04:30:54.643+0100 [conn1422098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:30:54.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:30:55.722+0100 [conn1421699] end connection 172.28.0.163:54503 (399 connections now open) 2015-10-05T04:30:55.723+0100 [mongosMain] connection accepted from 172.28.0.163:55928 #1422099 (400 connections now open) 2015-10-05T04:30:55.724+0100 [conn1422099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:00.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eef45703b51053eb1eb6 2015-10-05T04:31:01.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:04.188+0100 [conn1421684] end connection 172.28.0.164:63879 (399 connections now open) 2015-10-05T04:31:04.189+0100 [mongosMain] connection accepted from 172.28.0.164:65364 #1422100 (400 connections now open) 2015-10-05T04:31:04.191+0100 [conn1422100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:04.641+0100 [conn1421703] end connection 172.28.0.164:63940 (399 connections now open) 2015-10-05T04:31:04.642+0100 [mongosMain] connection accepted from 172.28.0.164:65367 #1422101 (400 connections now open) 2015-10-05T04:31:04.643+0100 [conn1422101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:05.079+0100 [conn1421682] end connection 172.28.0.163:54407 (399 connections now open) 2015-10-05T04:31:05.080+0100 [mongosMain] connection accepted from 172.28.0.163:55951 #1422102 (400 connections now open) 2015-10-05T04:31:05.081+0100 [conn1422102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:05.734+0100 [conn1421705] end connection 172.28.0.163:54518 (399 connections now open) 2015-10-05T04:31:05.735+0100 [mongosMain] connection accepted from 172.28.0.163:55952 #1422103 (400 connections now open) 2015-10-05T04:31:05.737+0100 [conn1422103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:08.105+0100 [conn1421686] end connection 172.28.0.164:63884 (399 connections now open) 2015-10-05T04:31:08.106+0100 [mongosMain] connection accepted from 172.28.0.164:65371 #1422104 (400 connections now open) 2015-10-05T04:31:08.108+0100 [conn1422104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:08.138+0100 [conn1421706] end connection 172.28.0.164:63945 (399 connections now open) 2015-10-05T04:31:08.140+0100 [mongosMain] connection accepted from 172.28.0.164:65372 #1422105 (400 connections now open) 2015-10-05T04:31:08.144+0100 [conn1422105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:09.089+0100 [conn1421670] end connection 172.28.0.163:54257 (399 connections now open) 2015-10-05T04:31:09.090+0100 [mongosMain] connection accepted from 172.28.0.163:55959 #1422106 (400 connections now open) 2015-10-05T04:31:09.091+0100 [conn1422106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:09.560+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:31:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:31:13.977+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:31:13.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:31:14.204+0100 [conn1421702] end connection 172.28.0.164:63937 (399 connections now open) 2015-10-05T04:31:14.205+0100 [mongosMain] connection accepted from 172.28.0.164:65379 #1422107 (400 connections now open) 2015-10-05T04:31:14.207+0100 [conn1422107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:14.657+0100 [conn1421708] end connection 172.28.0.164:63963 (399 connections now open) 2015-10-05T04:31:14.658+0100 [mongosMain] connection accepted from 172.28.0.164:65381 #1422108 (400 connections now open) 2015-10-05T04:31:14.660+0100 [conn1422108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:15.790+0100 [conn1421710] end connection 172.28.0.163:54561 (399 connections now open) 2015-10-05T04:31:15.790+0100 [mongosMain] connection accepted from 172.28.0.163:55969 #1422109 (400 connections now open) 2015-10-05T04:31:15.790+0100 [conn1422109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:18.130+0100 [conn1421658] end connection 172.28.0.164:63653 (399 connections now open) 2015-10-05T04:31:18.130+0100 [mongosMain] connection accepted from 172.28.0.164:65384 #1422110 (400 connections now open) 2015-10-05T04:31:18.130+0100 [conn1422110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:18.504+0100 [conn1421695] end connection 172.28.0.164:63916 (399 connections now open) 2015-10-05T04:31:18.504+0100 [mongosMain] connection accepted from 172.28.0.164:65386 #1422111 (400 connections now open) 2015-10-05T04:31:18.504+0100 [conn1422111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:19.093+0100 [conn1421671] end connection 172.28.0.163:54318 (399 connections now open) 2015-10-05T04:31:19.093+0100 [conn1421683] end connection 172.28.0.163:54432 (399 connections now open) 2015-10-05T04:31:19.101+0100 [mongosMain] connection accepted from 172.28.0.163:55975 #1422112 (399 connections now open) 2015-10-05T04:31:19.101+0100 [conn1422112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:19.102+0100 [mongosMain] connection accepted from 172.28.0.163:55976 #1422113 (400 connections now open) 2015-10-05T04:31:19.103+0100 [conn1422113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:21.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef085703b51053eb1f21 2015-10-05T04:31:21.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:24.672+0100 [conn1421714] end connection 172.28.0.164:64011 (399 connections now open) 2015-10-05T04:31:24.673+0100 [mongosMain] connection accepted from 172.28.0.164:65399 #1422114 (400 connections now open) 2015-10-05T04:31:24.675+0100 [conn1422114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:25.095+0100 [conn1421680] end connection 172.28.0.163:54376 (399 connections now open) 2015-10-05T04:31:25.096+0100 [mongosMain] connection accepted from 172.28.0.163:55985 #1422115 (400 connections now open) 2015-10-05T04:31:25.097+0100 [conn1422115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:25.750+0100 [conn1421716] end connection 172.28.0.163:54611 (399 connections now open) 2015-10-05T04:31:25.752+0100 [mongosMain] connection accepted from 172.28.0.163:55988 #1422116 (400 connections now open) 2015-10-05T04:31:25.753+0100 [conn1422116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:28.120+0100 [conn1421691] end connection 172.28.0.164:63901 (399 connections now open) 2015-10-05T04:31:28.120+0100 [conn1421604] end connection 172.28.0.164:63421 (398 connections now open) 2015-10-05T04:31:28.121+0100 [mongosMain] connection accepted from 172.28.0.164:65419 #1422117 (399 connections now open) 2015-10-05T04:31:28.121+0100 [mongosMain] connection accepted from 172.28.0.164:65420 #1422118 (400 connections now open) 2015-10-05T04:31:28.123+0100 [conn1422117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:28.123+0100 [conn1422118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:28.577+0100 [mongosMain] connection accepted from 127.0.0.1:55999 #1422119 (401 connections now open) 2015-10-05T04:31:28.579+0100 [conn1422119] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:28.584+0100 [conn1422119] end connection 127.0.0.1:55999 (400 connections now open) 2015-10-05T04:31:29.104+0100 [conn1421622] end connection 172.28.0.163:54076 (399 connections now open) 2015-10-05T04:31:29.104+0100 [conn1421687] end connection 172.28.0.163:54475 (399 connections now open) 2015-10-05T04:31:29.105+0100 [mongosMain] connection accepted from 172.28.0.163:56001 #1422120 (399 connections now open) 2015-10-05T04:31:29.106+0100 [mongosMain] connection accepted from 172.28.0.163:56002 #1422121 (400 connections now open) 2015-10-05T04:31:29.106+0100 [conn1422120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:29.107+0100 [conn1422121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:34.235+0100 [conn1421721] end connection 172.28.0.164:64025 (399 connections now open) 2015-10-05T04:31:34.236+0100 [mongosMain] connection accepted from 172.28.0.164:65453 #1422122 (400 connections now open) 2015-10-05T04:31:34.238+0100 [conn1422122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:34.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef165703b51053eb1f5e 2015-10-05T04:31:34.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:34.688+0100 [conn1421722] end connection 172.28.0.164:64027 (399 connections now open) 2015-10-05T04:31:34.689+0100 [mongosMain] connection accepted from 172.28.0.164:65461 #1422123 (400 connections now open) 2015-10-05T04:31:34.690+0100 [conn1422123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:35.111+0100 [conn1421715] end connection 172.28.0.163:54609 (399 connections now open) 2015-10-05T04:31:35.112+0100 [mongosMain] connection accepted from 172.28.0.163:56030 #1422124 (400 connections now open) 2015-10-05T04:31:35.113+0100 [conn1422124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:35.750+0100 [conn1421724] end connection 172.28.0.163:54623 (399 connections now open) 2015-10-05T04:31:35.752+0100 [mongosMain] connection accepted from 172.28.0.163:56034 #1422125 (400 connections now open) 2015-10-05T04:31:35.753+0100 [conn1422125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:38.136+0100 [conn1421718] end connection 172.28.0.164:64016 (399 connections now open) 2015-10-05T04:31:38.137+0100 [mongosMain] connection accepted from 172.28.0.164:65473 #1422126 (400 connections now open) 2015-10-05T04:31:38.138+0100 [conn1422126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:38.150+0100 [conn1421612] end connection 172.28.0.164:63470 (399 connections now open) 2015-10-05T04:31:38.151+0100 [mongosMain] connection accepted from 172.28.0.164:65474 #1422127 (400 connections now open) 2015-10-05T04:31:38.153+0100 [conn1422127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:39.104+0100 [conn1421712] end connection 172.28.0.163:54587 (399 connections now open) 2015-10-05T04:31:39.104+0100 [conn1421701] end connection 172.28.0.163:54509 (398 connections now open) 2015-10-05T04:31:39.106+0100 [mongosMain] connection accepted from 172.28.0.163:56038 #1422128 (399 connections now open) 2015-10-05T04:31:39.107+0100 [mongosMain] connection accepted from 172.28.0.163:56039 #1422129 (400 connections now open) 2015-10-05T04:31:39.107+0100 [conn1422128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:39.108+0100 [conn1422129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:39.609+0100 [mongosMain] connection accepted from 127.0.0.1:56041 #1422130 (401 connections now open) 2015-10-05T04:31:39.612+0100 [conn1422130] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:39.617+0100 [conn1422130] end connection 127.0.0.1:56041 (400 connections now open) 2015-10-05T04:31:39.856+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:31:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:31:40.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef1c5703b51053eb1f70 2015-10-05T04:31:40.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:44.703+0100 [conn1421731] end connection 172.28.0.164:64045 (399 connections now open) 2015-10-05T04:31:44.704+0100 [mongosMain] connection accepted from 172.28.0.164:65484 #1422131 (400 connections now open) 2015-10-05T04:31:44.706+0100 [conn1422131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:45.114+0100 [conn1421698] end connection 172.28.0.163:54500 (399 connections now open) 2015-10-05T04:31:45.115+0100 [mongosMain] connection accepted from 172.28.0.163:56047 #1422132 (400 connections now open) 2015-10-05T04:31:45.117+0100 [conn1422132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:45.766+0100 [conn1421733] end connection 172.28.0.163:54632 (399 connections now open) 2015-10-05T04:31:45.767+0100 [mongosMain] connection accepted from 172.28.0.163:56049 #1422133 (400 connections now open) 2015-10-05T04:31:45.768+0100 [conn1422133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:47.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef225703b51053eb1f85 2015-10-05T04:31:47.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:48.136+0100 [conn1421700] end connection 172.28.0.164:63932 (399 connections now open) 2015-10-05T04:31:48.137+0100 [mongosMain] connection accepted from 172.28.0.164:65490 #1422134 (400 connections now open) 2015-10-05T04:31:48.139+0100 [conn1422134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:49.120+0100 [conn1421720] end connection 172.28.0.163:54616 (399 connections now open) 2015-10-05T04:31:49.120+0100 [conn1421580] end connection 172.28.0.163:53945 (398 connections now open) 2015-10-05T04:31:49.122+0100 [mongosMain] connection accepted from 172.28.0.163:56055 #1422135 (399 connections now open) 2015-10-05T04:31:49.123+0100 [mongosMain] connection accepted from 172.28.0.163:56058 #1422136 (400 connections now open) 2015-10-05T04:31:49.124+0100 [conn1422135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:49.124+0100 [conn1422136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:53.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef295703b51053eb1f9a 2015-10-05T04:31:53.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:31:54.719+0100 [conn1421740] end connection 172.28.0.164:64065 (399 connections now open) 2015-10-05T04:31:54.720+0100 [mongosMain] connection accepted from 172.28.0.164:65497 #1422137 (400 connections now open) 2015-10-05T04:31:54.722+0100 [conn1422137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:55.126+0100 [conn1421709] end connection 172.28.0.163:54553 (399 connections now open) 2015-10-05T04:31:55.127+0100 [mongosMain] connection accepted from 172.28.0.163:56064 #1422138 (400 connections now open) 2015-10-05T04:31:55.128+0100 [conn1422138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:31:55.766+0100 [conn1421742] end connection 172.28.0.163:54647 (399 connections now open) 2015-10-05T04:31:55.767+0100 [mongosMain] connection accepted from 172.28.0.163:56067 #1422139 (400 connections now open) 2015-10-05T04:31:55.768+0100 [conn1422139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:00.658+0100 [conn1421711] end connection 172.28.0.164:63989 (399 connections now open) 2015-10-05T04:32:00.663+0100 [mongosMain] connection accepted from 172.28.0.164:65502 #1422140 (400 connections now open) 2015-10-05T04:32:00.665+0100 [conn1422140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:04.252+0100 [conn1421713] end connection 172.28.0.164:64009 (399 connections now open) 2015-10-05T04:32:04.253+0100 [mongosMain] connection accepted from 172.28.0.164:65508 #1422141 (400 connections now open) 2015-10-05T04:32:04.255+0100 [conn1422141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:04.720+0100 [conn1421747] end connection 172.28.0.164:64082 (399 connections now open) 2015-10-05T04:32:04.721+0100 [mongosMain] connection accepted from 172.28.0.164:65511 #1422142 (400 connections now open) 2015-10-05T04:32:04.723+0100 [conn1422142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:05.127+0100 [conn1421741] end connection 172.28.0.163:54644 (399 connections now open) 2015-10-05T04:32:05.128+0100 [mongosMain] connection accepted from 172.28.0.163:56093 #1422143 (400 connections now open) 2015-10-05T04:32:05.129+0100 [conn1422143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:05.782+0100 [conn1421749] end connection 172.28.0.163:54664 (399 connections now open) 2015-10-05T04:32:05.784+0100 [mongosMain] connection accepted from 172.28.0.163:56098 #1422144 (400 connections now open) 2015-10-05T04:32:05.785+0100 [conn1422144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:06.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef365703b51053eb1fcc 2015-10-05T04:32:06.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:08.151+0100 [conn1421725] end connection 172.28.0.164:64035 (399 connections now open) 2015-10-05T04:32:08.152+0100 [conn1421744] end connection 172.28.0.164:64074 (398 connections now open) 2015-10-05T04:32:08.153+0100 [mongosMain] connection accepted from 172.28.0.164:65527 #1422145 (399 connections now open) 2015-10-05T04:32:08.153+0100 [mongosMain] connection accepted from 172.28.0.164:65528 #1422146 (400 connections now open) 2015-10-05T04:32:08.154+0100 [conn1422145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:08.154+0100 [conn1422146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:10.121+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:32:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:32:13.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef3c5703b51053eb1fde 2015-10-05T04:32:13.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:14.266+0100 [conn1421746] end connection 172.28.0.164:64080 (399 connections now open) 2015-10-05T04:32:14.267+0100 [mongosMain] connection accepted from 172.28.0.164:49191 #1422147 (400 connections now open) 2015-10-05T04:32:14.269+0100 [conn1422147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:14.735+0100 [conn1421752] end connection 172.28.0.164:64103 (399 connections now open) 2015-10-05T04:32:14.737+0100 [mongosMain] connection accepted from 172.28.0.164:49202 #1422148 (400 connections now open) 2015-10-05T04:32:14.739+0100 [conn1422148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:15.142+0100 [conn1421723] end connection 172.28.0.163:54622 (399 connections now open) 2015-10-05T04:32:15.143+0100 [mongosMain] connection accepted from 172.28.0.163:56150 #1422149 (400 connections now open) 2015-10-05T04:32:15.144+0100 [conn1422149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:15.797+0100 [conn1421754] end connection 172.28.0.163:54706 (399 connections now open) 2015-10-05T04:32:15.798+0100 [mongosMain] connection accepted from 172.28.0.163:56153 #1422150 (400 connections now open) 2015-10-05T04:32:15.799+0100 [conn1422150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:18.167+0100 [conn1421734] end connection 172.28.0.164:64052 (399 connections now open) 2015-10-05T04:32:18.167+0100 [conn1421726] end connection 172.28.0.164:64034 (399 connections now open) 2015-10-05T04:32:18.167+0100 [mongosMain] connection accepted from 172.28.0.164:49209 #1422151 (399 connections now open) 2015-10-05T04:32:18.168+0100 [mongosMain] connection accepted from 172.28.0.164:49210 #1422152 (400 connections now open) 2015-10-05T04:32:18.169+0100 [conn1422151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:18.170+0100 [conn1422152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:19.151+0100 [conn1421728] end connection 172.28.0.163:54626 (399 connections now open) 2015-10-05T04:32:19.152+0100 [mongosMain] connection accepted from 172.28.0.163:56156 #1422153 (400 connections now open) 2015-10-05T04:32:19.154+0100 [conn1422153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:19.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef435703b51053eb1ff4 2015-10-05T04:32:19.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:24.267+0100 [conn1421707] end connection 172.28.0.164:63960 (399 connections now open) 2015-10-05T04:32:24.268+0100 [mongosMain] connection accepted from 172.28.0.164:49218 #1422154 (400 connections now open) 2015-10-05T04:32:24.270+0100 [conn1422154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:24.735+0100 [conn1421760] end connection 172.28.0.164:64166 (399 connections now open) 2015-10-05T04:32:24.736+0100 [mongosMain] connection accepted from 172.28.0.164:49220 #1422155 (400 connections now open) 2015-10-05T04:32:24.738+0100 [conn1422155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:25.149+0100 [conn1421704] end connection 172.28.0.163:54515 (399 connections now open) 2015-10-05T04:32:25.150+0100 [mongosMain] connection accepted from 172.28.0.163:56162 #1422156 (400 connections now open) 2015-10-05T04:32:25.151+0100 [conn1422156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:25.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef495703b51053eb2007 2015-10-05T04:32:25.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:25.804+0100 [conn1421762] end connection 172.28.0.163:54764 (399 connections now open) 2015-10-05T04:32:25.805+0100 [mongosMain] connection accepted from 172.28.0.163:56164 #1422157 (400 connections now open) 2015-10-05T04:32:25.807+0100 [conn1422157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:28.183+0100 [conn1421743] end connection 172.28.0.164:64073 (399 connections now open) 2015-10-05T04:32:28.183+0100 [conn1421735] end connection 172.28.0.164:64053 (399 connections now open) 2015-10-05T04:32:28.185+0100 [mongosMain] connection accepted from 172.28.0.164:49227 #1422158 (399 connections now open) 2015-10-05T04:32:28.186+0100 [mongosMain] connection accepted from 172.28.0.164:49228 #1422159 (400 connections now open) 2015-10-05T04:32:28.187+0100 [conn1422158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:28.188+0100 [conn1422159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:28.884+0100 [mongosMain] connection accepted from 127.0.0.1:56166 #1422160 (401 connections now open) 2015-10-05T04:32:28.887+0100 [conn1422160] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:28.892+0100 [conn1422160] end connection 127.0.0.1:56166 (400 connections now open) 2015-10-05T04:32:29.154+0100 [conn1421758] end connection 172.28.0.163:54732 (399 connections now open) 2015-10-05T04:32:29.154+0100 [conn1421672] end connection 172.28.0.163:54319 (398 connections now open) 2015-10-05T04:32:29.155+0100 [mongosMain] connection accepted from 172.28.0.163:56167 #1422161 (399 connections now open) 2015-10-05T04:32:29.156+0100 [mongosMain] connection accepted from 172.28.0.163:56168 #1422162 (400 connections now open) 2015-10-05T04:32:29.157+0100 [conn1422162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:29.157+0100 [conn1422161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:31.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef4f5703b51053eb2021 2015-10-05T04:32:31.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:34.283+0100 [conn1421730] end connection 172.28.0.164:64043 (399 connections now open) 2015-10-05T04:32:34.284+0100 [mongosMain] connection accepted from 172.28.0.164:49236 #1422163 (400 connections now open) 2015-10-05T04:32:34.286+0100 [conn1422163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:34.751+0100 [conn1421767] end connection 172.28.0.164:64182 (399 connections now open) 2015-10-05T04:32:34.752+0100 [mongosMain] connection accepted from 172.28.0.164:49239 #1422164 (400 connections now open) 2015-10-05T04:32:34.754+0100 [conn1422164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:35.158+0100 [conn1421732] end connection 172.28.0.163:54630 (399 connections now open) 2015-10-05T04:32:35.159+0100 [mongosMain] connection accepted from 172.28.0.163:56171 #1422165 (400 connections now open) 2015-10-05T04:32:35.161+0100 [conn1422165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:35.813+0100 [conn1421769] end connection 172.28.0.163:54775 (399 connections now open) 2015-10-05T04:32:35.814+0100 [mongosMain] connection accepted from 172.28.0.163:56173 #1422166 (400 connections now open) 2015-10-05T04:32:35.816+0100 [conn1422166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:38.126+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef555703b51053eb202b 2015-10-05T04:32:38.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:38.199+0100 [conn1421537] end connection 172.28.0.164:63219 (399 connections now open) 2015-10-05T04:32:38.199+0100 [conn1421756] end connection 172.28.0.164:64126 (398 connections now open) 2015-10-05T04:32:38.200+0100 [mongosMain] connection accepted from 172.28.0.164:49246 #1422167 (399 connections now open) 2015-10-05T04:32:38.201+0100 [mongosMain] connection accepted from 172.28.0.164:49248 #1422168 (400 connections now open) 2015-10-05T04:32:38.202+0100 [conn1422167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:38.203+0100 [conn1422168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:39.167+0100 [conn1421737] end connection 172.28.0.163:54636 (399 connections now open) 2015-10-05T04:32:39.168+0100 [conn1421745] end connection 172.28.0.163:54653 (398 connections now open) 2015-10-05T04:32:39.169+0100 [mongosMain] connection accepted from 172.28.0.163:56175 #1422169 (399 connections now open) 2015-10-05T04:32:39.169+0100 [mongosMain] connection accepted from 172.28.0.163:56176 #1422170 (400 connections now open) 2015-10-05T04:32:39.170+0100 [conn1422169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:39.170+0100 [conn1422170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:40.023+0100 [mongosMain] connection accepted from 127.0.0.1:56179 #1422171 (401 connections now open) 2015-10-05T04:32:40.026+0100 [conn1422171] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:40.030+0100 [conn1422171] end connection 127.0.0.1:56179 (400 connections now open) 2015-10-05T04:32:40.276+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:32:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:32:44.282+0100 [conn1421759] end connection 172.28.0.164:64162 (399 connections now open) 2015-10-05T04:32:44.283+0100 [mongosMain] connection accepted from 172.28.0.164:49257 #1422172 (400 connections now open) 2015-10-05T04:32:44.286+0100 [conn1422172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:44.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef5c5703b51053eb2044 2015-10-05T04:32:44.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:44.750+0100 [conn1421775] end connection 172.28.0.164:64198 (399 connections now open) 2015-10-05T04:32:44.751+0100 [mongosMain] connection accepted from 172.28.0.164:49260 #1422173 (400 connections now open) 2015-10-05T04:32:44.753+0100 [conn1422173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:45.174+0100 [conn1421748] end connection 172.28.0.163:54661 (399 connections now open) 2015-10-05T04:32:45.175+0100 [mongosMain] connection accepted from 172.28.0.163:56185 #1422174 (400 connections now open) 2015-10-05T04:32:45.176+0100 [conn1422174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:45.814+0100 [conn1421777] end connection 172.28.0.163:54785 (399 connections now open) 2015-10-05T04:32:45.815+0100 [mongosMain] connection accepted from 172.28.0.163:56189 #1422175 (400 connections now open) 2015-10-05T04:32:45.816+0100 [conn1422175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:48.214+0100 [conn1421763] end connection 172.28.0.164:64170 (399 connections now open) 2015-10-05T04:32:48.214+0100 [conn1421755] end connection 172.28.0.164:64127 (399 connections now open) 2015-10-05T04:32:48.215+0100 [mongosMain] connection accepted from 172.28.0.164:49271 #1422176 (399 connections now open) 2015-10-05T04:32:48.216+0100 [mongosMain] connection accepted from 172.28.0.164:49272 #1422177 (400 connections now open) 2015-10-05T04:32:48.217+0100 [conn1422176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:48.217+0100 [conn1422177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:49.168+0100 [conn1421598] end connection 172.28.0.163:53973 (399 connections now open) 2015-10-05T04:32:49.168+0100 [conn1421765] end connection 172.28.0.163:54768 (399 connections now open) 2015-10-05T04:32:49.169+0100 [mongosMain] connection accepted from 172.28.0.163:56194 #1422178 (399 connections now open) 2015-10-05T04:32:49.169+0100 [mongosMain] connection accepted from 172.28.0.163:56195 #1422179 (400 connections now open) 2015-10-05T04:32:49.170+0100 [conn1422178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:49.170+0100 [conn1422179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:50.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef625703b51053eb2064 2015-10-05T04:32:51.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:54.299+0100 [conn1421751] end connection 172.28.0.164:64101 (399 connections now open) 2015-10-05T04:32:54.300+0100 [mongosMain] connection accepted from 172.28.0.164:49279 #1422180 (400 connections now open) 2015-10-05T04:32:54.302+0100 [conn1422180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:54.767+0100 [conn1421784] end connection 172.28.0.164:64217 (399 connections now open) 2015-10-05T04:32:54.768+0100 [mongosMain] connection accepted from 172.28.0.164:49281 #1422181 (400 connections now open) 2015-10-05T04:32:54.770+0100 [conn1422181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:55.174+0100 [conn1421761] end connection 172.28.0.163:54761 (399 connections now open) 2015-10-05T04:32:55.175+0100 [mongosMain] connection accepted from 172.28.0.163:56202 #1422182 (400 connections now open) 2015-10-05T04:32:55.176+0100 [conn1422182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:55.829+0100 [conn1421786] end connection 172.28.0.163:54798 (399 connections now open) 2015-10-05T04:32:55.830+0100 [mongosMain] connection accepted from 172.28.0.163:56205 #1422183 (400 connections now open) 2015-10-05T04:32:55.831+0100 [conn1422183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:57.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef695703b51053eb207a 2015-10-05T04:32:57.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:32:58.230+0100 [conn1421770] end connection 172.28.0.164:64188 (399 connections now open) 2015-10-05T04:32:58.230+0100 [conn1421779] end connection 172.28.0.164:64207 (398 connections now open) 2015-10-05T04:32:58.231+0100 [mongosMain] connection accepted from 172.28.0.164:49286 #1422184 (399 connections now open) 2015-10-05T04:32:58.231+0100 [mongosMain] connection accepted from 172.28.0.164:49287 #1422185 (400 connections now open) 2015-10-05T04:32:58.233+0100 [conn1422184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:58.234+0100 [conn1422185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:59.183+0100 [conn1421736] end connection 172.28.0.163:54635 (399 connections now open) 2015-10-05T04:32:59.183+0100 [conn1421772] end connection 172.28.0.163:54777 (399 connections now open) 2015-10-05T04:32:59.184+0100 [mongosMain] connection accepted from 172.28.0.163:56211 #1422186 (399 connections now open) 2015-10-05T04:32:59.185+0100 [mongosMain] connection accepted from 172.28.0.163:56210 #1422187 (400 connections now open) 2015-10-05T04:32:59.185+0100 [conn1422186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:32:59.185+0100 [conn1422187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:03.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef6f5703b51053eb20a1 2015-10-05T04:33:03.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:04.299+0100 [conn1421739] end connection 172.28.0.164:64063 (399 connections now open) 2015-10-05T04:33:04.301+0100 [mongosMain] connection accepted from 172.28.0.164:49310 #1422188 (400 connections now open) 2015-10-05T04:33:04.303+0100 [conn1422188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:04.767+0100 [conn1421792] end connection 172.28.0.164:64234 (399 connections now open) 2015-10-05T04:33:04.768+0100 [mongosMain] connection accepted from 172.28.0.164:49316 #1422189 (400 connections now open) 2015-10-05T04:33:04.769+0100 [conn1422189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:05.190+0100 [conn1421753] end connection 172.28.0.163:54699 (399 connections now open) 2015-10-05T04:33:05.191+0100 [mongosMain] connection accepted from 172.28.0.163:56250 #1422190 (400 connections now open) 2015-10-05T04:33:05.192+0100 [conn1422190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:05.829+0100 [conn1421794] end connection 172.28.0.163:54816 (399 connections now open) 2015-10-05T04:33:05.830+0100 [mongosMain] connection accepted from 172.28.0.163:56255 #1422191 (400 connections now open) 2015-10-05T04:33:05.831+0100 [conn1422191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:08.230+0100 [conn1421796] end connection 172.28.0.164:64241 (399 connections now open) 2015-10-05T04:33:08.231+0100 [conn1421771] end connection 172.28.0.164:64189 (398 connections now open) 2015-10-05T04:33:08.232+0100 [mongosMain] connection accepted from 172.28.0.164:49338 #1422192 (399 connections now open) 2015-10-05T04:33:08.232+0100 [mongosMain] connection accepted from 172.28.0.164:49339 #1422193 (400 connections now open) 2015-10-05T04:33:08.234+0100 [conn1422192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:08.234+0100 [conn1422193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:09.184+0100 [conn1421645] end connection 172.28.0.163:54116 (399 connections now open) 2015-10-05T04:33:09.185+0100 [mongosMain] connection accepted from 172.28.0.163:56276 #1422194 (400 connections now open) 2015-10-05T04:33:09.187+0100 [conn1422194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:09.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef755703b51053eb20c4 2015-10-05T04:33:09.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:10.569+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:33:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:33:14.315+0100 [conn1421783] end connection 172.28.0.164:64214 (399 connections now open) 2015-10-05T04:33:14.317+0100 [mongosMain] connection accepted from 172.28.0.164:49357 #1422195 (400 connections now open) 2015-10-05T04:33:14.319+0100 [conn1422195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:14.782+0100 [conn1421800] end connection 172.28.0.164:64258 (399 connections now open) 2015-10-05T04:33:14.784+0100 [mongosMain] connection accepted from 172.28.0.164:49359 #1422196 (400 connections now open) 2015-10-05T04:33:14.785+0100 [conn1422196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:15.190+0100 [conn1421768] end connection 172.28.0.163:54774 (399 connections now open) 2015-10-05T04:33:15.191+0100 [mongosMain] connection accepted from 172.28.0.163:56286 #1422197 (400 connections now open) 2015-10-05T04:33:15.192+0100 [conn1422197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:15.845+0100 [conn1421802] end connection 172.28.0.163:54857 (399 connections now open) 2015-10-05T04:33:15.846+0100 [mongosMain] connection accepted from 172.28.0.163:56289 #1422198 (400 connections now open) 2015-10-05T04:33:15.848+0100 [conn1422198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:16.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef7b5703b51053eb20d8 2015-10-05T04:33:16.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:18.246+0100 [conn1421764] end connection 172.28.0.164:64172 (399 connections now open) 2015-10-05T04:33:18.246+0100 [conn1421787] end connection 172.28.0.164:64224 (399 connections now open) 2015-10-05T04:33:18.247+0100 [mongosMain] connection accepted from 172.28.0.164:49364 #1422199 (399 connections now open) 2015-10-05T04:33:18.247+0100 [mongosMain] connection accepted from 172.28.0.164:49363 #1422200 (400 connections now open) 2015-10-05T04:33:18.249+0100 [conn1422199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:18.249+0100 [conn1422200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:19.198+0100 [conn1421766] end connection 172.28.0.163:54769 (399 connections now open) 2015-10-05T04:33:19.198+0100 [conn1421789] end connection 172.28.0.163:54804 (398 connections now open) 2015-10-05T04:33:19.199+0100 [mongosMain] connection accepted from 172.28.0.163:56292 #1422201 (399 connections now open) 2015-10-05T04:33:19.200+0100 [mongosMain] connection accepted from 172.28.0.163:56293 #1422202 (400 connections now open) 2015-10-05T04:33:19.201+0100 [conn1422201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:19.201+0100 [conn1422202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:22.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef825703b51053eb20f0 2015-10-05T04:33:22.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:24.315+0100 [conn1421791] end connection 172.28.0.164:64231 (399 connections now open) 2015-10-05T04:33:24.316+0100 [mongosMain] connection accepted from 172.28.0.164:49373 #1422203 (400 connections now open) 2015-10-05T04:33:24.318+0100 [conn1422203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:24.782+0100 [conn1421807] end connection 172.28.0.164:64314 (399 connections now open) 2015-10-05T04:33:24.784+0100 [mongosMain] connection accepted from 172.28.0.164:49375 #1422204 (400 connections now open) 2015-10-05T04:33:24.786+0100 [conn1422204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:25.205+0100 [conn1421776] end connection 172.28.0.163:54783 (399 connections now open) 2015-10-05T04:33:25.208+0100 [mongosMain] connection accepted from 172.28.0.163:56297 #1422205 (400 connections now open) 2015-10-05T04:33:25.210+0100 [conn1422205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:25.860+0100 [conn1421809] end connection 172.28.0.163:54909 (399 connections now open) 2015-10-05T04:33:25.861+0100 [mongosMain] connection accepted from 172.28.0.163:56299 #1422206 (400 connections now open) 2015-10-05T04:33:25.862+0100 [conn1422206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:28.246+0100 [conn1421804] end connection 172.28.0.164:64283 (399 connections now open) 2015-10-05T04:33:28.248+0100 [mongosMain] connection accepted from 172.28.0.164:49382 #1422207 (400 connections now open) 2015-10-05T04:33:28.249+0100 [conn1422207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:28.820+0100 [mongosMain] connection accepted from 127.0.0.1:56301 #1422208 (401 connections now open) 2015-10-05T04:33:28.823+0100 [conn1422208] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:28.828+0100 [conn1422208] end connection 127.0.0.1:56301 (400 connections now open) 2015-10-05T04:33:29.011+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef885703b51053eb2102 2015-10-05T04:33:29.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:29.199+0100 [conn1421781] end connection 172.28.0.163:54788 (399 connections now open) 2015-10-05T04:33:29.199+0100 [conn1421719] end connection 172.28.0.163:54615 (399 connections now open) 2015-10-05T04:33:29.200+0100 [mongosMain] connection accepted from 172.28.0.163:56302 #1422209 (399 connections now open) 2015-10-05T04:33:29.200+0100 [mongosMain] connection accepted from 172.28.0.163:56303 #1422210 (400 connections now open) 2015-10-05T04:33:29.201+0100 [conn1422209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:29.201+0100 [conn1422210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:34.330+0100 [conn1421799] end connection 172.28.0.164:64254 (399 connections now open) 2015-10-05T04:33:34.331+0100 [mongosMain] connection accepted from 172.28.0.164:49389 #1422211 (400 connections now open) 2015-10-05T04:33:34.333+0100 [conn1422211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:34.798+0100 [conn1421815] end connection 172.28.0.164:64330 (399 connections now open) 2015-10-05T04:33:34.799+0100 [mongosMain] connection accepted from 172.28.0.164:49392 #1422212 (400 connections now open) 2015-10-05T04:33:34.802+0100 [conn1422212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:35.208+0100 [conn1421808] end connection 172.28.0.163:54907 (399 connections now open) 2015-10-05T04:33:35.210+0100 [mongosMain] connection accepted from 172.28.0.163:56306 #1422213 (400 connections now open) 2015-10-05T04:33:35.211+0100 [conn1422213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:35.262+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:33:35.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:33:35.861+0100 [conn1421817] end connection 172.28.0.163:54921 (399 connections now open) 2015-10-05T04:33:35.863+0100 [mongosMain] connection accepted from 172.28.0.163:56307 #1422214 (400 connections now open) 2015-10-05T04:33:35.864+0100 [conn1422214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:38.246+0100 [conn1421778] end connection 172.28.0.164:64205 (399 connections now open) 2015-10-05T04:33:38.247+0100 [mongosMain] connection accepted from 172.28.0.164:49400 #1422215 (400 connections now open) 2015-10-05T04:33:38.252+0100 [conn1422215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:39.215+0100 [conn1421797] end connection 172.28.0.163:54819 (399 connections now open) 2015-10-05T04:33:39.215+0100 [conn1421773] end connection 172.28.0.163:54778 (399 connections now open) 2015-10-05T04:33:39.216+0100 [mongosMain] connection accepted from 172.28.0.163:56311 #1422216 (399 connections now open) 2015-10-05T04:33:39.216+0100 [mongosMain] connection accepted from 172.28.0.163:56312 #1422217 (400 connections now open) 2015-10-05T04:33:39.217+0100 [conn1422216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:39.217+0100 [conn1422217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:40.076+0100 [mongosMain] connection accepted from 127.0.0.1:56315 #1422218 (401 connections now open) 2015-10-05T04:33:40.079+0100 [conn1422218] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:40.083+0100 [conn1422218] end connection 127.0.0.1:56315 (400 connections now open) 2015-10-05T04:33:40.863+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:33:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:33:41.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ef955703b51053eb212f 2015-10-05T04:33:41.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:44.330+0100 [conn1421806] end connection 172.28.0.164:64312 (399 connections now open) 2015-10-05T04:33:44.331+0100 [mongosMain] connection accepted from 172.28.0.164:49410 #1422219 (400 connections now open) 2015-10-05T04:33:44.333+0100 [conn1422219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:44.798+0100 [conn1421824] end connection 172.28.0.164:64348 (399 connections now open) 2015-10-05T04:33:44.800+0100 [mongosMain] connection accepted from 172.28.0.164:49412 #1422220 (400 connections now open) 2015-10-05T04:33:44.801+0100 [conn1422220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:45.221+0100 [conn1421785] end connection 172.28.0.163:54797 (399 connections now open) 2015-10-05T04:33:45.222+0100 [mongosMain] connection accepted from 172.28.0.163:56321 #1422221 (400 connections now open) 2015-10-05T04:33:45.223+0100 [conn1422221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:45.876+0100 [conn1421826] end connection 172.28.0.163:54930 (399 connections now open) 2015-10-05T04:33:45.877+0100 [mongosMain] connection accepted from 172.28.0.163:56323 #1422222 (400 connections now open) 2015-10-05T04:33:45.878+0100 [conn1422222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:48.261+0100 [conn1421811] end connection 172.28.0.164:64319 (399 connections now open) 2015-10-05T04:33:48.263+0100 [mongosMain] connection accepted from 172.28.0.164:49419 #1422223 (400 connections now open) 2015-10-05T04:33:48.265+0100 [conn1422223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:49.230+0100 [conn1421812] end connection 172.28.0.163:54913 (399 connections now open) 2015-10-05T04:33:49.230+0100 [conn1421790] end connection 172.28.0.163:54805 (398 connections now open) 2015-10-05T04:33:49.231+0100 [mongosMain] connection accepted from 172.28.0.163:56330 #1422224 (399 connections now open) 2015-10-05T04:33:49.231+0100 [mongosMain] connection accepted from 172.28.0.163:56331 #1422225 (400 connections now open) 2015-10-05T04:33:49.232+0100 [conn1422224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:49.232+0100 [conn1422225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:53.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efa15703b51053eb2150 2015-10-05T04:33:53.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:33:54.814+0100 [conn1421833] end connection 172.28.0.164:64367 (399 connections now open) 2015-10-05T04:33:54.815+0100 [mongosMain] connection accepted from 172.28.0.164:49427 #1422226 (400 connections now open) 2015-10-05T04:33:54.817+0100 [conn1422226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:55.237+0100 [conn1421816] end connection 172.28.0.163:54919 (399 connections now open) 2015-10-05T04:33:55.239+0100 [mongosMain] connection accepted from 172.28.0.163:56340 #1422227 (400 connections now open) 2015-10-05T04:33:55.240+0100 [conn1422227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:55.877+0100 [conn1421835] end connection 172.28.0.163:54946 (399 connections now open) 2015-10-05T04:33:55.879+0100 [mongosMain] connection accepted from 172.28.0.163:56341 #1422228 (400 connections now open) 2015-10-05T04:33:55.880+0100 [conn1422228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:58.277+0100 [conn1421819] end connection 172.28.0.164:64337 (399 connections now open) 2015-10-05T04:33:58.278+0100 [mongosMain] connection accepted from 172.28.0.164:49431 #1422229 (400 connections now open) 2015-10-05T04:33:58.280+0100 [conn1422229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:59.233+0100 [conn1421830] end connection 172.28.0.163:54935 (399 connections now open) 2015-10-05T04:33:59.233+0100 [conn1421780] end connection 172.28.0.163:54787 (398 connections now open) 2015-10-05T04:33:59.234+0100 [mongosMain] connection accepted from 172.28.0.163:56347 #1422230 (399 connections now open) 2015-10-05T04:33:59.235+0100 [conn1422230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:33:59.236+0100 [mongosMain] connection accepted from 172.28.0.163:56349 #1422231 (400 connections now open) 2015-10-05T04:33:59.237+0100 [conn1422231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:04.830+0100 [conn1421841] end connection 172.28.0.164:64384 (399 connections now open) 2015-10-05T04:34:04.832+0100 [mongosMain] connection accepted from 172.28.0.164:49459 #1422232 (400 connections now open) 2015-10-05T04:34:04.833+0100 [conn1422232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:05.237+0100 [conn1421801] end connection 172.28.0.163:54851 (399 connections now open) 2015-10-05T04:34:05.238+0100 [mongosMain] connection accepted from 172.28.0.163:56388 #1422233 (400 connections now open) 2015-10-05T04:34:05.239+0100 [conn1422233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:05.892+0100 [conn1421842] end connection 172.28.0.163:54966 (399 connections now open) 2015-10-05T04:34:05.893+0100 [mongosMain] connection accepted from 172.28.0.163:56392 #1422234 (400 connections now open) 2015-10-05T04:34:05.894+0100 [conn1422234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:06.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efad5703b51053eb219c 2015-10-05T04:34:06.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:08.293+0100 [conn1421845] end connection 172.28.0.164:64389 (399 connections now open) 2015-10-05T04:34:08.294+0100 [mongosMain] connection accepted from 172.28.0.164:49481 #1422235 (400 connections now open) 2015-10-05T04:34:08.295+0100 [conn1422235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:09.246+0100 [conn1421757] end connection 172.28.0.163:54731 (399 connections now open) 2015-10-05T04:34:09.247+0100 [conn1421821] end connection 172.28.0.163:54924 (399 connections now open) 2015-10-05T04:34:09.247+0100 [mongosMain] connection accepted from 172.28.0.163:56420 #1422236 (399 connections now open) 2015-10-05T04:34:09.248+0100 [mongosMain] connection accepted from 172.28.0.163:56421 #1422237 (400 connections now open) 2015-10-05T04:34:09.248+0100 [conn1422236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:09.249+0100 [conn1422237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:11.143+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:34:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:34:12.511+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:34:12.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:34:14.362+0100 [conn1421814] end connection 172.28.0.164:64327 (399 connections now open) 2015-10-05T04:34:14.363+0100 [mongosMain] connection accepted from 172.28.0.164:49494 #1422238 (400 connections now open) 2015-10-05T04:34:14.365+0100 [conn1422238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:14.830+0100 [conn1421849] end connection 172.28.0.164:64412 (399 connections now open) 2015-10-05T04:34:14.831+0100 [mongosMain] connection accepted from 172.28.0.164:49496 #1422239 (400 connections now open) 2015-10-05T04:34:14.833+0100 [conn1422239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:15.252+0100 [conn1421793] end connection 172.28.0.163:54812 (399 connections now open) 2015-10-05T04:34:15.253+0100 [mongosMain] connection accepted from 172.28.0.163:56435 #1422240 (400 connections now open) 2015-10-05T04:34:15.254+0100 [conn1422240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:15.892+0100 [conn1421851] end connection 172.28.0.163:55002 (399 connections now open) 2015-10-05T04:34:15.893+0100 [mongosMain] connection accepted from 172.28.0.163:56436 #1422241 (400 connections now open) 2015-10-05T04:34:15.894+0100 [conn1422241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:18.309+0100 [conn1421836] end connection 172.28.0.164:64373 (399 connections now open) 2015-10-05T04:34:18.309+0100 [conn1421788] end connection 172.28.0.164:64225 (399 connections now open) 2015-10-05T04:34:18.310+0100 [mongosMain] connection accepted from 172.28.0.164:49501 #1422242 (399 connections now open) 2015-10-05T04:34:18.310+0100 [mongosMain] connection accepted from 172.28.0.164:49500 #1422243 (400 connections now open) 2015-10-05T04:34:18.312+0100 [conn1422243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:18.312+0100 [conn1422242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:18.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efba5703b51053eb21b8 2015-10-05T04:34:18.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:19.246+0100 [conn1421822] end connection 172.28.0.163:54925 (399 connections now open) 2015-10-05T04:34:19.246+0100 [conn1421846] end connection 172.28.0.163:54971 (398 connections now open) 2015-10-05T04:34:19.248+0100 [mongosMain] connection accepted from 172.28.0.163:56441 #1422244 (399 connections now open) 2015-10-05T04:34:19.248+0100 [mongosMain] connection accepted from 172.28.0.163:56440 #1422245 (400 connections now open) 2015-10-05T04:34:19.249+0100 [conn1422245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:19.250+0100 [conn1422244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:24.378+0100 [conn1421832] end connection 172.28.0.164:64364 (399 connections now open) 2015-10-05T04:34:24.379+0100 [mongosMain] connection accepted from 172.28.0.164:49512 #1422246 (400 connections now open) 2015-10-05T04:34:24.380+0100 [conn1422246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:24.846+0100 [conn1421857] end connection 172.28.0.164:64465 (399 connections now open) 2015-10-05T04:34:24.848+0100 [mongosMain] connection accepted from 172.28.0.164:49514 #1422247 (400 connections now open) 2015-10-05T04:34:24.849+0100 [conn1422247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:24.909+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:34:24.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:34:25.253+0100 [conn1421825] end connection 172.28.0.163:54928 (399 connections now open) 2015-10-05T04:34:25.254+0100 [mongosMain] connection accepted from 172.28.0.163:56445 #1422248 (400 connections now open) 2015-10-05T04:34:25.255+0100 [conn1422248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:25.908+0100 [conn1421859] end connection 172.28.0.163:55055 (399 connections now open) 2015-10-05T04:34:25.909+0100 [mongosMain] connection accepted from 172.28.0.163:56447 #1422249 (400 connections now open) 2015-10-05T04:34:25.910+0100 [conn1422249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:28.324+0100 [conn1421827] end connection 172.28.0.164:64355 (399 connections now open) 2015-10-05T04:34:28.324+0100 [conn1421853] end connection 172.28.0.164:64436 (398 connections now open) 2015-10-05T04:34:28.326+0100 [mongosMain] connection accepted from 172.28.0.164:49520 #1422250 (399 connections now open) 2015-10-05T04:34:28.326+0100 [mongosMain] connection accepted from 172.28.0.164:49521 #1422251 (400 connections now open) 2015-10-05T04:34:28.327+0100 [conn1422250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:28.328+0100 [conn1422251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:28.707+0100 [mongosMain] connection accepted from 127.0.0.1:56449 #1422252 (401 connections now open) 2015-10-05T04:34:28.710+0100 [conn1422252] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:28.715+0100 [conn1422252] end connection 127.0.0.1:56449 (400 connections now open) 2015-10-05T04:34:29.261+0100 [conn1421805] end connection 172.28.0.163:54884 (399 connections now open) 2015-10-05T04:34:29.261+0100 [conn1421838] end connection 172.28.0.163:54954 (398 connections now open) 2015-10-05T04:34:29.262+0100 [mongosMain] connection accepted from 172.28.0.163:56450 #1422253 (399 connections now open) 2015-10-05T04:34:29.263+0100 [mongosMain] connection accepted from 172.28.0.163:56451 #1422254 (400 connections now open) 2015-10-05T04:34:29.263+0100 [conn1422253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:29.264+0100 [conn1422254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:31.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efc65703b51053eb21e1 2015-10-05T04:34:31.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:34.393+0100 [conn1421848] end connection 172.28.0.164:64408 (399 connections now open) 2015-10-05T04:34:34.397+0100 [mongosMain] connection accepted from 172.28.0.164:49529 #1422255 (400 connections now open) 2015-10-05T04:34:34.399+0100 [conn1422255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:34.861+0100 [conn1421864] end connection 172.28.0.164:64484 (399 connections now open) 2015-10-05T04:34:34.862+0100 [mongosMain] connection accepted from 172.28.0.164:49532 #1422256 (400 connections now open) 2015-10-05T04:34:34.864+0100 [conn1422256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:35.268+0100 [conn1421834] end connection 172.28.0.163:54944 (399 connections now open) 2015-10-05T04:34:35.269+0100 [mongosMain] connection accepted from 172.28.0.163:56455 #1422257 (400 connections now open) 2015-10-05T04:34:35.270+0100 [conn1422257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:35.909+0100 [conn1421866] end connection 172.28.0.163:55065 (399 connections now open) 2015-10-05T04:34:35.911+0100 [mongosMain] connection accepted from 172.28.0.163:56458 #1422258 (400 connections now open) 2015-10-05T04:34:35.912+0100 [conn1422258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:37.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efcd5703b51053eb21f9 2015-10-05T04:34:37.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:38.340+0100 [conn1421852] end connection 172.28.0.164:64434 (399 connections now open) 2015-10-05T04:34:38.340+0100 [conn1421803] end connection 172.28.0.164:64282 (398 connections now open) 2015-10-05T04:34:38.341+0100 [mongosMain] connection accepted from 172.28.0.164:49540 #1422259 (399 connections now open) 2015-10-05T04:34:38.342+0100 [mongosMain] connection accepted from 172.28.0.164:49539 #1422260 (400 connections now open) 2015-10-05T04:34:38.343+0100 [conn1422259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:38.343+0100 [conn1422260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:39.262+0100 [conn1421855] end connection 172.28.0.163:55025 (399 connections now open) 2015-10-05T04:34:39.263+0100 [conn1421813] end connection 172.28.0.163:54914 (399 connections now open) 2015-10-05T04:34:39.264+0100 [mongosMain] connection accepted from 172.28.0.163:56460 #1422261 (399 connections now open) 2015-10-05T04:34:39.264+0100 [mongosMain] connection accepted from 172.28.0.163:56461 #1422262 (400 connections now open) 2015-10-05T04:34:39.265+0100 [conn1422261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:39.265+0100 [conn1422262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:39.379+0100 [mongosMain] connection accepted from 127.0.0.1:56464 #1422263 (401 connections now open) 2015-10-05T04:34:39.382+0100 [conn1422263] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:39.387+0100 [conn1422263] end connection 127.0.0.1:56464 (400 connections now open) 2015-10-05T04:34:41.267+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:34:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:34:44.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efd35703b51053eb221a 2015-10-05T04:34:44.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:44.393+0100 [conn1421823] end connection 172.28.0.164:64344 (399 connections now open) 2015-10-05T04:34:44.395+0100 [mongosMain] connection accepted from 172.28.0.164:49549 #1422264 (400 connections now open) 2015-10-05T04:34:44.396+0100 [conn1422264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:44.861+0100 [conn1421872] end connection 172.28.0.164:64502 (399 connections now open) 2015-10-05T04:34:44.862+0100 [mongosMain] connection accepted from 172.28.0.164:49551 #1422265 (400 connections now open) 2015-10-05T04:34:44.864+0100 [conn1422265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:45.269+0100 [conn1421843] end connection 172.28.0.163:54968 (399 connections now open) 2015-10-05T04:34:45.271+0100 [mongosMain] connection accepted from 172.28.0.163:56471 #1422266 (400 connections now open) 2015-10-05T04:34:45.271+0100 [conn1422266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:45.923+0100 [conn1421874] end connection 172.28.0.163:55073 (399 connections now open) 2015-10-05T04:34:45.924+0100 [mongosMain] connection accepted from 172.28.0.163:56473 #1422267 (400 connections now open) 2015-10-05T04:34:45.925+0100 [conn1422267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:48.356+0100 [conn1421717] end connection 172.28.0.164:64015 (399 connections now open) 2015-10-05T04:34:48.356+0100 [conn1421867] end connection 172.28.0.164:64490 (398 connections now open) 2015-10-05T04:34:48.357+0100 [mongosMain] connection accepted from 172.28.0.164:49558 #1422268 (399 connections now open) 2015-10-05T04:34:48.358+0100 [mongosMain] connection accepted from 172.28.0.164:49559 #1422269 (400 connections now open) 2015-10-05T04:34:48.359+0100 [conn1422268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:48.360+0100 [conn1422269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:49.277+0100 [conn1421862] end connection 172.28.0.163:55059 (399 connections now open) 2015-10-05T04:34:49.277+0100 [conn1421798] end connection 172.28.0.163:54820 (398 connections now open) 2015-10-05T04:34:49.279+0100 [mongosMain] connection accepted from 172.28.0.163:56481 #1422270 (399 connections now open) 2015-10-05T04:34:49.279+0100 [mongosMain] connection accepted from 172.28.0.163:56482 #1422271 (400 connections now open) 2015-10-05T04:34:49.280+0100 [conn1422270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:49.280+0100 [conn1422271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:50.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efda5703b51053eb223e 2015-10-05T04:34:50.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:54.409+0100 [conn1421840] end connection 172.28.0.164:64381 (399 connections now open) 2015-10-05T04:34:54.411+0100 [mongosMain] connection accepted from 172.28.0.164:49567 #1422272 (400 connections now open) 2015-10-05T04:34:54.412+0100 [conn1422272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:54.877+0100 [conn1421881] end connection 172.28.0.164:64519 (399 connections now open) 2015-10-05T04:34:54.878+0100 [mongosMain] connection accepted from 172.28.0.164:49570 #1422273 (400 connections now open) 2015-10-05T04:34:54.880+0100 [conn1422273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:55.284+0100 [conn1421850] end connection 172.28.0.163:54996 (399 connections now open) 2015-10-05T04:34:55.285+0100 [mongosMain] connection accepted from 172.28.0.163:56492 #1422274 (400 connections now open) 2015-10-05T04:34:55.286+0100 [conn1422274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:55.938+0100 [conn1421883] end connection 172.28.0.163:55088 (399 connections now open) 2015-10-05T04:34:55.939+0100 [mongosMain] connection accepted from 172.28.0.163:56495 #1422275 (400 connections now open) 2015-10-05T04:34:55.940+0100 [conn1422275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:56.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efe05703b51053eb225c 2015-10-05T04:34:56.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:34:58.356+0100 [conn1421860] end connection 172.28.0.164:64470 (399 connections now open) 2015-10-05T04:34:58.356+0100 [conn1421795] end connection 172.28.0.164:64240 (398 connections now open) 2015-10-05T04:34:58.357+0100 [mongosMain] connection accepted from 172.28.0.164:49573 #1422276 (399 connections now open) 2015-10-05T04:34:58.358+0100 [mongosMain] connection accepted from 172.28.0.164:49574 #1422277 (400 connections now open) 2015-10-05T04:34:58.358+0100 [conn1422276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:58.359+0100 [conn1422277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:59.293+0100 [conn1421870] end connection 172.28.0.163:55068 (399 connections now open) 2015-10-05T04:34:59.293+0100 [conn1421829] end connection 172.28.0.163:54934 (399 connections now open) 2015-10-05T04:34:59.294+0100 [mongosMain] connection accepted from 172.28.0.163:56503 #1422278 (399 connections now open) 2015-10-05T04:34:59.295+0100 [mongosMain] connection accepted from 172.28.0.163:56504 #1422279 (400 connections now open) 2015-10-05T04:34:59.295+0100 [conn1422278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:34:59.296+0100 [conn1422279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:03.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efe65703b51053eb226c 2015-10-05T04:35:03.126+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:04.409+0100 [conn1421856] end connection 172.28.0.164:64463 (399 connections now open) 2015-10-05T04:35:04.410+0100 [mongosMain] connection accepted from 172.28.0.164:49593 #1422280 (400 connections now open) 2015-10-05T04:35:04.412+0100 [conn1422280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:04.876+0100 [conn1421888] end connection 172.28.0.164:64536 (399 connections now open) 2015-10-05T04:35:04.877+0100 [mongosMain] connection accepted from 172.28.0.164:49597 #1422281 (400 connections now open) 2015-10-05T04:35:04.878+0100 [conn1422281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:05.288+0100 [conn1421858] end connection 172.28.0.163:55052 (399 connections now open) 2015-10-05T04:35:05.290+0100 [mongosMain] connection accepted from 172.28.0.163:56550 #1422282 (400 connections now open) 2015-10-05T04:35:05.291+0100 [conn1422282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:05.939+0100 [conn1421890] end connection 172.28.0.163:55107 (399 connections now open) 2015-10-05T04:35:05.940+0100 [mongosMain] connection accepted from 172.28.0.163:56556 #1422283 (400 connections now open) 2015-10-05T04:35:05.942+0100 [conn1422283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:08.371+0100 [conn1421810] end connection 172.28.0.164:64318 (399 connections now open) 2015-10-05T04:35:08.371+0100 [conn1421876] end connection 172.28.0.164:64510 (398 connections now open) 2015-10-05T04:35:08.372+0100 [mongosMain] connection accepted from 172.28.0.164:49620 #1422284 (399 connections now open) 2015-10-05T04:35:08.372+0100 [mongosMain] connection accepted from 172.28.0.164:49621 #1422285 (400 connections now open) 2015-10-05T04:35:08.373+0100 [conn1422284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:08.374+0100 [conn1422285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:09.296+0100 [conn1421893] end connection 172.28.0.163:55114 (399 connections now open) 2015-10-05T04:35:09.296+0100 [conn1421847] end connection 172.28.0.163:54974 (399 connections now open) 2015-10-05T04:35:09.298+0100 [mongosMain] connection accepted from 172.28.0.163:56580 #1422286 (399 connections now open) 2015-10-05T04:35:09.298+0100 [mongosMain] connection accepted from 172.28.0.163:56581 #1422287 (400 connections now open) 2015-10-05T04:35:09.299+0100 [conn1422286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:09.299+0100 [conn1422287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:09.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611efed5703b51053eb229c 2015-10-05T04:35:09.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:11.523+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:35:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:35:14.893+0100 [conn1421895] end connection 172.28.0.164:64565 (399 connections now open) 2015-10-05T04:35:14.894+0100 [mongosMain] connection accepted from 172.28.0.164:49635 #1422288 (400 connections now open) 2015-10-05T04:35:14.895+0100 [conn1422288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:15.300+0100 [conn1421882] end connection 172.28.0.163:55086 (399 connections now open) 2015-10-05T04:35:15.302+0100 [mongosMain] connection accepted from 172.28.0.163:56594 #1422289 (400 connections now open) 2015-10-05T04:35:15.303+0100 [conn1422289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:15.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eff35703b51053eb22b1 2015-10-05T04:35:15.955+0100 [conn1421897] end connection 172.28.0.163:55148 (399 connections now open) 2015-10-05T04:35:15.956+0100 [mongosMain] connection accepted from 172.28.0.163:56597 #1422290 (400 connections now open) 2015-10-05T04:35:15.957+0100 [conn1422290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:15.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:18.372+0100 [conn1421892] end connection 172.28.0.164:64541 (399 connections now open) 2015-10-05T04:35:18.372+0100 [conn1421837] end connection 172.28.0.164:64374 (398 connections now open) 2015-10-05T04:35:18.373+0100 [mongosMain] connection accepted from 172.28.0.164:49641 #1422291 (399 connections now open) 2015-10-05T04:35:18.373+0100 [mongosMain] connection accepted from 172.28.0.164:49642 #1422292 (400 connections now open) 2015-10-05T04:35:18.375+0100 [conn1422291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:18.375+0100 [conn1422292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:19.309+0100 [conn1421729] end connection 172.28.0.163:54627 (399 connections now open) 2015-10-05T04:35:19.309+0100 [conn1421901] end connection 172.28.0.163:55171 (399 connections now open) 2015-10-05T04:35:19.310+0100 [mongosMain] connection accepted from 172.28.0.163:56601 #1422293 (399 connections now open) 2015-10-05T04:35:19.310+0100 [mongosMain] connection accepted from 172.28.0.163:56602 #1422294 (400 connections now open) 2015-10-05T04:35:19.311+0100 [conn1422293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:19.311+0100 [conn1422294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:22.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611eff95703b51053eb22ca 2015-10-05T04:35:22.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:24.893+0100 [conn1421903] end connection 172.28.0.164:64609 (399 connections now open) 2015-10-05T04:35:24.894+0100 [mongosMain] connection accepted from 172.28.0.164:49654 #1422295 (400 connections now open) 2015-10-05T04:35:24.896+0100 [conn1422295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:25.316+0100 [conn1421873] end connection 172.28.0.163:55071 (399 connections now open) 2015-10-05T04:35:25.317+0100 [mongosMain] connection accepted from 172.28.0.163:56606 #1422296 (400 connections now open) 2015-10-05T04:35:25.317+0100 [conn1422296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:25.955+0100 [conn1421905] end connection 172.28.0.163:55192 (399 connections now open) 2015-10-05T04:35:25.956+0100 [mongosMain] connection accepted from 172.28.0.163:56608 #1422297 (400 connections now open) 2015-10-05T04:35:25.957+0100 [conn1422297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:28.387+0100 [conn1421828] end connection 172.28.0.164:64356 (399 connections now open) 2015-10-05T04:35:28.388+0100 [conn1421884] end connection 172.28.0.164:64526 (398 connections now open) 2015-10-05T04:35:28.390+0100 [mongosMain] connection accepted from 172.28.0.164:49660 #1422298 (399 connections now open) 2015-10-05T04:35:28.390+0100 [mongosMain] connection accepted from 172.28.0.164:49661 #1422299 (400 connections now open) 2015-10-05T04:35:28.392+0100 [conn1422298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:28.392+0100 [conn1422299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:28.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0005703b51053eb22ea 2015-10-05T04:35:28.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:28.947+0100 [mongosMain] connection accepted from 127.0.0.1:56616 #1422300 (401 connections now open) 2015-10-05T04:35:28.950+0100 [conn1422300] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:28.955+0100 [conn1422300] end connection 127.0.0.1:56616 (400 connections now open) 2015-10-05T04:35:29.309+0100 [conn1421878] end connection 172.28.0.163:55076 (399 connections now open) 2015-10-05T04:35:29.309+0100 [conn1421887] end connection 172.28.0.163:55097 (399 connections now open) 2015-10-05T04:35:29.310+0100 [mongosMain] connection accepted from 172.28.0.163:56617 #1422301 (399 connections now open) 2015-10-05T04:35:29.311+0100 [mongosMain] connection accepted from 172.28.0.163:56618 #1422302 (400 connections now open) 2015-10-05T04:35:29.311+0100 [conn1422301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:29.312+0100 [conn1422302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:34.441+0100 [conn1421871] end connection 172.28.0.164:64498 (399 connections now open) 2015-10-05T04:35:34.442+0100 [mongosMain] connection accepted from 172.28.0.164:49668 #1422303 (400 connections now open) 2015-10-05T04:35:34.443+0100 [conn1422303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:34.908+0100 [conn1421911] end connection 172.28.0.164:64626 (399 connections now open) 2015-10-05T04:35:34.910+0100 [mongosMain] connection accepted from 172.28.0.164:49671 #1422304 (400 connections now open) 2015-10-05T04:35:34.911+0100 [conn1422304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:34.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0065703b51053eb2304 2015-10-05T04:35:35.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:35.316+0100 [conn1421865] end connection 172.28.0.163:55063 (399 connections now open) 2015-10-05T04:35:35.317+0100 [mongosMain] connection accepted from 172.28.0.163:56622 #1422305 (400 connections now open) 2015-10-05T04:35:35.318+0100 [conn1422305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:35.971+0100 [conn1421913] end connection 172.28.0.163:55202 (399 connections now open) 2015-10-05T04:35:35.972+0100 [mongosMain] connection accepted from 172.28.0.163:56624 #1422306 (400 connections now open) 2015-10-05T04:35:35.973+0100 [conn1422306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:38.387+0100 [conn1421899] end connection 172.28.0.164:64588 (399 connections now open) 2015-10-05T04:35:38.388+0100 [conn1421750] end connection 172.28.0.164:64086 (398 connections now open) 2015-10-05T04:35:38.389+0100 [mongosMain] connection accepted from 172.28.0.164:49679 #1422307 (399 connections now open) 2015-10-05T04:35:38.389+0100 [mongosMain] connection accepted from 172.28.0.164:49680 #1422308 (400 connections now open) 2015-10-05T04:35:38.390+0100 [conn1422307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:38.391+0100 [conn1422308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:39.325+0100 [conn1421886] end connection 172.28.0.163:55096 (399 connections now open) 2015-10-05T04:35:39.325+0100 [conn1421877] end connection 172.28.0.163:55075 (399 connections now open) 2015-10-05T04:35:39.326+0100 [mongosMain] connection accepted from 172.28.0.163:56627 #1422309 (399 connections now open) 2015-10-05T04:35:39.326+0100 [mongosMain] connection accepted from 172.28.0.163:56628 #1422310 (400 connections now open) 2015-10-05T04:35:39.327+0100 [conn1422309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:39.327+0100 [conn1422310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:39.518+0100 [mongosMain] connection accepted from 127.0.0.1:56631 #1422311 (401 connections now open) 2015-10-05T04:35:39.521+0100 [conn1422311] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:39.525+0100 [conn1422311] end connection 127.0.0.1:56631 (400 connections now open) 2015-10-05T04:35:41.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f00d5703b51053eb2321 2015-10-05T04:35:41.337+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:41.645+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:35:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:35:44.457+0100 [conn1421910] end connection 172.28.0.164:64624 (399 connections now open) 2015-10-05T04:35:44.458+0100 [mongosMain] connection accepted from 172.28.0.164:49688 #1422312 (400 connections now open) 2015-10-05T04:35:44.460+0100 [conn1422312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:44.925+0100 [conn1421920] end connection 172.28.0.164:64644 (399 connections now open) 2015-10-05T04:35:44.925+0100 [mongosMain] connection accepted from 172.28.0.164:49691 #1422313 (400 connections now open) 2015-10-05T04:35:44.927+0100 [conn1422313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:45.332+0100 [conn1421889] end connection 172.28.0.163:55105 (399 connections now open) 2015-10-05T04:35:45.334+0100 [mongosMain] connection accepted from 172.28.0.163:56639 #1422314 (400 connections now open) 2015-10-05T04:35:45.336+0100 [conn1422314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:45.972+0100 [conn1421922] end connection 172.28.0.163:55213 (399 connections now open) 2015-10-05T04:35:45.973+0100 [mongosMain] connection accepted from 172.28.0.163:56642 #1422315 (400 connections now open) 2015-10-05T04:35:45.974+0100 [conn1422315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:47.620+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0135703b51053eb2343 2015-10-05T04:35:47.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:48.403+0100 [conn1421861] end connection 172.28.0.164:64471 (399 connections now open) 2015-10-05T04:35:48.403+0100 [conn1421906] end connection 172.28.0.164:64613 (399 connections now open) 2015-10-05T04:35:48.406+0100 [mongosMain] connection accepted from 172.28.0.164:49697 #1422316 (399 connections now open) 2015-10-05T04:35:48.406+0100 [mongosMain] connection accepted from 172.28.0.164:49698 #1422317 (400 connections now open) 2015-10-05T04:35:48.407+0100 [conn1422316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:48.408+0100 [conn1422317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:49.325+0100 [conn1421900] end connection 172.28.0.163:55170 (399 connections now open) 2015-10-05T04:35:49.325+0100 [conn1421908] end connection 172.28.0.163:55195 (399 connections now open) 2015-10-05T04:35:49.326+0100 [mongosMain] connection accepted from 172.28.0.163:56646 #1422318 (399 connections now open) 2015-10-05T04:35:49.327+0100 [mongosMain] connection accepted from 172.28.0.163:56648 #1422319 (400 connections now open) 2015-10-05T04:35:49.328+0100 [conn1422318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:49.328+0100 [conn1422319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:54.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0195703b51053eb2367 2015-10-05T04:35:54.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:35:54.458+0100 [conn1421863] end connection 172.28.0.164:64480 (399 connections now open) 2015-10-05T04:35:54.459+0100 [mongosMain] connection accepted from 172.28.0.164:49704 #1422320 (400 connections now open) 2015-10-05T04:35:54.460+0100 [conn1422320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:54.924+0100 [conn1421929] end connection 172.28.0.164:64662 (399 connections now open) 2015-10-05T04:35:54.926+0100 [mongosMain] connection accepted from 172.28.0.164:49707 #1422321 (400 connections now open) 2015-10-05T04:35:54.927+0100 [conn1422321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:55.331+0100 [conn1421904] end connection 172.28.0.163:55189 (399 connections now open) 2015-10-05T04:35:55.332+0100 [mongosMain] connection accepted from 172.28.0.163:56656 #1422322 (400 connections now open) 2015-10-05T04:35:55.333+0100 [conn1422322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:55.986+0100 [conn1421931] end connection 172.28.0.163:55231 (399 connections now open) 2015-10-05T04:35:55.987+0100 [mongosMain] connection accepted from 172.28.0.163:56658 #1422323 (400 connections now open) 2015-10-05T04:35:55.988+0100 [conn1422323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:58.418+0100 [conn1421875] end connection 172.28.0.164:64509 (399 connections now open) 2015-10-05T04:35:58.419+0100 [conn1421914] end connection 172.28.0.164:64632 (398 connections now open) 2015-10-05T04:35:58.420+0100 [mongosMain] connection accepted from 172.28.0.164:49710 #1422324 (399 connections now open) 2015-10-05T04:35:58.420+0100 [mongosMain] connection accepted from 172.28.0.164:49711 #1422325 (400 connections now open) 2015-10-05T04:35:58.421+0100 [conn1422324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:58.422+0100 [conn1422325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:59.340+0100 [conn1421918] end connection 172.28.0.163:55207 (399 connections now open) 2015-10-05T04:35:59.340+0100 [conn1421917] end connection 172.28.0.163:55206 (398 connections now open) 2015-10-05T04:35:59.342+0100 [mongosMain] connection accepted from 172.28.0.163:56665 #1422326 (399 connections now open) 2015-10-05T04:35:59.342+0100 [conn1422326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:35:59.343+0100 [mongosMain] connection accepted from 172.28.0.163:56667 #1422327 (400 connections now open) 2015-10-05T04:35:59.344+0100 [conn1422327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:00.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0205703b51053eb237e 2015-10-05T04:36:00.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:04.473+0100 [conn1421902] end connection 172.28.0.164:64607 (399 connections now open) 2015-10-05T04:36:04.474+0100 [mongosMain] connection accepted from 172.28.0.164:49735 #1422328 (400 connections now open) 2015-10-05T04:36:04.475+0100 [conn1422328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:04.941+0100 [conn1421937] end connection 172.28.0.164:64678 (399 connections now open) 2015-10-05T04:36:04.942+0100 [mongosMain] connection accepted from 172.28.0.164:49738 #1422329 (400 connections now open) 2015-10-05T04:36:04.943+0100 [conn1422329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:05.347+0100 [conn1421912] end connection 172.28.0.163:55200 (399 connections now open) 2015-10-05T04:36:05.348+0100 [mongosMain] connection accepted from 172.28.0.163:56700 #1422330 (400 connections now open) 2015-10-05T04:36:05.349+0100 [conn1422330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:05.987+0100 [conn1421938] end connection 172.28.0.163:55247 (399 connections now open) 2015-10-05T04:36:05.988+0100 [mongosMain] connection accepted from 172.28.0.163:56706 #1422331 (400 connections now open) 2015-10-05T04:36:05.989+0100 [conn1422331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:08.434+0100 [conn1421923] end connection 172.28.0.164:64650 (399 connections now open) 2015-10-05T04:36:08.434+0100 [conn1421868] end connection 172.28.0.164:64491 (398 connections now open) 2015-10-05T04:36:08.435+0100 [mongosMain] connection accepted from 172.28.0.164:49765 #1422332 (399 connections now open) 2015-10-05T04:36:08.435+0100 [mongosMain] connection accepted from 172.28.0.164:49766 #1422333 (400 connections now open) 2015-10-05T04:36:08.436+0100 [conn1422332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:08.437+0100 [conn1422333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:09.341+0100 [conn1421839] end connection 172.28.0.163:54955 (399 connections now open) 2015-10-05T04:36:09.341+0100 [conn1421934] end connection 172.28.0.163:55237 (399 connections now open) 2015-10-05T04:36:09.342+0100 [mongosMain] connection accepted from 172.28.0.163:56737 #1422334 (399 connections now open) 2015-10-05T04:36:09.343+0100 [mongosMain] connection accepted from 172.28.0.163:56738 #1422335 (400 connections now open) 2015-10-05T04:36:09.343+0100 [conn1422334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:09.343+0100 [conn1422335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:11.837+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:36:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:36:12.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f02c5703b51053eb23d5 2015-10-05T04:36:12.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:14.472+0100 [conn1421936] end connection 172.28.0.164:64676 (399 connections now open) 2015-10-05T04:36:14.473+0100 [mongosMain] connection accepted from 172.28.0.164:49789 #1422336 (400 connections now open) 2015-10-05T04:36:14.474+0100 [conn1422336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:14.940+0100 [conn1421944] end connection 172.28.0.164:64704 (399 connections now open) 2015-10-05T04:36:14.941+0100 [mongosMain] connection accepted from 172.28.0.164:49791 #1422337 (400 connections now open) 2015-10-05T04:36:14.943+0100 [conn1422337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:15.348+0100 [conn1421896] end connection 172.28.0.163:55145 (399 connections now open) 2015-10-05T04:36:15.349+0100 [mongosMain] connection accepted from 172.28.0.163:56753 #1422338 (400 connections now open) 2015-10-05T04:36:15.350+0100 [conn1422338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:16.002+0100 [conn1421945] end connection 172.28.0.163:55287 (399 connections now open) 2015-10-05T04:36:16.003+0100 [mongosMain] connection accepted from 172.28.0.163:56755 #1422339 (400 connections now open) 2015-10-05T04:36:16.004+0100 [conn1422339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:18.450+0100 [conn1421939] end connection 172.28.0.164:64682 (399 connections now open) 2015-10-05T04:36:18.450+0100 [conn1421907] end connection 172.28.0.164:64614 (399 connections now open) 2015-10-05T04:36:18.452+0100 [mongosMain] connection accepted from 172.28.0.164:49797 #1422340 (399 connections now open) 2015-10-05T04:36:18.452+0100 [mongosMain] connection accepted from 172.28.0.164:49796 #1422341 (400 connections now open) 2015-10-05T04:36:18.454+0100 [conn1422340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:18.454+0100 [conn1422341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:19.356+0100 [conn1421941] end connection 172.28.0.163:55253 (399 connections now open) 2015-10-05T04:36:19.357+0100 [mongosMain] connection accepted from 172.28.0.163:56758 #1422342 (400 connections now open) 2015-10-05T04:36:19.358+0100 [conn1422342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:19.552+0100 [conn1421854] end connection 172.28.0.163:55024 (399 connections now open) 2015-10-05T04:36:19.554+0100 [mongosMain] connection accepted from 172.28.0.163:56760 #1422343 (400 connections now open) 2015-10-05T04:36:19.555+0100 [conn1422343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:24.487+0100 [conn1421919] end connection 172.28.0.164:64640 (399 connections now open) 2015-10-05T04:36:24.489+0100 [mongosMain] connection accepted from 172.28.0.164:49806 #1422344 (400 connections now open) 2015-10-05T04:36:24.490+0100 [conn1422344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:24.955+0100 [conn1421951] end connection 172.28.0.164:64754 (399 connections now open) 2015-10-05T04:36:24.956+0100 [mongosMain] connection accepted from 172.28.0.164:49809 #1422345 (400 connections now open) 2015-10-05T04:36:24.958+0100 [conn1422345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:24.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0385703b51053eb2421 2015-10-05T04:36:25.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:25.363+0100 [conn1421921] end connection 172.28.0.163:55211 (399 connections now open) 2015-10-05T04:36:25.364+0100 [mongosMain] connection accepted from 172.28.0.163:56764 #1422346 (400 connections now open) 2015-10-05T04:36:25.365+0100 [conn1422346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:26.018+0100 [conn1421953] end connection 172.28.0.163:55339 (399 connections now open) 2015-10-05T04:36:26.019+0100 [mongosMain] connection accepted from 172.28.0.163:56766 #1422347 (400 connections now open) 2015-10-05T04:36:26.020+0100 [conn1422347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:28.465+0100 [conn1421844] end connection 172.28.0.164:64388 (399 connections now open) 2015-10-05T04:36:28.466+0100 [conn1421946] end connection 172.28.0.164:64721 (398 connections now open) 2015-10-05T04:36:28.468+0100 [mongosMain] connection accepted from 172.28.0.164:49815 #1422348 (399 connections now open) 2015-10-05T04:36:28.469+0100 [mongosMain] connection accepted from 172.28.0.164:49816 #1422349 (400 connections now open) 2015-10-05T04:36:28.470+0100 [conn1422348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:28.471+0100 [conn1422349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:28.549+0100 [mongosMain] connection accepted from 127.0.0.1:56769 #1422350 (401 connections now open) 2015-10-05T04:36:28.552+0100 [conn1422350] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:28.557+0100 [conn1422350] end connection 127.0.0.1:56769 (400 connections now open) 2015-10-05T04:36:29.372+0100 [conn1421926] end connection 172.28.0.163:55218 (399 connections now open) 2015-10-05T04:36:29.372+0100 [conn1421894] end connection 172.28.0.163:55115 (398 connections now open) 2015-10-05T04:36:29.373+0100 [mongosMain] connection accepted from 172.28.0.163:56770 #1422351 (399 connections now open) 2015-10-05T04:36:29.373+0100 [mongosMain] connection accepted from 172.28.0.163:56771 #1422352 (400 connections now open) 2015-10-05T04:36:29.374+0100 [conn1422351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:29.374+0100 [conn1422352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:31.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f03f5703b51053eb243d 2015-10-05T04:36:31.269+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:34.504+0100 [conn1421943] end connection 172.28.0.164:64698 (399 connections now open) 2015-10-05T04:36:34.505+0100 [mongosMain] connection accepted from 172.28.0.164:49824 #1422353 (400 connections now open) 2015-10-05T04:36:34.507+0100 [conn1422353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:34.972+0100 [conn1421959] end connection 172.28.0.164:64771 (399 connections now open) 2015-10-05T04:36:34.972+0100 [mongosMain] connection accepted from 172.28.0.164:49826 #1422354 (400 connections now open) 2015-10-05T04:36:34.975+0100 [conn1422354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:35.365+0100 [conn1421930] end connection 172.28.0.163:55229 (399 connections now open) 2015-10-05T04:36:35.366+0100 [mongosMain] connection accepted from 172.28.0.163:56774 #1422355 (400 connections now open) 2015-10-05T04:36:35.367+0100 [conn1422355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:36.018+0100 [conn1421961] end connection 172.28.0.163:55351 (399 connections now open) 2015-10-05T04:36:36.020+0100 [mongosMain] connection accepted from 172.28.0.163:56776 #1422356 (400 connections now open) 2015-10-05T04:36:36.021+0100 [conn1422356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:37.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0455703b51053eb2456 2015-10-05T04:36:37.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:38.481+0100 [conn1421932] end connection 172.28.0.164:64670 (399 connections now open) 2015-10-05T04:36:38.481+0100 [conn1421891] end connection 172.28.0.164:64540 (398 connections now open) 2015-10-05T04:36:38.482+0100 [mongosMain] connection accepted from 172.28.0.164:49833 #1422357 (399 connections now open) 2015-10-05T04:36:38.482+0100 [mongosMain] connection accepted from 172.28.0.164:49834 #1422358 (400 connections now open) 2015-10-05T04:36:38.483+0100 [conn1422357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:38.484+0100 [conn1422358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:39.374+0100 [conn1421949] end connection 172.28.0.163:55308 (399 connections now open) 2015-10-05T04:36:39.374+0100 [conn1421909] end connection 172.28.0.163:55196 (398 connections now open) 2015-10-05T04:36:39.375+0100 [mongosMain] connection accepted from 172.28.0.163:56778 #1422359 (399 connections now open) 2015-10-05T04:36:39.376+0100 [mongosMain] connection accepted from 172.28.0.163:56779 #1422360 (400 connections now open) 2015-10-05T04:36:39.377+0100 [conn1422359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:39.377+0100 [conn1422360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:40.111+0100 [mongosMain] connection accepted from 127.0.0.1:56783 #1422361 (401 connections now open) 2015-10-05T04:36:40.114+0100 [conn1422361] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:40.118+0100 [conn1422361] end connection 127.0.0.1:56783 (400 connections now open) 2015-10-05T04:36:42.107+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:36:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:36:43.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f04b5703b51053eb2475 2015-10-05T04:36:44.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:44.504+0100 [conn1421928] end connection 172.28.0.164:64660 (399 connections now open) 2015-10-05T04:36:44.506+0100 [mongosMain] connection accepted from 172.28.0.164:49844 #1422362 (400 connections now open) 2015-10-05T04:36:44.508+0100 [conn1422362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:44.973+0100 [conn1421968] end connection 172.28.0.164:64788 (399 connections now open) 2015-10-05T04:36:44.974+0100 [mongosMain] connection accepted from 172.28.0.164:49846 #1422363 (400 connections now open) 2015-10-05T04:36:44.976+0100 [conn1422363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:45.378+0100 [conn1421969] end connection 172.28.0.163:55358 (399 connections now open) 2015-10-05T04:36:45.380+0100 [mongosMain] connection accepted from 172.28.0.163:56789 #1422364 (400 connections now open) 2015-10-05T04:36:45.380+0100 [conn1422364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:46.034+0100 [conn1421970] end connection 172.28.0.163:55360 (399 connections now open) 2015-10-05T04:36:46.035+0100 [mongosMain] connection accepted from 172.28.0.163:56792 #1422365 (400 connections now open) 2015-10-05T04:36:46.036+0100 [conn1422365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:48.481+0100 [conn1421954] end connection 172.28.0.164:64759 (399 connections now open) 2015-10-05T04:36:48.481+0100 [conn1421898] end connection 172.28.0.164:64587 (398 connections now open) 2015-10-05T04:36:48.482+0100 [mongosMain] connection accepted from 172.28.0.164:49853 #1422366 (399 connections now open) 2015-10-05T04:36:48.483+0100 [mongosMain] connection accepted from 172.28.0.164:49854 #1422367 (400 connections now open) 2015-10-05T04:36:48.484+0100 [conn1422367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:48.485+0100 [conn1422366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:49.388+0100 [conn1421957] end connection 172.28.0.163:55343 (399 connections now open) 2015-10-05T04:36:49.388+0100 [conn1421942] end connection 172.28.0.163:55254 (399 connections now open) 2015-10-05T04:36:49.389+0100 [mongosMain] connection accepted from 172.28.0.163:56797 #1422368 (399 connections now open) 2015-10-05T04:36:49.390+0100 [mongosMain] connection accepted from 172.28.0.163:56798 #1422369 (400 connections now open) 2015-10-05T04:36:49.390+0100 [conn1422368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:49.391+0100 [conn1422369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:50.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0525703b51053eb2485 2015-10-05T04:36:50.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:54.519+0100 [conn1421880] end connection 172.28.0.164:64517 (399 connections now open) 2015-10-05T04:36:54.520+0100 [mongosMain] connection accepted from 172.28.0.164:49860 #1422370 (400 connections now open) 2015-10-05T04:36:54.522+0100 [conn1422370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:54.986+0100 [conn1421977] end connection 172.28.0.164:64810 (399 connections now open) 2015-10-05T04:36:54.987+0100 [mongosMain] connection accepted from 172.28.0.164:49864 #1422371 (400 connections now open) 2015-10-05T04:36:54.989+0100 [conn1422371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:55.394+0100 [conn1421952] end connection 172.28.0.163:55335 (399 connections now open) 2015-10-05T04:36:55.395+0100 [mongosMain] connection accepted from 172.28.0.163:56806 #1422372 (400 connections now open) 2015-10-05T04:36:55.397+0100 [conn1422372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:56.034+0100 [conn1421979] end connection 172.28.0.163:55376 (399 connections now open) 2015-10-05T04:36:56.035+0100 [mongosMain] connection accepted from 172.28.0.163:56810 #1422373 (400 connections now open) 2015-10-05T04:36:56.036+0100 [conn1422373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:56.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0585703b51053eb249f 2015-10-05T04:36:56.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:36:58.497+0100 [conn1421962] end connection 172.28.0.164:64777 (399 connections now open) 2015-10-05T04:36:58.498+0100 [conn1421933] end connection 172.28.0.164:64669 (398 connections now open) 2015-10-05T04:36:58.499+0100 [mongosMain] connection accepted from 172.28.0.164:49868 #1422374 (399 connections now open) 2015-10-05T04:36:58.499+0100 [mongosMain] connection accepted from 172.28.0.164:49869 #1422375 (400 connections now open) 2015-10-05T04:36:58.501+0100 [conn1422374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:58.501+0100 [conn1422375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:59.388+0100 [conn1421948] end connection 172.28.0.163:55307 (399 connections now open) 2015-10-05T04:36:59.388+0100 [conn1421963] end connection 172.28.0.163:55353 (399 connections now open) 2015-10-05T04:36:59.389+0100 [mongosMain] connection accepted from 172.28.0.163:56816 #1422376 (399 connections now open) 2015-10-05T04:36:59.389+0100 [mongosMain] connection accepted from 172.28.0.163:56817 #1422377 (400 connections now open) 2015-10-05T04:36:59.390+0100 [conn1422376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:36:59.390+0100 [conn1422377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:03.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f05e5703b51053eb24b3 2015-10-05T04:37:03.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:04.536+0100 [conn1421967] end connection 172.28.0.164:64786 (399 connections now open) 2015-10-05T04:37:04.537+0100 [mongosMain] connection accepted from 172.28.0.164:49897 #1422378 (400 connections now open) 2015-10-05T04:37:04.539+0100 [conn1422378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:04.988+0100 [conn1421985] end connection 172.28.0.164:64826 (399 connections now open) 2015-10-05T04:37:04.990+0100 [mongosMain] connection accepted from 172.28.0.164:49901 #1422379 (400 connections now open) 2015-10-05T04:37:04.992+0100 [conn1422379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:05.395+0100 [conn1421960] end connection 172.28.0.163:55349 (399 connections now open) 2015-10-05T04:37:05.396+0100 [mongosMain] connection accepted from 172.28.0.163:56859 #1422380 (400 connections now open) 2015-10-05T04:37:05.397+0100 [conn1422380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:06.050+0100 [conn1421987] end connection 172.28.0.163:55393 (399 connections now open) 2015-10-05T04:37:06.051+0100 [mongosMain] connection accepted from 172.28.0.163:56862 #1422381 (400 connections now open) 2015-10-05T04:37:06.053+0100 [conn1422381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:08.497+0100 [conn1421915] end connection 172.28.0.164:64633 (399 connections now open) 2015-10-05T04:37:08.498+0100 [mongosMain] connection accepted from 172.28.0.164:49928 #1422382 (400 connections now open) 2015-10-05T04:37:08.500+0100 [conn1422382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:09.404+0100 [conn1421965] end connection 172.28.0.163:55356 (399 connections now open) 2015-10-05T04:37:09.404+0100 [conn1421973] end connection 172.28.0.163:55363 (399 connections now open) 2015-10-05T04:37:09.405+0100 [mongosMain] connection accepted from 172.28.0.163:56883 #1422383 (399 connections now open) 2015-10-05T04:37:09.406+0100 [mongosMain] connection accepted from 172.28.0.163:56884 #1422384 (400 connections now open) 2015-10-05T04:37:09.406+0100 [conn1422383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:09.406+0100 [conn1422384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:09.524+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0655703b51053eb24d2 2015-10-05T04:37:09.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:12.392+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:37:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:37:14.551+0100 [conn1421958] end connection 172.28.0.164:64768 (399 connections now open) 2015-10-05T04:37:14.552+0100 [mongosMain] connection accepted from 172.28.0.164:49936 #1422385 (400 connections now open) 2015-10-05T04:37:14.554+0100 [conn1422385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:15.004+0100 [conn1421993] end connection 172.28.0.164:64861 (399 connections now open) 2015-10-05T04:37:15.006+0100 [mongosMain] connection accepted from 172.28.0.164:49938 #1422386 (400 connections now open) 2015-10-05T04:37:15.007+0100 [conn1422386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:15.410+0100 [conn1421986] end connection 172.28.0.163:55391 (399 connections now open) 2015-10-05T04:37:15.411+0100 [mongosMain] connection accepted from 172.28.0.163:56900 #1422387 (400 connections now open) 2015-10-05T04:37:15.413+0100 [conn1422387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:16.050+0100 [conn1421995] end connection 172.28.0.163:55438 (399 connections now open) 2015-10-05T04:37:16.051+0100 [mongosMain] connection accepted from 172.28.0.163:56903 #1422388 (400 connections now open) 2015-10-05T04:37:16.053+0100 [conn1422388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:18.513+0100 [conn1421947] end connection 172.28.0.164:64722 (399 connections now open) 2015-10-05T04:37:18.513+0100 [conn1421989] end connection 172.28.0.164:64832 (399 connections now open) 2015-10-05T04:37:18.514+0100 [mongosMain] connection accepted from 172.28.0.164:49942 #1422389 (399 connections now open) 2015-10-05T04:37:18.515+0100 [mongosMain] connection accepted from 172.28.0.164:49943 #1422390 (400 connections now open) 2015-10-05T04:37:18.516+0100 [conn1422389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:18.517+0100 [conn1422390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:19.459+0100 [conn1421991] end connection 172.28.0.163:55400 (399 connections now open) 2015-10-05T04:37:19.459+0100 [conn1421925] end connection 172.28.0.163:55216 (399 connections now open) 2015-10-05T04:37:19.459+0100 [mongosMain] connection accepted from 172.28.0.163:56907 #1422391 (399 connections now open) 2015-10-05T04:37:19.459+0100 [mongosMain] connection accepted from 172.28.0.163:56908 #1422392 (400 connections now open) 2015-10-05T04:37:19.459+0100 [conn1422391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:19.459+0100 [conn1422392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:21.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0715703b51053eb250a 2015-10-05T04:37:22.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:24.566+0100 [conn1421984] end connection 172.28.0.164:64824 (399 connections now open) 2015-10-05T04:37:24.567+0100 [mongosMain] connection accepted from 172.28.0.164:49953 #1422393 (400 connections now open) 2015-10-05T04:37:24.569+0100 [conn1422393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:25.019+0100 [conn1422001] end connection 172.28.0.164:64903 (399 connections now open) 2015-10-05T04:37:25.020+0100 [mongosMain] connection accepted from 172.28.0.164:49955 #1422394 (400 connections now open) 2015-10-05T04:37:25.021+0100 [conn1422394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:25.410+0100 [conn1421978] end connection 172.28.0.163:55373 (399 connections now open) 2015-10-05T04:37:25.411+0100 [mongosMain] connection accepted from 172.28.0.163:56914 #1422395 (400 connections now open) 2015-10-05T04:37:25.413+0100 [conn1422395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:26.065+0100 [conn1422003] end connection 172.28.0.163:55495 (399 connections now open) 2015-10-05T04:37:26.066+0100 [mongosMain] connection accepted from 172.28.0.163:56916 #1422396 (400 connections now open) 2015-10-05T04:37:26.067+0100 [conn1422396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:28.513+0100 [conn1421940] end connection 172.28.0.164:64683 (399 connections now open) 2015-10-05T04:37:28.513+0100 [conn1421972] end connection 172.28.0.164:64797 (398 connections now open) 2015-10-05T04:37:28.513+0100 [mongosMain] connection accepted from 172.28.0.164:49961 #1422397 (399 connections now open) 2015-10-05T04:37:28.514+0100 [mongosMain] connection accepted from 172.28.0.164:49962 #1422398 (400 connections now open) 2015-10-05T04:37:28.515+0100 [conn1422397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:28.515+0100 [conn1422398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:28.592+0100 [mongosMain] connection accepted from 127.0.0.1:56918 #1422399 (401 connections now open) 2015-10-05T04:37:28.594+0100 [conn1422399] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:28.600+0100 [conn1422399] end connection 127.0.0.1:56918 (400 connections now open) 2015-10-05T04:37:29.425+0100 [conn1421998] end connection 172.28.0.163:55466 (399 connections now open) 2015-10-05T04:37:29.425+0100 [conn1421935] end connection 172.28.0.163:55239 (399 connections now open) 2015-10-05T04:37:29.426+0100 [mongosMain] connection accepted from 172.28.0.163:56920 #1422400 (399 connections now open) 2015-10-05T04:37:29.427+0100 [mongosMain] connection accepted from 172.28.0.163:56921 #1422401 (400 connections now open) 2015-10-05T04:37:29.427+0100 [conn1422400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:29.427+0100 [conn1422401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:34.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f07e5703b51053eb2559 2015-10-05T04:37:34.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:34.583+0100 [conn1421950] end connection 172.28.0.164:64752 (399 connections now open) 2015-10-05T04:37:34.584+0100 [mongosMain] connection accepted from 172.28.0.164:49970 #1422402 (400 connections now open) 2015-10-05T04:37:34.589+0100 [conn1422402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:35.034+0100 [conn1422009] end connection 172.28.0.164:64923 (399 connections now open) 2015-10-05T04:37:35.035+0100 [mongosMain] connection accepted from 172.28.0.164:49972 #1422403 (400 connections now open) 2015-10-05T04:37:35.039+0100 [conn1422403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:35.426+0100 [conn1421994] end connection 172.28.0.163:55433 (399 connections now open) 2015-10-05T04:37:35.427+0100 [mongosMain] connection accepted from 172.28.0.163:56925 #1422404 (400 connections now open) 2015-10-05T04:37:35.428+0100 [conn1422404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:36.081+0100 [conn1422011] end connection 172.28.0.163:55506 (399 connections now open) 2015-10-05T04:37:36.082+0100 [mongosMain] connection accepted from 172.28.0.163:56927 #1422405 (400 connections now open) 2015-10-05T04:37:36.084+0100 [conn1422405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:38.529+0100 [conn1421996] end connection 172.28.0.164:64881 (399 connections now open) 2015-10-05T04:37:38.529+0100 [conn1421964] end connection 172.28.0.164:64779 (398 connections now open) 2015-10-05T04:37:38.530+0100 [mongosMain] connection accepted from 172.28.0.164:49981 #1422406 (399 connections now open) 2015-10-05T04:37:38.531+0100 [mongosMain] connection accepted from 172.28.0.164:49980 #1422407 (400 connections now open) 2015-10-05T04:37:38.532+0100 [conn1422406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:38.532+0100 [conn1422407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:39.412+0100 [mongosMain] connection accepted from 127.0.0.1:56930 #1422408 (401 connections now open) 2015-10-05T04:37:39.414+0100 [conn1422408] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:39.420+0100 [conn1422408] end connection 127.0.0.1:56930 (400 connections now open) 2015-10-05T04:37:39.421+0100 [conn1421956] end connection 172.28.0.163:55342 (399 connections now open) 2015-10-05T04:37:39.421+0100 [conn1421982] end connection 172.28.0.163:55381 (398 connections now open) 2015-10-05T04:37:39.422+0100 [mongosMain] connection accepted from 172.28.0.163:56931 #1422409 (399 connections now open) 2015-10-05T04:37:39.422+0100 [mongosMain] connection accepted from 172.28.0.163:56932 #1422410 (400 connections now open) 2015-10-05T04:37:39.423+0100 [conn1422409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:39.424+0100 [conn1422410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:40.559+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:37:40.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:37:42.676+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:37:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:37:44.582+0100 [conn1421976] end connection 172.28.0.164:64807 (399 connections now open) 2015-10-05T04:37:44.583+0100 [mongosMain] connection accepted from 172.28.0.164:49989 #1422411 (400 connections now open) 2015-10-05T04:37:44.585+0100 [conn1422411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:45.055+0100 [conn1422018] end connection 172.28.0.164:64942 (399 connections now open) 2015-10-05T04:37:45.056+0100 [mongosMain] connection accepted from 172.28.0.164:49992 #1422412 (400 connections now open) 2015-10-05T04:37:45.058+0100 [conn1422412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:45.426+0100 [conn1422002] end connection 172.28.0.163:55491 (399 connections now open) 2015-10-05T04:37:45.427+0100 [mongosMain] connection accepted from 172.28.0.163:56941 #1422413 (400 connections now open) 2015-10-05T04:37:45.428+0100 [conn1422413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:46.081+0100 [conn1422020] end connection 172.28.0.163:55516 (399 connections now open) 2015-10-05T04:37:46.082+0100 [mongosMain] connection accepted from 172.28.0.163:56943 #1422414 (400 connections now open) 2015-10-05T04:37:46.083+0100 [conn1422414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:46.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f08a5703b51053eb25a0 2015-10-05T04:37:46.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:48.529+0100 [conn1421981] end connection 172.28.0.164:64816 (399 connections now open) 2015-10-05T04:37:48.529+0100 [conn1421955] end connection 172.28.0.164:64760 (398 connections now open) 2015-10-05T04:37:48.530+0100 [mongosMain] connection accepted from 172.28.0.164:49999 #1422415 (399 connections now open) 2015-10-05T04:37:48.531+0100 [mongosMain] connection accepted from 172.28.0.164:49998 #1422416 (400 connections now open) 2015-10-05T04:37:48.532+0100 [conn1422415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:48.533+0100 [conn1422416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:49.435+0100 [conn1421974] end connection 172.28.0.163:55364 (399 connections now open) 2015-10-05T04:37:49.435+0100 [conn1422007] end connection 172.28.0.163:55499 (398 connections now open) 2015-10-05T04:37:49.436+0100 [mongosMain] connection accepted from 172.28.0.163:56948 #1422417 (399 connections now open) 2015-10-05T04:37:49.436+0100 [mongosMain] connection accepted from 172.28.0.163:56949 #1422418 (400 connections now open) 2015-10-05T04:37:49.437+0100 [conn1422417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:49.437+0100 [conn1422418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:54.598+0100 [conn1421992] end connection 172.28.0.164:64856 (399 connections now open) 2015-10-05T04:37:54.599+0100 [mongosMain] connection accepted from 172.28.0.164:50006 #1422419 (400 connections now open) 2015-10-05T04:37:54.601+0100 [conn1422419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:55.066+0100 [conn1422026] end connection 172.28.0.164:64961 (399 connections now open) 2015-10-05T04:37:55.066+0100 [mongosMain] connection accepted from 172.28.0.164:50009 #1422420 (400 connections now open) 2015-10-05T04:37:55.068+0100 [conn1422420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:55.442+0100 [conn1422027] end connection 172.28.0.163:55529 (399 connections now open) 2015-10-05T04:37:55.443+0100 [mongosMain] connection accepted from 172.28.0.163:56964 #1422421 (400 connections now open) 2015-10-05T04:37:55.444+0100 [conn1422421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:56.097+0100 [conn1422028] end connection 172.28.0.163:55533 (399 connections now open) 2015-10-05T04:37:56.098+0100 [mongosMain] connection accepted from 172.28.0.163:56967 #1422422 (400 connections now open) 2015-10-05T04:37:56.099+0100 [conn1422422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:58.544+0100 [conn1421924] end connection 172.28.0.164:64651 (399 connections now open) 2015-10-05T04:37:58.544+0100 [conn1422005] end connection 172.28.0.164:64909 (398 connections now open) 2015-10-05T04:37:58.545+0100 [mongosMain] connection accepted from 172.28.0.164:50013 #1422423 (399 connections now open) 2015-10-05T04:37:58.545+0100 [mongosMain] connection accepted from 172.28.0.164:50014 #1422424 (400 connections now open) 2015-10-05T04:37:58.546+0100 [conn1422423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:58.546+0100 [conn1422424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:59.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0965703b51053eb25d6 2015-10-05T04:37:59.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:37:59.451+0100 [conn1422015] end connection 172.28.0.163:55509 (399 connections now open) 2015-10-05T04:37:59.451+0100 [conn1421983] end connection 172.28.0.163:55382 (398 connections now open) 2015-10-05T04:37:59.452+0100 [mongosMain] connection accepted from 172.28.0.163:56973 #1422425 (399 connections now open) 2015-10-05T04:37:59.453+0100 [mongosMain] connection accepted from 172.28.0.163:56974 #1422426 (400 connections now open) 2015-10-05T04:37:59.453+0100 [conn1422425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:37:59.454+0100 [conn1422426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:04.598+0100 [conn1422000] end connection 172.28.0.164:64902 (399 connections now open) 2015-10-05T04:38:04.600+0100 [mongosMain] connection accepted from 172.28.0.164:50039 #1422427 (400 connections now open) 2015-10-05T04:38:04.601+0100 [conn1422427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:05.067+0100 [conn1422033] end connection 172.28.0.164:64977 (399 connections now open) 2015-10-05T04:38:05.068+0100 [mongosMain] connection accepted from 172.28.0.164:50044 #1422428 (400 connections now open) 2015-10-05T04:38:05.069+0100 [conn1422428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:06.098+0100 [conn1422035] end connection 172.28.0.163:55550 (399 connections now open) 2015-10-05T04:38:06.099+0100 [mongosMain] connection accepted from 172.28.0.163:57020 #1422429 (400 connections now open) 2015-10-05T04:38:06.101+0100 [conn1422429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:08.545+0100 [conn1422012] end connection 172.28.0.164:64932 (399 connections now open) 2015-10-05T04:38:08.545+0100 [conn1421885] end connection 172.28.0.164:64527 (398 connections now open) 2015-10-05T04:38:08.546+0100 [mongosMain] connection accepted from 172.28.0.164:50060 #1422430 (399 connections now open) 2015-10-05T04:38:08.546+0100 [mongosMain] connection accepted from 172.28.0.164:50059 #1422431 (400 connections now open) 2015-10-05T04:38:08.548+0100 [conn1422430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:08.548+0100 [conn1422431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:09.451+0100 [conn1422022] end connection 172.28.0.163:55519 (399 connections now open) 2015-10-05T04:38:09.451+0100 [conn1422037] end connection 172.28.0.163:55556 (398 connections now open) 2015-10-05T04:38:09.452+0100 [mongosMain] connection accepted from 172.28.0.163:57048 #1422432 (399 connections now open) 2015-10-05T04:38:09.453+0100 [mongosMain] connection accepted from 172.28.0.163:57049 #1422433 (400 connections now open) 2015-10-05T04:38:09.453+0100 [conn1422432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:09.453+0100 [conn1422433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:11.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0a35703b51053eb2630 2015-10-05T04:38:11.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:38:13.114+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:38:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:38:14.614+0100 [conn1422008] end connection 172.28.0.164:64919 (399 connections now open) 2015-10-05T04:38:14.616+0100 [mongosMain] connection accepted from 172.28.0.164:50080 #1422434 (400 connections now open) 2015-10-05T04:38:14.617+0100 [conn1422434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:15.082+0100 [conn1422039] end connection 172.28.0.164:65004 (399 connections now open) 2015-10-05T04:38:15.083+0100 [mongosMain] connection accepted from 172.28.0.164:50082 #1422435 (400 connections now open) 2015-10-05T04:38:15.084+0100 [conn1422435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:16.113+0100 [conn1422040] end connection 172.28.0.163:55595 (399 connections now open) 2015-10-05T04:38:16.115+0100 [mongosMain] connection accepted from 172.28.0.163:57071 #1422436 (400 connections now open) 2015-10-05T04:38:16.116+0100 [conn1422436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:18.561+0100 [conn1422021] end connection 172.28.0.164:64950 (399 connections now open) 2015-10-05T04:38:18.561+0100 [conn1421818] end connection 172.28.0.164:64338 (399 connections now open) 2015-10-05T04:38:18.562+0100 [mongosMain] connection accepted from 172.28.0.164:50088 #1422437 (399 connections now open) 2015-10-05T04:38:18.562+0100 [mongosMain] connection accepted from 172.28.0.164:50089 #1422438 (400 connections now open) 2015-10-05T04:38:18.564+0100 [conn1422437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:18.564+0100 [conn1422438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:19.466+0100 [conn1421990] end connection 172.28.0.163:55399 (399 connections now open) 2015-10-05T04:38:19.466+0100 [conn1422030] end connection 172.28.0.163:55538 (399 connections now open) 2015-10-05T04:38:19.467+0100 [mongosMain] connection accepted from 172.28.0.163:57074 #1422439 (399 connections now open) 2015-10-05T04:38:19.468+0100 [mongosMain] connection accepted from 172.28.0.163:57075 #1422440 (400 connections now open) 2015-10-05T04:38:19.468+0100 [conn1422439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:19.469+0100 [conn1422440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:23.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0af5703b51053eb2670 2015-10-05T04:38:24.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:38:24.616+0100 [conn1422017] end connection 172.28.0.164:64940 (399 connections now open) 2015-10-05T04:38:24.617+0100 [mongosMain] connection accepted from 172.28.0.164:50097 #1422441 (400 connections now open) 2015-10-05T04:38:24.619+0100 [conn1422441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:25.082+0100 [conn1422044] end connection 172.28.0.164:65056 (399 connections now open) 2015-10-05T04:38:25.083+0100 [mongosMain] connection accepted from 172.28.0.164:50099 #1422442 (400 connections now open) 2015-10-05T04:38:25.084+0100 [conn1422442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:28.561+0100 [conn1422013] end connection 172.28.0.164:64933 (399 connections now open) 2015-10-05T04:38:28.562+0100 [mongosMain] connection accepted from 172.28.0.164:50104 #1422443 (400 connections now open) 2015-10-05T04:38:28.565+0100 [conn1422443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:29.093+0100 [mongosMain] connection accepted from 127.0.0.1:57081 #1422444 (401 connections now open) 2015-10-05T04:38:29.095+0100 [conn1422444] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:29.102+0100 [conn1422444] end connection 127.0.0.1:57081 (400 connections now open) 2015-10-05T04:38:29.467+0100 [conn1422023] end connection 172.28.0.163:55520 (399 connections now open) 2015-10-05T04:38:29.469+0100 [mongosMain] connection accepted from 172.28.0.163:57082 #1422445 (400 connections now open) 2015-10-05T04:38:29.470+0100 [conn1422445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:34.630+0100 [conn1422025] end connection 172.28.0.164:64959 (399 connections now open) 2015-10-05T04:38:34.631+0100 [mongosMain] connection accepted from 172.28.0.164:50112 #1422446 (400 connections now open) 2015-10-05T04:38:34.632+0100 [conn1422446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:39.483+0100 [conn1422042] end connection 172.28.0.163:55617 (399 connections now open) 2015-10-05T04:38:39.484+0100 [mongosMain] connection accepted from 172.28.0.163:57087 #1422447 (400 connections now open) 2015-10-05T04:38:39.485+0100 [conn1422447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:39.790+0100 [mongosMain] connection accepted from 127.0.0.1:57090 #1422448 (401 connections now open) 2015-10-05T04:38:39.792+0100 [conn1422448] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:39.796+0100 [conn1422448] end connection 127.0.0.1:57090 (400 connections now open) 2015-10-05T04:38:42.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0c25703b51053eb26cf 2015-10-05T04:38:42.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:38:43.371+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:38:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:38:44.629+0100 [conn1422043] end connection 172.28.0.164:65054 (399 connections now open) 2015-10-05T04:38:44.630+0100 [mongosMain] connection accepted from 172.28.0.164:50125 #1422449 (400 connections now open) 2015-10-05T04:38:44.632+0100 [conn1422449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:49.483+0100 [conn1422047] end connection 172.28.0.163:55644 (399 connections now open) 2015-10-05T04:38:49.485+0100 [mongosMain] connection accepted from 172.28.0.163:57103 #1422450 (400 connections now open) 2015-10-05T04:38:49.486+0100 [conn1422450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:54.645+0100 [conn1422032] end connection 172.28.0.164:64975 (399 connections now open) 2015-10-05T04:38:54.646+0100 [mongosMain] connection accepted from 172.28.0.164:50135 #1422451 (400 connections now open) 2015-10-05T04:38:54.648+0100 [conn1422451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:38:59.498+0100 [conn1422050] end connection 172.28.0.163:55650 (399 connections now open) 2015-10-05T04:38:59.500+0100 [mongosMain] connection accepted from 172.28.0.163:57115 #1422452 (400 connections now open) 2015-10-05T04:38:59.501+0100 [conn1422452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:00.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0d45703b51053eb2757 2015-10-05T04:39:00.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:07.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0da5703b51053eb279c 2015-10-05T04:39:07.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:08.607+0100 [conn1422029] end connection 172.28.0.164:64968 (399 connections now open) 2015-10-05T04:39:08.608+0100 [mongosMain] connection accepted from 172.28.0.164:50173 #1422453 (400 connections now open) 2015-10-05T04:39:08.609+0100 [conn1422453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:09.514+0100 [conn1422036] end connection 172.28.0.163:55555 (399 connections now open) 2015-10-05T04:39:09.514+0100 [conn1422057] end connection 172.28.0.163:55682 (399 connections now open) 2015-10-05T04:39:09.515+0100 [mongosMain] connection accepted from 172.28.0.163:57159 #1422454 (399 connections now open) 2015-10-05T04:39:09.516+0100 [mongosMain] connection accepted from 172.28.0.163:57160 #1422455 (400 connections now open) 2015-10-05T04:39:09.516+0100 [conn1422454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:09.516+0100 [conn1422455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:13.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0e15703b51053eb27ba 2015-10-05T04:39:13.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:13.659+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:39:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:39:18.624+0100 [conn1422049] end connection 172.28.0.164:65077 (399 connections now open) 2015-10-05T04:39:18.625+0100 [mongosMain] connection accepted from 172.28.0.164:50201 #1422456 (400 connections now open) 2015-10-05T04:39:18.627+0100 [conn1422456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:19.515+0100 [conn1421999] end connection 172.28.0.163:55467 (399 connections now open) 2015-10-05T04:39:19.516+0100 [mongosMain] connection accepted from 172.28.0.163:57188 #1422457 (400 connections now open) 2015-10-05T04:39:19.517+0100 [conn1422457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:19.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0e75703b51053eb27e3 2015-10-05T04:39:19.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:26.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0ed5703b51053eb2806 2015-10-05T04:39:26.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:28.624+0100 [conn1422041] end connection 172.28.0.164:65023 (399 connections now open) 2015-10-05T04:39:28.625+0100 [mongosMain] connection accepted from 172.28.0.164:50213 #1422458 (400 connections now open) 2015-10-05T04:39:28.627+0100 [conn1422458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:29.158+0100 [mongosMain] connection accepted from 127.0.0.1:57193 #1422459 (401 connections now open) 2015-10-05T04:39:29.161+0100 [conn1422459] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:29.166+0100 [conn1422459] end connection 127.0.0.1:57193 (400 connections now open) 2015-10-05T04:39:32.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0f45703b51053eb2820 2015-10-05T04:39:32.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:39.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f0fa5703b51053eb2835 2015-10-05T04:39:39.208+0100 [mongosMain] connection accepted from 127.0.0.1:57196 #1422460 (401 connections now open) 2015-10-05T04:39:39.210+0100 [conn1422460] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:39.214+0100 [conn1422460] end connection 127.0.0.1:57196 (400 connections now open) 2015-10-05T04:39:39.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:43.821+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:39:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:39:45.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1015703b51053eb2865 2015-10-05T04:39:45.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:45.536+0100 [conn1422019] end connection 172.28.0.163:55513 (399 connections now open) 2015-10-05T04:39:45.538+0100 [mongosMain] connection accepted from 172.28.0.163:57204 #1422461 (400 connections now open) 2015-10-05T04:39:45.539+0100 [conn1422461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:51.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1075703b51053eb2881 2015-10-05T04:39:51.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:39:55.552+0100 [conn1422010] end connection 172.28.0.163:55503 (399 connections now open) 2015-10-05T04:39:55.553+0100 [mongosMain] connection accepted from 172.28.0.163:57217 #1422462 (400 connections now open) 2015-10-05T04:39:55.554+0100 [conn1422462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:39:58.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f10d5703b51053eb28a3 2015-10-05T04:39:58.135+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:04.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1145703b51053eb28c6 2015-10-05T04:40:04.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:08.655+0100 [conn1421980] end connection 172.28.0.164:64815 (399 connections now open) 2015-10-05T04:40:08.657+0100 [mongosMain] connection accepted from 172.28.0.164:50372 #1422463 (400 connections now open) 2015-10-05T04:40:08.658+0100 [conn1422463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:09.562+0100 [conn1422054] end connection 172.28.0.163:55669 (399 connections now open) 2015-10-05T04:40:09.563+0100 [mongosMain] connection accepted from 172.28.0.163:57287 #1422464 (400 connections now open) 2015-10-05T04:40:09.564+0100 [conn1422464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:10.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f11a5703b51053eb28e4 2015-10-05T04:40:10.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:14.052+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:40:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:40:15.568+0100 [conn1422069] end connection 172.28.0.163:55772 (399 connections now open) 2015-10-05T04:40:15.569+0100 [mongosMain] connection accepted from 172.28.0.163:57312 #1422465 (400 connections now open) 2015-10-05T04:40:15.569+0100 [conn1422465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:16.208+0100 [conn1422045] end connection 172.28.0.163:55640 (399 connections now open) 2015-10-05T04:40:16.209+0100 [mongosMain] connection accepted from 172.28.0.163:57315 #1422466 (400 connections now open) 2015-10-05T04:40:16.210+0100 [conn1422466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:16.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1205703b51053eb28f9 2015-10-05T04:40:16.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:18.670+0100 [conn1422066] end connection 172.28.0.164:65191 (399 connections now open) 2015-10-05T04:40:18.672+0100 [mongosMain] connection accepted from 172.28.0.164:50430 #1422467 (400 connections now open) 2015-10-05T04:40:18.673+0100 [conn1422467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:19.562+0100 [conn1422052] end connection 172.28.0.163:55657 (399 connections now open) 2015-10-05T04:40:19.563+0100 [mongosMain] connection accepted from 172.28.0.163:57318 #1422468 (400 connections now open) 2015-10-05T04:40:19.564+0100 [conn1422468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:23.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1265703b51053eb2917 2015-10-05T04:40:23.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:25.192+0100 [conn1422048] end connection 172.28.0.164:65071 (399 connections now open) 2015-10-05T04:40:25.193+0100 [mongosMain] connection accepted from 172.28.0.164:50467 #1422469 (400 connections now open) 2015-10-05T04:40:25.195+0100 [conn1422469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:25.568+0100 [conn1422074] end connection 172.28.0.163:55838 (399 connections now open) 2015-10-05T04:40:25.569+0100 [mongosMain] connection accepted from 172.28.0.163:57322 #1422470 (400 connections now open) 2015-10-05T04:40:25.570+0100 [conn1422470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:26.223+0100 [conn1422078] end connection 172.28.0.163:55892 (399 connections now open) 2015-10-05T04:40:26.225+0100 [mongosMain] connection accepted from 172.28.0.163:57323 #1422471 (400 connections now open) 2015-10-05T04:40:26.227+0100 [conn1422471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:28.337+0100 [mongosMain] connection accepted from 127.0.0.1:57325 #1422472 (401 connections now open) 2015-10-05T04:40:28.339+0100 [conn1422472] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:28.345+0100 [conn1422472] end connection 127.0.0.1:57325 (400 connections now open) 2015-10-05T04:40:28.671+0100 [conn1422046] end connection 172.28.0.164:65060 (399 connections now open) 2015-10-05T04:40:28.672+0100 [mongosMain] connection accepted from 172.28.0.164:50471 #1422473 (400 connections now open) 2015-10-05T04:40:28.674+0100 [conn1422473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:29.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f12d5703b51053eb293c 2015-10-05T04:40:29.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:35.207+0100 [conn1422083] end connection 172.28.0.164:65300 (399 connections now open) 2015-10-05T04:40:35.208+0100 [mongosMain] connection accepted from 172.28.0.164:50483 #1422474 (400 connections now open) 2015-10-05T04:40:35.209+0100 [conn1422474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:35.583+0100 [conn1422073] end connection 172.28.0.163:55795 (399 connections now open) 2015-10-05T04:40:35.584+0100 [mongosMain] connection accepted from 172.28.0.163:57329 #1422475 (400 connections now open) 2015-10-05T04:40:35.585+0100 [conn1422475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:36.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1335703b51053eb2952 2015-10-05T04:40:36.239+0100 [conn1422085] end connection 172.28.0.163:55899 (399 connections now open) 2015-10-05T04:40:36.240+0100 [mongosMain] connection accepted from 172.28.0.163:57330 #1422476 (400 connections now open) 2015-10-05T04:40:36.241+0100 [conn1422476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:36.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:38.687+0100 [conn1422064] end connection 172.28.0.164:65174 (399 connections now open) 2015-10-05T04:40:38.688+0100 [mongosMain] connection accepted from 172.28.0.164:50499 #1422477 (400 connections now open) 2015-10-05T04:40:38.690+0100 [conn1422477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:39.835+0100 [mongosMain] connection accepted from 127.0.0.1:57333 #1422478 (401 connections now open) 2015-10-05T04:40:39.838+0100 [conn1422478] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:39.843+0100 [conn1422478] end connection 127.0.0.1:57333 (400 connections now open) 2015-10-05T04:40:42.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f13a5703b51053eb296e 2015-10-05T04:40:42.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:44.203+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:40:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:40:44.740+0100 [conn1422055] end connection 172.28.0.164:65106 (399 connections now open) 2015-10-05T04:40:44.742+0100 [mongosMain] connection accepted from 172.28.0.164:50514 #1422479 (400 connections now open) 2015-10-05T04:40:44.743+0100 [conn1422479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:45.208+0100 [conn1422088] end connection 172.28.0.164:65313 (399 connections now open) 2015-10-05T04:40:45.209+0100 [mongosMain] connection accepted from 172.28.0.164:50522 #1422480 (400 connections now open) 2015-10-05T04:40:45.211+0100 [conn1422480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:45.584+0100 [conn1422034] end connection 172.28.0.163:55548 (399 connections now open) 2015-10-05T04:40:45.585+0100 [mongosMain] connection accepted from 172.28.0.163:57340 #1422481 (400 connections now open) 2015-10-05T04:40:45.587+0100 [conn1422481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:46.239+0100 [conn1422089] end connection 172.28.0.163:55907 (399 connections now open) 2015-10-05T04:40:46.240+0100 [mongosMain] connection accepted from 172.28.0.163:57343 #1422482 (400 connections now open) 2015-10-05T04:40:46.241+0100 [conn1422482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:48.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1405703b51053eb2991 2015-10-05T04:40:49.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:54.756+0100 [conn1422038] end connection 172.28.0.164:65001 (399 connections now open) 2015-10-05T04:40:54.757+0100 [mongosMain] connection accepted from 172.28.0.164:50549 #1422483 (400 connections now open) 2015-10-05T04:40:54.759+0100 [conn1422483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:55.224+0100 [conn1422094] end connection 172.28.0.164:65335 (399 connections now open) 2015-10-05T04:40:55.225+0100 [mongosMain] connection accepted from 172.28.0.164:50552 #1422484 (400 connections now open) 2015-10-05T04:40:55.227+0100 [conn1422484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:55.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1475703b51053eb29bd 2015-10-05T04:40:55.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:40:55.599+0100 [conn1422056] end connection 172.28.0.163:55676 (399 connections now open) 2015-10-05T04:40:55.601+0100 [mongosMain] connection accepted from 172.28.0.163:57353 #1422485 (400 connections now open) 2015-10-05T04:40:55.602+0100 [conn1422485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:40:56.254+0100 [conn1422095] end connection 172.28.0.163:55916 (399 connections now open) 2015-10-05T04:40:56.255+0100 [mongosMain] connection accepted from 172.28.0.163:57355 #1422486 (400 connections now open) 2015-10-05T04:40:56.257+0100 [conn1422486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:01.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f14d5703b51053eb29e1 2015-10-05T04:41:01.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:04.771+0100 [conn1422062] end connection 172.28.0.164:65171 (399 connections now open) 2015-10-05T04:41:04.773+0100 [mongosMain] connection accepted from 172.28.0.164:50594 #1422487 (400 connections now open) 2015-10-05T04:41:04.775+0100 [conn1422487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:05.224+0100 [conn1422098] end connection 172.28.0.164:65349 (399 connections now open) 2015-10-05T04:41:05.224+0100 [mongosMain] connection accepted from 172.28.0.164:50605 #1422488 (400 connections now open) 2015-10-05T04:41:05.226+0100 [conn1422488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:06.255+0100 [conn1422099] end connection 172.28.0.163:55928 (399 connections now open) 2015-10-05T04:41:06.256+0100 [mongosMain] connection accepted from 172.28.0.163:57405 #1422489 (400 connections now open) 2015-10-05T04:41:06.257+0100 [conn1422489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:08.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1535703b51053eb2a24 2015-10-05T04:41:08.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:14.489+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:41:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:41:14.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f15a5703b51053eb2a44 2015-10-05T04:41:14.787+0100 [conn1422058] end connection 172.28.0.164:65129 (399 connections now open) 2015-10-05T04:41:14.790+0100 [mongosMain] connection accepted from 172.28.0.164:50682 #1422490 (400 connections now open) 2015-10-05T04:41:14.791+0100 [conn1422490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:14.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:15.239+0100 [conn1422101] end connection 172.28.0.164:65367 (399 connections now open) 2015-10-05T04:41:15.240+0100 [mongosMain] connection accepted from 172.28.0.164:50684 #1422491 (400 connections now open) 2015-10-05T04:41:15.242+0100 [conn1422491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:16.270+0100 [conn1422103] end connection 172.28.0.163:55952 (399 connections now open) 2015-10-05T04:41:16.271+0100 [mongosMain] connection accepted from 172.28.0.163:57447 #1422492 (400 connections now open) 2015-10-05T04:41:16.272+0100 [conn1422492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:18.718+0100 [conn1421997] end connection 172.28.0.164:64882 (399 connections now open) 2015-10-05T04:41:18.719+0100 [conn1422079] end connection 172.28.0.164:65287 (398 connections now open) 2015-10-05T04:41:18.719+0100 [mongosMain] connection accepted from 172.28.0.164:50688 #1422493 (399 connections now open) 2015-10-05T04:41:18.720+0100 [mongosMain] connection accepted from 172.28.0.164:50689 #1422494 (400 connections now open) 2015-10-05T04:41:18.721+0100 [conn1422493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:18.722+0100 [conn1422494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:19.624+0100 [conn1422061] end connection 172.28.0.163:55737 (399 connections now open) 2015-10-05T04:41:19.625+0100 [mongosMain] connection accepted from 172.28.0.163:57451 #1422495 (400 connections now open) 2015-10-05T04:41:19.626+0100 [conn1422495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:21.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1605703b51053eb2a6e 2015-10-05T04:41:21.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:24.803+0100 [conn1422072] end connection 172.28.0.164:65219 (399 connections now open) 2015-10-05T04:41:24.804+0100 [mongosMain] connection accepted from 172.28.0.164:50729 #1422496 (400 connections now open) 2015-10-05T04:41:24.805+0100 [conn1422496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:25.255+0100 [conn1422108] end connection 172.28.0.164:65381 (399 connections now open) 2015-10-05T04:41:25.256+0100 [mongosMain] connection accepted from 172.28.0.164:50737 #1422497 (400 connections now open) 2015-10-05T04:41:25.258+0100 [conn1422497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:25.631+0100 [conn1422077] end connection 172.28.0.163:55891 (399 connections now open) 2015-10-05T04:41:25.632+0100 [mongosMain] connection accepted from 172.28.0.163:57455 #1422498 (400 connections now open) 2015-10-05T04:41:25.633+0100 [conn1422498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:26.271+0100 [conn1422109] end connection 172.28.0.163:55969 (399 connections now open) 2015-10-05T04:41:26.272+0100 [mongosMain] connection accepted from 172.28.0.163:57457 #1422499 (400 connections now open) 2015-10-05T04:41:26.273+0100 [conn1422499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:27.502+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1675703b51053eb2a9e 2015-10-05T04:41:27.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:28.718+0100 [conn1422110] end connection 172.28.0.164:65384 (399 connections now open) 2015-10-05T04:41:28.718+0100 [conn1422059] end connection 172.28.0.164:65149 (398 connections now open) 2015-10-05T04:41:28.719+0100 [mongosMain] connection accepted from 172.28.0.164:50745 #1422500 (399 connections now open) 2015-10-05T04:41:28.720+0100 [mongosMain] connection accepted from 172.28.0.164:50746 #1422501 (400 connections now open) 2015-10-05T04:41:28.721+0100 [conn1422500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:28.722+0100 [conn1422501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:29.132+0100 [mongosMain] connection accepted from 127.0.0.1:57459 #1422502 (401 connections now open) 2015-10-05T04:41:29.135+0100 [conn1422502] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:29.141+0100 [conn1422502] end connection 127.0.0.1:57459 (400 connections now open) 2015-10-05T04:41:29.625+0100 [conn1422006] end connection 172.28.0.163:55498 (399 connections now open) 2015-10-05T04:41:29.627+0100 [mongosMain] connection accepted from 172.28.0.163:57460 #1422503 (400 connections now open) 2015-10-05T04:41:29.628+0100 [conn1422503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:33.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f16d5703b51053eb2ab5 2015-10-05T04:41:34.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:34.803+0100 [conn1422082] end connection 172.28.0.164:65298 (399 connections now open) 2015-10-05T04:41:34.804+0100 [mongosMain] connection accepted from 172.28.0.164:50754 #1422504 (400 connections now open) 2015-10-05T04:41:34.805+0100 [conn1422504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:35.255+0100 [conn1422114] end connection 172.28.0.164:65399 (399 connections now open) 2015-10-05T04:41:35.256+0100 [mongosMain] connection accepted from 172.28.0.164:50756 #1422505 (400 connections now open) 2015-10-05T04:41:35.258+0100 [conn1422505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:35.631+0100 [conn1422102] end connection 172.28.0.163:55951 (399 connections now open) 2015-10-05T04:41:35.632+0100 [mongosMain] connection accepted from 172.28.0.163:57463 #1422506 (400 connections now open) 2015-10-05T04:41:35.633+0100 [conn1422506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:36.286+0100 [conn1422116] end connection 172.28.0.163:55988 (399 connections now open) 2015-10-05T04:41:36.287+0100 [mongosMain] connection accepted from 172.28.0.163:57465 #1422507 (400 connections now open) 2015-10-05T04:41:36.288+0100 [conn1422507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:38.734+0100 [conn1422091] end connection 172.28.0.164:65321 (399 connections now open) 2015-10-05T04:41:38.734+0100 [conn1422090] end connection 172.28.0.164:65320 (399 connections now open) 2015-10-05T04:41:38.735+0100 [mongosMain] connection accepted from 172.28.0.164:50763 #1422508 (399 connections now open) 2015-10-05T04:41:38.735+0100 [mongosMain] connection accepted from 172.28.0.164:50764 #1422509 (400 connections now open) 2015-10-05T04:41:38.737+0100 [conn1422508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:38.737+0100 [conn1422509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:39.640+0100 [conn1422070] end connection 172.28.0.163:55777 (399 connections now open) 2015-10-05T04:41:39.640+0100 [conn1422106] end connection 172.28.0.163:55959 (399 connections now open) 2015-10-05T04:41:39.641+0100 [mongosMain] connection accepted from 172.28.0.163:57469 #1422510 (399 connections now open) 2015-10-05T04:41:39.641+0100 [mongosMain] connection accepted from 172.28.0.163:57470 #1422511 (400 connections now open) 2015-10-05T04:41:39.642+0100 [conn1422510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:39.643+0100 [conn1422511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:39.767+0100 [mongosMain] connection accepted from 127.0.0.1:57473 #1422512 (401 connections now open) 2015-10-05T04:41:39.769+0100 [conn1422512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:39.774+0100 [conn1422512] end connection 127.0.0.1:57473 (400 connections now open) 2015-10-05T04:41:40.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1745703b51053eb2ad6 2015-10-05T04:41:40.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:44.752+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:41:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:41:44.819+0100 [conn1422076] end connection 172.28.0.164:65283 (399 connections now open) 2015-10-05T04:41:44.820+0100 [mongosMain] connection accepted from 172.28.0.164:50773 #1422513 (400 connections now open) 2015-10-05T04:41:44.821+0100 [conn1422513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:45.271+0100 [conn1422123] end connection 172.28.0.164:65461 (399 connections now open) 2015-10-05T04:41:45.272+0100 [mongosMain] connection accepted from 172.28.0.164:50775 #1422514 (400 connections now open) 2015-10-05T04:41:45.274+0100 [conn1422514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:45.647+0100 [conn1422084] end connection 172.28.0.163:55898 (399 connections now open) 2015-10-05T04:41:45.649+0100 [mongosMain] connection accepted from 172.28.0.163:57480 #1422515 (400 connections now open) 2015-10-05T04:41:45.650+0100 [conn1422515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:46.287+0100 [conn1422125] end connection 172.28.0.163:56034 (399 connections now open) 2015-10-05T04:41:46.289+0100 [mongosMain] connection accepted from 172.28.0.163:57485 #1422516 (400 connections now open) 2015-10-05T04:41:46.290+0100 [conn1422516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:46.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f17a5703b51053eb2af3 2015-10-05T04:41:46.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:48.734+0100 [conn1421988] end connection 172.28.0.164:64831 (399 connections now open) 2015-10-05T04:41:48.734+0100 [conn1422086] end connection 172.28.0.164:65306 (398 connections now open) 2015-10-05T04:41:48.735+0100 [mongosMain] connection accepted from 172.28.0.164:50780 #1422517 (399 connections now open) 2015-10-05T04:41:48.735+0100 [mongosMain] connection accepted from 172.28.0.164:50781 #1422518 (400 connections now open) 2015-10-05T04:41:48.737+0100 [conn1422517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:48.737+0100 [conn1422518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:49.640+0100 [conn1422081] end connection 172.28.0.163:55895 (399 connections now open) 2015-10-05T04:41:49.641+0100 [mongosMain] connection accepted from 172.28.0.163:57491 #1422519 (400 connections now open) 2015-10-05T04:41:49.642+0100 [conn1422519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:53.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1805703b51053eb2b0f 2015-10-05T04:41:53.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:41:54.819+0100 [conn1422093] end connection 172.28.0.164:65332 (399 connections now open) 2015-10-05T04:41:54.820+0100 [mongosMain] connection accepted from 172.28.0.164:50788 #1422520 (400 connections now open) 2015-10-05T04:41:54.822+0100 [conn1422520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:55.268+0100 [conn1422131] end connection 172.28.0.164:65484 (399 connections now open) 2015-10-05T04:41:55.269+0100 [mongosMain] connection accepted from 172.28.0.164:50790 #1422521 (400 connections now open) 2015-10-05T04:41:55.271+0100 [conn1422521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:55.644+0100 [conn1422115] end connection 172.28.0.163:55985 (399 connections now open) 2015-10-05T04:41:55.645+0100 [mongosMain] connection accepted from 172.28.0.163:57501 #1422522 (400 connections now open) 2015-10-05T04:41:55.646+0100 [conn1422522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:56.295+0100 [conn1422133] end connection 172.28.0.163:56049 (399 connections now open) 2015-10-05T04:41:56.297+0100 [mongosMain] connection accepted from 172.28.0.163:57503 #1422523 (400 connections now open) 2015-10-05T04:41:56.298+0100 [conn1422523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:58.755+0100 [conn1422111] end connection 172.28.0.164:65386 (399 connections now open) 2015-10-05T04:41:58.756+0100 [mongosMain] connection accepted from 172.28.0.164:50794 #1422524 (400 connections now open) 2015-10-05T04:41:58.758+0100 [conn1422524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:59.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1875703b51053eb2b26 2015-10-05T04:41:59.647+0100 [conn1422112] end connection 172.28.0.163:55975 (399 connections now open) 2015-10-05T04:41:59.648+0100 [conn1422136] end connection 172.28.0.163:56058 (398 connections now open) 2015-10-05T04:41:59.650+0100 [mongosMain] connection accepted from 172.28.0.163:57511 #1422525 (399 connections now open) 2015-10-05T04:41:59.651+0100 [mongosMain] connection accepted from 172.28.0.163:57512 #1422526 (400 connections now open) 2015-10-05T04:41:59.652+0100 [conn1422525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:59.653+0100 [conn1422526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:41:59.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:04.824+0100 [conn1422100] end connection 172.28.0.164:65364 (399 connections now open) 2015-10-05T04:42:04.825+0100 [mongosMain] connection accepted from 172.28.0.164:50823 #1422527 (400 connections now open) 2015-10-05T04:42:04.827+0100 [conn1422527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:05.277+0100 [conn1422137] end connection 172.28.0.164:65497 (399 connections now open) 2015-10-05T04:42:05.278+0100 [mongosMain] connection accepted from 172.28.0.164:50826 #1422528 (400 connections now open) 2015-10-05T04:42:05.280+0100 [conn1422528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:05.653+0100 [conn1422124] end connection 172.28.0.163:56030 (399 connections now open) 2015-10-05T04:42:05.654+0100 [mongosMain] connection accepted from 172.28.0.163:57548 #1422529 (400 connections now open) 2015-10-05T04:42:05.655+0100 [conn1422529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:06.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f18d5703b51053eb2b60 2015-10-05T04:42:06.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:06.307+0100 [conn1422139] end connection 172.28.0.163:56067 (399 connections now open) 2015-10-05T04:42:06.309+0100 [mongosMain] connection accepted from 172.28.0.163:57552 #1422530 (400 connections now open) 2015-10-05T04:42:06.310+0100 [conn1422530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:08.740+0100 [conn1422004] end connection 172.28.0.164:64908 (399 connections now open) 2015-10-05T04:42:08.740+0100 [conn1422117] end connection 172.28.0.164:65419 (398 connections now open) 2015-10-05T04:42:08.741+0100 [mongosMain] connection accepted from 172.28.0.164:50849 #1422531 (399 connections now open) 2015-10-05T04:42:08.742+0100 [mongosMain] connection accepted from 172.28.0.164:50850 #1422532 (400 connections now open) 2015-10-05T04:42:08.743+0100 [conn1422531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:08.743+0100 [conn1422532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:09.662+0100 [conn1422113] end connection 172.28.0.163:55976 (399 connections now open) 2015-10-05T04:42:09.662+0100 [conn1422128] end connection 172.28.0.163:56038 (399 connections now open) 2015-10-05T04:42:09.663+0100 [mongosMain] connection accepted from 172.28.0.163:57575 #1422533 (399 connections now open) 2015-10-05T04:42:09.663+0100 [mongosMain] connection accepted from 172.28.0.163:57576 #1422534 (400 connections now open) 2015-10-05T04:42:09.664+0100 [conn1422533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:09.664+0100 [conn1422534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:12.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1945703b51053eb2b7a 2015-10-05T04:42:12.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:14.840+0100 [conn1422097] end connection 172.28.0.164:65345 (399 connections now open) 2015-10-05T04:42:14.841+0100 [mongosMain] connection accepted from 172.28.0.164:50873 #1422535 (400 connections now open) 2015-10-05T04:42:14.843+0100 [conn1422535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:15.014+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:42:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:42:15.292+0100 [conn1422142] end connection 172.28.0.164:65511 (399 connections now open) 2015-10-05T04:42:15.293+0100 [mongosMain] connection accepted from 172.28.0.164:50875 #1422536 (400 connections now open) 2015-10-05T04:42:15.294+0100 [conn1422536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:15.668+0100 [conn1422138] end connection 172.28.0.163:56064 (399 connections now open) 2015-10-05T04:42:15.669+0100 [mongosMain] connection accepted from 172.28.0.163:57593 #1422537 (400 connections now open) 2015-10-05T04:42:15.670+0100 [conn1422537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:16.308+0100 [conn1422144] end connection 172.28.0.163:56098 (399 connections now open) 2015-10-05T04:42:16.309+0100 [mongosMain] connection accepted from 172.28.0.163:57595 #1422538 (400 connections now open) 2015-10-05T04:42:16.310+0100 [conn1422538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:18.757+0100 [conn1422126] end connection 172.28.0.164:65473 (399 connections now open) 2015-10-05T04:42:18.757+0100 [conn1422080] end connection 172.28.0.164:65288 (398 connections now open) 2015-10-05T04:42:18.758+0100 [mongosMain] connection accepted from 172.28.0.164:50880 #1422539 (399 connections now open) 2015-10-05T04:42:18.759+0100 [mongosMain] connection accepted from 172.28.0.164:50881 #1422540 (400 connections now open) 2015-10-05T04:42:18.760+0100 [conn1422539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:18.760+0100 [conn1422540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:18.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f19a5703b51053eb2b8c 2015-10-05T04:42:18.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:19.665+0100 [conn1422135] end connection 172.28.0.163:56055 (399 connections now open) 2015-10-05T04:42:19.665+0100 [conn1422016] end connection 172.28.0.163:55512 (398 connections now open) 2015-10-05T04:42:19.666+0100 [mongosMain] connection accepted from 172.28.0.163:57598 #1422541 (399 connections now open) 2015-10-05T04:42:19.667+0100 [conn1422541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:19.668+0100 [mongosMain] connection accepted from 172.28.0.163:57599 #1422542 (400 connections now open) 2015-10-05T04:42:19.668+0100 [conn1422542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:24.855+0100 [conn1422107] end connection 172.28.0.164:65379 (399 connections now open) 2015-10-05T04:42:24.856+0100 [mongosMain] connection accepted from 172.28.0.164:50892 #1422543 (400 connections now open) 2015-10-05T04:42:24.858+0100 [conn1422543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:25.308+0100 [conn1422148] end connection 172.28.0.164:49202 (399 connections now open) 2015-10-05T04:42:25.309+0100 [mongosMain] connection accepted from 172.28.0.164:50894 #1422544 (400 connections now open) 2015-10-05T04:42:25.311+0100 [conn1422544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:25.668+0100 [conn1422132] end connection 172.28.0.163:56047 (399 connections now open) 2015-10-05T04:42:25.669+0100 [mongosMain] connection accepted from 172.28.0.163:57603 #1422545 (400 connections now open) 2015-10-05T04:42:25.670+0100 [conn1422545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:26.323+0100 [conn1422150] end connection 172.28.0.163:56153 (399 connections now open) 2015-10-05T04:42:26.326+0100 [mongosMain] connection accepted from 172.28.0.163:57604 #1422546 (400 connections now open) 2015-10-05T04:42:26.327+0100 [conn1422546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:28.404+0100 [mongosMain] connection accepted from 127.0.0.1:57606 #1422547 (401 connections now open) 2015-10-05T04:42:28.406+0100 [conn1422547] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:28.411+0100 [conn1422547] end connection 127.0.0.1:57606 (400 connections now open) 2015-10-05T04:42:28.772+0100 [conn1422104] end connection 172.28.0.164:65371 (399 connections now open) 2015-10-05T04:42:28.772+0100 [conn1421971] end connection 172.28.0.164:64796 (398 connections now open) 2015-10-05T04:42:28.774+0100 [mongosMain] connection accepted from 172.28.0.164:50900 #1422548 (399 connections now open) 2015-10-05T04:42:28.774+0100 [mongosMain] connection accepted from 172.28.0.164:50901 #1422549 (400 connections now open) 2015-10-05T04:42:28.776+0100 [conn1422548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:28.776+0100 [conn1422549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:29.678+0100 [conn1422060] end connection 172.28.0.163:55736 (399 connections now open) 2015-10-05T04:42:29.679+0100 [conn1422120] end connection 172.28.0.163:56001 (398 connections now open) 2015-10-05T04:42:29.680+0100 [mongosMain] connection accepted from 172.28.0.163:57607 #1422550 (399 connections now open) 2015-10-05T04:42:29.681+0100 [mongosMain] connection accepted from 172.28.0.163:57608 #1422551 (400 connections now open) 2015-10-05T04:42:29.681+0100 [conn1422550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:29.682+0100 [conn1422551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:31.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1a65703b51053eb2bdf 2015-10-05T04:42:31.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:34.856+0100 [conn1422122] end connection 172.28.0.164:65453 (399 connections now open) 2015-10-05T04:42:34.857+0100 [mongosMain] connection accepted from 172.28.0.164:50909 #1422552 (400 connections now open) 2015-10-05T04:42:34.859+0100 [conn1422552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:35.324+0100 [conn1422155] end connection 172.28.0.164:49220 (399 connections now open) 2015-10-05T04:42:35.325+0100 [mongosMain] connection accepted from 172.28.0.164:50911 #1422553 (400 connections now open) 2015-10-05T04:42:35.326+0100 [conn1422553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:35.684+0100 [conn1422149] end connection 172.28.0.163:56150 (399 connections now open) 2015-10-05T04:42:35.686+0100 [mongosMain] connection accepted from 172.28.0.163:57612 #1422554 (400 connections now open) 2015-10-05T04:42:35.687+0100 [conn1422554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:36.324+0100 [conn1422157] end connection 172.28.0.163:56164 (399 connections now open) 2015-10-05T04:42:36.325+0100 [mongosMain] connection accepted from 172.28.0.163:57614 #1422555 (400 connections now open) 2015-10-05T04:42:36.326+0100 [conn1422555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:38.788+0100 [conn1422146] end connection 172.28.0.164:65528 (399 connections now open) 2015-10-05T04:42:38.788+0100 [conn1422063] end connection 172.28.0.164:65173 (398 connections now open) 2015-10-05T04:42:38.789+0100 [mongosMain] connection accepted from 172.28.0.164:50918 #1422556 (399 connections now open) 2015-10-05T04:42:38.790+0100 [mongosMain] connection accepted from 172.28.0.164:50919 #1422557 (400 connections now open) 2015-10-05T04:42:38.791+0100 [conn1422556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:38.792+0100 [conn1422557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:39.406+0100 [mongosMain] connection accepted from 127.0.0.1:57616 #1422558 (401 connections now open) 2015-10-05T04:42:39.409+0100 [conn1422558] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:39.413+0100 [conn1422558] end connection 127.0.0.1:57616 (400 connections now open) 2015-10-05T04:42:39.679+0100 [conn1422153] end connection 172.28.0.163:56156 (399 connections now open) 2015-10-05T04:42:39.679+0100 [conn1422121] end connection 172.28.0.163:56002 (398 connections now open) 2015-10-05T04:42:39.680+0100 [mongosMain] connection accepted from 172.28.0.163:57617 #1422559 (399 connections now open) 2015-10-05T04:42:39.680+0100 [mongosMain] connection accepted from 172.28.0.163:57618 #1422560 (400 connections now open) 2015-10-05T04:42:39.681+0100 [conn1422559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:39.682+0100 [conn1422560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:43.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1b35703b51053eb2c1b 2015-10-05T04:42:43.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:44.871+0100 [conn1422141] end connection 172.28.0.164:65508 (399 connections now open) 2015-10-05T04:42:44.873+0100 [mongosMain] connection accepted from 172.28.0.164:50929 #1422561 (400 connections now open) 2015-10-05T04:42:44.875+0100 [conn1422561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:45.298+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:42:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:42:45.339+0100 [conn1422164] end connection 172.28.0.164:49239 (399 connections now open) 2015-10-05T04:42:45.341+0100 [mongosMain] connection accepted from 172.28.0.164:50931 #1422562 (400 connections now open) 2015-10-05T04:42:45.343+0100 [conn1422562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:45.684+0100 [conn1422156] end connection 172.28.0.163:56162 (399 connections now open) 2015-10-05T04:42:45.685+0100 [mongosMain] connection accepted from 172.28.0.163:57626 #1422563 (400 connections now open) 2015-10-05T04:42:45.687+0100 [conn1422563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:46.339+0100 [conn1422166] end connection 172.28.0.163:56173 (399 connections now open) 2015-10-05T04:42:46.340+0100 [mongosMain] connection accepted from 172.28.0.163:57629 #1422564 (400 connections now open) 2015-10-05T04:42:46.342+0100 [conn1422564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:48.803+0100 [conn1422152] end connection 172.28.0.164:49210 (399 connections now open) 2015-10-05T04:42:48.804+0100 [conn1422105] end connection 172.28.0.164:65372 (398 connections now open) 2015-10-05T04:42:48.804+0100 [mongosMain] connection accepted from 172.28.0.164:50939 #1422565 (399 connections now open) 2015-10-05T04:42:48.805+0100 [mongosMain] connection accepted from 172.28.0.164:50940 #1422566 (400 connections now open) 2015-10-05T04:42:48.806+0100 [conn1422565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:48.807+0100 [conn1422566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:49.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1b95703b51053eb2c30 2015-10-05T04:42:49.694+0100 [conn1422075] end connection 172.28.0.163:55869 (399 connections now open) 2015-10-05T04:42:49.694+0100 [conn1422162] end connection 172.28.0.163:56168 (399 connections now open) 2015-10-05T04:42:49.696+0100 [mongosMain] connection accepted from 172.28.0.163:57635 #1422567 (399 connections now open) 2015-10-05T04:42:49.696+0100 [mongosMain] connection accepted from 172.28.0.163:57636 #1422568 (400 connections now open) 2015-10-05T04:42:49.696+0100 [conn1422567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:49.697+0100 [conn1422568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:49.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:42:54.871+0100 [conn1422147] end connection 172.28.0.164:49191 (399 connections now open) 2015-10-05T04:42:54.872+0100 [mongosMain] connection accepted from 172.28.0.164:50947 #1422569 (400 connections now open) 2015-10-05T04:42:54.874+0100 [conn1422569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:55.340+0100 [conn1422173] end connection 172.28.0.164:49260 (399 connections now open) 2015-10-05T04:42:55.341+0100 [mongosMain] connection accepted from 172.28.0.164:50949 #1422570 (400 connections now open) 2015-10-05T04:42:55.342+0100 [conn1422570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:55.700+0100 [conn1422165] end connection 172.28.0.163:56171 (399 connections now open) 2015-10-05T04:42:55.701+0100 [mongosMain] connection accepted from 172.28.0.163:57647 #1422571 (400 connections now open) 2015-10-05T04:42:55.702+0100 [conn1422571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:56.340+0100 [conn1422175] end connection 172.28.0.163:56189 (399 connections now open) 2015-10-05T04:42:56.342+0100 [mongosMain] connection accepted from 172.28.0.163:57650 #1422572 (400 connections now open) 2015-10-05T04:42:56.343+0100 [conn1422572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:58.819+0100 [conn1422140] end connection 172.28.0.164:65502 (399 connections now open) 2015-10-05T04:42:58.820+0100 [conn1422168] end connection 172.28.0.164:49248 (398 connections now open) 2015-10-05T04:42:58.821+0100 [mongosMain] connection accepted from 172.28.0.164:50952 #1422573 (399 connections now open) 2015-10-05T04:42:58.821+0100 [mongosMain] connection accepted from 172.28.0.164:50953 #1422574 (400 connections now open) 2015-10-05T04:42:58.822+0100 [conn1422573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:58.823+0100 [conn1422574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:42:59.694+0100 [conn1422129] end connection 172.28.0.163:56039 (399 connections now open) 2015-10-05T04:42:59.695+0100 [mongosMain] connection accepted from 172.28.0.163:57655 #1422575 (400 connections now open) 2015-10-05T04:42:59.697+0100 [conn1422575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:02.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1c55703b51053eb2c76 2015-10-05T04:43:02.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:04.887+0100 [conn1422154] end connection 172.28.0.164:49218 (399 connections now open) 2015-10-05T04:43:04.888+0100 [mongosMain] connection accepted from 172.28.0.164:50975 #1422576 (400 connections now open) 2015-10-05T04:43:04.889+0100 [conn1422576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:05.355+0100 [conn1422181] end connection 172.28.0.164:49281 (399 connections now open) 2015-10-05T04:43:05.357+0100 [mongosMain] connection accepted from 172.28.0.164:50979 #1422577 (400 connections now open) 2015-10-05T04:43:05.358+0100 [conn1422577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:06.355+0100 [conn1422183] end connection 172.28.0.163:56205 (399 connections now open) 2015-10-05T04:43:06.356+0100 [mongosMain] connection accepted from 172.28.0.163:57702 #1422578 (400 connections now open) 2015-10-05T04:43:06.357+0100 [conn1422578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:08.835+0100 [conn1422184] end connection 172.28.0.164:49286 (399 connections now open) 2015-10-05T04:43:08.835+0100 [conn1422096] end connection 172.28.0.164:65340 (399 connections now open) 2015-10-05T04:43:08.836+0100 [mongosMain] connection accepted from 172.28.0.164:51027 #1422579 (399 connections now open) 2015-10-05T04:43:08.837+0100 [mongosMain] connection accepted from 172.28.0.164:51028 #1422580 (400 connections now open) 2015-10-05T04:43:08.838+0100 [conn1422579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:08.838+0100 [conn1422580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:09.711+0100 [conn1422065] end connection 172.28.0.163:55765 (399 connections now open) 2015-10-05T04:43:09.712+0100 [mongosMain] connection accepted from 172.28.0.163:57728 #1422581 (400 connections now open) 2015-10-05T04:43:09.713+0100 [conn1422581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:14.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1d25703b51053eb2cc4 2015-10-05T04:43:14.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:14.887+0100 [conn1422163] end connection 172.28.0.164:49236 (399 connections now open) 2015-10-05T04:43:14.889+0100 [mongosMain] connection accepted from 172.28.0.164:51044 #1422582 (400 connections now open) 2015-10-05T04:43:14.890+0100 [conn1422582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:15.355+0100 [conn1422189] end connection 172.28.0.164:49316 (399 connections now open) 2015-10-05T04:43:15.356+0100 [mongosMain] connection accepted from 172.28.0.164:51046 #1422583 (400 connections now open) 2015-10-05T04:43:15.358+0100 [conn1422583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:15.555+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:43:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:43:15.715+0100 [conn1422174] end connection 172.28.0.163:56185 (399 connections now open) 2015-10-05T04:43:15.717+0100 [mongosMain] connection accepted from 172.28.0.163:57747 #1422584 (400 connections now open) 2015-10-05T04:43:15.718+0100 [conn1422584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:16.371+0100 [conn1422191] end connection 172.28.0.163:56255 (399 connections now open) 2015-10-05T04:43:16.372+0100 [mongosMain] connection accepted from 172.28.0.163:57749 #1422585 (400 connections now open) 2015-10-05T04:43:16.373+0100 [conn1422585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:18.850+0100 [conn1422127] end connection 172.28.0.164:65474 (399 connections now open) 2015-10-05T04:43:18.850+0100 [conn1422192] end connection 172.28.0.164:49338 (399 connections now open) 2015-10-05T04:43:18.851+0100 [mongosMain] connection accepted from 172.28.0.164:51050 #1422586 (399 connections now open) 2015-10-05T04:43:18.852+0100 [mongosMain] connection accepted from 172.28.0.164:51051 #1422587 (400 connections now open) 2015-10-05T04:43:18.853+0100 [conn1422586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:18.853+0100 [conn1422587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:19.725+0100 [conn1422179] end connection 172.28.0.163:56195 (399 connections now open) 2015-10-05T04:43:19.725+0100 [conn1422178] end connection 172.28.0.163:56194 (399 connections now open) 2015-10-05T04:43:19.726+0100 [mongosMain] connection accepted from 172.28.0.163:57753 #1422588 (399 connections now open) 2015-10-05T04:43:19.726+0100 [mongosMain] connection accepted from 172.28.0.163:57752 #1422589 (400 connections now open) 2015-10-05T04:43:19.727+0100 [conn1422588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:19.727+0100 [conn1422589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:24.928+0100 [conn1422172] end connection 172.28.0.164:49257 (399 connections now open) 2015-10-05T04:43:24.928+0100 [mongosMain] connection accepted from 172.28.0.164:51064 #1422590 (400 connections now open) 2015-10-05T04:43:24.928+0100 [conn1422590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:25.396+0100 [conn1422196] end connection 172.28.0.164:49359 (399 connections now open) 2015-10-05T04:43:25.396+0100 [mongosMain] connection accepted from 172.28.0.164:51067 #1422591 (400 connections now open) 2015-10-05T04:43:25.396+0100 [conn1422591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:25.770+0100 [conn1422182] end connection 172.28.0.163:56202 (399 connections now open) 2015-10-05T04:43:25.770+0100 [mongosMain] connection accepted from 172.28.0.163:57758 #1422592 (400 connections now open) 2015-10-05T04:43:25.770+0100 [conn1422592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:26.383+0100 [conn1422198] end connection 172.28.0.163:56289 (399 connections now open) 2015-10-05T04:43:26.384+0100 [mongosMain] connection accepted from 172.28.0.163:57760 #1422593 (400 connections now open) 2015-10-05T04:43:26.385+0100 [conn1422593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:26.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1de5703b51053eb2ceb 2015-10-05T04:43:26.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:28.850+0100 [conn1422176] end connection 172.28.0.164:49271 (399 connections now open) 2015-10-05T04:43:28.850+0100 [conn1422134] end connection 172.28.0.164:65490 (398 connections now open) 2015-10-05T04:43:28.852+0100 [mongosMain] connection accepted from 172.28.0.164:51072 #1422594 (399 connections now open) 2015-10-05T04:43:28.853+0100 [mongosMain] connection accepted from 172.28.0.164:51073 #1422595 (400 connections now open) 2015-10-05T04:43:28.854+0100 [conn1422595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:28.854+0100 [conn1422594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:28.857+0100 [mongosMain] connection accepted from 127.0.0.1:57762 #1422596 (401 connections now open) 2015-10-05T04:43:28.862+0100 [conn1422596] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:28.866+0100 [conn1422596] end connection 127.0.0.1:57762 (400 connections now open) 2015-10-05T04:43:29.736+0100 [conn1422169] end connection 172.28.0.163:56175 (399 connections now open) 2015-10-05T04:43:29.736+0100 [conn1422170] end connection 172.28.0.163:56176 (398 connections now open) 2015-10-05T04:43:29.738+0100 [mongosMain] connection accepted from 172.28.0.163:57763 #1422597 (399 connections now open) 2015-10-05T04:43:29.739+0100 [conn1422597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:29.739+0100 [mongosMain] connection accepted from 172.28.0.163:57765 #1422598 (400 connections now open) 2015-10-05T04:43:29.740+0100 [conn1422598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:33.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1e45703b51053eb2d02 2015-10-05T04:43:33.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:34.919+0100 [conn1422180] end connection 172.28.0.164:49279 (399 connections now open) 2015-10-05T04:43:34.920+0100 [mongosMain] connection accepted from 172.28.0.164:51082 #1422599 (400 connections now open) 2015-10-05T04:43:34.921+0100 [conn1422599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:35.371+0100 [conn1422204] end connection 172.28.0.164:49375 (399 connections now open) 2015-10-05T04:43:35.372+0100 [mongosMain] connection accepted from 172.28.0.164:51084 #1422600 (400 connections now open) 2015-10-05T04:43:35.374+0100 [conn1422600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:35.731+0100 [conn1422143] end connection 172.28.0.163:56093 (399 connections now open) 2015-10-05T04:43:35.732+0100 [mongosMain] connection accepted from 172.28.0.163:57767 #1422601 (400 connections now open) 2015-10-05T04:43:35.733+0100 [conn1422601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:36.387+0100 [conn1422206] end connection 172.28.0.163:56299 (399 connections now open) 2015-10-05T04:43:36.388+0100 [mongosMain] connection accepted from 172.28.0.163:57769 #1422602 (400 connections now open) 2015-10-05T04:43:36.389+0100 [conn1422602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:38.866+0100 [conn1422159] end connection 172.28.0.164:49228 (399 connections now open) 2015-10-05T04:43:38.867+0100 [conn1422118] end connection 172.28.0.164:65420 (398 connections now open) 2015-10-05T04:43:38.868+0100 [mongosMain] connection accepted from 172.28.0.164:51091 #1422603 (399 connections now open) 2015-10-05T04:43:38.869+0100 [mongosMain] connection accepted from 172.28.0.164:51093 #1422604 (400 connections now open) 2015-10-05T04:43:38.870+0100 [conn1422603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:38.870+0100 [conn1422604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:39.280+0100 [mongosMain] connection accepted from 127.0.0.1:57771 #1422605 (401 connections now open) 2015-10-05T04:43:39.283+0100 [conn1422605] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:39.288+0100 [conn1422605] end connection 127.0.0.1:57771 (400 connections now open) 2015-10-05T04:43:39.741+0100 [conn1422186] end connection 172.28.0.163:56211 (399 connections now open) 2015-10-05T04:43:39.741+0100 [conn1422068] end connection 172.28.0.163:55770 (398 connections now open) 2015-10-05T04:43:39.743+0100 [mongosMain] connection accepted from 172.28.0.163:57774 #1422606 (399 connections now open) 2015-10-05T04:43:39.743+0100 [mongosMain] connection accepted from 172.28.0.163:57775 #1422607 (400 connections now open) 2015-10-05T04:43:39.743+0100 [conn1422606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:39.745+0100 [conn1422607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:44.934+0100 [conn1422195] end connection 172.28.0.164:49357 (399 connections now open) 2015-10-05T04:43:44.938+0100 [mongosMain] connection accepted from 172.28.0.164:51102 #1422608 (400 connections now open) 2015-10-05T04:43:44.940+0100 [conn1422608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:45.387+0100 [conn1422212] end connection 172.28.0.164:49392 (399 connections now open) 2015-10-05T04:43:45.388+0100 [mongosMain] connection accepted from 172.28.0.164:51104 #1422609 (400 connections now open) 2015-10-05T04:43:45.393+0100 [conn1422609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:45.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1f15703b51053eb2d31 2015-10-05T04:43:45.747+0100 [conn1422190] end connection 172.28.0.163:56250 (399 connections now open) 2015-10-05T04:43:45.748+0100 [mongosMain] connection accepted from 172.28.0.163:57783 #1422610 (400 connections now open) 2015-10-05T04:43:45.749+0100 [conn1422610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:45.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:45.807+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:43:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:43:46.388+0100 [conn1422214] end connection 172.28.0.163:56307 (399 connections now open) 2015-10-05T04:43:46.389+0100 [mongosMain] connection accepted from 172.28.0.163:57785 #1422611 (400 connections now open) 2015-10-05T04:43:46.390+0100 [conn1422611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:48.866+0100 [conn1422200] end connection 172.28.0.164:49363 (399 connections now open) 2015-10-05T04:43:48.867+0100 [conn1422145] end connection 172.28.0.164:65527 (398 connections now open) 2015-10-05T04:43:48.868+0100 [mongosMain] connection accepted from 172.28.0.164:51111 #1422612 (399 connections now open) 2015-10-05T04:43:48.868+0100 [mongosMain] connection accepted from 172.28.0.164:51112 #1422613 (400 connections now open) 2015-10-05T04:43:48.869+0100 [conn1422612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:48.870+0100 [conn1422613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:49.741+0100 [conn1422201] end connection 172.28.0.163:56292 (399 connections now open) 2015-10-05T04:43:49.741+0100 [conn1422161] end connection 172.28.0.163:56167 (398 connections now open) 2015-10-05T04:43:49.743+0100 [mongosMain] connection accepted from 172.28.0.163:57791 #1422614 (399 connections now open) 2015-10-05T04:43:49.744+0100 [mongosMain] connection accepted from 172.28.0.163:57792 #1422615 (400 connections now open) 2015-10-05T04:43:49.744+0100 [conn1422614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:49.745+0100 [conn1422615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:55.402+0100 [conn1422220] end connection 172.28.0.164:49412 (399 connections now open) 2015-10-05T04:43:55.404+0100 [mongosMain] connection accepted from 172.28.0.164:51120 #1422616 (400 connections now open) 2015-10-05T04:43:55.406+0100 [conn1422616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:55.747+0100 [conn1422205] end connection 172.28.0.163:56297 (399 connections now open) 2015-10-05T04:43:55.749+0100 [mongosMain] connection accepted from 172.28.0.163:57802 #1422617 (400 connections now open) 2015-10-05T04:43:55.750+0100 [conn1422617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:56.403+0100 [conn1422222] end connection 172.28.0.163:56323 (399 connections now open) 2015-10-05T04:43:56.404+0100 [mongosMain] connection accepted from 172.28.0.163:57804 #1422618 (400 connections now open) 2015-10-05T04:43:56.405+0100 [conn1422618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:57.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f1fd5703b51053eb2d60 2015-10-05T04:43:57.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:43:58.882+0100 [conn1422207] end connection 172.28.0.164:49382 (399 connections now open) 2015-10-05T04:43:58.882+0100 [conn1422151] end connection 172.28.0.164:49209 (398 connections now open) 2015-10-05T04:43:58.883+0100 [mongosMain] connection accepted from 172.28.0.164:51123 #1422619 (399 connections now open) 2015-10-05T04:43:58.883+0100 [mongosMain] connection accepted from 172.28.0.164:51124 #1422620 (400 connections now open) 2015-10-05T04:43:58.884+0100 [conn1422619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:58.885+0100 [conn1422620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:59.757+0100 [conn1422210] end connection 172.28.0.163:56303 (399 connections now open) 2015-10-05T04:43:59.757+0100 [conn1422187] end connection 172.28.0.163:56210 (398 connections now open) 2015-10-05T04:43:59.758+0100 [mongosMain] connection accepted from 172.28.0.163:57809 #1422621 (399 connections now open) 2015-10-05T04:43:59.758+0100 [mongosMain] connection accepted from 172.28.0.163:57810 #1422622 (400 connections now open) 2015-10-05T04:43:59.760+0100 [conn1422621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:43:59.760+0100 [conn1422622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:04.950+0100 [conn1422211] end connection 172.28.0.164:49389 (399 connections now open) 2015-10-05T04:44:04.951+0100 [mongosMain] connection accepted from 172.28.0.164:51154 #1422623 (400 connections now open) 2015-10-05T04:44:04.953+0100 [conn1422623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:05.402+0100 [conn1422226] end connection 172.28.0.164:49427 (399 connections now open) 2015-10-05T04:44:05.403+0100 [mongosMain] connection accepted from 172.28.0.164:51157 #1422624 (400 connections now open) 2015-10-05T04:44:05.404+0100 [conn1422624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:05.762+0100 [conn1422197] end connection 172.28.0.163:56286 (399 connections now open) 2015-10-05T04:44:05.763+0100 [mongosMain] connection accepted from 172.28.0.163:57854 #1422625 (400 connections now open) 2015-10-05T04:44:05.765+0100 [conn1422625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:06.404+0100 [conn1422228] end connection 172.28.0.163:56341 (399 connections now open) 2015-10-05T04:44:06.405+0100 [mongosMain] connection accepted from 172.28.0.163:57859 #1422626 (400 connections now open) 2015-10-05T04:44:06.406+0100 [conn1422626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:08.882+0100 [conn1422229] end connection 172.28.0.164:49431 (399 connections now open) 2015-10-05T04:44:08.883+0100 [conn1422177] end connection 172.28.0.164:49272 (398 connections now open) 2015-10-05T04:44:08.883+0100 [mongosMain] connection accepted from 172.28.0.164:51182 #1422627 (399 connections now open) 2015-10-05T04:44:08.884+0100 [mongosMain] connection accepted from 172.28.0.164:51183 #1422628 (400 connections now open) 2015-10-05T04:44:08.885+0100 [conn1422627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:08.886+0100 [conn1422628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:09.758+0100 [conn1422230] end connection 172.28.0.163:56347 (399 connections now open) 2015-10-05T04:44:09.758+0100 [conn1422202] end connection 172.28.0.163:56293 (399 connections now open) 2015-10-05T04:44:09.759+0100 [mongosMain] connection accepted from 172.28.0.163:57886 #1422629 (399 connections now open) 2015-10-05T04:44:09.759+0100 [mongosMain] connection accepted from 172.28.0.163:57887 #1422630 (400 connections now open) 2015-10-05T04:44:09.760+0100 [conn1422629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:09.761+0100 [conn1422630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:10.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f20a5703b51053eb2d9b 2015-10-05T04:44:10.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:14.966+0100 [conn1422203] end connection 172.28.0.164:49373 (399 connections now open) 2015-10-05T04:44:14.967+0100 [mongosMain] connection accepted from 172.28.0.164:51204 #1422631 (400 connections now open) 2015-10-05T04:44:14.969+0100 [conn1422631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:15.418+0100 [conn1422232] end connection 172.28.0.164:49459 (399 connections now open) 2015-10-05T04:44:15.419+0100 [mongosMain] connection accepted from 172.28.0.164:51206 #1422632 (400 connections now open) 2015-10-05T04:44:15.420+0100 [conn1422632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:15.763+0100 [conn1422221] end connection 172.28.0.163:56321 (399 connections now open) 2015-10-05T04:44:15.764+0100 [mongosMain] connection accepted from 172.28.0.163:57913 #1422633 (400 connections now open) 2015-10-05T04:44:15.766+0100 [conn1422633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:15.951+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:44:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:44:16.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2105703b51053eb2daa 2015-10-05T04:44:16.419+0100 [conn1422234] end connection 172.28.0.163:56392 (399 connections now open) 2015-10-05T04:44:16.421+0100 [mongosMain] connection accepted from 172.28.0.163:57914 #1422634 (400 connections now open) 2015-10-05T04:44:16.422+0100 [conn1422634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:16.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:18.897+0100 [conn1422215] end connection 172.28.0.164:49400 (399 connections now open) 2015-10-05T04:44:18.898+0100 [conn1422199] end connection 172.28.0.164:49364 (398 connections now open) 2015-10-05T04:44:18.898+0100 [mongosMain] connection accepted from 172.28.0.164:51212 #1422635 (399 connections now open) 2015-10-05T04:44:18.899+0100 [mongosMain] connection accepted from 172.28.0.164:51213 #1422636 (400 connections now open) 2015-10-05T04:44:18.900+0100 [conn1422635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:18.900+0100 [conn1422636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:19.773+0100 [conn1422225] end connection 172.28.0.163:56331 (399 connections now open) 2015-10-05T04:44:19.773+0100 [conn1422217] end connection 172.28.0.163:56312 (399 connections now open) 2015-10-05T04:44:19.774+0100 [mongosMain] connection accepted from 172.28.0.163:57919 #1422637 (399 connections now open) 2015-10-05T04:44:19.775+0100 [mongosMain] connection accepted from 172.28.0.163:57920 #1422638 (400 connections now open) 2015-10-05T04:44:19.776+0100 [conn1422638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:19.776+0100 [conn1422637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:22.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2165703b51053eb2db3 2015-10-05T04:44:22.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:24.966+0100 [conn1422219] end connection 172.28.0.164:49410 (399 connections now open) 2015-10-05T04:44:24.967+0100 [mongosMain] connection accepted from 172.28.0.164:51228 #1422639 (400 connections now open) 2015-10-05T04:44:24.969+0100 [conn1422639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:25.418+0100 [conn1422239] end connection 172.28.0.164:49496 (399 connections now open) 2015-10-05T04:44:25.419+0100 [mongosMain] connection accepted from 172.28.0.164:51230 #1422640 (400 connections now open) 2015-10-05T04:44:25.421+0100 [conn1422640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:25.778+0100 [conn1422213] end connection 172.28.0.163:56306 (399 connections now open) 2015-10-05T04:44:25.780+0100 [mongosMain] connection accepted from 172.28.0.163:57924 #1422641 (400 connections now open) 2015-10-05T04:44:25.781+0100 [conn1422641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:26.419+0100 [conn1422241] end connection 172.28.0.163:56436 (399 connections now open) 2015-10-05T04:44:26.421+0100 [mongosMain] connection accepted from 172.28.0.163:57926 #1422642 (400 connections now open) 2015-10-05T04:44:26.422+0100 [conn1422642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:28.341+0100 [mongosMain] connection accepted from 127.0.0.1:57928 #1422643 (401 connections now open) 2015-10-05T04:44:28.344+0100 [conn1422643] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:28.351+0100 [conn1422643] end connection 127.0.0.1:57928 (400 connections now open) 2015-10-05T04:44:28.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f21c5703b51053eb2dc3 2015-10-05T04:44:28.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:28.914+0100 [conn1422235] end connection 172.28.0.164:49481 (399 connections now open) 2015-10-05T04:44:28.914+0100 [conn1422167] end connection 172.28.0.164:49246 (399 connections now open) 2015-10-05T04:44:28.914+0100 [mongosMain] connection accepted from 172.28.0.164:51237 #1422644 (399 connections now open) 2015-10-05T04:44:28.915+0100 [mongosMain] connection accepted from 172.28.0.164:51238 #1422645 (400 connections now open) 2015-10-05T04:44:28.916+0100 [conn1422644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:28.916+0100 [conn1422645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:29.773+0100 [conn1422224] end connection 172.28.0.163:56330 (399 connections now open) 2015-10-05T04:44:29.773+0100 [conn1422194] end connection 172.28.0.163:56276 (398 connections now open) 2015-10-05T04:44:29.775+0100 [mongosMain] connection accepted from 172.28.0.163:57930 #1422646 (399 connections now open) 2015-10-05T04:44:29.777+0100 [conn1422646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:29.777+0100 [mongosMain] connection accepted from 172.28.0.163:57929 #1422647 (400 connections now open) 2015-10-05T04:44:29.778+0100 [conn1422647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:34.981+0100 [conn1422188] end connection 172.28.0.164:49310 (399 connections now open) 2015-10-05T04:44:34.982+0100 [mongosMain] connection accepted from 172.28.0.164:51247 #1422648 (400 connections now open) 2015-10-05T04:44:34.984+0100 [conn1422648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:35.435+0100 [conn1422247] end connection 172.28.0.164:49514 (399 connections now open) 2015-10-05T04:44:35.436+0100 [mongosMain] connection accepted from 172.28.0.164:51250 #1422649 (400 connections now open) 2015-10-05T04:44:35.439+0100 [conn1422649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:35.779+0100 [conn1422227] end connection 172.28.0.163:56340 (399 connections now open) 2015-10-05T04:44:35.780+0100 [mongosMain] connection accepted from 172.28.0.163:57933 #1422650 (400 connections now open) 2015-10-05T04:44:35.781+0100 [conn1422650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:36.434+0100 [conn1422249] end connection 172.28.0.163:56447 (399 connections now open) 2015-10-05T04:44:36.435+0100 [mongosMain] connection accepted from 172.28.0.163:57935 #1422651 (400 connections now open) 2015-10-05T04:44:36.437+0100 [conn1422651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:38.914+0100 [conn1422223] end connection 172.28.0.164:49419 (399 connections now open) 2015-10-05T04:44:38.914+0100 [conn1422185] end connection 172.28.0.164:49287 (398 connections now open) 2015-10-05T04:44:38.915+0100 [mongosMain] connection accepted from 172.28.0.164:51257 #1422652 (399 connections now open) 2015-10-05T04:44:38.915+0100 [mongosMain] connection accepted from 172.28.0.164:51258 #1422653 (400 connections now open) 2015-10-05T04:44:38.917+0100 [conn1422652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:38.917+0100 [conn1422653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:39.788+0100 [conn1422209] end connection 172.28.0.163:56302 (399 connections now open) 2015-10-05T04:44:39.788+0100 [conn1422237] end connection 172.28.0.163:56421 (399 connections now open) 2015-10-05T04:44:39.789+0100 [mongosMain] connection accepted from 172.28.0.163:57937 #1422654 (399 connections now open) 2015-10-05T04:44:39.789+0100 [mongosMain] connection accepted from 172.28.0.163:57938 #1422655 (400 connections now open) 2015-10-05T04:44:39.790+0100 [conn1422654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:39.790+0100 [conn1422655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:39.980+0100 [mongosMain] connection accepted from 127.0.0.1:57941 #1422656 (401 connections now open) 2015-10-05T04:44:39.984+0100 [conn1422656] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:39.988+0100 [conn1422656] end connection 127.0.0.1:57941 (400 connections now open) 2015-10-05T04:44:41.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2285703b51053eb2e09 2015-10-05T04:44:41.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:45.434+0100 [conn1422256] end connection 172.28.0.164:49532 (399 connections now open) 2015-10-05T04:44:45.435+0100 [mongosMain] connection accepted from 172.28.0.164:51269 #1422657 (400 connections now open) 2015-10-05T04:44:45.437+0100 [conn1422657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:45.794+0100 [conn1422233] end connection 172.28.0.163:56388 (399 connections now open) 2015-10-05T04:44:45.795+0100 [mongosMain] connection accepted from 172.28.0.163:57950 #1422658 (400 connections now open) 2015-10-05T04:44:45.796+0100 [conn1422658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:46.212+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:44:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:44:46.450+0100 [conn1422258] end connection 172.28.0.163:56458 (399 connections now open) 2015-10-05T04:44:46.452+0100 [mongosMain] connection accepted from 172.28.0.163:57952 #1422659 (400 connections now open) 2015-10-05T04:44:46.453+0100 [conn1422659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:48.913+0100 [conn1422242] end connection 172.28.0.164:49501 (399 connections now open) 2015-10-05T04:44:48.913+0100 [conn1422243] end connection 172.28.0.164:49500 (398 connections now open) 2015-10-05T04:44:48.914+0100 [mongosMain] connection accepted from 172.28.0.164:51275 #1422660 (399 connections now open) 2015-10-05T04:44:48.915+0100 [mongosMain] connection accepted from 172.28.0.164:51276 #1422661 (400 connections now open) 2015-10-05T04:44:48.916+0100 [conn1422660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:48.917+0100 [conn1422661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:49.805+0100 [conn1422254] end connection 172.28.0.163:56451 (399 connections now open) 2015-10-05T04:44:49.805+0100 [conn1422031] end connection 172.28.0.163:55539 (398 connections now open) 2015-10-05T04:44:49.806+0100 [mongosMain] connection accepted from 172.28.0.163:57958 #1422662 (399 connections now open) 2015-10-05T04:44:49.806+0100 [mongosMain] connection accepted from 172.28.0.163:57959 #1422663 (400 connections now open) 2015-10-05T04:44:49.807+0100 [conn1422662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:49.808+0100 [conn1422663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:53.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2355703b51053eb2e4e 2015-10-05T04:44:53.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:44:55.449+0100 [conn1422265] end connection 172.28.0.164:49551 (399 connections now open) 2015-10-05T04:44:55.451+0100 [mongosMain] connection accepted from 172.28.0.164:51288 #1422664 (400 connections now open) 2015-10-05T04:44:55.453+0100 [conn1422664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:55.797+0100 [conn1422248] end connection 172.28.0.163:56445 (399 connections now open) 2015-10-05T04:44:55.799+0100 [mongosMain] connection accepted from 172.28.0.163:57967 #1422665 (400 connections now open) 2015-10-05T04:44:55.800+0100 [conn1422665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:56.453+0100 [conn1422267] end connection 172.28.0.163:56473 (399 connections now open) 2015-10-05T04:44:56.454+0100 [mongosMain] connection accepted from 172.28.0.163:57971 #1422666 (400 connections now open) 2015-10-05T04:44:56.456+0100 [conn1422666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:58.929+0100 [conn1422250] end connection 172.28.0.164:49520 (399 connections now open) 2015-10-05T04:44:58.931+0100 [mongosMain] connection accepted from 172.28.0.164:51294 #1422667 (400 connections now open) 2015-10-05T04:44:58.932+0100 [conn1422667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:59.806+0100 [conn1422245] end connection 172.28.0.163:56440 (399 connections now open) 2015-10-05T04:44:59.806+0100 [conn1422216] end connection 172.28.0.163:56311 (398 connections now open) 2015-10-05T04:44:59.807+0100 [mongosMain] connection accepted from 172.28.0.163:57977 #1422668 (399 connections now open) 2015-10-05T04:44:59.807+0100 [mongosMain] connection accepted from 172.28.0.163:57978 #1422669 (400 connections now open) 2015-10-05T04:44:59.808+0100 [conn1422669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:44:59.808+0100 [conn1422668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:05.013+0100 [conn1422264] end connection 172.28.0.164:49549 (399 connections now open) 2015-10-05T04:45:05.014+0100 [mongosMain] connection accepted from 172.28.0.164:51322 #1422670 (400 connections now open) 2015-10-05T04:45:05.016+0100 [conn1422670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:05.465+0100 [conn1422273] end connection 172.28.0.164:49570 (399 connections now open) 2015-10-05T04:45:05.466+0100 [mongosMain] connection accepted from 172.28.0.164:51328 #1422671 (400 connections now open) 2015-10-05T04:45:05.468+0100 [conn1422671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:05.810+0100 [conn1422240] end connection 172.28.0.163:56435 (399 connections now open) 2015-10-05T04:45:05.812+0100 [mongosMain] connection accepted from 172.28.0.163:58018 #1422672 (400 connections now open) 2015-10-05T04:45:05.813+0100 [conn1422672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:06.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2415703b51053eb2e86 2015-10-05T04:45:06.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:45:06.466+0100 [conn1422275] end connection 172.28.0.163:56495 (399 connections now open) 2015-10-05T04:45:06.468+0100 [mongosMain] connection accepted from 172.28.0.163:58026 #1422673 (400 connections now open) 2015-10-05T04:45:06.469+0100 [conn1422673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:08.945+0100 [conn1422268] end connection 172.28.0.164:49558 (399 connections now open) 2015-10-05T04:45:08.945+0100 [conn1422276] end connection 172.28.0.164:49573 (399 connections now open) 2015-10-05T04:45:08.946+0100 [mongosMain] connection accepted from 172.28.0.164:51347 #1422674 (399 connections now open) 2015-10-05T04:45:08.946+0100 [mongosMain] connection accepted from 172.28.0.164:51348 #1422675 (400 connections now open) 2015-10-05T04:45:08.948+0100 [conn1422674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:08.948+0100 [conn1422675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:09.820+0100 [conn1422231] end connection 172.28.0.163:56349 (399 connections now open) 2015-10-05T04:45:09.821+0100 [conn1422271] end connection 172.28.0.163:56482 (398 connections now open) 2015-10-05T04:45:09.821+0100 [mongosMain] connection accepted from 172.28.0.163:58047 #1422676 (399 connections now open) 2015-10-05T04:45:09.822+0100 [mongosMain] connection accepted from 172.28.0.163:58048 #1422677 (400 connections now open) 2015-10-05T04:45:09.823+0100 [conn1422676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:09.823+0100 [conn1422677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:15.013+0100 [conn1422246] end connection 172.28.0.164:49512 (399 connections now open) 2015-10-05T04:45:15.014+0100 [mongosMain] connection accepted from 172.28.0.164:51367 #1422678 (400 connections now open) 2015-10-05T04:45:15.016+0100 [conn1422678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:15.481+0100 [conn1422281] end connection 172.28.0.164:49597 (399 connections now open) 2015-10-05T04:45:15.482+0100 [mongosMain] connection accepted from 172.28.0.164:51370 #1422679 (400 connections now open) 2015-10-05T04:45:15.483+0100 [conn1422679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:15.826+0100 [conn1422266] end connection 172.28.0.163:56471 (399 connections now open) 2015-10-05T04:45:15.827+0100 [mongosMain] connection accepted from 172.28.0.163:58075 #1422680 (400 connections now open) 2015-10-05T04:45:15.830+0100 [conn1422680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:16.466+0100 [conn1422283] end connection 172.28.0.163:56556 (399 connections now open) 2015-10-05T04:45:16.467+0100 [mongosMain] connection accepted from 172.28.0.163:58078 #1422681 (400 connections now open) 2015-10-05T04:45:16.468+0100 [conn1422681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:16.514+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:45:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:45:18.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f24e5703b51053eb2ea7 2015-10-05T04:45:18.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:45:18.961+0100 [conn1422260] end connection 172.28.0.164:49539 (399 connections now open) 2015-10-05T04:45:18.961+0100 [conn1422251] end connection 172.28.0.164:49521 (398 connections now open) 2015-10-05T04:45:18.962+0100 [mongosMain] connection accepted from 172.28.0.164:51376 #1422682 (399 connections now open) 2015-10-05T04:45:18.963+0100 [mongosMain] connection accepted from 172.28.0.164:51377 #1422683 (400 connections now open) 2015-10-05T04:45:18.964+0100 [conn1422682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:18.965+0100 [conn1422683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:19.820+0100 [conn1422236] end connection 172.28.0.163:56420 (399 connections now open) 2015-10-05T04:45:19.820+0100 [conn1422287] end connection 172.28.0.163:56581 (399 connections now open) 2015-10-05T04:45:19.821+0100 [mongosMain] connection accepted from 172.28.0.163:58080 #1422684 (399 connections now open) 2015-10-05T04:45:19.822+0100 [mongosMain] connection accepted from 172.28.0.163:58081 #1422685 (400 connections now open) 2015-10-05T04:45:19.822+0100 [conn1422684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:19.823+0100 [conn1422685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:25.496+0100 [conn1422288] end connection 172.28.0.164:49635 (399 connections now open) 2015-10-05T04:45:25.497+0100 [mongosMain] connection accepted from 172.28.0.164:51387 #1422686 (400 connections now open) 2015-10-05T04:45:25.499+0100 [conn1422686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:25.826+0100 [conn1422274] end connection 172.28.0.163:56492 (399 connections now open) 2015-10-05T04:45:25.827+0100 [mongosMain] connection accepted from 172.28.0.163:58085 #1422687 (400 connections now open) 2015-10-05T04:45:25.829+0100 [conn1422687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:26.482+0100 [conn1422290] end connection 172.28.0.163:56597 (399 connections now open) 2015-10-05T04:45:26.483+0100 [mongosMain] connection accepted from 172.28.0.163:58087 #1422688 (400 connections now open) 2015-10-05T04:45:26.484+0100 [conn1422688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:28.178+0100 [mongosMain] connection accepted from 127.0.0.1:58089 #1422689 (401 connections now open) 2015-10-05T04:45:28.182+0100 [conn1422689] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:28.187+0100 [conn1422689] end connection 127.0.0.1:58089 (400 connections now open) 2015-10-05T04:45:28.976+0100 [conn1422277] end connection 172.28.0.164:49574 (399 connections now open) 2015-10-05T04:45:28.977+0100 [conn1422285] end connection 172.28.0.164:49621 (398 connections now open) 2015-10-05T04:45:28.978+0100 [mongosMain] connection accepted from 172.28.0.164:51393 #1422690 (399 connections now open) 2015-10-05T04:45:28.978+0100 [mongosMain] connection accepted from 172.28.0.164:51394 #1422691 (400 connections now open) 2015-10-05T04:45:28.979+0100 [conn1422691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:28.979+0100 [conn1422690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:29.836+0100 [conn1422261] end connection 172.28.0.163:56460 (399 connections now open) 2015-10-05T04:45:29.836+0100 [conn1422278] end connection 172.28.0.163:56503 (398 connections now open) 2015-10-05T04:45:29.838+0100 [mongosMain] connection accepted from 172.28.0.163:58090 #1422692 (399 connections now open) 2015-10-05T04:45:29.838+0100 [mongosMain] connection accepted from 172.28.0.163:58091 #1422693 (400 connections now open) 2015-10-05T04:45:29.840+0100 [conn1422693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:29.840+0100 [conn1422692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:35.044+0100 [conn1422272] end connection 172.28.0.164:49567 (399 connections now open) 2015-10-05T04:45:35.046+0100 [mongosMain] connection accepted from 172.28.0.164:51402 #1422694 (400 connections now open) 2015-10-05T04:45:35.047+0100 [conn1422694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:35.512+0100 [conn1422295] end connection 172.28.0.164:49654 (399 connections now open) 2015-10-05T04:45:35.514+0100 [mongosMain] connection accepted from 172.28.0.164:51405 #1422695 (400 connections now open) 2015-10-05T04:45:35.516+0100 [conn1422695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:35.841+0100 [conn1422257] end connection 172.28.0.163:56455 (399 connections now open) 2015-10-05T04:45:35.842+0100 [mongosMain] connection accepted from 172.28.0.163:58096 #1422696 (400 connections now open) 2015-10-05T04:45:35.843+0100 [conn1422696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:36.483+0100 [conn1422297] end connection 172.28.0.163:56608 (399 connections now open) 2015-10-05T04:45:36.484+0100 [mongosMain] connection accepted from 172.28.0.163:58098 #1422697 (400 connections now open) 2015-10-05T04:45:36.486+0100 [conn1422697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:36.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2605703b51053eb2edc 2015-10-05T04:45:36.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:45:38.992+0100 [conn1422193] end connection 172.28.0.164:49339 (399 connections now open) 2015-10-05T04:45:38.992+0100 [conn1422269] end connection 172.28.0.164:49559 (398 connections now open) 2015-10-05T04:45:38.993+0100 [mongosMain] connection accepted from 172.28.0.164:51412 #1422698 (399 connections now open) 2015-10-05T04:45:38.993+0100 [mongosMain] connection accepted from 172.28.0.164:51413 #1422699 (400 connections now open) 2015-10-05T04:45:38.994+0100 [conn1422698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:38.995+0100 [conn1422699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:39.836+0100 [conn1422279] end connection 172.28.0.163:56504 (399 connections now open) 2015-10-05T04:45:39.836+0100 [conn1422244] end connection 172.28.0.163:56441 (399 connections now open) 2015-10-05T04:45:39.837+0100 [mongosMain] connection accepted from 172.28.0.163:58101 #1422700 (399 connections now open) 2015-10-05T04:45:39.837+0100 [mongosMain] connection accepted from 172.28.0.163:58102 #1422701 (400 connections now open) 2015-10-05T04:45:39.838+0100 [conn1422700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:39.838+0100 [conn1422701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:40.024+0100 [mongosMain] connection accepted from 127.0.0.1:58105 #1422702 (401 connections now open) 2015-10-05T04:45:40.026+0100 [conn1422702] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:40.030+0100 [conn1422702] end connection 127.0.0.1:58105 (400 connections now open) 2015-10-05T04:45:45.044+0100 [conn1422255] end connection 172.28.0.164:49529 (399 connections now open) 2015-10-05T04:45:45.045+0100 [mongosMain] connection accepted from 172.28.0.164:51424 #1422703 (400 connections now open) 2015-10-05T04:45:45.047+0100 [conn1422703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:45.512+0100 [conn1422304] end connection 172.28.0.164:49671 (399 connections now open) 2015-10-05T04:45:45.513+0100 [mongosMain] connection accepted from 172.28.0.164:51426 #1422704 (400 connections now open) 2015-10-05T04:45:45.514+0100 [conn1422704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:45.842+0100 [conn1422296] end connection 172.28.0.163:56606 (399 connections now open) 2015-10-05T04:45:45.843+0100 [mongosMain] connection accepted from 172.28.0.163:58112 #1422705 (400 connections now open) 2015-10-05T04:45:45.845+0100 [conn1422705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:46.498+0100 [conn1422306] end connection 172.28.0.163:56624 (399 connections now open) 2015-10-05T04:45:46.500+0100 [mongosMain] connection accepted from 172.28.0.163:58114 #1422706 (400 connections now open) 2015-10-05T04:45:46.501+0100 [conn1422706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:46.760+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:45:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:45:48.992+0100 [conn1422291] end connection 172.28.0.164:49641 (399 connections now open) 2015-10-05T04:45:48.993+0100 [mongosMain] connection accepted from 172.28.0.164:51432 #1422707 (400 connections now open) 2015-10-05T04:45:48.995+0100 [conn1422707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:49.028+0100 [conn1422158] end connection 172.28.0.164:49227 (399 connections now open) 2015-10-05T04:45:49.029+0100 [mongosMain] connection accepted from 172.28.0.164:51434 #1422708 (400 connections now open) 2015-10-05T04:45:49.031+0100 [conn1422708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:49.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f26c5703b51053eb2f06 2015-10-05T04:45:49.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:45:49.851+0100 [conn1422293] end connection 172.28.0.163:56601 (399 connections now open) 2015-10-05T04:45:49.851+0100 [conn1422262] end connection 172.28.0.163:56461 (398 connections now open) 2015-10-05T04:45:49.852+0100 [mongosMain] connection accepted from 172.28.0.163:58120 #1422709 (399 connections now open) 2015-10-05T04:45:49.853+0100 [mongosMain] connection accepted from 172.28.0.163:58121 #1422710 (400 connections now open) 2015-10-05T04:45:49.853+0100 [conn1422709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:49.854+0100 [conn1422710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:55.059+0100 [conn1422238] end connection 172.28.0.164:49494 (399 connections now open) 2015-10-05T04:45:55.061+0100 [mongosMain] connection accepted from 172.28.0.164:51441 #1422711 (400 connections now open) 2015-10-05T04:45:55.063+0100 [conn1422711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:55.528+0100 [conn1422313] end connection 172.28.0.164:49691 (399 connections now open) 2015-10-05T04:45:55.529+0100 [mongosMain] connection accepted from 172.28.0.164:51443 #1422712 (400 connections now open) 2015-10-05T04:45:55.531+0100 [conn1422712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:55.857+0100 [conn1422289] end connection 172.28.0.163:56594 (399 connections now open) 2015-10-05T04:45:55.858+0100 [mongosMain] connection accepted from 172.28.0.163:58130 #1422713 (400 connections now open) 2015-10-05T04:45:55.859+0100 [conn1422713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:56.498+0100 [conn1422315] end connection 172.28.0.163:56642 (399 connections now open) 2015-10-05T04:45:56.499+0100 [mongosMain] connection accepted from 172.28.0.163:58132 #1422714 (400 connections now open) 2015-10-05T04:45:56.501+0100 [conn1422714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:59.008+0100 [conn1422298] end connection 172.28.0.164:49660 (399 connections now open) 2015-10-05T04:45:59.008+0100 [conn1422259] end connection 172.28.0.164:49540 (399 connections now open) 2015-10-05T04:45:59.009+0100 [mongosMain] connection accepted from 172.28.0.164:51446 #1422715 (399 connections now open) 2015-10-05T04:45:59.009+0100 [mongosMain] connection accepted from 172.28.0.164:51447 #1422716 (400 connections now open) 2015-10-05T04:45:59.011+0100 [conn1422715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:59.011+0100 [conn1422716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:59.852+0100 [conn1422253] end connection 172.28.0.163:56450 (399 connections now open) 2015-10-05T04:45:59.852+0100 [conn1422302] end connection 172.28.0.163:56618 (398 connections now open) 2015-10-05T04:45:59.853+0100 [mongosMain] connection accepted from 172.28.0.163:58138 #1422717 (399 connections now open) 2015-10-05T04:45:59.853+0100 [mongosMain] connection accepted from 172.28.0.163:58139 #1422718 (400 connections now open) 2015-10-05T04:45:59.854+0100 [conn1422717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:45:59.854+0100 [conn1422718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:05.061+0100 [conn1422280] end connection 172.28.0.164:49593 (399 connections now open) 2015-10-05T04:46:05.062+0100 [mongosMain] connection accepted from 172.28.0.164:51467 #1422719 (400 connections now open) 2015-10-05T04:46:05.064+0100 [conn1422719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:05.528+0100 [conn1422321] end connection 172.28.0.164:49707 (399 connections now open) 2015-10-05T04:46:05.529+0100 [mongosMain] connection accepted from 172.28.0.164:51472 #1422720 (400 connections now open) 2015-10-05T04:46:05.530+0100 [conn1422720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:05.858+0100 [conn1422305] end connection 172.28.0.163:56622 (399 connections now open) 2015-10-05T04:46:05.859+0100 [mongosMain] connection accepted from 172.28.0.163:58180 #1422721 (400 connections now open) 2015-10-05T04:46:05.861+0100 [conn1422721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:06.513+0100 [conn1422323] end connection 172.28.0.163:56658 (399 connections now open) 2015-10-05T04:46:06.514+0100 [mongosMain] connection accepted from 172.28.0.163:58187 #1422722 (400 connections now open) 2015-10-05T04:46:06.515+0100 [conn1422722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:07.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f27f5703b51053eb2f6a 2015-10-05T04:46:07.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:09.023+0100 [conn1422325] end connection 172.28.0.164:49711 (399 connections now open) 2015-10-05T04:46:09.024+0100 [conn1422292] end connection 172.28.0.164:49642 (398 connections now open) 2015-10-05T04:46:09.024+0100 [mongosMain] connection accepted from 172.28.0.164:51493 #1422723 (399 connections now open) 2015-10-05T04:46:09.025+0100 [mongosMain] connection accepted from 172.28.0.164:51494 #1422724 (400 connections now open) 2015-10-05T04:46:09.026+0100 [conn1422723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:09.026+0100 [conn1422724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:09.867+0100 [conn1422270] end connection 172.28.0.163:56481 (399 connections now open) 2015-10-05T04:46:09.867+0100 [conn1422318] end connection 172.28.0.163:56646 (399 connections now open) 2015-10-05T04:46:09.868+0100 [mongosMain] connection accepted from 172.28.0.163:58213 #1422725 (399 connections now open) 2015-10-05T04:46:09.869+0100 [mongosMain] connection accepted from 172.28.0.163:58214 #1422726 (400 connections now open) 2015-10-05T04:46:09.869+0100 [conn1422725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:09.870+0100 [conn1422726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:15.075+0100 [conn1422303] end connection 172.28.0.164:49668 (399 connections now open) 2015-10-05T04:46:15.077+0100 [mongosMain] connection accepted from 172.28.0.164:51514 #1422727 (400 connections now open) 2015-10-05T04:46:15.079+0100 [conn1422727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:15.544+0100 [conn1422329] end connection 172.28.0.164:49738 (399 connections now open) 2015-10-05T04:46:15.545+0100 [mongosMain] connection accepted from 172.28.0.164:51517 #1422728 (400 connections now open) 2015-10-05T04:46:15.547+0100 [conn1422728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:15.873+0100 [conn1422314] end connection 172.28.0.163:56639 (399 connections now open) 2015-10-05T04:46:15.874+0100 [mongosMain] connection accepted from 172.28.0.163:58231 #1422729 (400 connections now open) 2015-10-05T04:46:15.875+0100 [conn1422729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:16.529+0100 [conn1422331] end connection 172.28.0.163:56706 (399 connections now open) 2015-10-05T04:46:16.530+0100 [mongosMain] connection accepted from 172.28.0.163:58233 #1422730 (400 connections now open) 2015-10-05T04:46:16.531+0100 [conn1422730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:17.020+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:46:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:46:19.025+0100 [conn1422316] end connection 172.28.0.164:49697 (399 connections now open) 2015-10-05T04:46:19.025+0100 [mongosMain] connection accepted from 172.28.0.164:51520 #1422731 (400 connections now open) 2015-10-05T04:46:19.027+0100 [conn1422731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:19.883+0100 [conn1422310] end connection 172.28.0.163:56628 (399 connections now open) 2015-10-05T04:46:19.883+0100 [conn1422286] end connection 172.28.0.163:56580 (399 connections now open) 2015-10-05T04:46:19.884+0100 [mongosMain] connection accepted from 172.28.0.163:58237 #1422732 (399 connections now open) 2015-10-05T04:46:19.884+0100 [mongosMain] connection accepted from 172.28.0.163:58238 #1422733 (400 connections now open) 2015-10-05T04:46:19.885+0100 [conn1422732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:19.885+0100 [conn1422733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:20.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f28b5703b51053eb2f98 2015-10-05T04:46:20.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:25.545+0100 [conn1422337] end connection 172.28.0.164:49791 (399 connections now open) 2015-10-05T04:46:25.546+0100 [mongosMain] connection accepted from 172.28.0.164:51533 #1422734 (400 connections now open) 2015-10-05T04:46:25.547+0100 [conn1422734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:25.889+0100 [conn1422282] end connection 172.28.0.163:56550 (399 connections now open) 2015-10-05T04:46:25.891+0100 [mongosMain] connection accepted from 172.28.0.163:58243 #1422735 (400 connections now open) 2015-10-05T04:46:25.892+0100 [conn1422735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:26.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2925703b51053eb2fac 2015-10-05T04:46:26.530+0100 [conn1422339] end connection 172.28.0.163:56755 (399 connections now open) 2015-10-05T04:46:26.531+0100 [mongosMain] connection accepted from 172.28.0.163:58245 #1422736 (400 connections now open) 2015-10-05T04:46:26.532+0100 [conn1422736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:26.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:28.608+0100 [mongosMain] connection accepted from 127.0.0.1:58247 #1422737 (401 connections now open) 2015-10-05T04:46:28.610+0100 [conn1422737] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:28.615+0100 [conn1422737] end connection 127.0.0.1:58247 (400 connections now open) 2015-10-05T04:46:29.040+0100 [conn1422307] end connection 172.28.0.164:49679 (399 connections now open) 2015-10-05T04:46:29.041+0100 [mongosMain] connection accepted from 172.28.0.164:51539 #1422738 (400 connections now open) 2015-10-05T04:46:29.043+0100 [conn1422738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:29.885+0100 [conn1422326] end connection 172.28.0.163:56665 (399 connections now open) 2015-10-05T04:46:29.886+0100 [conn1422327] end connection 172.28.0.163:56667 (398 connections now open) 2015-10-05T04:46:29.887+0100 [mongosMain] connection accepted from 172.28.0.163:58249 #1422739 (399 connections now open) 2015-10-05T04:46:29.888+0100 [conn1422739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:29.889+0100 [mongosMain] connection accepted from 172.28.0.163:58251 #1422740 (400 connections now open) 2015-10-05T04:46:29.889+0100 [conn1422740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:32.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2985703b51053eb2fc0 2015-10-05T04:46:33.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:35.560+0100 [conn1422345] end connection 172.28.0.164:49809 (399 connections now open) 2015-10-05T04:46:35.561+0100 [mongosMain] connection accepted from 172.28.0.164:51548 #1422741 (400 connections now open) 2015-10-05T04:46:35.562+0100 [conn1422741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:35.889+0100 [conn1422322] end connection 172.28.0.163:56656 (399 connections now open) 2015-10-05T04:46:35.890+0100 [mongosMain] connection accepted from 172.28.0.163:58252 #1422742 (400 connections now open) 2015-10-05T04:46:35.891+0100 [conn1422742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:36.545+0100 [conn1422347] end connection 172.28.0.163:56766 (399 connections now open) 2015-10-05T04:46:36.546+0100 [mongosMain] connection accepted from 172.28.0.163:58255 #1422743 (400 connections now open) 2015-10-05T04:46:36.548+0100 [conn1422743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:39.039+0100 [conn1422332] end connection 172.28.0.164:49765 (399 connections now open) 2015-10-05T04:46:39.041+0100 [mongosMain] connection accepted from 172.28.0.164:51556 #1422744 (400 connections now open) 2015-10-05T04:46:39.042+0100 [conn1422744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:39.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f29f5703b51053eb2fde 2015-10-05T04:46:39.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:39.678+0100 [mongosMain] connection accepted from 127.0.0.1:58257 #1422745 (401 connections now open) 2015-10-05T04:46:39.680+0100 [conn1422745] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:39.684+0100 [conn1422745] end connection 127.0.0.1:58257 (400 connections now open) 2015-10-05T04:46:39.899+0100 [conn1422319] end connection 172.28.0.163:56648 (399 connections now open) 2015-10-05T04:46:39.899+0100 [conn1422334] end connection 172.28.0.163:56737 (399 connections now open) 2015-10-05T04:46:39.900+0100 [mongosMain] connection accepted from 172.28.0.163:58258 #1422746 (399 connections now open) 2015-10-05T04:46:39.901+0100 [mongosMain] connection accepted from 172.28.0.163:58259 #1422747 (400 connections now open) 2015-10-05T04:46:39.902+0100 [conn1422746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:39.902+0100 [conn1422747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:45.091+0100 [conn1422336] end connection 172.28.0.164:49789 (399 connections now open) 2015-10-05T04:46:45.092+0100 [mongosMain] connection accepted from 172.28.0.164:51566 #1422748 (400 connections now open) 2015-10-05T04:46:45.094+0100 [conn1422748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:45.560+0100 [conn1422354] end connection 172.28.0.164:49826 (399 connections now open) 2015-10-05T04:46:45.561+0100 [mongosMain] connection accepted from 172.28.0.164:51568 #1422749 (400 connections now open) 2015-10-05T04:46:45.562+0100 [conn1422749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:45.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2a55703b51053eb2ff6 2015-10-05T04:46:45.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:45.904+0100 [conn1422346] end connection 172.28.0.163:56764 (399 connections now open) 2015-10-05T04:46:45.905+0100 [mongosMain] connection accepted from 172.28.0.163:58267 #1422750 (400 connections now open) 2015-10-05T04:46:45.906+0100 [conn1422750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:46.545+0100 [conn1422356] end connection 172.28.0.163:56776 (399 connections now open) 2015-10-05T04:46:46.546+0100 [mongosMain] connection accepted from 172.28.0.163:58270 #1422751 (400 connections now open) 2015-10-05T04:46:46.547+0100 [conn1422751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:47.305+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:46:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:46:49.056+0100 [conn1422348] end connection 172.28.0.164:49815 (399 connections now open) 2015-10-05T04:46:49.056+0100 [conn1422340] end connection 172.28.0.164:49797 (398 connections now open) 2015-10-05T04:46:49.057+0100 [mongosMain] connection accepted from 172.28.0.164:51574 #1422752 (399 connections now open) 2015-10-05T04:46:49.057+0100 [mongosMain] connection accepted from 172.28.0.164:51575 #1422753 (400 connections now open) 2015-10-05T04:46:49.058+0100 [conn1422753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:49.059+0100 [conn1422752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:49.899+0100 [conn1422301] end connection 172.28.0.163:56617 (399 connections now open) 2015-10-05T04:46:49.900+0100 [conn1422342] end connection 172.28.0.163:56758 (398 connections now open) 2015-10-05T04:46:49.901+0100 [mongosMain] connection accepted from 172.28.0.163:58276 #1422754 (399 connections now open) 2015-10-05T04:46:49.901+0100 [mongosMain] connection accepted from 172.28.0.163:58277 #1422755 (400 connections now open) 2015-10-05T04:46:49.902+0100 [conn1422754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:49.902+0100 [conn1422755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:52.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2ab5703b51053eb3013 2015-10-05T04:46:52.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:55.107+0100 [conn1422344] end connection 172.28.0.164:49806 (399 connections now open) 2015-10-05T04:46:55.109+0100 [mongosMain] connection accepted from 172.28.0.164:51582 #1422756 (400 connections now open) 2015-10-05T04:46:55.111+0100 [conn1422756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:55.575+0100 [conn1422363] end connection 172.28.0.164:49846 (399 connections now open) 2015-10-05T04:46:55.576+0100 [mongosMain] connection accepted from 172.28.0.164:51584 #1422757 (400 connections now open) 2015-10-05T04:46:55.578+0100 [conn1422757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:55.905+0100 [conn1422338] end connection 172.28.0.163:56753 (399 connections now open) 2015-10-05T04:46:55.906+0100 [mongosMain] connection accepted from 172.28.0.163:58284 #1422758 (400 connections now open) 2015-10-05T04:46:55.908+0100 [conn1422758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:56.561+0100 [conn1422365] end connection 172.28.0.163:56792 (399 connections now open) 2015-10-05T04:46:56.562+0100 [mongosMain] connection accepted from 172.28.0.163:58287 #1422759 (400 connections now open) 2015-10-05T04:46:56.563+0100 [conn1422759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:58.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2b25703b51053eb3023 2015-10-05T04:46:58.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:46:59.070+0100 [conn1422349] end connection 172.28.0.164:49816 (399 connections now open) 2015-10-05T04:46:59.071+0100 [conn1422333] end connection 172.28.0.164:49766 (399 connections now open) 2015-10-05T04:46:59.073+0100 [mongosMain] connection accepted from 172.28.0.164:51589 #1422760 (399 connections now open) 2015-10-05T04:46:59.073+0100 [mongosMain] connection accepted from 172.28.0.164:51590 #1422761 (400 connections now open) 2015-10-05T04:46:59.075+0100 [conn1422760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:59.075+0100 [conn1422761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:59.914+0100 [conn1422335] end connection 172.28.0.163:56738 (399 connections now open) 2015-10-05T04:46:59.914+0100 [conn1422359] end connection 172.28.0.163:56778 (398 connections now open) 2015-10-05T04:46:59.916+0100 [mongosMain] connection accepted from 172.28.0.163:58292 #1422762 (399 connections now open) 2015-10-05T04:46:59.916+0100 [mongosMain] connection accepted from 172.28.0.163:58293 #1422763 (400 connections now open) 2015-10-05T04:46:59.917+0100 [conn1422762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:46:59.917+0100 [conn1422763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:04.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2b85703b51053eb304d 2015-10-05T04:47:05.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:05.124+0100 [conn1422328] end connection 172.28.0.164:49735 (399 connections now open) 2015-10-05T04:47:05.125+0100 [mongosMain] connection accepted from 172.28.0.164:51629 #1422764 (400 connections now open) 2015-10-05T04:47:05.127+0100 [conn1422764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:05.591+0100 [conn1422371] end connection 172.28.0.164:49864 (399 connections now open) 2015-10-05T04:47:05.592+0100 [mongosMain] connection accepted from 172.28.0.164:51637 #1422765 (400 connections now open) 2015-10-05T04:47:05.594+0100 [conn1422765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:05.920+0100 [conn1422330] end connection 172.28.0.163:56700 (399 connections now open) 2015-10-05T04:47:05.921+0100 [mongosMain] connection accepted from 172.28.0.163:58321 #1422766 (400 connections now open) 2015-10-05T04:47:05.922+0100 [conn1422766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:06.561+0100 [conn1422373] end connection 172.28.0.163:56810 (399 connections now open) 2015-10-05T04:47:06.562+0100 [mongosMain] connection accepted from 172.28.0.163:58327 #1422767 (400 connections now open) 2015-10-05T04:47:06.563+0100 [conn1422767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:09.086+0100 [conn1422366] end connection 172.28.0.164:49853 (399 connections now open) 2015-10-05T04:47:09.087+0100 [conn1422299] end connection 172.28.0.164:49661 (398 connections now open) 2015-10-05T04:47:09.088+0100 [mongosMain] connection accepted from 172.28.0.164:51662 #1422768 (399 connections now open) 2015-10-05T04:47:09.088+0100 [mongosMain] connection accepted from 172.28.0.164:51663 #1422769 (400 connections now open) 2015-10-05T04:47:09.090+0100 [conn1422768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:09.090+0100 [conn1422769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:09.916+0100 [conn1422369] end connection 172.28.0.163:56798 (399 connections now open) 2015-10-05T04:47:09.916+0100 [conn1422309] end connection 172.28.0.163:56627 (398 connections now open) 2015-10-05T04:47:09.917+0100 [mongosMain] connection accepted from 172.28.0.163:58343 #1422770 (399 connections now open) 2015-10-05T04:47:09.917+0100 [mongosMain] connection accepted from 172.28.0.163:58345 #1422771 (400 connections now open) 2015-10-05T04:47:09.918+0100 [conn1422770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:09.918+0100 [conn1422771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:11.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2bf5703b51053eb306c 2015-10-05T04:47:11.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:15.124+0100 [conn1422353] end connection 172.28.0.164:49824 (399 connections now open) 2015-10-05T04:47:15.125+0100 [mongosMain] connection accepted from 172.28.0.164:51678 #1422772 (400 connections now open) 2015-10-05T04:47:15.127+0100 [conn1422772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:15.591+0100 [conn1422379] end connection 172.28.0.164:49901 (399 connections now open) 2015-10-05T04:47:15.592+0100 [mongosMain] connection accepted from 172.28.0.164:51681 #1422773 (400 connections now open) 2015-10-05T04:47:15.594+0100 [conn1422773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:15.920+0100 [conn1422355] end connection 172.28.0.163:56774 (399 connections now open) 2015-10-05T04:47:15.922+0100 [mongosMain] connection accepted from 172.28.0.163:58364 #1422774 (400 connections now open) 2015-10-05T04:47:15.923+0100 [conn1422774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:16.576+0100 [conn1422381] end connection 172.28.0.163:56862 (399 connections now open) 2015-10-05T04:47:16.577+0100 [mongosMain] connection accepted from 172.28.0.163:58366 #1422775 (400 connections now open) 2015-10-05T04:47:16.578+0100 [conn1422775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:17.581+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:47:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:47:17.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2c55703b51053eb307a 2015-10-05T04:47:17.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:19.102+0100 [conn1422357] end connection 172.28.0.164:49833 (399 connections now open) 2015-10-05T04:47:19.102+0100 [conn1422317] end connection 172.28.0.164:49698 (398 connections now open) 2015-10-05T04:47:19.103+0100 [mongosMain] connection accepted from 172.28.0.164:51685 #1422776 (399 connections now open) 2015-10-05T04:47:19.103+0100 [mongosMain] connection accepted from 172.28.0.164:51686 #1422777 (400 connections now open) 2015-10-05T04:47:19.105+0100 [conn1422776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:19.105+0100 [conn1422777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:19.930+0100 [conn1422351] end connection 172.28.0.163:56770 (399 connections now open) 2015-10-05T04:47:19.930+0100 [conn1422343] end connection 172.28.0.163:56760 (398 connections now open) 2015-10-05T04:47:19.932+0100 [mongosMain] connection accepted from 172.28.0.163:58372 #1422778 (399 connections now open) 2015-10-05T04:47:19.933+0100 [mongosMain] connection accepted from 172.28.0.163:58373 #1422779 (400 connections now open) 2015-10-05T04:47:19.933+0100 [conn1422778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:19.934+0100 [conn1422779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:24.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2cb5703b51053eb308a 2015-10-05T04:47:24.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:25.139+0100 [conn1422320] end connection 172.28.0.164:49704 (399 connections now open) 2015-10-05T04:47:25.140+0100 [mongosMain] connection accepted from 172.28.0.164:51695 #1422780 (400 connections now open) 2015-10-05T04:47:25.141+0100 [conn1422780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:25.607+0100 [conn1422386] end connection 172.28.0.164:49938 (399 connections now open) 2015-10-05T04:47:25.608+0100 [mongosMain] connection accepted from 172.28.0.164:51699 #1422781 (400 connections now open) 2015-10-05T04:47:25.609+0100 [conn1422781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:25.936+0100 [conn1422364] end connection 172.28.0.163:56789 (399 connections now open) 2015-10-05T04:47:25.937+0100 [mongosMain] connection accepted from 172.28.0.163:58378 #1422782 (400 connections now open) 2015-10-05T04:47:25.938+0100 [conn1422782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:26.592+0100 [conn1422388] end connection 172.28.0.163:56903 (399 connections now open) 2015-10-05T04:47:26.594+0100 [mongosMain] connection accepted from 172.28.0.163:58380 #1422783 (400 connections now open) 2015-10-05T04:47:26.595+0100 [conn1422783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:29.003+0100 [mongosMain] connection accepted from 127.0.0.1:58382 #1422784 (401 connections now open) 2015-10-05T04:47:29.006+0100 [conn1422784] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:29.011+0100 [conn1422784] end connection 127.0.0.1:58382 (400 connections now open) 2015-10-05T04:47:29.102+0100 [conn1422374] end connection 172.28.0.164:49868 (399 connections now open) 2015-10-05T04:47:29.103+0100 [conn1422324] end connection 172.28.0.164:49710 (398 connections now open) 2015-10-05T04:47:29.104+0100 [mongosMain] connection accepted from 172.28.0.164:51705 #1422785 (399 connections now open) 2015-10-05T04:47:29.104+0100 [mongosMain] connection accepted from 172.28.0.164:51706 #1422786 (400 connections now open) 2015-10-05T04:47:29.106+0100 [conn1422785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:29.106+0100 [conn1422786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:29.931+0100 [conn1422383] end connection 172.28.0.163:56883 (399 connections now open) 2015-10-05T04:47:29.933+0100 [conn1422294] end connection 172.28.0.163:56602 (398 connections now open) 2015-10-05T04:47:29.936+0100 [mongosMain] connection accepted from 172.28.0.163:58383 #1422787 (399 connections now open) 2015-10-05T04:47:29.936+0100 [mongosMain] connection accepted from 172.28.0.163:58386 #1422788 (400 connections now open) 2015-10-05T04:47:29.937+0100 [conn1422787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:29.937+0100 [conn1422788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:30.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2d25703b51053eb309b 2015-10-05T04:47:30.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:35.154+0100 [conn1422370] end connection 172.28.0.164:49860 (399 connections now open) 2015-10-05T04:47:35.156+0100 [mongosMain] connection accepted from 172.28.0.164:51713 #1422789 (400 connections now open) 2015-10-05T04:47:35.158+0100 [conn1422789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:35.622+0100 [conn1422394] end connection 172.28.0.164:49955 (399 connections now open) 2015-10-05T04:47:35.623+0100 [mongosMain] connection accepted from 172.28.0.164:51717 #1422790 (400 connections now open) 2015-10-05T04:47:35.625+0100 [conn1422790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:35.937+0100 [conn1422380] end connection 172.28.0.163:56859 (399 connections now open) 2015-10-05T04:47:35.938+0100 [mongosMain] connection accepted from 172.28.0.163:58388 #1422791 (400 connections now open) 2015-10-05T04:47:35.940+0100 [conn1422791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:36.592+0100 [conn1422396] end connection 172.28.0.163:56916 (399 connections now open) 2015-10-05T04:47:36.593+0100 [mongosMain] connection accepted from 172.28.0.163:58391 #1422792 (400 connections now open) 2015-10-05T04:47:36.594+0100 [conn1422792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:37.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2d85703b51053eb30a5 2015-10-05T04:47:37.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:39.118+0100 [conn1422375] end connection 172.28.0.164:49869 (399 connections now open) 2015-10-05T04:47:39.118+0100 [conn1422390] end connection 172.28.0.164:49943 (399 connections now open) 2015-10-05T04:47:39.119+0100 [mongosMain] connection accepted from 172.28.0.164:51725 #1422793 (399 connections now open) 2015-10-05T04:47:39.119+0100 [mongosMain] connection accepted from 172.28.0.164:51724 #1422794 (400 connections now open) 2015-10-05T04:47:39.121+0100 [conn1422794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:39.121+0100 [conn1422793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:39.489+0100 [mongosMain] connection accepted from 127.0.0.1:58393 #1422795 (401 connections now open) 2015-10-05T04:47:39.492+0100 [conn1422795] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:39.497+0100 [conn1422795] end connection 127.0.0.1:58393 (400 connections now open) 2015-10-05T04:47:39.946+0100 [conn1422376] end connection 172.28.0.163:56816 (399 connections now open) 2015-10-05T04:47:39.946+0100 [conn1422352] end connection 172.28.0.163:56771 (399 connections now open) 2015-10-05T04:47:39.947+0100 [mongosMain] connection accepted from 172.28.0.163:58394 #1422796 (399 connections now open) 2015-10-05T04:47:39.948+0100 [mongosMain] connection accepted from 172.28.0.163:58395 #1422797 (400 connections now open) 2015-10-05T04:47:39.948+0100 [conn1422796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:39.948+0100 [conn1422797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:43.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2df5703b51053eb30b1 2015-10-05T04:47:43.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:45.155+0100 [conn1422312] end connection 172.28.0.164:49688 (399 connections now open) 2015-10-05T04:47:45.156+0100 [mongosMain] connection accepted from 172.28.0.164:51733 #1422798 (400 connections now open) 2015-10-05T04:47:45.157+0100 [conn1422798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:45.622+0100 [conn1422403] end connection 172.28.0.164:49972 (399 connections now open) 2015-10-05T04:47:45.624+0100 [mongosMain] connection accepted from 172.28.0.164:51736 #1422799 (400 connections now open) 2015-10-05T04:47:45.626+0100 [conn1422799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:45.952+0100 [conn1422372] end connection 172.28.0.163:56806 (399 connections now open) 2015-10-05T04:47:45.953+0100 [mongosMain] connection accepted from 172.28.0.163:58405 #1422800 (400 connections now open) 2015-10-05T04:47:45.955+0100 [conn1422800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:46.608+0100 [conn1422405] end connection 172.28.0.163:56927 (399 connections now open) 2015-10-05T04:47:46.609+0100 [mongosMain] connection accepted from 172.28.0.163:58408 #1422801 (400 connections now open) 2015-10-05T04:47:46.611+0100 [conn1422801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:47.829+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:47:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:47:49.118+0100 [conn1422398] end connection 172.28.0.164:49962 (399 connections now open) 2015-10-05T04:47:49.118+0100 [conn1422341] end connection 172.28.0.164:49796 (398 connections now open) 2015-10-05T04:47:49.119+0100 [mongosMain] connection accepted from 172.28.0.164:51742 #1422802 (399 connections now open) 2015-10-05T04:47:49.119+0100 [mongosMain] connection accepted from 172.28.0.164:51743 #1422803 (400 connections now open) 2015-10-05T04:47:49.120+0100 [conn1422802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:49.121+0100 [conn1422803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:49.962+0100 [conn1422391] end connection 172.28.0.163:56907 (399 connections now open) 2015-10-05T04:47:49.962+0100 [conn1422360] end connection 172.28.0.163:56779 (399 connections now open) 2015-10-05T04:47:49.964+0100 [mongosMain] connection accepted from 172.28.0.163:58413 #1422804 (399 connections now open) 2015-10-05T04:47:49.964+0100 [mongosMain] connection accepted from 172.28.0.163:58414 #1422805 (400 connections now open) 2015-10-05T04:47:49.965+0100 [conn1422804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:49.965+0100 [conn1422805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:50.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2e55703b51053eb30b6 2015-10-05T04:47:50.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:55.155+0100 [conn1422362] end connection 172.28.0.164:49844 (399 connections now open) 2015-10-05T04:47:55.156+0100 [mongosMain] connection accepted from 172.28.0.164:51750 #1422806 (400 connections now open) 2015-10-05T04:47:55.157+0100 [conn1422806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:55.623+0100 [conn1422412] end connection 172.28.0.164:49992 (399 connections now open) 2015-10-05T04:47:55.624+0100 [mongosMain] connection accepted from 172.28.0.164:51752 #1422807 (400 connections now open) 2015-10-05T04:47:55.625+0100 [conn1422807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:56.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2ec5703b51053eb30c0 2015-10-05T04:47:56.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:47:56.608+0100 [conn1422414] end connection 172.28.0.163:56943 (399 connections now open) 2015-10-05T04:47:56.609+0100 [mongosMain] connection accepted from 172.28.0.163:58424 #1422808 (400 connections now open) 2015-10-05T04:47:56.610+0100 [conn1422808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:59.134+0100 [conn1422358] end connection 172.28.0.164:49834 (399 connections now open) 2015-10-05T04:47:59.135+0100 [mongosMain] connection accepted from 172.28.0.164:51755 #1422809 (400 connections now open) 2015-10-05T04:47:59.137+0100 [conn1422809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:59.962+0100 [conn1422401] end connection 172.28.0.163:56921 (399 connections now open) 2015-10-05T04:47:59.962+0100 [conn1422392] end connection 172.28.0.163:56908 (399 connections now open) 2015-10-05T04:47:59.963+0100 [mongosMain] connection accepted from 172.28.0.163:58430 #1422810 (399 connections now open) 2015-10-05T04:47:59.963+0100 [mongosMain] connection accepted from 172.28.0.163:58431 #1422811 (400 connections now open) 2015-10-05T04:47:59.964+0100 [conn1422810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:47:59.964+0100 [conn1422811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:02.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2f25703b51053eb30cb 2015-10-05T04:48:03.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:05.171+0100 [conn1422378] end connection 172.28.0.164:49897 (399 connections now open) 2015-10-05T04:48:05.172+0100 [mongosMain] connection accepted from 172.28.0.164:51790 #1422812 (400 connections now open) 2015-10-05T04:48:05.174+0100 [conn1422812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:05.639+0100 [conn1422420] end connection 172.28.0.164:50009 (399 connections now open) 2015-10-05T04:48:05.641+0100 [mongosMain] connection accepted from 172.28.0.164:51796 #1422813 (400 connections now open) 2015-10-05T04:48:05.643+0100 [conn1422813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:06.624+0100 [conn1422422] end connection 172.28.0.163:56967 (399 connections now open) 2015-10-05T04:48:06.625+0100 [mongosMain] connection accepted from 172.28.0.163:58495 #1422814 (400 connections now open) 2015-10-05T04:48:06.626+0100 [conn1422814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:09.149+0100 [conn1422308] end connection 172.28.0.164:49680 (399 connections now open) 2015-10-05T04:48:09.149+0100 [conn1422416] end connection 172.28.0.164:49998 (399 connections now open) 2015-10-05T04:48:09.151+0100 [mongosMain] connection accepted from 172.28.0.164:51820 #1422815 (399 connections now open) 2015-10-05T04:48:09.151+0100 [mongosMain] connection accepted from 172.28.0.164:51821 #1422816 (400 connections now open) 2015-10-05T04:48:09.152+0100 [conn1422815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:09.153+0100 [conn1422816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:09.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2f95703b51053eb30fa 2015-10-05T04:48:09.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:10.011+0100 [conn1422400] end connection 172.28.0.163:56920 (399 connections now open) 2015-10-05T04:48:10.011+0100 [conn1422418] end connection 172.28.0.163:56949 (399 connections now open) 2015-10-05T04:48:10.017+0100 [mongosMain] connection accepted from 172.28.0.163:58517 #1422817 (399 connections now open) 2015-10-05T04:48:10.017+0100 [mongosMain] connection accepted from 172.28.0.163:58520 #1422818 (400 connections now open) 2015-10-05T04:48:10.018+0100 [conn1422817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:10.019+0100 [conn1422818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:15.186+0100 [conn1422393] end connection 172.28.0.164:49953 (399 connections now open) 2015-10-05T04:48:15.187+0100 [mongosMain] connection accepted from 172.28.0.164:51836 #1422819 (400 connections now open) 2015-10-05T04:48:15.189+0100 [conn1422819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:15.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f2ff5703b51053eb311c 2015-10-05T04:48:15.654+0100 [conn1422428] end connection 172.28.0.164:50044 (399 connections now open) 2015-10-05T04:48:15.655+0100 [mongosMain] connection accepted from 172.28.0.164:51839 #1422820 (400 connections now open) 2015-10-05T04:48:15.657+0100 [conn1422820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:15.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:16.624+0100 [conn1422429] end connection 172.28.0.163:57020 (399 connections now open) 2015-10-05T04:48:16.626+0100 [mongosMain] connection accepted from 172.28.0.163:58533 #1422821 (400 connections now open) 2015-10-05T04:48:16.627+0100 [conn1422821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:18.094+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:48:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:48:19.165+0100 [conn1422382] end connection 172.28.0.164:49928 (399 connections now open) 2015-10-05T04:48:19.166+0100 [conn1422424] end connection 172.28.0.164:50014 (398 connections now open) 2015-10-05T04:48:19.166+0100 [mongosMain] connection accepted from 172.28.0.164:51844 #1422822 (400 connections now open) 2015-10-05T04:48:19.167+0100 [mongosMain] connection accepted from 172.28.0.164:51845 #1422823 (400 connections now open) 2015-10-05T04:48:19.168+0100 [conn1422822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:19.169+0100 [conn1422823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:20.009+0100 [conn1422384] end connection 172.28.0.163:56884 (399 connections now open) 2015-10-05T04:48:20.009+0100 [conn1422410] end connection 172.28.0.163:56932 (398 connections now open) 2015-10-05T04:48:20.010+0100 [mongosMain] connection accepted from 172.28.0.163:58535 #1422824 (399 connections now open) 2015-10-05T04:48:20.010+0100 [mongosMain] connection accepted from 172.28.0.163:58536 #1422825 (400 connections now open) 2015-10-05T04:48:20.011+0100 [conn1422824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:20.012+0100 [conn1422825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:22.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3055703b51053eb312d 2015-10-05T04:48:22.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:25.186+0100 [conn1422385] end connection 172.28.0.164:49936 (399 connections now open) 2015-10-05T04:48:25.187+0100 [mongosMain] connection accepted from 172.28.0.164:51855 #1422826 (400 connections now open) 2015-10-05T04:48:25.189+0100 [conn1422826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:25.654+0100 [conn1422435] end connection 172.28.0.164:50082 (399 connections now open) 2015-10-05T04:48:25.655+0100 [mongosMain] connection accepted from 172.28.0.164:51858 #1422827 (400 connections now open) 2015-10-05T04:48:25.658+0100 [conn1422827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:28.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f30c5703b51053eb3151 2015-10-05T04:48:28.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:28.622+0100 [mongosMain] connection accepted from 127.0.0.1:58542 #1422828 (401 connections now open) 2015-10-05T04:48:28.625+0100 [conn1422828] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:28.630+0100 [conn1422828] end connection 127.0.0.1:58542 (400 connections now open) 2015-10-05T04:48:29.165+0100 [conn1422389] end connection 172.28.0.164:49942 (399 connections now open) 2015-10-05T04:48:29.166+0100 [mongosMain] connection accepted from 172.28.0.164:51862 #1422829 (400 connections now open) 2015-10-05T04:48:29.168+0100 [conn1422829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:30.024+0100 [conn1422433] end connection 172.28.0.163:57049 (399 connections now open) 2015-10-05T04:48:30.024+0100 [conn1422368] end connection 172.28.0.163:56797 (398 connections now open) 2015-10-05T04:48:30.026+0100 [mongosMain] connection accepted from 172.28.0.163:58543 #1422830 (399 connections now open) 2015-10-05T04:48:30.027+0100 [mongosMain] connection accepted from 172.28.0.163:58544 #1422831 (400 connections now open) 2015-10-05T04:48:30.027+0100 [conn1422830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:30.027+0100 [conn1422831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:34.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3125703b51053eb316c 2015-10-05T04:48:34.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:35.202+0100 [conn1422427] end connection 172.28.0.164:50039 (399 connections now open) 2015-10-05T04:48:35.203+0100 [mongosMain] connection accepted from 172.28.0.164:51869 #1422832 (400 connections now open) 2015-10-05T04:48:35.205+0100 [conn1422832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:39.181+0100 [conn1422367] end connection 172.28.0.164:49854 (399 connections now open) 2015-10-05T04:48:39.182+0100 [mongosMain] connection accepted from 172.28.0.164:51877 #1422833 (400 connections now open) 2015-10-05T04:48:39.183+0100 [conn1422833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:39.186+0100 [mongosMain] connection accepted from 127.0.0.1:58552 #1422834 (401 connections now open) 2015-10-05T04:48:39.188+0100 [conn1422834] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:39.193+0100 [conn1422834] end connection 127.0.0.1:58552 (400 connections now open) 2015-10-05T04:48:40.025+0100 [conn1422425] end connection 172.28.0.163:56973 (399 connections now open) 2015-10-05T04:48:40.026+0100 [mongosMain] connection accepted from 172.28.0.163:58553 #1422835 (400 connections now open) 2015-10-05T04:48:40.027+0100 [conn1422835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:41.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3185703b51053eb3180 2015-10-05T04:48:41.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:45.202+0100 [conn1422402] end connection 172.28.0.164:49970 (399 connections now open) 2015-10-05T04:48:45.204+0100 [mongosMain] connection accepted from 172.28.0.164:51884 #1422836 (400 connections now open) 2015-10-05T04:48:45.205+0100 [conn1422836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:47.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f31f5703b51053eb31a8 2015-10-05T04:48:47.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:48.316+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:48:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:48:49.181+0100 [conn1422406] end connection 172.28.0.164:49981 (399 connections now open) 2015-10-05T04:48:49.182+0100 [mongosMain] connection accepted from 172.28.0.164:51890 #1422837 (400 connections now open) 2015-10-05T04:48:49.184+0100 [conn1422837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:50.041+0100 [conn1422439] end connection 172.28.0.163:57074 (399 connections now open) 2015-10-05T04:48:50.042+0100 [mongosMain] connection accepted from 172.28.0.163:58567 #1422838 (400 connections now open) 2015-10-05T04:48:50.043+0100 [conn1422838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:53.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3255703b51053eb31cb 2015-10-05T04:48:53.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:48:55.218+0100 [conn1422419] end connection 172.28.0.164:50006 (399 connections now open) 2015-10-05T04:48:55.219+0100 [mongosMain] connection accepted from 172.28.0.164:51897 #1422839 (400 connections now open) 2015-10-05T04:48:55.221+0100 [conn1422839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:48:59.197+0100 [conn1422284] end connection 172.28.0.164:49620 (399 connections now open) 2015-10-05T04:48:59.198+0100 [mongosMain] connection accepted from 172.28.0.164:51899 #1422840 (400 connections now open) 2015-10-05T04:48:59.200+0100 [conn1422840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:00.040+0100 [conn1422445] end connection 172.28.0.163:57082 (399 connections now open) 2015-10-05T04:49:00.041+0100 [mongosMain] connection accepted from 172.28.0.163:58580 #1422841 (400 connections now open) 2015-10-05T04:49:00.042+0100 [conn1422841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:05.234+0100 [conn1422411] end connection 172.28.0.164:49989 (399 connections now open) 2015-10-05T04:49:05.235+0100 [mongosMain] connection accepted from 172.28.0.164:51929 #1422842 (400 connections now open) 2015-10-05T04:49:05.237+0100 [conn1422842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:06.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3315703b51053eb3206 2015-10-05T04:49:06.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:09.197+0100 [conn1422437] end connection 172.28.0.164:50088 (399 connections now open) 2015-10-05T04:49:09.198+0100 [mongosMain] connection accepted from 172.28.0.164:51951 #1422843 (400 connections now open) 2015-10-05T04:49:09.200+0100 [conn1422843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:10.056+0100 [conn1422452] end connection 172.28.0.163:57115 (399 connections now open) 2015-10-05T04:49:10.056+0100 [conn1422377] end connection 172.28.0.163:56817 (399 connections now open) 2015-10-05T04:49:10.057+0100 [mongosMain] connection accepted from 172.28.0.163:58643 #1422844 (399 connections now open) 2015-10-05T04:49:10.058+0100 [mongosMain] connection accepted from 172.28.0.163:58644 #1422845 (400 connections now open) 2015-10-05T04:49:10.058+0100 [conn1422844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:10.059+0100 [conn1422845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:12.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3385703b51053eb3219 2015-10-05T04:49:12.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:15.234+0100 [conn1422441] end connection 172.28.0.164:50097 (399 connections now open) 2015-10-05T04:49:15.235+0100 [mongosMain] connection accepted from 172.28.0.164:51965 #1422846 (400 connections now open) 2015-10-05T04:49:15.236+0100 [conn1422846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:18.466+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:49:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:49:18.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f33e5703b51053eb3232 2015-10-05T04:49:18.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:19.212+0100 [conn1422431] end connection 172.28.0.164:50059 (399 connections now open) 2015-10-05T04:49:19.213+0100 [mongosMain] connection accepted from 172.28.0.164:51969 #1422847 (400 connections now open) 2015-10-05T04:49:19.215+0100 [conn1422847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:20.056+0100 [conn1422417] end connection 172.28.0.163:56948 (399 connections now open) 2015-10-05T04:49:20.058+0100 [mongosMain] connection accepted from 172.28.0.163:58663 #1422848 (400 connections now open) 2015-10-05T04:49:20.059+0100 [conn1422848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:25.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3445703b51053eb323f 2015-10-05T04:49:25.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:28.768+0100 [mongosMain] connection accepted from 127.0.0.1:58670 #1422849 (401 connections now open) 2015-10-05T04:49:28.768+0100 [conn1422849] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:28.783+0100 [conn1422849] end connection 127.0.0.1:58670 (400 connections now open) 2015-10-05T04:49:37.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3515703b51053eb3269 2015-10-05T04:49:37.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:39.638+0100 [mongosMain] connection accepted from 127.0.0.1:58672 #1422850 (401 connections now open) 2015-10-05T04:49:39.641+0100 [conn1422850] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:39.645+0100 [conn1422850] end connection 127.0.0.1:58672 (400 connections now open) 2015-10-05T04:49:43.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3575703b51053eb3286 2015-10-05T04:49:43.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:49:46.063+0100 [conn1422387] end connection 172.28.0.163:56900 (399 connections now open) 2015-10-05T04:49:46.067+0100 [mongosMain] connection accepted from 172.28.0.163:58681 #1422851 (400 connections now open) 2015-10-05T04:49:46.068+0100 [conn1422851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:48.746+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:49:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:49:49.229+0100 [conn1422438] end connection 172.28.0.164:50089 (399 connections now open) 2015-10-05T04:49:49.231+0100 [mongosMain] connection accepted from 172.28.0.164:52008 #1422852 (400 connections now open) 2015-10-05T04:49:49.232+0100 [conn1422852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:49:56.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3635703b51053eb32a2 2015-10-05T04:49:56.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:08.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3705703b51053eb32db 2015-10-05T04:50:08.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:09.260+0100 [conn1422453] end connection 172.28.0.164:50173 (399 connections now open) 2015-10-05T04:50:09.260+0100 [conn1422397] end connection 172.28.0.164:49961 (398 connections now open) 2015-10-05T04:50:09.261+0100 [mongosMain] connection accepted from 172.28.0.164:52061 #1422853 (399 connections now open) 2015-10-05T04:50:09.261+0100 [mongosMain] connection accepted from 172.28.0.164:52060 #1422854 (400 connections now open) 2015-10-05T04:50:09.262+0100 [conn1422853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:09.262+0100 [conn1422854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:10.103+0100 [conn1422455] end connection 172.28.0.163:57160 (399 connections now open) 2015-10-05T04:50:10.104+0100 [mongosMain] connection accepted from 172.28.0.163:58754 #1422855 (400 connections now open) 2015-10-05T04:50:10.105+0100 [conn1422855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:16.080+0100 [conn1422395] end connection 172.28.0.163:56914 (399 connections now open) 2015-10-05T04:50:16.082+0100 [mongosMain] connection accepted from 172.28.0.163:58764 #1422856 (400 connections now open) 2015-10-05T04:50:16.083+0100 [conn1422856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:16.734+0100 [conn1422436] end connection 172.28.0.163:57071 (399 connections now open) 2015-10-05T04:50:16.735+0100 [mongosMain] connection accepted from 172.28.0.163:58767 #1422857 (400 connections now open) 2015-10-05T04:50:16.736+0100 [conn1422857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:18.936+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:50:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:50:19.275+0100 [conn1422456] end connection 172.28.0.164:50201 (399 connections now open) 2015-10-05T04:50:19.276+0100 [mongosMain] connection accepted from 172.28.0.164:52073 #1422858 (400 connections now open) 2015-10-05T04:50:19.278+0100 [conn1422858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:20.119+0100 [conn1422447] end connection 172.28.0.163:57087 (399 connections now open) 2015-10-05T04:50:20.121+0100 [mongosMain] connection accepted from 172.28.0.163:58769 #1422859 (400 connections now open) 2015-10-05T04:50:20.122+0100 [conn1422859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:20.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f37c5703b51053eb3304 2015-10-05T04:50:20.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:25.781+0100 [conn1422442] end connection 172.28.0.164:50099 (399 connections now open) 2015-10-05T04:50:25.782+0100 [mongosMain] connection accepted from 172.28.0.164:52084 #1422860 (400 connections now open) 2015-10-05T04:50:25.785+0100 [conn1422860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:26.097+0100 [conn1422404] end connection 172.28.0.163:56925 (399 connections now open) 2015-10-05T04:50:26.098+0100 [mongosMain] connection accepted from 172.28.0.163:58772 #1422861 (400 connections now open) 2015-10-05T04:50:26.099+0100 [conn1422861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:26.749+0100 [conn1422466] end connection 172.28.0.163:57315 (399 connections now open) 2015-10-05T04:50:26.751+0100 [mongosMain] connection accepted from 172.28.0.163:58774 #1422862 (400 connections now open) 2015-10-05T04:50:26.752+0100 [conn1422862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:27.032+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:50:27.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:50:28.929+0100 [mongosMain] connection accepted from 127.0.0.1:58780 #1422863 (401 connections now open) 2015-10-05T04:50:28.932+0100 [conn1422863] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:28.937+0100 [conn1422863] end connection 127.0.0.1:58780 (400 connections now open) 2015-10-05T04:50:29.291+0100 [conn1422458] end connection 172.28.0.164:50213 (399 connections now open) 2015-10-05T04:50:29.293+0100 [mongosMain] connection accepted from 172.28.0.164:52089 #1422864 (400 connections now open) 2015-10-05T04:50:29.294+0100 [conn1422864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:33.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3895703b51053eb333e 2015-10-05T04:50:33.451+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:35.796+0100 [conn1422469] end connection 172.28.0.164:50467 (399 connections now open) 2015-10-05T04:50:35.798+0100 [mongosMain] connection accepted from 172.28.0.164:52097 #1422865 (400 connections now open) 2015-10-05T04:50:35.801+0100 [conn1422865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:36.110+0100 [conn1422462] end connection 172.28.0.163:57217 (399 connections now open) 2015-10-05T04:50:36.111+0100 [mongosMain] connection accepted from 172.28.0.163:58783 #1422866 (400 connections now open) 2015-10-05T04:50:36.112+0100 [conn1422866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:36.750+0100 [conn1422471] end connection 172.28.0.163:57323 (399 connections now open) 2015-10-05T04:50:36.751+0100 [mongosMain] connection accepted from 172.28.0.163:58785 #1422867 (400 connections now open) 2015-10-05T04:50:36.752+0100 [conn1422867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:39.305+0100 [mongosMain] connection accepted from 127.0.0.1:58787 #1422868 (401 connections now open) 2015-10-05T04:50:39.307+0100 [conn1422407] end connection 172.28.0.164:49980 (400 connections now open) 2015-10-05T04:50:39.308+0100 [conn1422868] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:39.308+0100 [mongosMain] connection accepted from 172.28.0.164:52104 #1422869 (401 connections now open) 2015-10-05T04:50:39.310+0100 [conn1422869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:39.314+0100 [conn1422868] end connection 127.0.0.1:58787 (400 connections now open) 2015-10-05T04:50:45.345+0100 [conn1422446] end connection 172.28.0.164:50112 (399 connections now open) 2015-10-05T04:50:45.346+0100 [mongosMain] connection accepted from 172.28.0.164:52112 #1422870 (400 connections now open) 2015-10-05T04:50:45.347+0100 [conn1422870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:45.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3955703b51053eb3378 2015-10-05T04:50:45.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:45.813+0100 [conn1422474] end connection 172.28.0.164:50483 (399 connections now open) 2015-10-05T04:50:45.814+0100 [mongosMain] connection accepted from 172.28.0.164:52115 #1422871 (400 connections now open) 2015-10-05T04:50:45.816+0100 [conn1422871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:46.110+0100 [conn1422465] end connection 172.28.0.163:57312 (399 connections now open) 2015-10-05T04:50:46.111+0100 [mongosMain] connection accepted from 172.28.0.163:58797 #1422872 (400 connections now open) 2015-10-05T04:50:46.113+0100 [conn1422872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:46.766+0100 [conn1422476] end connection 172.28.0.163:57330 (399 connections now open) 2015-10-05T04:50:46.767+0100 [mongosMain] connection accepted from 172.28.0.163:58799 #1422873 (400 connections now open) 2015-10-05T04:50:46.768+0100 [conn1422873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:49.095+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:50:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:50:51.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f39b5703b51053eb3398 2015-10-05T04:50:51.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:50:55.344+0100 [conn1422451] end connection 172.28.0.164:50135 (399 connections now open) 2015-10-05T04:50:55.345+0100 [mongosMain] connection accepted from 172.28.0.164:52125 #1422874 (400 connections now open) 2015-10-05T04:50:55.347+0100 [conn1422874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:55.812+0100 [conn1422480] end connection 172.28.0.164:50522 (399 connections now open) 2015-10-05T04:50:55.814+0100 [mongosMain] connection accepted from 172.28.0.164:52127 #1422875 (400 connections now open) 2015-10-05T04:50:55.815+0100 [conn1422875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:56.126+0100 [conn1422421] end connection 172.28.0.163:56964 (399 connections now open) 2015-10-05T04:50:56.127+0100 [mongosMain] connection accepted from 172.28.0.163:58809 #1422876 (400 connections now open) 2015-10-05T04:50:56.128+0100 [conn1422876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:56.766+0100 [conn1422482] end connection 172.28.0.163:57343 (399 connections now open) 2015-10-05T04:50:56.767+0100 [mongosMain] connection accepted from 172.28.0.163:58811 #1422877 (400 connections now open) 2015-10-05T04:50:56.769+0100 [conn1422877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:50:58.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3a15703b51053eb33b1 2015-10-05T04:50:58.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:05.360+0100 [conn1422434] end connection 172.28.0.164:50080 (399 connections now open) 2015-10-05T04:51:05.361+0100 [mongosMain] connection accepted from 172.28.0.164:52143 #1422878 (400 connections now open) 2015-10-05T04:51:05.363+0100 [conn1422878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:05.828+0100 [conn1422484] end connection 172.28.0.164:50552 (399 connections now open) 2015-10-05T04:51:05.829+0100 [mongosMain] connection accepted from 172.28.0.164:52149 #1422879 (400 connections now open) 2015-10-05T04:51:05.830+0100 [conn1422879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:06.126+0100 [conn1422470] end connection 172.28.0.163:57322 (399 connections now open) 2015-10-05T04:51:06.127+0100 [mongosMain] connection accepted from 172.28.0.163:58855 #1422880 (400 connections now open) 2015-10-05T04:51:06.128+0100 [conn1422880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:06.781+0100 [conn1422486] end connection 172.28.0.163:57355 (399 connections now open) 2015-10-05T04:51:06.782+0100 [mongosMain] connection accepted from 172.28.0.163:58860 #1422881 (400 connections now open) 2015-10-05T04:51:06.784+0100 [conn1422881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:09.338+0100 [conn1422473] end connection 172.28.0.164:50471 (399 connections now open) 2015-10-05T04:51:09.339+0100 [conn1422430] end connection 172.28.0.164:50060 (398 connections now open) 2015-10-05T04:51:09.340+0100 [mongosMain] connection accepted from 172.28.0.164:52168 #1422882 (399 connections now open) 2015-10-05T04:51:09.340+0100 [mongosMain] connection accepted from 172.28.0.164:52167 #1422883 (400 connections now open) 2015-10-05T04:51:09.341+0100 [conn1422882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:09.341+0100 [conn1422883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:10.152+0100 [conn1422464] end connection 172.28.0.163:57287 (399 connections now open) 2015-10-05T04:51:10.152+0100 [conn1422432] end connection 172.28.0.163:57048 (399 connections now open) 2015-10-05T04:51:10.153+0100 [mongosMain] connection accepted from 172.28.0.163:58891 #1422884 (399 connections now open) 2015-10-05T04:51:10.153+0100 [mongosMain] connection accepted from 172.28.0.163:58892 #1422885 (400 connections now open) 2015-10-05T04:51:10.154+0100 [conn1422884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:10.154+0100 [conn1422885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:10.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3ae5703b51053eb33f9 2015-10-05T04:51:10.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:15.376+0100 [conn1422449] end connection 172.28.0.164:50125 (399 connections now open) 2015-10-05T04:51:15.377+0100 [mongosMain] connection accepted from 172.28.0.164:52186 #1422886 (400 connections now open) 2015-10-05T04:51:15.379+0100 [conn1422886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:15.844+0100 [conn1422488] end connection 172.28.0.164:50605 (399 connections now open) 2015-10-05T04:51:15.845+0100 [mongosMain] connection accepted from 172.28.0.164:52188 #1422887 (400 connections now open) 2015-10-05T04:51:15.846+0100 [conn1422887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:16.142+0100 [conn1422461] end connection 172.28.0.163:57204 (399 connections now open) 2015-10-05T04:51:16.144+0100 [mongosMain] connection accepted from 172.28.0.163:58917 #1422888 (400 connections now open) 2015-10-05T04:51:16.145+0100 [conn1422888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:16.707+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3b45703b51053eb3418 2015-10-05T04:51:16.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:16.782+0100 [conn1422489] end connection 172.28.0.163:57405 (399 connections now open) 2015-10-05T04:51:16.783+0100 [mongosMain] connection accepted from 172.28.0.163:58920 #1422889 (400 connections now open) 2015-10-05T04:51:16.784+0100 [conn1422889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:19.232+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:51:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:51:19.353+0100 [conn1422477] end connection 172.28.0.164:50499 (399 connections now open) 2015-10-05T04:51:19.355+0100 [mongosMain] connection accepted from 172.28.0.164:52194 #1422890 (400 connections now open) 2015-10-05T04:51:19.357+0100 [conn1422890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:20.166+0100 [conn1422468] end connection 172.28.0.163:57318 (399 connections now open) 2015-10-05T04:51:20.166+0100 [conn1422454] end connection 172.28.0.163:57159 (398 connections now open) 2015-10-05T04:51:20.167+0100 [mongosMain] connection accepted from 172.28.0.163:58924 #1422891 (399 connections now open) 2015-10-05T04:51:20.168+0100 [mongosMain] connection accepted from 172.28.0.163:58925 #1422892 (400 connections now open) 2015-10-05T04:51:20.168+0100 [conn1422891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:20.168+0100 [conn1422892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:23.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3ba5703b51053eb3434 2015-10-05T04:51:23.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:25.391+0100 [conn1422487] end connection 172.28.0.164:50594 (399 connections now open) 2015-10-05T04:51:25.393+0100 [mongosMain] connection accepted from 172.28.0.164:52202 #1422893 (400 connections now open) 2015-10-05T04:51:25.394+0100 [conn1422893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:25.844+0100 [conn1422491] end connection 172.28.0.164:50684 (399 connections now open) 2015-10-05T04:51:25.845+0100 [mongosMain] connection accepted from 172.28.0.164:52205 #1422894 (400 connections now open) 2015-10-05T04:51:25.846+0100 [conn1422894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:26.142+0100 [conn1422475] end connection 172.28.0.163:57329 (399 connections now open) 2015-10-05T04:51:26.143+0100 [mongosMain] connection accepted from 172.28.0.163:58930 #1422895 (400 connections now open) 2015-10-05T04:51:26.144+0100 [conn1422895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:26.797+0100 [conn1422492] end connection 172.28.0.163:57447 (399 connections now open) 2015-10-05T04:51:26.798+0100 [mongosMain] connection accepted from 172.28.0.163:58931 #1422896 (400 connections now open) 2015-10-05T04:51:26.799+0100 [conn1422896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:28.664+0100 [mongosMain] connection accepted from 127.0.0.1:58934 #1422897 (401 connections now open) 2015-10-05T04:51:28.666+0100 [conn1422897] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:28.671+0100 [conn1422897] end connection 127.0.0.1:58934 (400 connections now open) 2015-10-05T04:51:29.369+0100 [conn1422467] end connection 172.28.0.164:50430 (399 connections now open) 2015-10-05T04:51:29.369+0100 [conn1422463] end connection 172.28.0.164:50372 (399 connections now open) 2015-10-05T04:51:29.370+0100 [mongosMain] connection accepted from 172.28.0.164:52209 #1422898 (399 connections now open) 2015-10-05T04:51:29.371+0100 [mongosMain] connection accepted from 172.28.0.164:52210 #1422899 (400 connections now open) 2015-10-05T04:51:29.373+0100 [conn1422898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:29.373+0100 [conn1422899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:30.182+0100 [conn1422426] end connection 172.28.0.163:56974 (399 connections now open) 2015-10-05T04:51:30.183+0100 [conn1422450] end connection 172.28.0.163:57103 (398 connections now open) 2015-10-05T04:51:30.184+0100 [mongosMain] connection accepted from 172.28.0.163:58935 #1422900 (399 connections now open) 2015-10-05T04:51:30.185+0100 [mongosMain] connection accepted from 172.28.0.163:58936 #1422901 (400 connections now open) 2015-10-05T04:51:30.186+0100 [conn1422901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:30.186+0100 [conn1422900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:35.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3c75703b51053eb345c 2015-10-05T04:51:35.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:35.860+0100 [conn1422497] end connection 172.28.0.164:50737 (399 connections now open) 2015-10-05T04:51:35.861+0100 [mongosMain] connection accepted from 172.28.0.164:52221 #1422902 (400 connections now open) 2015-10-05T04:51:35.863+0100 [conn1422902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:36.157+0100 [conn1422413] end connection 172.28.0.163:56941 (399 connections now open) 2015-10-05T04:51:36.158+0100 [mongosMain] connection accepted from 172.28.0.163:58939 #1422903 (400 connections now open) 2015-10-05T04:51:36.159+0100 [conn1422903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:36.813+0100 [conn1422499] end connection 172.28.0.163:57457 (399 connections now open) 2015-10-05T04:51:36.814+0100 [mongosMain] connection accepted from 172.28.0.163:58941 #1422904 (400 connections now open) 2015-10-05T04:51:36.816+0100 [conn1422904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:39.361+0100 [mongosMain] connection accepted from 127.0.0.1:58943 #1422905 (401 connections now open) 2015-10-05T04:51:39.363+0100 [conn1422905] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:39.366+0100 [conn1422905] end connection 127.0.0.1:58943 (400 connections now open) 2015-10-05T04:51:39.385+0100 [conn1422423] end connection 172.28.0.164:50013 (399 connections now open) 2015-10-05T04:51:39.385+0100 [conn1422494] end connection 172.28.0.164:50689 (399 connections now open) 2015-10-05T04:51:39.386+0100 [mongosMain] connection accepted from 172.28.0.164:52229 #1422906 (399 connections now open) 2015-10-05T04:51:39.387+0100 [mongosMain] connection accepted from 172.28.0.164:52228 #1422907 (400 connections now open) 2015-10-05T04:51:39.388+0100 [conn1422906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:39.388+0100 [conn1422907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:40.182+0100 [conn1422495] end connection 172.28.0.163:57451 (399 connections now open) 2015-10-05T04:51:40.182+0100 [conn1422409] end connection 172.28.0.163:56931 (398 connections now open) 2015-10-05T04:51:40.183+0100 [mongosMain] connection accepted from 172.28.0.163:58944 #1422908 (399 connections now open) 2015-10-05T04:51:40.184+0100 [mongosMain] connection accepted from 172.28.0.163:58945 #1422909 (400 connections now open) 2015-10-05T04:51:40.185+0100 [conn1422908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:40.186+0100 [conn1422909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:41.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3cd5703b51053eb346b 2015-10-05T04:51:41.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:45.875+0100 [conn1422505] end connection 172.28.0.164:50756 (399 connections now open) 2015-10-05T04:51:45.876+0100 [mongosMain] connection accepted from 172.28.0.164:52239 #1422910 (400 connections now open) 2015-10-05T04:51:45.878+0100 [conn1422910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:46.158+0100 [conn1422485] end connection 172.28.0.163:57353 (399 connections now open) 2015-10-05T04:51:46.159+0100 [mongosMain] connection accepted from 172.28.0.163:58953 #1422911 (400 connections now open) 2015-10-05T04:51:46.160+0100 [conn1422911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:46.813+0100 [conn1422507] end connection 172.28.0.163:57465 (399 connections now open) 2015-10-05T04:51:46.814+0100 [mongosMain] connection accepted from 172.28.0.163:58957 #1422912 (400 connections now open) 2015-10-05T04:51:46.816+0100 [conn1422912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:49.343+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:51:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:51:49.401+0100 [conn1422415] end connection 172.28.0.164:49999 (399 connections now open) 2015-10-05T04:51:49.402+0100 [mongosMain] connection accepted from 172.28.0.164:52243 #1422913 (400 connections now open) 2015-10-05T04:51:49.404+0100 [conn1422913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:54.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3d95703b51053eb3490 2015-10-05T04:51:54.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:51:55.423+0100 [conn1422483] end connection 172.28.0.164:50549 (399 connections now open) 2015-10-05T04:51:55.424+0100 [mongosMain] connection accepted from 172.28.0.164:52250 #1422914 (400 connections now open) 2015-10-05T04:51:55.425+0100 [conn1422914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:55.891+0100 [conn1422514] end connection 172.28.0.164:50775 (399 connections now open) 2015-10-05T04:51:55.892+0100 [mongosMain] connection accepted from 172.28.0.164:52252 #1422915 (400 connections now open) 2015-10-05T04:51:55.893+0100 [conn1422915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:56.173+0100 [conn1422498] end connection 172.28.0.163:57455 (399 connections now open) 2015-10-05T04:51:56.174+0100 [mongosMain] connection accepted from 172.28.0.163:58969 #1422916 (400 connections now open) 2015-10-05T04:51:56.175+0100 [conn1422916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:51:56.828+0100 [conn1422516] end connection 172.28.0.163:57485 (399 connections now open) 2015-10-05T04:51:56.830+0100 [mongosMain] connection accepted from 172.28.0.163:58972 #1422917 (400 connections now open) 2015-10-05T04:51:56.832+0100 [conn1422917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:05.438+0100 [conn1422479] end connection 172.28.0.164:50514 (399 connections now open) 2015-10-05T04:52:05.439+0100 [mongosMain] connection accepted from 172.28.0.164:52283 #1422918 (400 connections now open) 2015-10-05T04:52:05.441+0100 [conn1422918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:05.907+0100 [conn1422521] end connection 172.28.0.164:50790 (399 connections now open) 2015-10-05T04:52:05.908+0100 [mongosMain] connection accepted from 172.28.0.164:52286 #1422919 (400 connections now open) 2015-10-05T04:52:05.910+0100 [conn1422919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:06.189+0100 [conn1422506] end connection 172.28.0.163:57463 (399 connections now open) 2015-10-05T04:52:06.190+0100 [mongosMain] connection accepted from 172.28.0.163:59022 #1422920 (400 connections now open) 2015-10-05T04:52:06.191+0100 [conn1422920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:06.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3e65703b51053eb34bf 2015-10-05T04:52:06.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:06.831+0100 [conn1422523] end connection 172.28.0.163:57503 (399 connections now open) 2015-10-05T04:52:06.832+0100 [mongosMain] connection accepted from 172.28.0.163:59026 #1422921 (400 connections now open) 2015-10-05T04:52:06.833+0100 [conn1422921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:09.416+0100 [conn1422508] end connection 172.28.0.164:50763 (399 connections now open) 2015-10-05T04:52:09.417+0100 [mongosMain] connection accepted from 172.28.0.164:52302 #1422922 (400 connections now open) 2015-10-05T04:52:09.418+0100 [conn1422501] end connection 172.28.0.164:50746 (399 connections now open) 2015-10-05T04:52:09.419+0100 [conn1422922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:09.419+0100 [mongosMain] connection accepted from 172.28.0.164:52303 #1422923 (400 connections now open) 2015-10-05T04:52:09.421+0100 [conn1422923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:10.213+0100 [conn1422510] end connection 172.28.0.163:57469 (399 connections now open) 2015-10-05T04:52:10.213+0100 [conn1422525] end connection 172.28.0.163:57511 (399 connections now open) 2015-10-05T04:52:10.214+0100 [mongosMain] connection accepted from 172.28.0.163:59047 #1422924 (399 connections now open) 2015-10-05T04:52:10.215+0100 [mongosMain] connection accepted from 172.28.0.163:59048 #1422925 (400 connections now open) 2015-10-05T04:52:10.215+0100 [conn1422924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:10.216+0100 [conn1422925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:15.440+0100 [conn1422504] end connection 172.28.0.164:50754 (399 connections now open) 2015-10-05T04:52:15.441+0100 [mongosMain] connection accepted from 172.28.0.164:52318 #1422926 (400 connections now open) 2015-10-05T04:52:15.443+0100 [conn1422926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:15.906+0100 [conn1422528] end connection 172.28.0.164:50826 (399 connections now open) 2015-10-05T04:52:15.908+0100 [mongosMain] connection accepted from 172.28.0.164:52321 #1422927 (400 connections now open) 2015-10-05T04:52:15.909+0100 [conn1422927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:16.844+0100 [conn1422530] end connection 172.28.0.163:57552 (399 connections now open) 2015-10-05T04:52:16.846+0100 [mongosMain] connection accepted from 172.28.0.163:59063 #1422928 (400 connections now open) 2015-10-05T04:52:16.847+0100 [conn1422928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:18.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3f25703b51053eb34f9 2015-10-05T04:52:18.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:19.417+0100 [conn1422518] end connection 172.28.0.164:50781 (399 connections now open) 2015-10-05T04:52:19.417+0100 [conn1422493] end connection 172.28.0.164:50688 (398 connections now open) 2015-10-05T04:52:19.417+0100 [mongosMain] connection accepted from 172.28.0.164:52325 #1422929 (399 connections now open) 2015-10-05T04:52:19.418+0100 [mongosMain] connection accepted from 172.28.0.164:52326 #1422930 (400 connections now open) 2015-10-05T04:52:19.419+0100 [conn1422929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:19.420+0100 [conn1422930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:19.634+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:52:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:52:20.216+0100 [conn1422526] end connection 172.28.0.163:57512 (399 connections now open) 2015-10-05T04:52:20.216+0100 [conn1422519] end connection 172.28.0.163:57491 (399 connections now open) 2015-10-05T04:52:20.217+0100 [mongosMain] connection accepted from 172.28.0.163:59068 #1422931 (399 connections now open) 2015-10-05T04:52:20.217+0100 [mongosMain] connection accepted from 172.28.0.163:59069 #1422932 (400 connections now open) 2015-10-05T04:52:20.218+0100 [conn1422931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:20.218+0100 [conn1422932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:25.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3f85703b51053eb3514 2015-10-05T04:52:25.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:25.454+0100 [conn1422513] end connection 172.28.0.164:50773 (399 connections now open) 2015-10-05T04:52:25.456+0100 [mongosMain] connection accepted from 172.28.0.164:52337 #1422933 (400 connections now open) 2015-10-05T04:52:25.457+0100 [conn1422933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:25.923+0100 [conn1422536] end connection 172.28.0.164:50875 (399 connections now open) 2015-10-05T04:52:25.924+0100 [mongosMain] connection accepted from 172.28.0.164:52339 #1422934 (400 connections now open) 2015-10-05T04:52:25.925+0100 [conn1422934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:26.845+0100 [conn1422538] end connection 172.28.0.163:57595 (399 connections now open) 2015-10-05T04:52:26.846+0100 [mongosMain] connection accepted from 172.28.0.163:59073 #1422935 (400 connections now open) 2015-10-05T04:52:26.847+0100 [conn1422935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:28.809+0100 [mongosMain] connection accepted from 127.0.0.1:59075 #1422936 (401 connections now open) 2015-10-05T04:52:28.811+0100 [conn1422936] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:28.816+0100 [conn1422936] end connection 127.0.0.1:59075 (400 connections now open) 2015-10-05T04:52:29.432+0100 [conn1422532] end connection 172.28.0.164:50850 (399 connections now open) 2015-10-05T04:52:29.432+0100 [conn1422531] end connection 172.28.0.164:50849 (398 connections now open) 2015-10-05T04:52:29.433+0100 [mongosMain] connection accepted from 172.28.0.164:52344 #1422937 (399 connections now open) 2015-10-05T04:52:29.434+0100 [mongosMain] connection accepted from 172.28.0.164:52345 #1422938 (400 connections now open) 2015-10-05T04:52:29.435+0100 [conn1422937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:29.435+0100 [conn1422938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:30.229+0100 [conn1422503] end connection 172.28.0.163:57460 (399 connections now open) 2015-10-05T04:52:30.229+0100 [conn1422534] end connection 172.28.0.163:57576 (398 connections now open) 2015-10-05T04:52:30.230+0100 [mongosMain] connection accepted from 172.28.0.163:59076 #1422939 (399 connections now open) 2015-10-05T04:52:30.230+0100 [mongosMain] connection accepted from 172.28.0.163:59077 #1422940 (400 connections now open) 2015-10-05T04:52:30.231+0100 [conn1422939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:30.231+0100 [conn1422940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:31.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f3ff5703b51053eb3537 2015-10-05T04:52:31.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:35.455+0100 [conn1422520] end connection 172.28.0.164:50788 (399 connections now open) 2015-10-05T04:52:35.456+0100 [mongosMain] connection accepted from 172.28.0.164:52354 #1422941 (400 connections now open) 2015-10-05T04:52:35.457+0100 [conn1422941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:35.922+0100 [conn1422544] end connection 172.28.0.164:50894 (399 connections now open) 2015-10-05T04:52:35.923+0100 [mongosMain] connection accepted from 172.28.0.164:52356 #1422942 (400 connections now open) 2015-10-05T04:52:35.925+0100 [conn1422942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:36.860+0100 [conn1422546] end connection 172.28.0.163:57604 (399 connections now open) 2015-10-05T04:52:36.861+0100 [mongosMain] connection accepted from 172.28.0.163:59081 #1422943 (400 connections now open) 2015-10-05T04:52:36.862+0100 [conn1422943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:38.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4055703b51053eb3564 2015-10-05T04:52:38.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:39.201+0100 [mongosMain] connection accepted from 127.0.0.1:59083 #1422944 (401 connections now open) 2015-10-05T04:52:39.204+0100 [conn1422944] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:39.208+0100 [conn1422944] end connection 127.0.0.1:59083 (400 connections now open) 2015-10-05T04:52:39.448+0100 [conn1422509] end connection 172.28.0.164:50764 (399 connections now open) 2015-10-05T04:52:39.448+0100 [conn1422524] end connection 172.28.0.164:50794 (399 connections now open) 2015-10-05T04:52:39.449+0100 [mongosMain] connection accepted from 172.28.0.164:52364 #1422945 (399 connections now open) 2015-10-05T04:52:39.449+0100 [mongosMain] connection accepted from 172.28.0.164:52365 #1422946 (400 connections now open) 2015-10-05T04:52:39.450+0100 [conn1422945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:39.451+0100 [conn1422946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:40.246+0100 [conn1422511] end connection 172.28.0.163:57470 (399 connections now open) 2015-10-05T04:52:40.246+0100 [conn1422533] end connection 172.28.0.163:57575 (399 connections now open) 2015-10-05T04:52:40.247+0100 [mongosMain] connection accepted from 172.28.0.163:59084 #1422947 (399 connections now open) 2015-10-05T04:52:40.247+0100 [mongosMain] connection accepted from 172.28.0.163:59085 #1422948 (400 connections now open) 2015-10-05T04:52:40.248+0100 [conn1422947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:40.248+0100 [conn1422948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:44.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f40c5703b51053eb359d 2015-10-05T04:52:44.672+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:45.471+0100 [conn1422490] end connection 172.28.0.164:50682 (399 connections now open) 2015-10-05T04:52:45.473+0100 [mongosMain] connection accepted from 172.28.0.164:52372 #1422949 (400 connections now open) 2015-10-05T04:52:45.474+0100 [conn1422949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:45.940+0100 [conn1422553] end connection 172.28.0.164:50911 (399 connections now open) 2015-10-05T04:52:45.942+0100 [mongosMain] connection accepted from 172.28.0.164:52374 #1422950 (400 connections now open) 2015-10-05T04:52:45.944+0100 [conn1422950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:46.221+0100 [conn1422554] end connection 172.28.0.163:57612 (399 connections now open) 2015-10-05T04:52:46.222+0100 [mongosMain] connection accepted from 172.28.0.163:59095 #1422951 (400 connections now open) 2015-10-05T04:52:46.224+0100 [conn1422951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:46.860+0100 [conn1422555] end connection 172.28.0.163:57614 (399 connections now open) 2015-10-05T04:52:46.861+0100 [mongosMain] connection accepted from 172.28.0.163:59098 #1422952 (400 connections now open) 2015-10-05T04:52:46.863+0100 [conn1422952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:49.448+0100 [conn1422443] end connection 172.28.0.164:50104 (399 connections now open) 2015-10-05T04:52:49.448+0100 [conn1422539] end connection 172.28.0.164:50880 (398 connections now open) 2015-10-05T04:52:49.451+0100 [mongosMain] connection accepted from 172.28.0.164:52380 #1422953 (399 connections now open) 2015-10-05T04:52:49.451+0100 [mongosMain] connection accepted from 172.28.0.164:52381 #1422954 (400 connections now open) 2015-10-05T04:52:49.453+0100 [conn1422953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:49.453+0100 [conn1422954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:50.033+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:52:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:52:50.245+0100 [conn1422541] end connection 172.28.0.163:57598 (399 connections now open) 2015-10-05T04:52:50.246+0100 [conn1422542] end connection 172.28.0.163:57599 (399 connections now open) 2015-10-05T04:52:50.247+0100 [mongosMain] connection accepted from 172.28.0.163:59103 #1422955 (399 connections now open) 2015-10-05T04:52:50.247+0100 [mongosMain] connection accepted from 172.28.0.163:59104 #1422956 (400 connections now open) 2015-10-05T04:52:50.248+0100 [conn1422955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:50.248+0100 [conn1422956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:51.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4125703b51053eb35bc 2015-10-05T04:52:51.263+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:55.470+0100 [conn1422527] end connection 172.28.0.164:50823 (399 connections now open) 2015-10-05T04:52:55.471+0100 [mongosMain] connection accepted from 172.28.0.164:52388 #1422957 (400 connections now open) 2015-10-05T04:52:55.473+0100 [conn1422957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:55.938+0100 [conn1422562] end connection 172.28.0.164:50931 (399 connections now open) 2015-10-05T04:52:55.939+0100 [mongosMain] connection accepted from 172.28.0.164:52390 #1422958 (400 connections now open) 2015-10-05T04:52:55.941+0100 [conn1422958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:56.221+0100 [conn1422522] end connection 172.28.0.163:57501 (399 connections now open) 2015-10-05T04:52:56.222+0100 [mongosMain] connection accepted from 172.28.0.163:59115 #1422959 (400 connections now open) 2015-10-05T04:52:56.223+0100 [conn1422959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:56.876+0100 [conn1422564] end connection 172.28.0.163:57629 (399 connections now open) 2015-10-05T04:52:56.878+0100 [mongosMain] connection accepted from 172.28.0.163:59117 #1422960 (400 connections now open) 2015-10-05T04:52:56.879+0100 [conn1422960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:57.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4195703b51053eb35dc 2015-10-05T04:52:57.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:52:59.464+0100 [conn1422500] end connection 172.28.0.164:50745 (399 connections now open) 2015-10-05T04:52:59.464+0100 [conn1422548] end connection 172.28.0.164:50900 (398 connections now open) 2015-10-05T04:52:59.465+0100 [mongosMain] connection accepted from 172.28.0.164:52393 #1422961 (399 connections now open) 2015-10-05T04:52:59.466+0100 [mongosMain] connection accepted from 172.28.0.164:52394 #1422962 (400 connections now open) 2015-10-05T04:52:59.467+0100 [conn1422962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:52:59.468+0100 [conn1422961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:00.261+0100 [conn1422457] end connection 172.28.0.163:57188 (399 connections now open) 2015-10-05T04:53:00.262+0100 [mongosMain] connection accepted from 172.28.0.163:59123 #1422963 (400 connections now open) 2015-10-05T04:53:00.264+0100 [conn1422963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:03.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f41f5703b51053eb35fc 2015-10-05T04:53:04.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:05.486+0100 [conn1422543] end connection 172.28.0.164:50892 (399 connections now open) 2015-10-05T04:53:05.487+0100 [mongosMain] connection accepted from 172.28.0.164:52419 #1422964 (400 connections now open) 2015-10-05T04:53:05.489+0100 [conn1422964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:05.953+0100 [conn1422570] end connection 172.28.0.164:50949 (399 connections now open) 2015-10-05T04:53:05.954+0100 [mongosMain] connection accepted from 172.28.0.164:52426 #1422965 (400 connections now open) 2015-10-05T04:53:05.956+0100 [conn1422965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:06.236+0100 [conn1422515] end connection 172.28.0.163:57480 (399 connections now open) 2015-10-05T04:53:06.237+0100 [mongosMain] connection accepted from 172.28.0.163:59167 #1422966 (400 connections now open) 2015-10-05T04:53:06.238+0100 [conn1422966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:06.891+0100 [conn1422572] end connection 172.28.0.163:57650 (399 connections now open) 2015-10-05T04:53:06.892+0100 [mongosMain] connection accepted from 172.28.0.163:59172 #1422967 (400 connections now open) 2015-10-05T04:53:06.893+0100 [conn1422967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:09.464+0100 [conn1422517] end connection 172.28.0.164:50780 (399 connections now open) 2015-10-05T04:53:09.465+0100 [conn1422556] end connection 172.28.0.164:50918 (398 connections now open) 2015-10-05T04:53:09.466+0100 [mongosMain] connection accepted from 172.28.0.164:52439 #1422968 (399 connections now open) 2015-10-05T04:53:09.466+0100 [mongosMain] connection accepted from 172.28.0.164:52440 #1422969 (400 connections now open) 2015-10-05T04:53:09.467+0100 [conn1422968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:09.468+0100 [conn1422969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:10.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4265703b51053eb3623 2015-10-05T04:53:10.261+0100 [conn1422559] end connection 172.28.0.163:57617 (399 connections now open) 2015-10-05T04:53:10.261+0100 [conn1422560] end connection 172.28.0.163:57618 (398 connections now open) 2015-10-05T04:53:10.262+0100 [mongosMain] connection accepted from 172.28.0.163:59195 #1422970 (399 connections now open) 2015-10-05T04:53:10.262+0100 [mongosMain] connection accepted from 172.28.0.163:59194 #1422971 (400 connections now open) 2015-10-05T04:53:10.263+0100 [conn1422971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:10.263+0100 [conn1422970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:10.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:15.501+0100 [conn1422535] end connection 172.28.0.164:50873 (399 connections now open) 2015-10-05T04:53:15.502+0100 [mongosMain] connection accepted from 172.28.0.164:52450 #1422972 (400 connections now open) 2015-10-05T04:53:15.504+0100 [conn1422972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:15.970+0100 [conn1422577] end connection 172.28.0.164:50979 (399 connections now open) 2015-10-05T04:53:15.971+0100 [mongosMain] connection accepted from 172.28.0.164:52452 #1422973 (400 connections now open) 2015-10-05T04:53:15.973+0100 [conn1422973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:16.237+0100 [conn1422545] end connection 172.28.0.163:57603 (399 connections now open) 2015-10-05T04:53:16.238+0100 [mongosMain] connection accepted from 172.28.0.163:59203 #1422974 (400 connections now open) 2015-10-05T04:53:16.239+0100 [conn1422974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:16.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f42c5703b51053eb3639 2015-10-05T04:53:16.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:16.892+0100 [conn1422578] end connection 172.28.0.163:57702 (399 connections now open) 2015-10-05T04:53:16.894+0100 [mongosMain] connection accepted from 172.28.0.163:59206 #1422975 (400 connections now open) 2015-10-05T04:53:16.894+0100 [conn1422975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:19.480+0100 [conn1422574] end connection 172.28.0.164:50953 (399 connections now open) 2015-10-05T04:53:19.480+0100 [conn1422549] end connection 172.28.0.164:50901 (398 connections now open) 2015-10-05T04:53:19.481+0100 [mongosMain] connection accepted from 172.28.0.164:52457 #1422976 (399 connections now open) 2015-10-05T04:53:19.482+0100 [mongosMain] connection accepted from 172.28.0.164:52458 #1422977 (400 connections now open) 2015-10-05T04:53:19.483+0100 [conn1422976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:19.483+0100 [conn1422977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:20.276+0100 [conn1422568] end connection 172.28.0.163:57636 (399 connections now open) 2015-10-05T04:53:20.276+0100 [conn1422567] end connection 172.28.0.163:57635 (399 connections now open) 2015-10-05T04:53:20.277+0100 [mongosMain] connection accepted from 172.28.0.163:59208 #1422978 (399 connections now open) 2015-10-05T04:53:20.278+0100 [mongosMain] connection accepted from 172.28.0.163:59209 #1422979 (400 connections now open) 2015-10-05T04:53:20.278+0100 [conn1422978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:20.279+0100 [conn1422979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:20.302+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:53:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:53:23.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4325703b51053eb3648 2015-10-05T04:53:23.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:25.502+0100 [conn1422552] end connection 172.28.0.164:50909 (399 connections now open) 2015-10-05T04:53:25.503+0100 [mongosMain] connection accepted from 172.28.0.164:52468 #1422980 (400 connections now open) 2015-10-05T04:53:25.505+0100 [conn1422980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:25.969+0100 [conn1422583] end connection 172.28.0.164:51046 (399 connections now open) 2015-10-05T04:53:25.970+0100 [mongosMain] connection accepted from 172.28.0.164:52470 #1422981 (400 connections now open) 2015-10-05T04:53:25.972+0100 [conn1422981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:26.252+0100 [conn1422481] end connection 172.28.0.163:57340 (399 connections now open) 2015-10-05T04:53:26.254+0100 [mongosMain] connection accepted from 172.28.0.163:59212 #1422982 (400 connections now open) 2015-10-05T04:53:26.255+0100 [conn1422982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:26.908+0100 [conn1422585] end connection 172.28.0.163:57749 (399 connections now open) 2015-10-05T04:53:26.910+0100 [mongosMain] connection accepted from 172.28.0.163:59214 #1422983 (400 connections now open) 2015-10-05T04:53:26.911+0100 [conn1422983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:28.915+0100 [mongosMain] connection accepted from 127.0.0.1:59216 #1422984 (401 connections now open) 2015-10-05T04:53:28.918+0100 [conn1422984] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:28.923+0100 [conn1422984] end connection 127.0.0.1:59216 (400 connections now open) 2015-10-05T04:53:29.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4395703b51053eb3660 2015-10-05T04:53:29.480+0100 [conn1422557] end connection 172.28.0.164:50919 (399 connections now open) 2015-10-05T04:53:29.480+0100 [conn1422580] end connection 172.28.0.164:51028 (399 connections now open) 2015-10-05T04:53:29.481+0100 [mongosMain] connection accepted from 172.28.0.164:52475 #1422985 (399 connections now open) 2015-10-05T04:53:29.481+0100 [mongosMain] connection accepted from 172.28.0.164:52476 #1422986 (400 connections now open) 2015-10-05T04:53:29.482+0100 [conn1422985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:29.482+0100 [conn1422986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:29.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:30.277+0100 [conn1422588] end connection 172.28.0.163:57753 (399 connections now open) 2015-10-05T04:53:30.279+0100 [mongosMain] connection accepted from 172.28.0.163:59217 #1422987 (400 connections now open) 2015-10-05T04:53:30.280+0100 [conn1422987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:35.517+0100 [conn1422496] end connection 172.28.0.164:50729 (399 connections now open) 2015-10-05T04:53:35.518+0100 [mongosMain] connection accepted from 172.28.0.164:52486 #1422988 (400 connections now open) 2015-10-05T04:53:35.520+0100 [conn1422988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:35.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f43f5703b51053eb3674 2015-10-05T04:53:35.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:35.986+0100 [conn1422591] end connection 172.28.0.164:51067 (399 connections now open) 2015-10-05T04:53:35.987+0100 [mongosMain] connection accepted from 172.28.0.164:52488 #1422989 (400 connections now open) 2015-10-05T04:53:35.989+0100 [conn1422989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:36.268+0100 [conn1422537] end connection 172.28.0.163:57593 (399 connections now open) 2015-10-05T04:53:36.270+0100 [mongosMain] connection accepted from 172.28.0.163:59221 #1422990 (400 connections now open) 2015-10-05T04:53:36.271+0100 [conn1422990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:36.907+0100 [conn1422593] end connection 172.28.0.163:57760 (399 connections now open) 2015-10-05T04:53:36.909+0100 [mongosMain] connection accepted from 172.28.0.163:59223 #1422991 (400 connections now open) 2015-10-05T04:53:36.909+0100 [conn1422991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:39.233+0100 [mongosMain] connection accepted from 127.0.0.1:59225 #1422992 (401 connections now open) 2015-10-05T04:53:39.235+0100 [conn1422992] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:39.240+0100 [conn1422992] end connection 127.0.0.1:59225 (400 connections now open) 2015-10-05T04:53:39.496+0100 [conn1422540] end connection 172.28.0.164:50881 (399 connections now open) 2015-10-05T04:53:39.496+0100 [conn1422565] end connection 172.28.0.164:50939 (399 connections now open) 2015-10-05T04:53:39.497+0100 [mongosMain] connection accepted from 172.28.0.164:52497 #1422993 (399 connections now open) 2015-10-05T04:53:39.497+0100 [mongosMain] connection accepted from 172.28.0.164:52498 #1422994 (400 connections now open) 2015-10-05T04:53:39.498+0100 [conn1422993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:39.498+0100 [conn1422994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:40.292+0100 [conn1422551] end connection 172.28.0.163:57608 (399 connections now open) 2015-10-05T04:53:40.293+0100 [mongosMain] connection accepted from 172.28.0.163:59226 #1422995 (400 connections now open) 2015-10-05T04:53:40.294+0100 [conn1422995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:42.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4455703b51053eb3689 2015-10-05T04:53:42.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:45.517+0100 [conn1422576] end connection 172.28.0.164:50975 (399 connections now open) 2015-10-05T04:53:45.521+0100 [mongosMain] connection accepted from 172.28.0.164:52506 #1422996 (400 connections now open) 2015-10-05T04:53:45.523+0100 [conn1422996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:45.986+0100 [conn1422600] end connection 172.28.0.164:51084 (399 connections now open) 2015-10-05T04:53:45.987+0100 [mongosMain] connection accepted from 172.28.0.164:52509 #1422997 (400 connections now open) 2015-10-05T04:53:45.989+0100 [conn1422997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:46.268+0100 [conn1422571] end connection 172.28.0.163:57647 (399 connections now open) 2015-10-05T04:53:46.269+0100 [mongosMain] connection accepted from 172.28.0.163:59234 #1422998 (400 connections now open) 2015-10-05T04:53:46.270+0100 [conn1422998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:46.923+0100 [conn1422602] end connection 172.28.0.163:57769 (399 connections now open) 2015-10-05T04:53:46.924+0100 [mongosMain] connection accepted from 172.28.0.163:59235 #1422999 (400 connections now open) 2015-10-05T04:53:46.926+0100 [conn1422999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:48.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f44c5703b51053eb36a0 2015-10-05T04:53:48.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:49.496+0100 [conn1422566] end connection 172.28.0.164:50940 (399 connections now open) 2015-10-05T04:53:49.496+0100 [conn1422595] end connection 172.28.0.164:51073 (398 connections now open) 2015-10-05T04:53:49.497+0100 [mongosMain] connection accepted from 172.28.0.164:52515 #1423000 (399 connections now open) 2015-10-05T04:53:49.497+0100 [mongosMain] connection accepted from 172.28.0.164:52516 #1423001 (400 connections now open) 2015-10-05T04:53:49.498+0100 [conn1423000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:49.498+0100 [conn1423001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:50.293+0100 [conn1422597] end connection 172.28.0.163:57763 (399 connections now open) 2015-10-05T04:53:50.294+0100 [mongosMain] connection accepted from 172.28.0.163:59241 #1423002 (400 connections now open) 2015-10-05T04:53:50.295+0100 [conn1423002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:50.573+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:53:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:53:55.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4525703b51053eb36ae 2015-10-05T04:53:55.285+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:53:55.533+0100 [conn1422561] end connection 172.28.0.164:50929 (399 connections now open) 2015-10-05T04:53:55.534+0100 [mongosMain] connection accepted from 172.28.0.164:52525 #1423003 (400 connections now open) 2015-10-05T04:53:55.536+0100 [conn1423003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:56.001+0100 [conn1422609] end connection 172.28.0.164:51104 (399 connections now open) 2015-10-05T04:53:56.002+0100 [mongosMain] connection accepted from 172.28.0.164:52527 #1423004 (400 connections now open) 2015-10-05T04:53:56.004+0100 [conn1423004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:56.283+0100 [conn1422529] end connection 172.28.0.163:57548 (399 connections now open) 2015-10-05T04:53:56.284+0100 [mongosMain] connection accepted from 172.28.0.163:59274 #1423005 (400 connections now open) 2015-10-05T04:53:56.285+0100 [conn1423005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:56.923+0100 [conn1422611] end connection 172.28.0.163:57785 (399 connections now open) 2015-10-05T04:53:56.924+0100 [mongosMain] connection accepted from 172.28.0.163:59277 #1423006 (400 connections now open) 2015-10-05T04:53:56.925+0100 [conn1423006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:59.511+0100 [conn1422579] end connection 172.28.0.164:51027 (399 connections now open) 2015-10-05T04:53:59.511+0100 [conn1422586] end connection 172.28.0.164:51050 (399 connections now open) 2015-10-05T04:53:59.512+0100 [mongosMain] connection accepted from 172.28.0.164:52530 #1423007 (399 connections now open) 2015-10-05T04:53:59.513+0100 [mongosMain] connection accepted from 172.28.0.164:52531 #1423008 (400 connections now open) 2015-10-05T04:53:59.514+0100 [conn1423007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:53:59.514+0100 [conn1423008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:01.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4595703b51053eb36be 2015-10-05T04:54:01.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:05.533+0100 [conn1422599] end connection 172.28.0.164:51082 (399 connections now open) 2015-10-05T04:54:05.534+0100 [mongosMain] connection accepted from 172.28.0.164:52559 #1423009 (400 connections now open) 2015-10-05T04:54:05.536+0100 [conn1423009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:06.001+0100 [conn1422616] end connection 172.28.0.164:51120 (399 connections now open) 2015-10-05T04:54:06.002+0100 [mongosMain] connection accepted from 172.28.0.164:52563 #1423010 (400 connections now open) 2015-10-05T04:54:06.003+0100 [conn1423010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:06.284+0100 [conn1422601] end connection 172.28.0.163:57767 (399 connections now open) 2015-10-05T04:54:06.285+0100 [mongosMain] connection accepted from 172.28.0.163:59356 #1423011 (400 connections now open) 2015-10-05T04:54:06.287+0100 [conn1423011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:06.939+0100 [conn1422618] end connection 172.28.0.163:57804 (399 connections now open) 2015-10-05T04:54:06.940+0100 [mongosMain] connection accepted from 172.28.0.163:59364 #1423012 (400 connections now open) 2015-10-05T04:54:06.941+0100 [conn1423012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:07.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f45f5703b51053eb36e2 2015-10-05T04:54:07.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:09.510+0100 [conn1422619] end connection 172.28.0.164:51123 (399 connections now open) 2015-10-05T04:54:09.511+0100 [conn1422587] end connection 172.28.0.164:51051 (398 connections now open) 2015-10-05T04:54:09.512+0100 [mongosMain] connection accepted from 172.28.0.164:52590 #1423013 (399 connections now open) 2015-10-05T04:54:09.512+0100 [mongosMain] connection accepted from 172.28.0.164:52591 #1423014 (400 connections now open) 2015-10-05T04:54:09.513+0100 [conn1423013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:09.513+0100 [conn1423014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:10.324+0100 [conn1422622] end connection 172.28.0.163:57810 (399 connections now open) 2015-10-05T04:54:10.325+0100 [mongosMain] connection accepted from 172.28.0.163:59407 #1423015 (400 connections now open) 2015-10-05T04:54:10.327+0100 [conn1423015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:14.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4655703b51053eb36f4 2015-10-05T04:54:14.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:15.549+0100 [conn1422590] end connection 172.28.0.164:51064 (399 connections now open) 2015-10-05T04:54:15.550+0100 [mongosMain] connection accepted from 172.28.0.164:52604 #1423016 (400 connections now open) 2015-10-05T04:54:15.552+0100 [conn1423016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:16.017+0100 [conn1422624] end connection 172.28.0.164:51157 (399 connections now open) 2015-10-05T04:54:16.018+0100 [mongosMain] connection accepted from 172.28.0.164:52608 #1423017 (400 connections now open) 2015-10-05T04:54:16.020+0100 [conn1423017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:16.299+0100 [conn1422584] end connection 172.28.0.163:57747 (399 connections now open) 2015-10-05T04:54:16.300+0100 [mongosMain] connection accepted from 172.28.0.163:59432 #1423018 (400 connections now open) 2015-10-05T04:54:16.301+0100 [conn1423018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:16.939+0100 [conn1422626] end connection 172.28.0.163:57859 (399 connections now open) 2015-10-05T04:54:16.941+0100 [mongosMain] connection accepted from 172.28.0.163:59433 #1423019 (400 connections now open) 2015-10-05T04:54:16.942+0100 [conn1423019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:19.528+0100 [conn1422613] end connection 172.28.0.164:51112 (399 connections now open) 2015-10-05T04:54:19.529+0100 [conn1422603] end connection 172.28.0.164:51091 (399 connections now open) 2015-10-05T04:54:19.530+0100 [mongosMain] connection accepted from 172.28.0.164:52611 #1423020 (399 connections now open) 2015-10-05T04:54:19.530+0100 [mongosMain] connection accepted from 172.28.0.164:52613 #1423021 (400 connections now open) 2015-10-05T04:54:19.532+0100 [conn1423021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:19.532+0100 [conn1423020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:20.324+0100 [conn1422607] end connection 172.28.0.163:57775 (399 connections now open) 2015-10-05T04:54:20.325+0100 [mongosMain] connection accepted from 172.28.0.163:59436 #1423022 (400 connections now open) 2015-10-05T04:54:20.326+0100 [conn1423022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:20.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f46c5703b51053eb370e 2015-10-05T04:54:20.807+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:20.842+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:54:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:54:25.549+0100 [conn1422569] end connection 172.28.0.164:50947 (399 connections now open) 2015-10-05T04:54:25.550+0100 [mongosMain] connection accepted from 172.28.0.164:52623 #1423023 (400 connections now open) 2015-10-05T04:54:25.552+0100 [conn1423023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:26.017+0100 [conn1422632] end connection 172.28.0.164:51206 (399 connections now open) 2015-10-05T04:54:26.018+0100 [mongosMain] connection accepted from 172.28.0.164:52626 #1423024 (400 connections now open) 2015-10-05T04:54:26.019+0100 [conn1423024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:26.300+0100 [conn1422563] end connection 172.28.0.163:57626 (399 connections now open) 2015-10-05T04:54:26.302+0100 [mongosMain] connection accepted from 172.28.0.163:59463 #1423025 (400 connections now open) 2015-10-05T04:54:26.303+0100 [conn1423025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:26.954+0100 [conn1422634] end connection 172.28.0.163:57914 (399 connections now open) 2015-10-05T04:54:26.955+0100 [mongosMain] connection accepted from 172.28.0.163:59468 #1423026 (400 connections now open) 2015-10-05T04:54:26.957+0100 [conn1423026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:28.186+0100 [mongosMain] connection accepted from 127.0.0.1:59484 #1423027 (401 connections now open) 2015-10-05T04:54:28.189+0100 [conn1423027] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:28.194+0100 [conn1423027] end connection 127.0.0.1:59484 (400 connections now open) 2015-10-05T04:54:29.527+0100 [conn1422627] end connection 172.28.0.164:51182 (399 connections now open) 2015-10-05T04:54:29.527+0100 [conn1422573] end connection 172.28.0.164:50952 (399 connections now open) 2015-10-05T04:54:29.528+0100 [mongosMain] connection accepted from 172.28.0.164:52635 #1423028 (399 connections now open) 2015-10-05T04:54:29.528+0100 [mongosMain] connection accepted from 172.28.0.164:52636 #1423029 (400 connections now open) 2015-10-05T04:54:29.529+0100 [conn1423028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:29.529+0100 [conn1423029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:30.340+0100 [conn1422581] end connection 172.28.0.163:57728 (399 connections now open) 2015-10-05T04:54:30.341+0100 [conn1422629] end connection 172.28.0.163:57886 (398 connections now open) 2015-10-05T04:54:30.343+0100 [mongosMain] connection accepted from 172.28.0.163:59485 #1423030 (399 connections now open) 2015-10-05T04:54:30.343+0100 [mongosMain] connection accepted from 172.28.0.163:59495 #1423031 (400 connections now open) 2015-10-05T04:54:30.344+0100 [conn1423030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:30.344+0100 [conn1423031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:32.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4785703b51053eb3739 2015-10-05T04:54:33.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:35.565+0100 [conn1422608] end connection 172.28.0.164:51102 (399 connections now open) 2015-10-05T04:54:35.566+0100 [mongosMain] connection accepted from 172.28.0.164:52644 #1423032 (400 connections now open) 2015-10-05T04:54:35.567+0100 [conn1423032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:36.032+0100 [conn1422640] end connection 172.28.0.164:51230 (399 connections now open) 2015-10-05T04:54:36.033+0100 [mongosMain] connection accepted from 172.28.0.164:52646 #1423033 (400 connections now open) 2015-10-05T04:54:36.035+0100 [conn1423033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:36.315+0100 [conn1422610] end connection 172.28.0.163:57783 (399 connections now open) 2015-10-05T04:54:36.316+0100 [mongosMain] connection accepted from 172.28.0.163:59500 #1423034 (400 connections now open) 2015-10-05T04:54:36.317+0100 [conn1423034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:36.970+0100 [conn1422642] end connection 172.28.0.163:57926 (399 connections now open) 2015-10-05T04:54:36.972+0100 [mongosMain] connection accepted from 172.28.0.163:59519 #1423035 (400 connections now open) 2015-10-05T04:54:36.973+0100 [conn1423035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:39.542+0100 [conn1422612] end connection 172.28.0.164:51111 (399 connections now open) 2015-10-05T04:54:39.543+0100 [conn1422628] end connection 172.28.0.164:51183 (398 connections now open) 2015-10-05T04:54:39.544+0100 [mongosMain] connection accepted from 172.28.0.164:52654 #1423036 (399 connections now open) 2015-10-05T04:54:39.544+0100 [mongosMain] connection accepted from 172.28.0.164:52655 #1423037 (400 connections now open) 2015-10-05T04:54:39.545+0100 [conn1423036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:39.546+0100 [conn1423037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:39.776+0100 [mongosMain] connection accepted from 127.0.0.1:59521 #1423038 (401 connections now open) 2015-10-05T04:54:39.779+0100 [conn1423038] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:39.783+0100 [conn1423038] end connection 127.0.0.1:59521 (400 connections now open) 2015-10-05T04:54:40.340+0100 [conn1422615] end connection 172.28.0.163:57792 (399 connections now open) 2015-10-05T04:54:40.340+0100 [conn1422598] end connection 172.28.0.163:57765 (399 connections now open) 2015-10-05T04:54:40.342+0100 [mongosMain] connection accepted from 172.28.0.163:59524 #1423039 (399 connections now open) 2015-10-05T04:54:40.342+0100 [mongosMain] connection accepted from 172.28.0.163:59525 #1423040 (400 connections now open) 2015-10-05T04:54:40.343+0100 [conn1423039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:40.343+0100 [conn1423040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:45.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4855703b51053eb3780 2015-10-05T04:54:45.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:46.032+0100 [conn1422649] end connection 172.28.0.164:51250 (399 connections now open) 2015-10-05T04:54:46.033+0100 [mongosMain] connection accepted from 172.28.0.164:52667 #1423041 (400 connections now open) 2015-10-05T04:54:46.035+0100 [conn1423041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:46.331+0100 [conn1422617] end connection 172.28.0.163:57802 (399 connections now open) 2015-10-05T04:54:46.333+0100 [mongosMain] connection accepted from 172.28.0.163:59537 #1423042 (400 connections now open) 2015-10-05T04:54:46.333+0100 [conn1423042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:46.971+0100 [conn1422651] end connection 172.28.0.163:57935 (399 connections now open) 2015-10-05T04:54:46.973+0100 [mongosMain] connection accepted from 172.28.0.163:59539 #1423043 (400 connections now open) 2015-10-05T04:54:46.974+0100 [conn1423043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:49.558+0100 [conn1422620] end connection 172.28.0.164:51124 (399 connections now open) 2015-10-05T04:54:49.558+0100 [conn1422635] end connection 172.28.0.164:51212 (398 connections now open) 2015-10-05T04:54:49.559+0100 [mongosMain] connection accepted from 172.28.0.164:52674 #1423044 (399 connections now open) 2015-10-05T04:54:49.560+0100 [mongosMain] connection accepted from 172.28.0.164:52675 #1423045 (400 connections now open) 2015-10-05T04:54:49.561+0100 [conn1423044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:49.561+0100 [conn1423045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:50.355+0100 [conn1422646] end connection 172.28.0.163:57930 (399 connections now open) 2015-10-05T04:54:50.355+0100 [conn1422550] end connection 172.28.0.163:57607 (398 connections now open) 2015-10-05T04:54:50.357+0100 [mongosMain] connection accepted from 172.28.0.163:59549 #1423046 (399 connections now open) 2015-10-05T04:54:50.357+0100 [mongosMain] connection accepted from 172.28.0.163:59551 #1423047 (400 connections now open) 2015-10-05T04:54:50.358+0100 [conn1423046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:50.358+0100 [conn1423047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:50.972+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:54:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:54:51.623+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f48b5703b51053eb379d 2015-10-05T04:54:51.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:54:55.581+0100 [conn1422582] end connection 172.28.0.164:51044 (399 connections now open) 2015-10-05T04:54:55.582+0100 [mongosMain] connection accepted from 172.28.0.164:52684 #1423048 (400 connections now open) 2015-10-05T04:54:55.583+0100 [conn1423048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:56.049+0100 [conn1422657] end connection 172.28.0.164:51269 (399 connections now open) 2015-10-05T04:54:56.050+0100 [mongosMain] connection accepted from 172.28.0.164:52686 #1423049 (400 connections now open) 2015-10-05T04:54:56.051+0100 [conn1423049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:56.331+0100 [conn1422633] end connection 172.28.0.163:57913 (399 connections now open) 2015-10-05T04:54:56.332+0100 [mongosMain] connection accepted from 172.28.0.163:59570 #1423050 (400 connections now open) 2015-10-05T04:54:56.334+0100 [conn1423050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:56.986+0100 [conn1422659] end connection 172.28.0.163:57952 (399 connections now open) 2015-10-05T04:54:56.987+0100 [mongosMain] connection accepted from 172.28.0.163:59572 #1423051 (400 connections now open) 2015-10-05T04:54:56.988+0100 [conn1423051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:54:59.559+0100 [conn1422652] end connection 172.28.0.164:51257 (399 connections now open) 2015-10-05T04:54:59.560+0100 [mongosMain] connection accepted from 172.28.0.164:52690 #1423052 (400 connections now open) 2015-10-05T04:54:59.561+0100 [conn1423052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:00.356+0100 [conn1422630] end connection 172.28.0.163:57887 (399 connections now open) 2015-10-05T04:55:00.357+0100 [mongosMain] connection accepted from 172.28.0.163:59578 #1423053 (400 connections now open) 2015-10-05T04:55:00.358+0100 [conn1423053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:03.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4975703b51053eb37e0 2015-10-05T04:55:04.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:05.596+0100 [conn1422623] end connection 172.28.0.164:51154 (399 connections now open) 2015-10-05T04:55:05.598+0100 [mongosMain] connection accepted from 172.28.0.164:52732 #1423054 (400 connections now open) 2015-10-05T04:55:05.600+0100 [conn1423054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:06.065+0100 [conn1422664] end connection 172.28.0.164:51288 (399 connections now open) 2015-10-05T04:55:06.066+0100 [mongosMain] connection accepted from 172.28.0.164:52739 #1423055 (400 connections now open) 2015-10-05T04:55:06.067+0100 [conn1423055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:06.346+0100 [conn1422625] end connection 172.28.0.163:57854 (399 connections now open) 2015-10-05T04:55:06.347+0100 [mongosMain] connection accepted from 172.28.0.163:59621 #1423056 (400 connections now open) 2015-10-05T04:55:06.349+0100 [conn1423056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:06.986+0100 [conn1422666] end connection 172.28.0.163:57971 (399 connections now open) 2015-10-05T04:55:06.987+0100 [mongosMain] connection accepted from 172.28.0.163:59625 #1423057 (400 connections now open) 2015-10-05T04:55:06.988+0100 [conn1423057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:09.590+0100 [conn1422667] end connection 172.28.0.164:51294 (399 connections now open) 2015-10-05T04:55:09.591+0100 [conn1422636] end connection 172.28.0.164:51213 (398 connections now open) 2015-10-05T04:55:09.592+0100 [mongosMain] connection accepted from 172.28.0.164:52772 #1423058 (399 connections now open) 2015-10-05T04:55:09.592+0100 [mongosMain] connection accepted from 172.28.0.164:52782 #1423059 (400 connections now open) 2015-10-05T04:55:09.594+0100 [conn1423058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:09.594+0100 [conn1423059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:10.371+0100 [conn1422440] end connection 172.28.0.163:57075 (399 connections now open) 2015-10-05T04:55:10.371+0100 [conn1422668] end connection 172.28.0.163:57977 (398 connections now open) 2015-10-05T04:55:10.372+0100 [mongosMain] connection accepted from 172.28.0.163:59649 #1423060 (399 connections now open) 2015-10-05T04:55:10.372+0100 [mongosMain] connection accepted from 172.28.0.163:59650 #1423061 (400 connections now open) 2015-10-05T04:55:10.373+0100 [conn1423060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:10.374+0100 [conn1423061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:15.612+0100 [conn1422639] end connection 172.28.0.164:51228 (399 connections now open) 2015-10-05T04:55:15.613+0100 [mongosMain] connection accepted from 172.28.0.164:52790 #1423062 (400 connections now open) 2015-10-05T04:55:15.615+0100 [conn1423062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:16.080+0100 [conn1422671] end connection 172.28.0.164:51328 (399 connections now open) 2015-10-05T04:55:16.081+0100 [mongosMain] connection accepted from 172.28.0.164:52792 #1423063 (400 connections now open) 2015-10-05T04:55:16.083+0100 [conn1423063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:16.347+0100 [conn1422641] end connection 172.28.0.163:57924 (399 connections now open) 2015-10-05T04:55:16.348+0100 [mongosMain] connection accepted from 172.28.0.163:59657 #1423064 (400 connections now open) 2015-10-05T04:55:16.349+0100 [conn1423064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:16.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4a45703b51053eb3833 2015-10-05T04:55:16.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:17.002+0100 [conn1422673] end connection 172.28.0.163:58026 (399 connections now open) 2015-10-05T04:55:17.004+0100 [mongosMain] connection accepted from 172.28.0.163:59660 #1423065 (400 connections now open) 2015-10-05T04:55:17.005+0100 [conn1423065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:19.605+0100 [conn1422675] end connection 172.28.0.164:51348 (399 connections now open) 2015-10-05T04:55:19.605+0100 [conn1422594] end connection 172.28.0.164:51072 (398 connections now open) 2015-10-05T04:55:19.606+0100 [mongosMain] connection accepted from 172.28.0.164:52797 #1423066 (399 connections now open) 2015-10-05T04:55:19.607+0100 [mongosMain] connection accepted from 172.28.0.164:52798 #1423067 (400 connections now open) 2015-10-05T04:55:19.608+0100 [conn1423066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:19.608+0100 [conn1423067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:20.379+0100 [conn1422662] end connection 172.28.0.163:57958 (399 connections now open) 2015-10-05T04:55:20.379+0100 [conn1422606] end connection 172.28.0.163:57774 (398 connections now open) 2015-10-05T04:55:20.380+0100 [mongosMain] connection accepted from 172.28.0.163:59662 #1423068 (399 connections now open) 2015-10-05T04:55:20.381+0100 [mongosMain] connection accepted from 172.28.0.163:59663 #1423069 (400 connections now open) 2015-10-05T04:55:20.381+0100 [conn1423068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:20.382+0100 [conn1423069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:21.125+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:55:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:55:22.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4aa5703b51053eb3845 2015-10-05T04:55:22.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:25.627+0100 [conn1422648] end connection 172.28.0.164:51247 (399 connections now open) 2015-10-05T04:55:25.629+0100 [mongosMain] connection accepted from 172.28.0.164:52809 #1423070 (400 connections now open) 2015-10-05T04:55:25.630+0100 [conn1423070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:26.095+0100 [conn1422679] end connection 172.28.0.164:51370 (399 connections now open) 2015-10-05T04:55:26.097+0100 [mongosMain] connection accepted from 172.28.0.164:52813 #1423071 (400 connections now open) 2015-10-05T04:55:26.098+0100 [conn1423071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:26.362+0100 [conn1422592] end connection 172.28.0.163:57758 (399 connections now open) 2015-10-05T04:55:26.363+0100 [mongosMain] connection accepted from 172.28.0.163:59667 #1423072 (400 connections now open) 2015-10-05T04:55:26.364+0100 [conn1423072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:27.002+0100 [conn1422681] end connection 172.28.0.163:58078 (399 connections now open) 2015-10-05T04:55:27.003+0100 [mongosMain] connection accepted from 172.28.0.163:59670 #1423073 (400 connections now open) 2015-10-05T04:55:27.005+0100 [conn1423073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:29.031+0100 [mongosMain] connection accepted from 127.0.0.1:59674 #1423074 (401 connections now open) 2015-10-05T04:55:29.033+0100 [conn1423074] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:29.039+0100 [conn1423074] end connection 127.0.0.1:59674 (400 connections now open) 2015-10-05T04:55:29.621+0100 [conn1422661] end connection 172.28.0.164:51276 (399 connections now open) 2015-10-05T04:55:29.621+0100 [conn1422604] end connection 172.28.0.164:51093 (398 connections now open) 2015-10-05T04:55:29.623+0100 [mongosMain] connection accepted from 172.28.0.164:52819 #1423075 (399 connections now open) 2015-10-05T04:55:29.623+0100 [mongosMain] connection accepted from 172.28.0.164:52820 #1423076 (400 connections now open) 2015-10-05T04:55:29.625+0100 [conn1423075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:29.625+0100 [conn1423076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:30.425+0100 [conn1422654] end connection 172.28.0.163:57937 (399 connections now open) 2015-10-05T04:55:30.425+0100 [mongosMain] connection accepted from 172.28.0.163:59676 #1423077 (400 connections now open) 2015-10-05T04:55:30.425+0100 [conn1422621] end connection 172.28.0.163:57809 (399 connections now open) 2015-10-05T04:55:30.425+0100 [mongosMain] connection accepted from 172.28.0.163:59678 #1423078 (400 connections now open) 2015-10-05T04:55:30.425+0100 [conn1423077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:30.425+0100 [conn1423078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:35.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4b65703b51053eb3881 2015-10-05T04:55:35.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:35.644+0100 [conn1422631] end connection 172.28.0.164:51204 (399 connections now open) 2015-10-05T04:55:35.645+0100 [mongosMain] connection accepted from 172.28.0.164:52852 #1423079 (400 connections now open) 2015-10-05T04:55:35.646+0100 [conn1423079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:36.112+0100 [conn1422686] end connection 172.28.0.164:51387 (399 connections now open) 2015-10-05T04:55:36.113+0100 [mongosMain] connection accepted from 172.28.0.164:52853 #1423080 (400 connections now open) 2015-10-05T04:55:36.116+0100 [conn1423080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:36.363+0100 [conn1422658] end connection 172.28.0.163:57950 (399 connections now open) 2015-10-05T04:55:36.364+0100 [mongosMain] connection accepted from 172.28.0.163:59681 #1423081 (400 connections now open) 2015-10-05T04:55:36.365+0100 [conn1423081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:37.018+0100 [conn1422688] end connection 172.28.0.163:58087 (399 connections now open) 2015-10-05T04:55:37.019+0100 [mongosMain] connection accepted from 172.28.0.163:59684 #1423082 (400 connections now open) 2015-10-05T04:55:37.021+0100 [conn1423082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:39.638+0100 [conn1422645] end connection 172.28.0.164:51238 (399 connections now open) 2015-10-05T04:55:39.638+0100 [conn1422660] end connection 172.28.0.164:51275 (399 connections now open) 2015-10-05T04:55:39.639+0100 [mongosMain] connection accepted from 172.28.0.164:52863 #1423083 (399 connections now open) 2015-10-05T04:55:39.639+0100 [mongosMain] connection accepted from 172.28.0.164:52864 #1423084 (400 connections now open) 2015-10-05T04:55:39.641+0100 [conn1423083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:39.642+0100 [conn1423084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:40.039+0100 [mongosMain] connection accepted from 127.0.0.1:59687 #1423085 (401 connections now open) 2015-10-05T04:55:40.042+0100 [conn1423085] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:40.046+0100 [conn1423085] end connection 127.0.0.1:59687 (400 connections now open) 2015-10-05T04:55:40.403+0100 [conn1422677] end connection 172.28.0.163:58048 (399 connections now open) 2015-10-05T04:55:40.403+0100 [conn1422638] end connection 172.28.0.163:57920 (398 connections now open) 2015-10-05T04:55:40.404+0100 [mongosMain] connection accepted from 172.28.0.163:59689 #1423086 (399 connections now open) 2015-10-05T04:55:40.404+0100 [mongosMain] connection accepted from 172.28.0.163:59690 #1423087 (400 connections now open) 2015-10-05T04:55:40.405+0100 [conn1423086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:40.405+0100 [conn1423087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:41.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4bd5703b51053eb3899 2015-10-05T04:55:41.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:46.112+0100 [conn1422695] end connection 172.28.0.164:51405 (399 connections now open) 2015-10-05T04:55:46.113+0100 [mongosMain] connection accepted from 172.28.0.164:52873 #1423088 (400 connections now open) 2015-10-05T04:55:46.115+0100 [conn1423088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:46.378+0100 [conn1422672] end connection 172.28.0.163:58018 (399 connections now open) 2015-10-05T04:55:46.379+0100 [mongosMain] connection accepted from 172.28.0.163:59699 #1423089 (400 connections now open) 2015-10-05T04:55:46.380+0100 [conn1423089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:47.033+0100 [conn1422697] end connection 172.28.0.163:58098 (399 connections now open) 2015-10-05T04:55:47.034+0100 [mongosMain] connection accepted from 172.28.0.163:59701 #1423090 (400 connections now open) 2015-10-05T04:55:47.036+0100 [conn1423090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:49.652+0100 [conn1422682] end connection 172.28.0.164:51376 (399 connections now open) 2015-10-05T04:55:49.653+0100 [conn1422653] end connection 172.28.0.164:51258 (398 connections now open) 2015-10-05T04:55:49.654+0100 [mongosMain] connection accepted from 172.28.0.164:52878 #1423091 (399 connections now open) 2015-10-05T04:55:49.655+0100 [mongosMain] connection accepted from 172.28.0.164:52879 #1423092 (400 connections now open) 2015-10-05T04:55:49.656+0100 [conn1423091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:49.657+0100 [conn1423092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:50.404+0100 [conn1422637] end connection 172.28.0.163:57919 (399 connections now open) 2015-10-05T04:55:50.404+0100 [conn1422575] end connection 172.28.0.163:57655 (398 connections now open) 2015-10-05T04:55:50.405+0100 [mongosMain] connection accepted from 172.28.0.163:59707 #1423093 (399 connections now open) 2015-10-05T04:55:50.405+0100 [mongosMain] connection accepted from 172.28.0.163:59708 #1423094 (400 connections now open) 2015-10-05T04:55:50.406+0100 [conn1423093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:50.406+0100 [conn1423094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:51.391+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:55:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:55:53.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4c95703b51053eb38b5 2015-10-05T04:55:53.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:55:55.659+0100 [conn1422703] end connection 172.28.0.164:51424 (399 connections now open) 2015-10-05T04:55:55.660+0100 [mongosMain] connection accepted from 172.28.0.164:52887 #1423095 (400 connections now open) 2015-10-05T04:55:55.662+0100 [conn1423095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:56.128+0100 [conn1422704] end connection 172.28.0.164:51426 (399 connections now open) 2015-10-05T04:55:56.129+0100 [mongosMain] connection accepted from 172.28.0.164:52889 #1423096 (400 connections now open) 2015-10-05T04:55:56.131+0100 [conn1423096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:56.381+0100 [conn1422650] end connection 172.28.0.163:57933 (399 connections now open) 2015-10-05T04:55:56.382+0100 [mongosMain] connection accepted from 172.28.0.163:59717 #1423097 (400 connections now open) 2015-10-05T04:55:56.383+0100 [conn1423097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:57.036+0100 [conn1422706] end connection 172.28.0.163:58114 (399 connections now open) 2015-10-05T04:55:57.037+0100 [mongosMain] connection accepted from 172.28.0.163:59720 #1423098 (400 connections now open) 2015-10-05T04:55:57.038+0100 [conn1423098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:59.654+0100 [conn1422691] end connection 172.28.0.164:51394 (399 connections now open) 2015-10-05T04:55:59.655+0100 [conn1422644] end connection 172.28.0.164:51237 (398 connections now open) 2015-10-05T04:55:59.655+0100 [mongosMain] connection accepted from 172.28.0.164:52892 #1423099 (400 connections now open) 2015-10-05T04:55:59.657+0100 [conn1423099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:55:59.659+0100 [mongosMain] connection accepted from 172.28.0.164:52893 #1423100 (400 connections now open) 2015-10-05T04:55:59.660+0100 [conn1423100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:00.419+0100 [conn1422614] end connection 172.28.0.163:57791 (399 connections now open) 2015-10-05T04:56:00.419+0100 [conn1422685] end connection 172.28.0.163:58081 (399 connections now open) 2015-10-05T04:56:00.420+0100 [mongosMain] connection accepted from 172.28.0.163:59726 #1423101 (399 connections now open) 2015-10-05T04:56:00.421+0100 [mongosMain] connection accepted from 172.28.0.163:59727 #1423102 (400 connections now open) 2015-10-05T04:56:00.421+0100 [conn1423101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:00.421+0100 [conn1423102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:05.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4d55703b51053eb38f7 2015-10-05T04:56:06.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:56:06.128+0100 [conn1422712] end connection 172.28.0.164:51443 (399 connections now open) 2015-10-05T04:56:06.129+0100 [mongosMain] connection accepted from 172.28.0.164:52928 #1423103 (400 connections now open) 2015-10-05T04:56:06.131+0100 [conn1423103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:06.394+0100 [conn1422665] end connection 172.28.0.163:57967 (399 connections now open) 2015-10-05T04:56:06.396+0100 [mongosMain] connection accepted from 172.28.0.163:59765 #1423104 (400 connections now open) 2015-10-05T04:56:06.397+0100 [conn1423104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:07.049+0100 [conn1422714] end connection 172.28.0.163:58132 (399 connections now open) 2015-10-05T04:56:07.050+0100 [mongosMain] connection accepted from 172.28.0.163:59768 #1423105 (400 connections now open) 2015-10-05T04:56:07.051+0100 [conn1423105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:09.668+0100 [conn1422699] end connection 172.28.0.164:51413 (399 connections now open) 2015-10-05T04:56:09.668+0100 [conn1422674] end connection 172.28.0.164:51347 (398 connections now open) 2015-10-05T04:56:09.669+0100 [mongosMain] connection accepted from 172.28.0.164:52945 #1423106 (399 connections now open) 2015-10-05T04:56:09.670+0100 [mongosMain] connection accepted from 172.28.0.164:52946 #1423107 (400 connections now open) 2015-10-05T04:56:09.671+0100 [conn1423106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:09.671+0100 [conn1423107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:10.419+0100 [conn1422693] end connection 172.28.0.163:58091 (399 connections now open) 2015-10-05T04:56:10.419+0100 [conn1422669] end connection 172.28.0.163:57978 (399 connections now open) 2015-10-05T04:56:10.420+0100 [mongosMain] connection accepted from 172.28.0.163:59799 #1423108 (399 connections now open) 2015-10-05T04:56:10.421+0100 [mongosMain] connection accepted from 172.28.0.163:59800 #1423109 (400 connections now open) 2015-10-05T04:56:10.422+0100 [conn1423108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:10.422+0100 [conn1423109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:16.143+0100 [conn1422720] end connection 172.28.0.164:51472 (399 connections now open) 2015-10-05T04:56:16.144+0100 [mongosMain] connection accepted from 172.28.0.164:52955 #1423110 (400 connections now open) 2015-10-05T04:56:16.146+0100 [conn1423110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:16.410+0100 [conn1422680] end connection 172.28.0.163:58075 (399 connections now open) 2015-10-05T04:56:16.411+0100 [mongosMain] connection accepted from 172.28.0.163:59824 #1423111 (400 connections now open) 2015-10-05T04:56:16.412+0100 [conn1423111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:17.050+0100 [conn1422722] end connection 172.28.0.163:58187 (399 connections now open) 2015-10-05T04:56:17.052+0100 [mongosMain] connection accepted from 172.28.0.163:59831 #1423112 (400 connections now open) 2015-10-05T04:56:17.053+0100 [conn1423112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:19.684+0100 [conn1422698] end connection 172.28.0.164:51412 (399 connections now open) 2015-10-05T04:56:19.684+0100 [conn1422723] end connection 172.28.0.164:51493 (399 connections now open) 2015-10-05T04:56:19.685+0100 [mongosMain] connection accepted from 172.28.0.164:52960 #1423113 (399 connections now open) 2015-10-05T04:56:19.686+0100 [mongosMain] connection accepted from 172.28.0.164:52961 #1423114 (400 connections now open) 2015-10-05T04:56:19.687+0100 [conn1423113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:19.687+0100 [conn1423114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:20.434+0100 [conn1422701] end connection 172.28.0.163:58102 (399 connections now open) 2015-10-05T04:56:20.434+0100 [conn1422589] end connection 172.28.0.163:57752 (398 connections now open) 2015-10-05T04:56:20.435+0100 [mongosMain] connection accepted from 172.28.0.163:59837 #1423115 (399 connections now open) 2015-10-05T04:56:20.436+0100 [mongosMain] connection accepted from 172.28.0.163:59839 #1423116 (400 connections now open) 2015-10-05T04:56:20.436+0100 [conn1423115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:20.437+0100 [conn1423116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:21.650+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:56:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:56:24.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4e85703b51053eb393d 2015-10-05T04:56:24.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:56:26.159+0100 [conn1422728] end connection 172.28.0.164:51517 (399 connections now open) 2015-10-05T04:56:26.160+0100 [mongosMain] connection accepted from 172.28.0.164:52972 #1423117 (400 connections now open) 2015-10-05T04:56:26.162+0100 [conn1423117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:26.410+0100 [conn1422687] end connection 172.28.0.163:58085 (399 connections now open) 2015-10-05T04:56:26.411+0100 [mongosMain] connection accepted from 172.28.0.163:59851 #1423118 (400 connections now open) 2015-10-05T04:56:26.412+0100 [conn1423118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:27.065+0100 [conn1422730] end connection 172.28.0.163:58233 (399 connections now open) 2015-10-05T04:56:27.066+0100 [mongosMain] connection accepted from 172.28.0.163:59893 #1423119 (400 connections now open) 2015-10-05T04:56:27.067+0100 [conn1423119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:29.104+0100 [mongosMain] connection accepted from 127.0.0.1:59922 #1423120 (401 connections now open) 2015-10-05T04:56:29.107+0100 [conn1423120] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:29.111+0100 [conn1423120] end connection 127.0.0.1:59922 (400 connections now open) 2015-10-05T04:56:29.684+0100 [conn1422683] end connection 172.28.0.164:51377 (399 connections now open) 2015-10-05T04:56:29.684+0100 [conn1422715] end connection 172.28.0.164:51446 (399 connections now open) 2015-10-05T04:56:29.685+0100 [mongosMain] connection accepted from 172.28.0.164:52978 #1423121 (399 connections now open) 2015-10-05T04:56:29.686+0100 [mongosMain] connection accepted from 172.28.0.164:52979 #1423122 (400 connections now open) 2015-10-05T04:56:29.687+0100 [conn1423122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:29.687+0100 [conn1423121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:30.363+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T04:56:30.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T04:56:30.435+0100 [conn1422655] end connection 172.28.0.163:57938 (399 connections now open) 2015-10-05T04:56:30.435+0100 [conn1422718] end connection 172.28.0.163:58139 (399 connections now open) 2015-10-05T04:56:30.436+0100 [mongosMain] connection accepted from 172.28.0.163:59923 #1423123 (399 connections now open) 2015-10-05T04:56:30.436+0100 [mongosMain] connection accepted from 172.28.0.163:59924 #1423124 (400 connections now open) 2015-10-05T04:56:30.437+0100 [conn1423124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:30.437+0100 [conn1423123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:35.706+0100 [conn1422694] end connection 172.28.0.164:51402 (399 connections now open) 2015-10-05T04:56:35.707+0100 [mongosMain] connection accepted from 172.28.0.164:52988 #1423125 (400 connections now open) 2015-10-05T04:56:35.708+0100 [conn1423125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:36.159+0100 [conn1422734] end connection 172.28.0.164:51533 (399 connections now open) 2015-10-05T04:56:36.160+0100 [mongosMain] connection accepted from 172.28.0.164:52990 #1423126 (400 connections now open) 2015-10-05T04:56:36.162+0100 [conn1423126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:36.425+0100 [conn1422696] end connection 172.28.0.163:58096 (399 connections now open) 2015-10-05T04:56:36.426+0100 [mongosMain] connection accepted from 172.28.0.163:59927 #1423127 (400 connections now open) 2015-10-05T04:56:36.427+0100 [conn1423127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:36.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f4f45703b51053eb396e 2015-10-05T04:56:36.583+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:56:37.066+0100 [conn1422736] end connection 172.28.0.163:58245 (399 connections now open) 2015-10-05T04:56:37.067+0100 [mongosMain] connection accepted from 172.28.0.163:59930 #1423128 (400 connections now open) 2015-10-05T04:56:37.069+0100 [conn1423128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:39.684+0100 [conn1422731] end connection 172.28.0.164:51520 (399 connections now open) 2015-10-05T04:56:39.685+0100 [mongosMain] connection accepted from 172.28.0.164:52999 #1423129 (400 connections now open) 2015-10-05T04:56:39.687+0100 [conn1423129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:39.689+0100 [mongosMain] connection accepted from 127.0.0.1:59932 #1423130 (401 connections now open) 2015-10-05T04:56:39.692+0100 [conn1423130] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:39.696+0100 [conn1423130] end connection 127.0.0.1:59932 (400 connections now open) 2015-10-05T04:56:40.450+0100 [conn1422709] end connection 172.28.0.163:58120 (399 connections now open) 2015-10-05T04:56:40.451+0100 [conn1422647] end connection 172.28.0.163:57929 (398 connections now open) 2015-10-05T04:56:40.453+0100 [mongosMain] connection accepted from 172.28.0.163:59933 #1423131 (399 connections now open) 2015-10-05T04:56:40.454+0100 [mongosMain] connection accepted from 172.28.0.163:59934 #1423132 (400 connections now open) 2015-10-05T04:56:40.454+0100 [conn1423131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:40.456+0100 [conn1423132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:45.723+0100 [conn1422711] end connection 172.28.0.164:51441 (399 connections now open) 2015-10-05T04:56:45.724+0100 [mongosMain] connection accepted from 172.28.0.164:53008 #1423133 (400 connections now open) 2015-10-05T04:56:45.726+0100 [conn1423133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:46.175+0100 [conn1422741] end connection 172.28.0.164:51548 (399 connections now open) 2015-10-05T04:56:46.176+0100 [mongosMain] connection accepted from 172.28.0.164:53011 #1423134 (400 connections now open) 2015-10-05T04:56:46.178+0100 [conn1423134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:46.426+0100 [conn1422721] end connection 172.28.0.163:58180 (399 connections now open) 2015-10-05T04:56:46.427+0100 [mongosMain] connection accepted from 172.28.0.163:59944 #1423135 (400 connections now open) 2015-10-05T04:56:46.428+0100 [conn1423135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:47.081+0100 [conn1422743] end connection 172.28.0.163:58255 (399 connections now open) 2015-10-05T04:56:47.082+0100 [mongosMain] connection accepted from 172.28.0.163:59946 #1423136 (400 connections now open) 2015-10-05T04:56:47.083+0100 [conn1423136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:48.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5005703b51053eb39af 2015-10-05T04:56:49.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:56:49.700+0100 [conn1422707] end connection 172.28.0.164:51432 (399 connections now open) 2015-10-05T04:56:49.701+0100 [mongosMain] connection accepted from 172.28.0.164:53017 #1423137 (400 connections now open) 2015-10-05T04:56:49.703+0100 [conn1423137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:50.466+0100 [conn1422676] end connection 172.28.0.163:58047 (399 connections now open) 2015-10-05T04:56:50.466+0100 [conn1422726] end connection 172.28.0.163:58214 (399 connections now open) 2015-10-05T04:56:50.467+0100 [mongosMain] connection accepted from 172.28.0.163:59952 #1423138 (399 connections now open) 2015-10-05T04:56:50.467+0100 [mongosMain] connection accepted from 172.28.0.163:59953 #1423139 (400 connections now open) 2015-10-05T04:56:50.469+0100 [conn1423139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:50.469+0100 [conn1423138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:51.916+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:56:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:56:55.738+0100 [conn1422719] end connection 172.28.0.164:51467 (399 connections now open) 2015-10-05T04:56:55.739+0100 [mongosMain] connection accepted from 172.28.0.164:53025 #1423140 (400 connections now open) 2015-10-05T04:56:55.742+0100 [conn1423140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:56.190+0100 [conn1422749] end connection 172.28.0.164:51568 (399 connections now open) 2015-10-05T04:56:56.191+0100 [mongosMain] connection accepted from 172.28.0.164:53028 #1423141 (400 connections now open) 2015-10-05T04:56:56.192+0100 [conn1423141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:56.441+0100 [conn1422705] end connection 172.28.0.163:58112 (399 connections now open) 2015-10-05T04:56:56.443+0100 [mongosMain] connection accepted from 172.28.0.163:59962 #1423142 (400 connections now open) 2015-10-05T04:56:56.444+0100 [conn1423142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:57.081+0100 [conn1422751] end connection 172.28.0.163:58270 (399 connections now open) 2015-10-05T04:56:57.082+0100 [mongosMain] connection accepted from 172.28.0.163:59965 #1423143 (400 connections now open) 2015-10-05T04:56:57.083+0100 [conn1423143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:59.715+0100 [conn1422738] end connection 172.28.0.164:51539 (399 connections now open) 2015-10-05T04:56:59.716+0100 [conn1422724] end connection 172.28.0.164:51494 (398 connections now open) 2015-10-05T04:56:59.717+0100 [mongosMain] connection accepted from 172.28.0.164:53031 #1423144 (399 connections now open) 2015-10-05T04:56:59.717+0100 [mongosMain] connection accepted from 172.28.0.164:53032 #1423145 (400 connections now open) 2015-10-05T04:56:59.718+0100 [conn1423144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:56:59.718+0100 [conn1423145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:00.466+0100 [conn1422732] end connection 172.28.0.163:58237 (399 connections now open) 2015-10-05T04:57:00.466+0100 [conn1422710] end connection 172.28.0.163:58121 (399 connections now open) 2015-10-05T04:57:00.467+0100 [mongosMain] connection accepted from 172.28.0.163:59972 #1423146 (399 connections now open) 2015-10-05T04:57:00.468+0100 [mongosMain] connection accepted from 172.28.0.163:59973 #1423147 (400 connections now open) 2015-10-05T04:57:00.468+0100 [conn1423146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:00.468+0100 [conn1423147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:05.738+0100 [conn1422727] end connection 172.28.0.164:51514 (399 connections now open) 2015-10-05T04:57:05.739+0100 [mongosMain] connection accepted from 172.28.0.164:53066 #1423148 (400 connections now open) 2015-10-05T04:57:05.741+0100 [conn1423148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:06.206+0100 [conn1422757] end connection 172.28.0.164:51584 (399 connections now open) 2015-10-05T04:57:06.207+0100 [mongosMain] connection accepted from 172.28.0.164:53073 #1423149 (400 connections now open) 2015-10-05T04:57:06.208+0100 [conn1423149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:06.441+0100 [conn1422742] end connection 172.28.0.163:58252 (399 connections now open) 2015-10-05T04:57:06.442+0100 [mongosMain] connection accepted from 172.28.0.163:60019 #1423150 (400 connections now open) 2015-10-05T04:57:06.443+0100 [conn1423150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:07.096+0100 [conn1422759] end connection 172.28.0.163:58287 (399 connections now open) 2015-10-05T04:57:07.098+0100 [mongosMain] connection accepted from 172.28.0.163:60024 #1423151 (400 connections now open) 2015-10-05T04:57:07.099+0100 [conn1423151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:07.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5135703b51053eb3a05 2015-10-05T04:57:07.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:57:09.716+0100 [conn1422753] end connection 172.28.0.164:51575 (399 connections now open) 2015-10-05T04:57:09.717+0100 [conn1422690] end connection 172.28.0.164:51393 (398 connections now open) 2015-10-05T04:57:09.717+0100 [mongosMain] connection accepted from 172.28.0.164:53101 #1423152 (399 connections now open) 2015-10-05T04:57:09.718+0100 [mongosMain] connection accepted from 172.28.0.164:53100 #1423153 (400 connections now open) 2015-10-05T04:57:09.719+0100 [conn1423152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:09.719+0100 [conn1423153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:10.481+0100 [conn1422684] end connection 172.28.0.163:58080 (399 connections now open) 2015-10-05T04:57:10.481+0100 [conn1422739] end connection 172.28.0.163:58249 (398 connections now open) 2015-10-05T04:57:10.482+0100 [mongosMain] connection accepted from 172.28.0.163:60045 #1423154 (399 connections now open) 2015-10-05T04:57:10.482+0100 [mongosMain] connection accepted from 172.28.0.163:60046 #1423155 (400 connections now open) 2015-10-05T04:57:10.483+0100 [conn1423154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:10.483+0100 [conn1423155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:15.754+0100 [conn1422678] end connection 172.28.0.164:51367 (399 connections now open) 2015-10-05T04:57:15.754+0100 [mongosMain] connection accepted from 172.28.0.164:53105 #1423156 (400 connections now open) 2015-10-05T04:57:15.756+0100 [conn1423156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:16.221+0100 [conn1422765] end connection 172.28.0.164:51637 (399 connections now open) 2015-10-05T04:57:16.222+0100 [mongosMain] connection accepted from 172.28.0.164:53108 #1423157 (400 connections now open) 2015-10-05T04:57:16.223+0100 [conn1423157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:16.457+0100 [conn1422735] end connection 172.28.0.163:58243 (399 connections now open) 2015-10-05T04:57:16.458+0100 [mongosMain] connection accepted from 172.28.0.163:60054 #1423158 (400 connections now open) 2015-10-05T04:57:16.459+0100 [conn1423158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:17.112+0100 [conn1422767] end connection 172.28.0.163:58327 (399 connections now open) 2015-10-05T04:57:17.114+0100 [mongosMain] connection accepted from 172.28.0.163:60057 #1423159 (400 connections now open) 2015-10-05T04:57:17.115+0100 [conn1423159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:19.732+0100 [conn1422716] end connection 172.28.0.164:51447 (399 connections now open) 2015-10-05T04:57:19.732+0100 [conn1422760] end connection 172.28.0.164:51589 (399 connections now open) 2015-10-05T04:57:19.732+0100 [mongosMain] connection accepted from 172.28.0.164:53114 #1423160 (399 connections now open) 2015-10-05T04:57:19.733+0100 [mongosMain] connection accepted from 172.28.0.164:53115 #1423161 (400 connections now open) 2015-10-05T04:57:19.734+0100 [conn1423160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:19.734+0100 [conn1423161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:19.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f51f5703b51053eb3a15 2015-10-05T04:57:19.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:57:20.482+0100 [conn1422747] end connection 172.28.0.163:58259 (399 connections now open) 2015-10-05T04:57:20.482+0100 [conn1422663] end connection 172.28.0.163:57959 (399 connections now open) 2015-10-05T04:57:20.483+0100 [mongosMain] connection accepted from 172.28.0.163:60060 #1423162 (399 connections now open) 2015-10-05T04:57:20.483+0100 [mongosMain] connection accepted from 172.28.0.163:60061 #1423163 (400 connections now open) 2015-10-05T04:57:20.484+0100 [conn1423162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:20.485+0100 [conn1423163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:22.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:57:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:57:25.769+0100 [conn1422748] end connection 172.28.0.164:51566 (399 connections now open) 2015-10-05T04:57:25.770+0100 [mongosMain] connection accepted from 172.28.0.164:53125 #1423164 (400 connections now open) 2015-10-05T04:57:25.772+0100 [conn1423164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:26.238+0100 [conn1422773] end connection 172.28.0.164:51681 (399 connections now open) 2015-10-05T04:57:26.239+0100 [mongosMain] connection accepted from 172.28.0.164:53127 #1423165 (400 connections now open) 2015-10-05T04:57:26.240+0100 [conn1423165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:26.457+0100 [conn1422750] end connection 172.28.0.163:58267 (399 connections now open) 2015-10-05T04:57:26.458+0100 [mongosMain] connection accepted from 172.28.0.163:60067 #1423166 (400 connections now open) 2015-10-05T04:57:26.459+0100 [conn1423166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:27.112+0100 [conn1422775] end connection 172.28.0.163:58366 (399 connections now open) 2015-10-05T04:57:27.114+0100 [mongosMain] connection accepted from 172.28.0.163:60069 #1423167 (400 connections now open) 2015-10-05T04:57:27.115+0100 [conn1423167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:28.703+0100 [mongosMain] connection accepted from 127.0.0.1:60071 #1423168 (401 connections now open) 2015-10-05T04:57:28.706+0100 [conn1423168] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:28.712+0100 [conn1423168] end connection 127.0.0.1:60071 (400 connections now open) 2015-10-05T04:57:29.732+0100 [conn1422744] end connection 172.28.0.164:51556 (399 connections now open) 2015-10-05T04:57:29.732+0100 [conn1422761] end connection 172.28.0.164:51590 (398 connections now open) 2015-10-05T04:57:29.733+0100 [mongosMain] connection accepted from 172.28.0.164:53132 #1423169 (399 connections now open) 2015-10-05T04:57:29.734+0100 [mongosMain] connection accepted from 172.28.0.164:53133 #1423170 (400 connections now open) 2015-10-05T04:57:29.735+0100 [conn1423169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:29.735+0100 [conn1423170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:30.497+0100 [conn1422700] end connection 172.28.0.163:58101 (399 connections now open) 2015-10-05T04:57:30.497+0100 [conn1422770] end connection 172.28.0.163:58343 (399 connections now open) 2015-10-05T04:57:30.498+0100 [mongosMain] connection accepted from 172.28.0.163:60072 #1423171 (399 connections now open) 2015-10-05T04:57:30.499+0100 [mongosMain] connection accepted from 172.28.0.163:60073 #1423172 (400 connections now open) 2015-10-05T04:57:30.499+0100 [conn1423171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:30.499+0100 [conn1423172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:32.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f52b5703b51053eb3a3c 2015-10-05T04:57:32.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:57:35.785+0100 [conn1422772] end connection 172.28.0.164:51678 (399 connections now open) 2015-10-05T04:57:35.786+0100 [mongosMain] connection accepted from 172.28.0.164:53142 #1423173 (400 connections now open) 2015-10-05T04:57:35.788+0100 [conn1423173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:36.237+0100 [conn1422781] end connection 172.28.0.164:51699 (399 connections now open) 2015-10-05T04:57:36.238+0100 [mongosMain] connection accepted from 172.28.0.164:53145 #1423174 (400 connections now open) 2015-10-05T04:57:36.240+0100 [conn1423174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:36.473+0100 [conn1422713] end connection 172.28.0.163:58130 (399 connections now open) 2015-10-05T04:57:36.475+0100 [mongosMain] connection accepted from 172.28.0.163:60078 #1423175 (400 connections now open) 2015-10-05T04:57:36.476+0100 [conn1423175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:37.128+0100 [conn1422783] end connection 172.28.0.163:58380 (399 connections now open) 2015-10-05T04:57:37.129+0100 [mongosMain] connection accepted from 172.28.0.163:60080 #1423176 (400 connections now open) 2015-10-05T04:57:37.130+0100 [conn1423176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:38.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5325703b51053eb3a4e 2015-10-05T04:57:38.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:57:39.238+0100 [mongosMain] connection accepted from 127.0.0.1:60082 #1423177 (401 connections now open) 2015-10-05T04:57:39.241+0100 [conn1423177] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:39.245+0100 [conn1423177] end connection 127.0.0.1:60082 (400 connections now open) 2015-10-05T04:57:39.747+0100 [conn1422786] end connection 172.28.0.164:51706 (399 connections now open) 2015-10-05T04:57:39.747+0100 [conn1422768] end connection 172.28.0.164:51662 (398 connections now open) 2015-10-05T04:57:39.748+0100 [mongosMain] connection accepted from 172.28.0.164:53153 #1423178 (399 connections now open) 2015-10-05T04:57:39.749+0100 [mongosMain] connection accepted from 172.28.0.164:53154 #1423179 (400 connections now open) 2015-10-05T04:57:39.750+0100 [conn1423178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:39.750+0100 [conn1423179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:40.497+0100 [conn1422725] end connection 172.28.0.163:58213 (399 connections now open) 2015-10-05T04:57:40.497+0100 [conn1422755] end connection 172.28.0.163:58277 (399 connections now open) 2015-10-05T04:57:40.498+0100 [mongosMain] connection accepted from 172.28.0.163:60083 #1423180 (399 connections now open) 2015-10-05T04:57:40.498+0100 [mongosMain] connection accepted from 172.28.0.163:60084 #1423181 (400 connections now open) 2015-10-05T04:57:40.499+0100 [conn1423180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:40.499+0100 [conn1423181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:45.800+0100 [conn1422756] end connection 172.28.0.164:51582 (399 connections now open) 2015-10-05T04:57:45.802+0100 [mongosMain] connection accepted from 172.28.0.164:53162 #1423182 (400 connections now open) 2015-10-05T04:57:45.803+0100 [conn1423182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:46.253+0100 [conn1422790] end connection 172.28.0.164:51717 (399 connections now open) 2015-10-05T04:57:46.254+0100 [mongosMain] connection accepted from 172.28.0.164:53164 #1423183 (400 connections now open) 2015-10-05T04:57:46.256+0100 [conn1423183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:47.128+0100 [conn1422792] end connection 172.28.0.163:58391 (399 connections now open) 2015-10-05T04:57:47.129+0100 [mongosMain] connection accepted from 172.28.0.163:60098 #1423184 (400 connections now open) 2015-10-05T04:57:47.130+0100 [conn1423184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:49.749+0100 [conn1422769] end connection 172.28.0.164:51663 (399 connections now open) 2015-10-05T04:57:49.750+0100 [mongosMain] connection accepted from 172.28.0.164:53169 #1423185 (400 connections now open) 2015-10-05T04:57:49.751+0100 [conn1423185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:50.513+0100 [conn1422692] end connection 172.28.0.163:58090 (399 connections now open) 2015-10-05T04:57:50.513+0100 [conn1422763] end connection 172.28.0.163:58293 (398 connections now open) 2015-10-05T04:57:50.514+0100 [mongosMain] connection accepted from 172.28.0.163:60104 #1423186 (399 connections now open) 2015-10-05T04:57:50.515+0100 [mongosMain] connection accepted from 172.28.0.163:60105 #1423187 (400 connections now open) 2015-10-05T04:57:50.516+0100 [conn1423186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:50.516+0100 [conn1423187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:52.597+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:57:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:57:55.801+0100 [conn1422670] end connection 172.28.0.164:51322 (399 connections now open) 2015-10-05T04:57:55.802+0100 [mongosMain] connection accepted from 172.28.0.164:53176 #1423188 (400 connections now open) 2015-10-05T04:57:55.804+0100 [conn1423188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:56.253+0100 [conn1422799] end connection 172.28.0.164:51736 (399 connections now open) 2015-10-05T04:57:56.254+0100 [mongosMain] connection accepted from 172.28.0.164:53178 #1423189 (400 connections now open) 2015-10-05T04:57:56.256+0100 [conn1423189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:57:56.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5445703b51053eb3a96 2015-10-05T04:57:56.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:57:57.144+0100 [conn1422801] end connection 172.28.0.163:58408 (399 connections now open) 2015-10-05T04:57:57.145+0100 [mongosMain] connection accepted from 172.28.0.163:60116 #1423190 (400 connections now open) 2015-10-05T04:57:57.146+0100 [conn1423190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:00.518+0100 [conn1422717] end connection 172.28.0.163:58138 (399 connections now open) 2015-10-05T04:58:00.518+0100 [conn1422778] end connection 172.28.0.163:58372 (398 connections now open) 2015-10-05T04:58:00.519+0100 [mongosMain] connection accepted from 172.28.0.163:60123 #1423191 (399 connections now open) 2015-10-05T04:58:00.519+0100 [mongosMain] connection accepted from 172.28.0.163:60124 #1423192 (400 connections now open) 2015-10-05T04:58:00.520+0100 [conn1423191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:00.520+0100 [conn1423192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:05.816+0100 [conn1422764] end connection 172.28.0.164:51629 (399 connections now open) 2015-10-05T04:58:05.817+0100 [mongosMain] connection accepted from 172.28.0.164:53210 #1423193 (400 connections now open) 2015-10-05T04:58:05.818+0100 [conn1423193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:06.269+0100 [conn1422807] end connection 172.28.0.164:51752 (399 connections now open) 2015-10-05T04:58:06.270+0100 [mongosMain] connection accepted from 172.28.0.164:53213 #1423194 (400 connections now open) 2015-10-05T04:58:06.272+0100 [conn1423194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:07.144+0100 [conn1422808] end connection 172.28.0.163:58424 (399 connections now open) 2015-10-05T04:58:07.145+0100 [mongosMain] connection accepted from 172.28.0.163:60160 #1423195 (400 connections now open) 2015-10-05T04:58:07.146+0100 [conn1423195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:09.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5505703b51053eb3adf 2015-10-05T04:58:09.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:58:09.764+0100 [conn1422785] end connection 172.28.0.164:51705 (399 connections now open) 2015-10-05T04:58:09.764+0100 [conn1422803] end connection 172.28.0.164:51743 (398 connections now open) 2015-10-05T04:58:09.765+0100 [mongosMain] connection accepted from 172.28.0.164:53233 #1423196 (399 connections now open) 2015-10-05T04:58:09.766+0100 [mongosMain] connection accepted from 172.28.0.164:53234 #1423197 (400 connections now open) 2015-10-05T04:58:09.767+0100 [conn1423197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:09.767+0100 [conn1423196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:10.529+0100 [conn1422787] end connection 172.28.0.163:58383 (399 connections now open) 2015-10-05T04:58:10.529+0100 [conn1422771] end connection 172.28.0.163:58345 (399 connections now open) 2015-10-05T04:58:10.530+0100 [mongosMain] connection accepted from 172.28.0.163:60181 #1423198 (399 connections now open) 2015-10-05T04:58:10.531+0100 [mongosMain] connection accepted from 172.28.0.163:60182 #1423199 (400 connections now open) 2015-10-05T04:58:10.531+0100 [conn1423198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:10.531+0100 [conn1423199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:15.832+0100 [conn1422798] end connection 172.28.0.164:51733 (399 connections now open) 2015-10-05T04:58:15.833+0100 [mongosMain] connection accepted from 172.28.0.164:53250 #1423200 (400 connections now open) 2015-10-05T04:58:15.834+0100 [conn1423200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:16.284+0100 [conn1422813] end connection 172.28.0.164:51796 (399 connections now open) 2015-10-05T04:58:16.285+0100 [mongosMain] connection accepted from 172.28.0.164:53253 #1423201 (400 connections now open) 2015-10-05T04:58:16.287+0100 [conn1423201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:17.159+0100 [conn1422814] end connection 172.28.0.163:58495 (399 connections now open) 2015-10-05T04:58:17.161+0100 [mongosMain] connection accepted from 172.28.0.163:60203 #1423202 (400 connections now open) 2015-10-05T04:58:17.162+0100 [conn1423202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:19.779+0100 [conn1422793] end connection 172.28.0.164:51725 (399 connections now open) 2015-10-05T04:58:19.779+0100 [conn1422776] end connection 172.28.0.164:51685 (398 connections now open) 2015-10-05T04:58:19.780+0100 [mongosMain] connection accepted from 172.28.0.164:53257 #1423203 (399 connections now open) 2015-10-05T04:58:19.780+0100 [mongosMain] connection accepted from 172.28.0.164:53258 #1423204 (400 connections now open) 2015-10-05T04:58:19.781+0100 [conn1423204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:19.781+0100 [conn1423203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:20.544+0100 [conn1422810] end connection 172.28.0.163:58430 (399 connections now open) 2015-10-05T04:58:20.544+0100 [conn1422762] end connection 172.28.0.163:58292 (398 connections now open) 2015-10-05T04:58:20.545+0100 [mongosMain] connection accepted from 172.28.0.163:60206 #1423205 (399 connections now open) 2015-10-05T04:58:20.545+0100 [mongosMain] connection accepted from 172.28.0.163:60207 #1423206 (400 connections now open) 2015-10-05T04:58:20.546+0100 [conn1423205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:20.547+0100 [conn1423206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:21.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f55d5703b51053eb3b5b 2015-10-05T04:58:21.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:58:22.843+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:58:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:58:25.832+0100 [conn1422780] end connection 172.28.0.164:51695 (399 connections now open) 2015-10-05T04:58:25.833+0100 [mongosMain] connection accepted from 172.28.0.164:53267 #1423207 (400 connections now open) 2015-10-05T04:58:25.835+0100 [conn1423207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:26.300+0100 [conn1422820] end connection 172.28.0.164:51839 (399 connections now open) 2015-10-05T04:58:26.301+0100 [mongosMain] connection accepted from 172.28.0.164:53269 #1423208 (400 connections now open) 2015-10-05T04:58:26.305+0100 [conn1423208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:28.371+0100 [mongosMain] connection accepted from 127.0.0.1:60214 #1423209 (401 connections now open) 2015-10-05T04:58:28.374+0100 [conn1423209] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:28.380+0100 [conn1423209] end connection 127.0.0.1:60214 (400 connections now open) 2015-10-05T04:58:29.779+0100 [conn1422809] end connection 172.28.0.164:51755 (399 connections now open) 2015-10-05T04:58:29.780+0100 [conn1422802] end connection 172.28.0.164:51742 (398 connections now open) 2015-10-05T04:58:29.781+0100 [mongosMain] connection accepted from 172.28.0.164:53274 #1423210 (399 connections now open) 2015-10-05T04:58:29.781+0100 [mongosMain] connection accepted from 172.28.0.164:53275 #1423211 (400 connections now open) 2015-10-05T04:58:29.783+0100 [conn1423210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:29.783+0100 [conn1423211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:30.545+0100 [conn1422804] end connection 172.28.0.163:58413 (399 connections now open) 2015-10-05T04:58:30.545+0100 [conn1422733] end connection 172.28.0.163:58238 (399 connections now open) 2015-10-05T04:58:30.546+0100 [mongosMain] connection accepted from 172.28.0.163:60215 #1423212 (399 connections now open) 2015-10-05T04:58:30.547+0100 [mongosMain] connection accepted from 172.28.0.163:60216 #1423213 (400 connections now open) 2015-10-05T04:58:30.547+0100 [conn1423212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:30.548+0100 [conn1423213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:34.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5695703b51053eb3bdb 2015-10-05T04:58:34.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:58:39.385+0100 [mongosMain] connection accepted from 127.0.0.1:60222 #1423214 (401 connections now open) 2015-10-05T04:58:39.387+0100 [conn1423214] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:39.392+0100 [conn1423214] end connection 127.0.0.1:60222 (400 connections now open) 2015-10-05T04:58:39.795+0100 [conn1422708] end connection 172.28.0.164:51434 (399 connections now open) 2015-10-05T04:58:39.796+0100 [mongosMain] connection accepted from 172.28.0.164:53291 #1423215 (400 connections now open) 2015-10-05T04:58:39.797+0100 [conn1423215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:40.561+0100 [conn1422754] end connection 172.28.0.163:58276 (399 connections now open) 2015-10-05T04:58:40.561+0100 [conn1422796] end connection 172.28.0.163:58394 (398 connections now open) 2015-10-05T04:58:40.562+0100 [mongosMain] connection accepted from 172.28.0.163:60224 #1423216 (399 connections now open) 2015-10-05T04:58:40.562+0100 [mongosMain] connection accepted from 172.28.0.163:60225 #1423217 (400 connections now open) 2015-10-05T04:58:40.563+0100 [conn1423216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:40.563+0100 [conn1423217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:45.847+0100 [conn1422826] end connection 172.28.0.164:51855 (399 connections now open) 2015-10-05T04:58:45.848+0100 [mongosMain] connection accepted from 172.28.0.164:53299 #1423218 (400 connections now open) 2015-10-05T04:58:45.849+0100 [conn1423218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:46.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5765703b51053eb3c61 2015-10-05T04:58:46.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:58:49.796+0100 [conn1422816] end connection 172.28.0.164:51821 (399 connections now open) 2015-10-05T04:58:49.797+0100 [mongosMain] connection accepted from 172.28.0.164:53303 #1423219 (400 connections now open) 2015-10-05T04:58:49.799+0100 [conn1423219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:50.561+0100 [conn1422746] end connection 172.28.0.163:58258 (399 connections now open) 2015-10-05T04:58:50.562+0100 [conn1422818] end connection 172.28.0.163:58520 (398 connections now open) 2015-10-05T04:58:50.564+0100 [mongosMain] connection accepted from 172.28.0.163:60242 #1423220 (399 connections now open) 2015-10-05T04:58:50.564+0100 [mongosMain] connection accepted from 172.28.0.163:60243 #1423221 (400 connections now open) 2015-10-05T04:58:50.565+0100 [conn1423220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:50.565+0100 [conn1423221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:52.989+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:58:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:58:55.863+0100 [conn1422812] end connection 172.28.0.164:51790 (399 connections now open) 2015-10-05T04:58:55.865+0100 [mongosMain] connection accepted from 172.28.0.164:53312 #1423222 (400 connections now open) 2015-10-05T04:58:55.866+0100 [conn1423222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:56.542+0100 [conn1422758] end connection 172.28.0.163:58284 (399 connections now open) 2015-10-05T04:58:56.544+0100 [mongosMain] connection accepted from 172.28.0.163:60252 #1423223 (400 connections now open) 2015-10-05T04:58:56.545+0100 [conn1423223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:58:58.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5825703b51053eb3cfb 2015-10-05T04:58:58.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:58:59.810+0100 [conn1422822] end connection 172.28.0.164:51844 (399 connections now open) 2015-10-05T04:58:59.811+0100 [mongosMain] connection accepted from 172.28.0.164:53314 #1423224 (400 connections now open) 2015-10-05T04:58:59.813+0100 [conn1423224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:00.576+0100 [conn1422830] end connection 172.28.0.163:58543 (399 connections now open) 2015-10-05T04:59:00.576+0100 [conn1422779] end connection 172.28.0.163:58373 (399 connections now open) 2015-10-05T04:59:00.577+0100 [mongosMain] connection accepted from 172.28.0.163:60260 #1423225 (399 connections now open) 2015-10-05T04:59:00.577+0100 [mongosMain] connection accepted from 172.28.0.163:60261 #1423226 (400 connections now open) 2015-10-05T04:59:00.578+0100 [conn1423225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:00.578+0100 [conn1423226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:05.864+0100 [conn1422832] end connection 172.28.0.164:51869 (399 connections now open) 2015-10-05T04:59:05.865+0100 [mongosMain] connection accepted from 172.28.0.164:53341 #1423227 (400 connections now open) 2015-10-05T04:59:05.867+0100 [conn1423227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:06.551+0100 [conn1422774] end connection 172.28.0.163:58364 (399 connections now open) 2015-10-05T04:59:06.552+0100 [mongosMain] connection accepted from 172.28.0.163:60301 #1423228 (400 connections now open) 2015-10-05T04:59:06.554+0100 [conn1423228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:09.811+0100 [conn1422823] end connection 172.28.0.164:51845 (399 connections now open) 2015-10-05T04:59:09.811+0100 [conn1422833] end connection 172.28.0.164:51877 (399 connections now open) 2015-10-05T04:59:09.812+0100 [mongosMain] connection accepted from 172.28.0.164:53369 #1423229 (399 connections now open) 2015-10-05T04:59:09.812+0100 [mongosMain] connection accepted from 172.28.0.164:53368 #1423230 (400 connections now open) 2015-10-05T04:59:09.814+0100 [conn1423229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:09.814+0100 [conn1423230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:10.577+0100 [conn1422824] end connection 172.28.0.163:58535 (399 connections now open) 2015-10-05T04:59:10.577+0100 [conn1422811] end connection 172.28.0.163:58431 (398 connections now open) 2015-10-05T04:59:10.578+0100 [mongosMain] connection accepted from 172.28.0.163:60334 #1423231 (399 connections now open) 2015-10-05T04:59:10.578+0100 [mongosMain] connection accepted from 172.28.0.163:60335 #1423232 (400 connections now open) 2015-10-05T04:59:10.579+0100 [conn1423231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:10.579+0100 [conn1423232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:10.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f58e5703b51053eb3d89 2015-10-05T04:59:10.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:59:15.879+0100 [conn1422806] end connection 172.28.0.164:51750 (399 connections now open) 2015-10-05T04:59:15.881+0100 [mongosMain] connection accepted from 172.28.0.164:53379 #1423233 (400 connections now open) 2015-10-05T04:59:15.884+0100 [conn1423233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:16.567+0100 [conn1422800] end connection 172.28.0.163:58405 (399 connections now open) 2015-10-05T04:59:16.568+0100 [mongosMain] connection accepted from 172.28.0.163:60343 #1423234 (400 connections now open) 2015-10-05T04:59:16.570+0100 [conn1423234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:17.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5945703b51053eb3ddd 2015-10-05T04:59:17.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:59:19.826+0100 [conn1422794] end connection 172.28.0.164:51724 (399 connections now open) 2015-10-05T04:59:19.827+0100 [mongosMain] connection accepted from 172.28.0.164:53383 #1423235 (400 connections now open) 2015-10-05T04:59:19.829+0100 [conn1423235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:20.592+0100 [conn1422797] end connection 172.28.0.163:58395 (399 connections now open) 2015-10-05T04:59:20.592+0100 [conn1422841] end connection 172.28.0.163:58580 (398 connections now open) 2015-10-05T04:59:20.593+0100 [mongosMain] connection accepted from 172.28.0.163:60347 #1423236 (399 connections now open) 2015-10-05T04:59:20.593+0100 [mongosMain] connection accepted from 172.28.0.163:60348 #1423237 (400 connections now open) 2015-10-05T04:59:20.594+0100 [conn1423236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:20.595+0100 [conn1423237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:23.749+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5611f59926fd57ee99391e57') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444017563613), why: "doing balance round", ts: ObjectId('5611f59b5703b51053eb3e13') } } gle1: { lastOp: Timestamp 1444017557000|2, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1444017563000|3, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T04:59:23.753+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T04:59:23.885+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:59:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:59:23.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f59b5703b51053eb3e13 2015-10-05T04:59:24.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:59:25.879+0100 [conn1422789] end connection 172.28.0.164:51713 (399 connections now open) 2015-10-05T04:59:25.881+0100 [mongosMain] connection accepted from 172.28.0.164:53393 #1423238 (400 connections now open) 2015-10-05T04:59:25.883+0100 [conn1423238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:26.568+0100 [conn1422782] end connection 172.28.0.163:58378 (399 connections now open) 2015-10-05T04:59:26.569+0100 [mongosMain] connection accepted from 172.28.0.163:60350 #1423239 (400 connections now open) 2015-10-05T04:59:26.575+0100 [conn1423239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:28.548+0100 [mongosMain] connection accepted from 127.0.0.1:60353 #1423240 (401 connections now open) 2015-10-05T04:59:28.550+0100 [conn1423240] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:28.555+0100 [conn1423240] end connection 127.0.0.1:60353 (400 connections now open) 2015-10-05T04:59:40.122+0100 [mongosMain] connection accepted from 127.0.0.1:60358 #1423241 (401 connections now open) 2015-10-05T04:59:40.125+0100 [conn1423241] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:40.129+0100 [conn1423241] end connection 127.0.0.1:60358 (400 connections now open) 2015-10-05T04:59:42.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5ae5703b51053eb3ebf 2015-10-05T04:59:42.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:59:46.583+0100 [conn1422729] end connection 172.28.0.163:58231 (399 connections now open) 2015-10-05T04:59:46.584+0100 [mongosMain] connection accepted from 172.28.0.163:60366 #1423242 (400 connections now open) 2015-10-05T04:59:46.585+0100 [conn1423242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T04:59:54.042+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 04:59:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T04:59:54.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5ba5703b51053eb3f2f 2015-10-05T04:59:54.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T04:59:56.599+0100 [conn1422791] end connection 172.28.0.163:58388 (399 connections now open) 2015-10-05T04:59:56.601+0100 [mongosMain] connection accepted from 172.28.0.163:60378 #1423243 (400 connections now open) 2015-10-05T04:59:56.601+0100 [conn1423243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:01.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5c05703b51053eb3f75 2015-10-05T05:00:01.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:00:07.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5c75703b51053eb408a 2015-10-05T05:00:07.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:00:09.873+0100 [conn1422815] end connection 172.28.0.164:51820 (399 connections now open) 2015-10-05T05:00:09.874+0100 [mongosMain] connection accepted from 172.28.0.164:53444 #1423244 (400 connections now open) 2015-10-05T05:00:09.877+0100 [conn1423244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:10.640+0100 [conn1422844] end connection 172.28.0.163:58643 (399 connections now open) 2015-10-05T05:00:10.641+0100 [mongosMain] connection accepted from 172.28.0.163:60405 #1423245 (400 connections now open) 2015-10-05T05:00:10.642+0100 [conn1423245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:16.615+0100 [conn1422766] end connection 172.28.0.163:58321 (399 connections now open) 2015-10-05T05:00:16.616+0100 [mongosMain] connection accepted from 172.28.0.163:60414 #1423246 (400 connections now open) 2015-10-05T05:00:16.617+0100 [conn1423246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:17.271+0100 [conn1422821] end connection 172.28.0.163:58533 (399 connections now open) 2015-10-05T05:00:17.272+0100 [mongosMain] connection accepted from 172.28.0.163:60417 #1423247 (400 connections now open) 2015-10-05T05:00:17.273+0100 [conn1423247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:19.889+0100 [conn1422847] end connection 172.28.0.164:51969 (399 connections now open) 2015-10-05T05:00:19.890+0100 [mongosMain] connection accepted from 172.28.0.164:53454 #1423248 (400 connections now open) 2015-10-05T05:00:19.892+0100 [conn1423248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:20.639+0100 [conn1422838] end connection 172.28.0.163:58567 (399 connections now open) 2015-10-05T05:00:20.640+0100 [mongosMain] connection accepted from 172.28.0.163:60420 #1423249 (400 connections now open) 2015-10-05T05:00:20.642+0100 [conn1423249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:24.882+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:00:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:00:26.411+0100 [conn1422827] end connection 172.28.0.164:51858 (399 connections now open) 2015-10-05T05:00:26.412+0100 [mongosMain] connection accepted from 172.28.0.164:53467 #1423250 (400 connections now open) 2015-10-05T05:00:26.414+0100 [conn1423250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:26.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5d95703b51053eb44bb 2015-10-05T05:00:26.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:00:26.630+0100 [conn1422851] end connection 172.28.0.163:58681 (399 connections now open) 2015-10-05T05:00:26.632+0100 [mongosMain] connection accepted from 172.28.0.163:60423 #1423251 (400 connections now open) 2015-10-05T05:00:26.633+0100 [conn1423251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:27.270+0100 [conn1422857] end connection 172.28.0.163:58767 (399 connections now open) 2015-10-05T05:00:27.271+0100 [mongosMain] connection accepted from 172.28.0.163:60426 #1423252 (400 connections now open) 2015-10-05T05:00:27.272+0100 [conn1423252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:28.733+0100 [mongosMain] connection accepted from 127.0.0.1:60428 #1423253 (401 connections now open) 2015-10-05T05:00:28.736+0100 [conn1423253] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:28.741+0100 [conn1423253] end connection 127.0.0.1:60428 (400 connections now open) 2015-10-05T05:00:30.685+0100 [conn1422843] end connection 172.28.0.164:51951 (399 connections now open) 2015-10-05T05:00:30.689+0100 [mongosMain] connection accepted from 172.28.0.164:53472 #1423254 (400 connections now open) 2015-10-05T05:00:30.693+0100 [conn1423254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:36.426+0100 [conn1422860] end connection 172.28.0.164:52084 (399 connections now open) 2015-10-05T05:00:36.429+0100 [mongosMain] connection accepted from 172.28.0.164:53480 #1423255 (400 connections now open) 2015-10-05T05:00:36.431+0100 [conn1423255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:37.296+0100 [conn1422862] end connection 172.28.0.163:58774 (399 connections now open) 2015-10-05T05:00:37.297+0100 [mongosMain] connection accepted from 172.28.0.163:60433 #1423256 (400 connections now open) 2015-10-05T05:00:37.298+0100 [conn1423256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:39.948+0100 [mongosMain] connection accepted from 127.0.0.1:60435 #1423257 (401 connections now open) 2015-10-05T05:00:39.951+0100 [conn1423257] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:39.956+0100 [conn1423257] end connection 127.0.0.1:60435 (400 connections now open) 2015-10-05T05:00:40.685+0100 [conn1422853] end connection 172.28.0.164:52061 (399 connections now open) 2015-10-05T05:00:40.686+0100 [mongosMain] connection accepted from 172.28.0.164:53488 #1423258 (400 connections now open) 2015-10-05T05:00:40.688+0100 [conn1423258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:40.957+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:00:40.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:00:45.959+0100 [conn1422819] end connection 172.28.0.164:51836 (399 connections now open) 2015-10-05T05:00:45.960+0100 [mongosMain] connection accepted from 172.28.0.164:53503 #1423259 (400 connections now open) 2015-10-05T05:00:45.961+0100 [conn1423259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:46.426+0100 [conn1422865] end connection 172.28.0.164:52097 (399 connections now open) 2015-10-05T05:00:46.427+0100 [mongosMain] connection accepted from 172.28.0.164:53505 #1423260 (400 connections now open) 2015-10-05T05:00:46.429+0100 [conn1423260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:47.116+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5611f5edd5de43e0ed5d31a7') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444017646964), why: "doing balance round", ts: ObjectId('5611f5ee5703b51053eb48d9') } } gle1: { lastOp: Timestamp 1444017647000|2, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444017626000|8, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } 2015-10-05T05:00:47.121+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T05:00:47.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f5ee5703b51053eb48d9 2015-10-05T05:00:47.286+0100 [conn1422867] end connection 172.28.0.163:58785 (399 connections now open) 2015-10-05T05:00:47.288+0100 [mongosMain] connection accepted from 172.28.0.163:60445 #1423261 (400 connections now open) 2015-10-05T05:00:47.289+0100 [conn1423261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:47.390+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:00:55.134+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:00:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:00:55.978+0100 [conn1422836] end connection 172.28.0.164:51884 (399 connections now open) 2015-10-05T05:00:55.979+0100 [mongosMain] connection accepted from 172.28.0.164:53515 #1423262 (400 connections now open) 2015-10-05T05:00:55.981+0100 [conn1423262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:56.442+0100 [conn1422871] end connection 172.28.0.164:52115 (399 connections now open) 2015-10-05T05:00:56.449+0100 [mongosMain] connection accepted from 172.28.0.164:53517 #1423263 (400 connections now open) 2015-10-05T05:00:56.455+0100 [conn1423263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:56.646+0100 [conn1422856] end connection 172.28.0.163:58764 (399 connections now open) 2015-10-05T05:00:56.647+0100 [mongosMain] connection accepted from 172.28.0.163:60457 #1423264 (400 connections now open) 2015-10-05T05:00:56.648+0100 [conn1423264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:00:57.301+0100 [conn1422873] end connection 172.28.0.163:58799 (399 connections now open) 2015-10-05T05:00:57.302+0100 [mongosMain] connection accepted from 172.28.0.163:60458 #1423265 (400 connections now open) 2015-10-05T05:00:57.303+0100 [conn1423265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:00.733+0100 [conn1422837] end connection 172.28.0.164:51890 (399 connections now open) 2015-10-05T05:01:00.735+0100 [mongosMain] connection accepted from 172.28.0.164:53524 #1423266 (400 connections now open) 2015-10-05T05:01:00.737+0100 [conn1423266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:05.974+0100 [conn1422842] end connection 172.28.0.164:51929 (399 connections now open) 2015-10-05T05:01:05.975+0100 [mongosMain] connection accepted from 172.28.0.164:53532 #1423267 (400 connections now open) 2015-10-05T05:01:05.977+0100 [conn1423267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:06.444+0100 [conn1422875] end connection 172.28.0.164:52127 (399 connections now open) 2015-10-05T05:01:06.446+0100 [mongosMain] connection accepted from 172.28.0.164:53534 #1423268 (400 connections now open) 2015-10-05T05:01:06.448+0100 [conn1423268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:06.662+0100 [conn1422866] end connection 172.28.0.163:58783 (399 connections now open) 2015-10-05T05:01:06.663+0100 [mongosMain] connection accepted from 172.28.0.163:60477 #1423269 (400 connections now open) 2015-10-05T05:01:06.664+0100 [conn1423269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:07.302+0100 [conn1422877] end connection 172.28.0.163:58811 (399 connections now open) 2015-10-05T05:01:07.303+0100 [mongosMain] connection accepted from 172.28.0.163:60478 #1423270 (400 connections now open) 2015-10-05T05:01:07.304+0100 [conn1423270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:10.748+0100 [conn1422752] end connection 172.28.0.164:51574 (399 connections now open) 2015-10-05T05:01:10.748+0100 [conn1422883] end connection 172.28.0.164:52167 (398 connections now open) 2015-10-05T05:01:10.749+0100 [mongosMain] connection accepted from 172.28.0.164:53539 #1423271 (399 connections now open) 2015-10-05T05:01:10.750+0100 [mongosMain] connection accepted from 172.28.0.164:53540 #1423272 (400 connections now open) 2015-10-05T05:01:10.751+0100 [conn1423271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:10.751+0100 [conn1423272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:10.796+0100 [conn1422805] end connection 172.28.0.163:58414 (399 connections now open) 2015-10-05T05:01:10.796+0100 [conn1422859] end connection 172.28.0.163:58769 (399 connections now open) 2015-10-05T05:01:10.797+0100 [mongosMain] connection accepted from 172.28.0.163:60484 #1423273 (399 connections now open) 2015-10-05T05:01:10.797+0100 [mongosMain] connection accepted from 172.28.0.163:60485 #1423274 (400 connections now open) 2015-10-05T05:01:10.798+0100 [conn1423273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:10.798+0100 [conn1423274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:15.973+0100 [conn1422839] end connection 172.28.0.164:51897 (399 connections now open) 2015-10-05T05:01:15.974+0100 [mongosMain] connection accepted from 172.28.0.164:53544 #1423275 (400 connections now open) 2015-10-05T05:01:15.976+0100 [conn1423275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:16.467+0100 [conn1422879] end connection 172.28.0.164:52149 (399 connections now open) 2015-10-05T05:01:16.470+0100 [mongosMain] connection accepted from 172.28.0.164:53546 #1423276 (400 connections now open) 2015-10-05T05:01:16.472+0100 [conn1423276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:16.661+0100 [conn1422872] end connection 172.28.0.163:58797 (399 connections now open) 2015-10-05T05:01:16.662+0100 [mongosMain] connection accepted from 172.28.0.163:60493 #1423277 (400 connections now open) 2015-10-05T05:01:16.663+0100 [conn1423277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:17.317+0100 [conn1422881] end connection 172.28.0.163:58860 (399 connections now open) 2015-10-05T05:01:17.318+0100 [mongosMain] connection accepted from 172.28.0.163:60494 #1423278 (400 connections now open) 2015-10-05T05:01:17.319+0100 [conn1423278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:17.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f60d5703b51053eb4f34 2015-10-05T05:01:17.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:01:20.748+0100 [conn1422869] end connection 172.28.0.164:52104 (399 connections now open) 2015-10-05T05:01:20.748+0100 [conn1422882] end connection 172.28.0.164:52168 (398 connections now open) 2015-10-05T05:01:20.749+0100 [mongosMain] connection accepted from 172.28.0.164:53552 #1423279 (399 connections now open) 2015-10-05T05:01:20.750+0100 [mongosMain] connection accepted from 172.28.0.164:53551 #1423280 (400 connections now open) 2015-10-05T05:01:20.751+0100 [conn1423279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:20.751+0100 [conn1423280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:20.797+0100 [conn1422831] end connection 172.28.0.163:58544 (399 connections now open) 2015-10-05T05:01:20.797+0100 [conn1422835] end connection 172.28.0.163:58553 (399 connections now open) 2015-10-05T05:01:20.798+0100 [mongosMain] connection accepted from 172.28.0.163:60497 #1423281 (399 connections now open) 2015-10-05T05:01:20.798+0100 [mongosMain] connection accepted from 172.28.0.163:60498 #1423282 (400 connections now open) 2015-10-05T05:01:20.799+0100 [conn1423281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:20.799+0100 [conn1423282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:25.415+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:01:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:01:25.990+0100 [conn1422870] end connection 172.28.0.164:52112 (399 connections now open) 2015-10-05T05:01:25.991+0100 [mongosMain] connection accepted from 172.28.0.164:53560 #1423283 (400 connections now open) 2015-10-05T05:01:25.993+0100 [conn1423283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:26.459+0100 [conn1422887] end connection 172.28.0.164:52188 (399 connections now open) 2015-10-05T05:01:26.461+0100 [mongosMain] connection accepted from 172.28.0.164:53562 #1423284 (400 connections now open) 2015-10-05T05:01:26.463+0100 [conn1423284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:27.333+0100 [conn1422889] end connection 172.28.0.163:58920 (399 connections now open) 2015-10-05T05:01:27.334+0100 [mongosMain] connection accepted from 172.28.0.163:60503 #1423285 (400 connections now open) 2015-10-05T05:01:27.335+0100 [conn1423285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:28.924+0100 [mongosMain] connection accepted from 127.0.0.1:60505 #1423286 (401 connections now open) 2015-10-05T05:01:28.928+0100 [conn1423286] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:28.934+0100 [conn1423286] end connection 127.0.0.1:60505 (400 connections now open) 2015-10-05T05:01:30.763+0100 [conn1422864] end connection 172.28.0.164:52089 (399 connections now open) 2015-10-05T05:01:30.764+0100 [conn1422840] end connection 172.28.0.164:51899 (398 connections now open) 2015-10-05T05:01:30.764+0100 [mongosMain] connection accepted from 172.28.0.164:53567 #1423287 (399 connections now open) 2015-10-05T05:01:30.765+0100 [mongosMain] connection accepted from 172.28.0.164:53568 #1423288 (400 connections now open) 2015-10-05T05:01:30.766+0100 [conn1423287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:30.766+0100 [conn1423288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:30.811+0100 [conn1422885] end connection 172.28.0.163:58892 (399 connections now open) 2015-10-05T05:01:30.811+0100 [conn1422845] end connection 172.28.0.163:58644 (399 connections now open) 2015-10-05T05:01:30.811+0100 [mongosMain] connection accepted from 172.28.0.163:60506 #1423289 (399 connections now open) 2015-10-05T05:01:30.812+0100 [mongosMain] connection accepted from 172.28.0.163:60507 #1423290 (400 connections now open) 2015-10-05T05:01:30.812+0100 [conn1423289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:30.813+0100 [conn1423290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:36.029+0100 [conn1422874] end connection 172.28.0.164:52125 (399 connections now open) 2015-10-05T05:01:36.029+0100 [mongosMain] connection accepted from 172.28.0.164:53576 #1423291 (400 connections now open) 2015-10-05T05:01:36.029+0100 [conn1423291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:36.044+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:01:36.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:01:36.497+0100 [conn1422894] end connection 172.28.0.164:52205 (399 connections now open) 2015-10-05T05:01:36.497+0100 [mongosMain] connection accepted from 172.28.0.164:53578 #1423292 (400 connections now open) 2015-10-05T05:01:36.497+0100 [conn1423292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:36.731+0100 [conn1422876] end connection 172.28.0.163:58809 (399 connections now open) 2015-10-05T05:01:36.731+0100 [mongosMain] connection accepted from 172.28.0.163:60512 #1423293 (400 connections now open) 2015-10-05T05:01:36.731+0100 [conn1423293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:37.386+0100 [conn1422896] end connection 172.28.0.163:58931 (399 connections now open) 2015-10-05T05:01:37.386+0100 [mongosMain] connection accepted from 172.28.0.163:60514 #1423294 (400 connections now open) 2015-10-05T05:01:37.386+0100 [conn1423294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:40.123+0100 [mongosMain] connection accepted from 127.0.0.1:60516 #1423295 (401 connections now open) 2015-10-05T05:01:40.126+0100 [conn1423295] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:40.132+0100 [conn1423295] end connection 127.0.0.1:60516 (400 connections now open) 2015-10-05T05:01:40.763+0100 [conn1422858] end connection 172.28.0.164:52073 (399 connections now open) 2015-10-05T05:01:40.763+0100 [conn1422777] end connection 172.28.0.164:51686 (398 connections now open) 2015-10-05T05:01:40.764+0100 [mongosMain] connection accepted from 172.28.0.164:53587 #1423296 (399 connections now open) 2015-10-05T05:01:40.764+0100 [mongosMain] connection accepted from 172.28.0.164:53588 #1423297 (400 connections now open) 2015-10-05T05:01:40.765+0100 [conn1423296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:40.766+0100 [conn1423297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:40.813+0100 [conn1422892] end connection 172.28.0.163:58925 (399 connections now open) 2015-10-05T05:01:40.813+0100 [mongosMain] connection accepted from 172.28.0.163:60518 #1423298 (400 connections now open) 2015-10-05T05:01:40.814+0100 [conn1422825] end connection 172.28.0.163:58536 (399 connections now open) 2015-10-05T05:01:40.814+0100 [conn1423298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:40.815+0100 [mongosMain] connection accepted from 172.28.0.163:60521 #1423299 (400 connections now open) 2015-10-05T05:01:40.815+0100 [conn1423299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:42.269+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6265703b51053eb5439 2015-10-05T05:01:42.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:01:46.474+0100 [conn1422902] end connection 172.28.0.164:52221 (399 connections now open) 2015-10-05T05:01:46.474+0100 [mongosMain] connection accepted from 172.28.0.164:53597 #1423300 (400 connections now open) 2015-10-05T05:01:46.475+0100 [conn1423300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:46.694+0100 [conn1422888] end connection 172.28.0.163:58917 (399 connections now open) 2015-10-05T05:01:46.694+0100 [mongosMain] connection accepted from 172.28.0.163:60528 #1423301 (400 connections now open) 2015-10-05T05:01:46.695+0100 [conn1423301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:47.349+0100 [conn1422904] end connection 172.28.0.163:58941 (399 connections now open) 2015-10-05T05:01:47.350+0100 [mongosMain] connection accepted from 172.28.0.163:60529 #1423302 (400 connections now open) 2015-10-05T05:01:47.351+0100 [conn1423302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:48.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f62c5703b51053eb552a 2015-10-05T05:01:48.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:01:50.780+0100 [conn1422852] end connection 172.28.0.164:52008 (399 connections now open) 2015-10-05T05:01:50.781+0100 [mongosMain] connection accepted from 172.28.0.164:53600 #1423303 (400 connections now open) 2015-10-05T05:01:50.783+0100 [conn1423303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:50.849+0100 [conn1422884] end connection 172.28.0.163:58891 (399 connections now open) 2015-10-05T05:01:50.850+0100 [mongosMain] connection accepted from 172.28.0.163:60535 #1423304 (400 connections now open) 2015-10-05T05:01:50.851+0100 [conn1423304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:54.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6325703b51053eb5615 2015-10-05T05:01:54.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:01:55.580+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:01:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:01:56.488+0100 [conn1422910] end connection 172.28.0.164:52239 (399 connections now open) 2015-10-05T05:01:56.490+0100 [mongosMain] connection accepted from 172.28.0.164:53609 #1423305 (400 connections now open) 2015-10-05T05:01:56.492+0100 [conn1423305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:56.709+0100 [conn1422861] end connection 172.28.0.163:58772 (399 connections now open) 2015-10-05T05:01:56.710+0100 [mongosMain] connection accepted from 172.28.0.163:60543 #1423306 (400 connections now open) 2015-10-05T05:01:56.711+0100 [conn1423306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:01:57.349+0100 [conn1422912] end connection 172.28.0.163:58957 (399 connections now open) 2015-10-05T05:01:57.350+0100 [mongosMain] connection accepted from 172.28.0.163:60546 #1423307 (400 connections now open) 2015-10-05T05:01:57.351+0100 [conn1423307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:00.780+0100 [conn1422829] end connection 172.28.0.164:51862 (399 connections now open) 2015-10-05T05:02:00.780+0100 [mongosMain] connection accepted from 172.28.0.164:53616 #1423308 (400 connections now open) 2015-10-05T05:02:00.785+0100 [conn1423308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:00.845+0100 [conn1422848] end connection 172.28.0.163:58663 (399 connections now open) 2015-10-05T05:02:00.845+0100 [mongosMain] connection accepted from 172.28.0.163:60555 #1423309 (400 connections now open) 2015-10-05T05:02:00.846+0100 [conn1423309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:01.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6385703b51053eb5705 2015-10-05T05:02:01.274+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:06.504+0100 [conn1422915] end connection 172.28.0.164:52252 (399 connections now open) 2015-10-05T05:02:06.505+0100 [mongosMain] connection accepted from 172.28.0.164:53620 #1423310 (400 connections now open) 2015-10-05T05:02:06.507+0100 [conn1423310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:06.709+0100 [conn1422911] end connection 172.28.0.163:58953 (399 connections now open) 2015-10-05T05:02:06.710+0100 [mongosMain] connection accepted from 172.28.0.163:60564 #1423311 (400 connections now open) 2015-10-05T05:02:06.711+0100 [conn1423311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:07.364+0100 [conn1422917] end connection 172.28.0.163:58972 (399 connections now open) 2015-10-05T05:02:07.365+0100 [mongosMain] connection accepted from 172.28.0.163:60566 #1423312 (400 connections now open) 2015-10-05T05:02:07.366+0100 [conn1423312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:07.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f63f5703b51053eb57f3 2015-10-05T05:02:07.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:10.794+0100 [conn1422899] end connection 172.28.0.164:52210 (399 connections now open) 2015-10-05T05:02:10.794+0100 [conn1422854] end connection 172.28.0.164:52060 (398 connections now open) 2015-10-05T05:02:10.795+0100 [mongosMain] connection accepted from 172.28.0.164:53624 #1423313 (399 connections now open) 2015-10-05T05:02:10.796+0100 [mongosMain] connection accepted from 172.28.0.164:53625 #1423314 (400 connections now open) 2015-10-05T05:02:10.797+0100 [conn1423313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:10.797+0100 [conn1423314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:10.846+0100 [conn1422855] end connection 172.28.0.163:58754 (399 connections now open) 2015-10-05T05:02:10.846+0100 [conn1422788] end connection 172.28.0.163:58386 (399 connections now open) 2015-10-05T05:02:10.847+0100 [mongosMain] connection accepted from 172.28.0.163:60571 #1423315 (399 connections now open) 2015-10-05T05:02:10.847+0100 [mongosMain] connection accepted from 172.28.0.163:60572 #1423316 (400 connections now open) 2015-10-05T05:02:10.848+0100 [conn1423315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:10.848+0100 [conn1423316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:13.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6455703b51053eb58c4 2015-10-05T05:02:13.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:16.037+0100 [conn1422878] end connection 172.28.0.164:52143 (399 connections now open) 2015-10-05T05:02:16.038+0100 [mongosMain] connection accepted from 172.28.0.164:53629 #1423317 (400 connections now open) 2015-10-05T05:02:16.040+0100 [conn1423317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:16.505+0100 [conn1422919] end connection 172.28.0.164:52286 (399 connections now open) 2015-10-05T05:02:16.506+0100 [mongosMain] connection accepted from 172.28.0.164:53631 #1423318 (400 connections now open) 2015-10-05T05:02:16.508+0100 [conn1423318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:16.724+0100 [conn1422895] end connection 172.28.0.163:58930 (399 connections now open) 2015-10-05T05:02:16.725+0100 [mongosMain] connection accepted from 172.28.0.163:60580 #1423319 (400 connections now open) 2015-10-05T05:02:16.726+0100 [conn1423319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:17.364+0100 [conn1422921] end connection 172.28.0.163:59026 (399 connections now open) 2015-10-05T05:02:17.365+0100 [mongosMain] connection accepted from 172.28.0.163:60583 #1423320 (400 connections now open) 2015-10-05T05:02:17.366+0100 [conn1423320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:20.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f64b5703b51053eb5994 2015-10-05T05:02:20.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:20.794+0100 [conn1422907] end connection 172.28.0.164:52228 (399 connections now open) 2015-10-05T05:02:20.794+0100 [conn1422906] end connection 172.28.0.164:52229 (399 connections now open) 2015-10-05T05:02:20.795+0100 [mongosMain] connection accepted from 172.28.0.164:53637 #1423321 (399 connections now open) 2015-10-05T05:02:20.795+0100 [mongosMain] connection accepted from 172.28.0.164:53638 #1423322 (400 connections now open) 2015-10-05T05:02:20.796+0100 [conn1423321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:20.796+0100 [conn1423322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:20.858+0100 [conn1422891] end connection 172.28.0.163:58924 (399 connections now open) 2015-10-05T05:02:20.858+0100 [conn1422900] end connection 172.28.0.163:58935 (399 connections now open) 2015-10-05T05:02:20.859+0100 [mongosMain] connection accepted from 172.28.0.163:60586 #1423323 (399 connections now open) 2015-10-05T05:02:20.859+0100 [mongosMain] connection accepted from 172.28.0.163:60585 #1423324 (400 connections now open) 2015-10-05T05:02:20.859+0100 [conn1423323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:20.860+0100 [conn1423324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:25.854+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:02:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:02:26.052+0100 [conn1422893] end connection 172.28.0.164:52202 (399 connections now open) 2015-10-05T05:02:26.054+0100 [mongosMain] connection accepted from 172.28.0.164:53647 #1423325 (400 connections now open) 2015-10-05T05:02:26.055+0100 [conn1423325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:26.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6525703b51053eb5a5e 2015-10-05T05:02:26.520+0100 [conn1422927] end connection 172.28.0.164:52321 (399 connections now open) 2015-10-05T05:02:26.521+0100 [mongosMain] connection accepted from 172.28.0.164:53650 #1423326 (400 connections now open) 2015-10-05T05:02:26.523+0100 [conn1423326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:26.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:26.725+0100 [conn1422880] end connection 172.28.0.163:58855 (399 connections now open) 2015-10-05T05:02:26.726+0100 [mongosMain] connection accepted from 172.28.0.163:60590 #1423327 (400 connections now open) 2015-10-05T05:02:26.727+0100 [conn1423327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:27.380+0100 [conn1422928] end connection 172.28.0.163:59063 (399 connections now open) 2015-10-05T05:02:27.382+0100 [mongosMain] connection accepted from 172.28.0.163:60594 #1423328 (400 connections now open) 2015-10-05T05:02:27.383+0100 [conn1423328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:28.695+0100 [mongosMain] connection accepted from 127.0.0.1:60596 #1423329 (401 connections now open) 2015-10-05T05:02:28.697+0100 [conn1423329] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:28.702+0100 [conn1423329] end connection 127.0.0.1:60596 (400 connections now open) 2015-10-05T05:02:30.810+0100 [conn1422890] end connection 172.28.0.164:52194 (399 connections now open) 2015-10-05T05:02:30.810+0100 [conn1422922] end connection 172.28.0.164:52302 (398 connections now open) 2015-10-05T05:02:30.811+0100 [mongosMain] connection accepted from 172.28.0.164:53655 #1423330 (399 connections now open) 2015-10-05T05:02:30.811+0100 [mongosMain] connection accepted from 172.28.0.164:53656 #1423331 (400 connections now open) 2015-10-05T05:02:30.813+0100 [conn1423330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:30.813+0100 [conn1423331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:30.860+0100 [conn1422909] end connection 172.28.0.163:58945 (399 connections now open) 2015-10-05T05:02:30.860+0100 [conn1422740] end connection 172.28.0.163:58251 (399 connections now open) 2015-10-05T05:02:30.861+0100 [mongosMain] connection accepted from 172.28.0.163:60597 #1423332 (399 connections now open) 2015-10-05T05:02:30.861+0100 [mongosMain] connection accepted from 172.28.0.163:60598 #1423333 (400 connections now open) 2015-10-05T05:02:30.862+0100 [conn1423332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:30.862+0100 [conn1423333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:32.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6585703b51053eb5b20 2015-10-05T05:02:33.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:36.068+0100 [conn1422914] end connection 172.28.0.164:52250 (399 connections now open) 2015-10-05T05:02:36.069+0100 [mongosMain] connection accepted from 172.28.0.164:53665 #1423334 (400 connections now open) 2015-10-05T05:02:36.070+0100 [conn1423334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:36.536+0100 [conn1422934] end connection 172.28.0.164:52339 (399 connections now open) 2015-10-05T05:02:36.537+0100 [mongosMain] connection accepted from 172.28.0.164:53669 #1423335 (400 connections now open) 2015-10-05T05:02:36.538+0100 [conn1423335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:36.740+0100 [conn1422920] end connection 172.28.0.163:59022 (399 connections now open) 2015-10-05T05:02:36.742+0100 [mongosMain] connection accepted from 172.28.0.163:60601 #1423336 (400 connections now open) 2015-10-05T05:02:36.743+0100 [conn1423336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:37.380+0100 [conn1422935] end connection 172.28.0.163:59073 (399 connections now open) 2015-10-05T05:02:37.381+0100 [mongosMain] connection accepted from 172.28.0.163:60603 #1423337 (400 connections now open) 2015-10-05T05:02:37.382+0100 [conn1423337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:39.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f65f5703b51053eb5bc2 2015-10-05T05:02:39.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:40.072+0100 [mongosMain] connection accepted from 127.0.0.1:60605 #1423338 (401 connections now open) 2015-10-05T05:02:40.075+0100 [conn1423338] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:40.079+0100 [conn1423338] end connection 127.0.0.1:60605 (400 connections now open) 2015-10-05T05:02:40.810+0100 [conn1422930] end connection 172.28.0.164:52326 (399 connections now open) 2015-10-05T05:02:40.811+0100 [conn1422923] end connection 172.28.0.164:52303 (398 connections now open) 2015-10-05T05:02:40.811+0100 [mongosMain] connection accepted from 172.28.0.164:53676 #1423339 (399 connections now open) 2015-10-05T05:02:40.812+0100 [mongosMain] connection accepted from 172.28.0.164:53677 #1423340 (400 connections now open) 2015-10-05T05:02:40.813+0100 [conn1423339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:40.813+0100 [conn1423340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:40.875+0100 [conn1422908] end connection 172.28.0.163:58944 (399 connections now open) 2015-10-05T05:02:40.875+0100 [conn1422932] end connection 172.28.0.163:59069 (398 connections now open) 2015-10-05T05:02:40.876+0100 [mongosMain] connection accepted from 172.28.0.163:60607 #1423341 (399 connections now open) 2015-10-05T05:02:40.877+0100 [mongosMain] connection accepted from 172.28.0.163:60608 #1423342 (400 connections now open) 2015-10-05T05:02:40.877+0100 [conn1423341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:40.878+0100 [conn1423342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:45.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6655703b51053eb5c6d 2015-10-05T05:02:45.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:46.069+0100 [conn1422886] end connection 172.28.0.164:52186 (399 connections now open) 2015-10-05T05:02:46.070+0100 [mongosMain] connection accepted from 172.28.0.164:53684 #1423343 (400 connections now open) 2015-10-05T05:02:46.073+0100 [conn1423343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:46.536+0100 [conn1422942] end connection 172.28.0.164:52356 (399 connections now open) 2015-10-05T05:02:46.538+0100 [mongosMain] connection accepted from 172.28.0.164:53686 #1423344 (400 connections now open) 2015-10-05T05:02:46.539+0100 [conn1423344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:46.741+0100 [conn1422903] end connection 172.28.0.163:58939 (399 connections now open) 2015-10-05T05:02:46.742+0100 [mongosMain] connection accepted from 172.28.0.163:60617 #1423345 (400 connections now open) 2015-10-05T05:02:46.744+0100 [conn1423345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:47.396+0100 [conn1422943] end connection 172.28.0.163:59081 (399 connections now open) 2015-10-05T05:02:47.397+0100 [mongosMain] connection accepted from 172.28.0.163:60621 #1423346 (400 connections now open) 2015-10-05T05:02:47.398+0100 [conn1423346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:50.827+0100 [conn1422929] end connection 172.28.0.164:52325 (399 connections now open) 2015-10-05T05:02:50.827+0100 [conn1422913] end connection 172.28.0.164:52243 (398 connections now open) 2015-10-05T05:02:50.828+0100 [mongosMain] connection accepted from 172.28.0.164:53692 #1423347 (399 connections now open) 2015-10-05T05:02:50.828+0100 [mongosMain] connection accepted from 172.28.0.164:53693 #1423348 (400 connections now open) 2015-10-05T05:02:50.830+0100 [conn1423347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:50.830+0100 [conn1423348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:50.875+0100 [conn1422817] end connection 172.28.0.163:58517 (399 connections now open) 2015-10-05T05:02:50.876+0100 [mongosMain] connection accepted from 172.28.0.163:60625 #1423349 (400 connections now open) 2015-10-05T05:02:50.877+0100 [conn1423349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:51.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f66b5703b51053eb5d1f 2015-10-05T05:02:52.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:02:56.082+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:02:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:02:56.084+0100 [conn1422926] end connection 172.28.0.164:52318 (399 connections now open) 2015-10-05T05:02:56.085+0100 [mongosMain] connection accepted from 172.28.0.164:53699 #1423350 (400 connections now open) 2015-10-05T05:02:56.087+0100 [conn1423350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:56.554+0100 [conn1422950] end connection 172.28.0.164:52374 (399 connections now open) 2015-10-05T05:02:56.556+0100 [mongosMain] connection accepted from 172.28.0.164:53701 #1423351 (400 connections now open) 2015-10-05T05:02:56.559+0100 [conn1423351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:57.411+0100 [conn1422952] end connection 172.28.0.163:59098 (399 connections now open) 2015-10-05T05:02:57.412+0100 [mongosMain] connection accepted from 172.28.0.163:60636 #1423352 (400 connections now open) 2015-10-05T05:02:57.414+0100 [conn1423352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:02:58.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6725703b51053eb5dd4 2015-10-05T05:02:58.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:00.826+0100 [conn1422898] end connection 172.28.0.164:52209 (399 connections now open) 2015-10-05T05:03:00.827+0100 [conn1422938] end connection 172.28.0.164:52345 (398 connections now open) 2015-10-05T05:03:00.828+0100 [mongosMain] connection accepted from 172.28.0.164:53708 #1423353 (399 connections now open) 2015-10-05T05:03:00.828+0100 [mongosMain] connection accepted from 172.28.0.164:53709 #1423354 (400 connections now open) 2015-10-05T05:03:00.829+0100 [conn1423353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:00.830+0100 [conn1423354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:00.890+0100 [conn1422931] end connection 172.28.0.163:59068 (399 connections now open) 2015-10-05T05:03:00.892+0100 [mongosMain] connection accepted from 172.28.0.163:60645 #1423355 (400 connections now open) 2015-10-05T05:03:00.893+0100 [conn1423355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:04.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6785703b51053eb5e86 2015-10-05T05:03:04.818+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:06.099+0100 [conn1422918] end connection 172.28.0.164:52283 (399 connections now open) 2015-10-05T05:03:06.100+0100 [mongosMain] connection accepted from 172.28.0.164:53711 #1423356 (400 connections now open) 2015-10-05T05:03:06.102+0100 [conn1423356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:06.552+0100 [conn1422958] end connection 172.28.0.164:52390 (399 connections now open) 2015-10-05T05:03:06.553+0100 [mongosMain] connection accepted from 172.28.0.164:53713 #1423357 (400 connections now open) 2015-10-05T05:03:06.554+0100 [conn1423357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:07.413+0100 [conn1422960] end connection 172.28.0.163:59117 (399 connections now open) 2015-10-05T05:03:07.414+0100 [mongosMain] connection accepted from 172.28.0.163:60654 #1423358 (400 connections now open) 2015-10-05T05:03:07.415+0100 [conn1423358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:10.842+0100 [conn1422945] end connection 172.28.0.164:52364 (399 connections now open) 2015-10-05T05:03:10.842+0100 [conn1422937] end connection 172.28.0.164:52344 (399 connections now open) 2015-10-05T05:03:10.844+0100 [mongosMain] connection accepted from 172.28.0.164:53714 #1423359 (399 connections now open) 2015-10-05T05:03:10.844+0100 [mongosMain] connection accepted from 172.28.0.164:53715 #1423360 (400 connections now open) 2015-10-05T05:03:10.846+0100 [conn1423359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:10.846+0100 [conn1423360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:10.892+0100 [conn1422939] end connection 172.28.0.163:59076 (399 connections now open) 2015-10-05T05:03:10.892+0100 [conn1422925] end connection 172.28.0.163:59048 (398 connections now open) 2015-10-05T05:03:10.893+0100 [mongosMain] connection accepted from 172.28.0.163:60659 #1423361 (399 connections now open) 2015-10-05T05:03:10.894+0100 [mongosMain] connection accepted from 172.28.0.163:60660 #1423362 (400 connections now open) 2015-10-05T05:03:10.894+0100 [conn1423361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:10.895+0100 [conn1423362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:11.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f67e5703b51053eb5f11 2015-10-05T05:03:11.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:16.115+0100 [conn1422933] end connection 172.28.0.164:52337 (399 connections now open) 2015-10-05T05:03:16.116+0100 [mongosMain] connection accepted from 172.28.0.164:53721 #1423363 (400 connections now open) 2015-10-05T05:03:16.118+0100 [conn1423363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:16.568+0100 [conn1422965] end connection 172.28.0.164:52426 (399 connections now open) 2015-10-05T05:03:16.569+0100 [mongosMain] connection accepted from 172.28.0.164:53724 #1423364 (400 connections now open) 2015-10-05T05:03:16.570+0100 [conn1423364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:16.772+0100 [conn1422951] end connection 172.28.0.163:59095 (399 connections now open) 2015-10-05T05:03:16.773+0100 [mongosMain] connection accepted from 172.28.0.163:60667 #1423365 (400 connections now open) 2015-10-05T05:03:16.774+0100 [conn1423365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:17.427+0100 [conn1422967] end connection 172.28.0.163:59172 (399 connections now open) 2015-10-05T05:03:17.429+0100 [mongosMain] connection accepted from 172.28.0.163:60670 #1423366 (400 connections now open) 2015-10-05T05:03:17.430+0100 [conn1423366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:17.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6855703b51053eb5faf 2015-10-05T05:03:17.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:20.857+0100 [conn1422961] end connection 172.28.0.164:52393 (399 connections now open) 2015-10-05T05:03:20.858+0100 [mongosMain] connection accepted from 172.28.0.164:53730 #1423367 (400 connections now open) 2015-10-05T05:03:20.859+0100 [conn1423367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:20.906+0100 [conn1422901] end connection 172.28.0.163:58936 (399 connections now open) 2015-10-05T05:03:20.906+0100 [conn1422940] end connection 172.28.0.163:59077 (399 connections now open) 2015-10-05T05:03:20.907+0100 [mongosMain] connection accepted from 172.28.0.163:60675 #1423368 (399 connections now open) 2015-10-05T05:03:20.907+0100 [mongosMain] connection accepted from 172.28.0.163:60676 #1423369 (400 connections now open) 2015-10-05T05:03:20.908+0100 [conn1423368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:20.908+0100 [conn1423369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:23.812+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f68b5703b51053eb6042 2015-10-05T05:03:23.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:26.130+0100 [conn1422941] end connection 172.28.0.164:52354 (399 connections now open) 2015-10-05T05:03:26.131+0100 [mongosMain] connection accepted from 172.28.0.164:53738 #1423370 (400 connections now open) 2015-10-05T05:03:26.132+0100 [conn1423370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:26.267+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:03:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:03:26.583+0100 [conn1422973] end connection 172.28.0.164:52452 (399 connections now open) 2015-10-05T05:03:26.584+0100 [mongosMain] connection accepted from 172.28.0.164:53740 #1423371 (400 connections now open) 2015-10-05T05:03:26.586+0100 [conn1423371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:27.428+0100 [conn1422975] end connection 172.28.0.163:59206 (399 connections now open) 2015-10-05T05:03:27.429+0100 [mongosMain] connection accepted from 172.28.0.163:60682 #1423372 (400 connections now open) 2015-10-05T05:03:27.431+0100 [conn1423372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:29.128+0100 [mongosMain] connection accepted from 127.0.0.1:60685 #1423373 (401 connections now open) 2015-10-05T05:03:29.130+0100 [conn1423373] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:29.135+0100 [conn1423373] end connection 127.0.0.1:60685 (400 connections now open) 2015-10-05T05:03:30.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6915703b51053eb60d2 2015-10-05T05:03:30.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:30.858+0100 [conn1422969] end connection 172.28.0.164:52440 (399 connections now open) 2015-10-05T05:03:30.859+0100 [mongosMain] connection accepted from 172.28.0.164:53747 #1423374 (400 connections now open) 2015-10-05T05:03:30.861+0100 [conn1423374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:30.922+0100 [conn1422947] end connection 172.28.0.163:59084 (399 connections now open) 2015-10-05T05:03:30.923+0100 [mongosMain] connection accepted from 172.28.0.163:60686 #1423375 (400 connections now open) 2015-10-05T05:03:30.924+0100 [conn1423375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:36.146+0100 [conn1422949] end connection 172.28.0.164:52372 (399 connections now open) 2015-10-05T05:03:36.147+0100 [mongosMain] connection accepted from 172.28.0.164:53754 #1423376 (400 connections now open) 2015-10-05T05:03:36.149+0100 [conn1423376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:36.599+0100 [conn1422981] end connection 172.28.0.164:52470 (399 connections now open) 2015-10-05T05:03:36.600+0100 [mongosMain] connection accepted from 172.28.0.164:53758 #1423377 (400 connections now open) 2015-10-05T05:03:36.602+0100 [conn1423377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:36.788+0100 [conn1422959] end connection 172.28.0.163:59115 (399 connections now open) 2015-10-05T05:03:36.789+0100 [mongosMain] connection accepted from 172.28.0.163:60690 #1423378 (400 connections now open) 2015-10-05T05:03:36.790+0100 [conn1423378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:37.443+0100 [conn1422983] end connection 172.28.0.163:59214 (399 connections now open) 2015-10-05T05:03:37.444+0100 [mongosMain] connection accepted from 172.28.0.163:60691 #1423379 (400 connections now open) 2015-10-05T05:03:37.445+0100 [conn1423379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:39.797+0100 [mongosMain] connection accepted from 127.0.0.1:60695 #1423380 (401 connections now open) 2015-10-05T05:03:39.800+0100 [conn1423380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:39.822+0100 [conn1423380] end connection 127.0.0.1:60695 (400 connections now open) 2015-10-05T05:03:40.873+0100 [conn1422954] end connection 172.28.0.164:52381 (399 connections now open) 2015-10-05T05:03:40.875+0100 [conn1422953] end connection 172.28.0.164:52380 (398 connections now open) 2015-10-05T05:03:40.875+0100 [mongosMain] connection accepted from 172.28.0.164:53768 #1423381 (400 connections now open) 2015-10-05T05:03:40.876+0100 [mongosMain] connection accepted from 172.28.0.164:53769 #1423382 (400 connections now open) 2015-10-05T05:03:40.877+0100 [conn1423381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:40.878+0100 [conn1423382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:40.925+0100 [conn1422955] end connection 172.28.0.163:59103 (399 connections now open) 2015-10-05T05:03:40.926+0100 [mongosMain] connection accepted from 172.28.0.163:60698 #1423383 (400 connections now open) 2015-10-05T05:03:40.927+0100 [conn1423383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:46.147+0100 [conn1422957] end connection 172.28.0.164:52388 (399 connections now open) 2015-10-05T05:03:46.148+0100 [mongosMain] connection accepted from 172.28.0.164:53776 #1423384 (400 connections now open) 2015-10-05T05:03:46.150+0100 [conn1423384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:46.614+0100 [conn1422989] end connection 172.28.0.164:52488 (399 connections now open) 2015-10-05T05:03:46.616+0100 [mongosMain] connection accepted from 172.28.0.164:53778 #1423385 (400 connections now open) 2015-10-05T05:03:46.617+0100 [conn1423385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:46.804+0100 [conn1422916] end connection 172.28.0.163:58969 (399 connections now open) 2015-10-05T05:03:46.805+0100 [mongosMain] connection accepted from 172.28.0.163:60705 #1423386 (400 connections now open) 2015-10-05T05:03:46.806+0100 [conn1423386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:47.443+0100 [conn1422991] end connection 172.28.0.163:59223 (399 connections now open) 2015-10-05T05:03:47.444+0100 [mongosMain] connection accepted from 172.28.0.163:60707 #1423387 (400 connections now open) 2015-10-05T05:03:47.446+0100 [conn1423387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:48.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6a45703b51053eb623b 2015-10-05T05:03:48.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:03:50.874+0100 [conn1422976] end connection 172.28.0.164:52457 (399 connections now open) 2015-10-05T05:03:50.874+0100 [conn1422968] end connection 172.28.0.164:52439 (398 connections now open) 2015-10-05T05:03:50.875+0100 [mongosMain] connection accepted from 172.28.0.164:53787 #1423388 (399 connections now open) 2015-10-05T05:03:50.875+0100 [mongosMain] connection accepted from 172.28.0.164:53788 #1423389 (400 connections now open) 2015-10-05T05:03:50.877+0100 [conn1423388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:50.877+0100 [conn1423389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:50.937+0100 [conn1422971] end connection 172.28.0.163:59194 (399 connections now open) 2015-10-05T05:03:50.938+0100 [mongosMain] connection accepted from 172.28.0.163:60714 #1423390 (400 connections now open) 2015-10-05T05:03:50.940+0100 [conn1423390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:56.148+0100 [conn1422980] end connection 172.28.0.164:52468 (399 connections now open) 2015-10-05T05:03:56.149+0100 [mongosMain] connection accepted from 172.28.0.164:53796 #1423391 (400 connections now open) 2015-10-05T05:03:56.151+0100 [conn1423391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:56.557+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:03:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:03:56.616+0100 [conn1422997] end connection 172.28.0.164:52509 (399 connections now open) 2015-10-05T05:03:56.617+0100 [mongosMain] connection accepted from 172.28.0.164:53798 #1423392 (400 connections now open) 2015-10-05T05:03:56.618+0100 [conn1423392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:56.805+0100 [conn1422966] end connection 172.28.0.163:59167 (399 connections now open) 2015-10-05T05:03:56.805+0100 [mongosMain] connection accepted from 172.28.0.163:60721 #1423393 (400 connections now open) 2015-10-05T05:03:56.807+0100 [conn1423393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:03:57.459+0100 [conn1422999] end connection 172.28.0.163:59235 (399 connections now open) 2015-10-05T05:03:57.461+0100 [mongosMain] connection accepted from 172.28.0.163:60723 #1423394 (400 connections now open) 2015-10-05T05:03:57.462+0100 [conn1423394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:00.889+0100 [conn1422994] end connection 172.28.0.164:52498 (399 connections now open) 2015-10-05T05:04:00.890+0100 [mongosMain] connection accepted from 172.28.0.164:53808 #1423395 (400 connections now open) 2015-10-05T05:04:00.893+0100 [conn1423395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:00.943+0100 [conn1422979] end connection 172.28.0.163:59209 (399 connections now open) 2015-10-05T05:04:00.944+0100 [mongosMain] connection accepted from 172.28.0.163:60734 #1423396 (400 connections now open) 2015-10-05T05:04:00.945+0100 [conn1423396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:06.163+0100 [conn1422972] end connection 172.28.0.164:52450 (399 connections now open) 2015-10-05T05:04:06.164+0100 [mongosMain] connection accepted from 172.28.0.164:53810 #1423397 (400 connections now open) 2015-10-05T05:04:06.165+0100 [conn1423397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:06.631+0100 [conn1423004] end connection 172.28.0.164:52527 (399 connections now open) 2015-10-05T05:04:06.632+0100 [mongosMain] connection accepted from 172.28.0.164:53812 #1423398 (400 connections now open) 2015-10-05T05:04:06.634+0100 [conn1423398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:06.819+0100 [conn1422974] end connection 172.28.0.163:59203 (399 connections now open) 2015-10-05T05:04:06.820+0100 [mongosMain] connection accepted from 172.28.0.163:60742 #1423399 (400 connections now open) 2015-10-05T05:04:06.822+0100 [conn1423399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:06.909+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:04:06.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:04:07.474+0100 [conn1423006] end connection 172.28.0.163:59277 (399 connections now open) 2015-10-05T05:04:07.475+0100 [mongosMain] connection accepted from 172.28.0.163:60744 #1423400 (400 connections now open) 2015-10-05T05:04:07.476+0100 [conn1423400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:10.905+0100 [conn1422946] end connection 172.28.0.164:52365 (399 connections now open) 2015-10-05T05:04:10.905+0100 [conn1423008] end connection 172.28.0.164:52531 (398 connections now open) 2015-10-05T05:04:10.906+0100 [mongosMain] connection accepted from 172.28.0.164:53816 #1423401 (399 connections now open) 2015-10-05T05:04:10.907+0100 [mongosMain] connection accepted from 172.28.0.164:53817 #1423402 (400 connections now open) 2015-10-05T05:04:10.908+0100 [conn1423401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:10.908+0100 [conn1423402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:10.954+0100 [conn1422995] end connection 172.28.0.163:59226 (399 connections now open) 2015-10-05T05:04:10.955+0100 [mongosMain] connection accepted from 172.28.0.163:60749 #1423403 (400 connections now open) 2015-10-05T05:04:10.956+0100 [conn1423403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:16.178+0100 [conn1422988] end connection 172.28.0.164:52486 (399 connections now open) 2015-10-05T05:04:16.180+0100 [mongosMain] connection accepted from 172.28.0.164:53821 #1423404 (400 connections now open) 2015-10-05T05:04:16.182+0100 [conn1423404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:16.646+0100 [conn1423010] end connection 172.28.0.164:52563 (399 connections now open) 2015-10-05T05:04:16.647+0100 [mongosMain] connection accepted from 172.28.0.164:53823 #1423405 (400 connections now open) 2015-10-05T05:04:16.649+0100 [conn1423405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:16.820+0100 [conn1422990] end connection 172.28.0.163:59221 (399 connections now open) 2015-10-05T05:04:16.822+0100 [mongosMain] connection accepted from 172.28.0.163:60760 #1423406 (400 connections now open) 2015-10-05T05:04:16.823+0100 [conn1423406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:17.475+0100 [conn1423012] end connection 172.28.0.163:59364 (399 connections now open) 2015-10-05T05:04:17.476+0100 [mongosMain] connection accepted from 172.28.0.163:60762 #1423407 (400 connections now open) 2015-10-05T05:04:17.477+0100 [conn1423407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:19.057+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:04:19.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:04:20.920+0100 [conn1422993] end connection 172.28.0.164:52497 (399 connections now open) 2015-10-05T05:04:20.921+0100 [conn1422985] end connection 172.28.0.164:52475 (398 connections now open) 2015-10-05T05:04:20.922+0100 [mongosMain] connection accepted from 172.28.0.164:53831 #1423408 (399 connections now open) 2015-10-05T05:04:20.922+0100 [mongosMain] connection accepted from 172.28.0.164:53832 #1423409 (400 connections now open) 2015-10-05T05:04:20.938+0100 [conn1423408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:20.938+0100 [conn1423409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:20.956+0100 [conn1422987] end connection 172.28.0.163:59217 (399 connections now open) 2015-10-05T05:04:20.956+0100 [conn1422924] end connection 172.28.0.163:59047 (399 connections now open) 2015-10-05T05:04:20.957+0100 [mongosMain] connection accepted from 172.28.0.163:60765 #1423410 (399 connections now open) 2015-10-05T05:04:20.957+0100 [mongosMain] connection accepted from 172.28.0.163:60766 #1423411 (400 connections now open) 2015-10-05T05:04:20.958+0100 [conn1423410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:20.958+0100 [conn1423411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:25.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6c95703b51053eb6538 2015-10-05T05:04:25.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:04:26.178+0100 [conn1422846] end connection 172.28.0.164:51965 (399 connections now open) 2015-10-05T05:04:26.179+0100 [mongosMain] connection accepted from 172.28.0.164:53840 #1423412 (400 connections now open) 2015-10-05T05:04:26.181+0100 [conn1423412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:26.646+0100 [conn1423017] end connection 172.28.0.164:52608 (399 connections now open) 2015-10-05T05:04:26.647+0100 [mongosMain] connection accepted from 172.28.0.164:53842 #1423413 (400 connections now open) 2015-10-05T05:04:26.649+0100 [conn1423413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:26.835+0100 [conn1422982] end connection 172.28.0.163:59212 (399 connections now open) 2015-10-05T05:04:26.836+0100 [mongosMain] connection accepted from 172.28.0.163:60769 #1423414 (400 connections now open) 2015-10-05T05:04:26.837+0100 [conn1423414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:26.841+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:04:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:04:27.490+0100 [conn1423019] end connection 172.28.0.163:59433 (399 connections now open) 2015-10-05T05:04:27.491+0100 [mongosMain] connection accepted from 172.28.0.163:60771 #1423415 (400 connections now open) 2015-10-05T05:04:27.492+0100 [conn1423415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:28.738+0100 [mongosMain] connection accepted from 127.0.0.1:60773 #1423416 (401 connections now open) 2015-10-05T05:04:28.741+0100 [conn1423416] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:28.747+0100 [conn1423416] end connection 127.0.0.1:60773 (400 connections now open) 2015-10-05T05:04:30.936+0100 [conn1422986] end connection 172.28.0.164:52476 (399 connections now open) 2015-10-05T05:04:30.936+0100 [conn1423000] end connection 172.28.0.164:52515 (398 connections now open) 2015-10-05T05:04:30.937+0100 [mongosMain] connection accepted from 172.28.0.164:53851 #1423417 (399 connections now open) 2015-10-05T05:04:30.937+0100 [mongosMain] connection accepted from 172.28.0.164:53852 #1423418 (400 connections now open) 2015-10-05T05:04:30.939+0100 [conn1423418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:30.939+0100 [conn1423417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:30.969+0100 [conn1422956] end connection 172.28.0.163:59104 (399 connections now open) 2015-10-05T05:04:30.969+0100 [conn1423002] end connection 172.28.0.163:59241 (398 connections now open) 2015-10-05T05:04:30.970+0100 [mongosMain] connection accepted from 172.28.0.163:60777 #1423419 (399 connections now open) 2015-10-05T05:04:30.970+0100 [mongosMain] connection accepted from 172.28.0.163:60778 #1423420 (400 connections now open) 2015-10-05T05:04:30.971+0100 [conn1423419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:30.971+0100 [conn1423420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:36.194+0100 [conn1422996] end connection 172.28.0.164:52506 (399 connections now open) 2015-10-05T05:04:36.195+0100 [mongosMain] connection accepted from 172.28.0.164:53862 #1423421 (400 connections now open) 2015-10-05T05:04:36.196+0100 [conn1423421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:36.662+0100 [conn1423024] end connection 172.28.0.164:52626 (399 connections now open) 2015-10-05T05:04:36.663+0100 [mongosMain] connection accepted from 172.28.0.164:53866 #1423422 (400 connections now open) 2015-10-05T05:04:36.664+0100 [conn1423422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:36.851+0100 [conn1423011] end connection 172.28.0.163:59356 (399 connections now open) 2015-10-05T05:04:36.852+0100 [mongosMain] connection accepted from 172.28.0.163:60781 #1423423 (400 connections now open) 2015-10-05T05:04:36.853+0100 [conn1423423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:37.491+0100 [conn1423026] end connection 172.28.0.163:59468 (399 connections now open) 2015-10-05T05:04:37.492+0100 [mongosMain] connection accepted from 172.28.0.163:60783 #1423424 (400 connections now open) 2015-10-05T05:04:37.493+0100 [conn1423424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:39.337+0100 [mongosMain] connection accepted from 127.0.0.1:60785 #1423425 (401 connections now open) 2015-10-05T05:04:39.340+0100 [conn1423425] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:39.345+0100 [conn1423425] end connection 127.0.0.1:60785 (400 connections now open) 2015-10-05T05:04:40.952+0100 [conn1422977] end connection 172.28.0.164:52458 (399 connections now open) 2015-10-05T05:04:40.952+0100 [conn1423021] end connection 172.28.0.164:52613 (399 connections now open) 2015-10-05T05:04:40.953+0100 [mongosMain] connection accepted from 172.28.0.164:53874 #1423426 (399 connections now open) 2015-10-05T05:04:40.954+0100 [mongosMain] connection accepted from 172.28.0.164:53875 #1423427 (400 connections now open) 2015-10-05T05:04:40.955+0100 [conn1423426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:40.955+0100 [conn1423427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:40.974+0100 [conn1423015] end connection 172.28.0.163:59407 (399 connections now open) 2015-10-05T05:04:40.974+0100 [conn1422963] end connection 172.28.0.163:59123 (398 connections now open) 2015-10-05T05:04:40.975+0100 [mongosMain] connection accepted from 172.28.0.163:60788 #1423428 (399 connections now open) 2015-10-05T05:04:40.976+0100 [mongosMain] connection accepted from 172.28.0.163:60789 #1423429 (400 connections now open) 2015-10-05T05:04:40.976+0100 [conn1423428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:40.977+0100 [conn1423429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:43.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6db5703b51053eb6604 2015-10-05T05:04:43.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:04:46.194+0100 [conn1422964] end connection 172.28.0.164:52419 (399 connections now open) 2015-10-05T05:04:46.195+0100 [mongosMain] connection accepted from 172.28.0.164:53882 #1423430 (400 connections now open) 2015-10-05T05:04:46.196+0100 [conn1423430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:46.662+0100 [conn1423033] end connection 172.28.0.164:52646 (399 connections now open) 2015-10-05T05:04:46.663+0100 [mongosMain] connection accepted from 172.28.0.164:53884 #1423431 (400 connections now open) 2015-10-05T05:04:46.665+0100 [conn1423431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:46.851+0100 [conn1423025] end connection 172.28.0.163:59463 (399 connections now open) 2015-10-05T05:04:46.853+0100 [mongosMain] connection accepted from 172.28.0.163:60799 #1423432 (400 connections now open) 2015-10-05T05:04:46.854+0100 [conn1423432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:47.507+0100 [conn1423035] end connection 172.28.0.163:59519 (399 connections now open) 2015-10-05T05:04:47.508+0100 [mongosMain] connection accepted from 172.28.0.163:60801 #1423433 (400 connections now open) 2015-10-05T05:04:47.508+0100 [conn1423433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:49.949+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:04:49.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:04:50.952+0100 [conn1423013] end connection 172.28.0.164:52590 (399 connections now open) 2015-10-05T05:04:50.953+0100 [conn1423014] end connection 172.28.0.164:52591 (398 connections now open) 2015-10-05T05:04:50.955+0100 [mongosMain] connection accepted from 172.28.0.164:53893 #1423434 (399 connections now open) 2015-10-05T05:04:50.955+0100 [mongosMain] connection accepted from 172.28.0.164:53894 #1423435 (400 connections now open) 2015-10-05T05:04:50.957+0100 [conn1423435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:50.957+0100 [conn1423434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:50.984+0100 [conn1423031] end connection 172.28.0.163:59495 (399 connections now open) 2015-10-05T05:04:50.985+0100 [mongosMain] connection accepted from 172.28.0.163:60809 #1423436 (400 connections now open) 2015-10-05T05:04:50.986+0100 [conn1423436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:50.992+0100 [conn1422948] end connection 172.28.0.163:59085 (399 connections now open) 2015-10-05T05:04:50.993+0100 [mongosMain] connection accepted from 172.28.0.163:60812 #1423437 (400 connections now open) 2015-10-05T05:04:50.993+0100 [conn1423437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:56.210+0100 [conn1423023] end connection 172.28.0.164:52623 (399 connections now open) 2015-10-05T05:04:56.211+0100 [mongosMain] connection accepted from 172.28.0.164:53901 #1423438 (400 connections now open) 2015-10-05T05:04:56.213+0100 [conn1423438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:56.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6e75703b51053eb6695 2015-10-05T05:04:56.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:04:56.678+0100 [conn1423041] end connection 172.28.0.164:52667 (399 connections now open) 2015-10-05T05:04:56.679+0100 [mongosMain] connection accepted from 172.28.0.164:53904 #1423439 (400 connections now open) 2015-10-05T05:04:56.681+0100 [conn1423439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:56.866+0100 [conn1423005] end connection 172.28.0.163:59274 (399 connections now open) 2015-10-05T05:04:56.868+0100 [mongosMain] connection accepted from 172.28.0.163:60819 #1423440 (400 connections now open) 2015-10-05T05:04:56.869+0100 [conn1423440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:04:57.121+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:04:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:04:57.506+0100 [conn1423043] end connection 172.28.0.163:59539 (399 connections now open) 2015-10-05T05:04:57.507+0100 [mongosMain] connection accepted from 172.28.0.163:60821 #1423441 (400 connections now open) 2015-10-05T05:04:57.508+0100 [conn1423441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:00.968+0100 [conn1423036] end connection 172.28.0.164:52654 (399 connections now open) 2015-10-05T05:05:00.969+0100 [mongosMain] connection accepted from 172.28.0.164:53919 #1423442 (400 connections now open) 2015-10-05T05:05:00.970+0100 [conn1423442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:01.000+0100 [conn1423022] end connection 172.28.0.163:59436 (399 connections now open) 2015-10-05T05:05:01.000+0100 [conn1422970] end connection 172.28.0.163:59195 (399 connections now open) 2015-10-05T05:05:01.001+0100 [mongosMain] connection accepted from 172.28.0.163:60828 #1423443 (399 connections now open) 2015-10-05T05:05:01.002+0100 [mongosMain] connection accepted from 172.28.0.163:60829 #1423444 (400 connections now open) 2015-10-05T05:05:01.002+0100 [conn1423443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:01.003+0100 [conn1423444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:06.210+0100 [conn1423003] end connection 172.28.0.164:52525 (399 connections now open) 2015-10-05T05:05:06.211+0100 [mongosMain] connection accepted from 172.28.0.164:53922 #1423445 (400 connections now open) 2015-10-05T05:05:06.213+0100 [conn1423445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:06.679+0100 [conn1423049] end connection 172.28.0.164:52686 (399 connections now open) 2015-10-05T05:05:06.680+0100 [mongosMain] connection accepted from 172.28.0.164:53924 #1423446 (400 connections now open) 2015-10-05T05:05:06.682+0100 [conn1423446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:07.256+0100 [conn1423018] end connection 172.28.0.163:59432 (399 connections now open) 2015-10-05T05:05:07.259+0100 [mongosMain] connection accepted from 172.28.0.163:60840 #1423447 (400 connections now open) 2015-10-05T05:05:07.275+0100 [conn1423447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:07.522+0100 [conn1423051] end connection 172.28.0.163:59572 (399 connections now open) 2015-10-05T05:05:07.523+0100 [mongosMain] connection accepted from 172.28.0.163:60843 #1423448 (400 connections now open) 2015-10-05T05:05:07.525+0100 [conn1423448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:08.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f6f45703b51053eb6728 2015-10-05T05:05:08.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:05:10.968+0100 [conn1423052] end connection 172.28.0.164:52690 (399 connections now open) 2015-10-05T05:05:10.969+0100 [conn1422962] end connection 172.28.0.164:52394 (398 connections now open) 2015-10-05T05:05:10.970+0100 [mongosMain] connection accepted from 172.28.0.164:53928 #1423449 (399 connections now open) 2015-10-05T05:05:10.970+0100 [mongosMain] connection accepted from 172.28.0.164:53927 #1423450 (400 connections now open) 2015-10-05T05:05:10.971+0100 [conn1423449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:10.971+0100 [conn1423450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:11.001+0100 [conn1423030] end connection 172.28.0.163:59485 (399 connections now open) 2015-10-05T05:05:11.002+0100 [conn1423039] end connection 172.28.0.163:59524 (398 connections now open) 2015-10-05T05:05:11.003+0100 [mongosMain] connection accepted from 172.28.0.163:60847 #1423451 (399 connections now open) 2015-10-05T05:05:11.004+0100 [mongosMain] connection accepted from 172.28.0.163:60848 #1423452 (400 connections now open) 2015-10-05T05:05:11.004+0100 [conn1423451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:11.005+0100 [conn1423452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:16.225+0100 [conn1423032] end connection 172.28.0.164:52644 (399 connections now open) 2015-10-05T05:05:16.226+0100 [mongosMain] connection accepted from 172.28.0.164:53931 #1423453 (400 connections now open) 2015-10-05T05:05:16.227+0100 [conn1423453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:16.694+0100 [conn1423055] end connection 172.28.0.164:52739 (399 connections now open) 2015-10-05T05:05:16.696+0100 [mongosMain] connection accepted from 172.28.0.164:53933 #1423454 (400 connections now open) 2015-10-05T05:05:16.698+0100 [conn1423454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:16.882+0100 [conn1422998] end connection 172.28.0.163:59234 (399 connections now open) 2015-10-05T05:05:16.884+0100 [mongosMain] connection accepted from 172.28.0.163:60856 #1423455 (400 connections now open) 2015-10-05T05:05:16.885+0100 [conn1423455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:17.522+0100 [conn1423057] end connection 172.28.0.163:59625 (399 connections now open) 2015-10-05T05:05:17.523+0100 [mongosMain] connection accepted from 172.28.0.163:60858 #1423456 (400 connections now open) 2015-10-05T05:05:17.524+0100 [conn1423456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:20.984+0100 [conn1423028] end connection 172.28.0.164:52635 (399 connections now open) 2015-10-05T05:05:20.985+0100 [conn1423029] end connection 172.28.0.164:52636 (398 connections now open) 2015-10-05T05:05:20.985+0100 [mongosMain] connection accepted from 172.28.0.164:53949 #1423457 (399 connections now open) 2015-10-05T05:05:20.986+0100 [mongosMain] connection accepted from 172.28.0.164:53950 #1423458 (400 connections now open) 2015-10-05T05:05:20.987+0100 [conn1423457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:20.988+0100 [conn1423458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:21.016+0100 [conn1423046] end connection 172.28.0.163:59549 (399 connections now open) 2015-10-05T05:05:21.016+0100 [conn1423047] end connection 172.28.0.163:59551 (398 connections now open) 2015-10-05T05:05:21.017+0100 [mongosMain] connection accepted from 172.28.0.163:60861 #1423459 (399 connections now open) 2015-10-05T05:05:21.018+0100 [mongosMain] connection accepted from 172.28.0.163:60862 #1423460 (400 connections now open) 2015-10-05T05:05:21.018+0100 [conn1423459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:21.019+0100 [conn1423460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:21.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7005703b51053eb6793 2015-10-05T05:05:21.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:05:26.226+0100 [conn1423016] end connection 172.28.0.164:52604 (399 connections now open) 2015-10-05T05:05:26.227+0100 [mongosMain] connection accepted from 172.28.0.164:53958 #1423461 (400 connections now open) 2015-10-05T05:05:26.228+0100 [conn1423461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:26.693+0100 [conn1423063] end connection 172.28.0.164:52792 (399 connections now open) 2015-10-05T05:05:26.695+0100 [mongosMain] connection accepted from 172.28.0.164:53960 #1423462 (400 connections now open) 2015-10-05T05:05:26.697+0100 [conn1423462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:26.882+0100 [conn1423034] end connection 172.28.0.163:59500 (399 connections now open) 2015-10-05T05:05:26.883+0100 [mongosMain] connection accepted from 172.28.0.163:60865 #1423463 (400 connections now open) 2015-10-05T05:05:26.884+0100 [conn1423463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:27.287+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:05:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:05:27.537+0100 [conn1423065] end connection 172.28.0.163:59660 (399 connections now open) 2015-10-05T05:05:27.538+0100 [mongosMain] connection accepted from 172.28.0.163:60866 #1423464 (400 connections now open) 2015-10-05T05:05:27.539+0100 [conn1423464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:28.365+0100 [mongosMain] connection accepted from 127.0.0.1:60869 #1423465 (401 connections now open) 2015-10-05T05:05:28.367+0100 [conn1423465] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:28.372+0100 [conn1423465] end connection 127.0.0.1:60869 (400 connections now open) 2015-10-05T05:05:30.983+0100 [conn1423045] end connection 172.28.0.164:52675 (399 connections now open) 2015-10-05T05:05:30.984+0100 [conn1423007] end connection 172.28.0.164:52530 (398 connections now open) 2015-10-05T05:05:30.984+0100 [mongosMain] connection accepted from 172.28.0.164:53970 #1423466 (399 connections now open) 2015-10-05T05:05:30.985+0100 [mongosMain] connection accepted from 172.28.0.164:53971 #1423467 (400 connections now open) 2015-10-05T05:05:30.986+0100 [conn1423466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:30.986+0100 [conn1423467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:31.019+0100 [conn1423060] end connection 172.28.0.163:59649 (399 connections now open) 2015-10-05T05:05:31.019+0100 [conn1423053] end connection 172.28.0.163:59578 (399 connections now open) 2015-10-05T05:05:31.020+0100 [mongosMain] connection accepted from 172.28.0.163:60873 #1423468 (399 connections now open) 2015-10-05T05:05:31.020+0100 [mongosMain] connection accepted from 172.28.0.163:60874 #1423469 (400 connections now open) 2015-10-05T05:05:31.021+0100 [conn1423468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:31.021+0100 [conn1423469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:33.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f70d5703b51053eb67f6 2015-10-05T05:05:33.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:05:36.241+0100 [conn1423054] end connection 172.28.0.164:52732 (399 connections now open) 2015-10-05T05:05:36.242+0100 [mongosMain] connection accepted from 172.28.0.164:53979 #1423470 (400 connections now open) 2015-10-05T05:05:36.244+0100 [conn1423470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:36.709+0100 [conn1423071] end connection 172.28.0.164:52813 (399 connections now open) 2015-10-05T05:05:36.710+0100 [mongosMain] connection accepted from 172.28.0.164:53984 #1423471 (400 connections now open) 2015-10-05T05:05:36.712+0100 [conn1423471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:36.898+0100 [conn1423050] end connection 172.28.0.163:59570 (399 connections now open) 2015-10-05T05:05:36.900+0100 [mongosMain] connection accepted from 172.28.0.163:60879 #1423472 (400 connections now open) 2015-10-05T05:05:36.901+0100 [conn1423472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:37.553+0100 [conn1423073] end connection 172.28.0.163:59670 (399 connections now open) 2015-10-05T05:05:37.554+0100 [mongosMain] connection accepted from 172.28.0.163:60881 #1423473 (400 connections now open) 2015-10-05T05:05:37.555+0100 [conn1423473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:39.302+0100 [mongosMain] connection accepted from 127.0.0.1:60885 #1423474 (401 connections now open) 2015-10-05T05:05:39.305+0100 [conn1423474] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:39.309+0100 [conn1423474] end connection 127.0.0.1:60885 (400 connections now open) 2015-10-05T05:05:40.999+0100 [conn1423058] end connection 172.28.0.164:52772 (399 connections now open) 2015-10-05T05:05:40.999+0100 [conn1423001] end connection 172.28.0.164:52516 (399 connections now open) 2015-10-05T05:05:41.000+0100 [mongosMain] connection accepted from 172.28.0.164:53991 #1423475 (399 connections now open) 2015-10-05T05:05:41.001+0100 [mongosMain] connection accepted from 172.28.0.164:53992 #1423476 (400 connections now open) 2015-10-05T05:05:41.002+0100 [conn1423475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:41.002+0100 [conn1423476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:41.033+0100 [conn1423069] end connection 172.28.0.163:59663 (399 connections now open) 2015-10-05T05:05:41.033+0100 [conn1422978] end connection 172.28.0.163:59208 (398 connections now open) 2015-10-05T05:05:41.034+0100 [mongosMain] connection accepted from 172.28.0.163:60887 #1423477 (399 connections now open) 2015-10-05T05:05:41.034+0100 [mongosMain] connection accepted from 172.28.0.163:60888 #1423478 (400 connections now open) 2015-10-05T05:05:41.035+0100 [conn1423477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:41.035+0100 [conn1423478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:46.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7195703b51053eb6857 2015-10-05T05:05:46.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:05:46.241+0100 [conn1423009] end connection 172.28.0.164:52559 (399 connections now open) 2015-10-05T05:05:46.242+0100 [mongosMain] connection accepted from 172.28.0.164:54000 #1423479 (400 connections now open) 2015-10-05T05:05:46.244+0100 [conn1423479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:46.710+0100 [conn1423080] end connection 172.28.0.164:52853 (399 connections now open) 2015-10-05T05:05:46.711+0100 [mongosMain] connection accepted from 172.28.0.164:54002 #1423480 (400 connections now open) 2015-10-05T05:05:46.712+0100 [conn1423480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:46.898+0100 [conn1423042] end connection 172.28.0.163:59537 (399 connections now open) 2015-10-05T05:05:46.899+0100 [mongosMain] connection accepted from 172.28.0.163:60896 #1423481 (400 connections now open) 2015-10-05T05:05:46.900+0100 [conn1423481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:47.553+0100 [conn1423082] end connection 172.28.0.163:59684 (399 connections now open) 2015-10-05T05:05:47.555+0100 [mongosMain] connection accepted from 172.28.0.163:60901 #1423482 (400 connections now open) 2015-10-05T05:05:47.556+0100 [conn1423482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:51.015+0100 [conn1423037] end connection 172.28.0.164:52655 (399 connections now open) 2015-10-05T05:05:51.017+0100 [conn1423066] end connection 172.28.0.164:52797 (398 connections now open) 2015-10-05T05:05:51.018+0100 [mongosMain] connection accepted from 172.28.0.164:54008 #1423483 (399 connections now open) 2015-10-05T05:05:51.018+0100 [mongosMain] connection accepted from 172.28.0.164:54009 #1423484 (400 connections now open) 2015-10-05T05:05:51.019+0100 [conn1423483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:51.019+0100 [conn1423484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:51.033+0100 [conn1423061] end connection 172.28.0.163:59650 (399 connections now open) 2015-10-05T05:05:51.034+0100 [conn1423077] end connection 172.28.0.163:59676 (398 connections now open) 2015-10-05T05:05:51.034+0100 [mongosMain] connection accepted from 172.28.0.163:60905 #1423485 (399 connections now open) 2015-10-05T05:05:51.035+0100 [mongosMain] connection accepted from 172.28.0.163:60906 #1423486 (400 connections now open) 2015-10-05T05:05:51.035+0100 [conn1423485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:51.036+0100 [conn1423486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:56.257+0100 [conn1423070] end connection 172.28.0.164:52809 (399 connections now open) 2015-10-05T05:05:56.259+0100 [mongosMain] connection accepted from 172.28.0.164:54015 #1423487 (400 connections now open) 2015-10-05T05:05:56.261+0100 [conn1423487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:56.725+0100 [conn1423088] end connection 172.28.0.164:52873 (399 connections now open) 2015-10-05T05:05:56.726+0100 [mongosMain] connection accepted from 172.28.0.164:54017 #1423488 (400 connections now open) 2015-10-05T05:05:56.728+0100 [conn1423488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:56.914+0100 [conn1423072] end connection 172.28.0.163:59667 (399 connections now open) 2015-10-05T05:05:56.916+0100 [mongosMain] connection accepted from 172.28.0.163:60914 #1423489 (400 connections now open) 2015-10-05T05:05:56.917+0100 [conn1423489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:57.569+0100 [conn1423090] end connection 172.28.0.163:59701 (399 connections now open) 2015-10-05T05:05:57.570+0100 [mongosMain] connection accepted from 172.28.0.163:60916 #1423490 (400 connections now open) 2015-10-05T05:05:57.571+0100 [conn1423490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:05:57.611+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:05:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:05:58.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7265703b51053eb68a6 2015-10-05T05:05:58.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:01.030+0100 [conn1423083] end connection 172.28.0.164:52863 (399 connections now open) 2015-10-05T05:06:01.030+0100 [conn1423020] end connection 172.28.0.164:52611 (399 connections now open) 2015-10-05T05:06:01.031+0100 [mongosMain] connection accepted from 172.28.0.164:54022 #1423491 (399 connections now open) 2015-10-05T05:06:01.032+0100 [mongosMain] connection accepted from 172.28.0.164:54023 #1423492 (400 connections now open) 2015-10-05T05:06:01.033+0100 [conn1423491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:01.033+0100 [conn1423492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:01.047+0100 [conn1423068] end connection 172.28.0.163:59662 (399 connections now open) 2015-10-05T05:06:01.048+0100 [mongosMain] connection accepted from 172.28.0.163:60925 #1423493 (400 connections now open) 2015-10-05T05:06:01.049+0100 [conn1423493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:04.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f72c5703b51053eb68e1 2015-10-05T05:06:04.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:06.726+0100 [conn1423096] end connection 172.28.0.164:52889 (399 connections now open) 2015-10-05T05:06:06.727+0100 [mongosMain] connection accepted from 172.28.0.164:54027 #1423494 (400 connections now open) 2015-10-05T05:06:06.728+0100 [conn1423494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:06.929+0100 [conn1423056] end connection 172.28.0.163:59621 (399 connections now open) 2015-10-05T05:06:06.931+0100 [mongosMain] connection accepted from 172.28.0.163:60933 #1423495 (400 connections now open) 2015-10-05T05:06:06.931+0100 [conn1423495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:07.569+0100 [conn1423098] end connection 172.28.0.163:59720 (399 connections now open) 2015-10-05T05:06:07.570+0100 [mongosMain] connection accepted from 172.28.0.163:60936 #1423496 (400 connections now open) 2015-10-05T05:06:07.571+0100 [conn1423496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:11.046+0100 [conn1423075] end connection 172.28.0.164:52819 (399 connections now open) 2015-10-05T05:06:11.046+0100 [conn1423067] end connection 172.28.0.164:52798 (398 connections now open) 2015-10-05T05:06:11.048+0100 [mongosMain] connection accepted from 172.28.0.164:54031 #1423497 (399 connections now open) 2015-10-05T05:06:11.049+0100 [mongosMain] connection accepted from 172.28.0.164:54032 #1423498 (400 connections now open) 2015-10-05T05:06:11.051+0100 [conn1423498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:11.051+0100 [conn1423497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:11.063+0100 [conn1423093] end connection 172.28.0.163:59707 (399 connections now open) 2015-10-05T05:06:11.063+0100 [conn1423094] end connection 172.28.0.163:59708 (398 connections now open) 2015-10-05T05:06:11.064+0100 [mongosMain] connection accepted from 172.28.0.163:60940 #1423499 (399 connections now open) 2015-10-05T05:06:11.065+0100 [mongosMain] connection accepted from 172.28.0.163:60941 #1423500 (400 connections now open) 2015-10-05T05:06:11.066+0100 [conn1423499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:11.066+0100 [conn1423500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:16.740+0100 [conn1423103] end connection 172.28.0.164:52928 (399 connections now open) 2015-10-05T05:06:16.742+0100 [mongosMain] connection accepted from 172.28.0.164:54037 #1423501 (400 connections now open) 2015-10-05T05:06:16.743+0100 [conn1423501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:16.930+0100 [conn1423064] end connection 172.28.0.163:59657 (399 connections now open) 2015-10-05T05:06:16.931+0100 [mongosMain] connection accepted from 172.28.0.163:60950 #1423502 (400 connections now open) 2015-10-05T05:06:16.932+0100 [conn1423502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:17.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7385703b51053eb6945 2015-10-05T05:06:17.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:17.585+0100 [conn1423105] end connection 172.28.0.163:59768 (399 connections now open) 2015-10-05T05:06:17.586+0100 [mongosMain] connection accepted from 172.28.0.163:60952 #1423503 (400 connections now open) 2015-10-05T05:06:17.587+0100 [conn1423503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:21.062+0100 [conn1423100] end connection 172.28.0.164:52893 (399 connections now open) 2015-10-05T05:06:21.064+0100 [mongosMain] connection accepted from 172.28.0.164:54044 #1423504 (400 connections now open) 2015-10-05T05:06:21.064+0100 [conn1423099] end connection 172.28.0.164:52892 (398 connections now open) 2015-10-05T05:06:21.064+0100 [mongosMain] connection accepted from 172.28.0.164:54045 #1423505 (400 connections now open) 2015-10-05T05:06:21.065+0100 [conn1423101] end connection 172.28.0.163:59726 (399 connections now open) 2015-10-05T05:06:21.065+0100 [conn1423087] end connection 172.28.0.163:59690 (399 connections now open) 2015-10-05T05:06:21.065+0100 [conn1423504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:21.066+0100 [conn1423505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:21.066+0100 [mongosMain] connection accepted from 172.28.0.163:60956 #1423506 (399 connections now open) 2015-10-05T05:06:21.066+0100 [mongosMain] connection accepted from 172.28.0.163:60957 #1423507 (400 connections now open) 2015-10-05T05:06:21.066+0100 [conn1423506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:21.067+0100 [conn1423507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:26.273+0100 [conn1423095] end connection 172.28.0.164:52887 (399 connections now open) 2015-10-05T05:06:26.275+0100 [mongosMain] connection accepted from 172.28.0.164:54055 #1423508 (400 connections now open) 2015-10-05T05:06:26.277+0100 [conn1423508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:26.741+0100 [conn1423110] end connection 172.28.0.164:52955 (399 connections now open) 2015-10-05T05:06:26.742+0100 [mongosMain] connection accepted from 172.28.0.164:54059 #1423509 (400 connections now open) 2015-10-05T05:06:26.745+0100 [conn1423509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:26.945+0100 [conn1423081] end connection 172.28.0.163:59681 (399 connections now open) 2015-10-05T05:06:26.946+0100 [mongosMain] connection accepted from 172.28.0.163:60960 #1423510 (400 connections now open) 2015-10-05T05:06:26.947+0100 [conn1423510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:27.585+0100 [conn1423112] end connection 172.28.0.163:59831 (399 connections now open) 2015-10-05T05:06:27.586+0100 [mongosMain] connection accepted from 172.28.0.163:60961 #1423511 (400 connections now open) 2015-10-05T05:06:27.587+0100 [conn1423511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:27.861+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:06:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:06:28.737+0100 [mongosMain] connection accepted from 127.0.0.1:60963 #1423512 (401 connections now open) 2015-10-05T05:06:28.740+0100 [conn1423512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:28.747+0100 [conn1423512] end connection 127.0.0.1:60963 (400 connections now open) 2015-10-05T05:06:29.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7455703b51053eb6999 2015-10-05T05:06:29.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:31.062+0100 [conn1423044] end connection 172.28.0.164:52674 (399 connections now open) 2015-10-05T05:06:31.062+0100 [conn1423091] end connection 172.28.0.164:52878 (399 connections now open) 2015-10-05T05:06:31.063+0100 [mongosMain] connection accepted from 172.28.0.164:54066 #1423513 (399 connections now open) 2015-10-05T05:06:31.063+0100 [mongosMain] connection accepted from 172.28.0.164:54067 #1423514 (400 connections now open) 2015-10-05T05:06:31.066+0100 [conn1423514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:31.066+0100 [conn1423513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:31.079+0100 [conn1423086] end connection 172.28.0.163:59689 (399 connections now open) 2015-10-05T05:06:31.079+0100 [conn1423102] end connection 172.28.0.163:59727 (398 connections now open) 2015-10-05T05:06:31.080+0100 [mongosMain] connection accepted from 172.28.0.163:60964 #1423515 (399 connections now open) 2015-10-05T05:06:31.080+0100 [mongosMain] connection accepted from 172.28.0.163:60965 #1423516 (400 connections now open) 2015-10-05T05:06:31.081+0100 [conn1423515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:31.081+0100 [conn1423516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:36.756+0100 [conn1423117] end connection 172.28.0.164:52972 (399 connections now open) 2015-10-05T05:06:36.757+0100 [mongosMain] connection accepted from 172.28.0.164:54076 #1423517 (400 connections now open) 2015-10-05T05:06:36.759+0100 [conn1423517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:36.946+0100 [conn1423089] end connection 172.28.0.163:59699 (399 connections now open) 2015-10-05T05:06:36.947+0100 [mongosMain] connection accepted from 172.28.0.163:60968 #1423518 (400 connections now open) 2015-10-05T05:06:36.948+0100 [conn1423518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:37.600+0100 [conn1423119] end connection 172.28.0.163:59893 (399 connections now open) 2015-10-05T05:06:37.601+0100 [mongosMain] connection accepted from 172.28.0.163:60970 #1423519 (400 connections now open) 2015-10-05T05:06:37.602+0100 [conn1423519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:39.823+0100 [mongosMain] connection accepted from 127.0.0.1:60973 #1423520 (401 connections now open) 2015-10-05T05:06:39.827+0100 [conn1423520] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:39.831+0100 [conn1423520] end connection 127.0.0.1:60973 (400 connections now open) 2015-10-05T05:06:41.078+0100 [conn1423076] end connection 172.28.0.164:52820 (399 connections now open) 2015-10-05T05:06:41.079+0100 [conn1423106] end connection 172.28.0.164:52945 (398 connections now open) 2015-10-05T05:06:41.080+0100 [mongosMain] connection accepted from 172.28.0.164:54084 #1423521 (399 connections now open) 2015-10-05T05:06:41.080+0100 [mongosMain] connection accepted from 172.28.0.164:54085 #1423522 (400 connections now open) 2015-10-05T05:06:41.082+0100 [conn1423521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:41.082+0100 [conn1423109] end connection 172.28.0.163:59800 (399 connections now open) 2015-10-05T05:06:41.082+0100 [conn1423108] end connection 172.28.0.163:59799 (399 connections now open) 2015-10-05T05:06:41.082+0100 [conn1423522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:41.083+0100 [mongosMain] connection accepted from 172.28.0.163:60975 #1423523 (399 connections now open) 2015-10-05T05:06:41.083+0100 [mongosMain] connection accepted from 172.28.0.163:60976 #1423524 (400 connections now open) 2015-10-05T05:06:41.084+0100 [conn1423523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:41.084+0100 [conn1423524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:41.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7515703b51053eb6a4f 2015-10-05T05:06:42.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:46.304+0100 [conn1423125] end connection 172.28.0.164:52988 (399 connections now open) 2015-10-05T05:06:46.305+0100 [mongosMain] connection accepted from 172.28.0.164:54092 #1423525 (400 connections now open) 2015-10-05T05:06:46.307+0100 [conn1423525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:46.772+0100 [conn1423126] end connection 172.28.0.164:52990 (399 connections now open) 2015-10-05T05:06:46.773+0100 [mongosMain] connection accepted from 172.28.0.164:54095 #1423526 (400 connections now open) 2015-10-05T05:06:46.775+0100 [conn1423526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:46.961+0100 [conn1423127] end connection 172.28.0.163:59927 (399 connections now open) 2015-10-05T05:06:46.963+0100 [mongosMain] connection accepted from 172.28.0.163:60984 #1423527 (400 connections now open) 2015-10-05T05:06:46.964+0100 [conn1423527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:47.601+0100 [conn1423128] end connection 172.28.0.163:59930 (399 connections now open) 2015-10-05T05:06:47.602+0100 [mongosMain] connection accepted from 172.28.0.163:60986 #1423528 (400 connections now open) 2015-10-05T05:06:47.603+0100 [conn1423528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:51.077+0100 [conn1423114] end connection 172.28.0.164:52961 (399 connections now open) 2015-10-05T05:06:51.078+0100 [conn1423092] end connection 172.28.0.164:52879 (398 connections now open) 2015-10-05T05:06:51.078+0100 [mongosMain] connection accepted from 172.28.0.164:54100 #1423529 (399 connections now open) 2015-10-05T05:06:51.079+0100 [mongosMain] connection accepted from 172.28.0.164:54101 #1423530 (400 connections now open) 2015-10-05T05:06:51.080+0100 [conn1423529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:51.081+0100 [conn1423530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:51.095+0100 [conn1423115] end connection 172.28.0.163:59837 (399 connections now open) 2015-10-05T05:06:51.095+0100 [conn1423040] end connection 172.28.0.163:59525 (398 connections now open) 2015-10-05T05:06:51.096+0100 [mongosMain] connection accepted from 172.28.0.163:60991 #1423531 (399 connections now open) 2015-10-05T05:06:51.097+0100 [mongosMain] connection accepted from 172.28.0.163:60992 #1423532 (400 connections now open) 2015-10-05T05:06:51.097+0100 [conn1423531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:51.098+0100 [conn1423532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:54.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f75e5703b51053eb6abb 2015-10-05T05:06:54.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:06:56.320+0100 [conn1423048] end connection 172.28.0.164:52684 (399 connections now open) 2015-10-05T05:06:56.321+0100 [mongosMain] connection accepted from 172.28.0.164:54109 #1423533 (400 connections now open) 2015-10-05T05:06:56.323+0100 [conn1423533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:56.788+0100 [conn1423134] end connection 172.28.0.164:53011 (399 connections now open) 2015-10-05T05:06:56.791+0100 [mongosMain] connection accepted from 172.28.0.164:54112 #1423534 (400 connections now open) 2015-10-05T05:06:56.793+0100 [conn1423534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:56.961+0100 [conn1423111] end connection 172.28.0.163:59824 (399 connections now open) 2015-10-05T05:06:56.962+0100 [mongosMain] connection accepted from 172.28.0.163:61003 #1423535 (400 connections now open) 2015-10-05T05:06:56.963+0100 [conn1423535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:57.616+0100 [conn1423136] end connection 172.28.0.163:59946 (399 connections now open) 2015-10-05T05:06:57.618+0100 [mongosMain] connection accepted from 172.28.0.163:61005 #1423536 (400 connections now open) 2015-10-05T05:06:57.619+0100 [conn1423536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:06:58.113+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:06:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:07:01.093+0100 [conn1423122] end connection 172.28.0.164:52979 (399 connections now open) 2015-10-05T05:07:01.094+0100 [mongosMain] connection accepted from 172.28.0.164:54118 #1423537 (400 connections now open) 2015-10-05T05:07:01.096+0100 [conn1423537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:01.096+0100 [conn1423123] end connection 172.28.0.163:59923 (399 connections now open) 2015-10-05T05:07:01.096+0100 [conn1423124] end connection 172.28.0.163:59924 (399 connections now open) 2015-10-05T05:07:01.097+0100 [mongosMain] connection accepted from 172.28.0.163:61016 #1423538 (399 connections now open) 2015-10-05T05:07:01.097+0100 [mongosMain] connection accepted from 172.28.0.163:61017 #1423539 (400 connections now open) 2015-10-05T05:07:01.098+0100 [conn1423538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:01.098+0100 [conn1423539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:06.320+0100 [conn1423062] end connection 172.28.0.164:52790 (399 connections now open) 2015-10-05T05:07:06.322+0100 [mongosMain] connection accepted from 172.28.0.164:54122 #1423540 (400 connections now open) 2015-10-05T05:07:06.324+0100 [conn1423540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:06.788+0100 [conn1423141] end connection 172.28.0.164:53028 (399 connections now open) 2015-10-05T05:07:06.789+0100 [mongosMain] connection accepted from 172.28.0.164:54124 #1423541 (400 connections now open) 2015-10-05T05:07:06.792+0100 [conn1423541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:06.977+0100 [conn1423104] end connection 172.28.0.163:59765 (399 connections now open) 2015-10-05T05:07:06.979+0100 [mongosMain] connection accepted from 172.28.0.163:61029 #1423542 (400 connections now open) 2015-10-05T05:07:06.980+0100 [conn1423542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:07.632+0100 [conn1423143] end connection 172.28.0.163:59965 (399 connections now open) 2015-10-05T05:07:07.634+0100 [mongosMain] connection accepted from 172.28.0.163:61031 #1423543 (400 connections now open) 2015-10-05T05:07:07.635+0100 [conn1423543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:11.095+0100 [conn1423137] end connection 172.28.0.164:53017 (399 connections now open) 2015-10-05T05:07:11.097+0100 [mongosMain] connection accepted from 172.28.0.164:54126 #1423544 (400 connections now open) 2015-10-05T05:07:11.098+0100 [conn1423145] end connection 172.28.0.164:53032 (399 connections now open) 2015-10-05T05:07:11.099+0100 [conn1423544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:11.100+0100 [mongosMain] connection accepted from 172.28.0.164:54127 #1423545 (400 connections now open) 2015-10-05T05:07:11.103+0100 [conn1423545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:11.111+0100 [conn1423139] end connection 172.28.0.163:59953 (399 connections now open) 2015-10-05T05:07:11.112+0100 [conn1423146] end connection 172.28.0.163:59972 (398 connections now open) 2015-10-05T05:07:11.112+0100 [mongosMain] connection accepted from 172.28.0.163:61038 #1423546 (399 connections now open) 2015-10-05T05:07:11.113+0100 [mongosMain] connection accepted from 172.28.0.163:61039 #1423547 (400 connections now open) 2015-10-05T05:07:11.113+0100 [conn1423546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:11.114+0100 [conn1423547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:12.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7705703b51053eb6b68 2015-10-05T05:07:12.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:07:16.335+0100 [conn1423079] end connection 172.28.0.164:52852 (399 connections now open) 2015-10-05T05:07:16.337+0100 [mongosMain] connection accepted from 172.28.0.164:54131 #1423548 (400 connections now open) 2015-10-05T05:07:16.339+0100 [conn1423548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:16.805+0100 [conn1423149] end connection 172.28.0.164:53073 (399 connections now open) 2015-10-05T05:07:16.806+0100 [mongosMain] connection accepted from 172.28.0.164:54133 #1423549 (400 connections now open) 2015-10-05T05:07:16.808+0100 [conn1423549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:16.978+0100 [conn1423135] end connection 172.28.0.163:59944 (399 connections now open) 2015-10-05T05:07:16.980+0100 [mongosMain] connection accepted from 172.28.0.163:61048 #1423550 (400 connections now open) 2015-10-05T05:07:16.981+0100 [conn1423550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:17.633+0100 [conn1423151] end connection 172.28.0.163:60024 (399 connections now open) 2015-10-05T05:07:17.634+0100 [mongosMain] connection accepted from 172.28.0.163:61050 #1423551 (400 connections now open) 2015-10-05T05:07:17.635+0100 [conn1423551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:21.109+0100 [conn1423144] end connection 172.28.0.164:53031 (399 connections now open) 2015-10-05T05:07:21.109+0100 [conn1423059] end connection 172.28.0.164:52782 (398 connections now open) 2015-10-05T05:07:21.110+0100 [mongosMain] connection accepted from 172.28.0.164:54140 #1423552 (399 connections now open) 2015-10-05T05:07:21.111+0100 [mongosMain] connection accepted from 172.28.0.164:54139 #1423553 (400 connections now open) 2015-10-05T05:07:21.112+0100 [conn1423552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:21.113+0100 [conn1423132] end connection 172.28.0.163:59934 (399 connections now open) 2015-10-05T05:07:21.113+0100 [conn1423553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:21.114+0100 [mongosMain] connection accepted from 172.28.0.163:61053 #1423554 (400 connections now open) 2015-10-05T05:07:21.115+0100 [conn1423554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:24.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f77c5703b51053eb6bc1 2015-10-05T05:07:25.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:07:26.352+0100 [conn1423133] end connection 172.28.0.164:53008 (399 connections now open) 2015-10-05T05:07:26.353+0100 [mongosMain] connection accepted from 172.28.0.164:54153 #1423555 (400 connections now open) 2015-10-05T05:07:26.355+0100 [conn1423555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:26.821+0100 [conn1423157] end connection 172.28.0.164:53108 (399 connections now open) 2015-10-05T05:07:26.822+0100 [mongosMain] connection accepted from 172.28.0.164:54155 #1423556 (400 connections now open) 2015-10-05T05:07:26.824+0100 [conn1423556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:26.993+0100 [conn1423097] end connection 172.28.0.163:59717 (399 connections now open) 2015-10-05T05:07:26.994+0100 [mongosMain] connection accepted from 172.28.0.163:61060 #1423557 (400 connections now open) 2015-10-05T05:07:26.995+0100 [conn1423557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:27.648+0100 [conn1423159] end connection 172.28.0.163:60057 (399 connections now open) 2015-10-05T05:07:27.650+0100 [mongosMain] connection accepted from 172.28.0.163:61062 #1423558 (400 connections now open) 2015-10-05T05:07:27.651+0100 [conn1423558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:28.278+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:07:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:07:28.707+0100 [mongosMain] connection accepted from 127.0.0.1:61064 #1423559 (401 connections now open) 2015-10-05T05:07:28.709+0100 [conn1423559] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:28.715+0100 [conn1423559] end connection 127.0.0.1:61064 (400 connections now open) 2015-10-05T05:07:31.109+0100 [conn1423129] end connection 172.28.0.164:52999 (399 connections now open) 2015-10-05T05:07:31.110+0100 [conn1423107] end connection 172.28.0.164:52946 (398 connections now open) 2015-10-05T05:07:31.111+0100 [mongosMain] connection accepted from 172.28.0.164:54161 #1423560 (399 connections now open) 2015-10-05T05:07:31.111+0100 [mongosMain] connection accepted from 172.28.0.164:54160 #1423561 (400 connections now open) 2015-10-05T05:07:31.113+0100 [conn1423560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:31.113+0100 [conn1423561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:31.128+0100 [conn1423147] end connection 172.28.0.163:59973 (399 connections now open) 2015-10-05T05:07:31.129+0100 [mongosMain] connection accepted from 172.28.0.163:61066 #1423562 (400 connections now open) 2015-10-05T05:07:31.130+0100 [conn1423562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:36.351+0100 [conn1423148] end connection 172.28.0.164:53066 (399 connections now open) 2015-10-05T05:07:36.354+0100 [mongosMain] connection accepted from 172.28.0.164:54170 #1423563 (400 connections now open) 2015-10-05T05:07:36.357+0100 [conn1423563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:36.836+0100 [conn1423165] end connection 172.28.0.164:53127 (399 connections now open) 2015-10-05T05:07:36.837+0100 [mongosMain] connection accepted from 172.28.0.164:54173 #1423564 (400 connections now open) 2015-10-05T05:07:36.839+0100 [conn1423564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:37.008+0100 [conn1423150] end connection 172.28.0.163:60019 (399 connections now open) 2015-10-05T05:07:37.009+0100 [mongosMain] connection accepted from 172.28.0.163:61070 #1423565 (400 connections now open) 2015-10-05T05:07:37.010+0100 [conn1423565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:37.190+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:07:37.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:07:37.648+0100 [conn1423167] end connection 172.28.0.163:60069 (399 connections now open) 2015-10-05T05:07:37.649+0100 [mongosMain] connection accepted from 172.28.0.163:61072 #1423566 (400 connections now open) 2015-10-05T05:07:37.650+0100 [conn1423566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:39.526+0100 [mongosMain] connection accepted from 127.0.0.1:61077 #1423567 (401 connections now open) 2015-10-05T05:07:39.526+0100 [conn1423567] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:39.526+0100 [conn1423567] end connection 127.0.0.1:61077 (400 connections now open) 2015-10-05T05:07:41.148+0100 [conn1423153] end connection 172.28.0.164:53100 (399 connections now open) 2015-10-05T05:07:41.148+0100 [conn1423113] end connection 172.28.0.164:52960 (398 connections now open) 2015-10-05T05:07:41.148+0100 [mongosMain] connection accepted from 172.28.0.164:54180 #1423568 (399 connections now open) 2015-10-05T05:07:41.148+0100 [mongosMain] connection accepted from 172.28.0.164:54179 #1423569 (400 connections now open) 2015-10-05T05:07:41.148+0100 [conn1423568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:41.148+0100 [conn1423569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:41.179+0100 [conn1423155] end connection 172.28.0.163:60046 (399 connections now open) 2015-10-05T05:07:41.179+0100 [mongosMain] connection accepted from 172.28.0.163:61079 #1423570 (400 connections now open) 2015-10-05T05:07:41.179+0100 [conn1423570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:46.367+0100 [conn1423140] end connection 172.28.0.164:53025 (399 connections now open) 2015-10-05T05:07:46.368+0100 [mongosMain] connection accepted from 172.28.0.164:54188 #1423571 (400 connections now open) 2015-10-05T05:07:46.370+0100 [conn1423571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:46.851+0100 [conn1423174] end connection 172.28.0.164:53145 (399 connections now open) 2015-10-05T05:07:46.852+0100 [mongosMain] connection accepted from 172.28.0.164:54191 #1423572 (400 connections now open) 2015-10-05T05:07:46.854+0100 [conn1423572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:47.008+0100 [conn1423118] end connection 172.28.0.163:59851 (399 connections now open) 2015-10-05T05:07:47.009+0100 [mongosMain] connection accepted from 172.28.0.163:61088 #1423573 (400 connections now open) 2015-10-05T05:07:47.011+0100 [conn1423573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:47.663+0100 [conn1423176] end connection 172.28.0.163:60080 (399 connections now open) 2015-10-05T05:07:47.665+0100 [mongosMain] connection accepted from 172.28.0.163:61091 #1423574 (400 connections now open) 2015-10-05T05:07:47.666+0100 [conn1423574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:49.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7955703b51053eb6c9a 2015-10-05T05:07:49.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:07:51.144+0100 [conn1423162] end connection 172.28.0.163:60060 (399 connections now open) 2015-10-05T05:07:51.145+0100 [mongosMain] connection accepted from 172.28.0.163:61095 #1423575 (400 connections now open) 2015-10-05T05:07:51.146+0100 [conn1423575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:56.383+0100 [conn1423164] end connection 172.28.0.164:53125 (399 connections now open) 2015-10-05T05:07:56.384+0100 [mongosMain] connection accepted from 172.28.0.164:54201 #1423576 (400 connections now open) 2015-10-05T05:07:56.386+0100 [conn1423576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:56.850+0100 [conn1423183] end connection 172.28.0.164:53164 (399 connections now open) 2015-10-05T05:07:56.851+0100 [mongosMain] connection accepted from 172.28.0.164:54203 #1423577 (400 connections now open) 2015-10-05T05:07:56.852+0100 [conn1423577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:57.664+0100 [conn1423184] end connection 172.28.0.163:60098 (399 connections now open) 2015-10-05T05:07:57.665+0100 [mongosMain] connection accepted from 172.28.0.163:61107 #1423578 (400 connections now open) 2015-10-05T05:07:57.666+0100 [conn1423578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:07:58.570+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:07:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:08:01.158+0100 [conn1423171] end connection 172.28.0.163:60072 (399 connections now open) 2015-10-05T05:08:01.159+0100 [mongosMain] connection accepted from 172.28.0.163:61115 #1423579 (400 connections now open) 2015-10-05T05:08:01.160+0100 [conn1423579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:01.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7a15703b51053eb6d3e 2015-10-05T05:08:02.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:08:06.398+0100 [conn1423156] end connection 172.28.0.164:53105 (399 connections now open) 2015-10-05T05:08:06.400+0100 [mongosMain] connection accepted from 172.28.0.164:54213 #1423580 (400 connections now open) 2015-10-05T05:08:06.402+0100 [conn1423580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:06.866+0100 [conn1423189] end connection 172.28.0.164:53178 (399 connections now open) 2015-10-05T05:08:06.867+0100 [mongosMain] connection accepted from 172.28.0.164:54215 #1423581 (400 connections now open) 2015-10-05T05:08:06.869+0100 [conn1423581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:07.679+0100 [conn1423190] end connection 172.28.0.163:60116 (399 connections now open) 2015-10-05T05:08:07.680+0100 [mongosMain] connection accepted from 172.28.0.163:61125 #1423582 (400 connections now open) 2015-10-05T05:08:07.681+0100 [conn1423582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:11.158+0100 [conn1423160] end connection 172.28.0.164:53114 (399 connections now open) 2015-10-05T05:08:11.158+0100 [conn1423169] end connection 172.28.0.164:53132 (399 connections now open) 2015-10-05T05:08:11.159+0100 [mongosMain] connection accepted from 172.28.0.164:54217 #1423583 (399 connections now open) 2015-10-05T05:08:11.159+0100 [mongosMain] connection accepted from 172.28.0.164:54218 #1423584 (400 connections now open) 2015-10-05T05:08:11.161+0100 [conn1423583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:11.161+0100 [conn1423187] end connection 172.28.0.163:60105 (399 connections now open) 2015-10-05T05:08:11.162+0100 [conn1423584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:11.162+0100 [mongosMain] connection accepted from 172.28.0.163:61131 #1423585 (400 connections now open) 2015-10-05T05:08:11.163+0100 [conn1423585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:14.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7ae5703b51053eb6de0 2015-10-05T05:08:14.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:08:16.414+0100 [conn1423182] end connection 172.28.0.164:53162 (399 connections now open) 2015-10-05T05:08:16.415+0100 [mongosMain] connection accepted from 172.28.0.164:54222 #1423586 (400 connections now open) 2015-10-05T05:08:16.416+0100 [conn1423586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:16.882+0100 [conn1423194] end connection 172.28.0.164:53213 (399 connections now open) 2015-10-05T05:08:16.883+0100 [mongosMain] connection accepted from 172.28.0.164:54224 #1423587 (400 connections now open) 2015-10-05T05:08:16.885+0100 [conn1423587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:17.695+0100 [conn1423195] end connection 172.28.0.163:60160 (399 connections now open) 2015-10-05T05:08:17.696+0100 [mongosMain] connection accepted from 172.28.0.163:61140 #1423588 (400 connections now open) 2015-10-05T05:08:17.697+0100 [conn1423588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:21.173+0100 [conn1423170] end connection 172.28.0.164:53133 (399 connections now open) 2015-10-05T05:08:21.174+0100 [conn1423196] end connection 172.28.0.164:53233 (398 connections now open) 2015-10-05T05:08:21.174+0100 [mongosMain] connection accepted from 172.28.0.164:54229 #1423589 (399 connections now open) 2015-10-05T05:08:21.174+0100 [conn1423181] end connection 172.28.0.163:60084 (397 connections now open) 2015-10-05T05:08:21.175+0100 [mongosMain] connection accepted from 172.28.0.164:54230 #1423590 (399 connections now open) 2015-10-05T05:08:21.176+0100 [mongosMain] connection accepted from 172.28.0.163:61143 #1423591 (400 connections now open) 2015-10-05T05:08:21.176+0100 [conn1423589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:21.177+0100 [conn1423591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:21.177+0100 [conn1423590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:26.430+0100 [conn1423173] end connection 172.28.0.164:53142 (399 connections now open) 2015-10-05T05:08:26.431+0100 [mongosMain] connection accepted from 172.28.0.164:54241 #1423592 (400 connections now open) 2015-10-05T05:08:26.433+0100 [conn1423592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:26.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7ba5703b51053eb6e53 2015-10-05T05:08:26.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:08:26.898+0100 [conn1423201] end connection 172.28.0.164:53253 (399 connections now open) 2015-10-05T05:08:26.899+0100 [mongosMain] connection accepted from 172.28.0.164:54243 #1423593 (400 connections now open) 2015-10-05T05:08:26.904+0100 [conn1423593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:28.576+0100 [mongosMain] connection accepted from 127.0.0.1:61152 #1423594 (401 connections now open) 2015-10-05T05:08:28.578+0100 [conn1423594] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:28.584+0100 [conn1423594] end connection 127.0.0.1:61152 (400 connections now open) 2015-10-05T05:08:28.809+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:08:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:08:31.177+0100 [conn1423199] end connection 172.28.0.163:60182 (399 connections now open) 2015-10-05T05:08:31.179+0100 [mongosMain] connection accepted from 172.28.0.163:61153 #1423595 (400 connections now open) 2015-10-05T05:08:31.180+0100 [conn1423595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:31.189+0100 [conn1423179] end connection 172.28.0.164:53154 (399 connections now open) 2015-10-05T05:08:31.190+0100 [mongosMain] connection accepted from 172.28.0.164:54247 #1423596 (400 connections now open) 2015-10-05T05:08:31.192+0100 [conn1423596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:36.446+0100 [conn1423200] end connection 172.28.0.164:53250 (399 connections now open) 2015-10-05T05:08:36.447+0100 [mongosMain] connection accepted from 172.28.0.164:54254 #1423597 (400 connections now open) 2015-10-05T05:08:36.448+0100 [conn1423597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:39.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7c65703b51053eb6ef7 2015-10-05T05:08:39.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:08:40.044+0100 [mongosMain] connection accepted from 127.0.0.1:61160 #1423598 (401 connections now open) 2015-10-05T05:08:40.047+0100 [conn1423598] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:40.052+0100 [conn1423598] end connection 127.0.0.1:61160 (400 connections now open) 2015-10-05T05:08:41.190+0100 [conn1423192] end connection 172.28.0.163:60124 (399 connections now open) 2015-10-05T05:08:41.191+0100 [mongosMain] connection accepted from 172.28.0.163:61162 #1423599 (400 connections now open) 2015-10-05T05:08:41.192+0100 [conn1423599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:51.191+0100 [conn1423205] end connection 172.28.0.163:60206 (399 connections now open) 2015-10-05T05:08:51.192+0100 [mongosMain] connection accepted from 172.28.0.163:61177 #1423600 (400 connections now open) 2015-10-05T05:08:51.193+0100 [conn1423600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:51.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7d35703b51053eb6f99 2015-10-05T05:08:51.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:08:56.461+0100 [conn1423188] end connection 172.28.0.164:53176 (399 connections now open) 2015-10-05T05:08:56.462+0100 [mongosMain] connection accepted from 172.28.0.164:54279 #1423601 (400 connections now open) 2015-10-05T05:08:56.464+0100 [conn1423601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:57.071+0100 [conn1423158] end connection 172.28.0.163:60054 (399 connections now open) 2015-10-05T05:08:57.072+0100 [mongosMain] connection accepted from 172.28.0.163:61187 #1423602 (400 connections now open) 2015-10-05T05:08:57.073+0100 [conn1423602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:08:59.060+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:08:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:09:01.207+0100 [conn1423213] end connection 172.28.0.163:60216 (399 connections now open) 2015-10-05T05:09:01.208+0100 [mongosMain] connection accepted from 172.28.0.163:61196 #1423603 (400 connections now open) 2015-10-05T05:09:01.209+0100 [conn1423603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:04.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7df5703b51053eb7026 2015-10-05T05:09:04.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:09:06.477+0100 [conn1423193] end connection 172.28.0.164:53210 (399 connections now open) 2015-10-05T05:09:06.478+0100 [mongosMain] connection accepted from 172.28.0.164:54287 #1423604 (400 connections now open) 2015-10-05T05:09:06.480+0100 [conn1423604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:07.088+0100 [conn1423166] end connection 172.28.0.163:60067 (399 connections now open) 2015-10-05T05:09:07.091+0100 [mongosMain] connection accepted from 172.28.0.163:61214 #1423605 (400 connections now open) 2015-10-05T05:09:07.092+0100 [conn1423605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:11.251+0100 [conn1423161] end connection 172.28.0.164:53115 (399 connections now open) 2015-10-05T05:09:11.253+0100 [mongosMain] connection accepted from 172.28.0.164:54291 #1423606 (400 connections now open) 2015-10-05T05:09:11.255+0100 [conn1423606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:16.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7ec5703b51053eb7074 2015-10-05T05:09:16.493+0100 [conn1423207] end connection 172.28.0.164:53267 (399 connections now open) 2015-10-05T05:09:16.494+0100 [mongosMain] connection accepted from 172.28.0.164:54293 #1423607 (400 connections now open) 2015-10-05T05:09:16.495+0100 [conn1423607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:16.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:09:17.087+0100 [conn1423142] end connection 172.28.0.163:59962 (399 connections now open) 2015-10-05T05:09:17.088+0100 [mongosMain] connection accepted from 172.28.0.163:61224 #1423608 (400 connections now open) 2015-10-05T05:09:17.089+0100 [conn1423608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:21.268+0100 [conn1423211] end connection 172.28.0.164:53275 (399 connections now open) 2015-10-05T05:09:21.269+0100 [mongosMain] connection accepted from 172.28.0.164:54300 #1423609 (400 connections now open) 2015-10-05T05:09:21.270+0100 [conn1423609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:26.492+0100 [conn1423222] end connection 172.28.0.164:53312 (399 connections now open) 2015-10-05T05:09:26.494+0100 [mongosMain] connection accepted from 172.28.0.164:54309 #1423610 (400 connections now open) 2015-10-05T05:09:26.495+0100 [conn1423610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:28.528+0100 [mongosMain] connection accepted from 127.0.0.1:61228 #1423611 (401 connections now open) 2015-10-05T05:09:28.530+0100 [conn1423611] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:28.535+0100 [conn1423611] end connection 127.0.0.1:61228 (400 connections now open) 2015-10-05T05:09:28.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f7f85703b51053eb70c8 2015-10-05T05:09:28.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:09:29.322+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:09:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:09:31.283+0100 [conn1423204] end connection 172.28.0.164:53258 (399 connections now open) 2015-10-05T05:09:31.284+0100 [mongosMain] connection accepted from 172.28.0.164:54316 #1423612 (400 connections now open) 2015-10-05T05:09:31.288+0100 [conn1423612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:39.473+0100 [mongosMain] connection accepted from 127.0.0.1:61234 #1423613 (401 connections now open) 2015-10-05T05:09:39.476+0100 [conn1423613] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:09:39.480+0100 [conn1423613] end connection 127.0.0.1:61234 (400 connections now open) 2015-10-05T05:09:41.237+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8045703b51053eb711f 2015-10-05T05:09:41.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:09:53.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8115703b51053eb718d 2015-10-05T05:09:53.799+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:09:59.611+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:09:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:10:06.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f81d5703b51053eb7214 2015-10-05T05:10:06.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:10:11.314+0100 [conn1423235] end connection 172.28.0.164:53383 (399 connections now open) 2015-10-05T05:10:11.316+0100 [mongosMain] connection accepted from 172.28.0.164:54352 #1423614 (400 connections now open) 2015-10-05T05:10:11.328+0100 [conn1423614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:16.541+0100 [conn1423227] end connection 172.28.0.164:53341 (399 connections now open) 2015-10-05T05:10:16.542+0100 [mongosMain] connection accepted from 172.28.0.164:54355 #1423615 (400 connections now open) 2015-10-05T05:10:16.544+0100 [conn1423615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:17.150+0100 [conn1423175] end connection 172.28.0.163:60078 (399 connections now open) 2015-10-05T05:10:17.151+0100 [mongosMain] connection accepted from 172.28.0.163:61282 #1423616 (400 connections now open) 2015-10-05T05:10:17.152+0100 [conn1423616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:17.790+0100 [conn1423202] end connection 172.28.0.163:60203 (399 connections now open) 2015-10-05T05:10:17.791+0100 [mongosMain] connection accepted from 172.28.0.163:61283 #1423617 (400 connections now open) 2015-10-05T05:10:17.792+0100 [conn1423617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:18.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f82a5703b51053eb72a2 2015-10-05T05:10:18.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:10:21.290+0100 [conn1423231] end connection 172.28.0.163:60334 (399 connections now open) 2015-10-05T05:10:21.292+0100 [mongosMain] connection accepted from 172.28.0.163:61287 #1423618 (400 connections now open) 2015-10-05T05:10:21.294+0100 [conn1423618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:21.329+0100 [conn1423244] end connection 172.28.0.164:53444 (399 connections now open) 2015-10-05T05:10:21.338+0100 [mongosMain] connection accepted from 172.28.0.164:54361 #1423619 (400 connections now open) 2015-10-05T05:10:21.343+0100 [conn1423619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:27.008+0100 [conn1423208] end connection 172.28.0.164:53269 (399 connections now open) 2015-10-05T05:10:27.011+0100 [mongosMain] connection accepted from 172.28.0.164:54370 #1423620 (400 connections now open) 2015-10-05T05:10:27.013+0100 [conn1423620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:27.150+0100 [conn1423228] end connection 172.28.0.163:60301 (399 connections now open) 2015-10-05T05:10:27.151+0100 [mongosMain] connection accepted from 172.28.0.163:61288 #1423621 (400 connections now open) 2015-10-05T05:10:27.152+0100 [conn1423621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:27.806+0100 [conn1423247] end connection 172.28.0.163:60417 (399 connections now open) 2015-10-05T05:10:27.807+0100 [mongosMain] connection accepted from 172.28.0.163:61289 #1423622 (400 connections now open) 2015-10-05T05:10:27.808+0100 [conn1423622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:28.766+0100 [mongosMain] connection accepted from 127.0.0.1:61291 #1423623 (401 connections now open) 2015-10-05T05:10:28.769+0100 [conn1423623] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:28.773+0100 [conn1423623] end connection 127.0.0.1:61291 (400 connections now open) 2015-10-05T05:10:29.767+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:10:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:10:31.285+0100 [conn1423226] end connection 172.28.0.163:60261 (399 connections now open) 2015-10-05T05:10:31.287+0100 [mongosMain] connection accepted from 172.28.0.163:61295 #1423624 (400 connections now open) 2015-10-05T05:10:31.288+0100 [conn1423624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:31.330+0100 [conn1423084] end connection 172.28.0.164:52864 (399 connections now open) 2015-10-05T05:10:31.331+0100 [conn1423229] end connection 172.28.0.164:53369 (398 connections now open) 2015-10-05T05:10:31.332+0100 [mongosMain] connection accepted from 172.28.0.164:54376 #1423625 (399 connections now open) 2015-10-05T05:10:31.332+0100 [mongosMain] connection accepted from 172.28.0.164:54377 #1423626 (400 connections now open) 2015-10-05T05:10:31.334+0100 [conn1423626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:31.334+0100 [conn1423625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:36.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f83c5703b51053eb7371 2015-10-05T05:10:36.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:10:37.166+0100 [conn1423242] end connection 172.28.0.163:60366 (399 connections now open) 2015-10-05T05:10:37.167+0100 [mongosMain] connection accepted from 172.28.0.163:61299 #1423627 (400 connections now open) 2015-10-05T05:10:37.168+0100 [conn1423627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:37.806+0100 [conn1423252] end connection 172.28.0.163:60426 (399 connections now open) 2015-10-05T05:10:37.807+0100 [mongosMain] connection accepted from 172.28.0.163:61301 #1423628 (400 connections now open) 2015-10-05T05:10:37.809+0100 [conn1423628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:39.763+0100 [mongosMain] connection accepted from 127.0.0.1:61303 #1423629 (401 connections now open) 2015-10-05T05:10:39.765+0100 [conn1423629] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:39.771+0100 [conn1423629] end connection 127.0.0.1:61303 (400 connections now open) 2015-10-05T05:10:41.300+0100 [conn1423236] end connection 172.28.0.163:60347 (399 connections now open) 2015-10-05T05:10:41.301+0100 [mongosMain] connection accepted from 172.28.0.163:61305 #1423630 (400 connections now open) 2015-10-05T05:10:41.302+0100 [conn1423630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:41.346+0100 [conn1423215] end connection 172.28.0.164:53291 (399 connections now open) 2015-10-05T05:10:41.347+0100 [mongosMain] connection accepted from 172.28.0.164:54395 #1423631 (400 connections now open) 2015-10-05T05:10:41.349+0100 [conn1423631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:43.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8425703b51053eb73b1 2015-10-05T05:10:43.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:10:47.024+0100 [conn1423250] end connection 172.28.0.164:53467 (399 connections now open) 2015-10-05T05:10:47.025+0100 [mongosMain] connection accepted from 172.28.0.164:54406 #1423632 (400 connections now open) 2015-10-05T05:10:47.027+0100 [conn1423632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:47.166+0100 [conn1423234] end connection 172.28.0.163:60343 (399 connections now open) 2015-10-05T05:10:47.167+0100 [mongosMain] connection accepted from 172.28.0.163:61315 #1423633 (400 connections now open) 2015-10-05T05:10:47.168+0100 [conn1423633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:47.821+0100 [conn1423256] end connection 172.28.0.163:60433 (399 connections now open) 2015-10-05T05:10:47.822+0100 [mongosMain] connection accepted from 172.28.0.163:61317 #1423634 (400 connections now open) 2015-10-05T05:10:47.823+0100 [conn1423634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:51.301+0100 [conn1423245] end connection 172.28.0.163:60405 (399 connections now open) 2015-10-05T05:10:51.302+0100 [mongosMain] connection accepted from 172.28.0.163:61322 #1423635 (400 connections now open) 2015-10-05T05:10:51.303+0100 [conn1423635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:51.353+0100 [conn1423203] end connection 172.28.0.164:53257 (399 connections now open) 2015-10-05T05:10:51.354+0100 [mongosMain] connection accepted from 172.28.0.164:54410 #1423636 (400 connections now open) 2015-10-05T05:10:51.355+0100 [conn1423636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:57.040+0100 [conn1423255] end connection 172.28.0.164:53480 (399 connections now open) 2015-10-05T05:10:57.041+0100 [mongosMain] connection accepted from 172.28.0.164:54417 #1423637 (400 connections now open) 2015-10-05T05:10:57.042+0100 [conn1423637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:57.181+0100 [conn1423243] end connection 172.28.0.163:60378 (399 connections now open) 2015-10-05T05:10:57.182+0100 [mongosMain] connection accepted from 172.28.0.163:61331 #1423638 (400 connections now open) 2015-10-05T05:10:57.183+0100 [conn1423638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:10:57.821+0100 [conn1423261] end connection 172.28.0.163:60445 (399 connections now open) 2015-10-05T05:10:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:61333 #1423639 (400 connections now open) 2015-10-05T05:10:57.823+0100 [conn1423639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:00.048+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:10:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:11:01.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8555703b51053eb7463 2015-10-05T05:11:01.317+0100 [conn1423220] end connection 172.28.0.163:60242 (399 connections now open) 2015-10-05T05:11:01.318+0100 [mongosMain] connection accepted from 172.28.0.163:61340 #1423640 (400 connections now open) 2015-10-05T05:11:01.319+0100 [conn1423640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:01.361+0100 [conn1423248] end connection 172.28.0.164:53454 (399 connections now open) 2015-10-05T05:11:01.361+0100 [conn1423219] end connection 172.28.0.164:53303 (398 connections now open) 2015-10-05T05:11:01.362+0100 [mongosMain] connection accepted from 172.28.0.164:54423 #1423641 (399 connections now open) 2015-10-05T05:11:01.362+0100 [mongosMain] connection accepted from 172.28.0.164:54424 #1423642 (400 connections now open) 2015-10-05T05:11:01.363+0100 [conn1423641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:01.364+0100 [conn1423642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:01.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:06.587+0100 [conn1423233] end connection 172.28.0.164:53379 (399 connections now open) 2015-10-05T05:11:06.588+0100 [mongosMain] connection accepted from 172.28.0.164:54429 #1423643 (400 connections now open) 2015-10-05T05:11:06.590+0100 [conn1423643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:07.054+0100 [conn1423260] end connection 172.28.0.164:53505 (399 connections now open) 2015-10-05T05:11:07.055+0100 [mongosMain] connection accepted from 172.28.0.164:54431 #1423644 (400 connections now open) 2015-10-05T05:11:07.057+0100 [conn1423644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:07.180+0100 [conn1423239] end connection 172.28.0.163:60350 (399 connections now open) 2015-10-05T05:11:07.181+0100 [mongosMain] connection accepted from 172.28.0.163:61350 #1423645 (400 connections now open) 2015-10-05T05:11:07.182+0100 [conn1423645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:07.837+0100 [conn1423265] end connection 172.28.0.163:60458 (399 connections now open) 2015-10-05T05:11:07.838+0100 [mongosMain] connection accepted from 172.28.0.163:61355 #1423646 (400 connections now open) 2015-10-05T05:11:07.839+0100 [conn1423646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:11.362+0100 [conn1423254] end connection 172.28.0.164:53472 (399 connections now open) 2015-10-05T05:11:11.363+0100 [mongosMain] connection accepted from 172.28.0.164:54433 #1423647 (400 connections now open) 2015-10-05T05:11:11.366+0100 [conn1423647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:13.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8615703b51053eb750c 2015-10-05T05:11:13.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:16.603+0100 [conn1423238] end connection 172.28.0.164:53393 (399 connections now open) 2015-10-05T05:11:16.604+0100 [mongosMain] connection accepted from 172.28.0.164:54437 #1423648 (400 connections now open) 2015-10-05T05:11:16.605+0100 [conn1423648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:17.070+0100 [conn1423263] end connection 172.28.0.164:53517 (399 connections now open) 2015-10-05T05:11:17.072+0100 [mongosMain] connection accepted from 172.28.0.164:54439 #1423649 (400 connections now open) 2015-10-05T05:11:17.074+0100 [conn1423649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:17.197+0100 [conn1423264] end connection 172.28.0.163:60457 (399 connections now open) 2015-10-05T05:11:17.198+0100 [mongosMain] connection accepted from 172.28.0.163:61365 #1423650 (400 connections now open) 2015-10-05T05:11:17.199+0100 [conn1423650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:17.852+0100 [conn1423270] end connection 172.28.0.163:60478 (399 connections now open) 2015-10-05T05:11:17.854+0100 [mongosMain] connection accepted from 172.28.0.163:61367 #1423651 (400 connections now open) 2015-10-05T05:11:17.856+0100 [conn1423651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:21.332+0100 [conn1423172] end connection 172.28.0.163:60073 (399 connections now open) 2015-10-05T05:11:21.332+0100 [conn1423216] end connection 172.28.0.163:60224 (399 connections now open) 2015-10-05T05:11:21.333+0100 [mongosMain] connection accepted from 172.28.0.163:61371 #1423652 (399 connections now open) 2015-10-05T05:11:21.333+0100 [mongosMain] connection accepted from 172.28.0.163:61372 #1423653 (400 connections now open) 2015-10-05T05:11:21.334+0100 [conn1423652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:21.334+0100 [conn1423653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:21.377+0100 [conn1423258] end connection 172.28.0.164:53488 (399 connections now open) 2015-10-05T05:11:21.379+0100 [mongosMain] connection accepted from 172.28.0.164:54446 #1423654 (400 connections now open) 2015-10-05T05:11:21.380+0100 [conn1423654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:25.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f86d5703b51053eb7581 2015-10-05T05:11:26.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:26.603+0100 [conn1423218] end connection 172.28.0.164:53299 (399 connections now open) 2015-10-05T05:11:26.604+0100 [mongosMain] connection accepted from 172.28.0.164:54456 #1423655 (400 connections now open) 2015-10-05T05:11:26.606+0100 [conn1423655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:27.071+0100 [conn1423268] end connection 172.28.0.164:53534 (399 connections now open) 2015-10-05T05:11:27.072+0100 [mongosMain] connection accepted from 172.28.0.164:54458 #1423656 (400 connections now open) 2015-10-05T05:11:27.074+0100 [conn1423656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:27.201+0100 [conn1423251] end connection 172.28.0.163:60423 (399 connections now open) 2015-10-05T05:11:27.202+0100 [mongosMain] connection accepted from 172.28.0.163:61375 #1423657 (400 connections now open) 2015-10-05T05:11:27.203+0100 [conn1423657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:27.856+0100 [conn1423278] end connection 172.28.0.163:60494 (399 connections now open) 2015-10-05T05:11:27.858+0100 [mongosMain] connection accepted from 172.28.0.163:61377 #1423658 (400 connections now open) 2015-10-05T05:11:27.859+0100 [conn1423658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:29.147+0100 [mongosMain] connection accepted from 127.0.0.1:61379 #1423659 (401 connections now open) 2015-10-05T05:11:29.150+0100 [conn1423659] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:29.155+0100 [conn1423659] end connection 127.0.0.1:61379 (400 connections now open) 2015-10-05T05:11:30.345+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:11:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:11:31.335+0100 [conn1423273] end connection 172.28.0.163:60484 (399 connections now open) 2015-10-05T05:11:31.335+0100 [conn1423221] end connection 172.28.0.163:60243 (399 connections now open) 2015-10-05T05:11:31.337+0100 [mongosMain] connection accepted from 172.28.0.163:61380 #1423660 (399 connections now open) 2015-10-05T05:11:31.337+0100 [mongosMain] connection accepted from 172.28.0.163:61381 #1423661 (400 connections now open) 2015-10-05T05:11:31.338+0100 [conn1423660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:31.339+0100 [conn1423661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:31.377+0100 [conn1423210] end connection 172.28.0.164:53274 (399 connections now open) 2015-10-05T05:11:31.377+0100 [conn1423280] end connection 172.28.0.164:53551 (399 connections now open) 2015-10-05T05:11:31.378+0100 [mongosMain] connection accepted from 172.28.0.164:54466 #1423662 (399 connections now open) 2015-10-05T05:11:31.378+0100 [mongosMain] connection accepted from 172.28.0.164:54465 #1423663 (400 connections now open) 2015-10-05T05:11:31.379+0100 [conn1423663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:31.379+0100 [conn1423662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:36.618+0100 [conn1423259] end connection 172.28.0.164:53503 (399 connections now open) 2015-10-05T05:11:36.619+0100 [mongosMain] connection accepted from 172.28.0.164:54473 #1423664 (400 connections now open) 2015-10-05T05:11:36.621+0100 [conn1423664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:37.087+0100 [conn1423276] end connection 172.28.0.164:53546 (399 connections now open) 2015-10-05T05:11:37.088+0100 [mongosMain] connection accepted from 172.28.0.164:54478 #1423665 (400 connections now open) 2015-10-05T05:11:37.089+0100 [conn1423665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:37.213+0100 [conn1423269] end connection 172.28.0.163:60477 (399 connections now open) 2015-10-05T05:11:37.214+0100 [mongosMain] connection accepted from 172.28.0.163:61386 #1423666 (400 connections now open) 2015-10-05T05:11:37.216+0100 [conn1423666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:37.868+0100 [conn1423285] end connection 172.28.0.163:60503 (399 connections now open) 2015-10-05T05:11:37.869+0100 [mongosMain] connection accepted from 172.28.0.163:61387 #1423667 (400 connections now open) 2015-10-05T05:11:37.871+0100 [conn1423667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:38.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f87a5703b51053eb75ee 2015-10-05T05:11:38.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:39.557+0100 [mongosMain] connection accepted from 127.0.0.1:61391 #1423668 (401 connections now open) 2015-10-05T05:11:39.560+0100 [conn1423668] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:39.564+0100 [conn1423668] end connection 127.0.0.1:61391 (400 connections now open) 2015-10-05T05:11:41.349+0100 [conn1423249] end connection 172.28.0.163:60420 (399 connections now open) 2015-10-05T05:11:41.349+0100 [conn1423274] end connection 172.28.0.163:60485 (399 connections now open) 2015-10-05T05:11:41.350+0100 [mongosMain] connection accepted from 172.28.0.163:61393 #1423669 (399 connections now open) 2015-10-05T05:11:41.350+0100 [mongosMain] connection accepted from 172.28.0.163:61395 #1423670 (400 connections now open) 2015-10-05T05:11:41.351+0100 [conn1423669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:41.351+0100 [conn1423670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:41.393+0100 [conn1423266] end connection 172.28.0.164:53524 (399 connections now open) 2015-10-05T05:11:41.394+0100 [conn1423287] end connection 172.28.0.164:53567 (398 connections now open) 2015-10-05T05:11:41.395+0100 [mongosMain] connection accepted from 172.28.0.164:54486 #1423671 (399 connections now open) 2015-10-05T05:11:41.395+0100 [mongosMain] connection accepted from 172.28.0.164:54487 #1423672 (400 connections now open) 2015-10-05T05:11:41.397+0100 [conn1423671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:41.397+0100 [conn1423672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:44.714+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8805703b51053eb7616 2015-10-05T05:11:44.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:47.086+0100 [conn1423284] end connection 172.28.0.164:53562 (399 connections now open) 2015-10-05T05:11:47.088+0100 [mongosMain] connection accepted from 172.28.0.164:54495 #1423673 (400 connections now open) 2015-10-05T05:11:47.089+0100 [conn1423673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:47.229+0100 [conn1423246] end connection 172.28.0.163:60414 (399 connections now open) 2015-10-05T05:11:47.231+0100 [mongosMain] connection accepted from 172.28.0.163:61403 #1423674 (400 connections now open) 2015-10-05T05:11:47.232+0100 [conn1423674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:47.869+0100 [conn1423294] end connection 172.28.0.163:60514 (399 connections now open) 2015-10-05T05:11:47.870+0100 [mongosMain] connection accepted from 172.28.0.163:61406 #1423675 (400 connections now open) 2015-10-05T05:11:47.871+0100 [conn1423675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:51.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8865703b51053eb7650 2015-10-05T05:11:51.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:51.363+0100 [conn1423191] end connection 172.28.0.163:60123 (399 connections now open) 2015-10-05T05:11:51.363+0100 [conn1423282] end connection 172.28.0.163:60498 (399 connections now open) 2015-10-05T05:11:51.364+0100 [mongosMain] connection accepted from 172.28.0.163:61410 #1423676 (399 connections now open) 2015-10-05T05:11:51.365+0100 [mongosMain] connection accepted from 172.28.0.163:61411 #1423677 (400 connections now open) 2015-10-05T05:11:51.365+0100 [conn1423677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:51.365+0100 [conn1423676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:51.394+0100 [conn1423185] end connection 172.28.0.164:53169 (399 connections now open) 2015-10-05T05:11:51.395+0100 [mongosMain] connection accepted from 172.28.0.164:54500 #1423678 (400 connections now open) 2015-10-05T05:11:51.397+0100 [conn1423678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:56.634+0100 [conn1423275] end connection 172.28.0.164:53544 (399 connections now open) 2015-10-05T05:11:56.635+0100 [mongosMain] connection accepted from 172.28.0.164:54506 #1423679 (400 connections now open) 2015-10-05T05:11:56.637+0100 [conn1423679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:57.103+0100 [conn1423292] end connection 172.28.0.164:53578 (399 connections now open) 2015-10-05T05:11:57.104+0100 [mongosMain] connection accepted from 172.28.0.164:54508 #1423680 (400 connections now open) 2015-10-05T05:11:57.106+0100 [conn1423680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:57.229+0100 [conn1423223] end connection 172.28.0.163:60252 (399 connections now open) 2015-10-05T05:11:57.231+0100 [mongosMain] connection accepted from 172.28.0.163:61420 #1423681 (400 connections now open) 2015-10-05T05:11:57.232+0100 [conn1423681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:11:57.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f88d5703b51053eb7670 2015-10-05T05:11:57.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:11:57.884+0100 [conn1423302] end connection 172.28.0.163:60529 (399 connections now open) 2015-10-05T05:11:57.886+0100 [mongosMain] connection accepted from 172.28.0.163:61423 #1423682 (400 connections now open) 2015-10-05T05:11:57.887+0100 [conn1423682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:00.661+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:12:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:12:01.365+0100 [conn1423298] end connection 172.28.0.163:60518 (399 connections now open) 2015-10-05T05:12:01.365+0100 [conn1423131] end connection 172.28.0.163:59933 (398 connections now open) 2015-10-05T05:12:01.366+0100 [mongosMain] connection accepted from 172.28.0.163:61431 #1423683 (399 connections now open) 2015-10-05T05:12:01.367+0100 [mongosMain] connection accepted from 172.28.0.163:61432 #1423684 (400 connections now open) 2015-10-05T05:12:01.368+0100 [conn1423683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:01.368+0100 [conn1423684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:01.409+0100 [conn1423271] end connection 172.28.0.164:53539 (399 connections now open) 2015-10-05T05:12:01.410+0100 [mongosMain] connection accepted from 172.28.0.164:54515 #1423685 (400 connections now open) 2015-10-05T05:12:01.412+0100 [conn1423685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:03.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8935703b51053eb76ab 2015-10-05T05:12:03.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:07.102+0100 [conn1423300] end connection 172.28.0.164:53597 (399 connections now open) 2015-10-05T05:12:07.103+0100 [mongosMain] connection accepted from 172.28.0.164:54518 #1423686 (400 connections now open) 2015-10-05T05:12:07.104+0100 [conn1423686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:07.244+0100 [conn1423293] end connection 172.28.0.163:60512 (399 connections now open) 2015-10-05T05:12:07.245+0100 [mongosMain] connection accepted from 172.28.0.163:61440 #1423687 (400 connections now open) 2015-10-05T05:12:07.246+0100 [conn1423687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:07.884+0100 [conn1423307] end connection 172.28.0.163:60546 (399 connections now open) 2015-10-05T05:12:07.885+0100 [mongosMain] connection accepted from 172.28.0.163:61443 #1423688 (400 connections now open) 2015-10-05T05:12:07.887+0100 [conn1423688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:10.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8995703b51053eb76e7 2015-10-05T05:12:10.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:11.379+0100 [conn1423198] end connection 172.28.0.163:60181 (399 connections now open) 2015-10-05T05:12:11.380+0100 [mongosMain] connection accepted from 172.28.0.163:61448 #1423689 (400 connections now open) 2015-10-05T05:12:11.381+0100 [conn1423689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:11.408+0100 [conn1423296] end connection 172.28.0.164:53587 (399 connections now open) 2015-10-05T05:12:11.409+0100 [conn1423178] end connection 172.28.0.164:53153 (398 connections now open) 2015-10-05T05:12:11.409+0100 [mongosMain] connection accepted from 172.28.0.164:54522 #1423690 (399 connections now open) 2015-10-05T05:12:11.410+0100 [mongosMain] connection accepted from 172.28.0.164:54524 #1423691 (400 connections now open) 2015-10-05T05:12:11.411+0100 [conn1423690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:11.412+0100 [conn1423691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:16.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8a05703b51053eb770b 2015-10-05T05:12:16.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:17.103+0100 [conn1423305] end connection 172.28.0.164:53609 (399 connections now open) 2015-10-05T05:12:17.104+0100 [mongosMain] connection accepted from 172.28.0.164:54529 #1423692 (400 connections now open) 2015-10-05T05:12:17.106+0100 [conn1423692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:17.900+0100 [conn1423312] end connection 172.28.0.163:60566 (399 connections now open) 2015-10-05T05:12:17.901+0100 [mongosMain] connection accepted from 172.28.0.163:61457 #1423693 (400 connections now open) 2015-10-05T05:12:17.902+0100 [conn1423693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:21.383+0100 [conn1423237] end connection 172.28.0.163:60348 (399 connections now open) 2015-10-05T05:12:21.383+0100 [conn1423316] end connection 172.28.0.163:60572 (398 connections now open) 2015-10-05T05:12:21.384+0100 [mongosMain] connection accepted from 172.28.0.163:61461 #1423694 (399 connections now open) 2015-10-05T05:12:21.385+0100 [mongosMain] connection accepted from 172.28.0.163:61462 #1423695 (400 connections now open) 2015-10-05T05:12:21.385+0100 [conn1423694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:21.386+0100 [conn1423695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:21.426+0100 [conn1423272] end connection 172.28.0.164:53540 (399 connections now open) 2015-10-05T05:12:21.426+0100 [conn1423230] end connection 172.28.0.164:53368 (399 connections now open) 2015-10-05T05:12:21.429+0100 [mongosMain] connection accepted from 172.28.0.164:54537 #1423696 (399 connections now open) 2015-10-05T05:12:21.429+0100 [mongosMain] connection accepted from 172.28.0.164:54538 #1423697 (400 connections now open) 2015-10-05T05:12:21.430+0100 [conn1423696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:21.431+0100 [conn1423697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:22.832+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8a65703b51053eb774e 2015-10-05T05:12:22.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:26.649+0100 [conn1423291] end connection 172.28.0.164:53576 (399 connections now open) 2015-10-05T05:12:26.650+0100 [mongosMain] connection accepted from 172.28.0.164:54546 #1423698 (400 connections now open) 2015-10-05T05:12:26.652+0100 [conn1423698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:27.118+0100 [conn1423310] end connection 172.28.0.164:53620 (399 connections now open) 2015-10-05T05:12:27.120+0100 [mongosMain] connection accepted from 172.28.0.164:54549 #1423699 (400 connections now open) 2015-10-05T05:12:27.121+0100 [conn1423699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:27.260+0100 [conn1423277] end connection 172.28.0.163:60493 (399 connections now open) 2015-10-05T05:12:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:61465 #1423700 (400 connections now open) 2015-10-05T05:12:27.262+0100 [conn1423700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:27.900+0100 [conn1423320] end connection 172.28.0.163:60583 (399 connections now open) 2015-10-05T05:12:27.902+0100 [mongosMain] connection accepted from 172.28.0.163:61467 #1423701 (400 connections now open) 2015-10-05T05:12:27.903+0100 [conn1423701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:28.363+0100 [mongosMain] connection accepted from 127.0.0.1:61469 #1423702 (401 connections now open) 2015-10-05T05:12:28.365+0100 [conn1423702] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:28.370+0100 [conn1423702] end connection 127.0.0.1:61469 (400 connections now open) 2015-10-05T05:12:29.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8ac5703b51053eb778f 2015-10-05T05:12:29.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:30.925+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:12:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:12:31.395+0100 [conn1423290] end connection 172.28.0.163:60507 (399 connections now open) 2015-10-05T05:12:31.395+0100 [conn1423225] end connection 172.28.0.163:60260 (398 connections now open) 2015-10-05T05:12:31.396+0100 [mongosMain] connection accepted from 172.28.0.163:61470 #1423703 (399 connections now open) 2015-10-05T05:12:31.396+0100 [mongosMain] connection accepted from 172.28.0.163:61471 #1423704 (400 connections now open) 2015-10-05T05:12:31.397+0100 [conn1423703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:31.398+0100 [conn1423704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:31.440+0100 [conn1423322] end connection 172.28.0.164:53638 (399 connections now open) 2015-10-05T05:12:31.440+0100 [conn1423224] end connection 172.28.0.164:53314 (399 connections now open) 2015-10-05T05:12:31.441+0100 [mongosMain] connection accepted from 172.28.0.164:54555 #1423705 (399 connections now open) 2015-10-05T05:12:31.442+0100 [mongosMain] connection accepted from 172.28.0.164:54556 #1423706 (400 connections now open) 2015-10-05T05:12:31.443+0100 [conn1423705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:31.443+0100 [conn1423706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:35.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8b35703b51053eb77c5 2015-10-05T05:12:35.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:36.664+0100 [conn1423267] end connection 172.28.0.164:53532 (399 connections now open) 2015-10-05T05:12:36.666+0100 [mongosMain] connection accepted from 172.28.0.164:54564 #1423707 (400 connections now open) 2015-10-05T05:12:36.667+0100 [conn1423707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:37.133+0100 [conn1423318] end connection 172.28.0.164:53631 (399 connections now open) 2015-10-05T05:12:37.134+0100 [mongosMain] connection accepted from 172.28.0.164:54568 #1423708 (400 connections now open) 2015-10-05T05:12:37.136+0100 [conn1423708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:37.915+0100 [conn1423328] end connection 172.28.0.163:60594 (399 connections now open) 2015-10-05T05:12:37.916+0100 [mongosMain] connection accepted from 172.28.0.163:61473 #1423709 (400 connections now open) 2015-10-05T05:12:37.917+0100 [conn1423709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:40.177+0100 [mongosMain] connection accepted from 127.0.0.1:61476 #1423710 (401 connections now open) 2015-10-05T05:12:40.180+0100 [conn1423710] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:40.184+0100 [conn1423710] end connection 127.0.0.1:61476 (400 connections now open) 2015-10-05T05:12:41.400+0100 [conn1423323] end connection 172.28.0.163:60586 (399 connections now open) 2015-10-05T05:12:41.400+0100 [conn1423154] end connection 172.28.0.163:60045 (399 connections now open) 2015-10-05T05:12:41.401+0100 [mongosMain] connection accepted from 172.28.0.163:61478 #1423711 (399 connections now open) 2015-10-05T05:12:41.401+0100 [mongosMain] connection accepted from 172.28.0.163:61479 #1423712 (400 connections now open) 2015-10-05T05:12:41.402+0100 [conn1423711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:41.402+0100 [conn1423712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:41.439+0100 [conn1423152] end connection 172.28.0.164:53101 (399 connections now open) 2015-10-05T05:12:41.440+0100 [mongosMain] connection accepted from 172.28.0.164:54574 #1423713 (400 connections now open) 2015-10-05T05:12:41.442+0100 [conn1423713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:41.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8b95703b51053eb780d 2015-10-05T05:12:42.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:46.665+0100 [conn1423283] end connection 172.28.0.164:53560 (399 connections now open) 2015-10-05T05:12:46.666+0100 [mongosMain] connection accepted from 172.28.0.164:54581 #1423714 (400 connections now open) 2015-10-05T05:12:46.667+0100 [conn1423714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:47.133+0100 [conn1423326] end connection 172.28.0.164:53650 (399 connections now open) 2015-10-05T05:12:47.134+0100 [mongosMain] connection accepted from 172.28.0.164:54584 #1423715 (400 connections now open) 2015-10-05T05:12:47.136+0100 [conn1423715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:47.276+0100 [conn1423301] end connection 172.28.0.163:60528 (399 connections now open) 2015-10-05T05:12:47.278+0100 [mongosMain] connection accepted from 172.28.0.163:61489 #1423716 (400 connections now open) 2015-10-05T05:12:47.279+0100 [conn1423716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:47.931+0100 [conn1423337] end connection 172.28.0.163:60603 (399 connections now open) 2015-10-05T05:12:47.932+0100 [mongosMain] connection accepted from 172.28.0.163:61491 #1423717 (400 connections now open) 2015-10-05T05:12:47.933+0100 [conn1423717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:48.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8c05703b51053eb7845 2015-10-05T05:12:48.411+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:51.411+0100 [conn1423186] end connection 172.28.0.163:60104 (399 connections now open) 2015-10-05T05:12:51.412+0100 [mongosMain] connection accepted from 172.28.0.163:61496 #1423718 (400 connections now open) 2015-10-05T05:12:51.413+0100 [conn1423718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:51.455+0100 [conn1423340] end connection 172.28.0.164:53677 (399 connections now open) 2015-10-05T05:12:51.455+0100 [conn1423288] end connection 172.28.0.164:53568 (399 connections now open) 2015-10-05T05:12:51.456+0100 [mongosMain] connection accepted from 172.28.0.164:54589 #1423719 (399 connections now open) 2015-10-05T05:12:51.457+0100 [mongosMain] connection accepted from 172.28.0.164:54590 #1423720 (400 connections now open) 2015-10-05T05:12:51.458+0100 [conn1423719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:51.458+0100 [conn1423720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:54.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8c65703b51053eb788e 2015-10-05T05:12:54.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:12:56.681+0100 [conn1423262] end connection 172.28.0.164:53515 (399 connections now open) 2015-10-05T05:12:56.682+0100 [mongosMain] connection accepted from 172.28.0.164:54596 #1423721 (400 connections now open) 2015-10-05T05:12:56.684+0100 [conn1423721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:57.149+0100 [conn1423335] end connection 172.28.0.164:53669 (399 connections now open) 2015-10-05T05:12:57.150+0100 [mongosMain] connection accepted from 172.28.0.164:54598 #1423722 (400 connections now open) 2015-10-05T05:12:57.151+0100 [conn1423722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:12:57.932+0100 [conn1423346] end connection 172.28.0.163:60621 (399 connections now open) 2015-10-05T05:12:57.933+0100 [mongosMain] connection accepted from 172.28.0.163:61507 #1423723 (400 connections now open) 2015-10-05T05:12:57.934+0100 [conn1423723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:00.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8cc5703b51053eb78c4 2015-10-05T05:13:01.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:01.219+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:13:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:13:01.416+0100 [conn1423232] end connection 172.28.0.163:60335 (399 connections now open) 2015-10-05T05:13:01.417+0100 [mongosMain] connection accepted from 172.28.0.163:61521 #1423724 (400 connections now open) 2015-10-05T05:13:01.418+0100 [conn1423724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:01.455+0100 [conn1423313] end connection 172.28.0.164:53624 (399 connections now open) 2015-10-05T05:13:01.455+0100 [conn1423308] end connection 172.28.0.164:53616 (399 connections now open) 2015-10-05T05:13:01.457+0100 [mongosMain] connection accepted from 172.28.0.164:54607 #1423725 (399 connections now open) 2015-10-05T05:13:01.457+0100 [mongosMain] connection accepted from 172.28.0.164:54608 #1423726 (400 connections now open) 2015-10-05T05:13:01.458+0100 [conn1423725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:01.459+0100 [conn1423726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:06.696+0100 [conn1423343] end connection 172.28.0.164:53684 (399 connections now open) 2015-10-05T05:13:06.698+0100 [mongosMain] connection accepted from 172.28.0.164:54609 #1423727 (400 connections now open) 2015-10-05T05:13:06.700+0100 [conn1423727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:07.165+0100 [conn1423344] end connection 172.28.0.164:53686 (399 connections now open) 2015-10-05T05:13:07.168+0100 [mongosMain] connection accepted from 172.28.0.164:54612 #1423728 (400 connections now open) 2015-10-05T05:13:07.170+0100 [conn1423728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:07.337+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8d35703b51053eb790e 2015-10-05T05:13:07.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:07.947+0100 [conn1423352] end connection 172.28.0.163:60636 (399 connections now open) 2015-10-05T05:13:07.949+0100 [mongosMain] connection accepted from 172.28.0.163:61531 #1423729 (400 connections now open) 2015-10-05T05:13:07.950+0100 [conn1423729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:11.426+0100 [conn1423281] end connection 172.28.0.163:60497 (399 connections now open) 2015-10-05T05:13:11.427+0100 [mongosMain] connection accepted from 172.28.0.163:61535 #1423730 (400 connections now open) 2015-10-05T05:13:11.428+0100 [conn1423730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:11.471+0100 [conn1423121] end connection 172.28.0.164:52978 (399 connections now open) 2015-10-05T05:13:11.471+0100 [conn1423330] end connection 172.28.0.164:53655 (398 connections now open) 2015-10-05T05:13:11.472+0100 [mongosMain] connection accepted from 172.28.0.164:54616 #1423731 (399 connections now open) 2015-10-05T05:13:11.472+0100 [mongosMain] connection accepted from 172.28.0.164:54615 #1423732 (400 connections now open) 2015-10-05T05:13:11.473+0100 [conn1423731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:11.473+0100 [conn1423732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:13.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8d95703b51053eb7946 2015-10-05T05:13:13.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:16.696+0100 [conn1423317] end connection 172.28.0.164:53629 (399 connections now open) 2015-10-05T05:13:16.697+0100 [mongosMain] connection accepted from 172.28.0.164:54619 #1423733 (400 connections now open) 2015-10-05T05:13:16.699+0100 [conn1423733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:17.164+0100 [conn1423351] end connection 172.28.0.164:53701 (399 connections now open) 2015-10-05T05:13:17.165+0100 [mongosMain] connection accepted from 172.28.0.164:54621 #1423734 (400 connections now open) 2015-10-05T05:13:17.167+0100 [conn1423734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:17.947+0100 [conn1423358] end connection 172.28.0.163:60654 (399 connections now open) 2015-10-05T05:13:17.948+0100 [mongosMain] connection accepted from 172.28.0.163:61545 #1423735 (400 connections now open) 2015-10-05T05:13:17.950+0100 [conn1423735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:20.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8df5703b51053eb796a 2015-10-05T05:13:20.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:21.442+0100 [conn1423206] end connection 172.28.0.163:60207 (399 connections now open) 2015-10-05T05:13:21.443+0100 [conn1423342] end connection 172.28.0.163:60608 (398 connections now open) 2015-10-05T05:13:21.445+0100 [mongosMain] connection accepted from 172.28.0.163:61550 #1423736 (399 connections now open) 2015-10-05T05:13:21.446+0100 [mongosMain] connection accepted from 172.28.0.163:61553 #1423737 (400 connections now open) 2015-10-05T05:13:21.446+0100 [conn1423736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:21.447+0100 [conn1423737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:21.486+0100 [conn1423347] end connection 172.28.0.164:53692 (399 connections now open) 2015-10-05T05:13:21.487+0100 [conn1423314] end connection 172.28.0.164:53625 (398 connections now open) 2015-10-05T05:13:21.488+0100 [mongosMain] connection accepted from 172.28.0.164:54627 #1423738 (399 connections now open) 2015-10-05T05:13:21.489+0100 [mongosMain] connection accepted from 172.28.0.164:54628 #1423739 (400 connections now open) 2015-10-05T05:13:21.490+0100 [conn1423738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:21.490+0100 [conn1423739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:26.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8e65703b51053eb7994 2015-10-05T05:13:26.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:26.712+0100 [conn1423325] end connection 172.28.0.164:53647 (399 connections now open) 2015-10-05T05:13:26.713+0100 [mongosMain] connection accepted from 172.28.0.164:54638 #1423740 (400 connections now open) 2015-10-05T05:13:26.715+0100 [conn1423740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:27.180+0100 [conn1423357] end connection 172.28.0.164:53713 (399 connections now open) 2015-10-05T05:13:27.182+0100 [mongosMain] connection accepted from 172.28.0.164:54640 #1423741 (400 connections now open) 2015-10-05T05:13:27.183+0100 [conn1423741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:27.308+0100 [conn1423327] end connection 172.28.0.163:60590 (399 connections now open) 2015-10-05T05:13:27.309+0100 [mongosMain] connection accepted from 172.28.0.163:61554 #1423742 (400 connections now open) 2015-10-05T05:13:27.311+0100 [conn1423742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:27.963+0100 [conn1423366] end connection 172.28.0.163:60670 (399 connections now open) 2015-10-05T05:13:27.965+0100 [mongosMain] connection accepted from 172.28.0.163:61556 #1423743 (400 connections now open) 2015-10-05T05:13:27.966+0100 [conn1423743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:29.140+0100 [mongosMain] connection accepted from 127.0.0.1:61558 #1423744 (401 connections now open) 2015-10-05T05:13:29.143+0100 [conn1423744] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:29.149+0100 [conn1423744] end connection 127.0.0.1:61558 (400 connections now open) 2015-10-05T05:13:31.446+0100 [conn1423333] end connection 172.28.0.163:60598 (399 connections now open) 2015-10-05T05:13:31.446+0100 [conn1423138] end connection 172.28.0.163:59952 (398 connections now open) 2015-10-05T05:13:31.447+0100 [mongosMain] connection accepted from 172.28.0.163:61559 #1423745 (399 connections now open) 2015-10-05T05:13:31.447+0100 [mongosMain] connection accepted from 172.28.0.163:61560 #1423746 (400 connections now open) 2015-10-05T05:13:31.448+0100 [conn1423745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:31.448+0100 [conn1423746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:31.480+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:13:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:13:31.502+0100 [conn1423197] end connection 172.28.0.164:53234 (399 connections now open) 2015-10-05T05:13:31.502+0100 [conn1423354] end connection 172.28.0.164:53709 (399 connections now open) 2015-10-05T05:13:31.503+0100 [mongosMain] connection accepted from 172.28.0.164:54647 #1423747 (399 connections now open) 2015-10-05T05:13:31.503+0100 [mongosMain] connection accepted from 172.28.0.164:54646 #1423748 (400 connections now open) 2015-10-05T05:13:31.504+0100 [conn1423747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:31.505+0100 [conn1423748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:32.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8ec5703b51053eb79c8 2015-10-05T05:13:32.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:36.728+0100 [conn1423356] end connection 172.28.0.164:53711 (399 connections now open) 2015-10-05T05:13:36.730+0100 [mongosMain] connection accepted from 172.28.0.164:54656 #1423749 (400 connections now open) 2015-10-05T05:13:36.732+0100 [conn1423749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:37.196+0100 [conn1423364] end connection 172.28.0.164:53724 (399 connections now open) 2015-10-05T05:13:37.197+0100 [mongosMain] connection accepted from 172.28.0.164:54658 #1423750 (400 connections now open) 2015-10-05T05:13:37.198+0100 [conn1423750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:37.323+0100 [conn1423365] end connection 172.28.0.163:60667 (399 connections now open) 2015-10-05T05:13:37.325+0100 [mongosMain] connection accepted from 172.28.0.163:61564 #1423751 (400 connections now open) 2015-10-05T05:13:37.326+0100 [conn1423751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:37.963+0100 [conn1423372] end connection 172.28.0.163:60682 (399 connections now open) 2015-10-05T05:13:37.965+0100 [mongosMain] connection accepted from 172.28.0.163:61566 #1423752 (400 connections now open) 2015-10-05T05:13:37.966+0100 [conn1423752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:39.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8f25703b51053eb79ec 2015-10-05T05:13:39.199+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:39.443+0100 [mongosMain] connection accepted from 127.0.0.1:61568 #1423753 (401 connections now open) 2015-10-05T05:13:39.445+0100 [conn1423753] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:39.449+0100 [conn1423753] end connection 127.0.0.1:61568 (400 connections now open) 2015-10-05T05:13:41.458+0100 [conn1423368] end connection 172.28.0.163:60675 (399 connections now open) 2015-10-05T05:13:41.458+0100 [conn1423289] end connection 172.28.0.163:60506 (399 connections now open) 2015-10-05T05:13:41.460+0100 [mongosMain] connection accepted from 172.28.0.163:61571 #1423754 (399 connections now open) 2015-10-05T05:13:41.460+0100 [mongosMain] connection accepted from 172.28.0.163:61572 #1423755 (400 connections now open) 2015-10-05T05:13:41.461+0100 [conn1423754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:41.461+0100 [conn1423755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:41.502+0100 [conn1423297] end connection 172.28.0.164:53588 (399 connections now open) 2015-10-05T05:13:41.502+0100 [conn1423360] end connection 172.28.0.164:53715 (399 connections now open) 2015-10-05T05:13:41.503+0100 [mongosMain] connection accepted from 172.28.0.164:54668 #1423756 (399 connections now open) 2015-10-05T05:13:41.503+0100 [mongosMain] connection accepted from 172.28.0.164:54669 #1423757 (400 connections now open) 2015-10-05T05:13:41.504+0100 [conn1423757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:41.504+0100 [conn1423756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:45.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8f95703b51053eb7a13 2015-10-05T05:13:45.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:46.728+0100 [conn1423363] end connection 172.28.0.164:53721 (399 connections now open) 2015-10-05T05:13:46.729+0100 [mongosMain] connection accepted from 172.28.0.164:54675 #1423758 (400 connections now open) 2015-10-05T05:13:46.731+0100 [conn1423758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:47.196+0100 [conn1423371] end connection 172.28.0.164:53740 (399 connections now open) 2015-10-05T05:13:47.197+0100 [mongosMain] connection accepted from 172.28.0.164:54679 #1423759 (400 connections now open) 2015-10-05T05:13:47.199+0100 [conn1423759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:47.323+0100 [conn1423336] end connection 172.28.0.163:60601 (399 connections now open) 2015-10-05T05:13:47.324+0100 [mongosMain] connection accepted from 172.28.0.163:61583 #1423760 (400 connections now open) 2015-10-05T05:13:47.325+0100 [conn1423760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:47.979+0100 [conn1423379] end connection 172.28.0.163:60691 (399 connections now open) 2015-10-05T05:13:47.980+0100 [mongosMain] connection accepted from 172.28.0.163:61585 #1423761 (400 connections now open) 2015-10-05T05:13:47.982+0100 [conn1423761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:51.464+0100 [conn1423212] end connection 172.28.0.163:60215 (399 connections now open) 2015-10-05T05:13:51.464+0100 [conn1423375] end connection 172.28.0.163:60686 (398 connections now open) 2015-10-05T05:13:51.471+0100 [mongosMain] connection accepted from 172.28.0.163:61591 #1423762 (399 connections now open) 2015-10-05T05:13:51.472+0100 [conn1423762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:51.476+0100 [mongosMain] connection accepted from 172.28.0.163:61592 #1423763 (400 connections now open) 2015-10-05T05:13:51.477+0100 [conn1423763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:51.518+0100 [conn1423321] end connection 172.28.0.164:53637 (399 connections now open) 2015-10-05T05:13:51.519+0100 [conn1423367] end connection 172.28.0.164:53730 (398 connections now open) 2015-10-05T05:13:51.520+0100 [mongosMain] connection accepted from 172.28.0.164:54684 #1423764 (399 connections now open) 2015-10-05T05:13:51.521+0100 [mongosMain] connection accepted from 172.28.0.164:54685 #1423765 (400 connections now open) 2015-10-05T05:13:51.522+0100 [conn1423764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:51.523+0100 [conn1423765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:51.906+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f8ff5703b51053eb7a3a 2015-10-05T05:13:52.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:13:56.743+0100 [conn1423350] end connection 172.28.0.164:53699 (399 connections now open) 2015-10-05T05:13:56.748+0100 [mongosMain] connection accepted from 172.28.0.164:54692 #1423766 (400 connections now open) 2015-10-05T05:13:56.752+0100 [conn1423766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:57.211+0100 [conn1423377] end connection 172.28.0.164:53758 (399 connections now open) 2015-10-05T05:13:57.213+0100 [mongosMain] connection accepted from 172.28.0.164:54694 #1423767 (400 connections now open) 2015-10-05T05:13:57.215+0100 [conn1423767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:57.339+0100 [conn1423319] end connection 172.28.0.163:60580 (399 connections now open) 2015-10-05T05:13:57.340+0100 [mongosMain] connection accepted from 172.28.0.163:61600 #1423768 (400 connections now open) 2015-10-05T05:13:57.341+0100 [conn1423768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:57.995+0100 [conn1423387] end connection 172.28.0.163:60707 (399 connections now open) 2015-10-05T05:13:57.996+0100 [mongosMain] connection accepted from 172.28.0.163:61602 #1423769 (400 connections now open) 2015-10-05T05:13:57.997+0100 [conn1423769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:13:58.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9065703b51053eb7a63 2015-10-05T05:13:58.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:01.474+0100 [conn1423361] end connection 172.28.0.163:60659 (399 connections now open) 2015-10-05T05:14:01.474+0100 [conn1423116] end connection 172.28.0.163:59839 (399 connections now open) 2015-10-05T05:14:01.475+0100 [mongosMain] connection accepted from 172.28.0.163:61608 #1423770 (399 connections now open) 2015-10-05T05:14:01.475+0100 [mongosMain] connection accepted from 172.28.0.163:61609 #1423771 (400 connections now open) 2015-10-05T05:14:01.476+0100 [conn1423770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:01.477+0100 [conn1423771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:01.518+0100 [conn1423381] end connection 172.28.0.164:53768 (399 connections now open) 2015-10-05T05:14:01.518+0100 [conn1423303] end connection 172.28.0.164:53600 (398 connections now open) 2015-10-05T05:14:01.520+0100 [mongosMain] connection accepted from 172.28.0.164:54699 #1423772 (399 connections now open) 2015-10-05T05:14:01.520+0100 [mongosMain] connection accepted from 172.28.0.164:54700 #1423773 (400 connections now open) 2015-10-05T05:14:01.522+0100 [conn1423772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:01.522+0100 [conn1423773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:01.643+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:14:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:14:04.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f90c5703b51053eb7aa2 2015-10-05T05:14:04.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:06.760+0100 [conn1423376] end connection 172.28.0.164:53754 (399 connections now open) 2015-10-05T05:14:06.761+0100 [mongosMain] connection accepted from 172.28.0.164:54702 #1423774 (400 connections now open) 2015-10-05T05:14:06.762+0100 [conn1423774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:07.212+0100 [conn1423385] end connection 172.28.0.164:53778 (399 connections now open) 2015-10-05T05:14:07.213+0100 [mongosMain] connection accepted from 172.28.0.164:54704 #1423775 (400 connections now open) 2015-10-05T05:14:07.215+0100 [conn1423775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:07.339+0100 [conn1423306] end connection 172.28.0.163:60543 (399 connections now open) 2015-10-05T05:14:07.340+0100 [mongosMain] connection accepted from 172.28.0.163:61621 #1423776 (400 connections now open) 2015-10-05T05:14:07.341+0100 [conn1423776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:07.995+0100 [conn1423394] end connection 172.28.0.163:60723 (399 connections now open) 2015-10-05T05:14:07.996+0100 [mongosMain] connection accepted from 172.28.0.163:61623 #1423777 (400 connections now open) 2015-10-05T05:14:07.997+0100 [conn1423777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:10.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9125703b51053eb7ac5 2015-10-05T05:14:10.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:11.476+0100 [conn1423299] end connection 172.28.0.163:60521 (399 connections now open) 2015-10-05T05:14:11.477+0100 [conn1423390] end connection 172.28.0.163:60714 (398 connections now open) 2015-10-05T05:14:11.478+0100 [mongosMain] connection accepted from 172.28.0.163:61628 #1423778 (399 connections now open) 2015-10-05T05:14:11.479+0100 [mongosMain] connection accepted from 172.28.0.163:61629 #1423779 (400 connections now open) 2015-10-05T05:14:11.480+0100 [conn1423778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:11.480+0100 [conn1423779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:11.534+0100 [conn1423374] end connection 172.28.0.164:53747 (399 connections now open) 2015-10-05T05:14:11.535+0100 [conn1423348] end connection 172.28.0.164:53693 (398 connections now open) 2015-10-05T05:14:11.535+0100 [mongosMain] connection accepted from 172.28.0.164:54707 #1423780 (399 connections now open) 2015-10-05T05:14:11.536+0100 [mongosMain] connection accepted from 172.28.0.164:54708 #1423781 (400 connections now open) 2015-10-05T05:14:11.537+0100 [conn1423780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:11.538+0100 [conn1423781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:16.775+0100 [conn1423334] end connection 172.28.0.164:53665 (399 connections now open) 2015-10-05T05:14:16.776+0100 [mongosMain] connection accepted from 172.28.0.164:54712 #1423782 (400 connections now open) 2015-10-05T05:14:16.777+0100 [conn1423782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:17.227+0100 [conn1423392] end connection 172.28.0.164:53798 (399 connections now open) 2015-10-05T05:14:17.228+0100 [mongosMain] connection accepted from 172.28.0.164:54714 #1423783 (400 connections now open) 2015-10-05T05:14:17.230+0100 [conn1423783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:17.355+0100 [conn1423345] end connection 172.28.0.163:60617 (399 connections now open) 2015-10-05T05:14:17.356+0100 [mongosMain] connection accepted from 172.28.0.163:61639 #1423784 (400 connections now open) 2015-10-05T05:14:17.357+0100 [conn1423784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:18.011+0100 [conn1423400] end connection 172.28.0.163:60744 (399 connections now open) 2015-10-05T05:14:18.012+0100 [mongosMain] connection accepted from 172.28.0.163:61641 #1423785 (400 connections now open) 2015-10-05T05:14:18.014+0100 [conn1423785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:21.489+0100 [conn1423078] end connection 172.28.0.163:59678 (399 connections now open) 2015-10-05T05:14:21.489+0100 [conn1423383] end connection 172.28.0.163:60698 (399 connections now open) 2015-10-05T05:14:21.490+0100 [mongosMain] connection accepted from 172.28.0.163:61644 #1423786 (399 connections now open) 2015-10-05T05:14:21.491+0100 [mongosMain] connection accepted from 172.28.0.163:61645 #1423787 (400 connections now open) 2015-10-05T05:14:21.492+0100 [conn1423787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:21.492+0100 [conn1423786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:21.550+0100 [conn1423339] end connection 172.28.0.164:53676 (399 connections now open) 2015-10-05T05:14:21.550+0100 [conn1423388] end connection 172.28.0.164:53787 (398 connections now open) 2015-10-05T05:14:21.552+0100 [mongosMain] connection accepted from 172.28.0.164:54725 #1423788 (399 connections now open) 2015-10-05T05:14:21.552+0100 [mongosMain] connection accepted from 172.28.0.164:54724 #1423789 (400 connections now open) 2015-10-05T05:14:21.554+0100 [conn1423788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:21.554+0100 [conn1423789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:23.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f91e5703b51053eb7afa 2015-10-05T05:14:23.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:26.791+0100 [conn1423384] end connection 172.28.0.164:53776 (399 connections now open) 2015-10-05T05:14:26.792+0100 [mongosMain] connection accepted from 172.28.0.164:54735 #1423790 (400 connections now open) 2015-10-05T05:14:26.794+0100 [conn1423790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:27.243+0100 [conn1423398] end connection 172.28.0.164:53812 (399 connections now open) 2015-10-05T05:14:27.244+0100 [mongosMain] connection accepted from 172.28.0.164:54737 #1423791 (400 connections now open) 2015-10-05T05:14:27.246+0100 [conn1423791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:27.370+0100 [conn1423311] end connection 172.28.0.163:60564 (399 connections now open) 2015-10-05T05:14:27.371+0100 [mongosMain] connection accepted from 172.28.0.163:61648 #1423792 (400 connections now open) 2015-10-05T05:14:27.373+0100 [conn1423792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:28.011+0100 [conn1423407] end connection 172.28.0.163:60762 (399 connections now open) 2015-10-05T05:14:28.014+0100 [mongosMain] connection accepted from 172.28.0.163:61650 #1423793 (400 connections now open) 2015-10-05T05:14:28.015+0100 [conn1423793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:28.975+0100 [mongosMain] connection accepted from 127.0.0.1:61652 #1423794 (401 connections now open) 2015-10-05T05:14:28.978+0100 [conn1423794] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:28.984+0100 [conn1423794] end connection 127.0.0.1:61652 (400 connections now open) 2015-10-05T05:14:29.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9255703b51053eb7b1e 2015-10-05T05:14:29.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:31.506+0100 [conn1423396] end connection 172.28.0.163:60734 (399 connections now open) 2015-10-05T05:14:31.506+0100 [conn1423163] end connection 172.28.0.163:60061 (399 connections now open) 2015-10-05T05:14:31.506+0100 [mongosMain] connection accepted from 172.28.0.163:61653 #1423795 (399 connections now open) 2015-10-05T05:14:31.507+0100 [mongosMain] connection accepted from 172.28.0.163:61654 #1423796 (400 connections now open) 2015-10-05T05:14:31.507+0100 [conn1423795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:31.508+0100 [conn1423796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:31.566+0100 [conn1423395] end connection 172.28.0.164:53808 (399 connections now open) 2015-10-05T05:14:31.566+0100 [conn1423382] end connection 172.28.0.164:53769 (398 connections now open) 2015-10-05T05:14:31.567+0100 [mongosMain] connection accepted from 172.28.0.164:54744 #1423797 (399 connections now open) 2015-10-05T05:14:31.568+0100 [mongosMain] connection accepted from 172.28.0.164:54745 #1423798 (400 connections now open) 2015-10-05T05:14:31.569+0100 [conn1423797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:31.569+0100 [conn1423798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:31.918+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:14:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:14:35.774+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:14:35.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:14:36.790+0100 [conn1423370] end connection 172.28.0.164:53738 (399 connections now open) 2015-10-05T05:14:36.791+0100 [mongosMain] connection accepted from 172.28.0.164:54753 #1423799 (400 connections now open) 2015-10-05T05:14:36.792+0100 [conn1423799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:37.258+0100 [conn1423405] end connection 172.28.0.164:53823 (399 connections now open) 2015-10-05T05:14:37.259+0100 [mongosMain] connection accepted from 172.28.0.164:54758 #1423800 (400 connections now open) 2015-10-05T05:14:37.260+0100 [conn1423800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:37.370+0100 [conn1423378] end connection 172.28.0.163:60690 (399 connections now open) 2015-10-05T05:14:37.371+0100 [mongosMain] connection accepted from 172.28.0.163:61658 #1423801 (400 connections now open) 2015-10-05T05:14:37.372+0100 [conn1423801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:38.026+0100 [conn1423415] end connection 172.28.0.163:60771 (399 connections now open) 2015-10-05T05:14:38.028+0100 [mongosMain] connection accepted from 172.28.0.163:61660 #1423802 (400 connections now open) 2015-10-05T05:14:38.029+0100 [conn1423802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:39.619+0100 [mongosMain] connection accepted from 127.0.0.1:61662 #1423803 (401 connections now open) 2015-10-05T05:14:39.622+0100 [conn1423803] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:39.626+0100 [conn1423803] end connection 127.0.0.1:61662 (400 connections now open) 2015-10-05T05:14:41.506+0100 [conn1423411] end connection 172.28.0.163:60766 (399 connections now open) 2015-10-05T05:14:41.506+0100 [conn1423180] end connection 172.28.0.163:60083 (399 connections now open) 2015-10-05T05:14:41.507+0100 [mongosMain] connection accepted from 172.28.0.163:61666 #1423804 (399 connections now open) 2015-10-05T05:14:41.508+0100 [mongosMain] connection accepted from 172.28.0.163:61667 #1423805 (400 connections now open) 2015-10-05T05:14:41.508+0100 [conn1423804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:41.508+0100 [conn1423805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:41.580+0100 [conn1423401] end connection 172.28.0.164:53816 (399 connections now open) 2015-10-05T05:14:41.581+0100 [conn1423279] end connection 172.28.0.164:53552 (398 connections now open) 2015-10-05T05:14:41.592+0100 [mongosMain] connection accepted from 172.28.0.164:54765 #1423806 (399 connections now open) 2015-10-05T05:14:41.592+0100 [mongosMain] connection accepted from 172.28.0.164:54766 #1423807 (400 connections now open) 2015-10-05T05:14:41.594+0100 [conn1423807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:41.594+0100 [conn1423806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:42.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9315703b51053eb7b75 2015-10-05T05:14:42.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:46.806+0100 [conn1423412] end connection 172.28.0.164:53840 (399 connections now open) 2015-10-05T05:14:46.808+0100 [mongosMain] connection accepted from 172.28.0.164:54772 #1423808 (400 connections now open) 2015-10-05T05:14:46.809+0100 [conn1423808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:47.275+0100 [conn1423413] end connection 172.28.0.164:53842 (399 connections now open) 2015-10-05T05:14:47.276+0100 [mongosMain] connection accepted from 172.28.0.164:54775 #1423809 (400 connections now open) 2015-10-05T05:14:47.278+0100 [conn1423809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:47.387+0100 [conn1423386] end connection 172.28.0.163:60705 (399 connections now open) 2015-10-05T05:14:47.388+0100 [mongosMain] connection accepted from 172.28.0.163:61677 #1423810 (400 connections now open) 2015-10-05T05:14:47.389+0100 [conn1423810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:48.027+0100 [conn1423424] end connection 172.28.0.163:60783 (399 connections now open) 2015-10-05T05:14:48.028+0100 [mongosMain] connection accepted from 172.28.0.163:61679 #1423811 (400 connections now open) 2015-10-05T05:14:48.029+0100 [conn1423811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:51.522+0100 [conn1423217] end connection 172.28.0.163:60225 (399 connections now open) 2015-10-05T05:14:51.522+0100 [conn1423419] end connection 172.28.0.163:60777 (399 connections now open) 2015-10-05T05:14:51.523+0100 [mongosMain] connection accepted from 172.28.0.163:61684 #1423812 (399 connections now open) 2015-10-05T05:14:51.523+0100 [mongosMain] connection accepted from 172.28.0.163:61685 #1423813 (400 connections now open) 2015-10-05T05:14:51.524+0100 [conn1423812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:51.524+0100 [conn1423813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:51.597+0100 [conn1423409] end connection 172.28.0.164:53832 (399 connections now open) 2015-10-05T05:14:51.597+0100 [conn1423353] end connection 172.28.0.164:53708 (399 connections now open) 2015-10-05T05:14:51.598+0100 [mongosMain] connection accepted from 172.28.0.164:54783 #1423814 (399 connections now open) 2015-10-05T05:14:51.598+0100 [mongosMain] connection accepted from 172.28.0.164:54784 #1423815 (400 connections now open) 2015-10-05T05:14:51.599+0100 [conn1423814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:51.599+0100 [conn1423815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:54.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f93e5703b51053eb7bca 2015-10-05T05:14:54.626+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:14:56.806+0100 [conn1423391] end connection 172.28.0.164:53796 (399 connections now open) 2015-10-05T05:14:56.808+0100 [mongosMain] connection accepted from 172.28.0.164:54789 #1423816 (400 connections now open) 2015-10-05T05:14:56.809+0100 [conn1423816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:57.274+0100 [conn1423422] end connection 172.28.0.164:53866 (399 connections now open) 2015-10-05T05:14:57.278+0100 [mongosMain] connection accepted from 172.28.0.164:54791 #1423817 (400 connections now open) 2015-10-05T05:14:57.279+0100 [conn1423817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:57.386+0100 [conn1423399] end connection 172.28.0.163:60742 (399 connections now open) 2015-10-05T05:14:57.387+0100 [mongosMain] connection accepted from 172.28.0.163:61707 #1423818 (400 connections now open) 2015-10-05T05:14:57.389+0100 [conn1423818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:14:58.043+0100 [conn1423433] end connection 172.28.0.163:60801 (399 connections now open) 2015-10-05T05:14:58.044+0100 [mongosMain] connection accepted from 172.28.0.163:61710 #1423819 (400 connections now open) 2015-10-05T05:14:58.045+0100 [conn1423819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:01.523+0100 [conn1423428] end connection 172.28.0.163:60788 (399 connections now open) 2015-10-05T05:15:01.523+0100 [conn1423341] end connection 172.28.0.163:60607 (398 connections now open) 2015-10-05T05:15:01.524+0100 [mongosMain] connection accepted from 172.28.0.163:61722 #1423820 (399 connections now open) 2015-10-05T05:15:01.524+0100 [mongosMain] connection accepted from 172.28.0.163:61723 #1423821 (400 connections now open) 2015-10-05T05:15:01.525+0100 [conn1423820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:01.525+0100 [conn1423821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:01.597+0100 [conn1423418] end connection 172.28.0.164:53852 (399 connections now open) 2015-10-05T05:15:01.598+0100 [conn1423331] end connection 172.28.0.164:53656 (398 connections now open) 2015-10-05T05:15:01.599+0100 [mongosMain] connection accepted from 172.28.0.164:54801 #1423822 (399 connections now open) 2015-10-05T05:15:01.600+0100 [mongosMain] connection accepted from 172.28.0.164:54802 #1423823 (400 connections now open) 2015-10-05T05:15:01.601+0100 [conn1423822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:01.601+0100 [conn1423823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:02.173+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:15:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:15:06.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f94a5703b51053eb7c24 2015-10-05T05:15:06.823+0100 [conn1423430] end connection 172.28.0.164:53882 (399 connections now open) 2015-10-05T05:15:06.824+0100 [mongosMain] connection accepted from 172.28.0.164:54806 #1423824 (400 connections now open) 2015-10-05T05:15:06.826+0100 [conn1423824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:06.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:07.291+0100 [conn1423431] end connection 172.28.0.164:53884 (399 connections now open) 2015-10-05T05:15:07.292+0100 [mongosMain] connection accepted from 172.28.0.164:54810 #1423825 (400 connections now open) 2015-10-05T05:15:07.293+0100 [conn1423825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:07.402+0100 [conn1423393] end connection 172.28.0.163:60721 (399 connections now open) 2015-10-05T05:15:07.403+0100 [mongosMain] connection accepted from 172.28.0.163:61733 #1423826 (400 connections now open) 2015-10-05T05:15:07.404+0100 [conn1423826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:08.043+0100 [conn1423441] end connection 172.28.0.163:60821 (399 connections now open) 2015-10-05T05:15:08.044+0100 [mongosMain] connection accepted from 172.28.0.163:61736 #1423827 (400 connections now open) 2015-10-05T05:15:08.045+0100 [conn1423827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:11.537+0100 [conn1423304] end connection 172.28.0.163:60535 (399 connections now open) 2015-10-05T05:15:11.537+0100 [conn1423403] end connection 172.28.0.163:60749 (398 connections now open) 2015-10-05T05:15:11.538+0100 [mongosMain] connection accepted from 172.28.0.163:61741 #1423828 (399 connections now open) 2015-10-05T05:15:11.538+0100 [mongosMain] connection accepted from 172.28.0.163:61742 #1423829 (400 connections now open) 2015-10-05T05:15:11.539+0100 [conn1423828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:11.540+0100 [conn1423829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:11.613+0100 [conn1423435] end connection 172.28.0.164:53894 (399 connections now open) 2015-10-05T05:15:11.613+0100 [conn1423359] end connection 172.28.0.164:53714 (398 connections now open) 2015-10-05T05:15:11.614+0100 [mongosMain] connection accepted from 172.28.0.164:54814 #1423830 (399 connections now open) 2015-10-05T05:15:11.614+0100 [mongosMain] connection accepted from 172.28.0.164:54815 #1423831 (400 connections now open) 2015-10-05T05:15:11.615+0100 [conn1423830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:11.616+0100 [conn1423831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:13.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9505703b51053eb7c54 2015-10-05T05:15:13.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:16.838+0100 [conn1423397] end connection 172.28.0.164:53810 (399 connections now open) 2015-10-05T05:15:16.839+0100 [mongosMain] connection accepted from 172.28.0.164:54820 #1423832 (400 connections now open) 2015-10-05T05:15:16.841+0100 [conn1423832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:17.305+0100 [conn1423439] end connection 172.28.0.164:53904 (399 connections now open) 2015-10-05T05:15:17.306+0100 [mongosMain] connection accepted from 172.28.0.164:54822 #1423833 (400 connections now open) 2015-10-05T05:15:17.308+0100 [conn1423833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:17.402+0100 [conn1423406] end connection 172.28.0.163:60760 (399 connections now open) 2015-10-05T05:15:17.403+0100 [mongosMain] connection accepted from 172.28.0.163:61751 #1423834 (400 connections now open) 2015-10-05T05:15:17.404+0100 [conn1423834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:18.058+0100 [conn1423448] end connection 172.28.0.163:60843 (399 connections now open) 2015-10-05T05:15:18.059+0100 [mongosMain] connection accepted from 172.28.0.163:61753 #1423835 (400 connections now open) 2015-10-05T05:15:18.061+0100 [conn1423835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:19.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9575703b51053eb7c84 2015-10-05T05:15:19.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:21.539+0100 [conn1423443] end connection 172.28.0.163:60828 (399 connections now open) 2015-10-05T05:15:21.539+0100 [conn1423332] end connection 172.28.0.163:60597 (398 connections now open) 2015-10-05T05:15:21.540+0100 [mongosMain] connection accepted from 172.28.0.163:61758 #1423836 (399 connections now open) 2015-10-05T05:15:21.540+0100 [mongosMain] connection accepted from 172.28.0.163:61757 #1423837 (400 connections now open) 2015-10-05T05:15:21.541+0100 [conn1423837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:21.541+0100 [conn1423836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:21.628+0100 [conn1423389] end connection 172.28.0.164:53788 (399 connections now open) 2015-10-05T05:15:21.628+0100 [conn1423442] end connection 172.28.0.164:53919 (398 connections now open) 2015-10-05T05:15:21.630+0100 [mongosMain] connection accepted from 172.28.0.164:54831 #1423838 (399 connections now open) 2015-10-05T05:15:21.630+0100 [mongosMain] connection accepted from 172.28.0.164:54830 #1423839 (400 connections now open) 2015-10-05T05:15:21.632+0100 [conn1423838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:21.632+0100 [conn1423839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:25.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f95d5703b51053eb7ca0 2015-10-05T05:15:25.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:26.838+0100 [conn1423421] end connection 172.28.0.164:53862 (399 connections now open) 2015-10-05T05:15:26.839+0100 [mongosMain] connection accepted from 172.28.0.164:54841 #1423840 (400 connections now open) 2015-10-05T05:15:26.841+0100 [conn1423840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:27.306+0100 [conn1423446] end connection 172.28.0.164:53924 (399 connections now open) 2015-10-05T05:15:27.307+0100 [mongosMain] connection accepted from 172.28.0.164:54843 #1423841 (400 connections now open) 2015-10-05T05:15:27.308+0100 [conn1423841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:27.418+0100 [conn1423414] end connection 172.28.0.163:60769 (399 connections now open) 2015-10-05T05:15:27.420+0100 [mongosMain] connection accepted from 172.28.0.163:61761 #1423842 (400 connections now open) 2015-10-05T05:15:27.421+0100 [conn1423842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:28.074+0100 [conn1423456] end connection 172.28.0.163:60858 (399 connections now open) 2015-10-05T05:15:28.076+0100 [mongosMain] connection accepted from 172.28.0.163:61763 #1423843 (400 connections now open) 2015-10-05T05:15:28.077+0100 [conn1423843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:28.696+0100 [mongosMain] connection accepted from 127.0.0.1:61765 #1423844 (401 connections now open) 2015-10-05T05:15:28.698+0100 [conn1423844] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:28.704+0100 [conn1423844] end connection 127.0.0.1:61765 (400 connections now open) 2015-10-05T05:15:31.552+0100 [conn1423451] end connection 172.28.0.163:60847 (399 connections now open) 2015-10-05T05:15:31.552+0100 [conn1423324] end connection 172.28.0.163:60585 (399 connections now open) 2015-10-05T05:15:31.554+0100 [mongosMain] connection accepted from 172.28.0.163:61767 #1423845 (399 connections now open) 2015-10-05T05:15:31.554+0100 [mongosMain] connection accepted from 172.28.0.163:61768 #1423846 (400 connections now open) 2015-10-05T05:15:31.555+0100 [conn1423845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:31.555+0100 [conn1423846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:31.643+0100 [conn1423450] end connection 172.28.0.164:53927 (399 connections now open) 2015-10-05T05:15:31.643+0100 [conn1423402] end connection 172.28.0.164:53817 (398 connections now open) 2015-10-05T05:15:31.644+0100 [mongosMain] connection accepted from 172.28.0.164:54850 #1423847 (399 connections now open) 2015-10-05T05:15:31.645+0100 [mongosMain] connection accepted from 172.28.0.164:54851 #1423848 (400 connections now open) 2015-10-05T05:15:31.646+0100 [conn1423847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:31.646+0100 [conn1423848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:32.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9635703b51053eb7cbc 2015-10-05T05:15:32.390+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:32.458+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:15:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:15:36.853+0100 [conn1423445] end connection 172.28.0.164:53922 (399 connections now open) 2015-10-05T05:15:36.855+0100 [mongosMain] connection accepted from 172.28.0.164:54858 #1423849 (400 connections now open) 2015-10-05T05:15:36.856+0100 [conn1423849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:37.321+0100 [conn1423454] end connection 172.28.0.164:53933 (399 connections now open) 2015-10-05T05:15:37.322+0100 [mongosMain] connection accepted from 172.28.0.164:54860 #1423850 (400 connections now open) 2015-10-05T05:15:37.324+0100 [conn1423850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:37.418+0100 [conn1423440] end connection 172.28.0.163:60819 (399 connections now open) 2015-10-05T05:15:37.420+0100 [mongosMain] connection accepted from 172.28.0.163:61773 #1423851 (400 connections now open) 2015-10-05T05:15:37.421+0100 [conn1423851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:38.074+0100 [conn1423464] end connection 172.28.0.163:60866 (399 connections now open) 2015-10-05T05:15:38.075+0100 [mongosMain] connection accepted from 172.28.0.163:61775 #1423852 (400 connections now open) 2015-10-05T05:15:38.076+0100 [conn1423852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:38.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f96a5703b51053eb7cd9 2015-10-05T05:15:38.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:40.141+0100 [mongosMain] connection accepted from 127.0.0.1:61777 #1423853 (401 connections now open) 2015-10-05T05:15:40.145+0100 [conn1423853] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:40.149+0100 [conn1423853] end connection 127.0.0.1:61777 (400 connections now open) 2015-10-05T05:15:41.557+0100 [conn1423436] end connection 172.28.0.163:60809 (399 connections now open) 2015-10-05T05:15:41.558+0100 [conn1423369] end connection 172.28.0.163:60676 (399 connections now open) 2015-10-05T05:15:41.559+0100 [mongosMain] connection accepted from 172.28.0.163:61779 #1423854 (399 connections now open) 2015-10-05T05:15:41.559+0100 [mongosMain] connection accepted from 172.28.0.163:61780 #1423855 (400 connections now open) 2015-10-05T05:15:41.560+0100 [conn1423854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:41.560+0100 [conn1423855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:41.659+0100 [conn1423426] end connection 172.28.0.164:53874 (399 connections now open) 2015-10-05T05:15:41.659+0100 [conn1423417] end connection 172.28.0.164:53851 (398 connections now open) 2015-10-05T05:15:41.660+0100 [mongosMain] connection accepted from 172.28.0.164:54869 #1423856 (399 connections now open) 2015-10-05T05:15:41.660+0100 [mongosMain] connection accepted from 172.28.0.164:54870 #1423857 (400 connections now open) 2015-10-05T05:15:41.661+0100 [conn1423856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:41.662+0100 [conn1423857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:45.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9705703b51053eb7cf7 2015-10-05T05:15:45.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:46.853+0100 [conn1423438] end connection 172.28.0.164:53901 (399 connections now open) 2015-10-05T05:15:46.854+0100 [mongosMain] connection accepted from 172.28.0.164:54877 #1423858 (400 connections now open) 2015-10-05T05:15:46.856+0100 [conn1423858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:47.323+0100 [conn1423462] end connection 172.28.0.164:53960 (399 connections now open) 2015-10-05T05:15:47.324+0100 [mongosMain] connection accepted from 172.28.0.164:54879 #1423859 (400 connections now open) 2015-10-05T05:15:47.325+0100 [conn1423859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:47.433+0100 [conn1423423] end connection 172.28.0.163:60781 (399 connections now open) 2015-10-05T05:15:47.434+0100 [mongosMain] connection accepted from 172.28.0.163:61790 #1423860 (400 connections now open) 2015-10-05T05:15:47.435+0100 [conn1423860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:48.090+0100 [conn1423473] end connection 172.28.0.163:60881 (399 connections now open) 2015-10-05T05:15:48.091+0100 [mongosMain] connection accepted from 172.28.0.163:61793 #1423861 (400 connections now open) 2015-10-05T05:15:48.092+0100 [conn1423861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:51.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9775703b51053eb7d14 2015-10-05T05:15:51.568+0100 [conn1423309] end connection 172.28.0.163:60555 (399 connections now open) 2015-10-05T05:15:51.568+0100 [conn1423469] end connection 172.28.0.163:60874 (398 connections now open) 2015-10-05T05:15:51.570+0100 [mongosMain] connection accepted from 172.28.0.163:61797 #1423862 (399 connections now open) 2015-10-05T05:15:51.571+0100 [mongosMain] connection accepted from 172.28.0.163:61798 #1423863 (400 connections now open) 2015-10-05T05:15:51.572+0100 [conn1423862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:51.572+0100 [conn1423863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:51.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:51.660+0100 [conn1423449] end connection 172.28.0.164:53928 (399 connections now open) 2015-10-05T05:15:51.660+0100 [conn1423457] end connection 172.28.0.164:53949 (398 connections now open) 2015-10-05T05:15:51.662+0100 [mongosMain] connection accepted from 172.28.0.164:54886 #1423864 (399 connections now open) 2015-10-05T05:15:51.662+0100 [mongosMain] connection accepted from 172.28.0.164:54887 #1423865 (400 connections now open) 2015-10-05T05:15:51.664+0100 [conn1423864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:51.664+0100 [conn1423865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:56.869+0100 [conn1423453] end connection 172.28.0.164:53931 (399 connections now open) 2015-10-05T05:15:56.871+0100 [mongosMain] connection accepted from 172.28.0.164:54894 #1423866 (400 connections now open) 2015-10-05T05:15:56.874+0100 [conn1423866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:57.337+0100 [conn1423471] end connection 172.28.0.164:53984 (399 connections now open) 2015-10-05T05:15:57.338+0100 [mongosMain] connection accepted from 172.28.0.164:54896 #1423867 (400 connections now open) 2015-10-05T05:15:57.340+0100 [conn1423867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:57.449+0100 [conn1423447] end connection 172.28.0.163:60840 (399 connections now open) 2015-10-05T05:15:57.450+0100 [mongosMain] connection accepted from 172.28.0.163:61808 #1423868 (400 connections now open) 2015-10-05T05:15:57.451+0100 [conn1423868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:15:57.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f97d5703b51053eb7d26 2015-10-05T05:15:58.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:15:58.090+0100 [conn1423482] end connection 172.28.0.163:60901 (399 connections now open) 2015-10-05T05:15:58.092+0100 [mongosMain] connection accepted from 172.28.0.163:61811 #1423869 (400 connections now open) 2015-10-05T05:15:58.093+0100 [conn1423869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:01.584+0100 [conn1423460] end connection 172.28.0.163:60862 (399 connections now open) 2015-10-05T05:16:01.584+0100 [conn1423349] end connection 172.28.0.163:60625 (398 connections now open) 2015-10-05T05:16:01.586+0100 [mongosMain] connection accepted from 172.28.0.163:61820 #1423870 (399 connections now open) 2015-10-05T05:16:01.586+0100 [mongosMain] connection accepted from 172.28.0.163:61821 #1423871 (400 connections now open) 2015-10-05T05:16:01.587+0100 [conn1423870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:01.587+0100 [conn1423871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:01.676+0100 [conn1423466] end connection 172.28.0.164:53970 (399 connections now open) 2015-10-05T05:16:01.676+0100 [conn1423483] end connection 172.28.0.164:54008 (399 connections now open) 2015-10-05T05:16:01.677+0100 [mongosMain] connection accepted from 172.28.0.164:54901 #1423872 (399 connections now open) 2015-10-05T05:16:01.677+0100 [mongosMain] connection accepted from 172.28.0.164:54902 #1423873 (400 connections now open) 2015-10-05T05:16:01.679+0100 [conn1423872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:01.679+0100 [conn1423873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:02.654+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:16:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:16:04.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9845703b51053eb7d49 2015-10-05T05:16:04.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:06.870+0100 [conn1423404] end connection 172.28.0.164:53821 (399 connections now open) 2015-10-05T05:16:06.871+0100 [mongosMain] connection accepted from 172.28.0.164:54905 #1423874 (400 connections now open) 2015-10-05T05:16:06.872+0100 [conn1423874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:07.338+0100 [conn1423480] end connection 172.28.0.164:54002 (399 connections now open) 2015-10-05T05:16:07.339+0100 [mongosMain] connection accepted from 172.28.0.164:54907 #1423875 (400 connections now open) 2015-10-05T05:16:07.341+0100 [conn1423875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:07.449+0100 [conn1423455] end connection 172.28.0.163:60856 (399 connections now open) 2015-10-05T05:16:07.451+0100 [mongosMain] connection accepted from 172.28.0.163:61830 #1423876 (400 connections now open) 2015-10-05T05:16:07.452+0100 [conn1423876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:08.105+0100 [conn1423490] end connection 172.28.0.163:60916 (399 connections now open) 2015-10-05T05:16:08.107+0100 [mongosMain] connection accepted from 172.28.0.163:61832 #1423877 (400 connections now open) 2015-10-05T05:16:08.107+0100 [conn1423877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:10.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f98a5703b51053eb7d5d 2015-10-05T05:16:10.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:11.611+0100 [conn1423486] end connection 172.28.0.163:60906 (399 connections now open) 2015-10-05T05:16:11.612+0100 [conn1423355] end connection 172.28.0.163:60645 (398 connections now open) 2015-10-05T05:16:11.613+0100 [mongosMain] connection accepted from 172.28.0.163:61836 #1423878 (399 connections now open) 2015-10-05T05:16:11.613+0100 [mongosMain] connection accepted from 172.28.0.163:61837 #1423879 (400 connections now open) 2015-10-05T05:16:11.614+0100 [conn1423878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:11.614+0100 [conn1423879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:11.675+0100 [conn1423475] end connection 172.28.0.164:53991 (399 connections now open) 2015-10-05T05:16:11.676+0100 [conn1423476] end connection 172.28.0.164:53992 (398 connections now open) 2015-10-05T05:16:11.677+0100 [mongosMain] connection accepted from 172.28.0.164:54912 #1423880 (399 connections now open) 2015-10-05T05:16:11.678+0100 [mongosMain] connection accepted from 172.28.0.164:54913 #1423881 (400 connections now open) 2015-10-05T05:16:11.679+0100 [conn1423880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:11.679+0100 [conn1423881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:16.885+0100 [conn1423487] end connection 172.28.0.164:54015 (399 connections now open) 2015-10-05T05:16:16.887+0100 [mongosMain] connection accepted from 172.28.0.164:54918 #1423882 (400 connections now open) 2015-10-05T05:16:16.888+0100 [conn1423882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:17.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9905703b51053eb7d75 2015-10-05T05:16:17.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:17.353+0100 [conn1423488] end connection 172.28.0.164:54017 (399 connections now open) 2015-10-05T05:16:17.354+0100 [mongosMain] connection accepted from 172.28.0.164:54921 #1423883 (400 connections now open) 2015-10-05T05:16:17.356+0100 [conn1423883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:17.465+0100 [conn1423432] end connection 172.28.0.163:60799 (399 connections now open) 2015-10-05T05:16:17.466+0100 [mongosMain] connection accepted from 172.28.0.163:61844 #1423884 (400 connections now open) 2015-10-05T05:16:17.467+0100 [conn1423884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:18.106+0100 [conn1423496] end connection 172.28.0.163:60936 (399 connections now open) 2015-10-05T05:16:18.107+0100 [mongosMain] connection accepted from 172.28.0.163:61845 #1423885 (400 connections now open) 2015-10-05T05:16:18.108+0100 [conn1423885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:21.600+0100 [conn1423477] end connection 172.28.0.163:60887 (399 connections now open) 2015-10-05T05:16:21.600+0100 [conn1423362] end connection 172.28.0.163:60660 (398 connections now open) 2015-10-05T05:16:21.601+0100 [mongosMain] connection accepted from 172.28.0.163:61849 #1423886 (399 connections now open) 2015-10-05T05:16:21.601+0100 [mongosMain] connection accepted from 172.28.0.163:61850 #1423887 (400 connections now open) 2015-10-05T05:16:21.602+0100 [conn1423886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:21.602+0100 [conn1423887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:21.691+0100 [conn1423492] end connection 172.28.0.164:54023 (399 connections now open) 2015-10-05T05:16:21.691+0100 [conn1423434] end connection 172.28.0.164:53893 (399 connections now open) 2015-10-05T05:16:21.692+0100 [mongosMain] connection accepted from 172.28.0.164:54928 #1423888 (399 connections now open) 2015-10-05T05:16:21.693+0100 [mongosMain] connection accepted from 172.28.0.164:54927 #1423889 (400 connections now open) 2015-10-05T05:16:21.694+0100 [conn1423888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:21.694+0100 [conn1423889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:23.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9975703b51053eb7da6 2015-10-05T05:16:23.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:26.885+0100 [conn1423479] end connection 172.28.0.164:54000 (399 connections now open) 2015-10-05T05:16:26.886+0100 [mongosMain] connection accepted from 172.28.0.164:54938 #1423890 (400 connections now open) 2015-10-05T05:16:26.887+0100 [conn1423890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:27.353+0100 [conn1423494] end connection 172.28.0.164:54027 (399 connections now open) 2015-10-05T05:16:27.354+0100 [mongosMain] connection accepted from 172.28.0.164:54941 #1423891 (400 connections now open) 2015-10-05T05:16:27.356+0100 [conn1423891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:27.465+0100 [conn1423463] end connection 172.28.0.163:60865 (399 connections now open) 2015-10-05T05:16:27.468+0100 [mongosMain] connection accepted from 172.28.0.163:61852 #1423892 (400 connections now open) 2015-10-05T05:16:27.469+0100 [conn1423892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:28.121+0100 [conn1423503] end connection 172.28.0.163:60952 (399 connections now open) 2015-10-05T05:16:28.122+0100 [mongosMain] connection accepted from 172.28.0.163:61854 #1423893 (400 connections now open) 2015-10-05T05:16:28.123+0100 [conn1423893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:29.100+0100 [mongosMain] connection accepted from 127.0.0.1:61856 #1423894 (401 connections now open) 2015-10-05T05:16:29.103+0100 [conn1423894] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:29.107+0100 [conn1423894] end connection 127.0.0.1:61856 (400 connections now open) 2015-10-05T05:16:29.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f99d5703b51053eb7dc9 2015-10-05T05:16:30.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:31.603+0100 [conn1423437] end connection 172.28.0.163:60812 (399 connections now open) 2015-10-05T05:16:31.603+0100 [conn1423499] end connection 172.28.0.163:60940 (398 connections now open) 2015-10-05T05:16:31.604+0100 [mongosMain] connection accepted from 172.28.0.163:61857 #1423895 (399 connections now open) 2015-10-05T05:16:31.605+0100 [mongosMain] connection accepted from 172.28.0.163:61858 #1423896 (400 connections now open) 2015-10-05T05:16:31.605+0100 [conn1423895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:31.606+0100 [conn1423896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:31.691+0100 [conn1423467] end connection 172.28.0.164:53971 (399 connections now open) 2015-10-05T05:16:31.691+0100 [conn1423484] end connection 172.28.0.164:54009 (399 connections now open) 2015-10-05T05:16:31.692+0100 [mongosMain] connection accepted from 172.28.0.164:54949 #1423897 (399 connections now open) 2015-10-05T05:16:31.692+0100 [mongosMain] connection accepted from 172.28.0.164:54948 #1423898 (400 connections now open) 2015-10-05T05:16:31.694+0100 [conn1423897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:31.694+0100 [conn1423898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:32.915+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:16:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:16:36.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9a45703b51053eb7df5 2015-10-05T05:16:36.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:36.901+0100 [conn1423461] end connection 172.28.0.164:53958 (399 connections now open) 2015-10-05T05:16:36.902+0100 [mongosMain] connection accepted from 172.28.0.164:54956 #1423899 (400 connections now open) 2015-10-05T05:16:36.903+0100 [conn1423899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:37.369+0100 [conn1423501] end connection 172.28.0.164:54037 (399 connections now open) 2015-10-05T05:16:37.370+0100 [mongosMain] connection accepted from 172.28.0.164:54958 #1423900 (400 connections now open) 2015-10-05T05:16:37.371+0100 [conn1423900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:37.480+0100 [conn1423481] end connection 172.28.0.163:60896 (399 connections now open) 2015-10-05T05:16:37.481+0100 [mongosMain] connection accepted from 172.28.0.163:61862 #1423901 (400 connections now open) 2015-10-05T05:16:37.482+0100 [conn1423901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:38.122+0100 [conn1423511] end connection 172.28.0.163:60961 (399 connections now open) 2015-10-05T05:16:38.124+0100 [mongosMain] connection accepted from 172.28.0.163:61864 #1423902 (400 connections now open) 2015-10-05T05:16:38.125+0100 [conn1423902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:40.127+0100 [mongosMain] connection accepted from 127.0.0.1:61866 #1423903 (401 connections now open) 2015-10-05T05:16:40.130+0100 [conn1423903] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:40.134+0100 [conn1423903] end connection 127.0.0.1:61866 (400 connections now open) 2015-10-05T05:16:41.615+0100 [conn1423420] end connection 172.28.0.163:60778 (399 connections now open) 2015-10-05T05:16:41.615+0100 [conn1423507] end connection 172.28.0.163:60957 (399 connections now open) 2015-10-05T05:16:41.616+0100 [mongosMain] connection accepted from 172.28.0.163:61869 #1423904 (399 connections now open) 2015-10-05T05:16:41.617+0100 [mongosMain] connection accepted from 172.28.0.163:61870 #1423905 (400 connections now open) 2015-10-05T05:16:41.617+0100 [conn1423904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:41.617+0100 [conn1423905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:41.710+0100 [conn1423497] end connection 172.28.0.164:54031 (399 connections now open) 2015-10-05T05:16:41.711+0100 [conn1423427] end connection 172.28.0.164:53875 (398 connections now open) 2015-10-05T05:16:41.711+0100 [mongosMain] connection accepted from 172.28.0.164:54968 #1423906 (399 connections now open) 2015-10-05T05:16:41.712+0100 [mongosMain] connection accepted from 172.28.0.164:54969 #1423907 (400 connections now open) 2015-10-05T05:16:41.713+0100 [conn1423906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:41.714+0100 [conn1423907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:42.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9aa5703b51053eb7e28 2015-10-05T05:16:42.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:46.901+0100 [conn1423508] end connection 172.28.0.164:54055 (399 connections now open) 2015-10-05T05:16:46.902+0100 [mongosMain] connection accepted from 172.28.0.164:54975 #1423908 (400 connections now open) 2015-10-05T05:16:46.904+0100 [conn1423908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:47.369+0100 [conn1423509] end connection 172.28.0.164:54059 (399 connections now open) 2015-10-05T05:16:47.371+0100 [mongosMain] connection accepted from 172.28.0.164:54979 #1423909 (400 connections now open) 2015-10-05T05:16:47.372+0100 [conn1423909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:47.481+0100 [conn1423489] end connection 172.28.0.163:60914 (399 connections now open) 2015-10-05T05:16:47.482+0100 [mongosMain] connection accepted from 172.28.0.163:61878 #1423910 (400 connections now open) 2015-10-05T05:16:47.483+0100 [conn1423910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:48.138+0100 [conn1423519] end connection 172.28.0.163:60970 (399 connections now open) 2015-10-05T05:16:48.139+0100 [mongosMain] connection accepted from 172.28.0.163:61880 #1423911 (400 connections now open) 2015-10-05T05:16:48.139+0100 [conn1423911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:49.006+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9b05703b51053eb7e58 2015-10-05T05:16:49.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:51.617+0100 [conn1423429] end connection 172.28.0.163:60789 (399 connections now open) 2015-10-05T05:16:51.617+0100 [conn1423515] end connection 172.28.0.163:60964 (399 connections now open) 2015-10-05T05:16:51.619+0100 [mongosMain] connection accepted from 172.28.0.163:61884 #1423912 (399 connections now open) 2015-10-05T05:16:51.619+0100 [mongosMain] connection accepted from 172.28.0.163:61885 #1423913 (400 connections now open) 2015-10-05T05:16:51.620+0100 [conn1423912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:51.620+0100 [conn1423913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:51.707+0100 [conn1423505] end connection 172.28.0.164:54045 (399 connections now open) 2015-10-05T05:16:51.707+0100 [conn1423504] end connection 172.28.0.164:54044 (398 connections now open) 2015-10-05T05:16:51.708+0100 [mongosMain] connection accepted from 172.28.0.164:54982 #1423914 (399 connections now open) 2015-10-05T05:16:51.708+0100 [mongosMain] connection accepted from 172.28.0.164:54983 #1423915 (400 connections now open) 2015-10-05T05:16:51.710+0100 [conn1423914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:51.710+0100 [conn1423915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:55.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9b75703b51053eb7e7e 2015-10-05T05:16:55.519+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:16:57.386+0100 [conn1423517] end connection 172.28.0.164:54076 (399 connections now open) 2015-10-05T05:16:57.386+0100 [mongosMain] connection accepted from 172.28.0.164:54991 #1423916 (400 connections now open) 2015-10-05T05:16:57.388+0100 [conn1423916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:57.496+0100 [conn1423502] end connection 172.28.0.163:60950 (399 connections now open) 2015-10-05T05:16:57.497+0100 [mongosMain] connection accepted from 172.28.0.163:61894 #1423917 (400 connections now open) 2015-10-05T05:16:57.498+0100 [conn1423917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:16:58.153+0100 [conn1423528] end connection 172.28.0.163:60986 (399 connections now open) 2015-10-05T05:16:58.154+0100 [mongosMain] connection accepted from 172.28.0.163:61897 #1423918 (400 connections now open) 2015-10-05T05:16:58.155+0100 [conn1423918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:01.631+0100 [conn1423531] end connection 172.28.0.163:60991 (399 connections now open) 2015-10-05T05:17:01.631+0100 [conn1423452] end connection 172.28.0.163:60848 (399 connections now open) 2015-10-05T05:17:01.632+0100 [mongosMain] connection accepted from 172.28.0.163:61911 #1423919 (399 connections now open) 2015-10-05T05:17:01.632+0100 [mongosMain] connection accepted from 172.28.0.163:61912 #1423920 (400 connections now open) 2015-10-05T05:17:01.633+0100 [conn1423920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:01.633+0100 [conn1423919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:01.723+0100 [conn1423408] end connection 172.28.0.164:53831 (399 connections now open) 2015-10-05T05:17:01.723+0100 [conn1423529] end connection 172.28.0.164:54100 (398 connections now open) 2015-10-05T05:17:01.724+0100 [mongosMain] connection accepted from 172.28.0.164:55000 #1423921 (399 connections now open) 2015-10-05T05:17:01.725+0100 [mongosMain] connection accepted from 172.28.0.164:55001 #1423922 (400 connections now open) 2015-10-05T05:17:01.726+0100 [conn1423921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:01.727+0100 [conn1423922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:03.187+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:17:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:17:06.918+0100 [conn1423470] end connection 172.28.0.164:53979 (399 connections now open) 2015-10-05T05:17:06.919+0100 [mongosMain] connection accepted from 172.28.0.164:55003 #1423923 (400 connections now open) 2015-10-05T05:17:06.920+0100 [conn1423923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:07.385+0100 [conn1423526] end connection 172.28.0.164:54095 (399 connections now open) 2015-10-05T05:17:07.386+0100 [mongosMain] connection accepted from 172.28.0.164:55005 #1423924 (400 connections now open) 2015-10-05T05:17:07.388+0100 [conn1423924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:07.512+0100 [conn1423495] end connection 172.28.0.163:60933 (399 connections now open) 2015-10-05T05:17:07.513+0100 [mongosMain] connection accepted from 172.28.0.163:61921 #1423925 (400 connections now open) 2015-10-05T05:17:07.515+0100 [conn1423925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:07.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9c35703b51053eb7ed4 2015-10-05T05:17:07.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:08.153+0100 [conn1423536] end connection 172.28.0.163:61005 (399 connections now open) 2015-10-05T05:17:08.155+0100 [mongosMain] connection accepted from 172.28.0.163:61924 #1423926 (400 connections now open) 2015-10-05T05:17:08.156+0100 [conn1423926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:11.632+0100 [conn1423524] end connection 172.28.0.163:60976 (399 connections now open) 2015-10-05T05:17:11.632+0100 [conn1423410] end connection 172.28.0.163:60765 (399 connections now open) 2015-10-05T05:17:11.633+0100 [mongosMain] connection accepted from 172.28.0.163:61929 #1423927 (399 connections now open) 2015-10-05T05:17:11.633+0100 [mongosMain] connection accepted from 172.28.0.163:61930 #1423928 (400 connections now open) 2015-10-05T05:17:11.634+0100 [conn1423927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:11.634+0100 [conn1423928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:11.738+0100 [conn1423498] end connection 172.28.0.164:54032 (399 connections now open) 2015-10-05T05:17:11.738+0100 [conn1423513] end connection 172.28.0.164:54066 (399 connections now open) 2015-10-05T05:17:11.739+0100 [mongosMain] connection accepted from 172.28.0.164:55010 #1423929 (399 connections now open) 2015-10-05T05:17:11.739+0100 [mongosMain] connection accepted from 172.28.0.164:55009 #1423930 (400 connections now open) 2015-10-05T05:17:11.741+0100 [conn1423929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:11.741+0100 [conn1423930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:14.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9c95703b51053eb7eee 2015-10-05T05:17:14.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:16.937+0100 [conn1423533] end connection 172.28.0.164:54109 (399 connections now open) 2015-10-05T05:17:16.938+0100 [mongosMain] connection accepted from 172.28.0.164:55013 #1423931 (400 connections now open) 2015-10-05T05:17:16.939+0100 [conn1423931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:17.401+0100 [conn1423534] end connection 172.28.0.164:54112 (399 connections now open) 2015-10-05T05:17:17.402+0100 [mongosMain] connection accepted from 172.28.0.164:55015 #1423932 (400 connections now open) 2015-10-05T05:17:17.403+0100 [conn1423932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:17.513+0100 [conn1423472] end connection 172.28.0.163:60879 (399 connections now open) 2015-10-05T05:17:17.514+0100 [mongosMain] connection accepted from 172.28.0.163:61940 #1423933 (400 connections now open) 2015-10-05T05:17:17.515+0100 [conn1423933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:18.168+0100 [conn1423543] end connection 172.28.0.163:61031 (399 connections now open) 2015-10-05T05:17:18.169+0100 [mongosMain] connection accepted from 172.28.0.163:61942 #1423934 (400 connections now open) 2015-10-05T05:17:18.170+0100 [conn1423934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:21.648+0100 [conn1423539] end connection 172.28.0.163:61017 (399 connections now open) 2015-10-05T05:17:21.648+0100 [conn1423444] end connection 172.28.0.163:60829 (399 connections now open) 2015-10-05T05:17:21.649+0100 [mongosMain] connection accepted from 172.28.0.163:61946 #1423935 (399 connections now open) 2015-10-05T05:17:21.649+0100 [mongosMain] connection accepted from 172.28.0.163:61948 #1423936 (400 connections now open) 2015-10-05T05:17:21.650+0100 [conn1423935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:21.650+0100 [conn1423936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:21.738+0100 [conn1423514] end connection 172.28.0.164:54067 (399 connections now open) 2015-10-05T05:17:21.738+0100 [conn1423522] end connection 172.28.0.164:54085 (399 connections now open) 2015-10-05T05:17:21.739+0100 [mongosMain] connection accepted from 172.28.0.164:55022 #1423937 (399 connections now open) 2015-10-05T05:17:21.739+0100 [mongosMain] connection accepted from 172.28.0.164:55023 #1423938 (400 connections now open) 2015-10-05T05:17:21.740+0100 [conn1423937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:21.740+0100 [conn1423938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:26.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9d65703b51053eb7f21 2015-10-05T05:17:26.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:27.401+0100 [conn1423541] end connection 172.28.0.164:54124 (399 connections now open) 2015-10-05T05:17:27.402+0100 [mongosMain] connection accepted from 172.28.0.164:55033 #1423939 (400 connections now open) 2015-10-05T05:17:27.403+0100 [conn1423939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:27.528+0100 [conn1423518] end connection 172.28.0.163:60968 (399 connections now open) 2015-10-05T05:17:27.530+0100 [mongosMain] connection accepted from 172.28.0.163:61951 #1423940 (400 connections now open) 2015-10-05T05:17:27.531+0100 [conn1423940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:28.170+0100 [conn1423551] end connection 172.28.0.163:61050 (399 connections now open) 2015-10-05T05:17:28.171+0100 [mongosMain] connection accepted from 172.28.0.163:61953 #1423941 (400 connections now open) 2015-10-05T05:17:28.172+0100 [conn1423941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:28.511+0100 [mongosMain] connection accepted from 127.0.0.1:61955 #1423942 (401 connections now open) 2015-10-05T05:17:28.514+0100 [conn1423942] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:28.520+0100 [conn1423942] end connection 127.0.0.1:61955 (400 connections now open) 2015-10-05T05:17:31.663+0100 [conn1423554] end connection 172.28.0.163:61053 (399 connections now open) 2015-10-05T05:17:31.663+0100 [conn1423468] end connection 172.28.0.163:60873 (399 connections now open) 2015-10-05T05:17:31.664+0100 [mongosMain] connection accepted from 172.28.0.163:61956 #1423943 (399 connections now open) 2015-10-05T05:17:31.665+0100 [mongosMain] connection accepted from 172.28.0.163:61957 #1423944 (400 connections now open) 2015-10-05T05:17:31.666+0100 [conn1423944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:31.666+0100 [conn1423943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:31.754+0100 [conn1423491] end connection 172.28.0.164:54022 (399 connections now open) 2015-10-05T05:17:31.754+0100 [conn1423537] end connection 172.28.0.164:54118 (398 connections now open) 2015-10-05T05:17:31.755+0100 [mongosMain] connection accepted from 172.28.0.164:55040 #1423945 (399 connections now open) 2015-10-05T05:17:31.755+0100 [mongosMain] connection accepted from 172.28.0.164:55041 #1423946 (400 connections now open) 2015-10-05T05:17:31.756+0100 [conn1423945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:31.757+0100 [conn1423946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:32.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9dc5703b51053eb7f39 2015-10-05T05:17:32.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:33.346+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:17:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:17:37.417+0100 [conn1423549] end connection 172.28.0.164:54133 (399 connections now open) 2015-10-05T05:17:37.418+0100 [mongosMain] connection accepted from 172.28.0.164:55050 #1423947 (400 connections now open) 2015-10-05T05:17:37.420+0100 [conn1423947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:37.529+0100 [conn1423542] end connection 172.28.0.163:61029 (399 connections now open) 2015-10-05T05:17:37.531+0100 [mongosMain] connection accepted from 172.28.0.163:61961 #1423948 (400 connections now open) 2015-10-05T05:17:37.531+0100 [conn1423948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:38.184+0100 [conn1423558] end connection 172.28.0.163:61062 (399 connections now open) 2015-10-05T05:17:38.185+0100 [mongosMain] connection accepted from 172.28.0.163:61963 #1423949 (400 connections now open) 2015-10-05T05:17:38.187+0100 [conn1423949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:39.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9e25703b51053eb7f4b 2015-10-05T05:17:39.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:40.092+0100 [mongosMain] connection accepted from 127.0.0.1:61965 #1423950 (401 connections now open) 2015-10-05T05:17:40.094+0100 [conn1423950] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:40.101+0100 [conn1423950] end connection 127.0.0.1:61965 (400 connections now open) 2015-10-05T05:17:41.666+0100 [conn1423546] end connection 172.28.0.163:61038 (399 connections now open) 2015-10-05T05:17:41.668+0100 [mongosMain] connection accepted from 172.28.0.163:61970 #1423951 (400 connections now open) 2015-10-05T05:17:41.668+0100 [conn1423478] end connection 172.28.0.163:60888 (399 connections now open) 2015-10-05T05:17:41.669+0100 [conn1423951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:41.670+0100 [mongosMain] connection accepted from 172.28.0.163:61973 #1423952 (400 connections now open) 2015-10-05T05:17:41.670+0100 [conn1423952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:41.754+0100 [conn1423545] end connection 172.28.0.164:54127 (399 connections now open) 2015-10-05T05:17:41.754+0100 [conn1423544] end connection 172.28.0.164:54126 (398 connections now open) 2015-10-05T05:17:41.755+0100 [mongosMain] connection accepted from 172.28.0.164:55070 #1423953 (399 connections now open) 2015-10-05T05:17:41.756+0100 [mongosMain] connection accepted from 172.28.0.164:55071 #1423954 (400 connections now open) 2015-10-05T05:17:41.757+0100 [conn1423953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:41.757+0100 [conn1423954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:45.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9e95703b51053eb7f65 2015-10-05T05:17:45.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:46.964+0100 [conn1423563] end connection 172.28.0.164:54170 (399 connections now open) 2015-10-05T05:17:46.965+0100 [mongosMain] connection accepted from 172.28.0.164:55078 #1423955 (400 connections now open) 2015-10-05T05:17:46.967+0100 [conn1423955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:47.432+0100 [conn1423556] end connection 172.28.0.164:54155 (399 connections now open) 2015-10-05T05:17:47.433+0100 [mongosMain] connection accepted from 172.28.0.164:55080 #1423956 (400 connections now open) 2015-10-05T05:17:47.435+0100 [conn1423956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:47.544+0100 [conn1423550] end connection 172.28.0.163:61048 (399 connections now open) 2015-10-05T05:17:47.545+0100 [mongosMain] connection accepted from 172.28.0.163:61980 #1423957 (400 connections now open) 2015-10-05T05:17:47.546+0100 [conn1423957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:48.185+0100 [conn1423566] end connection 172.28.0.163:61072 (399 connections now open) 2015-10-05T05:17:48.186+0100 [mongosMain] connection accepted from 172.28.0.163:61983 #1423958 (400 connections now open) 2015-10-05T05:17:48.187+0100 [conn1423958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:51.681+0100 [conn1423562] end connection 172.28.0.163:61066 (399 connections now open) 2015-10-05T05:17:51.683+0100 [conn1423315] end connection 172.28.0.163:60571 (398 connections now open) 2015-10-05T05:17:51.684+0100 [mongosMain] connection accepted from 172.28.0.163:61989 #1423959 (399 connections now open) 2015-10-05T05:17:51.685+0100 [mongosMain] connection accepted from 172.28.0.163:61992 #1423960 (400 connections now open) 2015-10-05T05:17:51.685+0100 [conn1423959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:51.686+0100 [conn1423960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:51.770+0100 [conn1423521] end connection 172.28.0.164:54084 (399 connections now open) 2015-10-05T05:17:51.770+0100 [mongosMain] connection accepted from 172.28.0.164:55087 #1423961 (400 connections now open) 2015-10-05T05:17:51.771+0100 [conn1423552] end connection 172.28.0.164:54140 (399 connections now open) 2015-10-05T05:17:51.772+0100 [mongosMain] connection accepted from 172.28.0.164:55088 #1423962 (400 connections now open) 2015-10-05T05:17:51.772+0100 [conn1423961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:51.773+0100 [conn1423962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:51.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9ef5703b51053eb7f86 2015-10-05T05:17:52.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:17:56.980+0100 [conn1423555] end connection 172.28.0.164:54153 (399 connections now open) 2015-10-05T05:17:56.981+0100 [mongosMain] connection accepted from 172.28.0.164:55094 #1423963 (400 connections now open) 2015-10-05T05:17:56.983+0100 [conn1423963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:57.448+0100 [conn1423564] end connection 172.28.0.164:54173 (399 connections now open) 2015-10-05T05:17:57.449+0100 [mongosMain] connection accepted from 172.28.0.164:55096 #1423964 (400 connections now open) 2015-10-05T05:17:57.452+0100 [conn1423964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:58.200+0100 [conn1423574] end connection 172.28.0.163:61091 (399 connections now open) 2015-10-05T05:17:58.202+0100 [mongosMain] connection accepted from 172.28.0.163:62000 #1423965 (400 connections now open) 2015-10-05T05:17:58.203+0100 [conn1423965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:17:58.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9f65703b51053eb7fa4 2015-10-05T05:17:58.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:01.681+0100 [conn1423570] end connection 172.28.0.163:61079 (399 connections now open) 2015-10-05T05:18:01.682+0100 [conn1423459] end connection 172.28.0.163:60861 (398 connections now open) 2015-10-05T05:18:01.684+0100 [mongosMain] connection accepted from 172.28.0.163:62009 #1423966 (399 connections now open) 2015-10-05T05:18:01.685+0100 [mongosMain] connection accepted from 172.28.0.163:62012 #1423967 (400 connections now open) 2015-10-05T05:18:01.685+0100 [conn1423966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:01.686+0100 [conn1423967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:03.632+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:18:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:18:04.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611f9fc5703b51053eb7fde 2015-10-05T05:18:04.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:06.980+0100 [conn1423548] end connection 172.28.0.164:54131 (399 connections now open) 2015-10-05T05:18:06.980+0100 [mongosMain] connection accepted from 172.28.0.164:55105 #1423968 (400 connections now open) 2015-10-05T05:18:06.984+0100 [conn1423968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:07.448+0100 [conn1423572] end connection 172.28.0.164:54191 (399 connections now open) 2015-10-05T05:18:07.449+0100 [mongosMain] connection accepted from 172.28.0.164:55107 #1423969 (400 connections now open) 2015-10-05T05:18:07.451+0100 [conn1423969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:07.559+0100 [conn1423527] end connection 172.28.0.163:60984 (399 connections now open) 2015-10-05T05:18:07.560+0100 [mongosMain] connection accepted from 172.28.0.163:62019 #1423970 (400 connections now open) 2015-10-05T05:18:07.561+0100 [conn1423970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:08.216+0100 [conn1423578] end connection 172.28.0.163:61107 (399 connections now open) 2015-10-05T05:18:08.217+0100 [mongosMain] connection accepted from 172.28.0.163:62021 #1423971 (400 connections now open) 2015-10-05T05:18:08.218+0100 [conn1423971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:11.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa025703b51053eb7fff 2015-10-05T05:18:11.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:11.694+0100 [conn1423485] end connection 172.28.0.163:60905 (399 connections now open) 2015-10-05T05:18:11.694+0100 [conn1423575] end connection 172.28.0.163:61095 (399 connections now open) 2015-10-05T05:18:11.695+0100 [mongosMain] connection accepted from 172.28.0.163:62025 #1423972 (399 connections now open) 2015-10-05T05:18:11.696+0100 [mongosMain] connection accepted from 172.28.0.163:62026 #1423973 (400 connections now open) 2015-10-05T05:18:11.696+0100 [conn1423972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:11.697+0100 [conn1423973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:11.786+0100 [conn1423569] end connection 172.28.0.164:54179 (399 connections now open) 2015-10-05T05:18:11.787+0100 [mongosMain] connection accepted from 172.28.0.164:55110 #1423974 (400 connections now open) 2015-10-05T05:18:11.789+0100 [conn1423974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:16.998+0100 [conn1423576] end connection 172.28.0.164:54201 (399 connections now open) 2015-10-05T05:18:16.999+0100 [mongosMain] connection accepted from 172.28.0.164:55114 #1423975 (400 connections now open) 2015-10-05T05:18:17.001+0100 [conn1423975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:17.463+0100 [conn1423577] end connection 172.28.0.164:54203 (399 connections now open) 2015-10-05T05:18:17.465+0100 [mongosMain] connection accepted from 172.28.0.164:55116 #1423976 (400 connections now open) 2015-10-05T05:18:17.467+0100 [conn1423976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:17.560+0100 [conn1423535] end connection 172.28.0.163:61003 (399 connections now open) 2015-10-05T05:18:17.561+0100 [mongosMain] connection accepted from 172.28.0.163:62035 #1423977 (400 connections now open) 2015-10-05T05:18:17.562+0100 [conn1423977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:17.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa095703b51053eb8020 2015-10-05T05:18:17.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:18.217+0100 [conn1423582] end connection 172.28.0.163:61125 (399 connections now open) 2015-10-05T05:18:18.218+0100 [mongosMain] connection accepted from 172.28.0.163:62038 #1423978 (400 connections now open) 2015-10-05T05:18:18.219+0100 [conn1423978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:21.697+0100 [conn1423579] end connection 172.28.0.163:61115 (399 connections now open) 2015-10-05T05:18:21.697+0100 [conn1423523] end connection 172.28.0.163:60975 (399 connections now open) 2015-10-05T05:18:21.698+0100 [mongosMain] connection accepted from 172.28.0.163:62041 #1423979 (399 connections now open) 2015-10-05T05:18:21.699+0100 [mongosMain] connection accepted from 172.28.0.163:62042 #1423980 (400 connections now open) 2015-10-05T05:18:21.700+0100 [conn1423979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:21.700+0100 [conn1423980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:21.802+0100 [conn1423561] end connection 172.28.0.164:54160 (399 connections now open) 2015-10-05T05:18:21.803+0100 [mongosMain] connection accepted from 172.28.0.164:55121 #1423981 (400 connections now open) 2015-10-05T05:18:21.805+0100 [conn1423981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:23.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa0f5703b51053eb8047 2015-10-05T05:18:24.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:27.011+0100 [conn1423525] end connection 172.28.0.164:54092 (399 connections now open) 2015-10-05T05:18:27.013+0100 [mongosMain] connection accepted from 172.28.0.164:55131 #1423982 (400 connections now open) 2015-10-05T05:18:27.015+0100 [conn1423982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:27.463+0100 [conn1423581] end connection 172.28.0.164:54215 (399 connections now open) 2015-10-05T05:18:27.465+0100 [mongosMain] connection accepted from 172.28.0.164:55133 #1423983 (400 connections now open) 2015-10-05T05:18:27.466+0100 [conn1423983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:28.767+0100 [mongosMain] connection accepted from 127.0.0.1:62047 #1423984 (401 connections now open) 2015-10-05T05:18:28.769+0100 [conn1423984] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:28.774+0100 [conn1423984] end connection 127.0.0.1:62047 (400 connections now open) 2015-10-05T05:18:30.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa165703b51053eb8073 2015-10-05T05:18:30.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:31.710+0100 [conn1423585] end connection 172.28.0.163:61131 (399 connections now open) 2015-10-05T05:18:31.711+0100 [mongosMain] connection accepted from 172.28.0.163:62048 #1423985 (400 connections now open) 2015-10-05T05:18:31.713+0100 [conn1423985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:31.801+0100 [conn1423583] end connection 172.28.0.164:54217 (399 connections now open) 2015-10-05T05:18:31.803+0100 [mongosMain] connection accepted from 172.28.0.164:55138 #1423986 (400 connections now open) 2015-10-05T05:18:31.804+0100 [conn1423986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:33.890+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:18:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:18:36.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa1c5703b51053eb8092 2015-10-05T05:18:36.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:37.026+0100 [conn1423540] end connection 172.28.0.164:54122 (399 connections now open) 2015-10-05T05:18:37.028+0100 [mongosMain] connection accepted from 172.28.0.164:55147 #1423987 (400 connections now open) 2015-10-05T05:18:37.030+0100 [conn1423987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:37.479+0100 [conn1423587] end connection 172.28.0.164:54224 (399 connections now open) 2015-10-05T05:18:37.480+0100 [mongosMain] connection accepted from 172.28.0.164:55148 #1423988 (400 connections now open) 2015-10-05T05:18:37.481+0100 [conn1423988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:40.063+0100 [mongosMain] connection accepted from 127.0.0.1:62053 #1423989 (401 connections now open) 2015-10-05T05:18:40.065+0100 [conn1423989] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:40.070+0100 [conn1423989] end connection 127.0.0.1:62053 (400 connections now open) 2015-10-05T05:18:41.726+0100 [conn1423591] end connection 172.28.0.163:61143 (399 connections now open) 2015-10-05T05:18:41.727+0100 [mongosMain] connection accepted from 172.28.0.163:62056 #1423990 (400 connections now open) 2015-10-05T05:18:41.728+0100 [conn1423990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:43.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa225703b51053eb80bb 2015-10-05T05:18:43.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:47.043+0100 [conn1423586] end connection 172.28.0.164:54222 (399 connections now open) 2015-10-05T05:18:47.044+0100 [mongosMain] connection accepted from 172.28.0.164:55162 #1423991 (400 connections now open) 2015-10-05T05:18:47.046+0100 [conn1423991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:47.591+0100 [conn1423557] end connection 172.28.0.163:61060 (399 connections now open) 2015-10-05T05:18:47.592+0100 [mongosMain] connection accepted from 172.28.0.163:62065 #1423992 (400 connections now open) 2015-10-05T05:18:47.592+0100 [conn1423992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:49.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa295703b51053eb80e2 2015-10-05T05:18:49.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:51.726+0100 [conn1423595] end connection 172.28.0.163:61153 (399 connections now open) 2015-10-05T05:18:51.727+0100 [mongosMain] connection accepted from 172.28.0.163:62073 #1423993 (400 connections now open) 2015-10-05T05:18:51.728+0100 [conn1423993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:51.833+0100 [conn1423596] end connection 172.28.0.164:54247 (399 connections now open) 2015-10-05T05:18:51.834+0100 [mongosMain] connection accepted from 172.28.0.164:55167 #1423994 (400 connections now open) 2015-10-05T05:18:51.836+0100 [conn1423994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:18:55.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa2f5703b51053eb810a 2015-10-05T05:18:56.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:18:57.607+0100 [conn1423510] end connection 172.28.0.163:60960 (399 connections now open) 2015-10-05T05:18:57.608+0100 [mongosMain] connection accepted from 172.28.0.163:62083 #1423995 (400 connections now open) 2015-10-05T05:18:57.609+0100 [conn1423995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:01.741+0100 [conn1423599] end connection 172.28.0.163:61162 (399 connections now open) 2015-10-05T05:19:01.742+0100 [mongosMain] connection accepted from 172.28.0.163:62095 #1423996 (400 connections now open) 2015-10-05T05:19:01.743+0100 [conn1423996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:02.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa365703b51053eb813c 2015-10-05T05:19:02.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:04.151+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:19:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:19:07.073+0100 [conn1423592] end connection 172.28.0.164:54241 (399 connections now open) 2015-10-05T05:19:07.074+0100 [mongosMain] connection accepted from 172.28.0.164:55178 #1423997 (400 connections now open) 2015-10-05T05:19:07.077+0100 [conn1423997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:07.607+0100 [conn1423602] end connection 172.28.0.163:61187 (399 connections now open) 2015-10-05T05:19:07.608+0100 [mongosMain] connection accepted from 172.28.0.163:62103 #1423998 (400 connections now open) 2015-10-05T05:19:07.609+0100 [conn1423998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:08.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa3c5703b51053eb8175 2015-10-05T05:19:08.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:14.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa425703b51053eb8190 2015-10-05T05:19:15.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:17.090+0100 [conn1423601] end connection 172.28.0.164:54279 (399 connections now open) 2015-10-05T05:19:17.091+0100 [mongosMain] connection accepted from 172.28.0.164:55180 #1423999 (400 connections now open) 2015-10-05T05:19:17.093+0100 [conn1423999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:21.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa495703b51053eb81b7 2015-10-05T05:19:21.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:21.864+0100 [conn1423606] end connection 172.28.0.164:54291 (399 connections now open) 2015-10-05T05:19:21.865+0100 [mongosMain] connection accepted from 172.28.0.164:55188 #1424000 (400 connections now open) 2015-10-05T05:19:21.866+0100 [conn1424000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:27.105+0100 [conn1423607] end connection 172.28.0.164:54293 (399 connections now open) 2015-10-05T05:19:27.106+0100 [mongosMain] connection accepted from 172.28.0.164:55195 #1424001 (400 connections now open) 2015-10-05T05:19:27.108+0100 [conn1424001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:27.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa4f5703b51053eb81ca 2015-10-05T05:19:27.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:28.193+0100 [mongosMain] connection accepted from 127.0.0.1:62118 #1424002 (401 connections now open) 2015-10-05T05:19:28.195+0100 [conn1424002] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:28.200+0100 [conn1424002] end connection 127.0.0.1:62118 (400 connections now open) 2015-10-05T05:19:31.880+0100 [conn1423590] end connection 172.28.0.164:54230 (399 connections now open) 2015-10-05T05:19:31.882+0100 [mongosMain] connection accepted from 172.28.0.164:55202 #1424003 (400 connections now open) 2015-10-05T05:19:31.883+0100 [conn1424003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:33.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa555703b51053eb81e7 2015-10-05T05:19:33.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:34.405+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:19:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:19:37.105+0100 [conn1423604] end connection 172.28.0.164:54287 (399 connections now open) 2015-10-05T05:19:37.107+0100 [mongosMain] connection accepted from 172.28.0.164:55209 #1424004 (400 connections now open) 2015-10-05T05:19:37.108+0100 [conn1424004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:39.225+0100 [mongosMain] connection accepted from 127.0.0.1:62123 #1424005 (401 connections now open) 2015-10-05T05:19:39.228+0100 [conn1424005] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:19:39.232+0100 [conn1424005] end connection 127.0.0.1:62123 (400 connections now open) 2015-10-05T05:19:40.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa5b5703b51053eb8203 2015-10-05T05:19:40.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:19:52.626+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa685703b51053eb8243 2015-10-05T05:19:52.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:04.564+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:20:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:20:04.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa745703b51053eb82b4 2015-10-05T05:20:04.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:11.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa7a5703b51053eb82cf 2015-10-05T05:20:11.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:11.804+0100 [conn1423516] end connection 172.28.0.163:60965 (399 connections now open) 2015-10-05T05:20:11.805+0100 [mongosMain] connection accepted from 172.28.0.163:62165 #1424006 (400 connections now open) 2015-10-05T05:20:11.807+0100 [conn1424006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:11.927+0100 [conn1423612] end connection 172.28.0.164:54316 (399 connections now open) 2015-10-05T05:20:11.928+0100 [mongosMain] connection accepted from 172.28.0.164:55237 #1424007 (400 connections now open) 2015-10-05T05:20:11.935+0100 [conn1424007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:17.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa815703b51053eb82eb 2015-10-05T05:20:17.818+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:18.326+0100 [conn1423588] end connection 172.28.0.163:61140 (399 connections now open) 2015-10-05T05:20:18.327+0100 [mongosMain] connection accepted from 172.28.0.163:62172 #1424008 (400 connections now open) 2015-10-05T05:20:18.328+0100 [conn1424008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:21.807+0100 [conn1423600] end connection 172.28.0.163:61177 (399 connections now open) 2015-10-05T05:20:21.807+0100 [conn1423538] end connection 172.28.0.163:61016 (399 connections now open) 2015-10-05T05:20:21.808+0100 [mongosMain] connection accepted from 172.28.0.163:62175 #1424009 (399 connections now open) 2015-10-05T05:20:21.808+0100 [mongosMain] connection accepted from 172.28.0.163:62176 #1424010 (400 connections now open) 2015-10-05T05:20:21.809+0100 [conn1424009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:21.809+0100 [conn1424010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:21.942+0100 [conn1423609] end connection 172.28.0.164:54300 (399 connections now open) 2015-10-05T05:20:21.942+0100 [conn1423530] end connection 172.28.0.164:54101 (398 connections now open) 2015-10-05T05:20:21.944+0100 [mongosMain] connection accepted from 172.28.0.164:55250 #1424011 (399 connections now open) 2015-10-05T05:20:21.944+0100 [mongosMain] connection accepted from 172.28.0.164:55249 #1424012 (400 connections now open) 2015-10-05T05:20:21.945+0100 [conn1424011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:21.946+0100 [conn1424012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:23.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa875703b51053eb830c 2015-10-05T05:20:24.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:27.622+0100 [conn1423593] end connection 172.28.0.164:54243 (399 connections now open) 2015-10-05T05:20:27.623+0100 [mongosMain] connection accepted from 172.28.0.164:55261 #1424013 (400 connections now open) 2015-10-05T05:20:27.626+0100 [conn1424013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:27.733+0100 [conn1423605] end connection 172.28.0.163:61214 (399 connections now open) 2015-10-05T05:20:27.734+0100 [mongosMain] connection accepted from 172.28.0.163:62179 #1424014 (400 connections now open) 2015-10-05T05:20:27.736+0100 [conn1424014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:28.326+0100 [conn1423617] end connection 172.28.0.163:61283 (399 connections now open) 2015-10-05T05:20:28.327+0100 [mongosMain] connection accepted from 172.28.0.163:62180 #1424015 (400 connections now open) 2015-10-05T05:20:28.328+0100 [conn1424015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:28.720+0100 [mongosMain] connection accepted from 127.0.0.1:62185 #1424016 (401 connections now open) 2015-10-05T05:20:28.723+0100 [conn1424016] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:28.728+0100 [conn1424016] end connection 127.0.0.1:62185 (400 connections now open) 2015-10-05T05:20:30.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa8e5703b51053eb832f 2015-10-05T05:20:30.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:31.820+0100 [conn1423603] end connection 172.28.0.163:61196 (399 connections now open) 2015-10-05T05:20:31.822+0100 [mongosMain] connection accepted from 172.28.0.163:62187 #1424017 (400 connections now open) 2015-10-05T05:20:31.823+0100 [conn1424017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:31.943+0100 [conn1423568] end connection 172.28.0.164:54180 (399 connections now open) 2015-10-05T05:20:31.944+0100 [mongosMain] connection accepted from 172.28.0.164:55266 #1424018 (400 connections now open) 2015-10-05T05:20:31.946+0100 [conn1424018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:34.792+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:20:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:20:36.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa945703b51053eb834c 2015-10-05T05:20:36.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:37.749+0100 [conn1423616] end connection 172.28.0.163:61282 (399 connections now open) 2015-10-05T05:20:37.750+0100 [mongosMain] connection accepted from 172.28.0.163:62190 #1424019 (400 connections now open) 2015-10-05T05:20:37.751+0100 [conn1424019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:38.342+0100 [conn1423622] end connection 172.28.0.163:61289 (399 connections now open) 2015-10-05T05:20:38.343+0100 [mongosMain] connection accepted from 172.28.0.163:62192 #1424020 (400 connections now open) 2015-10-05T05:20:38.344+0100 [conn1424020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:39.523+0100 [mongosMain] connection accepted from 127.0.0.1:62194 #1424021 (401 connections now open) 2015-10-05T05:20:39.526+0100 [conn1424021] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:39.530+0100 [conn1424021] end connection 127.0.0.1:62194 (400 connections now open) 2015-10-05T05:20:41.828+0100 [conn1423618] end connection 172.28.0.163:61287 (399 connections now open) 2015-10-05T05:20:41.829+0100 [mongosMain] connection accepted from 172.28.0.163:62196 #1424022 (400 connections now open) 2015-10-05T05:20:41.830+0100 [conn1424022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:41.958+0100 [conn1423458] end connection 172.28.0.164:53950 (399 connections now open) 2015-10-05T05:20:41.959+0100 [mongosMain] connection accepted from 172.28.0.164:55280 #1424023 (400 connections now open) 2015-10-05T05:20:41.960+0100 [conn1424023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:42.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fa9a5703b51053eb8373 2015-10-05T05:20:43.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:47.638+0100 [conn1423620] end connection 172.28.0.164:54370 (399 connections now open) 2015-10-05T05:20:47.640+0100 [mongosMain] connection accepted from 172.28.0.164:55292 #1424024 (400 connections now open) 2015-10-05T05:20:47.643+0100 [conn1424024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:47.750+0100 [conn1423573] end connection 172.28.0.163:61088 (399 connections now open) 2015-10-05T05:20:47.752+0100 [mongosMain] connection accepted from 172.28.0.163:62214 #1424025 (400 connections now open) 2015-10-05T05:20:47.753+0100 [conn1424025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:48.343+0100 [conn1423628] end connection 172.28.0.163:61301 (399 connections now open) 2015-10-05T05:20:48.344+0100 [mongosMain] connection accepted from 172.28.0.163:62216 #1424026 (400 connections now open) 2015-10-05T05:20:48.345+0100 [conn1424026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:49.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faa15703b51053eb83a9 2015-10-05T05:20:49.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:51.837+0100 [conn1423506] end connection 172.28.0.163:60956 (399 connections now open) 2015-10-05T05:20:51.837+0100 [conn1423624] end connection 172.28.0.163:61295 (399 connections now open) 2015-10-05T05:20:51.838+0100 [mongosMain] connection accepted from 172.28.0.163:62220 #1424027 (399 connections now open) 2015-10-05T05:20:51.838+0100 [mongosMain] connection accepted from 172.28.0.163:62221 #1424028 (400 connections now open) 2015-10-05T05:20:51.839+0100 [conn1424027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:51.840+0100 [conn1424028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:51.959+0100 [conn1423560] end connection 172.28.0.164:54161 (399 connections now open) 2015-10-05T05:20:51.961+0100 [mongosMain] connection accepted from 172.28.0.164:55295 #1424029 (400 connections now open) 2015-10-05T05:20:51.964+0100 [conn1424029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:55.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faa75703b51053eb83d9 2015-10-05T05:20:55.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:20:57.653+0100 [conn1423632] end connection 172.28.0.164:54406 (399 connections now open) 2015-10-05T05:20:57.654+0100 [mongosMain] connection accepted from 172.28.0.164:55301 #1424030 (400 connections now open) 2015-10-05T05:20:57.656+0100 [conn1424030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:57.765+0100 [conn1423621] end connection 172.28.0.163:61288 (399 connections now open) 2015-10-05T05:20:57.766+0100 [mongosMain] connection accepted from 172.28.0.163:62232 #1424031 (400 connections now open) 2015-10-05T05:20:57.767+0100 [conn1424031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:20:58.357+0100 [conn1423634] end connection 172.28.0.163:61317 (399 connections now open) 2015-10-05T05:20:58.358+0100 [mongosMain] connection accepted from 172.28.0.163:62234 #1424032 (400 connections now open) 2015-10-05T05:20:58.360+0100 [conn1424032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:01.836+0100 [conn1423635] end connection 172.28.0.163:61322 (399 connections now open) 2015-10-05T05:21:01.837+0100 [mongosMain] connection accepted from 172.28.0.163:62244 #1424033 (400 connections now open) 2015-10-05T05:21:01.838+0100 [conn1424033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:01.974+0100 [conn1423589] end connection 172.28.0.164:54229 (399 connections now open) 2015-10-05T05:21:01.974+0100 [conn1423626] end connection 172.28.0.164:54377 (399 connections now open) 2015-10-05T05:21:01.975+0100 [mongosMain] connection accepted from 172.28.0.164:55309 #1424034 (399 connections now open) 2015-10-05T05:21:01.976+0100 [mongosMain] connection accepted from 172.28.0.164:55310 #1424035 (400 connections now open) 2015-10-05T05:21:01.977+0100 [conn1424034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:01.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faad5703b51053eb83f0 2015-10-05T05:21:01.978+0100 [conn1424035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:02.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:04.945+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:21:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:21:07.185+0100 [conn1423615] end connection 172.28.0.164:54355 (399 connections now open) 2015-10-05T05:21:07.186+0100 [mongosMain] connection accepted from 172.28.0.164:55314 #1424036 (400 connections now open) 2015-10-05T05:21:07.191+0100 [conn1424036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:07.653+0100 [conn1423637] end connection 172.28.0.164:54417 (399 connections now open) 2015-10-05T05:21:07.654+0100 [mongosMain] connection accepted from 172.28.0.164:55316 #1424037 (400 connections now open) 2015-10-05T05:21:07.656+0100 [conn1424037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:07.766+0100 [conn1423608] end connection 172.28.0.163:61224 (399 connections now open) 2015-10-05T05:21:07.767+0100 [mongosMain] connection accepted from 172.28.0.163:62255 #1424038 (400 connections now open) 2015-10-05T05:21:07.768+0100 [conn1424038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:08.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fab45703b51053eb8427 2015-10-05T05:21:08.373+0100 [conn1423639] end connection 172.28.0.163:61333 (399 connections now open) 2015-10-05T05:21:08.375+0100 [mongosMain] connection accepted from 172.28.0.163:62257 #1424039 (400 connections now open) 2015-10-05T05:21:08.376+0100 [conn1424039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:08.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:11.852+0100 [conn1423640] end connection 172.28.0.163:61340 (399 connections now open) 2015-10-05T05:21:11.852+0100 [conn1423493] end connection 172.28.0.163:60925 (399 connections now open) 2015-10-05T05:21:11.854+0100 [mongosMain] connection accepted from 172.28.0.163:62261 #1424040 (399 connections now open) 2015-10-05T05:21:11.854+0100 [mongosMain] connection accepted from 172.28.0.163:62262 #1424041 (400 connections now open) 2015-10-05T05:21:11.855+0100 [conn1424040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:11.855+0100 [conn1424041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:11.974+0100 [conn1423614] end connection 172.28.0.164:54352 (399 connections now open) 2015-10-05T05:21:11.977+0100 [mongosMain] connection accepted from 172.28.0.164:55320 #1424042 (400 connections now open) 2015-10-05T05:21:11.979+0100 [conn1424042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:14.626+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faba5703b51053eb8448 2015-10-05T05:21:14.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:17.201+0100 [conn1423610] end connection 172.28.0.164:54309 (399 connections now open) 2015-10-05T05:21:17.202+0100 [mongosMain] connection accepted from 172.28.0.164:55324 #1424043 (400 connections now open) 2015-10-05T05:21:17.204+0100 [conn1424043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:17.669+0100 [conn1423644] end connection 172.28.0.164:54431 (399 connections now open) 2015-10-05T05:21:17.670+0100 [mongosMain] connection accepted from 172.28.0.164:55326 #1424044 (400 connections now open) 2015-10-05T05:21:17.672+0100 [conn1424044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:17.780+0100 [conn1423627] end connection 172.28.0.163:61299 (399 connections now open) 2015-10-05T05:21:17.781+0100 [mongosMain] connection accepted from 172.28.0.163:62269 #1424045 (400 connections now open) 2015-10-05T05:21:17.782+0100 [conn1424045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:18.373+0100 [conn1423646] end connection 172.28.0.163:61355 (399 connections now open) 2015-10-05T05:21:18.374+0100 [mongosMain] connection accepted from 172.28.0.163:62270 #1424046 (400 connections now open) 2015-10-05T05:21:18.375+0100 [conn1424046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:20.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fac05703b51053eb846e 2015-10-05T05:21:21.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:21.855+0100 [conn1423630] end connection 172.28.0.163:61305 (399 connections now open) 2015-10-05T05:21:21.856+0100 [mongosMain] connection accepted from 172.28.0.163:62274 #1424047 (400 connections now open) 2015-10-05T05:21:21.857+0100 [conn1424047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:21.990+0100 [conn1423619] end connection 172.28.0.164:54361 (399 connections now open) 2015-10-05T05:21:21.990+0100 [conn1423631] end connection 172.28.0.164:54395 (399 connections now open) 2015-10-05T05:21:21.992+0100 [mongosMain] connection accepted from 172.28.0.164:55334 #1424048 (399 connections now open) 2015-10-05T05:21:21.992+0100 [mongosMain] connection accepted from 172.28.0.164:55335 #1424049 (400 connections now open) 2015-10-05T05:21:21.993+0100 [conn1424048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:21.994+0100 [conn1424049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:27.201+0100 [conn1423597] end connection 172.28.0.164:54254 (399 connections now open) 2015-10-05T05:21:27.202+0100 [mongosMain] connection accepted from 172.28.0.164:55343 #1424050 (400 connections now open) 2015-10-05T05:21:27.204+0100 [conn1424050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:27.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fac75703b51053eb8495 2015-10-05T05:21:27.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:27.668+0100 [conn1423649] end connection 172.28.0.164:54439 (399 connections now open) 2015-10-05T05:21:27.670+0100 [mongosMain] connection accepted from 172.28.0.164:55346 #1424051 (400 connections now open) 2015-10-05T05:21:27.672+0100 [conn1424051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:27.781+0100 [conn1423645] end connection 172.28.0.163:61350 (399 connections now open) 2015-10-05T05:21:27.783+0100 [mongosMain] connection accepted from 172.28.0.163:62277 #1424052 (400 connections now open) 2015-10-05T05:21:27.784+0100 [conn1424052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:28.389+0100 [conn1423651] end connection 172.28.0.163:61367 (399 connections now open) 2015-10-05T05:21:28.390+0100 [mongosMain] connection accepted from 172.28.0.163:62279 #1424053 (400 connections now open) 2015-10-05T05:21:28.391+0100 [conn1424053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:28.508+0100 [mongosMain] connection accepted from 127.0.0.1:62281 #1424054 (401 connections now open) 2015-10-05T05:21:28.511+0100 [conn1424054] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:28.515+0100 [conn1424054] end connection 127.0.0.1:62281 (400 connections now open) 2015-10-05T05:21:31.867+0100 [conn1423547] end connection 172.28.0.163:61039 (399 connections now open) 2015-10-05T05:21:31.868+0100 [conn1423652] end connection 172.28.0.163:61371 (398 connections now open) 2015-10-05T05:21:31.868+0100 [mongosMain] connection accepted from 172.28.0.163:62282 #1424055 (399 connections now open) 2015-10-05T05:21:31.869+0100 [mongosMain] connection accepted from 172.28.0.163:62283 #1424056 (400 connections now open) 2015-10-05T05:21:31.869+0100 [conn1424055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:31.870+0100 [conn1424056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:31.991+0100 [conn1423625] end connection 172.28.0.164:54376 (399 connections now open) 2015-10-05T05:21:31.991+0100 [conn1423641] end connection 172.28.0.164:54423 (398 connections now open) 2015-10-05T05:21:31.992+0100 [mongosMain] connection accepted from 172.28.0.164:55352 #1424057 (399 connections now open) 2015-10-05T05:21:31.992+0100 [mongosMain] connection accepted from 172.28.0.164:55353 #1424058 (400 connections now open) 2015-10-05T05:21:31.993+0100 [conn1424057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:31.993+0100 [conn1424058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:33.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611facd5703b51053eb84b2 2015-10-05T05:21:34.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:35.216+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:21:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:21:37.217+0100 [conn1423580] end connection 172.28.0.164:54213 (399 connections now open) 2015-10-05T05:21:37.218+0100 [mongosMain] connection accepted from 172.28.0.164:55361 #1424059 (400 connections now open) 2015-10-05T05:21:37.220+0100 [conn1424059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:37.685+0100 [conn1423656] end connection 172.28.0.164:54458 (399 connections now open) 2015-10-05T05:21:37.686+0100 [mongosMain] connection accepted from 172.28.0.164:55364 #1424060 (400 connections now open) 2015-10-05T05:21:37.688+0100 [conn1424060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:37.796+0100 [conn1423638] end connection 172.28.0.163:61331 (399 connections now open) 2015-10-05T05:21:37.797+0100 [mongosMain] connection accepted from 172.28.0.163:62287 #1424061 (400 connections now open) 2015-10-05T05:21:37.798+0100 [conn1424061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:38.389+0100 [conn1423658] end connection 172.28.0.163:61377 (399 connections now open) 2015-10-05T05:21:38.392+0100 [mongosMain] connection accepted from 172.28.0.163:62293 #1424062 (400 connections now open) 2015-10-05T05:21:38.393+0100 [conn1424062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:40.210+0100 [mongosMain] connection accepted from 127.0.0.1:62294 #1424063 (401 connections now open) 2015-10-05T05:21:40.213+0100 [conn1424063] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:40.218+0100 [conn1424063] end connection 127.0.0.1:62294 (400 connections now open) 2015-10-05T05:21:40.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fad45703b51053eb84c8 2015-10-05T05:21:40.441+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:41.883+0100 [conn1423532] end connection 172.28.0.163:60992 (399 connections now open) 2015-10-05T05:21:41.884+0100 [mongosMain] connection accepted from 172.28.0.163:62297 #1424064 (400 connections now open) 2015-10-05T05:21:41.885+0100 [conn1424064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:42.006+0100 [conn1423647] end connection 172.28.0.164:54433 (399 connections now open) 2015-10-05T05:21:42.006+0100 [conn1423636] end connection 172.28.0.164:54410 (398 connections now open) 2015-10-05T05:21:42.007+0100 [mongosMain] connection accepted from 172.28.0.164:55373 #1424065 (399 connections now open) 2015-10-05T05:21:42.008+0100 [mongosMain] connection accepted from 172.28.0.164:55372 #1424066 (400 connections now open) 2015-10-05T05:21:42.009+0100 [conn1424065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:42.010+0100 [conn1424066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:46.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fada5703b51053eb84df 2015-10-05T05:21:46.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:47.216+0100 [conn1423643] end connection 172.28.0.164:54429 (399 connections now open) 2015-10-05T05:21:47.217+0100 [mongosMain] connection accepted from 172.28.0.164:55380 #1424067 (400 connections now open) 2015-10-05T05:21:47.219+0100 [conn1424067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:47.686+0100 [conn1423665] end connection 172.28.0.164:54478 (399 connections now open) 2015-10-05T05:21:47.687+0100 [mongosMain] connection accepted from 172.28.0.164:55383 #1424068 (400 connections now open) 2015-10-05T05:21:47.688+0100 [conn1424068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:47.812+0100 [conn1423565] end connection 172.28.0.163:61070 (399 connections now open) 2015-10-05T05:21:47.813+0100 [mongosMain] connection accepted from 172.28.0.163:62307 #1424069 (400 connections now open) 2015-10-05T05:21:47.814+0100 [conn1424069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:48.405+0100 [conn1423667] end connection 172.28.0.163:61387 (399 connections now open) 2015-10-05T05:21:48.406+0100 [mongosMain] connection accepted from 172.28.0.163:62310 #1424070 (400 connections now open) 2015-10-05T05:21:48.407+0100 [conn1424070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:51.884+0100 [conn1423500] end connection 172.28.0.163:60941 (399 connections now open) 2015-10-05T05:21:51.885+0100 [mongosMain] connection accepted from 172.28.0.163:62314 #1424071 (400 connections now open) 2015-10-05T05:21:51.886+0100 [conn1424071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:52.021+0100 [conn1423584] end connection 172.28.0.164:54218 (399 connections now open) 2015-10-05T05:21:52.021+0100 [conn1423663] end connection 172.28.0.164:54465 (399 connections now open) 2015-10-05T05:21:52.022+0100 [mongosMain] connection accepted from 172.28.0.164:55388 #1424072 (399 connections now open) 2015-10-05T05:21:52.023+0100 [mongosMain] connection accepted from 172.28.0.164:55389 #1424073 (400 connections now open) 2015-10-05T05:21:52.023+0100 [conn1424072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:52.024+0100 [conn1424073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:53.125+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fae05703b51053eb84fe 2015-10-05T05:21:53.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:21:57.233+0100 [conn1423664] end connection 172.28.0.164:54473 (399 connections now open) 2015-10-05T05:21:57.234+0100 [mongosMain] connection accepted from 172.28.0.164:55394 #1424074 (400 connections now open) 2015-10-05T05:21:57.235+0100 [conn1424074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:57.701+0100 [conn1423673] end connection 172.28.0.164:54495 (399 connections now open) 2015-10-05T05:21:57.702+0100 [mongosMain] connection accepted from 172.28.0.164:55396 #1424075 (400 connections now open) 2015-10-05T05:21:57.704+0100 [conn1424075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:57.813+0100 [conn1423633] end connection 172.28.0.163:61315 (399 connections now open) 2015-10-05T05:21:57.814+0100 [mongosMain] connection accepted from 172.28.0.163:62327 #1424076 (400 connections now open) 2015-10-05T05:21:57.815+0100 [conn1424076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:58.406+0100 [conn1423675] end connection 172.28.0.163:61406 (399 connections now open) 2015-10-05T05:21:58.407+0100 [mongosMain] connection accepted from 172.28.0.163:62328 #1424077 (400 connections now open) 2015-10-05T05:21:58.408+0100 [conn1424077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:21:59.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fae75703b51053eb8517 2015-10-05T05:21:59.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:22:01.899+0100 [conn1423653] end connection 172.28.0.163:61372 (399 connections now open) 2015-10-05T05:22:01.899+0100 [conn1423677] end connection 172.28.0.163:61411 (398 connections now open) 2015-10-05T05:22:01.901+0100 [mongosMain] connection accepted from 172.28.0.163:62341 #1424078 (399 connections now open) 2015-10-05T05:22:01.901+0100 [mongosMain] connection accepted from 172.28.0.163:62342 #1424079 (400 connections now open) 2015-10-05T05:22:01.902+0100 [conn1424078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:01.902+0100 [conn1424079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:02.037+0100 [conn1423662] end connection 172.28.0.164:54466 (399 connections now open) 2015-10-05T05:22:02.039+0100 [mongosMain] connection accepted from 172.28.0.164:55405 #1424080 (400 connections now open) 2015-10-05T05:22:02.041+0100 [conn1424080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:05.517+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:22:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:22:07.232+0100 [conn1423571] end connection 172.28.0.164:54188 (399 connections now open) 2015-10-05T05:22:07.242+0100 [mongosMain] connection accepted from 172.28.0.164:55406 #1424081 (400 connections now open) 2015-10-05T05:22:07.244+0100 [conn1424081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:07.700+0100 [conn1423680] end connection 172.28.0.164:54508 (399 connections now open) 2015-10-05T05:22:07.701+0100 [mongosMain] connection accepted from 172.28.0.164:55408 #1424082 (400 connections now open) 2015-10-05T05:22:07.703+0100 [conn1424082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:07.828+0100 [conn1423650] end connection 172.28.0.163:61365 (399 connections now open) 2015-10-05T05:22:07.829+0100 [mongosMain] connection accepted from 172.28.0.163:62350 #1424083 (400 connections now open) 2015-10-05T05:22:07.830+0100 [conn1424083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:08.420+0100 [conn1423682] end connection 172.28.0.163:61423 (399 connections now open) 2015-10-05T05:22:08.421+0100 [mongosMain] connection accepted from 172.28.0.163:62353 #1424084 (400 connections now open) 2015-10-05T05:22:08.422+0100 [conn1424084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:11.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faf35703b51053eb854f 2015-10-05T05:22:11.899+0100 [conn1423661] end connection 172.28.0.163:61381 (399 connections now open) 2015-10-05T05:22:11.900+0100 [mongosMain] connection accepted from 172.28.0.163:62356 #1424085 (400 connections now open) 2015-10-05T05:22:11.902+0100 [conn1424085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:11.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:22:12.053+0100 [conn1423672] end connection 172.28.0.164:54487 (399 connections now open) 2015-10-05T05:22:12.054+0100 [mongosMain] connection accepted from 172.28.0.164:55412 #1424086 (400 connections now open) 2015-10-05T05:22:12.056+0100 [conn1424086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:17.248+0100 [conn1423655] end connection 172.28.0.164:54456 (399 connections now open) 2015-10-05T05:22:17.249+0100 [mongosMain] connection accepted from 172.28.0.164:55416 #1424087 (400 connections now open) 2015-10-05T05:22:17.251+0100 [conn1424087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:17.717+0100 [conn1423686] end connection 172.28.0.164:54518 (399 connections now open) 2015-10-05T05:22:17.718+0100 [mongosMain] connection accepted from 172.28.0.164:55418 #1424088 (400 connections now open) 2015-10-05T05:22:17.719+0100 [conn1424088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:17.828+0100 [conn1423657] end connection 172.28.0.163:61375 (399 connections now open) 2015-10-05T05:22:17.830+0100 [mongosMain] connection accepted from 172.28.0.163:62365 #1424089 (400 connections now open) 2015-10-05T05:22:17.830+0100 [conn1424089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:18.436+0100 [conn1423688] end connection 172.28.0.163:61443 (399 connections now open) 2015-10-05T05:22:18.438+0100 [mongosMain] connection accepted from 172.28.0.163:62366 #1424090 (400 connections now open) 2015-10-05T05:22:18.439+0100 [conn1424090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:21.915+0100 [conn1423684] end connection 172.28.0.163:61432 (399 connections now open) 2015-10-05T05:22:21.916+0100 [mongosMain] connection accepted from 172.28.0.163:62369 #1424091 (400 connections now open) 2015-10-05T05:22:21.917+0100 [conn1424091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:22.053+0100 [conn1423654] end connection 172.28.0.164:54446 (399 connections now open) 2015-10-05T05:22:22.054+0100 [mongosMain] connection accepted from 172.28.0.164:55427 #1424092 (400 connections now open) 2015-10-05T05:22:22.056+0100 [conn1424092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:24.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611faff5703b51053eb858c 2015-10-05T05:22:24.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:22:27.264+0100 [conn1423648] end connection 172.28.0.164:54437 (399 connections now open) 2015-10-05T05:22:27.265+0100 [mongosMain] connection accepted from 172.28.0.164:55435 #1424093 (400 connections now open) 2015-10-05T05:22:27.266+0100 [conn1424093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:27.733+0100 [conn1423692] end connection 172.28.0.164:54529 (399 connections now open) 2015-10-05T05:22:27.734+0100 [mongosMain] connection accepted from 172.28.0.164:55438 #1424094 (400 connections now open) 2015-10-05T05:22:27.735+0100 [conn1424094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:27.843+0100 [conn1423674] end connection 172.28.0.163:61403 (399 connections now open) 2015-10-05T05:22:27.844+0100 [mongosMain] connection accepted from 172.28.0.163:62371 #1424095 (400 connections now open) 2015-10-05T05:22:27.845+0100 [conn1424095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:28.436+0100 [conn1423693] end connection 172.28.0.163:61457 (399 connections now open) 2015-10-05T05:22:28.438+0100 [mongosMain] connection accepted from 172.28.0.163:62372 #1424096 (400 connections now open) 2015-10-05T05:22:28.439+0100 [conn1424096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:29.024+0100 [mongosMain] connection accepted from 127.0.0.1:62374 #1424097 (401 connections now open) 2015-10-05T05:22:29.027+0100 [conn1424097] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:29.035+0100 [conn1424097] end connection 127.0.0.1:62374 (400 connections now open) 2015-10-05T05:22:31.918+0100 [conn1423695] end connection 172.28.0.163:61462 (399 connections now open) 2015-10-05T05:22:31.919+0100 [mongosMain] connection accepted from 172.28.0.163:62376 #1424098 (400 connections now open) 2015-10-05T05:22:31.920+0100 [conn1424098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:32.068+0100 [conn1423690] end connection 172.28.0.164:54522 (399 connections now open) 2015-10-05T05:22:32.069+0100 [mongosMain] connection accepted from 172.28.0.164:55443 #1424099 (400 connections now open) 2015-10-05T05:22:32.071+0100 [conn1424099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:35.772+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:22:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:22:36.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb0c5703b51053eb85ca 2015-10-05T05:22:36.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:22:37.280+0100 [conn1423679] end connection 172.28.0.164:54506 (399 connections now open) 2015-10-05T05:22:37.281+0100 [mongosMain] connection accepted from 172.28.0.164:55452 #1424100 (400 connections now open) 2015-10-05T05:22:37.283+0100 [conn1424100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:37.748+0100 [conn1423699] end connection 172.28.0.164:54549 (399 connections now open) 2015-10-05T05:22:37.749+0100 [mongosMain] connection accepted from 172.28.0.164:55455 #1424101 (400 connections now open) 2015-10-05T05:22:37.751+0100 [conn1424101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:37.844+0100 [conn1423687] end connection 172.28.0.163:61440 (399 connections now open) 2015-10-05T05:22:37.845+0100 [mongosMain] connection accepted from 172.28.0.163:62379 #1424102 (400 connections now open) 2015-10-05T05:22:37.847+0100 [conn1424102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:38.452+0100 [conn1423701] end connection 172.28.0.163:61467 (399 connections now open) 2015-10-05T05:22:38.453+0100 [mongosMain] connection accepted from 172.28.0.163:62380 #1424103 (400 connections now open) 2015-10-05T05:22:38.454+0100 [conn1424103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:40.021+0100 [mongosMain] connection accepted from 127.0.0.1:62382 #1424104 (401 connections now open) 2015-10-05T05:22:40.025+0100 [conn1424104] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:40.029+0100 [conn1424104] end connection 127.0.0.1:62382 (400 connections now open) 2015-10-05T05:22:41.931+0100 [conn1423676] end connection 172.28.0.163:61410 (399 connections now open) 2015-10-05T05:22:41.931+0100 [conn1423683] end connection 172.28.0.163:61431 (399 connections now open) 2015-10-05T05:22:41.932+0100 [mongosMain] connection accepted from 172.28.0.163:62385 #1424105 (399 connections now open) 2015-10-05T05:22:41.933+0100 [mongosMain] connection accepted from 172.28.0.163:62386 #1424106 (400 connections now open) 2015-10-05T05:22:41.933+0100 [conn1424105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:41.934+0100 [conn1424106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:42.084+0100 [conn1423678] end connection 172.28.0.164:54500 (399 connections now open) 2015-10-05T05:22:42.085+0100 [mongosMain] connection accepted from 172.28.0.164:55463 #1424107 (400 connections now open) 2015-10-05T05:22:42.087+0100 [conn1424107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:47.748+0100 [conn1423708] end connection 172.28.0.164:54568 (399 connections now open) 2015-10-05T05:22:47.749+0100 [mongosMain] connection accepted from 172.28.0.164:55472 #1424108 (400 connections now open) 2015-10-05T05:22:47.751+0100 [conn1424108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:48.452+0100 [conn1423709] end connection 172.28.0.163:61473 (399 connections now open) 2015-10-05T05:22:48.453+0100 [mongosMain] connection accepted from 172.28.0.163:62398 #1424109 (400 connections now open) 2015-10-05T05:22:48.455+0100 [conn1424109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:48.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb185703b51053eb8604 2015-10-05T05:22:49.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:22:51.932+0100 [conn1423670] end connection 172.28.0.163:61395 (399 connections now open) 2015-10-05T05:22:51.933+0100 [mongosMain] connection accepted from 172.28.0.163:62402 #1424110 (400 connections now open) 2015-10-05T05:22:51.934+0100 [conn1424110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:52.084+0100 [conn1423706] end connection 172.28.0.164:54556 (399 connections now open) 2015-10-05T05:22:52.085+0100 [mongosMain] connection accepted from 172.28.0.164:55477 #1424111 (400 connections now open) 2015-10-05T05:22:52.087+0100 [conn1424111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:57.295+0100 [conn1423698] end connection 172.28.0.164:54546 (399 connections now open) 2015-10-05T05:22:57.297+0100 [mongosMain] connection accepted from 172.28.0.164:55482 #1424112 (400 connections now open) 2015-10-05T05:22:57.299+0100 [conn1424112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:57.764+0100 [conn1423715] end connection 172.28.0.164:54584 (399 connections now open) 2015-10-05T05:22:57.765+0100 [mongosMain] connection accepted from 172.28.0.164:55484 #1424113 (400 connections now open) 2015-10-05T05:22:57.767+0100 [conn1424113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:22:58.468+0100 [conn1423717] end connection 172.28.0.163:61491 (399 connections now open) 2015-10-05T05:22:58.470+0100 [mongosMain] connection accepted from 172.28.0.163:62414 #1424114 (400 connections now open) 2015-10-05T05:22:58.471+0100 [conn1424114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:01.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb255703b51053eb8649 2015-10-05T05:23:01.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:01.946+0100 [conn1423703] end connection 172.28.0.163:61470 (399 connections now open) 2015-10-05T05:23:01.947+0100 [mongosMain] connection accepted from 172.28.0.163:62422 #1424115 (400 connections now open) 2015-10-05T05:23:01.948+0100 [conn1424115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:02.100+0100 [conn1423719] end connection 172.28.0.164:54589 (399 connections now open) 2015-10-05T05:23:02.101+0100 [conn1423691] end connection 172.28.0.164:54524 (398 connections now open) 2015-10-05T05:23:02.102+0100 [mongosMain] connection accepted from 172.28.0.164:55493 #1424116 (399 connections now open) 2015-10-05T05:23:02.102+0100 [mongosMain] connection accepted from 172.28.0.164:55494 #1424117 (400 connections now open) 2015-10-05T05:23:02.104+0100 [conn1424116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:02.104+0100 [conn1424117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:06.033+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:23:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:23:07.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb2b5703b51053eb8691 2015-10-05T05:23:07.764+0100 [conn1423722] end connection 172.28.0.164:54598 (399 connections now open) 2015-10-05T05:23:07.764+0100 [mongosMain] connection accepted from 172.28.0.164:55510 #1424118 (400 connections now open) 2015-10-05T05:23:07.766+0100 [conn1424118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:07.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:08.468+0100 [conn1423723] end connection 172.28.0.163:61507 (399 connections now open) 2015-10-05T05:23:08.469+0100 [mongosMain] connection accepted from 172.28.0.163:62457 #1424119 (400 connections now open) 2015-10-05T05:23:08.470+0100 [conn1424119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:12.100+0100 [conn1423696] end connection 172.28.0.164:54537 (399 connections now open) 2015-10-05T05:23:12.101+0100 [conn1423642] end connection 172.28.0.164:54424 (398 connections now open) 2015-10-05T05:23:12.101+0100 [mongosMain] connection accepted from 172.28.0.164:55514 #1424120 (400 connections now open) 2015-10-05T05:23:12.103+0100 [mongosMain] connection accepted from 172.28.0.164:55517 #1424121 (400 connections now open) 2015-10-05T05:23:12.104+0100 [conn1424120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:12.105+0100 [conn1424121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:14.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb315703b51053eb86af 2015-10-05T05:23:14.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:17.779+0100 [conn1423728] end connection 172.28.0.164:54612 (399 connections now open) 2015-10-05T05:23:17.780+0100 [mongosMain] connection accepted from 172.28.0.164:55521 #1424122 (400 connections now open) 2015-10-05T05:23:17.782+0100 [conn1424122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:18.483+0100 [conn1423729] end connection 172.28.0.163:61531 (399 connections now open) 2015-10-05T05:23:18.484+0100 [mongosMain] connection accepted from 172.28.0.163:62469 #1424123 (400 connections now open) 2015-10-05T05:23:18.485+0100 [conn1424123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:20.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb385703b51053eb86cb 2015-10-05T05:23:20.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:22.116+0100 [conn1423705] end connection 172.28.0.164:54555 (399 connections now open) 2015-10-05T05:23:22.117+0100 [mongosMain] connection accepted from 172.28.0.164:55530 #1424124 (400 connections now open) 2015-10-05T05:23:22.119+0100 [conn1424124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:26.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb3e5703b51053eb86dc 2015-10-05T05:23:27.069+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:27.343+0100 [conn1423707] end connection 172.28.0.164:54564 (399 connections now open) 2015-10-05T05:23:27.344+0100 [mongosMain] connection accepted from 172.28.0.164:55538 #1424125 (400 connections now open) 2015-10-05T05:23:27.345+0100 [conn1424125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:27.522+0100 [mongosMain] connection accepted from 127.0.0.1:62474 #1424126 (401 connections now open) 2015-10-05T05:23:27.524+0100 [conn1424126] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:27.529+0100 [conn1424126] end connection 127.0.0.1:62474 (400 connections now open) 2015-10-05T05:23:27.795+0100 [conn1423734] end connection 172.28.0.164:54621 (399 connections now open) 2015-10-05T05:23:27.796+0100 [mongosMain] connection accepted from 172.28.0.164:55541 #1424127 (400 connections now open) 2015-10-05T05:23:27.798+0100 [conn1424127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:27.891+0100 [conn1423700] end connection 172.28.0.163:61465 (399 connections now open) 2015-10-05T05:23:27.892+0100 [mongosMain] connection accepted from 172.28.0.163:62475 #1424128 (400 connections now open) 2015-10-05T05:23:27.893+0100 [conn1424128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:28.484+0100 [conn1423735] end connection 172.28.0.163:61545 (399 connections now open) 2015-10-05T05:23:28.485+0100 [mongosMain] connection accepted from 172.28.0.163:62477 #1424129 (400 connections now open) 2015-10-05T05:23:28.487+0100 [conn1424129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:29.046+0100 [mongosMain] connection accepted from 127.0.0.1:62479 #1424130 (401 connections now open) 2015-10-05T05:23:29.049+0100 [conn1424130] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:29.054+0100 [conn1424130] end connection 127.0.0.1:62479 (400 connections now open) 2015-10-05T05:23:29.219+0100 [mongosMain] connection accepted from 127.0.0.1:62480 #1424131 (401 connections now open) 2015-10-05T05:23:29.222+0100 [conn1424131] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:29.227+0100 [conn1424131] end connection 127.0.0.1:62480 (400 connections now open) 2015-10-05T05:23:31.978+0100 [conn1423737] end connection 172.28.0.163:61553 (399 connections now open) 2015-10-05T05:23:31.978+0100 [conn1423730] end connection 172.28.0.163:61535 (399 connections now open) 2015-10-05T05:23:31.979+0100 [mongosMain] connection accepted from 172.28.0.163:62482 #1424132 (399 connections now open) 2015-10-05T05:23:31.979+0100 [mongosMain] connection accepted from 172.28.0.163:62483 #1424133 (400 connections now open) 2015-10-05T05:23:31.980+0100 [conn1424132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:31.981+0100 [conn1424133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:32.131+0100 [conn1423671] end connection 172.28.0.164:54486 (399 connections now open) 2015-10-05T05:23:32.131+0100 [conn1423726] end connection 172.28.0.164:54608 (398 connections now open) 2015-10-05T05:23:32.133+0100 [mongosMain] connection accepted from 172.28.0.164:55549 #1424134 (399 connections now open) 2015-10-05T05:23:32.133+0100 [mongosMain] connection accepted from 172.28.0.164:55547 #1424135 (400 connections now open) 2015-10-05T05:23:32.135+0100 [conn1424134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:32.136+0100 [conn1424135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:33.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb455703b51053eb86eb 2015-10-05T05:23:33.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:36.287+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:23:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:23:37.342+0100 [conn1423727] end connection 172.28.0.164:54609 (399 connections now open) 2015-10-05T05:23:37.344+0100 [mongosMain] connection accepted from 172.28.0.164:55560 #1424136 (400 connections now open) 2015-10-05T05:23:37.345+0100 [conn1424136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:37.794+0100 [conn1423741] end connection 172.28.0.164:54640 (399 connections now open) 2015-10-05T05:23:37.796+0100 [mongosMain] connection accepted from 172.28.0.164:55562 #1424137 (400 connections now open) 2015-10-05T05:23:37.797+0100 [conn1424137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:37.906+0100 [conn1423666] end connection 172.28.0.163:61386 (399 connections now open) 2015-10-05T05:23:37.907+0100 [mongosMain] connection accepted from 172.28.0.163:62487 #1424138 (400 connections now open) 2015-10-05T05:23:37.908+0100 [conn1424138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:38.499+0100 [conn1423743] end connection 172.28.0.163:61556 (399 connections now open) 2015-10-05T05:23:38.501+0100 [mongosMain] connection accepted from 172.28.0.163:62490 #1424139 (400 connections now open) 2015-10-05T05:23:38.502+0100 [conn1424139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:39.251+0100 [mongosMain] connection accepted from 127.0.0.1:62492 #1424140 (401 connections now open) 2015-10-05T05:23:39.254+0100 [conn1424140] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:39.258+0100 [conn1424140] end connection 127.0.0.1:62492 (400 connections now open) 2015-10-05T05:23:39.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb4b5703b51053eb8708 2015-10-05T05:23:39.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:41.981+0100 [conn1423724] end connection 172.28.0.163:61521 (399 connections now open) 2015-10-05T05:23:41.981+0100 [conn1423712] end connection 172.28.0.163:61479 (399 connections now open) 2015-10-05T05:23:41.982+0100 [mongosMain] connection accepted from 172.28.0.163:62495 #1424141 (399 connections now open) 2015-10-05T05:23:41.982+0100 [mongosMain] connection accepted from 172.28.0.163:62496 #1424142 (400 connections now open) 2015-10-05T05:23:41.983+0100 [conn1424142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:41.983+0100 [conn1424141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:42.131+0100 [conn1423731] end connection 172.28.0.164:54616 (399 connections now open) 2015-10-05T05:23:42.131+0100 [conn1423553] end connection 172.28.0.164:54139 (398 connections now open) 2015-10-05T05:23:42.133+0100 [mongosMain] connection accepted from 172.28.0.164:55572 #1424143 (399 connections now open) 2015-10-05T05:23:42.134+0100 [mongosMain] connection accepted from 172.28.0.164:55573 #1424144 (400 connections now open) 2015-10-05T05:23:42.135+0100 [conn1424143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:42.136+0100 [conn1424144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:46.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb515703b51053eb871d 2015-10-05T05:23:46.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:47.358+0100 [conn1423749] end connection 172.28.0.164:54656 (399 connections now open) 2015-10-05T05:23:47.359+0100 [mongosMain] connection accepted from 172.28.0.164:55581 #1424145 (400 connections now open) 2015-10-05T05:23:47.361+0100 [conn1424145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:47.811+0100 [conn1423750] end connection 172.28.0.164:54658 (399 connections now open) 2015-10-05T05:23:47.812+0100 [mongosMain] connection accepted from 172.28.0.164:55582 #1424146 (400 connections now open) 2015-10-05T05:23:47.814+0100 [conn1424146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:51.994+0100 [conn1423745] end connection 172.28.0.163:61559 (399 connections now open) 2015-10-05T05:23:51.995+0100 [conn1423704] end connection 172.28.0.163:61471 (399 connections now open) 2015-10-05T05:23:51.996+0100 [mongosMain] connection accepted from 172.28.0.163:62512 #1424147 (399 connections now open) 2015-10-05T05:23:51.996+0100 [mongosMain] connection accepted from 172.28.0.163:62513 #1424148 (400 connections now open) 2015-10-05T05:23:51.997+0100 [conn1424147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:51.998+0100 [conn1424148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:52.147+0100 [conn1423738] end connection 172.28.0.164:54627 (399 connections now open) 2015-10-05T05:23:52.147+0100 [conn1423713] end connection 172.28.0.164:54574 (398 connections now open) 2015-10-05T05:23:52.148+0100 [mongosMain] connection accepted from 172.28.0.164:55588 #1424149 (399 connections now open) 2015-10-05T05:23:52.148+0100 [mongosMain] connection accepted from 172.28.0.164:55589 #1424150 (400 connections now open) 2015-10-05T05:23:52.150+0100 [conn1424149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:52.150+0100 [conn1424150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:52.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb585703b51053eb8730 2015-10-05T05:23:52.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:23:57.374+0100 [conn1423740] end connection 172.28.0.164:54638 (399 connections now open) 2015-10-05T05:23:57.375+0100 [mongosMain] connection accepted from 172.28.0.164:55594 #1424151 (400 connections now open) 2015-10-05T05:23:57.377+0100 [conn1424151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:57.826+0100 [conn1423759] end connection 172.28.0.164:54679 (399 connections now open) 2015-10-05T05:23:57.827+0100 [mongosMain] connection accepted from 172.28.0.164:55596 #1424152 (400 connections now open) 2015-10-05T05:23:57.829+0100 [conn1424152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:57.922+0100 [conn1423760] end connection 172.28.0.163:61583 (399 connections now open) 2015-10-05T05:23:57.923+0100 [mongosMain] connection accepted from 172.28.0.163:62523 #1424153 (400 connections now open) 2015-10-05T05:23:57.924+0100 [conn1424153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:58.515+0100 [conn1423761] end connection 172.28.0.163:61585 (399 connections now open) 2015-10-05T05:23:58.516+0100 [mongosMain] connection accepted from 172.28.0.163:62525 #1424154 (400 connections now open) 2015-10-05T05:23:58.517+0100 [conn1424154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:23:59.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb5e5703b51053eb8745 2015-10-05T05:23:59.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:24:01.997+0100 [conn1423718] end connection 172.28.0.163:61496 (399 connections now open) 2015-10-05T05:24:01.997+0100 [conn1423755] end connection 172.28.0.163:61572 (398 connections now open) 2015-10-05T05:24:01.998+0100 [mongosMain] connection accepted from 172.28.0.163:62533 #1424155 (399 connections now open) 2015-10-05T05:24:01.999+0100 [conn1424155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:01.999+0100 [mongosMain] connection accepted from 172.28.0.163:62534 #1424156 (400 connections now open) 2015-10-05T05:24:02.000+0100 [conn1424156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:02.147+0100 [conn1423748] end connection 172.28.0.164:54646 (399 connections now open) 2015-10-05T05:24:02.148+0100 [conn1423685] end connection 172.28.0.164:54515 (398 connections now open) 2015-10-05T05:24:02.149+0100 [mongosMain] connection accepted from 172.28.0.164:55602 #1424157 (399 connections now open) 2015-10-05T05:24:02.150+0100 [mongosMain] connection accepted from 172.28.0.164:55603 #1424158 (400 connections now open) 2015-10-05T05:24:02.154+0100 [conn1424157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:02.154+0100 [conn1424158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:05.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb655703b51053eb8782 2015-10-05T05:24:05.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:24:06.547+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:24:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:24:07.373+0100 [conn1423721] end connection 172.28.0.164:54596 (399 connections now open) 2015-10-05T05:24:07.375+0100 [mongosMain] connection accepted from 172.28.0.164:55606 #1424159 (400 connections now open) 2015-10-05T05:24:07.377+0100 [conn1424159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:07.842+0100 [conn1423767] end connection 172.28.0.164:54694 (399 connections now open) 2015-10-05T05:24:07.843+0100 [mongosMain] connection accepted from 172.28.0.164:55608 #1424160 (400 connections now open) 2015-10-05T05:24:07.847+0100 [conn1424160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:07.923+0100 [conn1423681] end connection 172.28.0.163:61420 (399 connections now open) 2015-10-05T05:24:07.924+0100 [mongosMain] connection accepted from 172.28.0.163:62547 #1424161 (400 connections now open) 2015-10-05T05:24:07.925+0100 [conn1424161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:08.532+0100 [conn1423752] end connection 172.28.0.163:61566 (399 connections now open) 2015-10-05T05:24:08.534+0100 [mongosMain] connection accepted from 172.28.0.163:62555 #1424162 (400 connections now open) 2015-10-05T05:24:08.535+0100 [conn1424162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:12.009+0100 [conn1423763] end connection 172.28.0.163:61592 (399 connections now open) 2015-10-05T05:24:12.009+0100 [conn1423660] end connection 172.28.0.163:61380 (398 connections now open) 2015-10-05T05:24:12.010+0100 [mongosMain] connection accepted from 172.28.0.163:62566 #1424163 (399 connections now open) 2015-10-05T05:24:12.011+0100 [mongosMain] connection accepted from 172.28.0.163:62567 #1424164 (400 connections now open) 2015-10-05T05:24:12.011+0100 [conn1424163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:12.012+0100 [conn1424164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:12.163+0100 [conn1423756] end connection 172.28.0.164:54668 (399 connections now open) 2015-10-05T05:24:12.163+0100 [conn1423732] end connection 172.28.0.164:54615 (398 connections now open) 2015-10-05T05:24:12.164+0100 [mongosMain] connection accepted from 172.28.0.164:55611 #1424165 (399 connections now open) 2015-10-05T05:24:12.165+0100 [mongosMain] connection accepted from 172.28.0.164:55612 #1424166 (400 connections now open) 2015-10-05T05:24:12.166+0100 [conn1424165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:12.166+0100 [conn1424166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:17.390+0100 [conn1423758] end connection 172.28.0.164:54675 (399 connections now open) 2015-10-05T05:24:17.390+0100 [mongosMain] connection accepted from 172.28.0.164:55616 #1424167 (400 connections now open) 2015-10-05T05:24:17.392+0100 [conn1424167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:17.858+0100 [conn1423775] end connection 172.28.0.164:54704 (399 connections now open) 2015-10-05T05:24:17.860+0100 [mongosMain] connection accepted from 172.28.0.164:55618 #1424168 (400 connections now open) 2015-10-05T05:24:17.862+0100 [conn1424168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:17.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb715703b51053eb87c7 2015-10-05T05:24:17.938+0100 [conn1423751] end connection 172.28.0.163:61564 (399 connections now open) 2015-10-05T05:24:17.939+0100 [mongosMain] connection accepted from 172.28.0.163:62575 #1424169 (400 connections now open) 2015-10-05T05:24:17.940+0100 [conn1424169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:18.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:24:18.531+0100 [conn1423769] end connection 172.28.0.163:61602 (399 connections now open) 2015-10-05T05:24:18.532+0100 [mongosMain] connection accepted from 172.28.0.163:62577 #1424170 (400 connections now open) 2015-10-05T05:24:18.533+0100 [conn1424170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:22.025+0100 [conn1423771] end connection 172.28.0.163:61609 (399 connections now open) 2015-10-05T05:24:22.025+0100 [conn1423736] end connection 172.28.0.163:61550 (398 connections now open) 2015-10-05T05:24:22.026+0100 [mongosMain] connection accepted from 172.28.0.163:62580 #1424171 (399 connections now open) 2015-10-05T05:24:22.027+0100 [mongosMain] connection accepted from 172.28.0.163:62581 #1424172 (400 connections now open) 2015-10-05T05:24:22.027+0100 [conn1424171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:22.028+0100 [conn1424172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:22.178+0100 [conn1423772] end connection 172.28.0.164:54699 (399 connections now open) 2015-10-05T05:24:22.179+0100 [conn1423747] end connection 172.28.0.164:54647 (398 connections now open) 2015-10-05T05:24:22.180+0100 [mongosMain] connection accepted from 172.28.0.164:55627 #1424173 (399 connections now open) 2015-10-05T05:24:22.180+0100 [mongosMain] connection accepted from 172.28.0.164:55628 #1424174 (400 connections now open) 2015-10-05T05:24:22.181+0100 [conn1424173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:22.182+0100 [conn1424174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:27.405+0100 [conn1423714] end connection 172.28.0.164:54581 (399 connections now open) 2015-10-05T05:24:27.407+0100 [mongosMain] connection accepted from 172.28.0.164:55637 #1424175 (400 connections now open) 2015-10-05T05:24:27.408+0100 [conn1424175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:27.874+0100 [conn1423783] end connection 172.28.0.164:54714 (399 connections now open) 2015-10-05T05:24:27.874+0100 [mongosMain] connection accepted from 172.28.0.164:55640 #1424176 (400 connections now open) 2015-10-05T05:24:27.876+0100 [conn1424176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:27.939+0100 [conn1423716] end connection 172.28.0.163:61489 (399 connections now open) 2015-10-05T05:24:27.940+0100 [mongosMain] connection accepted from 172.28.0.163:62584 #1424177 (400 connections now open) 2015-10-05T05:24:27.941+0100 [conn1424177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:28.287+0100 [mongosMain] connection accepted from 127.0.0.1:62586 #1424178 (401 connections now open) 2015-10-05T05:24:28.289+0100 [conn1424178] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:28.294+0100 [conn1424178] end connection 127.0.0.1:62586 (400 connections now open) 2015-10-05T05:24:28.548+0100 [conn1423777] end connection 172.28.0.163:61623 (399 connections now open) 2015-10-05T05:24:28.549+0100 [mongosMain] connection accepted from 172.28.0.163:62588 #1424179 (400 connections now open) 2015-10-05T05:24:28.550+0100 [conn1424179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:30.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb7e5703b51053eb8803 2015-10-05T05:24:30.263+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:24:32.028+0100 [conn1423694] end connection 172.28.0.163:61461 (399 connections now open) 2015-10-05T05:24:32.028+0100 [conn1423779] end connection 172.28.0.163:61629 (398 connections now open) 2015-10-05T05:24:32.029+0100 [mongosMain] connection accepted from 172.28.0.163:62589 #1424180 (399 connections now open) 2015-10-05T05:24:32.029+0100 [mongosMain] connection accepted from 172.28.0.163:62591 #1424181 (400 connections now open) 2015-10-05T05:24:32.030+0100 [conn1424180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:32.030+0100 [conn1424181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:32.195+0100 [conn1423765] end connection 172.28.0.164:54685 (399 connections now open) 2015-10-05T05:24:32.195+0100 [conn1423720] end connection 172.28.0.164:54590 (399 connections now open) 2015-10-05T05:24:32.196+0100 [mongosMain] connection accepted from 172.28.0.164:55648 #1424182 (399 connections now open) 2015-10-05T05:24:32.196+0100 [mongosMain] connection accepted from 172.28.0.164:55649 #1424183 (400 connections now open) 2015-10-05T05:24:32.197+0100 [conn1424182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:32.197+0100 [conn1424183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:36.684+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:24:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:24:37.406+0100 [conn1423733] end connection 172.28.0.164:54619 (399 connections now open) 2015-10-05T05:24:37.407+0100 [mongosMain] connection accepted from 172.28.0.164:55658 #1424184 (400 connections now open) 2015-10-05T05:24:37.409+0100 [conn1424184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:37.874+0100 [conn1423791] end connection 172.28.0.164:54737 (399 connections now open) 2015-10-05T05:24:37.874+0100 [mongosMain] connection accepted from 172.28.0.164:55661 #1424185 (400 connections now open) 2015-10-05T05:24:37.876+0100 [conn1424185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:37.954+0100 [conn1423742] end connection 172.28.0.163:61554 (399 connections now open) 2015-10-05T05:24:37.955+0100 [mongosMain] connection accepted from 172.28.0.163:62595 #1424186 (400 connections now open) 2015-10-05T05:24:37.956+0100 [conn1424186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:38.547+0100 [conn1423785] end connection 172.28.0.163:61641 (399 connections now open) 2015-10-05T05:24:38.549+0100 [mongosMain] connection accepted from 172.28.0.163:62597 #1424187 (400 connections now open) 2015-10-05T05:24:38.550+0100 [conn1424187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:40.039+0100 [mongosMain] connection accepted from 127.0.0.1:62599 #1424188 (401 connections now open) 2015-10-05T05:24:40.042+0100 [conn1424188] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:40.047+0100 [conn1424188] end connection 127.0.0.1:62599 (400 connections now open) 2015-10-05T05:24:42.041+0100 [conn1423787] end connection 172.28.0.163:61645 (399 connections now open) 2015-10-05T05:24:42.041+0100 [conn1423669] end connection 172.28.0.163:61393 (399 connections now open) 2015-10-05T05:24:42.042+0100 [mongosMain] connection accepted from 172.28.0.163:62603 #1424189 (399 connections now open) 2015-10-05T05:24:42.042+0100 [mongosMain] connection accepted from 172.28.0.163:62604 #1424190 (400 connections now open) 2015-10-05T05:24:42.043+0100 [conn1424189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:42.043+0100 [conn1424190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:42.210+0100 [conn1423780] end connection 172.28.0.164:54707 (399 connections now open) 2015-10-05T05:24:42.210+0100 [conn1423725] end connection 172.28.0.164:54607 (399 connections now open) 2015-10-05T05:24:42.211+0100 [mongosMain] connection accepted from 172.28.0.164:55668 #1424191 (399 connections now open) 2015-10-05T05:24:42.211+0100 [mongosMain] connection accepted from 172.28.0.164:55669 #1424192 (400 connections now open) 2015-10-05T05:24:42.213+0100 [conn1424192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:42.213+0100 [conn1424191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:47.421+0100 [conn1423766] end connection 172.28.0.164:54692 (399 connections now open) 2015-10-05T05:24:47.422+0100 [mongosMain] connection accepted from 172.28.0.164:55680 #1424193 (400 connections now open) 2015-10-05T05:24:47.424+0100 [conn1424193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:47.889+0100 [conn1423800] end connection 172.28.0.164:54758 (399 connections now open) 2015-10-05T05:24:47.890+0100 [mongosMain] connection accepted from 172.28.0.164:55682 #1424194 (400 connections now open) 2015-10-05T05:24:47.892+0100 [conn1424194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:47.970+0100 [conn1423768] end connection 172.28.0.163:61600 (399 connections now open) 2015-10-05T05:24:47.971+0100 [mongosMain] connection accepted from 172.28.0.163:62616 #1424195 (400 connections now open) 2015-10-05T05:24:47.973+0100 [conn1424195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:48.502+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb905703b51053eb8854 2015-10-05T05:24:48.562+0100 [conn1423793] end connection 172.28.0.163:61650 (399 connections now open) 2015-10-05T05:24:48.564+0100 [mongosMain] connection accepted from 172.28.0.163:62618 #1424196 (400 connections now open) 2015-10-05T05:24:48.565+0100 [conn1424196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:48.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:24:52.041+0100 [conn1423754] end connection 172.28.0.163:61571 (399 connections now open) 2015-10-05T05:24:52.041+0100 [conn1423796] end connection 172.28.0.163:61654 (399 connections now open) 2015-10-05T05:24:52.042+0100 [mongosMain] connection accepted from 172.28.0.163:62623 #1424197 (399 connections now open) 2015-10-05T05:24:52.043+0100 [mongosMain] connection accepted from 172.28.0.163:62624 #1424198 (400 connections now open) 2015-10-05T05:24:52.043+0100 [conn1424197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:52.044+0100 [conn1424198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:52.226+0100 [conn1423757] end connection 172.28.0.164:54669 (399 connections now open) 2015-10-05T05:24:52.226+0100 [conn1423797] end connection 172.28.0.164:54744 (398 connections now open) 2015-10-05T05:24:52.226+0100 [mongosMain] connection accepted from 172.28.0.164:55689 #1424199 (400 connections now open) 2015-10-05T05:24:52.227+0100 [mongosMain] connection accepted from 172.28.0.164:55690 #1424200 (400 connections now open) 2015-10-05T05:24:52.227+0100 [conn1424199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:52.229+0100 [conn1424200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:54.746+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:24:54.746+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:24:57.421+0100 [conn1423782] end connection 172.28.0.164:54712 (399 connections now open) 2015-10-05T05:24:57.422+0100 [mongosMain] connection accepted from 172.28.0.164:55696 #1424201 (400 connections now open) 2015-10-05T05:24:57.424+0100 [conn1424201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:57.889+0100 [conn1423809] end connection 172.28.0.164:54775 (399 connections now open) 2015-10-05T05:24:57.890+0100 [mongosMain] connection accepted from 172.28.0.164:55698 #1424202 (400 connections now open) 2015-10-05T05:24:57.892+0100 [conn1424202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:57.973+0100 [conn1423784] end connection 172.28.0.163:61639 (399 connections now open) 2015-10-05T05:24:57.974+0100 [mongosMain] connection accepted from 172.28.0.163:62634 #1424203 (400 connections now open) 2015-10-05T05:24:57.976+0100 [conn1424203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:24:58.566+0100 [conn1423802] end connection 172.28.0.163:61660 (399 connections now open) 2015-10-05T05:24:58.568+0100 [mongosMain] connection accepted from 172.28.0.163:62637 #1424204 (400 connections now open) 2015-10-05T05:24:58.569+0100 [conn1424204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:00.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fb9c5703b51053eb8898 2015-10-05T05:25:00.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:25:02.057+0100 [conn1423746] end connection 172.28.0.163:61560 (399 connections now open) 2015-10-05T05:25:02.057+0100 [conn1423812] end connection 172.28.0.163:61684 (399 connections now open) 2015-10-05T05:25:02.059+0100 [mongosMain] connection accepted from 172.28.0.163:62645 #1424205 (399 connections now open) 2015-10-05T05:25:02.059+0100 [mongosMain] connection accepted from 172.28.0.163:62646 #1424206 (400 connections now open) 2015-10-05T05:25:02.060+0100 [conn1424205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:02.060+0100 [conn1424206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:02.225+0100 [conn1423788] end connection 172.28.0.164:54725 (399 connections now open) 2015-10-05T05:25:02.225+0100 [conn1423764] end connection 172.28.0.164:54684 (398 connections now open) 2015-10-05T05:25:02.226+0100 [mongosMain] connection accepted from 172.28.0.164:55707 #1424207 (399 connections now open) 2015-10-05T05:25:02.226+0100 [mongosMain] connection accepted from 172.28.0.164:55708 #1424208 (400 connections now open) 2015-10-05T05:25:02.227+0100 [conn1424207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:02.228+0100 [conn1424208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:06.834+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:25:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:25:07.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fba25703b51053eb88cc 2015-10-05T05:25:07.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:25:07.905+0100 [conn1423817] end connection 172.28.0.164:54791 (399 connections now open) 2015-10-05T05:25:07.906+0100 [mongosMain] connection accepted from 172.28.0.164:55711 #1424209 (400 connections now open) 2015-10-05T05:25:07.908+0100 [conn1424209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:07.985+0100 [conn1423776] end connection 172.28.0.163:61621 (399 connections now open) 2015-10-05T05:25:07.986+0100 [mongosMain] connection accepted from 172.28.0.163:62656 #1424210 (400 connections now open) 2015-10-05T05:25:07.987+0100 [conn1424210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:08.578+0100 [conn1423811] end connection 172.28.0.163:61679 (399 connections now open) 2015-10-05T05:25:08.579+0100 [mongosMain] connection accepted from 172.28.0.163:62658 #1424211 (400 connections now open) 2015-10-05T05:25:08.580+0100 [conn1424211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:12.059+0100 [conn1423711] end connection 172.28.0.163:61478 (399 connections now open) 2015-10-05T05:25:12.063+0100 [mongosMain] connection accepted from 172.28.0.163:62662 #1424212 (400 connections now open) 2015-10-05T05:25:12.064+0100 [conn1424212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:12.241+0100 [conn1423697] end connection 172.28.0.164:54538 (399 connections now open) 2015-10-05T05:25:12.242+0100 [conn1423815] end connection 172.28.0.164:54784 (398 connections now open) 2015-10-05T05:25:12.243+0100 [mongosMain] connection accepted from 172.28.0.164:55715 #1424213 (399 connections now open) 2015-10-05T05:25:12.243+0100 [mongosMain] connection accepted from 172.28.0.164:55716 #1424214 (400 connections now open) 2015-10-05T05:25:12.245+0100 [conn1424214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:12.245+0100 [conn1424213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:13.559+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:25:13.560+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:25:17.453+0100 [conn1423816] end connection 172.28.0.164:54789 (399 connections now open) 2015-10-05T05:25:17.454+0100 [mongosMain] connection accepted from 172.28.0.164:55719 #1424215 (400 connections now open) 2015-10-05T05:25:17.456+0100 [conn1424215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:17.905+0100 [conn1423825] end connection 172.28.0.164:54810 (399 connections now open) 2015-10-05T05:25:17.907+0100 [mongosMain] connection accepted from 172.28.0.164:55721 #1424216 (400 connections now open) 2015-10-05T05:25:17.908+0100 [conn1424216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:17.986+0100 [conn1423792] end connection 172.28.0.163:61648 (399 connections now open) 2015-10-05T05:25:17.987+0100 [mongosMain] connection accepted from 172.28.0.163:62672 #1424217 (400 connections now open) 2015-10-05T05:25:17.988+0100 [conn1424217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:18.594+0100 [conn1423819] end connection 172.28.0.163:61710 (399 connections now open) 2015-10-05T05:25:18.595+0100 [mongosMain] connection accepted from 172.28.0.163:62674 #1424218 (400 connections now open) 2015-10-05T05:25:18.597+0100 [conn1424218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:19.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbaf5703b51053eb8900 2015-10-05T05:25:19.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:25:22.072+0100 [conn1423820] end connection 172.28.0.163:61722 (399 connections now open) 2015-10-05T05:25:22.072+0100 [conn1423689] end connection 172.28.0.163:61448 (398 connections now open) 2015-10-05T05:25:22.074+0100 [mongosMain] connection accepted from 172.28.0.163:62679 #1424219 (399 connections now open) 2015-10-05T05:25:22.075+0100 [mongosMain] connection accepted from 172.28.0.163:62681 #1424220 (400 connections now open) 2015-10-05T05:25:22.076+0100 [conn1424219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:22.076+0100 [conn1424220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:22.257+0100 [conn1423822] end connection 172.28.0.164:54801 (399 connections now open) 2015-10-05T05:25:22.257+0100 [conn1423781] end connection 172.28.0.164:54708 (398 connections now open) 2015-10-05T05:25:22.259+0100 [mongosMain] connection accepted from 172.28.0.164:55730 #1424221 (399 connections now open) 2015-10-05T05:25:22.259+0100 [mongosMain] connection accepted from 172.28.0.164:55731 #1424222 (400 connections now open) 2015-10-05T05:25:22.261+0100 [conn1424221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:22.261+0100 [conn1424222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:27.468+0100 [conn1423774] end connection 172.28.0.164:54702 (399 connections now open) 2015-10-05T05:25:27.469+0100 [mongosMain] connection accepted from 172.28.0.164:55739 #1424223 (400 connections now open) 2015-10-05T05:25:27.470+0100 [conn1424223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:27.921+0100 [conn1423833] end connection 172.28.0.164:54822 (399 connections now open) 2015-10-05T05:25:27.922+0100 [mongosMain] connection accepted from 172.28.0.164:55742 #1424224 (400 connections now open) 2015-10-05T05:25:27.923+0100 [conn1424224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:28.001+0100 [conn1423818] end connection 172.28.0.163:61707 (399 connections now open) 2015-10-05T05:25:28.003+0100 [mongosMain] connection accepted from 172.28.0.163:62682 #1424225 (400 connections now open) 2015-10-05T05:25:28.004+0100 [conn1424225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:28.594+0100 [conn1423827] end connection 172.28.0.163:61736 (399 connections now open) 2015-10-05T05:25:28.596+0100 [mongosMain] connection accepted from 172.28.0.163:62685 #1424226 (400 connections now open) 2015-10-05T05:25:28.597+0100 [conn1424226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:28.924+0100 [mongosMain] connection accepted from 127.0.0.1:62687 #1424227 (401 connections now open) 2015-10-05T05:25:28.927+0100 [conn1424227] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:28.932+0100 [conn1424227] end connection 127.0.0.1:62687 (400 connections now open) 2015-10-05T05:25:32.086+0100 [conn1423829] end connection 172.28.0.163:61742 (399 connections now open) 2015-10-05T05:25:32.088+0100 [mongosMain] connection accepted from 172.28.0.163:62690 #1424228 (400 connections now open) 2015-10-05T05:25:32.091+0100 [conn1424228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:32.094+0100 [conn1423762] end connection 172.28.0.163:61591 (399 connections now open) 2015-10-05T05:25:32.095+0100 [mongosMain] connection accepted from 172.28.0.163:62695 #1424229 (400 connections now open) 2015-10-05T05:25:32.097+0100 [conn1424229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:32.258+0100 [conn1423806] end connection 172.28.0.164:54765 (399 connections now open) 2015-10-05T05:25:32.258+0100 [conn1423739] end connection 172.28.0.164:54628 (398 connections now open) 2015-10-05T05:25:32.259+0100 [mongosMain] connection accepted from 172.28.0.164:55748 #1424230 (399 connections now open) 2015-10-05T05:25:32.259+0100 [mongosMain] connection accepted from 172.28.0.164:55749 #1424231 (400 connections now open) 2015-10-05T05:25:32.261+0100 [conn1424230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:32.261+0100 [conn1424231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:37.115+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:25:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:25:37.483+0100 [conn1423824] end connection 172.28.0.164:54806 (399 connections now open) 2015-10-05T05:25:37.485+0100 [mongosMain] connection accepted from 172.28.0.164:55758 #1424232 (400 connections now open) 2015-10-05T05:25:37.486+0100 [conn1424232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:37.937+0100 [conn1423841] end connection 172.28.0.164:54843 (399 connections now open) 2015-10-05T05:25:37.938+0100 [mongosMain] connection accepted from 172.28.0.164:55760 #1424233 (400 connections now open) 2015-10-05T05:25:37.940+0100 [conn1424233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:38.609+0100 [conn1423835] end connection 172.28.0.163:61753 (399 connections now open) 2015-10-05T05:25:38.610+0100 [mongosMain] connection accepted from 172.28.0.163:62699 #1424234 (400 connections now open) 2015-10-05T05:25:38.611+0100 [conn1424234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:39.982+0100 [mongosMain] connection accepted from 127.0.0.1:62701 #1424235 (401 connections now open) 2015-10-05T05:25:39.984+0100 [conn1424235] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:39.989+0100 [conn1424235] end connection 127.0.0.1:62701 (400 connections now open) 2015-10-05T05:25:42.089+0100 [conn1423804] end connection 172.28.0.163:61666 (399 connections now open) 2015-10-05T05:25:42.089+0100 [conn1423778] end connection 172.28.0.163:61628 (399 connections now open) 2015-10-05T05:25:42.090+0100 [mongosMain] connection accepted from 172.28.0.163:62704 #1424236 (399 connections now open) 2015-10-05T05:25:42.090+0100 [mongosMain] connection accepted from 172.28.0.163:62705 #1424237 (400 connections now open) 2015-10-05T05:25:42.091+0100 [conn1424236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:42.092+0100 [conn1424237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:42.274+0100 [conn1423830] end connection 172.28.0.164:54814 (399 connections now open) 2015-10-05T05:25:42.274+0100 [mongosMain] connection accepted from 172.28.0.164:55767 #1424238 (400 connections now open) 2015-10-05T05:25:42.275+0100 [conn1423789] end connection 172.28.0.164:54724 (399 connections now open) 2015-10-05T05:25:42.276+0100 [mongosMain] connection accepted from 172.28.0.164:55769 #1424239 (400 connections now open) 2015-10-05T05:25:42.276+0100 [conn1424238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:42.277+0100 [conn1424239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:44.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbc85703b51053eb8975 2015-10-05T05:25:44.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:25:47.485+0100 [conn1423790] end connection 172.28.0.164:54735 (399 connections now open) 2015-10-05T05:25:47.487+0100 [mongosMain] connection accepted from 172.28.0.164:55775 #1424240 (400 connections now open) 2015-10-05T05:25:47.488+0100 [conn1424240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:47.936+0100 [conn1423850] end connection 172.28.0.164:54860 (399 connections now open) 2015-10-05T05:25:47.938+0100 [mongosMain] connection accepted from 172.28.0.164:55778 #1424241 (400 connections now open) 2015-10-05T05:25:47.939+0100 [conn1424241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:48.017+0100 [conn1423826] end connection 172.28.0.163:61733 (399 connections now open) 2015-10-05T05:25:48.018+0100 [mongosMain] connection accepted from 172.28.0.163:62716 #1424242 (400 connections now open) 2015-10-05T05:25:48.020+0100 [conn1424242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:48.611+0100 [conn1423843] end connection 172.28.0.163:61763 (399 connections now open) 2015-10-05T05:25:48.612+0100 [mongosMain] connection accepted from 172.28.0.163:62718 #1424243 (400 connections now open) 2015-10-05T05:25:48.613+0100 [conn1424243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:52.147+0100 [conn1423837] end connection 172.28.0.163:61757 (399 connections now open) 2015-10-05T05:25:52.147+0100 [conn1423805] end connection 172.28.0.163:61667 (399 connections now open) 2015-10-05T05:25:52.147+0100 [mongosMain] connection accepted from 172.28.0.163:62723 #1424244 (399 connections now open) 2015-10-05T05:25:52.147+0100 [mongosMain] connection accepted from 172.28.0.163:62724 #1424245 (400 connections now open) 2015-10-05T05:25:52.147+0100 [conn1424244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:52.147+0100 [conn1424245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:52.303+0100 [conn1423838] end connection 172.28.0.164:54831 (399 connections now open) 2015-10-05T05:25:52.303+0100 [conn1423807] end connection 172.28.0.164:54766 (398 connections now open) 2015-10-05T05:25:52.303+0100 [mongosMain] connection accepted from 172.28.0.164:55783 #1424246 (399 connections now open) 2015-10-05T05:25:52.303+0100 [mongosMain] connection accepted from 172.28.0.164:55784 #1424247 (400 connections now open) 2015-10-05T05:25:52.303+0100 [conn1424246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:52.303+0100 [conn1424247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:56.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbd45703b51053eb899c 2015-10-05T05:25:56.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:25:57.499+0100 [conn1423799] end connection 172.28.0.164:54753 (399 connections now open) 2015-10-05T05:25:57.501+0100 [mongosMain] connection accepted from 172.28.0.164:55790 #1424248 (400 connections now open) 2015-10-05T05:25:57.503+0100 [conn1424248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:57.952+0100 [conn1423859] end connection 172.28.0.164:54879 (399 connections now open) 2015-10-05T05:25:57.953+0100 [mongosMain] connection accepted from 172.28.0.164:55792 #1424249 (400 connections now open) 2015-10-05T05:25:57.955+0100 [conn1424249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:58.032+0100 [conn1423801] end connection 172.28.0.163:61658 (399 connections now open) 2015-10-05T05:25:58.034+0100 [mongosMain] connection accepted from 172.28.0.163:62732 #1424250 (400 connections now open) 2015-10-05T05:25:58.035+0100 [conn1424250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:25:58.625+0100 [conn1423852] end connection 172.28.0.163:61775 (399 connections now open) 2015-10-05T05:25:58.626+0100 [mongosMain] connection accepted from 172.28.0.163:62735 #1424251 (400 connections now open) 2015-10-05T05:25:58.627+0100 [conn1424251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:02.104+0100 [conn1423795] end connection 172.28.0.163:61653 (399 connections now open) 2015-10-05T05:26:02.104+0100 [conn1423846] end connection 172.28.0.163:61768 (399 connections now open) 2015-10-05T05:26:02.105+0100 [mongosMain] connection accepted from 172.28.0.163:62743 #1424252 (399 connections now open) 2015-10-05T05:26:02.105+0100 [mongosMain] connection accepted from 172.28.0.163:62744 #1424253 (400 connections now open) 2015-10-05T05:26:02.106+0100 [conn1424252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:02.106+0100 [conn1424253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:02.289+0100 [conn1423814] end connection 172.28.0.164:54783 (399 connections now open) 2015-10-05T05:26:02.289+0100 [conn1423865] end connection 172.28.0.164:54887 (398 connections now open) 2015-10-05T05:26:02.290+0100 [mongosMain] connection accepted from 172.28.0.164:55798 #1424254 (399 connections now open) 2015-10-05T05:26:02.290+0100 [mongosMain] connection accepted from 172.28.0.164:55799 #1424255 (400 connections now open) 2015-10-05T05:26:02.292+0100 [conn1424255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:02.292+0100 [conn1424254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:07.257+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:26:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:26:07.951+0100 [conn1423867] end connection 172.28.0.164:54896 (399 connections now open) 2015-10-05T05:26:07.953+0100 [mongosMain] connection accepted from 172.28.0.164:55804 #1424256 (400 connections now open) 2015-10-05T05:26:07.954+0100 [conn1424256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:08.033+0100 [conn1423834] end connection 172.28.0.163:61751 (399 connections now open) 2015-10-05T05:26:08.034+0100 [mongosMain] connection accepted from 172.28.0.163:62753 #1424257 (400 connections now open) 2015-10-05T05:26:08.036+0100 [conn1424257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:08.626+0100 [conn1423861] end connection 172.28.0.163:61793 (399 connections now open) 2015-10-05T05:26:08.628+0100 [mongosMain] connection accepted from 172.28.0.163:62755 #1424258 (400 connections now open) 2015-10-05T05:26:08.629+0100 [conn1424258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:08.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbe05703b51053eb89e0 2015-10-05T05:26:08.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:26:12.119+0100 [conn1423821] end connection 172.28.0.163:61723 (399 connections now open) 2015-10-05T05:26:12.119+0100 [conn1423863] end connection 172.28.0.163:61798 (398 connections now open) 2015-10-05T05:26:12.120+0100 [mongosMain] connection accepted from 172.28.0.163:62758 #1424259 (399 connections now open) 2015-10-05T05:26:12.121+0100 [mongosMain] connection accepted from 172.28.0.163:62759 #1424260 (400 connections now open) 2015-10-05T05:26:12.122+0100 [conn1424259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:12.122+0100 [conn1424260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:12.288+0100 [conn1423856] end connection 172.28.0.164:54869 (399 connections now open) 2015-10-05T05:26:12.289+0100 [conn1423773] end connection 172.28.0.164:54700 (398 connections now open) 2015-10-05T05:26:12.289+0100 [mongosMain] connection accepted from 172.28.0.164:55808 #1424261 (399 connections now open) 2015-10-05T05:26:12.290+0100 [mongosMain] connection accepted from 172.28.0.164:55809 #1424262 (400 connections now open) 2015-10-05T05:26:12.292+0100 [conn1424261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:12.292+0100 [conn1424262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:17.515+0100 [conn1423832] end connection 172.28.0.164:54820 (399 connections now open) 2015-10-05T05:26:17.519+0100 [mongosMain] connection accepted from 172.28.0.164:55813 #1424263 (400 connections now open) 2015-10-05T05:26:17.520+0100 [conn1424263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:17.968+0100 [conn1423875] end connection 172.28.0.164:54907 (399 connections now open) 2015-10-05T05:26:17.968+0100 [mongosMain] connection accepted from 172.28.0.164:55815 #1424264 (400 connections now open) 2015-10-05T05:26:17.970+0100 [conn1424264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:18.048+0100 [conn1423851] end connection 172.28.0.163:61773 (399 connections now open) 2015-10-05T05:26:18.050+0100 [mongosMain] connection accepted from 172.28.0.163:62768 #1424265 (400 connections now open) 2015-10-05T05:26:18.051+0100 [conn1424265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:18.641+0100 [conn1423869] end connection 172.28.0.163:61811 (399 connections now open) 2015-10-05T05:26:18.643+0100 [mongosMain] connection accepted from 172.28.0.163:62769 #1424266 (400 connections now open) 2015-10-05T05:26:18.644+0100 [conn1424266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:21.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbec5703b51053eb8a09 2015-10-05T05:26:21.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:26:22.122+0100 [conn1423855] end connection 172.28.0.163:61780 (399 connections now open) 2015-10-05T05:26:22.122+0100 [conn1423836] end connection 172.28.0.163:61758 (399 connections now open) 2015-10-05T05:26:22.123+0100 [mongosMain] connection accepted from 172.28.0.163:62773 #1424267 (399 connections now open) 2015-10-05T05:26:22.124+0100 [mongosMain] connection accepted from 172.28.0.163:62774 #1424268 (400 connections now open) 2015-10-05T05:26:22.124+0100 [conn1424267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:22.125+0100 [conn1424268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:22.305+0100 [conn1423847] end connection 172.28.0.164:54850 (399 connections now open) 2015-10-05T05:26:22.305+0100 [conn1423839] end connection 172.28.0.164:54830 (398 connections now open) 2015-10-05T05:26:22.307+0100 [mongosMain] connection accepted from 172.28.0.164:55826 #1424269 (399 connections now open) 2015-10-05T05:26:22.308+0100 [mongosMain] connection accepted from 172.28.0.164:55827 #1424270 (400 connections now open) 2015-10-05T05:26:22.309+0100 [conn1424269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:22.309+0100 [conn1424270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:27.515+0100 [conn1423808] end connection 172.28.0.164:54772 (399 connections now open) 2015-10-05T05:26:27.516+0100 [mongosMain] connection accepted from 172.28.0.164:55834 #1424271 (400 connections now open) 2015-10-05T05:26:27.518+0100 [conn1424271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:27.968+0100 [conn1423883] end connection 172.28.0.164:54921 (399 connections now open) 2015-10-05T05:26:27.968+0100 [mongosMain] connection accepted from 172.28.0.164:55836 #1424272 (400 connections now open) 2015-10-05T05:26:27.970+0100 [conn1424272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:28.051+0100 [conn1423860] end connection 172.28.0.163:61790 (399 connections now open) 2015-10-05T05:26:28.052+0100 [mongosMain] connection accepted from 172.28.0.163:62777 #1424273 (400 connections now open) 2015-10-05T05:26:28.054+0100 [conn1424273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:28.259+0100 [mongosMain] connection accepted from 127.0.0.1:62779 #1424274 (401 connections now open) 2015-10-05T05:26:28.262+0100 [conn1424274] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:28.267+0100 [conn1424274] end connection 127.0.0.1:62779 (400 connections now open) 2015-10-05T05:26:28.656+0100 [conn1423877] end connection 172.28.0.163:61832 (399 connections now open) 2015-10-05T05:26:28.658+0100 [mongosMain] connection accepted from 172.28.0.163:62780 #1424275 (400 connections now open) 2015-10-05T05:26:28.659+0100 [conn1424275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:32.135+0100 [conn1423870] end connection 172.28.0.163:61820 (399 connections now open) 2015-10-05T05:26:32.135+0100 [conn1423828] end connection 172.28.0.163:61741 (399 connections now open) 2015-10-05T05:26:32.137+0100 [mongosMain] connection accepted from 172.28.0.163:62782 #1424276 (399 connections now open) 2015-10-05T05:26:32.137+0100 [mongosMain] connection accepted from 172.28.0.163:62783 #1424277 (400 connections now open) 2015-10-05T05:26:32.138+0100 [conn1424276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:32.138+0100 [conn1424277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:32.304+0100 [conn1423872] end connection 172.28.0.164:54901 (399 connections now open) 2015-10-05T05:26:32.304+0100 [conn1423798] end connection 172.28.0.164:54745 (398 connections now open) 2015-10-05T05:26:32.305+0100 [mongosMain] connection accepted from 172.28.0.164:55846 #1424278 (399 connections now open) 2015-10-05T05:26:32.306+0100 [mongosMain] connection accepted from 172.28.0.164:55847 #1424279 (400 connections now open) 2015-10-05T05:26:32.307+0100 [conn1424278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:32.307+0100 [conn1424279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:33.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fbf95703b51053eb8a3a 2015-10-05T05:26:33.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:26:37.522+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:26:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:26:37.531+0100 [conn1423866] end connection 172.28.0.164:54894 (399 connections now open) 2015-10-05T05:26:37.532+0100 [mongosMain] connection accepted from 172.28.0.164:55856 #1424280 (400 connections now open) 2015-10-05T05:26:37.533+0100 [conn1424280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:37.983+0100 [conn1423891] end connection 172.28.0.164:54941 (399 connections now open) 2015-10-05T05:26:37.983+0100 [mongosMain] connection accepted from 172.28.0.164:55859 #1424281 (400 connections now open) 2015-10-05T05:26:37.985+0100 [conn1424281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:38.064+0100 [conn1423810] end connection 172.28.0.163:61677 (399 connections now open) 2015-10-05T05:26:38.065+0100 [mongosMain] connection accepted from 172.28.0.163:62786 #1424282 (400 connections now open) 2015-10-05T05:26:38.066+0100 [conn1424282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:38.657+0100 [conn1423885] end connection 172.28.0.163:61845 (399 connections now open) 2015-10-05T05:26:38.658+0100 [mongosMain] connection accepted from 172.28.0.163:62789 #1424283 (400 connections now open) 2015-10-05T05:26:38.659+0100 [conn1424283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:39.343+0100 [mongosMain] connection accepted from 127.0.0.1:62790 #1424284 (401 connections now open) 2015-10-05T05:26:39.345+0100 [conn1424284] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:39.349+0100 [conn1424284] end connection 127.0.0.1:62790 (400 connections now open) 2015-10-05T05:26:42.139+0100 [conn1423813] end connection 172.28.0.163:61685 (399 connections now open) 2015-10-05T05:26:42.139+0100 [conn1423878] end connection 172.28.0.163:61836 (398 connections now open) 2015-10-05T05:26:42.141+0100 [mongosMain] connection accepted from 172.28.0.163:62794 #1424285 (399 connections now open) 2015-10-05T05:26:42.141+0100 [mongosMain] connection accepted from 172.28.0.163:62795 #1424286 (400 connections now open) 2015-10-05T05:26:42.143+0100 [conn1424285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:42.143+0100 [conn1424286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:42.319+0100 [conn1423823] end connection 172.28.0.164:54802 (399 connections now open) 2015-10-05T05:26:42.320+0100 [conn1423880] end connection 172.28.0.164:54912 (398 connections now open) 2015-10-05T05:26:42.320+0100 [mongosMain] connection accepted from 172.28.0.164:55866 #1424287 (399 connections now open) 2015-10-05T05:26:42.321+0100 [mongosMain] connection accepted from 172.28.0.164:55867 #1424288 (400 connections now open) 2015-10-05T05:26:42.322+0100 [conn1424287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:42.322+0100 [conn1424288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:46.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc055703b51053eb8a7d 2015-10-05T05:26:46.144+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:26:47.531+0100 [conn1423858] end connection 172.28.0.164:54877 (399 connections now open) 2015-10-05T05:26:47.532+0100 [mongosMain] connection accepted from 172.28.0.164:55876 #1424289 (400 connections now open) 2015-10-05T05:26:47.534+0100 [conn1424289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:47.983+0100 [conn1423900] end connection 172.28.0.164:54958 (399 connections now open) 2015-10-05T05:26:47.985+0100 [mongosMain] connection accepted from 172.28.0.164:55878 #1424290 (400 connections now open) 2015-10-05T05:26:47.987+0100 [conn1424290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:48.064+0100 [conn1423842] end connection 172.28.0.163:61761 (399 connections now open) 2015-10-05T05:26:48.065+0100 [mongosMain] connection accepted from 172.28.0.163:62804 #1424291 (400 connections now open) 2015-10-05T05:26:48.067+0100 [conn1424291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:48.672+0100 [conn1423893] end connection 172.28.0.163:61854 (399 connections now open) 2015-10-05T05:26:48.673+0100 [mongosMain] connection accepted from 172.28.0.163:62807 #1424292 (400 connections now open) 2015-10-05T05:26:48.674+0100 [conn1424292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:52.151+0100 [conn1423887] end connection 172.28.0.163:61850 (399 connections now open) 2015-10-05T05:26:52.151+0100 [conn1423770] end connection 172.28.0.163:61608 (398 connections now open) 2015-10-05T05:26:52.152+0100 [mongosMain] connection accepted from 172.28.0.163:62811 #1424293 (399 connections now open) 2015-10-05T05:26:52.152+0100 [mongosMain] connection accepted from 172.28.0.163:62812 #1424294 (400 connections now open) 2015-10-05T05:26:52.153+0100 [conn1424293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:52.153+0100 [conn1424294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:52.290+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:26:52.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:26:52.320+0100 [conn1423848] end connection 172.28.0.164:54851 (399 connections now open) 2015-10-05T05:26:52.322+0100 [mongosMain] connection accepted from 172.28.0.164:55886 #1424295 (400 connections now open) 2015-10-05T05:26:52.322+0100 [conn1423889] end connection 172.28.0.164:54927 (399 connections now open) 2015-10-05T05:26:52.323+0100 [mongosMain] connection accepted from 172.28.0.164:55887 #1424296 (400 connections now open) 2015-10-05T05:26:52.324+0100 [conn1424295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:52.325+0100 [conn1424296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:57.547+0100 [conn1423882] end connection 172.28.0.164:54918 (399 connections now open) 2015-10-05T05:26:57.548+0100 [mongosMain] connection accepted from 172.28.0.164:55891 #1424297 (400 connections now open) 2015-10-05T05:26:57.550+0100 [conn1424297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:58.001+0100 [conn1423909] end connection 172.28.0.164:54979 (399 connections now open) 2015-10-05T05:26:58.001+0100 [mongosMain] connection accepted from 172.28.0.164:55893 #1424298 (400 connections now open) 2015-10-05T05:26:58.003+0100 [conn1424298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:58.080+0100 [conn1423868] end connection 172.28.0.163:61808 (399 connections now open) 2015-10-05T05:26:58.081+0100 [mongosMain] connection accepted from 172.28.0.163:62821 #1424299 (400 connections now open) 2015-10-05T05:26:58.083+0100 [conn1424299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:58.672+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc125703b51053eb8abf 2015-10-05T05:26:58.673+0100 [conn1423902] end connection 172.28.0.163:61864 (399 connections now open) 2015-10-05T05:26:58.674+0100 [mongosMain] connection accepted from 172.28.0.163:62823 #1424300 (400 connections now open) 2015-10-05T05:26:58.676+0100 [conn1424300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:26:58.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:02.169+0100 [conn1423905] end connection 172.28.0.163:61870 (399 connections now open) 2015-10-05T05:27:02.169+0100 [conn1423871] end connection 172.28.0.163:61821 (399 connections now open) 2015-10-05T05:27:02.170+0100 [mongosMain] connection accepted from 172.28.0.163:62832 #1424301 (399 connections now open) 2015-10-05T05:27:02.171+0100 [mongosMain] connection accepted from 172.28.0.163:62833 #1424302 (400 connections now open) 2015-10-05T05:27:02.171+0100 [conn1424301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:02.171+0100 [conn1424302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:02.336+0100 [conn1423906] end connection 172.28.0.164:54968 (399 connections now open) 2015-10-05T05:27:02.336+0100 [conn1423857] end connection 172.28.0.164:54870 (398 connections now open) 2015-10-05T05:27:02.338+0100 [mongosMain] connection accepted from 172.28.0.164:55902 #1424303 (399 connections now open) 2015-10-05T05:27:02.338+0100 [mongosMain] connection accepted from 172.28.0.164:55903 #1424304 (400 connections now open) 2015-10-05T05:27:02.340+0100 [conn1424303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:02.340+0100 [conn1424304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:07.562+0100 [conn1423874] end connection 172.28.0.164:54905 (399 connections now open) 2015-10-05T05:27:07.563+0100 [mongosMain] connection accepted from 172.28.0.164:55905 #1424305 (400 connections now open) 2015-10-05T05:27:07.564+0100 [conn1424305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:07.803+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:27:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:27:08.015+0100 [conn1423916] end connection 172.28.0.164:54991 (399 connections now open) 2015-10-05T05:27:08.016+0100 [mongosMain] connection accepted from 172.28.0.164:55907 #1424306 (400 connections now open) 2015-10-05T05:27:08.018+0100 [conn1424306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:08.083+0100 [conn1423884] end connection 172.28.0.163:61844 (399 connections now open) 2015-10-05T05:27:08.084+0100 [mongosMain] connection accepted from 172.28.0.163:62845 #1424307 (400 connections now open) 2015-10-05T05:27:08.085+0100 [conn1424307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:08.688+0100 [conn1423911] end connection 172.28.0.163:61880 (399 connections now open) 2015-10-05T05:27:08.689+0100 [mongosMain] connection accepted from 172.28.0.163:62847 #1424308 (400 connections now open) 2015-10-05T05:27:08.690+0100 [conn1424308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:11.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc1e5703b51053eb8b0e 2015-10-05T05:27:11.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:12.168+0100 [conn1423896] end connection 172.28.0.163:61858 (399 connections now open) 2015-10-05T05:27:12.168+0100 [conn1423862] end connection 172.28.0.163:61797 (399 connections now open) 2015-10-05T05:27:12.169+0100 [mongosMain] connection accepted from 172.28.0.163:62852 #1424309 (399 connections now open) 2015-10-05T05:27:12.169+0100 [mongosMain] connection accepted from 172.28.0.163:62853 #1424310 (400 connections now open) 2015-10-05T05:27:12.170+0100 [conn1424309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:12.170+0100 [conn1424310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:12.335+0100 [conn1423898] end connection 172.28.0.164:54948 (399 connections now open) 2015-10-05T05:27:12.336+0100 [mongosMain] connection accepted from 172.28.0.164:55910 #1424311 (400 connections now open) 2015-10-05T05:27:12.337+0100 [conn1423888] end connection 172.28.0.164:54928 (399 connections now open) 2015-10-05T05:27:12.338+0100 [conn1424311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:12.339+0100 [mongosMain] connection accepted from 172.28.0.164:55911 #1424312 (400 connections now open) 2015-10-05T05:27:12.340+0100 [conn1424312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:17.579+0100 [conn1423849] end connection 172.28.0.164:54858 (399 connections now open) 2015-10-05T05:27:17.580+0100 [mongosMain] connection accepted from 172.28.0.164:55914 #1424313 (400 connections now open) 2015-10-05T05:27:17.583+0100 [conn1424313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:18.031+0100 [conn1423924] end connection 172.28.0.164:55005 (399 connections now open) 2015-10-05T05:27:18.032+0100 [mongosMain] connection accepted from 172.28.0.164:55916 #1424314 (400 connections now open) 2015-10-05T05:27:18.034+0100 [conn1424314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:18.095+0100 [conn1423876] end connection 172.28.0.163:61830 (399 connections now open) 2015-10-05T05:27:18.096+0100 [mongosMain] connection accepted from 172.28.0.163:62862 #1424315 (400 connections now open) 2015-10-05T05:27:18.098+0100 [conn1424315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:18.688+0100 [conn1423918] end connection 172.28.0.163:61897 (399 connections now open) 2015-10-05T05:27:18.689+0100 [mongosMain] connection accepted from 172.28.0.163:62864 #1424316 (400 connections now open) 2015-10-05T05:27:18.691+0100 [conn1424316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:22.182+0100 [conn1423879] end connection 172.28.0.163:61837 (399 connections now open) 2015-10-05T05:27:22.183+0100 [conn1423919] end connection 172.28.0.163:61911 (398 connections now open) 2015-10-05T05:27:22.183+0100 [mongosMain] connection accepted from 172.28.0.163:62867 #1424317 (399 connections now open) 2015-10-05T05:27:22.184+0100 [mongosMain] connection accepted from 172.28.0.163:62868 #1424318 (400 connections now open) 2015-10-05T05:27:22.184+0100 [conn1424317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:22.185+0100 [conn1424318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:22.351+0100 [conn1423897] end connection 172.28.0.164:54949 (399 connections now open) 2015-10-05T05:27:22.351+0100 [conn1423914] end connection 172.28.0.164:54982 (398 connections now open) 2015-10-05T05:27:22.352+0100 [mongosMain] connection accepted from 172.28.0.164:55925 #1424319 (399 connections now open) 2015-10-05T05:27:22.352+0100 [mongosMain] connection accepted from 172.28.0.164:55926 #1424320 (400 connections now open) 2015-10-05T05:27:22.364+0100 [conn1424320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:22.364+0100 [conn1424319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:23.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc2b5703b51053eb8b3b 2015-10-05T05:27:23.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:27.579+0100 [conn1423899] end connection 172.28.0.164:54956 (399 connections now open) 2015-10-05T05:27:27.580+0100 [mongosMain] connection accepted from 172.28.0.164:55934 #1424321 (400 connections now open) 2015-10-05T05:27:27.581+0100 [conn1424321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:28.046+0100 [conn1423932] end connection 172.28.0.164:55015 (399 connections now open) 2015-10-05T05:27:28.048+0100 [mongosMain] connection accepted from 172.28.0.164:55936 #1424322 (400 connections now open) 2015-10-05T05:27:28.050+0100 [conn1424322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:28.111+0100 [conn1423892] end connection 172.28.0.163:61852 (399 connections now open) 2015-10-05T05:27:28.112+0100 [mongosMain] connection accepted from 172.28.0.163:62872 #1424323 (400 connections now open) 2015-10-05T05:27:28.113+0100 [conn1424323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:28.605+0100 [mongosMain] connection accepted from 127.0.0.1:62874 #1424324 (401 connections now open) 2015-10-05T05:27:28.608+0100 [conn1424324] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:28.613+0100 [conn1424324] end connection 127.0.0.1:62874 (400 connections now open) 2015-10-05T05:27:28.704+0100 [conn1423926] end connection 172.28.0.163:61924 (399 connections now open) 2015-10-05T05:27:28.706+0100 [mongosMain] connection accepted from 172.28.0.163:62875 #1424325 (400 connections now open) 2015-10-05T05:27:28.707+0100 [conn1424325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:29.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc315703b51053eb8b5a 2015-10-05T05:27:30.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:32.185+0100 [conn1423854] end connection 172.28.0.163:61779 (399 connections now open) 2015-10-05T05:27:32.186+0100 [conn1423912] end connection 172.28.0.163:61884 (398 connections now open) 2015-10-05T05:27:32.187+0100 [mongosMain] connection accepted from 172.28.0.163:62878 #1424326 (399 connections now open) 2015-10-05T05:27:32.189+0100 [mongosMain] connection accepted from 172.28.0.163:62879 #1424327 (400 connections now open) 2015-10-05T05:27:32.189+0100 [conn1424326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:32.189+0100 [conn1424327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:32.352+0100 [conn1423873] end connection 172.28.0.164:54902 (399 connections now open) 2015-10-05T05:27:32.352+0100 [conn1423930] end connection 172.28.0.164:55009 (398 connections now open) 2015-10-05T05:27:32.353+0100 [mongosMain] connection accepted from 172.28.0.164:55944 #1424328 (399 connections now open) 2015-10-05T05:27:32.353+0100 [mongosMain] connection accepted from 172.28.0.164:55945 #1424329 (400 connections now open) 2015-10-05T05:27:32.354+0100 [conn1424328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:32.355+0100 [conn1424329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:36.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc385703b51053eb8b6c 2015-10-05T05:27:36.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:37.594+0100 [conn1423840] end connection 172.28.0.164:54841 (399 connections now open) 2015-10-05T05:27:37.595+0100 [mongosMain] connection accepted from 172.28.0.164:55954 #1424330 (400 connections now open) 2015-10-05T05:27:37.596+0100 [conn1424330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:38.046+0100 [conn1423939] end connection 172.28.0.164:55033 (399 connections now open) 2015-10-05T05:27:38.047+0100 [mongosMain] connection accepted from 172.28.0.164:55956 #1424331 (400 connections now open) 2015-10-05T05:27:38.048+0100 [conn1424331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:38.080+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:27:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:27:38.112+0100 [conn1423901] end connection 172.28.0.163:61862 (399 connections now open) 2015-10-05T05:27:38.113+0100 [mongosMain] connection accepted from 172.28.0.163:62881 #1424332 (400 connections now open) 2015-10-05T05:27:38.114+0100 [conn1424332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:38.705+0100 [conn1423934] end connection 172.28.0.163:61942 (399 connections now open) 2015-10-05T05:27:38.706+0100 [mongosMain] connection accepted from 172.28.0.163:62883 #1424333 (400 connections now open) 2015-10-05T05:27:38.707+0100 [conn1424333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:39.219+0100 [mongosMain] connection accepted from 127.0.0.1:62885 #1424334 (401 connections now open) 2015-10-05T05:27:39.222+0100 [conn1424334] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:39.227+0100 [conn1424334] end connection 127.0.0.1:62885 (400 connections now open) 2015-10-05T05:27:42.197+0100 [conn1423935] end connection 172.28.0.163:61946 (399 connections now open) 2015-10-05T05:27:42.198+0100 [conn1423886] end connection 172.28.0.163:61849 (398 connections now open) 2015-10-05T05:27:42.199+0100 [mongosMain] connection accepted from 172.28.0.163:62889 #1424335 (399 connections now open) 2015-10-05T05:27:42.199+0100 [mongosMain] connection accepted from 172.28.0.163:62890 #1424336 (400 connections now open) 2015-10-05T05:27:42.200+0100 [conn1424335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:42.200+0100 [conn1424336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:42.368+0100 [conn1423922] end connection 172.28.0.164:55001 (399 connections now open) 2015-10-05T05:27:42.368+0100 [conn1423831] end connection 172.28.0.164:54815 (398 connections now open) 2015-10-05T05:27:42.369+0100 [mongosMain] connection accepted from 172.28.0.164:55963 #1424337 (399 connections now open) 2015-10-05T05:27:42.370+0100 [mongosMain] connection accepted from 172.28.0.164:55964 #1424338 (400 connections now open) 2015-10-05T05:27:42.371+0100 [conn1424337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:42.371+0100 [conn1424338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:42.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc3e5703b51053eb8b7f 2015-10-05T05:27:42.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:47.594+0100 [conn1423890] end connection 172.28.0.164:54938 (399 connections now open) 2015-10-05T05:27:47.595+0100 [mongosMain] connection accepted from 172.28.0.164:55974 #1424339 (400 connections now open) 2015-10-05T05:27:47.598+0100 [conn1424339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:48.063+0100 [conn1423947] end connection 172.28.0.164:55050 (399 connections now open) 2015-10-05T05:27:48.071+0100 [mongosMain] connection accepted from 172.28.0.164:55976 #1424340 (400 connections now open) 2015-10-05T05:27:48.073+0100 [conn1424340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:48.127+0100 [conn1423917] end connection 172.28.0.163:61894 (399 connections now open) 2015-10-05T05:27:48.129+0100 [mongosMain] connection accepted from 172.28.0.163:62901 #1424341 (400 connections now open) 2015-10-05T05:27:48.130+0100 [conn1424341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:48.720+0100 [conn1423941] end connection 172.28.0.163:61953 (399 connections now open) 2015-10-05T05:27:48.721+0100 [mongosMain] connection accepted from 172.28.0.163:62904 #1424342 (400 connections now open) 2015-10-05T05:27:48.722+0100 [conn1424342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:49.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc445703b51053eb8b92 2015-10-05T05:27:49.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:52.200+0100 [conn1423913] end connection 172.28.0.163:61885 (399 connections now open) 2015-10-05T05:27:52.200+0100 [conn1423928] end connection 172.28.0.163:61930 (399 connections now open) 2015-10-05T05:27:52.201+0100 [mongosMain] connection accepted from 172.28.0.163:62908 #1424343 (399 connections now open) 2015-10-05T05:27:52.201+0100 [mongosMain] connection accepted from 172.28.0.163:62909 #1424344 (400 connections now open) 2015-10-05T05:27:52.202+0100 [conn1424343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:52.202+0100 [conn1424344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:52.367+0100 [conn1423946] end connection 172.28.0.164:55041 (399 connections now open) 2015-10-05T05:27:52.367+0100 [conn1423864] end connection 172.28.0.164:54886 (399 connections now open) 2015-10-05T05:27:52.369+0100 [mongosMain] connection accepted from 172.28.0.164:55984 #1424345 (399 connections now open) 2015-10-05T05:27:52.369+0100 [mongosMain] connection accepted from 172.28.0.164:55985 #1424346 (400 connections now open) 2015-10-05T05:27:52.370+0100 [conn1424345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:52.370+0100 [conn1424346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:55.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc4b5703b51053eb8ba8 2015-10-05T05:27:55.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:27:57.609+0100 [conn1423931] end connection 172.28.0.164:55013 (399 connections now open) 2015-10-05T05:27:57.611+0100 [mongosMain] connection accepted from 172.28.0.164:55988 #1424347 (400 connections now open) 2015-10-05T05:27:57.613+0100 [conn1424347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:58.078+0100 [conn1423956] end connection 172.28.0.164:55080 (399 connections now open) 2015-10-05T05:27:58.079+0100 [mongosMain] connection accepted from 172.28.0.164:55990 #1424348 (400 connections now open) 2015-10-05T05:27:58.081+0100 [conn1424348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:58.127+0100 [conn1423925] end connection 172.28.0.163:61921 (399 connections now open) 2015-10-05T05:27:58.128+0100 [mongosMain] connection accepted from 172.28.0.163:62919 #1424349 (400 connections now open) 2015-10-05T05:27:58.129+0100 [conn1424349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:27:58.735+0100 [conn1423949] end connection 172.28.0.163:61963 (399 connections now open) 2015-10-05T05:27:58.736+0100 [mongosMain] connection accepted from 172.28.0.163:62922 #1424350 (400 connections now open) 2015-10-05T05:27:58.737+0100 [conn1424350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:02.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc515703b51053eb8bc0 2015-10-05T05:28:02.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:02.214+0100 [conn1423845] end connection 172.28.0.163:61767 (399 connections now open) 2015-10-05T05:28:02.215+0100 [conn1423944] end connection 172.28.0.163:61957 (398 connections now open) 2015-10-05T05:28:02.215+0100 [mongosMain] connection accepted from 172.28.0.163:62931 #1424351 (399 connections now open) 2015-10-05T05:28:02.216+0100 [mongosMain] connection accepted from 172.28.0.163:62932 #1424352 (400 connections now open) 2015-10-05T05:28:02.217+0100 [conn1424351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:02.217+0100 [conn1424352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:02.383+0100 [conn1423915] end connection 172.28.0.164:54983 (399 connections now open) 2015-10-05T05:28:02.384+0100 [conn1423937] end connection 172.28.0.164:55022 (398 connections now open) 2015-10-05T05:28:02.384+0100 [mongosMain] connection accepted from 172.28.0.164:55997 #1424353 (399 connections now open) 2015-10-05T05:28:02.385+0100 [mongosMain] connection accepted from 172.28.0.164:55998 #1424354 (400 connections now open) 2015-10-05T05:28:02.386+0100 [conn1424353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:02.386+0100 [conn1424354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:07.610+0100 [conn1423908] end connection 172.28.0.164:54975 (399 connections now open) 2015-10-05T05:28:07.611+0100 [mongosMain] connection accepted from 172.28.0.164:55999 #1424355 (400 connections now open) 2015-10-05T05:28:07.613+0100 [conn1424355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:08.094+0100 [conn1423964] end connection 172.28.0.164:55096 (399 connections now open) 2015-10-05T05:28:08.095+0100 [mongosMain] connection accepted from 172.28.0.164:56001 #1424356 (400 connections now open) 2015-10-05T05:28:08.098+0100 [conn1424356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:08.143+0100 [conn1423910] end connection 172.28.0.163:61878 (399 connections now open) 2015-10-05T05:28:08.144+0100 [mongosMain] connection accepted from 172.28.0.163:62941 #1424357 (400 connections now open) 2015-10-05T05:28:08.146+0100 [conn1424357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:08.247+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:28:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:28:08.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc585703b51053eb8bef 2015-10-05T05:28:08.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:08.736+0100 [conn1423958] end connection 172.28.0.163:61983 (399 connections now open) 2015-10-05T05:28:08.737+0100 [mongosMain] connection accepted from 172.28.0.163:62943 #1424358 (400 connections now open) 2015-10-05T05:28:08.739+0100 [conn1424358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:12.215+0100 [conn1423904] end connection 172.28.0.163:61869 (399 connections now open) 2015-10-05T05:28:12.215+0100 [conn1423959] end connection 172.28.0.163:61989 (399 connections now open) 2015-10-05T05:28:12.217+0100 [mongosMain] connection accepted from 172.28.0.163:62947 #1424359 (399 connections now open) 2015-10-05T05:28:12.217+0100 [mongosMain] connection accepted from 172.28.0.163:62948 #1424360 (400 connections now open) 2015-10-05T05:28:12.218+0100 [conn1424359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:12.218+0100 [conn1424360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:12.399+0100 [conn1423962] end connection 172.28.0.164:55088 (399 connections now open) 2015-10-05T05:28:12.399+0100 [conn1423907] end connection 172.28.0.164:54969 (399 connections now open) 2015-10-05T05:28:12.400+0100 [mongosMain] connection accepted from 172.28.0.164:56005 #1424361 (399 connections now open) 2015-10-05T05:28:12.401+0100 [mongosMain] connection accepted from 172.28.0.164:56006 #1424362 (400 connections now open) 2015-10-05T05:28:12.402+0100 [conn1424362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:12.402+0100 [conn1424361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:14.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc5e5703b51053eb8c0f 2015-10-05T05:28:14.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:18.094+0100 [conn1423969] end connection 172.28.0.164:55107 (399 connections now open) 2015-10-05T05:28:18.095+0100 [mongosMain] connection accepted from 172.28.0.164:56012 #1424363 (400 connections now open) 2015-10-05T05:28:18.097+0100 [conn1424363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:18.143+0100 [conn1423940] end connection 172.28.0.163:61951 (399 connections now open) 2015-10-05T05:28:18.145+0100 [mongosMain] connection accepted from 172.28.0.163:62957 #1424364 (400 connections now open) 2015-10-05T05:28:18.146+0100 [conn1424364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:18.751+0100 [conn1423965] end connection 172.28.0.163:62000 (399 connections now open) 2015-10-05T05:28:18.753+0100 [mongosMain] connection accepted from 172.28.0.163:62959 #1424365 (400 connections now open) 2015-10-05T05:28:18.754+0100 [conn1424365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:20.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc645703b51053eb8c2b 2015-10-05T05:28:21.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:22.230+0100 [conn1423951] end connection 172.28.0.163:61970 (399 connections now open) 2015-10-05T05:28:22.230+0100 [conn1423895] end connection 172.28.0.163:61857 (399 connections now open) 2015-10-05T05:28:22.231+0100 [mongosMain] connection accepted from 172.28.0.163:62965 #1424366 (399 connections now open) 2015-10-05T05:28:22.232+0100 [mongosMain] connection accepted from 172.28.0.163:62966 #1424367 (400 connections now open) 2015-10-05T05:28:22.232+0100 [conn1424366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:22.233+0100 [conn1424367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:22.400+0100 [conn1423954] end connection 172.28.0.164:55071 (399 connections now open) 2015-10-05T05:28:22.401+0100 [mongosMain] connection accepted from 172.28.0.164:56019 #1424368 (400 connections now open) 2015-10-05T05:28:22.403+0100 [conn1424368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:27.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc6b5703b51053eb8c4f 2015-10-05T05:28:27.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:28.094+0100 [conn1423976] end connection 172.28.0.164:55116 (399 connections now open) 2015-10-05T05:28:28.095+0100 [mongosMain] connection accepted from 172.28.0.164:56028 #1424369 (400 connections now open) 2015-10-05T05:28:28.096+0100 [conn1424369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:28.158+0100 [conn1423933] end connection 172.28.0.163:61940 (399 connections now open) 2015-10-05T05:28:28.159+0100 [mongosMain] connection accepted from 172.28.0.163:62968 #1424370 (400 connections now open) 2015-10-05T05:28:28.160+0100 [conn1424370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:28.229+0100 [mongosMain] connection accepted from 127.0.0.1:62970 #1424371 (401 connections now open) 2015-10-05T05:28:28.232+0100 [conn1424371] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:28.237+0100 [conn1424371] end connection 127.0.0.1:62970 (400 connections now open) 2015-10-05T05:28:28.751+0100 [conn1423971] end connection 172.28.0.163:62021 (399 connections now open) 2015-10-05T05:28:28.752+0100 [mongosMain] connection accepted from 172.28.0.163:62971 #1424372 (400 connections now open) 2015-10-05T05:28:28.753+0100 [conn1424372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:32.248+0100 [conn1423786] end connection 172.28.0.163:61644 (399 connections now open) 2015-10-05T05:28:32.249+0100 [mongosMain] connection accepted from 172.28.0.163:62973 #1424373 (400 connections now open) 2015-10-05T05:28:32.251+0100 [conn1424373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:32.251+0100 [conn1423966] end connection 172.28.0.163:62009 (399 connections now open) 2015-10-05T05:28:32.252+0100 [mongosMain] connection accepted from 172.28.0.163:62976 #1424374 (400 connections now open) 2015-10-05T05:28:32.253+0100 [conn1424374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:32.415+0100 [conn1423974] end connection 172.28.0.164:55110 (399 connections now open) 2015-10-05T05:28:32.416+0100 [mongosMain] connection accepted from 172.28.0.164:56032 #1424375 (400 connections now open) 2015-10-05T05:28:32.418+0100 [conn1424375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:33.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc715703b51053eb8c6a 2015-10-05T05:28:33.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:37.641+0100 [conn1423923] end connection 172.28.0.164:55003 (399 connections now open) 2015-10-05T05:28:37.642+0100 [mongosMain] connection accepted from 172.28.0.164:56040 #1424376 (400 connections now open) 2015-10-05T05:28:37.644+0100 [conn1424376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:38.110+0100 [conn1423983] end connection 172.28.0.164:55133 (399 connections now open) 2015-10-05T05:28:38.111+0100 [mongosMain] connection accepted from 172.28.0.164:56043 #1424377 (400 connections now open) 2015-10-05T05:28:38.112+0100 [conn1424377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:38.527+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:28:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:28:39.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc775703b51053eb8c89 2015-10-05T05:28:40.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:40.067+0100 [mongosMain] connection accepted from 127.0.0.1:62980 #1424378 (401 connections now open) 2015-10-05T05:28:40.069+0100 [conn1424378] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:40.074+0100 [conn1424378] end connection 127.0.0.1:62980 (400 connections now open) 2015-10-05T05:28:42.247+0100 [conn1423979] end connection 172.28.0.163:62041 (399 connections now open) 2015-10-05T05:28:42.247+0100 [conn1423936] end connection 172.28.0.163:61948 (398 connections now open) 2015-10-05T05:28:42.249+0100 [mongosMain] connection accepted from 172.28.0.163:62983 #1424379 (399 connections now open) 2015-10-05T05:28:42.249+0100 [mongosMain] connection accepted from 172.28.0.163:62984 #1424380 (400 connections now open) 2015-10-05T05:28:42.250+0100 [conn1424379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:42.251+0100 [conn1424380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:46.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc7e5703b51053eb8cbe 2015-10-05T05:28:46.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:47.658+0100 [conn1423968] end connection 172.28.0.164:55105 (399 connections now open) 2015-10-05T05:28:47.659+0100 [mongosMain] connection accepted from 172.28.0.164:56056 #1424381 (400 connections now open) 2015-10-05T05:28:47.661+0100 [conn1424381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:52.262+0100 [conn1423943] end connection 172.28.0.163:61956 (399 connections now open) 2015-10-05T05:28:52.262+0100 [conn1423973] end connection 172.28.0.163:62026 (398 connections now open) 2015-10-05T05:28:52.263+0100 [mongosMain] connection accepted from 172.28.0.163:63002 #1424382 (399 connections now open) 2015-10-05T05:28:52.264+0100 [mongosMain] connection accepted from 172.28.0.163:63003 #1424383 (400 connections now open) 2015-10-05T05:28:52.264+0100 [conn1424382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:52.265+0100 [conn1424383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:52.430+0100 [conn1423981] end connection 172.28.0.164:55121 (399 connections now open) 2015-10-05T05:28:52.431+0100 [mongosMain] connection accepted from 172.28.0.164:56060 #1424384 (400 connections now open) 2015-10-05T05:28:52.433+0100 [conn1424384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:52.741+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc845703b51053eb8cee 2015-10-05T05:28:52.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:28:57.657+0100 [conn1423975] end connection 172.28.0.164:55114 (399 connections now open) 2015-10-05T05:28:57.658+0100 [mongosMain] connection accepted from 172.28.0.164:56065 #1424385 (400 connections now open) 2015-10-05T05:28:57.660+0100 [conn1424385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:28:59.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc8a5703b51053eb8d11 2015-10-05T05:28:59.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:02.262+0100 [conn1423985] end connection 172.28.0.163:62048 (399 connections now open) 2015-10-05T05:29:02.262+0100 [conn1423952] end connection 172.28.0.163:61973 (399 connections now open) 2015-10-05T05:29:02.263+0100 [mongosMain] connection accepted from 172.28.0.163:63028 #1424386 (399 connections now open) 2015-10-05T05:29:02.264+0100 [mongosMain] connection accepted from 172.28.0.163:63029 #1424387 (400 connections now open) 2015-10-05T05:29:02.265+0100 [conn1424386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:02.265+0100 [conn1424387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:02.431+0100 [conn1423994] end connection 172.28.0.164:55167 (399 connections now open) 2015-10-05T05:29:02.432+0100 [mongosMain] connection accepted from 172.28.0.164:56071 #1424388 (400 connections now open) 2015-10-05T05:29:02.433+0100 [conn1424388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:05.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc915703b51053eb8d6f 2015-10-05T05:29:05.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:07.673+0100 [conn1423982] end connection 172.28.0.164:55131 (399 connections now open) 2015-10-05T05:29:07.674+0100 [mongosMain] connection accepted from 172.28.0.164:56073 #1424389 (400 connections now open) 2015-10-05T05:29:07.675+0100 [conn1424389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:08.693+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:29:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:29:11.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc975703b51053eb8db6 2015-10-05T05:29:11.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:12.277+0100 [conn1423927] end connection 172.28.0.163:61929 (399 connections now open) 2015-10-05T05:29:12.279+0100 [mongosMain] connection accepted from 172.28.0.163:63044 #1424390 (400 connections now open) 2015-10-05T05:29:12.280+0100 [conn1424390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:17.690+0100 [conn1423963] end connection 172.28.0.164:55094 (399 connections now open) 2015-10-05T05:29:17.691+0100 [mongosMain] connection accepted from 172.28.0.164:56078 #1424391 (400 connections now open) 2015-10-05T05:29:17.693+0100 [conn1424391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:17.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fc9d5703b51053eb8dfe 2015-10-05T05:29:17.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:24.274+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fca35703b51053eb8e37 2015-10-05T05:29:24.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:27.704+0100 [conn1423991] end connection 172.28.0.164:55162 (399 connections now open) 2015-10-05T05:29:27.705+0100 [mongosMain] connection accepted from 172.28.0.164:56095 #1424392 (400 connections now open) 2015-10-05T05:29:27.707+0100 [conn1424392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:28.842+0100 [mongosMain] connection accepted from 127.0.0.1:63059 #1424393 (401 connections now open) 2015-10-05T05:29:28.845+0100 [conn1424393] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:28.850+0100 [conn1424393] end connection 127.0.0.1:63059 (400 connections now open) 2015-10-05T05:29:30.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcaa5703b51053eb8e54 2015-10-05T05:29:30.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:32.462+0100 [conn1424000] end connection 172.28.0.164:55188 (399 connections now open) 2015-10-05T05:29:32.463+0100 [mongosMain] connection accepted from 172.28.0.164:56101 #1424394 (400 connections now open) 2015-10-05T05:29:32.465+0100 [conn1424394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:37.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcb05703b51053eb8e6f 2015-10-05T05:29:37.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:38.965+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:29:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:29:39.400+0100 [mongosMain] connection accepted from 127.0.0.1:63064 #1424395 (401 connections now open) 2015-10-05T05:29:39.402+0100 [conn1424395] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:39.408+0100 [conn1424395] end connection 127.0.0.1:63064 (400 connections now open) 2015-10-05T05:29:42.478+0100 [conn1423953] end connection 172.28.0.164:55070 (399 connections now open) 2015-10-05T05:29:42.480+0100 [mongosMain] connection accepted from 172.28.0.164:56115 #1424396 (400 connections now open) 2015-10-05T05:29:42.481+0100 [conn1424396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:29:43.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcb75703b51053eb8e95 2015-10-05T05:29:43.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:49.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcbd5703b51053eb8ebc 2015-10-05T05:29:49.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:56.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcc35703b51053eb8ed3 2015-10-05T05:29:56.077+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:29:58.237+0100 [conn1423995] end connection 172.28.0.163:62083 (399 connections now open) 2015-10-05T05:29:58.238+0100 [mongosMain] connection accepted from 172.28.0.163:63083 #1424397 (400 connections now open) 2015-10-05T05:29:58.239+0100 [conn1424397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:02.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcca5703b51053eb8ee9 2015-10-05T05:30:02.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:02.324+0100 [conn1423993] end connection 172.28.0.163:62073 (399 connections now open) 2015-10-05T05:30:02.324+0100 [conn1423972] end connection 172.28.0.163:62025 (399 connections now open) 2015-10-05T05:30:02.325+0100 [mongosMain] connection accepted from 172.28.0.163:63092 #1424398 (399 connections now open) 2015-10-05T05:30:02.326+0100 [mongosMain] connection accepted from 172.28.0.163:63093 #1424399 (400 connections now open) 2015-10-05T05:30:02.327+0100 [conn1424398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:02.327+0100 [conn1424399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:08.253+0100 [conn1423970] end connection 172.28.0.163:62019 (399 connections now open) 2015-10-05T05:30:08.254+0100 [mongosMain] connection accepted from 172.28.0.163:63102 #1424400 (400 connections now open) 2015-10-05T05:30:08.255+0100 [conn1424400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:08.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcd05703b51053eb8f2f 2015-10-05T05:30:08.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:09.091+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:30:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:30:12.326+0100 [conn1423960] end connection 172.28.0.163:61992 (399 connections now open) 2015-10-05T05:30:12.328+0100 [mongosMain] connection accepted from 172.28.0.163:63107 #1424401 (400 connections now open) 2015-10-05T05:30:12.329+0100 [conn1424401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:12.509+0100 [conn1423986] end connection 172.28.0.164:55138 (399 connections now open) 2015-10-05T05:30:12.510+0100 [mongosMain] connection accepted from 172.28.0.164:56143 #1424402 (400 connections now open) 2015-10-05T05:30:12.512+0100 [conn1424402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:14.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcd65703b51053eb8f61 2015-10-05T05:30:14.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:18.253+0100 [conn1423998] end connection 172.28.0.163:62103 (399 connections now open) 2015-10-05T05:30:18.254+0100 [mongosMain] connection accepted from 172.28.0.163:63115 #1424403 (400 connections now open) 2015-10-05T05:30:18.255+0100 [conn1424403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:18.846+0100 [conn1423978] end connection 172.28.0.163:62038 (399 connections now open) 2015-10-05T05:30:18.847+0100 [mongosMain] connection accepted from 172.28.0.163:63116 #1424404 (400 connections now open) 2015-10-05T05:30:18.848+0100 [conn1424404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:21.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcdc5703b51053eb8f93 2015-10-05T05:30:21.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:22.340+0100 [conn1423990] end connection 172.28.0.163:62056 (399 connections now open) 2015-10-05T05:30:22.342+0100 [mongosMain] connection accepted from 172.28.0.163:63118 #1424405 (400 connections now open) 2015-10-05T05:30:22.343+0100 [conn1424405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:22.525+0100 [conn1423921] end connection 172.28.0.164:55000 (399 connections now open) 2015-10-05T05:30:22.526+0100 [mongosMain] connection accepted from 172.28.0.164:56158 #1424406 (400 connections now open) 2015-10-05T05:30:22.528+0100 [conn1424406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:27.608+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fce35703b51053eb8fce 2015-10-05T05:30:27.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:28.235+0100 [conn1423988] end connection 172.28.0.164:55148 (399 connections now open) 2015-10-05T05:30:28.237+0100 [mongosMain] connection accepted from 172.28.0.164:56168 #1424407 (400 connections now open) 2015-10-05T05:30:28.243+0100 [conn1424407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:28.261+0100 [mongosMain] connection accepted from 127.0.0.1:63121 #1424408 (401 connections now open) 2015-10-05T05:30:28.264+0100 [conn1424408] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:28.269+0100 [conn1423957] end connection 172.28.0.163:61980 (400 connections now open) 2015-10-05T05:30:28.269+0100 [conn1424408] end connection 127.0.0.1:63121 (399 connections now open) 2015-10-05T05:30:28.270+0100 [mongosMain] connection accepted from 172.28.0.163:63122 #1424409 (400 connections now open) 2015-10-05T05:30:28.270+0100 [conn1424409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:28.861+0100 [conn1424008] end connection 172.28.0.163:62172 (399 connections now open) 2015-10-05T05:30:28.862+0100 [mongosMain] connection accepted from 172.28.0.163:63123 #1424410 (400 connections now open) 2015-10-05T05:30:28.863+0100 [conn1424410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:32.342+0100 [conn1423996] end connection 172.28.0.163:62095 (399 connections now open) 2015-10-05T05:30:32.343+0100 [mongosMain] connection accepted from 172.28.0.163:63128 #1424411 (400 connections now open) 2015-10-05T05:30:32.344+0100 [conn1424411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:32.541+0100 [conn1423881] end connection 172.28.0.164:54913 (399 connections now open) 2015-10-05T05:30:32.542+0100 [mongosMain] connection accepted from 172.28.0.164:56175 #1424412 (400 connections now open) 2015-10-05T05:30:32.544+0100 [conn1424412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:34.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fce95703b51053eb8ffa 2015-10-05T05:30:34.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:38.878+0100 [conn1424015] end connection 172.28.0.163:62180 (399 connections now open) 2015-10-05T05:30:38.879+0100 [mongosMain] connection accepted from 172.28.0.163:63131 #1424413 (400 connections now open) 2015-10-05T05:30:38.880+0100 [conn1424413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:39.264+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:30:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:30:39.616+0100 [mongosMain] connection accepted from 127.0.0.1:63133 #1424414 (401 connections now open) 2015-10-05T05:30:39.619+0100 [conn1424414] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:39.624+0100 [conn1424414] end connection 127.0.0.1:63133 (400 connections now open) 2015-10-05T05:30:40.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcf05703b51053eb901d 2015-10-05T05:30:40.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:42.356+0100 [conn1424017] end connection 172.28.0.163:62187 (399 connections now open) 2015-10-05T05:30:42.357+0100 [mongosMain] connection accepted from 172.28.0.163:63136 #1424415 (400 connections now open) 2015-10-05T05:30:42.358+0100 [conn1424415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:42.557+0100 [conn1423929] end connection 172.28.0.164:55010 (399 connections now open) 2015-10-05T05:30:42.558+0100 [mongosMain] connection accepted from 172.28.0.164:56188 #1424416 (400 connections now open) 2015-10-05T05:30:42.560+0100 [conn1424416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:46.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcf65703b51053eb903c 2015-10-05T05:30:46.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:47.814+0100 [conn1423955] end connection 172.28.0.164:55078 (399 connections now open) 2015-10-05T05:30:47.815+0100 [mongosMain] connection accepted from 172.28.0.164:56194 #1424417 (400 connections now open) 2015-10-05T05:30:47.817+0100 [conn1424417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:48.267+0100 [conn1424013] end connection 172.28.0.164:55261 (399 connections now open) 2015-10-05T05:30:48.268+0100 [mongosMain] connection accepted from 172.28.0.164:56197 #1424418 (400 connections now open) 2015-10-05T05:30:48.270+0100 [conn1424418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:48.285+0100 [conn1424019] end connection 172.28.0.163:62190 (399 connections now open) 2015-10-05T05:30:48.286+0100 [mongosMain] connection accepted from 172.28.0.163:63145 #1424419 (400 connections now open) 2015-10-05T05:30:48.287+0100 [conn1424419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:52.357+0100 [conn1423967] end connection 172.28.0.163:62012 (399 connections now open) 2015-10-05T05:30:52.357+0100 [conn1424009] end connection 172.28.0.163:62175 (398 connections now open) 2015-10-05T05:30:52.358+0100 [mongosMain] connection accepted from 172.28.0.163:63151 #1424420 (399 connections now open) 2015-10-05T05:30:52.358+0100 [mongosMain] connection accepted from 172.28.0.163:63152 #1424421 (400 connections now open) 2015-10-05T05:30:52.359+0100 [conn1424420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:52.360+0100 [conn1424421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:52.587+0100 [conn1423961] end connection 172.28.0.164:55087 (399 connections now open) 2015-10-05T05:30:52.589+0100 [mongosMain] connection accepted from 172.28.0.164:56200 #1424422 (400 connections now open) 2015-10-05T05:30:52.590+0100 [conn1424422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:53.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fcfc5703b51053eb906c 2015-10-05T05:30:53.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:30:57.830+0100 [conn1424001] end connection 172.28.0.164:55195 (399 connections now open) 2015-10-05T05:30:57.831+0100 [mongosMain] connection accepted from 172.28.0.164:56205 #1424423 (400 connections now open) 2015-10-05T05:30:57.833+0100 [conn1424423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:58.283+0100 [conn1424024] end connection 172.28.0.164:55292 (399 connections now open) 2015-10-05T05:30:58.285+0100 [conn1423977] end connection 172.28.0.163:62035 (398 connections now open) 2015-10-05T05:30:58.285+0100 [mongosMain] connection accepted from 172.28.0.164:56207 #1424424 (399 connections now open) 2015-10-05T05:30:58.286+0100 [mongosMain] connection accepted from 172.28.0.163:63163 #1424425 (400 connections now open) 2015-10-05T05:30:58.286+0100 [conn1424424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:58.287+0100 [conn1424425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:58.893+0100 [conn1424020] end connection 172.28.0.163:62192 (399 connections now open) 2015-10-05T05:30:58.894+0100 [mongosMain] connection accepted from 172.28.0.163:63165 #1424426 (400 connections now open) 2015-10-05T05:30:58.896+0100 [conn1424426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:30:59.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd035703b51053eb9092 2015-10-05T05:30:59.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:02.372+0100 [conn1424022] end connection 172.28.0.163:62196 (399 connections now open) 2015-10-05T05:31:02.374+0100 [mongosMain] connection accepted from 172.28.0.163:63171 #1424427 (400 connections now open) 2015-10-05T05:31:02.375+0100 [conn1424427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:02.572+0100 [conn1423938] end connection 172.28.0.164:55023 (399 connections now open) 2015-10-05T05:31:02.573+0100 [conn1424012] end connection 172.28.0.164:55249 (398 connections now open) 2015-10-05T05:31:02.574+0100 [mongosMain] connection accepted from 172.28.0.164:56216 #1424428 (399 connections now open) 2015-10-05T05:31:02.574+0100 [mongosMain] connection accepted from 172.28.0.164:56215 #1424429 (400 connections now open) 2015-10-05T05:31:02.576+0100 [conn1424428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:02.576+0100 [conn1424429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:05.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd095703b51053eb90d9 2015-10-05T05:31:05.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:07.845+0100 [conn1423987] end connection 172.28.0.164:55147 (399 connections now open) 2015-10-05T05:31:07.847+0100 [mongosMain] connection accepted from 172.28.0.164:56218 #1424430 (400 connections now open) 2015-10-05T05:31:07.848+0100 [conn1424430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:08.298+0100 [conn1424030] end connection 172.28.0.164:55301 (399 connections now open) 2015-10-05T05:31:08.299+0100 [mongosMain] connection accepted from 172.28.0.164:56221 #1424431 (400 connections now open) 2015-10-05T05:31:08.300+0100 [conn1424014] end connection 172.28.0.163:62179 (399 connections now open) 2015-10-05T05:31:08.301+0100 [conn1424431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:08.301+0100 [mongosMain] connection accepted from 172.28.0.163:63181 #1424432 (400 connections now open) 2015-10-05T05:31:08.302+0100 [conn1424432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:08.893+0100 [conn1424032] end connection 172.28.0.163:62234 (399 connections now open) 2015-10-05T05:31:08.894+0100 [mongosMain] connection accepted from 172.28.0.163:63184 #1424433 (400 connections now open) 2015-10-05T05:31:08.895+0100 [conn1424433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:09.545+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:31:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:31:12.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd0f5703b51053eb9101 2015-10-05T05:31:12.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:12.374+0100 [conn1424027] end connection 172.28.0.163:62220 (399 connections now open) 2015-10-05T05:31:12.376+0100 [mongosMain] connection accepted from 172.28.0.163:63186 #1424434 (400 connections now open) 2015-10-05T05:31:12.377+0100 [conn1424434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:12.588+0100 [conn1424003] end connection 172.28.0.164:55202 (399 connections now open) 2015-10-05T05:31:12.588+0100 [conn1424018] end connection 172.28.0.164:55266 (398 connections now open) 2015-10-05T05:31:12.588+0100 [mongosMain] connection accepted from 172.28.0.164:56226 #1424435 (399 connections now open) 2015-10-05T05:31:12.589+0100 [mongosMain] connection accepted from 172.28.0.164:56225 #1424436 (400 connections now open) 2015-10-05T05:31:12.590+0100 [conn1424435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:12.591+0100 [conn1424436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:17.877+0100 [conn1424004] end connection 172.28.0.164:55209 (399 connections now open) 2015-10-05T05:31:17.878+0100 [mongosMain] connection accepted from 172.28.0.164:56230 #1424437 (400 connections now open) 2015-10-05T05:31:17.880+0100 [conn1424437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:18.301+0100 [conn1424025] end connection 172.28.0.163:62214 (399 connections now open) 2015-10-05T05:31:18.303+0100 [mongosMain] connection accepted from 172.28.0.163:63194 #1424438 (400 connections now open) 2015-10-05T05:31:18.304+0100 [conn1424438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:18.313+0100 [conn1424037] end connection 172.28.0.164:55316 (399 connections now open) 2015-10-05T05:31:18.315+0100 [mongosMain] connection accepted from 172.28.0.164:56232 #1424439 (400 connections now open) 2015-10-05T05:31:18.317+0100 [conn1424439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:18.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd165703b51053eb9127 2015-10-05T05:31:18.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:18.909+0100 [conn1424026] end connection 172.28.0.163:62216 (399 connections now open) 2015-10-05T05:31:18.910+0100 [mongosMain] connection accepted from 172.28.0.163:63197 #1424440 (400 connections now open) 2015-10-05T05:31:18.911+0100 [conn1424440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:22.387+0100 [conn1424033] end connection 172.28.0.163:62244 (399 connections now open) 2015-10-05T05:31:22.388+0100 [mongosMain] connection accepted from 172.28.0.163:63201 #1424441 (400 connections now open) 2015-10-05T05:31:22.389+0100 [conn1424441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:22.603+0100 [conn1424007] end connection 172.28.0.164:55237 (399 connections now open) 2015-10-05T05:31:22.603+0100 [conn1424011] end connection 172.28.0.164:55250 (399 connections now open) 2015-10-05T05:31:22.604+0100 [mongosMain] connection accepted from 172.28.0.164:56239 #1424442 (399 connections now open) 2015-10-05T05:31:22.605+0100 [mongosMain] connection accepted from 172.28.0.164:56240 #1424443 (400 connections now open) 2015-10-05T05:31:22.606+0100 [conn1424442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:22.606+0100 [conn1424443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:24.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd1c5703b51053eb9155 2015-10-05T05:31:25.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:27.877+0100 [conn1423997] end connection 172.28.0.164:55178 (399 connections now open) 2015-10-05T05:31:27.878+0100 [mongosMain] connection accepted from 172.28.0.164:56251 #1424444 (400 connections now open) 2015-10-05T05:31:27.880+0100 [conn1424444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:28.316+0100 [conn1423992] end connection 172.28.0.163:62065 (399 connections now open) 2015-10-05T05:31:28.317+0100 [mongosMain] connection accepted from 172.28.0.163:63203 #1424445 (400 connections now open) 2015-10-05T05:31:28.318+0100 [conn1424445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:28.329+0100 [conn1424044] end connection 172.28.0.164:55326 (399 connections now open) 2015-10-05T05:31:28.330+0100 [mongosMain] connection accepted from 172.28.0.164:56253 #1424446 (400 connections now open) 2015-10-05T05:31:28.332+0100 [conn1424446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:28.456+0100 [mongosMain] connection accepted from 127.0.0.1:63206 #1424447 (401 connections now open) 2015-10-05T05:31:28.459+0100 [conn1424447] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:28.465+0100 [conn1424447] end connection 127.0.0.1:63206 (400 connections now open) 2015-10-05T05:31:28.909+0100 [conn1424039] end connection 172.28.0.163:62257 (399 connections now open) 2015-10-05T05:31:28.910+0100 [mongosMain] connection accepted from 172.28.0.163:63207 #1424448 (400 connections now open) 2015-10-05T05:31:28.911+0100 [conn1424448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:32.619+0100 [conn1424034] end connection 172.28.0.164:55309 (399 connections now open) 2015-10-05T05:31:32.619+0100 [conn1424035] end connection 172.28.0.164:55310 (398 connections now open) 2015-10-05T05:31:32.620+0100 [mongosMain] connection accepted from 172.28.0.164:56258 #1424449 (399 connections now open) 2015-10-05T05:31:32.621+0100 [mongosMain] connection accepted from 172.28.0.164:56259 #1424450 (400 connections now open) 2015-10-05T05:31:32.622+0100 [conn1424449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:32.623+0100 [conn1424450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:38.345+0100 [conn1424051] end connection 172.28.0.164:55346 (399 connections now open) 2015-10-05T05:31:38.348+0100 [mongosMain] connection accepted from 172.28.0.164:56269 #1424451 (400 connections now open) 2015-10-05T05:31:38.350+0100 [conn1424451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:38.925+0100 [conn1424046] end connection 172.28.0.163:62270 (399 connections now open) 2015-10-05T05:31:38.926+0100 [mongosMain] connection accepted from 172.28.0.163:63214 #1424452 (400 connections now open) 2015-10-05T05:31:38.927+0100 [conn1424452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:39.271+0100 [mongosMain] connection accepted from 127.0.0.1:63216 #1424453 (401 connections now open) 2015-10-05T05:31:39.273+0100 [conn1424453] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:39.278+0100 [conn1424453] end connection 127.0.0.1:63216 (400 connections now open) 2015-10-05T05:31:39.690+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:31:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:31:42.408+0100 [conn1423920] end connection 172.28.0.163:61912 (399 connections now open) 2015-10-05T05:31:42.410+0100 [mongosMain] connection accepted from 172.28.0.163:63219 #1424454 (400 connections now open) 2015-10-05T05:31:42.411+0100 [conn1424454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:42.634+0100 [conn1424042] end connection 172.28.0.164:55320 (399 connections now open) 2015-10-05T05:31:42.635+0100 [conn1424023] end connection 172.28.0.164:55280 (398 connections now open) 2015-10-05T05:31:42.635+0100 [mongosMain] connection accepted from 172.28.0.164:56278 #1424455 (399 connections now open) 2015-10-05T05:31:42.635+0100 [mongosMain] connection accepted from 172.28.0.164:56279 #1424456 (400 connections now open) 2015-10-05T05:31:42.636+0100 [conn1424455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:42.637+0100 [conn1424456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:43.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd2f5703b51053eb91c9 2015-10-05T05:31:43.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:48.332+0100 [conn1423948] end connection 172.28.0.163:61961 (399 connections now open) 2015-10-05T05:31:48.333+0100 [mongosMain] connection accepted from 172.28.0.163:63229 #1424457 (400 connections now open) 2015-10-05T05:31:48.334+0100 [conn1424457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:48.360+0100 [conn1424060] end connection 172.28.0.164:55364 (399 connections now open) 2015-10-05T05:31:48.361+0100 [mongosMain] connection accepted from 172.28.0.164:56287 #1424458 (400 connections now open) 2015-10-05T05:31:48.363+0100 [conn1424458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:48.925+0100 [conn1424053] end connection 172.28.0.163:62279 (399 connections now open) 2015-10-05T05:31:48.927+0100 [mongosMain] connection accepted from 172.28.0.163:63231 #1424459 (400 connections now open) 2015-10-05T05:31:48.928+0100 [conn1424459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:52.419+0100 [conn1424041] end connection 172.28.0.163:62262 (399 connections now open) 2015-10-05T05:31:52.420+0100 [mongosMain] connection accepted from 172.28.0.163:63235 #1424460 (400 connections now open) 2015-10-05T05:31:52.421+0100 [conn1424460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:52.650+0100 [conn1424048] end connection 172.28.0.164:55334 (399 connections now open) 2015-10-05T05:31:52.651+0100 [conn1424049] end connection 172.28.0.164:55335 (398 connections now open) 2015-10-05T05:31:52.652+0100 [mongosMain] connection accepted from 172.28.0.164:56292 #1424461 (399 connections now open) 2015-10-05T05:31:52.653+0100 [mongosMain] connection accepted from 172.28.0.164:56293 #1424462 (400 connections now open) 2015-10-05T05:31:52.654+0100 [conn1424461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:52.654+0100 [conn1424462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:55.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd3b5703b51053eb9224 2015-10-05T05:31:55.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:31:58.391+0100 [conn1424068] end connection 172.28.0.164:55383 (399 connections now open) 2015-10-05T05:31:58.391+0100 [mongosMain] connection accepted from 172.28.0.164:56300 #1424463 (400 connections now open) 2015-10-05T05:31:58.391+0100 [conn1424031] end connection 172.28.0.163:62232 (399 connections now open) 2015-10-05T05:31:58.391+0100 [conn1424463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:58.391+0100 [mongosMain] connection accepted from 172.28.0.163:63246 #1424464 (400 connections now open) 2015-10-05T05:31:58.391+0100 [conn1424464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:31:58.984+0100 [conn1424062] end connection 172.28.0.163:62293 (399 connections now open) 2015-10-05T05:31:58.984+0100 [mongosMain] connection accepted from 172.28.0.163:63248 #1424465 (400 connections now open) 2015-10-05T05:31:58.984+0100 [conn1424465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:02.066+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd415703b51053eb924a 2015-10-05T05:32:02.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:02.421+0100 [conn1424040] end connection 172.28.0.163:62261 (399 connections now open) 2015-10-05T05:32:02.422+0100 [mongosMain] connection accepted from 172.28.0.163:63257 #1424466 (400 connections now open) 2015-10-05T05:32:02.423+0100 [conn1424466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:02.493+0100 [conn1424010] end connection 172.28.0.163:62176 (399 connections now open) 2015-10-05T05:32:02.495+0100 [mongosMain] connection accepted from 172.28.0.163:63258 #1424467 (400 connections now open) 2015-10-05T05:32:02.496+0100 [conn1424467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:02.666+0100 [conn1424066] end connection 172.28.0.164:55372 (399 connections now open) 2015-10-05T05:32:02.666+0100 [conn1424029] end connection 172.28.0.164:55295 (398 connections now open) 2015-10-05T05:32:02.667+0100 [mongosMain] connection accepted from 172.28.0.164:56306 #1424468 (399 connections now open) 2015-10-05T05:32:02.668+0100 [mongosMain] connection accepted from 172.28.0.164:56307 #1424469 (400 connections now open) 2015-10-05T05:32:02.669+0100 [conn1424468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:02.669+0100 [conn1424469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:08.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd485703b51053eb9281 2015-10-05T05:32:08.348+0100 [conn1424045] end connection 172.28.0.163:62269 (399 connections now open) 2015-10-05T05:32:08.349+0100 [mongosMain] connection accepted from 172.28.0.163:63269 #1424470 (400 connections now open) 2015-10-05T05:32:08.351+0100 [conn1424470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:08.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:08.376+0100 [conn1424075] end connection 172.28.0.164:55396 (399 connections now open) 2015-10-05T05:32:08.377+0100 [mongosMain] connection accepted from 172.28.0.164:56309 #1424471 (400 connections now open) 2015-10-05T05:32:08.379+0100 [conn1424471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:08.955+0100 [conn1424070] end connection 172.28.0.163:62310 (399 connections now open) 2015-10-05T05:32:08.956+0100 [mongosMain] connection accepted from 172.28.0.163:63271 #1424472 (400 connections now open) 2015-10-05T05:32:08.957+0100 [conn1424472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:09.824+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:32:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:32:12.435+0100 [conn1424055] end connection 172.28.0.163:62282 (399 connections now open) 2015-10-05T05:32:12.436+0100 [conn1424056] end connection 172.28.0.163:62283 (399 connections now open) 2015-10-05T05:32:12.437+0100 [mongosMain] connection accepted from 172.28.0.163:63275 #1424473 (399 connections now open) 2015-10-05T05:32:12.437+0100 [mongosMain] connection accepted from 172.28.0.163:63276 #1424474 (400 connections now open) 2015-10-05T05:32:12.438+0100 [conn1424473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:12.438+0100 [conn1424474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:12.683+0100 [conn1424073] end connection 172.28.0.164:55389 (399 connections now open) 2015-10-05T05:32:12.683+0100 [conn1424057] end connection 172.28.0.164:55352 (398 connections now open) 2015-10-05T05:32:12.684+0100 [mongosMain] connection accepted from 172.28.0.164:56313 #1424475 (399 connections now open) 2015-10-05T05:32:12.684+0100 [mongosMain] connection accepted from 172.28.0.164:56314 #1424476 (400 connections now open) 2015-10-05T05:32:12.685+0100 [conn1424475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:12.686+0100 [conn1424476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:14.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd4e5703b51053eb929b 2015-10-05T05:32:14.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:17.923+0100 [conn1424081] end connection 172.28.0.164:55406 (399 connections now open) 2015-10-05T05:32:17.925+0100 [mongosMain] connection accepted from 172.28.0.164:56319 #1424477 (400 connections now open) 2015-10-05T05:32:17.926+0100 [conn1424477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:18.363+0100 [conn1424061] end connection 172.28.0.163:62287 (399 connections now open) 2015-10-05T05:32:18.364+0100 [mongosMain] connection accepted from 172.28.0.163:63285 #1424478 (400 connections now open) 2015-10-05T05:32:18.366+0100 [conn1424478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:18.391+0100 [conn1424082] end connection 172.28.0.164:55408 (399 connections now open) 2015-10-05T05:32:18.393+0100 [mongosMain] connection accepted from 172.28.0.164:56321 #1424479 (400 connections now open) 2015-10-05T05:32:18.394+0100 [conn1424479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:18.956+0100 [conn1424077] end connection 172.28.0.163:62328 (399 connections now open) 2015-10-05T05:32:18.957+0100 [mongosMain] connection accepted from 172.28.0.163:63286 #1424480 (400 connections now open) 2015-10-05T05:32:18.959+0100 [conn1424480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:21.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd545703b51053eb92ca 2015-10-05T05:32:21.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:22.437+0100 [conn1424047] end connection 172.28.0.163:62274 (399 connections now open) 2015-10-05T05:32:22.437+0100 [conn1423980] end connection 172.28.0.163:62042 (399 connections now open) 2015-10-05T05:32:22.438+0100 [mongosMain] connection accepted from 172.28.0.163:63289 #1424481 (399 connections now open) 2015-10-05T05:32:22.439+0100 [mongosMain] connection accepted from 172.28.0.163:63290 #1424482 (400 connections now open) 2015-10-05T05:32:22.440+0100 [conn1424481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:22.440+0100 [conn1424482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:22.699+0100 [conn1424058] end connection 172.28.0.164:55353 (399 connections now open) 2015-10-05T05:32:22.699+0100 [mongosMain] connection accepted from 172.28.0.164:56330 #1424483 (400 connections now open) 2015-10-05T05:32:22.701+0100 [conn1424483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:27.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd5b5703b51053eb92f8 2015-10-05T05:32:27.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:27.923+0100 [conn1424050] end connection 172.28.0.164:55343 (399 connections now open) 2015-10-05T05:32:27.925+0100 [mongosMain] connection accepted from 172.28.0.164:56338 #1424484 (400 connections now open) 2015-10-05T05:32:27.927+0100 [conn1424484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:28.363+0100 [conn1424069] end connection 172.28.0.163:62307 (399 connections now open) 2015-10-05T05:32:28.364+0100 [mongosMain] connection accepted from 172.28.0.163:63293 #1424485 (400 connections now open) 2015-10-05T05:32:28.366+0100 [conn1424485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:28.391+0100 [conn1424088] end connection 172.28.0.164:55418 (399 connections now open) 2015-10-05T05:32:28.392+0100 [mongosMain] connection accepted from 172.28.0.164:56340 #1424486 (400 connections now open) 2015-10-05T05:32:28.394+0100 [conn1424486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:28.898+0100 [mongosMain] connection accepted from 127.0.0.1:63294 #1424487 (401 connections now open) 2015-10-05T05:32:28.900+0100 [conn1424487] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:28.905+0100 [conn1424487] end connection 127.0.0.1:63294 (400 connections now open) 2015-10-05T05:32:28.971+0100 [conn1424084] end connection 172.28.0.163:62353 (399 connections now open) 2015-10-05T05:32:28.973+0100 [mongosMain] connection accepted from 172.28.0.163:63295 #1424488 (400 connections now open) 2015-10-05T05:32:28.973+0100 [conn1424488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:32.451+0100 [conn1424071] end connection 172.28.0.163:62314 (399 connections now open) 2015-10-05T05:32:32.451+0100 [conn1424085] end connection 172.28.0.163:62356 (399 connections now open) 2015-10-05T05:32:32.452+0100 [mongosMain] connection accepted from 172.28.0.163:63297 #1424489 (399 connections now open) 2015-10-05T05:32:32.453+0100 [mongosMain] connection accepted from 172.28.0.163:63298 #1424490 (400 connections now open) 2015-10-05T05:32:32.454+0100 [conn1424489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:32.454+0100 [conn1424490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:32.714+0100 [conn1424086] end connection 172.28.0.164:55412 (399 connections now open) 2015-10-05T05:32:32.715+0100 [mongosMain] connection accepted from 172.28.0.164:56346 #1424491 (400 connections now open) 2015-10-05T05:32:32.717+0100 [conn1424491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:33.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd615703b51053eb931d 2015-10-05T05:32:34.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:37.939+0100 [conn1424036] end connection 172.28.0.164:55314 (399 connections now open) 2015-10-05T05:32:37.940+0100 [mongosMain] connection accepted from 172.28.0.164:56357 #1424492 (400 connections now open) 2015-10-05T05:32:37.942+0100 [conn1424492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:38.392+0100 [conn1424094] end connection 172.28.0.164:55438 (399 connections now open) 2015-10-05T05:32:38.393+0100 [mongosMain] connection accepted from 172.28.0.164:56361 #1424493 (400 connections now open) 2015-10-05T05:32:38.395+0100 [conn1424493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:38.972+0100 [conn1424090] end connection 172.28.0.163:62366 (399 connections now open) 2015-10-05T05:32:38.975+0100 [mongosMain] connection accepted from 172.28.0.163:63303 #1424494 (400 connections now open) 2015-10-05T05:32:38.976+0100 [conn1424494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:39.443+0100 [mongosMain] connection accepted from 127.0.0.1:63305 #1424495 (401 connections now open) 2015-10-05T05:32:39.446+0100 [conn1424495] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:39.450+0100 [conn1424495] end connection 127.0.0.1:63305 (400 connections now open) 2015-10-05T05:32:40.191+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:32:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:32:40.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd685703b51053eb9338 2015-10-05T05:32:40.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:42.467+0100 [conn1424078] end connection 172.28.0.163:62341 (399 connections now open) 2015-10-05T05:32:42.467+0100 [conn1424098] end connection 172.28.0.163:62376 (398 connections now open) 2015-10-05T05:32:42.468+0100 [mongosMain] connection accepted from 172.28.0.163:63308 #1424496 (399 connections now open) 2015-10-05T05:32:42.468+0100 [mongosMain] connection accepted from 172.28.0.163:63309 #1424497 (400 connections now open) 2015-10-05T05:32:42.469+0100 [conn1424496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:42.469+0100 [conn1424497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:42.729+0100 [conn1424080] end connection 172.28.0.164:55405 (399 connections now open) 2015-10-05T05:32:42.730+0100 [mongosMain] connection accepted from 172.28.0.164:56366 #1424498 (400 connections now open) 2015-10-05T05:32:42.732+0100 [conn1424498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:46.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd6e5703b51053eb9369 2015-10-05T05:32:46.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:32:47.939+0100 [conn1423999] end connection 172.28.0.164:55180 (399 connections now open) 2015-10-05T05:32:47.940+0100 [mongosMain] connection accepted from 172.28.0.164:56375 #1424499 (400 connections now open) 2015-10-05T05:32:47.941+0100 [conn1424499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:48.379+0100 [conn1424076] end connection 172.28.0.163:62327 (399 connections now open) 2015-10-05T05:32:48.380+0100 [mongosMain] connection accepted from 172.28.0.163:63318 #1424500 (400 connections now open) 2015-10-05T05:32:48.381+0100 [conn1424500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:48.408+0100 [conn1424101] end connection 172.28.0.164:55455 (399 connections now open) 2015-10-05T05:32:48.409+0100 [mongosMain] connection accepted from 172.28.0.164:56377 #1424501 (400 connections now open) 2015-10-05T05:32:48.411+0100 [conn1424501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:48.987+0100 [conn1424096] end connection 172.28.0.163:62372 (399 connections now open) 2015-10-05T05:32:48.988+0100 [mongosMain] connection accepted from 172.28.0.163:63320 #1424502 (400 connections now open) 2015-10-05T05:32:48.989+0100 [conn1424502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:52.468+0100 [conn1424105] end connection 172.28.0.163:62385 (399 connections now open) 2015-10-05T05:32:52.470+0100 [mongosMain] connection accepted from 172.28.0.163:63325 #1424503 (400 connections now open) 2015-10-05T05:32:52.470+0100 [conn1424503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:52.745+0100 [conn1424065] end connection 172.28.0.164:55373 (399 connections now open) 2015-10-05T05:32:52.746+0100 [mongosMain] connection accepted from 172.28.0.164:56384 #1424504 (400 connections now open) 2015-10-05T05:32:52.748+0100 [conn1424504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:57.955+0100 [conn1424074] end connection 172.28.0.164:55394 (399 connections now open) 2015-10-05T05:32:57.956+0100 [mongosMain] connection accepted from 172.28.0.164:56389 #1424505 (400 connections now open) 2015-10-05T05:32:57.961+0100 [conn1424505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:58.394+0100 [conn1424095] end connection 172.28.0.163:62371 (399 connections now open) 2015-10-05T05:32:58.395+0100 [mongosMain] connection accepted from 172.28.0.163:63334 #1424506 (400 connections now open) 2015-10-05T05:32:58.396+0100 [conn1424506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:58.423+0100 [conn1424108] end connection 172.28.0.164:55472 (399 connections now open) 2015-10-05T05:32:58.425+0100 [mongosMain] connection accepted from 172.28.0.164:56391 #1424507 (400 connections now open) 2015-10-05T05:32:58.426+0100 [conn1424507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:58.987+0100 [conn1424103] end connection 172.28.0.163:62380 (399 connections now open) 2015-10-05T05:32:58.988+0100 [mongosMain] connection accepted from 172.28.0.163:63337 #1424508 (400 connections now open) 2015-10-05T05:32:58.989+0100 [conn1424508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:32:59.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd7a5703b51053eb93c8 2015-10-05T05:32:59.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:02.483+0100 [conn1424079] end connection 172.28.0.163:62342 (399 connections now open) 2015-10-05T05:33:02.484+0100 [mongosMain] connection accepted from 172.28.0.163:63348 #1424509 (400 connections now open) 2015-10-05T05:33:02.485+0100 [conn1424509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:02.761+0100 [conn1424099] end connection 172.28.0.164:55443 (399 connections now open) 2015-10-05T05:33:02.762+0100 [mongosMain] connection accepted from 172.28.0.164:56399 #1424510 (400 connections now open) 2015-10-05T05:33:02.764+0100 [conn1424510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:07.955+0100 [conn1424067] end connection 172.28.0.164:55380 (399 connections now open) 2015-10-05T05:33:07.957+0100 [mongosMain] connection accepted from 172.28.0.164:56401 #1424511 (400 connections now open) 2015-10-05T05:33:07.958+0100 [conn1424511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:08.410+0100 [conn1424052] end connection 172.28.0.163:62277 (399 connections now open) 2015-10-05T05:33:08.411+0100 [mongosMain] connection accepted from 172.28.0.163:63357 #1424512 (400 connections now open) 2015-10-05T05:33:08.412+0100 [conn1424512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:08.438+0100 [conn1424113] end connection 172.28.0.164:55484 (399 connections now open) 2015-10-05T05:33:08.440+0100 [mongosMain] connection accepted from 172.28.0.164:56403 #1424513 (400 connections now open) 2015-10-05T05:33:08.442+0100 [conn1424513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:09.003+0100 [conn1424109] end connection 172.28.0.163:62398 (399 connections now open) 2015-10-05T05:33:09.004+0100 [mongosMain] connection accepted from 172.28.0.163:63360 #1424514 (400 connections now open) 2015-10-05T05:33:09.006+0100 [conn1424514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:10.467+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:33:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:33:11.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd875703b51053eb9418 2015-10-05T05:33:11.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:12.484+0100 [conn1424064] end connection 172.28.0.163:62297 (399 connections now open) 2015-10-05T05:33:12.484+0100 [conn1424110] end connection 172.28.0.163:62402 (399 connections now open) 2015-10-05T05:33:12.485+0100 [mongosMain] connection accepted from 172.28.0.163:63364 #1424515 (399 connections now open) 2015-10-05T05:33:12.485+0100 [mongosMain] connection accepted from 172.28.0.163:63365 #1424516 (400 connections now open) 2015-10-05T05:33:12.486+0100 [conn1424515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:12.486+0100 [conn1424516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:12.761+0100 [conn1424092] end connection 172.28.0.164:55427 (399 connections now open) 2015-10-05T05:33:12.761+0100 [conn1424072] end connection 172.28.0.164:55388 (398 connections now open) 2015-10-05T05:33:12.762+0100 [mongosMain] connection accepted from 172.28.0.164:56406 #1424517 (399 connections now open) 2015-10-05T05:33:12.762+0100 [mongosMain] connection accepted from 172.28.0.164:56407 #1424518 (400 connections now open) 2015-10-05T05:33:12.764+0100 [conn1424517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:12.764+0100 [conn1424518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:17.971+0100 [conn1424059] end connection 172.28.0.164:55361 (399 connections now open) 2015-10-05T05:33:17.972+0100 [mongosMain] connection accepted from 172.28.0.164:56416 #1424519 (400 connections now open) 2015-10-05T05:33:17.974+0100 [conn1424519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:18.456+0100 [conn1424118] end connection 172.28.0.164:55510 (399 connections now open) 2015-10-05T05:33:18.457+0100 [mongosMain] connection accepted from 172.28.0.164:56418 #1424520 (400 connections now open) 2015-10-05T05:33:18.459+0100 [conn1424520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:19.004+0100 [conn1424114] end connection 172.28.0.163:62414 (399 connections now open) 2015-10-05T05:33:19.005+0100 [mongosMain] connection accepted from 172.28.0.163:63376 #1424521 (400 connections now open) 2015-10-05T05:33:19.006+0100 [conn1424521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:22.791+0100 [conn1424117] end connection 172.28.0.164:55494 (399 connections now open) 2015-10-05T05:33:22.791+0100 [conn1424116] end connection 172.28.0.164:55493 (399 connections now open) 2015-10-05T05:33:22.792+0100 [mongosMain] connection accepted from 172.28.0.164:56429 #1424522 (399 connections now open) 2015-10-05T05:33:22.793+0100 [mongosMain] connection accepted from 172.28.0.164:56428 #1424523 (400 connections now open) 2015-10-05T05:33:22.794+0100 [conn1424522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:22.794+0100 [conn1424523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:24.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fd935703b51053eb944f 2015-10-05T05:33:24.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:28.472+0100 [conn1424122] end connection 172.28.0.164:55521 (399 connections now open) 2015-10-05T05:33:28.473+0100 [mongosMain] connection accepted from 172.28.0.164:56437 #1424524 (400 connections now open) 2015-10-05T05:33:28.476+0100 [conn1424524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:28.587+0100 [mongosMain] connection accepted from 127.0.0.1:63383 #1424525 (401 connections now open) 2015-10-05T05:33:28.590+0100 [conn1424525] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:28.594+0100 [conn1424525] end connection 127.0.0.1:63383 (400 connections now open) 2015-10-05T05:33:29.019+0100 [conn1424119] end connection 172.28.0.163:62457 (399 connections now open) 2015-10-05T05:33:29.020+0100 [mongosMain] connection accepted from 172.28.0.163:63384 #1424526 (400 connections now open) 2015-10-05T05:33:29.022+0100 [conn1424526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:32.501+0100 [conn1424091] end connection 172.28.0.163:62369 (399 connections now open) 2015-10-05T05:33:32.502+0100 [mongosMain] connection accepted from 172.28.0.163:63386 #1424527 (400 connections now open) 2015-10-05T05:33:32.504+0100 [conn1424527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:32.776+0100 [conn1424107] end connection 172.28.0.164:55463 (399 connections now open) 2015-10-05T05:33:32.776+0100 [conn1424120] end connection 172.28.0.164:55514 (398 connections now open) 2015-10-05T05:33:32.777+0100 [mongosMain] connection accepted from 172.28.0.164:56444 #1424528 (399 connections now open) 2015-10-05T05:33:32.777+0100 [mongosMain] connection accepted from 172.28.0.164:56445 #1424529 (400 connections now open) 2015-10-05T05:33:32.778+0100 [conn1424528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:32.779+0100 [conn1424529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:36.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fda05703b51053eb948d 2015-10-05T05:33:36.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:37.986+0100 [conn1424093] end connection 172.28.0.164:55435 (399 connections now open) 2015-10-05T05:33:37.987+0100 [mongosMain] connection accepted from 172.28.0.164:56453 #1424530 (400 connections now open) 2015-10-05T05:33:37.989+0100 [conn1424530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:38.427+0100 [conn1424083] end connection 172.28.0.163:62350 (399 connections now open) 2015-10-05T05:33:38.428+0100 [mongosMain] connection accepted from 172.28.0.163:63391 #1424531 (400 connections now open) 2015-10-05T05:33:38.429+0100 [conn1424531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:38.486+0100 [conn1424127] end connection 172.28.0.164:55541 (399 connections now open) 2015-10-05T05:33:38.487+0100 [mongosMain] connection accepted from 172.28.0.164:56457 #1424532 (400 connections now open) 2015-10-05T05:33:38.489+0100 [conn1424532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:39.035+0100 [conn1424123] end connection 172.28.0.163:62469 (399 connections now open) 2015-10-05T05:33:39.036+0100 [mongosMain] connection accepted from 172.28.0.163:63393 #1424533 (400 connections now open) 2015-10-05T05:33:39.037+0100 [conn1424533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:39.277+0100 [mongosMain] connection accepted from 127.0.0.1:63395 #1424534 (401 connections now open) 2015-10-05T05:33:39.280+0100 [conn1424534] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:39.284+0100 [conn1424534] end connection 127.0.0.1:63395 (400 connections now open) 2015-10-05T05:33:40.626+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:33:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:33:42.514+0100 [conn1424006] end connection 172.28.0.163:62165 (399 connections now open) 2015-10-05T05:33:42.514+0100 [conn1424115] end connection 172.28.0.163:62422 (399 connections now open) 2015-10-05T05:33:42.515+0100 [mongosMain] connection accepted from 172.28.0.163:63399 #1424535 (399 connections now open) 2015-10-05T05:33:42.515+0100 [mongosMain] connection accepted from 172.28.0.163:63400 #1424536 (400 connections now open) 2015-10-05T05:33:42.516+0100 [conn1424535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:42.517+0100 [conn1424536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:42.792+0100 [conn1424111] end connection 172.28.0.164:55477 (399 connections now open) 2015-10-05T05:33:42.792+0100 [conn1424124] end connection 172.28.0.164:55530 (398 connections now open) 2015-10-05T05:33:42.793+0100 [mongosMain] connection accepted from 172.28.0.164:56469 #1424537 (399 connections now open) 2015-10-05T05:33:42.794+0100 [mongosMain] connection accepted from 172.28.0.164:56470 #1424538 (400 connections now open) 2015-10-05T05:33:42.795+0100 [conn1424537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:42.795+0100 [conn1424538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:48.004+0100 [conn1424100] end connection 172.28.0.164:55452 (399 connections now open) 2015-10-05T05:33:48.005+0100 [mongosMain] connection accepted from 172.28.0.164:56477 #1424539 (400 connections now open) 2015-10-05T05:33:48.007+0100 [conn1424539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:48.442+0100 [conn1424138] end connection 172.28.0.163:62487 (399 connections now open) 2015-10-05T05:33:48.443+0100 [mongosMain] connection accepted from 172.28.0.163:63409 #1424540 (400 connections now open) 2015-10-05T05:33:48.445+0100 [conn1424540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:48.502+0100 [conn1424137] end connection 172.28.0.164:55562 (399 connections now open) 2015-10-05T05:33:48.503+0100 [mongosMain] connection accepted from 172.28.0.164:56478 #1424541 (400 connections now open) 2015-10-05T05:33:48.505+0100 [conn1424541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:48.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdac5703b51053eb94cb 2015-10-05T05:33:48.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:49.035+0100 [conn1424129] end connection 172.28.0.163:62477 (399 connections now open) 2015-10-05T05:33:49.036+0100 [mongosMain] connection accepted from 172.28.0.163:63412 #1424542 (400 connections now open) 2015-10-05T05:33:49.037+0100 [conn1424542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:52.515+0100 [conn1424132] end connection 172.28.0.163:62482 (399 connections now open) 2015-10-05T05:33:52.517+0100 [mongosMain] connection accepted from 172.28.0.163:63417 #1424543 (400 connections now open) 2015-10-05T05:33:52.518+0100 [conn1424543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:52.792+0100 [conn1424135] end connection 172.28.0.164:55547 (399 connections now open) 2015-10-05T05:33:52.793+0100 [mongosMain] connection accepted from 172.28.0.164:56483 #1424544 (400 connections now open) 2015-10-05T05:33:52.795+0100 [conn1424544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:55.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdb25703b51053eb94e0 2015-10-05T05:33:55.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:33:58.018+0100 [conn1424136] end connection 172.28.0.164:55560 (399 connections now open) 2015-10-05T05:33:58.019+0100 [mongosMain] connection accepted from 172.28.0.164:56487 #1424545 (400 connections now open) 2015-10-05T05:33:58.021+0100 [conn1424545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:58.442+0100 [conn1424038] end connection 172.28.0.163:62255 (399 connections now open) 2015-10-05T05:33:58.444+0100 [mongosMain] connection accepted from 172.28.0.163:63426 #1424546 (400 connections now open) 2015-10-05T05:33:58.445+0100 [conn1424546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:58.517+0100 [conn1424146] end connection 172.28.0.164:55582 (399 connections now open) 2015-10-05T05:33:58.518+0100 [mongosMain] connection accepted from 172.28.0.164:56490 #1424547 (400 connections now open) 2015-10-05T05:33:58.520+0100 [conn1424547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:33:59.050+0100 [conn1424139] end connection 172.28.0.163:62490 (399 connections now open) 2015-10-05T05:33:59.050+0100 [mongosMain] connection accepted from 172.28.0.163:63429 #1424548 (400 connections now open) 2015-10-05T05:33:59.052+0100 [conn1424548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:02.530+0100 [conn1424141] end connection 172.28.0.163:62495 (399 connections now open) 2015-10-05T05:34:02.530+0100 [conn1424142] end connection 172.28.0.163:62496 (398 connections now open) 2015-10-05T05:34:02.531+0100 [mongosMain] connection accepted from 172.28.0.163:63438 #1424549 (399 connections now open) 2015-10-05T05:34:02.532+0100 [mongosMain] connection accepted from 172.28.0.163:63439 #1424550 (400 connections now open) 2015-10-05T05:34:02.533+0100 [conn1424549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:02.533+0100 [conn1424550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:02.808+0100 [conn1424121] end connection 172.28.0.164:55517 (399 connections now open) 2015-10-05T05:34:02.808+0100 [conn1424143] end connection 172.28.0.164:55572 (399 connections now open) 2015-10-05T05:34:02.809+0100 [mongosMain] connection accepted from 172.28.0.164:56497 #1424551 (399 connections now open) 2015-10-05T05:34:02.809+0100 [mongosMain] connection accepted from 172.28.0.164:56496 #1424552 (400 connections now open) 2015-10-05T05:34:02.810+0100 [conn1424551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:02.811+0100 [conn1424552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:07.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdbf5703b51053eb953c 2015-10-05T05:34:07.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:08.035+0100 [conn1424125] end connection 172.28.0.164:55538 (399 connections now open) 2015-10-05T05:34:08.036+0100 [mongosMain] connection accepted from 172.28.0.164:56500 #1424553 (400 connections now open) 2015-10-05T05:34:08.037+0100 [conn1424553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:08.457+0100 [conn1424128] end connection 172.28.0.163:62475 (399 connections now open) 2015-10-05T05:34:08.458+0100 [mongosMain] connection accepted from 172.28.0.163:63448 #1424554 (400 connections now open) 2015-10-05T05:34:08.459+0100 [conn1424554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:08.533+0100 [conn1424152] end connection 172.28.0.164:55596 (399 connections now open) 2015-10-05T05:34:08.534+0100 [mongosMain] connection accepted from 172.28.0.164:56502 #1424555 (400 connections now open) 2015-10-05T05:34:08.536+0100 [conn1424555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:09.049+0100 [conn1424154] end connection 172.28.0.163:62525 (399 connections now open) 2015-10-05T05:34:09.050+0100 [mongosMain] connection accepted from 172.28.0.163:63451 #1424556 (400 connections now open) 2015-10-05T05:34:09.051+0100 [conn1424556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:10.927+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:34:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:34:12.546+0100 [conn1424133] end connection 172.28.0.163:62483 (399 connections now open) 2015-10-05T05:34:12.547+0100 [conn1424156] end connection 172.28.0.163:62534 (398 connections now open) 2015-10-05T05:34:12.550+0100 [mongosMain] connection accepted from 172.28.0.163:63457 #1424557 (399 connections now open) 2015-10-05T05:34:12.551+0100 [mongosMain] connection accepted from 172.28.0.163:63458 #1424558 (400 connections now open) 2015-10-05T05:34:12.552+0100 [conn1424557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:12.552+0100 [conn1424558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:12.808+0100 [conn1424157] end connection 172.28.0.164:55602 (399 connections now open) 2015-10-05T05:34:12.810+0100 [mongosMain] connection accepted from 172.28.0.164:56505 #1424559 (400 connections now open) 2015-10-05T05:34:12.811+0100 [conn1424559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:13.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdc55703b51053eb9560 2015-10-05T05:34:13.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:18.050+0100 [conn1424112] end connection 172.28.0.164:55482 (399 connections now open) 2015-10-05T05:34:18.051+0100 [mongosMain] connection accepted from 172.28.0.164:56510 #1424560 (400 connections now open) 2015-10-05T05:34:18.053+0100 [conn1424560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:18.458+0100 [conn1424102] end connection 172.28.0.163:62379 (399 connections now open) 2015-10-05T05:34:18.459+0100 [mongosMain] connection accepted from 172.28.0.163:63464 #1424561 (400 connections now open) 2015-10-05T05:34:18.460+0100 [conn1424561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:18.549+0100 [conn1424160] end connection 172.28.0.164:55608 (399 connections now open) 2015-10-05T05:34:18.550+0100 [mongosMain] connection accepted from 172.28.0.164:56512 #1424562 (400 connections now open) 2015-10-05T05:34:18.551+0100 [conn1424562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:19.066+0100 [conn1424162] end connection 172.28.0.163:62555 (399 connections now open) 2015-10-05T05:34:19.068+0100 [mongosMain] connection accepted from 172.28.0.163:63466 #1424563 (400 connections now open) 2015-10-05T05:34:19.069+0100 [conn1424563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:20.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdcb5703b51053eb9583 2015-10-05T05:34:20.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:22.547+0100 [conn1424164] end connection 172.28.0.163:62567 (399 connections now open) 2015-10-05T05:34:22.547+0100 [conn1424028] end connection 172.28.0.163:62221 (398 connections now open) 2015-10-05T05:34:22.548+0100 [mongosMain] connection accepted from 172.28.0.163:63472 #1424564 (399 connections now open) 2015-10-05T05:34:22.549+0100 [mongosMain] connection accepted from 172.28.0.163:63473 #1424565 (400 connections now open) 2015-10-05T05:34:22.550+0100 [conn1424564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:22.550+0100 [conn1424565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:22.823+0100 [conn1424158] end connection 172.28.0.164:55603 (399 connections now open) 2015-10-05T05:34:22.824+0100 [conn1424149] end connection 172.28.0.164:55588 (398 connections now open) 2015-10-05T05:34:22.825+0100 [mongosMain] connection accepted from 172.28.0.164:56520 #1424566 (400 connections now open) 2015-10-05T05:34:22.825+0100 [mongosMain] connection accepted from 172.28.0.164:56521 #1424567 (400 connections now open) 2015-10-05T05:34:22.827+0100 [conn1424566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:22.827+0100 [conn1424567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:26.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdd25703b51053eb95a3 2015-10-05T05:34:27.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:28.065+0100 [conn1424043] end connection 172.28.0.164:55324 (399 connections now open) 2015-10-05T05:34:28.066+0100 [mongosMain] connection accepted from 172.28.0.164:56530 #1424568 (400 connections now open) 2015-10-05T05:34:28.068+0100 [conn1424568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:28.473+0100 [conn1424153] end connection 172.28.0.163:62523 (399 connections now open) 2015-10-05T05:34:28.474+0100 [mongosMain] connection accepted from 172.28.0.163:63476 #1424569 (400 connections now open) 2015-10-05T05:34:28.476+0100 [conn1424569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:28.510+0100 [mongosMain] connection accepted from 127.0.0.1:63478 #1424570 (401 connections now open) 2015-10-05T05:34:28.512+0100 [conn1424570] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:28.517+0100 [conn1424570] end connection 127.0.0.1:63478 (400 connections now open) 2015-10-05T05:34:28.564+0100 [conn1424168] end connection 172.28.0.164:55618 (399 connections now open) 2015-10-05T05:34:28.565+0100 [mongosMain] connection accepted from 172.28.0.164:56533 #1424571 (400 connections now open) 2015-10-05T05:34:28.566+0100 [conn1424571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:29.066+0100 [conn1424170] end connection 172.28.0.163:62577 (399 connections now open) 2015-10-05T05:34:29.067+0100 [mongosMain] connection accepted from 172.28.0.163:63479 #1424572 (400 connections now open) 2015-10-05T05:34:29.068+0100 [conn1424572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:32.561+0100 [conn1424148] end connection 172.28.0.163:62513 (399 connections now open) 2015-10-05T05:34:32.562+0100 [conn1424147] end connection 172.28.0.163:62512 (398 connections now open) 2015-10-05T05:34:32.563+0100 [mongosMain] connection accepted from 172.28.0.163:63482 #1424573 (399 connections now open) 2015-10-05T05:34:32.564+0100 [mongosMain] connection accepted from 172.28.0.163:63485 #1424574 (400 connections now open) 2015-10-05T05:34:32.565+0100 [conn1424573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:32.565+0100 [conn1424574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:32.824+0100 [conn1424165] end connection 172.28.0.164:55611 (399 connections now open) 2015-10-05T05:34:32.824+0100 [conn1424150] end connection 172.28.0.164:55589 (399 connections now open) 2015-10-05T05:34:32.825+0100 [mongosMain] connection accepted from 172.28.0.164:56540 #1424575 (399 connections now open) 2015-10-05T05:34:32.825+0100 [mongosMain] connection accepted from 172.28.0.164:56541 #1424576 (400 connections now open) 2015-10-05T05:34:32.826+0100 [conn1424575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:32.826+0100 [conn1424576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:33.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdd95703b51053eb95cb 2015-10-05T05:34:33.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:38.066+0100 [conn1424167] end connection 172.28.0.164:55616 (399 connections now open) 2015-10-05T05:34:38.070+0100 [mongosMain] connection accepted from 172.28.0.164:56550 #1424577 (400 connections now open) 2015-10-05T05:34:38.071+0100 [conn1424577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:38.489+0100 [conn1424161] end connection 172.28.0.163:62547 (399 connections now open) 2015-10-05T05:34:38.490+0100 [mongosMain] connection accepted from 172.28.0.163:63487 #1424578 (400 connections now open) 2015-10-05T05:34:38.492+0100 [conn1424578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:38.581+0100 [conn1424176] end connection 172.28.0.164:55640 (399 connections now open) 2015-10-05T05:34:38.582+0100 [mongosMain] connection accepted from 172.28.0.164:56552 #1424579 (400 connections now open) 2015-10-05T05:34:38.583+0100 [conn1424579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:39.082+0100 [conn1424179] end connection 172.28.0.163:62588 (399 connections now open) 2015-10-05T05:34:39.083+0100 [mongosMain] connection accepted from 172.28.0.163:63489 #1424580 (400 connections now open) 2015-10-05T05:34:39.084+0100 [conn1424580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:39.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fddf5703b51053eb95f9 2015-10-05T05:34:39.918+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:40.040+0100 [mongosMain] connection accepted from 127.0.0.1:63491 #1424581 (401 connections now open) 2015-10-05T05:34:40.042+0100 [conn1424581] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:40.046+0100 [conn1424581] end connection 127.0.0.1:63491 (400 connections now open) 2015-10-05T05:34:41.214+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:34:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:34:42.564+0100 [conn1424171] end connection 172.28.0.163:62580 (399 connections now open) 2015-10-05T05:34:42.564+0100 [conn1424155] end connection 172.28.0.163:62533 (399 connections now open) 2015-10-05T05:34:42.565+0100 [mongosMain] connection accepted from 172.28.0.163:63495 #1424582 (399 connections now open) 2015-10-05T05:34:42.566+0100 [mongosMain] connection accepted from 172.28.0.163:63496 #1424583 (400 connections now open) 2015-10-05T05:34:42.566+0100 [conn1424582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:42.567+0100 [conn1424583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:42.840+0100 [conn1424173] end connection 172.28.0.164:55627 (399 connections now open) 2015-10-05T05:34:42.840+0100 [conn1424134] end connection 172.28.0.164:55549 (399 connections now open) 2015-10-05T05:34:42.842+0100 [mongosMain] connection accepted from 172.28.0.164:56565 #1424584 (399 connections now open) 2015-10-05T05:34:42.842+0100 [mongosMain] connection accepted from 172.28.0.164:56566 #1424585 (400 connections now open) 2015-10-05T05:34:42.844+0100 [conn1424584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:42.844+0100 [conn1424585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:46.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fde55703b51053eb9637 2015-10-05T05:34:46.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:48.066+0100 [conn1424175] end connection 172.28.0.164:55637 (399 connections now open) 2015-10-05T05:34:48.067+0100 [mongosMain] connection accepted from 172.28.0.164:56573 #1424586 (400 connections now open) 2015-10-05T05:34:48.069+0100 [conn1424586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:48.490+0100 [conn1424089] end connection 172.28.0.163:62365 (399 connections now open) 2015-10-05T05:34:48.491+0100 [mongosMain] connection accepted from 172.28.0.163:63504 #1424587 (400 connections now open) 2015-10-05T05:34:48.492+0100 [conn1424587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:48.595+0100 [conn1424185] end connection 172.28.0.164:55661 (399 connections now open) 2015-10-05T05:34:48.596+0100 [mongosMain] connection accepted from 172.28.0.164:56575 #1424588 (400 connections now open) 2015-10-05T05:34:48.598+0100 [conn1424588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:49.097+0100 [conn1424187] end connection 172.28.0.163:62597 (399 connections now open) 2015-10-05T05:34:49.098+0100 [mongosMain] connection accepted from 172.28.0.163:63506 #1424589 (400 connections now open) 2015-10-05T05:34:49.099+0100 [conn1424589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:52.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdec5703b51053eb9658 2015-10-05T05:34:52.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:52.578+0100 [conn1424172] end connection 172.28.0.163:62581 (399 connections now open) 2015-10-05T05:34:52.578+0100 [conn1424181] end connection 172.28.0.163:62591 (399 connections now open) 2015-10-05T05:34:52.579+0100 [mongosMain] connection accepted from 172.28.0.163:63511 #1424590 (399 connections now open) 2015-10-05T05:34:52.579+0100 [mongosMain] connection accepted from 172.28.0.163:63510 #1424591 (400 connections now open) 2015-10-05T05:34:52.580+0100 [conn1424590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:52.580+0100 [conn1424591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:52.855+0100 [conn1424191] end connection 172.28.0.164:55668 (399 connections now open) 2015-10-05T05:34:52.860+0100 [mongosMain] connection accepted from 172.28.0.164:56582 #1424592 (400 connections now open) 2015-10-05T05:34:52.861+0100 [conn1424174] end connection 172.28.0.164:55628 (399 connections now open) 2015-10-05T05:34:52.862+0100 [conn1424592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:52.862+0100 [mongosMain] connection accepted from 172.28.0.164:56584 #1424593 (400 connections now open) 2015-10-05T05:34:52.863+0100 [conn1424593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:58.082+0100 [conn1424159] end connection 172.28.0.164:55606 (399 connections now open) 2015-10-05T05:34:58.083+0100 [mongosMain] connection accepted from 172.28.0.164:56591 #1424594 (400 connections now open) 2015-10-05T05:34:58.085+0100 [conn1424594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:58.505+0100 [conn1424169] end connection 172.28.0.163:62575 (399 connections now open) 2015-10-05T05:34:58.506+0100 [mongosMain] connection accepted from 172.28.0.163:63520 #1424595 (400 connections now open) 2015-10-05T05:34:58.507+0100 [conn1424595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:58.611+0100 [conn1424194] end connection 172.28.0.164:55682 (399 connections now open) 2015-10-05T05:34:58.612+0100 [mongosMain] connection accepted from 172.28.0.164:56593 #1424596 (400 connections now open) 2015-10-05T05:34:58.614+0100 [conn1424596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:34:58.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdf25703b51053eb967a 2015-10-05T05:34:58.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:34:59.098+0100 [conn1424196] end connection 172.28.0.163:62618 (399 connections now open) 2015-10-05T05:34:59.099+0100 [mongosMain] connection accepted from 172.28.0.163:63523 #1424597 (400 connections now open) 2015-10-05T05:34:59.100+0100 [conn1424597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:02.580+0100 [conn1424106] end connection 172.28.0.163:62386 (399 connections now open) 2015-10-05T05:35:02.580+0100 [conn1424190] end connection 172.28.0.163:62604 (398 connections now open) 2015-10-05T05:35:02.581+0100 [mongosMain] connection accepted from 172.28.0.163:63533 #1424598 (399 connections now open) 2015-10-05T05:35:02.582+0100 [mongosMain] connection accepted from 172.28.0.163:63534 #1424599 (400 connections now open) 2015-10-05T05:35:02.583+0100 [conn1424598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:02.583+0100 [conn1424599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:02.855+0100 [conn1424200] end connection 172.28.0.164:55690 (399 connections now open) 2015-10-05T05:35:02.856+0100 [conn1424144] end connection 172.28.0.164:55573 (398 connections now open) 2015-10-05T05:35:02.858+0100 [mongosMain] connection accepted from 172.28.0.164:56600 #1424600 (399 connections now open) 2015-10-05T05:35:02.859+0100 [mongosMain] connection accepted from 172.28.0.164:56601 #1424601 (400 connections now open) 2015-10-05T05:35:02.860+0100 [conn1424600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:02.861+0100 [conn1424601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:05.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdf85703b51053eb96ad 2015-10-05T05:35:05.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:08.097+0100 [conn1424145] end connection 172.28.0.164:55581 (399 connections now open) 2015-10-05T05:35:08.098+0100 [mongosMain] connection accepted from 172.28.0.164:56603 #1424602 (400 connections now open) 2015-10-05T05:35:08.099+0100 [conn1424602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:08.506+0100 [conn1424186] end connection 172.28.0.163:62595 (399 connections now open) 2015-10-05T05:35:08.507+0100 [mongosMain] connection accepted from 172.28.0.163:63546 #1424603 (400 connections now open) 2015-10-05T05:35:08.508+0100 [conn1424603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:08.611+0100 [conn1424202] end connection 172.28.0.164:55698 (399 connections now open) 2015-10-05T05:35:08.613+0100 [mongosMain] connection accepted from 172.28.0.164:56605 #1424604 (400 connections now open) 2015-10-05T05:35:08.615+0100 [conn1424604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:09.113+0100 [conn1424204] end connection 172.28.0.163:62637 (399 connections now open) 2015-10-05T05:35:09.114+0100 [mongosMain] connection accepted from 172.28.0.163:63548 #1424605 (400 connections now open) 2015-10-05T05:35:09.116+0100 [conn1424605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:11.359+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:35:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:35:11.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fdff5703b51053eb96d7 2015-10-05T05:35:11.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:12.594+0100 [conn1424206] end connection 172.28.0.163:62646 (399 connections now open) 2015-10-05T05:35:12.594+0100 [conn1424180] end connection 172.28.0.163:62589 (398 connections now open) 2015-10-05T05:35:12.595+0100 [mongosMain] connection accepted from 172.28.0.163:63551 #1424606 (399 connections now open) 2015-10-05T05:35:12.596+0100 [mongosMain] connection accepted from 172.28.0.163:63552 #1424607 (400 connections now open) 2015-10-05T05:35:12.597+0100 [conn1424606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:12.597+0100 [conn1424607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:12.871+0100 [conn1424182] end connection 172.28.0.164:55648 (399 connections now open) 2015-10-05T05:35:12.872+0100 [conn1424183] end connection 172.28.0.164:55649 (398 connections now open) 2015-10-05T05:35:12.872+0100 [mongosMain] connection accepted from 172.28.0.164:56609 #1424608 (399 connections now open) 2015-10-05T05:35:12.873+0100 [mongosMain] connection accepted from 172.28.0.164:56610 #1424609 (400 connections now open) 2015-10-05T05:35:12.875+0100 [conn1424608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:12.875+0100 [conn1424609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:17.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe055703b51053eb9708 2015-10-05T05:35:17.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:18.097+0100 [conn1424184] end connection 172.28.0.164:55658 (399 connections now open) 2015-10-05T05:35:18.097+0100 [mongosMain] connection accepted from 172.28.0.164:56614 #1424610 (400 connections now open) 2015-10-05T05:35:18.099+0100 [conn1424610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:18.520+0100 [conn1424177] end connection 172.28.0.163:62584 (399 connections now open) 2015-10-05T05:35:18.521+0100 [mongosMain] connection accepted from 172.28.0.163:63561 #1424611 (400 connections now open) 2015-10-05T05:35:18.522+0100 [conn1424611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:18.627+0100 [conn1424209] end connection 172.28.0.164:55711 (399 connections now open) 2015-10-05T05:35:18.628+0100 [mongosMain] connection accepted from 172.28.0.164:56616 #1424612 (400 connections now open) 2015-10-05T05:35:18.631+0100 [conn1424612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:19.113+0100 [conn1424211] end connection 172.28.0.163:62658 (399 connections now open) 2015-10-05T05:35:19.114+0100 [mongosMain] connection accepted from 172.28.0.163:63563 #1424613 (400 connections now open) 2015-10-05T05:35:19.115+0100 [conn1424613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:22.595+0100 [conn1424163] end connection 172.28.0.163:62566 (399 connections now open) 2015-10-05T05:35:22.599+0100 [mongosMain] connection accepted from 172.28.0.163:63568 #1424614 (400 connections now open) 2015-10-05T05:35:22.600+0100 [conn1424614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:22.887+0100 [conn1424208] end connection 172.28.0.164:55708 (399 connections now open) 2015-10-05T05:35:22.887+0100 [conn1424207] end connection 172.28.0.164:55707 (399 connections now open) 2015-10-05T05:35:22.888+0100 [mongosMain] connection accepted from 172.28.0.164:56626 #1424615 (399 connections now open) 2015-10-05T05:35:22.888+0100 [mongosMain] connection accepted from 172.28.0.164:56627 #1424616 (400 connections now open) 2015-10-05T05:35:22.890+0100 [conn1424615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:22.890+0100 [conn1424616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:24.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe0b5703b51053eb9729 2015-10-05T05:35:24.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:28.112+0100 [conn1424151] end connection 172.28.0.164:55594 (399 connections now open) 2015-10-05T05:35:28.113+0100 [mongosMain] connection accepted from 172.28.0.164:56634 #1424617 (400 connections now open) 2015-10-05T05:35:28.115+0100 [conn1424617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:28.432+0100 [mongosMain] connection accepted from 127.0.0.1:63569 #1424618 (401 connections now open) 2015-10-05T05:35:28.435+0100 [conn1424618] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:28.440+0100 [conn1424618] end connection 127.0.0.1:63569 (400 connections now open) 2015-10-05T05:35:28.521+0100 [conn1424195] end connection 172.28.0.163:62616 (399 connections now open) 2015-10-05T05:35:28.522+0100 [mongosMain] connection accepted from 172.28.0.163:63570 #1424619 (400 connections now open) 2015-10-05T05:35:28.523+0100 [conn1424619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:28.643+0100 [conn1424216] end connection 172.28.0.164:55721 (399 connections now open) 2015-10-05T05:35:28.644+0100 [mongosMain] connection accepted from 172.28.0.164:56636 #1424620 (400 connections now open) 2015-10-05T05:35:28.645+0100 [conn1424620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:29.129+0100 [conn1424218] end connection 172.28.0.163:62674 (399 connections now open) 2015-10-05T05:35:29.130+0100 [mongosMain] connection accepted from 172.28.0.163:63575 #1424621 (400 connections now open) 2015-10-05T05:35:29.131+0100 [conn1424621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:30.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe125703b51053eb974d 2015-10-05T05:35:30.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:32.609+0100 [conn1424220] end connection 172.28.0.163:62681 (399 connections now open) 2015-10-05T05:35:32.609+0100 [conn1424189] end connection 172.28.0.163:62603 (399 connections now open) 2015-10-05T05:35:32.611+0100 [mongosMain] connection accepted from 172.28.0.163:63579 #1424622 (399 connections now open) 2015-10-05T05:35:32.611+0100 [mongosMain] connection accepted from 172.28.0.163:63580 #1424623 (400 connections now open) 2015-10-05T05:35:32.612+0100 [conn1424622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:32.612+0100 [conn1424623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:32.903+0100 [conn1424192] end connection 172.28.0.164:55669 (399 connections now open) 2015-10-05T05:35:32.903+0100 [conn1424214] end connection 172.28.0.164:55716 (398 connections now open) 2015-10-05T05:35:32.904+0100 [mongosMain] connection accepted from 172.28.0.164:56645 #1424624 (399 connections now open) 2015-10-05T05:35:32.904+0100 [mongosMain] connection accepted from 172.28.0.164:56646 #1424625 (400 connections now open) 2015-10-05T05:35:32.905+0100 [conn1424624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:32.906+0100 [conn1424625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:36.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe185703b51053eb9768 2015-10-05T05:35:36.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:38.129+0100 [conn1424193] end connection 172.28.0.164:55680 (399 connections now open) 2015-10-05T05:35:38.130+0100 [mongosMain] connection accepted from 172.28.0.164:56654 #1424626 (400 connections now open) 2015-10-05T05:35:38.132+0100 [conn1424626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:38.659+0100 [conn1424224] end connection 172.28.0.164:55742 (399 connections now open) 2015-10-05T05:35:38.660+0100 [mongosMain] connection accepted from 172.28.0.164:56656 #1424627 (400 connections now open) 2015-10-05T05:35:38.662+0100 [conn1424627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:39.129+0100 [conn1424226] end connection 172.28.0.163:62685 (399 connections now open) 2015-10-05T05:35:39.131+0100 [mongosMain] connection accepted from 172.28.0.163:63585 #1424628 (400 connections now open) 2015-10-05T05:35:39.132+0100 [conn1424628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:39.311+0100 [mongosMain] connection accepted from 127.0.0.1:63587 #1424629 (401 connections now open) 2015-10-05T05:35:39.314+0100 [conn1424629] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:39.319+0100 [conn1424629] end connection 127.0.0.1:63587 (400 connections now open) 2015-10-05T05:35:41.525+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:35:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:35:42.624+0100 [conn1424198] end connection 172.28.0.163:62624 (399 connections now open) 2015-10-05T05:35:42.624+0100 [conn1424212] end connection 172.28.0.163:62662 (398 connections now open) 2015-10-05T05:35:42.626+0100 [mongosMain] connection accepted from 172.28.0.163:63593 #1424630 (399 connections now open) 2015-10-05T05:35:42.626+0100 [mongosMain] connection accepted from 172.28.0.163:63594 #1424631 (400 connections now open) 2015-10-05T05:35:42.628+0100 [conn1424631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:42.628+0100 [conn1424630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:42.918+0100 [conn1424199] end connection 172.28.0.164:55689 (399 connections now open) 2015-10-05T05:35:42.919+0100 [conn1424221] end connection 172.28.0.164:55730 (398 connections now open) 2015-10-05T05:35:42.920+0100 [mongosMain] connection accepted from 172.28.0.164:56664 #1424632 (399 connections now open) 2015-10-05T05:35:42.920+0100 [mongosMain] connection accepted from 172.28.0.164:56665 #1424633 (400 connections now open) 2015-10-05T05:35:42.921+0100 [conn1424632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:42.922+0100 [conn1424633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:43.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe1e5703b51053eb9790 2015-10-05T05:35:43.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:48.552+0100 [conn1424210] end connection 172.28.0.163:62656 (399 connections now open) 2015-10-05T05:35:48.554+0100 [mongosMain] connection accepted from 172.28.0.163:63603 #1424634 (400 connections now open) 2015-10-05T05:35:48.555+0100 [conn1424634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:48.676+0100 [conn1424233] end connection 172.28.0.164:55760 (399 connections now open) 2015-10-05T05:35:48.677+0100 [mongosMain] connection accepted from 172.28.0.164:56675 #1424635 (400 connections now open) 2015-10-05T05:35:48.679+0100 [conn1424635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:49.145+0100 [conn1424234] end connection 172.28.0.163:62699 (399 connections now open) 2015-10-05T05:35:49.146+0100 [mongosMain] connection accepted from 172.28.0.163:63606 #1424636 (400 connections now open) 2015-10-05T05:35:49.147+0100 [conn1424636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:49.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe255703b51053eb97ae 2015-10-05T05:35:49.524+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:52.625+0100 [conn1424228] end connection 172.28.0.163:62690 (399 connections now open) 2015-10-05T05:35:52.626+0100 [conn1424219] end connection 172.28.0.163:62679 (398 connections now open) 2015-10-05T05:35:52.626+0100 [mongosMain] connection accepted from 172.28.0.163:63611 #1424637 (399 connections now open) 2015-10-05T05:35:52.626+0100 [mongosMain] connection accepted from 172.28.0.163:63612 #1424638 (400 connections now open) 2015-10-05T05:35:52.627+0100 [conn1424637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:52.627+0100 [conn1424638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:52.933+0100 [conn1424238] end connection 172.28.0.164:55767 (399 connections now open) 2015-10-05T05:35:52.934+0100 [conn1423945] end connection 172.28.0.164:55040 (398 connections now open) 2015-10-05T05:35:52.934+0100 [mongosMain] connection accepted from 172.28.0.164:56681 #1424639 (399 connections now open) 2015-10-05T05:35:52.935+0100 [mongosMain] connection accepted from 172.28.0.164:56682 #1424640 (400 connections now open) 2015-10-05T05:35:52.936+0100 [conn1424639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:52.937+0100 [conn1424640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:55.812+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe2b5703b51053eb97c9 2015-10-05T05:35:55.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:35:58.160+0100 [conn1424240] end connection 172.28.0.164:55775 (399 connections now open) 2015-10-05T05:35:58.165+0100 [mongosMain] connection accepted from 172.28.0.164:56687 #1424641 (400 connections now open) 2015-10-05T05:35:58.167+0100 [conn1424641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:58.555+0100 [conn1424225] end connection 172.28.0.163:62682 (399 connections now open) 2015-10-05T05:35:58.556+0100 [mongosMain] connection accepted from 172.28.0.163:63621 #1424642 (400 connections now open) 2015-10-05T05:35:58.557+0100 [conn1424642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:58.690+0100 [conn1424241] end connection 172.28.0.164:55778 (399 connections now open) 2015-10-05T05:35:58.691+0100 [mongosMain] connection accepted from 172.28.0.164:56689 #1424643 (400 connections now open) 2015-10-05T05:35:58.693+0100 [conn1424643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:35:59.148+0100 [conn1424243] end connection 172.28.0.163:62718 (399 connections now open) 2015-10-05T05:35:59.149+0100 [mongosMain] connection accepted from 172.28.0.163:63624 #1424644 (400 connections now open) 2015-10-05T05:35:59.151+0100 [conn1424644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:02.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe315703b51053eb97e3 2015-10-05T05:36:02.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:02.640+0100 [conn1424244] end connection 172.28.0.163:62723 (399 connections now open) 2015-10-05T05:36:02.640+0100 [conn1424229] end connection 172.28.0.163:62695 (399 connections now open) 2015-10-05T05:36:02.642+0100 [mongosMain] connection accepted from 172.28.0.163:63633 #1424645 (399 connections now open) 2015-10-05T05:36:02.643+0100 [mongosMain] connection accepted from 172.28.0.163:63635 #1424646 (400 connections now open) 2015-10-05T05:36:02.643+0100 [conn1424645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:02.643+0100 [conn1424646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:02.950+0100 [conn1424230] end connection 172.28.0.164:55748 (399 connections now open) 2015-10-05T05:36:02.950+0100 [conn1424213] end connection 172.28.0.164:55715 (398 connections now open) 2015-10-05T05:36:02.951+0100 [mongosMain] connection accepted from 172.28.0.164:56694 #1424647 (399 connections now open) 2015-10-05T05:36:02.952+0100 [mongosMain] connection accepted from 172.28.0.164:56695 #1424648 (400 connections now open) 2015-10-05T05:36:02.954+0100 [conn1424647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:02.954+0100 [conn1424648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:08.175+0100 [conn1424232] end connection 172.28.0.164:55758 (399 connections now open) 2015-10-05T05:36:08.177+0100 [mongosMain] connection accepted from 172.28.0.164:56698 #1424649 (400 connections now open) 2015-10-05T05:36:08.179+0100 [conn1424649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:08.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe385703b51053eb9825 2015-10-05T05:36:08.584+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:08.691+0100 [conn1424249] end connection 172.28.0.164:55792 (399 connections now open) 2015-10-05T05:36:08.692+0100 [mongosMain] connection accepted from 172.28.0.164:56700 #1424650 (400 connections now open) 2015-10-05T05:36:08.694+0100 [conn1424650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:09.161+0100 [conn1424251] end connection 172.28.0.163:62735 (399 connections now open) 2015-10-05T05:36:09.162+0100 [mongosMain] connection accepted from 172.28.0.163:63644 #1424651 (400 connections now open) 2015-10-05T05:36:09.163+0100 [conn1424651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:11.659+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:36:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:36:12.642+0100 [conn1424237] end connection 172.28.0.163:62705 (399 connections now open) 2015-10-05T05:36:12.642+0100 [conn1424205] end connection 172.28.0.163:62645 (399 connections now open) 2015-10-05T05:36:12.644+0100 [mongosMain] connection accepted from 172.28.0.163:63648 #1424652 (399 connections now open) 2015-10-05T05:36:12.644+0100 [mongosMain] connection accepted from 172.28.0.163:63649 #1424653 (400 connections now open) 2015-10-05T05:36:12.645+0100 [conn1424652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:12.645+0100 [conn1424653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:12.965+0100 [conn1424222] end connection 172.28.0.164:55731 (399 connections now open) 2015-10-05T05:36:12.965+0100 [conn1424254] end connection 172.28.0.164:55798 (398 connections now open) 2015-10-05T05:36:12.966+0100 [mongosMain] connection accepted from 172.28.0.164:56704 #1424654 (399 connections now open) 2015-10-05T05:36:12.966+0100 [mongosMain] connection accepted from 172.28.0.164:56705 #1424655 (400 connections now open) 2015-10-05T05:36:12.967+0100 [conn1424654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:12.968+0100 [conn1424655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:14.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe3e5703b51053eb9856 2015-10-05T05:36:14.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:18.191+0100 [conn1424223] end connection 172.28.0.164:55739 (399 connections now open) 2015-10-05T05:36:18.192+0100 [mongosMain] connection accepted from 172.28.0.164:56709 #1424656 (400 connections now open) 2015-10-05T05:36:18.193+0100 [conn1424656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:18.690+0100 [conn1424256] end connection 172.28.0.164:55804 (399 connections now open) 2015-10-05T05:36:18.691+0100 [mongosMain] connection accepted from 172.28.0.164:56711 #1424657 (400 connections now open) 2015-10-05T05:36:18.693+0100 [conn1424657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:19.176+0100 [conn1424258] end connection 172.28.0.163:62755 (399 connections now open) 2015-10-05T05:36:19.177+0100 [mongosMain] connection accepted from 172.28.0.163:63655 #1424658 (400 connections now open) 2015-10-05T05:36:19.178+0100 [conn1424658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:21.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe445703b51053eb988a 2015-10-05T05:36:21.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:22.657+0100 [conn1424252] end connection 172.28.0.163:62743 (399 connections now open) 2015-10-05T05:36:22.658+0100 [conn1424197] end connection 172.28.0.163:62623 (398 connections now open) 2015-10-05T05:36:22.659+0100 [mongosMain] connection accepted from 172.28.0.163:63661 #1424659 (399 connections now open) 2015-10-05T05:36:22.662+0100 [conn1424659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:22.663+0100 [mongosMain] connection accepted from 172.28.0.163:63663 #1424660 (400 connections now open) 2015-10-05T05:36:22.664+0100 [conn1424660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:22.980+0100 [conn1424261] end connection 172.28.0.164:55808 (399 connections now open) 2015-10-05T05:36:22.981+0100 [conn1424255] end connection 172.28.0.164:55799 (398 connections now open) 2015-10-05T05:36:22.982+0100 [mongosMain] connection accepted from 172.28.0.164:56720 #1424661 (399 connections now open) 2015-10-05T05:36:22.983+0100 [mongosMain] connection accepted from 172.28.0.164:56721 #1424662 (400 connections now open) 2015-10-05T05:36:22.984+0100 [conn1424661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:22.984+0100 [conn1424662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:27.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe4b5703b51053eb98ca 2015-10-05T05:36:27.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:28.207+0100 [conn1424215] end connection 172.28.0.164:55719 (399 connections now open) 2015-10-05T05:36:28.208+0100 [mongosMain] connection accepted from 172.28.0.164:56729 #1424663 (400 connections now open) 2015-10-05T05:36:28.210+0100 [conn1424663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:28.277+0100 [mongosMain] connection accepted from 127.0.0.1:63664 #1424664 (401 connections now open) 2015-10-05T05:36:28.280+0100 [conn1424664] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:28.285+0100 [conn1424664] end connection 127.0.0.1:63664 (400 connections now open) 2015-10-05T05:36:28.706+0100 [conn1424264] end connection 172.28.0.164:55815 (399 connections now open) 2015-10-05T05:36:28.707+0100 [mongosMain] connection accepted from 172.28.0.164:56731 #1424665 (400 connections now open) 2015-10-05T05:36:28.708+0100 [conn1424665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:29.177+0100 [conn1424266] end connection 172.28.0.163:62769 (399 connections now open) 2015-10-05T05:36:29.179+0100 [mongosMain] connection accepted from 172.28.0.163:63666 #1424666 (400 connections now open) 2015-10-05T05:36:29.180+0100 [conn1424666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:32.660+0100 [conn1424236] end connection 172.28.0.163:62704 (399 connections now open) 2015-10-05T05:36:32.660+0100 [conn1424259] end connection 172.28.0.163:62758 (398 connections now open) 2015-10-05T05:36:32.661+0100 [mongosMain] connection accepted from 172.28.0.163:63668 #1424667 (399 connections now open) 2015-10-05T05:36:32.662+0100 [mongosMain] connection accepted from 172.28.0.163:63669 #1424668 (400 connections now open) 2015-10-05T05:36:32.663+0100 [conn1424667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:32.664+0100 [conn1424668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:32.997+0100 [conn1424246] end connection 172.28.0.164:55783 (399 connections now open) 2015-10-05T05:36:32.997+0100 [conn1424166] end connection 172.28.0.164:55612 (398 connections now open) 2015-10-05T05:36:32.998+0100 [mongosMain] connection accepted from 172.28.0.164:56738 #1424669 (399 connections now open) 2015-10-05T05:36:32.999+0100 [mongosMain] connection accepted from 172.28.0.164:56739 #1424670 (400 connections now open) 2015-10-05T05:36:33.000+0100 [conn1424669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:33.000+0100 [conn1424670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:33.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe515703b51053eb98f7 2015-10-05T05:36:33.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:38.222+0100 [conn1424248] end connection 172.28.0.164:55790 (399 connections now open) 2015-10-05T05:36:38.224+0100 [mongosMain] connection accepted from 172.28.0.164:56749 #1424671 (400 connections now open) 2015-10-05T05:36:38.225+0100 [conn1424671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:38.722+0100 [conn1424272] end connection 172.28.0.164:55836 (399 connections now open) 2015-10-05T05:36:38.723+0100 [mongosMain] connection accepted from 172.28.0.164:56753 #1424672 (400 connections now open) 2015-10-05T05:36:38.725+0100 [conn1424672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:39.192+0100 [conn1424275] end connection 172.28.0.163:62780 (399 connections now open) 2015-10-05T05:36:39.193+0100 [mongosMain] connection accepted from 172.28.0.163:63672 #1424673 (400 connections now open) 2015-10-05T05:36:39.194+0100 [conn1424673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:39.983+0100 [mongosMain] connection accepted from 127.0.0.1:63674 #1424674 (401 connections now open) 2015-10-05T05:36:39.985+0100 [conn1424674] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:39.990+0100 [conn1424674] end connection 127.0.0.1:63674 (400 connections now open) 2015-10-05T05:36:40.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe575703b51053eb9937 2015-10-05T05:36:40.144+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:41.920+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:36:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:36:42.672+0100 [conn1424276] end connection 172.28.0.163:62782 (399 connections now open) 2015-10-05T05:36:42.673+0100 [mongosMain] connection accepted from 172.28.0.163:63679 #1424675 (400 connections now open) 2015-10-05T05:36:42.674+0100 [conn1424675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:43.013+0100 [conn1424231] end connection 172.28.0.164:55749 (399 connections now open) 2015-10-05T05:36:43.013+0100 [conn1424269] end connection 172.28.0.164:55826 (398 connections now open) 2015-10-05T05:36:43.014+0100 [mongosMain] connection accepted from 172.28.0.164:56760 #1424676 (399 connections now open) 2015-10-05T05:36:43.015+0100 [mongosMain] connection accepted from 172.28.0.164:56761 #1424677 (400 connections now open) 2015-10-05T05:36:43.016+0100 [conn1424676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:43.017+0100 [conn1424677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:46.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe5e5703b51053eb9989 2015-10-05T05:36:46.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:48.222+0100 [conn1424087] end connection 172.28.0.164:55416 (399 connections now open) 2015-10-05T05:36:48.223+0100 [mongosMain] connection accepted from 172.28.0.164:56768 #1424678 (400 connections now open) 2015-10-05T05:36:48.224+0100 [conn1424678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:48.721+0100 [conn1424281] end connection 172.28.0.164:55859 (399 connections now open) 2015-10-05T05:36:48.722+0100 [mongosMain] connection accepted from 172.28.0.164:56770 #1424679 (400 connections now open) 2015-10-05T05:36:48.723+0100 [conn1424679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:49.197+0100 [conn1424283] end connection 172.28.0.163:62789 (399 connections now open) 2015-10-05T05:36:49.199+0100 [mongosMain] connection accepted from 172.28.0.163:63687 #1424680 (400 connections now open) 2015-10-05T05:36:49.200+0100 [conn1424680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:52.687+0100 [conn1424277] end connection 172.28.0.163:62783 (399 connections now open) 2015-10-05T05:36:52.687+0100 [conn1424267] end connection 172.28.0.163:62773 (399 connections now open) 2015-10-05T05:36:52.688+0100 [mongosMain] connection accepted from 172.28.0.163:63693 #1424681 (399 connections now open) 2015-10-05T05:36:52.689+0100 [mongosMain] connection accepted from 172.28.0.163:63694 #1424682 (400 connections now open) 2015-10-05T05:36:52.690+0100 [conn1424681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:52.690+0100 [conn1424682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:53.012+0100 [conn1424278] end connection 172.28.0.164:55846 (399 connections now open) 2015-10-05T05:36:53.012+0100 [conn1424239] end connection 172.28.0.164:55769 (399 connections now open) 2015-10-05T05:36:53.013+0100 [mongosMain] connection accepted from 172.28.0.164:56777 #1424683 (399 connections now open) 2015-10-05T05:36:53.014+0100 [mongosMain] connection accepted from 172.28.0.164:56776 #1424684 (400 connections now open) 2015-10-05T05:36:53.015+0100 [conn1424683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:53.016+0100 [conn1424684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:58.239+0100 [conn1424263] end connection 172.28.0.164:55813 (399 connections now open) 2015-10-05T05:36:58.240+0100 [mongosMain] connection accepted from 172.28.0.164:56782 #1424685 (400 connections now open) 2015-10-05T05:36:58.242+0100 [conn1424685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:58.738+0100 [conn1424290] end connection 172.28.0.164:55878 (399 connections now open) 2015-10-05T05:36:58.739+0100 [mongosMain] connection accepted from 172.28.0.164:56784 #1424686 (400 connections now open) 2015-10-05T05:36:58.741+0100 [conn1424686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:36:58.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe6a5703b51053eb9a19 2015-10-05T05:36:58.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:36:59.208+0100 [conn1424292] end connection 172.28.0.163:62807 (399 connections now open) 2015-10-05T05:36:59.209+0100 [mongosMain] connection accepted from 172.28.0.163:63704 #1424687 (400 connections now open) 2015-10-05T05:36:59.210+0100 [conn1424687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:02.687+0100 [conn1424253] end connection 172.28.0.163:62744 (399 connections now open) 2015-10-05T05:37:02.687+0100 [conn1424286] end connection 172.28.0.163:62795 (398 connections now open) 2015-10-05T05:37:02.688+0100 [mongosMain] connection accepted from 172.28.0.163:63714 #1424688 (399 connections now open) 2015-10-05T05:37:02.689+0100 [mongosMain] connection accepted from 172.28.0.163:63713 #1424689 (400 connections now open) 2015-10-05T05:37:02.689+0100 [conn1424688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:02.689+0100 [conn1424689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:03.027+0100 [conn1424270] end connection 172.28.0.164:55827 (399 connections now open) 2015-10-05T05:37:03.028+0100 [conn1424288] end connection 172.28.0.164:55867 (398 connections now open) 2015-10-05T05:37:03.029+0100 [mongosMain] connection accepted from 172.28.0.164:56791 #1424690 (399 connections now open) 2015-10-05T05:37:03.029+0100 [mongosMain] connection accepted from 172.28.0.164:56790 #1424691 (400 connections now open) 2015-10-05T05:37:03.030+0100 [conn1424690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:03.030+0100 [conn1424691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:08.238+0100 [conn1424271] end connection 172.28.0.164:55834 (399 connections now open) 2015-10-05T05:37:08.239+0100 [mongosMain] connection accepted from 172.28.0.164:56794 #1424692 (400 connections now open) 2015-10-05T05:37:08.241+0100 [conn1424692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:08.615+0100 [conn1424273] end connection 172.28.0.163:62777 (399 connections now open) 2015-10-05T05:37:08.617+0100 [mongosMain] connection accepted from 172.28.0.163:63724 #1424693 (400 connections now open) 2015-10-05T05:37:08.618+0100 [conn1424693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:08.737+0100 [conn1424298] end connection 172.28.0.164:55893 (399 connections now open) 2015-10-05T05:37:08.739+0100 [mongosMain] connection accepted from 172.28.0.164:56796 #1424694 (400 connections now open) 2015-10-05T05:37:08.740+0100 [conn1424694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:09.208+0100 [conn1424300] end connection 172.28.0.163:62823 (399 connections now open) 2015-10-05T05:37:09.210+0100 [mongosMain] connection accepted from 172.28.0.163:63727 #1424695 (400 connections now open) 2015-10-05T05:37:09.211+0100 [conn1424695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:11.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe775703b51053eb9b04 2015-10-05T05:37:11.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:12.063+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:37:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:37:12.704+0100 [conn1424294] end connection 172.28.0.163:62812 (399 connections now open) 2015-10-05T05:37:12.704+0100 [conn1424285] end connection 172.28.0.163:62794 (399 connections now open) 2015-10-05T05:37:12.705+0100 [mongosMain] connection accepted from 172.28.0.163:63734 #1424696 (399 connections now open) 2015-10-05T05:37:12.706+0100 [mongosMain] connection accepted from 172.28.0.163:63735 #1424697 (400 connections now open) 2015-10-05T05:37:12.706+0100 [conn1424696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:12.707+0100 [conn1424697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:13.034+0100 [conn1424247] end connection 172.28.0.164:55784 (399 connections now open) 2015-10-05T05:37:13.034+0100 [conn1424296] end connection 172.28.0.164:55887 (398 connections now open) 2015-10-05T05:37:13.035+0100 [mongosMain] connection accepted from 172.28.0.164:56801 #1424698 (399 connections now open) 2015-10-05T05:37:13.036+0100 [mongosMain] connection accepted from 172.28.0.164:56802 #1424699 (400 connections now open) 2015-10-05T05:37:13.037+0100 [conn1424698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:13.037+0100 [conn1424699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:18.254+0100 [conn1424280] end connection 172.28.0.164:55856 (399 connections now open) 2015-10-05T05:37:18.255+0100 [mongosMain] connection accepted from 172.28.0.164:56805 #1424700 (400 connections now open) 2015-10-05T05:37:18.257+0100 [conn1424700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:18.631+0100 [conn1424282] end connection 172.28.0.163:62786 (399 connections now open) 2015-10-05T05:37:18.633+0100 [mongosMain] connection accepted from 172.28.0.163:63742 #1424701 (400 connections now open) 2015-10-05T05:37:18.634+0100 [conn1424701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:18.753+0100 [conn1424306] end connection 172.28.0.164:55907 (399 connections now open) 2015-10-05T05:37:18.754+0100 [mongosMain] connection accepted from 172.28.0.164:56808 #1424702 (400 connections now open) 2015-10-05T05:37:18.756+0100 [conn1424702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:19.224+0100 [conn1424308] end connection 172.28.0.163:62847 (399 connections now open) 2015-10-05T05:37:19.226+0100 [mongosMain] connection accepted from 172.28.0.163:63744 #1424703 (400 connections now open) 2015-10-05T05:37:19.227+0100 [conn1424703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:22.705+0100 [conn1424301] end connection 172.28.0.163:62832 (399 connections now open) 2015-10-05T05:37:22.705+0100 [conn1424260] end connection 172.28.0.163:62759 (399 connections now open) 2015-10-05T05:37:22.706+0100 [mongosMain] connection accepted from 172.28.0.163:63752 #1424704 (399 connections now open) 2015-10-05T05:37:22.707+0100 [mongosMain] connection accepted from 172.28.0.163:63751 #1424705 (400 connections now open) 2015-10-05T05:37:22.707+0100 [conn1424704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:22.708+0100 [conn1424705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:23.044+0100 [conn1424287] end connection 172.28.0.164:55866 (399 connections now open) 2015-10-05T05:37:23.044+0100 [conn1424303] end connection 172.28.0.164:55902 (398 connections now open) 2015-10-05T05:37:23.045+0100 [mongosMain] connection accepted from 172.28.0.164:56818 #1424706 (399 connections now open) 2015-10-05T05:37:23.045+0100 [mongosMain] connection accepted from 172.28.0.164:56819 #1424707 (400 connections now open) 2015-10-05T05:37:23.046+0100 [conn1424706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:23.046+0100 [conn1424707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:23.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe835703b51053eb9ba8 2015-10-05T05:37:23.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:28.193+0100 [mongosMain] connection accepted from 127.0.0.1:63755 #1424708 (401 connections now open) 2015-10-05T05:37:28.196+0100 [conn1424708] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:28.201+0100 [conn1424708] end connection 127.0.0.1:63755 (400 connections now open) 2015-10-05T05:37:28.254+0100 [conn1424297] end connection 172.28.0.164:55891 (399 connections now open) 2015-10-05T05:37:28.255+0100 [mongosMain] connection accepted from 172.28.0.164:56827 #1424709 (400 connections now open) 2015-10-05T05:37:28.257+0100 [conn1424709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:28.632+0100 [conn1424242] end connection 172.28.0.163:62716 (399 connections now open) 2015-10-05T05:37:28.633+0100 [mongosMain] connection accepted from 172.28.0.163:63756 #1424710 (400 connections now open) 2015-10-05T05:37:28.634+0100 [conn1424710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:28.753+0100 [conn1424314] end connection 172.28.0.164:55916 (399 connections now open) 2015-10-05T05:37:28.755+0100 [mongosMain] connection accepted from 172.28.0.164:56829 #1424711 (400 connections now open) 2015-10-05T05:37:28.757+0100 [conn1424711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:29.225+0100 [conn1424316] end connection 172.28.0.163:62864 (399 connections now open) 2015-10-05T05:37:29.227+0100 [mongosMain] connection accepted from 172.28.0.163:63758 #1424712 (400 connections now open) 2015-10-05T05:37:29.228+0100 [conn1424712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:29.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe895703b51053eb9bee 2015-10-05T05:37:30.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:32.719+0100 [conn1424309] end connection 172.28.0.163:62852 (399 connections now open) 2015-10-05T05:37:32.719+0100 [conn1424302] end connection 172.28.0.163:62833 (398 connections now open) 2015-10-05T05:37:32.720+0100 [mongosMain] connection accepted from 172.28.0.163:63760 #1424713 (399 connections now open) 2015-10-05T05:37:32.721+0100 [mongosMain] connection accepted from 172.28.0.163:63761 #1424714 (400 connections now open) 2015-10-05T05:37:32.721+0100 [conn1424713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:32.722+0100 [conn1424714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:33.044+0100 [conn1424311] end connection 172.28.0.164:55910 (399 connections now open) 2015-10-05T05:37:33.044+0100 [conn1424295] end connection 172.28.0.164:55886 (399 connections now open) 2015-10-05T05:37:33.046+0100 [mongosMain] connection accepted from 172.28.0.164:56836 #1424715 (399 connections now open) 2015-10-05T05:37:33.046+0100 [mongosMain] connection accepted from 172.28.0.164:56837 #1424716 (400 connections now open) 2015-10-05T05:37:33.047+0100 [conn1424715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:33.048+0100 [conn1424716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:36.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe905703b51053eb9c34 2015-10-05T05:37:36.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:38.269+0100 [conn1424289] end connection 172.28.0.164:55876 (399 connections now open) 2015-10-05T05:37:38.271+0100 [mongosMain] connection accepted from 172.28.0.164:56848 #1424717 (400 connections now open) 2015-10-05T05:37:38.272+0100 [conn1424717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:38.647+0100 [conn1424203] end connection 172.28.0.163:62634 (399 connections now open) 2015-10-05T05:37:38.648+0100 [mongosMain] connection accepted from 172.28.0.163:63765 #1424718 (400 connections now open) 2015-10-05T05:37:38.649+0100 [conn1424718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:38.752+0100 [conn1424322] end connection 172.28.0.164:55936 (399 connections now open) 2015-10-05T05:37:38.754+0100 [mongosMain] connection accepted from 172.28.0.164:56850 #1424719 (400 connections now open) 2015-10-05T05:37:38.755+0100 [conn1424719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:39.239+0100 [conn1424325] end connection 172.28.0.163:62875 (399 connections now open) 2015-10-05T05:37:39.240+0100 [mongosMain] connection accepted from 172.28.0.163:63767 #1424720 (400 connections now open) 2015-10-05T05:37:39.241+0100 [conn1424720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:39.535+0100 [mongosMain] connection accepted from 127.0.0.1:63769 #1424721 (401 connections now open) 2015-10-05T05:37:39.537+0100 [conn1424721] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:39.542+0100 [conn1424721] end connection 127.0.0.1:63769 (400 connections now open) 2015-10-05T05:37:42.187+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:37:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:37:42.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe965703b51053eb9c5d 2015-10-05T05:37:42.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:42.724+0100 [conn1424318] end connection 172.28.0.163:62868 (399 connections now open) 2015-10-05T05:37:42.724+0100 [conn1424293] end connection 172.28.0.163:62811 (398 connections now open) 2015-10-05T05:37:42.725+0100 [mongosMain] connection accepted from 172.28.0.163:63773 #1424722 (399 connections now open) 2015-10-05T05:37:42.726+0100 [mongosMain] connection accepted from 172.28.0.163:63774 #1424723 (400 connections now open) 2015-10-05T05:37:42.727+0100 [conn1424722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:42.727+0100 [conn1424723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:43.060+0100 [conn1424320] end connection 172.28.0.164:55926 (399 connections now open) 2015-10-05T05:37:43.060+0100 [conn1424262] end connection 172.28.0.164:55809 (398 connections now open) 2015-10-05T05:37:43.061+0100 [mongosMain] connection accepted from 172.28.0.164:56858 #1424724 (399 connections now open) 2015-10-05T05:37:43.061+0100 [mongosMain] connection accepted from 172.28.0.164:56859 #1424725 (400 connections now open) 2015-10-05T05:37:43.062+0100 [conn1424724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:43.062+0100 [conn1424725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:48.270+0100 [conn1424305] end connection 172.28.0.164:55905 (399 connections now open) 2015-10-05T05:37:48.271+0100 [mongosMain] connection accepted from 172.28.0.164:56865 #1424726 (400 connections now open) 2015-10-05T05:37:48.273+0100 [conn1424726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:48.647+0100 [conn1424299] end connection 172.28.0.163:62821 (399 connections now open) 2015-10-05T05:37:48.648+0100 [mongosMain] connection accepted from 172.28.0.163:63784 #1424727 (400 connections now open) 2015-10-05T05:37:48.649+0100 [conn1424727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:48.769+0100 [conn1424331] end connection 172.28.0.164:55956 (399 connections now open) 2015-10-05T05:37:48.771+0100 [mongosMain] connection accepted from 172.28.0.164:56869 #1424728 (400 connections now open) 2015-10-05T05:37:48.772+0100 [conn1424728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:48.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fe9c5703b51053eb9c8f 2015-10-05T05:37:48.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:49.255+0100 [conn1424333] end connection 172.28.0.163:62883 (399 connections now open) 2015-10-05T05:37:49.257+0100 [mongosMain] connection accepted from 172.28.0.163:63786 #1424729 (400 connections now open) 2015-10-05T05:37:49.258+0100 [conn1424729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:52.735+0100 [conn1424245] end connection 172.28.0.163:62724 (399 connections now open) 2015-10-05T05:37:52.735+0100 [conn1424326] end connection 172.28.0.163:62878 (399 connections now open) 2015-10-05T05:37:52.736+0100 [mongosMain] connection accepted from 172.28.0.163:63790 #1424730 (399 connections now open) 2015-10-05T05:37:52.737+0100 [mongosMain] connection accepted from 172.28.0.163:63791 #1424731 (400 connections now open) 2015-10-05T05:37:52.738+0100 [conn1424730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:52.738+0100 [conn1424731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:53.060+0100 [conn1424328] end connection 172.28.0.164:55944 (399 connections now open) 2015-10-05T05:37:53.060+0100 [conn1424279] end connection 172.28.0.164:55847 (398 connections now open) 2015-10-05T05:37:53.060+0100 [mongosMain] connection accepted from 172.28.0.164:56876 #1424732 (399 connections now open) 2015-10-05T05:37:53.061+0100 [mongosMain] connection accepted from 172.28.0.164:56877 #1424733 (400 connections now open) 2015-10-05T05:37:53.062+0100 [conn1424732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:53.062+0100 [conn1424733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:55.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fea25703b51053eb9cb0 2015-10-05T05:37:55.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:37:58.662+0100 [conn1424250] end connection 172.28.0.163:62732 (399 connections now open) 2015-10-05T05:37:58.663+0100 [mongosMain] connection accepted from 172.28.0.163:63800 #1424734 (400 connections now open) 2015-10-05T05:37:58.664+0100 [conn1424734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:58.784+0100 [conn1424340] end connection 172.28.0.164:55976 (399 connections now open) 2015-10-05T05:37:58.786+0100 [mongosMain] connection accepted from 172.28.0.164:56881 #1424735 (400 connections now open) 2015-10-05T05:37:58.787+0100 [conn1424735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:37:59.255+0100 [conn1424342] end connection 172.28.0.163:62904 (399 connections now open) 2015-10-05T05:37:59.256+0100 [mongosMain] connection accepted from 172.28.0.163:63803 #1424736 (400 connections now open) 2015-10-05T05:37:59.257+0100 [conn1424736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:01.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fea95703b51053eb9ce5 2015-10-05T05:38:01.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:02.777+0100 [conn1424310] end connection 172.28.0.163:62853 (399 connections now open) 2015-10-05T05:38:02.777+0100 [conn1424336] end connection 172.28.0.163:62890 (399 connections now open) 2015-10-05T05:38:02.777+0100 [mongosMain] connection accepted from 172.28.0.163:63814 #1424737 (399 connections now open) 2015-10-05T05:38:02.777+0100 [mongosMain] connection accepted from 172.28.0.163:63815 #1424738 (400 connections now open) 2015-10-05T05:38:02.777+0100 [conn1424737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:02.777+0100 [conn1424738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:03.104+0100 [conn1424345] end connection 172.28.0.164:55984 (399 connections now open) 2015-10-05T05:38:03.104+0100 [conn1424304] end connection 172.28.0.164:55903 (398 connections now open) 2015-10-05T05:38:03.104+0100 [mongosMain] connection accepted from 172.28.0.164:56891 #1424739 (399 connections now open) 2015-10-05T05:38:03.104+0100 [mongosMain] connection accepted from 172.28.0.164:56892 #1424740 (400 connections now open) 2015-10-05T05:38:03.104+0100 [conn1424739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:03.104+0100 [conn1424740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:07.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611feaf5703b51053eb9d2c 2015-10-05T05:38:08.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:08.301+0100 [conn1424339] end connection 172.28.0.164:55974 (399 connections now open) 2015-10-05T05:38:08.303+0100 [mongosMain] connection accepted from 172.28.0.164:56894 #1424741 (400 connections now open) 2015-10-05T05:38:08.306+0100 [conn1424741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:08.663+0100 [conn1424257] end connection 172.28.0.163:62753 (399 connections now open) 2015-10-05T05:38:08.665+0100 [mongosMain] connection accepted from 172.28.0.163:63824 #1424742 (400 connections now open) 2015-10-05T05:38:08.666+0100 [conn1424742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:08.801+0100 [conn1424348] end connection 172.28.0.164:55990 (399 connections now open) 2015-10-05T05:38:08.802+0100 [mongosMain] connection accepted from 172.28.0.164:56896 #1424743 (400 connections now open) 2015-10-05T05:38:08.803+0100 [conn1424743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:09.271+0100 [conn1424350] end connection 172.28.0.163:62922 (399 connections now open) 2015-10-05T05:38:09.273+0100 [mongosMain] connection accepted from 172.28.0.163:63826 #1424744 (400 connections now open) 2015-10-05T05:38:09.274+0100 [conn1424744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:12.440+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:38:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:38:12.750+0100 [conn1424343] end connection 172.28.0.163:62908 (399 connections now open) 2015-10-05T05:38:12.750+0100 [conn1424327] end connection 172.28.0.163:62879 (399 connections now open) 2015-10-05T05:38:12.751+0100 [mongosMain] connection accepted from 172.28.0.163:63830 #1424745 (399 connections now open) 2015-10-05T05:38:12.752+0100 [mongosMain] connection accepted from 172.28.0.163:63831 #1424746 (400 connections now open) 2015-10-05T05:38:12.752+0100 [conn1424745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:12.753+0100 [conn1424746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:13.075+0100 [conn1424346] end connection 172.28.0.164:55985 (399 connections now open) 2015-10-05T05:38:13.075+0100 [conn1424337] end connection 172.28.0.164:55963 (398 connections now open) 2015-10-05T05:38:13.076+0100 [mongosMain] connection accepted from 172.28.0.164:56900 #1424747 (399 connections now open) 2015-10-05T05:38:13.077+0100 [mongosMain] connection accepted from 172.28.0.164:56901 #1424748 (400 connections now open) 2015-10-05T05:38:13.078+0100 [conn1424747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:13.079+0100 [conn1424748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:14.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611feb65703b51053eb9d59 2015-10-05T05:38:14.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:18.318+0100 [conn1424330] end connection 172.28.0.164:55954 (399 connections now open) 2015-10-05T05:38:18.319+0100 [mongosMain] connection accepted from 172.28.0.164:56905 #1424749 (400 connections now open) 2015-10-05T05:38:18.322+0100 [conn1424749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:18.679+0100 [conn1424307] end connection 172.28.0.163:62845 (399 connections now open) 2015-10-05T05:38:18.680+0100 [mongosMain] connection accepted from 172.28.0.163:63838 #1424750 (400 connections now open) 2015-10-05T05:38:18.682+0100 [conn1424750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:18.817+0100 [conn1424356] end connection 172.28.0.164:56001 (399 connections now open) 2015-10-05T05:38:18.818+0100 [mongosMain] connection accepted from 172.28.0.164:56908 #1424751 (400 connections now open) 2015-10-05T05:38:18.820+0100 [conn1424751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:19.272+0100 [conn1424358] end connection 172.28.0.163:62943 (399 connections now open) 2015-10-05T05:38:19.273+0100 [mongosMain] connection accepted from 172.28.0.163:63840 #1424752 (400 connections now open) 2015-10-05T05:38:19.274+0100 [conn1424752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:20.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611febc5703b51053eb9d96 2015-10-05T05:38:20.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:22.766+0100 [conn1424352] end connection 172.28.0.163:62932 (399 connections now open) 2015-10-05T05:38:22.766+0100 [conn1424335] end connection 172.28.0.163:62889 (399 connections now open) 2015-10-05T05:38:22.767+0100 [mongosMain] connection accepted from 172.28.0.163:63843 #1424753 (399 connections now open) 2015-10-05T05:38:22.767+0100 [mongosMain] connection accepted from 172.28.0.163:63844 #1424754 (400 connections now open) 2015-10-05T05:38:22.768+0100 [conn1424753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:22.768+0100 [conn1424754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:23.092+0100 [conn1424362] end connection 172.28.0.164:56006 (399 connections now open) 2015-10-05T05:38:23.094+0100 [mongosMain] connection accepted from 172.28.0.164:56916 #1424755 (400 connections now open) 2015-10-05T05:38:23.096+0100 [conn1424755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:26.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fec25703b51053eb9de4 2015-10-05T05:38:27.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:28.318+0100 [conn1424321] end connection 172.28.0.164:55934 (399 connections now open) 2015-10-05T05:38:28.319+0100 [mongosMain] connection accepted from 172.28.0.164:56923 #1424756 (400 connections now open) 2015-10-05T05:38:28.321+0100 [conn1424756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:28.374+0100 [mongosMain] connection accepted from 127.0.0.1:63846 #1424757 (401 connections now open) 2015-10-05T05:38:28.377+0100 [conn1424757] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:28.383+0100 [conn1424757] end connection 127.0.0.1:63846 (400 connections now open) 2015-10-05T05:38:28.680+0100 [conn1424265] end connection 172.28.0.163:62768 (399 connections now open) 2015-10-05T05:38:28.681+0100 [mongosMain] connection accepted from 172.28.0.163:63847 #1424758 (400 connections now open) 2015-10-05T05:38:28.682+0100 [conn1424758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:28.832+0100 [conn1424363] end connection 172.28.0.164:56012 (399 connections now open) 2015-10-05T05:38:28.834+0100 [mongosMain] connection accepted from 172.28.0.164:56925 #1424759 (400 connections now open) 2015-10-05T05:38:28.837+0100 [conn1424759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:29.287+0100 [conn1424365] end connection 172.28.0.163:62959 (399 connections now open) 2015-10-05T05:38:29.289+0100 [mongosMain] connection accepted from 172.28.0.163:63849 #1424760 (400 connections now open) 2015-10-05T05:38:29.290+0100 [conn1424760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:32.771+0100 [conn1424360] end connection 172.28.0.163:62948 (399 connections now open) 2015-10-05T05:38:32.771+0100 [conn1424268] end connection 172.28.0.163:62774 (398 connections now open) 2015-10-05T05:38:32.772+0100 [mongosMain] connection accepted from 172.28.0.163:63852 #1424761 (399 connections now open) 2015-10-05T05:38:32.773+0100 [mongosMain] connection accepted from 172.28.0.163:63853 #1424762 (400 connections now open) 2015-10-05T05:38:32.773+0100 [conn1424761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:32.774+0100 [conn1424762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:33.095+0100 [conn1424361] end connection 172.28.0.164:56005 (399 connections now open) 2015-10-05T05:38:33.095+0100 [conn1424354] end connection 172.28.0.164:55998 (398 connections now open) 2015-10-05T05:38:33.096+0100 [mongosMain] connection accepted from 172.28.0.164:56931 #1424763 (399 connections now open) 2015-10-05T05:38:33.096+0100 [mongosMain] connection accepted from 172.28.0.164:56932 #1424764 (400 connections now open) 2015-10-05T05:38:33.098+0100 [conn1424763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:33.099+0100 [conn1424764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:33.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fec95703b51053eb9e2d 2015-10-05T05:38:33.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:38.318+0100 [conn1424355] end connection 172.28.0.164:55999 (399 connections now open) 2015-10-05T05:38:38.319+0100 [mongosMain] connection accepted from 172.28.0.164:56940 #1424765 (400 connections now open) 2015-10-05T05:38:38.321+0100 [conn1424765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:38.694+0100 [conn1424217] end connection 172.28.0.163:62672 (399 connections now open) 2015-10-05T05:38:38.696+0100 [mongosMain] connection accepted from 172.28.0.163:63856 #1424766 (400 connections now open) 2015-10-05T05:38:38.697+0100 [conn1424766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:38.847+0100 [conn1424369] end connection 172.28.0.164:56028 (399 connections now open) 2015-10-05T05:38:38.849+0100 [mongosMain] connection accepted from 172.28.0.164:56943 #1424767 (400 connections now open) 2015-10-05T05:38:38.850+0100 [conn1424767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:39.389+0100 [mongosMain] connection accepted from 127.0.0.1:63859 #1424768 (401 connections now open) 2015-10-05T05:38:39.392+0100 [conn1424768] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:39.397+0100 [conn1424768] end connection 127.0.0.1:63859 (400 connections now open) 2015-10-05T05:38:39.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fecf5703b51053eb9e7e 2015-10-05T05:38:39.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:42.586+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:38:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:38:42.781+0100 [conn1424367] end connection 172.28.0.163:62966 (399 connections now open) 2015-10-05T05:38:42.781+0100 [conn1424366] end connection 172.28.0.163:62965 (399 connections now open) 2015-10-05T05:38:42.783+0100 [mongosMain] connection accepted from 172.28.0.163:63863 #1424769 (399 connections now open) 2015-10-05T05:38:42.783+0100 [mongosMain] connection accepted from 172.28.0.163:63864 #1424770 (400 connections now open) 2015-10-05T05:38:42.784+0100 [conn1424769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:42.784+0100 [conn1424770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:43.106+0100 [conn1424368] end connection 172.28.0.164:56019 (399 connections now open) 2015-10-05T05:38:43.107+0100 [mongosMain] connection accepted from 172.28.0.164:56949 #1424771 (400 connections now open) 2015-10-05T05:38:43.109+0100 [conn1424771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:46.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fed55703b51053eb9ec8 2015-10-05T05:38:46.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:48.333+0100 [conn1424347] end connection 172.28.0.164:55988 (399 connections now open) 2015-10-05T05:38:48.334+0100 [mongosMain] connection accepted from 172.28.0.164:56955 #1424772 (400 connections now open) 2015-10-05T05:38:48.336+0100 [conn1424772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:48.710+0100 [conn1424291] end connection 172.28.0.163:62804 (399 connections now open) 2015-10-05T05:38:48.712+0100 [mongosMain] connection accepted from 172.28.0.163:63874 #1424773 (400 connections now open) 2015-10-05T05:38:48.713+0100 [conn1424773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:52.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fedc5703b51053eb9f03 2015-10-05T05:38:52.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:38:52.783+0100 [conn1424351] end connection 172.28.0.163:62931 (399 connections now open) 2015-10-05T05:38:52.784+0100 [mongosMain] connection accepted from 172.28.0.163:63883 #1424774 (400 connections now open) 2015-10-05T05:38:52.785+0100 [conn1424774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:58.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fee25703b51053eb9f36 2015-10-05T05:38:58.711+0100 [conn1424315] end connection 172.28.0.163:62862 (399 connections now open) 2015-10-05T05:38:58.712+0100 [mongosMain] connection accepted from 172.28.0.163:63894 #1424775 (400 connections now open) 2015-10-05T05:38:58.713+0100 [conn1424775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:38:58.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:02.797+0100 [conn1424373] end connection 172.28.0.163:62973 (399 connections now open) 2015-10-05T05:39:02.797+0100 [conn1424382] end connection 172.28.0.163:63002 (399 connections now open) 2015-10-05T05:39:02.798+0100 [mongosMain] connection accepted from 172.28.0.163:63905 #1424776 (399 connections now open) 2015-10-05T05:39:02.799+0100 [mongosMain] connection accepted from 172.28.0.163:63906 #1424777 (400 connections now open) 2015-10-05T05:39:02.799+0100 [conn1424776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:02.799+0100 [conn1424777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:03.123+0100 [conn1424375] end connection 172.28.0.164:56032 (399 connections now open) 2015-10-05T05:39:03.124+0100 [mongosMain] connection accepted from 172.28.0.164:56971 #1424778 (400 connections now open) 2015-10-05T05:39:03.125+0100 [conn1424778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:08.727+0100 [conn1424349] end connection 172.28.0.163:62919 (399 connections now open) 2015-10-05T05:39:08.728+0100 [mongosMain] connection accepted from 172.28.0.163:63916 #1424779 (400 connections now open) 2015-10-05T05:39:08.729+0100 [conn1424779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:11.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611feee5703b51053eb9fb1 2015-10-05T05:39:11.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:12.798+0100 [conn1424344] end connection 172.28.0.163:62909 (399 connections now open) 2015-10-05T05:39:12.798+0100 [conn1424380] end connection 172.28.0.163:62984 (399 connections now open) 2015-10-05T05:39:12.799+0100 [mongosMain] connection accepted from 172.28.0.163:63920 #1424780 (399 connections now open) 2015-10-05T05:39:12.799+0100 [mongosMain] connection accepted from 172.28.0.163:63921 #1424781 (400 connections now open) 2015-10-05T05:39:12.800+0100 [conn1424780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:12.801+0100 [conn1424781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:12.854+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:39:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:39:17.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fef55703b51053eb9fe4 2015-10-05T05:39:17.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:18.349+0100 [conn1424313] end connection 172.28.0.164:55914 (399 connections now open) 2015-10-05T05:39:18.350+0100 [mongosMain] connection accepted from 172.28.0.164:56977 #1424782 (400 connections now open) 2015-10-05T05:39:18.352+0100 [conn1424782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:22.812+0100 [conn1424386] end connection 172.28.0.163:63028 (399 connections now open) 2015-10-05T05:39:22.813+0100 [mongosMain] connection accepted from 172.28.0.163:63932 #1424783 (400 connections now open) 2015-10-05T05:39:22.814+0100 [conn1424783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:23.139+0100 [conn1424384] end connection 172.28.0.164:56060 (399 connections now open) 2015-10-05T05:39:23.140+0100 [mongosMain] connection accepted from 172.28.0.164:56985 #1424784 (400 connections now open) 2015-10-05T05:39:23.142+0100 [conn1424784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:28.269+0100 [mongosMain] connection accepted from 127.0.0.1:63936 #1424785 (401 connections now open) 2015-10-05T05:39:28.271+0100 [conn1424785] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:28.277+0100 [conn1424785] end connection 127.0.0.1:63936 (400 connections now open) 2015-10-05T05:39:28.365+0100 [conn1424376] end connection 172.28.0.164:56040 (399 connections now open) 2015-10-05T05:39:28.365+0100 [mongosMain] connection accepted from 172.28.0.164:56995 #1424786 (400 connections now open) 2015-10-05T05:39:28.367+0100 [conn1424786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:28.742+0100 [conn1424357] end connection 172.28.0.163:62941 (399 connections now open) 2015-10-05T05:39:28.743+0100 [mongosMain] connection accepted from 172.28.0.163:63938 #1424787 (400 connections now open) 2015-10-05T05:39:28.744+0100 [conn1424787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:29.691+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff015703b51053eba027 2015-10-05T05:39:29.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:38.743+0100 [conn1424341] end connection 172.28.0.163:62901 (399 connections now open) 2015-10-05T05:39:38.745+0100 [mongosMain] connection accepted from 172.28.0.163:63942 #1424788 (400 connections now open) 2015-10-05T05:39:38.746+0100 [conn1424788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:40.054+0100 [mongosMain] connection accepted from 127.0.0.1:63943 #1424789 (401 connections now open) 2015-10-05T05:39:40.057+0100 [conn1424789] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:40.062+0100 [conn1424789] end connection 127.0.0.1:63943 (400 connections now open) 2015-10-05T05:39:42.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff0d5703b51053eba068 2015-10-05T05:39:42.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:42.831+0100 [conn1424374] end connection 172.28.0.163:62976 (399 connections now open) 2015-10-05T05:39:42.832+0100 [mongosMain] connection accepted from 172.28.0.163:63948 #1424790 (400 connections now open) 2015-10-05T05:39:42.833+0100 [conn1424790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:43.008+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:39:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:39:43.154+0100 [conn1424329] end connection 172.28.0.164:55945 (399 connections now open) 2015-10-05T05:39:43.155+0100 [mongosMain] connection accepted from 172.28.0.164:57014 #1424791 (400 connections now open) 2015-10-05T05:39:43.156+0100 [conn1424791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:48.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff145703b51053eba085 2015-10-05T05:39:48.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:39:48.757+0100 [conn1424370] end connection 172.28.0.163:62968 (399 connections now open) 2015-10-05T05:39:48.759+0100 [mongosMain] connection accepted from 172.28.0.163:63956 #1424792 (400 connections now open) 2015-10-05T05:39:48.759+0100 [conn1424792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:39:58.773+0100 [conn1424364] end connection 172.28.0.163:62957 (399 connections now open) 2015-10-05T05:39:58.774+0100 [mongosMain] connection accepted from 172.28.0.163:63971 #1424793 (400 connections now open) 2015-10-05T05:39:58.775+0100 [conn1424793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:06.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff265703b51053eba0e6 2015-10-05T05:40:06.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:13.306+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:40:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:40:18.789+0100 [conn1424397] end connection 172.28.0.163:63083 (399 connections now open) 2015-10-05T05:40:18.790+0100 [mongosMain] connection accepted from 172.28.0.163:63995 #1424794 (400 connections now open) 2015-10-05T05:40:18.792+0100 [conn1424794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:19.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff325703b51053eba12d 2015-10-05T05:40:19.382+0100 [conn1424372] end connection 172.28.0.163:62971 (399 connections now open) 2015-10-05T05:40:19.384+0100 [mongosMain] connection accepted from 172.28.0.163:63996 #1424795 (400 connections now open) 2015-10-05T05:40:19.385+0100 [conn1424795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:19.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:22.865+0100 [conn1424399] end connection 172.28.0.163:63093 (399 connections now open) 2015-10-05T05:40:22.866+0100 [mongosMain] connection accepted from 172.28.0.163:63998 #1424796 (400 connections now open) 2015-10-05T05:40:22.867+0100 [conn1424796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:25.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff395703b51053eba14f 2015-10-05T05:40:25.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:28.674+0100 [mongosMain] connection accepted from 127.0.0.1:64001 #1424797 (401 connections now open) 2015-10-05T05:40:28.677+0100 [conn1424797] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:28.682+0100 [conn1424797] end connection 127.0.0.1:64001 (400 connections now open) 2015-10-05T05:40:28.789+0100 [conn1424323] end connection 172.28.0.163:62872 (399 connections now open) 2015-10-05T05:40:28.790+0100 [mongosMain] connection accepted from 172.28.0.163:64002 #1424798 (400 connections now open) 2015-10-05T05:40:28.791+0100 [conn1424798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:28.973+0100 [conn1424377] end connection 172.28.0.164:56043 (399 connections now open) 2015-10-05T05:40:28.974+0100 [mongosMain] connection accepted from 172.28.0.164:57057 #1424799 (400 connections now open) 2015-10-05T05:40:28.975+0100 [conn1424799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:29.398+0100 [conn1424404] end connection 172.28.0.163:63116 (399 connections now open) 2015-10-05T05:40:29.399+0100 [mongosMain] connection accepted from 172.28.0.163:64004 #1424800 (400 connections now open) 2015-10-05T05:40:29.400+0100 [conn1424800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:32.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff3f5703b51053eba175 2015-10-05T05:40:32.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:32.876+0100 [conn1424405] end connection 172.28.0.163:63118 (399 connections now open) 2015-10-05T05:40:32.877+0100 [mongosMain] connection accepted from 172.28.0.163:64008 #1424801 (400 connections now open) 2015-10-05T05:40:32.878+0100 [conn1424801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:38.444+0100 [conn1424392] end connection 172.28.0.164:56095 (399 connections now open) 2015-10-05T05:40:38.446+0100 [mongosMain] connection accepted from 172.28.0.164:57070 #1424802 (400 connections now open) 2015-10-05T05:40:38.447+0100 [conn1424802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:38.526+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff465703b51053eba19d 2015-10-05T05:40:38.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:39.398+0100 [conn1424410] end connection 172.28.0.163:63123 (399 connections now open) 2015-10-05T05:40:39.399+0100 [mongosMain] connection accepted from 172.28.0.163:64011 #1424803 (400 connections now open) 2015-10-05T05:40:39.401+0100 [conn1424803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:39.759+0100 [mongosMain] connection accepted from 127.0.0.1:64013 #1424804 (401 connections now open) 2015-10-05T05:40:39.761+0100 [conn1424804] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:39.766+0100 [conn1424804] end connection 127.0.0.1:64013 (400 connections now open) 2015-10-05T05:40:42.876+0100 [conn1424401] end connection 172.28.0.163:63107 (399 connections now open) 2015-10-05T05:40:42.876+0100 [conn1424411] end connection 172.28.0.163:63128 (399 connections now open) 2015-10-05T05:40:42.877+0100 [mongosMain] connection accepted from 172.28.0.163:64017 #1424805 (399 connections now open) 2015-10-05T05:40:42.878+0100 [mongosMain] connection accepted from 172.28.0.163:64018 #1424806 (400 connections now open) 2015-10-05T05:40:42.878+0100 [conn1424805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:42.878+0100 [conn1424806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:43.217+0100 [conn1424319] end connection 172.28.0.164:55925 (399 connections now open) 2015-10-05T05:40:43.218+0100 [mongosMain] connection accepted from 172.28.0.164:57078 #1424807 (400 connections now open) 2015-10-05T05:40:43.220+0100 [conn1424807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:43.511+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:40:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:40:44.812+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff4c5703b51053eba1ca 2015-10-05T05:40:44.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:48.444+0100 [conn1424385] end connection 172.28.0.164:56065 (399 connections now open) 2015-10-05T05:40:48.444+0100 [mongosMain] connection accepted from 172.28.0.164:57088 #1424808 (400 connections now open) 2015-10-05T05:40:48.446+0100 [conn1424808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:48.805+0100 [conn1424332] end connection 172.28.0.163:62881 (399 connections now open) 2015-10-05T05:40:48.806+0100 [mongosMain] connection accepted from 172.28.0.163:64029 #1424809 (400 connections now open) 2015-10-05T05:40:48.807+0100 [conn1424809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:48.990+0100 [conn1424407] end connection 172.28.0.164:56168 (399 connections now open) 2015-10-05T05:40:48.991+0100 [mongosMain] connection accepted from 172.28.0.164:57090 #1424810 (400 connections now open) 2015-10-05T05:40:48.993+0100 [conn1424810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:51.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff525703b51053eba1f8 2015-10-05T05:40:51.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:52.892+0100 [conn1424387] end connection 172.28.0.163:63029 (399 connections now open) 2015-10-05T05:40:52.893+0100 [mongosMain] connection accepted from 172.28.0.163:64034 #1424811 (400 connections now open) 2015-10-05T05:40:52.894+0100 [conn1424811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:53.232+0100 [conn1424394] end connection 172.28.0.164:56101 (399 connections now open) 2015-10-05T05:40:53.233+0100 [conn1424406] end connection 172.28.0.164:56158 (398 connections now open) 2015-10-05T05:40:53.234+0100 [mongosMain] connection accepted from 172.28.0.164:57097 #1424812 (399 connections now open) 2015-10-05T05:40:53.234+0100 [mongosMain] connection accepted from 172.28.0.164:57096 #1424813 (400 connections now open) 2015-10-05T05:40:53.235+0100 [conn1424812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:53.236+0100 [conn1424813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:57.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff595703b51053eba22a 2015-10-05T05:40:57.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:40:58.461+0100 [conn1424381] end connection 172.28.0.164:56056 (399 connections now open) 2015-10-05T05:40:58.461+0100 [mongosMain] connection accepted from 172.28.0.164:57101 #1424814 (400 connections now open) 2015-10-05T05:40:58.465+0100 [conn1424814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:58.820+0100 [conn1424403] end connection 172.28.0.163:63115 (399 connections now open) 2015-10-05T05:40:58.821+0100 [mongosMain] connection accepted from 172.28.0.163:64044 #1424815 (400 connections now open) 2015-10-05T05:40:58.822+0100 [conn1424815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:59.005+0100 [conn1424418] end connection 172.28.0.164:56197 (399 connections now open) 2015-10-05T05:40:59.006+0100 [mongosMain] connection accepted from 172.28.0.164:57103 #1424816 (400 connections now open) 2015-10-05T05:40:59.009+0100 [conn1424816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:40:59.413+0100 [conn1424413] end connection 172.28.0.163:63131 (399 connections now open) 2015-10-05T05:40:59.414+0100 [mongosMain] connection accepted from 172.28.0.163:64046 #1424817 (400 connections now open) 2015-10-05T05:40:59.415+0100 [conn1424817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:02.907+0100 [conn1424415] end connection 172.28.0.163:63136 (399 connections now open) 2015-10-05T05:41:02.908+0100 [mongosMain] connection accepted from 172.28.0.163:64055 #1424818 (400 connections now open) 2015-10-05T05:41:02.909+0100 [conn1424818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:03.232+0100 [conn1424388] end connection 172.28.0.164:56071 (399 connections now open) 2015-10-05T05:41:03.233+0100 [mongosMain] connection accepted from 172.28.0.164:57106 #1424819 (400 connections now open) 2015-10-05T05:41:03.235+0100 [conn1424312] end connection 172.28.0.164:55911 (399 connections now open) 2015-10-05T05:41:03.236+0100 [conn1424819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:03.236+0100 [mongosMain] connection accepted from 172.28.0.164:57107 #1424820 (400 connections now open) 2015-10-05T05:41:03.237+0100 [conn1424820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:04.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff5f5703b51053eba269 2015-10-05T05:41:04.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:08.459+0100 [conn1424389] end connection 172.28.0.164:56073 (399 connections now open) 2015-10-05T05:41:08.461+0100 [mongosMain] connection accepted from 172.28.0.164:57110 #1424821 (400 connections now open) 2015-10-05T05:41:08.463+0100 [conn1424821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:08.821+0100 [conn1424400] end connection 172.28.0.163:63102 (399 connections now open) 2015-10-05T05:41:08.822+0100 [mongosMain] connection accepted from 172.28.0.163:64065 #1424822 (400 connections now open) 2015-10-05T05:41:08.823+0100 [conn1424822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:09.004+0100 [conn1424424] end connection 172.28.0.164:56207 (399 connections now open) 2015-10-05T05:41:09.005+0100 [mongosMain] connection accepted from 172.28.0.164:57113 #1424823 (400 connections now open) 2015-10-05T05:41:09.007+0100 [conn1424823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:09.429+0100 [conn1424426] end connection 172.28.0.163:63165 (399 connections now open) 2015-10-05T05:41:09.430+0100 [mongosMain] connection accepted from 172.28.0.163:64067 #1424824 (400 connections now open) 2015-10-05T05:41:09.431+0100 [conn1424824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:10.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff665703b51053eba292 2015-10-05T05:41:10.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:12.908+0100 [conn1424427] end connection 172.28.0.163:63171 (399 connections now open) 2015-10-05T05:41:12.909+0100 [mongosMain] connection accepted from 172.28.0.163:64070 #1424825 (400 connections now open) 2015-10-05T05:41:12.909+0100 [conn1424825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:13.248+0100 [conn1424402] end connection 172.28.0.164:56143 (399 connections now open) 2015-10-05T05:41:13.248+0100 [conn1424396] end connection 172.28.0.164:56115 (398 connections now open) 2015-10-05T05:41:13.249+0100 [mongosMain] connection accepted from 172.28.0.164:57115 #1424826 (399 connections now open) 2015-10-05T05:41:13.250+0100 [mongosMain] connection accepted from 172.28.0.164:57116 #1424827 (400 connections now open) 2015-10-05T05:41:13.251+0100 [conn1424826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:13.251+0100 [conn1424827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:13.786+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:41:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:41:16.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff6c5703b51053eba2b7 2015-10-05T05:41:17.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:18.474+0100 [conn1424391] end connection 172.28.0.164:56078 (399 connections now open) 2015-10-05T05:41:18.475+0100 [mongosMain] connection accepted from 172.28.0.164:57119 #1424828 (400 connections now open) 2015-10-05T05:41:18.477+0100 [conn1424828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:18.836+0100 [conn1424419] end connection 172.28.0.163:63145 (399 connections now open) 2015-10-05T05:41:18.837+0100 [mongosMain] connection accepted from 172.28.0.163:64077 #1424829 (400 connections now open) 2015-10-05T05:41:18.838+0100 [conn1424829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:19.021+0100 [conn1424431] end connection 172.28.0.164:56221 (399 connections now open) 2015-10-05T05:41:19.023+0100 [mongosMain] connection accepted from 172.28.0.164:57121 #1424830 (400 connections now open) 2015-10-05T05:41:19.025+0100 [conn1424830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:19.429+0100 [conn1424433] end connection 172.28.0.163:63184 (399 connections now open) 2015-10-05T05:41:19.430+0100 [mongosMain] connection accepted from 172.28.0.163:64079 #1424831 (400 connections now open) 2015-10-05T05:41:19.431+0100 [conn1424831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:23.264+0100 [conn1424353] end connection 172.28.0.164:55997 (399 connections now open) 2015-10-05T05:41:23.264+0100 [conn1424428] end connection 172.28.0.164:56216 (398 connections now open) 2015-10-05T05:41:23.265+0100 [mongosMain] connection accepted from 172.28.0.164:57131 #1424832 (399 connections now open) 2015-10-05T05:41:23.266+0100 [mongosMain] connection accepted from 172.28.0.164:57132 #1424833 (400 connections now open) 2015-10-05T05:41:23.267+0100 [conn1424832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:23.268+0100 [conn1424833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:23.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff735703b51053eba2ea 2015-10-05T05:41:23.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:28.491+0100 [conn1424201] end connection 172.28.0.164:55696 (399 connections now open) 2015-10-05T05:41:28.493+0100 [mongosMain] connection accepted from 172.28.0.164:57139 #1424834 (400 connections now open) 2015-10-05T05:41:28.494+0100 [conn1424834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:28.510+0100 [mongosMain] connection accepted from 127.0.0.1:64083 #1424835 (401 connections now open) 2015-10-05T05:41:28.513+0100 [conn1424835] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:28.517+0100 [conn1424835] end connection 127.0.0.1:64083 (400 connections now open) 2015-10-05T05:41:28.852+0100 [conn1424425] end connection 172.28.0.163:63163 (399 connections now open) 2015-10-05T05:41:28.853+0100 [mongosMain] connection accepted from 172.28.0.163:64084 #1424836 (400 connections now open) 2015-10-05T05:41:28.854+0100 [conn1424836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:29.021+0100 [conn1424439] end connection 172.28.0.164:56232 (399 connections now open) 2015-10-05T05:41:29.023+0100 [mongosMain] connection accepted from 172.28.0.164:57141 #1424837 (400 connections now open) 2015-10-05T05:41:29.024+0100 [conn1424837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:29.445+0100 [conn1424440] end connection 172.28.0.163:63197 (399 connections now open) 2015-10-05T05:41:29.446+0100 [mongosMain] connection accepted from 172.28.0.163:64086 #1424838 (400 connections now open) 2015-10-05T05:41:29.447+0100 [conn1424838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:29.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff795703b51053eba33f 2015-10-05T05:41:29.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:33.279+0100 [conn1424435] end connection 172.28.0.164:56226 (399 connections now open) 2015-10-05T05:41:33.281+0100 [mongosMain] connection accepted from 172.28.0.164:57148 #1424839 (400 connections now open) 2015-10-05T05:41:33.283+0100 [conn1424839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:38.507+0100 [conn1424417] end connection 172.28.0.164:56194 (399 connections now open) 2015-10-05T05:41:38.509+0100 [mongosMain] connection accepted from 172.28.0.164:57157 #1424840 (400 connections now open) 2015-10-05T05:41:38.510+0100 [conn1424840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:38.852+0100 [conn1424409] end connection 172.28.0.163:63122 (399 connections now open) 2015-10-05T05:41:38.853+0100 [mongosMain] connection accepted from 172.28.0.163:64092 #1424841 (400 connections now open) 2015-10-05T05:41:38.854+0100 [conn1424841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:39.037+0100 [conn1424446] end connection 172.28.0.164:56253 (399 connections now open) 2015-10-05T05:41:39.038+0100 [mongosMain] connection accepted from 172.28.0.164:57160 #1424842 (400 connections now open) 2015-10-05T05:41:39.040+0100 [conn1424842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:39.446+0100 [conn1424448] end connection 172.28.0.163:63207 (399 connections now open) 2015-10-05T05:41:39.448+0100 [mongosMain] connection accepted from 172.28.0.163:64095 #1424843 (400 connections now open) 2015-10-05T05:41:39.449+0100 [conn1424843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:40.084+0100 [mongosMain] connection accepted from 127.0.0.1:64097 #1424844 (401 connections now open) 2015-10-05T05:41:40.086+0100 [conn1424844] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:40.091+0100 [conn1424844] end connection 127.0.0.1:64097 (400 connections now open) 2015-10-05T05:41:42.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff865703b51053eba38e 2015-10-05T05:41:42.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:43.295+0100 [conn1424443] end connection 172.28.0.164:56240 (399 connections now open) 2015-10-05T05:41:43.296+0100 [conn1424449] end connection 172.28.0.164:56258 (398 connections now open) 2015-10-05T05:41:43.296+0100 [mongosMain] connection accepted from 172.28.0.164:57167 #1424845 (399 connections now open) 2015-10-05T05:41:43.297+0100 [mongosMain] connection accepted from 172.28.0.164:57168 #1424846 (400 connections now open) 2015-10-05T05:41:43.298+0100 [conn1424845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:43.299+0100 [conn1424846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:44.052+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:41:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:41:48.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff8c5703b51053eba3bc 2015-10-05T05:41:48.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:49.052+0100 [conn1424451] end connection 172.28.0.164:56269 (399 connections now open) 2015-10-05T05:41:49.059+0100 [mongosMain] connection accepted from 172.28.0.164:57177 #1424847 (400 connections now open) 2015-10-05T05:41:49.061+0100 [conn1424847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:49.460+0100 [conn1424452] end connection 172.28.0.163:63214 (399 connections now open) 2015-10-05T05:41:49.462+0100 [mongosMain] connection accepted from 172.28.0.163:64108 #1424848 (400 connections now open) 2015-10-05T05:41:49.463+0100 [conn1424848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:53.311+0100 [conn1424450] end connection 172.28.0.164:56259 (399 connections now open) 2015-10-05T05:41:53.312+0100 [mongosMain] connection accepted from 172.28.0.164:57184 #1424849 (400 connections now open) 2015-10-05T05:41:53.315+0100 [conn1424849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:54.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff925703b51053eba3d4 2015-10-05T05:41:55.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:41:58.860+0100 [conn1424457] end connection 172.28.0.163:63229 (399 connections now open) 2015-10-05T05:41:58.861+0100 [mongosMain] connection accepted from 172.28.0.163:64120 #1424850 (400 connections now open) 2015-10-05T05:41:58.862+0100 [conn1424850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:59.060+0100 [conn1424458] end connection 172.28.0.164:56287 (399 connections now open) 2015-10-05T05:41:59.061+0100 [mongosMain] connection accepted from 172.28.0.164:57188 #1424851 (400 connections now open) 2015-10-05T05:41:59.064+0100 [conn1424851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:41:59.468+0100 [conn1424459] end connection 172.28.0.163:63231 (399 connections now open) 2015-10-05T05:41:59.469+0100 [mongosMain] connection accepted from 172.28.0.163:64122 #1424852 (400 connections now open) 2015-10-05T05:41:59.470+0100 [conn1424852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:01.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff995703b51053eba3f9 2015-10-05T05:42:01.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:02.947+0100 [conn1424441] end connection 172.28.0.163:63201 (399 connections now open) 2015-10-05T05:42:02.947+0100 [conn1424359] end connection 172.28.0.163:62947 (399 connections now open) 2015-10-05T05:42:02.948+0100 [mongosMain] connection accepted from 172.28.0.163:64132 #1424853 (399 connections now open) 2015-10-05T05:42:02.948+0100 [mongosMain] connection accepted from 172.28.0.163:64133 #1424854 (400 connections now open) 2015-10-05T05:42:02.949+0100 [conn1424853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:02.949+0100 [conn1424854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:03.303+0100 [conn1424455] end connection 172.28.0.164:56278 (399 connections now open) 2015-10-05T05:42:03.304+0100 [mongosMain] connection accepted from 172.28.0.164:57194 #1424855 (400 connections now open) 2015-10-05T05:42:03.305+0100 [conn1424855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:07.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ff9f5703b51053eba43f 2015-10-05T05:42:07.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:08.874+0100 [conn1424445] end connection 172.28.0.163:63203 (399 connections now open) 2015-10-05T05:42:08.875+0100 [mongosMain] connection accepted from 172.28.0.163:64142 #1424856 (400 connections now open) 2015-10-05T05:42:08.876+0100 [conn1424856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:09.075+0100 [conn1424463] end connection 172.28.0.164:56300 (399 connections now open) 2015-10-05T05:42:09.076+0100 [mongosMain] connection accepted from 172.28.0.164:57199 #1424857 (400 connections now open) 2015-10-05T05:42:09.077+0100 [conn1424857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:09.468+0100 [conn1424465] end connection 172.28.0.163:63248 (399 connections now open) 2015-10-05T05:42:09.470+0100 [mongosMain] connection accepted from 172.28.0.163:64144 #1424858 (400 connections now open) 2015-10-05T05:42:09.471+0100 [conn1424858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:12.947+0100 [conn1424434] end connection 172.28.0.163:63186 (399 connections now open) 2015-10-05T05:42:12.947+0100 [conn1424390] end connection 172.28.0.163:63044 (399 connections now open) 2015-10-05T05:42:12.948+0100 [mongosMain] connection accepted from 172.28.0.163:64149 #1424859 (399 connections now open) 2015-10-05T05:42:12.948+0100 [mongosMain] connection accepted from 172.28.0.163:64150 #1424860 (400 connections now open) 2015-10-05T05:42:12.949+0100 [conn1424859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:12.949+0100 [conn1424860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:13.319+0100 [conn1424461] end connection 172.28.0.164:56292 (399 connections now open) 2015-10-05T05:42:13.320+0100 [mongosMain] connection accepted from 172.28.0.164:57204 #1424861 (400 connections now open) 2015-10-05T05:42:13.321+0100 [conn1424861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:13.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffa55703b51053eba45e 2015-10-05T05:42:13.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:14.320+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:42:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:42:18.545+0100 [conn1424437] end connection 172.28.0.164:56230 (399 connections now open) 2015-10-05T05:42:18.546+0100 [mongosMain] connection accepted from 172.28.0.164:57209 #1424862 (400 connections now open) 2015-10-05T05:42:18.547+0100 [conn1424862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:18.875+0100 [conn1424432] end connection 172.28.0.163:63181 (399 connections now open) 2015-10-05T05:42:18.877+0100 [mongosMain] connection accepted from 172.28.0.163:64158 #1424863 (400 connections now open) 2015-10-05T05:42:18.878+0100 [conn1424863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:19.091+0100 [conn1424471] end connection 172.28.0.164:56309 (399 connections now open) 2015-10-05T05:42:19.092+0100 [mongosMain] connection accepted from 172.28.0.164:57213 #1424864 (400 connections now open) 2015-10-05T05:42:19.093+0100 [conn1424864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:19.484+0100 [conn1424472] end connection 172.28.0.163:63271 (399 connections now open) 2015-10-05T05:42:19.485+0100 [mongosMain] connection accepted from 172.28.0.163:64160 #1424865 (400 connections now open) 2015-10-05T05:42:19.486+0100 [conn1424865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:20.057+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:42:20.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:42:22.963+0100 [conn1424421] end connection 172.28.0.163:63152 (399 connections now open) 2015-10-05T05:42:22.963+0100 [conn1424398] end connection 172.28.0.163:63092 (398 connections now open) 2015-10-05T05:42:22.964+0100 [mongosMain] connection accepted from 172.28.0.163:64163 #1424866 (399 connections now open) 2015-10-05T05:42:22.964+0100 [mongosMain] connection accepted from 172.28.0.163:64164 #1424867 (400 connections now open) 2015-10-05T05:42:22.965+0100 [conn1424866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:22.965+0100 [conn1424867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:23.335+0100 [conn1424468] end connection 172.28.0.164:56306 (399 connections now open) 2015-10-05T05:42:23.336+0100 [mongosMain] connection accepted from 172.28.0.164:57221 #1424868 (400 connections now open) 2015-10-05T05:42:23.338+0100 [conn1424868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:26.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffb25703b51053eba4b1 2015-10-05T05:42:26.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:28.665+0100 [mongosMain] connection accepted from 127.0.0.1:64166 #1424869 (401 connections now open) 2015-10-05T05:42:28.668+0100 [conn1424869] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:28.673+0100 [conn1424869] end connection 127.0.0.1:64166 (400 connections now open) 2015-10-05T05:42:28.890+0100 [conn1424438] end connection 172.28.0.163:63194 (399 connections now open) 2015-10-05T05:42:28.891+0100 [mongosMain] connection accepted from 172.28.0.163:64167 #1424870 (400 connections now open) 2015-10-05T05:42:28.892+0100 [conn1424870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:29.090+0100 [conn1424479] end connection 172.28.0.164:56321 (399 connections now open) 2015-10-05T05:42:29.091+0100 [mongosMain] connection accepted from 172.28.0.164:57228 #1424871 (400 connections now open) 2015-10-05T05:42:29.094+0100 [conn1424871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:29.484+0100 [conn1424480] end connection 172.28.0.163:63286 (399 connections now open) 2015-10-05T05:42:29.486+0100 [mongosMain] connection accepted from 172.28.0.163:64169 #1424872 (400 connections now open) 2015-10-05T05:42:29.487+0100 [conn1424872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:32.978+0100 [conn1424454] end connection 172.28.0.163:63219 (399 connections now open) 2015-10-05T05:42:32.978+0100 [conn1424466] end connection 172.28.0.163:63257 (399 connections now open) 2015-10-05T05:42:32.979+0100 [mongosMain] connection accepted from 172.28.0.163:64171 #1424873 (399 connections now open) 2015-10-05T05:42:32.980+0100 [mongosMain] connection accepted from 172.28.0.163:64172 #1424874 (400 connections now open) 2015-10-05T05:42:32.980+0100 [conn1424873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:32.981+0100 [conn1424874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:33.350+0100 [conn1424475] end connection 172.28.0.164:56313 (399 connections now open) 2015-10-05T05:42:33.350+0100 [conn1424416] end connection 172.28.0.164:56188 (398 connections now open) 2015-10-05T05:42:33.352+0100 [mongosMain] connection accepted from 172.28.0.164:57235 #1424875 (399 connections now open) 2015-10-05T05:42:33.353+0100 [mongosMain] connection accepted from 172.28.0.164:57236 #1424876 (400 connections now open) 2015-10-05T05:42:33.354+0100 [conn1424875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:33.354+0100 [conn1424876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:38.544+0100 [conn1424484] end connection 172.28.0.164:56338 (399 connections now open) 2015-10-05T05:42:38.545+0100 [mongosMain] connection accepted from 172.28.0.164:57246 #1424877 (400 connections now open) 2015-10-05T05:42:38.547+0100 [conn1424877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:38.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffbe5703b51053eba506 2015-10-05T05:42:38.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:38.891+0100 [conn1424470] end connection 172.28.0.163:63269 (399 connections now open) 2015-10-05T05:42:38.893+0100 [mongosMain] connection accepted from 172.28.0.163:64176 #1424878 (400 connections now open) 2015-10-05T05:42:38.894+0100 [conn1424878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:39.106+0100 [conn1424486] end connection 172.28.0.164:56340 (399 connections now open) 2015-10-05T05:42:39.106+0100 [mongosMain] connection accepted from 172.28.0.164:57249 #1424879 (400 connections now open) 2015-10-05T05:42:39.108+0100 [conn1424879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:39.500+0100 [conn1424488] end connection 172.28.0.163:63295 (399 connections now open) 2015-10-05T05:42:39.501+0100 [mongosMain] connection accepted from 172.28.0.163:64177 #1424880 (400 connections now open) 2015-10-05T05:42:39.502+0100 [conn1424880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:39.786+0100 [mongosMain] connection accepted from 127.0.0.1:64179 #1424881 (401 connections now open) 2015-10-05T05:42:39.789+0100 [conn1424881] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:39.794+0100 [conn1424881] end connection 127.0.0.1:64179 (400 connections now open) 2015-10-05T05:42:42.980+0100 [conn1424474] end connection 172.28.0.163:63276 (399 connections now open) 2015-10-05T05:42:42.980+0100 [conn1424420] end connection 172.28.0.163:63151 (399 connections now open) 2015-10-05T05:42:42.981+0100 [mongosMain] connection accepted from 172.28.0.163:64183 #1424882 (399 connections now open) 2015-10-05T05:42:42.981+0100 [mongosMain] connection accepted from 172.28.0.163:64184 #1424883 (400 connections now open) 2015-10-05T05:42:42.982+0100 [conn1424882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:42.982+0100 [conn1424883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:43.366+0100 [conn1424422] end connection 172.28.0.164:56200 (399 connections now open) 2015-10-05T05:42:43.368+0100 [mongosMain] connection accepted from 172.28.0.164:57255 #1424884 (400 connections now open) 2015-10-05T05:42:43.370+0100 [conn1424884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:44.475+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:42:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:42:44.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffc45703b51053eba52b 2015-10-05T05:42:44.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:48.560+0100 [conn1424430] end connection 172.28.0.164:56218 (399 connections now open) 2015-10-05T05:42:48.562+0100 [mongosMain] connection accepted from 172.28.0.164:57266 #1424885 (400 connections now open) 2015-10-05T05:42:48.567+0100 [conn1424885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:48.906+0100 [conn1424478] end connection 172.28.0.163:63285 (399 connections now open) 2015-10-05T05:42:48.907+0100 [mongosMain] connection accepted from 172.28.0.163:64195 #1424886 (400 connections now open) 2015-10-05T05:42:48.908+0100 [conn1424886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:49.106+0100 [conn1424493] end connection 172.28.0.164:56361 (399 connections now open) 2015-10-05T05:42:49.108+0100 [mongosMain] connection accepted from 172.28.0.164:57268 #1424887 (400 connections now open) 2015-10-05T05:42:49.110+0100 [conn1424887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:49.500+0100 [conn1424494] end connection 172.28.0.163:63303 (399 connections now open) 2015-10-05T05:42:49.501+0100 [mongosMain] connection accepted from 172.28.0.163:64196 #1424888 (400 connections now open) 2015-10-05T05:42:49.503+0100 [conn1424888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:51.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffca5703b51053eba54c 2015-10-05T05:42:51.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:52.994+0100 [conn1424489] end connection 172.28.0.163:63297 (399 connections now open) 2015-10-05T05:42:52.994+0100 [conn1424379] end connection 172.28.0.163:62983 (398 connections now open) 2015-10-05T05:42:52.995+0100 [mongosMain] connection accepted from 172.28.0.163:64200 #1424889 (399 connections now open) 2015-10-05T05:42:52.996+0100 [mongosMain] connection accepted from 172.28.0.163:64201 #1424890 (400 connections now open) 2015-10-05T05:42:52.997+0100 [conn1424889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:52.997+0100 [conn1424890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:53.367+0100 [conn1424338] end connection 172.28.0.164:55964 (399 connections now open) 2015-10-05T05:42:53.367+0100 [mongosMain] connection accepted from 172.28.0.164:57274 #1424891 (400 connections now open) 2015-10-05T05:42:53.369+0100 [conn1424891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:57.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffd15703b51053eba568 2015-10-05T05:42:57.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:42:58.576+0100 [conn1424477] end connection 172.28.0.164:56319 (399 connections now open) 2015-10-05T05:42:58.577+0100 [mongosMain] connection accepted from 172.28.0.164:57277 #1424892 (400 connections now open) 2015-10-05T05:42:58.579+0100 [conn1424892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:58.922+0100 [conn1424500] end connection 172.28.0.163:63318 (399 connections now open) 2015-10-05T05:42:58.924+0100 [mongosMain] connection accepted from 172.28.0.163:64211 #1424893 (400 connections now open) 2015-10-05T05:42:58.925+0100 [conn1424893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:59.122+0100 [conn1424501] end connection 172.28.0.164:56377 (399 connections now open) 2015-10-05T05:42:59.124+0100 [mongosMain] connection accepted from 172.28.0.164:57279 #1424894 (400 connections now open) 2015-10-05T05:42:59.126+0100 [conn1424894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:42:59.515+0100 [conn1424502] end connection 172.28.0.163:63320 (399 connections now open) 2015-10-05T05:42:59.517+0100 [mongosMain] connection accepted from 172.28.0.163:64214 #1424895 (400 connections now open) 2015-10-05T05:42:59.518+0100 [conn1424895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:03.003+0100 [conn1424383] end connection 172.28.0.163:63003 (399 connections now open) 2015-10-05T05:43:03.003+0100 [conn1424481] end connection 172.28.0.163:63289 (399 connections now open) 2015-10-05T05:43:03.004+0100 [mongosMain] connection accepted from 172.28.0.163:64223 #1424896 (399 connections now open) 2015-10-05T05:43:03.004+0100 [mongosMain] connection accepted from 172.28.0.163:64224 #1424897 (400 connections now open) 2015-10-05T05:43:03.005+0100 [conn1424896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:03.005+0100 [conn1424897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:03.381+0100 [conn1424483] end connection 172.28.0.164:56330 (399 connections now open) 2015-10-05T05:43:03.381+0100 [conn1424476] end connection 172.28.0.164:56314 (398 connections now open) 2015-10-05T05:43:03.382+0100 [mongosMain] connection accepted from 172.28.0.164:57287 #1424898 (399 connections now open) 2015-10-05T05:43:03.384+0100 [mongosMain] connection accepted from 172.28.0.164:57286 #1424899 (400 connections now open) 2015-10-05T05:43:03.384+0100 [conn1424898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:03.385+0100 [conn1424899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:03.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffd75703b51053eba599 2015-10-05T05:43:03.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:08.926+0100 [conn1424506] end connection 172.28.0.163:63334 (399 connections now open) 2015-10-05T05:43:08.927+0100 [mongosMain] connection accepted from 172.28.0.163:64233 #1424900 (400 connections now open) 2015-10-05T05:43:08.928+0100 [conn1424900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:09.138+0100 [conn1424507] end connection 172.28.0.164:56391 (399 connections now open) 2015-10-05T05:43:09.139+0100 [mongosMain] connection accepted from 172.28.0.164:57290 #1424901 (400 connections now open) 2015-10-05T05:43:09.140+0100 [conn1424901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:09.520+0100 [conn1424508] end connection 172.28.0.163:63337 (399 connections now open) 2015-10-05T05:43:09.521+0100 [mongosMain] connection accepted from 172.28.0.163:64235 #1424902 (400 connections now open) 2015-10-05T05:43:09.522+0100 [conn1424902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:10.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffdd5703b51053eba5f9 2015-10-05T05:43:10.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:13.011+0100 [conn1424503] end connection 172.28.0.163:63325 (399 connections now open) 2015-10-05T05:43:13.012+0100 [mongosMain] connection accepted from 172.28.0.163:64238 #1424903 (400 connections now open) 2015-10-05T05:43:13.013+0100 [conn1424903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:13.382+0100 [conn1424469] end connection 172.28.0.164:56307 (399 connections now open) 2015-10-05T05:43:13.382+0100 [conn1424491] end connection 172.28.0.164:56346 (398 connections now open) 2015-10-05T05:43:13.383+0100 [mongosMain] connection accepted from 172.28.0.164:57295 #1424904 (399 connections now open) 2015-10-05T05:43:13.383+0100 [mongosMain] connection accepted from 172.28.0.164:57296 #1424905 (400 connections now open) 2015-10-05T05:43:13.385+0100 [conn1424904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:13.385+0100 [conn1424905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:14.883+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:43:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:43:16.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffe45703b51053eba626 2015-10-05T05:43:16.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:18.592+0100 [conn1424444] end connection 172.28.0.164:56251 (399 connections now open) 2015-10-05T05:43:18.593+0100 [mongosMain] connection accepted from 172.28.0.164:57301 #1424906 (400 connections now open) 2015-10-05T05:43:18.595+0100 [conn1424906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:18.937+0100 [conn1424485] end connection 172.28.0.163:63293 (399 connections now open) 2015-10-05T05:43:18.938+0100 [mongosMain] connection accepted from 172.28.0.163:64246 #1424907 (400 connections now open) 2015-10-05T05:43:18.939+0100 [conn1424907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:19.138+0100 [conn1424513] end connection 172.28.0.164:56403 (399 connections now open) 2015-10-05T05:43:19.140+0100 [mongosMain] connection accepted from 172.28.0.164:57303 #1424908 (400 connections now open) 2015-10-05T05:43:19.141+0100 [conn1424908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:19.531+0100 [conn1424514] end connection 172.28.0.163:63360 (399 connections now open) 2015-10-05T05:43:19.533+0100 [mongosMain] connection accepted from 172.28.0.163:64248 #1424909 (400 connections now open) 2015-10-05T05:43:19.534+0100 [conn1424909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:23.013+0100 [conn1424509] end connection 172.28.0.163:63348 (399 connections now open) 2015-10-05T05:43:23.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611ffea5703b51053eba643 2015-10-05T05:43:23.014+0100 [mongosMain] connection accepted from 172.28.0.163:64251 #1424910 (400 connections now open) 2015-10-05T05:43:23.016+0100 [conn1424910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:23.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:23.397+0100 [conn1424412] end connection 172.28.0.164:56175 (399 connections now open) 2015-10-05T05:43:23.398+0100 [conn1424510] end connection 172.28.0.164:56399 (398 connections now open) 2015-10-05T05:43:23.398+0100 [mongosMain] connection accepted from 172.28.0.164:57312 #1424911 (399 connections now open) 2015-10-05T05:43:23.399+0100 [mongosMain] connection accepted from 172.28.0.164:57313 #1424912 (400 connections now open) 2015-10-05T05:43:23.399+0100 [conn1424911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:23.400+0100 [conn1424912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:28.505+0100 [mongosMain] connection accepted from 127.0.0.1:64253 #1424913 (401 connections now open) 2015-10-05T05:43:28.508+0100 [conn1424913] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:28.513+0100 [conn1424913] end connection 127.0.0.1:64253 (400 connections now open) 2015-10-05T05:43:28.592+0100 [conn1424492] end connection 172.28.0.164:56357 (399 connections now open) 2015-10-05T05:43:28.593+0100 [mongosMain] connection accepted from 172.28.0.164:57319 #1424914 (400 connections now open) 2015-10-05T05:43:28.595+0100 [conn1424914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:29.139+0100 [conn1424520] end connection 172.28.0.164:56418 (399 connections now open) 2015-10-05T05:43:29.140+0100 [mongosMain] connection accepted from 172.28.0.164:57321 #1424915 (400 connections now open) 2015-10-05T05:43:29.142+0100 [conn1424915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:29.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fff15703b51053eba65f 2015-10-05T05:43:29.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:29.547+0100 [conn1424521] end connection 172.28.0.163:63376 (399 connections now open) 2015-10-05T05:43:29.548+0100 [mongosMain] connection accepted from 172.28.0.163:64255 #1424916 (400 connections now open) 2015-10-05T05:43:29.549+0100 [conn1424916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:33.028+0100 [conn1424497] end connection 172.28.0.163:63309 (399 connections now open) 2015-10-05T05:43:33.029+0100 [mongosMain] connection accepted from 172.28.0.163:64258 #1424917 (400 connections now open) 2015-10-05T05:43:33.030+0100 [conn1424917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:33.398+0100 [conn1424517] end connection 172.28.0.164:56406 (399 connections now open) 2015-10-05T05:43:33.399+0100 [conn1424436] end connection 172.28.0.164:56225 (398 connections now open) 2015-10-05T05:43:33.399+0100 [mongosMain] connection accepted from 172.28.0.164:57329 #1424918 (399 connections now open) 2015-10-05T05:43:33.399+0100 [mongosMain] connection accepted from 172.28.0.164:57330 #1424919 (400 connections now open) 2015-10-05T05:43:33.401+0100 [conn1424919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:33.401+0100 [conn1424918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:35.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fff75703b51053eba675 2015-10-05T05:43:35.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:38.608+0100 [conn1424511] end connection 172.28.0.164:56401 (399 connections now open) 2015-10-05T05:43:38.609+0100 [mongosMain] connection accepted from 172.28.0.164:57338 #1424920 (400 connections now open) 2015-10-05T05:43:38.610+0100 [conn1424920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:39.154+0100 [conn1424524] end connection 172.28.0.164:56437 (399 connections now open) 2015-10-05T05:43:39.155+0100 [mongosMain] connection accepted from 172.28.0.164:57343 #1424921 (400 connections now open) 2015-10-05T05:43:39.156+0100 [conn1424921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:39.339+0100 [mongosMain] connection accepted from 127.0.0.1:64266 #1424922 (401 connections now open) 2015-10-05T05:43:39.342+0100 [conn1424922] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:39.345+0100 [conn1424922] end connection 127.0.0.1:64266 (400 connections now open) 2015-10-05T05:43:39.547+0100 [conn1424526] end connection 172.28.0.163:63384 (399 connections now open) 2015-10-05T05:43:39.548+0100 [mongosMain] connection accepted from 172.28.0.163:64267 #1424923 (400 connections now open) 2015-10-05T05:43:39.549+0100 [conn1424923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:42.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5611fffd5703b51053eba692 2015-10-05T05:43:42.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:43.026+0100 [conn1424467] end connection 172.28.0.163:63258 (399 connections now open) 2015-10-05T05:43:43.027+0100 [mongosMain] connection accepted from 172.28.0.163:64272 #1424924 (400 connections now open) 2015-10-05T05:43:43.028+0100 [conn1424924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:43.413+0100 [conn1424429] end connection 172.28.0.164:56215 (399 connections now open) 2015-10-05T05:43:43.414+0100 [conn1424529] end connection 172.28.0.164:56445 (398 connections now open) 2015-10-05T05:43:43.416+0100 [mongosMain] connection accepted from 172.28.0.164:57350 #1424925 (399 connections now open) 2015-10-05T05:43:43.416+0100 [mongosMain] connection accepted from 172.28.0.164:57351 #1424926 (400 connections now open) 2015-10-05T05:43:43.417+0100 [conn1424925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:43.417+0100 [conn1424926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:45.146+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:43:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:43:48.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200045703b51053eba6b5 2015-10-05T05:43:48.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:48.607+0100 [conn1424423] end connection 172.28.0.164:56205 (399 connections now open) 2015-10-05T05:43:48.608+0100 [mongosMain] connection accepted from 172.28.0.164:57358 #1424927 (400 connections now open) 2015-10-05T05:43:48.609+0100 [conn1424927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:49.156+0100 [conn1424532] end connection 172.28.0.164:56457 (399 connections now open) 2015-10-05T05:43:49.157+0100 [mongosMain] connection accepted from 172.28.0.164:57359 #1424928 (400 connections now open) 2015-10-05T05:43:49.159+0100 [conn1424928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:49.563+0100 [conn1424533] end connection 172.28.0.163:63393 (399 connections now open) 2015-10-05T05:43:49.564+0100 [mongosMain] connection accepted from 172.28.0.163:64282 #1424929 (400 connections now open) 2015-10-05T05:43:49.565+0100 [conn1424929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:53.041+0100 [conn1424515] end connection 172.28.0.163:63364 (399 connections now open) 2015-10-05T05:43:53.042+0100 [mongosMain] connection accepted from 172.28.0.163:64288 #1424930 (400 connections now open) 2015-10-05T05:43:53.043+0100 [conn1424930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:53.414+0100 [conn1424462] end connection 172.28.0.164:56293 (399 connections now open) 2015-10-05T05:43:53.414+0100 [conn1424537] end connection 172.28.0.164:56469 (399 connections now open) 2015-10-05T05:43:53.415+0100 [mongosMain] connection accepted from 172.28.0.164:57366 #1424931 (399 connections now open) 2015-10-05T05:43:53.416+0100 [mongosMain] connection accepted from 172.28.0.164:57367 #1424932 (400 connections now open) 2015-10-05T05:43:53.417+0100 [conn1424931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:53.417+0100 [conn1424932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:54.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612000a5703b51053eba6db 2015-10-05T05:43:54.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:43:58.624+0100 [conn1424505] end connection 172.28.0.164:56389 (399 connections now open) 2015-10-05T05:43:58.625+0100 [mongosMain] connection accepted from 172.28.0.164:57371 #1424933 (400 connections now open) 2015-10-05T05:43:58.627+0100 [conn1424933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:59.171+0100 [conn1424541] end connection 172.28.0.164:56478 (399 connections now open) 2015-10-05T05:43:59.172+0100 [mongosMain] connection accepted from 172.28.0.164:57373 #1424934 (400 connections now open) 2015-10-05T05:43:59.174+0100 [conn1424934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:43:59.563+0100 [conn1424542] end connection 172.28.0.163:63412 (399 connections now open) 2015-10-05T05:43:59.564+0100 [mongosMain] connection accepted from 172.28.0.163:64300 #1424935 (400 connections now open) 2015-10-05T05:43:59.565+0100 [conn1424935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:00.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200105703b51053eba711 2015-10-05T05:44:01.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:03.057+0100 [conn1424482] end connection 172.28.0.163:63290 (399 connections now open) 2015-10-05T05:44:03.058+0100 [conn1424535] end connection 172.28.0.163:63399 (398 connections now open) 2015-10-05T05:44:03.058+0100 [mongosMain] connection accepted from 172.28.0.163:64312 #1424936 (399 connections now open) 2015-10-05T05:44:03.059+0100 [mongosMain] connection accepted from 172.28.0.163:64313 #1424937 (400 connections now open) 2015-10-05T05:44:03.059+0100 [conn1424936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:03.060+0100 [conn1424937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:03.457+0100 [conn1424528] end connection 172.28.0.164:56444 (399 connections now open) 2015-10-05T05:44:03.457+0100 [conn1424544] end connection 172.28.0.164:56483 (398 connections now open) 2015-10-05T05:44:03.457+0100 [mongosMain] connection accepted from 172.28.0.164:57379 #1424938 (399 connections now open) 2015-10-05T05:44:03.457+0100 [mongosMain] connection accepted from 172.28.0.164:57380 #1424939 (400 connections now open) 2015-10-05T05:44:03.457+0100 [conn1424938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:03.457+0100 [conn1424939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:07.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200175703b51053eba73d 2015-10-05T05:44:07.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:08.639+0100 [conn1424499] end connection 172.28.0.164:56375 (399 connections now open) 2015-10-05T05:44:08.640+0100 [mongosMain] connection accepted from 172.28.0.164:57384 #1424940 (400 connections now open) 2015-10-05T05:44:08.644+0100 [conn1424940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:08.985+0100 [conn1424512] end connection 172.28.0.163:63357 (399 connections now open) 2015-10-05T05:44:08.987+0100 [mongosMain] connection accepted from 172.28.0.163:64325 #1424941 (400 connections now open) 2015-10-05T05:44:08.988+0100 [conn1424941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:09.187+0100 [conn1424547] end connection 172.28.0.164:56490 (399 connections now open) 2015-10-05T05:44:09.188+0100 [mongosMain] connection accepted from 172.28.0.164:57386 #1424942 (400 connections now open) 2015-10-05T05:44:09.190+0100 [conn1424942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:09.578+0100 [conn1424548] end connection 172.28.0.163:63429 (399 connections now open) 2015-10-05T05:44:09.579+0100 [mongosMain] connection accepted from 172.28.0.163:64328 #1424943 (400 connections now open) 2015-10-05T05:44:09.580+0100 [conn1424943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:13.059+0100 [conn1424543] end connection 172.28.0.163:63417 (399 connections now open) 2015-10-05T05:44:13.059+0100 [conn1424490] end connection 172.28.0.163:63298 (399 connections now open) 2015-10-05T05:44:13.059+0100 [mongosMain] connection accepted from 172.28.0.163:64334 #1424944 (399 connections now open) 2015-10-05T05:44:13.060+0100 [mongosMain] connection accepted from 172.28.0.163:64335 #1424945 (400 connections now open) 2015-10-05T05:44:13.060+0100 [conn1424944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:13.060+0100 [conn1424945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:13.445+0100 [conn1424504] end connection 172.28.0.164:56384 (399 connections now open) 2015-10-05T05:44:13.445+0100 [conn1424522] end connection 172.28.0.164:56429 (399 connections now open) 2015-10-05T05:44:13.446+0100 [mongosMain] connection accepted from 172.28.0.164:57389 #1424946 (399 connections now open) 2015-10-05T05:44:13.447+0100 [mongosMain] connection accepted from 172.28.0.164:57390 #1424947 (400 connections now open) 2015-10-05T05:44:13.447+0100 [conn1424946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:13.448+0100 [conn1424947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:13.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612001d5703b51053eba77d 2015-10-05T05:44:13.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:15.424+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:44:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:44:18.639+0100 [conn1424545] end connection 172.28.0.164:56487 (399 connections now open) 2015-10-05T05:44:18.640+0100 [mongosMain] connection accepted from 172.28.0.164:57396 #1424948 (400 connections now open) 2015-10-05T05:44:18.642+0100 [conn1424948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:18.986+0100 [conn1424546] end connection 172.28.0.163:63426 (399 connections now open) 2015-10-05T05:44:18.988+0100 [mongosMain] connection accepted from 172.28.0.163:64343 #1424949 (400 connections now open) 2015-10-05T05:44:18.989+0100 [conn1424949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:19.185+0100 [conn1424555] end connection 172.28.0.164:56502 (399 connections now open) 2015-10-05T05:44:19.186+0100 [mongosMain] connection accepted from 172.28.0.164:57399 #1424950 (400 connections now open) 2015-10-05T05:44:19.187+0100 [conn1424950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:19.579+0100 [conn1424556] end connection 172.28.0.163:63451 (399 connections now open) 2015-10-05T05:44:19.580+0100 [mongosMain] connection accepted from 172.28.0.163:64345 #1424951 (400 connections now open) 2015-10-05T05:44:19.581+0100 [conn1424951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:23.073+0100 [conn1424516] end connection 172.28.0.163:63365 (399 connections now open) 2015-10-05T05:44:23.073+0100 [conn1424527] end connection 172.28.0.163:63386 (398 connections now open) 2015-10-05T05:44:23.075+0100 [mongosMain] connection accepted from 172.28.0.163:64349 #1424952 (399 connections now open) 2015-10-05T05:44:23.076+0100 [mongosMain] connection accepted from 172.28.0.163:64351 #1424953 (400 connections now open) 2015-10-05T05:44:23.076+0100 [conn1424952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:23.077+0100 [conn1424953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:23.446+0100 [conn1424538] end connection 172.28.0.164:56470 (399 connections now open) 2015-10-05T05:44:23.446+0100 [conn1424559] end connection 172.28.0.164:56505 (398 connections now open) 2015-10-05T05:44:23.447+0100 [mongosMain] connection accepted from 172.28.0.164:57410 #1424954 (399 connections now open) 2015-10-05T05:44:23.447+0100 [mongosMain] connection accepted from 172.28.0.164:57411 #1424955 (400 connections now open) 2015-10-05T05:44:23.448+0100 [conn1424954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:23.449+0100 [conn1424955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:26.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200295703b51053eba7b4 2015-10-05T05:44:26.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:28.579+0100 [mongosMain] connection accepted from 127.0.0.1:64352 #1424956 (401 connections now open) 2015-10-05T05:44:28.581+0100 [conn1424956] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:28.586+0100 [conn1424956] end connection 127.0.0.1:64352 (400 connections now open) 2015-10-05T05:44:28.639+0100 [conn1424539] end connection 172.28.0.164:56477 (399 connections now open) 2015-10-05T05:44:28.640+0100 [mongosMain] connection accepted from 172.28.0.164:57419 #1424957 (400 connections now open) 2015-10-05T05:44:28.642+0100 [conn1424957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:29.001+0100 [conn1424561] end connection 172.28.0.163:63464 (399 connections now open) 2015-10-05T05:44:29.002+0100 [mongosMain] connection accepted from 172.28.0.163:64353 #1424958 (400 connections now open) 2015-10-05T05:44:29.003+0100 [conn1424958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:29.185+0100 [conn1424562] end connection 172.28.0.164:56512 (399 connections now open) 2015-10-05T05:44:29.187+0100 [mongosMain] connection accepted from 172.28.0.164:57422 #1424959 (400 connections now open) 2015-10-05T05:44:29.188+0100 [conn1424959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:29.593+0100 [conn1424563] end connection 172.28.0.163:63466 (399 connections now open) 2015-10-05T05:44:29.594+0100 [mongosMain] connection accepted from 172.28.0.163:64355 #1424960 (400 connections now open) 2015-10-05T05:44:29.596+0100 [conn1424960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:32.428+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:44:32.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:44:33.076+0100 [conn1424558] end connection 172.28.0.163:63458 (399 connections now open) 2015-10-05T05:44:33.076+0100 [conn1424496] end connection 172.28.0.163:63308 (399 connections now open) 2015-10-05T05:44:33.077+0100 [mongosMain] connection accepted from 172.28.0.163:64358 #1424961 (399 connections now open) 2015-10-05T05:44:33.078+0100 [mongosMain] connection accepted from 172.28.0.163:64359 #1424962 (400 connections now open) 2015-10-05T05:44:33.079+0100 [conn1424961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:33.079+0100 [conn1424962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:33.461+0100 [conn1424523] end connection 172.28.0.164:56428 (399 connections now open) 2015-10-05T05:44:33.461+0100 [conn1424552] end connection 172.28.0.164:56496 (399 connections now open) 2015-10-05T05:44:33.462+0100 [mongosMain] connection accepted from 172.28.0.164:57428 #1424963 (399 connections now open) 2015-10-05T05:44:33.463+0100 [mongosMain] connection accepted from 172.28.0.164:57429 #1424964 (400 connections now open) 2015-10-05T05:44:33.465+0100 [conn1424963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:33.465+0100 [conn1424964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:38.655+0100 [conn1424519] end connection 172.28.0.164:56416 (399 connections now open) 2015-10-05T05:44:38.656+0100 [mongosMain] connection accepted from 172.28.0.164:57436 #1424965 (400 connections now open) 2015-10-05T05:44:38.658+0100 [conn1424965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:38.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200365703b51053eba80e 2015-10-05T05:44:38.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:39.001+0100 [conn1424531] end connection 172.28.0.163:63391 (399 connections now open) 2015-10-05T05:44:39.003+0100 [mongosMain] connection accepted from 172.28.0.163:64363 #1424966 (400 connections now open) 2015-10-05T05:44:39.004+0100 [conn1424966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:39.181+0100 [mongosMain] connection accepted from 127.0.0.1:64365 #1424967 (401 connections now open) 2015-10-05T05:44:39.184+0100 [conn1424967] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:39.189+0100 [conn1424967] end connection 127.0.0.1:64365 (400 connections now open) 2015-10-05T05:44:39.201+0100 [conn1424571] end connection 172.28.0.164:56533 (399 connections now open) 2015-10-05T05:44:39.202+0100 [mongosMain] connection accepted from 172.28.0.164:57440 #1424968 (400 connections now open) 2015-10-05T05:44:39.203+0100 [conn1424968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:39.609+0100 [conn1424572] end connection 172.28.0.163:63479 (399 connections now open) 2015-10-05T05:44:39.610+0100 [mongosMain] connection accepted from 172.28.0.163:64366 #1424969 (400 connections now open) 2015-10-05T05:44:39.611+0100 [conn1424969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:43.089+0100 [conn1424549] end connection 172.28.0.163:63438 (399 connections now open) 2015-10-05T05:44:43.090+0100 [conn1424536] end connection 172.28.0.163:63400 (398 connections now open) 2015-10-05T05:44:43.090+0100 [mongosMain] connection accepted from 172.28.0.163:64372 #1424970 (399 connections now open) 2015-10-05T05:44:43.091+0100 [mongosMain] connection accepted from 172.28.0.163:64373 #1424971 (400 connections now open) 2015-10-05T05:44:43.092+0100 [conn1424970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:43.093+0100 [conn1424971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:43.461+0100 [conn1424518] end connection 172.28.0.164:56407 (399 connections now open) 2015-10-05T05:44:43.461+0100 [conn1424567] end connection 172.28.0.164:56521 (398 connections now open) 2015-10-05T05:44:43.462+0100 [mongosMain] connection accepted from 172.28.0.164:57446 #1424972 (399 connections now open) 2015-10-05T05:44:43.463+0100 [mongosMain] connection accepted from 172.28.0.164:57447 #1424973 (400 connections now open) 2015-10-05T05:44:43.464+0100 [conn1424972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:43.465+0100 [conn1424973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:45.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612003c5703b51053eba834 2015-10-05T05:44:45.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:45.678+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:44:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:44:48.671+0100 [conn1424560] end connection 172.28.0.164:56510 (399 connections now open) 2015-10-05T05:44:48.672+0100 [mongosMain] connection accepted from 172.28.0.164:57456 #1424974 (400 connections now open) 2015-10-05T05:44:48.673+0100 [conn1424974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:49.017+0100 [conn1424569] end connection 172.28.0.163:63476 (399 connections now open) 2015-10-05T05:44:49.018+0100 [mongosMain] connection accepted from 172.28.0.163:64382 #1424975 (400 connections now open) 2015-10-05T05:44:49.020+0100 [conn1424975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:49.217+0100 [conn1424579] end connection 172.28.0.164:56552 (399 connections now open) 2015-10-05T05:44:49.218+0100 [mongosMain] connection accepted from 172.28.0.164:57458 #1424976 (400 connections now open) 2015-10-05T05:44:49.220+0100 [conn1424976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:49.610+0100 [conn1424580] end connection 172.28.0.163:63489 (399 connections now open) 2015-10-05T05:44:49.611+0100 [mongosMain] connection accepted from 172.28.0.163:64385 #1424977 (400 connections now open) 2015-10-05T05:44:49.612+0100 [conn1424977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:51.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200435703b51053eba85e 2015-10-05T05:44:51.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:53.094+0100 [conn1424317] end connection 172.28.0.163:62867 (399 connections now open) 2015-10-05T05:44:53.095+0100 [conn1424564] end connection 172.28.0.163:63472 (398 connections now open) 2015-10-05T05:44:53.096+0100 [mongosMain] connection accepted from 172.28.0.163:64389 #1424978 (399 connections now open) 2015-10-05T05:44:53.096+0100 [mongosMain] connection accepted from 172.28.0.163:64390 #1424979 (400 connections now open) 2015-10-05T05:44:53.097+0100 [conn1424978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:53.097+0100 [conn1424979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:53.477+0100 [conn1424585] end connection 172.28.0.164:56566 (399 connections now open) 2015-10-05T05:44:53.477+0100 [conn1424442] end connection 172.28.0.164:56239 (398 connections now open) 2015-10-05T05:44:53.478+0100 [mongosMain] connection accepted from 172.28.0.164:57467 #1424980 (399 connections now open) 2015-10-05T05:44:53.478+0100 [mongosMain] connection accepted from 172.28.0.164:57468 #1424981 (400 connections now open) 2015-10-05T05:44:53.479+0100 [conn1424980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:53.480+0100 [conn1424981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:57.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200495703b51053eba888 2015-10-05T05:44:57.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:44:58.687+0100 [conn1424553] end connection 172.28.0.164:56500 (399 connections now open) 2015-10-05T05:44:58.688+0100 [mongosMain] connection accepted from 172.28.0.164:57472 #1424982 (400 connections now open) 2015-10-05T05:44:58.689+0100 [conn1424982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:59.017+0100 [conn1424540] end connection 172.28.0.163:63409 (399 connections now open) 2015-10-05T05:44:59.019+0100 [mongosMain] connection accepted from 172.28.0.163:64400 #1424983 (400 connections now open) 2015-10-05T05:44:59.020+0100 [conn1424983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:59.232+0100 [conn1424588] end connection 172.28.0.164:56575 (399 connections now open) 2015-10-05T05:44:59.233+0100 [mongosMain] connection accepted from 172.28.0.164:57474 #1424984 (400 connections now open) 2015-10-05T05:44:59.235+0100 [conn1424984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:44:59.626+0100 [conn1424589] end connection 172.28.0.163:63506 (399 connections now open) 2015-10-05T05:44:59.627+0100 [mongosMain] connection accepted from 172.28.0.163:64402 #1424985 (400 connections now open) 2015-10-05T05:44:59.628+0100 [conn1424985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:03.105+0100 [conn1424573] end connection 172.28.0.163:63482 (399 connections now open) 2015-10-05T05:45:03.105+0100 [conn1424550] end connection 172.28.0.163:63439 (398 connections now open) 2015-10-05T05:45:03.106+0100 [mongosMain] connection accepted from 172.28.0.163:64412 #1424986 (399 connections now open) 2015-10-05T05:45:03.106+0100 [mongosMain] connection accepted from 172.28.0.163:64413 #1424987 (400 connections now open) 2015-10-05T05:45:03.107+0100 [conn1424986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:03.107+0100 [conn1424987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:03.477+0100 [conn1424592] end connection 172.28.0.164:56582 (399 connections now open) 2015-10-05T05:45:03.477+0100 [conn1424551] end connection 172.28.0.164:56497 (399 connections now open) 2015-10-05T05:45:03.478+0100 [mongosMain] connection accepted from 172.28.0.164:57480 #1424988 (399 connections now open) 2015-10-05T05:45:03.478+0100 [mongosMain] connection accepted from 172.28.0.164:57481 #1424989 (400 connections now open) 2015-10-05T05:45:03.479+0100 [conn1424988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:03.480+0100 [conn1424989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:04.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612004f5703b51053eba8b8 2015-10-05T05:45:04.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:08.703+0100 [conn1424577] end connection 172.28.0.164:56550 (399 connections now open) 2015-10-05T05:45:08.705+0100 [mongosMain] connection accepted from 172.28.0.164:57484 #1424990 (400 connections now open) 2015-10-05T05:45:08.706+0100 [conn1424990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:09.032+0100 [conn1424554] end connection 172.28.0.163:63448 (399 connections now open) 2015-10-05T05:45:09.033+0100 [mongosMain] connection accepted from 172.28.0.163:64423 #1424991 (400 connections now open) 2015-10-05T05:45:09.034+0100 [conn1424991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:09.233+0100 [conn1424596] end connection 172.28.0.164:56593 (399 connections now open) 2015-10-05T05:45:09.234+0100 [mongosMain] connection accepted from 172.28.0.164:57486 #1424992 (400 connections now open) 2015-10-05T05:45:09.236+0100 [conn1424992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:09.625+0100 [conn1424597] end connection 172.28.0.163:63523 (399 connections now open) 2015-10-05T05:45:09.627+0100 [mongosMain] connection accepted from 172.28.0.163:64425 #1424993 (400 connections now open) 2015-10-05T05:45:09.628+0100 [conn1424993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:10.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200565703b51053eba8e7 2015-10-05T05:45:10.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:13.120+0100 [conn1424583] end connection 172.28.0.163:63496 (399 connections now open) 2015-10-05T05:45:13.120+0100 [conn1424565] end connection 172.28.0.163:63473 (399 connections now open) 2015-10-05T05:45:13.122+0100 [mongosMain] connection accepted from 172.28.0.163:64429 #1424994 (399 connections now open) 2015-10-05T05:45:13.122+0100 [mongosMain] connection accepted from 172.28.0.163:64430 #1424995 (400 connections now open) 2015-10-05T05:45:13.122+0100 [conn1424994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:13.123+0100 [conn1424995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:13.492+0100 [conn1424576] end connection 172.28.0.164:56541 (399 connections now open) 2015-10-05T05:45:13.492+0100 [conn1424498] end connection 172.28.0.164:56366 (398 connections now open) 2015-10-05T05:45:13.494+0100 [mongosMain] connection accepted from 172.28.0.164:57489 #1424996 (399 connections now open) 2015-10-05T05:45:13.494+0100 [mongosMain] connection accepted from 172.28.0.164:57490 #1424997 (400 connections now open) 2015-10-05T05:45:13.495+0100 [conn1424996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:13.496+0100 [conn1424997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:15.969+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:45:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:45:16.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612005c5703b51053eba90e 2015-10-05T05:45:16.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:18.717+0100 [conn1424586] end connection 172.28.0.164:56573 (399 connections now open) 2015-10-05T05:45:18.718+0100 [mongosMain] connection accepted from 172.28.0.164:57496 #1424998 (400 connections now open) 2015-10-05T05:45:18.720+0100 [conn1424998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:19.033+0100 [conn1424587] end connection 172.28.0.163:63504 (399 connections now open) 2015-10-05T05:45:19.035+0100 [mongosMain] connection accepted from 172.28.0.163:64437 #1424999 (400 connections now open) 2015-10-05T05:45:19.036+0100 [conn1424999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:19.248+0100 [conn1424604] end connection 172.28.0.164:56605 (399 connections now open) 2015-10-05T05:45:19.249+0100 [mongosMain] connection accepted from 172.28.0.164:57498 #1425000 (400 connections now open) 2015-10-05T05:45:19.251+0100 [conn1425000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:19.641+0100 [conn1424605] end connection 172.28.0.163:63548 (399 connections now open) 2015-10-05T05:45:19.643+0100 [mongosMain] connection accepted from 172.28.0.163:64439 #1425001 (400 connections now open) 2015-10-05T05:45:19.644+0100 [conn1425001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:23.122+0100 [conn1424599] end connection 172.28.0.163:63534 (399 connections now open) 2015-10-05T05:45:23.122+0100 [conn1424557] end connection 172.28.0.163:63457 (399 connections now open) 2015-10-05T05:45:23.123+0100 [mongosMain] connection accepted from 172.28.0.163:64443 #1425002 (399 connections now open) 2015-10-05T05:45:23.123+0100 [mongosMain] connection accepted from 172.28.0.163:64444 #1425003 (400 connections now open) 2015-10-05T05:45:23.124+0100 [conn1425002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:23.124+0100 [conn1425003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:23.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200625703b51053eba93d 2015-10-05T05:45:23.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:23.508+0100 [conn1424608] end connection 172.28.0.164:56609 (399 connections now open) 2015-10-05T05:45:23.509+0100 [conn1424584] end connection 172.28.0.164:56565 (398 connections now open) 2015-10-05T05:45:23.510+0100 [mongosMain] connection accepted from 172.28.0.164:57507 #1425004 (399 connections now open) 2015-10-05T05:45:23.510+0100 [mongosMain] connection accepted from 172.28.0.164:57506 #1425005 (400 connections now open) 2015-10-05T05:45:23.511+0100 [conn1425004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:23.512+0100 [conn1425005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:28.617+0100 [mongosMain] connection accepted from 127.0.0.1:64447 #1425006 (401 connections now open) 2015-10-05T05:45:28.620+0100 [conn1425006] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:28.625+0100 [conn1425006] end connection 127.0.0.1:64447 (400 connections now open) 2015-10-05T05:45:28.733+0100 [conn1424594] end connection 172.28.0.164:56591 (399 connections now open) 2015-10-05T05:45:28.735+0100 [mongosMain] connection accepted from 172.28.0.164:57514 #1425007 (400 connections now open) 2015-10-05T05:45:28.737+0100 [conn1425007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:29.048+0100 [conn1424595] end connection 172.28.0.163:63520 (399 connections now open) 2015-10-05T05:45:29.050+0100 [mongosMain] connection accepted from 172.28.0.163:64448 #1425008 (400 connections now open) 2015-10-05T05:45:29.051+0100 [conn1425008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:29.264+0100 [conn1424612] end connection 172.28.0.164:56616 (399 connections now open) 2015-10-05T05:45:29.265+0100 [mongosMain] connection accepted from 172.28.0.164:57516 #1425009 (400 connections now open) 2015-10-05T05:45:29.267+0100 [conn1425009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:29.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200695703b51053eba964 2015-10-05T05:45:29.641+0100 [conn1424613] end connection 172.28.0.163:63563 (399 connections now open) 2015-10-05T05:45:29.642+0100 [mongosMain] connection accepted from 172.28.0.163:64450 #1425010 (400 connections now open) 2015-10-05T05:45:29.643+0100 [conn1425010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:29.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:33.136+0100 [conn1424614] end connection 172.28.0.163:63568 (399 connections now open) 2015-10-05T05:45:33.136+0100 [conn1424590] end connection 172.28.0.163:63511 (399 connections now open) 2015-10-05T05:45:33.137+0100 [mongosMain] connection accepted from 172.28.0.163:64454 #1425011 (399 connections now open) 2015-10-05T05:45:33.138+0100 [mongosMain] connection accepted from 172.28.0.163:64455 #1425012 (400 connections now open) 2015-10-05T05:45:33.138+0100 [conn1425011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:33.139+0100 [conn1425012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:33.508+0100 [conn1424615] end connection 172.28.0.164:56626 (399 connections now open) 2015-10-05T05:45:33.508+0100 [conn1424593] end connection 172.28.0.164:56584 (398 connections now open) 2015-10-05T05:45:33.509+0100 [mongosMain] connection accepted from 172.28.0.164:57524 #1425013 (399 connections now open) 2015-10-05T05:45:33.510+0100 [mongosMain] connection accepted from 172.28.0.164:57525 #1425014 (400 connections now open) 2015-10-05T05:45:33.510+0100 [conn1425013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:33.511+0100 [conn1425014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:35.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612006f5703b51053eba991 2015-10-05T05:45:35.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:38.749+0100 [conn1424568] end connection 172.28.0.164:56530 (399 connections now open) 2015-10-05T05:45:38.750+0100 [mongosMain] connection accepted from 172.28.0.164:57537 #1425015 (400 connections now open) 2015-10-05T05:45:38.752+0100 [conn1425015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:39.064+0100 [conn1424578] end connection 172.28.0.163:63487 (399 connections now open) 2015-10-05T05:45:39.065+0100 [mongosMain] connection accepted from 172.28.0.163:64459 #1425016 (400 connections now open) 2015-10-05T05:45:39.067+0100 [conn1425016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:39.279+0100 [conn1424620] end connection 172.28.0.164:56636 (399 connections now open) 2015-10-05T05:45:39.281+0100 [mongosMain] connection accepted from 172.28.0.164:57538 #1425017 (400 connections now open) 2015-10-05T05:45:39.282+0100 [conn1425017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:39.657+0100 [conn1424621] end connection 172.28.0.163:63575 (399 connections now open) 2015-10-05T05:45:39.658+0100 [mongosMain] connection accepted from 172.28.0.163:64461 #1425018 (400 connections now open) 2015-10-05T05:45:39.659+0100 [conn1425018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:39.860+0100 [mongosMain] connection accepted from 127.0.0.1:64464 #1425019 (401 connections now open) 2015-10-05T05:45:39.863+0100 [conn1425019] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:39.869+0100 [conn1425019] end connection 127.0.0.1:64464 (400 connections now open) 2015-10-05T05:45:42.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200755703b51053eba9b5 2015-10-05T05:45:42.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:43.136+0100 [conn1424607] end connection 172.28.0.163:63552 (399 connections now open) 2015-10-05T05:45:43.137+0100 [mongosMain] connection accepted from 172.28.0.163:64469 #1425020 (400 connections now open) 2015-10-05T05:45:43.139+0100 [conn1424473] end connection 172.28.0.163:63275 (399 connections now open) 2015-10-05T05:45:43.139+0100 [conn1425020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:43.139+0100 [mongosMain] connection accepted from 172.28.0.163:64471 #1425021 (400 connections now open) 2015-10-05T05:45:43.140+0100 [conn1425021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:43.524+0100 [conn1424600] end connection 172.28.0.164:56600 (399 connections now open) 2015-10-05T05:45:43.525+0100 [mongosMain] connection accepted from 172.28.0.164:57546 #1425022 (400 connections now open) 2015-10-05T05:45:43.527+0100 [conn1425022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:46.242+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:45:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:45:48.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612007c5703b51053eba9e1 2015-10-05T05:45:48.749+0100 [conn1424530] end connection 172.28.0.164:56453 (399 connections now open) 2015-10-05T05:45:48.750+0100 [mongosMain] connection accepted from 172.28.0.164:57555 #1425023 (400 connections now open) 2015-10-05T05:45:48.753+0100 [conn1425023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:48.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:49.064+0100 [conn1424464] end connection 172.28.0.163:63246 (399 connections now open) 2015-10-05T05:45:49.065+0100 [mongosMain] connection accepted from 172.28.0.163:64478 #1425024 (400 connections now open) 2015-10-05T05:45:49.066+0100 [conn1425024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:49.296+0100 [conn1424627] end connection 172.28.0.164:56656 (399 connections now open) 2015-10-05T05:45:49.297+0100 [mongosMain] connection accepted from 172.28.0.164:57557 #1425025 (400 connections now open) 2015-10-05T05:45:49.300+0100 [conn1425025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:49.657+0100 [conn1424628] end connection 172.28.0.163:63585 (399 connections now open) 2015-10-05T05:45:49.658+0100 [mongosMain] connection accepted from 172.28.0.163:64482 #1425026 (400 connections now open) 2015-10-05T05:45:49.660+0100 [conn1425026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:53.153+0100 [conn1424598] end connection 172.28.0.163:63533 (399 connections now open) 2015-10-05T05:45:53.153+0100 [conn1424622] end connection 172.28.0.163:63579 (398 connections now open) 2015-10-05T05:45:53.154+0100 [mongosMain] connection accepted from 172.28.0.163:64488 #1425027 (399 connections now open) 2015-10-05T05:45:53.155+0100 [mongosMain] connection accepted from 172.28.0.163:64489 #1425028 (400 connections now open) 2015-10-05T05:45:53.155+0100 [conn1425027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:53.156+0100 [conn1425028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:53.540+0100 [conn1424625] end connection 172.28.0.164:56646 (399 connections now open) 2015-10-05T05:45:53.540+0100 [conn1424632] end connection 172.28.0.164:56664 (398 connections now open) 2015-10-05T05:45:53.541+0100 [mongosMain] connection accepted from 172.28.0.164:57561 #1425029 (399 connections now open) 2015-10-05T05:45:53.542+0100 [mongosMain] connection accepted from 172.28.0.164:57562 #1425030 (400 connections now open) 2015-10-05T05:45:53.543+0100 [conn1425029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:53.544+0100 [conn1425030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:54.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200825703b51053eba9fa 2015-10-05T05:45:55.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:45:59.311+0100 [conn1424635] end connection 172.28.0.164:56675 (399 connections now open) 2015-10-05T05:45:59.312+0100 [mongosMain] connection accepted from 172.28.0.164:57570 #1425031 (400 connections now open) 2015-10-05T05:45:59.314+0100 [conn1425031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:45:59.672+0100 [conn1424636] end connection 172.28.0.163:63606 (399 connections now open) 2015-10-05T05:45:59.673+0100 [mongosMain] connection accepted from 172.28.0.163:64501 #1425032 (400 connections now open) 2015-10-05T05:45:59.674+0100 [conn1425032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:01.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200895703b51053ebaa03 2015-10-05T05:46:01.237+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:03.159+0100 [conn1424631] end connection 172.28.0.163:63594 (399 connections now open) 2015-10-05T05:46:03.159+0100 [conn1424606] end connection 172.28.0.163:63551 (398 connections now open) 2015-10-05T05:46:03.160+0100 [mongosMain] connection accepted from 172.28.0.163:64513 #1425033 (399 connections now open) 2015-10-05T05:46:03.160+0100 [mongosMain] connection accepted from 172.28.0.163:64514 #1425034 (400 connections now open) 2015-10-05T05:46:03.161+0100 [conn1425033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:03.161+0100 [conn1425034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:03.540+0100 [conn1424633] end connection 172.28.0.164:56665 (399 connections now open) 2015-10-05T05:46:03.540+0100 [conn1424575] end connection 172.28.0.164:56540 (398 connections now open) 2015-10-05T05:46:03.541+0100 [mongosMain] connection accepted from 172.28.0.164:57576 #1425035 (399 connections now open) 2015-10-05T05:46:03.541+0100 [mongosMain] connection accepted from 172.28.0.164:57577 #1425036 (400 connections now open) 2015-10-05T05:46:03.543+0100 [conn1425035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:03.543+0100 [conn1425036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:07.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612008f5703b51053ebaa37 2015-10-05T05:46:07.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:08.765+0100 [conn1424617] end connection 172.28.0.164:56634 (399 connections now open) 2015-10-05T05:46:08.766+0100 [mongosMain] connection accepted from 172.28.0.164:57580 #1425037 (400 connections now open) 2015-10-05T05:46:08.767+0100 [conn1425037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:09.311+0100 [conn1424643] end connection 172.28.0.164:56689 (399 connections now open) 2015-10-05T05:46:09.312+0100 [mongosMain] connection accepted from 172.28.0.164:57582 #1425038 (400 connections now open) 2015-10-05T05:46:09.314+0100 [conn1425038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:09.688+0100 [conn1424644] end connection 172.28.0.163:63624 (399 connections now open) 2015-10-05T05:46:09.689+0100 [mongosMain] connection accepted from 172.28.0.163:64525 #1425039 (400 connections now open) 2015-10-05T05:46:09.690+0100 [conn1425039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:13.168+0100 [conn1424460] end connection 172.28.0.163:63235 (399 connections now open) 2015-10-05T05:46:13.168+0100 [conn1424637] end connection 172.28.0.163:63611 (399 connections now open) 2015-10-05T05:46:13.169+0100 [mongosMain] connection accepted from 172.28.0.163:64528 #1425040 (399 connections now open) 2015-10-05T05:46:13.170+0100 [mongosMain] connection accepted from 172.28.0.163:64529 #1425041 (400 connections now open) 2015-10-05T05:46:13.171+0100 [conn1425040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:13.171+0100 [conn1425041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:13.555+0100 [conn1424647] end connection 172.28.0.164:56694 (399 connections now open) 2015-10-05T05:46:13.555+0100 [conn1424566] end connection 172.28.0.164:56520 (398 connections now open) 2015-10-05T05:46:13.557+0100 [mongosMain] connection accepted from 172.28.0.164:57585 #1425042 (399 connections now open) 2015-10-05T05:46:13.557+0100 [mongosMain] connection accepted from 172.28.0.164:57586 #1425043 (400 connections now open) 2015-10-05T05:46:13.558+0100 [conn1425042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:13.559+0100 [conn1425043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:13.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200955703b51053ebaa55 2015-10-05T05:46:14.077+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:16.502+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:46:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:46:18.781+0100 [conn1424602] end connection 172.28.0.164:56603 (399 connections now open) 2015-10-05T05:46:18.782+0100 [mongosMain] connection accepted from 172.28.0.164:57593 #1425044 (400 connections now open) 2015-10-05T05:46:18.784+0100 [conn1425044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:19.330+0100 [conn1424650] end connection 172.28.0.164:56700 (399 connections now open) 2015-10-05T05:46:19.332+0100 [mongosMain] connection accepted from 172.28.0.164:57597 #1425045 (400 connections now open) 2015-10-05T05:46:19.333+0100 [conn1425045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:19.688+0100 [conn1424651] end connection 172.28.0.163:63644 (399 connections now open) 2015-10-05T05:46:19.689+0100 [mongosMain] connection accepted from 172.28.0.163:64535 #1425046 (400 connections now open) 2015-10-05T05:46:19.691+0100 [conn1425046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:20.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612009c5703b51053ebaa75 2015-10-05T05:46:20.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:23.171+0100 [conn1424645] end connection 172.28.0.163:63633 (399 connections now open) 2015-10-05T05:46:23.171+0100 [conn1424582] end connection 172.28.0.163:63495 (399 connections now open) 2015-10-05T05:46:23.172+0100 [mongosMain] connection accepted from 172.28.0.163:64539 #1425047 (399 connections now open) 2015-10-05T05:46:23.172+0100 [mongosMain] connection accepted from 172.28.0.163:64540 #1425048 (400 connections now open) 2015-10-05T05:46:23.173+0100 [conn1425047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:23.173+0100 [conn1425048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:23.571+0100 [conn1424655] end connection 172.28.0.164:56705 (399 connections now open) 2015-10-05T05:46:23.572+0100 [mongosMain] connection accepted from 172.28.0.164:57605 #1425049 (400 connections now open) 2015-10-05T05:46:23.574+0100 [conn1425049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:26.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200a25703b51053ebaa9c 2015-10-05T05:46:26.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:28.797+0100 [conn1424649] end connection 172.28.0.164:56698 (399 connections now open) 2015-10-05T05:46:28.798+0100 [mongosMain] connection accepted from 172.28.0.164:57612 #1425050 (400 connections now open) 2015-10-05T05:46:28.800+0100 [conn1425050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:29.021+0100 [mongosMain] connection accepted from 127.0.0.1:64544 #1425051 (401 connections now open) 2015-10-05T05:46:29.023+0100 [conn1425051] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:29.028+0100 [conn1425051] end connection 127.0.0.1:64544 (400 connections now open) 2015-10-05T05:46:29.327+0100 [conn1424657] end connection 172.28.0.164:56711 (399 connections now open) 2015-10-05T05:46:29.330+0100 [mongosMain] connection accepted from 172.28.0.164:57615 #1425052 (400 connections now open) 2015-10-05T05:46:29.331+0100 [conn1425052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:29.705+0100 [conn1424658] end connection 172.28.0.163:63655 (399 connections now open) 2015-10-05T05:46:29.706+0100 [mongosMain] connection accepted from 172.28.0.163:64545 #1425053 (400 connections now open) 2015-10-05T05:46:29.707+0100 [conn1425053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:32.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200a85703b51053ebaabb 2015-10-05T05:46:33.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:33.183+0100 [conn1424653] end connection 172.28.0.163:63649 (399 connections now open) 2015-10-05T05:46:33.184+0100 [mongosMain] connection accepted from 172.28.0.163:64547 #1425054 (400 connections now open) 2015-10-05T05:46:33.185+0100 [conn1425054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:33.586+0100 [conn1424661] end connection 172.28.0.164:56720 (399 connections now open) 2015-10-05T05:46:33.588+0100 [mongosMain] connection accepted from 172.28.0.164:57623 #1425055 (400 connections now open) 2015-10-05T05:46:33.589+0100 [conn1425055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:38.812+0100 [conn1424641] end connection 172.28.0.164:56687 (399 connections now open) 2015-10-05T05:46:38.814+0100 [mongosMain] connection accepted from 172.28.0.164:57633 #1425056 (400 connections now open) 2015-10-05T05:46:38.815+0100 [conn1425056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:39.111+0100 [conn1424619] end connection 172.28.0.163:63570 (399 connections now open) 2015-10-05T05:46:39.112+0100 [mongosMain] connection accepted from 172.28.0.163:64551 #1425057 (400 connections now open) 2015-10-05T05:46:39.113+0100 [conn1425057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:39.343+0100 [conn1424665] end connection 172.28.0.164:56731 (399 connections now open) 2015-10-05T05:46:39.344+0100 [mongosMain] connection accepted from 172.28.0.164:57635 #1425058 (400 connections now open) 2015-10-05T05:46:39.345+0100 [conn1425058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:39.385+0100 [mongosMain] connection accepted from 127.0.0.1:64553 #1425059 (401 connections now open) 2015-10-05T05:46:39.388+0100 [conn1425059] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:39.392+0100 [conn1425059] end connection 127.0.0.1:64553 (400 connections now open) 2015-10-05T05:46:39.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200af5703b51053ebaae9 2015-10-05T05:46:39.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:39.704+0100 [conn1424666] end connection 172.28.0.163:63666 (399 connections now open) 2015-10-05T05:46:39.705+0100 [mongosMain] connection accepted from 172.28.0.163:64554 #1425060 (400 connections now open) 2015-10-05T05:46:39.706+0100 [conn1425060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:43.199+0100 [conn1424660] end connection 172.28.0.163:63663 (399 connections now open) 2015-10-05T05:46:43.200+0100 [mongosMain] connection accepted from 172.28.0.163:64559 #1425061 (400 connections now open) 2015-10-05T05:46:43.202+0100 [conn1425061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:43.602+0100 [conn1424639] end connection 172.28.0.164:56681 (399 connections now open) 2015-10-05T05:46:43.603+0100 [conn1424624] end connection 172.28.0.164:56645 (398 connections now open) 2015-10-05T05:46:43.604+0100 [mongosMain] connection accepted from 172.28.0.164:57642 #1425062 (399 connections now open) 2015-10-05T05:46:43.604+0100 [mongosMain] connection accepted from 172.28.0.164:57643 #1425063 (400 connections now open) 2015-10-05T05:46:43.605+0100 [conn1425062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:43.606+0100 [conn1425063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:45.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200b55703b51053ebab1a 2015-10-05T05:46:45.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:46.646+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:46:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:46:48.827+0100 [conn1424626] end connection 172.28.0.164:56654 (399 connections now open) 2015-10-05T05:46:48.828+0100 [mongosMain] connection accepted from 172.28.0.164:57652 #1425064 (400 connections now open) 2015-10-05T05:46:48.829+0100 [conn1425064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:49.358+0100 [conn1424672] end connection 172.28.0.164:56753 (399 connections now open) 2015-10-05T05:46:49.359+0100 [mongosMain] connection accepted from 172.28.0.164:57654 #1425065 (400 connections now open) 2015-10-05T05:46:49.362+0100 [conn1425065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:49.720+0100 [conn1424673] end connection 172.28.0.163:63672 (399 connections now open) 2015-10-05T05:46:49.721+0100 [mongosMain] connection accepted from 172.28.0.163:64571 #1425066 (400 connections now open) 2015-10-05T05:46:49.723+0100 [conn1425066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:51.906+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200bb5703b51053ebab4f 2015-10-05T05:46:51.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:53.200+0100 [conn1424675] end connection 172.28.0.163:63679 (399 connections now open) 2015-10-05T05:46:53.202+0100 [mongosMain] connection accepted from 172.28.0.163:64578 #1425067 (400 connections now open) 2015-10-05T05:46:53.203+0100 [conn1425067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:53.617+0100 [conn1424669] end connection 172.28.0.164:56738 (399 connections now open) 2015-10-05T05:46:53.618+0100 [conn1424601] end connection 172.28.0.164:56601 (398 connections now open) 2015-10-05T05:46:53.618+0100 [mongosMain] connection accepted from 172.28.0.164:57661 #1425068 (399 connections now open) 2015-10-05T05:46:53.618+0100 [mongosMain] connection accepted from 172.28.0.164:57662 #1425069 (400 connections now open) 2015-10-05T05:46:53.620+0100 [conn1425068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:53.620+0100 [conn1425069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:58.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200c15703b51053ebab78 2015-10-05T05:46:58.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:46:59.359+0100 [conn1424679] end connection 172.28.0.164:56770 (399 connections now open) 2015-10-05T05:46:59.360+0100 [mongosMain] connection accepted from 172.28.0.164:57668 #1425070 (400 connections now open) 2015-10-05T05:46:59.362+0100 [conn1425070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:46:59.720+0100 [conn1424680] end connection 172.28.0.163:63687 (399 connections now open) 2015-10-05T05:46:59.722+0100 [mongosMain] connection accepted from 172.28.0.163:64588 #1425071 (400 connections now open) 2015-10-05T05:46:59.723+0100 [conn1425071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:03.618+0100 [conn1424662] end connection 172.28.0.164:56721 (399 connections now open) 2015-10-05T05:47:03.618+0100 [conn1424677] end connection 172.28.0.164:56761 (399 connections now open) 2015-10-05T05:47:03.620+0100 [mongosMain] connection accepted from 172.28.0.164:57674 #1425072 (399 connections now open) 2015-10-05T05:47:03.620+0100 [mongosMain] connection accepted from 172.28.0.164:57675 #1425073 (400 connections now open) 2015-10-05T05:47:03.622+0100 [conn1425072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:03.623+0100 [conn1425073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:04.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200c85703b51053ebabba 2015-10-05T05:47:04.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:08.844+0100 [conn1424656] end connection 172.28.0.164:56709 (399 connections now open) 2015-10-05T05:47:08.846+0100 [mongosMain] connection accepted from 172.28.0.164:57676 #1425074 (400 connections now open) 2015-10-05T05:47:08.847+0100 [conn1425074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:09.143+0100 [conn1424642] end connection 172.28.0.163:63621 (399 connections now open) 2015-10-05T05:47:09.144+0100 [mongosMain] connection accepted from 172.28.0.163:64608 #1425075 (400 connections now open) 2015-10-05T05:47:09.146+0100 [conn1425075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:09.375+0100 [conn1424686] end connection 172.28.0.164:56784 (399 connections now open) 2015-10-05T05:47:09.376+0100 [mongosMain] connection accepted from 172.28.0.164:57678 #1425076 (400 connections now open) 2015-10-05T05:47:09.377+0100 [conn1425076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:09.735+0100 [conn1424687] end connection 172.28.0.163:63704 (399 connections now open) 2015-10-05T05:47:09.736+0100 [mongosMain] connection accepted from 172.28.0.163:64610 #1425077 (400 connections now open) 2015-10-05T05:47:09.737+0100 [conn1425077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:11.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200ce5703b51053ebabed 2015-10-05T05:47:11.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:13.216+0100 [conn1424623] end connection 172.28.0.163:63580 (399 connections now open) 2015-10-05T05:47:13.216+0100 [conn1424688] end connection 172.28.0.163:63714 (399 connections now open) 2015-10-05T05:47:13.217+0100 [mongosMain] connection accepted from 172.28.0.163:64616 #1425078 (399 connections now open) 2015-10-05T05:47:13.217+0100 [mongosMain] connection accepted from 172.28.0.163:64617 #1425079 (400 connections now open) 2015-10-05T05:47:13.218+0100 [conn1425078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:13.218+0100 [conn1425079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:13.634+0100 [conn1424684] end connection 172.28.0.164:56776 (399 connections now open) 2015-10-05T05:47:13.635+0100 [mongosMain] connection accepted from 172.28.0.164:57681 #1425080 (400 connections now open) 2015-10-05T05:47:13.636+0100 [conn1424616] end connection 172.28.0.164:56627 (399 connections now open) 2015-10-05T05:47:13.637+0100 [mongosMain] connection accepted from 172.28.0.164:57684 #1425081 (400 connections now open) 2015-10-05T05:47:13.638+0100 [conn1425080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:13.639+0100 [conn1425081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:16.771+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:47:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:47:17.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200d55703b51053ebac1b 2015-10-05T05:47:17.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:19.143+0100 [conn1424603] end connection 172.28.0.163:63546 (399 connections now open) 2015-10-05T05:47:19.144+0100 [mongosMain] connection accepted from 172.28.0.163:64626 #1425082 (400 connections now open) 2015-10-05T05:47:19.145+0100 [conn1425082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:19.390+0100 [conn1424694] end connection 172.28.0.164:56796 (399 connections now open) 2015-10-05T05:47:19.391+0100 [mongosMain] connection accepted from 172.28.0.164:57688 #1425083 (400 connections now open) 2015-10-05T05:47:19.393+0100 [conn1425083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:19.736+0100 [conn1424695] end connection 172.28.0.163:63727 (399 connections now open) 2015-10-05T05:47:19.737+0100 [mongosMain] connection accepted from 172.28.0.163:64628 #1425084 (400 connections now open) 2015-10-05T05:47:19.738+0100 [conn1425084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:23.231+0100 [conn1424591] end connection 172.28.0.163:63510 (399 connections now open) 2015-10-05T05:47:23.231+0100 [conn1424667] end connection 172.28.0.163:63668 (399 connections now open) 2015-10-05T05:47:23.232+0100 [mongosMain] connection accepted from 172.28.0.163:64632 #1425085 (399 connections now open) 2015-10-05T05:47:23.232+0100 [mongosMain] connection accepted from 172.28.0.163:64633 #1425086 (400 connections now open) 2015-10-05T05:47:23.233+0100 [conn1425085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:23.233+0100 [conn1425086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:23.649+0100 [conn1424698] end connection 172.28.0.164:56801 (399 connections now open) 2015-10-05T05:47:23.650+0100 [conn1424670] end connection 172.28.0.164:56739 (398 connections now open) 2015-10-05T05:47:23.651+0100 [mongosMain] connection accepted from 172.28.0.164:57694 #1425087 (399 connections now open) 2015-10-05T05:47:23.651+0100 [mongosMain] connection accepted from 172.28.0.164:57696 #1425088 (400 connections now open) 2015-10-05T05:47:23.653+0100 [conn1425087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:23.653+0100 [conn1425088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:28.464+0100 [mongosMain] connection accepted from 127.0.0.1:64635 #1425089 (401 connections now open) 2015-10-05T05:47:28.467+0100 [conn1425089] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:28.473+0100 [conn1425089] end connection 127.0.0.1:64635 (400 connections now open) 2015-10-05T05:47:28.860+0100 [conn1424671] end connection 172.28.0.164:56749 (399 connections now open) 2015-10-05T05:47:28.861+0100 [mongosMain] connection accepted from 172.28.0.164:57705 #1425090 (400 connections now open) 2015-10-05T05:47:28.863+0100 [conn1425090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:29.405+0100 [conn1424702] end connection 172.28.0.164:56808 (399 connections now open) 2015-10-05T05:47:29.407+0100 [mongosMain] connection accepted from 172.28.0.164:57707 #1425091 (400 connections now open) 2015-10-05T05:47:29.408+0100 [conn1425091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:29.751+0100 [conn1424703] end connection 172.28.0.163:63744 (399 connections now open) 2015-10-05T05:47:29.753+0100 [mongosMain] connection accepted from 172.28.0.163:64638 #1425092 (400 connections now open) 2015-10-05T05:47:29.754+0100 [conn1425092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:29.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200e15703b51053ebac5a 2015-10-05T05:47:29.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:33.232+0100 [conn1424668] end connection 172.28.0.163:63669 (399 connections now open) 2015-10-05T05:47:33.232+0100 [conn1424681] end connection 172.28.0.163:63693 (398 connections now open) 2015-10-05T05:47:33.233+0100 [mongosMain] connection accepted from 172.28.0.163:64640 #1425093 (399 connections now open) 2015-10-05T05:47:33.234+0100 [mongosMain] connection accepted from 172.28.0.163:64641 #1425094 (400 connections now open) 2015-10-05T05:47:33.235+0100 [conn1425093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:33.235+0100 [conn1425094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:33.649+0100 [conn1424690] end connection 172.28.0.164:56791 (399 connections now open) 2015-10-05T05:47:33.649+0100 [conn1424640] end connection 172.28.0.164:56682 (398 connections now open) 2015-10-05T05:47:33.650+0100 [mongosMain] connection accepted from 172.28.0.164:57715 #1425095 (399 connections now open) 2015-10-05T05:47:33.651+0100 [mongosMain] connection accepted from 172.28.0.164:57716 #1425096 (400 connections now open) 2015-10-05T05:47:33.652+0100 [conn1425095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:33.652+0100 [conn1425096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:36.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200e75703b51053ebac7b 2015-10-05T05:47:36.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:38.875+0100 [conn1424663] end connection 172.28.0.164:56729 (399 connections now open) 2015-10-05T05:47:38.876+0100 [mongosMain] connection accepted from 172.28.0.164:57727 #1425097 (400 connections now open) 2015-10-05T05:47:38.877+0100 [conn1425097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:39.162+0100 [conn1424634] end connection 172.28.0.163:63603 (399 connections now open) 2015-10-05T05:47:39.163+0100 [mongosMain] connection accepted from 172.28.0.163:64644 #1425098 (400 connections now open) 2015-10-05T05:47:39.165+0100 [conn1425098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:39.422+0100 [conn1424711] end connection 172.28.0.164:56829 (399 connections now open) 2015-10-05T05:47:39.423+0100 [mongosMain] connection accepted from 172.28.0.164:57729 #1425099 (400 connections now open) 2015-10-05T05:47:39.425+0100 [conn1425099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:39.768+0100 [conn1424712] end connection 172.28.0.163:63758 (399 connections now open) 2015-10-05T05:47:39.769+0100 [mongosMain] connection accepted from 172.28.0.163:64646 #1425100 (400 connections now open) 2015-10-05T05:47:39.770+0100 [conn1425100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:39.806+0100 [mongosMain] connection accepted from 127.0.0.1:64648 #1425101 (401 connections now open) 2015-10-05T05:47:39.809+0100 [conn1425101] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:39.815+0100 [conn1425101] end connection 127.0.0.1:64648 (400 connections now open) 2015-10-05T05:47:42.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200ee5703b51053ebac8f 2015-10-05T05:47:42.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:43.246+0100 [conn1424652] end connection 172.28.0.163:63648 (399 connections now open) 2015-10-05T05:47:43.246+0100 [conn1424696] end connection 172.28.0.163:63734 (398 connections now open) 2015-10-05T05:47:43.247+0100 [mongosMain] connection accepted from 172.28.0.163:64652 #1425102 (399 connections now open) 2015-10-05T05:47:43.248+0100 [mongosMain] connection accepted from 172.28.0.163:64653 #1425103 (400 connections now open) 2015-10-05T05:47:43.248+0100 [conn1425102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:43.249+0100 [conn1425103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:43.665+0100 [conn1424609] end connection 172.28.0.164:56610 (399 connections now open) 2015-10-05T05:47:43.666+0100 [conn1424707] end connection 172.28.0.164:56819 (398 connections now open) 2015-10-05T05:47:43.667+0100 [mongosMain] connection accepted from 172.28.0.164:57738 #1425104 (399 connections now open) 2015-10-05T05:47:43.667+0100 [mongosMain] connection accepted from 172.28.0.164:57737 #1425105 (400 connections now open) 2015-10-05T05:47:43.669+0100 [conn1425104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:43.669+0100 [conn1425105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:47.036+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:47:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:47:48.875+0100 [conn1424692] end connection 172.28.0.164:56794 (399 connections now open) 2015-10-05T05:47:48.876+0100 [mongosMain] connection accepted from 172.28.0.164:57744 #1425106 (400 connections now open) 2015-10-05T05:47:48.878+0100 [conn1425106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:49.174+0100 [conn1424611] end connection 172.28.0.163:63561 (399 connections now open) 2015-10-05T05:47:49.175+0100 [mongosMain] connection accepted from 172.28.0.163:64663 #1425107 (400 connections now open) 2015-10-05T05:47:49.176+0100 [conn1425107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:49.422+0100 [conn1424719] end connection 172.28.0.164:56850 (399 connections now open) 2015-10-05T05:47:49.423+0100 [mongosMain] connection accepted from 172.28.0.164:57747 #1425108 (400 connections now open) 2015-10-05T05:47:49.425+0100 [conn1425108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:49.767+0100 [conn1424720] end connection 172.28.0.163:63767 (399 connections now open) 2015-10-05T05:47:49.768+0100 [mongosMain] connection accepted from 172.28.0.163:64666 #1425109 (400 connections now open) 2015-10-05T05:47:49.769+0100 [conn1425109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:53.247+0100 [conn1424704] end connection 172.28.0.163:63752 (399 connections now open) 2015-10-05T05:47:53.247+0100 [conn1424689] end connection 172.28.0.163:63713 (399 connections now open) 2015-10-05T05:47:53.248+0100 [mongosMain] connection accepted from 172.28.0.163:64671 #1425110 (399 connections now open) 2015-10-05T05:47:53.249+0100 [mongosMain] connection accepted from 172.28.0.163:64672 #1425111 (400 connections now open) 2015-10-05T05:47:53.249+0100 [conn1425110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:53.249+0100 [conn1425111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:53.665+0100 [conn1424715] end connection 172.28.0.164:56836 (399 connections now open) 2015-10-05T05:47:53.665+0100 [conn1424648] end connection 172.28.0.164:56695 (398 connections now open) 2015-10-05T05:47:53.666+0100 [mongosMain] connection accepted from 172.28.0.164:57754 #1425112 (399 connections now open) 2015-10-05T05:47:53.666+0100 [mongosMain] connection accepted from 172.28.0.164:57755 #1425113 (400 connections now open) 2015-10-05T05:47:53.667+0100 [conn1425112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:53.668+0100 [conn1425113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:54.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561200fa5703b51053ebacb9 2015-10-05T05:47:55.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:47:58.891+0100 [conn1424685] end connection 172.28.0.164:56782 (399 connections now open) 2015-10-05T05:47:58.893+0100 [mongosMain] connection accepted from 172.28.0.164:57759 #1425114 (400 connections now open) 2015-10-05T05:47:58.895+0100 [conn1425114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:59.175+0100 [conn1424710] end connection 172.28.0.163:63756 (399 connections now open) 2015-10-05T05:47:59.176+0100 [mongosMain] connection accepted from 172.28.0.163:64683 #1425115 (400 connections now open) 2015-10-05T05:47:59.178+0100 [conn1425115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:59.437+0100 [conn1424728] end connection 172.28.0.164:56869 (399 connections now open) 2015-10-05T05:47:59.438+0100 [mongosMain] connection accepted from 172.28.0.164:57761 #1425116 (400 connections now open) 2015-10-05T05:47:59.440+0100 [conn1425116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:47:59.783+0100 [conn1424729] end connection 172.28.0.163:63786 (399 connections now open) 2015-10-05T05:47:59.785+0100 [mongosMain] connection accepted from 172.28.0.163:64685 #1425117 (400 connections now open) 2015-10-05T05:47:59.786+0100 [conn1425117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:03.262+0100 [conn1424714] end connection 172.28.0.163:63761 (399 connections now open) 2015-10-05T05:48:03.262+0100 [conn1424682] end connection 172.28.0.163:63694 (399 connections now open) 2015-10-05T05:48:03.263+0100 [mongosMain] connection accepted from 172.28.0.163:64694 #1425118 (399 connections now open) 2015-10-05T05:48:03.263+0100 [mongosMain] connection accepted from 172.28.0.163:64695 #1425119 (400 connections now open) 2015-10-05T05:48:03.264+0100 [conn1425118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:03.264+0100 [conn1425119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:03.681+0100 [conn1424683] end connection 172.28.0.164:56777 (399 connections now open) 2015-10-05T05:48:03.682+0100 [conn1424724] end connection 172.28.0.164:56858 (398 connections now open) 2015-10-05T05:48:03.683+0100 [mongosMain] connection accepted from 172.28.0.164:57768 #1425120 (399 connections now open) 2015-10-05T05:48:03.683+0100 [mongosMain] connection accepted from 172.28.0.164:57771 #1425121 (400 connections now open) 2015-10-05T05:48:03.684+0100 [conn1425120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:03.685+0100 [conn1425121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:07.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201075703b51053ebad1e 2015-10-05T05:48:07.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:48:08.907+0100 [conn1424610] end connection 172.28.0.164:56614 (399 connections now open) 2015-10-05T05:48:08.908+0100 [mongosMain] connection accepted from 172.28.0.164:57774 #1425122 (400 connections now open) 2015-10-05T05:48:08.910+0100 [conn1425122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:09.452+0100 [conn1424735] end connection 172.28.0.164:56881 (399 connections now open) 2015-10-05T05:48:09.453+0100 [mongosMain] connection accepted from 172.28.0.164:57776 #1425123 (400 connections now open) 2015-10-05T05:48:09.455+0100 [conn1425123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:09.783+0100 [conn1424736] end connection 172.28.0.163:63803 (399 connections now open) 2015-10-05T05:48:09.785+0100 [mongosMain] connection accepted from 172.28.0.163:64705 #1425124 (400 connections now open) 2015-10-05T05:48:09.786+0100 [conn1425124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:13.278+0100 [conn1424723] end connection 172.28.0.163:63774 (399 connections now open) 2015-10-05T05:48:13.279+0100 [conn1424630] end connection 172.28.0.163:63593 (398 connections now open) 2015-10-05T05:48:13.280+0100 [mongosMain] connection accepted from 172.28.0.163:64709 #1425125 (399 connections now open) 2015-10-05T05:48:13.280+0100 [mongosMain] connection accepted from 172.28.0.163:64710 #1425126 (400 connections now open) 2015-10-05T05:48:13.281+0100 [conn1425125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:13.281+0100 [conn1425126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:13.681+0100 [conn1424732] end connection 172.28.0.164:56876 (399 connections now open) 2015-10-05T05:48:13.681+0100 [conn1424676] end connection 172.28.0.164:56760 (398 connections now open) 2015-10-05T05:48:13.682+0100 [mongosMain] connection accepted from 172.28.0.164:57780 #1425127 (399 connections now open) 2015-10-05T05:48:13.682+0100 [mongosMain] connection accepted from 172.28.0.164:57781 #1425128 (400 connections now open) 2015-10-05T05:48:13.684+0100 [conn1425128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:13.684+0100 [conn1425127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:17.298+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:48:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:48:18.906+0100 [conn1424700] end connection 172.28.0.164:56805 (399 connections now open) 2015-10-05T05:48:18.907+0100 [mongosMain] connection accepted from 172.28.0.164:57786 #1425129 (400 connections now open) 2015-10-05T05:48:18.909+0100 [conn1425129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:19.206+0100 [conn1424718] end connection 172.28.0.163:63765 (399 connections now open) 2015-10-05T05:48:19.207+0100 [mongosMain] connection accepted from 172.28.0.163:64717 #1425130 (400 connections now open) 2015-10-05T05:48:19.208+0100 [conn1425130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:19.452+0100 [conn1424743] end connection 172.28.0.164:56896 (399 connections now open) 2015-10-05T05:48:19.456+0100 [mongosMain] connection accepted from 172.28.0.164:57789 #1425131 (400 connections now open) 2015-10-05T05:48:19.462+0100 [conn1425131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:19.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201135703b51053ebad75 2015-10-05T05:48:19.798+0100 [conn1424744] end connection 172.28.0.163:63826 (399 connections now open) 2015-10-05T05:48:19.799+0100 [mongosMain] connection accepted from 172.28.0.163:64720 #1425132 (400 connections now open) 2015-10-05T05:48:19.800+0100 [conn1425132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:19.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:48:23.280+0100 [conn1424745] end connection 172.28.0.163:63830 (399 connections now open) 2015-10-05T05:48:23.280+0100 [conn1424659] end connection 172.28.0.163:63661 (399 connections now open) 2015-10-05T05:48:23.281+0100 [mongosMain] connection accepted from 172.28.0.163:64723 #1425133 (399 connections now open) 2015-10-05T05:48:23.282+0100 [mongosMain] connection accepted from 172.28.0.163:64724 #1425134 (400 connections now open) 2015-10-05T05:48:23.282+0100 [conn1425133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:23.282+0100 [conn1425134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:23.697+0100 [conn1424748] end connection 172.28.0.164:56901 (399 connections now open) 2015-10-05T05:48:23.698+0100 [mongosMain] connection accepted from 172.28.0.164:57795 #1425135 (400 connections now open) 2015-10-05T05:48:23.699+0100 [conn1424691] end connection 172.28.0.164:56790 (398 connections now open) 2015-10-05T05:48:23.699+0100 [mongosMain] connection accepted from 172.28.0.164:57796 #1425136 (400 connections now open) 2015-10-05T05:48:23.701+0100 [conn1425135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:23.701+0100 [conn1425136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:28.444+0100 [mongosMain] connection accepted from 127.0.0.1:64727 #1425137 (401 connections now open) 2015-10-05T05:48:28.447+0100 [conn1425137] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:28.452+0100 [conn1425137] end connection 127.0.0.1:64727 (400 connections now open) 2015-10-05T05:48:28.906+0100 [conn1424726] end connection 172.28.0.164:56865 (399 connections now open) 2015-10-05T05:48:28.907+0100 [mongosMain] connection accepted from 172.28.0.164:57804 #1425138 (400 connections now open) 2015-10-05T05:48:28.908+0100 [conn1425138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:29.206+0100 [conn1424742] end connection 172.28.0.163:63824 (399 connections now open) 2015-10-05T05:48:29.207+0100 [mongosMain] connection accepted from 172.28.0.163:64729 #1425139 (400 connections now open) 2015-10-05T05:48:29.208+0100 [conn1425139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:29.452+0100 [conn1424751] end connection 172.28.0.164:56908 (399 connections now open) 2015-10-05T05:48:29.453+0100 [mongosMain] connection accepted from 172.28.0.164:57807 #1425140 (400 connections now open) 2015-10-05T05:48:29.455+0100 [conn1425140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:29.799+0100 [conn1424752] end connection 172.28.0.163:63840 (399 connections now open) 2015-10-05T05:48:29.800+0100 [mongosMain] connection accepted from 172.28.0.163:64731 #1425141 (400 connections now open) 2015-10-05T05:48:29.801+0100 [conn1425141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:32.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612011f5703b51053ebadbb 2015-10-05T05:48:32.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:48:33.294+0100 [conn1424737] end connection 172.28.0.163:63814 (399 connections now open) 2015-10-05T05:48:33.294+0100 [conn1424574] end connection 172.28.0.163:63485 (398 connections now open) 2015-10-05T05:48:33.295+0100 [mongosMain] connection accepted from 172.28.0.163:64733 #1425142 (399 connections now open) 2015-10-05T05:48:33.295+0100 [mongosMain] connection accepted from 172.28.0.163:64734 #1425143 (400 connections now open) 2015-10-05T05:48:33.296+0100 [conn1425142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:33.297+0100 [conn1425143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:33.697+0100 [conn1424739] end connection 172.28.0.164:56891 (399 connections now open) 2015-10-05T05:48:33.697+0100 [conn1424654] end connection 172.28.0.164:56704 (399 connections now open) 2015-10-05T05:48:33.698+0100 [mongosMain] connection accepted from 172.28.0.164:57813 #1425144 (399 connections now open) 2015-10-05T05:48:33.699+0100 [mongosMain] connection accepted from 172.28.0.164:57814 #1425145 (400 connections now open) 2015-10-05T05:48:33.700+0100 [conn1425144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:33.700+0100 [conn1425145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:38.922+0100 [conn1424678] end connection 172.28.0.164:56768 (399 connections now open) 2015-10-05T05:48:38.923+0100 [mongosMain] connection accepted from 172.28.0.164:57821 #1425146 (400 connections now open) 2015-10-05T05:48:38.925+0100 [conn1425146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:39.221+0100 [conn1424693] end connection 172.28.0.163:63724 (399 connections now open) 2015-10-05T05:48:39.222+0100 [mongosMain] connection accepted from 172.28.0.163:64738 #1425147 (400 connections now open) 2015-10-05T05:48:39.223+0100 [conn1425147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:39.284+0100 [mongosMain] connection accepted from 127.0.0.1:64740 #1425148 (401 connections now open) 2015-10-05T05:48:39.287+0100 [conn1425148] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:39.292+0100 [conn1425148] end connection 127.0.0.1:64740 (400 connections now open) 2015-10-05T05:48:39.469+0100 [conn1424759] end connection 172.28.0.164:56925 (399 connections now open) 2015-10-05T05:48:39.471+0100 [mongosMain] connection accepted from 172.28.0.164:57826 #1425149 (400 connections now open) 2015-10-05T05:48:39.473+0100 [conn1425149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:43.294+0100 [conn1424731] end connection 172.28.0.163:63791 (399 connections now open) 2015-10-05T05:48:43.294+0100 [conn1424638] end connection 172.28.0.163:63612 (399 connections now open) 2015-10-05T05:48:43.296+0100 [mongosMain] connection accepted from 172.28.0.163:64745 #1425150 (399 connections now open) 2015-10-05T05:48:43.296+0100 [mongosMain] connection accepted from 172.28.0.163:64746 #1425151 (400 connections now open) 2015-10-05T05:48:43.297+0100 [conn1425150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:43.297+0100 [conn1425151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:43.713+0100 [conn1424764] end connection 172.28.0.164:56932 (399 connections now open) 2015-10-05T05:48:43.713+0100 [conn1424716] end connection 172.28.0.164:56837 (398 connections now open) 2015-10-05T05:48:43.714+0100 [mongosMain] connection accepted from 172.28.0.164:57831 #1425152 (399 connections now open) 2015-10-05T05:48:43.714+0100 [mongosMain] connection accepted from 172.28.0.164:57832 #1425153 (400 connections now open) 2015-10-05T05:48:43.715+0100 [conn1425152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:43.716+0100 [conn1425153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:44.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612012c5703b51053ebae12 2015-10-05T05:48:44.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:48:47.582+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:48:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:48:48.924+0100 [conn1424741] end connection 172.28.0.164:56894 (399 connections now open) 2015-10-05T05:48:48.925+0100 [mongosMain] connection accepted from 172.28.0.164:57839 #1425154 (400 connections now open) 2015-10-05T05:48:48.926+0100 [conn1425154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:49.222+0100 [conn1424701] end connection 172.28.0.163:63742 (399 connections now open) 2015-10-05T05:48:49.223+0100 [mongosMain] connection accepted from 172.28.0.163:64757 #1425155 (400 connections now open) 2015-10-05T05:48:49.224+0100 [conn1425155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:53.311+0100 [conn1424705] end connection 172.28.0.163:63751 (399 connections now open) 2015-10-05T05:48:53.311+0100 [conn1424754] end connection 172.28.0.163:63844 (399 connections now open) 2015-10-05T05:48:53.312+0100 [mongosMain] connection accepted from 172.28.0.163:64764 #1425156 (399 connections now open) 2015-10-05T05:48:53.313+0100 [mongosMain] connection accepted from 172.28.0.163:64765 #1425157 (400 connections now open) 2015-10-05T05:48:53.313+0100 [conn1425156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:53.314+0100 [conn1425157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:56.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201385703b51053ebae81 2015-10-05T05:48:57.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:48:58.938+0100 [conn1424709] end connection 172.28.0.164:56827 (399 connections now open) 2015-10-05T05:48:58.940+0100 [mongosMain] connection accepted from 172.28.0.164:57847 #1425158 (400 connections now open) 2015-10-05T05:48:58.941+0100 [conn1425158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:48:59.237+0100 [conn1424727] end connection 172.28.0.163:63784 (399 connections now open) 2015-10-05T05:48:59.238+0100 [mongosMain] connection accepted from 172.28.0.163:64775 #1425159 (400 connections now open) 2015-10-05T05:48:59.239+0100 [conn1425159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:03.315+0100 [conn1424722] end connection 172.28.0.163:63773 (399 connections now open) 2015-10-05T05:49:03.315+0100 [conn1424762] end connection 172.28.0.163:63853 (399 connections now open) 2015-10-05T05:49:03.316+0100 [mongosMain] connection accepted from 172.28.0.163:64784 #1425160 (399 connections now open) 2015-10-05T05:49:03.316+0100 [mongosMain] connection accepted from 172.28.0.163:64786 #1425161 (400 connections now open) 2015-10-05T05:49:03.317+0100 [conn1425160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:03.317+0100 [conn1425161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:03.728+0100 [conn1424755] end connection 172.28.0.164:56916 (399 connections now open) 2015-10-05T05:49:03.729+0100 [mongosMain] connection accepted from 172.28.0.164:57850 #1425162 (400 connections now open) 2015-10-05T05:49:03.731+0100 [conn1425162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:09.238+0100 [conn1424750] end connection 172.28.0.163:63838 (399 connections now open) 2015-10-05T05:49:09.239+0100 [mongosMain] connection accepted from 172.28.0.163:64795 #1425163 (400 connections now open) 2015-10-05T05:49:09.240+0100 [conn1425163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:09.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201455703b51053ebaef1 2015-10-05T05:49:09.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:13.325+0100 [conn1424697] end connection 172.28.0.163:63735 (399 connections now open) 2015-10-05T05:49:13.325+0100 [conn1424769] end connection 172.28.0.163:63863 (398 connections now open) 2015-10-05T05:49:13.326+0100 [mongosMain] connection accepted from 172.28.0.163:64799 #1425164 (399 connections now open) 2015-10-05T05:49:13.326+0100 [mongosMain] connection accepted from 172.28.0.163:64800 #1425165 (400 connections now open) 2015-10-05T05:49:13.327+0100 [conn1425164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:13.328+0100 [conn1425165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:17.833+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:49:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:49:18.954+0100 [conn1424749] end connection 172.28.0.164:56905 (399 connections now open) 2015-10-05T05:49:18.956+0100 [mongosMain] connection accepted from 172.28.0.164:57856 #1425166 (400 connections now open) 2015-10-05T05:49:18.957+0100 [conn1425166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:19.253+0100 [conn1424734] end connection 172.28.0.163:63800 (399 connections now open) 2015-10-05T05:49:19.254+0100 [mongosMain] connection accepted from 172.28.0.163:64807 #1425167 (400 connections now open) 2015-10-05T05:49:19.255+0100 [conn1425167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:21.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201515703b51053ebaf36 2015-10-05T05:49:22.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:23.328+0100 [conn1424730] end connection 172.28.0.163:63790 (399 connections now open) 2015-10-05T05:49:23.329+0100 [mongosMain] connection accepted from 172.28.0.163:64811 #1425168 (400 connections now open) 2015-10-05T05:49:23.330+0100 [conn1425168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:28.322+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201585703b51053ebaf70 2015-10-05T05:49:28.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:28.970+0100 [conn1424756] end connection 172.28.0.164:56923 (399 connections now open) 2015-10-05T05:49:28.971+0100 [mongosMain] connection accepted from 172.28.0.164:57870 #1425169 (400 connections now open) 2015-10-05T05:49:28.973+0100 [conn1425169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:29.125+0100 [mongosMain] connection accepted from 127.0.0.1:64815 #1425170 (401 connections now open) 2015-10-05T05:49:29.128+0100 [conn1425170] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:29.133+0100 [conn1425170] end connection 127.0.0.1:64815 (400 connections now open) 2015-10-05T05:49:29.259+0100 [conn1424773] end connection 172.28.0.163:63874 (399 connections now open) 2015-10-05T05:49:29.260+0100 [mongosMain] connection accepted from 172.28.0.163:64816 #1425171 (400 connections now open) 2015-10-05T05:49:29.261+0100 [conn1425171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:33.341+0100 [conn1424776] end connection 172.28.0.163:63905 (399 connections now open) 2015-10-05T05:49:33.341+0100 [conn1424738] end connection 172.28.0.163:63815 (399 connections now open) 2015-10-05T05:49:33.342+0100 [mongosMain] connection accepted from 172.28.0.163:64817 #1425172 (399 connections now open) 2015-10-05T05:49:33.342+0100 [mongosMain] connection accepted from 172.28.0.163:64818 #1425173 (400 connections now open) 2015-10-05T05:49:33.343+0100 [conn1425172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:33.344+0100 [conn1425173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:33.744+0100 [conn1424740] end connection 172.28.0.164:56892 (399 connections now open) 2015-10-05T05:49:33.745+0100 [mongosMain] connection accepted from 172.28.0.164:57878 #1425174 (400 connections now open) 2015-10-05T05:49:33.747+0100 [conn1425174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:34.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612015e5703b51053ebaf8f 2015-10-05T05:49:34.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:39.269+0100 [conn1424779] end connection 172.28.0.163:63916 (399 connections now open) 2015-10-05T05:49:39.270+0100 [mongosMain] connection accepted from 172.28.0.163:64822 #1425175 (400 connections now open) 2015-10-05T05:49:39.271+0100 [conn1425175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:40.040+0100 [mongosMain] connection accepted from 127.0.0.1:64824 #1425176 (401 connections now open) 2015-10-05T05:49:40.043+0100 [conn1425176] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:40.049+0100 [conn1425176] end connection 127.0.0.1:64824 (400 connections now open) 2015-10-05T05:49:41.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201645703b51053ebafb1 2015-10-05T05:49:41.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:43.358+0100 [conn1424746] end connection 172.28.0.163:63831 (399 connections now open) 2015-10-05T05:49:43.359+0100 [mongosMain] connection accepted from 172.28.0.163:64831 #1425177 (400 connections now open) 2015-10-05T05:49:43.361+0100 [conn1425177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:43.760+0100 [conn1424725] end connection 172.28.0.164:56859 (399 connections now open) 2015-10-05T05:49:43.761+0100 [mongosMain] connection accepted from 172.28.0.164:57894 #1425178 (400 connections now open) 2015-10-05T05:49:43.763+0100 [conn1425178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:47.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612016b5703b51053ebafdd 2015-10-05T05:49:47.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:47.972+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:49:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:49:49.284+0100 [conn1424766] end connection 172.28.0.163:63856 (399 connections now open) 2015-10-05T05:49:49.289+0100 [mongosMain] connection accepted from 172.28.0.163:64839 #1425179 (400 connections now open) 2015-10-05T05:49:49.290+0100 [conn1425179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:53.358+0100 [conn1424646] end connection 172.28.0.163:63635 (399 connections now open) 2015-10-05T05:49:53.359+0100 [mongosMain] connection accepted from 172.28.0.163:64843 #1425180 (400 connections now open) 2015-10-05T05:49:53.360+0100 [conn1425180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:49:53.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201715703b51053ebb00e 2015-10-05T05:49:53.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:49:59.291+0100 [conn1424758] end connection 172.28.0.163:63847 (399 connections now open) 2015-10-05T05:49:59.293+0100 [mongosMain] connection accepted from 172.28.0.163:64851 #1425181 (400 connections now open) 2015-10-05T05:49:59.294+0100 [conn1425181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:00.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201775703b51053ebb02f 2015-10-05T05:50:00.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:03.374+0100 [conn1424774] end connection 172.28.0.163:63883 (399 connections now open) 2015-10-05T05:50:03.375+0100 [mongosMain] connection accepted from 172.28.0.163:64857 #1425182 (400 connections now open) 2015-10-05T05:50:03.376+0100 [conn1425182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:03.775+0100 [conn1424763] end connection 172.28.0.164:56931 (399 connections now open) 2015-10-05T05:50:03.776+0100 [conn1424778] end connection 172.28.0.164:56971 (398 connections now open) 2015-10-05T05:50:03.776+0100 [mongosMain] connection accepted from 172.28.0.164:57918 #1425183 (399 connections now open) 2015-10-05T05:50:03.777+0100 [mongosMain] connection accepted from 172.28.0.164:57919 #1425184 (400 connections now open) 2015-10-05T05:50:03.778+0100 [conn1425183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:03.778+0100 [conn1425184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:06.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612017e5703b51053ebb068 2015-10-05T05:50:06.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:09.342+0100 [conn1424775] end connection 172.28.0.163:63894 (399 connections now open) 2015-10-05T05:50:09.342+0100 [mongosMain] connection accepted from 172.28.0.163:64867 #1425185 (400 connections now open) 2015-10-05T05:50:09.342+0100 [conn1425185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:12.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201845703b51053ebb081 2015-10-05T05:50:12.832+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:13.775+0100 [conn1424699] end connection 172.28.0.164:56802 (399 connections now open) 2015-10-05T05:50:13.776+0100 [mongosMain] connection accepted from 172.28.0.164:57922 #1425186 (400 connections now open) 2015-10-05T05:50:13.778+0100 [conn1425186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:18.228+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:50:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:50:19.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612018a5703b51053ebb0a0 2015-10-05T05:50:19.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:19.301+0100 [conn1424788] end connection 172.28.0.163:63942 (399 connections now open) 2015-10-05T05:50:19.303+0100 [mongosMain] connection accepted from 172.28.0.163:64875 #1425187 (400 connections now open) 2015-10-05T05:50:19.304+0100 [conn1425187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:19.909+0100 [conn1424760] end connection 172.28.0.163:63849 (399 connections now open) 2015-10-05T05:50:19.911+0100 [mongosMain] connection accepted from 172.28.0.163:64877 #1425188 (400 connections now open) 2015-10-05T05:50:19.912+0100 [conn1425188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:23.388+0100 [conn1424781] end connection 172.28.0.163:63921 (399 connections now open) 2015-10-05T05:50:23.389+0100 [mongosMain] connection accepted from 172.28.0.163:64880 #1425189 (400 connections now open) 2015-10-05T05:50:23.390+0100 [conn1425189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:23.791+0100 [conn1424747] end connection 172.28.0.164:56900 (399 connections now open) 2015-10-05T05:50:23.792+0100 [mongosMain] connection accepted from 172.28.0.164:57936 #1425190 (400 connections now open) 2015-10-05T05:50:23.794+0100 [conn1425190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:25.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201915703b51053ebb0c1 2015-10-05T05:50:25.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:28.353+0100 [mongosMain] connection accepted from 127.0.0.1:64883 #1425191 (401 connections now open) 2015-10-05T05:50:28.356+0100 [conn1425191] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:28.361+0100 [conn1425191] end connection 127.0.0.1:64883 (400 connections now open) 2015-10-05T05:50:29.316+0100 [conn1424792] end connection 172.28.0.163:63956 (399 connections now open) 2015-10-05T05:50:29.317+0100 [mongosMain] connection accepted from 172.28.0.163:64887 #1425192 (400 connections now open) 2015-10-05T05:50:29.317+0100 [conn1425192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:29.579+0100 [conn1424767] end connection 172.28.0.164:56943 (399 connections now open) 2015-10-05T05:50:29.580+0100 [mongosMain] connection accepted from 172.28.0.164:57944 #1425193 (400 connections now open) 2015-10-05T05:50:29.581+0100 [conn1425193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:29.909+0100 [conn1424795] end connection 172.28.0.163:63996 (399 connections now open) 2015-10-05T05:50:29.910+0100 [mongosMain] connection accepted from 172.28.0.163:64889 #1425194 (400 connections now open) 2015-10-05T05:50:29.910+0100 [conn1425194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:31.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201975703b51053ebb0dd 2015-10-05T05:50:31.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:33.391+0100 [conn1424796] end connection 172.28.0.163:63998 (399 connections now open) 2015-10-05T05:50:33.392+0100 [mongosMain] connection accepted from 172.28.0.163:64893 #1425195 (400 connections now open) 2015-10-05T05:50:33.393+0100 [conn1425195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:38.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612019d5703b51053ebb0f2 2015-10-05T05:50:38.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:39.317+0100 [conn1424787] end connection 172.28.0.163:63938 (399 connections now open) 2015-10-05T05:50:39.318+0100 [mongosMain] connection accepted from 172.28.0.163:64895 #1425196 (400 connections now open) 2015-10-05T05:50:39.319+0100 [conn1425196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:39.776+0100 [mongosMain] connection accepted from 127.0.0.1:64896 #1425197 (401 connections now open) 2015-10-05T05:50:39.778+0100 [conn1425197] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:39.782+0100 [conn1425197] end connection 127.0.0.1:64896 (400 connections now open) 2015-10-05T05:50:39.925+0100 [conn1424800] end connection 172.28.0.163:64004 (399 connections now open) 2015-10-05T05:50:39.926+0100 [mongosMain] connection accepted from 172.28.0.163:64897 #1425198 (400 connections now open) 2015-10-05T05:50:39.927+0100 [conn1425198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:43.404+0100 [conn1424790] end connection 172.28.0.163:63948 (399 connections now open) 2015-10-05T05:50:43.405+0100 [conn1424777] end connection 172.28.0.163:63906 (398 connections now open) 2015-10-05T05:50:43.406+0100 [mongosMain] connection accepted from 172.28.0.163:64903 #1425199 (399 connections now open) 2015-10-05T05:50:43.406+0100 [mongosMain] connection accepted from 172.28.0.163:64904 #1425200 (400 connections now open) 2015-10-05T05:50:43.407+0100 [conn1425199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:43.407+0100 [conn1425200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:48.478+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:50:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:50:49.332+0100 [conn1424809] end connection 172.28.0.163:64029 (399 connections now open) 2015-10-05T05:50:49.333+0100 [mongosMain] connection accepted from 172.28.0.163:64911 #1425201 (400 connections now open) 2015-10-05T05:50:49.334+0100 [conn1425201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:49.610+0100 [conn1424799] end connection 172.28.0.164:57057 (399 connections now open) 2015-10-05T05:50:49.611+0100 [mongosMain] connection accepted from 172.28.0.164:57969 #1425202 (400 connections now open) 2015-10-05T05:50:49.613+0100 [conn1425202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:50.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201aa5703b51053ebb155 2015-10-05T05:50:50.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:53.419+0100 [conn1424770] end connection 172.28.0.163:63864 (399 connections now open) 2015-10-05T05:50:53.419+0100 [conn1424801] end connection 172.28.0.163:64008 (399 connections now open) 2015-10-05T05:50:53.420+0100 [mongosMain] connection accepted from 172.28.0.163:64917 #1425203 (399 connections now open) 2015-10-05T05:50:53.421+0100 [mongosMain] connection accepted from 172.28.0.163:64918 #1425204 (400 connections now open) 2015-10-05T05:50:53.422+0100 [conn1425203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:53.422+0100 [conn1425204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:53.838+0100 [conn1424733] end connection 172.28.0.164:56877 (399 connections now open) 2015-10-05T05:50:53.838+0100 [conn1424784] end connection 172.28.0.164:56985 (399 connections now open) 2015-10-05T05:50:53.839+0100 [mongosMain] connection accepted from 172.28.0.164:57975 #1425205 (399 connections now open) 2015-10-05T05:50:53.840+0100 [mongosMain] connection accepted from 172.28.0.164:57976 #1425206 (400 connections now open) 2015-10-05T05:50:53.841+0100 [conn1425205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:53.841+0100 [conn1425206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:56.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201b05703b51053ebb18f 2015-10-05T05:50:56.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:50:59.098+0100 [conn1424765] end connection 172.28.0.164:56940 (399 connections now open) 2015-10-05T05:50:59.099+0100 [mongosMain] connection accepted from 172.28.0.164:57980 #1425207 (400 connections now open) 2015-10-05T05:50:59.101+0100 [conn1425207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:59.333+0100 [conn1424798] end connection 172.28.0.163:64002 (399 connections now open) 2015-10-05T05:50:59.334+0100 [mongosMain] connection accepted from 172.28.0.163:64927 #1425208 (400 connections now open) 2015-10-05T05:50:59.335+0100 [conn1425208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:59.642+0100 [conn1424810] end connection 172.28.0.164:57090 (399 connections now open) 2015-10-05T05:50:59.643+0100 [mongosMain] connection accepted from 172.28.0.164:57983 #1425209 (400 connections now open) 2015-10-05T05:50:59.645+0100 [conn1425209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:50:59.942+0100 [conn1424803] end connection 172.28.0.163:64011 (399 connections now open) 2015-10-05T05:50:59.943+0100 [mongosMain] connection accepted from 172.28.0.163:64929 #1425210 (400 connections now open) 2015-10-05T05:50:59.944+0100 [conn1425210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:03.030+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201b65703b51053ebb1c1 2015-10-05T05:51:03.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:03.421+0100 [conn1424761] end connection 172.28.0.163:63852 (399 connections now open) 2015-10-05T05:51:03.421+0100 [conn1424805] end connection 172.28.0.163:64017 (399 connections now open) 2015-10-05T05:51:03.422+0100 [mongosMain] connection accepted from 172.28.0.163:64944 #1425211 (399 connections now open) 2015-10-05T05:51:03.423+0100 [mongosMain] connection accepted from 172.28.0.163:64945 #1425212 (400 connections now open) 2015-10-05T05:51:03.423+0100 [conn1425211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:03.424+0100 [conn1425212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:03.838+0100 [conn1424791] end connection 172.28.0.164:57014 (399 connections now open) 2015-10-05T05:51:03.838+0100 [conn1424771] end connection 172.28.0.164:56949 (399 connections now open) 2015-10-05T05:51:03.839+0100 [mongosMain] connection accepted from 172.28.0.164:57987 #1425213 (399 connections now open) 2015-10-05T05:51:03.840+0100 [mongosMain] connection accepted from 172.28.0.164:57988 #1425214 (400 connections now open) 2015-10-05T05:51:03.841+0100 [conn1425213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:03.841+0100 [conn1425214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:09.096+0100 [conn1424808] end connection 172.28.0.164:57088 (399 connections now open) 2015-10-05T05:51:09.097+0100 [mongosMain] connection accepted from 172.28.0.164:57991 #1425215 (400 connections now open) 2015-10-05T05:51:09.098+0100 [conn1425215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:09.382+0100 [conn1424793] end connection 172.28.0.163:63971 (399 connections now open) 2015-10-05T05:51:09.383+0100 [mongosMain] connection accepted from 172.28.0.163:64954 #1425216 (400 connections now open) 2015-10-05T05:51:09.384+0100 [conn1425216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:09.642+0100 [conn1424816] end connection 172.28.0.164:57103 (399 connections now open) 2015-10-05T05:51:09.643+0100 [mongosMain] connection accepted from 172.28.0.164:57993 #1425217 (400 connections now open) 2015-10-05T05:51:09.646+0100 [conn1425217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:09.945+0100 [conn1424817] end connection 172.28.0.163:64046 (399 connections now open) 2015-10-05T05:51:09.946+0100 [mongosMain] connection accepted from 172.28.0.163:64957 #1425218 (400 connections now open) 2015-10-05T05:51:09.947+0100 [conn1425218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:13.435+0100 [conn1424811] end connection 172.28.0.163:64034 (399 connections now open) 2015-10-05T05:51:13.437+0100 [mongosMain] connection accepted from 172.28.0.163:64960 #1425219 (400 connections now open) 2015-10-05T05:51:13.438+0100 [conn1425219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:13.854+0100 [conn1424813] end connection 172.28.0.164:57096 (399 connections now open) 2015-10-05T05:51:13.854+0100 [conn1424807] end connection 172.28.0.164:57078 (398 connections now open) 2015-10-05T05:51:13.855+0100 [mongosMain] connection accepted from 172.28.0.164:57994 #1425220 (399 connections now open) 2015-10-05T05:51:13.856+0100 [mongosMain] connection accepted from 172.28.0.164:57995 #1425221 (400 connections now open) 2015-10-05T05:51:13.857+0100 [conn1425220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:13.858+0100 [conn1425221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:15.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201c35703b51053ebb232 2015-10-05T05:51:15.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:18.632+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:51:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:51:19.112+0100 [conn1424772] end connection 172.28.0.164:56955 (399 connections now open) 2015-10-05T05:51:19.113+0100 [mongosMain] connection accepted from 172.28.0.164:58000 #1425222 (400 connections now open) 2015-10-05T05:51:19.116+0100 [conn1425222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:19.658+0100 [conn1424823] end connection 172.28.0.164:57113 (399 connections now open) 2015-10-05T05:51:19.659+0100 [mongosMain] connection accepted from 172.28.0.164:58002 #1425223 (400 connections now open) 2015-10-05T05:51:19.662+0100 [conn1425223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:19.956+0100 [conn1424824] end connection 172.28.0.163:64067 (399 connections now open) 2015-10-05T05:51:19.957+0100 [mongosMain] connection accepted from 172.28.0.163:64966 #1425224 (400 connections now open) 2015-10-05T05:51:19.958+0100 [conn1425224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:21.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201c95703b51053ebb25a 2015-10-05T05:51:21.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:23.870+0100 [conn1424456] end connection 172.28.0.164:56279 (399 connections now open) 2015-10-05T05:51:23.870+0100 [conn1424826] end connection 172.28.0.164:57115 (399 connections now open) 2015-10-05T05:51:23.871+0100 [mongosMain] connection accepted from 172.28.0.164:58010 #1425225 (399 connections now open) 2015-10-05T05:51:23.871+0100 [mongosMain] connection accepted from 172.28.0.164:58011 #1425226 (400 connections now open) 2015-10-05T05:51:23.873+0100 [conn1425225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:23.873+0100 [conn1425226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:29.127+0100 [conn1424786] end connection 172.28.0.164:56995 (399 connections now open) 2015-10-05T05:51:29.129+0100 [mongosMain] connection accepted from 172.28.0.164:58019 #1425227 (400 connections now open) 2015-10-05T05:51:29.132+0100 [conn1425227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:29.135+0100 [mongosMain] connection accepted from 127.0.0.1:64971 #1425228 (401 connections now open) 2015-10-05T05:51:29.137+0100 [conn1425228] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:29.143+0100 [conn1425228] end connection 127.0.0.1:64971 (400 connections now open) 2015-10-05T05:51:29.395+0100 [conn1424815] end connection 172.28.0.163:64044 (399 connections now open) 2015-10-05T05:51:29.396+0100 [mongosMain] connection accepted from 172.28.0.163:64972 #1425229 (400 connections now open) 2015-10-05T05:51:29.397+0100 [conn1425229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:29.673+0100 [conn1424830] end connection 172.28.0.164:57121 (399 connections now open) 2015-10-05T05:51:29.675+0100 [mongosMain] connection accepted from 172.28.0.164:58021 #1425230 (400 connections now open) 2015-10-05T05:51:29.677+0100 [conn1425230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:29.957+0100 [conn1424831] end connection 172.28.0.163:64079 (399 connections now open) 2015-10-05T05:51:29.958+0100 [mongosMain] connection accepted from 172.28.0.163:64973 #1425231 (400 connections now open) 2015-10-05T05:51:29.959+0100 [conn1425231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:33.870+0100 [conn1424819] end connection 172.28.0.164:57106 (399 connections now open) 2015-10-05T05:51:33.871+0100 [mongosMain] connection accepted from 172.28.0.164:58026 #1425232 (400 connections now open) 2015-10-05T05:51:33.873+0100 [conn1425232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:33.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201d55703b51053ebb2b8 2015-10-05T05:51:34.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:39.127+0100 [conn1424717] end connection 172.28.0.164:56848 (399 connections now open) 2015-10-05T05:51:39.129+0100 [mongosMain] connection accepted from 172.28.0.164:58035 #1425233 (400 connections now open) 2015-10-05T05:51:39.130+0100 [conn1425233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:39.395+0100 [conn1424822] end connection 172.28.0.163:64065 (399 connections now open) 2015-10-05T05:51:39.397+0100 [mongosMain] connection accepted from 172.28.0.163:64977 #1425234 (400 connections now open) 2015-10-05T05:51:39.398+0100 [conn1425234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:39.668+0100 [mongosMain] connection accepted from 127.0.0.1:64979 #1425235 (401 connections now open) 2015-10-05T05:51:39.671+0100 [conn1425235] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:39.673+0100 [conn1424837] end connection 172.28.0.164:57141 (400 connections now open) 2015-10-05T05:51:39.674+0100 [mongosMain] connection accepted from 172.28.0.164:58037 #1425236 (401 connections now open) 2015-10-05T05:51:39.675+0100 [conn1425235] end connection 127.0.0.1:64979 (400 connections now open) 2015-10-05T05:51:39.675+0100 [conn1425236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:39.972+0100 [conn1424838] end connection 172.28.0.163:64086 (399 connections now open) 2015-10-05T05:51:39.973+0100 [mongosMain] connection accepted from 172.28.0.163:64980 #1425237 (400 connections now open) 2015-10-05T05:51:39.974+0100 [conn1425237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:43.885+0100 [conn1424839] end connection 172.28.0.164:57148 (399 connections now open) 2015-10-05T05:51:43.886+0100 [mongosMain] connection accepted from 172.28.0.164:58045 #1425238 (400 connections now open) 2015-10-05T05:51:43.887+0100 [conn1425238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:46.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201e25703b51053ebb2fa 2015-10-05T05:51:46.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:48.791+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:51:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:51:49.144+0100 [conn1424821] end connection 172.28.0.164:57110 (399 connections now open) 2015-10-05T05:51:49.145+0100 [mongosMain] connection accepted from 172.28.0.164:58051 #1425239 (400 connections now open) 2015-10-05T05:51:49.147+0100 [conn1425239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:49.689+0100 [conn1424842] end connection 172.28.0.164:57160 (399 connections now open) 2015-10-05T05:51:49.690+0100 [mongosMain] connection accepted from 172.28.0.164:58053 #1425240 (400 connections now open) 2015-10-05T05:51:49.692+0100 [conn1425240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:49.988+0100 [conn1424843] end connection 172.28.0.163:64095 (399 connections now open) 2015-10-05T05:51:49.989+0100 [mongosMain] connection accepted from 172.28.0.163:64995 #1425241 (400 connections now open) 2015-10-05T05:51:49.990+0100 [conn1425241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:53.467+0100 [conn1424783] end connection 172.28.0.163:63932 (399 connections now open) 2015-10-05T05:51:53.468+0100 [mongosMain] connection accepted from 172.28.0.163:65000 #1425242 (400 connections now open) 2015-10-05T05:51:53.469+0100 [conn1425242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:53.886+0100 [conn1424845] end connection 172.28.0.164:57167 (399 connections now open) 2015-10-05T05:51:53.888+0100 [mongosMain] connection accepted from 172.28.0.164:58061 #1425243 (400 connections now open) 2015-10-05T05:51:53.889+0100 [conn1425243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:58.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201ee5703b51053ebb366 2015-10-05T05:51:58.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:51:59.143+0100 [conn1424802] end connection 172.28.0.164:57070 (399 connections now open) 2015-10-05T05:51:59.145+0100 [mongosMain] connection accepted from 172.28.0.164:58065 #1425244 (400 connections now open) 2015-10-05T05:51:59.147+0100 [conn1425244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:59.690+0100 [conn1424847] end connection 172.28.0.164:57177 (399 connections now open) 2015-10-05T05:51:59.691+0100 [mongosMain] connection accepted from 172.28.0.164:58067 #1425245 (400 connections now open) 2015-10-05T05:51:59.693+0100 [conn1425245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:51:59.992+0100 [conn1424848] end connection 172.28.0.163:64108 (399 connections now open) 2015-10-05T05:51:59.993+0100 [mongosMain] connection accepted from 172.28.0.163:65009 #1425246 (400 connections now open) 2015-10-05T05:51:59.994+0100 [conn1425246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:03.467+0100 [conn1424753] end connection 172.28.0.163:63843 (399 connections now open) 2015-10-05T05:52:03.468+0100 [conn1424818] end connection 172.28.0.163:64055 (398 connections now open) 2015-10-05T05:52:03.469+0100 [mongosMain] connection accepted from 172.28.0.163:65016 #1425247 (399 connections now open) 2015-10-05T05:52:03.469+0100 [mongosMain] connection accepted from 172.28.0.163:65017 #1425248 (400 connections now open) 2015-10-05T05:52:03.470+0100 [conn1425247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:03.470+0100 [conn1425248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:03.901+0100 [conn1424849] end connection 172.28.0.164:57184 (399 connections now open) 2015-10-05T05:52:03.903+0100 [mongosMain] connection accepted from 172.28.0.164:58072 #1425249 (400 connections now open) 2015-10-05T05:52:03.904+0100 [conn1425249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:04.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201f45703b51053ebb3a9 2015-10-05T05:52:04.945+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:52:09.143+0100 [conn1424814] end connection 172.28.0.164:57101 (399 connections now open) 2015-10-05T05:52:09.144+0100 [mongosMain] connection accepted from 172.28.0.164:58074 #1425250 (400 connections now open) 2015-10-05T05:52:09.146+0100 [conn1425250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:09.427+0100 [conn1424829] end connection 172.28.0.163:64077 (399 connections now open) 2015-10-05T05:52:09.428+0100 [mongosMain] connection accepted from 172.28.0.163:65026 #1425251 (400 connections now open) 2015-10-05T05:52:09.429+0100 [conn1425251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:09.690+0100 [conn1424851] end connection 172.28.0.164:57188 (399 connections now open) 2015-10-05T05:52:09.691+0100 [mongosMain] connection accepted from 172.28.0.164:58076 #1425252 (400 connections now open) 2015-10-05T05:52:09.693+0100 [conn1425252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:10.004+0100 [conn1424852] end connection 172.28.0.163:64122 (399 connections now open) 2015-10-05T05:52:10.005+0100 [mongosMain] connection accepted from 172.28.0.163:65029 #1425253 (400 connections now open) 2015-10-05T05:52:10.006+0100 [conn1425253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:11.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561201fa5703b51053ebb3c8 2015-10-05T05:52:11.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:52:13.482+0100 [conn1424825] end connection 172.28.0.163:64070 (399 connections now open) 2015-10-05T05:52:13.483+0100 [mongosMain] connection accepted from 172.28.0.163:65032 #1425254 (400 connections now open) 2015-10-05T05:52:13.485+0100 [conn1425254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:13.901+0100 [conn1424846] end connection 172.28.0.164:57168 (399 connections now open) 2015-10-05T05:52:13.901+0100 [conn1424833] end connection 172.28.0.164:57132 (399 connections now open) 2015-10-05T05:52:13.902+0100 [mongosMain] connection accepted from 172.28.0.164:58080 #1425255 (399 connections now open) 2015-10-05T05:52:13.902+0100 [mongosMain] connection accepted from 172.28.0.164:58081 #1425256 (400 connections now open) 2015-10-05T05:52:13.903+0100 [conn1425255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:13.904+0100 [conn1425256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:19.060+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:52:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:52:19.159+0100 [conn1424840] end connection 172.28.0.164:57157 (399 connections now open) 2015-10-05T05:52:19.159+0100 [mongosMain] connection accepted from 172.28.0.164:58086 #1425257 (400 connections now open) 2015-10-05T05:52:19.161+0100 [conn1425257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:19.442+0100 [conn1424836] end connection 172.28.0.163:64084 (399 connections now open) 2015-10-05T05:52:19.443+0100 [mongosMain] connection accepted from 172.28.0.163:65038 #1425258 (400 connections now open) 2015-10-05T05:52:19.445+0100 [conn1425258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:19.705+0100 [conn1424857] end connection 172.28.0.164:57199 (399 connections now open) 2015-10-05T05:52:19.706+0100 [mongosMain] connection accepted from 172.28.0.164:58090 #1425259 (400 connections now open) 2015-10-05T05:52:19.708+0100 [conn1425259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:20.004+0100 [conn1424858] end connection 172.28.0.163:64144 (399 connections now open) 2015-10-05T05:52:20.005+0100 [mongosMain] connection accepted from 172.28.0.163:65040 #1425260 (400 connections now open) 2015-10-05T05:52:20.007+0100 [conn1425260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:23.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202075703b51053ebb41d 2015-10-05T05:52:23.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:52:23.498+0100 [conn1424854] end connection 172.28.0.163:64133 (399 connections now open) 2015-10-05T05:52:23.500+0100 [mongosMain] connection accepted from 172.28.0.163:65043 #1425261 (400 connections now open) 2015-10-05T05:52:23.501+0100 [conn1425261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:23.917+0100 [conn1424861] end connection 172.28.0.164:57204 (399 connections now open) 2015-10-05T05:52:23.918+0100 [mongosMain] connection accepted from 172.28.0.164:58097 #1425262 (400 connections now open) 2015-10-05T05:52:23.920+0100 [conn1425262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:29.019+0100 [mongosMain] connection accepted from 127.0.0.1:65045 #1425263 (401 connections now open) 2015-10-05T05:52:29.021+0100 [conn1425263] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:29.029+0100 [conn1425263] end connection 127.0.0.1:65045 (400 connections now open) 2015-10-05T05:52:29.443+0100 [conn1424794] end connection 172.28.0.163:63995 (399 connections now open) 2015-10-05T05:52:29.444+0100 [mongosMain] connection accepted from 172.28.0.163:65046 #1425264 (400 connections now open) 2015-10-05T05:52:29.445+0100 [conn1425264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:29.720+0100 [conn1424864] end connection 172.28.0.164:57213 (399 connections now open) 2015-10-05T05:52:29.722+0100 [mongosMain] connection accepted from 172.28.0.164:58105 #1425265 (400 connections now open) 2015-10-05T05:52:29.724+0100 [conn1425265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:30.020+0100 [conn1424865] end connection 172.28.0.163:64160 (399 connections now open) 2015-10-05T05:52:30.021+0100 [mongosMain] connection accepted from 172.28.0.163:65049 #1425266 (400 connections now open) 2015-10-05T05:52:30.022+0100 [conn1425266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:33.500+0100 [conn1424867] end connection 172.28.0.163:64164 (399 connections now open) 2015-10-05T05:52:33.501+0100 [conn1424859] end connection 172.28.0.163:64149 (398 connections now open) 2015-10-05T05:52:33.502+0100 [mongosMain] connection accepted from 172.28.0.163:65051 #1425267 (399 connections now open) 2015-10-05T05:52:33.502+0100 [mongosMain] connection accepted from 172.28.0.163:65052 #1425268 (400 connections now open) 2015-10-05T05:52:33.503+0100 [conn1425267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:33.503+0100 [conn1425268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:33.933+0100 [conn1424855] end connection 172.28.0.164:57194 (399 connections now open) 2015-10-05T05:52:33.933+0100 [conn1424832] end connection 172.28.0.164:57131 (398 connections now open) 2015-10-05T05:52:33.935+0100 [mongosMain] connection accepted from 172.28.0.164:58111 #1425269 (399 connections now open) 2015-10-05T05:52:33.935+0100 [mongosMain] connection accepted from 172.28.0.164:58112 #1425270 (400 connections now open) 2015-10-05T05:52:33.937+0100 [conn1425269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:33.937+0100 [conn1425270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:35.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202135703b51053ebb467 2015-10-05T05:52:35.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:52:39.190+0100 [conn1424828] end connection 172.28.0.164:57119 (399 connections now open) 2015-10-05T05:52:39.191+0100 [mongosMain] connection accepted from 172.28.0.164:58122 #1425271 (400 connections now open) 2015-10-05T05:52:39.193+0100 [conn1425271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:39.408+0100 [mongosMain] connection accepted from 127.0.0.1:65056 #1425272 (401 connections now open) 2015-10-05T05:52:39.411+0100 [conn1425272] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:39.415+0100 [conn1425272] end connection 127.0.0.1:65056 (400 connections now open) 2015-10-05T05:52:39.458+0100 [conn1424850] end connection 172.28.0.163:64120 (399 connections now open) 2015-10-05T05:52:39.459+0100 [mongosMain] connection accepted from 172.28.0.163:65057 #1425273 (400 connections now open) 2015-10-05T05:52:39.460+0100 [conn1425273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:39.737+0100 [conn1424871] end connection 172.28.0.164:57228 (399 connections now open) 2015-10-05T05:52:39.738+0100 [mongosMain] connection accepted from 172.28.0.164:58124 #1425274 (400 connections now open) 2015-10-05T05:52:39.740+0100 [conn1425274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:40.020+0100 [conn1424872] end connection 172.28.0.163:64169 (399 connections now open) 2015-10-05T05:52:40.022+0100 [mongosMain] connection accepted from 172.28.0.163:65058 #1425275 (400 connections now open) 2015-10-05T05:52:40.023+0100 [conn1425275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:43.514+0100 [conn1424874] end connection 172.28.0.163:64172 (399 connections now open) 2015-10-05T05:52:43.514+0100 [conn1424866] end connection 172.28.0.163:64163 (399 connections now open) 2015-10-05T05:52:43.515+0100 [mongosMain] connection accepted from 172.28.0.163:65065 #1425276 (399 connections now open) 2015-10-05T05:52:43.515+0100 [mongosMain] connection accepted from 172.28.0.163:65066 #1425277 (400 connections now open) 2015-10-05T05:52:43.516+0100 [conn1425276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:43.516+0100 [conn1425277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:43.948+0100 [conn1424827] end connection 172.28.0.164:57116 (399 connections now open) 2015-10-05T05:52:43.949+0100 [mongosMain] connection accepted from 172.28.0.164:58131 #1425278 (400 connections now open) 2015-10-05T05:52:43.951+0100 [conn1425278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:47.927+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T05:52:47.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T05:52:49.458+0100 [conn1424863] end connection 172.28.0.163:64158 (399 connections now open) 2015-10-05T05:52:49.459+0100 [mongosMain] connection accepted from 172.28.0.163:65075 #1425279 (400 connections now open) 2015-10-05T05:52:49.461+0100 [conn1425279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:49.462+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:52:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:52:49.736+0100 [conn1424879] end connection 172.28.0.164:57249 (399 connections now open) 2015-10-05T05:52:49.738+0100 [mongosMain] connection accepted from 172.28.0.164:58139 #1425280 (400 connections now open) 2015-10-05T05:52:49.740+0100 [conn1425280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:50.036+0100 [conn1424880] end connection 172.28.0.163:64177 (399 connections now open) 2015-10-05T05:52:50.037+0100 [mongosMain] connection accepted from 172.28.0.163:65077 #1425281 (400 connections now open) 2015-10-05T05:52:50.038+0100 [conn1425281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:53.515+0100 [conn1424806] end connection 172.28.0.163:64018 (399 connections now open) 2015-10-05T05:52:53.516+0100 [conn1424873] end connection 172.28.0.163:64171 (398 connections now open) 2015-10-05T05:52:53.516+0100 [mongosMain] connection accepted from 172.28.0.163:65082 #1425282 (399 connections now open) 2015-10-05T05:52:53.517+0100 [mongosMain] connection accepted from 172.28.0.163:65083 #1425283 (400 connections now open) 2015-10-05T05:52:53.518+0100 [conn1425283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:53.518+0100 [conn1425282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:53.964+0100 [conn1424812] end connection 172.28.0.164:57097 (399 connections now open) 2015-10-05T05:52:53.965+0100 [mongosMain] connection accepted from 172.28.0.164:58149 #1425284 (400 connections now open) 2015-10-05T05:52:53.966+0100 [conn1425284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:54.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202255703b51053ebb4ee 2015-10-05T05:52:54.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:52:59.206+0100 [conn1424877] end connection 172.28.0.164:57246 (399 connections now open) 2015-10-05T05:52:59.208+0100 [mongosMain] connection accepted from 172.28.0.164:58152 #1425285 (400 connections now open) 2015-10-05T05:52:59.209+0100 [conn1425285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:59.474+0100 [conn1424841] end connection 172.28.0.163:64092 (399 connections now open) 2015-10-05T05:52:59.475+0100 [mongosMain] connection accepted from 172.28.0.163:65095 #1425286 (400 connections now open) 2015-10-05T05:52:59.476+0100 [conn1425286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:52:59.752+0100 [conn1424887] end connection 172.28.0.164:57268 (399 connections now open) 2015-10-05T05:52:59.753+0100 [mongosMain] connection accepted from 172.28.0.164:58154 #1425287 (400 connections now open) 2015-10-05T05:52:59.755+0100 [conn1425287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:00.051+0100 [conn1424888] end connection 172.28.0.163:64196 (399 connections now open) 2015-10-05T05:53:00.053+0100 [mongosMain] connection accepted from 172.28.0.163:65097 #1425288 (400 connections now open) 2015-10-05T05:53:00.054+0100 [conn1425288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:03.530+0100 [conn1424882] end connection 172.28.0.163:64183 (399 connections now open) 2015-10-05T05:53:03.530+0100 [conn1424780] end connection 172.28.0.163:63920 (399 connections now open) 2015-10-05T05:53:03.531+0100 [mongosMain] connection accepted from 172.28.0.163:65109 #1425289 (399 connections now open) 2015-10-05T05:53:03.532+0100 [mongosMain] connection accepted from 172.28.0.163:65110 #1425290 (400 connections now open) 2015-10-05T05:53:03.532+0100 [conn1425289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:03.533+0100 [conn1425290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:03.979+0100 [conn1424868] end connection 172.28.0.164:57221 (399 connections now open) 2015-10-05T05:53:03.980+0100 [conn1424876] end connection 172.28.0.164:57236 (398 connections now open) 2015-10-05T05:53:03.981+0100 [mongosMain] connection accepted from 172.28.0.164:58162 #1425291 (399 connections now open) 2015-10-05T05:53:03.981+0100 [mongosMain] connection accepted from 172.28.0.164:58163 #1425292 (400 connections now open) 2015-10-05T05:53:03.982+0100 [conn1425292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:03.984+0100 [conn1425291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:09.475+0100 [conn1424878] end connection 172.28.0.163:64176 (399 connections now open) 2015-10-05T05:53:09.476+0100 [mongosMain] connection accepted from 172.28.0.163:65119 #1425293 (400 connections now open) 2015-10-05T05:53:09.477+0100 [conn1425293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:09.753+0100 [conn1424894] end connection 172.28.0.164:57279 (399 connections now open) 2015-10-05T05:53:09.754+0100 [mongosMain] connection accepted from 172.28.0.164:58166 #1425294 (400 connections now open) 2015-10-05T05:53:09.756+0100 [conn1425294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:10.052+0100 [conn1424895] end connection 172.28.0.163:64214 (399 connections now open) 2015-10-05T05:53:10.053+0100 [mongosMain] connection accepted from 172.28.0.163:65122 #1425295 (400 connections now open) 2015-10-05T05:53:10.054+0100 [conn1425295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:12.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202385703b51053ebb588 2015-10-05T05:53:12.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:53:13.533+0100 [conn1424889] end connection 172.28.0.163:64200 (399 connections now open) 2015-10-05T05:53:13.533+0100 [conn1424853] end connection 172.28.0.163:64132 (399 connections now open) 2015-10-05T05:53:13.534+0100 [mongosMain] connection accepted from 172.28.0.163:65126 #1425296 (399 connections now open) 2015-10-05T05:53:13.534+0100 [mongosMain] connection accepted from 172.28.0.163:65127 #1425297 (400 connections now open) 2015-10-05T05:53:13.535+0100 [conn1425296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:13.535+0100 [conn1425297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:13.980+0100 [conn1424875] end connection 172.28.0.164:57235 (399 connections now open) 2015-10-05T05:53:13.982+0100 [conn1424884] end connection 172.28.0.164:57255 (398 connections now open) 2015-10-05T05:53:13.983+0100 [mongosMain] connection accepted from 172.28.0.164:58169 #1425298 (399 connections now open) 2015-10-05T05:53:13.984+0100 [mongosMain] connection accepted from 172.28.0.164:58170 #1425299 (400 connections now open) 2015-10-05T05:53:13.985+0100 [conn1425298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:13.986+0100 [conn1425299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:19.222+0100 [conn1424892] end connection 172.28.0.164:57277 (399 connections now open) 2015-10-05T05:53:19.223+0100 [mongosMain] connection accepted from 172.28.0.164:58175 #1425300 (400 connections now open) 2015-10-05T05:53:19.225+0100 [conn1425300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:19.490+0100 [conn1424856] end connection 172.28.0.163:64142 (399 connections now open) 2015-10-05T05:53:19.491+0100 [mongosMain] connection accepted from 172.28.0.163:65134 #1425301 (400 connections now open) 2015-10-05T05:53:19.492+0100 [conn1425301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:19.674+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:53:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:53:19.768+0100 [conn1424901] end connection 172.28.0.164:57290 (399 connections now open) 2015-10-05T05:53:19.769+0100 [mongosMain] connection accepted from 172.28.0.164:58177 #1425302 (400 connections now open) 2015-10-05T05:53:19.770+0100 [conn1425302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:20.067+0100 [conn1424902] end connection 172.28.0.163:64235 (399 connections now open) 2015-10-05T05:53:20.068+0100 [mongosMain] connection accepted from 172.28.0.163:65136 #1425303 (400 connections now open) 2015-10-05T05:53:20.068+0100 [conn1425303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:23.545+0100 [conn1424897] end connection 172.28.0.163:64224 (399 connections now open) 2015-10-05T05:53:23.546+0100 [mongosMain] connection accepted from 172.28.0.163:65141 #1425304 (400 connections now open) 2015-10-05T05:53:23.547+0100 [conn1425304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:23.995+0100 [conn1424905] end connection 172.28.0.164:57296 (399 connections now open) 2015-10-05T05:53:23.995+0100 [conn1424706] end connection 172.28.0.164:56818 (399 connections now open) 2015-10-05T05:53:23.996+0100 [mongosMain] connection accepted from 172.28.0.164:58186 #1425305 (399 connections now open) 2015-10-05T05:53:23.996+0100 [mongosMain] connection accepted from 172.28.0.164:58187 #1425306 (400 connections now open) 2015-10-05T05:53:23.998+0100 [conn1425306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:23.998+0100 [conn1425305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:24.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202445703b51053ebb5d8 2015-10-05T05:53:25.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:53:28.871+0100 [mongosMain] connection accepted from 127.0.0.1:65144 #1425307 (401 connections now open) 2015-10-05T05:53:28.874+0100 [conn1425307] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:28.879+0100 [conn1425307] end connection 127.0.0.1:65144 (400 connections now open) 2015-10-05T05:53:29.223+0100 [conn1424885] end connection 172.28.0.164:57266 (399 connections now open) 2015-10-05T05:53:29.224+0100 [mongosMain] connection accepted from 172.28.0.164:58193 #1425308 (400 connections now open) 2015-10-05T05:53:29.226+0100 [conn1425308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:29.505+0100 [conn1424893] end connection 172.28.0.163:64211 (399 connections now open) 2015-10-05T05:53:29.507+0100 [mongosMain] connection accepted from 172.28.0.163:65145 #1425309 (400 connections now open) 2015-10-05T05:53:29.508+0100 [conn1425309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:29.768+0100 [conn1424908] end connection 172.28.0.164:57303 (399 connections now open) 2015-10-05T05:53:29.770+0100 [mongosMain] connection accepted from 172.28.0.164:58195 #1425310 (400 connections now open) 2015-10-05T05:53:29.771+0100 [conn1425310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:30.067+0100 [conn1424909] end connection 172.28.0.163:64248 (399 connections now open) 2015-10-05T05:53:30.068+0100 [mongosMain] connection accepted from 172.28.0.163:65147 #1425311 (400 connections now open) 2015-10-05T05:53:30.070+0100 [conn1425311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:31.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612024b5703b51053ebb5fe 2015-10-05T05:53:31.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:53:33.553+0100 [conn1424903] end connection 172.28.0.163:64238 (399 connections now open) 2015-10-05T05:53:33.555+0100 [mongosMain] connection accepted from 172.28.0.163:65150 #1425312 (400 connections now open) 2015-10-05T05:53:33.556+0100 [conn1425312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:33.995+0100 [conn1424898] end connection 172.28.0.164:57287 (399 connections now open) 2015-10-05T05:53:33.996+0100 [conn1424899] end connection 172.28.0.164:57286 (398 connections now open) 2015-10-05T05:53:33.996+0100 [mongosMain] connection accepted from 172.28.0.164:58203 #1425313 (399 connections now open) 2015-10-05T05:53:33.997+0100 [mongosMain] connection accepted from 172.28.0.164:58204 #1425314 (400 connections now open) 2015-10-05T05:53:33.998+0100 [conn1425313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:33.998+0100 [conn1425314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:37.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202515703b51053ebb629 2015-10-05T05:53:37.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:53:39.238+0100 [conn1424834] end connection 172.28.0.164:57139 (399 connections now open) 2015-10-05T05:53:39.239+0100 [mongosMain] connection accepted from 172.28.0.164:58214 #1425315 (400 connections now open) 2015-10-05T05:53:39.241+0100 [conn1425315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:39.783+0100 [conn1424915] end connection 172.28.0.164:57321 (399 connections now open) 2015-10-05T05:53:39.784+0100 [mongosMain] connection accepted from 172.28.0.164:58216 #1425316 (400 connections now open) 2015-10-05T05:53:39.786+0100 [conn1425316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:39.832+0100 [mongosMain] connection accepted from 127.0.0.1:65154 #1425317 (401 connections now open) 2015-10-05T05:53:39.835+0100 [conn1425317] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:39.839+0100 [conn1425317] end connection 127.0.0.1:65154 (400 connections now open) 2015-10-05T05:53:40.083+0100 [conn1424916] end connection 172.28.0.163:64255 (399 connections now open) 2015-10-05T05:53:40.084+0100 [mongosMain] connection accepted from 172.28.0.163:65155 #1425318 (400 connections now open) 2015-10-05T05:53:40.085+0100 [conn1425318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:44.011+0100 [conn1424912] end connection 172.28.0.164:57313 (399 connections now open) 2015-10-05T05:53:44.011+0100 [conn1424911] end connection 172.28.0.164:57312 (399 connections now open) 2015-10-05T05:53:44.012+0100 [mongosMain] connection accepted from 172.28.0.164:58224 #1425319 (399 connections now open) 2015-10-05T05:53:44.013+0100 [mongosMain] connection accepted from 172.28.0.164:58225 #1425320 (400 connections now open) 2015-10-05T05:53:44.014+0100 [conn1425319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:44.015+0100 [conn1425320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:49.240+0100 [conn1424782] end connection 172.28.0.164:56977 (399 connections now open) 2015-10-05T05:53:49.242+0100 [mongosMain] connection accepted from 172.28.0.164:58232 #1425321 (400 connections now open) 2015-10-05T05:53:49.243+0100 [conn1425321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:49.783+0100 [conn1424921] end connection 172.28.0.164:57343 (399 connections now open) 2015-10-05T05:53:49.785+0100 [mongosMain] connection accepted from 172.28.0.164:58234 #1425322 (400 connections now open) 2015-10-05T05:53:49.787+0100 [conn1425322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:49.950+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:53:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:53:49.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612025d5703b51053ebb677 2015-10-05T05:53:50.083+0100 [conn1424923] end connection 172.28.0.163:64267 (399 connections now open) 2015-10-05T05:53:50.085+0100 [mongosMain] connection accepted from 172.28.0.163:65173 #1425323 (400 connections now open) 2015-10-05T05:53:50.086+0100 [conn1425323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:50.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:53:53.577+0100 [conn1424890] end connection 172.28.0.163:64201 (399 connections now open) 2015-10-05T05:53:53.579+0100 [mongosMain] connection accepted from 172.28.0.163:65180 #1425324 (400 connections now open) 2015-10-05T05:53:53.580+0100 [conn1425324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:54.011+0100 [conn1424904] end connection 172.28.0.164:57295 (399 connections now open) 2015-10-05T05:53:54.013+0100 [mongosMain] connection accepted from 172.28.0.164:58241 #1425325 (400 connections now open) 2015-10-05T05:53:54.015+0100 [conn1425325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:59.254+0100 [conn1424862] end connection 172.28.0.164:57209 (399 connections now open) 2015-10-05T05:53:59.255+0100 [mongosMain] connection accepted from 172.28.0.164:58244 #1425326 (400 connections now open) 2015-10-05T05:53:59.256+0100 [conn1425326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:53:59.800+0100 [conn1424928] end connection 172.28.0.164:57359 (399 connections now open) 2015-10-05T05:53:59.801+0100 [mongosMain] connection accepted from 172.28.0.164:58246 #1425327 (400 connections now open) 2015-10-05T05:53:59.803+0100 [conn1425327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:00.098+0100 [conn1424929] end connection 172.28.0.163:64282 (399 connections now open) 2015-10-05T05:54:00.099+0100 [mongosMain] connection accepted from 172.28.0.163:65189 #1425328 (400 connections now open) 2015-10-05T05:54:00.101+0100 [conn1425328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:02.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612026a5703b51053ebb6d1 2015-10-05T05:54:02.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:03.581+0100 [conn1424713] end connection 172.28.0.163:63760 (399 connections now open) 2015-10-05T05:54:03.582+0100 [conn1424917] end connection 172.28.0.163:64258 (398 connections now open) 2015-10-05T05:54:03.582+0100 [mongosMain] connection accepted from 172.28.0.163:65199 #1425329 (399 connections now open) 2015-10-05T05:54:03.583+0100 [mongosMain] connection accepted from 172.28.0.163:65200 #1425330 (400 connections now open) 2015-10-05T05:54:03.583+0100 [conn1425329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:03.584+0100 [conn1425330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:04.027+0100 [conn1424820] end connection 172.28.0.164:57107 (399 connections now open) 2015-10-05T05:54:04.027+0100 [conn1424931] end connection 172.28.0.164:57366 (398 connections now open) 2015-10-05T05:54:04.028+0100 [mongosMain] connection accepted from 172.28.0.164:58256 #1425331 (399 connections now open) 2015-10-05T05:54:04.028+0100 [mongosMain] connection accepted from 172.28.0.164:58255 #1425332 (400 connections now open) 2015-10-05T05:54:04.030+0100 [conn1425331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:04.030+0100 [conn1425332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:09.269+0100 [conn1424920] end connection 172.28.0.164:57338 (399 connections now open) 2015-10-05T05:54:09.272+0100 [mongosMain] connection accepted from 172.28.0.164:58259 #1425333 (400 connections now open) 2015-10-05T05:54:09.274+0100 [conn1425333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:09.537+0100 [conn1424907] end connection 172.28.0.163:64246 (399 connections now open) 2015-10-05T05:54:09.538+0100 [mongosMain] connection accepted from 172.28.0.163:65209 #1425334 (400 connections now open) 2015-10-05T05:54:09.539+0100 [conn1425334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:09.815+0100 [conn1424934] end connection 172.28.0.164:57373 (399 connections now open) 2015-10-05T05:54:09.816+0100 [mongosMain] connection accepted from 172.28.0.164:58261 #1425335 (400 connections now open) 2015-10-05T05:54:09.818+0100 [conn1425335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:10.099+0100 [conn1424935] end connection 172.28.0.163:64300 (399 connections now open) 2015-10-05T05:54:10.100+0100 [mongosMain] connection accepted from 172.28.0.163:65212 #1425336 (400 connections now open) 2015-10-05T05:54:10.101+0100 [conn1425336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:13.594+0100 [conn1424910] end connection 172.28.0.163:64251 (399 connections now open) 2015-10-05T05:54:13.594+0100 [conn1424896] end connection 172.28.0.163:64223 (399 connections now open) 2015-10-05T05:54:13.595+0100 [mongosMain] connection accepted from 172.28.0.163:65219 #1425337 (399 connections now open) 2015-10-05T05:54:13.595+0100 [mongosMain] connection accepted from 172.28.0.163:65220 #1425338 (400 connections now open) 2015-10-05T05:54:13.596+0100 [conn1425337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:13.596+0100 [conn1425338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:14.042+0100 [conn1424925] end connection 172.28.0.164:57350 (399 connections now open) 2015-10-05T05:54:14.042+0100 [conn1424938] end connection 172.28.0.164:57379 (399 connections now open) 2015-10-05T05:54:14.043+0100 [mongosMain] connection accepted from 172.28.0.164:58264 #1425339 (399 connections now open) 2015-10-05T05:54:14.044+0100 [mongosMain] connection accepted from 172.28.0.164:58265 #1425340 (400 connections now open) 2015-10-05T05:54:14.045+0100 [conn1425339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:14.045+0100 [conn1425340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:14.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202765703b51053ebb732 2015-10-05T05:54:14.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:19.284+0100 [conn1424927] end connection 172.28.0.164:57358 (399 connections now open) 2015-10-05T05:54:19.286+0100 [mongosMain] connection accepted from 172.28.0.164:58271 #1425341 (400 connections now open) 2015-10-05T05:54:19.287+0100 [conn1425341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:19.816+0100 [conn1424942] end connection 172.28.0.164:57386 (399 connections now open) 2015-10-05T05:54:19.817+0100 [mongosMain] connection accepted from 172.28.0.164:58274 #1425342 (400 connections now open) 2015-10-05T05:54:19.818+0100 [conn1425342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:20.114+0100 [conn1424943] end connection 172.28.0.163:64328 (399 connections now open) 2015-10-05T05:54:20.116+0100 [mongosMain] connection accepted from 172.28.0.163:65228 #1425343 (400 connections now open) 2015-10-05T05:54:20.117+0100 [conn1425343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:20.226+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:54:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:54:23.595+0100 [conn1424883] end connection 172.28.0.163:64184 (399 connections now open) 2015-10-05T05:54:23.595+0100 [conn1424937] end connection 172.28.0.163:64313 (399 connections now open) 2015-10-05T05:54:23.597+0100 [mongosMain] connection accepted from 172.28.0.163:65231 #1425344 (399 connections now open) 2015-10-05T05:54:23.597+0100 [mongosMain] connection accepted from 172.28.0.163:65232 #1425345 (400 connections now open) 2015-10-05T05:54:23.628+0100 [conn1425345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:23.628+0100 [conn1425344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:24.058+0100 [conn1424926] end connection 172.28.0.164:57351 (399 connections now open) 2015-10-05T05:54:24.059+0100 [conn1424918] end connection 172.28.0.164:57329 (398 connections now open) 2015-10-05T05:54:24.060+0100 [mongosMain] connection accepted from 172.28.0.164:58282 #1425346 (399 connections now open) 2015-10-05T05:54:24.060+0100 [mongosMain] connection accepted from 172.28.0.164:58283 #1425347 (400 connections now open) 2015-10-05T05:54:24.061+0100 [conn1425346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:24.061+0100 [conn1425347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:27.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202825703b51053ebb778 2015-10-05T05:54:27.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:28.210+0100 [mongosMain] connection accepted from 127.0.0.1:65236 #1425348 (401 connections now open) 2015-10-05T05:54:28.213+0100 [conn1425348] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:28.218+0100 [conn1425348] end connection 127.0.0.1:65236 (400 connections now open) 2015-10-05T05:54:29.301+0100 [conn1424914] end connection 172.28.0.164:57319 (399 connections now open) 2015-10-05T05:54:29.302+0100 [mongosMain] connection accepted from 172.28.0.164:58291 #1425349 (400 connections now open) 2015-10-05T05:54:29.303+0100 [conn1425349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:29.831+0100 [conn1424950] end connection 172.28.0.164:57399 (399 connections now open) 2015-10-05T05:54:29.832+0100 [mongosMain] connection accepted from 172.28.0.164:58293 #1425350 (400 connections now open) 2015-10-05T05:54:29.834+0100 [conn1425350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:30.130+0100 [conn1424951] end connection 172.28.0.163:64345 (399 connections now open) 2015-10-05T05:54:30.131+0100 [mongosMain] connection accepted from 172.28.0.163:65237 #1425351 (400 connections now open) 2015-10-05T05:54:30.132+0100 [conn1425351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:33.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202895703b51053ebb7ab 2015-10-05T05:54:33.609+0100 [conn1424860] end connection 172.28.0.163:64150 (399 connections now open) 2015-10-05T05:54:33.610+0100 [mongosMain] connection accepted from 172.28.0.163:65241 #1425352 (400 connections now open) 2015-10-05T05:54:33.611+0100 [conn1425352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:33.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:34.058+0100 [conn1424939] end connection 172.28.0.164:57380 (399 connections now open) 2015-10-05T05:54:34.059+0100 [mongosMain] connection accepted from 172.28.0.164:58300 #1425353 (400 connections now open) 2015-10-05T05:54:34.061+0100 [conn1425353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:39.301+0100 [conn1424906] end connection 172.28.0.164:57301 (399 connections now open) 2015-10-05T05:54:39.302+0100 [mongosMain] connection accepted from 172.28.0.164:58310 #1425354 (400 connections now open) 2015-10-05T05:54:39.303+0100 [conn1425354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:39.553+0100 [conn1424949] end connection 172.28.0.163:64343 (399 connections now open) 2015-10-05T05:54:39.554+0100 [mongosMain] connection accepted from 172.28.0.163:65246 #1425355 (400 connections now open) 2015-10-05T05:54:39.555+0100 [conn1425355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:39.831+0100 [conn1424959] end connection 172.28.0.164:57422 (399 connections now open) 2015-10-05T05:54:39.832+0100 [mongosMain] connection accepted from 172.28.0.164:58312 #1425356 (400 connections now open) 2015-10-05T05:54:39.834+0100 [conn1425356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:39.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612028f5703b51053ebb7fe 2015-10-05T05:54:40.030+0100 [mongosMain] connection accepted from 127.0.0.1:65249 #1425357 (401 connections now open) 2015-10-05T05:54:40.032+0100 [conn1425357] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:40.036+0100 [conn1425357] end connection 127.0.0.1:65249 (400 connections now open) 2015-10-05T05:54:40.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:40.129+0100 [conn1424960] end connection 172.28.0.163:64355 (399 connections now open) 2015-10-05T05:54:40.130+0100 [mongosMain] connection accepted from 172.28.0.163:65250 #1425358 (400 connections now open) 2015-10-05T05:54:40.131+0100 [conn1425358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:43.609+0100 [conn1424945] end connection 172.28.0.163:64335 (399 connections now open) 2015-10-05T05:54:43.609+0100 [conn1424924] end connection 172.28.0.163:64272 (399 connections now open) 2015-10-05T05:54:43.610+0100 [mongosMain] connection accepted from 172.28.0.163:65257 #1425359 (399 connections now open) 2015-10-05T05:54:43.611+0100 [mongosMain] connection accepted from 172.28.0.163:65258 #1425360 (400 connections now open) 2015-10-05T05:54:43.611+0100 [conn1425359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:43.611+0100 [conn1425360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:44.074+0100 [conn1424947] end connection 172.28.0.164:57390 (399 connections now open) 2015-10-05T05:54:44.074+0100 [conn1424919] end connection 172.28.0.164:57330 (398 connections now open) 2015-10-05T05:54:44.075+0100 [mongosMain] connection accepted from 172.28.0.164:58320 #1425361 (399 connections now open) 2015-10-05T05:54:44.076+0100 [mongosMain] connection accepted from 172.28.0.164:58322 #1425362 (400 connections now open) 2015-10-05T05:54:44.077+0100 [conn1425361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:44.077+0100 [conn1425362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:46.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202965703b51053ebb85e 2015-10-05T05:54:46.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:49.316+0100 [conn1424940] end connection 172.28.0.164:57384 (399 connections now open) 2015-10-05T05:54:49.317+0100 [mongosMain] connection accepted from 172.28.0.164:58333 #1425363 (400 connections now open) 2015-10-05T05:54:49.318+0100 [conn1425363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:49.568+0100 [conn1424886] end connection 172.28.0.163:64195 (399 connections now open) 2015-10-05T05:54:49.570+0100 [mongosMain] connection accepted from 172.28.0.163:65267 #1425364 (400 connections now open) 2015-10-05T05:54:49.571+0100 [conn1425364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:49.846+0100 [conn1424968] end connection 172.28.0.164:57440 (399 connections now open) 2015-10-05T05:54:49.847+0100 [mongosMain] connection accepted from 172.28.0.164:58336 #1425365 (400 connections now open) 2015-10-05T05:54:49.849+0100 [conn1425365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:50.146+0100 [conn1424969] end connection 172.28.0.163:64366 (399 connections now open) 2015-10-05T05:54:50.147+0100 [mongosMain] connection accepted from 172.28.0.163:65270 #1425366 (400 connections now open) 2015-10-05T05:54:50.148+0100 [conn1425366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:50.574+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:54:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:54:52.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612029c5703b51053ebb8c8 2015-10-05T05:54:52.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:53.625+0100 [conn1424961] end connection 172.28.0.163:64358 (399 connections now open) 2015-10-05T05:54:53.626+0100 [mongosMain] connection accepted from 172.28.0.163:65274 #1425367 (400 connections now open) 2015-10-05T05:54:53.628+0100 [conn1425367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:54.074+0100 [conn1424955] end connection 172.28.0.164:57411 (399 connections now open) 2015-10-05T05:54:54.075+0100 [conn1424932] end connection 172.28.0.164:57367 (398 connections now open) 2015-10-05T05:54:54.075+0100 [mongosMain] connection accepted from 172.28.0.164:58343 #1425368 (399 connections now open) 2015-10-05T05:54:54.076+0100 [mongosMain] connection accepted from 172.28.0.164:58344 #1425369 (400 connections now open) 2015-10-05T05:54:54.077+0100 [conn1425368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:54.078+0100 [conn1425369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:59.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202a25703b51053ebb929 2015-10-05T05:54:59.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:54:59.332+0100 [conn1424948] end connection 172.28.0.164:57396 (399 connections now open) 2015-10-05T05:54:59.333+0100 [mongosMain] connection accepted from 172.28.0.164:58347 #1425370 (400 connections now open) 2015-10-05T05:54:59.335+0100 [conn1425370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:59.584+0100 [conn1424941] end connection 172.28.0.163:64325 (399 connections now open) 2015-10-05T05:54:59.585+0100 [mongosMain] connection accepted from 172.28.0.163:65283 #1425371 (400 connections now open) 2015-10-05T05:54:59.586+0100 [conn1425371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:54:59.862+0100 [conn1424976] end connection 172.28.0.164:57458 (399 connections now open) 2015-10-05T05:54:59.863+0100 [mongosMain] connection accepted from 172.28.0.164:58349 #1425372 (400 connections now open) 2015-10-05T05:54:59.864+0100 [conn1425372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:00.146+0100 [conn1424977] end connection 172.28.0.163:64385 (399 connections now open) 2015-10-05T05:55:00.147+0100 [mongosMain] connection accepted from 172.28.0.163:65287 #1425373 (400 connections now open) 2015-10-05T05:55:00.148+0100 [conn1425373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:03.640+0100 [conn1424952] end connection 172.28.0.163:64349 (399 connections now open) 2015-10-05T05:55:03.640+0100 [conn1424953] end connection 172.28.0.163:64351 (398 connections now open) 2015-10-05T05:55:03.641+0100 [mongosMain] connection accepted from 172.28.0.163:65297 #1425374 (399 connections now open) 2015-10-05T05:55:03.641+0100 [mongosMain] connection accepted from 172.28.0.163:65298 #1425375 (400 connections now open) 2015-10-05T05:55:03.642+0100 [conn1425374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:03.643+0100 [conn1425375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:04.090+0100 [conn1424964] end connection 172.28.0.164:57429 (399 connections now open) 2015-10-05T05:55:04.090+0100 [conn1424963] end connection 172.28.0.164:57428 (399 connections now open) 2015-10-05T05:55:04.091+0100 [mongosMain] connection accepted from 172.28.0.164:58355 #1425376 (399 connections now open) 2015-10-05T05:55:04.091+0100 [mongosMain] connection accepted from 172.28.0.164:58356 #1425377 (400 connections now open) 2015-10-05T05:55:04.092+0100 [conn1425376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:04.093+0100 [conn1425377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:05.222+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202a95703b51053ebb9a0 2015-10-05T05:55:05.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:09.347+0100 [conn1424957] end connection 172.28.0.164:57419 (399 connections now open) 2015-10-05T05:55:09.349+0100 [mongosMain] connection accepted from 172.28.0.164:58358 #1425378 (400 connections now open) 2015-10-05T05:55:09.350+0100 [conn1425378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:09.584+0100 [conn1424900] end connection 172.28.0.163:64233 (399 connections now open) 2015-10-05T05:55:09.585+0100 [mongosMain] connection accepted from 172.28.0.163:65308 #1425379 (400 connections now open) 2015-10-05T05:55:09.586+0100 [conn1425379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:09.878+0100 [conn1424984] end connection 172.28.0.164:57474 (399 connections now open) 2015-10-05T05:55:09.879+0100 [mongosMain] connection accepted from 172.28.0.164:58360 #1425380 (400 connections now open) 2015-10-05T05:55:09.880+0100 [conn1425380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:10.161+0100 [conn1424985] end connection 172.28.0.163:64402 (399 connections now open) 2015-10-05T05:55:10.162+0100 [mongosMain] connection accepted from 172.28.0.163:65310 #1425381 (400 connections now open) 2015-10-05T05:55:10.163+0100 [conn1425381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:11.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202af5703b51053ebb9f2 2015-10-05T05:55:11.707+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:13.640+0100 [conn1424930] end connection 172.28.0.163:64288 (399 connections now open) 2015-10-05T05:55:13.640+0100 [conn1424979] end connection 172.28.0.163:64390 (399 connections now open) 2015-10-05T05:55:13.641+0100 [mongosMain] connection accepted from 172.28.0.163:65313 #1425382 (399 connections now open) 2015-10-05T05:55:13.642+0100 [mongosMain] connection accepted from 172.28.0.163:65314 #1425383 (400 connections now open) 2015-10-05T05:55:13.642+0100 [conn1425382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:13.642+0100 [conn1425383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:14.090+0100 [conn1424972] end connection 172.28.0.164:57446 (399 connections now open) 2015-10-05T05:55:14.090+0100 [conn1424980] end connection 172.28.0.164:57467 (398 connections now open) 2015-10-05T05:55:14.092+0100 [mongosMain] connection accepted from 172.28.0.164:58363 #1425384 (399 connections now open) 2015-10-05T05:55:14.092+0100 [mongosMain] connection accepted from 172.28.0.164:58364 #1425385 (400 connections now open) 2015-10-05T05:55:14.093+0100 [conn1425384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:14.093+0100 [conn1425385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:17.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202b55703b51053ebba41 2015-10-05T05:55:18.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:19.601+0100 [conn1424966] end connection 172.28.0.163:64363 (399 connections now open) 2015-10-05T05:55:19.602+0100 [mongosMain] connection accepted from 172.28.0.163:65321 #1425386 (400 connections now open) 2015-10-05T05:55:19.603+0100 [conn1425386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:19.894+0100 [conn1424992] end connection 172.28.0.164:57486 (399 connections now open) 2015-10-05T05:55:19.895+0100 [mongosMain] connection accepted from 172.28.0.164:58374 #1425387 (400 connections now open) 2015-10-05T05:55:19.897+0100 [conn1425387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:20.162+0100 [conn1424993] end connection 172.28.0.163:64425 (399 connections now open) 2015-10-05T05:55:20.163+0100 [mongosMain] connection accepted from 172.28.0.163:65323 #1425388 (400 connections now open) 2015-10-05T05:55:20.164+0100 [conn1425388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:20.827+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:55:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:55:23.656+0100 [conn1424987] end connection 172.28.0.163:64413 (399 connections now open) 2015-10-05T05:55:23.656+0100 [conn1424978] end connection 172.28.0.163:64389 (398 connections now open) 2015-10-05T05:55:23.658+0100 [mongosMain] connection accepted from 172.28.0.163:65327 #1425389 (399 connections now open) 2015-10-05T05:55:23.658+0100 [mongosMain] connection accepted from 172.28.0.163:65328 #1425390 (400 connections now open) 2015-10-05T05:55:23.659+0100 [conn1425389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:23.660+0100 [conn1425390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:24.105+0100 [conn1424988] end connection 172.28.0.164:57480 (399 connections now open) 2015-10-05T05:55:24.106+0100 [conn1424891] end connection 172.28.0.164:57274 (398 connections now open) 2015-10-05T05:55:24.106+0100 [mongosMain] connection accepted from 172.28.0.164:58382 #1425391 (399 connections now open) 2015-10-05T05:55:24.107+0100 [mongosMain] connection accepted from 172.28.0.164:58383 #1425392 (400 connections now open) 2015-10-05T05:55:24.108+0100 [conn1425391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:24.108+0100 [conn1425392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:24.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202bc5703b51053ebba7c 2015-10-05T05:55:24.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:29.110+0100 [mongosMain] connection accepted from 127.0.0.1:65331 #1425393 (401 connections now open) 2015-10-05T05:55:29.113+0100 [conn1425393] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:29.118+0100 [conn1425393] end connection 127.0.0.1:65331 (400 connections now open) 2015-10-05T05:55:29.348+0100 [conn1424965] end connection 172.28.0.164:57436 (399 connections now open) 2015-10-05T05:55:29.349+0100 [mongosMain] connection accepted from 172.28.0.164:58390 #1425394 (400 connections now open) 2015-10-05T05:55:29.351+0100 [conn1425394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:29.600+0100 [conn1424958] end connection 172.28.0.163:64353 (399 connections now open) 2015-10-05T05:55:29.602+0100 [mongosMain] connection accepted from 172.28.0.163:65332 #1425395 (400 connections now open) 2015-10-05T05:55:29.603+0100 [conn1425395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:29.894+0100 [conn1425000] end connection 172.28.0.164:57498 (399 connections now open) 2015-10-05T05:55:29.895+0100 [mongosMain] connection accepted from 172.28.0.164:58392 #1425396 (400 connections now open) 2015-10-05T05:55:29.897+0100 [conn1425396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:30.177+0100 [conn1425001] end connection 172.28.0.163:64439 (399 connections now open) 2015-10-05T05:55:30.178+0100 [mongosMain] connection accepted from 172.28.0.163:65334 #1425397 (400 connections now open) 2015-10-05T05:55:30.179+0100 [conn1425397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:30.809+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202c25703b51053ebbaa5 2015-10-05T05:55:30.945+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:33.661+0100 [conn1424962] end connection 172.28.0.163:64359 (399 connections now open) 2015-10-05T05:55:33.661+0100 [conn1424970] end connection 172.28.0.163:64372 (399 connections now open) 2015-10-05T05:55:33.662+0100 [mongosMain] connection accepted from 172.28.0.163:65338 #1425398 (399 connections now open) 2015-10-05T05:55:33.663+0100 [mongosMain] connection accepted from 172.28.0.163:65339 #1425399 (400 connections now open) 2015-10-05T05:55:33.664+0100 [conn1425398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:33.664+0100 [conn1425399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:34.107+0100 [conn1424973] end connection 172.28.0.164:57447 (399 connections now open) 2015-10-05T05:55:34.107+0100 [conn1424954] end connection 172.28.0.164:57410 (398 connections now open) 2015-10-05T05:55:34.109+0100 [mongosMain] connection accepted from 172.28.0.164:58402 #1425400 (399 connections now open) 2015-10-05T05:55:34.109+0100 [mongosMain] connection accepted from 172.28.0.164:58401 #1425401 (400 connections now open) 2015-10-05T05:55:34.111+0100 [conn1425400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:34.111+0100 [conn1425401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:37.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202c85703b51053ebbac6 2015-10-05T05:55:37.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:39.364+0100 [conn1424990] end connection 172.28.0.164:57484 (399 connections now open) 2015-10-05T05:55:39.365+0100 [mongosMain] connection accepted from 172.28.0.164:58411 #1425402 (400 connections now open) 2015-10-05T05:55:39.366+0100 [conn1425402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:39.617+0100 [conn1424870] end connection 172.28.0.163:64167 (399 connections now open) 2015-10-05T05:55:39.618+0100 [mongosMain] connection accepted from 172.28.0.163:65344 #1425403 (400 connections now open) 2015-10-05T05:55:39.620+0100 [conn1425403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:39.780+0100 [mongosMain] connection accepted from 127.0.0.1:65345 #1425404 (401 connections now open) 2015-10-05T05:55:39.782+0100 [conn1425404] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:39.786+0100 [conn1425404] end connection 127.0.0.1:65345 (400 connections now open) 2015-10-05T05:55:39.918+0100 [conn1425009] end connection 172.28.0.164:57516 (399 connections now open) 2015-10-05T05:55:39.919+0100 [mongosMain] connection accepted from 172.28.0.164:58414 #1425405 (400 connections now open) 2015-10-05T05:55:39.920+0100 [conn1425405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:40.178+0100 [conn1425010] end connection 172.28.0.163:64450 (399 connections now open) 2015-10-05T05:55:40.179+0100 [mongosMain] connection accepted from 172.28.0.163:65346 #1425406 (400 connections now open) 2015-10-05T05:55:40.180+0100 [conn1425406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:43.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202cf5703b51053ebbae9 2015-10-05T05:55:43.671+0100 [conn1424995] end connection 172.28.0.163:64430 (399 connections now open) 2015-10-05T05:55:43.672+0100 [conn1424936] end connection 172.28.0.163:64312 (399 connections now open) 2015-10-05T05:55:43.673+0100 [mongosMain] connection accepted from 172.28.0.163:65352 #1425407 (399 connections now open) 2015-10-05T05:55:43.673+0100 [mongosMain] connection accepted from 172.28.0.163:65353 #1425408 (400 connections now open) 2015-10-05T05:55:43.674+0100 [conn1425407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:43.674+0100 [conn1425408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:43.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:44.121+0100 [conn1425014] end connection 172.28.0.164:57525 (399 connections now open) 2015-10-05T05:55:44.121+0100 [conn1424996] end connection 172.28.0.164:57489 (398 connections now open) 2015-10-05T05:55:44.123+0100 [mongosMain] connection accepted from 172.28.0.164:58421 #1425409 (399 connections now open) 2015-10-05T05:55:44.123+0100 [mongosMain] connection accepted from 172.28.0.164:58422 #1425410 (400 connections now open) 2015-10-05T05:55:44.124+0100 [conn1425409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:44.125+0100 [conn1425410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:49.379+0100 [conn1424998] end connection 172.28.0.164:57496 (399 connections now open) 2015-10-05T05:55:49.380+0100 [mongosMain] connection accepted from 172.28.0.164:58429 #1425411 (400 connections now open) 2015-10-05T05:55:49.382+0100 [conn1425411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:49.618+0100 [conn1424975] end connection 172.28.0.163:64382 (399 connections now open) 2015-10-05T05:55:49.619+0100 [mongosMain] connection accepted from 172.28.0.163:65363 #1425412 (400 connections now open) 2015-10-05T05:55:49.620+0100 [conn1425412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:49.925+0100 [conn1425017] end connection 172.28.0.164:57538 (399 connections now open) 2015-10-05T05:55:49.926+0100 [mongosMain] connection accepted from 172.28.0.164:58431 #1425413 (400 connections now open) 2015-10-05T05:55:49.928+0100 [conn1425413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:49.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202d55703b51053ebbb15 2015-10-05T05:55:50.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:50.193+0100 [conn1425018] end connection 172.28.0.163:64461 (399 connections now open) 2015-10-05T05:55:50.194+0100 [mongosMain] connection accepted from 172.28.0.163:65365 #1425414 (400 connections now open) 2015-10-05T05:55:50.195+0100 [conn1425414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:51.006+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:55:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:55:53.673+0100 [conn1425003] end connection 172.28.0.163:64444 (399 connections now open) 2015-10-05T05:55:53.673+0100 [conn1424971] end connection 172.28.0.163:64373 (399 connections now open) 2015-10-05T05:55:53.674+0100 [mongosMain] connection accepted from 172.28.0.163:65369 #1425415 (399 connections now open) 2015-10-05T05:55:53.674+0100 [mongosMain] connection accepted from 172.28.0.163:65370 #1425416 (400 connections now open) 2015-10-05T05:55:53.675+0100 [conn1425415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:53.675+0100 [conn1425416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:54.122+0100 [conn1424997] end connection 172.28.0.164:57490 (399 connections now open) 2015-10-05T05:55:54.122+0100 [conn1425013] end connection 172.28.0.164:57524 (398 connections now open) 2015-10-05T05:55:54.123+0100 [mongosMain] connection accepted from 172.28.0.164:58439 #1425417 (399 connections now open) 2015-10-05T05:55:54.123+0100 [mongosMain] connection accepted from 172.28.0.164:58440 #1425418 (400 connections now open) 2015-10-05T05:55:54.125+0100 [conn1425417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:54.125+0100 [conn1425418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:56.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202dc5703b51053ebbb3a 2015-10-05T05:55:56.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:55:59.379+0100 [conn1424974] end connection 172.28.0.164:57456 (399 connections now open) 2015-10-05T05:55:59.381+0100 [mongosMain] connection accepted from 172.28.0.164:58443 #1425419 (400 connections now open) 2015-10-05T05:55:59.383+0100 [conn1425419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:59.631+0100 [conn1425016] end connection 172.28.0.163:64459 (399 connections now open) 2015-10-05T05:55:59.632+0100 [mongosMain] connection accepted from 172.28.0.163:65380 #1425420 (400 connections now open) 2015-10-05T05:55:59.633+0100 [conn1425420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:55:59.925+0100 [conn1425025] end connection 172.28.0.164:57557 (399 connections now open) 2015-10-05T05:55:59.927+0100 [mongosMain] connection accepted from 172.28.0.164:58445 #1425421 (400 connections now open) 2015-10-05T05:55:59.929+0100 [conn1425421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:00.209+0100 [conn1425026] end connection 172.28.0.163:64482 (399 connections now open) 2015-10-05T05:56:00.210+0100 [mongosMain] connection accepted from 172.28.0.163:65385 #1425422 (400 connections now open) 2015-10-05T05:56:00.211+0100 [conn1425422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:02.766+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202e25703b51053ebbb5e 2015-10-05T05:56:02.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:03.687+0100 [conn1425012] end connection 172.28.0.163:64455 (399 connections now open) 2015-10-05T05:56:03.687+0100 [conn1424944] end connection 172.28.0.163:64334 (399 connections now open) 2015-10-05T05:56:03.688+0100 [mongosMain] connection accepted from 172.28.0.163:65398 #1425423 (399 connections now open) 2015-10-05T05:56:03.688+0100 [mongosMain] connection accepted from 172.28.0.163:65397 #1425424 (400 connections now open) 2015-10-05T05:56:03.689+0100 [conn1425423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:03.689+0100 [conn1425424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:04.137+0100 [conn1424989] end connection 172.28.0.164:57481 (399 connections now open) 2015-10-05T05:56:04.137+0100 [conn1425005] end connection 172.28.0.164:57506 (398 connections now open) 2015-10-05T05:56:04.138+0100 [mongosMain] connection accepted from 172.28.0.164:58452 #1425425 (399 connections now open) 2015-10-05T05:56:04.138+0100 [mongosMain] connection accepted from 172.28.0.164:58453 #1425426 (400 connections now open) 2015-10-05T05:56:04.140+0100 [conn1425425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:04.140+0100 [conn1425426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:09.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202e85703b51053ebbba5 2015-10-05T05:56:09.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:09.396+0100 [conn1424982] end connection 172.28.0.164:57472 (399 connections now open) 2015-10-05T05:56:09.398+0100 [mongosMain] connection accepted from 172.28.0.164:58457 #1425427 (400 connections now open) 2015-10-05T05:56:09.399+0100 [conn1425427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:09.632+0100 [conn1424999] end connection 172.28.0.163:64437 (399 connections now open) 2015-10-05T05:56:09.634+0100 [mongosMain] connection accepted from 172.28.0.163:65406 #1425428 (400 connections now open) 2015-10-05T05:56:09.635+0100 [conn1425428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:09.941+0100 [conn1425031] end connection 172.28.0.164:57570 (399 connections now open) 2015-10-05T05:56:09.942+0100 [mongosMain] connection accepted from 172.28.0.164:58459 #1425429 (400 connections now open) 2015-10-05T05:56:09.945+0100 [conn1425429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:10.209+0100 [conn1425032] end connection 172.28.0.163:64501 (399 connections now open) 2015-10-05T05:56:10.210+0100 [mongosMain] connection accepted from 172.28.0.163:65409 #1425430 (400 connections now open) 2015-10-05T05:56:10.211+0100 [conn1425430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:13.744+0100 [conn1425028] end connection 172.28.0.163:64489 (399 connections now open) 2015-10-05T05:56:13.744+0100 [conn1424994] end connection 172.28.0.163:64429 (399 connections now open) 2015-10-05T05:56:13.744+0100 [mongosMain] connection accepted from 172.28.0.163:65414 #1425431 (399 connections now open) 2015-10-05T05:56:13.744+0100 [mongosMain] connection accepted from 172.28.0.163:65415 #1425432 (400 connections now open) 2015-10-05T05:56:13.744+0100 [conn1425431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:13.744+0100 [conn1425432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:14.181+0100 [conn1425004] end connection 172.28.0.164:57507 (399 connections now open) 2015-10-05T05:56:14.181+0100 [conn1425029] end connection 172.28.0.164:57561 (398 connections now open) 2015-10-05T05:56:14.181+0100 [mongosMain] connection accepted from 172.28.0.164:58463 #1425433 (399 connections now open) 2015-10-05T05:56:14.181+0100 [mongosMain] connection accepted from 172.28.0.164:58464 #1425434 (400 connections now open) 2015-10-05T05:56:14.181+0100 [conn1425433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:14.181+0100 [conn1425434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:15.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202ef5703b51053ebbbcc 2015-10-05T05:56:15.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:19.410+0100 [conn1425007] end connection 172.28.0.164:57514 (399 connections now open) 2015-10-05T05:56:19.411+0100 [mongosMain] connection accepted from 172.28.0.164:58470 #1425435 (400 connections now open) 2015-10-05T05:56:19.413+0100 [conn1425435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:19.956+0100 [conn1425038] end connection 172.28.0.164:57582 (399 connections now open) 2015-10-05T05:56:19.958+0100 [mongosMain] connection accepted from 172.28.0.164:58472 #1425436 (400 connections now open) 2015-10-05T05:56:19.959+0100 [conn1425436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:20.224+0100 [conn1425039] end connection 172.28.0.163:64525 (399 connections now open) 2015-10-05T05:56:20.225+0100 [mongosMain] connection accepted from 172.28.0.163:65434 #1425437 (400 connections now open) 2015-10-05T05:56:20.226+0100 [conn1425437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:21.255+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:56:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:56:21.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202f55703b51053ebbc06 2015-10-05T05:56:21.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:23.706+0100 [conn1425020] end connection 172.28.0.163:64469 (399 connections now open) 2015-10-05T05:56:23.707+0100 [mongosMain] connection accepted from 172.28.0.163:65438 #1425438 (400 connections now open) 2015-10-05T05:56:23.708+0100 [conn1425438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:24.153+0100 [conn1425036] end connection 172.28.0.164:57577 (399 connections now open) 2015-10-05T05:56:24.153+0100 [conn1425022] end connection 172.28.0.164:57546 (398 connections now open) 2015-10-05T05:56:24.154+0100 [mongosMain] connection accepted from 172.28.0.164:58480 #1425439 (399 connections now open) 2015-10-05T05:56:24.155+0100 [mongosMain] connection accepted from 172.28.0.164:58481 #1425440 (400 connections now open) 2015-10-05T05:56:24.156+0100 [conn1425439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:24.156+0100 [conn1425440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:28.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561202fb5703b51053ebbc3a 2015-10-05T05:56:28.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:28.265+0100 [mongosMain] connection accepted from 127.0.0.1:65442 #1425441 (401 connections now open) 2015-10-05T05:56:28.268+0100 [conn1425441] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:28.274+0100 [conn1425441] end connection 127.0.0.1:65442 (400 connections now open) 2015-10-05T05:56:29.426+0100 [conn1425015] end connection 172.28.0.164:57537 (399 connections now open) 2015-10-05T05:56:29.427+0100 [mongosMain] connection accepted from 172.28.0.164:58491 #1425442 (400 connections now open) 2015-10-05T05:56:29.429+0100 [conn1425442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:29.663+0100 [conn1424991] end connection 172.28.0.163:64423 (399 connections now open) 2015-10-05T05:56:29.664+0100 [mongosMain] connection accepted from 172.28.0.163:65443 #1425443 (400 connections now open) 2015-10-05T05:56:29.665+0100 [conn1425443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:29.957+0100 [conn1425045] end connection 172.28.0.164:57597 (399 connections now open) 2015-10-05T05:56:29.958+0100 [mongosMain] connection accepted from 172.28.0.164:58493 #1425444 (400 connections now open) 2015-10-05T05:56:29.960+0100 [conn1425444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:30.225+0100 [conn1425046] end connection 172.28.0.163:64535 (399 connections now open) 2015-10-05T05:56:30.227+0100 [mongosMain] connection accepted from 172.28.0.163:65445 #1425445 (400 connections now open) 2015-10-05T05:56:30.228+0100 [conn1425445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:33.719+0100 [conn1425040] end connection 172.28.0.163:64528 (399 connections now open) 2015-10-05T05:56:33.720+0100 [mongosMain] connection accepted from 172.28.0.163:65448 #1425446 (400 connections now open) 2015-10-05T05:56:33.721+0100 [conn1425446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:34.168+0100 [conn1425035] end connection 172.28.0.164:57576 (399 connections now open) 2015-10-05T05:56:34.169+0100 [conn1425030] end connection 172.28.0.164:57562 (398 connections now open) 2015-10-05T05:56:34.170+0100 [mongosMain] connection accepted from 172.28.0.164:58500 #1425447 (399 connections now open) 2015-10-05T05:56:34.170+0100 [mongosMain] connection accepted from 172.28.0.164:58501 #1425448 (400 connections now open) 2015-10-05T05:56:34.172+0100 [conn1425447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:34.173+0100 [conn1425448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:34.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203025703b51053ebbc7c 2015-10-05T05:56:34.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:39.442+0100 [conn1425037] end connection 172.28.0.164:57580 (399 connections now open) 2015-10-05T05:56:39.443+0100 [mongosMain] connection accepted from 172.28.0.164:58510 #1425449 (400 connections now open) 2015-10-05T05:56:39.445+0100 [conn1425449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:39.684+0100 [mongosMain] connection accepted from 127.0.0.1:65452 #1425450 (401 connections now open) 2015-10-05T05:56:39.687+0100 [conn1425450] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:39.692+0100 [conn1425450] end connection 127.0.0.1:65452 (400 connections now open) 2015-10-05T05:56:39.972+0100 [conn1425052] end connection 172.28.0.164:57615 (399 connections now open) 2015-10-05T05:56:39.973+0100 [mongosMain] connection accepted from 172.28.0.164:58513 #1425451 (400 connections now open) 2015-10-05T05:56:39.976+0100 [conn1425451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:40.240+0100 [conn1425053] end connection 172.28.0.163:64545 (399 connections now open) 2015-10-05T05:56:40.241+0100 [mongosMain] connection accepted from 172.28.0.163:65453 #1425452 (400 connections now open) 2015-10-05T05:56:40.242+0100 [conn1425452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:43.719+0100 [conn1425034] end connection 172.28.0.163:64514 (399 connections now open) 2015-10-05T05:56:43.720+0100 [mongosMain] connection accepted from 172.28.0.163:65458 #1425453 (400 connections now open) 2015-10-05T05:56:43.721+0100 [conn1425453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:44.169+0100 [conn1425042] end connection 172.28.0.164:57585 (399 connections now open) 2015-10-05T05:56:44.171+0100 [mongosMain] connection accepted from 172.28.0.164:58520 #1425454 (400 connections now open) 2015-10-05T05:56:44.173+0100 [conn1425454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:46.918+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612030e5703b51053ebbce7 2015-10-05T05:56:47.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:56:49.988+0100 [conn1425058] end connection 172.28.0.164:57635 (399 connections now open) 2015-10-05T05:56:49.989+0100 [mongosMain] connection accepted from 172.28.0.164:58528 #1425455 (400 connections now open) 2015-10-05T05:56:49.990+0100 [conn1425455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:50.241+0100 [conn1425060] end connection 172.28.0.163:64554 (399 connections now open) 2015-10-05T05:56:50.242+0100 [mongosMain] connection accepted from 172.28.0.163:65470 #1425456 (400 connections now open) 2015-10-05T05:56:50.243+0100 [conn1425456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:51.528+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:56:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:56:53.734+0100 [conn1425047] end connection 172.28.0.163:64539 (399 connections now open) 2015-10-05T05:56:53.736+0100 [mongosMain] connection accepted from 172.28.0.163:65475 #1425457 (400 connections now open) 2015-10-05T05:56:53.737+0100 [conn1425457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:56:59.458+0100 [conn1425023] end connection 172.28.0.164:57555 (399 connections now open) 2015-10-05T05:56:59.458+0100 [mongosMain] connection accepted from 172.28.0.164:58539 #1425458 (400 connections now open) 2015-10-05T05:56:59.460+0100 [conn1425458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:00.004+0100 [conn1425065] end connection 172.28.0.164:57654 (399 connections now open) 2015-10-05T05:57:00.006+0100 [mongosMain] connection accepted from 172.28.0.164:58541 #1425459 (400 connections now open) 2015-10-05T05:57:00.008+0100 [conn1425459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:00.256+0100 [conn1425066] end connection 172.28.0.163:64571 (399 connections now open) 2015-10-05T05:57:00.257+0100 [mongosMain] connection accepted from 172.28.0.163:65487 #1425460 (400 connections now open) 2015-10-05T05:57:00.259+0100 [conn1425460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:01.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] DBClientCursor::init call() failed 2015-10-05T05:57:01.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] Detected bad connection created at 1443942310837983 microSec, clearing pool for mywdb9.tg-server.net:27017 of 2 connections 2015-10-05T05:57:01.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : DBClientBase::findN: transport error: mywdb9.tg-server.net:27017 ns: admin.$cmd query: { writebacklisten: ObjectId('55eee2205703b510530e6e89') } 2015-10-05T05:57:02.379+0100 [conn1425446] DBClientCursor::init lazy say() failed 2015-10-05T05:57:02.379+0100 [conn1425446] DBClientCursor::init message from say() was empty 2015-10-05T05:57:02.379+0100 [conn1425446] slave no longer has secondary status: mywdb9.tg-server.net:27017 2015-10-05T05:57:02.379+0100 [conn1425446] warning: Weird shift of primary detected 2015-10-05T05:57:02.531+0100 [ReplicaSetMonitorWatcher] Socket hangup detected, no longer connected (idle 10 secs, remote host 172.31.0.218:27017) 2015-10-05T05:57:03.192+0100 [PeriodicTaskRunner] Socket hangup detected, no longer connected (idle 60 secs, remote host 172.31.0.218:27017) 2015-10-05T05:57:03.192+0100 [PeriodicTaskRunner] Socket hangup detected, no longer connected (idle 60 secs, remote host 172.31.0.218:27017) 2015-10-05T05:57:03.193+0100 [PeriodicTaskRunner] Socket hangup detected, no longer connected (idle 60 secs, remote host 172.31.0.218:27017) 2015-10-05T05:57:03.193+0100 [PeriodicTaskRunner] Socket hangup detected, no longer connected (idle 60 secs, remote host 172.31.0.218:27017) 2015-10-05T05:57:03.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:03.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:03.538+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:03.736+0100 [conn1425067] end connection 172.28.0.163:64578 (399 connections now open) 2015-10-05T05:57:03.737+0100 [mongosMain] connection accepted from 172.28.0.163:65497 #1425461 (400 connections now open) 2015-10-05T05:57:03.738+0100 [conn1425461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:04.184+0100 [conn1425068] end connection 172.28.0.164:57661 (399 connections now open) 2015-10-05T05:57:04.185+0100 [mongosMain] connection accepted from 172.28.0.164:58547 #1425462 (400 connections now open) 2015-10-05T05:57:04.186+0100 [conn1425462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:05.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203215703b51053ebbd9a 2015-10-05T05:57:05.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:06.529+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:06.529+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:09.458+0100 [conn1425050] end connection 172.28.0.164:57612 (399 connections now open) 2015-10-05T05:57:09.459+0100 [mongosMain] connection accepted from 172.28.0.164:58550 #1425463 (400 connections now open) 2015-10-05T05:57:09.461+0100 [conn1425463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:09.694+0100 [conn1424983] end connection 172.28.0.163:64400 (399 connections now open) 2015-10-05T05:57:09.696+0100 [mongosMain] connection accepted from 172.28.0.163:65511 #1425464 (400 connections now open) 2015-10-05T05:57:09.697+0100 [conn1425464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:10.004+0100 [conn1425070] end connection 172.28.0.164:57668 (399 connections now open) 2015-10-05T05:57:10.005+0100 [mongosMain] connection accepted from 172.28.0.164:58554 #1425465 (400 connections now open) 2015-10-05T05:57:10.007+0100 [conn1425465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:10.271+0100 [conn1425071] end connection 172.28.0.163:64588 (399 connections now open) 2015-10-05T05:57:10.272+0100 [mongosMain] connection accepted from 172.28.0.163:65513 #1425466 (400 connections now open) 2015-10-05T05:57:10.274+0100 [conn1425466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:10.605+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:10.605+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:11.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203275703b51053ebbdcc 2015-10-05T05:57:11.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:13.750+0100 [conn1425061] end connection 172.28.0.163:64559 (399 connections now open) 2015-10-05T05:57:13.751+0100 [mongosMain] connection accepted from 172.28.0.163:65520 #1425467 (400 connections now open) 2015-10-05T05:57:13.752+0100 [conn1425467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:14.200+0100 [conn1425049] end connection 172.28.0.164:57605 (399 connections now open) 2015-10-05T05:57:14.201+0100 [conn1425063] end connection 172.28.0.164:57643 (398 connections now open) 2015-10-05T05:57:14.202+0100 [mongosMain] connection accepted from 172.28.0.164:58557 #1425468 (399 connections now open) 2015-10-05T05:57:14.202+0100 [mongosMain] connection accepted from 172.28.0.164:58558 #1425469 (400 connections now open) 2015-10-05T05:57:14.203+0100 [conn1425468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:14.204+0100 [conn1425469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:14.597+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:15.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:15.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:19.695+0100 [conn1425057] end connection 172.28.0.163:64551 (399 connections now open) 2015-10-05T05:57:19.696+0100 [mongosMain] connection accepted from 172.28.0.163:65527 #1425470 (400 connections now open) 2015-10-05T05:57:19.697+0100 [conn1425470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:20.019+0100 [conn1425076] end connection 172.28.0.164:57678 (399 connections now open) 2015-10-05T05:57:20.020+0100 [mongosMain] connection accepted from 172.28.0.164:58563 #1425471 (400 connections now open) 2015-10-05T05:57:20.022+0100 [conn1425471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:20.272+0100 [conn1425077] end connection 172.28.0.163:64610 (399 connections now open) 2015-10-05T05:57:20.274+0100 [mongosMain] connection accepted from 172.28.0.163:65529 #1425472 (400 connections now open) 2015-10-05T05:57:20.274+0100 [conn1425472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:21.611+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:21.611+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:21.803+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:57:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:57:23.754+0100 [conn1425054] end connection 172.28.0.163:64547 (399 connections now open) 2015-10-05T05:57:23.754+0100 [conn1425011] end connection 172.28.0.163:64454 (399 connections now open) 2015-10-05T05:57:23.755+0100 [mongosMain] connection accepted from 172.28.0.163:65534 #1425473 (399 connections now open) 2015-10-05T05:57:23.755+0100 [mongosMain] connection accepted from 172.28.0.163:49155 #1425474 (400 connections now open) 2015-10-05T05:57:23.756+0100 [conn1425474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:23.756+0100 [conn1425473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:23.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203335703b51053ebbe27 2015-10-05T05:57:24.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:24.216+0100 [conn1424946] end connection 172.28.0.164:57389 (399 connections now open) 2015-10-05T05:57:24.216+0100 [conn1425073] end connection 172.28.0.164:57675 (398 connections now open) 2015-10-05T05:57:24.218+0100 [mongosMain] connection accepted from 172.28.0.164:58576 #1425475 (399 connections now open) 2015-10-05T05:57:24.218+0100 [mongosMain] connection accepted from 172.28.0.164:58577 #1425476 (400 connections now open) 2015-10-05T05:57:24.219+0100 [conn1425475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:24.220+0100 [conn1425476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:25.623+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:28.582+0100 [mongosMain] connection accepted from 127.0.0.1:49162 #1425477 (401 connections now open) 2015-10-05T05:57:28.585+0100 [conn1425477] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:28.590+0100 [conn1425477] end connection 127.0.0.1:49162 (400 connections now open) 2015-10-05T05:57:28.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:28.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:29.490+0100 [conn1425056] end connection 172.28.0.164:57633 (399 connections now open) 2015-10-05T05:57:29.491+0100 [mongosMain] connection accepted from 172.28.0.164:58582 #1425478 (400 connections now open) 2015-10-05T05:57:29.492+0100 [conn1425478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:29.710+0100 [conn1425024] end connection 172.28.0.163:64478 (399 connections now open) 2015-10-05T05:57:29.711+0100 [mongosMain] connection accepted from 172.28.0.163:49163 #1425479 (400 connections now open) 2015-10-05T05:57:29.712+0100 [conn1425479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:30.035+0100 [conn1425083] end connection 172.28.0.164:57688 (399 connections now open) 2015-10-05T05:57:30.036+0100 [mongosMain] connection accepted from 172.28.0.164:58585 #1425480 (400 connections now open) 2015-10-05T05:57:30.037+0100 [conn1425480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:30.287+0100 [conn1425084] end connection 172.28.0.163:64628 (399 connections now open) 2015-10-05T05:57:30.288+0100 [mongosMain] connection accepted from 172.28.0.163:49165 #1425481 (400 connections now open) 2015-10-05T05:57:30.289+0100 [conn1425481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:33.766+0100 [conn1425079] end connection 172.28.0.163:64617 (399 connections now open) 2015-10-05T05:57:33.766+0100 [conn1425078] end connection 172.28.0.163:64616 (399 connections now open) 2015-10-05T05:57:33.767+0100 [mongosMain] connection accepted from 172.28.0.163:49169 #1425482 (399 connections now open) 2015-10-05T05:57:33.767+0100 [mongosMain] connection accepted from 172.28.0.163:49170 #1425483 (400 connections now open) 2015-10-05T05:57:33.768+0100 [conn1425482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:33.768+0100 [conn1425483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:34.231+0100 [conn1425055] end connection 172.28.0.164:57623 (399 connections now open) 2015-10-05T05:57:34.233+0100 [mongosMain] connection accepted from 172.28.0.164:58593 #1425484 (400 connections now open) 2015-10-05T05:57:34.234+0100 [conn1425484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:36.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203405703b51053ebbe7a 2015-10-05T05:57:36.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:36.625+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:36.628+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:36.628+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:39.505+0100 [conn1425064] end connection 172.28.0.164:57652 (399 connections now open) 2015-10-05T05:57:39.506+0100 [mongosMain] connection accepted from 172.28.0.164:58602 #1425485 (400 connections now open) 2015-10-05T05:57:39.508+0100 [conn1425485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:39.596+0100 [mongosMain] connection accepted from 127.0.0.1:49184 #1425486 (401 connections now open) 2015-10-05T05:57:39.598+0100 [conn1425486] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:39.603+0100 [conn1425486] end connection 127.0.0.1:49184 (400 connections now open) 2015-10-05T05:57:39.726+0100 [conn1425082] end connection 172.28.0.163:64626 (399 connections now open) 2015-10-05T05:57:39.727+0100 [mongosMain] connection accepted from 172.28.0.163:49186 #1425487 (400 connections now open) 2015-10-05T05:57:39.728+0100 [conn1425487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:40.050+0100 [conn1425091] end connection 172.28.0.164:57707 (399 connections now open) 2015-10-05T05:57:40.051+0100 [mongosMain] connection accepted from 172.28.0.164:58605 #1425488 (400 connections now open) 2015-10-05T05:57:40.052+0100 [conn1425488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:40.289+0100 [conn1425092] end connection 172.28.0.163:64638 (399 connections now open) 2015-10-05T05:57:40.289+0100 [mongosMain] connection accepted from 172.28.0.163:49191 #1425489 (400 connections now open) 2015-10-05T05:57:40.290+0100 [conn1425489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:43.766+0100 [conn1425027] end connection 172.28.0.163:64488 (399 connections now open) 2015-10-05T05:57:43.766+0100 [conn1425085] end connection 172.28.0.163:64632 (399 connections now open) 2015-10-05T05:57:43.767+0100 [mongosMain] connection accepted from 172.28.0.163:49209 #1425490 (399 connections now open) 2015-10-05T05:57:43.767+0100 [mongosMain] connection accepted from 172.28.0.163:49210 #1425491 (400 connections now open) 2015-10-05T05:57:43.768+0100 [conn1425490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:43.768+0100 [conn1425491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:44.246+0100 [conn1425062] end connection 172.28.0.164:57642 (399 connections now open) 2015-10-05T05:57:44.248+0100 [conn1425072] end connection 172.28.0.164:57674 (398 connections now open) 2015-10-05T05:57:44.248+0100 [mongosMain] connection accepted from 172.28.0.164:58614 #1425492 (399 connections now open) 2015-10-05T05:57:44.249+0100 [mongosMain] connection accepted from 172.28.0.164:58615 #1425493 (400 connections now open) 2015-10-05T05:57:44.250+0100 [conn1425492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:44.251+0100 [conn1425493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:45.631+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:45.632+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:47.643+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:48.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612034c5703b51053ebbec6 2015-10-05T05:57:48.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:49.505+0100 [conn1425044] end connection 172.28.0.164:57593 (399 connections now open) 2015-10-05T05:57:49.507+0100 [mongosMain] connection accepted from 172.28.0.164:58622 #1425494 (400 connections now open) 2015-10-05T05:57:49.508+0100 [conn1425494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:49.726+0100 [conn1425098] end connection 172.28.0.163:64644 (399 connections now open) 2015-10-05T05:57:49.727+0100 [mongosMain] connection accepted from 172.28.0.163:49221 #1425495 (400 connections now open) 2015-10-05T05:57:49.729+0100 [conn1425495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:50.050+0100 [conn1425099] end connection 172.28.0.164:57729 (399 connections now open) 2015-10-05T05:57:50.051+0100 [mongosMain] connection accepted from 172.28.0.164:58624 #1425496 (400 connections now open) 2015-10-05T05:57:50.053+0100 [conn1425496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:50.303+0100 [conn1425100] end connection 172.28.0.163:64646 (399 connections now open) 2015-10-05T05:57:50.304+0100 [mongosMain] connection accepted from 172.28.0.163:49223 #1425497 (400 connections now open) 2015-10-05T05:57:50.305+0100 [conn1425497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:52.080+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:57:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:57:53.782+0100 [conn1425093] end connection 172.28.0.163:64640 (399 connections now open) 2015-10-05T05:57:53.783+0100 [mongosMain] connection accepted from 172.28.0.163:49229 #1425498 (400 connections now open) 2015-10-05T05:57:53.785+0100 [conn1425498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:53.868+0100 [conn1425041] end connection 172.28.0.163:64529 (399 connections now open) 2015-10-05T05:57:53.869+0100 [mongosMain] connection accepted from 172.28.0.163:49232 #1425499 (400 connections now open) 2015-10-05T05:57:53.870+0100 [conn1425499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:54.263+0100 [conn1425043] end connection 172.28.0.164:57586 (399 connections now open) 2015-10-05T05:57:54.263+0100 [conn1425080] end connection 172.28.0.164:57681 (398 connections now open) 2015-10-05T05:57:54.264+0100 [mongosMain] connection accepted from 172.28.0.164:58633 #1425500 (399 connections now open) 2015-10-05T05:57:54.264+0100 [mongosMain] connection accepted from 172.28.0.164:58634 #1425501 (400 connections now open) 2015-10-05T05:57:54.266+0100 [conn1425500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:54.266+0100 [conn1425501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:57:55.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203525703b51053ebbef1 2015-10-05T05:57:55.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:57:55.644+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:55.644+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:57:58.644+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:57:59.506+0100 [conn1425097] end connection 172.28.0.164:57727 (399 connections now open) 2015-10-05T05:57:59.507+0100 [mongosMain] connection accepted from 172.28.0.164:58642 #1425502 (400 connections now open) 2015-10-05T05:57:59.508+0100 [conn1425502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:00.052+0100 [conn1425108] end connection 172.28.0.164:57747 (399 connections now open) 2015-10-05T05:58:00.053+0100 [mongosMain] connection accepted from 172.28.0.164:58644 #1425503 (400 connections now open) 2015-10-05T05:58:00.054+0100 [conn1425503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:00.304+0100 [conn1425109] end connection 172.28.0.163:64666 (399 connections now open) 2015-10-05T05:58:00.305+0100 [mongosMain] connection accepted from 172.28.0.163:49246 #1425504 (400 connections now open) 2015-10-05T05:58:00.306+0100 [conn1425504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:03.797+0100 [conn1425103] end connection 172.28.0.163:64653 (399 connections now open) 2015-10-05T05:58:03.798+0100 [conn1425048] end connection 172.28.0.163:64540 (398 connections now open) 2015-10-05T05:58:03.799+0100 [mongosMain] connection accepted from 172.28.0.163:49256 #1425505 (399 connections now open) 2015-10-05T05:58:03.800+0100 [mongosMain] connection accepted from 172.28.0.163:49257 #1425506 (400 connections now open) 2015-10-05T05:58:03.800+0100 [conn1425505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:03.801+0100 [conn1425506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:04.280+0100 [conn1425087] end connection 172.28.0.164:57694 (399 connections now open) 2015-10-05T05:58:04.280+0100 [conn1425095] end connection 172.28.0.164:57715 (398 connections now open) 2015-10-05T05:58:04.281+0100 [mongosMain] connection accepted from 172.28.0.164:58653 #1425507 (399 connections now open) 2015-10-05T05:58:04.281+0100 [mongosMain] connection accepted from 172.28.0.164:58654 #1425508 (400 connections now open) 2015-10-05T05:58:04.282+0100 [conn1425507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:04.283+0100 [conn1425508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:06.645+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:06.646+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:07.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612035f5703b51053ebbf4d 2015-10-05T05:58:07.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:09.693+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:10.067+0100 [conn1425116] end connection 172.28.0.164:57761 (399 connections now open) 2015-10-05T05:58:10.069+0100 [mongosMain] connection accepted from 172.28.0.164:58659 #1425509 (400 connections now open) 2015-10-05T05:58:10.071+0100 [conn1425509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:10.319+0100 [conn1425117] end connection 172.28.0.163:64685 (399 connections now open) 2015-10-05T05:58:10.320+0100 [mongosMain] connection accepted from 172.28.0.163:49276 #1425510 (400 connections now open) 2015-10-05T05:58:10.320+0100 [conn1425510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:13.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203655703b51053ebbf84 2015-10-05T05:58:13.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:13.798+0100 [conn1425110] end connection 172.28.0.163:64671 (399 connections now open) 2015-10-05T05:58:13.798+0100 [conn1425021] end connection 172.28.0.163:64471 (399 connections now open) 2015-10-05T05:58:13.800+0100 [mongosMain] connection accepted from 172.28.0.163:49280 #1425511 (399 connections now open) 2015-10-05T05:58:13.800+0100 [mongosMain] connection accepted from 172.28.0.163:49281 #1425512 (400 connections now open) 2015-10-05T05:58:13.801+0100 [conn1425511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:13.801+0100 [conn1425512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:14.279+0100 [conn1425088] end connection 172.28.0.164:57696 (399 connections now open) 2015-10-05T05:58:14.279+0100 [conn1425096] end connection 172.28.0.164:57716 (399 connections now open) 2015-10-05T05:58:14.280+0100 [mongosMain] connection accepted from 172.28.0.164:58663 #1425513 (399 connections now open) 2015-10-05T05:58:14.281+0100 [mongosMain] connection accepted from 172.28.0.164:58664 #1425514 (400 connections now open) 2015-10-05T05:58:14.282+0100 [conn1425513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:14.283+0100 [conn1425514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:18.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:18.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:20.083+0100 [conn1425123] end connection 172.28.0.164:57776 (399 connections now open) 2015-10-05T05:58:20.084+0100 [mongosMain] connection accepted from 172.28.0.164:58675 #1425515 (400 connections now open) 2015-10-05T05:58:20.085+0100 [conn1425515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:20.319+0100 [conn1425124] end connection 172.28.0.163:64705 (399 connections now open) 2015-10-05T05:58:20.321+0100 [mongosMain] connection accepted from 172.28.0.163:49291 #1425516 (400 connections now open) 2015-10-05T05:58:20.322+0100 [conn1425516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:20.646+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:20.646+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:20.698+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:22.348+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:58:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:58:23.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:23.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:23.813+0100 [conn1425119] end connection 172.28.0.163:64695 (399 connections now open) 2015-10-05T05:58:23.813+0100 [conn1425033] end connection 172.28.0.163:64513 (399 connections now open) 2015-10-05T05:58:23.814+0100 [mongosMain] connection accepted from 172.28.0.163:49296 #1425517 (399 connections now open) 2015-10-05T05:58:23.815+0100 [mongosMain] connection accepted from 172.28.0.163:49297 #1425518 (400 connections now open) 2015-10-05T05:58:23.815+0100 [conn1425517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:23.816+0100 [conn1425518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:24.297+0100 [conn1425112] end connection 172.28.0.164:57754 (399 connections now open) 2015-10-05T05:58:24.297+0100 [conn1425069] end connection 172.28.0.164:57662 (398 connections now open) 2015-10-05T05:58:24.298+0100 [mongosMain] connection accepted from 172.28.0.164:58684 #1425519 (399 connections now open) 2015-10-05T05:58:24.299+0100 [mongosMain] connection accepted from 172.28.0.164:58685 #1425520 (400 connections now open) 2015-10-05T05:58:24.300+0100 [conn1425519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:24.301+0100 [conn1425520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:26.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203715703b51053ebbfc9 2015-10-05T05:58:26.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:27.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:27.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:28.565+0100 [mongosMain] connection accepted from 127.0.0.1:49302 #1425521 (401 connections now open) 2015-10-05T05:58:28.568+0100 [conn1425521] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:28.573+0100 [conn1425521] end connection 127.0.0.1:49302 (400 connections now open) 2015-10-05T05:58:29.758+0100 [conn1425075] end connection 172.28.0.163:64608 (399 connections now open) 2015-10-05T05:58:29.759+0100 [mongosMain] connection accepted from 172.28.0.163:49303 #1425522 (400 connections now open) 2015-10-05T05:58:29.761+0100 [conn1425522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:30.083+0100 [conn1425131] end connection 172.28.0.164:57789 (399 connections now open) 2015-10-05T05:58:30.084+0100 [mongosMain] connection accepted from 172.28.0.164:58695 #1425523 (400 connections now open) 2015-10-05T05:58:30.086+0100 [conn1425523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:30.335+0100 [conn1425132] end connection 172.28.0.163:64720 (399 connections now open) 2015-10-05T05:58:30.336+0100 [mongosMain] connection accepted from 172.28.0.163:49304 #1425524 (400 connections now open) 2015-10-05T05:58:30.337+0100 [conn1425524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:31.707+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:32.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:32.678+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:33.815+0100 [conn1425125] end connection 172.28.0.163:64709 (399 connections now open) 2015-10-05T05:58:33.815+0100 [conn1425002] end connection 172.28.0.163:64443 (399 connections now open) 2015-10-05T05:58:33.816+0100 [mongosMain] connection accepted from 172.28.0.163:49309 #1425525 (399 connections now open) 2015-10-05T05:58:33.817+0100 [mongosMain] connection accepted from 172.28.0.163:49310 #1425526 (400 connections now open) 2015-10-05T05:58:33.817+0100 [conn1425525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:33.818+0100 [conn1425526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:34.295+0100 [conn1425105] end connection 172.28.0.164:57737 (399 connections now open) 2015-10-05T05:58:34.296+0100 [conn1425104] end connection 172.28.0.164:57738 (398 connections now open) 2015-10-05T05:58:34.296+0100 [mongosMain] connection accepted from 172.28.0.164:58704 #1425527 (399 connections now open) 2015-10-05T05:58:34.297+0100 [mongosMain] connection accepted from 172.28.0.164:58705 #1425528 (400 connections now open) 2015-10-05T05:58:34.299+0100 [conn1425528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:34.299+0100 [conn1425527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:38.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612037e5703b51053ebc023 2015-10-05T05:58:38.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:38.686+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:38.686+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:39.773+0100 [conn1425130] end connection 172.28.0.163:64717 (399 connections now open) 2015-10-05T05:58:39.774+0100 [mongosMain] connection accepted from 172.28.0.163:49313 #1425529 (400 connections now open) 2015-10-05T05:58:39.776+0100 [conn1425529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:39.958+0100 [mongosMain] connection accepted from 127.0.0.1:49315 #1425530 (401 connections now open) 2015-10-05T05:58:39.961+0100 [conn1425530] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:39.966+0100 [conn1425530] end connection 127.0.0.1:49315 (400 connections now open) 2015-10-05T05:58:40.098+0100 [conn1425140] end connection 172.28.0.164:57807 (399 connections now open) 2015-10-05T05:58:40.100+0100 [mongosMain] connection accepted from 172.28.0.164:58718 #1425531 (400 connections now open) 2015-10-05T05:58:40.103+0100 [conn1425531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:42.709+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:43.829+0100 [conn1425102] end connection 172.28.0.163:64652 (399 connections now open) 2015-10-05T05:58:43.829+0100 [conn1425134] end connection 172.28.0.163:64724 (399 connections now open) 2015-10-05T05:58:43.830+0100 [mongosMain] connection accepted from 172.28.0.163:49323 #1425532 (399 connections now open) 2015-10-05T05:58:43.831+0100 [mongosMain] connection accepted from 172.28.0.163:49324 #1425533 (400 connections now open) 2015-10-05T05:58:43.831+0100 [conn1425532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:43.832+0100 [conn1425533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:44.311+0100 [conn1425121] end connection 172.28.0.164:57771 (399 connections now open) 2015-10-05T05:58:44.311+0100 [conn1425120] end connection 172.28.0.164:57768 (398 connections now open) 2015-10-05T05:58:44.312+0100 [mongosMain] connection accepted from 172.28.0.164:58725 #1425534 (399 connections now open) 2015-10-05T05:58:44.313+0100 [mongosMain] connection accepted from 172.28.0.164:58726 #1425535 (400 connections now open) 2015-10-05T05:58:44.314+0100 [conn1425534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:44.315+0100 [conn1425535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:44.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203845703b51053ebc06c 2015-10-05T05:58:45.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:45.690+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:45.690+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:49.775+0100 [conn1425008] end connection 172.28.0.163:64448 (399 connections now open) 2015-10-05T05:58:49.776+0100 [mongosMain] connection accepted from 172.28.0.163:49333 #1425536 (400 connections now open) 2015-10-05T05:58:49.777+0100 [conn1425536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:51.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612038b5703b51053ebc0b9 2015-10-05T05:58:51.623+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:52.612+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:58:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:58:53.691+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:53.691+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:58:53.708+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:58:53.830+0100 [conn1425150] end connection 172.28.0.163:64745 (399 connections now open) 2015-10-05T05:58:53.830+0100 [conn1424986] end connection 172.28.0.163:64412 (398 connections now open) 2015-10-05T05:58:53.831+0100 [mongosMain] connection accepted from 172.28.0.163:49342 #1425537 (399 connections now open) 2015-10-05T05:58:53.831+0100 [mongosMain] connection accepted from 172.28.0.163:49343 #1425538 (400 connections now open) 2015-10-05T05:58:53.832+0100 [conn1425537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:53.833+0100 [conn1425538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:54.310+0100 [conn1425127] end connection 172.28.0.164:57780 (399 connections now open) 2015-10-05T05:58:54.310+0100 [conn1425113] end connection 172.28.0.164:57755 (399 connections now open) 2015-10-05T05:58:54.311+0100 [mongosMain] connection accepted from 172.28.0.164:58742 #1425539 (399 connections now open) 2015-10-05T05:58:54.311+0100 [mongosMain] connection accepted from 172.28.0.164:58743 #1425540 (400 connections now open) 2015-10-05T05:58:54.313+0100 [conn1425540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:54.313+0100 [conn1425539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:58:57.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203915703b51053ebc0fc 2015-10-05T05:58:57.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:58:59.789+0100 [conn1425107] end connection 172.28.0.163:64663 (399 connections now open) 2015-10-05T05:58:59.790+0100 [mongosMain] connection accepted from 172.28.0.163:49354 #1425541 (400 connections now open) 2015-10-05T05:58:59.791+0100 [conn1425541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:02.706+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:02.707+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:03.845+0100 [conn1425118] end connection 172.28.0.163:64694 (399 connections now open) 2015-10-05T05:59:03.845+0100 [conn1425142] end connection 172.28.0.163:64733 (399 connections now open) 2015-10-05T05:59:03.846+0100 [mongosMain] connection accepted from 172.28.0.163:49365 #1425542 (399 connections now open) 2015-10-05T05:59:03.847+0100 [mongosMain] connection accepted from 172.28.0.163:49366 #1425543 (400 connections now open) 2015-10-05T05:59:03.847+0100 [conn1425542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:03.847+0100 [conn1425543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:04.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203975703b51053ebc154 2015-10-05T05:59:04.326+0100 [conn1425135] end connection 172.28.0.164:57795 (399 connections now open) 2015-10-05T05:59:04.328+0100 [mongosMain] connection accepted from 172.28.0.164:58751 #1425544 (400 connections now open) 2015-10-05T05:59:04.329+0100 [conn1425544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:04.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:04.715+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:09.805+0100 [conn1425115] end connection 172.28.0.163:64683 (399 connections now open) 2015-10-05T05:59:09.807+0100 [mongosMain] connection accepted from 172.28.0.163:49376 #1425545 (400 connections now open) 2015-10-05T05:59:09.808+0100 [conn1425545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:10.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612039e5703b51053ebc19f 2015-10-05T05:59:10.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:12.727+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:12.728+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:13.860+0100 [conn1425111] end connection 172.28.0.163:64672 (399 connections now open) 2015-10-05T05:59:13.861+0100 [mongosMain] connection accepted from 172.28.0.163:49381 #1425546 (400 connections now open) 2015-10-05T05:59:13.862+0100 [conn1425546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:14.326+0100 [conn1425162] end connection 172.28.0.164:57850 (399 connections now open) 2015-10-05T05:59:14.327+0100 [mongosMain] connection accepted from 172.28.0.164:58757 #1425547 (400 connections now open) 2015-10-05T05:59:14.328+0100 [conn1425547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:15.720+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:17.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203a45703b51053ebc1ee 2015-10-05T05:59:17.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:19.584+0100 [conn1424933] end connection 172.28.0.164:57371 (399 connections now open) 2015-10-05T05:59:19.585+0100 [mongosMain] connection accepted from 172.28.0.164:58762 #1425548 (400 connections now open) 2015-10-05T05:59:19.587+0100 [conn1425548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:19.805+0100 [conn1425139] end connection 172.28.0.163:64729 (399 connections now open) 2015-10-05T05:59:19.806+0100 [mongosMain] connection accepted from 172.28.0.163:49390 #1425549 (400 connections now open) 2015-10-05T05:59:19.807+0100 [conn1425549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:22.845+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:59:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:59:23.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203ab5703b51053ebc248 2015-10-05T05:59:23.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:23.736+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:23.736+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:23.865+0100 [conn1425161] end connection 172.28.0.163:64786 (399 connections now open) 2015-10-05T05:59:23.865+0100 [conn1425094] end connection 172.28.0.163:64641 (398 connections now open) 2015-10-05T05:59:23.867+0100 [mongosMain] connection accepted from 172.28.0.163:49394 #1425550 (399 connections now open) 2015-10-05T05:59:23.867+0100 [mongosMain] connection accepted from 172.28.0.163:49395 #1425551 (400 connections now open) 2015-10-05T05:59:23.868+0100 [conn1425550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:23.868+0100 [conn1425551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:26.726+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:29.129+0100 [mongosMain] connection accepted from 127.0.0.1:49401 #1425552 (401 connections now open) 2015-10-05T05:59:29.131+0100 [conn1425552] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:29.137+0100 [conn1425552] end connection 127.0.0.1:49401 (400 connections now open) 2015-10-05T05:59:29.585+0100 [conn1425158] end connection 172.28.0.164:57847 (399 connections now open) 2015-10-05T05:59:29.586+0100 [mongosMain] connection accepted from 172.28.0.164:58782 #1425553 (400 connections now open) 2015-10-05T05:59:29.588+0100 [conn1425553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:29.820+0100 [conn1425147] end connection 172.28.0.163:64738 (399 connections now open) 2015-10-05T05:59:29.821+0100 [mongosMain] connection accepted from 172.28.0.163:49402 #1425554 (400 connections now open) 2015-10-05T05:59:29.823+0100 [conn1425554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:30.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203b15703b51053ebc29f 2015-10-05T05:59:30.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:33.877+0100 [conn1425126] end connection 172.28.0.163:64710 (399 connections now open) 2015-10-05T05:59:33.877+0100 [conn1425156] end connection 172.28.0.163:64764 (399 connections now open) 2015-10-05T05:59:33.878+0100 [mongosMain] connection accepted from 172.28.0.163:49404 #1425555 (399 connections now open) 2015-10-05T05:59:33.878+0100 [mongosMain] connection accepted from 172.28.0.163:49405 #1425556 (400 connections now open) 2015-10-05T05:59:33.879+0100 [conn1425555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:33.879+0100 [conn1425556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:34.342+0100 [conn1425081] end connection 172.28.0.164:57684 (399 connections now open) 2015-10-05T05:59:34.344+0100 [mongosMain] connection accepted from 172.28.0.164:58790 #1425557 (400 connections now open) 2015-10-05T05:59:34.345+0100 [conn1425557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:35.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:35.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:36.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203b85703b51053ebc30c 2015-10-05T05:59:36.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:37.737+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:37.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:37.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:39.599+0100 [conn1425074] end connection 172.28.0.164:57676 (399 connections now open) 2015-10-05T05:59:39.601+0100 [mongosMain] connection accepted from 172.28.0.164:58799 #1425558 (400 connections now open) 2015-10-05T05:59:39.603+0100 [conn1425558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:39.821+0100 [conn1425159] end connection 172.28.0.163:64775 (399 connections now open) 2015-10-05T05:59:39.822+0100 [mongosMain] connection accepted from 172.28.0.163:49413 #1425559 (400 connections now open) 2015-10-05T05:59:39.823+0100 [conn1425559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:40.142+0100 [mongosMain] connection accepted from 127.0.0.1:49414 #1425560 (401 connections now open) 2015-10-05T05:59:40.145+0100 [conn1425560] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:40.149+0100 [conn1425560] end connection 127.0.0.1:49414 (400 connections now open) 2015-10-05T05:59:40.805+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:40.805+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:42.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203be5703b51053ebc374 2015-10-05T05:59:42.990+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:43.938+0100 [conn1425086] end connection 172.28.0.163:64633 (399 connections now open) 2015-10-05T05:59:43.942+0100 [mongosMain] connection accepted from 172.28.0.163:49423 #1425561 (400 connections now open) 2015-10-05T05:59:43.943+0100 [conn1425561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:44.357+0100 [conn1425128] end connection 172.28.0.164:57781 (399 connections now open) 2015-10-05T05:59:44.358+0100 [mongosMain] connection accepted from 172.28.0.164:58812 #1425562 (400 connections now open) 2015-10-05T05:59:44.360+0100 [conn1425562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:44.807+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:44.808+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:48.747+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:49.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203c45703b51053ebc3cb 2015-10-05T05:59:49.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:49.600+0100 [conn1425106] end connection 172.28.0.164:57744 (399 connections now open) 2015-10-05T05:59:49.601+0100 [mongosMain] connection accepted from 172.28.0.164:58820 #1425563 (400 connections now open) 2015-10-05T05:59:49.603+0100 [conn1425563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:49.812+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:49.812+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:49.836+0100 [conn1425163] end connection 172.28.0.163:64795 (399 connections now open) 2015-10-05T05:59:49.837+0100 [mongosMain] connection accepted from 172.28.0.163:49432 #1425564 (400 connections now open) 2015-10-05T05:59:49.838+0100 [conn1425564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:53.115+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 05:59:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T05:59:53.892+0100 [conn1425133] end connection 172.28.0.163:64723 (399 connections now open) 2015-10-05T05:59:53.893+0100 [mongosMain] connection accepted from 172.28.0.163:49439 #1425565 (400 connections now open) 2015-10-05T05:59:53.895+0100 [conn1425565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:55.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203cb5703b51053ebc415 2015-10-05T05:59:55.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:55.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T05:59:55.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T05:59:59.616+0100 [conn1425154] end connection 172.28.0.164:57839 (399 connections now open) 2015-10-05T05:59:59.618+0100 [mongosMain] connection accepted from 172.28.0.164:58830 #1425566 (400 connections now open) 2015-10-05T05:59:59.620+0100 [conn1425566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T05:59:59.759+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T05:59:59.837+0100 [conn1425155] end connection 172.28.0.163:64757 (399 connections now open) 2015-10-05T05:59:59.838+0100 [mongosMain] connection accepted from 172.28.0.163:49449 #1425567 (400 connections now open) 2015-10-05T05:59:59.839+0100 [conn1425567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:02.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203d15703b51053ebc479 2015-10-05T06:00:02.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:02.823+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:02.823+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:03.900+0100 [conn1425172] end connection 172.28.0.163:64817 (399 connections now open) 2015-10-05T06:00:03.902+0100 [mongosMain] connection accepted from 172.28.0.163:49461 #1425568 (400 connections now open) 2015-10-05T06:00:03.903+0100 [conn1425160] end connection 172.28.0.163:64784 (399 connections now open) 2015-10-05T06:00:03.903+0100 [conn1425568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:03.903+0100 [mongosMain] connection accepted from 172.28.0.163:49463 #1425569 (400 connections now open) 2015-10-05T06:00:03.904+0100 [conn1425569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:04.374+0100 [conn1425153] end connection 172.28.0.164:57832 (399 connections now open) 2015-10-05T06:00:04.374+0100 [conn1425152] end connection 172.28.0.164:57831 (399 connections now open) 2015-10-05T06:00:04.375+0100 [mongosMain] connection accepted from 172.28.0.164:58845 #1425570 (399 connections now open) 2015-10-05T06:00:04.376+0100 [mongosMain] connection accepted from 172.28.0.164:58846 #1425571 (400 connections now open) 2015-10-05T06:00:04.376+0100 [conn1425570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:04.377+0100 [conn1425571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:08.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203d85703b51053ebc584 2015-10-05T06:00:08.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:09.631+0100 [conn1425114] end connection 172.28.0.164:57759 (399 connections now open) 2015-10-05T06:00:09.633+0100 [mongosMain] connection accepted from 172.28.0.164:58851 #1425572 (400 connections now open) 2015-10-05T06:00:09.634+0100 [conn1425572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:09.852+0100 [conn1425175] end connection 172.28.0.163:64822 (399 connections now open) 2015-10-05T06:00:09.853+0100 [mongosMain] connection accepted from 172.28.0.163:49477 #1425573 (400 connections now open) 2015-10-05T06:00:09.854+0100 [conn1425573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:10.773+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:10.838+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:10.838+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:13.926+0100 [conn1425151] end connection 172.28.0.163:64746 (399 connections now open) 2015-10-05T06:00:13.927+0100 [mongosMain] connection accepted from 172.28.0.163:49482 #1425574 (400 connections now open) 2015-10-05T06:00:13.928+0100 [conn1425574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:14.374+0100 [conn1425178] end connection 172.28.0.164:57894 (399 connections now open) 2015-10-05T06:00:14.374+0100 [mongosMain] connection accepted from 172.28.0.164:58855 #1425575 (400 connections now open) 2015-10-05T06:00:14.377+0100 [conn1425575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:14.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203de5703b51053ebc72a 2015-10-05T06:00:14.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:19.631+0100 [conn1425090] end connection 172.28.0.164:57705 (399 connections now open) 2015-10-05T06:00:19.633+0100 [mongosMain] connection accepted from 172.28.0.164:58864 #1425576 (400 connections now open) 2015-10-05T06:00:19.635+0100 [conn1425576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:19.835+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:19.835+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:19.853+0100 [conn1425171] end connection 172.28.0.163:64816 (399 connections now open) 2015-10-05T06:00:19.854+0100 [mongosMain] connection accepted from 172.28.0.163:49490 #1425577 (400 connections now open) 2015-10-05T06:00:19.855+0100 [conn1425577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:20.429+0100 [conn1425141] end connection 172.28.0.163:64731 (399 connections now open) 2015-10-05T06:00:20.430+0100 [mongosMain] connection accepted from 172.28.0.163:49491 #1425578 (400 connections now open) 2015-10-05T06:00:20.431+0100 [conn1425578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:21.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203e45703b51053ebc90a 2015-10-05T06:00:21.404+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:21.861+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:23.385+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:00:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:00:23.913+0100 [conn1425165] end connection 172.28.0.163:64800 (399 connections now open) 2015-10-05T06:00:23.914+0100 [conn1425168] end connection 172.28.0.163:64811 (398 connections now open) 2015-10-05T06:00:23.914+0100 [mongosMain] connection accepted from 172.28.0.163:49494 #1425579 (399 connections now open) 2015-10-05T06:00:23.917+0100 [conn1425579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:23.919+0100 [mongosMain] connection accepted from 172.28.0.163:49498 #1425580 (400 connections now open) 2015-10-05T06:00:23.919+0100 [conn1425580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:24.394+0100 [conn1425174] end connection 172.28.0.164:57878 (399 connections now open) 2015-10-05T06:00:24.395+0100 [mongosMain] connection accepted from 172.28.0.164:58873 #1425581 (400 connections now open) 2015-10-05T06:00:24.397+0100 [conn1425581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:27.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203eb5703b51053ebcad8 2015-10-05T06:00:27.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:28.840+0100 [mongosMain] connection accepted from 127.0.0.1:49503 #1425582 (401 connections now open) 2015-10-05T06:00:28.843+0100 [conn1425582] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:28.848+0100 [conn1425582] end connection 127.0.0.1:49503 (400 connections now open) 2015-10-05T06:00:29.839+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:29.839+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:29.868+0100 [conn1425181] end connection 172.28.0.163:64851 (399 connections now open) 2015-10-05T06:00:29.869+0100 [mongosMain] connection accepted from 172.28.0.163:49505 #1425583 (400 connections now open) 2015-10-05T06:00:29.870+0100 [conn1425583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:30.193+0100 [conn1425149] end connection 172.28.0.164:57826 (399 connections now open) 2015-10-05T06:00:30.195+0100 [mongosMain] connection accepted from 172.28.0.164:58883 #1425584 (400 connections now open) 2015-10-05T06:00:30.197+0100 [conn1425584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:30.445+0100 [conn1425188] end connection 172.28.0.163:64877 (399 connections now open) 2015-10-05T06:00:30.446+0100 [mongosMain] connection accepted from 172.28.0.163:49506 #1425585 (400 connections now open) 2015-10-05T06:00:30.446+0100 [conn1425585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:32.872+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:33.924+0100 [conn1425157] end connection 172.28.0.163:64765 (399 connections now open) 2015-10-05T06:00:33.926+0100 [mongosMain] connection accepted from 172.28.0.163:49510 #1425586 (400 connections now open) 2015-10-05T06:00:33.926+0100 [conn1425586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:34.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203f15703b51053ebccd2 2015-10-05T06:00:34.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:39.647+0100 [conn1425138] end connection 172.28.0.164:57804 (399 connections now open) 2015-10-05T06:00:39.649+0100 [mongosMain] connection accepted from 172.28.0.164:58902 #1425587 (400 connections now open) 2015-10-05T06:00:39.651+0100 [conn1425587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:39.883+0100 [conn1425179] end connection 172.28.0.163:64839 (399 connections now open) 2015-10-05T06:00:39.884+0100 [mongosMain] connection accepted from 172.28.0.163:49512 #1425588 (400 connections now open) 2015-10-05T06:00:39.885+0100 [conn1425588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:39.907+0100 [mongosMain] connection accepted from 127.0.0.1:49513 #1425589 (401 connections now open) 2015-10-05T06:00:39.911+0100 [conn1425589] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:39.916+0100 [conn1425589] end connection 127.0.0.1:49513 (400 connections now open) 2015-10-05T06:00:40.445+0100 [conn1425194] end connection 172.28.0.163:64889 (399 connections now open) 2015-10-05T06:00:40.446+0100 [mongosMain] connection accepted from 172.28.0.163:49515 #1425590 (400 connections now open) 2015-10-05T06:00:40.447+0100 [conn1425590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:40.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203f85703b51053ebce6c 2015-10-05T06:00:40.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:40.847+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:40.847+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:43.882+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:43.938+0100 [conn1425164] end connection 172.28.0.163:64799 (399 connections now open) 2015-10-05T06:00:43.939+0100 [conn1425189] end connection 172.28.0.163:64880 (398 connections now open) 2015-10-05T06:00:43.939+0100 [mongosMain] connection accepted from 172.28.0.163:49524 #1425591 (399 connections now open) 2015-10-05T06:00:43.939+0100 [mongosMain] connection accepted from 172.28.0.163:49525 #1425592 (400 connections now open) 2015-10-05T06:00:43.940+0100 [conn1425591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:43.940+0100 [conn1425592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:46.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561203fe5703b51053ebcf99 2015-10-05T06:00:46.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:49.663+0100 [conn1425169] end connection 172.28.0.164:57870 (399 connections now open) 2015-10-05T06:00:49.664+0100 [mongosMain] connection accepted from 172.28.0.164:58927 #1425593 (400 connections now open) 2015-10-05T06:00:49.666+0100 [conn1425593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:49.884+0100 [conn1425196] end connection 172.28.0.163:64895 (399 connections now open) 2015-10-05T06:00:49.885+0100 [mongosMain] connection accepted from 172.28.0.163:49540 #1425594 (400 connections now open) 2015-10-05T06:00:49.886+0100 [conn1425594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:50.209+0100 [conn1425193] end connection 172.28.0.164:57944 (399 connections now open) 2015-10-05T06:00:50.210+0100 [mongosMain] connection accepted from 172.28.0.164:58929 #1425595 (400 connections now open) 2015-10-05T06:00:50.212+0100 [conn1425595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:52.897+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:52.897+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:53.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204045703b51053ebd104 2015-10-05T06:00:53.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:00:53.705+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:00:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:00:53.940+0100 [conn1425173] end connection 172.28.0.163:64818 (399 connections now open) 2015-10-05T06:00:53.941+0100 [mongosMain] connection accepted from 172.28.0.163:49550 #1425596 (400 connections now open) 2015-10-05T06:00:53.942+0100 [conn1425596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:54.420+0100 [conn1425145] end connection 172.28.0.164:57814 (399 connections now open) 2015-10-05T06:00:54.421+0100 [conn1424981] end connection 172.28.0.164:57468 (398 connections now open) 2015-10-05T06:00:54.421+0100 [mongosMain] connection accepted from 172.28.0.164:58937 #1425597 (399 connections now open) 2015-10-05T06:00:54.422+0100 [mongosMain] connection accepted from 172.28.0.164:58938 #1425598 (400 connections now open) 2015-10-05T06:00:54.423+0100 [conn1425597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:54.424+0100 [conn1425598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:00:54.924+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:54.924+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:54.942+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:57.931+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:00:57.931+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:00:59.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612040b5703b51053ebd1f2 2015-10-05T06:00:59.899+0100 [conn1425192] end connection 172.28.0.163:64887 (399 connections now open) 2015-10-05T06:00:59.902+0100 [mongosMain] connection accepted from 172.28.0.163:49563 #1425599 (400 connections now open) 2015-10-05T06:00:59.903+0100 [conn1425599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:00.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:00.223+0100 [conn1425202] end connection 172.28.0.164:57969 (399 connections now open) 2015-10-05T06:01:00.224+0100 [mongosMain] connection accepted from 172.28.0.164:58946 #1425600 (400 connections now open) 2015-10-05T06:01:00.225+0100 [conn1425600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:00.460+0100 [conn1425198] end connection 172.28.0.163:64897 (399 connections now open) 2015-10-05T06:01:00.461+0100 [mongosMain] connection accepted from 172.28.0.163:49564 #1425601 (400 connections now open) 2015-10-05T06:01:00.462+0100 [conn1425601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:02.084+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:02.085+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:03.971+0100 [conn1425204] end connection 172.28.0.163:64918 (399 connections now open) 2015-10-05T06:01:03.972+0100 [conn1425143] end connection 172.28.0.163:64734 (398 connections now open) 2015-10-05T06:01:03.976+0100 [mongosMain] connection accepted from 172.28.0.163:49572 #1425602 (399 connections now open) 2015-10-05T06:01:03.976+0100 [conn1425602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:03.977+0100 [mongosMain] connection accepted from 172.28.0.163:49573 #1425603 (400 connections now open) 2015-10-05T06:01:03.978+0100 [conn1425603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:04.420+0100 [conn1425205] end connection 172.28.0.164:57975 (399 connections now open) 2015-10-05T06:01:04.420+0100 [conn1425183] end connection 172.28.0.164:57918 (398 connections now open) 2015-10-05T06:01:04.421+0100 [mongosMain] connection accepted from 172.28.0.164:58955 #1425604 (399 connections now open) 2015-10-05T06:01:04.421+0100 [mongosMain] connection accepted from 172.28.0.164:58954 #1425605 (400 connections now open) 2015-10-05T06:01:04.422+0100 [conn1425605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:04.422+0100 [conn1425604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:05.963+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:06.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204125703b51053ebd40d 2015-10-05T06:01:06.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:07.158+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:07.158+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:09.693+0100 [conn1425146] end connection 172.28.0.164:57821 (399 connections now open) 2015-10-05T06:01:09.694+0100 [mongosMain] connection accepted from 172.28.0.164:58960 #1425606 (400 connections now open) 2015-10-05T06:01:09.695+0100 [conn1425606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:10.223+0100 [conn1425209] end connection 172.28.0.164:57983 (399 connections now open) 2015-10-05T06:01:10.224+0100 [mongosMain] connection accepted from 172.28.0.164:58964 #1425607 (400 connections now open) 2015-10-05T06:01:10.225+0100 [conn1425607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:10.475+0100 [conn1425210] end connection 172.28.0.163:64929 (399 connections now open) 2015-10-05T06:01:10.476+0100 [mongosMain] connection accepted from 172.28.0.163:49585 #1425608 (400 connections now open) 2015-10-05T06:01:10.477+0100 [conn1425608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:12.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204185703b51053ebd626 2015-10-05T06:01:12.492+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:13.163+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:13.164+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:13.964+0100 [conn1425195] end connection 172.28.0.163:64893 (399 connections now open) 2015-10-05T06:01:13.965+0100 [mongosMain] connection accepted from 172.28.0.163:49598 #1425609 (400 connections now open) 2015-10-05T06:01:13.966+0100 [conn1425609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:14.435+0100 [conn1425144] end connection 172.28.0.164:57813 (399 connections now open) 2015-10-05T06:01:14.435+0100 [conn1425184] end connection 172.28.0.164:57919 (398 connections now open) 2015-10-05T06:01:14.436+0100 [mongosMain] connection accepted from 172.28.0.164:58970 #1425610 (399 connections now open) 2015-10-05T06:01:14.436+0100 [mongosMain] connection accepted from 172.28.0.164:58971 #1425611 (400 connections now open) 2015-10-05T06:01:14.437+0100 [conn1425610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:14.437+0100 [conn1425611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:16.973+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:18.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612041e5703b51053ebd7a5 2015-10-05T06:01:18.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:19.710+0100 [conn1425166] end connection 172.28.0.164:57856 (399 connections now open) 2015-10-05T06:01:19.711+0100 [mongosMain] connection accepted from 172.28.0.164:58978 #1425612 (400 connections now open) 2015-10-05T06:01:19.713+0100 [conn1425612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:19.915+0100 [conn1425185] end connection 172.28.0.163:64867 (399 connections now open) 2015-10-05T06:01:19.916+0100 [mongosMain] connection accepted from 172.28.0.163:49607 #1425613 (400 connections now open) 2015-10-05T06:01:19.917+0100 [conn1425613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:20.169+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:20.169+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:20.239+0100 [conn1425217] end connection 172.28.0.164:57993 (399 connections now open) 2015-10-05T06:01:20.241+0100 [mongosMain] connection accepted from 172.28.0.164:58981 #1425614 (400 connections now open) 2015-10-05T06:01:20.242+0100 [conn1425614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:20.492+0100 [conn1425218] end connection 172.28.0.163:64957 (399 connections now open) 2015-10-05T06:01:20.493+0100 [mongosMain] connection accepted from 172.28.0.163:49609 #1425615 (400 connections now open) 2015-10-05T06:01:20.494+0100 [conn1425615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:23.900+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:01:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:01:24.451+0100 [conn1425190] end connection 172.28.0.164:57936 (399 connections now open) 2015-10-05T06:01:24.452+0100 [conn1425220] end connection 172.28.0.164:57994 (398 connections now open) 2015-10-05T06:01:24.452+0100 [mongosMain] connection accepted from 172.28.0.164:58991 #1425616 (399 connections now open) 2015-10-05T06:01:24.452+0100 [mongosMain] connection accepted from 172.28.0.164:58989 #1425617 (400 connections now open) 2015-10-05T06:01:24.453+0100 [conn1425616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:24.454+0100 [conn1425617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:24.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204245703b51053ebd92c 2015-10-05T06:01:24.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:27.979+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:28.175+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:28.175+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:28.559+0100 [mongosMain] connection accepted from 127.0.0.1:49619 #1425618 (401 connections now open) 2015-10-05T06:01:28.561+0100 [conn1425618] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:28.566+0100 [conn1425618] end connection 127.0.0.1:49619 (400 connections now open) 2015-10-05T06:01:29.725+0100 [conn1425129] end connection 172.28.0.164:57786 (399 connections now open) 2015-10-05T06:01:29.726+0100 [mongosMain] connection accepted from 172.28.0.164:58998 #1425619 (400 connections now open) 2015-10-05T06:01:29.728+0100 [conn1425619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:29.921+0100 [conn1425208] end connection 172.28.0.163:64927 (399 connections now open) 2015-10-05T06:01:29.922+0100 [mongosMain] connection accepted from 172.28.0.163:49620 #1425620 (400 connections now open) 2015-10-05T06:01:29.924+0100 [conn1425620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:30.255+0100 [conn1425223] end connection 172.28.0.164:58002 (399 connections now open) 2015-10-05T06:01:30.256+0100 [mongosMain] connection accepted from 172.28.0.164:59001 #1425621 (400 connections now open) 2015-10-05T06:01:30.258+0100 [conn1425621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:30.499+0100 [conn1425224] end connection 172.28.0.163:64966 (399 connections now open) 2015-10-05T06:01:30.501+0100 [mongosMain] connection accepted from 172.28.0.163:49621 #1425622 (400 connections now open) 2015-10-05T06:01:30.502+0100 [conn1425622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:31.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612042a5703b51053ebda96 2015-10-05T06:01:31.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:34.551+0100 [conn1425226] end connection 172.28.0.164:58011 (399 connections now open) 2015-10-05T06:01:34.552+0100 [conn1425213] end connection 172.28.0.164:57987 (398 connections now open) 2015-10-05T06:01:34.556+0100 [mongosMain] connection accepted from 172.28.0.164:59007 #1425623 (399 connections now open) 2015-10-05T06:01:34.556+0100 [mongosMain] connection accepted from 172.28.0.164:59008 #1425624 (400 connections now open) 2015-10-05T06:01:34.570+0100 [conn1425623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:34.571+0100 [conn1425624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:37.220+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:37.220+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:37.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204315703b51053ebdb9a 2015-10-05T06:01:37.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:38.983+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:39.513+0100 [mongosMain] connection accepted from 127.0.0.1:49628 #1425625 (401 connections now open) 2015-10-05T06:01:39.516+0100 [conn1425625] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:39.521+0100 [conn1425625] end connection 127.0.0.1:49628 (400 connections now open) 2015-10-05T06:01:39.742+0100 [conn1425215] end connection 172.28.0.164:57991 (399 connections now open) 2015-10-05T06:01:39.743+0100 [mongosMain] connection accepted from 172.28.0.164:59018 #1425626 (400 connections now open) 2015-10-05T06:01:39.745+0100 [conn1425626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:39.931+0100 [conn1425216] end connection 172.28.0.163:64954 (399 connections now open) 2015-10-05T06:01:39.932+0100 [mongosMain] connection accepted from 172.28.0.163:49629 #1425627 (400 connections now open) 2015-10-05T06:01:39.933+0100 [conn1425627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:40.271+0100 [conn1425230] end connection 172.28.0.164:58021 (399 connections now open) 2015-10-05T06:01:40.273+0100 [mongosMain] connection accepted from 172.28.0.164:59020 #1425628 (400 connections now open) 2015-10-05T06:01:40.275+0100 [conn1425628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:40.508+0100 [conn1425231] end connection 172.28.0.163:64973 (399 connections now open) 2015-10-05T06:01:40.509+0100 [mongosMain] connection accepted from 172.28.0.163:49631 #1425629 (400 connections now open) 2015-10-05T06:01:40.510+0100 [conn1425629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:44.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204375703b51053ebdcb6 2015-10-05T06:01:44.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:44.545+0100 [conn1425214] end connection 172.28.0.164:57988 (399 connections now open) 2015-10-05T06:01:44.546+0100 [mongosMain] connection accepted from 172.28.0.164:59029 #1425630 (400 connections now open) 2015-10-05T06:01:44.547+0100 [conn1425630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:47.231+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:47.231+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:49.741+0100 [conn1425122] end connection 172.28.0.164:57774 (399 connections now open) 2015-10-05T06:01:49.742+0100 [mongosMain] connection accepted from 172.28.0.164:59038 #1425631 (400 connections now open) 2015-10-05T06:01:49.744+0100 [conn1425631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:49.992+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:50.287+0100 [conn1425236] end connection 172.28.0.164:58037 (399 connections now open) 2015-10-05T06:01:50.288+0100 [mongosMain] connection accepted from 172.28.0.164:59040 #1425632 (400 connections now open) 2015-10-05T06:01:50.290+0100 [conn1425632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:50.508+0100 [conn1425237] end connection 172.28.0.163:64980 (399 connections now open) 2015-10-05T06:01:50.509+0100 [mongosMain] connection accepted from 172.28.0.163:49647 #1425633 (400 connections now open) 2015-10-05T06:01:50.510+0100 [conn1425633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:50.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612043e5703b51053ebddc8 2015-10-05T06:01:50.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:54.050+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:01:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:01:57.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204445703b51053ebdedb 2015-10-05T06:01:57.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:01:58.236+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:01:58.237+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:01:59.757+0100 [conn1425227] end connection 172.28.0.164:58019 (399 connections now open) 2015-10-05T06:01:59.758+0100 [mongosMain] connection accepted from 172.28.0.164:59067 #1425634 (400 connections now open) 2015-10-05T06:01:59.761+0100 [conn1425634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:01:59.947+0100 [conn1425187] end connection 172.28.0.163:64875 (399 connections now open) 2015-10-05T06:01:59.948+0100 [mongosMain] connection accepted from 172.28.0.163:49677 #1425635 (400 connections now open) 2015-10-05T06:01:59.949+0100 [conn1425635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:00.304+0100 [conn1425240] end connection 172.28.0.164:58053 (399 connections now open) 2015-10-05T06:02:00.306+0100 [mongosMain] connection accepted from 172.28.0.164:59070 #1425636 (400 connections now open) 2015-10-05T06:02:00.307+0100 [conn1425636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:00.524+0100 [conn1425241] end connection 172.28.0.163:64995 (399 connections now open) 2015-10-05T06:02:00.525+0100 [mongosMain] connection accepted from 172.28.0.163:49680 #1425637 (400 connections now open) 2015-10-05T06:02:00.526+0100 [conn1425637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:01.145+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:03.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612044b5703b51053ebdfe5 2015-10-05T06:02:03.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:04.360+0100 [conn1425182] end connection 172.28.0.163:64857 (399 connections now open) 2015-10-05T06:02:04.360+0100 [conn1425219] end connection 172.28.0.163:64960 (399 connections now open) 2015-10-05T06:02:04.361+0100 [mongosMain] connection accepted from 172.28.0.163:49686 #1425638 (399 connections now open) 2015-10-05T06:02:04.362+0100 [mongosMain] connection accepted from 172.28.0.163:49687 #1425639 (400 connections now open) 2015-10-05T06:02:04.362+0100 [conn1425638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:04.362+0100 [conn1425639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:04.562+0100 [conn1425232] end connection 172.28.0.164:58026 (399 connections now open) 2015-10-05T06:02:04.562+0100 [mongosMain] connection accepted from 172.28.0.164:59077 #1425640 (400 connections now open) 2015-10-05T06:02:04.564+0100 [conn1425640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:09.757+0100 [conn1425222] end connection 172.28.0.164:58000 (399 connections now open) 2015-10-05T06:02:09.758+0100 [mongosMain] connection accepted from 172.28.0.164:59084 #1425641 (400 connections now open) 2015-10-05T06:02:09.760+0100 [conn1425641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:09.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204515703b51053ebe0f4 2015-10-05T06:02:09.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:09.962+0100 [conn1425229] end connection 172.28.0.163:64972 (399 connections now open) 2015-10-05T06:02:09.962+0100 [mongosMain] connection accepted from 172.28.0.163:49702 #1425642 (400 connections now open) 2015-10-05T06:02:09.963+0100 [conn1425642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:10.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:10.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:10.303+0100 [conn1425245] end connection 172.28.0.164:58067 (399 connections now open) 2015-10-05T06:02:10.305+0100 [mongosMain] connection accepted from 172.28.0.164:59087 #1425643 (400 connections now open) 2015-10-05T06:02:10.307+0100 [conn1425643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:10.524+0100 [conn1425246] end connection 172.28.0.163:65009 (399 connections now open) 2015-10-05T06:02:10.525+0100 [mongosMain] connection accepted from 172.28.0.163:49704 #1425644 (400 connections now open) 2015-10-05T06:02:10.526+0100 [conn1425644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:12.151+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:12.250+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:12.250+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:14.377+0100 [conn1425203] end connection 172.28.0.163:64917 (399 connections now open) 2015-10-05T06:02:14.378+0100 [conn1425212] end connection 172.28.0.163:64945 (399 connections now open) 2015-10-05T06:02:14.379+0100 [mongosMain] connection accepted from 172.28.0.163:49712 #1425645 (399 connections now open) 2015-10-05T06:02:14.379+0100 [mongosMain] connection accepted from 172.28.0.163:49713 #1425646 (400 connections now open) 2015-10-05T06:02:14.380+0100 [conn1425645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:14.380+0100 [conn1425646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:14.561+0100 [conn1425238] end connection 172.28.0.164:58045 (399 connections now open) 2015-10-05T06:02:14.562+0100 [mongosMain] connection accepted from 172.28.0.164:59094 #1425647 (400 connections now open) 2015-10-05T06:02:14.569+0100 [conn1425647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:14.620+0100 [conn1425136] end connection 172.28.0.164:57796 (399 connections now open) 2015-10-05T06:02:14.620+0100 [mongosMain] connection accepted from 172.28.0.164:59095 #1425648 (400 connections now open) 2015-10-05T06:02:14.620+0100 [conn1425648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:15.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:15.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:16.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204575703b51053ebe1c7 2015-10-05T06:02:16.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:19.308+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:19.308+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:19.773+0100 [conn1425207] end connection 172.28.0.164:57980 (399 connections now open) 2015-10-05T06:02:19.774+0100 [mongosMain] connection accepted from 172.28.0.164:59106 #1425649 (400 connections now open) 2015-10-05T06:02:19.776+0100 [conn1425649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:19.962+0100 [conn1425201] end connection 172.28.0.163:64911 (399 connections now open) 2015-10-05T06:02:19.963+0100 [mongosMain] connection accepted from 172.28.0.163:49727 #1425650 (400 connections now open) 2015-10-05T06:02:19.965+0100 [conn1425650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:20.319+0100 [conn1425252] end connection 172.28.0.164:58076 (399 connections now open) 2015-10-05T06:02:20.321+0100 [mongosMain] connection accepted from 172.28.0.164:59109 #1425651 (400 connections now open) 2015-10-05T06:02:20.322+0100 [conn1425651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:20.539+0100 [conn1425253] end connection 172.28.0.163:65029 (399 connections now open) 2015-10-05T06:02:20.540+0100 [mongosMain] connection accepted from 172.28.0.163:49730 #1425652 (400 connections now open) 2015-10-05T06:02:20.541+0100 [conn1425652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:22.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612045e5703b51053ebe2a5 2015-10-05T06:02:22.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:23.254+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:24.303+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:02:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:02:24.313+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:24.313+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:24.381+0100 [conn1425199] end connection 172.28.0.163:64903 (399 connections now open) 2015-10-05T06:02:24.381+0100 [conn1425242] end connection 172.28.0.163:65000 (399 connections now open) 2015-10-05T06:02:24.382+0100 [mongosMain] connection accepted from 172.28.0.163:49734 #1425653 (399 connections now open) 2015-10-05T06:02:24.382+0100 [mongosMain] connection accepted from 172.28.0.163:49735 #1425654 (400 connections now open) 2015-10-05T06:02:24.383+0100 [conn1425653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:24.383+0100 [conn1425654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:24.578+0100 [conn1425249] end connection 172.28.0.164:58072 (399 connections now open) 2015-10-05T06:02:24.579+0100 [mongosMain] connection accepted from 172.28.0.164:59117 #1425655 (400 connections now open) 2015-10-05T06:02:24.581+0100 [conn1425655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:28.436+0100 [mongosMain] connection accepted from 127.0.0.1:49740 #1425656 (401 connections now open) 2015-10-05T06:02:28.439+0100 [conn1425656] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:28.445+0100 [conn1425656] end connection 127.0.0.1:49740 (400 connections now open) 2015-10-05T06:02:28.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204645703b51053ebe371 2015-10-05T06:02:29.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:30.318+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:30.319+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:30.334+0100 [conn1425259] end connection 172.28.0.164:58090 (399 connections now open) 2015-10-05T06:02:30.334+0100 [mongosMain] connection accepted from 172.28.0.164:59127 #1425657 (400 connections now open) 2015-10-05T06:02:30.336+0100 [conn1425657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:30.540+0100 [conn1425260] end connection 172.28.0.163:65040 (399 connections now open) 2015-10-05T06:02:30.541+0100 [mongosMain] connection accepted from 172.28.0.163:49743 #1425658 (400 connections now open) 2015-10-05T06:02:30.542+0100 [conn1425658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:34.251+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:34.393+0100 [conn1425248] end connection 172.28.0.163:65017 (399 connections now open) 2015-10-05T06:02:34.393+0100 [conn1425247] end connection 172.28.0.163:65016 (399 connections now open) 2015-10-05T06:02:34.394+0100 [mongosMain] connection accepted from 172.28.0.163:49747 #1425659 (399 connections now open) 2015-10-05T06:02:34.394+0100 [mongosMain] connection accepted from 172.28.0.163:49748 #1425660 (400 connections now open) 2015-10-05T06:02:34.394+0100 [conn1425659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:34.395+0100 [conn1425660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:34.578+0100 [conn1425221] end connection 172.28.0.164:57995 (399 connections now open) 2015-10-05T06:02:34.578+0100 [conn1425243] end connection 172.28.0.164:58061 (398 connections now open) 2015-10-05T06:02:34.579+0100 [mongosMain] connection accepted from 172.28.0.164:59133 #1425661 (399 connections now open) 2015-10-05T06:02:34.579+0100 [mongosMain] connection accepted from 172.28.0.164:59134 #1425662 (400 connections now open) 2015-10-05T06:02:34.580+0100 [conn1425661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:34.581+0100 [conn1425662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:35.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612046b5703b51053ebe431 2015-10-05T06:02:35.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:37.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:37.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:39.751+0100 [mongosMain] connection accepted from 127.0.0.1:49753 #1425663 (401 connections now open) 2015-10-05T06:02:39.754+0100 [conn1425663] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:39.757+0100 [conn1425663] end connection 127.0.0.1:49753 (400 connections now open) 2015-10-05T06:02:39.978+0100 [conn1425264] end connection 172.28.0.163:65046 (399 connections now open) 2015-10-05T06:02:39.979+0100 [mongosMain] connection accepted from 172.28.0.163:49755 #1425664 (400 connections now open) 2015-10-05T06:02:39.980+0100 [conn1425664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:40.334+0100 [conn1425265] end connection 172.28.0.164:58105 (399 connections now open) 2015-10-05T06:02:40.334+0100 [mongosMain] connection accepted from 172.28.0.164:59146 #1425665 (400 connections now open) 2015-10-05T06:02:40.336+0100 [conn1425665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:40.555+0100 [conn1425266] end connection 172.28.0.163:65049 (399 connections now open) 2015-10-05T06:02:40.556+0100 [mongosMain] connection accepted from 172.28.0.163:49757 #1425666 (400 connections now open) 2015-10-05T06:02:40.558+0100 [conn1425666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:41.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204715703b51053ebe4d5 2015-10-05T06:02:41.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:44.409+0100 [conn1425261] end connection 172.28.0.163:65043 (399 connections now open) 2015-10-05T06:02:44.409+0100 [conn1425211] end connection 172.28.0.163:64944 (398 connections now open) 2015-10-05T06:02:44.411+0100 [mongosMain] connection accepted from 172.28.0.163:49765 #1425667 (399 connections now open) 2015-10-05T06:02:44.411+0100 [mongosMain] connection accepted from 172.28.0.163:49766 #1425668 (400 connections now open) 2015-10-05T06:02:44.412+0100 [conn1425667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:44.412+0100 [conn1425668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:44.595+0100 [conn1425262] end connection 172.28.0.164:58097 (399 connections now open) 2015-10-05T06:02:44.596+0100 [mongosMain] connection accepted from 172.28.0.164:59154 #1425669 (400 connections now open) 2015-10-05T06:02:44.598+0100 [conn1425669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:45.268+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:45.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:45.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:48.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204775703b51053ebe590 2015-10-05T06:02:48.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:49.993+0100 [conn1425258] end connection 172.28.0.163:65038 (399 connections now open) 2015-10-05T06:02:49.994+0100 [mongosMain] connection accepted from 172.28.0.163:49773 #1425670 (400 connections now open) 2015-10-05T06:02:49.995+0100 [conn1425670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:50.350+0100 [conn1425274] end connection 172.28.0.164:58124 (399 connections now open) 2015-10-05T06:02:50.350+0100 [mongosMain] connection accepted from 172.28.0.164:59164 #1425671 (400 connections now open) 2015-10-05T06:02:50.352+0100 [conn1425671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:50.571+0100 [conn1425275] end connection 172.28.0.163:65058 (399 connections now open) 2015-10-05T06:02:50.572+0100 [mongosMain] connection accepted from 172.28.0.163:49775 #1425672 (400 connections now open) 2015-10-05T06:02:50.574+0100 [conn1425672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:54.342+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:54.342+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:02:54.410+0100 [conn1425200] end connection 172.28.0.163:64904 (399 connections now open) 2015-10-05T06:02:54.411+0100 [conn1425254] end connection 172.28.0.163:65032 (399 connections now open) 2015-10-05T06:02:54.412+0100 [mongosMain] connection accepted from 172.28.0.163:49781 #1425673 (399 connections now open) 2015-10-05T06:02:54.412+0100 [mongosMain] connection accepted from 172.28.0.163:49782 #1425674 (400 connections now open) 2015-10-05T06:02:54.413+0100 [conn1425673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:54.413+0100 [conn1425674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:54.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612047e5703b51053ebe612 2015-10-05T06:02:54.582+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:02:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:02:54.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:02:54.695+0100 [conn1425270] end connection 172.28.0.164:58112 (399 connections now open) 2015-10-05T06:02:54.699+0100 [mongosMain] connection accepted from 172.28.0.164:59173 #1425675 (400 connections now open) 2015-10-05T06:02:54.700+0100 [conn1425675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:56.273+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:02:59.804+0100 [conn1425244] end connection 172.28.0.164:58065 (399 connections now open) 2015-10-05T06:02:59.811+0100 [mongosMain] connection accepted from 172.28.0.164:59179 #1425676 (400 connections now open) 2015-10-05T06:02:59.813+0100 [conn1425676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:02:59.997+0100 [conn1425234] end connection 172.28.0.163:64977 (399 connections now open) 2015-10-05T06:02:59.998+0100 [mongosMain] connection accepted from 172.28.0.163:49798 #1425677 (400 connections now open) 2015-10-05T06:02:59.999+0100 [conn1425677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:00.350+0100 [conn1425280] end connection 172.28.0.164:58139 (399 connections now open) 2015-10-05T06:03:00.352+0100 [mongosMain] connection accepted from 172.28.0.164:59182 #1425678 (400 connections now open) 2015-10-05T06:03:00.353+0100 [conn1425678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:00.574+0100 [conn1425281] end connection 172.28.0.163:65077 (399 connections now open) 2015-10-05T06:03:00.575+0100 [mongosMain] connection accepted from 172.28.0.163:49802 #1425679 (400 connections now open) 2015-10-05T06:03:00.576+0100 [conn1425679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:00.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204845703b51053ebe6ae 2015-10-05T06:03:00.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:04.351+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:04.351+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:04.425+0100 [conn1425276] end connection 172.28.0.163:65065 (399 connections now open) 2015-10-05T06:03:04.426+0100 [mongosMain] connection accepted from 172.28.0.163:49810 #1425680 (400 connections now open) 2015-10-05T06:03:04.426+0100 [conn1425680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:04.687+0100 [conn1425269] end connection 172.28.0.164:58111 (399 connections now open) 2015-10-05T06:03:04.687+0100 [conn1425284] end connection 172.28.0.164:58149 (399 connections now open) 2015-10-05T06:03:04.688+0100 [mongosMain] connection accepted from 172.28.0.164:59187 #1425681 (399 connections now open) 2015-10-05T06:03:04.688+0100 [mongosMain] connection accepted from 172.28.0.164:59188 #1425682 (400 connections now open) 2015-10-05T06:03:04.689+0100 [conn1425682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:04.689+0100 [conn1425681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:07.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612048a5703b51053ebe77d 2015-10-05T06:03:07.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:07.340+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:09.805+0100 [conn1425257] end connection 172.28.0.164:58086 (399 connections now open) 2015-10-05T06:03:09.806+0100 [mongosMain] connection accepted from 172.28.0.164:59190 #1425683 (400 connections now open) 2015-10-05T06:03:09.808+0100 [conn1425683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:10.009+0100 [conn1425251] end connection 172.28.0.163:65026 (399 connections now open) 2015-10-05T06:03:10.010+0100 [mongosMain] connection accepted from 172.28.0.163:49818 #1425684 (400 connections now open) 2015-10-05T06:03:10.010+0100 [conn1425684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:10.350+0100 [conn1425287] end connection 172.28.0.164:58154 (399 connections now open) 2015-10-05T06:03:10.351+0100 [mongosMain] connection accepted from 172.28.0.164:59192 #1425685 (400 connections now open) 2015-10-05T06:03:10.356+0100 [conn1425685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:10.586+0100 [conn1425288] end connection 172.28.0.163:65097 (399 connections now open) 2015-10-05T06:03:10.587+0100 [mongosMain] connection accepted from 172.28.0.163:49823 #1425686 (400 connections now open) 2015-10-05T06:03:10.588+0100 [conn1425686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:13.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204915703b51053ebe841 2015-10-05T06:03:13.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:14.426+0100 [conn1425268] end connection 172.28.0.163:65052 (399 connections now open) 2015-10-05T06:03:14.427+0100 [mongosMain] connection accepted from 172.28.0.163:49828 #1425687 (400 connections now open) 2015-10-05T06:03:14.428+0100 [conn1425687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:14.688+0100 [conn1425291] end connection 172.28.0.164:58162 (399 connections now open) 2015-10-05T06:03:14.688+0100 [conn1425278] end connection 172.28.0.164:58131 (398 connections now open) 2015-10-05T06:03:14.689+0100 [mongosMain] connection accepted from 172.28.0.164:59197 #1425688 (399 connections now open) 2015-10-05T06:03:14.689+0100 [mongosMain] connection accepted from 172.28.0.164:59198 #1425689 (400 connections now open) 2015-10-05T06:03:14.690+0100 [conn1425688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:14.691+0100 [conn1425689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:15.368+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:15.368+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:18.426+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:19.821+0100 [conn1425285] end connection 172.28.0.164:58152 (399 connections now open) 2015-10-05T06:03:19.822+0100 [mongosMain] connection accepted from 172.28.0.164:59205 #1425690 (400 connections now open) 2015-10-05T06:03:19.823+0100 [conn1425690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:19.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204975703b51053ebe8ef 2015-10-05T06:03:19.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:20.024+0100 [conn1425273] end connection 172.28.0.163:65057 (399 connections now open) 2015-10-05T06:03:20.026+0100 [mongosMain] connection accepted from 172.28.0.163:49834 #1425691 (400 connections now open) 2015-10-05T06:03:20.027+0100 [conn1425691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:20.366+0100 [conn1425294] end connection 172.28.0.164:58166 (399 connections now open) 2015-10-05T06:03:20.367+0100 [mongosMain] connection accepted from 172.28.0.164:59207 #1425692 (400 connections now open) 2015-10-05T06:03:20.368+0100 [conn1425692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:20.587+0100 [conn1425295] end connection 172.28.0.163:65122 (399 connections now open) 2015-10-05T06:03:20.588+0100 [mongosMain] connection accepted from 172.28.0.163:49836 #1425693 (400 connections now open) 2015-10-05T06:03:20.589+0100 [conn1425693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:24.440+0100 [conn1425289] end connection 172.28.0.163:65109 (399 connections now open) 2015-10-05T06:03:24.442+0100 [mongosMain] connection accepted from 172.28.0.163:49840 #1425694 (400 connections now open) 2015-10-05T06:03:24.442+0100 [conn1425694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:24.703+0100 [conn1425298] end connection 172.28.0.164:58169 (399 connections now open) 2015-10-05T06:03:24.703+0100 [conn1425206] end connection 172.28.0.164:57976 (398 connections now open) 2015-10-05T06:03:24.704+0100 [mongosMain] connection accepted from 172.28.0.164:59216 #1425695 (399 connections now open) 2015-10-05T06:03:24.704+0100 [mongosMain] connection accepted from 172.28.0.164:59217 #1425696 (400 connections now open) 2015-10-05T06:03:24.706+0100 [conn1425695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:24.706+0100 [conn1425696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:24.865+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:03:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:03:26.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612049d5703b51053ebe98d 2015-10-05T06:03:26.334+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:27.371+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:27.371+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:28.581+0100 [mongosMain] connection accepted from 127.0.0.1:49846 #1425697 (401 connections now open) 2015-10-05T06:03:28.584+0100 [conn1425697] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:28.589+0100 [conn1425697] end connection 127.0.0.1:49846 (400 connections now open) 2015-10-05T06:03:29.382+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:29.382+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:29.428+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:30.025+0100 [conn1425293] end connection 172.28.0.163:65119 (399 connections now open) 2015-10-05T06:03:30.027+0100 [mongosMain] connection accepted from 172.28.0.163:49847 #1425698 (400 connections now open) 2015-10-05T06:03:30.028+0100 [conn1425698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:30.381+0100 [conn1425302] end connection 172.28.0.164:58177 (399 connections now open) 2015-10-05T06:03:30.382+0100 [mongosMain] connection accepted from 172.28.0.164:59230 #1425699 (400 connections now open) 2015-10-05T06:03:30.383+0100 [conn1425699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:30.602+0100 [conn1425303] end connection 172.28.0.163:65136 (399 connections now open) 2015-10-05T06:03:30.604+0100 [mongosMain] connection accepted from 172.28.0.163:49849 #1425700 (400 connections now open) 2015-10-05T06:03:30.605+0100 [conn1425700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:32.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:32.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:32.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204a45703b51053ebea42 2015-10-05T06:03:32.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:34.444+0100 [conn1425283] end connection 172.28.0.163:65083 (399 connections now open) 2015-10-05T06:03:34.445+0100 [mongosMain] connection accepted from 172.28.0.163:49852 #1425701 (400 connections now open) 2015-10-05T06:03:34.446+0100 [conn1425701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:34.720+0100 [conn1425306] end connection 172.28.0.164:58187 (399 connections now open) 2015-10-05T06:03:34.720+0100 [conn1425255] end connection 172.28.0.164:58080 (398 connections now open) 2015-10-05T06:03:34.721+0100 [mongosMain] connection accepted from 172.28.0.164:59238 #1425702 (399 connections now open) 2015-10-05T06:03:34.721+0100 [mongosMain] connection accepted from 172.28.0.164:59239 #1425703 (400 connections now open) 2015-10-05T06:03:34.723+0100 [conn1425702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:34.723+0100 [conn1425703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:36.390+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:36.390+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:38.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204aa5703b51053ebeaeb 2015-10-05T06:03:39.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:39.851+0100 [conn1425300] end connection 172.28.0.164:58175 (399 connections now open) 2015-10-05T06:03:39.852+0100 [mongosMain] connection accepted from 172.28.0.164:59251 #1425704 (400 connections now open) 2015-10-05T06:03:39.853+0100 [conn1425704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:40.039+0100 [mongosMain] connection accepted from 127.0.0.1:49859 #1425705 (401 connections now open) 2015-10-05T06:03:40.041+0100 [conn1425167] end connection 172.28.0.163:64807 (400 connections now open) 2015-10-05T06:03:40.041+0100 [conn1425705] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:40.042+0100 [mongosMain] connection accepted from 172.28.0.163:49860 #1425706 (401 connections now open) 2015-10-05T06:03:40.043+0100 [conn1425706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:40.046+0100 [conn1425705] end connection 127.0.0.1:49859 (400 connections now open) 2015-10-05T06:03:40.381+0100 [conn1425310] end connection 172.28.0.164:58195 (399 connections now open) 2015-10-05T06:03:40.382+0100 [mongosMain] connection accepted from 172.28.0.164:59255 #1425707 (400 connections now open) 2015-10-05T06:03:40.383+0100 [conn1425707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:40.427+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:40.603+0100 [conn1425311] end connection 172.28.0.163:65147 (399 connections now open) 2015-10-05T06:03:40.604+0100 [mongosMain] connection accepted from 172.28.0.163:49863 #1425708 (400 connections now open) 2015-10-05T06:03:40.605+0100 [conn1425708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:41.385+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:41.385+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:44.456+0100 [conn1425297] end connection 172.28.0.163:65127 (399 connections now open) 2015-10-05T06:03:44.457+0100 [mongosMain] connection accepted from 172.28.0.163:49871 #1425709 (400 connections now open) 2015-10-05T06:03:44.458+0100 [conn1425709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:44.741+0100 [conn1425292] end connection 172.28.0.164:58163 (399 connections now open) 2015-10-05T06:03:44.741+0100 [mongosMain] connection accepted from 172.28.0.164:59263 #1425710 (400 connections now open) 2015-10-05T06:03:44.744+0100 [conn1425710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:45.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204b15703b51053ebeb8d 2015-10-05T06:03:45.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:47.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:47.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:49.867+0100 [conn1425239] end connection 172.28.0.164:58051 (399 connections now open) 2015-10-05T06:03:49.868+0100 [mongosMain] connection accepted from 172.28.0.164:59271 #1425711 (400 connections now open) 2015-10-05T06:03:49.869+0100 [conn1425711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:50.398+0100 [conn1425316] end connection 172.28.0.164:58216 (399 connections now open) 2015-10-05T06:03:50.399+0100 [mongosMain] connection accepted from 172.28.0.164:59274 #1425712 (400 connections now open) 2015-10-05T06:03:50.400+0100 [conn1425712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:50.622+0100 [conn1425318] end connection 172.28.0.163:65155 (399 connections now open) 2015-10-05T06:03:50.623+0100 [mongosMain] connection accepted from 172.28.0.163:49882 #1425713 (400 connections now open) 2015-10-05T06:03:50.624+0100 [conn1425713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:51.426+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:51.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204b75703b51053ebec1d 2015-10-05T06:03:51.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:54.404+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:03:54.404+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:03:54.905+0100 [conn1425314] end connection 172.28.0.164:58204 (399 connections now open) 2015-10-05T06:03:54.907+0100 [mongosMain] connection accepted from 172.28.0.164:59282 #1425714 (400 connections now open) 2015-10-05T06:03:54.909+0100 [conn1425714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:03:55.136+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:03:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:03:58.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204bd5703b51053ebeca7 2015-10-05T06:03:58.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:03:59.882+0100 [conn1425308] end connection 172.28.0.164:58193 (399 connections now open) 2015-10-05T06:03:59.883+0100 [mongosMain] connection accepted from 172.28.0.164:59285 #1425715 (400 connections now open) 2015-10-05T06:03:59.885+0100 [conn1425715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:00.414+0100 [conn1425322] end connection 172.28.0.164:58234 (399 connections now open) 2015-10-05T06:04:00.415+0100 [mongosMain] connection accepted from 172.28.0.164:59287 #1425716 (400 connections now open) 2015-10-05T06:04:00.417+0100 [conn1425716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:00.619+0100 [conn1425323] end connection 172.28.0.163:65173 (399 connections now open) 2015-10-05T06:04:00.620+0100 [mongosMain] connection accepted from 172.28.0.163:49901 #1425717 (400 connections now open) 2015-10-05T06:04:00.621+0100 [conn1425717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:02.414+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:02.414+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:02.426+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:04.480+0100 [conn1425296] end connection 172.28.0.163:65126 (399 connections now open) 2015-10-05T06:04:04.482+0100 [mongosMain] connection accepted from 172.28.0.163:49910 #1425718 (400 connections now open) 2015-10-05T06:04:04.483+0100 [conn1425718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:04.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204c45703b51053ebed50 2015-10-05T06:04:04.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:04.875+0100 [conn1425256] end connection 172.28.0.164:58081 (399 connections now open) 2015-10-05T06:04:04.877+0100 [mongosMain] connection accepted from 172.28.0.164:59292 #1425719 (400 connections now open) 2015-10-05T06:04:04.878+0100 [conn1425719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:10.428+0100 [conn1425327] end connection 172.28.0.164:58246 (399 connections now open) 2015-10-05T06:04:10.429+0100 [mongosMain] connection accepted from 172.28.0.164:59296 #1425720 (400 connections now open) 2015-10-05T06:04:10.431+0100 [conn1425720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:10.634+0100 [conn1425328] end connection 172.28.0.163:65189 (399 connections now open) 2015-10-05T06:04:10.636+0100 [mongosMain] connection accepted from 172.28.0.163:49922 #1425721 (400 connections now open) 2015-10-05T06:04:10.637+0100 [conn1425721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:10.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204ca5703b51053ebede1 2015-10-05T06:04:11.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:11.421+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:11.421+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:13.436+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:14.489+0100 [conn1425312] end connection 172.28.0.163:65150 (399 connections now open) 2015-10-05T06:04:14.490+0100 [mongosMain] connection accepted from 172.28.0.163:49928 #1425722 (400 connections now open) 2015-10-05T06:04:14.491+0100 [conn1425722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:14.875+0100 [conn1425313] end connection 172.28.0.164:58203 (399 connections now open) 2015-10-05T06:04:14.875+0100 [mongosMain] connection accepted from 172.28.0.164:59300 #1425723 (400 connections now open) 2015-10-05T06:04:14.877+0100 [conn1425723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:17.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204d15703b51053ebee78 2015-10-05T06:04:17.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:19.898+0100 [conn1425326] end connection 172.28.0.164:58244 (399 connections now open) 2015-10-05T06:04:19.899+0100 [mongosMain] connection accepted from 172.28.0.164:59306 #1425724 (400 connections now open) 2015-10-05T06:04:19.901+0100 [conn1425724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:20.444+0100 [conn1425335] end connection 172.28.0.164:58261 (399 connections now open) 2015-10-05T06:04:20.445+0100 [mongosMain] connection accepted from 172.28.0.164:59309 #1425725 (400 connections now open) 2015-10-05T06:04:20.447+0100 [conn1425725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:20.649+0100 [conn1425336] end connection 172.28.0.163:65212 (399 connections now open) 2015-10-05T06:04:20.650+0100 [mongosMain] connection accepted from 172.28.0.163:49937 #1425726 (400 connections now open) 2015-10-05T06:04:20.652+0100 [conn1425726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:21.424+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:21.424+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:23.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204d75703b51053ebef27 2015-10-05T06:04:23.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:24.442+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:24.493+0100 [conn1425282] end connection 172.28.0.163:65082 (399 connections now open) 2015-10-05T06:04:24.493+0100 [conn1425304] end connection 172.28.0.163:65141 (399 connections now open) 2015-10-05T06:04:24.494+0100 [mongosMain] connection accepted from 172.28.0.163:49942 #1425727 (399 connections now open) 2015-10-05T06:04:24.495+0100 [mongosMain] connection accepted from 172.28.0.163:49943 #1425728 (400 connections now open) 2015-10-05T06:04:24.496+0100 [conn1425727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:24.496+0100 [conn1425728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:24.925+0100 [conn1425331] end connection 172.28.0.164:58256 (399 connections now open) 2015-10-05T06:04:24.927+0100 [mongosMain] connection accepted from 172.28.0.164:59317 #1425729 (400 connections now open) 2015-10-05T06:04:24.929+0100 [conn1425729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:25.301+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:04:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:04:28.892+0100 [mongosMain] connection accepted from 127.0.0.1:49945 #1425730 (401 connections now open) 2015-10-05T06:04:28.901+0100 [conn1425730] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:28.906+0100 [conn1425730] end connection 127.0.0.1:49945 (400 connections now open) 2015-10-05T06:04:29.914+0100 [conn1425233] end connection 172.28.0.164:58035 (399 connections now open) 2015-10-05T06:04:29.916+0100 [mongosMain] connection accepted from 172.28.0.164:59326 #1425731 (400 connections now open) 2015-10-05T06:04:29.918+0100 [conn1425731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:30.460+0100 [conn1425342] end connection 172.28.0.164:58274 (399 connections now open) 2015-10-05T06:04:30.461+0100 [mongosMain] connection accepted from 172.28.0.164:59328 #1425732 (400 connections now open) 2015-10-05T06:04:30.463+0100 [conn1425732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:30.651+0100 [conn1425343] end connection 172.28.0.163:65228 (399 connections now open) 2015-10-05T06:04:30.653+0100 [mongosMain] connection accepted from 172.28.0.163:49948 #1425733 (400 connections now open) 2015-10-05T06:04:30.654+0100 [conn1425733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:32.434+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:32.435+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:34.504+0100 [conn1425324] end connection 172.28.0.163:65180 (399 connections now open) 2015-10-05T06:04:34.504+0100 [conn1425330] end connection 172.28.0.163:65200 (399 connections now open) 2015-10-05T06:04:34.505+0100 [mongosMain] connection accepted from 172.28.0.163:49952 #1425734 (399 connections now open) 2015-10-05T06:04:34.505+0100 [mongosMain] connection accepted from 172.28.0.163:49953 #1425735 (400 connections now open) 2015-10-05T06:04:34.506+0100 [conn1425734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:34.506+0100 [conn1425735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:34.891+0100 [conn1425319] end connection 172.28.0.164:58224 (399 connections now open) 2015-10-05T06:04:34.892+0100 [mongosMain] connection accepted from 172.28.0.164:59337 #1425736 (400 connections now open) 2015-10-05T06:04:34.893+0100 [conn1425736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:35.452+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:39.741+0100 [mongosMain] connection accepted from 127.0.0.1:49956 #1425737 (401 connections now open) 2015-10-05T06:04:39.744+0100 [conn1425737] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:39.748+0100 [conn1425737] end connection 127.0.0.1:49956 (400 connections now open) 2015-10-05T06:04:39.928+0100 [conn1425333] end connection 172.28.0.164:58259 (399 connections now open) 2015-10-05T06:04:39.929+0100 [mongosMain] connection accepted from 172.28.0.164:59344 #1425738 (400 connections now open) 2015-10-05T06:04:39.930+0100 [conn1425738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:40.088+0100 [conn1425301] end connection 172.28.0.163:65134 (399 connections now open) 2015-10-05T06:04:40.090+0100 [mongosMain] connection accepted from 172.28.0.163:49957 #1425739 (400 connections now open) 2015-10-05T06:04:40.091+0100 [conn1425739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:40.459+0100 [conn1425350] end connection 172.28.0.164:58293 (399 connections now open) 2015-10-05T06:04:40.461+0100 [mongosMain] connection accepted from 172.28.0.164:59353 #1425740 (400 connections now open) 2015-10-05T06:04:40.462+0100 [conn1425740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:40.665+0100 [conn1425351] end connection 172.28.0.163:65237 (399 connections now open) 2015-10-05T06:04:40.666+0100 [mongosMain] connection accepted from 172.28.0.163:49961 #1425741 (400 connections now open) 2015-10-05T06:04:40.667+0100 [conn1425741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:41.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204e95703b51053ebf09b 2015-10-05T06:04:41.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:44.447+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:44.447+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:44.504+0100 [conn1425344] end connection 172.28.0.163:65231 (399 connections now open) 2015-10-05T06:04:44.505+0100 [mongosMain] connection accepted from 172.28.0.163:49967 #1425742 (400 connections now open) 2015-10-05T06:04:44.506+0100 [conn1425742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:44.506+0100 [conn1425337] end connection 172.28.0.163:65219 (399 connections now open) 2015-10-05T06:04:44.507+0100 [mongosMain] connection accepted from 172.28.0.163:49970 #1425743 (400 connections now open) 2015-10-05T06:04:44.508+0100 [conn1425743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:44.907+0100 [conn1425340] end connection 172.28.0.164:58265 (399 connections now open) 2015-10-05T06:04:44.908+0100 [mongosMain] connection accepted from 172.28.0.164:59361 #1425744 (400 connections now open) 2015-10-05T06:04:44.910+0100 [conn1425744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:46.452+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:46.456+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:46.456+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:49.461+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:49.462+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:49.945+0100 [conn1425271] end connection 172.28.0.164:58122 (399 connections now open) 2015-10-05T06:04:49.946+0100 [mongosMain] connection accepted from 172.28.0.164:59370 #1425745 (400 connections now open) 2015-10-05T06:04:49.948+0100 [conn1425745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:50.104+0100 [conn1425334] end connection 172.28.0.163:65209 (399 connections now open) 2015-10-05T06:04:50.106+0100 [mongosMain] connection accepted from 172.28.0.163:49981 #1425746 (400 connections now open) 2015-10-05T06:04:50.107+0100 [conn1425746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:50.475+0100 [conn1425356] end connection 172.28.0.164:58312 (399 connections now open) 2015-10-05T06:04:50.477+0100 [mongosMain] connection accepted from 172.28.0.164:59373 #1425747 (400 connections now open) 2015-10-05T06:04:50.479+0100 [conn1425747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:50.666+0100 [conn1425358] end connection 172.28.0.163:65250 (399 connections now open) 2015-10-05T06:04:50.666+0100 [mongosMain] connection accepted from 172.28.0.163:49983 #1425748 (400 connections now open) 2015-10-05T06:04:50.667+0100 [conn1425748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:53.466+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:53.466+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:54.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561204f55703b51053ebf1b1 2015-10-05T06:04:54.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:04:54.520+0100 [conn1425345] end connection 172.28.0.163:65232 (399 connections now open) 2015-10-05T06:04:54.520+0100 [conn1425338] end connection 172.28.0.163:65220 (398 connections now open) 2015-10-05T06:04:54.521+0100 [mongosMain] connection accepted from 172.28.0.163:49991 #1425749 (399 connections now open) 2015-10-05T06:04:54.521+0100 [mongosMain] connection accepted from 172.28.0.163:49992 #1425750 (400 connections now open) 2015-10-05T06:04:54.522+0100 [conn1425749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:54.522+0100 [conn1425750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:54.907+0100 [conn1425347] end connection 172.28.0.164:58283 (399 connections now open) 2015-10-05T06:04:54.908+0100 [conn1425305] end connection 172.28.0.164:58186 (399 connections now open) 2015-10-05T06:04:54.910+0100 [mongosMain] connection accepted from 172.28.0.164:59383 #1425751 (399 connections now open) 2015-10-05T06:04:54.910+0100 [mongosMain] connection accepted from 172.28.0.164:59382 #1425752 (400 connections now open) 2015-10-05T06:04:54.912+0100 [conn1425751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:54.912+0100 [conn1425752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:04:55.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:04:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:04:57.495+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:58.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:04:58.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:04:59.961+0100 [conn1425315] end connection 172.28.0.164:58214 (399 connections now open) 2015-10-05T06:04:59.963+0100 [mongosMain] connection accepted from 172.28.0.164:59386 #1425753 (400 connections now open) 2015-10-05T06:04:59.965+0100 [conn1425753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:00.104+0100 [conn1425309] end connection 172.28.0.163:65145 (399 connections now open) 2015-10-05T06:05:00.106+0100 [mongosMain] connection accepted from 172.28.0.163:50003 #1425754 (400 connections now open) 2015-10-05T06:05:00.107+0100 [conn1425754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:00.491+0100 [conn1425365] end connection 172.28.0.164:58336 (399 connections now open) 2015-10-05T06:05:00.492+0100 [mongosMain] connection accepted from 172.28.0.164:59391 #1425755 (400 connections now open) 2015-10-05T06:05:00.494+0100 [conn1425755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:04.479+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:04.479+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:04.525+0100 [conn1425360] end connection 172.28.0.163:65258 (399 connections now open) 2015-10-05T06:05:04.526+0100 [conn1425177] end connection 172.28.0.163:64831 (398 connections now open) 2015-10-05T06:05:04.528+0100 [mongosMain] connection accepted from 172.28.0.163:50011 #1425756 (399 connections now open) 2015-10-05T06:05:04.529+0100 [mongosMain] connection accepted from 172.28.0.163:50014 #1425757 (400 connections now open) 2015-10-05T06:05:04.529+0100 [conn1425756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:04.529+0100 [conn1425757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:04.923+0100 [conn1425353] end connection 172.28.0.164:58300 (399 connections now open) 2015-10-05T06:05:04.923+0100 [conn1425339] end connection 172.28.0.164:58264 (399 connections now open) 2015-10-05T06:05:04.924+0100 [mongosMain] connection accepted from 172.28.0.164:59397 #1425758 (399 connections now open) 2015-10-05T06:05:04.924+0100 [mongosMain] connection accepted from 172.28.0.164:59398 #1425759 (400 connections now open) 2015-10-05T06:05:04.925+0100 [conn1425758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:04.926+0100 [conn1425759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:06.372+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:05:06.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:05:08.500+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:09.976+0100 [conn1425321] end connection 172.28.0.164:58232 (399 connections now open) 2015-10-05T06:05:09.978+0100 [mongosMain] connection accepted from 172.28.0.164:59403 #1425760 (400 connections now open) 2015-10-05T06:05:09.979+0100 [conn1425760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:10.120+0100 [conn1425286] end connection 172.28.0.163:65095 (399 connections now open) 2015-10-05T06:05:10.120+0100 [mongosMain] connection accepted from 172.28.0.163:50022 #1425761 (400 connections now open) 2015-10-05T06:05:10.122+0100 [conn1425761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:10.506+0100 [conn1425372] end connection 172.28.0.164:58349 (399 connections now open) 2015-10-05T06:05:10.507+0100 [mongosMain] connection accepted from 172.28.0.164:59406 #1425762 (400 connections now open) 2015-10-05T06:05:10.508+0100 [conn1425762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:10.682+0100 [conn1425373] end connection 172.28.0.163:65287 (399 connections now open) 2015-10-05T06:05:10.684+0100 [mongosMain] connection accepted from 172.28.0.163:50025 #1425763 (400 connections now open) 2015-10-05T06:05:10.685+0100 [conn1425763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:11.487+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:11.487+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:12.535+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:05:12.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:05:14.535+0100 [conn1425367] end connection 172.28.0.163:65274 (399 connections now open) 2015-10-05T06:05:14.535+0100 [conn1425290] end connection 172.28.0.163:65110 (399 connections now open) 2015-10-05T06:05:14.536+0100 [mongosMain] connection accepted from 172.28.0.163:50031 #1425764 (399 connections now open) 2015-10-05T06:05:14.536+0100 [mongosMain] connection accepted from 172.28.0.163:50033 #1425765 (400 connections now open) 2015-10-05T06:05:14.537+0100 [conn1425764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:14.537+0100 [conn1425765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:14.923+0100 [conn1425325] end connection 172.28.0.164:58241 (399 connections now open) 2015-10-05T06:05:14.923+0100 [conn1425368] end connection 172.28.0.164:58343 (398 connections now open) 2015-10-05T06:05:14.924+0100 [mongosMain] connection accepted from 172.28.0.164:59409 #1425766 (399 connections now open) 2015-10-05T06:05:14.925+0100 [mongosMain] connection accepted from 172.28.0.164:59410 #1425767 (400 connections now open) 2015-10-05T06:05:14.926+0100 [conn1425766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:14.927+0100 [conn1425767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:19.501+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:19.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:19.510+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:19.977+0100 [conn1425341] end connection 172.28.0.164:58271 (399 connections now open) 2015-10-05T06:05:19.979+0100 [mongosMain] connection accepted from 172.28.0.164:59420 #1425768 (400 connections now open) 2015-10-05T06:05:19.981+0100 [conn1425768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:20.120+0100 [conn1425279] end connection 172.28.0.163:65075 (399 connections now open) 2015-10-05T06:05:20.122+0100 [mongosMain] connection accepted from 172.28.0.163:50041 #1425769 (400 connections now open) 2015-10-05T06:05:20.123+0100 [conn1425769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:20.523+0100 [conn1425380] end connection 172.28.0.164:58360 (399 connections now open) 2015-10-05T06:05:20.524+0100 [mongosMain] connection accepted from 172.28.0.164:59423 #1425770 (400 connections now open) 2015-10-05T06:05:20.526+0100 [conn1425770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:20.698+0100 [conn1425366] end connection 172.28.0.163:65270 (399 connections now open) 2015-10-05T06:05:20.699+0100 [mongosMain] connection accepted from 172.28.0.163:50044 #1425771 (400 connections now open) 2015-10-05T06:05:20.700+0100 [conn1425771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:24.551+0100 [conn1425375] end connection 172.28.0.163:65298 (399 connections now open) 2015-10-05T06:05:24.551+0100 [conn1425180] end connection 172.28.0.163:64843 (399 connections now open) 2015-10-05T06:05:24.552+0100 [mongosMain] connection accepted from 172.28.0.163:50047 #1425772 (399 connections now open) 2015-10-05T06:05:24.553+0100 [mongosMain] connection accepted from 172.28.0.163:50048 #1425773 (400 connections now open) 2015-10-05T06:05:24.553+0100 [conn1425772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:24.554+0100 [conn1425773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:24.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205145703b51053ebf453 2015-10-05T06:05:24.938+0100 [conn1425376] end connection 172.28.0.164:58355 (399 connections now open) 2015-10-05T06:05:24.938+0100 [conn1425299] end connection 172.28.0.164:58170 (399 connections now open) 2015-10-05T06:05:24.939+0100 [mongosMain] connection accepted from 172.28.0.164:59431 #1425774 (399 connections now open) 2015-10-05T06:05:24.939+0100 [mongosMain] connection accepted from 172.28.0.164:59432 #1425775 (400 connections now open) 2015-10-05T06:05:24.941+0100 [conn1425774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:24.942+0100 [conn1425775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:24.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:05:25.699+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:05:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:05:28.553+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:28.554+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:28.853+0100 [mongosMain] connection accepted from 127.0.0.1:50053 #1425776 (401 connections now open) 2015-10-05T06:05:28.856+0100 [conn1425776] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:28.862+0100 [conn1425776] end connection 127.0.0.1:50053 (400 connections now open) 2015-10-05T06:05:29.993+0100 [conn1425363] end connection 172.28.0.164:58333 (399 connections now open) 2015-10-05T06:05:29.993+0100 [mongosMain] connection accepted from 172.28.0.164:59441 #1425777 (400 connections now open) 2015-10-05T06:05:29.995+0100 [conn1425777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:30.135+0100 [conn1425371] end connection 172.28.0.163:65283 (399 connections now open) 2015-10-05T06:05:30.136+0100 [mongosMain] connection accepted from 172.28.0.163:50057 #1425778 (400 connections now open) 2015-10-05T06:05:30.138+0100 [conn1425778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:30.515+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:30.539+0100 [conn1425387] end connection 172.28.0.164:58374 (399 connections now open) 2015-10-05T06:05:30.540+0100 [mongosMain] connection accepted from 172.28.0.164:59444 #1425779 (400 connections now open) 2015-10-05T06:05:30.541+0100 [conn1425779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:30.697+0100 [conn1425381] end connection 172.28.0.163:65310 (399 connections now open) 2015-10-05T06:05:30.698+0100 [mongosMain] connection accepted from 172.28.0.163:50060 #1425780 (400 connections now open) 2015-10-05T06:05:30.700+0100 [conn1425780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:34.552+0100 [conn1425382] end connection 172.28.0.163:65313 (399 connections now open) 2015-10-05T06:05:34.552+0100 [conn1425329] end connection 172.28.0.163:65199 (399 connections now open) 2015-10-05T06:05:34.553+0100 [mongosMain] connection accepted from 172.28.0.163:50063 #1425781 (399 connections now open) 2015-10-05T06:05:34.553+0100 [mongosMain] connection accepted from 172.28.0.163:50062 #1425782 (400 connections now open) 2015-10-05T06:05:34.554+0100 [conn1425781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:34.554+0100 [conn1425782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:34.954+0100 [conn1425346] end connection 172.28.0.164:58282 (399 connections now open) 2015-10-05T06:05:34.955+0100 [conn1425385] end connection 172.28.0.164:58364 (398 connections now open) 2015-10-05T06:05:34.955+0100 [mongosMain] connection accepted from 172.28.0.164:59452 #1425783 (399 connections now open) 2015-10-05T06:05:34.956+0100 [mongosMain] connection accepted from 172.28.0.164:59453 #1425784 (400 connections now open) 2015-10-05T06:05:34.957+0100 [conn1425783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:34.958+0100 [conn1425784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:38.556+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:38.556+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:39.993+0100 [conn1425370] end connection 172.28.0.164:58347 (399 connections now open) 2015-10-05T06:05:39.994+0100 [mongosMain] connection accepted from 172.28.0.164:59463 #1425785 (400 connections now open) 2015-10-05T06:05:39.996+0100 [conn1425785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:40.070+0100 [mongosMain] connection accepted from 127.0.0.1:50068 #1425786 (401 connections now open) 2015-10-05T06:05:40.074+0100 [conn1425786] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:40.079+0100 [conn1425786] end connection 127.0.0.1:50068 (400 connections now open) 2015-10-05T06:05:40.136+0100 [conn1425379] end connection 172.28.0.163:65308 (399 connections now open) 2015-10-05T06:05:40.138+0100 [mongosMain] connection accepted from 172.28.0.163:50069 #1425787 (400 connections now open) 2015-10-05T06:05:40.139+0100 [conn1425787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:40.538+0100 [conn1425396] end connection 172.28.0.164:58392 (399 connections now open) 2015-10-05T06:05:40.539+0100 [mongosMain] connection accepted from 172.28.0.164:59465 #1425788 (400 connections now open) 2015-10-05T06:05:40.541+0100 [conn1425788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:40.713+0100 [conn1425388] end connection 172.28.0.163:65323 (399 connections now open) 2015-10-05T06:05:40.714+0100 [mongosMain] connection accepted from 172.28.0.163:50073 #1425789 (400 connections now open) 2015-10-05T06:05:40.715+0100 [conn1425789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:41.527+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:43.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205265703b51053ebf582 2015-10-05T06:05:43.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:05:44.575+0100 [conn1425390] end connection 172.28.0.163:65328 (399 connections now open) 2015-10-05T06:05:44.575+0100 [conn1425374] end connection 172.28.0.163:65297 (399 connections now open) 2015-10-05T06:05:44.576+0100 [mongosMain] connection accepted from 172.28.0.163:50080 #1425790 (399 connections now open) 2015-10-05T06:05:44.576+0100 [mongosMain] connection accepted from 172.28.0.163:50081 #1425791 (400 connections now open) 2015-10-05T06:05:44.577+0100 [conn1425790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:44.577+0100 [conn1425791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:44.969+0100 [conn1425225] end connection 172.28.0.164:58010 (399 connections now open) 2015-10-05T06:05:44.971+0100 [mongosMain] connection accepted from 172.28.0.164:59474 #1425792 (400 connections now open) 2015-10-05T06:05:44.972+0100 [conn1425792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:49.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612052d5703b51053ebf5ff 2015-10-05T06:05:49.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:05:49.617+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:49.617+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:05:50.008+0100 [conn1425354] end connection 172.28.0.164:58310 (399 connections now open) 2015-10-05T06:05:50.009+0100 [mongosMain] connection accepted from 172.28.0.164:59482 #1425793 (400 connections now open) 2015-10-05T06:05:50.010+0100 [conn1425793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:50.151+0100 [conn1425355] end connection 172.28.0.163:65246 (399 connections now open) 2015-10-05T06:05:50.152+0100 [mongosMain] connection accepted from 172.28.0.163:50090 #1425794 (400 connections now open) 2015-10-05T06:05:50.153+0100 [conn1425794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:50.554+0100 [conn1425405] end connection 172.28.0.164:58414 (399 connections now open) 2015-10-05T06:05:50.555+0100 [mongosMain] connection accepted from 172.28.0.164:59484 #1425795 (400 connections now open) 2015-10-05T06:05:50.557+0100 [conn1425795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:50.735+0100 [conn1425397] end connection 172.28.0.163:65334 (399 connections now open) 2015-10-05T06:05:50.736+0100 [mongosMain] connection accepted from 172.28.0.163:50092 #1425796 (400 connections now open) 2015-10-05T06:05:50.738+0100 [conn1425796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:52.538+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:05:54.567+0100 [conn1425267] end connection 172.28.0.163:65051 (399 connections now open) 2015-10-05T06:05:54.567+0100 [conn1425398] end connection 172.28.0.163:65338 (399 connections now open) 2015-10-05T06:05:54.568+0100 [mongosMain] connection accepted from 172.28.0.163:50098 #1425797 (399 connections now open) 2015-10-05T06:05:54.569+0100 [mongosMain] connection accepted from 172.28.0.163:50099 #1425798 (400 connections now open) 2015-10-05T06:05:54.570+0100 [conn1425797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:54.570+0100 [conn1425798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:54.986+0100 [conn1425369] end connection 172.28.0.164:58344 (399 connections now open) 2015-10-05T06:05:54.986+0100 [conn1425391] end connection 172.28.0.164:58382 (399 connections now open) 2015-10-05T06:05:54.987+0100 [mongosMain] connection accepted from 172.28.0.164:59493 #1425799 (399 connections now open) 2015-10-05T06:05:54.987+0100 [mongosMain] connection accepted from 172.28.0.164:59492 #1425800 (400 connections now open) 2015-10-05T06:05:54.989+0100 [conn1425799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:54.989+0100 [conn1425800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:05:56.052+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:05:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:06:00.024+0100 [conn1425378] end connection 172.28.0.164:58358 (399 connections now open) 2015-10-05T06:06:00.025+0100 [mongosMain] connection accepted from 172.28.0.164:59497 #1425801 (400 connections now open) 2015-10-05T06:06:00.027+0100 [conn1425801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:00.167+0100 [conn1425364] end connection 172.28.0.163:65267 (399 connections now open) 2015-10-05T06:06:00.168+0100 [mongosMain] connection accepted from 172.28.0.163:50107 #1425802 (400 connections now open) 2015-10-05T06:06:00.169+0100 [conn1425802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:00.570+0100 [conn1425413] end connection 172.28.0.164:58431 (399 connections now open) 2015-10-05T06:06:00.571+0100 [mongosMain] connection accepted from 172.28.0.164:59499 #1425803 (400 connections now open) 2015-10-05T06:06:00.572+0100 [conn1425803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:00.730+0100 [conn1425406] end connection 172.28.0.163:65346 (399 connections now open) 2015-10-05T06:06:00.731+0100 [mongosMain] connection accepted from 172.28.0.163:50111 #1425804 (400 connections now open) 2015-10-05T06:06:00.732+0100 [conn1425804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:01.617+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:01.617+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:03.552+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:03.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:03.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:04.583+0100 [conn1425277] end connection 172.28.0.163:65066 (399 connections now open) 2015-10-05T06:06:04.583+0100 [conn1425408] end connection 172.28.0.163:65353 (399 connections now open) 2015-10-05T06:06:04.584+0100 [mongosMain] connection accepted from 172.28.0.163:50119 #1425805 (399 connections now open) 2015-10-05T06:06:04.584+0100 [mongosMain] connection accepted from 172.28.0.163:50120 #1425806 (400 connections now open) 2015-10-05T06:06:04.585+0100 [conn1425805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:04.585+0100 [conn1425806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:05.001+0100 [conn1425320] end connection 172.28.0.164:58225 (399 connections now open) 2015-10-05T06:06:05.001+0100 [conn1425410] end connection 172.28.0.164:58422 (399 connections now open) 2015-10-05T06:06:05.002+0100 [mongosMain] connection accepted from 172.28.0.164:59504 #1425807 (399 connections now open) 2015-10-05T06:06:05.002+0100 [mongosMain] connection accepted from 172.28.0.164:59505 #1425808 (400 connections now open) 2015-10-05T06:06:05.004+0100 [conn1425807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:05.004+0100 [conn1425808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:06.618+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:06.618+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:07.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612053f5703b51053ebf708 2015-10-05T06:06:07.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:10.025+0100 [conn1425349] end connection 172.28.0.164:58291 (399 connections now open) 2015-10-05T06:06:10.027+0100 [mongosMain] connection accepted from 172.28.0.164:59510 #1425809 (400 connections now open) 2015-10-05T06:06:10.029+0100 [conn1425809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:10.167+0100 [conn1425386] end connection 172.28.0.163:65321 (399 connections now open) 2015-10-05T06:06:10.168+0100 [mongosMain] connection accepted from 172.28.0.163:50131 #1425810 (400 connections now open) 2015-10-05T06:06:10.170+0100 [conn1425810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:10.570+0100 [conn1425421] end connection 172.28.0.164:58445 (399 connections now open) 2015-10-05T06:06:10.571+0100 [mongosMain] connection accepted from 172.28.0.164:59512 #1425811 (400 connections now open) 2015-10-05T06:06:10.573+0100 [conn1425811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:10.701+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:10.702+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:10.744+0100 [conn1425414] end connection 172.28.0.163:65365 (399 connections now open) 2015-10-05T06:06:10.746+0100 [mongosMain] connection accepted from 172.28.0.163:50133 #1425812 (400 connections now open) 2015-10-05T06:06:10.747+0100 [conn1425812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:14.559+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:14.583+0100 [conn1425359] end connection 172.28.0.163:65257 (399 connections now open) 2015-10-05T06:06:14.583+0100 [conn1425424] end connection 172.28.0.163:65397 (399 connections now open) 2015-10-05T06:06:14.584+0100 [mongosMain] connection accepted from 172.28.0.163:50138 #1425813 (399 connections now open) 2015-10-05T06:06:14.584+0100 [mongosMain] connection accepted from 172.28.0.163:50139 #1425814 (400 connections now open) 2015-10-05T06:06:14.585+0100 [conn1425813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:14.585+0100 [conn1425814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:15.019+0100 [conn1425361] end connection 172.28.0.164:58320 (399 connections now open) 2015-10-05T06:06:15.019+0100 [conn1425186] end connection 172.28.0.164:57922 (398 connections now open) 2015-10-05T06:06:15.020+0100 [mongosMain] connection accepted from 172.28.0.164:59517 #1425815 (399 connections now open) 2015-10-05T06:06:15.020+0100 [mongosMain] connection accepted from 172.28.0.164:59518 #1425816 (400 connections now open) 2015-10-05T06:06:15.022+0100 [conn1425816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:15.022+0100 [conn1425815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:15.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:15.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:20.039+0100 [conn1425411] end connection 172.28.0.164:58429 (399 connections now open) 2015-10-05T06:06:20.042+0100 [mongosMain] connection accepted from 172.28.0.164:59526 #1425817 (400 connections now open) 2015-10-05T06:06:20.043+0100 [conn1425817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:20.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612054b5703b51053ebf78b 2015-10-05T06:06:20.183+0100 [conn1425395] end connection 172.28.0.163:65332 (399 connections now open) 2015-10-05T06:06:20.184+0100 [mongosMain] connection accepted from 172.28.0.163:50147 #1425818 (400 connections now open) 2015-10-05T06:06:20.186+0100 [conn1425818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:20.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:20.586+0100 [conn1425429] end connection 172.28.0.164:58459 (399 connections now open) 2015-10-05T06:06:20.588+0100 [mongosMain] connection accepted from 172.28.0.164:59528 #1425819 (400 connections now open) 2015-10-05T06:06:20.590+0100 [conn1425819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:20.745+0100 [conn1425422] end connection 172.28.0.163:65385 (399 connections now open) 2015-10-05T06:06:20.747+0100 [mongosMain] connection accepted from 172.28.0.163:50150 #1425820 (400 connections now open) 2015-10-05T06:06:20.748+0100 [conn1425820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:21.712+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:21.712+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:24.599+0100 [conn1425415] end connection 172.28.0.163:65369 (399 connections now open) 2015-10-05T06:06:24.599+0100 [conn1425383] end connection 172.28.0.163:65314 (399 connections now open) 2015-10-05T06:06:24.600+0100 [mongosMain] connection accepted from 172.28.0.163:50155 #1425821 (399 connections now open) 2015-10-05T06:06:24.601+0100 [mongosMain] connection accepted from 172.28.0.163:50156 #1425822 (400 connections now open) 2015-10-05T06:06:24.602+0100 [conn1425821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:24.602+0100 [conn1425822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:25.017+0100 [conn1425418] end connection 172.28.0.164:58440 (399 connections now open) 2015-10-05T06:06:25.017+0100 [conn1425400] end connection 172.28.0.164:58402 (399 connections now open) 2015-10-05T06:06:25.018+0100 [mongosMain] connection accepted from 172.28.0.164:59541 #1425823 (399 connections now open) 2015-10-05T06:06:25.019+0100 [mongosMain] connection accepted from 172.28.0.164:59542 #1425824 (400 connections now open) 2015-10-05T06:06:25.020+0100 [conn1425823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:25.020+0100 [conn1425824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:25.570+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:26.328+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:06:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:06:26.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205525703b51053ebf7e0 2015-10-05T06:06:26.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:28.376+0100 [mongosMain] connection accepted from 127.0.0.1:50159 #1425825 (401 connections now open) 2015-10-05T06:06:28.379+0100 [conn1425825] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:28.384+0100 [conn1425825] end connection 127.0.0.1:50159 (400 connections now open) 2015-10-05T06:06:28.717+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:28.717+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:30.040+0100 [conn1425419] end connection 172.28.0.164:58443 (399 connections now open) 2015-10-05T06:06:30.041+0100 [mongosMain] connection accepted from 172.28.0.164:59550 #1425826 (400 connections now open) 2015-10-05T06:06:30.042+0100 [conn1425826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:30.183+0100 [conn1425403] end connection 172.28.0.163:65344 (399 connections now open) 2015-10-05T06:06:30.185+0100 [mongosMain] connection accepted from 172.28.0.163:50161 #1425827 (400 connections now open) 2015-10-05T06:06:30.186+0100 [conn1425827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:30.587+0100 [conn1425436] end connection 172.28.0.164:58472 (399 connections now open) 2015-10-05T06:06:30.588+0100 [mongosMain] connection accepted from 172.28.0.164:59552 #1425828 (400 connections now open) 2015-10-05T06:06:30.589+0100 [conn1425828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:30.760+0100 [conn1425430] end connection 172.28.0.163:65409 (399 connections now open) 2015-10-05T06:06:30.761+0100 [mongosMain] connection accepted from 172.28.0.163:50163 #1425829 (400 connections now open) 2015-10-05T06:06:30.762+0100 [conn1425829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:32.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205585703b51053ebf82e 2015-10-05T06:06:32.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:34.602+0100 [conn1425432] end connection 172.28.0.163:65415 (399 connections now open) 2015-10-05T06:06:34.604+0100 [mongosMain] connection accepted from 172.28.0.163:50165 #1425830 (400 connections now open) 2015-10-05T06:06:34.605+0100 [conn1425830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:35.033+0100 [conn1425392] end connection 172.28.0.164:58383 (399 connections now open) 2015-10-05T06:06:35.033+0100 [conn1425426] end connection 172.28.0.164:58453 (399 connections now open) 2015-10-05T06:06:35.034+0100 [mongosMain] connection accepted from 172.28.0.164:59560 #1425831 (399 connections now open) 2015-10-05T06:06:35.034+0100 [mongosMain] connection accepted from 172.28.0.164:59561 #1425832 (400 connections now open) 2015-10-05T06:06:35.036+0100 [conn1425831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:35.036+0100 [conn1425832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:36.576+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:36.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:36.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:39.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612055e5703b51053ebf872 2015-10-05T06:06:39.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:39.637+0100 [mongosMain] connection accepted from 127.0.0.1:50171 #1425833 (401 connections now open) 2015-10-05T06:06:39.640+0100 [conn1425833] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:39.644+0100 [conn1425833] end connection 127.0.0.1:50171 (400 connections now open) 2015-10-05T06:06:40.055+0100 [conn1425394] end connection 172.28.0.164:58390 (399 connections now open) 2015-10-05T06:06:40.056+0100 [mongosMain] connection accepted from 172.28.0.164:59571 #1425834 (400 connections now open) 2015-10-05T06:06:40.057+0100 [conn1425834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:40.602+0100 [conn1425444] end connection 172.28.0.164:58493 (399 connections now open) 2015-10-05T06:06:40.603+0100 [mongosMain] connection accepted from 172.28.0.164:59574 #1425835 (400 connections now open) 2015-10-05T06:06:40.605+0100 [conn1425835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:40.766+0100 [conn1425437] end connection 172.28.0.163:65434 (399 connections now open) 2015-10-05T06:06:40.767+0100 [mongosMain] connection accepted from 172.28.0.163:50173 #1425836 (400 connections now open) 2015-10-05T06:06:40.768+0100 [conn1425836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:45.033+0100 [conn1425409] end connection 172.28.0.164:58421 (399 connections now open) 2015-10-05T06:06:45.034+0100 [conn1425401] end connection 172.28.0.164:58401 (398 connections now open) 2015-10-05T06:06:45.035+0100 [mongosMain] connection accepted from 172.28.0.164:59584 #1425837 (399 connections now open) 2015-10-05T06:06:45.035+0100 [mongosMain] connection accepted from 172.28.0.164:59585 #1425838 (400 connections now open) 2015-10-05T06:06:45.036+0100 [conn1425837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:45.037+0100 [conn1425838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:45.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205655703b51053ebf8cb 2015-10-05T06:06:45.722+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:45.722+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:45.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:47.593+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:50.055+0100 [conn1425250] end connection 172.28.0.164:58074 (399 connections now open) 2015-10-05T06:06:50.057+0100 [mongosMain] connection accepted from 172.28.0.164:59593 #1425839 (400 connections now open) 2015-10-05T06:06:50.059+0100 [conn1425839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:50.602+0100 [conn1425451] end connection 172.28.0.164:58513 (399 connections now open) 2015-10-05T06:06:50.603+0100 [mongosMain] connection accepted from 172.28.0.164:59595 #1425840 (400 connections now open) 2015-10-05T06:06:50.605+0100 [conn1425840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:50.776+0100 [conn1425445] end connection 172.28.0.163:65445 (399 connections now open) 2015-10-05T06:06:50.777+0100 [mongosMain] connection accepted from 172.28.0.163:50189 #1425841 (400 connections now open) 2015-10-05T06:06:50.778+0100 [conn1425841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:52.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612056b5703b51053ebf92b 2015-10-05T06:06:52.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:06:54.630+0100 [conn1425453] end connection 172.28.0.163:65458 (399 connections now open) 2015-10-05T06:06:54.631+0100 [mongosMain] connection accepted from 172.28.0.163:50195 #1425842 (400 connections now open) 2015-10-05T06:06:54.632+0100 [conn1425842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:55.049+0100 [conn1425377] end connection 172.28.0.164:58356 (399 connections now open) 2015-10-05T06:06:55.050+0100 [conn1425440] end connection 172.28.0.164:58481 (398 connections now open) 2015-10-05T06:06:55.050+0100 [mongosMain] connection accepted from 172.28.0.164:59605 #1425843 (399 connections now open) 2015-10-05T06:06:55.051+0100 [mongosMain] connection accepted from 172.28.0.164:59607 #1425844 (400 connections now open) 2015-10-05T06:06:55.052+0100 [conn1425843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:55.053+0100 [conn1425844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:06:55.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:55.731+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:06:56.600+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:06:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:06:58.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205725703b51053ebf96c 2015-10-05T06:06:58.608+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:06:58.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:00.071+0100 [conn1425442] end connection 172.28.0.164:58491 (399 connections now open) 2015-10-05T06:07:00.074+0100 [mongosMain] connection accepted from 172.28.0.164:59611 #1425845 (400 connections now open) 2015-10-05T06:07:00.076+0100 [conn1425845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:00.617+0100 [conn1425455] end connection 172.28.0.164:58528 (399 connections now open) 2015-10-05T06:07:00.618+0100 [mongosMain] connection accepted from 172.28.0.164:59614 #1425846 (400 connections now open) 2015-10-05T06:07:00.620+0100 [conn1425846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:00.791+0100 [conn1425452] end connection 172.28.0.163:65453 (399 connections now open) 2015-10-05T06:07:00.792+0100 [mongosMain] connection accepted from 172.28.0.163:50206 #1425847 (400 connections now open) 2015-10-05T06:07:00.793+0100 [conn1425847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:04.631+0100 [conn1425438] end connection 172.28.0.163:65438 (399 connections now open) 2015-10-05T06:07:04.632+0100 [mongosMain] connection accepted from 172.28.0.163:50213 #1425848 (400 connections now open) 2015-10-05T06:07:04.634+0100 [conn1425848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:04.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205785703b51053ebf9b7 2015-10-05T06:07:04.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:05.064+0100 [conn1425332] end connection 172.28.0.164:58255 (399 connections now open) 2015-10-05T06:07:05.064+0100 [conn1425434] end connection 172.28.0.164:58464 (399 connections now open) 2015-10-05T06:07:05.064+0100 [mongosMain] connection accepted from 172.28.0.164:59620 #1425849 (399 connections now open) 2015-10-05T06:07:05.065+0100 [mongosMain] connection accepted from 172.28.0.164:59621 #1425850 (400 connections now open) 2015-10-05T06:07:05.065+0100 [conn1425849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:05.066+0100 [conn1425850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:06.756+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:06.756+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:09.626+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:10.087+0100 [conn1425427] end connection 172.28.0.164:58457 (399 connections now open) 2015-10-05T06:07:10.089+0100 [mongosMain] connection accepted from 172.28.0.164:59627 #1425851 (400 connections now open) 2015-10-05T06:07:10.091+0100 [conn1425851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:10.215+0100 [conn1425428] end connection 172.28.0.163:65406 (399 connections now open) 2015-10-05T06:07:10.216+0100 [mongosMain] connection accepted from 172.28.0.163:50223 #1425852 (400 connections now open) 2015-10-05T06:07:10.218+0100 [conn1425852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:10.632+0100 [conn1425459] end connection 172.28.0.164:58541 (399 connections now open) 2015-10-05T06:07:10.633+0100 [mongosMain] connection accepted from 172.28.0.164:59631 #1425853 (400 connections now open) 2015-10-05T06:07:10.637+0100 [conn1425853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:10.792+0100 [conn1425456] end connection 172.28.0.163:65470 (399 connections now open) 2015-10-05T06:07:10.793+0100 [mongosMain] connection accepted from 172.28.0.163:50226 #1425854 (400 connections now open) 2015-10-05T06:07:10.794+0100 [conn1425854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:11.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612057e5703b51053ebfa0f 2015-10-05T06:07:11.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:14.645+0100 [conn1425399] end connection 172.28.0.163:65339 (399 connections now open) 2015-10-05T06:07:14.645+0100 [conn1425457] end connection 172.28.0.163:65475 (399 connections now open) 2015-10-05T06:07:14.646+0100 [mongosMain] connection accepted from 172.28.0.163:50230 #1425855 (399 connections now open) 2015-10-05T06:07:14.647+0100 [mongosMain] connection accepted from 172.28.0.163:50231 #1425856 (400 connections now open) 2015-10-05T06:07:14.647+0100 [conn1425855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:14.648+0100 [conn1425856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:15.080+0100 [conn1425454] end connection 172.28.0.164:58520 (399 connections now open) 2015-10-05T06:07:15.081+0100 [conn1425384] end connection 172.28.0.164:58363 (398 connections now open) 2015-10-05T06:07:15.081+0100 [mongosMain] connection accepted from 172.28.0.164:59634 #1425857 (399 connections now open) 2015-10-05T06:07:15.082+0100 [mongosMain] connection accepted from 172.28.0.164:59635 #1425858 (400 connections now open) 2015-10-05T06:07:15.082+0100 [conn1425857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:15.083+0100 [conn1425858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:17.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205855703b51053ebfa4e 2015-10-05T06:07:17.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:18.763+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:18.763+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:20.230+0100 [conn1425464] end connection 172.28.0.163:65511 (399 connections now open) 2015-10-05T06:07:20.231+0100 [mongosMain] connection accepted from 172.28.0.163:50240 #1425859 (400 connections now open) 2015-10-05T06:07:20.232+0100 [conn1425859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:20.627+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:20.633+0100 [conn1425465] end connection 172.28.0.164:58554 (399 connections now open) 2015-10-05T06:07:20.633+0100 [mongosMain] connection accepted from 172.28.0.164:59643 #1425860 (400 connections now open) 2015-10-05T06:07:20.635+0100 [conn1425860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:20.765+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:20.765+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:20.807+0100 [conn1425460] end connection 172.28.0.163:65487 (399 connections now open) 2015-10-05T06:07:20.809+0100 [mongosMain] connection accepted from 172.28.0.163:50243 #1425861 (400 connections now open) 2015-10-05T06:07:20.810+0100 [conn1425861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:23.785+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:23.786+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:23.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612058b5703b51053ebfa8d 2015-10-05T06:07:23.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:24.646+0100 [conn1425461] end connection 172.28.0.163:65497 (399 connections now open) 2015-10-05T06:07:24.646+0100 [conn1425423] end connection 172.28.0.163:65398 (399 connections now open) 2015-10-05T06:07:24.647+0100 [mongosMain] connection accepted from 172.28.0.163:50247 #1425862 (399 connections now open) 2015-10-05T06:07:24.648+0100 [mongosMain] connection accepted from 172.28.0.163:50248 #1425863 (400 connections now open) 2015-10-05T06:07:24.648+0100 [conn1425862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:24.649+0100 [conn1425863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:25.080+0100 [conn1425425] end connection 172.28.0.164:58452 (399 connections now open) 2015-10-05T06:07:25.080+0100 [conn1425447] end connection 172.28.0.164:58500 (398 connections now open) 2015-10-05T06:07:25.081+0100 [mongosMain] connection accepted from 172.28.0.164:59653 #1425864 (399 connections now open) 2015-10-05T06:07:25.082+0100 [mongosMain] connection accepted from 172.28.0.164:59654 #1425865 (400 connections now open) 2015-10-05T06:07:25.083+0100 [conn1425864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:25.083+0100 [conn1425865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:26.878+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:07:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:07:27.793+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:27.794+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:28.903+0100 [mongosMain] connection accepted from 127.0.0.1:50251 #1425866 (401 connections now open) 2015-10-05T06:07:28.906+0100 [conn1425866] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:28.912+0100 [conn1425866] end connection 127.0.0.1:50251 (400 connections now open) 2015-10-05T06:07:30.103+0100 [conn1425458] end connection 172.28.0.164:58539 (399 connections now open) 2015-10-05T06:07:30.104+0100 [mongosMain] connection accepted from 172.28.0.164:59661 #1425867 (400 connections now open) 2015-10-05T06:07:30.105+0100 [conn1425867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:30.246+0100 [conn1425412] end connection 172.28.0.163:65363 (399 connections now open) 2015-10-05T06:07:30.247+0100 [mongosMain] connection accepted from 172.28.0.163:50252 #1425868 (400 connections now open) 2015-10-05T06:07:30.248+0100 [conn1425868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:30.649+0100 [conn1425471] end connection 172.28.0.164:58563 (399 connections now open) 2015-10-05T06:07:30.649+0100 [mongosMain] connection accepted from 172.28.0.164:59664 #1425869 (400 connections now open) 2015-10-05T06:07:30.651+0100 [conn1425869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:30.808+0100 [conn1425466] end connection 172.28.0.163:65513 (399 connections now open) 2015-10-05T06:07:30.809+0100 [mongosMain] connection accepted from 172.28.0.163:50255 #1425870 (400 connections now open) 2015-10-05T06:07:30.811+0100 [conn1425870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:31.637+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:32.848+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:32.849+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:34.661+0100 [conn1425407] end connection 172.28.0.163:65352 (399 connections now open) 2015-10-05T06:07:34.661+0100 [conn1425467] end connection 172.28.0.163:65520 (399 connections now open) 2015-10-05T06:07:34.662+0100 [mongosMain] connection accepted from 172.28.0.163:50258 #1425871 (399 connections now open) 2015-10-05T06:07:34.662+0100 [mongosMain] connection accepted from 172.28.0.163:50259 #1425872 (400 connections now open) 2015-10-05T06:07:34.663+0100 [conn1425871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:34.663+0100 [conn1425872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:35.096+0100 [conn1425448] end connection 172.28.0.164:58501 (399 connections now open) 2015-10-05T06:07:35.096+0100 [conn1425462] end connection 172.28.0.164:58547 (398 connections now open) 2015-10-05T06:07:35.097+0100 [mongosMain] connection accepted from 172.28.0.164:59672 #1425873 (399 connections now open) 2015-10-05T06:07:35.097+0100 [mongosMain] connection accepted from 172.28.0.164:59673 #1425874 (400 connections now open) 2015-10-05T06:07:35.100+0100 [conn1425873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:35.100+0100 [conn1425874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:36.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205975703b51053ebfb36 2015-10-05T06:07:36.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:38.851+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:38.851+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:39.604+0100 [mongosMain] connection accepted from 127.0.0.1:50265 #1425875 (401 connections now open) 2015-10-05T06:07:39.606+0100 [conn1425875] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:39.611+0100 [conn1425875] end connection 127.0.0.1:50265 (400 connections now open) 2015-10-05T06:07:40.119+0100 [conn1425435] end connection 172.28.0.164:58470 (399 connections now open) 2015-10-05T06:07:40.120+0100 [mongosMain] connection accepted from 172.28.0.164:59682 #1425876 (400 connections now open) 2015-10-05T06:07:40.123+0100 [conn1425876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:40.246+0100 [conn1425420] end connection 172.28.0.163:65380 (399 connections now open) 2015-10-05T06:07:40.247+0100 [mongosMain] connection accepted from 172.28.0.163:50266 #1425877 (400 connections now open) 2015-10-05T06:07:40.248+0100 [conn1425877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:40.649+0100 [conn1425480] end connection 172.28.0.164:58585 (399 connections now open) 2015-10-05T06:07:40.650+0100 [mongosMain] connection accepted from 172.28.0.164:59684 #1425878 (400 connections now open) 2015-10-05T06:07:40.651+0100 [conn1425878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:40.823+0100 [conn1425472] end connection 172.28.0.163:65529 (399 connections now open) 2015-10-05T06:07:40.824+0100 [mongosMain] connection accepted from 172.28.0.163:50269 #1425879 (400 connections now open) 2015-10-05T06:07:40.825+0100 [conn1425879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:42.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612059e5703b51053ebfb97 2015-10-05T06:07:42.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:42.643+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:44.662+0100 [conn1425446] end connection 172.28.0.163:65448 (399 connections now open) 2015-10-05T06:07:44.663+0100 [conn1425431] end connection 172.28.0.163:65414 (399 connections now open) 2015-10-05T06:07:44.664+0100 [mongosMain] connection accepted from 172.28.0.163:50276 #1425880 (399 connections now open) 2015-10-05T06:07:44.664+0100 [mongosMain] connection accepted from 172.28.0.163:50277 #1425881 (400 connections now open) 2015-10-05T06:07:44.664+0100 [conn1425880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:44.665+0100 [conn1425881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:45.095+0100 [conn1425468] end connection 172.28.0.164:58557 (399 connections now open) 2015-10-05T06:07:45.096+0100 [conn1425469] end connection 172.28.0.164:58558 (398 connections now open) 2015-10-05T06:07:45.096+0100 [mongosMain] connection accepted from 172.28.0.164:59692 #1425882 (399 connections now open) 2015-10-05T06:07:45.097+0100 [mongosMain] connection accepted from 172.28.0.164:59693 #1425883 (400 connections now open) 2015-10-05T06:07:45.098+0100 [conn1425882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:45.098+0100 [conn1425883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:45.903+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:45.904+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:48.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205a45703b51053ebfbe4 2015-10-05T06:07:48.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:50.134+0100 [conn1425449] end connection 172.28.0.164:58510 (399 connections now open) 2015-10-05T06:07:50.135+0100 [mongosMain] connection accepted from 172.28.0.164:59703 #1425884 (400 connections now open) 2015-10-05T06:07:50.136+0100 [conn1425884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:50.664+0100 [conn1425488] end connection 172.28.0.164:58605 (399 connections now open) 2015-10-05T06:07:50.666+0100 [mongosMain] connection accepted from 172.28.0.164:59706 #1425885 (400 connections now open) 2015-10-05T06:07:50.668+0100 [conn1425885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:50.823+0100 [conn1425481] end connection 172.28.0.163:49165 (399 connections now open) 2015-10-05T06:07:50.824+0100 [mongosMain] connection accepted from 172.28.0.163:50288 #1425886 (400 connections now open) 2015-10-05T06:07:50.825+0100 [conn1425886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:53.655+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:54.008+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:07:54.008+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:07:54.677+0100 [conn1425389] end connection 172.28.0.163:65327 (399 connections now open) 2015-10-05T06:07:54.678+0100 [mongosMain] connection accepted from 172.28.0.163:50295 #1425887 (400 connections now open) 2015-10-05T06:07:54.679+0100 [conn1425887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:55.096+0100 [conn1425476] end connection 172.28.0.164:58577 (399 connections now open) 2015-10-05T06:07:55.096+0100 [conn1425417] end connection 172.28.0.164:58439 (398 connections now open) 2015-10-05T06:07:55.097+0100 [mongosMain] connection accepted from 172.28.0.164:59715 #1425888 (399 connections now open) 2015-10-05T06:07:55.097+0100 [mongosMain] connection accepted from 172.28.0.164:59714 #1425889 (400 connections now open) 2015-10-05T06:07:55.099+0100 [conn1425888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:55.099+0100 [conn1425889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:07:55.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205aa5703b51053ebfc53 2015-10-05T06:07:55.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:07:57.012+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:07:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:08:00.149+0100 [conn1425478] end connection 172.28.0.164:58582 (399 connections now open) 2015-10-05T06:08:00.151+0100 [mongosMain] connection accepted from 172.28.0.164:59717 #1425890 (400 connections now open) 2015-10-05T06:08:00.152+0100 [conn1425890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:00.262+0100 [conn1425470] end connection 172.28.0.163:65527 (399 connections now open) 2015-10-05T06:08:00.264+0100 [mongosMain] connection accepted from 172.28.0.163:50305 #1425891 (400 connections now open) 2015-10-05T06:08:00.266+0100 [conn1425891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:00.679+0100 [conn1425496] end connection 172.28.0.164:58624 (399 connections now open) 2015-10-05T06:08:00.680+0100 [mongosMain] connection accepted from 172.28.0.164:59721 #1425892 (400 connections now open) 2015-10-05T06:08:00.681+0100 [conn1425892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:00.839+0100 [conn1425489] end connection 172.28.0.163:49191 (399 connections now open) 2015-10-05T06:08:00.840+0100 [mongosMain] connection accepted from 172.28.0.163:50308 #1425893 (400 connections now open) 2015-10-05T06:08:00.841+0100 [conn1425893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:01.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205b15703b51053ebfcad 2015-10-05T06:08:01.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:03.018+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:03.019+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:04.677+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:04.693+0100 [conn1425416] end connection 172.28.0.163:65370 (399 connections now open) 2015-10-05T06:08:04.693+0100 [conn1425474] end connection 172.28.0.163:49155 (398 connections now open) 2015-10-05T06:08:04.694+0100 [mongosMain] connection accepted from 172.28.0.163:50318 #1425894 (399 connections now open) 2015-10-05T06:08:04.694+0100 [mongosMain] connection accepted from 172.28.0.163:50319 #1425895 (400 connections now open) 2015-10-05T06:08:04.695+0100 [conn1425894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:04.695+0100 [conn1425895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:05.112+0100 [conn1425492] end connection 172.28.0.164:58614 (399 connections now open) 2015-10-05T06:08:05.113+0100 [mongosMain] connection accepted from 172.28.0.164:59727 #1425896 (400 connections now open) 2015-10-05T06:08:05.115+0100 [conn1425896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:08.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205b75703b51053ebfd25 2015-10-05T06:08:08.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:10.696+0100 [conn1425503] end connection 172.28.0.164:58644 (399 connections now open) 2015-10-05T06:08:10.697+0100 [mongosMain] connection accepted from 172.28.0.164:59730 #1425897 (400 connections now open) 2015-10-05T06:08:10.698+0100 [conn1425897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:10.839+0100 [conn1425497] end connection 172.28.0.163:49223 (399 connections now open) 2015-10-05T06:08:10.840+0100 [mongosMain] connection accepted from 172.28.0.163:50327 #1425898 (400 connections now open) 2015-10-05T06:08:10.842+0100 [conn1425898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:13.022+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:13.022+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:14.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205be5703b51053ebfd94 2015-10-05T06:08:14.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:14.694+0100 [conn1425352] end connection 172.28.0.163:65241 (399 connections now open) 2015-10-05T06:08:14.694+0100 [conn1425482] end connection 172.28.0.163:49169 (399 connections now open) 2015-10-05T06:08:14.695+0100 [mongosMain] connection accepted from 172.28.0.163:50334 #1425899 (399 connections now open) 2015-10-05T06:08:14.696+0100 [mongosMain] connection accepted from 172.28.0.163:50335 #1425900 (400 connections now open) 2015-10-05T06:08:14.697+0100 [conn1425900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:14.697+0100 [conn1425899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:15.112+0100 [conn1425501] end connection 172.28.0.164:58634 (399 connections now open) 2015-10-05T06:08:15.112+0100 [conn1425508] end connection 172.28.0.164:58654 (398 connections now open) 2015-10-05T06:08:15.113+0100 [mongosMain] connection accepted from 172.28.0.164:59737 #1425901 (399 connections now open) 2015-10-05T06:08:15.114+0100 [mongosMain] connection accepted from 172.28.0.164:59738 #1425902 (400 connections now open) 2015-10-05T06:08:15.114+0100 [conn1425901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:15.115+0100 [conn1425902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:15.682+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:20.739+0100 [conn1425509] end connection 172.28.0.164:58659 (399 connections now open) 2015-10-05T06:08:20.739+0100 [mongosMain] connection accepted from 172.28.0.164:59745 #1425903 (400 connections now open) 2015-10-05T06:08:20.739+0100 [conn1425903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:20.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205c45703b51053ebfded 2015-10-05T06:08:20.895+0100 [conn1425504] end connection 172.28.0.163:49246 (399 connections now open) 2015-10-05T06:08:20.895+0100 [mongosMain] connection accepted from 172.28.0.163:50343 #1425904 (400 connections now open) 2015-10-05T06:08:20.895+0100 [conn1425904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:20.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:24.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:24.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:24.707+0100 [conn1425490] end connection 172.28.0.163:49209 (399 connections now open) 2015-10-05T06:08:24.707+0100 [conn1425473] end connection 172.28.0.163:65534 (399 connections now open) 2015-10-05T06:08:24.708+0100 [mongosMain] connection accepted from 172.28.0.163:50346 #1425905 (399 connections now open) 2015-10-05T06:08:24.709+0100 [mongosMain] connection accepted from 172.28.0.163:50347 #1425906 (400 connections now open) 2015-10-05T06:08:24.709+0100 [conn1425905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:24.709+0100 [conn1425906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:25.127+0100 [conn1425484] end connection 172.28.0.164:58593 (399 connections now open) 2015-10-05T06:08:25.127+0100 [conn1425475] end connection 172.28.0.164:58576 (398 connections now open) 2015-10-05T06:08:25.128+0100 [mongosMain] connection accepted from 172.28.0.164:59756 #1425907 (399 connections now open) 2015-10-05T06:08:25.129+0100 [mongosMain] connection accepted from 172.28.0.164:59757 #1425908 (400 connections now open) 2015-10-05T06:08:25.130+0100 [conn1425907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:25.131+0100 [conn1425908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:26.682+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:27.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205ca5703b51053ebfe65 2015-10-05T06:08:27.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:27.163+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:08:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:08:28.943+0100 [mongosMain] connection accepted from 127.0.0.1:50350 #1425909 (401 connections now open) 2015-10-05T06:08:28.947+0100 [conn1425909] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:28.951+0100 [conn1425909] end connection 127.0.0.1:50350 (400 connections now open) 2015-10-05T06:08:30.295+0100 [conn1425479] end connection 172.28.0.163:49163 (399 connections now open) 2015-10-05T06:08:30.296+0100 [mongosMain] connection accepted from 172.28.0.163:50351 #1425910 (400 connections now open) 2015-10-05T06:08:30.297+0100 [conn1425910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:30.727+0100 [conn1425515] end connection 172.28.0.164:58675 (399 connections now open) 2015-10-05T06:08:30.728+0100 [mongosMain] connection accepted from 172.28.0.164:59764 #1425911 (400 connections now open) 2015-10-05T06:08:30.729+0100 [conn1425911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:30.871+0100 [conn1425510] end connection 172.28.0.163:49276 (399 connections now open) 2015-10-05T06:08:30.873+0100 [mongosMain] connection accepted from 172.28.0.163:50354 #1425912 (400 connections now open) 2015-10-05T06:08:30.874+0100 [conn1425912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:33.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205d15703b51053ebfecd 2015-10-05T06:08:33.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:34.722+0100 [conn1425491] end connection 172.28.0.163:49210 (399 connections now open) 2015-10-05T06:08:34.722+0100 [conn1425505] end connection 172.28.0.163:49256 (399 connections now open) 2015-10-05T06:08:34.723+0100 [mongosMain] connection accepted from 172.28.0.163:50355 #1425913 (399 connections now open) 2015-10-05T06:08:34.724+0100 [mongosMain] connection accepted from 172.28.0.163:50356 #1425914 (400 connections now open) 2015-10-05T06:08:34.724+0100 [conn1425913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:34.725+0100 [conn1425914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:35.128+0100 [conn1425500] end connection 172.28.0.164:58633 (399 connections now open) 2015-10-05T06:08:35.128+0100 [conn1425507] end connection 172.28.0.164:58653 (398 connections now open) 2015-10-05T06:08:35.129+0100 [mongosMain] connection accepted from 172.28.0.164:59774 #1425915 (399 connections now open) 2015-10-05T06:08:35.129+0100 [mongosMain] connection accepted from 172.28.0.164:59775 #1425916 (400 connections now open) 2015-10-05T06:08:35.131+0100 [conn1425915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:35.132+0100 [conn1425916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:36.040+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:36.041+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:37.698+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:38.049+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:38.050+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:39.183+0100 [mongosMain] connection accepted from 127.0.0.1:50361 #1425917 (401 connections now open) 2015-10-05T06:08:39.185+0100 [conn1425917] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:39.190+0100 [conn1425917] end connection 127.0.0.1:50361 (400 connections now open) 2015-10-05T06:08:39.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205d75703b51053ebff33 2015-10-05T06:08:39.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:40.294+0100 [conn1425487] end connection 172.28.0.163:49186 (399 connections now open) 2015-10-05T06:08:40.294+0100 [mongosMain] connection accepted from 172.28.0.163:50363 #1425918 (400 connections now open) 2015-10-05T06:08:40.295+0100 [conn1425918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:41.055+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:41.056+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:44.724+0100 [conn1425511] end connection 172.28.0.163:49280 (399 connections now open) 2015-10-05T06:08:44.725+0100 [mongosMain] connection accepted from 172.28.0.163:50372 #1425919 (400 connections now open) 2015-10-05T06:08:44.726+0100 [conn1425919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:45.057+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:45.058+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:45.142+0100 [conn1425433] end connection 172.28.0.164:58463 (399 connections now open) 2015-10-05T06:08:45.143+0100 [conn1425513] end connection 172.28.0.164:58663 (398 connections now open) 2015-10-05T06:08:45.144+0100 [mongosMain] connection accepted from 172.28.0.164:59796 #1425920 (399 connections now open) 2015-10-05T06:08:45.144+0100 [mongosMain] connection accepted from 172.28.0.164:59797 #1425921 (400 connections now open) 2015-10-05T06:08:45.145+0100 [conn1425920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:45.146+0100 [conn1425921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:45.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205dd5703b51053ebffa1 2015-10-05T06:08:45.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:48.713+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:50.054+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:50.054+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:54.729+0100 [conn1425498] end connection 172.28.0.163:49229 (399 connections now open) 2015-10-05T06:08:54.731+0100 [mongosMain] connection accepted from 172.28.0.163:50389 #1425922 (400 connections now open) 2015-10-05T06:08:54.732+0100 [conn1425922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:55.142+0100 [conn1425520] end connection 172.28.0.164:58685 (399 connections now open) 2015-10-05T06:08:55.142+0100 [conn1425493] end connection 172.28.0.164:58615 (399 connections now open) 2015-10-05T06:08:55.143+0100 [mongosMain] connection accepted from 172.28.0.164:59816 #1425923 (399 connections now open) 2015-10-05T06:08:55.144+0100 [mongosMain] connection accepted from 172.28.0.164:59817 #1425924 (400 connections now open) 2015-10-05T06:08:55.145+0100 [conn1425923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:55.145+0100 [conn1425924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:08:56.059+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:08:56.060+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:08:57.440+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:08:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:08:58.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205e95703b51053ec0075 2015-10-05T06:08:58.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:08:59.714+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:00.229+0100 [conn1425485] end connection 172.28.0.164:58602 (399 connections now open) 2015-10-05T06:09:00.230+0100 [mongosMain] connection accepted from 172.28.0.164:59826 #1425925 (400 connections now open) 2015-10-05T06:09:00.232+0100 [conn1425925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:00.325+0100 [conn1425443] end connection 172.28.0.163:65443 (399 connections now open) 2015-10-05T06:09:00.326+0100 [mongosMain] connection accepted from 172.28.0.163:50401 #1425926 (400 connections now open) 2015-10-05T06:09:00.327+0100 [conn1425926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:03.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:03.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:04.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205f05703b51053ec00ec 2015-10-05T06:09:04.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:09:04.740+0100 [conn1425483] end connection 172.28.0.163:49170 (399 connections now open) 2015-10-05T06:09:04.740+0100 [conn1425525] end connection 172.28.0.163:49309 (399 connections now open) 2015-10-05T06:09:04.741+0100 [mongosMain] connection accepted from 172.28.0.163:50411 #1425927 (399 connections now open) 2015-10-05T06:09:04.742+0100 [mongosMain] connection accepted from 172.28.0.163:50412 #1425928 (400 connections now open) 2015-10-05T06:09:04.742+0100 [conn1425927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:04.743+0100 [conn1425928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:05.159+0100 [conn1425528] end connection 172.28.0.164:58705 (399 connections now open) 2015-10-05T06:09:05.160+0100 [mongosMain] connection accepted from 172.28.0.164:59833 #1425929 (400 connections now open) 2015-10-05T06:09:05.161+0100 [conn1425929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:10.325+0100 [conn1425522] end connection 172.28.0.163:49303 (399 connections now open) 2015-10-05T06:09:10.326+0100 [mongosMain] connection accepted from 172.28.0.163:50425 #1425930 (400 connections now open) 2015-10-05T06:09:10.327+0100 [conn1425930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:10.749+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:11.068+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:11.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:14.740+0100 [conn1425532] end connection 172.28.0.163:49323 (399 connections now open) 2015-10-05T06:09:14.740+0100 [conn1425537] end connection 172.28.0.163:49342 (399 connections now open) 2015-10-05T06:09:14.742+0100 [mongosMain] connection accepted from 172.28.0.163:50430 #1425931 (399 connections now open) 2015-10-05T06:09:14.742+0100 [mongosMain] connection accepted from 172.28.0.163:50431 #1425932 (400 connections now open) 2015-10-05T06:09:14.743+0100 [conn1425931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:14.743+0100 [conn1425932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:15.174+0100 [conn1425534] end connection 172.28.0.164:58725 (399 connections now open) 2015-10-05T06:09:15.176+0100 [mongosMain] connection accepted from 172.28.0.164:59837 #1425933 (400 connections now open) 2015-10-05T06:09:15.178+0100 [conn1425933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:17.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561205fc5703b51053ec01a3 2015-10-05T06:09:17.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:09:20.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:20.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:20.262+0100 [conn1425402] end connection 172.28.0.164:58411 (399 connections now open) 2015-10-05T06:09:20.263+0100 [mongosMain] connection accepted from 172.28.0.164:59844 #1425934 (400 connections now open) 2015-10-05T06:09:20.264+0100 [conn1425934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:20.341+0100 [conn1425529] end connection 172.28.0.163:49313 (399 connections now open) 2015-10-05T06:09:20.343+0100 [mongosMain] connection accepted from 172.28.0.163:50438 #1425935 (400 connections now open) 2015-10-05T06:09:20.344+0100 [conn1425935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:21.852+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:24.755+0100 [conn1425506] end connection 172.28.0.163:49257 (399 connections now open) 2015-10-05T06:09:24.755+0100 [conn1425518] end connection 172.28.0.163:49297 (399 connections now open) 2015-10-05T06:09:24.756+0100 [mongosMain] connection accepted from 172.28.0.163:50443 #1425936 (399 connections now open) 2015-10-05T06:09:24.757+0100 [mongosMain] connection accepted from 172.28.0.163:50444 #1425937 (400 connections now open) 2015-10-05T06:09:24.757+0100 [conn1425936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:24.758+0100 [conn1425937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:27.690+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:09:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:09:29.156+0100 [mongosMain] connection accepted from 127.0.0.1:50448 #1425938 (401 connections now open) 2015-10-05T06:09:29.159+0100 [conn1425938] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:29.163+0100 [conn1425938] end connection 127.0.0.1:50448 (400 connections now open) 2015-10-05T06:09:29.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206095703b51053ec0215 2015-10-05T06:09:29.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:09:30.082+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:30.082+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:30.341+0100 [conn1425495] end connection 172.28.0.163:49221 (399 connections now open) 2015-10-05T06:09:30.342+0100 [mongosMain] connection accepted from 172.28.0.163:50449 #1425939 (400 connections now open) 2015-10-05T06:09:30.343+0100 [conn1425939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:32.857+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:34.772+0100 [conn1425538] end connection 172.28.0.163:49343 (399 connections now open) 2015-10-05T06:09:34.772+0100 [conn1425533] end connection 172.28.0.163:49324 (399 connections now open) 2015-10-05T06:09:34.773+0100 [mongosMain] connection accepted from 172.28.0.163:50453 #1425940 (399 connections now open) 2015-10-05T06:09:34.773+0100 [mongosMain] connection accepted from 172.28.0.163:50454 #1425941 (400 connections now open) 2015-10-05T06:09:34.774+0100 [conn1425940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:34.774+0100 [conn1425941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:40.173+0100 [mongosMain] connection accepted from 127.0.0.1:50459 #1425942 (401 connections now open) 2015-10-05T06:09:40.175+0100 [conn1425942] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:40.179+0100 [conn1425942] end connection 127.0.0.1:50459 (400 connections now open) 2015-10-05T06:09:40.291+0100 [conn1425502] end connection 172.28.0.164:58642 (399 connections now open) 2015-10-05T06:09:40.292+0100 [mongosMain] connection accepted from 172.28.0.164:59878 #1425943 (400 connections now open) 2015-10-05T06:09:40.303+0100 [conn1425943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:40.357+0100 [conn1425545] end connection 172.28.0.163:49376 (399 connections now open) 2015-10-05T06:09:40.357+0100 [mongosMain] connection accepted from 172.28.0.163:50462 #1425944 (400 connections now open) 2015-10-05T06:09:40.358+0100 [conn1425944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:41.105+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:41.106+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:42.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206155703b51053ec02ac 2015-10-05T06:09:42.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:09:43.872+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:44.800+0100 [conn1425546] end connection 172.28.0.163:49381 (399 connections now open) 2015-10-05T06:09:44.801+0100 [conn1425543] end connection 172.28.0.163:49366 (398 connections now open) 2015-10-05T06:09:44.802+0100 [mongosMain] connection accepted from 172.28.0.163:50468 #1425945 (399 connections now open) 2015-10-05T06:09:44.802+0100 [mongosMain] connection accepted from 172.28.0.163:50469 #1425946 (400 connections now open) 2015-10-05T06:09:44.803+0100 [conn1425945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:44.803+0100 [conn1425946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:50.291+0100 [conn1425463] end connection 172.28.0.164:58550 (399 connections now open) 2015-10-05T06:09:50.292+0100 [mongosMain] connection accepted from 172.28.0.164:59895 #1425947 (400 connections now open) 2015-10-05T06:09:50.294+0100 [conn1425947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:50.357+0100 [conn1425554] end connection 172.28.0.163:49402 (399 connections now open) 2015-10-05T06:09:50.359+0100 [mongosMain] connection accepted from 172.28.0.163:50478 #1425948 (400 connections now open) 2015-10-05T06:09:50.360+0100 [conn1425948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:09:53.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:53.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:54.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206225703b51053ec0335 2015-10-05T06:09:54.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:09:54.884+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:55.115+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:55.116+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:09:57.847+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:09:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:09:58.122+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:09:58.123+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:00.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206285703b51053ec0371 2015-10-05T06:10:00.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:10:02.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:02.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:05.221+0100 [conn1425562] end connection 172.28.0.164:58812 (399 connections now open) 2015-10-05T06:10:05.222+0100 [mongosMain] connection accepted from 172.28.0.164:59911 #1425949 (400 connections now open) 2015-10-05T06:10:05.224+0100 [conn1425949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:05.892+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:07.136+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:07.136+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:10.950+0100 [conn1425524] end connection 172.28.0.163:49304 (399 connections now open) 2015-10-05T06:10:10.951+0100 [mongosMain] connection accepted from 172.28.0.163:50512 #1425950 (400 connections now open) 2015-10-05T06:10:10.953+0100 [conn1425950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:12.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206345703b51053ec0410 2015-10-05T06:10:12.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:10:13.146+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:13.147+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:15.221+0100 [conn1425527] end connection 172.28.0.164:58704 (399 connections now open) 2015-10-05T06:10:15.226+0100 [mongosMain] connection accepted from 172.28.0.164:59917 #1425951 (400 connections now open) 2015-10-05T06:10:15.227+0100 [conn1425951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:16.905+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:19.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612063a5703b51053ec046e 2015-10-05T06:10:19.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:10:20.200+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:20.201+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:20.965+0100 [conn1425516] end connection 172.28.0.163:49291 (399 connections now open) 2015-10-05T06:10:20.966+0100 [mongosMain] connection accepted from 172.28.0.163:50524 #1425952 (400 connections now open) 2015-10-05T06:10:20.968+0100 [conn1425952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:25.237+0100 [conn1425539] end connection 172.28.0.164:58742 (399 connections now open) 2015-10-05T06:10:25.238+0100 [conn1425362] end connection 172.28.0.164:58322 (398 connections now open) 2015-10-05T06:10:25.239+0100 [mongosMain] connection accepted from 172.28.0.164:59932 #1425953 (399 connections now open) 2015-10-05T06:10:25.239+0100 [mongosMain] connection accepted from 172.28.0.164:59933 #1425954 (400 connections now open) 2015-10-05T06:10:25.241+0100 [conn1425953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:25.241+0100 [conn1425954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:25.532+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:10:25.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:10:27.914+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:28.126+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:10:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:10:28.217+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:28.218+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:28.616+0100 [mongosMain] connection accepted from 127.0.0.1:50533 #1425955 (401 connections now open) 2015-10-05T06:10:28.619+0100 [conn1425955] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:28.624+0100 [conn1425955] end connection 127.0.0.1:50533 (400 connections now open) 2015-10-05T06:10:30.339+0100 [conn1425548] end connection 172.28.0.164:58762 (399 connections now open) 2015-10-05T06:10:30.340+0100 [mongosMain] connection accepted from 172.28.0.164:59940 #1425956 (400 connections now open) 2015-10-05T06:10:30.342+0100 [conn1425956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:30.404+0100 [conn1425549] end connection 172.28.0.163:49390 (399 connections now open) 2015-10-05T06:10:30.405+0100 [mongosMain] connection accepted from 172.28.0.163:50534 #1425957 (400 connections now open) 2015-10-05T06:10:30.409+0100 [conn1425957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:30.885+0100 [conn1425523] end connection 172.28.0.164:58695 (399 connections now open) 2015-10-05T06:10:30.886+0100 [mongosMain] connection accepted from 172.28.0.164:59943 #1425958 (400 connections now open) 2015-10-05T06:10:30.887+0100 [conn1425958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:30.966+0100 [conn1425578] end connection 172.28.0.163:49491 (399 connections now open) 2015-10-05T06:10:30.967+0100 [mongosMain] connection accepted from 172.28.0.163:50537 #1425959 (400 connections now open) 2015-10-05T06:10:30.969+0100 [conn1425959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:31.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206475703b51053ec051a 2015-10-05T06:10:31.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:10:34.818+0100 [conn1425561] end connection 172.28.0.163:49423 (399 connections now open) 2015-10-05T06:10:34.819+0100 [conn1425568] end connection 172.28.0.163:49461 (399 connections now open) 2015-10-05T06:10:34.820+0100 [mongosMain] connection accepted from 172.28.0.163:50540 #1425960 (399 connections now open) 2015-10-05T06:10:34.820+0100 [mongosMain] connection accepted from 172.28.0.163:50541 #1425961 (400 connections now open) 2015-10-05T06:10:34.820+0100 [conn1425960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:34.821+0100 [conn1425961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:35.238+0100 [conn1425544] end connection 172.28.0.164:58751 (399 connections now open) 2015-10-05T06:10:35.239+0100 [mongosMain] connection accepted from 172.28.0.164:59953 #1425962 (400 connections now open) 2015-10-05T06:10:35.241+0100 [conn1425962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:37.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:37.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:38.209+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:10:38.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:10:38.928+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:39.720+0100 [mongosMain] connection accepted from 127.0.0.1:50548 #1425963 (401 connections now open) 2015-10-05T06:10:39.725+0100 [conn1425963] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:39.729+0100 [conn1425963] end connection 127.0.0.1:50548 (400 connections now open) 2015-10-05T06:10:40.404+0100 [conn1425536] end connection 172.28.0.163:49333 (399 connections now open) 2015-10-05T06:10:40.405+0100 [mongosMain] connection accepted from 172.28.0.163:50549 #1425964 (400 connections now open) 2015-10-05T06:10:40.407+0100 [conn1425964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:40.886+0100 [conn1425531] end connection 172.28.0.164:58718 (399 connections now open) 2015-10-05T06:10:40.887+0100 [mongosMain] connection accepted from 172.28.0.164:59965 #1425965 (400 connections now open) 2015-10-05T06:10:40.889+0100 [conn1425965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:40.981+0100 [conn1425585] end connection 172.28.0.163:49506 (399 connections now open) 2015-10-05T06:10:40.982+0100 [mongosMain] connection accepted from 172.28.0.163:50552 #1425966 (400 connections now open) 2015-10-05T06:10:40.983+0100 [conn1425966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:44.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206545703b51053ec05b8 2015-10-05T06:10:44.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:10:44.820+0100 [conn1425579] end connection 172.28.0.163:49494 (399 connections now open) 2015-10-05T06:10:44.820+0100 [conn1425542] end connection 172.28.0.163:49365 (399 connections now open) 2015-10-05T06:10:44.821+0100 [mongosMain] connection accepted from 172.28.0.163:50558 #1425967 (399 connections now open) 2015-10-05T06:10:44.821+0100 [mongosMain] connection accepted from 172.28.0.163:50559 #1425968 (400 connections now open) 2015-10-05T06:10:44.822+0100 [conn1425967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:44.822+0100 [conn1425968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:47.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:47.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:10:50.039+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:50.420+0100 [conn1425559] end connection 172.28.0.163:49413 (399 connections now open) 2015-10-05T06:10:50.421+0100 [mongosMain] connection accepted from 172.28.0.163:50570 #1425969 (400 connections now open) 2015-10-05T06:10:50.422+0100 [conn1425969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:50.901+0100 [conn1425584] end connection 172.28.0.164:58883 (399 connections now open) 2015-10-05T06:10:50.903+0100 [mongosMain] connection accepted from 172.28.0.164:59979 #1425970 (400 connections now open) 2015-10-05T06:10:50.905+0100 [conn1425970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:54.834+0100 [conn1425580] end connection 172.28.0.163:49498 (399 connections now open) 2015-10-05T06:10:54.836+0100 [mongosMain] connection accepted from 172.28.0.163:50577 #1425971 (400 connections now open) 2015-10-05T06:10:54.837+0100 [conn1425971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:55.268+0100 [conn1425570] end connection 172.28.0.164:58845 (399 connections now open) 2015-10-05T06:10:55.270+0100 [mongosMain] connection accepted from 172.28.0.164:59987 #1425972 (400 connections now open) 2015-10-05T06:10:55.271+0100 [conn1425972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:10:58.290+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:10:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:10:58.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:10:58.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:00.420+0100 [conn1425541] end connection 172.28.0.163:49354 (399 connections now open) 2015-10-05T06:11:00.421+0100 [mongosMain] connection accepted from 172.28.0.163:50588 #1425973 (400 connections now open) 2015-10-05T06:11:00.422+0100 [conn1425973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:00.901+0100 [conn1425595] end connection 172.28.0.164:58929 (399 connections now open) 2015-10-05T06:11:00.902+0100 [mongosMain] connection accepted from 172.28.0.164:59992 #1425974 (400 connections now open) 2015-10-05T06:11:00.904+0100 [conn1425974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:00.997+0100 [conn1425590] end connection 172.28.0.163:49515 (399 connections now open) 2015-10-05T06:11:00.998+0100 [mongosMain] connection accepted from 172.28.0.163:50591 #1425975 (400 connections now open) 2015-10-05T06:11:00.999+0100 [conn1425975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:01.046+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:02.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206665703b51053ec06c1 2015-10-05T06:11:02.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:11:04.850+0100 [conn1425592] end connection 172.28.0.163:49525 (399 connections now open) 2015-10-05T06:11:04.850+0100 [conn1425517] end connection 172.28.0.163:49296 (399 connections now open) 2015-10-05T06:11:04.852+0100 [mongosMain] connection accepted from 172.28.0.163:50597 #1425976 (399 connections now open) 2015-10-05T06:11:04.852+0100 [mongosMain] connection accepted from 172.28.0.163:50598 #1425977 (400 connections now open) 2015-10-05T06:11:04.853+0100 [conn1425977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:04.853+0100 [conn1425976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:05.269+0100 [conn1425535] end connection 172.28.0.164:58726 (399 connections now open) 2015-10-05T06:11:05.271+0100 [mongosMain] connection accepted from 172.28.0.164:59994 #1425978 (400 connections now open) 2015-10-05T06:11:05.272+0100 [conn1425978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:10.387+0100 [conn1425576] end connection 172.28.0.164:58864 (399 connections now open) 2015-10-05T06:11:10.388+0100 [mongosMain] connection accepted from 172.28.0.164:59998 #1425979 (400 connections now open) 2015-10-05T06:11:10.392+0100 [conn1425979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:10.420+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:10.421+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:10.435+0100 [conn1425577] end connection 172.28.0.163:49490 (399 connections now open) 2015-10-05T06:11:10.436+0100 [mongosMain] connection accepted from 172.28.0.163:50607 #1425980 (400 connections now open) 2015-10-05T06:11:10.437+0100 [conn1425980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:10.918+0100 [conn1425600] end connection 172.28.0.164:58946 (399 connections now open) 2015-10-05T06:11:10.919+0100 [mongosMain] connection accepted from 172.28.0.164:60001 #1425981 (400 connections now open) 2015-10-05T06:11:10.922+0100 [conn1425981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:11.013+0100 [conn1425601] end connection 172.28.0.163:49564 (399 connections now open) 2015-10-05T06:11:11.015+0100 [mongosMain] connection accepted from 172.28.0.163:50609 #1425982 (400 connections now open) 2015-10-05T06:11:11.016+0100 [conn1425982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:12.057+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:12.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:12.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:14.851+0100 [conn1425526] end connection 172.28.0.163:49310 (399 connections now open) 2015-10-05T06:11:14.851+0100 [conn1425551] end connection 172.28.0.163:49395 (399 connections now open) 2015-10-05T06:11:14.852+0100 [mongosMain] connection accepted from 172.28.0.163:50618 #1425983 (399 connections now open) 2015-10-05T06:11:14.853+0100 [mongosMain] connection accepted from 172.28.0.163:50619 #1425984 (400 connections now open) 2015-10-05T06:11:14.853+0100 [conn1425983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:14.854+0100 [conn1425984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:15.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206725703b51053ec0795 2015-10-05T06:11:15.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:11:15.284+0100 [conn1425610] end connection 172.28.0.164:58970 (399 connections now open) 2015-10-05T06:11:15.289+0100 [mongosMain] connection accepted from 172.28.0.164:60004 #1425985 (400 connections now open) 2015-10-05T06:11:15.290+0100 [conn1425985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:15.546+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:15.546+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:19.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:19.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:20.402+0100 [conn1425563] end connection 172.28.0.164:58820 (399 connections now open) 2015-10-05T06:11:20.402+0100 [mongosMain] connection accepted from 172.28.0.164:60017 #1425986 (400 connections now open) 2015-10-05T06:11:20.404+0100 [conn1425986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:20.436+0100 [conn1425564] end connection 172.28.0.163:49432 (399 connections now open) 2015-10-05T06:11:20.437+0100 [mongosMain] connection accepted from 172.28.0.163:50627 #1425987 (400 connections now open) 2015-10-05T06:11:20.438+0100 [conn1425987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:20.932+0100 [conn1425607] end connection 172.28.0.164:58964 (399 connections now open) 2015-10-05T06:11:20.933+0100 [mongosMain] connection accepted from 172.28.0.164:60019 #1425988 (400 connections now open) 2015-10-05T06:11:20.935+0100 [conn1425988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:21.015+0100 [conn1425608] end connection 172.28.0.163:49585 (399 connections now open) 2015-10-05T06:11:21.016+0100 [mongosMain] connection accepted from 172.28.0.163:50630 #1425989 (400 connections now open) 2015-10-05T06:11:21.017+0100 [conn1425989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:21.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206795703b51053ec07e6 2015-10-05T06:11:21.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:11:23.066+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:24.553+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:24.553+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:24.867+0100 [conn1425555] end connection 172.28.0.163:49404 (399 connections now open) 2015-10-05T06:11:24.867+0100 [conn1425569] end connection 172.28.0.163:49463 (399 connections now open) 2015-10-05T06:11:24.868+0100 [mongosMain] connection accepted from 172.28.0.163:50633 #1425990 (399 connections now open) 2015-10-05T06:11:24.868+0100 [mongosMain] connection accepted from 172.28.0.163:50634 #1425991 (400 connections now open) 2015-10-05T06:11:24.869+0100 [conn1425990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:24.870+0100 [conn1425991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:25.285+0100 [conn1425605] end connection 172.28.0.164:58954 (399 connections now open) 2015-10-05T06:11:25.286+0100 [mongosMain] connection accepted from 172.28.0.164:60028 #1425992 (400 connections now open) 2015-10-05T06:11:25.291+0100 [conn1425992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:27.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612067f5703b51053ec0838 2015-10-05T06:11:27.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:11:28.558+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:11:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:11:28.755+0100 [mongosMain] connection accepted from 127.0.0.1:50637 #1425993 (401 connections now open) 2015-10-05T06:11:28.757+0100 [conn1425993] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:28.763+0100 [conn1425993] end connection 127.0.0.1:50637 (400 connections now open) 2015-10-05T06:11:30.418+0100 [conn1425572] end connection 172.28.0.164:58851 (399 connections now open) 2015-10-05T06:11:30.419+0100 [mongosMain] connection accepted from 172.28.0.164:60035 #1425994 (400 connections now open) 2015-10-05T06:11:30.421+0100 [conn1425994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:30.451+0100 [conn1425588] end connection 172.28.0.163:49512 (399 connections now open) 2015-10-05T06:11:30.453+0100 [mongosMain] connection accepted from 172.28.0.163:50639 #1425995 (400 connections now open) 2015-10-05T06:11:30.454+0100 [conn1425995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:30.561+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:30.561+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:30.948+0100 [conn1425614] end connection 172.28.0.164:58981 (399 connections now open) 2015-10-05T06:11:30.951+0100 [mongosMain] connection accepted from 172.28.0.164:60039 #1425996 (400 connections now open) 2015-10-05T06:11:30.953+0100 [conn1425996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:31.028+0100 [conn1425615] end connection 172.28.0.163:49609 (399 connections now open) 2015-10-05T06:11:31.029+0100 [mongosMain] connection accepted from 172.28.0.163:50640 #1425997 (400 connections now open) 2015-10-05T06:11:31.030+0100 [conn1425997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:34.072+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:34.869+0100 [conn1425512] end connection 172.28.0.163:49281 (399 connections now open) 2015-10-05T06:11:34.870+0100 [mongosMain] connection accepted from 172.28.0.163:50643 #1425998 (400 connections now open) 2015-10-05T06:11:34.871+0100 [conn1425998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:35.302+0100 [conn1425597] end connection 172.28.0.164:58937 (399 connections now open) 2015-10-05T06:11:35.303+0100 [conn1425540] end connection 172.28.0.164:58743 (398 connections now open) 2015-10-05T06:11:35.303+0100 [mongosMain] connection accepted from 172.28.0.164:60046 #1425999 (399 connections now open) 2015-10-05T06:11:35.304+0100 [mongosMain] connection accepted from 172.28.0.164:60047 #1426000 (400 connections now open) 2015-10-05T06:11:35.306+0100 [conn1425999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:35.306+0100 [conn1426000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:37.638+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:37.638+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:39.442+0100 [mongosMain] connection accepted from 127.0.0.1:50648 #1426001 (401 connections now open) 2015-10-05T06:11:39.444+0100 [conn1426001] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:39.448+0100 [conn1426001] end connection 127.0.0.1:50648 (400 connections now open) 2015-10-05T06:11:40.433+0100 [conn1425553] end connection 172.28.0.164:58782 (399 connections now open) 2015-10-05T06:11:40.435+0100 [mongosMain] connection accepted from 172.28.0.164:60057 #1426002 (400 connections now open) 2015-10-05T06:11:40.436+0100 [conn1426002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:40.467+0100 [conn1425573] end connection 172.28.0.163:49477 (399 connections now open) 2015-10-05T06:11:40.468+0100 [mongosMain] connection accepted from 172.28.0.163:50649 #1426003 (400 connections now open) 2015-10-05T06:11:40.469+0100 [conn1426003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:40.964+0100 [conn1425621] end connection 172.28.0.164:59001 (399 connections now open) 2015-10-05T06:11:40.965+0100 [mongosMain] connection accepted from 172.28.0.164:60060 #1426004 (400 connections now open) 2015-10-05T06:11:40.967+0100 [conn1426004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:41.029+0100 [conn1425622] end connection 172.28.0.163:49621 (399 connections now open) 2015-10-05T06:11:41.030+0100 [mongosMain] connection accepted from 172.28.0.163:50651 #1426005 (400 connections now open) 2015-10-05T06:11:41.031+0100 [conn1426005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:44.882+0100 [conn1425499] end connection 172.28.0.163:49232 (399 connections now open) 2015-10-05T06:11:44.883+0100 [mongosMain] connection accepted from 172.28.0.163:50659 #1426006 (400 connections now open) 2015-10-05T06:11:44.884+0100 [conn1426006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:45.080+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:45.315+0100 [conn1425611] end connection 172.28.0.164:58971 (399 connections now open) 2015-10-05T06:11:45.315+0100 [conn1425623] end connection 172.28.0.164:59007 (398 connections now open) 2015-10-05T06:11:45.316+0100 [mongosMain] connection accepted from 172.28.0.164:60069 #1426007 (399 connections now open) 2015-10-05T06:11:45.317+0100 [mongosMain] connection accepted from 172.28.0.164:60070 #1426008 (400 connections now open) 2015-10-05T06:11:45.317+0100 [conn1426007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:45.319+0100 [conn1426008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:45.642+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:45.642+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:46.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206915703b51053ec0900 2015-10-05T06:11:46.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:11:50.449+0100 [conn1425587] end connection 172.28.0.164:58902 (399 connections now open) 2015-10-05T06:11:50.450+0100 [mongosMain] connection accepted from 172.28.0.164:60076 #1426009 (400 connections now open) 2015-10-05T06:11:50.453+0100 [conn1426009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:50.467+0100 [conn1425599] end connection 172.28.0.163:49563 (399 connections now open) 2015-10-05T06:11:50.468+0100 [mongosMain] connection accepted from 172.28.0.163:50669 #1426010 (400 connections now open) 2015-10-05T06:11:50.469+0100 [conn1426010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:50.979+0100 [conn1425628] end connection 172.28.0.164:59020 (399 connections now open) 2015-10-05T06:11:50.980+0100 [mongosMain] connection accepted from 172.28.0.164:60079 #1426011 (400 connections now open) 2015-10-05T06:11:50.981+0100 [conn1426011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:51.044+0100 [conn1425629] end connection 172.28.0.163:49631 (399 connections now open) 2015-10-05T06:11:51.045+0100 [mongosMain] connection accepted from 172.28.0.163:50670 #1426012 (400 connections now open) 2015-10-05T06:11:51.046+0100 [conn1426012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:54.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:54.653+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:11:54.882+0100 [conn1425565] end connection 172.28.0.163:49439 (399 connections now open) 2015-10-05T06:11:54.883+0100 [mongosMain] connection accepted from 172.28.0.163:50677 #1426013 (400 connections now open) 2015-10-05T06:11:54.884+0100 [conn1426013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:55.316+0100 [conn1425616] end connection 172.28.0.164:58991 (399 connections now open) 2015-10-05T06:11:55.316+0100 [conn1425598] end connection 172.28.0.164:58938 (399 connections now open) 2015-10-05T06:11:55.317+0100 [mongosMain] connection accepted from 172.28.0.164:60088 #1426014 (399 connections now open) 2015-10-05T06:11:55.318+0100 [mongosMain] connection accepted from 172.28.0.164:60089 #1426015 (400 connections now open) 2015-10-05T06:11:55.319+0100 [conn1426014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:55.319+0100 [conn1426015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:11:56.090+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:11:58.814+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:11:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:12:00.465+0100 [conn1425566] end connection 172.28.0.164:58830 (399 connections now open) 2015-10-05T06:12:00.466+0100 [mongosMain] connection accepted from 172.28.0.164:60093 #1426016 (400 connections now open) 2015-10-05T06:12:00.467+0100 [conn1426016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:00.483+0100 [conn1425583] end connection 172.28.0.163:49505 (399 connections now open) 2015-10-05T06:12:00.485+0100 [mongosMain] connection accepted from 172.28.0.163:50687 #1426017 (400 connections now open) 2015-10-05T06:12:00.486+0100 [conn1426017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:00.995+0100 [conn1425632] end connection 172.28.0.164:59040 (399 connections now open) 2015-10-05T06:12:00.996+0100 [mongosMain] connection accepted from 172.28.0.164:60095 #1426018 (400 connections now open) 2015-10-05T06:12:00.998+0100 [conn1426018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:01.045+0100 [conn1425633] end connection 172.28.0.163:49647 (399 connections now open) 2015-10-05T06:12:01.046+0100 [mongosMain] connection accepted from 172.28.0.163:50690 #1426019 (400 connections now open) 2015-10-05T06:12:01.047+0100 [conn1426019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:04.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206a45703b51053ec09c9 2015-10-05T06:12:04.657+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:04.657+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:04.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:04.898+0100 [conn1425609] end connection 172.28.0.163:49598 (399 connections now open) 2015-10-05T06:12:04.898+0100 [conn1425603] end connection 172.28.0.163:49573 (399 connections now open) 2015-10-05T06:12:04.899+0100 [mongosMain] connection accepted from 172.28.0.163:50697 #1426020 (399 connections now open) 2015-10-05T06:12:04.899+0100 [mongosMain] connection accepted from 172.28.0.163:50698 #1426021 (400 connections now open) 2015-10-05T06:12:04.900+0100 [conn1426020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:04.900+0100 [conn1426021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:05.316+0100 [conn1425547] end connection 172.28.0.164:58757 (399 connections now open) 2015-10-05T06:12:05.317+0100 [conn1425581] end connection 172.28.0.164:58873 (398 connections now open) 2015-10-05T06:12:05.317+0100 [mongosMain] connection accepted from 172.28.0.164:60100 #1426022 (399 connections now open) 2015-10-05T06:12:05.318+0100 [mongosMain] connection accepted from 172.28.0.164:60101 #1426023 (400 connections now open) 2015-10-05T06:12:05.319+0100 [conn1426022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:05.320+0100 [conn1426023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:07.098+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:10.481+0100 [conn1425612] end connection 172.28.0.164:58978 (399 connections now open) 2015-10-05T06:12:10.482+0100 [mongosMain] connection accepted from 172.28.0.164:60104 #1426024 (400 connections now open) 2015-10-05T06:12:10.483+0100 [conn1425620] end connection 172.28.0.163:49620 (399 connections now open) 2015-10-05T06:12:10.484+0100 [conn1426024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:10.484+0100 [mongosMain] connection accepted from 172.28.0.163:50711 #1426025 (400 connections now open) 2015-10-05T06:12:10.486+0100 [conn1426025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:10.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206aa5703b51053ec0a10 2015-10-05T06:12:10.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:11.010+0100 [conn1425636] end connection 172.28.0.164:59070 (399 connections now open) 2015-10-05T06:12:11.011+0100 [mongosMain] connection accepted from 172.28.0.164:60106 #1426026 (400 connections now open) 2015-10-05T06:12:11.013+0100 [conn1426026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:11.060+0100 [conn1425637] end connection 172.28.0.163:49680 (399 connections now open) 2015-10-05T06:12:11.061+0100 [mongosMain] connection accepted from 172.28.0.163:50714 #1426027 (400 connections now open) 2015-10-05T06:12:11.062+0100 [conn1426027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:14.913+0100 [conn1425638] end connection 172.28.0.163:49686 (399 connections now open) 2015-10-05T06:12:14.913+0100 [conn1425550] end connection 172.28.0.163:49394 (398 connections now open) 2015-10-05T06:12:14.914+0100 [mongosMain] connection accepted from 172.28.0.163:50720 #1426028 (399 connections now open) 2015-10-05T06:12:14.914+0100 [mongosMain] connection accepted from 172.28.0.163:50721 #1426029 (400 connections now open) 2015-10-05T06:12:14.915+0100 [conn1426028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:14.916+0100 [conn1426029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:15.332+0100 [conn1425630] end connection 172.28.0.164:59029 (399 connections now open) 2015-10-05T06:12:15.332+0100 [conn1425557] end connection 172.28.0.164:58790 (398 connections now open) 2015-10-05T06:12:15.333+0100 [mongosMain] connection accepted from 172.28.0.164:60111 #1426030 (399 connections now open) 2015-10-05T06:12:15.334+0100 [mongosMain] connection accepted from 172.28.0.164:60110 #1426031 (400 connections now open) 2015-10-05T06:12:15.335+0100 [conn1426030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:15.335+0100 [conn1426031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:15.663+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:15.663+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:17.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206b05703b51053ec0a5e 2015-10-05T06:12:17.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:18.110+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:20.480+0100 [conn1425619] end connection 172.28.0.164:58998 (399 connections now open) 2015-10-05T06:12:20.481+0100 [mongosMain] connection accepted from 172.28.0.164:60119 #1426032 (400 connections now open) 2015-10-05T06:12:20.482+0100 [conn1426032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:20.499+0100 [conn1425613] end connection 172.28.0.163:49607 (399 connections now open) 2015-10-05T06:12:20.500+0100 [mongosMain] connection accepted from 172.28.0.163:50731 #1426033 (400 connections now open) 2015-10-05T06:12:20.501+0100 [conn1426033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:21.026+0100 [conn1425643] end connection 172.28.0.164:59087 (399 connections now open) 2015-10-05T06:12:21.028+0100 [mongosMain] connection accepted from 172.28.0.164:60121 #1426034 (400 connections now open) 2015-10-05T06:12:21.030+0100 [conn1426034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:21.061+0100 [conn1425644] end connection 172.28.0.163:49704 (399 connections now open) 2015-10-05T06:12:21.063+0100 [mongosMain] connection accepted from 172.28.0.163:50733 #1426035 (400 connections now open) 2015-10-05T06:12:21.063+0100 [conn1426035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:23.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206b75703b51053ec0ab2 2015-10-05T06:12:23.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:24.914+0100 [conn1425602] end connection 172.28.0.163:49572 (399 connections now open) 2015-10-05T06:12:24.914+0100 [conn1425574] end connection 172.28.0.163:49482 (399 connections now open) 2015-10-05T06:12:24.915+0100 [mongosMain] connection accepted from 172.28.0.163:50735 #1426036 (399 connections now open) 2015-10-05T06:12:24.915+0100 [mongosMain] connection accepted from 172.28.0.163:50736 #1426037 (400 connections now open) 2015-10-05T06:12:24.916+0100 [conn1426036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:24.916+0100 [conn1426037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:25.348+0100 [conn1425647] end connection 172.28.0.164:59094 (399 connections now open) 2015-10-05T06:12:25.348+0100 [conn1425519] end connection 172.28.0.164:58684 (399 connections now open) 2015-10-05T06:12:25.348+0100 [mongosMain] connection accepted from 172.28.0.164:60130 #1426038 (399 connections now open) 2015-10-05T06:12:25.349+0100 [mongosMain] connection accepted from 172.28.0.164:60131 #1426039 (400 connections now open) 2015-10-05T06:12:25.350+0100 [conn1426038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:25.352+0100 [conn1426039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:27.684+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:27.684+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:28.841+0100 [mongosMain] connection accepted from 127.0.0.1:50742 #1426040 (401 connections now open) 2015-10-05T06:12:28.844+0100 [conn1426040] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:28.850+0100 [conn1426040] end connection 127.0.0.1:50742 (400 connections now open) 2015-10-05T06:12:29.083+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:12:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:12:29.119+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:29.705+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:29.705+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:30.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206bd5703b51053ec0b03 2015-10-05T06:12:30.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:30.496+0100 [conn1425494] end connection 172.28.0.164:58622 (399 connections now open) 2015-10-05T06:12:30.498+0100 [mongosMain] connection accepted from 172.28.0.164:60139 #1426041 (400 connections now open) 2015-10-05T06:12:30.499+0100 [conn1425567] end connection 172.28.0.163:49449 (399 connections now open) 2015-10-05T06:12:30.500+0100 [mongosMain] connection accepted from 172.28.0.163:50743 #1426042 (400 connections now open) 2015-10-05T06:12:30.500+0100 [conn1426041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:30.501+0100 [conn1426042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:31.043+0100 [conn1425651] end connection 172.28.0.164:59109 (399 connections now open) 2015-10-05T06:12:31.044+0100 [mongosMain] connection accepted from 172.28.0.164:60142 #1426043 (400 connections now open) 2015-10-05T06:12:31.046+0100 [conn1426043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:31.076+0100 [conn1425652] end connection 172.28.0.163:49730 (399 connections now open) 2015-10-05T06:12:31.077+0100 [mongosMain] connection accepted from 172.28.0.163:50745 #1426044 (400 connections now open) 2015-10-05T06:12:31.078+0100 [conn1426044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:32.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:32.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:34.929+0100 [conn1425596] end connection 172.28.0.163:49550 (399 connections now open) 2015-10-05T06:12:34.930+0100 [mongosMain] connection accepted from 172.28.0.163:50748 #1426045 (400 connections now open) 2015-10-05T06:12:34.931+0100 [conn1426045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:35.348+0100 [conn1425575] end connection 172.28.0.164:58855 (399 connections now open) 2015-10-05T06:12:35.349+0100 [conn1425655] end connection 172.28.0.164:59117 (398 connections now open) 2015-10-05T06:12:35.349+0100 [mongosMain] connection accepted from 172.28.0.164:60152 #1426046 (399 connections now open) 2015-10-05T06:12:35.350+0100 [mongosMain] connection accepted from 172.28.0.164:60153 #1426047 (400 connections now open) 2015-10-05T06:12:35.352+0100 [conn1426046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:35.352+0100 [conn1426047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:36.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206c45703b51053ec0b4d 2015-10-05T06:12:36.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:36.710+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:36.710+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:39.944+0100 [mongosMain] connection accepted from 127.0.0.1:50753 #1426048 (401 connections now open) 2015-10-05T06:12:39.948+0100 [conn1426048] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:39.952+0100 [conn1426048] end connection 127.0.0.1:50753 (400 connections now open) 2015-10-05T06:12:40.216+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:40.496+0100 [conn1425593] end connection 172.28.0.164:58927 (399 connections now open) 2015-10-05T06:12:40.497+0100 [mongosMain] connection accepted from 172.28.0.164:60163 #1426049 (400 connections now open) 2015-10-05T06:12:40.500+0100 [conn1426049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:40.514+0100 [conn1425642] end connection 172.28.0.163:49702 (399 connections now open) 2015-10-05T06:12:40.516+0100 [mongosMain] connection accepted from 172.28.0.163:50754 #1426050 (400 connections now open) 2015-10-05T06:12:40.517+0100 [conn1426050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:41.042+0100 [conn1425657] end connection 172.28.0.164:59127 (399 connections now open) 2015-10-05T06:12:41.044+0100 [mongosMain] connection accepted from 172.28.0.164:60165 #1426051 (400 connections now open) 2015-10-05T06:12:41.045+0100 [conn1426051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:41.091+0100 [conn1425658] end connection 172.28.0.163:49743 (399 connections now open) 2015-10-05T06:12:41.092+0100 [mongosMain] connection accepted from 172.28.0.163:50758 #1426052 (400 connections now open) 2015-10-05T06:12:41.093+0100 [conn1426052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:41.716+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:41.717+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:42.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206ca5703b51053ec0b99 2015-10-05T06:12:42.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:45.364+0100 [conn1425640] end connection 172.28.0.164:59077 (399 connections now open) 2015-10-05T06:12:45.365+0100 [mongosMain] connection accepted from 172.28.0.164:60173 #1426053 (400 connections now open) 2015-10-05T06:12:45.366+0100 [conn1426053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:47.729+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:47.729+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:49.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206d05703b51053ec0bcd 2015-10-05T06:12:49.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:50.512+0100 [conn1425558] end connection 172.28.0.164:58799 (399 connections now open) 2015-10-05T06:12:50.513+0100 [mongosMain] connection accepted from 172.28.0.164:60182 #1426054 (400 connections now open) 2015-10-05T06:12:50.515+0100 [conn1426054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:50.517+0100 [conn1425635] end connection 172.28.0.163:49677 (399 connections now open) 2015-10-05T06:12:50.519+0100 [mongosMain] connection accepted from 172.28.0.163:50776 #1426055 (400 connections now open) 2015-10-05T06:12:50.519+0100 [conn1426055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:51.059+0100 [conn1425665] end connection 172.28.0.164:59146 (399 connections now open) 2015-10-05T06:12:51.060+0100 [mongosMain] connection accepted from 172.28.0.164:60184 #1426056 (400 connections now open) 2015-10-05T06:12:51.062+0100 [conn1426056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:51.094+0100 [conn1425666] end connection 172.28.0.163:49757 (399 connections now open) 2015-10-05T06:12:51.095+0100 [mongosMain] connection accepted from 172.28.0.163:50778 #1426057 (400 connections now open) 2015-10-05T06:12:51.097+0100 [conn1426057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:51.221+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:54.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:12:54.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:12:54.945+0100 [conn1425653] end connection 172.28.0.163:49734 (399 connections now open) 2015-10-05T06:12:54.946+0100 [mongosMain] connection accepted from 172.28.0.163:50785 #1426058 (400 connections now open) 2015-10-05T06:12:54.948+0100 [conn1426058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:55.380+0100 [conn1425661] end connection 172.28.0.164:59133 (399 connections now open) 2015-10-05T06:12:55.381+0100 [mongosMain] connection accepted from 172.28.0.164:60192 #1426059 (400 connections now open) 2015-10-05T06:12:55.383+0100 [conn1426059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:12:55.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206d75703b51053ec0c01 2015-10-05T06:12:55.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:12:59.215+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:12:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:13:00.512+0100 [conn1425631] end connection 172.28.0.164:59038 (399 connections now open) 2015-10-05T06:13:00.513+0100 [mongosMain] connection accepted from 172.28.0.164:60197 #1426060 (400 connections now open) 2015-10-05T06:13:00.515+0100 [conn1426060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:00.530+0100 [conn1425594] end connection 172.28.0.163:49540 (399 connections now open) 2015-10-05T06:13:00.532+0100 [mongosMain] connection accepted from 172.28.0.163:50799 #1426061 (400 connections now open) 2015-10-05T06:13:00.534+0100 [conn1426061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:01.058+0100 [conn1425671] end connection 172.28.0.164:59164 (399 connections now open) 2015-10-05T06:13:01.059+0100 [mongosMain] connection accepted from 172.28.0.164:60201 #1426062 (400 connections now open) 2015-10-05T06:13:01.061+0100 [conn1426062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:01.107+0100 [conn1425672] end connection 172.28.0.163:49775 (399 connections now open) 2015-10-05T06:13:01.108+0100 [mongosMain] connection accepted from 172.28.0.163:50800 #1426063 (400 connections now open) 2015-10-05T06:13:01.109+0100 [conn1426063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:02.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206dd5703b51053ec0c34 2015-10-05T06:13:02.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:02.231+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:02.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:02.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:04.949+0100 [conn1425646] end connection 172.28.0.163:49713 (399 connections now open) 2015-10-05T06:13:04.949+0100 [conn1425645] end connection 172.28.0.163:49712 (399 connections now open) 2015-10-05T06:13:04.950+0100 [mongosMain] connection accepted from 172.28.0.163:50809 #1426064 (399 connections now open) 2015-10-05T06:13:04.951+0100 [mongosMain] connection accepted from 172.28.0.163:50810 #1426065 (400 connections now open) 2015-10-05T06:13:04.951+0100 [conn1426064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:04.951+0100 [conn1426065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:05.379+0100 [conn1425439] end connection 172.28.0.164:58480 (399 connections now open) 2015-10-05T06:13:05.380+0100 [mongosMain] connection accepted from 172.28.0.164:60204 #1426066 (400 connections now open) 2015-10-05T06:13:05.381+0100 [conn1426066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:08.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206e45703b51053ec0c76 2015-10-05T06:13:08.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:10.513+0100 [conn1425634] end connection 172.28.0.164:59067 (399 connections now open) 2015-10-05T06:13:10.514+0100 [mongosMain] connection accepted from 172.28.0.164:60206 #1426067 (400 connections now open) 2015-10-05T06:13:10.516+0100 [conn1426067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:10.546+0100 [conn1425664] end connection 172.28.0.163:49755 (399 connections now open) 2015-10-05T06:13:10.547+0100 [mongosMain] connection accepted from 172.28.0.163:50821 #1426068 (400 connections now open) 2015-10-05T06:13:10.548+0100 [conn1426068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:11.059+0100 [conn1425678] end connection 172.28.0.164:59182 (399 connections now open) 2015-10-05T06:13:11.061+0100 [mongosMain] connection accepted from 172.28.0.164:60208 #1426069 (400 connections now open) 2015-10-05T06:13:11.062+0100 [conn1426069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:11.108+0100 [conn1425679] end connection 172.28.0.163:49802 (399 connections now open) 2015-10-05T06:13:11.109+0100 [mongosMain] connection accepted from 172.28.0.163:50824 #1426070 (400 connections now open) 2015-10-05T06:13:11.110+0100 [conn1426070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:11.734+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:11.734+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:13.230+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:14.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206ea5703b51053ec0ca6 2015-10-05T06:13:14.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:14.960+0100 [conn1425673] end connection 172.28.0.163:49781 (399 connections now open) 2015-10-05T06:13:14.962+0100 [mongosMain] connection accepted from 172.28.0.163:50830 #1426071 (400 connections now open) 2015-10-05T06:13:14.963+0100 [conn1426071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:15.394+0100 [conn1425604] end connection 172.28.0.164:58955 (399 connections now open) 2015-10-05T06:13:15.395+0100 [conn1425662] end connection 172.28.0.164:59134 (398 connections now open) 2015-10-05T06:13:15.395+0100 [mongosMain] connection accepted from 172.28.0.164:60211 #1426072 (399 connections now open) 2015-10-05T06:13:15.396+0100 [mongosMain] connection accepted from 172.28.0.164:60212 #1426073 (400 connections now open) 2015-10-05T06:13:15.397+0100 [conn1426072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:15.397+0100 [conn1426073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:20.528+0100 [conn1425606] end connection 172.28.0.164:58960 (399 connections now open) 2015-10-05T06:13:20.529+0100 [mongosMain] connection accepted from 172.28.0.164:60220 #1426074 (400 connections now open) 2015-10-05T06:13:20.530+0100 [conn1426074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:20.546+0100 [conn1425670] end connection 172.28.0.163:49773 (399 connections now open) 2015-10-05T06:13:20.547+0100 [mongosMain] connection accepted from 172.28.0.163:50835 #1426075 (400 connections now open) 2015-10-05T06:13:20.549+0100 [conn1426075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:20.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206f05703b51053ec0cd6 2015-10-05T06:13:20.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:21.075+0100 [conn1425685] end connection 172.28.0.164:59192 (399 connections now open) 2015-10-05T06:13:21.076+0100 [mongosMain] connection accepted from 172.28.0.164:60224 #1426076 (400 connections now open) 2015-10-05T06:13:21.078+0100 [conn1426076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:21.123+0100 [conn1425686] end connection 172.28.0.163:49823 (399 connections now open) 2015-10-05T06:13:21.124+0100 [mongosMain] connection accepted from 172.28.0.163:50839 #1426077 (400 connections now open) 2015-10-05T06:13:21.125+0100 [conn1426077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:21.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:21.802+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:24.231+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:24.965+0100 [conn1425667] end connection 172.28.0.163:49765 (399 connections now open) 2015-10-05T06:13:24.966+0100 [mongosMain] connection accepted from 172.28.0.163:50842 #1426078 (400 connections now open) 2015-10-05T06:13:24.967+0100 [conn1426078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:25.395+0100 [conn1425681] end connection 172.28.0.164:59187 (399 connections now open) 2015-10-05T06:13:25.395+0100 [conn1425571] end connection 172.28.0.164:58846 (398 connections now open) 2015-10-05T06:13:25.396+0100 [mongosMain] connection accepted from 172.28.0.164:60233 #1426079 (399 connections now open) 2015-10-05T06:13:25.396+0100 [mongosMain] connection accepted from 172.28.0.164:60234 #1426080 (400 connections now open) 2015-10-05T06:13:25.397+0100 [conn1426079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:25.398+0100 [conn1426080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:27.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561206f65703b51053ec0d0a 2015-10-05T06:13:27.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:28.741+0100 [mongosMain] connection accepted from 127.0.0.1:50847 #1426081 (401 connections now open) 2015-10-05T06:13:28.743+0100 [conn1426081] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:28.749+0100 [conn1426081] end connection 127.0.0.1:50847 (400 connections now open) 2015-10-05T06:13:29.500+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:13:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:13:30.543+0100 [conn1425683] end connection 172.28.0.164:59190 (399 connections now open) 2015-10-05T06:13:30.544+0100 [mongosMain] connection accepted from 172.28.0.164:60243 #1426082 (400 connections now open) 2015-10-05T06:13:30.546+0100 [conn1426082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:30.562+0100 [conn1425677] end connection 172.28.0.163:49798 (399 connections now open) 2015-10-05T06:13:30.563+0100 [mongosMain] connection accepted from 172.28.0.163:50851 #1426083 (400 connections now open) 2015-10-05T06:13:30.564+0100 [conn1426083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:31.089+0100 [conn1425692] end connection 172.28.0.164:59207 (399 connections now open) 2015-10-05T06:13:31.091+0100 [mongosMain] connection accepted from 172.28.0.164:60245 #1426084 (400 connections now open) 2015-10-05T06:13:31.092+0100 [conn1426084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:31.124+0100 [conn1425693] end connection 172.28.0.163:49836 (399 connections now open) 2015-10-05T06:13:31.126+0100 [mongosMain] connection accepted from 172.28.0.163:50853 #1426085 (400 connections now open) 2015-10-05T06:13:31.127+0100 [conn1426085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:32.805+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:32.806+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:34.976+0100 [conn1425660] end connection 172.28.0.163:49748 (399 connections now open) 2015-10-05T06:13:34.977+0100 [mongosMain] connection accepted from 172.28.0.163:50857 #1426086 (400 connections now open) 2015-10-05T06:13:34.978+0100 [conn1426086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:35.236+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:35.411+0100 [conn1425514] end connection 172.28.0.164:58664 (399 connections now open) 2015-10-05T06:13:35.412+0100 [mongosMain] connection accepted from 172.28.0.164:60254 #1426087 (400 connections now open) 2015-10-05T06:13:35.417+0100 [conn1426087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:39.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207035703b51053ec0d69 2015-10-05T06:13:39.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:40.142+0100 [mongosMain] connection accepted from 127.0.0.1:50861 #1426088 (401 connections now open) 2015-10-05T06:13:40.145+0100 [conn1426088] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:40.149+0100 [conn1426088] end connection 127.0.0.1:50861 (400 connections now open) 2015-10-05T06:13:40.560+0100 [conn1425641] end connection 172.28.0.164:59084 (399 connections now open) 2015-10-05T06:13:40.562+0100 [mongosMain] connection accepted from 172.28.0.164:60265 #1426089 (400 connections now open) 2015-10-05T06:13:40.562+0100 [conn1425627] end connection 172.28.0.163:49629 (399 connections now open) 2015-10-05T06:13:40.563+0100 [mongosMain] connection accepted from 172.28.0.163:50863 #1426090 (400 connections now open) 2015-10-05T06:13:40.564+0100 [conn1426089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:40.564+0100 [conn1426090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:41.105+0100 [conn1425699] end connection 172.28.0.164:59230 (399 connections now open) 2015-10-05T06:13:41.107+0100 [mongosMain] connection accepted from 172.28.0.164:60267 #1426091 (400 connections now open) 2015-10-05T06:13:41.108+0100 [conn1426091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:41.139+0100 [conn1425700] end connection 172.28.0.163:49849 (399 connections now open) 2015-10-05T06:13:41.140+0100 [mongosMain] connection accepted from 172.28.0.163:50865 #1426092 (400 connections now open) 2015-10-05T06:13:41.141+0100 [conn1426092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:44.829+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:44.829+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:44.992+0100 [conn1425680] end connection 172.28.0.163:49810 (399 connections now open) 2015-10-05T06:13:45.012+0100 [mongosMain] connection accepted from 172.28.0.163:50873 #1426093 (400 connections now open) 2015-10-05T06:13:45.013+0100 [conn1426093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:45.411+0100 [conn1425702] end connection 172.28.0.164:59238 (399 connections now open) 2015-10-05T06:13:45.411+0100 [conn1425617] end connection 172.28.0.164:58989 (398 connections now open) 2015-10-05T06:13:45.412+0100 [mongosMain] connection accepted from 172.28.0.164:60279 #1426094 (399 connections now open) 2015-10-05T06:13:45.412+0100 [mongosMain] connection accepted from 172.28.0.164:60280 #1426095 (400 connections now open) 2015-10-05T06:13:45.413+0100 [conn1426094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:45.414+0100 [conn1426095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:46.265+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:46.843+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:46.843+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:49.844+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:49.844+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:50.559+0100 [conn1425676] end connection 172.28.0.164:59179 (399 connections now open) 2015-10-05T06:13:50.560+0100 [mongosMain] connection accepted from 172.28.0.164:60291 #1426096 (400 connections now open) 2015-10-05T06:13:50.562+0100 [conn1426096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:51.105+0100 [conn1425707] end connection 172.28.0.164:59255 (399 connections now open) 2015-10-05T06:13:51.106+0100 [mongosMain] connection accepted from 172.28.0.164:60293 #1426097 (400 connections now open) 2015-10-05T06:13:51.108+0100 [conn1426097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:51.139+0100 [conn1425708] end connection 172.28.0.163:49863 (399 connections now open) 2015-10-05T06:13:51.140+0100 [mongosMain] connection accepted from 172.28.0.163:50886 #1426098 (400 connections now open) 2015-10-05T06:13:51.141+0100 [conn1426098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:51.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612070f5703b51053ec0dba 2015-10-05T06:13:51.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:13:53.847+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:53.848+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:55.427+0100 [conn1425695] end connection 172.28.0.164:59216 (399 connections now open) 2015-10-05T06:13:55.428+0100 [mongosMain] connection accepted from 172.28.0.164:60302 #1426099 (400 connections now open) 2015-10-05T06:13:55.429+0100 [conn1426099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:13:57.279+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:58.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:13:58.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:13:59.638+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:13:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:14:00.576+0100 [conn1425626] end connection 172.28.0.164:59018 (399 connections now open) 2015-10-05T06:14:00.577+0100 [mongosMain] connection accepted from 172.28.0.164:60307 #1426100 (400 connections now open) 2015-10-05T06:14:00.579+0100 [conn1426100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:01.121+0100 [conn1425712] end connection 172.28.0.164:59274 (399 connections now open) 2015-10-05T06:14:01.122+0100 [mongosMain] connection accepted from 172.28.0.164:60309 #1426101 (400 connections now open) 2015-10-05T06:14:01.124+0100 [conn1426101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:01.155+0100 [conn1425713] end connection 172.28.0.163:49882 (399 connections now open) 2015-10-05T06:14:01.156+0100 [mongosMain] connection accepted from 172.28.0.163:50907 #1426102 (400 connections now open) 2015-10-05T06:14:01.157+0100 [conn1426102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:04.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612071b5703b51053ec0e1d 2015-10-05T06:14:04.385+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:14:04.860+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:04.860+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:05.024+0100 [conn1425687] end connection 172.28.0.163:49828 (399 connections now open) 2015-10-05T06:14:05.024+0100 [conn1425639] end connection 172.28.0.163:49687 (398 connections now open) 2015-10-05T06:14:05.025+0100 [mongosMain] connection accepted from 172.28.0.163:50915 #1426103 (399 connections now open) 2015-10-05T06:14:05.025+0100 [mongosMain] connection accepted from 172.28.0.163:50916 #1426104 (400 connections now open) 2015-10-05T06:14:05.026+0100 [conn1426103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:05.026+0100 [conn1426104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:08.284+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:10.575+0100 [conn1425704] end connection 172.28.0.164:59251 (399 connections now open) 2015-10-05T06:14:10.576+0100 [mongosMain] connection accepted from 172.28.0.164:60318 #1426105 (400 connections now open) 2015-10-05T06:14:10.577+0100 [conn1426105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:11.121+0100 [conn1425716] end connection 172.28.0.164:59287 (399 connections now open) 2015-10-05T06:14:11.122+0100 [mongosMain] connection accepted from 172.28.0.164:60320 #1426106 (400 connections now open) 2015-10-05T06:14:11.124+0100 [conn1426106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:11.170+0100 [conn1425717] end connection 172.28.0.163:49901 (399 connections now open) 2015-10-05T06:14:11.171+0100 [mongosMain] connection accepted from 172.28.0.163:50927 #1426107 (400 connections now open) 2015-10-05T06:14:11.172+0100 [conn1426107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:11.863+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:11.863+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:15.039+0100 [conn1425586] end connection 172.28.0.163:49510 (399 connections now open) 2015-10-05T06:14:15.039+0100 [conn1425701] end connection 172.28.0.163:49852 (399 connections now open) 2015-10-05T06:14:15.040+0100 [mongosMain] connection accepted from 172.28.0.163:50935 #1426108 (399 connections now open) 2015-10-05T06:14:15.041+0100 [mongosMain] connection accepted from 172.28.0.163:50936 #1426109 (400 connections now open) 2015-10-05T06:14:15.041+0100 [conn1426108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:15.042+0100 [conn1426109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:15.458+0100 [conn1425719] end connection 172.28.0.164:59292 (399 connections now open) 2015-10-05T06:14:15.459+0100 [mongosMain] connection accepted from 172.28.0.164:60329 #1426110 (400 connections now open) 2015-10-05T06:14:15.461+0100 [conn1426110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:19.301+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:19.869+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:19.869+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:20.609+0100 [conn1425650] end connection 172.28.0.163:49727 (399 connections now open) 2015-10-05T06:14:20.610+0100 [mongosMain] connection accepted from 172.28.0.163:50946 #1426111 (400 connections now open) 2015-10-05T06:14:20.611+0100 [conn1426111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:21.137+0100 [conn1425720] end connection 172.28.0.164:59296 (399 connections now open) 2015-10-05T06:14:21.138+0100 [mongosMain] connection accepted from 172.28.0.164:60340 #1426112 (400 connections now open) 2015-10-05T06:14:21.139+0100 [conn1426112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:21.171+0100 [conn1425721] end connection 172.28.0.163:49922 (399 connections now open) 2015-10-05T06:14:21.173+0100 [mongosMain] connection accepted from 172.28.0.163:50948 #1426113 (400 connections now open) 2015-10-05T06:14:21.174+0100 [conn1426113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:22.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612072e5703b51053ec0e8a 2015-10-05T06:14:22.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:14:25.094+0100 [conn1425709] end connection 172.28.0.163:49871 (399 connections now open) 2015-10-05T06:14:25.094+0100 [conn1425718] end connection 172.28.0.163:49910 (399 connections now open) 2015-10-05T06:14:25.094+0100 [mongosMain] connection accepted from 172.28.0.163:50951 #1426114 (399 connections now open) 2015-10-05T06:14:25.094+0100 [mongosMain] connection accepted from 172.28.0.163:50952 #1426115 (400 connections now open) 2015-10-05T06:14:25.094+0100 [conn1426114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:25.094+0100 [conn1426115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:25.499+0100 [conn1425723] end connection 172.28.0.164:59300 (399 connections now open) 2015-10-05T06:14:25.499+0100 [mongosMain] connection accepted from 172.28.0.164:60349 #1426116 (400 connections now open) 2015-10-05T06:14:25.499+0100 [conn1426116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:28.279+0100 [mongosMain] connection accepted from 127.0.0.1:50956 #1426117 (401 connections now open) 2015-10-05T06:14:28.282+0100 [conn1426117] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:28.287+0100 [conn1426117] end connection 127.0.0.1:50956 (400 connections now open) 2015-10-05T06:14:28.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207345703b51053ec0eb4 2015-10-05T06:14:28.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:14:28.889+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:28.889+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:29.938+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:14:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:14:30.311+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:30.609+0100 [conn1425684] end connection 172.28.0.163:49818 (399 connections now open) 2015-10-05T06:14:30.610+0100 [mongosMain] connection accepted from 172.28.0.163:50960 #1426118 (400 connections now open) 2015-10-05T06:14:30.611+0100 [conn1426118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:31.137+0100 [conn1425725] end connection 172.28.0.164:59309 (399 connections now open) 2015-10-05T06:14:31.138+0100 [mongosMain] connection accepted from 172.28.0.164:60359 #1426119 (400 connections now open) 2015-10-05T06:14:31.140+0100 [conn1426119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:31.186+0100 [conn1425726] end connection 172.28.0.163:49937 (399 connections now open) 2015-10-05T06:14:31.187+0100 [mongosMain] connection accepted from 172.28.0.163:50962 #1426120 (400 connections now open) 2015-10-05T06:14:31.189+0100 [conn1426120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:35.059+0100 [conn1425556] end connection 172.28.0.163:49405 (399 connections now open) 2015-10-05T06:14:35.059+0100 [conn1425722] end connection 172.28.0.163:49928 (398 connections now open) 2015-10-05T06:14:35.060+0100 [mongosMain] connection accepted from 172.28.0.163:50964 #1426121 (399 connections now open) 2015-10-05T06:14:35.060+0100 [mongosMain] connection accepted from 172.28.0.163:50965 #1426122 (400 connections now open) 2015-10-05T06:14:35.061+0100 [conn1426121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:35.061+0100 [conn1426122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:35.474+0100 [conn1425688] end connection 172.28.0.164:59197 (399 connections now open) 2015-10-05T06:14:35.476+0100 [mongosMain] connection accepted from 172.28.0.164:60370 #1426123 (400 connections now open) 2015-10-05T06:14:35.478+0100 [conn1426123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:38.900+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:38.901+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:39.823+0100 [mongosMain] connection accepted from 127.0.0.1:50970 #1426124 (401 connections now open) 2015-10-05T06:14:39.826+0100 [conn1426124] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:39.832+0100 [conn1426124] end connection 127.0.0.1:50970 (400 connections now open) 2015-10-05T06:14:40.606+0100 [conn1425690] end connection 172.28.0.164:59205 (399 connections now open) 2015-10-05T06:14:40.607+0100 [mongosMain] connection accepted from 172.28.0.164:60380 #1426125 (400 connections now open) 2015-10-05T06:14:40.608+0100 [conn1426125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:40.624+0100 [conn1425698] end connection 172.28.0.163:49847 (399 connections now open) 2015-10-05T06:14:40.625+0100 [mongosMain] connection accepted from 172.28.0.163:50974 #1426126 (400 connections now open) 2015-10-05T06:14:40.626+0100 [conn1426126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:41.152+0100 [conn1425732] end connection 172.28.0.164:59328 (399 connections now open) 2015-10-05T06:14:41.153+0100 [mongosMain] connection accepted from 172.28.0.164:60383 #1426127 (400 connections now open) 2015-10-05T06:14:41.155+0100 [conn1426127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:41.187+0100 [conn1425733] end connection 172.28.0.163:49948 (399 connections now open) 2015-10-05T06:14:41.188+0100 [mongosMain] connection accepted from 172.28.0.163:50976 #1426128 (400 connections now open) 2015-10-05T06:14:41.189+0100 [conn1426128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:41.317+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:45.070+0100 [conn1425728] end connection 172.28.0.163:49943 (399 connections now open) 2015-10-05T06:14:45.070+0100 [conn1425674] end connection 172.28.0.163:49782 (398 connections now open) 2015-10-05T06:14:45.071+0100 [mongosMain] connection accepted from 172.28.0.163:50982 #1426129 (399 connections now open) 2015-10-05T06:14:45.072+0100 [mongosMain] connection accepted from 172.28.0.163:50983 #1426130 (400 connections now open) 2015-10-05T06:14:45.072+0100 [conn1426129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:45.073+0100 [conn1426130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:45.490+0100 [conn1425729] end connection 172.28.0.164:59317 (399 connections now open) 2015-10-05T06:14:45.492+0100 [mongosMain] connection accepted from 172.28.0.164:60391 #1426131 (400 connections now open) 2015-10-05T06:14:45.493+0100 [conn1426131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:49.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:49.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:14:50.622+0100 [conn1425715] end connection 172.28.0.164:59285 (399 connections now open) 2015-10-05T06:14:50.623+0100 [mongosMain] connection accepted from 172.28.0.164:60400 #1426132 (400 connections now open) 2015-10-05T06:14:50.625+0100 [conn1426132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:51.168+0100 [conn1425740] end connection 172.28.0.164:59353 (399 connections now open) 2015-10-05T06:14:51.169+0100 [mongosMain] connection accepted from 172.28.0.164:60403 #1426133 (400 connections now open) 2015-10-05T06:14:51.172+0100 [conn1426133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:51.201+0100 [conn1425741] end connection 172.28.0.163:49961 (399 connections now open) 2015-10-05T06:14:51.202+0100 [mongosMain] connection accepted from 172.28.0.163:50993 #1426134 (400 connections now open) 2015-10-05T06:14:51.203+0100 [conn1426134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:52.419+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:14:53.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612074c5703b51053ec0f9a 2015-10-05T06:14:53.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:14:55.071+0100 [conn1425735] end connection 172.28.0.163:49953 (399 connections now open) 2015-10-05T06:14:55.072+0100 [conn1425743] end connection 172.28.0.163:49970 (399 connections now open) 2015-10-05T06:14:55.073+0100 [mongosMain] connection accepted from 172.28.0.163:51002 #1426135 (399 connections now open) 2015-10-05T06:14:55.073+0100 [mongosMain] connection accepted from 172.28.0.163:51003 #1426136 (400 connections now open) 2015-10-05T06:14:55.074+0100 [conn1426135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:55.074+0100 [conn1426136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:55.490+0100 [conn1425736] end connection 172.28.0.164:59337 (399 connections now open) 2015-10-05T06:14:55.491+0100 [mongosMain] connection accepted from 172.28.0.164:60410 #1426137 (400 connections now open) 2015-10-05T06:14:55.493+0100 [conn1426137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:14:59.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207535703b51053ec0fd0 2015-10-05T06:14:59.525+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:00.209+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:14:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:15:00.622+0100 [conn1425711] end connection 172.28.0.164:59271 (399 connections now open) 2015-10-05T06:15:00.624+0100 [mongosMain] connection accepted from 172.28.0.164:60418 #1426138 (400 connections now open) 2015-10-05T06:15:00.625+0100 [conn1426138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:00.640+0100 [conn1425739] end connection 172.28.0.163:49957 (399 connections now open) 2015-10-05T06:15:00.641+0100 [mongosMain] connection accepted from 172.28.0.163:51014 #1426139 (400 connections now open) 2015-10-05T06:15:00.642+0100 [conn1426139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:01.168+0100 [conn1425747] end connection 172.28.0.164:59373 (399 connections now open) 2015-10-05T06:15:01.170+0100 [mongosMain] connection accepted from 172.28.0.164:60420 #1426140 (400 connections now open) 2015-10-05T06:15:01.171+0100 [conn1426140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:01.929+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:01.930+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:03.432+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:03.932+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:03.932+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:05.086+0100 [conn1425694] end connection 172.28.0.163:49840 (399 connections now open) 2015-10-05T06:15:05.087+0100 [conn1425727] end connection 172.28.0.163:49942 (398 connections now open) 2015-10-05T06:15:05.088+0100 [mongosMain] connection accepted from 172.28.0.163:51027 #1426141 (399 connections now open) 2015-10-05T06:15:05.088+0100 [mongosMain] connection accepted from 172.28.0.163:51028 #1426142 (400 connections now open) 2015-10-05T06:15:05.089+0100 [conn1426141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:05.089+0100 [conn1426142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:05.506+0100 [conn1425744] end connection 172.28.0.164:59361 (399 connections now open) 2015-10-05T06:15:05.507+0100 [mongosMain] connection accepted from 172.28.0.164:60425 #1426143 (400 connections now open) 2015-10-05T06:15:05.509+0100 [conn1426143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:06.943+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:06.943+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:10.637+0100 [conn1425649] end connection 172.28.0.164:59106 (399 connections now open) 2015-10-05T06:15:10.639+0100 [mongosMain] connection accepted from 172.28.0.164:60429 #1426144 (400 connections now open) 2015-10-05T06:15:10.641+0100 [conn1426144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:10.946+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:10.946+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:11.183+0100 [conn1425755] end connection 172.28.0.164:59391 (399 connections now open) 2015-10-05T06:15:11.185+0100 [mongosMain] connection accepted from 172.28.0.164:60431 #1426145 (400 connections now open) 2015-10-05T06:15:11.187+0100 [conn1426145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:14.435+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:15.087+0100 [conn1425742] end connection 172.28.0.163:49967 (399 connections now open) 2015-10-05T06:15:15.102+0100 [mongosMain] connection accepted from 172.28.0.163:51047 #1426146 (400 connections now open) 2015-10-05T06:15:15.103+0100 [conn1426146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:15.178+0100 [conn1425654] end connection 172.28.0.163:49735 (399 connections now open) 2015-10-05T06:15:15.179+0100 [mongosMain] connection accepted from 172.28.0.163:51048 #1426147 (400 connections now open) 2015-10-05T06:15:15.180+0100 [conn1426147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:15.506+0100 [conn1425669] end connection 172.28.0.164:59154 (399 connections now open) 2015-10-05T06:15:15.508+0100 [mongosMain] connection accepted from 172.28.0.164:60438 #1426148 (400 connections now open) 2015-10-05T06:15:15.510+0100 [conn1426148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:15.949+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:15.950+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:17.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207655703b51053ec10c7 2015-10-05T06:15:17.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:20.638+0100 [conn1425731] end connection 172.28.0.164:59326 (399 connections now open) 2015-10-05T06:15:20.639+0100 [mongosMain] connection accepted from 172.28.0.164:60444 #1426149 (400 connections now open) 2015-10-05T06:15:20.641+0100 [conn1426149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:20.656+0100 [conn1425746] end connection 172.28.0.163:49981 (399 connections now open) 2015-10-05T06:15:20.657+0100 [mongosMain] connection accepted from 172.28.0.163:51054 #1426150 (400 connections now open) 2015-10-05T06:15:20.658+0100 [conn1426150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:21.185+0100 [conn1425762] end connection 172.28.0.164:59406 (399 connections now open) 2015-10-05T06:15:21.188+0100 [mongosMain] connection accepted from 172.28.0.164:60447 #1426151 (400 connections now open) 2015-10-05T06:15:21.190+0100 [conn1426151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:21.233+0100 [conn1425763] end connection 172.28.0.163:50025 (399 connections now open) 2015-10-05T06:15:21.234+0100 [mongosMain] connection accepted from 172.28.0.163:51058 #1426152 (400 connections now open) 2015-10-05T06:15:21.235+0100 [conn1426152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:21.962+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:21.962+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:25.103+0100 [conn1425750] end connection 172.28.0.163:49992 (399 connections now open) 2015-10-05T06:15:25.103+0100 [conn1425591] end connection 172.28.0.163:49524 (399 connections now open) 2015-10-05T06:15:25.104+0100 [mongosMain] connection accepted from 172.28.0.163:51061 #1426153 (399 connections now open) 2015-10-05T06:15:25.104+0100 [mongosMain] connection accepted from 172.28.0.163:51062 #1426154 (400 connections now open) 2015-10-05T06:15:25.105+0100 [conn1426153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:25.105+0100 [conn1426154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:25.439+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:25.522+0100 [conn1425648] end connection 172.28.0.164:59095 (399 connections now open) 2015-10-05T06:15:25.522+0100 [conn1425751] end connection 172.28.0.164:59383 (398 connections now open) 2015-10-05T06:15:25.523+0100 [mongosMain] connection accepted from 172.28.0.164:60458 #1426155 (399 connections now open) 2015-10-05T06:15:25.524+0100 [mongosMain] connection accepted from 172.28.0.164:60459 #1426156 (400 connections now open) 2015-10-05T06:15:25.525+0100 [conn1426155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:25.526+0100 [conn1426156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:28.970+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:28.970+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:28.978+0100 [mongosMain] connection accepted from 127.0.0.1:51065 #1426157 (401 connections now open) 2015-10-05T06:15:28.981+0100 [conn1426157] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:28.988+0100 [conn1426157] end connection 127.0.0.1:51065 (400 connections now open) 2015-10-05T06:15:30.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207715703b51053ec115c 2015-10-05T06:15:30.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:30.466+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:15:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:15:30.653+0100 [conn1425745] end connection 172.28.0.164:59370 (399 connections now open) 2015-10-05T06:15:30.655+0100 [mongosMain] connection accepted from 172.28.0.164:60466 #1426158 (400 connections now open) 2015-10-05T06:15:30.656+0100 [conn1425691] end connection 172.28.0.163:49834 (399 connections now open) 2015-10-05T06:15:30.657+0100 [conn1426158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:30.657+0100 [mongosMain] connection accepted from 172.28.0.163:51068 #1426159 (400 connections now open) 2015-10-05T06:15:30.658+0100 [conn1426159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:31.200+0100 [conn1425770] end connection 172.28.0.164:59423 (399 connections now open) 2015-10-05T06:15:31.201+0100 [mongosMain] connection accepted from 172.28.0.164:60468 #1426160 (400 connections now open) 2015-10-05T06:15:31.203+0100 [conn1426160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:31.233+0100 [conn1425748] end connection 172.28.0.163:49983 (399 connections now open) 2015-10-05T06:15:31.234+0100 [mongosMain] connection accepted from 172.28.0.163:51070 #1426161 (400 connections now open) 2015-10-05T06:15:31.235+0100 [conn1426161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:35.102+0100 [conn1425757] end connection 172.28.0.163:50014 (399 connections now open) 2015-10-05T06:15:35.102+0100 [conn1425668] end connection 172.28.0.163:49766 (399 connections now open) 2015-10-05T06:15:35.103+0100 [mongosMain] connection accepted from 172.28.0.163:51072 #1426162 (399 connections now open) 2015-10-05T06:15:35.104+0100 [mongosMain] connection accepted from 172.28.0.163:51073 #1426163 (400 connections now open) 2015-10-05T06:15:35.105+0100 [conn1426162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:35.105+0100 [conn1426163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:35.537+0100 [conn1425703] end connection 172.28.0.164:59239 (399 connections now open) 2015-10-05T06:15:35.537+0100 [conn1425758] end connection 172.28.0.164:59397 (399 connections now open) 2015-10-05T06:15:35.539+0100 [mongosMain] connection accepted from 172.28.0.164:60479 #1426164 (399 connections now open) 2015-10-05T06:15:35.539+0100 [mongosMain] connection accepted from 172.28.0.164:60478 #1426165 (400 connections now open) 2015-10-05T06:15:35.540+0100 [conn1426164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:35.541+0100 [conn1426165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:36.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207785703b51053ec119b 2015-10-05T06:15:36.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:36.443+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:36.975+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:36.975+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:39.963+0100 [mongosMain] connection accepted from 127.0.0.1:51079 #1426166 (401 connections now open) 2015-10-05T06:15:39.966+0100 [conn1426166] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:39.970+0100 [conn1426166] end connection 127.0.0.1:51079 (400 connections now open) 2015-10-05T06:15:40.653+0100 [conn1425760] end connection 172.28.0.164:59403 (399 connections now open) 2015-10-05T06:15:40.654+0100 [mongosMain] connection accepted from 172.28.0.164:60486 #1426167 (400 connections now open) 2015-10-05T06:15:40.655+0100 [conn1426167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:40.672+0100 [conn1425754] end connection 172.28.0.163:50003 (399 connections now open) 2015-10-05T06:15:40.673+0100 [mongosMain] connection accepted from 172.28.0.163:51080 #1426168 (400 connections now open) 2015-10-05T06:15:40.675+0100 [conn1426168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:41.199+0100 [conn1425779] end connection 172.28.0.164:59444 (399 connections now open) 2015-10-05T06:15:41.200+0100 [mongosMain] connection accepted from 172.28.0.164:60490 #1426169 (400 connections now open) 2015-10-05T06:15:41.201+0100 [conn1426169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:41.249+0100 [conn1425771] end connection 172.28.0.163:50044 (399 connections now open) 2015-10-05T06:15:41.250+0100 [mongosMain] connection accepted from 172.28.0.163:51082 #1426170 (400 connections now open) 2015-10-05T06:15:41.252+0100 [conn1426170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:45.553+0100 [conn1425767] end connection 172.28.0.164:59410 (399 connections now open) 2015-10-05T06:15:45.553+0100 [conn1425752] end connection 172.28.0.164:59382 (398 connections now open) 2015-10-05T06:15:45.554+0100 [mongosMain] connection accepted from 172.28.0.164:60499 #1426171 (399 connections now open) 2015-10-05T06:15:45.554+0100 [mongosMain] connection accepted from 172.28.0.164:60500 #1426172 (400 connections now open) 2015-10-05T06:15:45.556+0100 [conn1426172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:45.556+0100 [conn1426171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:45.986+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:45.986+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:47.523+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:48.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207845703b51053ec1232 2015-10-05T06:15:48.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:50.670+0100 [conn1425768] end connection 172.28.0.164:59420 (399 connections now open) 2015-10-05T06:15:50.670+0100 [mongosMain] connection accepted from 172.28.0.164:60507 #1426173 (400 connections now open) 2015-10-05T06:15:50.672+0100 [conn1426173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:50.687+0100 [conn1425778] end connection 172.28.0.163:50057 (399 connections now open) 2015-10-05T06:15:50.688+0100 [mongosMain] connection accepted from 172.28.0.163:51098 #1426174 (400 connections now open) 2015-10-05T06:15:50.690+0100 [conn1426174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:51.215+0100 [conn1425788] end connection 172.28.0.164:59465 (399 connections now open) 2015-10-05T06:15:51.216+0100 [mongosMain] connection accepted from 172.28.0.164:60509 #1426175 (400 connections now open) 2015-10-05T06:15:51.220+0100 [conn1426175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:51.249+0100 [conn1425780] end connection 172.28.0.163:50060 (399 connections now open) 2015-10-05T06:15:51.250+0100 [mongosMain] connection accepted from 172.28.0.163:51100 #1426176 (400 connections now open) 2015-10-05T06:15:51.252+0100 [conn1426176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:54.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612078a5703b51053ec126a 2015-10-05T06:15:55.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:15:55.118+0100 [conn1425772] end connection 172.28.0.163:50047 (399 connections now open) 2015-10-05T06:15:55.119+0100 [mongosMain] connection accepted from 172.28.0.163:51107 #1426177 (400 connections now open) 2015-10-05T06:15:55.120+0100 [conn1426177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:55.569+0100 [conn1425714] end connection 172.28.0.164:59282 (399 connections now open) 2015-10-05T06:15:55.570+0100 [mongosMain] connection accepted from 172.28.0.164:60517 #1426178 (400 connections now open) 2015-10-05T06:15:55.573+0100 [conn1426178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:15:56.006+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:15:56.006+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:15:58.537+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:00.676+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:16:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:16:00.685+0100 [conn1425753] end connection 172.28.0.164:59386 (399 connections now open) 2015-10-05T06:16:00.687+0100 [mongosMain] connection accepted from 172.28.0.164:60520 #1426179 (400 connections now open) 2015-10-05T06:16:00.688+0100 [conn1425706] end connection 172.28.0.163:49860 (399 connections now open) 2015-10-05T06:16:00.689+0100 [conn1426179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:00.689+0100 [mongosMain] connection accepted from 172.28.0.163:51118 #1426180 (400 connections now open) 2015-10-05T06:16:00.691+0100 [conn1426180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:01.231+0100 [conn1425795] end connection 172.28.0.164:59484 (399 connections now open) 2015-10-05T06:16:01.232+0100 [mongosMain] connection accepted from 172.28.0.164:60522 #1426181 (400 connections now open) 2015-10-05T06:16:01.234+0100 [conn1426181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:01.265+0100 [conn1425789] end connection 172.28.0.163:50073 (399 connections now open) 2015-10-05T06:16:01.266+0100 [mongosMain] connection accepted from 172.28.0.163:51120 #1426182 (400 connections now open) 2015-10-05T06:16:01.268+0100 [conn1426182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:05.134+0100 [conn1425765] end connection 172.28.0.163:50033 (399 connections now open) 2015-10-05T06:16:05.134+0100 [conn1425756] end connection 172.28.0.163:50011 (399 connections now open) 2015-10-05T06:16:05.136+0100 [mongosMain] connection accepted from 172.28.0.163:51126 #1426183 (399 connections now open) 2015-10-05T06:16:05.136+0100 [mongosMain] connection accepted from 172.28.0.163:51127 #1426184 (400 connections now open) 2015-10-05T06:16:05.137+0100 [conn1426183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:05.137+0100 [conn1426184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:05.585+0100 [conn1425774] end connection 172.28.0.164:59431 (399 connections now open) 2015-10-05T06:16:05.585+0100 [conn1425775] end connection 172.28.0.164:59432 (399 connections now open) 2015-10-05T06:16:05.586+0100 [mongosMain] connection accepted from 172.28.0.164:60525 #1426185 (399 connections now open) 2015-10-05T06:16:05.586+0100 [mongosMain] connection accepted from 172.28.0.164:60526 #1426186 (400 connections now open) 2015-10-05T06:16:05.588+0100 [conn1426185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:05.588+0100 [conn1426186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:07.016+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:07.017+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:09.556+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:10.701+0100 [conn1425738] end connection 172.28.0.164:59344 (399 connections now open) 2015-10-05T06:16:10.703+0100 [mongosMain] connection accepted from 172.28.0.164:60532 #1426187 (400 connections now open) 2015-10-05T06:16:10.705+0100 [conn1426187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:11.231+0100 [conn1425803] end connection 172.28.0.164:59499 (399 connections now open) 2015-10-05T06:16:11.233+0100 [mongosMain] connection accepted from 172.28.0.164:60534 #1426188 (400 connections now open) 2015-10-05T06:16:11.235+0100 [conn1426188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:11.265+0100 [conn1425796] end connection 172.28.0.163:50092 (399 connections now open) 2015-10-05T06:16:11.266+0100 [mongosMain] connection accepted from 172.28.0.163:51137 #1426189 (400 connections now open) 2015-10-05T06:16:11.268+0100 [conn1426189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:13.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612079d5703b51053ec1320 2015-10-05T06:16:13.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:16:15.151+0100 [conn1425734] end connection 172.28.0.163:49952 (399 connections now open) 2015-10-05T06:16:15.151+0100 [conn1425790] end connection 172.28.0.163:50080 (399 connections now open) 2015-10-05T06:16:15.152+0100 [mongosMain] connection accepted from 172.28.0.163:51144 #1426190 (399 connections now open) 2015-10-05T06:16:15.153+0100 [mongosMain] connection accepted from 172.28.0.163:51145 #1426191 (400 connections now open) 2015-10-05T06:16:15.154+0100 [conn1426190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:15.154+0100 [conn1426191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:15.599+0100 [conn1425799] end connection 172.28.0.164:59493 (399 connections now open) 2015-10-05T06:16:15.599+0100 [conn1425766] end connection 172.28.0.164:59409 (398 connections now open) 2015-10-05T06:16:15.600+0100 [mongosMain] connection accepted from 172.28.0.164:60538 #1426192 (399 connections now open) 2015-10-05T06:16:15.601+0100 [mongosMain] connection accepted from 172.28.0.164:60539 #1426193 (400 connections now open) 2015-10-05T06:16:15.601+0100 [conn1426192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:15.602+0100 [conn1426193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:19.026+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:19.026+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:19.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207a35703b51053ec1358 2015-10-05T06:16:19.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:16:20.568+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:20.703+0100 [conn1425802] end connection 172.28.0.163:50107 (399 connections now open) 2015-10-05T06:16:20.704+0100 [mongosMain] connection accepted from 172.28.0.163:51155 #1426194 (400 connections now open) 2015-10-05T06:16:20.706+0100 [conn1426194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:20.716+0100 [conn1425724] end connection 172.28.0.164:59306 (399 connections now open) 2015-10-05T06:16:20.717+0100 [mongosMain] connection accepted from 172.28.0.164:60548 #1426195 (400 connections now open) 2015-10-05T06:16:20.720+0100 [conn1426195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:21.025+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:21.026+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:21.246+0100 [conn1425811] end connection 172.28.0.164:59512 (399 connections now open) 2015-10-05T06:16:21.247+0100 [mongosMain] connection accepted from 172.28.0.164:60551 #1426196 (400 connections now open) 2015-10-05T06:16:21.249+0100 [conn1426196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:21.280+0100 [conn1425804] end connection 172.28.0.163:50111 (399 connections now open) 2015-10-05T06:16:21.281+0100 [mongosMain] connection accepted from 172.28.0.163:51156 #1426197 (400 connections now open) 2015-10-05T06:16:21.282+0100 [conn1426197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:24.034+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:24.034+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:25.151+0100 [conn1425791] end connection 172.28.0.163:50081 (399 connections now open) 2015-10-05T06:16:25.151+0100 [conn1425806] end connection 172.28.0.163:50120 (398 connections now open) 2015-10-05T06:16:25.152+0100 [mongosMain] connection accepted from 172.28.0.163:51159 #1426198 (399 connections now open) 2015-10-05T06:16:25.152+0100 [mongosMain] connection accepted from 172.28.0.163:51160 #1426199 (400 connections now open) 2015-10-05T06:16:25.153+0100 [conn1426198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:25.153+0100 [conn1426199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:25.601+0100 [conn1425815] end connection 172.28.0.164:59517 (399 connections now open) 2015-10-05T06:16:25.601+0100 [conn1425689] end connection 172.28.0.164:59198 (398 connections now open) 2015-10-05T06:16:25.601+0100 [mongosMain] connection accepted from 172.28.0.164:60563 #1426200 (399 connections now open) 2015-10-05T06:16:25.602+0100 [mongosMain] connection accepted from 172.28.0.164:60564 #1426201 (400 connections now open) 2015-10-05T06:16:25.603+0100 [conn1426200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:25.604+0100 [conn1426201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:28.048+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:28.049+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:28.720+0100 [mongosMain] connection accepted from 127.0.0.1:51163 #1426202 (401 connections now open) 2015-10-05T06:16:28.722+0100 [conn1426202] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:28.728+0100 [conn1426202] end connection 127.0.0.1:51163 (400 connections now open) 2015-10-05T06:16:30.717+0100 [conn1425793] end connection 172.28.0.164:59482 (399 connections now open) 2015-10-05T06:16:30.718+0100 [mongosMain] connection accepted from 172.28.0.164:60574 #1426203 (400 connections now open) 2015-10-05T06:16:30.719+0100 [conn1425810] end connection 172.28.0.163:50131 (399 connections now open) 2015-10-05T06:16:30.720+0100 [conn1426203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:30.720+0100 [mongosMain] connection accepted from 172.28.0.163:51165 #1426204 (400 connections now open) 2015-10-05T06:16:30.721+0100 [conn1426204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:30.814+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:16:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:16:31.247+0100 [conn1425819] end connection 172.28.0.164:59528 (399 connections now open) 2015-10-05T06:16:31.248+0100 [mongosMain] connection accepted from 172.28.0.164:60578 #1426205 (400 connections now open) 2015-10-05T06:16:31.250+0100 [conn1426205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:31.281+0100 [conn1425812] end connection 172.28.0.163:50133 (399 connections now open) 2015-10-05T06:16:31.282+0100 [mongosMain] connection accepted from 172.28.0.163:51166 #1426206 (400 connections now open) 2015-10-05T06:16:31.283+0100 [conn1426206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:31.573+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:33.057+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:33.057+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:35.167+0100 [conn1425813] end connection 172.28.0.163:50138 (399 connections now open) 2015-10-05T06:16:35.168+0100 [mongosMain] connection accepted from 172.28.0.163:51169 #1426207 (400 connections now open) 2015-10-05T06:16:35.169+0100 [conn1426207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:35.616+0100 [conn1425784] end connection 172.28.0.164:59453 (399 connections now open) 2015-10-05T06:16:35.617+0100 [mongosMain] connection accepted from 172.28.0.164:60585 #1426208 (400 connections now open) 2015-10-05T06:16:35.619+0100 [conn1426208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:35.627+0100 [conn1425710] end connection 172.28.0.164:59263 (399 connections now open) 2015-10-05T06:16:35.628+0100 [mongosMain] connection accepted from 172.28.0.164:60586 #1426209 (400 connections now open) 2015-10-05T06:16:35.630+0100 [conn1426209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:38.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207b55703b51053ec13e8 2015-10-05T06:16:38.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:16:39.068+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:39.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:39.549+0100 [mongosMain] connection accepted from 127.0.0.1:51172 #1426210 (401 connections now open) 2015-10-05T06:16:39.552+0100 [conn1426210] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:39.557+0100 [conn1426210] end connection 127.0.0.1:51172 (400 connections now open) 2015-10-05T06:16:40.732+0100 [conn1425777] end connection 172.28.0.164:59441 (399 connections now open) 2015-10-05T06:16:40.733+0100 [mongosMain] connection accepted from 172.28.0.164:60597 #1426211 (400 connections now open) 2015-10-05T06:16:40.735+0100 [conn1426211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:41.262+0100 [conn1425828] end connection 172.28.0.164:59552 (399 connections now open) 2015-10-05T06:16:41.263+0100 [mongosMain] connection accepted from 172.28.0.164:60599 #1426212 (400 connections now open) 2015-10-05T06:16:41.265+0100 [conn1426212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:41.296+0100 [conn1425820] end connection 172.28.0.163:50150 (399 connections now open) 2015-10-05T06:16:41.297+0100 [mongosMain] connection accepted from 172.28.0.163:51175 #1426213 (400 connections now open) 2015-10-05T06:16:41.298+0100 [conn1426213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:42.587+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:44.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207bc5703b51053ec142b 2015-10-05T06:16:44.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:16:45.166+0100 [conn1425821] end connection 172.28.0.163:50155 (399 connections now open) 2015-10-05T06:16:45.167+0100 [mongosMain] connection accepted from 172.28.0.163:51186 #1426214 (400 connections now open) 2015-10-05T06:16:45.168+0100 [conn1426214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:45.632+0100 [conn1425808] end connection 172.28.0.164:59505 (399 connections now open) 2015-10-05T06:16:45.632+0100 [conn1425624] end connection 172.28.0.164:59008 (398 connections now open) 2015-10-05T06:16:45.633+0100 [mongosMain] connection accepted from 172.28.0.164:60606 #1426215 (399 connections now open) 2015-10-05T06:16:45.633+0100 [mongosMain] connection accepted from 172.28.0.164:60607 #1426216 (400 connections now open) 2015-10-05T06:16:45.635+0100 [conn1426215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:45.635+0100 [conn1426216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:46.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:46.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:50.732+0100 [conn1425785] end connection 172.28.0.164:59463 (399 connections now open) 2015-10-05T06:16:50.734+0100 [mongosMain] connection accepted from 172.28.0.164:60616 #1426217 (400 connections now open) 2015-10-05T06:16:50.735+0100 [conn1425769] end connection 172.28.0.163:50041 (399 connections now open) 2015-10-05T06:16:50.736+0100 [conn1426217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:50.736+0100 [mongosMain] connection accepted from 172.28.0.163:51193 #1426218 (400 connections now open) 2015-10-05T06:16:50.737+0100 [conn1426218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:50.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207c25703b51053ec1463 2015-10-05T06:16:50.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:16:51.263+0100 [conn1425835] end connection 172.28.0.164:59574 (399 connections now open) 2015-10-05T06:16:51.264+0100 [mongosMain] connection accepted from 172.28.0.164:60618 #1426219 (400 connections now open) 2015-10-05T06:16:51.265+0100 [conn1426219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:51.312+0100 [conn1425829] end connection 172.28.0.163:50163 (399 connections now open) 2015-10-05T06:16:51.313+0100 [mongosMain] connection accepted from 172.28.0.163:51195 #1426220 (400 connections now open) 2015-10-05T06:16:51.315+0100 [conn1426220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:53.594+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:54.116+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:16:54.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:16:55.181+0100 [conn1425782] end connection 172.28.0.163:50062 (399 connections now open) 2015-10-05T06:16:55.181+0100 [conn1425797] end connection 172.28.0.163:50098 (399 connections now open) 2015-10-05T06:16:55.182+0100 [mongosMain] connection accepted from 172.28.0.163:51203 #1426221 (399 connections now open) 2015-10-05T06:16:55.183+0100 [mongosMain] connection accepted from 172.28.0.163:51204 #1426222 (400 connections now open) 2015-10-05T06:16:55.184+0100 [conn1426221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:55.184+0100 [conn1426222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:55.631+0100 [conn1425696] end connection 172.28.0.164:59217 (399 connections now open) 2015-10-05T06:16:55.631+0100 [conn1425823] end connection 172.28.0.164:59541 (398 connections now open) 2015-10-05T06:16:55.633+0100 [mongosMain] connection accepted from 172.28.0.164:60626 #1426223 (399 connections now open) 2015-10-05T06:16:55.633+0100 [mongosMain] connection accepted from 172.28.0.164:60627 #1426224 (400 connections now open) 2015-10-05T06:16:55.635+0100 [conn1426223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:55.635+0100 [conn1426224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:16:57.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207c85703b51053ec148c 2015-10-05T06:16:57.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:00.738+0100 [conn1425827] end connection 172.28.0.163:50161 (399 connections now open) 2015-10-05T06:17:00.740+0100 [mongosMain] connection accepted from 172.28.0.163:51212 #1426225 (400 connections now open) 2015-10-05T06:17:00.741+0100 [conn1426225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:00.748+0100 [conn1425801] end connection 172.28.0.164:59497 (399 connections now open) 2015-10-05T06:17:00.751+0100 [mongosMain] connection accepted from 172.28.0.164:60633 #1426226 (400 connections now open) 2015-10-05T06:17:00.753+0100 [conn1426226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:01.096+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:17:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:17:01.279+0100 [conn1425840] end connection 172.28.0.164:59595 (399 connections now open) 2015-10-05T06:17:01.280+0100 [mongosMain] connection accepted from 172.28.0.164:60635 #1426227 (400 connections now open) 2015-10-05T06:17:01.282+0100 [conn1426227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:01.315+0100 [conn1425836] end connection 172.28.0.163:50173 (399 connections now open) 2015-10-05T06:17:01.316+0100 [mongosMain] connection accepted from 172.28.0.163:51216 #1426228 (400 connections now open) 2015-10-05T06:17:01.318+0100 [conn1426228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:03.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:03.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:03.623+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207cf5703b51053ec14e0 2015-10-05T06:17:03.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:04.599+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:05.182+0100 [conn1425822] end connection 172.28.0.163:50156 (399 connections now open) 2015-10-05T06:17:05.182+0100 [conn1425830] end connection 172.28.0.163:50165 (398 connections now open) 2015-10-05T06:17:05.184+0100 [mongosMain] connection accepted from 172.28.0.163:51227 #1426229 (399 connections now open) 2015-10-05T06:17:05.184+0100 [mongosMain] connection accepted from 172.28.0.163:51228 #1426230 (400 connections now open) 2015-10-05T06:17:05.185+0100 [conn1426229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:05.185+0100 [conn1426230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:05.632+0100 [conn1425831] end connection 172.28.0.164:59560 (399 connections now open) 2015-10-05T06:17:05.632+0100 [conn1425800] end connection 172.28.0.164:59492 (399 connections now open) 2015-10-05T06:17:05.633+0100 [mongosMain] connection accepted from 172.28.0.164:60641 #1426231 (399 connections now open) 2015-10-05T06:17:05.634+0100 [mongosMain] connection accepted from 172.28.0.164:60642 #1426232 (400 connections now open) 2015-10-05T06:17:05.635+0100 [conn1426231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:05.636+0100 [conn1426232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:09.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207d55703b51053ec153d 2015-10-05T06:17:09.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:10.750+0100 [conn1425794] end connection 172.28.0.163:50090 (399 connections now open) 2015-10-05T06:17:10.751+0100 [mongosMain] connection accepted from 172.28.0.163:51236 #1426233 (400 connections now open) 2015-10-05T06:17:10.752+0100 [conn1426233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:10.765+0100 [conn1425839] end connection 172.28.0.164:59593 (399 connections now open) 2015-10-05T06:17:10.766+0100 [mongosMain] connection accepted from 172.28.0.164:60643 #1426234 (400 connections now open) 2015-10-05T06:17:10.768+0100 [conn1426234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:11.295+0100 [conn1425846] end connection 172.28.0.164:59614 (399 connections now open) 2015-10-05T06:17:11.296+0100 [mongosMain] connection accepted from 172.28.0.164:60645 #1426235 (400 connections now open) 2015-10-05T06:17:11.298+0100 [conn1426235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:11.328+0100 [conn1425841] end connection 172.28.0.163:50189 (399 connections now open) 2015-10-05T06:17:11.329+0100 [mongosMain] connection accepted from 172.28.0.163:51238 #1426236 (400 connections now open) 2015-10-05T06:17:11.331+0100 [conn1426236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:13.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:13.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:15.197+0100 [conn1425781] end connection 172.28.0.163:50063 (399 connections now open) 2015-10-05T06:17:15.197+0100 [conn1425805] end connection 172.28.0.163:50119 (398 connections now open) 2015-10-05T06:17:15.198+0100 [mongosMain] connection accepted from 172.28.0.163:51245 #1426237 (399 connections now open) 2015-10-05T06:17:15.199+0100 [mongosMain] connection accepted from 172.28.0.163:51246 #1426238 (400 connections now open) 2015-10-05T06:17:15.199+0100 [conn1426237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:15.200+0100 [conn1426238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:15.610+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:15.648+0100 [conn1425838] end connection 172.28.0.164:59585 (399 connections now open) 2015-10-05T06:17:15.648+0100 [conn1425759] end connection 172.28.0.164:59398 (399 connections now open) 2015-10-05T06:17:15.649+0100 [mongosMain] connection accepted from 172.28.0.164:60651 #1426239 (399 connections now open) 2015-10-05T06:17:15.649+0100 [mongosMain] connection accepted from 172.28.0.164:60650 #1426240 (400 connections now open) 2015-10-05T06:17:15.651+0100 [conn1426239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:15.651+0100 [conn1426240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:16.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207db5703b51053ec156f 2015-10-05T06:17:16.390+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:20.780+0100 [conn1425845] end connection 172.28.0.164:59611 (399 connections now open) 2015-10-05T06:17:20.781+0100 [mongosMain] connection accepted from 172.28.0.164:60657 #1426241 (400 connections now open) 2015-10-05T06:17:20.783+0100 [conn1426241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:21.310+0100 [conn1425853] end connection 172.28.0.164:59631 (399 connections now open) 2015-10-05T06:17:21.311+0100 [mongosMain] connection accepted from 172.28.0.164:60659 #1426242 (400 connections now open) 2015-10-05T06:17:21.313+0100 [conn1426242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:21.328+0100 [conn1425847] end connection 172.28.0.163:50206 (399 connections now open) 2015-10-05T06:17:21.329+0100 [mongosMain] connection accepted from 172.28.0.163:51254 #1426243 (400 connections now open) 2015-10-05T06:17:21.331+0100 [conn1426243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:22.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207e25703b51053ec159f 2015-10-05T06:17:22.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:24.152+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:24.152+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:25.213+0100 [conn1425773] end connection 172.28.0.163:50048 (399 connections now open) 2015-10-05T06:17:25.213+0100 [conn1425848] end connection 172.28.0.163:50213 (399 connections now open) 2015-10-05T06:17:25.214+0100 [mongosMain] connection accepted from 172.28.0.163:51257 #1426244 (399 connections now open) 2015-10-05T06:17:25.215+0100 [mongosMain] connection accepted from 172.28.0.163:51258 #1426245 (400 connections now open) 2015-10-05T06:17:25.215+0100 [conn1426244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:25.216+0100 [conn1426245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:25.662+0100 [conn1425807] end connection 172.28.0.164:59504 (399 connections now open) 2015-10-05T06:17:25.663+0100 [conn1425844] end connection 172.28.0.164:59607 (399 connections now open) 2015-10-05T06:17:25.664+0100 [mongosMain] connection accepted from 172.28.0.164:60670 #1426246 (399 connections now open) 2015-10-05T06:17:25.664+0100 [mongosMain] connection accepted from 172.28.0.164:60671 #1426247 (400 connections now open) 2015-10-05T06:17:25.665+0100 [conn1426246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:25.665+0100 [conn1426247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:26.623+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:28.669+0100 [mongosMain] connection accepted from 127.0.0.1:51262 #1426248 (401 connections now open) 2015-10-05T06:17:28.672+0100 [conn1426248] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:28.678+0100 [conn1426248] end connection 127.0.0.1:51262 (400 connections now open) 2015-10-05T06:17:28.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207e85703b51053ec15e2 2015-10-05T06:17:29.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:30.779+0100 [conn1425817] end connection 172.28.0.164:59526 (399 connections now open) 2015-10-05T06:17:30.780+0100 [mongosMain] connection accepted from 172.28.0.164:60679 #1426249 (400 connections now open) 2015-10-05T06:17:30.782+0100 [conn1426249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:31.325+0100 [conn1425860] end connection 172.28.0.164:59643 (399 connections now open) 2015-10-05T06:17:31.326+0100 [mongosMain] connection accepted from 172.28.0.164:60681 #1426250 (400 connections now open) 2015-10-05T06:17:31.328+0100 [conn1426250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:31.343+0100 [conn1425854] end connection 172.28.0.163:50226 (399 connections now open) 2015-10-05T06:17:31.344+0100 [mongosMain] connection accepted from 172.28.0.163:51264 #1426251 (400 connections now open) 2015-10-05T06:17:31.345+0100 [conn1426251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:31.375+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:17:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:17:35.215+0100 [conn1425855] end connection 172.28.0.163:50230 (399 connections now open) 2015-10-05T06:17:35.215+0100 [conn1425764] end connection 172.28.0.163:50031 (398 connections now open) 2015-10-05T06:17:35.216+0100 [mongosMain] connection accepted from 172.28.0.163:51269 #1426252 (399 connections now open) 2015-10-05T06:17:35.216+0100 [mongosMain] connection accepted from 172.28.0.163:51270 #1426253 (400 connections now open) 2015-10-05T06:17:35.217+0100 [conn1426252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:35.217+0100 [conn1426253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:35.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207ef5703b51053ec1625 2015-10-05T06:17:35.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:35.679+0100 [conn1425816] end connection 172.28.0.164:59518 (399 connections now open) 2015-10-05T06:17:35.680+0100 [conn1425850] end connection 172.28.0.164:59621 (398 connections now open) 2015-10-05T06:17:35.680+0100 [mongosMain] connection accepted from 172.28.0.164:60690 #1426254 (399 connections now open) 2015-10-05T06:17:35.680+0100 [mongosMain] connection accepted from 172.28.0.164:60691 #1426255 (400 connections now open) 2015-10-05T06:17:35.682+0100 [conn1426254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:35.683+0100 [conn1426255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:36.154+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:36.154+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:37.624+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:38.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:38.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:39.390+0100 [mongosMain] connection accepted from 127.0.0.1:51275 #1426256 (401 connections now open) 2015-10-05T06:17:39.392+0100 [conn1426256] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:39.397+0100 [conn1426256] end connection 127.0.0.1:51275 (400 connections now open) 2015-10-05T06:17:40.795+0100 [conn1425809] end connection 172.28.0.164:59510 (399 connections now open) 2015-10-05T06:17:40.796+0100 [mongosMain] connection accepted from 172.28.0.164:60700 #1426257 (400 connections now open) 2015-10-05T06:17:40.798+0100 [conn1426257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:41.157+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:41.157+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:41.341+0100 [conn1425869] end connection 172.28.0.164:59664 (399 connections now open) 2015-10-05T06:17:41.343+0100 [mongosMain] connection accepted from 172.28.0.164:60702 #1426258 (400 connections now open) 2015-10-05T06:17:41.344+0100 [conn1425861] end connection 172.28.0.163:50243 (399 connections now open) 2015-10-05T06:17:41.345+0100 [mongosMain] connection accepted from 172.28.0.163:51279 #1426259 (400 connections now open) 2015-10-05T06:17:41.345+0100 [conn1426258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:41.346+0100 [conn1426259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:41.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207f55703b51053ec1659 2015-10-05T06:17:41.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:45.159+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:45.159+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:45.229+0100 [conn1425842] end connection 172.28.0.163:50195 (399 connections now open) 2015-10-05T06:17:45.230+0100 [mongosMain] connection accepted from 172.28.0.163:51286 #1426260 (400 connections now open) 2015-10-05T06:17:45.231+0100 [conn1426260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:45.694+0100 [conn1425857] end connection 172.28.0.164:59634 (399 connections now open) 2015-10-05T06:17:45.694+0100 [conn1425675] end connection 172.28.0.164:59173 (398 connections now open) 2015-10-05T06:17:45.695+0100 [mongosMain] connection accepted from 172.28.0.164:60710 #1426261 (399 connections now open) 2015-10-05T06:17:45.695+0100 [mongosMain] connection accepted from 172.28.0.164:60711 #1426262 (400 connections now open) 2015-10-05T06:17:45.696+0100 [conn1426261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:45.697+0100 [conn1426262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:48.135+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561207fb5703b51053ec1693 2015-10-05T06:17:48.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:48.632+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:50.160+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:50.160+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:51.341+0100 [conn1425878] end connection 172.28.0.164:59684 (399 connections now open) 2015-10-05T06:17:51.343+0100 [mongosMain] connection accepted from 172.28.0.164:60722 #1426263 (400 connections now open) 2015-10-05T06:17:51.344+0100 [conn1426263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:51.359+0100 [conn1425870] end connection 172.28.0.163:50255 (399 connections now open) 2015-10-05T06:17:51.360+0100 [mongosMain] connection accepted from 172.28.0.163:51295 #1426264 (400 connections now open) 2015-10-05T06:17:51.362+0100 [conn1426264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:54.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208025703b51053ec16c5 2015-10-05T06:17:54.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:17:55.231+0100 [conn1425814] end connection 172.28.0.163:50139 (399 connections now open) 2015-10-05T06:17:55.231+0100 [conn1425872] end connection 172.28.0.163:50259 (399 connections now open) 2015-10-05T06:17:55.232+0100 [mongosMain] connection accepted from 172.28.0.163:51303 #1426265 (399 connections now open) 2015-10-05T06:17:55.232+0100 [mongosMain] connection accepted from 172.28.0.163:51304 #1426266 (400 connections now open) 2015-10-05T06:17:55.233+0100 [conn1426265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:55.233+0100 [conn1426266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:55.710+0100 [conn1425882] end connection 172.28.0.164:59692 (399 connections now open) 2015-10-05T06:17:55.710+0100 [conn1425837] end connection 172.28.0.164:59584 (398 connections now open) 2015-10-05T06:17:55.711+0100 [mongosMain] connection accepted from 172.28.0.164:60731 #1426267 (399 connections now open) 2015-10-05T06:17:55.711+0100 [mongosMain] connection accepted from 172.28.0.164:60730 #1426268 (400 connections now open) 2015-10-05T06:17:55.712+0100 [conn1426267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:55.712+0100 [conn1426268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:17:56.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:17:56.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:17:59.635+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:00.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208085703b51053ec16e5 2015-10-05T06:18:01.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:01.356+0100 [conn1425885] end connection 172.28.0.164:59706 (399 connections now open) 2015-10-05T06:18:01.357+0100 [mongosMain] connection accepted from 172.28.0.164:60738 #1426269 (400 connections now open) 2015-10-05T06:18:01.359+0100 [conn1426269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:01.360+0100 [conn1425879] end connection 172.28.0.163:50269 (399 connections now open) 2015-10-05T06:18:01.362+0100 [mongosMain] connection accepted from 172.28.0.163:51316 #1426270 (400 connections now open) 2015-10-05T06:18:01.363+0100 [conn1426270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:01.646+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:18:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:18:03.258+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:03.258+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:05.244+0100 [conn1425863] end connection 172.28.0.163:50248 (399 connections now open) 2015-10-05T06:18:05.245+0100 [mongosMain] connection accepted from 172.28.0.163:51325 #1426271 (400 connections now open) 2015-10-05T06:18:05.246+0100 [conn1426271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:05.725+0100 [conn1425832] end connection 172.28.0.164:59561 (399 connections now open) 2015-10-05T06:18:05.726+0100 [conn1425873] end connection 172.28.0.164:59672 (398 connections now open) 2015-10-05T06:18:05.727+0100 [mongosMain] connection accepted from 172.28.0.164:60743 #1426272 (399 connections now open) 2015-10-05T06:18:05.727+0100 [mongosMain] connection accepted from 172.28.0.164:60744 #1426273 (400 connections now open) 2015-10-05T06:18:05.728+0100 [conn1426272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:05.729+0100 [conn1426273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:07.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612080f5703b51053ec171e 2015-10-05T06:18:07.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:10.637+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:11.257+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:11.257+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:11.373+0100 [conn1425892] end connection 172.28.0.164:59721 (399 connections now open) 2015-10-05T06:18:11.374+0100 [mongosMain] connection accepted from 172.28.0.164:60748 #1426274 (400 connections now open) 2015-10-05T06:18:11.375+0100 [conn1425886] end connection 172.28.0.163:50288 (399 connections now open) 2015-10-05T06:18:11.376+0100 [mongosMain] connection accepted from 172.28.0.163:51336 #1426275 (400 connections now open) 2015-10-05T06:18:11.377+0100 [conn1426274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:11.377+0100 [conn1426275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:13.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208155703b51053ec1757 2015-10-05T06:18:13.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:15.246+0100 [conn1425887] end connection 172.28.0.163:50295 (399 connections now open) 2015-10-05T06:18:15.247+0100 [mongosMain] connection accepted from 172.28.0.163:51342 #1426276 (400 connections now open) 2015-10-05T06:18:15.248+0100 [conn1426276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:15.742+0100 [conn1425792] end connection 172.28.0.164:59474 (399 connections now open) 2015-10-05T06:18:15.743+0100 [conn1425865] end connection 172.28.0.164:59654 (398 connections now open) 2015-10-05T06:18:15.744+0100 [mongosMain] connection accepted from 172.28.0.164:60754 #1426277 (399 connections now open) 2015-10-05T06:18:15.744+0100 [mongosMain] connection accepted from 172.28.0.164:60753 #1426278 (400 connections now open) 2015-10-05T06:18:15.746+0100 [conn1426277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:15.746+0100 [conn1426278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:20.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612081b5703b51053ec1789 2015-10-05T06:18:20.261+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:20.261+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:20.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:20.813+0100 [conn1425859] end connection 172.28.0.163:50240 (399 connections now open) 2015-10-05T06:18:20.814+0100 [mongosMain] connection accepted from 172.28.0.163:51348 #1426279 (400 connections now open) 2015-10-05T06:18:20.815+0100 [conn1426279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:20.858+0100 [conn1425867] end connection 172.28.0.164:59661 (399 connections now open) 2015-10-05T06:18:20.859+0100 [mongosMain] connection accepted from 172.28.0.164:60761 #1426280 (400 connections now open) 2015-10-05T06:18:20.861+0100 [conn1426280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:21.389+0100 [conn1425897] end connection 172.28.0.164:59730 (399 connections now open) 2015-10-05T06:18:21.390+0100 [mongosMain] connection accepted from 172.28.0.164:60767 #1426281 (400 connections now open) 2015-10-05T06:18:21.391+0100 [conn1425893] end connection 172.28.0.163:50308 (399 connections now open) 2015-10-05T06:18:21.393+0100 [mongosMain] connection accepted from 172.28.0.163:51350 #1426282 (400 connections now open) 2015-10-05T06:18:21.393+0100 [conn1426281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:21.394+0100 [conn1426282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:21.652+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:25.260+0100 [conn1425895] end connection 172.28.0.163:50319 (399 connections now open) 2015-10-05T06:18:25.260+0100 [conn1425862] end connection 172.28.0.163:50247 (398 connections now open) 2015-10-05T06:18:25.262+0100 [mongosMain] connection accepted from 172.28.0.163:51354 #1426283 (399 connections now open) 2015-10-05T06:18:25.262+0100 [mongosMain] connection accepted from 172.28.0.163:51355 #1426284 (400 connections now open) 2015-10-05T06:18:25.263+0100 [conn1426283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:25.263+0100 [conn1426284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:25.757+0100 [conn1425896] end connection 172.28.0.164:59727 (399 connections now open) 2015-10-05T06:18:25.758+0100 [conn1425874] end connection 172.28.0.164:59673 (399 connections now open) 2015-10-05T06:18:25.759+0100 [mongosMain] connection accepted from 172.28.0.164:60773 #1426285 (399 connections now open) 2015-10-05T06:18:25.759+0100 [mongosMain] connection accepted from 172.28.0.164:60772 #1426286 (400 connections now open) 2015-10-05T06:18:25.760+0100 [conn1426285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:25.761+0100 [conn1426286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:26.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208225703b51053ec17ac 2015-10-05T06:18:26.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:28.409+0100 [mongosMain] connection accepted from 127.0.0.1:51359 #1426287 (401 connections now open) 2015-10-05T06:18:28.411+0100 [conn1426287] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:28.416+0100 [conn1426287] end connection 127.0.0.1:51359 (400 connections now open) 2015-10-05T06:18:30.265+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:30.265+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:30.816+0100 [conn1425868] end connection 172.28.0.163:50252 (399 connections now open) 2015-10-05T06:18:30.817+0100 [mongosMain] connection accepted from 172.28.0.163:51361 #1426288 (400 connections now open) 2015-10-05T06:18:30.818+0100 [conn1426288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:30.860+0100 [conn1425876] end connection 172.28.0.164:59682 (399 connections now open) 2015-10-05T06:18:30.861+0100 [mongosMain] connection accepted from 172.28.0.164:60791 #1426289 (400 connections now open) 2015-10-05T06:18:30.863+0100 [conn1426289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:31.393+0100 [conn1425898] end connection 172.28.0.163:50327 (399 connections now open) 2015-10-05T06:18:31.395+0100 [mongosMain] connection accepted from 172.28.0.163:51363 #1426290 (400 connections now open) 2015-10-05T06:18:31.396+0100 [conn1426290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:31.405+0100 [conn1425903] end connection 172.28.0.164:59745 (399 connections now open) 2015-10-05T06:18:31.406+0100 [mongosMain] connection accepted from 172.28.0.164:60795 #1426291 (400 connections now open) 2015-10-05T06:18:31.407+0100 [conn1426291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:31.903+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:18:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:18:32.661+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:33.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208285703b51053ec17dc 2015-10-05T06:18:33.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:35.261+0100 [conn1425659] end connection 172.28.0.163:49747 (399 connections now open) 2015-10-05T06:18:35.261+0100 [conn1425899] end connection 172.28.0.163:50334 (399 connections now open) 2015-10-05T06:18:35.262+0100 [mongosMain] connection accepted from 172.28.0.163:51369 #1426292 (399 connections now open) 2015-10-05T06:18:35.263+0100 [mongosMain] connection accepted from 172.28.0.163:51370 #1426293 (400 connections now open) 2015-10-05T06:18:35.263+0100 [conn1426292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:35.264+0100 [conn1426293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:35.774+0100 [conn1425889] end connection 172.28.0.164:59714 (399 connections now open) 2015-10-05T06:18:35.774+0100 [conn1425783] end connection 172.28.0.164:59452 (398 connections now open) 2015-10-05T06:18:35.776+0100 [mongosMain] connection accepted from 172.28.0.164:60803 #1426294 (399 connections now open) 2015-10-05T06:18:35.776+0100 [mongosMain] connection accepted from 172.28.0.164:60802 #1426295 (400 connections now open) 2015-10-05T06:18:35.777+0100 [conn1426294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:35.777+0100 [conn1426295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:39.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612082f5703b51053ec1805 2015-10-05T06:18:39.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:40.154+0100 [mongosMain] connection accepted from 127.0.0.1:51372 #1426296 (401 connections now open) 2015-10-05T06:18:40.156+0100 [conn1426296] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:40.161+0100 [conn1426296] end connection 127.0.0.1:51372 (400 connections now open) 2015-10-05T06:18:40.829+0100 [conn1425877] end connection 172.28.0.163:50266 (399 connections now open) 2015-10-05T06:18:40.830+0100 [mongosMain] connection accepted from 172.28.0.163:51375 #1426297 (400 connections now open) 2015-10-05T06:18:40.832+0100 [conn1426297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:40.874+0100 [conn1425890] end connection 172.28.0.164:59717 (399 connections now open) 2015-10-05T06:18:40.875+0100 [mongosMain] connection accepted from 172.28.0.164:60812 #1426298 (400 connections now open) 2015-10-05T06:18:40.877+0100 [conn1426298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:41.283+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:41.284+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:41.406+0100 [conn1425904] end connection 172.28.0.163:50343 (399 connections now open) 2015-10-05T06:18:41.407+0100 [mongosMain] connection accepted from 172.28.0.163:51377 #1426299 (400 connections now open) 2015-10-05T06:18:41.408+0100 [conn1426299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:43.664+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:45.276+0100 [conn1425881] end connection 172.28.0.163:50277 (399 connections now open) 2015-10-05T06:18:45.276+0100 [conn1425894] end connection 172.28.0.163:50318 (399 connections now open) 2015-10-05T06:18:45.277+0100 [mongosMain] connection accepted from 172.28.0.163:51386 #1426300 (399 connections now open) 2015-10-05T06:18:45.278+0100 [mongosMain] connection accepted from 172.28.0.163:51388 #1426301 (400 connections now open) 2015-10-05T06:18:45.278+0100 [conn1426300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:45.279+0100 [conn1426301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:45.789+0100 [conn1425908] end connection 172.28.0.164:59757 (399 connections now open) 2015-10-05T06:18:45.790+0100 [mongosMain] connection accepted from 172.28.0.164:60823 #1426302 (400 connections now open) 2015-10-05T06:18:45.792+0100 [conn1426302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:45.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208355703b51053ec183a 2015-10-05T06:18:46.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:50.845+0100 [conn1425818] end connection 172.28.0.163:50147 (399 connections now open) 2015-10-05T06:18:50.847+0100 [mongosMain] connection accepted from 172.28.0.163:51396 #1426303 (400 connections now open) 2015-10-05T06:18:50.848+0100 [conn1426303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:52.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612083c5703b51053ec187d 2015-10-05T06:18:52.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:18:53.344+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:53.345+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:54.672+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:55.293+0100 [conn1425905] end connection 172.28.0.163:50346 (399 connections now open) 2015-10-05T06:18:55.293+0100 [conn1425871] end connection 172.28.0.163:50258 (398 connections now open) 2015-10-05T06:18:55.294+0100 [mongosMain] connection accepted from 172.28.0.163:51408 #1426304 (399 connections now open) 2015-10-05T06:18:55.294+0100 [mongosMain] connection accepted from 172.28.0.163:51409 #1426305 (400 connections now open) 2015-10-05T06:18:55.295+0100 [conn1426304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:55.295+0100 [conn1426305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:55.363+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:55.364+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:55.788+0100 [conn1425901] end connection 172.28.0.164:59737 (399 connections now open) 2015-10-05T06:18:55.790+0100 [mongosMain] connection accepted from 172.28.0.164:60842 #1426306 (400 connections now open) 2015-10-05T06:18:55.791+0100 [conn1426306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:18:58.444+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:18:58.444+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:18:58.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208425703b51053ec18b4 2015-10-05T06:18:58.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:00.845+0100 [conn1425761] end connection 172.28.0.163:50022 (399 connections now open) 2015-10-05T06:19:00.846+0100 [mongosMain] connection accepted from 172.28.0.163:51420 #1426307 (400 connections now open) 2015-10-05T06:19:00.847+0100 [conn1426307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:02.062+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:19:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:19:02.439+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:02.440+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:05.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208485703b51053ec18e7 2015-10-05T06:19:05.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:05.299+0100 [conn1425749] end connection 172.28.0.163:49991 (399 connections now open) 2015-10-05T06:19:05.299+0100 [conn1425919] end connection 172.28.0.163:50372 (399 connections now open) 2015-10-05T06:19:05.300+0100 [mongosMain] connection accepted from 172.28.0.163:51428 #1426308 (399 connections now open) 2015-10-05T06:19:05.301+0100 [mongosMain] connection accepted from 172.28.0.163:51429 #1426309 (400 connections now open) 2015-10-05T06:19:05.301+0100 [conn1426308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:05.301+0100 [conn1426309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:05.756+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:05.804+0100 [conn1425921] end connection 172.28.0.164:59797 (399 connections now open) 2015-10-05T06:19:05.805+0100 [conn1425923] end connection 172.28.0.164:59816 (398 connections now open) 2015-10-05T06:19:05.806+0100 [mongosMain] connection accepted from 172.28.0.164:60852 #1426310 (399 connections now open) 2015-10-05T06:19:05.807+0100 [mongosMain] connection accepted from 172.28.0.164:60853 #1426311 (400 connections now open) 2015-10-05T06:19:05.808+0100 [conn1426310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:05.808+0100 [conn1426311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:07.440+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:07.440+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:10.861+0100 [conn1425910] end connection 172.28.0.163:50351 (399 connections now open) 2015-10-05T06:19:10.862+0100 [mongosMain] connection accepted from 172.28.0.163:51439 #1426312 (400 connections now open) 2015-10-05T06:19:10.863+0100 [conn1426312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:11.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612084f5703b51053ec1915 2015-10-05T06:19:11.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:13.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:13.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:15.307+0100 [conn1425856] end connection 172.28.0.163:50231 (399 connections now open) 2015-10-05T06:19:15.308+0100 [conn1425922] end connection 172.28.0.163:50389 (398 connections now open) 2015-10-05T06:19:15.309+0100 [mongosMain] connection accepted from 172.28.0.163:51445 #1426313 (399 connections now open) 2015-10-05T06:19:15.309+0100 [mongosMain] connection accepted from 172.28.0.163:51446 #1426314 (400 connections now open) 2015-10-05T06:19:15.310+0100 [conn1426313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:15.310+0100 [conn1426314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:15.805+0100 [conn1425924] end connection 172.28.0.164:59817 (399 connections now open) 2015-10-05T06:19:15.805+0100 [conn1425907] end connection 172.28.0.164:59756 (398 connections now open) 2015-10-05T06:19:15.806+0100 [mongosMain] connection accepted from 172.28.0.164:60861 #1426315 (399 connections now open) 2015-10-05T06:19:15.806+0100 [mongosMain] connection accepted from 172.28.0.164:60862 #1426316 (400 connections now open) 2015-10-05T06:19:15.808+0100 [conn1426315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:15.808+0100 [conn1426316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:16.764+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:17.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208555703b51053ec1938 2015-10-05T06:19:18.066+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:20.523+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:20.524+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:20.860+0100 [conn1425918] end connection 172.28.0.163:50363 (399 connections now open) 2015-10-05T06:19:20.861+0100 [mongosMain] connection accepted from 172.28.0.163:51457 #1426317 (400 connections now open) 2015-10-05T06:19:20.862+0100 [conn1426317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:20.920+0100 [conn1425834] end connection 172.28.0.164:59571 (399 connections now open) 2015-10-05T06:19:20.921+0100 [mongosMain] connection accepted from 172.28.0.164:60870 #1426318 (400 connections now open) 2015-10-05T06:19:20.923+0100 [conn1426318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:24.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612085c5703b51053ec1965 2015-10-05T06:19:24.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:25.308+0100 [conn1425928] end connection 172.28.0.163:50412 (399 connections now open) 2015-10-05T06:19:25.309+0100 [mongosMain] connection accepted from 172.28.0.163:51460 #1426319 (400 connections now open) 2015-10-05T06:19:25.312+0100 [conn1426319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:26.203+0100 [conn1425843] end connection 172.28.0.164:59605 (399 connections now open) 2015-10-05T06:19:26.204+0100 [mongosMain] connection accepted from 172.28.0.164:60880 #1426320 (400 connections now open) 2015-10-05T06:19:26.206+0100 [conn1425798] end connection 172.28.0.163:50099 (399 connections now open) 2015-10-05T06:19:26.207+0100 [mongosMain] connection accepted from 172.28.0.163:51463 #1426321 (400 connections now open) 2015-10-05T06:19:26.208+0100 [conn1426321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:26.208+0100 [conn1426320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:27.773+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:28.572+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:28.572+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:29.030+0100 [mongosMain] connection accepted from 127.0.0.1:51466 #1426322 (401 connections now open) 2015-10-05T06:19:29.034+0100 [conn1426322] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:29.039+0100 [conn1426322] end connection 127.0.0.1:51466 (400 connections now open) 2015-10-05T06:19:30.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208625703b51053ec198c 2015-10-05T06:19:30.876+0100 [conn1425852] end connection 172.28.0.163:50223 (399 connections now open) 2015-10-05T06:19:30.878+0100 [mongosMain] connection accepted from 172.28.0.163:51468 #1426323 (400 connections now open) 2015-10-05T06:19:30.879+0100 [conn1426323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:30.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:30.937+0100 [conn1425884] end connection 172.28.0.164:59703 (399 connections now open) 2015-10-05T06:19:30.938+0100 [mongosMain] connection accepted from 172.28.0.164:60890 #1426324 (400 connections now open) 2015-10-05T06:19:30.940+0100 [conn1426324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:32.312+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:19:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:19:35.322+0100 [conn1425927] end connection 172.28.0.163:50411 (399 connections now open) 2015-10-05T06:19:35.322+0100 [conn1425932] end connection 172.28.0.163:50431 (399 connections now open) 2015-10-05T06:19:35.323+0100 [mongosMain] connection accepted from 172.28.0.163:51469 #1426325 (399 connections now open) 2015-10-05T06:19:35.323+0100 [mongosMain] connection accepted from 172.28.0.163:51470 #1426326 (400 connections now open) 2015-10-05T06:19:35.324+0100 [conn1426325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:35.324+0100 [conn1426326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:35.837+0100 [conn1425915] end connection 172.28.0.164:59774 (399 connections now open) 2015-10-05T06:19:35.837+0100 [mongosMain] connection accepted from 172.28.0.164:60897 #1426327 (400 connections now open) 2015-10-05T06:19:35.839+0100 [conn1426327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:37.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208685703b51053ec19b5 2015-10-05T06:19:37.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:37.590+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:37.590+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:38.780+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:39.229+0100 [mongosMain] connection accepted from 127.0.0.1:51476 #1426328 (401 connections now open) 2015-10-05T06:19:39.232+0100 [conn1426328] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:39.235+0100 [conn1426328] end connection 127.0.0.1:51476 (400 connections now open) 2015-10-05T06:19:40.878+0100 [conn1425891] end connection 172.28.0.163:50305 (399 connections now open) 2015-10-05T06:19:40.879+0100 [mongosMain] connection accepted from 172.28.0.163:51479 #1426329 (400 connections now open) 2015-10-05T06:19:40.880+0100 [conn1426329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:40.952+0100 [conn1425934] end connection 172.28.0.164:59844 (399 connections now open) 2015-10-05T06:19:40.953+0100 [mongosMain] connection accepted from 172.28.0.164:60909 #1426330 (400 connections now open) 2015-10-05T06:19:40.957+0100 [conn1426330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:45.835+0100 [conn1425682] end connection 172.28.0.164:59188 (399 connections now open) 2015-10-05T06:19:45.836+0100 [mongosMain] connection accepted from 172.28.0.164:60916 #1426331 (400 connections now open) 2015-10-05T06:19:45.838+0100 [conn1426331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:47.598+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:47.598+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:19:49.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208755703b51053ec1a11 2015-10-05T06:19:49.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:49.789+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:50.892+0100 [conn1425926] end connection 172.28.0.163:50401 (399 connections now open) 2015-10-05T06:19:50.893+0100 [mongosMain] connection accepted from 172.28.0.163:51493 #1426332 (400 connections now open) 2015-10-05T06:19:50.894+0100 [conn1426332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:55.836+0100 [conn1425824] end connection 172.28.0.164:59542 (399 connections now open) 2015-10-05T06:19:55.838+0100 [mongosMain] connection accepted from 172.28.0.164:60929 #1426333 (400 connections now open) 2015-10-05T06:19:55.840+0100 [conn1426333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:19:55.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612087b5703b51053ec1a3d 2015-10-05T06:19:55.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:19:58.609+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:19:58.609+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:00.793+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:02.595+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:20:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:20:05.852+0100 [conn1425864] end connection 172.28.0.164:59653 (399 connections now open) 2015-10-05T06:20:05.853+0100 [mongosMain] connection accepted from 172.28.0.164:60934 #1426334 (400 connections now open) 2015-10-05T06:20:05.854+0100 [conn1426334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:08.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208875703b51053ec1aab 2015-10-05T06:20:08.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:20:10.626+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:10.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:11.485+0100 [conn1425912] end connection 172.28.0.163:50354 (399 connections now open) 2015-10-05T06:20:11.486+0100 [mongosMain] connection accepted from 172.28.0.163:51526 #1426335 (400 connections now open) 2015-10-05T06:20:11.487+0100 [conn1426335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:11.796+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:12.629+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:12.630+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:15.355+0100 [conn1425937] end connection 172.28.0.163:50444 (399 connections now open) 2015-10-05T06:20:15.356+0100 [mongosMain] connection accepted from 172.28.0.163:51532 #1426336 (400 connections now open) 2015-10-05T06:20:15.357+0100 [conn1426336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:15.639+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:15.639+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:19.638+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:19.638+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:20.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208945703b51053ec1b18 2015-10-05T06:20:20.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:20:20.924+0100 [conn1425935] end connection 172.28.0.163:50438 (399 connections now open) 2015-10-05T06:20:20.925+0100 [mongosMain] connection accepted from 172.28.0.163:51540 #1426337 (400 connections now open) 2015-10-05T06:20:20.926+0100 [conn1426337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:22.800+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:24.643+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:24.643+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:25.370+0100 [conn1425940] end connection 172.28.0.163:50453 (399 connections now open) 2015-10-05T06:20:25.370+0100 [conn1425945] end connection 172.28.0.163:50468 (399 connections now open) 2015-10-05T06:20:25.371+0100 [mongosMain] connection accepted from 172.28.0.163:51545 #1426338 (399 connections now open) 2015-10-05T06:20:25.372+0100 [mongosMain] connection accepted from 172.28.0.163:51546 #1426339 (400 connections now open) 2015-10-05T06:20:25.372+0100 [conn1426338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:25.373+0100 [conn1426339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:25.868+0100 [conn1425916] end connection 172.28.0.164:59775 (399 connections now open) 2015-10-05T06:20:25.870+0100 [mongosMain] connection accepted from 172.28.0.164:60960 #1426340 (400 connections now open) 2015-10-05T06:20:25.872+0100 [conn1426340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:28.481+0100 [mongosMain] connection accepted from 127.0.0.1:51551 #1426341 (401 connections now open) 2015-10-05T06:20:28.481+0100 [conn1426341] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:28.497+0100 [conn1426341] end connection 127.0.0.1:51551 (400 connections now open) 2015-10-05T06:20:30.656+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:30.656+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:30.935+0100 [conn1425939] end connection 172.28.0.163:50449 (399 connections now open) 2015-10-05T06:20:30.937+0100 [mongosMain] connection accepted from 172.28.0.163:51558 #1426342 (400 connections now open) 2015-10-05T06:20:30.938+0100 [conn1426342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:31.016+0100 [conn1425851] end connection 172.28.0.164:59627 (399 connections now open) 2015-10-05T06:20:31.017+0100 [mongosMain] connection accepted from 172.28.0.164:60967 #1426343 (400 connections now open) 2015-10-05T06:20:31.019+0100 [conn1426343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:31.501+0100 [conn1425952] end connection 172.28.0.163:50524 (399 connections now open) 2015-10-05T06:20:31.502+0100 [mongosMain] connection accepted from 172.28.0.163:51559 #1426344 (400 connections now open) 2015-10-05T06:20:31.503+0100 [conn1426344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:31.562+0100 [conn1425911] end connection 172.28.0.164:59764 (399 connections now open) 2015-10-05T06:20:31.563+0100 [mongosMain] connection accepted from 172.28.0.164:60970 #1426345 (400 connections now open) 2015-10-05T06:20:31.564+0100 [conn1426345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:32.866+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:20:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:20:33.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208a05703b51053ec1b7a 2015-10-05T06:20:33.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:20:33.806+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:35.370+0100 [conn1425914] end connection 172.28.0.163:50356 (399 connections now open) 2015-10-05T06:20:35.372+0100 [mongosMain] connection accepted from 172.28.0.163:51562 #1426346 (400 connections now open) 2015-10-05T06:20:35.373+0100 [conn1426346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:35.867+0100 [conn1425929] end connection 172.28.0.164:59833 (399 connections now open) 2015-10-05T06:20:35.867+0100 [conn1425849] end connection 172.28.0.164:59620 (399 connections now open) 2015-10-05T06:20:35.869+0100 [mongosMain] connection accepted from 172.28.0.164:60976 #1426347 (399 connections now open) 2015-10-05T06:20:35.869+0100 [mongosMain] connection accepted from 172.28.0.164:60977 #1426348 (400 connections now open) 2015-10-05T06:20:35.870+0100 [conn1426347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:35.871+0100 [conn1426348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:37.662+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:37.663+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:39.354+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:20:39.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:20:39.573+0100 [mongosMain] connection accepted from 127.0.0.1:51567 #1426349 (401 connections now open) 2015-10-05T06:20:39.575+0100 [conn1426349] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:39.580+0100 [conn1426349] end connection 127.0.0.1:51567 (400 connections now open) 2015-10-05T06:20:40.960+0100 [conn1425944] end connection 172.28.0.163:50462 (399 connections now open) 2015-10-05T06:20:40.961+0100 [mongosMain] connection accepted from 172.28.0.163:51569 #1426350 (400 connections now open) 2015-10-05T06:20:40.962+0100 [conn1426350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:41.505+0100 [conn1425950] end connection 172.28.0.163:50512 (399 connections now open) 2015-10-05T06:20:41.506+0100 [mongosMain] connection accepted from 172.28.0.163:51571 #1426351 (400 connections now open) 2015-10-05T06:20:41.507+0100 [conn1426351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:41.577+0100 [conn1425958] end connection 172.28.0.164:59943 (399 connections now open) 2015-10-05T06:20:41.578+0100 [mongosMain] connection accepted from 172.28.0.164:60989 #1426352 (400 connections now open) 2015-10-05T06:20:41.580+0100 [conn1426352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:44.825+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:45.386+0100 [conn1425960] end connection 172.28.0.163:50540 (399 connections now open) 2015-10-05T06:20:45.386+0100 [conn1425961] end connection 172.28.0.163:50541 (399 connections now open) 2015-10-05T06:20:45.387+0100 [mongosMain] connection accepted from 172.28.0.163:51579 #1426353 (399 connections now open) 2015-10-05T06:20:45.387+0100 [mongosMain] connection accepted from 172.28.0.163:51580 #1426354 (400 connections now open) 2015-10-05T06:20:45.388+0100 [conn1426353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:45.388+0100 [conn1426354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:45.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208ad5703b51053ec1bf2 2015-10-05T06:20:45.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:45.678+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:45.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:20:45.882+0100 [conn1425954] end connection 172.28.0.164:59933 (399 connections now open) 2015-10-05T06:20:45.884+0100 [mongosMain] connection accepted from 172.28.0.164:60998 #1426355 (400 connections now open) 2015-10-05T06:20:45.885+0100 [conn1426355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:50.971+0100 [conn1425948] end connection 172.28.0.163:50478 (399 connections now open) 2015-10-05T06:20:50.973+0100 [mongosMain] connection accepted from 172.28.0.163:51589 #1426356 (400 connections now open) 2015-10-05T06:20:50.974+0100 [conn1426356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:51.517+0100 [conn1425959] end connection 172.28.0.163:50537 (399 connections now open) 2015-10-05T06:20:51.518+0100 [mongosMain] connection accepted from 172.28.0.163:51591 #1426357 (400 connections now open) 2015-10-05T06:20:51.519+0100 [conn1426357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:51.577+0100 [conn1425965] end connection 172.28.0.164:59965 (399 connections now open) 2015-10-05T06:20:51.579+0100 [mongosMain] connection accepted from 172.28.0.164:61007 #1426358 (400 connections now open) 2015-10-05T06:20:51.580+0100 [conn1426358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:54.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:54.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:20:55.386+0100 [conn1425931] end connection 172.28.0.163:50430 (399 connections now open) 2015-10-05T06:20:55.387+0100 [mongosMain] connection accepted from 172.28.0.163:51600 #1426359 (400 connections now open) 2015-10-05T06:20:55.388+0100 [conn1426359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:55.883+0100 [conn1425962] end connection 172.28.0.164:59953 (399 connections now open) 2015-10-05T06:20:55.883+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:20:55.884+0100 [mongosMain] connection accepted from 172.28.0.164:61016 #1426360 (400 connections now open) 2015-10-05T06:20:55.886+0100 [conn1426360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:20:57.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208b95703b51053ec1c69 2015-10-05T06:20:58.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:21:00.987+0100 [conn1425787] end connection 172.28.0.163:50069 (399 connections now open) 2015-10-05T06:21:00.988+0100 [mongosMain] connection accepted from 172.28.0.163:51644 #1426361 (400 connections now open) 2015-10-05T06:21:00.989+0100 [conn1426361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:01.533+0100 [conn1425966] end connection 172.28.0.163:50552 (399 connections now open) 2015-10-05T06:21:01.534+0100 [mongosMain] connection accepted from 172.28.0.163:51648 #1426362 (400 connections now open) 2015-10-05T06:21:01.535+0100 [conn1426362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:01.593+0100 [conn1425970] end connection 172.28.0.164:59979 (399 connections now open) 2015-10-05T06:21:01.594+0100 [mongosMain] connection accepted from 172.28.0.164:61021 #1426363 (400 connections now open) 2015-10-05T06:21:01.596+0100 [conn1426363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:03.145+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:21:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:21:04.679+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:04.679+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:05.401+0100 [conn1425946] end connection 172.28.0.163:50469 (399 connections now open) 2015-10-05T06:21:05.401+0100 [conn1425900] end connection 172.28.0.163:50335 (399 connections now open) 2015-10-05T06:21:05.402+0100 [mongosMain] connection accepted from 172.28.0.163:51656 #1426364 (399 connections now open) 2015-10-05T06:21:05.403+0100 [mongosMain] connection accepted from 172.28.0.163:51657 #1426365 (400 connections now open) 2015-10-05T06:21:05.403+0100 [conn1426364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:05.404+0100 [conn1426365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:05.900+0100 [conn1425888] end connection 172.28.0.164:59715 (399 connections now open) 2015-10-05T06:21:05.901+0100 [mongosMain] connection accepted from 172.28.0.164:61027 #1426366 (400 connections now open) 2015-10-05T06:21:05.903+0100 [conn1426366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:06.887+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:10.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208c65703b51053ec1cf8 2015-10-05T06:21:10.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:21:10.987+0100 [conn1425969] end connection 172.28.0.163:50570 (399 connections now open) 2015-10-05T06:21:10.989+0100 [mongosMain] connection accepted from 172.28.0.163:51667 #1426367 (400 connections now open) 2015-10-05T06:21:10.990+0100 [conn1426367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:11.063+0100 [conn1425826] end connection 172.28.0.164:59550 (399 connections now open) 2015-10-05T06:21:11.064+0100 [mongosMain] connection accepted from 172.28.0.164:61030 #1426368 (400 connections now open) 2015-10-05T06:21:11.066+0100 [conn1426368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:11.533+0100 [conn1425975] end connection 172.28.0.163:50591 (399 connections now open) 2015-10-05T06:21:11.534+0100 [mongosMain] connection accepted from 172.28.0.163:51668 #1426369 (400 connections now open) 2015-10-05T06:21:11.535+0100 [conn1426369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:11.609+0100 [conn1425974] end connection 172.28.0.164:59992 (399 connections now open) 2015-10-05T06:21:11.610+0100 [mongosMain] connection accepted from 172.28.0.164:61032 #1426370 (400 connections now open) 2015-10-05T06:21:11.611+0100 [conn1426370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:15.403+0100 [conn1425968] end connection 172.28.0.163:50559 (399 connections now open) 2015-10-05T06:21:15.404+0100 [mongosMain] connection accepted from 172.28.0.163:51675 #1426371 (400 connections now open) 2015-10-05T06:21:15.405+0100 [conn1426371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:15.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:15.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:15.914+0100 [conn1425933] end connection 172.28.0.164:59837 (399 connections now open) 2015-10-05T06:21:15.914+0100 [conn1425883] end connection 172.28.0.164:59693 (399 connections now open) 2015-10-05T06:21:15.915+0100 [mongosMain] connection accepted from 172.28.0.164:61036 #1426372 (399 connections now open) 2015-10-05T06:21:15.916+0100 [mongosMain] connection accepted from 172.28.0.164:61037 #1426373 (400 connections now open) 2015-10-05T06:21:15.917+0100 [conn1426372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:15.918+0100 [conn1426373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:16.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208cc5703b51053ec1d24 2015-10-05T06:21:17.069+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:21:17.922+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:21.003+0100 [conn1425973] end connection 172.28.0.163:50588 (399 connections now open) 2015-10-05T06:21:21.005+0100 [mongosMain] connection accepted from 172.28.0.163:51683 #1426374 (400 connections now open) 2015-10-05T06:21:21.006+0100 [conn1426374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:21.064+0100 [conn1425956] end connection 172.28.0.164:59940 (399 connections now open) 2015-10-05T06:21:21.066+0100 [mongosMain] connection accepted from 172.28.0.164:61042 #1426375 (400 connections now open) 2015-10-05T06:21:21.067+0100 [conn1426375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:21.549+0100 [conn1425982] end connection 172.28.0.163:50609 (399 connections now open) 2015-10-05T06:21:21.551+0100 [mongosMain] connection accepted from 172.28.0.163:51684 #1426376 (400 connections now open) 2015-10-05T06:21:21.552+0100 [conn1426376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:21.608+0100 [conn1425981] end connection 172.28.0.164:60001 (399 connections now open) 2015-10-05T06:21:21.610+0100 [mongosMain] connection accepted from 172.28.0.164:61046 #1426377 (400 connections now open) 2015-10-05T06:21:21.612+0100 [conn1426377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:25.417+0100 [conn1425977] end connection 172.28.0.163:50598 (399 connections now open) 2015-10-05T06:21:25.418+0100 [mongosMain] connection accepted from 172.28.0.163:51686 #1426378 (400 connections now open) 2015-10-05T06:21:25.419+0100 [conn1426378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:25.930+0100 [conn1425902] end connection 172.28.0.164:59738 (399 connections now open) 2015-10-05T06:21:25.932+0100 [mongosMain] connection accepted from 172.28.0.164:61052 #1426379 (400 connections now open) 2015-10-05T06:21:25.934+0100 [conn1426379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:27.678+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:27.678+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:28.583+0100 [mongosMain] connection accepted from 127.0.0.1:51692 #1426380 (401 connections now open) 2015-10-05T06:21:28.586+0100 [conn1426380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:28.591+0100 [conn1426380] end connection 127.0.0.1:51692 (400 connections now open) 2015-10-05T06:21:28.927+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:29.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208d95703b51053ec1d8b 2015-10-05T06:21:29.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:21:29.685+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:29.686+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:31.005+0100 [conn1425957] end connection 172.28.0.163:50534 (399 connections now open) 2015-10-05T06:21:31.006+0100 [mongosMain] connection accepted from 172.28.0.163:51695 #1426381 (400 connections now open) 2015-10-05T06:21:31.007+0100 [conn1426381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:31.062+0100 [conn1425947] end connection 172.28.0.164:59895 (399 connections now open) 2015-10-05T06:21:31.063+0100 [mongosMain] connection accepted from 172.28.0.164:61062 #1426382 (400 connections now open) 2015-10-05T06:21:31.064+0100 [conn1426382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:31.550+0100 [conn1425989] end connection 172.28.0.163:50630 (399 connections now open) 2015-10-05T06:21:31.552+0100 [mongosMain] connection accepted from 172.28.0.163:51696 #1426383 (400 connections now open) 2015-10-05T06:21:31.553+0100 [conn1426383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:31.608+0100 [conn1425988] end connection 172.28.0.164:60019 (399 connections now open) 2015-10-05T06:21:31.610+0100 [mongosMain] connection accepted from 172.28.0.164:61066 #1426384 (400 connections now open) 2015-10-05T06:21:31.611+0100 [conn1426384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:32.696+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:32.696+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:33.415+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:21:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:21:35.946+0100 [conn1425992] end connection 172.28.0.164:60028 (399 connections now open) 2015-10-05T06:21:35.946+0100 [conn1425920] end connection 172.28.0.164:59796 (398 connections now open) 2015-10-05T06:21:35.947+0100 [mongosMain] connection accepted from 172.28.0.164:61074 #1426385 (399 connections now open) 2015-10-05T06:21:35.947+0100 [mongosMain] connection accepted from 172.28.0.164:61073 #1426386 (400 connections now open) 2015-10-05T06:21:35.955+0100 [conn1426385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:35.956+0100 [conn1426386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:36.707+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:36.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:39.931+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:40.178+0100 [mongosMain] connection accepted from 127.0.0.1:51704 #1426387 (401 connections now open) 2015-10-05T06:21:40.181+0100 [conn1426387] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:40.186+0100 [conn1426387] end connection 127.0.0.1:51704 (400 connections now open) 2015-10-05T06:21:41.078+0100 [conn1425943] end connection 172.28.0.164:59878 (399 connections now open) 2015-10-05T06:21:41.081+0100 [mongosMain] connection accepted from 172.28.0.164:61085 #1426388 (400 connections now open) 2015-10-05T06:21:41.088+0100 [conn1426388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:41.564+0100 [conn1425997] end connection 172.28.0.163:50640 (399 connections now open) 2015-10-05T06:21:41.566+0100 [mongosMain] connection accepted from 172.28.0.163:51708 #1426389 (400 connections now open) 2015-10-05T06:21:41.567+0100 [conn1426389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:41.625+0100 [conn1425996] end connection 172.28.0.164:60039 (399 connections now open) 2015-10-05T06:21:41.626+0100 [mongosMain] connection accepted from 172.28.0.164:61088 #1426390 (400 connections now open) 2015-10-05T06:21:41.627+0100 [conn1426390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:41.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:41.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:45.433+0100 [conn1425971] end connection 172.28.0.163:50577 (399 connections now open) 2015-10-05T06:21:45.435+0100 [mongosMain] connection accepted from 172.28.0.163:51715 #1426391 (400 connections now open) 2015-10-05T06:21:45.436+0100 [conn1426391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:45.961+0100 [conn1425985] end connection 172.28.0.164:60004 (399 connections now open) 2015-10-05T06:21:45.962+0100 [mongosMain] connection accepted from 172.28.0.164:61096 #1426392 (400 connections now open) 2015-10-05T06:21:45.964+0100 [conn1426392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:47.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208eb5703b51053ec1e0f 2015-10-05T06:21:47.791+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:47.791+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:47.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:21:50.938+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:51.020+0100 [conn1425964] end connection 172.28.0.163:50549 (399 connections now open) 2015-10-05T06:21:51.022+0100 [mongosMain] connection accepted from 172.28.0.163:51726 #1426393 (400 connections now open) 2015-10-05T06:21:51.023+0100 [conn1426393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:51.079+0100 [conn1425925] end connection 172.28.0.164:59826 (399 connections now open) 2015-10-05T06:21:51.080+0100 [mongosMain] connection accepted from 172.28.0.164:61103 #1426394 (400 connections now open) 2015-10-05T06:21:51.081+0100 [conn1426394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:51.566+0100 [conn1426005] end connection 172.28.0.163:50651 (399 connections now open) 2015-10-05T06:21:51.567+0100 [mongosMain] connection accepted from 172.28.0.163:51729 #1426395 (400 connections now open) 2015-10-05T06:21:51.569+0100 [conn1426395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:51.625+0100 [conn1426004] end connection 172.28.0.164:60060 (399 connections now open) 2015-10-05T06:21:51.626+0100 [mongosMain] connection accepted from 172.28.0.164:61106 #1426396 (400 connections now open) 2015-10-05T06:21:51.627+0100 [conn1426396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:54.795+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:21:54.795+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:21:55.450+0100 [conn1425984] end connection 172.28.0.163:50619 (399 connections now open) 2015-10-05T06:21:55.451+0100 [mongosMain] connection accepted from 172.28.0.163:51736 #1426397 (400 connections now open) 2015-10-05T06:21:55.453+0100 [conn1426397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:56.788+0100 [conn1425991] end connection 172.28.0.163:50634 (399 connections now open) 2015-10-05T06:21:56.789+0100 [mongosMain] connection accepted from 172.28.0.163:51739 #1426398 (400 connections now open) 2015-10-05T06:21:56.790+0100 [conn1426398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:56.801+0100 [conn1425999] end connection 172.28.0.164:60046 (399 connections now open) 2015-10-05T06:21:56.806+0100 [conn1425858] end connection 172.28.0.164:59635 (398 connections now open) 2015-10-05T06:21:56.807+0100 [mongosMain] connection accepted from 172.28.0.164:61112 #1426399 (399 connections now open) 2015-10-05T06:21:56.816+0100 [mongosMain] connection accepted from 172.28.0.164:61114 #1426400 (400 connections now open) 2015-10-05T06:21:56.828+0100 [conn1426399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:21:56.831+0100 [conn1426400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:00.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561208f85703b51053ec1e65 2015-10-05T06:22:00.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:01.034+0100 [conn1425995] end connection 172.28.0.163:50639 (399 connections now open) 2015-10-05T06:22:01.035+0100 [mongosMain] connection accepted from 172.28.0.163:51747 #1426401 (400 connections now open) 2015-10-05T06:22:01.037+0100 [conn1426401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:01.094+0100 [conn1425986] end connection 172.28.0.164:60017 (399 connections now open) 2015-10-05T06:22:01.095+0100 [mongosMain] connection accepted from 172.28.0.164:61120 #1426402 (400 connections now open) 2015-10-05T06:22:01.097+0100 [conn1426402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:01.580+0100 [conn1426012] end connection 172.28.0.163:50670 (399 connections now open) 2015-10-05T06:22:01.581+0100 [mongosMain] connection accepted from 172.28.0.163:51750 #1426403 (400 connections now open) 2015-10-05T06:22:01.582+0100 [conn1426403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:01.640+0100 [conn1426011] end connection 172.28.0.164:60079 (399 connections now open) 2015-10-05T06:22:01.641+0100 [mongosMain] connection accepted from 172.28.0.164:61122 #1426404 (400 connections now open) 2015-10-05T06:22:01.643+0100 [conn1426404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:01.942+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:02.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:02.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:03.652+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:22:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:22:05.450+0100 [conn1425936] end connection 172.28.0.163:50443 (399 connections now open) 2015-10-05T06:22:05.451+0100 [mongosMain] connection accepted from 172.28.0.163:51757 #1426405 (400 connections now open) 2015-10-05T06:22:05.452+0100 [conn1426405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:06.523+0100 [conn1425951] end connection 172.28.0.164:59917 (399 connections now open) 2015-10-05T06:22:06.524+0100 [conn1426008] end connection 172.28.0.164:60070 (398 connections now open) 2015-10-05T06:22:06.524+0100 [mongosMain] connection accepted from 172.28.0.164:61128 #1426406 (399 connections now open) 2015-10-05T06:22:06.525+0100 [mongosMain] connection accepted from 172.28.0.164:61129 #1426407 (400 connections now open) 2015-10-05T06:22:06.526+0100 [conn1426406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:06.527+0100 [conn1426407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:11.035+0100 [conn1425980] end connection 172.28.0.163:50607 (399 connections now open) 2015-10-05T06:22:11.036+0100 [mongosMain] connection accepted from 172.28.0.163:51767 #1426408 (400 connections now open) 2015-10-05T06:22:11.038+0100 [conn1426408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:11.110+0100 [conn1426002] end connection 172.28.0.164:60057 (399 connections now open) 2015-10-05T06:22:11.111+0100 [mongosMain] connection accepted from 172.28.0.164:61134 #1426409 (400 connections now open) 2015-10-05T06:22:11.113+0100 [conn1426409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:11.581+0100 [conn1426019] end connection 172.28.0.163:50690 (399 connections now open) 2015-10-05T06:22:11.582+0100 [mongosMain] connection accepted from 172.28.0.163:51769 #1426410 (400 connections now open) 2015-10-05T06:22:11.583+0100 [conn1426410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:11.656+0100 [conn1426018] end connection 172.28.0.164:60095 (399 connections now open) 2015-10-05T06:22:11.657+0100 [mongosMain] connection accepted from 172.28.0.164:61136 #1426411 (400 connections now open) 2015-10-05T06:22:11.659+0100 [conn1426411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:11.806+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:11.806+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:12.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209045703b51053ec1f05 2015-10-05T06:22:12.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:12.948+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:15.465+0100 [conn1425976] end connection 172.28.0.163:50597 (399 connections now open) 2015-10-05T06:22:15.465+0100 [conn1425990] end connection 172.28.0.163:50633 (399 connections now open) 2015-10-05T06:22:15.466+0100 [mongosMain] connection accepted from 172.28.0.163:51778 #1426412 (399 connections now open) 2015-10-05T06:22:15.467+0100 [mongosMain] connection accepted from 172.28.0.163:51779 #1426413 (400 connections now open) 2015-10-05T06:22:15.467+0100 [conn1426412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:15.468+0100 [conn1426413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:16.539+0100 [conn1426007] end connection 172.28.0.164:60069 (399 connections now open) 2015-10-05T06:22:16.540+0100 [conn1425972] end connection 172.28.0.164:59987 (398 connections now open) 2015-10-05T06:22:16.541+0100 [mongosMain] connection accepted from 172.28.0.164:61142 #1426414 (399 connections now open) 2015-10-05T06:22:16.541+0100 [mongosMain] connection accepted from 172.28.0.164:61143 #1426415 (400 connections now open) 2015-10-05T06:22:16.543+0100 [conn1426414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:16.543+0100 [conn1426415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:19.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612090a5703b51053ec1f48 2015-10-05T06:22:19.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:21.050+0100 [conn1426003] end connection 172.28.0.163:50649 (399 connections now open) 2015-10-05T06:22:21.051+0100 [mongosMain] connection accepted from 172.28.0.163:51789 #1426416 (400 connections now open) 2015-10-05T06:22:21.052+0100 [conn1426416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:21.110+0100 [conn1425979] end connection 172.28.0.164:59998 (399 connections now open) 2015-10-05T06:22:21.110+0100 [mongosMain] connection accepted from 172.28.0.164:61148 #1426417 (400 connections now open) 2015-10-05T06:22:21.112+0100 [conn1426417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:21.596+0100 [conn1426027] end connection 172.28.0.163:50714 (399 connections now open) 2015-10-05T06:22:21.597+0100 [mongosMain] connection accepted from 172.28.0.163:51793 #1426418 (400 connections now open) 2015-10-05T06:22:21.598+0100 [conn1426418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:21.656+0100 [conn1426026] end connection 172.28.0.164:60106 (399 connections now open) 2015-10-05T06:22:21.658+0100 [mongosMain] connection accepted from 172.28.0.164:61150 #1426419 (400 connections now open) 2015-10-05T06:22:21.660+0100 [conn1426419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:21.811+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:21.811+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:23.970+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:25.465+0100 [conn1426028] end connection 172.28.0.163:50720 (399 connections now open) 2015-10-05T06:22:25.465+0100 [conn1425880] end connection 172.28.0.163:50276 (399 connections now open) 2015-10-05T06:22:25.466+0100 [mongosMain] connection accepted from 172.28.0.163:51798 #1426420 (399 connections now open) 2015-10-05T06:22:25.467+0100 [mongosMain] connection accepted from 172.28.0.163:51799 #1426421 (400 connections now open) 2015-10-05T06:22:25.467+0100 [conn1426420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:25.468+0100 [conn1426421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:25.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209115703b51053ec1f96 2015-10-05T06:22:25.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:26.542+0100 [conn1426014] end connection 172.28.0.164:60088 (399 connections now open) 2015-10-05T06:22:26.542+0100 [conn1426000] end connection 172.28.0.164:60047 (399 connections now open) 2015-10-05T06:22:26.543+0100 [mongosMain] connection accepted from 172.28.0.164:61162 #1426422 (399 connections now open) 2015-10-05T06:22:26.544+0100 [mongosMain] connection accepted from 172.28.0.164:61161 #1426423 (400 connections now open) 2015-10-05T06:22:26.545+0100 [conn1426422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:26.546+0100 [conn1426423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:28.354+0100 [mongosMain] connection accepted from 127.0.0.1:51802 #1426424 (401 connections now open) 2015-10-05T06:22:28.357+0100 [conn1426424] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:28.362+0100 [conn1426424] end connection 127.0.0.1:51802 (400 connections now open) 2015-10-05T06:22:31.066+0100 [conn1425930] end connection 172.28.0.163:50425 (399 connections now open) 2015-10-05T06:22:31.067+0100 [mongosMain] connection accepted from 172.28.0.163:51805 #1426425 (400 connections now open) 2015-10-05T06:22:31.068+0100 [conn1426425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:31.126+0100 [conn1425994] end connection 172.28.0.164:60035 (399 connections now open) 2015-10-05T06:22:31.127+0100 [mongosMain] connection accepted from 172.28.0.164:61167 #1426426 (400 connections now open) 2015-10-05T06:22:31.129+0100 [conn1426426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:31.612+0100 [conn1426035] end connection 172.28.0.163:50733 (399 connections now open) 2015-10-05T06:22:31.614+0100 [mongosMain] connection accepted from 172.28.0.163:51813 #1426427 (400 connections now open) 2015-10-05T06:22:31.615+0100 [conn1426427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:31.672+0100 [conn1426034] end connection 172.28.0.164:60121 (399 connections now open) 2015-10-05T06:22:31.673+0100 [mongosMain] connection accepted from 172.28.0.164:61169 #1426428 (400 connections now open) 2015-10-05T06:22:31.674+0100 [conn1426428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:31.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209175703b51053ec1fef 2015-10-05T06:22:31.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:32.818+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:32.818+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:33.900+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:22:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:22:34.974+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:35.480+0100 [conn1425906] end connection 172.28.0.163:50347 (399 connections now open) 2015-10-05T06:22:35.481+0100 [mongosMain] connection accepted from 172.28.0.163:51818 #1426429 (400 connections now open) 2015-10-05T06:22:35.482+0100 [conn1426429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:36.556+0100 [conn1426022] end connection 172.28.0.164:60100 (399 connections now open) 2015-10-05T06:22:36.556+0100 [conn1425953] end connection 172.28.0.164:59932 (399 connections now open) 2015-10-05T06:22:36.557+0100 [mongosMain] connection accepted from 172.28.0.164:61181 #1426430 (399 connections now open) 2015-10-05T06:22:36.558+0100 [mongosMain] connection accepted from 172.28.0.164:61182 #1426431 (400 connections now open) 2015-10-05T06:22:36.559+0100 [conn1426430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:36.559+0100 [conn1426431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:40.015+0100 [mongosMain] connection accepted from 127.0.0.1:51820 #1426432 (401 connections now open) 2015-10-05T06:22:40.019+0100 [conn1426432] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:40.022+0100 [conn1426432] end connection 127.0.0.1:51820 (400 connections now open) 2015-10-05T06:22:41.067+0100 [conn1425987] end connection 172.28.0.163:50627 (399 connections now open) 2015-10-05T06:22:41.068+0100 [mongosMain] connection accepted from 172.28.0.163:51825 #1426433 (400 connections now open) 2015-10-05T06:22:41.069+0100 [conn1426433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:41.141+0100 [conn1426032] end connection 172.28.0.164:60119 (399 connections now open) 2015-10-05T06:22:41.142+0100 [mongosMain] connection accepted from 172.28.0.164:61188 #1426434 (400 connections now open) 2015-10-05T06:22:41.143+0100 [conn1426434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:41.613+0100 [conn1426044] end connection 172.28.0.163:50745 (399 connections now open) 2015-10-05T06:22:41.614+0100 [mongosMain] connection accepted from 172.28.0.163:51828 #1426435 (400 connections now open) 2015-10-05T06:22:41.616+0100 [conn1426435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:41.687+0100 [conn1426043] end connection 172.28.0.164:60142 (399 connections now open) 2015-10-05T06:22:41.688+0100 [mongosMain] connection accepted from 172.28.0.164:61190 #1426436 (400 connections now open) 2015-10-05T06:22:41.690+0100 [conn1426436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:44.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209235703b51053ec206e 2015-10-05T06:22:44.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:44.837+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:44.837+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:45.482+0100 [conn1425967] end connection 172.28.0.163:50558 (399 connections now open) 2015-10-05T06:22:45.483+0100 [mongosMain] connection accepted from 172.28.0.163:51835 #1426437 (400 connections now open) 2015-10-05T06:22:45.484+0100 [conn1426437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:45.990+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:46.570+0100 [conn1426031] end connection 172.28.0.164:60110 (399 connections now open) 2015-10-05T06:22:46.572+0100 [mongosMain] connection accepted from 172.28.0.164:61200 #1426438 (400 connections now open) 2015-10-05T06:22:46.574+0100 [conn1426438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:46.851+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:46.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:49.861+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:49.861+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:51.082+0100 [conn1426010] end connection 172.28.0.163:50669 (399 connections now open) 2015-10-05T06:22:51.083+0100 [mongosMain] connection accepted from 172.28.0.163:51846 #1426439 (400 connections now open) 2015-10-05T06:22:51.085+0100 [conn1426439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:51.157+0100 [conn1426009] end connection 172.28.0.164:60076 (399 connections now open) 2015-10-05T06:22:51.158+0100 [mongosMain] connection accepted from 172.28.0.164:61207 #1426440 (400 connections now open) 2015-10-05T06:22:51.160+0100 [conn1426440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:51.627+0100 [conn1426052] end connection 172.28.0.163:50758 (399 connections now open) 2015-10-05T06:22:51.640+0100 [mongosMain] connection accepted from 172.28.0.163:51848 #1426441 (400 connections now open) 2015-10-05T06:22:51.641+0100 [conn1426441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:51.687+0100 [conn1426051] end connection 172.28.0.164:60165 (399 connections now open) 2015-10-05T06:22:51.688+0100 [mongosMain] connection accepted from 172.28.0.164:61210 #1426442 (400 connections now open) 2015-10-05T06:22:51.690+0100 [conn1426442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:53.866+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:53.866+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:22:55.496+0100 [conn1425983] end connection 172.28.0.163:50618 (399 connections now open) 2015-10-05T06:22:55.497+0100 [conn1426021] end connection 172.28.0.163:50698 (398 connections now open) 2015-10-05T06:22:55.498+0100 [mongosMain] connection accepted from 172.28.0.163:51856 #1426443 (399 connections now open) 2015-10-05T06:22:55.498+0100 [mongosMain] connection accepted from 172.28.0.163:51857 #1426444 (400 connections now open) 2015-10-05T06:22:55.499+0100 [conn1426443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:55.499+0100 [conn1426444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:56.570+0100 [conn1426047] end connection 172.28.0.164:60153 (399 connections now open) 2015-10-05T06:22:56.570+0100 [conn1426030] end connection 172.28.0.164:60111 (398 connections now open) 2015-10-05T06:22:56.572+0100 [mongosMain] connection accepted from 172.28.0.164:61218 #1426445 (399 connections now open) 2015-10-05T06:22:56.572+0100 [mongosMain] connection accepted from 172.28.0.164:61219 #1426446 (400 connections now open) 2015-10-05T06:22:56.573+0100 [conn1426445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:56.574+0100 [conn1426446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:22:56.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209305703b51053ec20e5 2015-10-05T06:22:56.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:22:57.000+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:58.868+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:22:58.868+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:01.084+0100 [conn1426033] end connection 172.28.0.163:50731 (399 connections now open) 2015-10-05T06:23:01.085+0100 [mongosMain] connection accepted from 172.28.0.163:51866 #1426447 (400 connections now open) 2015-10-05T06:23:01.086+0100 [conn1426447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:01.172+0100 [conn1426016] end connection 172.28.0.164:60093 (399 connections now open) 2015-10-05T06:23:01.174+0100 [mongosMain] connection accepted from 172.28.0.164:61223 #1426448 (400 connections now open) 2015-10-05T06:23:01.176+0100 [conn1426448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:01.630+0100 [conn1426057] end connection 172.28.0.163:50778 (399 connections now open) 2015-10-05T06:23:01.633+0100 [mongosMain] connection accepted from 172.28.0.163:51871 #1426449 (400 connections now open) 2015-10-05T06:23:01.634+0100 [conn1426449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:01.703+0100 [conn1426056] end connection 172.28.0.164:60184 (399 connections now open) 2015-10-05T06:23:01.705+0100 [mongosMain] connection accepted from 172.28.0.164:61225 #1426450 (400 connections now open) 2015-10-05T06:23:01.706+0100 [conn1426450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:04.167+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:23:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:23:04.865+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:04.865+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:05.513+0100 [conn1425998] end connection 172.28.0.163:50643 (399 connections now open) 2015-10-05T06:23:05.513+0100 [conn1426058] end connection 172.28.0.163:50785 (399 connections now open) 2015-10-05T06:23:05.514+0100 [mongosMain] connection accepted from 172.28.0.163:51877 #1426451 (399 connections now open) 2015-10-05T06:23:05.514+0100 [mongosMain] connection accepted from 172.28.0.163:51878 #1426452 (400 connections now open) 2015-10-05T06:23:05.515+0100 [conn1426451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:05.515+0100 [conn1426452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:08.062+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:09.011+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612093c5703b51053ec214f 2015-10-05T06:23:09.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:23:11.097+0100 [conn1426025] end connection 172.28.0.163:50711 (399 connections now open) 2015-10-05T06:23:11.098+0100 [mongosMain] connection accepted from 172.28.0.163:51889 #1426453 (400 connections now open) 2015-10-05T06:23:11.099+0100 [conn1426453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:11.189+0100 [conn1426054] end connection 172.28.0.164:60182 (399 connections now open) 2015-10-05T06:23:11.190+0100 [mongosMain] connection accepted from 172.28.0.164:61232 #1426454 (400 connections now open) 2015-10-05T06:23:11.192+0100 [conn1426454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:11.643+0100 [conn1426063] end connection 172.28.0.163:50800 (399 connections now open) 2015-10-05T06:23:11.644+0100 [mongosMain] connection accepted from 172.28.0.163:51891 #1426455 (400 connections now open) 2015-10-05T06:23:11.645+0100 [conn1426455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:11.719+0100 [conn1426062] end connection 172.28.0.164:60201 (399 connections now open) 2015-10-05T06:23:11.722+0100 [mongosMain] connection accepted from 172.28.0.164:61234 #1426456 (400 connections now open) 2015-10-05T06:23:11.724+0100 [conn1426456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:11.872+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:11.873+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:15.513+0100 [conn1426013] end connection 172.28.0.163:50677 (399 connections now open) 2015-10-05T06:23:15.513+0100 [conn1426037] end connection 172.28.0.163:50736 (399 connections now open) 2015-10-05T06:23:15.514+0100 [mongosMain] connection accepted from 172.28.0.163:51896 #1426457 (399 connections now open) 2015-10-05T06:23:15.515+0100 [mongosMain] connection accepted from 172.28.0.163:51897 #1426458 (400 connections now open) 2015-10-05T06:23:15.515+0100 [conn1426457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:15.516+0100 [conn1426458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:16.586+0100 [conn1426039] end connection 172.28.0.164:60131 (399 connections now open) 2015-10-05T06:23:16.587+0100 [mongosMain] connection accepted from 172.28.0.164:61239 #1426459 (400 connections now open) 2015-10-05T06:23:16.589+0100 [conn1426459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:19.069+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:19.876+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:19.876+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:21.098+0100 [conn1426042] end connection 172.28.0.163:50743 (399 connections now open) 2015-10-05T06:23:21.099+0100 [mongosMain] connection accepted from 172.28.0.163:51905 #1426460 (400 connections now open) 2015-10-05T06:23:21.100+0100 [conn1426460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:21.189+0100 [conn1426024] end connection 172.28.0.164:60104 (399 connections now open) 2015-10-05T06:23:21.190+0100 [mongosMain] connection accepted from 172.28.0.164:61247 #1426461 (400 connections now open) 2015-10-05T06:23:21.192+0100 [conn1426461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:21.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209495703b51053ec218c 2015-10-05T06:23:21.644+0100 [conn1426070] end connection 172.28.0.163:50824 (399 connections now open) 2015-10-05T06:23:21.645+0100 [mongosMain] connection accepted from 172.28.0.163:51907 #1426462 (400 connections now open) 2015-10-05T06:23:21.646+0100 [conn1426462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:21.691+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:23:21.735+0100 [conn1426069] end connection 172.28.0.164:60208 (399 connections now open) 2015-10-05T06:23:21.736+0100 [mongosMain] connection accepted from 172.28.0.164:61250 #1426463 (400 connections now open) 2015-10-05T06:23:21.738+0100 [conn1426463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:25.528+0100 [conn1426064] end connection 172.28.0.163:50809 (399 connections now open) 2015-10-05T06:23:25.528+0100 [conn1425913] end connection 172.28.0.163:50355 (399 connections now open) 2015-10-05T06:23:25.530+0100 [mongosMain] connection accepted from 172.28.0.163:51910 #1426464 (399 connections now open) 2015-10-05T06:23:25.530+0100 [mongosMain] connection accepted from 172.28.0.163:51911 #1426465 (400 connections now open) 2015-10-05T06:23:25.531+0100 [conn1426464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:25.531+0100 [conn1426465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:26.602+0100 [conn1426053] end connection 172.28.0.164:60173 (399 connections now open) 2015-10-05T06:23:26.603+0100 [mongosMain] connection accepted from 172.28.0.164:61260 #1426466 (400 connections now open) 2015-10-05T06:23:26.605+0100 [conn1426466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:28.704+0100 [mongosMain] connection accepted from 127.0.0.1:51915 #1426467 (401 connections now open) 2015-10-05T06:23:28.707+0100 [conn1426467] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:28.712+0100 [conn1426467] end connection 127.0.0.1:51915 (400 connections now open) 2015-10-05T06:23:28.875+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:28.876+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:30.078+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:31.113+0100 [conn1426017] end connection 172.28.0.163:50687 (399 connections now open) 2015-10-05T06:23:31.114+0100 [mongosMain] connection accepted from 172.28.0.163:51918 #1426468 (400 connections now open) 2015-10-05T06:23:31.115+0100 [conn1426468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:31.204+0100 [conn1426041] end connection 172.28.0.164:60139 (399 connections now open) 2015-10-05T06:23:31.205+0100 [mongosMain] connection accepted from 172.28.0.164:61267 #1426469 (400 connections now open) 2015-10-05T06:23:31.207+0100 [conn1426469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:31.659+0100 [conn1426077] end connection 172.28.0.163:50839 (399 connections now open) 2015-10-05T06:23:31.660+0100 [mongosMain] connection accepted from 172.28.0.163:51920 #1426470 (400 connections now open) 2015-10-05T06:23:31.661+0100 [conn1426470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:31.751+0100 [conn1426076] end connection 172.28.0.164:60224 (399 connections now open) 2015-10-05T06:23:31.752+0100 [mongosMain] connection accepted from 172.28.0.164:61269 #1426471 (400 connections now open) 2015-10-05T06:23:31.753+0100 [conn1426471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:33.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209555703b51053ec21d9 2015-10-05T06:23:34.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:23:34.425+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:23:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:23:35.529+0100 [conn1426078] end connection 172.28.0.163:50842 (399 connections now open) 2015-10-05T06:23:35.530+0100 [mongosMain] connection accepted from 172.28.0.163:51923 #1426472 (400 connections now open) 2015-10-05T06:23:35.531+0100 [conn1426472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:38.884+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:38.885+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:39.192+0100 [mongosMain] connection accepted from 127.0.0.1:51928 #1426473 (401 connections now open) 2015-10-05T06:23:39.195+0100 [conn1426473] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:39.199+0100 [conn1426473] end connection 127.0.0.1:51928 (400 connections now open) 2015-10-05T06:23:40.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612095c5703b51053ec21f6 2015-10-05T06:23:40.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:23:41.081+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:41.129+0100 [conn1426068] end connection 172.28.0.163:50821 (399 connections now open) 2015-10-05T06:23:41.130+0100 [mongosMain] connection accepted from 172.28.0.163:51933 #1426474 (400 connections now open) 2015-10-05T06:23:41.131+0100 [conn1426474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:41.219+0100 [conn1426067] end connection 172.28.0.164:60206 (399 connections now open) 2015-10-05T06:23:41.220+0100 [mongosMain] connection accepted from 172.28.0.164:61286 #1426475 (400 connections now open) 2015-10-05T06:23:41.222+0100 [conn1426475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:41.675+0100 [conn1426085] end connection 172.28.0.163:50853 (399 connections now open) 2015-10-05T06:23:41.676+0100 [mongosMain] connection accepted from 172.28.0.163:51934 #1426476 (400 connections now open) 2015-10-05T06:23:41.677+0100 [conn1426476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:41.766+0100 [conn1426084] end connection 172.28.0.164:60245 (399 connections now open) 2015-10-05T06:23:41.767+0100 [mongosMain] connection accepted from 172.28.0.164:61288 #1426477 (400 connections now open) 2015-10-05T06:23:41.769+0100 [conn1426477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:45.543+0100 [conn1426086] end connection 172.28.0.163:50857 (399 connections now open) 2015-10-05T06:23:45.544+0100 [mongosMain] connection accepted from 172.28.0.163:51941 #1426478 (400 connections now open) 2015-10-05T06:23:45.545+0100 [conn1426478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:46.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209625703b51053ec2222 2015-10-05T06:23:46.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:23:46.633+0100 [conn1426073] end connection 172.28.0.164:60212 (399 connections now open) 2015-10-05T06:23:46.634+0100 [mongosMain] connection accepted from 172.28.0.164:61295 #1426479 (400 connections now open) 2015-10-05T06:23:46.636+0100 [conn1426479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:49.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:49.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:23:51.129+0100 [conn1426061] end connection 172.28.0.163:50799 (399 connections now open) 2015-10-05T06:23:51.130+0100 [mongosMain] connection accepted from 172.28.0.163:51953 #1426480 (400 connections now open) 2015-10-05T06:23:51.131+0100 [conn1426480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:51.229+0100 [conn1426049] end connection 172.28.0.164:60163 (399 connections now open) 2015-10-05T06:23:51.230+0100 [mongosMain] connection accepted from 172.28.0.164:61303 #1426481 (400 connections now open) 2015-10-05T06:23:51.231+0100 [conn1426481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:51.676+0100 [conn1426092] end connection 172.28.0.163:50865 (399 connections now open) 2015-10-05T06:23:51.677+0100 [mongosMain] connection accepted from 172.28.0.163:51954 #1426482 (400 connections now open) 2015-10-05T06:23:51.678+0100 [conn1426482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:51.766+0100 [conn1426091] end connection 172.28.0.164:60267 (399 connections now open) 2015-10-05T06:23:51.768+0100 [mongosMain] connection accepted from 172.28.0.164:61307 #1426483 (400 connections now open) 2015-10-05T06:23:51.770+0100 [conn1426483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:52.089+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:23:55.544+0100 [conn1426036] end connection 172.28.0.163:50735 (399 connections now open) 2015-10-05T06:23:55.545+0100 [mongosMain] connection accepted from 172.28.0.163:51960 #1426484 (400 connections now open) 2015-10-05T06:23:55.546+0100 [conn1426484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:56.649+0100 [conn1426079] end connection 172.28.0.164:60233 (399 connections now open) 2015-10-05T06:23:56.649+0100 [mongosMain] connection accepted from 172.28.0.164:61314 #1426485 (400 connections now open) 2015-10-05T06:23:56.651+0100 [conn1426485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:23:58.834+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612096e5703b51053ec2273 2015-10-05T06:23:58.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:01.145+0100 [conn1426050] end connection 172.28.0.163:50754 (399 connections now open) 2015-10-05T06:24:01.146+0100 [mongosMain] connection accepted from 172.28.0.163:51974 #1426486 (400 connections now open) 2015-10-05T06:24:01.147+0100 [conn1426486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:01.236+0100 [conn1426089] end connection 172.28.0.164:60265 (399 connections now open) 2015-10-05T06:24:01.237+0100 [mongosMain] connection accepted from 172.28.0.164:61319 #1426487 (400 connections now open) 2015-10-05T06:24:01.239+0100 [conn1426487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:01.691+0100 [conn1426098] end connection 172.28.0.163:50886 (399 connections now open) 2015-10-05T06:24:01.692+0100 [mongosMain] connection accepted from 172.28.0.163:51976 #1426488 (400 connections now open) 2015-10-05T06:24:01.693+0100 [conn1426488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:01.782+0100 [conn1426097] end connection 172.28.0.164:60293 (399 connections now open) 2015-10-05T06:24:01.783+0100 [mongosMain] connection accepted from 172.28.0.164:61322 #1426489 (400 connections now open) 2015-10-05T06:24:01.785+0100 [conn1426489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:01.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:01.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:03.091+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:03.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:03.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:04.907+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:24:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:24:05.559+0100 [conn1426006] end connection 172.28.0.163:50659 (399 connections now open) 2015-10-05T06:24:05.559+0100 [conn1426071] end connection 172.28.0.163:50830 (399 connections now open) 2015-10-05T06:24:05.560+0100 [mongosMain] connection accepted from 172.28.0.163:51984 #1426490 (399 connections now open) 2015-10-05T06:24:05.560+0100 [mongosMain] connection accepted from 172.28.0.163:51985 #1426491 (400 connections now open) 2015-10-05T06:24:05.561+0100 [conn1426490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:05.561+0100 [conn1426491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:06.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:06.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:10.894+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:10.894+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:11.236+0100 [conn1426096] end connection 172.28.0.164:60291 (399 connections now open) 2015-10-05T06:24:11.237+0100 [mongosMain] connection accepted from 172.28.0.164:61331 #1426492 (400 connections now open) 2015-10-05T06:24:11.238+0100 [conn1426492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:11.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612097a5703b51053ec2307 2015-10-05T06:24:11.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:11.691+0100 [conn1426102] end connection 172.28.0.163:50907 (399 connections now open) 2015-10-05T06:24:11.692+0100 [mongosMain] connection accepted from 172.28.0.163:51996 #1426493 (400 connections now open) 2015-10-05T06:24:11.693+0100 [conn1426493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:11.783+0100 [conn1426101] end connection 172.28.0.164:60309 (399 connections now open) 2015-10-05T06:24:11.785+0100 [mongosMain] connection accepted from 172.28.0.164:61333 #1426494 (400 connections now open) 2015-10-05T06:24:11.787+0100 [conn1426494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:14.098+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:15.560+0100 [conn1426020] end connection 172.28.0.163:50697 (399 connections now open) 2015-10-05T06:24:15.561+0100 [mongosMain] connection accepted from 172.28.0.163:52003 #1426495 (400 connections now open) 2015-10-05T06:24:15.562+0100 [conn1426495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:15.899+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:15.899+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:16.680+0100 [conn1426094] end connection 172.28.0.164:60279 (399 connections now open) 2015-10-05T06:24:16.681+0100 [mongosMain] connection accepted from 172.28.0.164:61340 #1426496 (400 connections now open) 2015-10-05T06:24:16.683+0100 [conn1426496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:17.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209815703b51053ec2366 2015-10-05T06:24:17.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:21.160+0100 [conn1426075] end connection 172.28.0.163:50835 (399 connections now open) 2015-10-05T06:24:21.161+0100 [mongosMain] connection accepted from 172.28.0.163:52010 #1426497 (400 connections now open) 2015-10-05T06:24:21.162+0100 [conn1426497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:21.706+0100 [conn1426107] end connection 172.28.0.163:50927 (399 connections now open) 2015-10-05T06:24:21.707+0100 [mongosMain] connection accepted from 172.28.0.163:52012 #1426498 (400 connections now open) 2015-10-05T06:24:21.709+0100 [conn1426498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:21.798+0100 [conn1426106] end connection 172.28.0.164:60320 (399 connections now open) 2015-10-05T06:24:21.799+0100 [mongosMain] connection accepted from 172.28.0.164:61349 #1426499 (400 connections now open) 2015-10-05T06:24:21.800+0100 [conn1426499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:21.916+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:21.916+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:23.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209875703b51053ec239c 2015-10-05T06:24:24.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:25.103+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:25.575+0100 [conn1426103] end connection 172.28.0.163:50915 (399 connections now open) 2015-10-05T06:24:25.577+0100 [mongosMain] connection accepted from 172.28.0.163:52015 #1426500 (400 connections now open) 2015-10-05T06:24:25.578+0100 [conn1426500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:26.680+0100 [conn1426099] end connection 172.28.0.164:60302 (399 connections now open) 2015-10-05T06:24:26.681+0100 [mongosMain] connection accepted from 172.28.0.164:61359 #1426501 (400 connections now open) 2015-10-05T06:24:26.683+0100 [conn1426501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:28.339+0100 [mongosMain] connection accepted from 127.0.0.1:52019 #1426502 (401 connections now open) 2015-10-05T06:24:28.342+0100 [conn1426502] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:28.347+0100 [conn1426502] end connection 127.0.0.1:52019 (400 connections now open) 2015-10-05T06:24:28.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:28.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:30.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612098e5703b51053ec23cf 2015-10-05T06:24:30.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:31.162+0100 [conn1426090] end connection 172.28.0.163:50863 (399 connections now open) 2015-10-05T06:24:31.163+0100 [mongosMain] connection accepted from 172.28.0.163:52020 #1426503 (400 connections now open) 2015-10-05T06:24:31.164+0100 [conn1426503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:31.268+0100 [conn1426082] end connection 172.28.0.164:60243 (399 connections now open) 2015-10-05T06:24:31.269+0100 [mongosMain] connection accepted from 172.28.0.164:61369 #1426504 (400 connections now open) 2015-10-05T06:24:31.270+0100 [conn1426504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:31.708+0100 [conn1426113] end connection 172.28.0.163:50948 (399 connections now open) 2015-10-05T06:24:31.709+0100 [mongosMain] connection accepted from 172.28.0.163:52022 #1426505 (400 connections now open) 2015-10-05T06:24:31.710+0100 [conn1426505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:31.798+0100 [conn1426112] end connection 172.28.0.164:60340 (399 connections now open) 2015-10-05T06:24:31.801+0100 [mongosMain] connection accepted from 172.28.0.164:61371 #1426506 (400 connections now open) 2015-10-05T06:24:31.803+0100 [conn1426506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:35.118+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:24:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:24:35.591+0100 [conn1426093] end connection 172.28.0.163:50873 (399 connections now open) 2015-10-05T06:24:35.592+0100 [mongosMain] connection accepted from 172.28.0.163:52027 #1426507 (400 connections now open) 2015-10-05T06:24:35.593+0100 [conn1426507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:36.117+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:36.696+0100 [conn1426116] end connection 172.28.0.164:60349 (399 connections now open) 2015-10-05T06:24:36.697+0100 [mongosMain] connection accepted from 172.28.0.164:61380 #1426508 (400 connections now open) 2015-10-05T06:24:36.699+0100 [conn1426508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:36.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209945703b51053ec23f8 2015-10-05T06:24:36.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:36.927+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:36.927+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:39.580+0100 [mongosMain] connection accepted from 127.0.0.1:52031 #1426509 (401 connections now open) 2015-10-05T06:24:39.583+0100 [conn1426509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:39.589+0100 [conn1426509] end connection 127.0.0.1:52031 (400 connections now open) 2015-10-05T06:24:41.176+0100 [conn1426055] end connection 172.28.0.163:50776 (399 connections now open) 2015-10-05T06:24:41.178+0100 [mongosMain] connection accepted from 172.28.0.163:52034 #1426510 (400 connections now open) 2015-10-05T06:24:41.179+0100 [conn1426510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:41.283+0100 [conn1426074] end connection 172.28.0.164:60220 (399 connections now open) 2015-10-05T06:24:41.284+0100 [mongosMain] connection accepted from 172.28.0.164:61390 #1426511 (400 connections now open) 2015-10-05T06:24:41.286+0100 [conn1426511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:41.723+0100 [conn1426120] end connection 172.28.0.163:50962 (399 connections now open) 2015-10-05T06:24:41.724+0100 [mongosMain] connection accepted from 172.28.0.163:52036 #1426512 (400 connections now open) 2015-10-05T06:24:41.725+0100 [conn1426512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:41.814+0100 [conn1426119] end connection 172.28.0.164:60359 (399 connections now open) 2015-10-05T06:24:41.815+0100 [mongosMain] connection accepted from 172.28.0.164:61393 #1426513 (400 connections now open) 2015-10-05T06:24:41.816+0100 [conn1426513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:43.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612099a5703b51053ec242a 2015-10-05T06:24:43.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:45.592+0100 [conn1426108] end connection 172.28.0.163:50935 (399 connections now open) 2015-10-05T06:24:45.594+0100 [mongosMain] connection accepted from 172.28.0.163:52046 #1426514 (400 connections now open) 2015-10-05T06:24:45.595+0100 [conn1426514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:45.938+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:45.938+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:46.697+0100 [conn1426123] end connection 172.28.0.164:60370 (399 connections now open) 2015-10-05T06:24:46.698+0100 [mongosMain] connection accepted from 172.28.0.164:61402 #1426515 (400 connections now open) 2015-10-05T06:24:46.700+0100 [conn1426515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:47.126+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:49.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209a15703b51053ec244c 2015-10-05T06:24:49.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:51.299+0100 [conn1426100] end connection 172.28.0.164:60307 (399 connections now open) 2015-10-05T06:24:51.300+0100 [mongosMain] connection accepted from 172.28.0.164:61410 #1426516 (400 connections now open) 2015-10-05T06:24:51.303+0100 [conn1426516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:51.725+0100 [conn1426128] end connection 172.28.0.163:50976 (399 connections now open) 2015-10-05T06:24:51.726+0100 [mongosMain] connection accepted from 172.28.0.163:52055 #1426517 (400 connections now open) 2015-10-05T06:24:51.727+0100 [conn1426517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:51.830+0100 [conn1426127] end connection 172.28.0.164:60383 (399 connections now open) 2015-10-05T06:24:51.831+0100 [mongosMain] connection accepted from 172.28.0.164:61413 #1426518 (400 connections now open) 2015-10-05T06:24:51.833+0100 [conn1426518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:55.606+0100 [conn1426114] end connection 172.28.0.163:50951 (399 connections now open) 2015-10-05T06:24:55.607+0100 [mongosMain] connection accepted from 172.28.0.163:52061 #1426519 (400 connections now open) 2015-10-05T06:24:55.608+0100 [conn1426519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:55.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209a75703b51053ec2484 2015-10-05T06:24:55.959+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:24:55.959+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:24:56.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:24:56.712+0100 [conn1426110] end connection 172.28.0.164:60329 (399 connections now open) 2015-10-05T06:24:56.714+0100 [mongosMain] connection accepted from 172.28.0.164:61420 #1426520 (400 connections now open) 2015-10-05T06:24:56.715+0100 [conn1426520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:24:58.139+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:01.845+0100 [conn1426133] end connection 172.28.0.164:60403 (399 connections now open) 2015-10-05T06:25:01.846+0100 [mongosMain] connection accepted from 172.28.0.164:61426 #1426521 (400 connections now open) 2015-10-05T06:25:01.848+0100 [conn1426521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:02.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209ae5703b51053ec24ab 2015-10-05T06:25:02.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:05.248+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:25:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:25:05.607+0100 [conn1426129] end connection 172.28.0.163:50982 (399 connections now open) 2015-10-05T06:25:05.607+0100 [conn1426104] end connection 172.28.0.163:50916 (398 connections now open) 2015-10-05T06:25:05.608+0100 [mongosMain] connection accepted from 172.28.0.163:52082 #1426522 (399 connections now open) 2015-10-05T06:25:05.609+0100 [mongosMain] connection accepted from 172.28.0.163:52081 #1426523 (400 connections now open) 2015-10-05T06:25:05.610+0100 [conn1426522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:05.610+0100 [conn1426523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:06.964+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:06.965+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:08.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209b45703b51053ec24f8 2015-10-05T06:25:08.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:09.144+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:11.314+0100 [conn1426060] end connection 172.28.0.164:60197 (399 connections now open) 2015-10-05T06:25:11.316+0100 [mongosMain] connection accepted from 172.28.0.164:61435 #1426524 (400 connections now open) 2015-10-05T06:25:11.317+0100 [conn1426524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:11.860+0100 [conn1426140] end connection 172.28.0.164:60420 (399 connections now open) 2015-10-05T06:25:11.862+0100 [mongosMain] connection accepted from 172.28.0.164:61437 #1426525 (400 connections now open) 2015-10-05T06:25:11.864+0100 [conn1426525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:15.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209ba5703b51053ec2529 2015-10-05T06:25:15.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:15.623+0100 [conn1426130] end connection 172.28.0.163:50983 (399 connections now open) 2015-10-05T06:25:15.623+0100 [conn1426122] end connection 172.28.0.163:50965 (398 connections now open) 2015-10-05T06:25:15.624+0100 [mongosMain] connection accepted from 172.28.0.163:52099 #1426526 (399 connections now open) 2015-10-05T06:25:15.624+0100 [mongosMain] connection accepted from 172.28.0.163:52100 #1426527 (400 connections now open) 2015-10-05T06:25:15.625+0100 [conn1426526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:15.626+0100 [conn1426527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:16.744+0100 [conn1426131] end connection 172.28.0.164:60391 (399 connections now open) 2015-10-05T06:25:16.745+0100 [mongosMain] connection accepted from 172.28.0.164:61442 #1426528 (400 connections now open) 2015-10-05T06:25:16.746+0100 [conn1426528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:18.966+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:18.966+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:20.159+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:20.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:20.982+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:21.208+0100 [conn1426126] end connection 172.28.0.163:50974 (399 connections now open) 2015-10-05T06:25:21.209+0100 [mongosMain] connection accepted from 172.28.0.163:52110 #1426529 (400 connections now open) 2015-10-05T06:25:21.210+0100 [conn1426529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:21.361+0100 [conn1426132] end connection 172.28.0.164:60400 (399 connections now open) 2015-10-05T06:25:21.362+0100 [mongosMain] connection accepted from 172.28.0.164:61451 #1426530 (400 connections now open) 2015-10-05T06:25:21.365+0100 [conn1426530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:21.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209c15703b51053ec25a4 2015-10-05T06:25:21.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:21.754+0100 [conn1426134] end connection 172.28.0.163:50993 (399 connections now open) 2015-10-05T06:25:21.755+0100 [mongosMain] connection accepted from 172.28.0.163:52112 #1426531 (400 connections now open) 2015-10-05T06:25:21.756+0100 [conn1426531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:21.876+0100 [conn1426145] end connection 172.28.0.164:60431 (399 connections now open) 2015-10-05T06:25:21.877+0100 [mongosMain] connection accepted from 172.28.0.164:61455 #1426532 (400 connections now open) 2015-10-05T06:25:21.879+0100 [conn1426532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:23.982+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:23.982+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:25.623+0100 [conn1426121] end connection 172.28.0.163:50964 (399 connections now open) 2015-10-05T06:25:25.623+0100 [conn1426135] end connection 172.28.0.163:51002 (399 connections now open) 2015-10-05T06:25:25.624+0100 [mongosMain] connection accepted from 172.28.0.163:52115 #1426533 (399 connections now open) 2015-10-05T06:25:25.624+0100 [mongosMain] connection accepted from 172.28.0.163:52116 #1426534 (400 connections now open) 2015-10-05T06:25:25.625+0100 [conn1426533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:25.626+0100 [conn1426534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:26.759+0100 [conn1426038] end connection 172.28.0.164:60130 (399 connections now open) 2015-10-05T06:25:26.759+0100 [conn1426137] end connection 172.28.0.164:60410 (398 connections now open) 2015-10-05T06:25:26.760+0100 [mongosMain] connection accepted from 172.28.0.164:61464 #1426535 (399 connections now open) 2015-10-05T06:25:26.760+0100 [mongosMain] connection accepted from 172.28.0.164:61463 #1426536 (400 connections now open) 2015-10-05T06:25:26.761+0100 [conn1426535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:26.761+0100 [conn1426536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:27.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209c75703b51053ec25dc 2015-10-05T06:25:27.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:27.989+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:27.989+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:28.254+0100 [mongosMain] connection accepted from 127.0.0.1:52120 #1426537 (401 connections now open) 2015-10-05T06:25:28.257+0100 [conn1426537] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:28.264+0100 [conn1426537] end connection 127.0.0.1:52120 (400 connections now open) 2015-10-05T06:25:31.167+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:31.223+0100 [conn1426118] end connection 172.28.0.163:50960 (399 connections now open) 2015-10-05T06:25:31.224+0100 [mongosMain] connection accepted from 172.28.0.163:52124 #1426538 (400 connections now open) 2015-10-05T06:25:31.225+0100 [conn1426538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:31.330+0100 [conn1426105] end connection 172.28.0.164:60318 (399 connections now open) 2015-10-05T06:25:31.331+0100 [mongosMain] connection accepted from 172.28.0.164:61475 #1426539 (400 connections now open) 2015-10-05T06:25:31.333+0100 [conn1426539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:31.769+0100 [conn1426152] end connection 172.28.0.163:51058 (399 connections now open) 2015-10-05T06:25:31.770+0100 [mongosMain] connection accepted from 172.28.0.163:52127 #1426540 (400 connections now open) 2015-10-05T06:25:31.772+0100 [conn1426540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:31.877+0100 [conn1426151] end connection 172.28.0.164:60447 (399 connections now open) 2015-10-05T06:25:31.878+0100 [mongosMain] connection accepted from 172.28.0.164:61479 #1426541 (400 connections now open) 2015-10-05T06:25:31.881+0100 [conn1426541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:33.001+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:33.001+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:34.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209cd5703b51053ec2613 2015-10-05T06:25:34.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:35.392+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:25:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:25:35.638+0100 [conn1426141] end connection 172.28.0.163:51027 (399 connections now open) 2015-10-05T06:25:35.639+0100 [conn1426029] end connection 172.28.0.163:50721 (398 connections now open) 2015-10-05T06:25:35.641+0100 [mongosMain] connection accepted from 172.28.0.163:52131 #1426542 (399 connections now open) 2015-10-05T06:25:35.641+0100 [mongosMain] connection accepted from 172.28.0.163:52132 #1426543 (400 connections now open) 2015-10-05T06:25:35.642+0100 [conn1426542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:35.643+0100 [conn1426543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:36.759+0100 [conn1426143] end connection 172.28.0.164:60425 (399 connections now open) 2015-10-05T06:25:36.760+0100 [mongosMain] connection accepted from 172.28.0.164:61489 #1426544 (400 connections now open) 2015-10-05T06:25:36.760+0100 [conn1426015] end connection 172.28.0.164:60089 (399 connections now open) 2015-10-05T06:25:36.761+0100 [mongosMain] connection accepted from 172.28.0.164:61490 #1426545 (400 connections now open) 2015-10-05T06:25:36.762+0100 [conn1426544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:36.763+0100 [conn1426545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:39.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:39.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:39.331+0100 [mongosMain] connection accepted from 127.0.0.1:52136 #1426546 (401 connections now open) 2015-10-05T06:25:39.335+0100 [conn1426546] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:39.340+0100 [conn1426546] end connection 127.0.0.1:52136 (400 connections now open) 2015-10-05T06:25:40.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209d45703b51053ec263e 2015-10-05T06:25:40.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:41.224+0100 [conn1426139] end connection 172.28.0.163:51014 (399 connections now open) 2015-10-05T06:25:41.225+0100 [mongosMain] connection accepted from 172.28.0.163:52139 #1426547 (400 connections now open) 2015-10-05T06:25:41.226+0100 [conn1426547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:41.346+0100 [conn1426144] end connection 172.28.0.164:60429 (399 connections now open) 2015-10-05T06:25:41.348+0100 [mongosMain] connection accepted from 172.28.0.164:61499 #1426548 (400 connections now open) 2015-10-05T06:25:41.349+0100 [conn1426548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:41.770+0100 [conn1426161] end connection 172.28.0.163:51070 (399 connections now open) 2015-10-05T06:25:41.771+0100 [mongosMain] connection accepted from 172.28.0.163:52142 #1426549 (400 connections now open) 2015-10-05T06:25:41.773+0100 [conn1426549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:41.892+0100 [conn1426160] end connection 172.28.0.164:60468 (399 connections now open) 2015-10-05T06:25:41.893+0100 [mongosMain] connection accepted from 172.28.0.164:61501 #1426550 (400 connections now open) 2015-10-05T06:25:41.895+0100 [conn1426550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:42.192+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:45.654+0100 [conn1426153] end connection 172.28.0.163:51061 (399 connections now open) 2015-10-05T06:25:45.655+0100 [mongosMain] connection accepted from 172.28.0.163:52148 #1426551 (400 connections now open) 2015-10-05T06:25:45.656+0100 [conn1426551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:45.725+0100 [conn1425941] end connection 172.28.0.163:50454 (399 connections now open) 2015-10-05T06:25:45.728+0100 [mongosMain] connection accepted from 172.28.0.163:52149 #1426552 (400 connections now open) 2015-10-05T06:25:45.729+0100 [conn1426552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:46.031+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:46.031+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:46.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209da5703b51053ec2671 2015-10-05T06:25:46.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:46.775+0100 [conn1426148] end connection 172.28.0.164:60438 (399 connections now open) 2015-10-05T06:25:46.776+0100 [conn1426155] end connection 172.28.0.164:60458 (399 connections now open) 2015-10-05T06:25:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:61508 #1426553 (399 connections now open) 2015-10-05T06:25:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:61507 #1426554 (400 connections now open) 2015-10-05T06:25:46.778+0100 [conn1426553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:46.779+0100 [conn1426554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:51.239+0100 [conn1426150] end connection 172.28.0.163:51054 (399 connections now open) 2015-10-05T06:25:51.240+0100 [mongosMain] connection accepted from 172.28.0.163:52155 #1426555 (400 connections now open) 2015-10-05T06:25:51.241+0100 [conn1426555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:51.785+0100 [conn1426170] end connection 172.28.0.163:51082 (399 connections now open) 2015-10-05T06:25:51.786+0100 [mongosMain] connection accepted from 172.28.0.163:52157 #1426556 (400 connections now open) 2015-10-05T06:25:51.787+0100 [conn1426556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:51.892+0100 [conn1426169] end connection 172.28.0.164:60490 (399 connections now open) 2015-10-05T06:25:51.894+0100 [mongosMain] connection accepted from 172.28.0.164:61515 #1426557 (400 connections now open) 2015-10-05T06:25:51.895+0100 [conn1426557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:52.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209e05703b51053ec26a2 2015-10-05T06:25:53.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:25:53.201+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:54.040+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:25:54.040+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:25:55.654+0100 [conn1426146] end connection 172.28.0.163:51047 (399 connections now open) 2015-10-05T06:25:55.655+0100 [mongosMain] connection accepted from 172.28.0.163:52166 #1426558 (400 connections now open) 2015-10-05T06:25:55.656+0100 [conn1426558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:56.775+0100 [conn1426164] end connection 172.28.0.164:60479 (399 connections now open) 2015-10-05T06:25:56.775+0100 [conn1425978] end connection 172.28.0.164:59994 (398 connections now open) 2015-10-05T06:25:56.778+0100 [mongosMain] connection accepted from 172.28.0.164:61524 #1426559 (399 connections now open) 2015-10-05T06:25:56.779+0100 [mongosMain] connection accepted from 172.28.0.164:61525 #1426560 (400 connections now open) 2015-10-05T06:25:56.780+0100 [conn1426559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:56.780+0100 [conn1426560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:25:59.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209e75703b51053ec26c0 2015-10-05T06:25:59.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:01.241+0100 [conn1426111] end connection 172.28.0.163:50946 (399 connections now open) 2015-10-05T06:26:01.243+0100 [mongosMain] connection accepted from 172.28.0.163:52179 #1426561 (400 connections now open) 2015-10-05T06:26:01.244+0100 [conn1426561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:01.361+0100 [conn1426149] end connection 172.28.0.164:60444 (399 connections now open) 2015-10-05T06:26:01.363+0100 [mongosMain] connection accepted from 172.28.0.164:61529 #1426562 (400 connections now open) 2015-10-05T06:26:01.364+0100 [conn1426562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:01.787+0100 [conn1426176] end connection 172.28.0.163:51100 (399 connections now open) 2015-10-05T06:26:01.789+0100 [mongosMain] connection accepted from 172.28.0.163:52182 #1426563 (400 connections now open) 2015-10-05T06:26:01.790+0100 [conn1426563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:01.908+0100 [conn1426175] end connection 172.28.0.164:60509 (399 connections now open) 2015-10-05T06:26:01.909+0100 [mongosMain] connection accepted from 172.28.0.164:61531 #1426564 (400 connections now open) 2015-10-05T06:26:01.911+0100 [conn1426564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:03.051+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:03.051+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:04.204+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:05.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209ed5703b51053ec26fa 2015-10-05T06:26:05.668+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:26:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:26:05.669+0100 [conn1426154] end connection 172.28.0.163:51062 (399 connections now open) 2015-10-05T06:26:05.670+0100 [mongosMain] connection accepted from 172.28.0.163:52190 #1426565 (400 connections now open) 2015-10-05T06:26:05.671+0100 [conn1426565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:05.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:06.791+0100 [conn1426072] end connection 172.28.0.164:60211 (399 connections now open) 2015-10-05T06:26:06.792+0100 [mongosMain] connection accepted from 172.28.0.164:61536 #1426566 (400 connections now open) 2015-10-05T06:26:06.793+0100 [conn1426566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:11.255+0100 [conn1426180] end connection 172.28.0.163:51118 (399 connections now open) 2015-10-05T06:26:11.256+0100 [mongosMain] connection accepted from 172.28.0.163:52200 #1426567 (400 connections now open) 2015-10-05T06:26:11.257+0100 [conn1426567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:11.377+0100 [conn1426167] end connection 172.28.0.164:60486 (399 connections now open) 2015-10-05T06:26:11.378+0100 [mongosMain] connection accepted from 172.28.0.164:61540 #1426568 (400 connections now open) 2015-10-05T06:26:11.380+0100 [conn1426568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:11.801+0100 [conn1426182] end connection 172.28.0.163:51120 (399 connections now open) 2015-10-05T06:26:11.802+0100 [mongosMain] connection accepted from 172.28.0.163:52202 #1426569 (400 connections now open) 2015-10-05T06:26:11.804+0100 [conn1426569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:11.924+0100 [conn1426181] end connection 172.28.0.164:60522 (399 connections now open) 2015-10-05T06:26:11.925+0100 [mongosMain] connection accepted from 172.28.0.164:61542 #1426570 (400 connections now open) 2015-10-05T06:26:11.927+0100 [conn1426570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:12.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209f35703b51053ec271a 2015-10-05T06:26:12.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:13.061+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:13.061+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:15.205+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:15.671+0100 [conn1426184] end connection 172.28.0.163:51127 (399 connections now open) 2015-10-05T06:26:15.671+0100 [conn1426045] end connection 172.28.0.163:50748 (399 connections now open) 2015-10-05T06:26:15.672+0100 [mongosMain] connection accepted from 172.28.0.163:52209 #1426571 (399 connections now open) 2015-10-05T06:26:15.673+0100 [mongosMain] connection accepted from 172.28.0.163:52210 #1426572 (400 connections now open) 2015-10-05T06:26:15.673+0100 [conn1426571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:15.673+0100 [conn1426572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:16.806+0100 [conn1426087] end connection 172.28.0.164:60254 (399 connections now open) 2015-10-05T06:26:16.808+0100 [mongosMain] connection accepted from 172.28.0.164:61549 #1426573 (400 connections now open) 2015-10-05T06:26:16.810+0100 [conn1426573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:18.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561209fa5703b51053ec273f 2015-10-05T06:26:18.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:21.256+0100 [conn1426083] end connection 172.28.0.163:50851 (399 connections now open) 2015-10-05T06:26:21.258+0100 [mongosMain] connection accepted from 172.28.0.163:52219 #1426574 (400 connections now open) 2015-10-05T06:26:21.259+0100 [conn1426574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:21.377+0100 [conn1426125] end connection 172.28.0.164:60380 (399 connections now open) 2015-10-05T06:26:21.379+0100 [mongosMain] connection accepted from 172.28.0.164:61555 #1426575 (400 connections now open) 2015-10-05T06:26:21.381+0100 [conn1426575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:21.802+0100 [conn1426189] end connection 172.28.0.163:51137 (399 connections now open) 2015-10-05T06:26:21.804+0100 [mongosMain] connection accepted from 172.28.0.163:52221 #1426576 (400 connections now open) 2015-10-05T06:26:21.805+0100 [conn1426576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:21.923+0100 [conn1426188] end connection 172.28.0.164:60534 (399 connections now open) 2015-10-05T06:26:21.924+0100 [mongosMain] connection accepted from 172.28.0.164:61559 #1426577 (400 connections now open) 2015-10-05T06:26:21.926+0100 [conn1426577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:24.085+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:24.085+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:24.746+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a005703b51053ec2767 2015-10-05T06:26:24.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:25.684+0100 [conn1426109] end connection 172.28.0.163:50936 (399 connections now open) 2015-10-05T06:26:25.684+0100 [conn1426177] end connection 172.28.0.163:51107 (399 connections now open) 2015-10-05T06:26:25.686+0100 [mongosMain] connection accepted from 172.28.0.163:52225 #1426578 (399 connections now open) 2015-10-05T06:26:25.686+0100 [mongosMain] connection accepted from 172.28.0.163:52226 #1426579 (400 connections now open) 2015-10-05T06:26:25.686+0100 [conn1426578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:25.687+0100 [conn1426579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:26.228+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:26.821+0100 [conn1426023] end connection 172.28.0.164:60101 (399 connections now open) 2015-10-05T06:26:26.822+0100 [conn1426185] end connection 172.28.0.164:60525 (399 connections now open) 2015-10-05T06:26:26.823+0100 [mongosMain] connection accepted from 172.28.0.164:61569 #1426580 (399 connections now open) 2015-10-05T06:26:26.823+0100 [mongosMain] connection accepted from 172.28.0.164:61570 #1426581 (400 connections now open) 2015-10-05T06:26:26.824+0100 [conn1426580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:26.825+0100 [conn1426581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:28.635+0100 [mongosMain] connection accepted from 127.0.0.1:52229 #1426582 (401 connections now open) 2015-10-05T06:26:28.638+0100 [conn1426582] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:28.643+0100 [conn1426582] end connection 127.0.0.1:52229 (400 connections now open) 2015-10-05T06:26:31.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a065703b51053ec278d 2015-10-05T06:26:31.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:31.307+0100 [conn1426174] end connection 172.28.0.163:51098 (399 connections now open) 2015-10-05T06:26:31.307+0100 [mongosMain] connection accepted from 172.28.0.163:52231 #1426583 (400 connections now open) 2015-10-05T06:26:31.307+0100 [conn1426583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:31.416+0100 [conn1426173] end connection 172.28.0.164:60507 (399 connections now open) 2015-10-05T06:26:31.416+0100 [mongosMain] connection accepted from 172.28.0.164:61575 #1426584 (400 connections now open) 2015-10-05T06:26:31.416+0100 [conn1426584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:31.853+0100 [conn1426197] end connection 172.28.0.163:51156 (399 connections now open) 2015-10-05T06:26:31.853+0100 [mongosMain] connection accepted from 172.28.0.163:52232 #1426585 (400 connections now open) 2015-10-05T06:26:31.853+0100 [conn1426585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:31.962+0100 [conn1426196] end connection 172.28.0.164:60551 (399 connections now open) 2015-10-05T06:26:31.962+0100 [mongosMain] connection accepted from 172.28.0.164:61578 #1426586 (400 connections now open) 2015-10-05T06:26:31.962+0100 [conn1426586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:35.686+0100 [conn1426191] end connection 172.28.0.163:51145 (399 connections now open) 2015-10-05T06:26:35.686+0100 [conn1426115] end connection 172.28.0.163:50952 (399 connections now open) 2015-10-05T06:26:35.688+0100 [mongosMain] connection accepted from 172.28.0.163:52235 #1426587 (399 connections now open) 2015-10-05T06:26:35.688+0100 [mongosMain] connection accepted from 172.28.0.163:52236 #1426588 (400 connections now open) 2015-10-05T06:26:35.689+0100 [conn1426587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:35.689+0100 [conn1426588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:35.933+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:26:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:26:36.094+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:36.095+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:36.822+0100 [conn1426156] end connection 172.28.0.164:60459 (399 connections now open) 2015-10-05T06:26:36.823+0100 [conn1426080] end connection 172.28.0.164:60234 (398 connections now open) 2015-10-05T06:26:36.823+0100 [mongosMain] connection accepted from 172.28.0.164:61586 #1426589 (399 connections now open) 2015-10-05T06:26:36.824+0100 [mongosMain] connection accepted from 172.28.0.164:61587 #1426590 (400 connections now open) 2015-10-05T06:26:36.825+0100 [conn1426589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:36.827+0100 [conn1426590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:37.234+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:38.106+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:38.106+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:39.468+0100 [mongosMain] connection accepted from 127.0.0.1:52242 #1426591 (401 connections now open) 2015-10-05T06:26:39.471+0100 [conn1426591] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:39.476+0100 [conn1426591] end connection 127.0.0.1:52242 (400 connections now open) 2015-10-05T06:26:41.126+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:41.126+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:41.393+0100 [conn1426138] end connection 172.28.0.164:60418 (399 connections now open) 2015-10-05T06:26:41.395+0100 [mongosMain] connection accepted from 172.28.0.164:61598 #1426592 (400 connections now open) 2015-10-05T06:26:41.396+0100 [conn1426592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:41.832+0100 [conn1426206] end connection 172.28.0.163:51166 (399 connections now open) 2015-10-05T06:26:41.833+0100 [mongosMain] connection accepted from 172.28.0.163:52246 #1426593 (400 connections now open) 2015-10-05T06:26:41.834+0100 [conn1426593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:41.939+0100 [conn1426205] end connection 172.28.0.164:60578 (399 connections now open) 2015-10-05T06:26:41.940+0100 [mongosMain] connection accepted from 172.28.0.164:61601 #1426594 (400 connections now open) 2015-10-05T06:26:41.943+0100 [conn1426594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:45.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:45.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:45.701+0100 [conn1426136] end connection 172.28.0.163:51003 (399 connections now open) 2015-10-05T06:26:45.701+0100 [conn1426199] end connection 172.28.0.163:51160 (399 connections now open) 2015-10-05T06:26:45.702+0100 [mongosMain] connection accepted from 172.28.0.163:52254 #1426595 (399 connections now open) 2015-10-05T06:26:45.703+0100 [mongosMain] connection accepted from 172.28.0.163:52256 #1426596 (400 connections now open) 2015-10-05T06:26:45.703+0100 [conn1426595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:45.704+0100 [conn1426596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:46.838+0100 [conn1425949] end connection 172.28.0.164:59911 (399 connections now open) 2015-10-05T06:26:46.838+0100 [conn1426192] end connection 172.28.0.164:60538 (398 connections now open) 2015-10-05T06:26:46.839+0100 [mongosMain] connection accepted from 172.28.0.164:61610 #1426597 (399 connections now open) 2015-10-05T06:26:46.839+0100 [mongosMain] connection accepted from 172.28.0.164:61611 #1426598 (400 connections now open) 2015-10-05T06:26:46.841+0100 [conn1426597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:46.841+0100 [conn1426598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:48.238+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:49.326+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a195703b51053ec281e 2015-10-05T06:26:49.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:26:50.285+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:50.285+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:51.409+0100 [conn1426158] end connection 172.28.0.164:60466 (399 connections now open) 2015-10-05T06:26:51.411+0100 [mongosMain] connection accepted from 172.28.0.164:61617 #1426599 (400 connections now open) 2015-10-05T06:26:51.413+0100 [conn1426599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:51.832+0100 [conn1426213] end connection 172.28.0.163:51175 (399 connections now open) 2015-10-05T06:26:51.834+0100 [mongosMain] connection accepted from 172.28.0.163:52266 #1426600 (400 connections now open) 2015-10-05T06:26:51.835+0100 [conn1426600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:51.954+0100 [conn1426212] end connection 172.28.0.164:60599 (399 connections now open) 2015-10-05T06:26:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:61620 #1426601 (400 connections now open) 2015-10-05T06:26:51.958+0100 [conn1426601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:55.702+0100 [conn1426162] end connection 172.28.0.163:51072 (399 connections now open) 2015-10-05T06:26:55.703+0100 [mongosMain] connection accepted from 172.28.0.163:52274 #1426602 (400 connections now open) 2015-10-05T06:26:55.704+0100 [conn1426602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:56.291+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:26:56.291+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:26:56.854+0100 [conn1426165] end connection 172.28.0.164:60478 (399 connections now open) 2015-10-05T06:26:56.854+0100 [conn1426171] end connection 172.28.0.164:60499 (399 connections now open) 2015-10-05T06:26:56.855+0100 [mongosMain] connection accepted from 172.28.0.164:61626 #1426603 (399 connections now open) 2015-10-05T06:26:56.856+0100 [mongosMain] connection accepted from 172.28.0.164:61628 #1426604 (400 connections now open) 2015-10-05T06:26:56.858+0100 [conn1426603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:56.858+0100 [conn1426604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:26:59.256+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:01.425+0100 [conn1426195] end connection 172.28.0.164:60548 (399 connections now open) 2015-10-05T06:27:01.426+0100 [mongosMain] connection accepted from 172.28.0.164:61633 #1426605 (400 connections now open) 2015-10-05T06:27:01.428+0100 [conn1426605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:01.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a255703b51053ec2879 2015-10-05T06:27:01.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:01.847+0100 [conn1426220] end connection 172.28.0.163:51195 (399 connections now open) 2015-10-05T06:27:01.849+0100 [mongosMain] connection accepted from 172.28.0.163:52288 #1426606 (400 connections now open) 2015-10-05T06:27:01.850+0100 [conn1426606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:01.954+0100 [conn1426219] end connection 172.28.0.164:60618 (399 connections now open) 2015-10-05T06:27:01.955+0100 [mongosMain] connection accepted from 172.28.0.164:61635 #1426607 (400 connections now open) 2015-10-05T06:27:01.957+0100 [conn1426607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:03.299+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:03.299+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:05.721+0100 [conn1426190] end connection 172.28.0.163:51144 (399 connections now open) 2015-10-05T06:27:05.721+0100 [conn1426214] end connection 172.28.0.163:51186 (398 connections now open) 2015-10-05T06:27:05.722+0100 [mongosMain] connection accepted from 172.28.0.163:52298 #1426608 (399 connections now open) 2015-10-05T06:27:05.723+0100 [mongosMain] connection accepted from 172.28.0.163:52299 #1426609 (400 connections now open) 2015-10-05T06:27:05.723+0100 [conn1426608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:05.723+0100 [conn1426609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:06.190+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:27:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:27:06.869+0100 [conn1426200] end connection 172.28.0.164:60563 (399 connections now open) 2015-10-05T06:27:06.871+0100 [conn1426186] end connection 172.28.0.164:60526 (398 connections now open) 2015-10-05T06:27:06.872+0100 [mongosMain] connection accepted from 172.28.0.164:61640 #1426610 (399 connections now open) 2015-10-05T06:27:06.873+0100 [mongosMain] connection accepted from 172.28.0.164:61641 #1426611 (400 connections now open) 2015-10-05T06:27:06.873+0100 [conn1426610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:06.875+0100 [conn1426611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:10.261+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:11.304+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:11.305+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:11.439+0100 [conn1426187] end connection 172.28.0.164:60532 (399 connections now open) 2015-10-05T06:27:11.440+0100 [mongosMain] connection accepted from 172.28.0.164:61643 #1426612 (400 connections now open) 2015-10-05T06:27:11.441+0100 [conn1426612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:11.848+0100 [conn1426228] end connection 172.28.0.163:51216 (399 connections now open) 2015-10-05T06:27:11.849+0100 [mongosMain] connection accepted from 172.28.0.163:52313 #1426613 (400 connections now open) 2015-10-05T06:27:11.850+0100 [conn1426613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:11.970+0100 [conn1426227] end connection 172.28.0.164:60635 (399 connections now open) 2015-10-05T06:27:11.971+0100 [mongosMain] connection accepted from 172.28.0.164:61645 #1426614 (400 connections now open) 2015-10-05T06:27:11.973+0100 [conn1426614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:13.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a315703b51053ec28eb 2015-10-05T06:27:13.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:15.733+0100 [conn1426207] end connection 172.28.0.163:51169 (399 connections now open) 2015-10-05T06:27:15.733+0100 [conn1426147] end connection 172.28.0.163:51048 (399 connections now open) 2015-10-05T06:27:15.735+0100 [mongosMain] connection accepted from 172.28.0.163:52318 #1426615 (399 connections now open) 2015-10-05T06:27:15.735+0100 [mongosMain] connection accepted from 172.28.0.163:52319 #1426616 (400 connections now open) 2015-10-05T06:27:15.736+0100 [conn1426615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:15.736+0100 [conn1426616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:16.869+0100 [conn1426215] end connection 172.28.0.164:60606 (399 connections now open) 2015-10-05T06:27:16.870+0100 [conn1426178] end connection 172.28.0.164:60517 (398 connections now open) 2015-10-05T06:27:16.870+0100 [mongosMain] connection accepted from 172.28.0.164:61651 #1426617 (399 connections now open) 2015-10-05T06:27:16.871+0100 [mongosMain] connection accepted from 172.28.0.164:61652 #1426618 (400 connections now open) 2015-10-05T06:27:16.872+0100 [conn1426617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:16.872+0100 [conn1426618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:20.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a375703b51053ec291e 2015-10-05T06:27:20.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:20.357+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:20.358+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:21.279+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:21.455+0100 [conn1426203] end connection 172.28.0.164:60574 (399 connections now open) 2015-10-05T06:27:21.456+0100 [mongosMain] connection accepted from 172.28.0.164:61657 #1426619 (400 connections now open) 2015-10-05T06:27:21.458+0100 [conn1426619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:21.863+0100 [conn1426236] end connection 172.28.0.163:51238 (399 connections now open) 2015-10-05T06:27:21.864+0100 [mongosMain] connection accepted from 172.28.0.163:52329 #1426620 (400 connections now open) 2015-10-05T06:27:21.865+0100 [conn1426620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:21.986+0100 [conn1426235] end connection 172.28.0.164:60645 (399 connections now open) 2015-10-05T06:27:21.987+0100 [mongosMain] connection accepted from 172.28.0.164:61661 #1426621 (400 connections now open) 2015-10-05T06:27:21.989+0100 [conn1426621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:25.735+0100 [conn1426198] end connection 172.28.0.163:51159 (399 connections now open) 2015-10-05T06:27:25.735+0100 [conn1426230] end connection 172.28.0.163:51228 (399 connections now open) 2015-10-05T06:27:25.736+0100 [mongosMain] connection accepted from 172.28.0.163:52332 #1426622 (399 connections now open) 2015-10-05T06:27:25.737+0100 [mongosMain] connection accepted from 172.28.0.163:52333 #1426623 (400 connections now open) 2015-10-05T06:27:25.737+0100 [conn1426622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:25.737+0100 [conn1426623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:26.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a3e5703b51053ec2955 2015-10-05T06:27:26.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:26.891+0100 [conn1426208] end connection 172.28.0.164:60585 (399 connections now open) 2015-10-05T06:27:26.891+0100 [conn1426046] end connection 172.28.0.164:60152 (398 connections now open) 2015-10-05T06:27:26.892+0100 [mongosMain] connection accepted from 172.28.0.164:61670 #1426624 (399 connections now open) 2015-10-05T06:27:26.892+0100 [mongosMain] connection accepted from 172.28.0.164:61671 #1426625 (400 connections now open) 2015-10-05T06:27:26.894+0100 [conn1426624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:26.894+0100 [conn1426625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:28.345+0100 [mongosMain] connection accepted from 127.0.0.1:52335 #1426626 (401 connections now open) 2015-10-05T06:27:28.347+0100 [conn1426626] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:28.351+0100 [conn1426626] end connection 127.0.0.1:52335 (400 connections now open) 2015-10-05T06:27:30.393+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:30.394+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:31.472+0100 [conn1426179] end connection 172.28.0.164:60520 (399 connections now open) 2015-10-05T06:27:31.473+0100 [mongosMain] connection accepted from 172.28.0.164:61679 #1426627 (400 connections now open) 2015-10-05T06:27:31.475+0100 [conn1426627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:31.868+0100 [conn1426243] end connection 172.28.0.163:51254 (399 connections now open) 2015-10-05T06:27:31.869+0100 [mongosMain] connection accepted from 172.28.0.163:52339 #1426628 (400 connections now open) 2015-10-05T06:27:31.870+0100 [conn1426628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:32.002+0100 [conn1426242] end connection 172.28.0.164:60659 (399 connections now open) 2015-10-05T06:27:32.003+0100 [mongosMain] connection accepted from 172.28.0.164:61682 #1426629 (400 connections now open) 2015-10-05T06:27:32.005+0100 [conn1426629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:32.289+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:32.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a445703b51053ec2995 2015-10-05T06:27:32.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:35.748+0100 [conn1426222] end connection 172.28.0.163:51204 (399 connections now open) 2015-10-05T06:27:35.749+0100 [conn1426065] end connection 172.28.0.163:50810 (399 connections now open) 2015-10-05T06:27:35.750+0100 [mongosMain] connection accepted from 172.28.0.163:52341 #1426630 (399 connections now open) 2015-10-05T06:27:35.750+0100 [mongosMain] connection accepted from 172.28.0.163:52342 #1426631 (400 connections now open) 2015-10-05T06:27:35.751+0100 [conn1426630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:35.752+0100 [conn1426631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:36.328+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:27:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:27:36.901+0100 [conn1426224] end connection 172.28.0.164:60627 (399 connections now open) 2015-10-05T06:27:36.902+0100 [conn1426059] end connection 172.28.0.164:60192 (398 connections now open) 2015-10-05T06:27:36.902+0100 [mongosMain] connection accepted from 172.28.0.164:61693 #1426632 (399 connections now open) 2015-10-05T06:27:36.904+0100 [mongosMain] connection accepted from 172.28.0.164:61694 #1426633 (400 connections now open) 2015-10-05T06:27:36.904+0100 [conn1426632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:36.906+0100 [conn1426633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:40.095+0100 [mongosMain] connection accepted from 127.0.0.1:52345 #1426634 (401 connections now open) 2015-10-05T06:27:40.097+0100 [conn1426634] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:40.103+0100 [conn1426634] end connection 127.0.0.1:52345 (400 connections now open) 2015-10-05T06:27:41.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:41.392+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:41.487+0100 [conn1426234] end connection 172.28.0.164:60643 (399 connections now open) 2015-10-05T06:27:41.489+0100 [mongosMain] connection accepted from 172.28.0.164:61702 #1426635 (400 connections now open) 2015-10-05T06:27:41.490+0100 [conn1426635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:41.879+0100 [conn1426251] end connection 172.28.0.163:51264 (399 connections now open) 2015-10-05T06:27:41.880+0100 [mongosMain] connection accepted from 172.28.0.163:52351 #1426636 (400 connections now open) 2015-10-05T06:27:41.881+0100 [conn1426636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:42.017+0100 [conn1426250] end connection 172.28.0.164:60681 (399 connections now open) 2015-10-05T06:27:42.018+0100 [mongosMain] connection accepted from 172.28.0.164:61705 #1426637 (400 connections now open) 2015-10-05T06:27:42.023+0100 [conn1426637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:43.294+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:45.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a505703b51053ec29dc 2015-10-05T06:27:45.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:45.749+0100 [conn1426221] end connection 172.28.0.163:51203 (399 connections now open) 2015-10-05T06:27:45.749+0100 [conn1426238] end connection 172.28.0.163:51246 (399 connections now open) 2015-10-05T06:27:45.749+0100 [mongosMain] connection accepted from 172.28.0.163:52358 #1426638 (399 connections now open) 2015-10-05T06:27:45.750+0100 [mongosMain] connection accepted from 172.28.0.163:52359 #1426639 (400 connections now open) 2015-10-05T06:27:45.750+0100 [conn1426638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:45.751+0100 [conn1426639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:46.917+0100 [mongosMain] connection accepted from 172.28.0.164:61714 #1426640 (401 connections now open) 2015-10-05T06:27:46.918+0100 [conn1426231] end connection 172.28.0.164:60641 (400 connections now open) 2015-10-05T06:27:46.919+0100 [conn1426095] end connection 172.28.0.164:60280 (399 connections now open) 2015-10-05T06:27:46.919+0100 [conn1426640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:46.920+0100 [mongosMain] connection accepted from 172.28.0.164:61715 #1426641 (400 connections now open) 2015-10-05T06:27:46.922+0100 [conn1426641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:51.502+0100 [conn1426226] end connection 172.28.0.164:60633 (399 connections now open) 2015-10-05T06:27:51.503+0100 [mongosMain] connection accepted from 172.28.0.164:61723 #1426642 (400 connections now open) 2015-10-05T06:27:51.505+0100 [conn1426642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:51.895+0100 [conn1426259] end connection 172.28.0.163:51279 (399 connections now open) 2015-10-05T06:27:51.896+0100 [mongosMain] connection accepted from 172.28.0.163:52368 #1426643 (400 connections now open) 2015-10-05T06:27:51.897+0100 [conn1426643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:52.033+0100 [conn1426258] end connection 172.28.0.164:60702 (399 connections now open) 2015-10-05T06:27:52.035+0100 [mongosMain] connection accepted from 172.28.0.164:61725 #1426644 (400 connections now open) 2015-10-05T06:27:52.037+0100 [conn1426644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:53.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:53.397+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:54.308+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:55.395+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:55.395+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:27:55.764+0100 [conn1426244] end connection 172.28.0.163:51257 (399 connections now open) 2015-10-05T06:27:55.765+0100 [mongosMain] connection accepted from 172.28.0.163:52380 #1426645 (400 connections now open) 2015-10-05T06:27:55.766+0100 [conn1426645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:56.917+0100 [conn1426239] end connection 172.28.0.164:60651 (399 connections now open) 2015-10-05T06:27:56.918+0100 [conn1426172] end connection 172.28.0.164:60500 (398 connections now open) 2015-10-05T06:27:56.918+0100 [mongosMain] connection accepted from 172.28.0.164:61733 #1426646 (399 connections now open) 2015-10-05T06:27:56.919+0100 [mongosMain] connection accepted from 172.28.0.164:61734 #1426647 (400 connections now open) 2015-10-05T06:27:56.920+0100 [conn1426646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:56.921+0100 [conn1426647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:27:57.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a5d5703b51053ec2a24 2015-10-05T06:27:57.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:27:58.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:27:58.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:01.352+0100 [conn1426233] end connection 172.28.0.163:51236 (399 connections now open) 2015-10-05T06:28:01.353+0100 [mongosMain] connection accepted from 172.28.0.163:52392 #1426648 (400 connections now open) 2015-10-05T06:28:01.354+0100 [conn1426648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:01.897+0100 [conn1426264] end connection 172.28.0.163:51295 (399 connections now open) 2015-10-05T06:28:01.899+0100 [mongosMain] connection accepted from 172.28.0.163:52396 #1426649 (400 connections now open) 2015-10-05T06:28:01.900+0100 [conn1426649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:02.049+0100 [conn1426263] end connection 172.28.0.164:60722 (399 connections now open) 2015-10-05T06:28:02.050+0100 [mongosMain] connection accepted from 172.28.0.164:61739 #1426650 (400 connections now open) 2015-10-05T06:28:02.052+0100 [conn1426650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:02.401+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:02.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:05.318+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:05.765+0100 [conn1426252] end connection 172.28.0.163:51269 (399 connections now open) 2015-10-05T06:28:05.766+0100 [mongosMain] connection accepted from 172.28.0.163:52436 #1426651 (400 connections now open) 2015-10-05T06:28:05.767+0100 [conn1426651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:06.511+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:28:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:28:06.917+0100 [conn1426247] end connection 172.28.0.164:60671 (399 connections now open) 2015-10-05T06:28:06.917+0100 [conn1426066] end connection 172.28.0.164:60204 (398 connections now open) 2015-10-05T06:28:06.918+0100 [mongosMain] connection accepted from 172.28.0.164:61746 #1426652 (399 connections now open) 2015-10-05T06:28:06.918+0100 [mongosMain] connection accepted from 172.28.0.164:61745 #1426653 (400 connections now open) 2015-10-05T06:28:06.919+0100 [conn1426652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:06.919+0100 [conn1426653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:07.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:07.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:09.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a695703b51053ec2a85 2015-10-05T06:28:10.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:11.363+0100 [conn1426194] end connection 172.28.0.163:51155 (399 connections now open) 2015-10-05T06:28:11.364+0100 [mongosMain] connection accepted from 172.28.0.163:52446 #1426654 (400 connections now open) 2015-10-05T06:28:11.365+0100 [conn1426654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:11.534+0100 [conn1426217] end connection 172.28.0.164:60616 (399 connections now open) 2015-10-05T06:28:11.536+0100 [mongosMain] connection accepted from 172.28.0.164:61749 #1426655 (400 connections now open) 2015-10-05T06:28:11.537+0100 [conn1426655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:11.910+0100 [conn1426270] end connection 172.28.0.163:51316 (399 connections now open) 2015-10-05T06:28:11.911+0100 [mongosMain] connection accepted from 172.28.0.163:52449 #1426656 (400 connections now open) 2015-10-05T06:28:11.912+0100 [conn1426656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:12.064+0100 [conn1426269] end connection 172.28.0.164:60738 (399 connections now open) 2015-10-05T06:28:12.065+0100 [mongosMain] connection accepted from 172.28.0.164:61751 #1426657 (400 connections now open) 2015-10-05T06:28:12.067+0100 [conn1426657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:13.409+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:13.409+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:15.780+0100 [conn1426271] end connection 172.28.0.163:51325 (399 connections now open) 2015-10-05T06:28:15.781+0100 [mongosMain] connection accepted from 172.28.0.163:52457 #1426658 (400 connections now open) 2015-10-05T06:28:15.782+0100 [conn1426658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:16.329+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:16.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a705703b51053ec2ae7 2015-10-05T06:28:16.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:16.933+0100 [conn1426255] end connection 172.28.0.164:60691 (399 connections now open) 2015-10-05T06:28:16.934+0100 [conn1426193] end connection 172.28.0.164:60539 (399 connections now open) 2015-10-05T06:28:16.934+0100 [mongosMain] connection accepted from 172.28.0.164:61759 #1426659 (400 connections now open) 2015-10-05T06:28:16.934+0100 [mongosMain] connection accepted from 172.28.0.164:61758 #1426660 (400 connections now open) 2015-10-05T06:28:16.936+0100 [conn1426659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:16.936+0100 [conn1426660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:20.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:20.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:21.366+0100 [conn1426225] end connection 172.28.0.163:51212 (399 connections now open) 2015-10-05T06:28:21.367+0100 [mongosMain] connection accepted from 172.28.0.163:52465 #1426661 (400 connections now open) 2015-10-05T06:28:21.368+0100 [conn1426661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:21.550+0100 [conn1426241] end connection 172.28.0.164:60657 (399 connections now open) 2015-10-05T06:28:21.550+0100 [mongosMain] connection accepted from 172.28.0.164:61766 #1426662 (400 connections now open) 2015-10-05T06:28:21.553+0100 [conn1426662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:21.913+0100 [conn1426275] end connection 172.28.0.163:51336 (399 connections now open) 2015-10-05T06:28:21.914+0100 [mongosMain] connection accepted from 172.28.0.163:52466 #1426663 (400 connections now open) 2015-10-05T06:28:21.915+0100 [conn1426663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:22.080+0100 [conn1426274] end connection 172.28.0.164:60748 (399 connections now open) 2015-10-05T06:28:22.081+0100 [mongosMain] connection accepted from 172.28.0.164:61768 #1426664 (400 connections now open) 2015-10-05T06:28:22.083+0100 [conn1426664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:22.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a765703b51053ec2b49 2015-10-05T06:28:22.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:25.782+0100 [conn1426253] end connection 172.28.0.163:51270 (399 connections now open) 2015-10-05T06:28:25.782+0100 [conn1426266] end connection 172.28.0.163:51304 (398 connections now open) 2015-10-05T06:28:25.783+0100 [mongosMain] connection accepted from 172.28.0.163:52468 #1426665 (399 connections now open) 2015-10-05T06:28:25.783+0100 [mongosMain] connection accepted from 172.28.0.163:52469 #1426666 (400 connections now open) 2015-10-05T06:28:25.784+0100 [conn1426665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:25.784+0100 [conn1426666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:26.948+0100 [conn1426223] end connection 172.28.0.164:60626 (399 connections now open) 2015-10-05T06:28:26.949+0100 [conn1426273] end connection 172.28.0.164:60744 (398 connections now open) 2015-10-05T06:28:26.950+0100 [mongosMain] connection accepted from 172.28.0.164:61782 #1426667 (399 connections now open) 2015-10-05T06:28:26.951+0100 [mongosMain] connection accepted from 172.28.0.164:61783 #1426668 (400 connections now open) 2015-10-05T06:28:26.952+0100 [conn1426667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:26.952+0100 [conn1426668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:27.338+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:28.277+0100 [mongosMain] connection accepted from 127.0.0.1:52482 #1426669 (401 connections now open) 2015-10-05T06:28:28.281+0100 [conn1426669] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:28.286+0100 [conn1426669] end connection 127.0.0.1:52482 (400 connections now open) 2015-10-05T06:28:28.422+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:28.422+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:29.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a7c5703b51053ec2b7c 2015-10-05T06:28:29.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:31.380+0100 [conn1426204] end connection 172.28.0.163:51165 (399 connections now open) 2015-10-05T06:28:31.382+0100 [mongosMain] connection accepted from 172.28.0.163:52483 #1426670 (400 connections now open) 2015-10-05T06:28:31.383+0100 [conn1426670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:31.926+0100 [conn1426282] end connection 172.28.0.163:51350 (399 connections now open) 2015-10-05T06:28:31.927+0100 [mongosMain] connection accepted from 172.28.0.163:52485 #1426671 (400 connections now open) 2015-10-05T06:28:31.929+0100 [conn1426671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:32.096+0100 [conn1426281] end connection 172.28.0.164:60767 (399 connections now open) 2015-10-05T06:28:32.097+0100 [mongosMain] connection accepted from 172.28.0.164:61793 #1426672 (400 connections now open) 2015-10-05T06:28:32.098+0100 [conn1426672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:35.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a835703b51053ec2ba5 2015-10-05T06:28:35.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:35.796+0100 [conn1426245] end connection 172.28.0.163:51258 (399 connections now open) 2015-10-05T06:28:35.796+0100 [conn1426283] end connection 172.28.0.163:51354 (399 connections now open) 2015-10-05T06:28:35.798+0100 [mongosMain] connection accepted from 172.28.0.163:52487 #1426673 (399 connections now open) 2015-10-05T06:28:35.798+0100 [mongosMain] connection accepted from 172.28.0.163:52488 #1426674 (400 connections now open) 2015-10-05T06:28:35.799+0100 [conn1426673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:35.799+0100 [conn1426674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:36.653+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:28:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:28:36.964+0100 [conn1426261] end connection 172.28.0.164:60710 (399 connections now open) 2015-10-05T06:28:36.964+0100 [conn1426246] end connection 172.28.0.164:60670 (398 connections now open) 2015-10-05T06:28:36.965+0100 [mongosMain] connection accepted from 172.28.0.164:61801 #1426675 (399 connections now open) 2015-10-05T06:28:36.966+0100 [mongosMain] connection accepted from 172.28.0.164:61802 #1426676 (400 connections now open) 2015-10-05T06:28:36.967+0100 [conn1426675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:36.967+0100 [conn1426676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:37.427+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:37.427+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:38.348+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:40.071+0100 [mongosMain] connection accepted from 127.0.0.1:52493 #1426677 (401 connections now open) 2015-10-05T06:28:40.074+0100 [conn1426677] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:40.079+0100 [conn1426677] end connection 127.0.0.1:52493 (400 connections now open) 2015-10-05T06:28:41.381+0100 [conn1426159] end connection 172.28.0.163:51068 (399 connections now open) 2015-10-05T06:28:41.382+0100 [mongosMain] connection accepted from 172.28.0.163:52496 #1426678 (400 connections now open) 2015-10-05T06:28:41.384+0100 [conn1426678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:41.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a895703b51053ec2be5 2015-10-05T06:28:41.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:41.927+0100 [conn1426290] end connection 172.28.0.163:51363 (399 connections now open) 2015-10-05T06:28:41.928+0100 [mongosMain] connection accepted from 172.28.0.163:52498 #1426679 (400 connections now open) 2015-10-05T06:28:41.930+0100 [conn1426679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:45.812+0100 [conn1426260] end connection 172.28.0.163:51286 (399 connections now open) 2015-10-05T06:28:45.812+0100 [conn1426276] end connection 172.28.0.163:51342 (399 connections now open) 2015-10-05T06:28:45.814+0100 [mongosMain] connection accepted from 172.28.0.163:52503 #1426680 (399 connections now open) 2015-10-05T06:28:45.814+0100 [mongosMain] connection accepted from 172.28.0.163:52504 #1426681 (400 connections now open) 2015-10-05T06:28:45.816+0100 [conn1426680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:45.816+0100 [conn1426681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:46.979+0100 [conn1426201] end connection 172.28.0.164:60564 (399 connections now open) 2015-10-05T06:28:46.979+0100 [conn1426295] end connection 172.28.0.164:60802 (399 connections now open) 2015-10-05T06:28:46.981+0100 [mongosMain] connection accepted from 172.28.0.164:61835 #1426682 (399 connections now open) 2015-10-05T06:28:46.981+0100 [mongosMain] connection accepted from 172.28.0.164:61834 #1426683 (400 connections now open) 2015-10-05T06:28:46.983+0100 [conn1426682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:46.983+0100 [conn1426683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:47.430+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:47.430+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:28:47.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a8f5703b51053ec2c4b 2015-10-05T06:28:48.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:28:49.373+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:51.397+0100 [conn1426218] end connection 172.28.0.163:51193 (399 connections now open) 2015-10-05T06:28:51.398+0100 [mongosMain] connection accepted from 172.28.0.163:52516 #1426684 (400 connections now open) 2015-10-05T06:28:51.400+0100 [conn1426684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:55.813+0100 [conn1426292] end connection 172.28.0.163:51369 (399 connections now open) 2015-10-05T06:28:55.813+0100 [conn1426163] end connection 172.28.0.163:51073 (398 connections now open) 2015-10-05T06:28:55.814+0100 [mongosMain] connection accepted from 172.28.0.163:52523 #1426685 (399 connections now open) 2015-10-05T06:28:55.814+0100 [mongosMain] connection accepted from 172.28.0.163:52524 #1426686 (400 connections now open) 2015-10-05T06:28:55.815+0100 [conn1426685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:55.815+0100 [conn1426686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:56.995+0100 [conn1426268] end connection 172.28.0.164:60730 (399 connections now open) 2015-10-05T06:28:56.995+0100 [conn1426254] end connection 172.28.0.164:60690 (399 connections now open) 2015-10-05T06:28:56.997+0100 [mongosMain] connection accepted from 172.28.0.164:61848 #1426687 (399 connections now open) 2015-10-05T06:28:56.997+0100 [mongosMain] connection accepted from 172.28.0.164:61865 #1426688 (400 connections now open) 2015-10-05T06:28:56.999+0100 [conn1426687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:56.999+0100 [conn1426688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:28:58.450+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:28:58.450+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:00.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120a9c5703b51053ec2cca 2015-10-05T06:29:00.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:00.379+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:01.401+0100 [conn1426279] end connection 172.28.0.163:51348 (399 connections now open) 2015-10-05T06:29:01.403+0100 [mongosMain] connection accepted from 172.28.0.163:52535 #1426689 (400 connections now open) 2015-10-05T06:29:01.404+0100 [conn1426689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:05.827+0100 [conn1426237] end connection 172.28.0.163:51245 (399 connections now open) 2015-10-05T06:29:05.828+0100 [conn1426304] end connection 172.28.0.163:51408 (398 connections now open) 2015-10-05T06:29:05.829+0100 [mongosMain] connection accepted from 172.28.0.163:52542 #1426690 (399 connections now open) 2015-10-05T06:29:05.829+0100 [mongosMain] connection accepted from 172.28.0.163:52543 #1426691 (400 connections now open) 2015-10-05T06:29:05.830+0100 [conn1426690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:05.830+0100 [conn1426691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:06.915+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:29:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:29:07.011+0100 [conn1426232] end connection 172.28.0.164:60642 (399 connections now open) 2015-10-05T06:29:07.011+0100 [conn1426278] end connection 172.28.0.164:60753 (398 connections now open) 2015-10-05T06:29:07.012+0100 [mongosMain] connection accepted from 172.28.0.164:61873 #1426692 (399 connections now open) 2015-10-05T06:29:07.012+0100 [mongosMain] connection accepted from 172.28.0.164:61874 #1426693 (400 connections now open) 2015-10-05T06:29:07.013+0100 [conn1426692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:07.014+0100 [conn1426693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:10.461+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:10.461+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:11.398+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:11.412+0100 [conn1426168] end connection 172.28.0.163:51080 (399 connections now open) 2015-10-05T06:29:11.413+0100 [mongosMain] connection accepted from 172.28.0.163:52552 #1426694 (400 connections now open) 2015-10-05T06:29:11.414+0100 [conn1426694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:12.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120aa85703b51053ec2d75 2015-10-05T06:29:12.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:12.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:12.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:15.465+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:15.465+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:15.838+0100 [conn1426284] end connection 172.28.0.163:51355 (399 connections now open) 2015-10-05T06:29:15.838+0100 [conn1426300] end connection 172.28.0.163:51386 (399 connections now open) 2015-10-05T06:29:15.840+0100 [mongosMain] connection accepted from 172.28.0.163:52556 #1426695 (399 connections now open) 2015-10-05T06:29:15.840+0100 [mongosMain] connection accepted from 172.28.0.163:52557 #1426696 (400 connections now open) 2015-10-05T06:29:15.841+0100 [conn1426695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:15.841+0100 [conn1426696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:17.027+0100 [conn1426285] end connection 172.28.0.164:60773 (399 connections now open) 2015-10-05T06:29:17.028+0100 [mongosMain] connection accepted from 172.28.0.164:61883 #1426697 (400 connections now open) 2015-10-05T06:29:17.030+0100 [conn1426697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:18.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120aae5703b51053ec2dae 2015-10-05T06:29:18.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:19.479+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:19.479+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:21.428+0100 [conn1426297] end connection 172.28.0.163:51375 (399 connections now open) 2015-10-05T06:29:21.429+0100 [mongosMain] connection accepted from 172.28.0.163:52563 #1426698 (400 connections now open) 2015-10-05T06:29:21.430+0100 [conn1426698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:22.448+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:24.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:24.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:24.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ab45703b51053ec2dd9 2015-10-05T06:29:25.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:25.844+0100 [conn1426301] end connection 172.28.0.163:51388 (399 connections now open) 2015-10-05T06:29:25.844+0100 [conn1426314] end connection 172.28.0.163:51446 (399 connections now open) 2015-10-05T06:29:25.845+0100 [mongosMain] connection accepted from 172.28.0.163:52572 #1426699 (399 connections now open) 2015-10-05T06:29:25.845+0100 [mongosMain] connection accepted from 172.28.0.163:52573 #1426700 (400 connections now open) 2015-10-05T06:29:25.846+0100 [conn1426699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:25.847+0100 [conn1426700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:27.047+0100 [conn1426302] end connection 172.28.0.164:60823 (399 connections now open) 2015-10-05T06:29:27.047+0100 [conn1426311] end connection 172.28.0.164:60853 (398 connections now open) 2015-10-05T06:29:27.049+0100 [mongosMain] connection accepted from 172.28.0.164:61910 #1426701 (399 connections now open) 2015-10-05T06:29:27.049+0100 [mongosMain] connection accepted from 172.28.0.164:61909 #1426702 (400 connections now open) 2015-10-05T06:29:27.050+0100 [conn1426701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:27.051+0100 [conn1426702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:28.299+0100 [mongosMain] connection accepted from 127.0.0.1:52576 #1426703 (401 connections now open) 2015-10-05T06:29:28.302+0100 [conn1426703] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:28.307+0100 [conn1426703] end connection 127.0.0.1:52576 (400 connections now open) 2015-10-05T06:29:30.485+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:30.485+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:31.428+0100 [conn1426303] end connection 172.28.0.163:51396 (399 connections now open) 2015-10-05T06:29:31.429+0100 [mongosMain] connection accepted from 172.28.0.163:52580 #1426704 (400 connections now open) 2015-10-05T06:29:31.430+0100 [conn1426704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:31.628+0100 [conn1426249] end connection 172.28.0.164:60679 (399 connections now open) 2015-10-05T06:29:31.629+0100 [mongosMain] connection accepted from 172.28.0.164:61916 #1426705 (400 connections now open) 2015-10-05T06:29:31.631+0100 [conn1426705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:31.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120abb5703b51053ec2e09 2015-10-05T06:29:31.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:33.452+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:35.845+0100 [conn1426308] end connection 172.28.0.163:51428 (399 connections now open) 2015-10-05T06:29:35.846+0100 [mongosMain] connection accepted from 172.28.0.163:52583 #1426706 (400 connections now open) 2015-10-05T06:29:35.847+0100 [conn1426706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:37.058+0100 [conn1426216] end connection 172.28.0.164:60607 (399 connections now open) 2015-10-05T06:29:37.060+0100 [mongosMain] connection accepted from 172.28.0.164:61930 #1426707 (400 connections now open) 2015-10-05T06:29:37.061+0100 [conn1426707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:37.071+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:29:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:29:37.508+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:37.508+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:39.719+0100 [mongosMain] connection accepted from 127.0.0.1:52588 #1426708 (401 connections now open) 2015-10-05T06:29:39.722+0100 [conn1426708] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:39.727+0100 [conn1426708] end connection 127.0.0.1:52588 (400 connections now open) 2015-10-05T06:29:41.443+0100 [conn1426312] end connection 172.28.0.163:51439 (399 connections now open) 2015-10-05T06:29:41.444+0100 [mongosMain] connection accepted from 172.28.0.163:52592 #1426709 (400 connections now open) 2015-10-05T06:29:41.445+0100 [conn1426709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:41.628+0100 [conn1426318] end connection 172.28.0.164:60870 (399 connections now open) 2015-10-05T06:29:41.630+0100 [mongosMain] connection accepted from 172.28.0.164:61941 #1426710 (400 connections now open) 2015-10-05T06:29:41.632+0100 [conn1426710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:44.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ac75703b51053ec2e8e 2015-10-05T06:29:44.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:44.460+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:45.528+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:45.528+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:47.058+0100 [conn1426262] end connection 172.28.0.164:60711 (399 connections now open) 2015-10-05T06:29:47.060+0100 [mongosMain] connection accepted from 172.28.0.164:61949 #1426711 (400 connections now open) 2015-10-05T06:29:47.062+0100 [conn1426711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:50.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ace5703b51053ec2ebb 2015-10-05T06:29:50.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:51.444+0100 [conn1426288] end connection 172.28.0.163:51361 (399 connections now open) 2015-10-05T06:29:51.445+0100 [mongosMain] connection accepted from 172.28.0.163:52606 #1426712 (400 connections now open) 2015-10-05T06:29:51.446+0100 [conn1426712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:51.644+0100 [conn1426211] end connection 172.28.0.164:60597 (399 connections now open) 2015-10-05T06:29:51.645+0100 [mongosMain] connection accepted from 172.28.0.164:61955 #1426713 (400 connections now open) 2015-10-05T06:29:51.647+0100 [conn1426713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:29:54.533+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:54.534+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:29:55.463+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:29:56.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ad45703b51053ec2edb 2015-10-05T06:29:57.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:29:57.073+0100 [conn1426294] end connection 172.28.0.164:60803 (399 connections now open) 2015-10-05T06:29:57.074+0100 [mongosMain] connection accepted from 172.28.0.164:61964 #1426714 (400 connections now open) 2015-10-05T06:29:57.076+0100 [conn1426714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:01.459+0100 [conn1426323] end connection 172.28.0.163:51468 (399 connections now open) 2015-10-05T06:30:01.460+0100 [mongosMain] connection accepted from 172.28.0.163:52628 #1426715 (400 connections now open) 2015-10-05T06:30:01.461+0100 [conn1426715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:03.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120adb5703b51053ec2f07 2015-10-05T06:30:03.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:04.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:04.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:06.471+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:07.110+0100 [conn1426286] end connection 172.28.0.164:60772 (399 connections now open) 2015-10-05T06:30:07.111+0100 [mongosMain] connection accepted from 172.28.0.164:61980 #1426716 (400 connections now open) 2015-10-05T06:30:07.113+0100 [conn1426716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:07.250+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:30:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:30:09.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ae15703b51053ec2f4c 2015-10-05T06:30:09.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:11.460+0100 [conn1426329] end connection 172.28.0.163:51479 (399 connections now open) 2015-10-05T06:30:11.461+0100 [mongosMain] connection accepted from 172.28.0.163:52644 #1426717 (400 connections now open) 2015-10-05T06:30:11.463+0100 [conn1426717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:12.006+0100 [conn1426299] end connection 172.28.0.163:51377 (399 connections now open) 2015-10-05T06:30:12.007+0100 [mongosMain] connection accepted from 172.28.0.163:52646 #1426718 (400 connections now open) 2015-10-05T06:30:12.009+0100 [conn1426718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:15.554+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:15.554+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:15.890+0100 [conn1426325] end connection 172.28.0.163:51469 (399 connections now open) 2015-10-05T06:30:15.891+0100 [mongosMain] connection accepted from 172.28.0.163:52652 #1426719 (400 connections now open) 2015-10-05T06:30:15.892+0100 [conn1426719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:15.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ae75703b51053ec2f84 2015-10-05T06:30:16.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:17.488+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:22.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120aee5703b51053ec2fdb 2015-10-05T06:30:22.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:25.891+0100 [conn1426293] end connection 172.28.0.163:51370 (399 connections now open) 2015-10-05T06:30:25.893+0100 [mongosMain] connection accepted from 172.28.0.163:52660 #1426720 (400 connections now open) 2015-10-05T06:30:25.894+0100 [conn1426720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:27.137+0100 [conn1426315] end connection 172.28.0.164:60861 (399 connections now open) 2015-10-05T06:30:27.137+0100 [conn1426316] end connection 172.28.0.164:60862 (398 connections now open) 2015-10-05T06:30:27.138+0100 [mongosMain] connection accepted from 172.28.0.164:62001 #1426721 (399 connections now open) 2015-10-05T06:30:27.139+0100 [mongosMain] connection accepted from 172.28.0.164:62002 #1426722 (400 connections now open) 2015-10-05T06:30:27.141+0100 [conn1426721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:27.141+0100 [conn1426722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:27.553+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:27.554+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:28.495+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:28.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120af45703b51053ec3033 2015-10-05T06:30:28.874+0100 [mongosMain] connection accepted from 127.0.0.1:52666 #1426723 (401 connections now open) 2015-10-05T06:30:28.877+0100 [conn1426723] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:28.881+0100 [conn1426723] end connection 127.0.0.1:52666 (400 connections now open) 2015-10-05T06:30:28.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:29.558+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:29.559+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:31.476+0100 [conn1426317] end connection 172.28.0.163:51457 (399 connections now open) 2015-10-05T06:30:31.477+0100 [mongosMain] connection accepted from 172.28.0.163:52668 #1426724 (400 connections now open) 2015-10-05T06:30:31.478+0100 [conn1426724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:31.676+0100 [conn1426280] end connection 172.28.0.164:60761 (399 connections now open) 2015-10-05T06:30:31.685+0100 [mongosMain] connection accepted from 172.28.0.164:62011 #1426725 (400 connections now open) 2015-10-05T06:30:31.686+0100 [conn1426725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:32.022+0100 [conn1426335] end connection 172.28.0.163:51526 (399 connections now open) 2015-10-05T06:30:32.024+0100 [mongosMain] connection accepted from 172.28.0.163:52671 #1426726 (400 connections now open) 2015-10-05T06:30:32.025+0100 [conn1426726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:32.222+0100 [conn1426291] end connection 172.28.0.164:60795 (399 connections now open) 2015-10-05T06:30:32.223+0100 [mongosMain] connection accepted from 172.28.0.164:62015 #1426727 (400 connections now open) 2015-10-05T06:30:32.225+0100 [conn1426727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:32.565+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:32.565+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:35.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120afa5703b51053ec3073 2015-10-05T06:30:35.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:35.907+0100 [conn1426183] end connection 172.28.0.163:51126 (399 connections now open) 2015-10-05T06:30:35.907+0100 [conn1426339] end connection 172.28.0.163:51546 (399 connections now open) 2015-10-05T06:30:35.908+0100 [mongosMain] connection accepted from 172.28.0.163:52674 #1426728 (399 connections now open) 2015-10-05T06:30:35.908+0100 [mongosMain] connection accepted from 172.28.0.163:52675 #1426729 (400 connections now open) 2015-10-05T06:30:35.909+0100 [conn1426728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:35.909+0100 [conn1426729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:36.566+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:36.566+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:37.135+0100 [conn1426306] end connection 172.28.0.164:60842 (399 connections now open) 2015-10-05T06:30:37.135+0100 [conn1426334] end connection 172.28.0.164:60934 (398 connections now open) 2015-10-05T06:30:37.136+0100 [mongosMain] connection accepted from 172.28.0.164:62025 #1426730 (399 connections now open) 2015-10-05T06:30:37.137+0100 [mongosMain] connection accepted from 172.28.0.164:62024 #1426731 (400 connections now open) 2015-10-05T06:30:37.137+0100 [conn1426731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:37.138+0100 [conn1426730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:37.538+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:30:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:30:39.506+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:39.877+0100 [mongosMain] connection accepted from 127.0.0.1:52680 #1426732 (401 connections now open) 2015-10-05T06:30:39.880+0100 [conn1426732] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:39.885+0100 [conn1426732] end connection 127.0.0.1:52680 (400 connections now open) 2015-10-05T06:30:41.491+0100 [conn1426337] end connection 172.28.0.163:51540 (399 connections now open) 2015-10-05T06:30:41.492+0100 [mongosMain] connection accepted from 172.28.0.163:52683 #1426733 (400 connections now open) 2015-10-05T06:30:41.494+0100 [conn1426733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:41.566+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:41.566+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:41.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b015703b51053ec30ab 2015-10-05T06:30:42.037+0100 [conn1426344] end connection 172.28.0.163:51559 (399 connections now open) 2015-10-05T06:30:42.039+0100 [mongosMain] connection accepted from 172.28.0.163:52687 #1426734 (400 connections now open) 2015-10-05T06:30:42.040+0100 [conn1426734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:42.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:42.237+0100 [conn1426345] end connection 172.28.0.164:60970 (399 connections now open) 2015-10-05T06:30:42.238+0100 [mongosMain] connection accepted from 172.28.0.164:62035 #1426735 (400 connections now open) 2015-10-05T06:30:42.242+0100 [conn1426735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:45.907+0100 [conn1426336] end connection 172.28.0.163:51532 (399 connections now open) 2015-10-05T06:30:45.907+0100 [conn1426142] end connection 172.28.0.163:51028 (399 connections now open) 2015-10-05T06:30:45.908+0100 [mongosMain] connection accepted from 172.28.0.163:52695 #1426736 (399 connections now open) 2015-10-05T06:30:45.908+0100 [mongosMain] connection accepted from 172.28.0.163:52696 #1426737 (400 connections now open) 2015-10-05T06:30:45.909+0100 [conn1426736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:45.909+0100 [conn1426737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:47.152+0100 [conn1426327] end connection 172.28.0.164:60897 (399 connections now open) 2015-10-05T06:30:47.152+0100 [conn1426340] end connection 172.28.0.164:60960 (399 connections now open) 2015-10-05T06:30:47.153+0100 [mongosMain] connection accepted from 172.28.0.164:62046 #1426738 (399 connections now open) 2015-10-05T06:30:47.153+0100 [mongosMain] connection accepted from 172.28.0.164:62047 #1426739 (400 connections now open) 2015-10-05T06:30:47.155+0100 [conn1426739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:47.155+0100 [conn1426738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:47.580+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:47.580+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:48.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b085703b51053ec30f3 2015-10-05T06:30:48.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:50.516+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:52.052+0100 [conn1426351] end connection 172.28.0.163:51571 (399 connections now open) 2015-10-05T06:30:52.054+0100 [mongosMain] connection accepted from 172.28.0.163:52708 #1426740 (400 connections now open) 2015-10-05T06:30:52.055+0100 [conn1426740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:52.237+0100 [conn1426352] end connection 172.28.0.164:60989 (399 connections now open) 2015-10-05T06:30:52.239+0100 [mongosMain] connection accepted from 172.28.0.164:62055 #1426741 (400 connections now open) 2015-10-05T06:30:52.241+0100 [conn1426741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:54.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b0e5703b51053ec3131 2015-10-05T06:30:54.588+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:30:54.588+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:30:54.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:30:55.923+0100 [conn1426346] end connection 172.28.0.163:51562 (399 connections now open) 2015-10-05T06:30:55.923+0100 [conn1426265] end connection 172.28.0.163:51303 (399 connections now open) 2015-10-05T06:30:55.924+0100 [mongosMain] connection accepted from 172.28.0.163:52716 #1426742 (399 connections now open) 2015-10-05T06:30:55.924+0100 [mongosMain] connection accepted from 172.28.0.163:52717 #1426743 (400 connections now open) 2015-10-05T06:30:55.925+0100 [conn1426742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:55.925+0100 [conn1426743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:57.153+0100 [conn1426272] end connection 172.28.0.164:60743 (399 connections now open) 2015-10-05T06:30:57.155+0100 [conn1426347] end connection 172.28.0.164:60976 (398 connections now open) 2015-10-05T06:30:57.156+0100 [mongosMain] connection accepted from 172.28.0.164:62060 #1426744 (400 connections now open) 2015-10-05T06:30:57.156+0100 [mongosMain] connection accepted from 172.28.0.164:62061 #1426745 (400 connections now open) 2015-10-05T06:30:57.158+0100 [conn1426744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:30:57.159+0100 [conn1426745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:00.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b145703b51053ec316f 2015-10-05T06:31:01.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:01.509+0100 [conn1426307] end connection 172.28.0.163:51420 (399 connections now open) 2015-10-05T06:31:01.511+0100 [mongosMain] connection accepted from 172.28.0.163:52728 #1426746 (400 connections now open) 2015-10-05T06:31:01.512+0100 [conn1426746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:01.540+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:02.055+0100 [conn1426357] end connection 172.28.0.163:51591 (399 connections now open) 2015-10-05T06:31:02.056+0100 [mongosMain] connection accepted from 172.28.0.163:52731 #1426747 (400 connections now open) 2015-10-05T06:31:02.058+0100 [conn1426747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:02.253+0100 [conn1426358] end connection 172.28.0.164:61007 (399 connections now open) 2015-10-05T06:31:02.254+0100 [mongosMain] connection accepted from 172.28.0.164:62066 #1426748 (400 connections now open) 2015-10-05T06:31:02.256+0100 [conn1426748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:02.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:02.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:05.922+0100 [conn1426313] end connection 172.28.0.163:51445 (399 connections now open) 2015-10-05T06:31:05.923+0100 [mongosMain] connection accepted from 172.28.0.163:52737 #1426749 (400 connections now open) 2015-10-05T06:31:05.925+0100 [conn1426749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:07.167+0100 [conn1426209] end connection 172.28.0.164:60586 (399 connections now open) 2015-10-05T06:31:07.167+0100 [conn1426310] end connection 172.28.0.164:60852 (399 connections now open) 2015-10-05T06:31:07.169+0100 [mongosMain] connection accepted from 172.28.0.164:62069 #1426750 (399 connections now open) 2015-10-05T06:31:07.169+0100 [mongosMain] connection accepted from 172.28.0.164:62070 #1426751 (400 connections now open) 2015-10-05T06:31:07.170+0100 [conn1426750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:07.170+0100 [conn1426751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:07.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b1b5703b51053ec31df 2015-10-05T06:31:07.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:07.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:31:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:31:11.522+0100 [conn1426356] end connection 172.28.0.163:51589 (399 connections now open) 2015-10-05T06:31:11.523+0100 [mongosMain] connection accepted from 172.28.0.163:52747 #1426752 (400 connections now open) 2015-10-05T06:31:11.524+0100 [conn1426752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:11.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:11.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:11.725+0100 [conn1426330] end connection 172.28.0.164:60909 (399 connections now open) 2015-10-05T06:31:11.725+0100 [mongosMain] connection accepted from 172.28.0.164:62074 #1426753 (400 connections now open) 2015-10-05T06:31:11.727+0100 [conn1426753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:12.068+0100 [conn1426362] end connection 172.28.0.163:51648 (399 connections now open) 2015-10-05T06:31:12.069+0100 [mongosMain] connection accepted from 172.28.0.163:52752 #1426754 (400 connections now open) 2015-10-05T06:31:12.071+0100 [conn1426754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:12.253+0100 [conn1426363] end connection 172.28.0.164:61021 (399 connections now open) 2015-10-05T06:31:12.254+0100 [mongosMain] connection accepted from 172.28.0.164:62076 #1426755 (400 connections now open) 2015-10-05T06:31:12.256+0100 [conn1426755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:12.549+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:13.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b215703b51053ec3223 2015-10-05T06:31:14.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:15.938+0100 [conn1426353] end connection 172.28.0.163:51579 (399 connections now open) 2015-10-05T06:31:15.938+0100 [conn1426364] end connection 172.28.0.163:51656 (399 connections now open) 2015-10-05T06:31:15.939+0100 [mongosMain] connection accepted from 172.28.0.163:52758 #1426756 (399 connections now open) 2015-10-05T06:31:15.939+0100 [mongosMain] connection accepted from 172.28.0.163:52759 #1426757 (400 connections now open) 2015-10-05T06:31:15.940+0100 [conn1426756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:15.940+0100 [conn1426757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:17.168+0100 [conn1426355] end connection 172.28.0.164:60998 (399 connections now open) 2015-10-05T06:31:17.168+0100 [conn1426267] end connection 172.28.0.164:60731 (398 connections now open) 2015-10-05T06:31:17.170+0100 [mongosMain] connection accepted from 172.28.0.164:62081 #1426758 (399 connections now open) 2015-10-05T06:31:17.170+0100 [mongosMain] connection accepted from 172.28.0.164:62082 #1426759 (400 connections now open) 2015-10-05T06:31:17.172+0100 [conn1426758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:17.172+0100 [conn1426759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:20.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b285703b51053ec325a 2015-10-05T06:31:20.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:21.523+0100 [conn1426350] end connection 172.28.0.163:51569 (399 connections now open) 2015-10-05T06:31:21.524+0100 [mongosMain] connection accepted from 172.28.0.163:52767 #1426760 (400 connections now open) 2015-10-05T06:31:21.525+0100 [conn1426760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:21.624+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:21.624+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:21.740+0100 [conn1426289] end connection 172.28.0.164:60791 (399 connections now open) 2015-10-05T06:31:21.741+0100 [mongosMain] connection accepted from 172.28.0.164:62090 #1426761 (400 connections now open) 2015-10-05T06:31:21.743+0100 [conn1426761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:22.069+0100 [conn1426369] end connection 172.28.0.163:51668 (399 connections now open) 2015-10-05T06:31:22.070+0100 [mongosMain] connection accepted from 172.28.0.163:52768 #1426762 (400 connections now open) 2015-10-05T06:31:22.071+0100 [conn1426762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:22.269+0100 [conn1426370] end connection 172.28.0.164:61032 (399 connections now open) 2015-10-05T06:31:22.270+0100 [mongosMain] connection accepted from 172.28.0.164:62092 #1426763 (400 connections now open) 2015-10-05T06:31:22.275+0100 [conn1426763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:23.572+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:25.953+0100 [conn1426319] end connection 172.28.0.163:51460 (399 connections now open) 2015-10-05T06:31:25.954+0100 [mongosMain] connection accepted from 172.28.0.163:52772 #1426764 (400 connections now open) 2015-10-05T06:31:25.955+0100 [conn1426764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:26.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b2e5703b51053ec3296 2015-10-05T06:31:26.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:27.167+0100 [conn1426331] end connection 172.28.0.164:60916 (399 connections now open) 2015-10-05T06:31:27.168+0100 [mongosMain] connection accepted from 172.28.0.164:62102 #1426765 (400 connections now open) 2015-10-05T06:31:27.170+0100 [conn1426765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:28.844+0100 [mongosMain] connection accepted from 127.0.0.1:52774 #1426766 (401 connections now open) 2015-10-05T06:31:28.847+0100 [conn1426766] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:28.852+0100 [conn1426766] end connection 127.0.0.1:52774 (400 connections now open) 2015-10-05T06:31:31.538+0100 [conn1426361] end connection 172.28.0.163:51644 (399 connections now open) 2015-10-05T06:31:31.539+0100 [mongosMain] connection accepted from 172.28.0.163:52775 #1426767 (400 connections now open) 2015-10-05T06:31:31.540+0100 [conn1426767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:31.754+0100 [conn1426368] end connection 172.28.0.164:61030 (399 connections now open) 2015-10-05T06:31:31.755+0100 [mongosMain] connection accepted from 172.28.0.164:62107 #1426768 (400 connections now open) 2015-10-05T06:31:31.757+0100 [conn1426768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:32.084+0100 [conn1426376] end connection 172.28.0.163:51684 (399 connections now open) 2015-10-05T06:31:32.086+0100 [mongosMain] connection accepted from 172.28.0.163:52777 #1426769 (400 connections now open) 2015-10-05T06:31:32.087+0100 [conn1426769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:32.284+0100 [conn1426377] end connection 172.28.0.164:61046 (399 connections now open) 2015-10-05T06:31:32.285+0100 [mongosMain] connection accepted from 172.28.0.164:62109 #1426770 (400 connections now open) 2015-10-05T06:31:32.286+0100 [conn1426770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:32.641+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:32.642+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:33.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b345703b51053ec32d9 2015-10-05T06:31:33.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:34.587+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:35.956+0100 [conn1426354] end connection 172.28.0.163:51580 (399 connections now open) 2015-10-05T06:31:35.958+0100 [conn1426229] end connection 172.28.0.163:51227 (398 connections now open) 2015-10-05T06:31:35.959+0100 [mongosMain] connection accepted from 172.28.0.163:52781 #1426771 (399 connections now open) 2015-10-05T06:31:35.959+0100 [mongosMain] connection accepted from 172.28.0.163:52782 #1426772 (400 connections now open) 2015-10-05T06:31:35.960+0100 [conn1426771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:35.961+0100 [conn1426772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:37.982+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:31:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:31:39.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b3b5703b51053ec3328 2015-10-05T06:31:39.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:40.047+0100 [mongosMain] connection accepted from 127.0.0.1:52787 #1426773 (401 connections now open) 2015-10-05T06:31:40.050+0100 [conn1426773] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:40.054+0100 [conn1426773] end connection 127.0.0.1:52787 (400 connections now open) 2015-10-05T06:31:41.538+0100 [conn1426367] end connection 172.28.0.163:51667 (399 connections now open) 2015-10-05T06:31:41.539+0100 [mongosMain] connection accepted from 172.28.0.163:52789 #1426774 (400 connections now open) 2015-10-05T06:31:41.540+0100 [conn1426774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:41.770+0100 [conn1426257] end connection 172.28.0.164:60700 (399 connections now open) 2015-10-05T06:31:41.771+0100 [mongosMain] connection accepted from 172.28.0.164:62125 #1426775 (400 connections now open) 2015-10-05T06:31:41.773+0100 [conn1426775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:42.084+0100 [conn1426383] end connection 172.28.0.163:51696 (399 connections now open) 2015-10-05T06:31:42.085+0100 [mongosMain] connection accepted from 172.28.0.163:52791 #1426776 (400 connections now open) 2015-10-05T06:31:42.087+0100 [conn1426776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:42.300+0100 [conn1426384] end connection 172.28.0.164:61066 (399 connections now open) 2015-10-05T06:31:42.301+0100 [mongosMain] connection accepted from 172.28.0.164:62127 #1426777 (400 connections now open) 2015-10-05T06:31:42.304+0100 [conn1426777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:44.660+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:44.660+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:45.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b415703b51053ec3383 2015-10-05T06:31:45.593+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:45.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:45.969+0100 [conn1426321] end connection 172.28.0.163:51463 (399 connections now open) 2015-10-05T06:31:45.970+0100 [mongosMain] connection accepted from 172.28.0.163:52801 #1426778 (400 connections now open) 2015-10-05T06:31:45.971+0100 [conn1426778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:46.663+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:46.663+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:47.200+0100 [conn1426372] end connection 172.28.0.164:61036 (399 connections now open) 2015-10-05T06:31:47.201+0100 [mongosMain] connection accepted from 172.28.0.164:62137 #1426779 (400 connections now open) 2015-10-05T06:31:47.203+0100 [conn1426779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:49.666+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:49.666+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:51.554+0100 [conn1426332] end connection 172.28.0.163:51493 (399 connections now open) 2015-10-05T06:31:51.556+0100 [mongosMain] connection accepted from 172.28.0.163:52809 #1426780 (400 connections now open) 2015-10-05T06:31:51.557+0100 [conn1426780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:51.769+0100 [conn1426298] end connection 172.28.0.164:60812 (399 connections now open) 2015-10-05T06:31:51.770+0100 [mongosMain] connection accepted from 172.28.0.164:62143 #1426781 (400 connections now open) 2015-10-05T06:31:51.772+0100 [conn1426781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:51.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b475703b51053ec33c3 2015-10-05T06:31:52.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:52.100+0100 [conn1426389] end connection 172.28.0.163:51708 (399 connections now open) 2015-10-05T06:31:52.102+0100 [mongosMain] connection accepted from 172.28.0.163:52813 #1426782 (400 connections now open) 2015-10-05T06:31:52.103+0100 [conn1426782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:52.316+0100 [conn1426390] end connection 172.28.0.164:61088 (399 connections now open) 2015-10-05T06:31:52.317+0100 [mongosMain] connection accepted from 172.28.0.164:62146 #1426783 (400 connections now open) 2015-10-05T06:31:52.319+0100 [conn1426783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:53.672+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:53.672+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:31:55.998+0100 [conn1426371] end connection 172.28.0.163:51675 (399 connections now open) 2015-10-05T06:31:56.007+0100 [mongosMain] connection accepted from 172.28.0.163:52824 #1426784 (400 connections now open) 2015-10-05T06:31:56.008+0100 [conn1426784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:56.600+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:57.200+0100 [conn1426360] end connection 172.28.0.164:61016 (399 connections now open) 2015-10-05T06:31:57.200+0100 [conn1426348] end connection 172.28.0.164:60977 (399 connections now open) 2015-10-05T06:31:57.201+0100 [mongosMain] connection accepted from 172.28.0.164:62157 #1426785 (399 connections now open) 2015-10-05T06:31:57.202+0100 [mongosMain] connection accepted from 172.28.0.164:62156 #1426786 (400 connections now open) 2015-10-05T06:31:57.203+0100 [conn1426785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:57.204+0100 [conn1426786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:31:58.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b4e5703b51053ec3403 2015-10-05T06:31:58.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:31:58.683+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:31:58.684+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:01.569+0100 [conn1426374] end connection 172.28.0.163:51683 (399 connections now open) 2015-10-05T06:32:01.571+0100 [mongosMain] connection accepted from 172.28.0.163:52832 #1426787 (400 connections now open) 2015-10-05T06:32:01.572+0100 [conn1426787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:01.785+0100 [conn1426388] end connection 172.28.0.164:61085 (399 connections now open) 2015-10-05T06:32:01.786+0100 [mongosMain] connection accepted from 172.28.0.164:62161 #1426788 (400 connections now open) 2015-10-05T06:32:01.787+0100 [conn1426788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:02.115+0100 [conn1426395] end connection 172.28.0.163:51729 (399 connections now open) 2015-10-05T06:32:02.116+0100 [mongosMain] connection accepted from 172.28.0.163:52835 #1426789 (400 connections now open) 2015-10-05T06:32:02.117+0100 [conn1426789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:02.332+0100 [conn1426396] end connection 172.28.0.164:61106 (399 connections now open) 2015-10-05T06:32:02.333+0100 [mongosMain] connection accepted from 172.28.0.164:62163 #1426790 (400 connections now open) 2015-10-05T06:32:02.334+0100 [conn1426790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:04.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b545703b51053ec345d 2015-10-05T06:32:04.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:04.691+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:04.691+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:05.986+0100 [conn1426309] end connection 172.28.0.163:51429 (399 connections now open) 2015-10-05T06:32:05.987+0100 [mongosMain] connection accepted from 172.28.0.163:52844 #1426791 (400 connections now open) 2015-10-05T06:32:05.988+0100 [conn1426791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:07.215+0100 [conn1426392] end connection 172.28.0.164:61096 (399 connections now open) 2015-10-05T06:32:07.215+0100 [conn1426386] end connection 172.28.0.164:61073 (399 connections now open) 2015-10-05T06:32:07.216+0100 [mongosMain] connection accepted from 172.28.0.164:62169 #1426792 (399 connections now open) 2015-10-05T06:32:07.216+0100 [mongosMain] connection accepted from 172.28.0.164:62170 #1426793 (400 connections now open) 2015-10-05T06:32:07.218+0100 [conn1426792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:07.218+0100 [conn1426793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:07.710+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:08.259+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:32:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:32:10.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b5a5703b51053ec34b5 2015-10-05T06:32:11.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:11.570+0100 [conn1426393] end connection 172.28.0.163:51726 (399 connections now open) 2015-10-05T06:32:11.571+0100 [mongosMain] connection accepted from 172.28.0.163:52855 #1426794 (400 connections now open) 2015-10-05T06:32:11.572+0100 [conn1426794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:11.783+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:11.783+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:11.801+0100 [conn1426375] end connection 172.28.0.164:61042 (399 connections now open) 2015-10-05T06:32:11.802+0100 [mongosMain] connection accepted from 172.28.0.164:62172 #1426795 (400 connections now open) 2015-10-05T06:32:11.806+0100 [conn1426795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:12.116+0100 [conn1426403] end connection 172.28.0.163:51750 (399 connections now open) 2015-10-05T06:32:12.118+0100 [mongosMain] connection accepted from 172.28.0.163:52859 #1426796 (400 connections now open) 2015-10-05T06:32:12.119+0100 [conn1426796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:12.347+0100 [conn1426404] end connection 172.28.0.164:61122 (399 connections now open) 2015-10-05T06:32:12.349+0100 [mongosMain] connection accepted from 172.28.0.164:62174 #1426797 (400 connections now open) 2015-10-05T06:32:12.351+0100 [conn1426797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:15.985+0100 [conn1426391] end connection 172.28.0.163:51715 (399 connections now open) 2015-10-05T06:32:15.986+0100 [conn1426378] end connection 172.28.0.163:51686 (399 connections now open) 2015-10-05T06:32:15.987+0100 [mongosMain] connection accepted from 172.28.0.163:52865 #1426798 (399 connections now open) 2015-10-05T06:32:15.987+0100 [mongosMain] connection accepted from 172.28.0.163:52866 #1426799 (400 connections now open) 2015-10-05T06:32:15.988+0100 [conn1426798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:15.988+0100 [conn1426799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:17.215+0100 [conn1426399] end connection 172.28.0.164:61112 (399 connections now open) 2015-10-05T06:32:17.216+0100 [mongosMain] connection accepted from 172.28.0.164:62179 #1426800 (400 connections now open) 2015-10-05T06:32:17.218+0100 [conn1426400] end connection 172.28.0.164:61114 (399 connections now open) 2015-10-05T06:32:17.218+0100 [conn1426800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:17.219+0100 [mongosMain] connection accepted from 172.28.0.164:62182 #1426801 (400 connections now open) 2015-10-05T06:32:17.221+0100 [conn1426801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:17.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b615703b51053ec34fc 2015-10-05T06:32:17.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:18.719+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:19.790+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:19.790+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:21.585+0100 [conn1426381] end connection 172.28.0.163:51695 (399 connections now open) 2015-10-05T06:32:21.586+0100 [mongosMain] connection accepted from 172.28.0.163:52874 #1426802 (400 connections now open) 2015-10-05T06:32:21.587+0100 [conn1426802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:21.802+0100 [conn1426324] end connection 172.28.0.164:60890 (399 connections now open) 2015-10-05T06:32:21.803+0100 [mongosMain] connection accepted from 172.28.0.164:62190 #1426803 (400 connections now open) 2015-10-05T06:32:21.804+0100 [conn1426803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:22.131+0100 [conn1426410] end connection 172.28.0.163:51769 (399 connections now open) 2015-10-05T06:32:22.132+0100 [mongosMain] connection accepted from 172.28.0.163:52875 #1426804 (400 connections now open) 2015-10-05T06:32:22.134+0100 [conn1426804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:22.348+0100 [conn1426411] end connection 172.28.0.164:61136 (399 connections now open) 2015-10-05T06:32:22.349+0100 [mongosMain] connection accepted from 172.28.0.164:62193 #1426805 (400 connections now open) 2015-10-05T06:32:22.351+0100 [conn1426805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:23.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b675703b51053ec354a 2015-10-05T06:32:23.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:26.003+0100 [conn1426365] end connection 172.28.0.163:51657 (399 connections now open) 2015-10-05T06:32:26.004+0100 [mongosMain] connection accepted from 172.28.0.163:52877 #1426806 (400 connections now open) 2015-10-05T06:32:26.005+0100 [conn1426806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:27.231+0100 [conn1426277] end connection 172.28.0.164:60754 (399 connections now open) 2015-10-05T06:32:27.231+0100 [conn1426407] end connection 172.28.0.164:61129 (398 connections now open) 2015-10-05T06:32:27.232+0100 [mongosMain] connection accepted from 172.28.0.164:62202 #1426807 (399 connections now open) 2015-10-05T06:32:27.232+0100 [mongosMain] connection accepted from 172.28.0.164:62201 #1426808 (400 connections now open) 2015-10-05T06:32:27.234+0100 [conn1426807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:27.234+0100 [conn1426808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:28.463+0100 [mongosMain] connection accepted from 127.0.0.1:52880 #1426809 (401 connections now open) 2015-10-05T06:32:28.466+0100 [conn1426809] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:28.472+0100 [conn1426809] end connection 127.0.0.1:52880 (400 connections now open) 2015-10-05T06:32:28.790+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:28.790+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:29.725+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:29.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b6d5703b51053ec359c 2015-10-05T06:32:29.930+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:31.586+0100 [conn1426342] end connection 172.28.0.163:51558 (399 connections now open) 2015-10-05T06:32:31.588+0100 [mongosMain] connection accepted from 172.28.0.163:52882 #1426810 (400 connections now open) 2015-10-05T06:32:31.589+0100 [conn1426810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:31.801+0100 [conn1426343] end connection 172.28.0.164:60967 (399 connections now open) 2015-10-05T06:32:31.802+0100 [mongosMain] connection accepted from 172.28.0.164:62209 #1426811 (400 connections now open) 2015-10-05T06:32:31.804+0100 [conn1426811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:32.132+0100 [conn1426418] end connection 172.28.0.163:51793 (399 connections now open) 2015-10-05T06:32:32.134+0100 [mongosMain] connection accepted from 172.28.0.163:52884 #1426812 (400 connections now open) 2015-10-05T06:32:32.135+0100 [conn1426812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:32.347+0100 [conn1426419] end connection 172.28.0.164:61150 (399 connections now open) 2015-10-05T06:32:32.348+0100 [mongosMain] connection accepted from 172.28.0.164:62213 #1426813 (400 connections now open) 2015-10-05T06:32:32.349+0100 [conn1426813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:36.052+0100 [conn1426305] end connection 172.28.0.163:51409 (399 connections now open) 2015-10-05T06:32:36.052+0100 [mongosMain] connection accepted from 172.28.0.163:52887 #1426814 (400 connections now open) 2015-10-05T06:32:36.052+0100 [conn1426814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:36.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b735703b51053ec35d2 2015-10-05T06:32:36.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:37.269+0100 [conn1426385] end connection 172.28.0.164:61074 (399 connections now open) 2015-10-05T06:32:37.269+0100 [mongosMain] connection accepted from 172.28.0.164:62220 #1426815 (400 connections now open) 2015-10-05T06:32:37.269+0100 [conn1426815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:38.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:32:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:32:38.794+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:38.794+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:39.930+0100 [mongosMain] connection accepted from 127.0.0.1:52896 #1426816 (401 connections now open) 2015-10-05T06:32:39.933+0100 [conn1426816] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:39.937+0100 [conn1426816] end connection 127.0.0.1:52896 (400 connections now open) 2015-10-05T06:32:40.739+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:41.817+0100 [conn1426394] end connection 172.28.0.164:61103 (399 connections now open) 2015-10-05T06:32:41.829+0100 [mongosMain] connection accepted from 172.28.0.164:62230 #1426817 (400 connections now open) 2015-10-05T06:32:41.830+0100 [conn1426817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:42.147+0100 [conn1426427] end connection 172.28.0.163:51813 (399 connections now open) 2015-10-05T06:32:42.148+0100 [mongosMain] connection accepted from 172.28.0.163:52900 #1426818 (400 connections now open) 2015-10-05T06:32:42.149+0100 [conn1426818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:42.363+0100 [conn1426428] end connection 172.28.0.164:61169 (399 connections now open) 2015-10-05T06:32:42.364+0100 [mongosMain] connection accepted from 172.28.0.164:62233 #1426819 (400 connections now open) 2015-10-05T06:32:42.366+0100 [conn1426819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:42.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b7a5703b51053ec3608 2015-10-05T06:32:42.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:46.032+0100 [conn1426413] end connection 172.28.0.163:51779 (399 connections now open) 2015-10-05T06:32:46.032+0100 [conn1426326] end connection 172.28.0.163:51470 (399 connections now open) 2015-10-05T06:32:46.034+0100 [mongosMain] connection accepted from 172.28.0.163:52906 #1426820 (399 connections now open) 2015-10-05T06:32:46.034+0100 [mongosMain] connection accepted from 172.28.0.163:52907 #1426821 (400 connections now open) 2015-10-05T06:32:46.035+0100 [conn1426820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:46.035+0100 [conn1426821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:47.262+0100 [conn1426423] end connection 172.28.0.164:61161 (399 connections now open) 2015-10-05T06:32:47.263+0100 [mongosMain] connection accepted from 172.28.0.164:62241 #1426822 (400 connections now open) 2015-10-05T06:32:47.266+0100 [conn1426822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:48.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b805703b51053ec364e 2015-10-05T06:32:48.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:49.809+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:49.809+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:32:51.602+0100 [conn1426425] end connection 172.28.0.163:51805 (399 connections now open) 2015-10-05T06:32:51.603+0100 [mongosMain] connection accepted from 172.28.0.163:52916 #1426823 (400 connections now open) 2015-10-05T06:32:51.605+0100 [conn1426823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:51.739+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:32:51.817+0100 [conn1426409] end connection 172.28.0.164:61134 (399 connections now open) 2015-10-05T06:32:51.818+0100 [mongosMain] connection accepted from 172.28.0.164:62248 #1426824 (400 connections now open) 2015-10-05T06:32:51.819+0100 [conn1426824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:52.148+0100 [conn1426435] end connection 172.28.0.163:51828 (399 connections now open) 2015-10-05T06:32:52.150+0100 [mongosMain] connection accepted from 172.28.0.163:52919 #1426825 (400 connections now open) 2015-10-05T06:32:52.151+0100 [conn1426825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:52.364+0100 [conn1426436] end connection 172.28.0.164:61190 (399 connections now open) 2015-10-05T06:32:52.365+0100 [mongosMain] connection accepted from 172.28.0.164:62252 #1426826 (400 connections now open) 2015-10-05T06:32:52.367+0100 [conn1426826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:55.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b875703b51053ec3680 2015-10-05T06:32:55.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:32:56.032+0100 [conn1426421] end connection 172.28.0.163:51799 (399 connections now open) 2015-10-05T06:32:56.032+0100 [conn1426338] end connection 172.28.0.163:51545 (399 connections now open) 2015-10-05T06:32:56.033+0100 [mongosMain] connection accepted from 172.28.0.163:52927 #1426827 (399 connections now open) 2015-10-05T06:32:56.034+0100 [mongosMain] connection accepted from 172.28.0.163:52928 #1426828 (400 connections now open) 2015-10-05T06:32:56.035+0100 [conn1426827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:56.035+0100 [conn1426828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:32:57.278+0100 [conn1426430] end connection 172.28.0.164:61181 (399 connections now open) 2015-10-05T06:32:57.278+0100 [mongosMain] connection accepted from 172.28.0.164:62258 #1426829 (400 connections now open) 2015-10-05T06:32:57.280+0100 [conn1426829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:01.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b8d5703b51053ec36b3 2015-10-05T06:33:01.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:33:01.617+0100 [conn1426408] end connection 172.28.0.163:51767 (399 connections now open) 2015-10-05T06:33:01.618+0100 [mongosMain] connection accepted from 172.28.0.163:52940 #1426830 (400 connections now open) 2015-10-05T06:33:01.619+0100 [conn1426830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:01.813+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:01.813+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:01.834+0100 [conn1426434] end connection 172.28.0.164:61188 (399 connections now open) 2015-10-05T06:33:01.835+0100 [mongosMain] connection accepted from 172.28.0.164:62263 #1426831 (400 connections now open) 2015-10-05T06:33:01.837+0100 [conn1426831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:02.163+0100 [conn1426441] end connection 172.28.0.163:51848 (399 connections now open) 2015-10-05T06:33:02.165+0100 [mongosMain] connection accepted from 172.28.0.163:52944 #1426832 (400 connections now open) 2015-10-05T06:33:02.166+0100 [conn1426832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:02.378+0100 [conn1426442] end connection 172.28.0.164:61210 (399 connections now open) 2015-10-05T06:33:02.379+0100 [mongosMain] connection accepted from 172.28.0.164:62266 #1426833 (400 connections now open) 2015-10-05T06:33:02.381+0100 [conn1426833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:02.746+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:03.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:03.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:06.044+0100 [conn1426398] end connection 172.28.0.163:51739 (399 connections now open) 2015-10-05T06:33:06.044+0100 [conn1426444] end connection 172.28.0.163:51857 (399 connections now open) 2015-10-05T06:33:06.045+0100 [mongosMain] connection accepted from 172.28.0.163:52953 #1426834 (399 connections now open) 2015-10-05T06:33:06.046+0100 [mongosMain] connection accepted from 172.28.0.163:52954 #1426835 (400 connections now open) 2015-10-05T06:33:06.046+0100 [conn1426834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:06.047+0100 [conn1426835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:06.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:06.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:07.295+0100 [conn1426415] end connection 172.28.0.164:61143 (399 connections now open) 2015-10-05T06:33:07.295+0100 [mongosMain] connection accepted from 172.28.0.164:62275 #1426836 (400 connections now open) 2015-10-05T06:33:07.297+0100 [conn1426836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:08.721+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:33:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:33:10.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:10.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:11.617+0100 [conn1426416] end connection 172.28.0.163:51789 (399 connections now open) 2015-10-05T06:33:11.618+0100 [mongosMain] connection accepted from 172.28.0.163:52963 #1426837 (400 connections now open) 2015-10-05T06:33:11.620+0100 [conn1426837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:11.850+0100 [conn1426417] end connection 172.28.0.164:61148 (399 connections now open) 2015-10-05T06:33:11.850+0100 [mongosMain] connection accepted from 172.28.0.164:62281 #1426838 (400 connections now open) 2015-10-05T06:33:11.853+0100 [conn1426838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:12.164+0100 [conn1426449] end connection 172.28.0.163:51871 (399 connections now open) 2015-10-05T06:33:12.165+0100 [mongosMain] connection accepted from 172.28.0.163:52966 #1426839 (400 connections now open) 2015-10-05T06:33:12.167+0100 [conn1426839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:12.395+0100 [conn1426450] end connection 172.28.0.164:61225 (399 connections now open) 2015-10-05T06:33:12.396+0100 [mongosMain] connection accepted from 172.28.0.164:62284 #1426840 (400 connections now open) 2015-10-05T06:33:12.398+0100 [conn1426840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:13.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120b995703b51053ec3728 2015-10-05T06:33:13.757+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:13.873+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:33:15.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:15.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:16.048+0100 [conn1426412] end connection 172.28.0.163:51778 (399 connections now open) 2015-10-05T06:33:16.048+0100 [conn1426451] end connection 172.28.0.163:51877 (399 connections now open) 2015-10-05T06:33:16.049+0100 [mongosMain] connection accepted from 172.28.0.163:52973 #1426841 (399 connections now open) 2015-10-05T06:33:16.050+0100 [mongosMain] connection accepted from 172.28.0.163:52974 #1426842 (400 connections now open) 2015-10-05T06:33:16.050+0100 [conn1426841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:16.050+0100 [conn1426842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:21.633+0100 [conn1426447] end connection 172.28.0.163:51866 (399 connections now open) 2015-10-05T06:33:21.635+0100 [mongosMain] connection accepted from 172.28.0.163:52982 #1426843 (400 connections now open) 2015-10-05T06:33:21.636+0100 [conn1426843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:21.835+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:21.835+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:21.848+0100 [conn1426440] end connection 172.28.0.164:61207 (399 connections now open) 2015-10-05T06:33:21.849+0100 [mongosMain] connection accepted from 172.28.0.164:62297 #1426844 (400 connections now open) 2015-10-05T06:33:21.850+0100 [conn1426844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:22.178+0100 [conn1426455] end connection 172.28.0.163:51891 (399 connections now open) 2015-10-05T06:33:22.179+0100 [mongosMain] connection accepted from 172.28.0.163:52984 #1426845 (400 connections now open) 2015-10-05T06:33:22.180+0100 [conn1426845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:22.394+0100 [conn1426456] end connection 172.28.0.164:61234 (399 connections now open) 2015-10-05T06:33:22.395+0100 [mongosMain] connection accepted from 172.28.0.164:62302 #1426846 (400 connections now open) 2015-10-05T06:33:22.396+0100 [conn1426846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:24.769+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:26.048+0100 [conn1426420] end connection 172.28.0.163:51798 (399 connections now open) 2015-10-05T06:33:26.048+0100 [conn1426458] end connection 172.28.0.163:51897 (399 connections now open) 2015-10-05T06:33:26.049+0100 [mongosMain] connection accepted from 172.28.0.163:52989 #1426847 (399 connections now open) 2015-10-05T06:33:26.049+0100 [mongosMain] connection accepted from 172.28.0.163:52988 #1426848 (400 connections now open) 2015-10-05T06:33:26.050+0100 [conn1426847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:26.050+0100 [conn1426848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:26.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ba55703b51053ec377c 2015-10-05T06:33:26.326+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:33:27.309+0100 [conn1426438] end connection 172.28.0.164:61200 (399 connections now open) 2015-10-05T06:33:27.310+0100 [mongosMain] connection accepted from 172.28.0.164:62312 #1426849 (400 connections now open) 2015-10-05T06:33:27.312+0100 [conn1426849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:28.268+0100 [mongosMain] connection accepted from 127.0.0.1:52993 #1426850 (401 connections now open) 2015-10-05T06:33:28.271+0100 [conn1426850] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:28.276+0100 [conn1426850] end connection 127.0.0.1:52993 (400 connections now open) 2015-10-05T06:33:28.846+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:28.847+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:31.865+0100 [conn1426382] end connection 172.28.0.164:61062 (399 connections now open) 2015-10-05T06:33:31.866+0100 [mongosMain] connection accepted from 172.28.0.164:62319 #1426851 (400 connections now open) 2015-10-05T06:33:31.868+0100 [conn1426851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:32.195+0100 [conn1426462] end connection 172.28.0.163:51907 (399 connections now open) 2015-10-05T06:33:32.196+0100 [mongosMain] connection accepted from 172.28.0.163:52996 #1426852 (400 connections now open) 2015-10-05T06:33:32.197+0100 [conn1426852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:32.410+0100 [conn1426463] end connection 172.28.0.164:61250 (399 connections now open) 2015-10-05T06:33:32.412+0100 [mongosMain] connection accepted from 172.28.0.164:62321 #1426853 (400 connections now open) 2015-10-05T06:33:32.413+0100 [conn1426853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:35.772+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:36.064+0100 [conn1426397] end connection 172.28.0.163:51736 (399 connections now open) 2015-10-05T06:33:36.066+0100 [mongosMain] connection accepted from 172.28.0.163:53002 #1426854 (400 connections now open) 2015-10-05T06:33:36.067+0100 [conn1426854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:36.857+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:36.858+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:37.325+0100 [conn1426445] end connection 172.28.0.164:61218 (399 connections now open) 2015-10-05T06:33:37.326+0100 [mongosMain] connection accepted from 172.28.0.164:62331 #1426855 (400 connections now open) 2015-10-05T06:33:37.327+0100 [conn1426855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:38.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bb25703b51053ec37da 2015-10-05T06:33:38.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:33:38.989+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:33:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:33:39.447+0100 [mongosMain] connection accepted from 127.0.0.1:53007 #1426856 (401 connections now open) 2015-10-05T06:33:39.450+0100 [conn1426856] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:39.454+0100 [conn1426856] end connection 127.0.0.1:53007 (400 connections now open) 2015-10-05T06:33:41.649+0100 [conn1426433] end connection 172.28.0.163:51825 (399 connections now open) 2015-10-05T06:33:41.650+0100 [mongosMain] connection accepted from 172.28.0.163:53009 #1426857 (400 connections now open) 2015-10-05T06:33:41.652+0100 [conn1426857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:41.880+0100 [conn1426448] end connection 172.28.0.164:61223 (399 connections now open) 2015-10-05T06:33:41.881+0100 [mongosMain] connection accepted from 172.28.0.164:62339 #1426858 (400 connections now open) 2015-10-05T06:33:41.883+0100 [conn1426858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:42.195+0100 [conn1426470] end connection 172.28.0.163:51920 (399 connections now open) 2015-10-05T06:33:42.196+0100 [mongosMain] connection accepted from 172.28.0.163:53013 #1426859 (400 connections now open) 2015-10-05T06:33:42.198+0100 [conn1426859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:42.426+0100 [conn1426471] end connection 172.28.0.164:61269 (399 connections now open) 2015-10-05T06:33:42.427+0100 [mongosMain] connection accepted from 172.28.0.164:62341 #1426860 (400 connections now open) 2015-10-05T06:33:42.428+0100 [conn1426860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:45.861+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:45.861+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:46.064+0100 [conn1426465] end connection 172.28.0.163:51911 (399 connections now open) 2015-10-05T06:33:46.065+0100 [mongosMain] connection accepted from 172.28.0.163:53022 #1426861 (400 connections now open) 2015-10-05T06:33:46.066+0100 [conn1426861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:46.774+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:51.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bbe5703b51053ec3829 2015-10-05T06:33:51.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:33:51.664+0100 [conn1426439] end connection 172.28.0.163:51846 (399 connections now open) 2015-10-05T06:33:51.666+0100 [mongosMain] connection accepted from 172.28.0.163:53032 #1426862 (400 connections now open) 2015-10-05T06:33:51.667+0100 [conn1426862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:51.880+0100 [conn1426461] end connection 172.28.0.164:61247 (399 connections now open) 2015-10-05T06:33:51.881+0100 [mongosMain] connection accepted from 172.28.0.164:62356 #1426863 (400 connections now open) 2015-10-05T06:33:51.883+0100 [conn1426863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:52.210+0100 [conn1426476] end connection 172.28.0.163:51934 (399 connections now open) 2015-10-05T06:33:52.211+0100 [mongosMain] connection accepted from 172.28.0.163:53033 #1426864 (400 connections now open) 2015-10-05T06:33:52.212+0100 [conn1426864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:52.426+0100 [conn1426477] end connection 172.28.0.164:61288 (399 connections now open) 2015-10-05T06:33:52.427+0100 [mongosMain] connection accepted from 172.28.0.164:62358 #1426865 (400 connections now open) 2015-10-05T06:33:52.429+0100 [conn1426865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:55.864+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:33:55.865+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:33:56.339+0100 [conn1426437] end connection 172.28.0.163:51835 (399 connections now open) 2015-10-05T06:33:56.344+0100 [mongosMain] connection accepted from 172.28.0.163:53042 #1426866 (400 connections now open) 2015-10-05T06:33:56.350+0100 [conn1426866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:57.342+0100 [conn1426459] end connection 172.28.0.164:61239 (399 connections now open) 2015-10-05T06:33:57.343+0100 [mongosMain] connection accepted from 172.28.0.164:62363 #1426867 (400 connections now open) 2015-10-05T06:33:57.346+0100 [conn1426867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:33:57.805+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:01.669+0100 [conn1426468] end connection 172.28.0.163:51918 (399 connections now open) 2015-10-05T06:34:01.671+0100 [mongosMain] connection accepted from 172.28.0.163:53052 #1426868 (400 connections now open) 2015-10-05T06:34:01.672+0100 [conn1426868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:01.896+0100 [conn1426454] end connection 172.28.0.164:61232 (399 connections now open) 2015-10-05T06:34:01.897+0100 [mongosMain] connection accepted from 172.28.0.164:62369 #1426869 (400 connections now open) 2015-10-05T06:34:01.901+0100 [conn1426869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:02.216+0100 [conn1426482] end connection 172.28.0.163:51954 (399 connections now open) 2015-10-05T06:34:02.217+0100 [mongosMain] connection accepted from 172.28.0.163:53054 #1426870 (400 connections now open) 2015-10-05T06:34:02.218+0100 [conn1426870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:02.442+0100 [conn1426483] end connection 172.28.0.164:61307 (399 connections now open) 2015-10-05T06:34:02.444+0100 [mongosMain] connection accepted from 172.28.0.164:62372 #1426871 (400 connections now open) 2015-10-05T06:34:02.446+0100 [conn1426871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:03.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bcb5703b51053ec388a 2015-10-05T06:34:03.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:06.328+0100 [conn1426405] end connection 172.28.0.163:51757 (399 connections now open) 2015-10-05T06:34:06.329+0100 [mongosMain] connection accepted from 172.28.0.163:53061 #1426872 (400 connections now open) 2015-10-05T06:34:06.330+0100 [conn1426872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:06.879+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:06.879+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:08.821+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:09.261+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:34:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:34:11.680+0100 [conn1426453] end connection 172.28.0.163:51889 (399 connections now open) 2015-10-05T06:34:11.681+0100 [mongosMain] connection accepted from 172.28.0.163:53072 #1426873 (400 connections now open) 2015-10-05T06:34:11.682+0100 [conn1426873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:11.912+0100 [conn1426402] end connection 172.28.0.164:61120 (399 connections now open) 2015-10-05T06:34:11.914+0100 [mongosMain] connection accepted from 172.28.0.164:62381 #1426874 (400 connections now open) 2015-10-05T06:34:11.916+0100 [conn1426874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:12.226+0100 [conn1426488] end connection 172.28.0.163:51976 (399 connections now open) 2015-10-05T06:34:12.228+0100 [mongosMain] connection accepted from 172.28.0.163:53074 #1426875 (400 connections now open) 2015-10-05T06:34:12.229+0100 [conn1426875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:12.442+0100 [conn1426489] end connection 172.28.0.164:61322 (399 connections now open) 2015-10-05T06:34:12.443+0100 [mongosMain] connection accepted from 172.28.0.164:62383 #1426876 (400 connections now open) 2015-10-05T06:34:12.445+0100 [conn1426876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:15.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bd75703b51053ec38fa 2015-10-05T06:34:16.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:16.330+0100 [conn1426491] end connection 172.28.0.163:51985 (399 connections now open) 2015-10-05T06:34:16.331+0100 [conn1426429] end connection 172.28.0.163:51818 (399 connections now open) 2015-10-05T06:34:16.332+0100 [mongosMain] connection accepted from 172.28.0.163:53080 #1426877 (399 connections now open) 2015-10-05T06:34:16.332+0100 [mongosMain] connection accepted from 172.28.0.163:53081 #1426878 (400 connections now open) 2015-10-05T06:34:16.333+0100 [conn1426877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:16.333+0100 [conn1426878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:17.357+0100 [conn1426479] end connection 172.28.0.164:61295 (399 connections now open) 2015-10-05T06:34:17.358+0100 [mongosMain] connection accepted from 172.28.0.164:62388 #1426879 (400 connections now open) 2015-10-05T06:34:17.363+0100 [conn1426879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:18.890+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:18.890+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:19.859+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:20.898+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:20.899+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:21.681+0100 [conn1426474] end connection 172.28.0.163:51933 (399 connections now open) 2015-10-05T06:34:21.682+0100 [mongosMain] connection accepted from 172.28.0.163:53089 #1426880 (400 connections now open) 2015-10-05T06:34:21.683+0100 [conn1426880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:21.927+0100 [conn1426481] end connection 172.28.0.164:61303 (399 connections now open) 2015-10-05T06:34:21.928+0100 [mongosMain] connection accepted from 172.28.0.164:62398 #1426881 (400 connections now open) 2015-10-05T06:34:21.930+0100 [conn1426881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:22.226+0100 [conn1426493] end connection 172.28.0.163:51996 (399 connections now open) 2015-10-05T06:34:22.228+0100 [mongosMain] connection accepted from 172.28.0.163:53090 #1426882 (400 connections now open) 2015-10-05T06:34:22.229+0100 [conn1426882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:22.457+0100 [conn1426494] end connection 172.28.0.164:61333 (399 connections now open) 2015-10-05T06:34:22.458+0100 [mongosMain] connection accepted from 172.28.0.164:62401 #1426883 (400 connections now open) 2015-10-05T06:34:22.460+0100 [conn1426883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:23.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:23.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:26.345+0100 [conn1426472] end connection 172.28.0.163:51923 (399 connections now open) 2015-10-05T06:34:26.346+0100 [mongosMain] connection accepted from 172.28.0.163:53094 #1426884 (400 connections now open) 2015-10-05T06:34:26.347+0100 [conn1426884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:27.373+0100 [conn1426466] end connection 172.28.0.164:61260 (399 connections now open) 2015-10-05T06:34:27.374+0100 [mongosMain] connection accepted from 172.28.0.164:62411 #1426885 (400 connections now open) 2015-10-05T06:34:27.375+0100 [conn1426885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:27.912+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:27.913+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:28.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120be45703b51053ec394b 2015-10-05T06:34:28.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:28.624+0100 [mongosMain] connection accepted from 127.0.0.1:53100 #1426886 (401 connections now open) 2015-10-05T06:34:28.627+0100 [conn1426886] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:28.632+0100 [conn1426886] end connection 127.0.0.1:53100 (400 connections now open) 2015-10-05T06:34:30.869+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:31.697+0100 [conn1426480] end connection 172.28.0.163:51953 (399 connections now open) 2015-10-05T06:34:31.698+0100 [mongosMain] connection accepted from 172.28.0.163:53102 #1426887 (400 connections now open) 2015-10-05T06:34:31.699+0100 [conn1426887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:31.943+0100 [conn1426426] end connection 172.28.0.164:61167 (399 connections now open) 2015-10-05T06:34:31.944+0100 [mongosMain] connection accepted from 172.28.0.164:62420 #1426888 (400 connections now open) 2015-10-05T06:34:31.946+0100 [conn1426888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:32.242+0100 [conn1426498] end connection 172.28.0.163:52012 (399 connections now open) 2015-10-05T06:34:32.243+0100 [mongosMain] connection accepted from 172.28.0.163:53105 #1426889 (400 connections now open) 2015-10-05T06:34:32.244+0100 [conn1426889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:32.474+0100 [conn1426499] end connection 172.28.0.164:61349 (399 connections now open) 2015-10-05T06:34:32.475+0100 [mongosMain] connection accepted from 172.28.0.164:62422 #1426890 (400 connections now open) 2015-10-05T06:34:32.477+0100 [conn1426890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:32.918+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:32.919+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:34.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bea5703b51053ec398b 2015-10-05T06:34:34.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:36.348+0100 [conn1426359] end connection 172.28.0.163:51600 (399 connections now open) 2015-10-05T06:34:36.348+0100 [conn1426500] end connection 172.28.0.163:52015 (398 connections now open) 2015-10-05T06:34:36.349+0100 [mongosMain] connection accepted from 172.28.0.163:53107 #1426891 (399 connections now open) 2015-10-05T06:34:36.349+0100 [mongosMain] connection accepted from 172.28.0.163:53108 #1426892 (400 connections now open) 2015-10-05T06:34:36.350+0100 [conn1426891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:36.350+0100 [conn1426892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:37.373+0100 [conn1426379] end connection 172.28.0.164:61052 (399 connections now open) 2015-10-05T06:34:37.373+0100 [conn1426485] end connection 172.28.0.164:61314 (398 connections now open) 2015-10-05T06:34:37.376+0100 [mongosMain] connection accepted from 172.28.0.164:62432 #1426893 (399 connections now open) 2015-10-05T06:34:37.378+0100 [conn1426893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:37.387+0100 [mongosMain] connection accepted from 172.28.0.164:62433 #1426894 (400 connections now open) 2015-10-05T06:34:37.388+0100 [conn1426894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:38.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:38.923+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:39.529+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:34:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:34:40.002+0100 [mongosMain] connection accepted from 127.0.0.1:53112 #1426895 (401 connections now open) 2015-10-05T06:34:40.005+0100 [conn1426895] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:40.009+0100 [conn1426895] end connection 127.0.0.1:53112 (400 connections now open) 2015-10-05T06:34:41.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bf05703b51053ec39c1 2015-10-05T06:34:41.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:41.697+0100 [conn1426486] end connection 172.28.0.163:51974 (399 connections now open) 2015-10-05T06:34:41.698+0100 [mongosMain] connection accepted from 172.28.0.163:53119 #1426896 (400 connections now open) 2015-10-05T06:34:41.699+0100 [conn1426896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:41.883+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:41.959+0100 [conn1426492] end connection 172.28.0.164:61331 (399 connections now open) 2015-10-05T06:34:41.959+0100 [mongosMain] connection accepted from 172.28.0.164:62443 #1426897 (400 connections now open) 2015-10-05T06:34:41.961+0100 [conn1426897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:42.242+0100 [conn1426505] end connection 172.28.0.163:52022 (399 connections now open) 2015-10-05T06:34:42.244+0100 [mongosMain] connection accepted from 172.28.0.163:53121 #1426898 (400 connections now open) 2015-10-05T06:34:42.245+0100 [conn1426898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:42.489+0100 [conn1426506] end connection 172.28.0.164:61371 (399 connections now open) 2015-10-05T06:34:42.490+0100 [mongosMain] connection accepted from 172.28.0.164:62445 #1426899 (400 connections now open) 2015-10-05T06:34:42.491+0100 [conn1426899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:45.944+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:45.944+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:46.362+0100 [conn1426478] end connection 172.28.0.163:51941 (399 connections now open) 2015-10-05T06:34:46.363+0100 [mongosMain] connection accepted from 172.28.0.163:53130 #1426900 (400 connections now open) 2015-10-05T06:34:46.364+0100 [conn1426900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:47.373+0100 [conn1426496] end connection 172.28.0.164:61340 (399 connections now open) 2015-10-05T06:34:47.375+0100 [mongosMain] connection accepted from 172.28.0.164:62455 #1426901 (400 connections now open) 2015-10-05T06:34:47.377+0100 [conn1426901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:47.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bf75703b51053ec3a0f 2015-10-05T06:34:47.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:51.959+0100 [conn1426487] end connection 172.28.0.164:61319 (399 connections now open) 2015-10-05T06:34:51.960+0100 [mongosMain] connection accepted from 172.28.0.164:62462 #1426902 (400 connections now open) 2015-10-05T06:34:51.962+0100 [conn1426902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:52.257+0100 [conn1426512] end connection 172.28.0.163:52036 (399 connections now open) 2015-10-05T06:34:52.259+0100 [mongosMain] connection accepted from 172.28.0.163:53141 #1426903 (400 connections now open) 2015-10-05T06:34:52.259+0100 [conn1426903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:52.504+0100 [conn1426513] end connection 172.28.0.164:61393 (399 connections now open) 2015-10-05T06:34:52.505+0100 [mongosMain] connection accepted from 172.28.0.164:62465 #1426904 (400 connections now open) 2015-10-05T06:34:52.506+0100 [conn1426904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:52.888+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:53.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:34:53.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:34:53.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120bfd5703b51053ec3a47 2015-10-05T06:34:54.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:34:56.382+0100 [conn1426490] end connection 172.28.0.163:51984 (399 connections now open) 2015-10-05T06:34:56.383+0100 [mongosMain] connection accepted from 172.28.0.163:53151 #1426905 (400 connections now open) 2015-10-05T06:34:56.383+0100 [conn1426905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:57.388+0100 [conn1426501] end connection 172.28.0.164:61359 (399 connections now open) 2015-10-05T06:34:57.388+0100 [conn1426431] end connection 172.28.0.164:61182 (398 connections now open) 2015-10-05T06:34:57.389+0100 [mongosMain] connection accepted from 172.28.0.164:62472 #1426906 (400 connections now open) 2015-10-05T06:34:57.389+0100 [mongosMain] connection accepted from 172.28.0.164:62473 #1426907 (400 connections now open) 2015-10-05T06:34:57.391+0100 [conn1426906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:34:57.392+0100 [conn1426907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:01.959+0100 [conn1426511] end connection 172.28.0.164:61390 (399 connections now open) 2015-10-05T06:35:01.960+0100 [mongosMain] connection accepted from 172.28.0.164:62479 #1426908 (400 connections now open) 2015-10-05T06:35:01.961+0100 [conn1426908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:02.505+0100 [conn1426518] end connection 172.28.0.164:61413 (399 connections now open) 2015-10-05T06:35:02.506+0100 [mongosMain] connection accepted from 172.28.0.164:62481 #1426909 (400 connections now open) 2015-10-05T06:35:02.508+0100 [conn1426909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:02.951+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:02.951+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:03.899+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:06.377+0100 [conn1426519] end connection 172.28.0.163:52061 (399 connections now open) 2015-10-05T06:35:06.377+0100 [conn1426452] end connection 172.28.0.163:51878 (399 connections now open) 2015-10-05T06:35:06.378+0100 [mongosMain] connection accepted from 172.28.0.163:53166 #1426910 (399 connections now open) 2015-10-05T06:35:06.379+0100 [mongosMain] connection accepted from 172.28.0.163:53167 #1426911 (400 connections now open) 2015-10-05T06:35:06.380+0100 [conn1426910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:06.380+0100 [conn1426911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:06.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c0a5703b51053ec3ac9 2015-10-05T06:35:06.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:35:07.404+0100 [conn1426508] end connection 172.28.0.164:61380 (399 connections now open) 2015-10-05T06:35:07.404+0100 [conn1426406] end connection 172.28.0.164:61128 (399 connections now open) 2015-10-05T06:35:07.405+0100 [mongosMain] connection accepted from 172.28.0.164:62486 #1426912 (399 connections now open) 2015-10-05T06:35:07.405+0100 [mongosMain] connection accepted from 172.28.0.164:62487 #1426913 (400 connections now open) 2015-10-05T06:35:07.407+0100 [conn1426913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:07.407+0100 [conn1426912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:09.827+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:35:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:35:12.521+0100 [conn1426521] end connection 172.28.0.164:61426 (399 connections now open) 2015-10-05T06:35:12.521+0100 [mongosMain] connection accepted from 172.28.0.164:62492 #1426914 (400 connections now open) 2015-10-05T06:35:12.524+0100 [conn1426914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:12.961+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:12.961+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:14.916+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:16.377+0100 [conn1426514] end connection 172.28.0.163:52046 (399 connections now open) 2015-10-05T06:35:16.378+0100 [conn1426464] end connection 172.28.0.163:51910 (398 connections now open) 2015-10-05T06:35:16.379+0100 [mongosMain] connection accepted from 172.28.0.163:53188 #1426915 (399 connections now open) 2015-10-05T06:35:16.379+0100 [mongosMain] connection accepted from 172.28.0.163:53189 #1426916 (400 connections now open) 2015-10-05T06:35:16.380+0100 [conn1426915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:16.380+0100 [conn1426916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:17.420+0100 [conn1426373] end connection 172.28.0.164:61037 (399 connections now open) 2015-10-05T06:35:17.420+0100 [conn1426515] end connection 172.28.0.164:61402 (398 connections now open) 2015-10-05T06:35:17.422+0100 [mongosMain] connection accepted from 172.28.0.164:62499 #1426917 (399 connections now open) 2015-10-05T06:35:17.422+0100 [mongosMain] connection accepted from 172.28.0.164:62498 #1426918 (400 connections now open) 2015-10-05T06:35:17.423+0100 [conn1426917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:17.424+0100 [conn1426918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:21.743+0100 [conn1426401] end connection 172.28.0.163:51747 (399 connections now open) 2015-10-05T06:35:21.744+0100 [mongosMain] connection accepted from 172.28.0.163:53194 #1426919 (400 connections now open) 2015-10-05T06:35:21.745+0100 [conn1426919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:21.991+0100 [conn1426524] end connection 172.28.0.164:61435 (399 connections now open) 2015-10-05T06:35:21.992+0100 [mongosMain] connection accepted from 172.28.0.164:62508 #1426920 (400 connections now open) 2015-10-05T06:35:21.993+0100 [conn1426920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:22.289+0100 [conn1426517] end connection 172.28.0.163:52055 (399 connections now open) 2015-10-05T06:35:22.290+0100 [mongosMain] connection accepted from 172.28.0.163:53195 #1426921 (400 connections now open) 2015-10-05T06:35:22.291+0100 [conn1426921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:22.535+0100 [conn1426525] end connection 172.28.0.164:61437 (399 connections now open) 2015-10-05T06:35:22.536+0100 [mongosMain] connection accepted from 172.28.0.164:62510 #1426922 (400 connections now open) 2015-10-05T06:35:22.538+0100 [conn1426922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:23.963+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:23.963+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:24.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c1c5703b51053ec3b5a 2015-10-05T06:35:24.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:35:25.921+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:26.392+0100 [conn1426522] end connection 172.28.0.163:52082 (399 connections now open) 2015-10-05T06:35:26.393+0100 [mongosMain] connection accepted from 172.28.0.163:53200 #1426923 (400 connections now open) 2015-10-05T06:35:26.394+0100 [conn1426923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:27.436+0100 [conn1426528] end connection 172.28.0.164:61442 (399 connections now open) 2015-10-05T06:35:27.437+0100 [mongosMain] connection accepted from 172.28.0.164:62522 #1426924 (400 connections now open) 2015-10-05T06:35:27.439+0100 [conn1426924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:28.865+0100 [mongosMain] connection accepted from 127.0.0.1:53204 #1426925 (401 connections now open) 2015-10-05T06:35:28.870+0100 [conn1426925] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:28.875+0100 [conn1426925] end connection 127.0.0.1:53204 (400 connections now open) 2015-10-05T06:35:31.746+0100 [conn1426497] end connection 172.28.0.163:52010 (399 connections now open) 2015-10-05T06:35:31.747+0100 [mongosMain] connection accepted from 172.28.0.163:53209 #1426926 (400 connections now open) 2015-10-05T06:35:31.749+0100 [conn1426926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:31.990+0100 [conn1426504] end connection 172.28.0.164:61369 (399 connections now open) 2015-10-05T06:35:31.991+0100 [mongosMain] connection accepted from 172.28.0.164:62528 #1426927 (400 connections now open) 2015-10-05T06:35:31.993+0100 [conn1426927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:32.292+0100 [conn1426531] end connection 172.28.0.163:52112 (399 connections now open) 2015-10-05T06:35:32.294+0100 [mongosMain] connection accepted from 172.28.0.163:53211 #1426928 (400 connections now open) 2015-10-05T06:35:32.295+0100 [conn1426928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:32.536+0100 [conn1426532] end connection 172.28.0.164:61455 (399 connections now open) 2015-10-05T06:35:32.537+0100 [mongosMain] connection accepted from 172.28.0.164:62530 #1426929 (400 connections now open) 2015-10-05T06:35:32.539+0100 [conn1426929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:35.959+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:35.960+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:36.408+0100 [conn1426484] end connection 172.28.0.163:51960 (399 connections now open) 2015-10-05T06:35:36.408+0100 [conn1426527] end connection 172.28.0.163:52100 (399 connections now open) 2015-10-05T06:35:36.409+0100 [mongosMain] connection accepted from 172.28.0.163:53217 #1426930 (399 connections now open) 2015-10-05T06:35:36.409+0100 [mongosMain] connection accepted from 172.28.0.163:53218 #1426931 (400 connections now open) 2015-10-05T06:35:36.410+0100 [conn1426930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:36.411+0100 [conn1426931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:36.934+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:37.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c285703b51053ec3bc5 2015-10-05T06:35:37.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:35:37.965+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:37.965+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:39.357+0100 [mongosMain] connection accepted from 127.0.0.1:53223 #1426932 (401 connections now open) 2015-10-05T06:35:39.359+0100 [conn1426932] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:39.363+0100 [conn1426932] end connection 127.0.0.1:53223 (400 connections now open) 2015-10-05T06:35:39.976+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:35:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:35:40.968+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:40.968+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:41.759+0100 [conn1426503] end connection 172.28.0.163:52020 (399 connections now open) 2015-10-05T06:35:41.761+0100 [mongosMain] connection accepted from 172.28.0.163:53227 #1426933 (400 connections now open) 2015-10-05T06:35:41.762+0100 [conn1426933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:42.005+0100 [conn1426516] end connection 172.28.0.164:61410 (399 connections now open) 2015-10-05T06:35:42.007+0100 [mongosMain] connection accepted from 172.28.0.164:62546 #1426934 (400 connections now open) 2015-10-05T06:35:42.008+0100 [conn1426934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:42.305+0100 [conn1426540] end connection 172.28.0.163:52127 (399 connections now open) 2015-10-05T06:35:42.306+0100 [mongosMain] connection accepted from 172.28.0.163:53229 #1426935 (400 connections now open) 2015-10-05T06:35:42.307+0100 [conn1426935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:43.287+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:35:43.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:35:44.973+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:44.973+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:46.409+0100 [conn1426443] end connection 172.28.0.163:51856 (399 connections now open) 2015-10-05T06:35:46.410+0100 [conn1426533] end connection 172.28.0.163:52115 (398 connections now open) 2015-10-05T06:35:46.410+0100 [mongosMain] connection accepted from 172.28.0.163:53238 #1426936 (399 connections now open) 2015-10-05T06:35:46.411+0100 [mongosMain] connection accepted from 172.28.0.163:53239 #1426937 (400 connections now open) 2015-10-05T06:35:46.411+0100 [conn1426936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:46.412+0100 [conn1426937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:47.466+0100 [conn1426422] end connection 172.28.0.164:61162 (399 connections now open) 2015-10-05T06:35:47.467+0100 [conn1426535] end connection 172.28.0.164:61464 (398 connections now open) 2015-10-05T06:35:47.467+0100 [mongosMain] connection accepted from 172.28.0.164:62558 #1426938 (399 connections now open) 2015-10-05T06:35:47.468+0100 [mongosMain] connection accepted from 172.28.0.164:62559 #1426939 (400 connections now open) 2015-10-05T06:35:47.469+0100 [conn1426938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:47.469+0100 [conn1426939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:47.944+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:49.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c355703b51053ec3c23 2015-10-05T06:35:49.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:35:49.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:49.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:51.760+0100 [conn1426460] end connection 172.28.0.163:51905 (399 connections now open) 2015-10-05T06:35:51.761+0100 [mongosMain] connection accepted from 172.28.0.163:53248 #1426940 (400 connections now open) 2015-10-05T06:35:51.763+0100 [conn1426940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:52.008+0100 [conn1426539] end connection 172.28.0.164:61475 (399 connections now open) 2015-10-05T06:35:52.009+0100 [mongosMain] connection accepted from 172.28.0.164:62565 #1426941 (400 connections now open) 2015-10-05T06:35:52.012+0100 [conn1426941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:52.306+0100 [conn1426549] end connection 172.28.0.163:52142 (399 connections now open) 2015-10-05T06:35:52.307+0100 [mongosMain] connection accepted from 172.28.0.163:53250 #1426942 (400 connections now open) 2015-10-05T06:35:52.309+0100 [conn1426942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:52.552+0100 [conn1426550] end connection 172.28.0.164:61501 (399 connections now open) 2015-10-05T06:35:52.553+0100 [mongosMain] connection accepted from 172.28.0.164:62568 #1426943 (400 connections now open) 2015-10-05T06:35:52.555+0100 [conn1426943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:55.980+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:35:55.980+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:35:56.425+0100 [conn1426507] end connection 172.28.0.163:52027 (399 connections now open) 2015-10-05T06:35:56.426+0100 [mongosMain] connection accepted from 172.28.0.163:53260 #1426944 (400 connections now open) 2015-10-05T06:35:56.427+0100 [conn1426944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:57.467+0100 [conn1426545] end connection 172.28.0.164:61490 (399 connections now open) 2015-10-05T06:35:57.467+0100 [conn1426520] end connection 172.28.0.164:61420 (399 connections now open) 2015-10-05T06:35:57.468+0100 [mongosMain] connection accepted from 172.28.0.164:62575 #1426945 (399 connections now open) 2015-10-05T06:35:57.469+0100 [mongosMain] connection accepted from 172.28.0.164:62576 #1426946 (400 connections now open) 2015-10-05T06:35:57.470+0100 [conn1426945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:57.470+0100 [conn1426946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:35:58.987+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:01.774+0100 [conn1426538] end connection 172.28.0.163:52124 (399 connections now open) 2015-10-05T06:36:01.775+0100 [mongosMain] connection accepted from 172.28.0.163:53269 #1426947 (400 connections now open) 2015-10-05T06:36:01.777+0100 [conn1426947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:01.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c415703b51053ec3c7d 2015-10-05T06:36:02.022+0100 [conn1426475] end connection 172.28.0.164:61286 (399 connections now open) 2015-10-05T06:36:02.024+0100 [mongosMain] connection accepted from 172.28.0.164:62580 #1426948 (400 connections now open) 2015-10-05T06:36:02.025+0100 [conn1426948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:02.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:02.320+0100 [conn1426556] end connection 172.28.0.163:52157 (399 connections now open) 2015-10-05T06:36:02.322+0100 [mongosMain] connection accepted from 172.28.0.163:53272 #1426949 (400 connections now open) 2015-10-05T06:36:02.323+0100 [conn1426949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:02.567+0100 [conn1426541] end connection 172.28.0.164:61479 (399 connections now open) 2015-10-05T06:36:02.569+0100 [mongosMain] connection accepted from 172.28.0.164:62581 #1426950 (400 connections now open) 2015-10-05T06:36:02.572+0100 [conn1426950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:02.987+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:02.987+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:06.428+0100 [conn1426543] end connection 172.28.0.163:52132 (399 connections now open) 2015-10-05T06:36:06.429+0100 [mongosMain] connection accepted from 172.28.0.163:53281 #1426951 (400 connections now open) 2015-10-05T06:36:06.430+0100 [conn1426951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:07.483+0100 [conn1426544] end connection 172.28.0.164:61489 (399 connections now open) 2015-10-05T06:36:07.483+0100 [conn1426320] end connection 172.28.0.164:60880 (399 connections now open) 2015-10-05T06:36:07.484+0100 [mongosMain] connection accepted from 172.28.0.164:62586 #1426952 (399 connections now open) 2015-10-05T06:36:07.484+0100 [mongosMain] connection accepted from 172.28.0.164:62587 #1426953 (400 connections now open) 2015-10-05T06:36:07.486+0100 [conn1426952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:07.486+0100 [conn1426953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:09.998+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:10.258+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:36:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:36:11.000+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:11.000+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:11.790+0100 [conn1426510] end connection 172.28.0.163:52034 (399 connections now open) 2015-10-05T06:36:11.791+0100 [mongosMain] connection accepted from 172.28.0.163:53289 #1426954 (400 connections now open) 2015-10-05T06:36:11.792+0100 [conn1426954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:12.322+0100 [conn1426563] end connection 172.28.0.163:52182 (399 connections now open) 2015-10-05T06:36:12.323+0100 [mongosMain] connection accepted from 172.28.0.163:53291 #1426955 (400 connections now open) 2015-10-05T06:36:12.324+0100 [conn1426955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:12.567+0100 [conn1426557] end connection 172.28.0.164:61515 (399 connections now open) 2015-10-05T06:36:12.569+0100 [mongosMain] connection accepted from 172.28.0.164:62593 #1426956 (400 connections now open) 2015-10-05T06:36:12.571+0100 [conn1426956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:14.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c4e5703b51053ec3d19 2015-10-05T06:36:14.322+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:16.440+0100 [conn1426523] end connection 172.28.0.163:52081 (399 connections now open) 2015-10-05T06:36:16.441+0100 [mongosMain] connection accepted from 172.28.0.163:53297 #1426957 (400 connections now open) 2015-10-05T06:36:16.442+0100 [conn1426957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:16.460+0100 [conn1426542] end connection 172.28.0.163:52131 (399 connections now open) 2015-10-05T06:36:16.461+0100 [mongosMain] connection accepted from 172.28.0.163:53299 #1426958 (400 connections now open) 2015-10-05T06:36:16.462+0100 [conn1426958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:17.500+0100 [conn1426240] end connection 172.28.0.164:60650 (399 connections now open) 2015-10-05T06:36:17.501+0100 [mongosMain] connection accepted from 172.28.0.164:62600 #1426959 (400 connections now open) 2015-10-05T06:36:17.502+0100 [conn1426959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:20.007+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:20.008+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:20.500+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:36:20.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:36:21.005+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:21.791+0100 [conn1426529] end connection 172.28.0.163:52110 (399 connections now open) 2015-10-05T06:36:21.793+0100 [mongosMain] connection accepted from 172.28.0.163:53308 #1426960 (400 connections now open) 2015-10-05T06:36:21.794+0100 [conn1426960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:22.038+0100 [conn1426469] end connection 172.28.0.164:61267 (399 connections now open) 2015-10-05T06:36:22.040+0100 [mongosMain] connection accepted from 172.28.0.164:62609 #1426961 (400 connections now open) 2015-10-05T06:36:22.041+0100 [conn1426961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:22.336+0100 [conn1426569] end connection 172.28.0.163:52202 (399 connections now open) 2015-10-05T06:36:22.337+0100 [mongosMain] connection accepted from 172.28.0.163:53310 #1426962 (400 connections now open) 2015-10-05T06:36:22.338+0100 [conn1426962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:22.588+0100 [conn1426564] end connection 172.28.0.164:61531 (399 connections now open) 2015-10-05T06:36:22.589+0100 [mongosMain] connection accepted from 172.28.0.164:62611 #1426963 (400 connections now open) 2015-10-05T06:36:22.592+0100 [conn1426963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:26.444+0100 [conn1426552] end connection 172.28.0.163:52149 (399 connections now open) 2015-10-05T06:36:26.444+0100 [conn1426551] end connection 172.28.0.163:52148 (399 connections now open) 2015-10-05T06:36:26.445+0100 [mongosMain] connection accepted from 172.28.0.163:53313 #1426964 (399 connections now open) 2015-10-05T06:36:26.445+0100 [mongosMain] connection accepted from 172.28.0.163:53314 #1426965 (400 connections now open) 2015-10-05T06:36:26.446+0100 [conn1426964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:26.447+0100 [conn1426965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:26.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c5a5703b51053ec3daf 2015-10-05T06:36:26.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:27.499+0100 [conn1426446] end connection 172.28.0.164:61219 (399 connections now open) 2015-10-05T06:36:27.499+0100 [conn1426559] end connection 172.28.0.164:61524 (399 connections now open) 2015-10-05T06:36:27.500+0100 [mongosMain] connection accepted from 172.28.0.164:62622 #1426966 (399 connections now open) 2015-10-05T06:36:27.500+0100 [mongosMain] connection accepted from 172.28.0.164:62623 #1426967 (400 connections now open) 2015-10-05T06:36:27.501+0100 [conn1426966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:27.502+0100 [conn1426967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:28.540+0100 [mongosMain] connection accepted from 127.0.0.1:53316 #1426968 (401 connections now open) 2015-10-05T06:36:28.542+0100 [conn1426968] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:28.547+0100 [conn1426968] end connection 127.0.0.1:53316 (400 connections now open) 2015-10-05T06:36:30.020+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:30.021+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:31.806+0100 [conn1426567] end connection 172.28.0.163:52200 (399 connections now open) 2015-10-05T06:36:31.807+0100 [mongosMain] connection accepted from 172.28.0.163:53320 #1426969 (400 connections now open) 2015-10-05T06:36:31.809+0100 [conn1426969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:32.018+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:32.352+0100 [conn1426576] end connection 172.28.0.163:52221 (399 connections now open) 2015-10-05T06:36:32.353+0100 [mongosMain] connection accepted from 172.28.0.163:53322 #1426970 (400 connections now open) 2015-10-05T06:36:32.354+0100 [conn1426970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:32.583+0100 [conn1426570] end connection 172.28.0.164:61542 (399 connections now open) 2015-10-05T06:36:32.584+0100 [mongosMain] connection accepted from 172.28.0.164:62631 #1426971 (400 connections now open) 2015-10-05T06:36:32.586+0100 [conn1426971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:33.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c605703b51053ec3e0c 2015-10-05T06:36:33.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:36.455+0100 [conn1426558] end connection 172.28.0.163:52166 (399 connections now open) 2015-10-05T06:36:36.456+0100 [conn1426534] end connection 172.28.0.163:52116 (399 connections now open) 2015-10-05T06:36:36.457+0100 [mongosMain] connection accepted from 172.28.0.163:53324 #1426972 (399 connections now open) 2015-10-05T06:36:36.457+0100 [mongosMain] connection accepted from 172.28.0.163:53325 #1426973 (400 connections now open) 2015-10-05T06:36:36.458+0100 [conn1426972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:36.459+0100 [conn1426973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:37.514+0100 [conn1426581] end connection 172.28.0.164:61570 (399 connections now open) 2015-10-05T06:36:37.514+0100 [conn1426553] end connection 172.28.0.164:61508 (399 connections now open) 2015-10-05T06:36:37.515+0100 [mongosMain] connection accepted from 172.28.0.164:62639 #1426974 (399 connections now open) 2015-10-05T06:36:37.516+0100 [mongosMain] connection accepted from 172.28.0.164:62640 #1426975 (400 connections now open) 2015-10-05T06:36:37.517+0100 [conn1426975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:37.517+0100 [conn1426974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:39.206+0100 [mongosMain] connection accepted from 127.0.0.1:53327 #1426976 (401 connections now open) 2015-10-05T06:36:39.209+0100 [conn1426976] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:39.213+0100 [conn1426976] end connection 127.0.0.1:53327 (400 connections now open) 2015-10-05T06:36:39.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c675703b51053ec3e61 2015-10-05T06:36:39.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:40.403+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:36:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:36:41.065+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:41.065+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:42.352+0100 [conn1426585] end connection 172.28.0.163:52232 (399 connections now open) 2015-10-05T06:36:42.353+0100 [mongosMain] connection accepted from 172.28.0.163:53333 #1426977 (400 connections now open) 2015-10-05T06:36:42.354+0100 [conn1426977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:42.599+0100 [conn1426577] end connection 172.28.0.164:61559 (399 connections now open) 2015-10-05T06:36:42.600+0100 [mongosMain] connection accepted from 172.28.0.164:62652 #1426978 (400 connections now open) 2015-10-05T06:36:42.601+0100 [conn1426978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:43.024+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:45.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c6d5703b51053ec3eb6 2015-10-05T06:36:45.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:46.457+0100 [conn1426578] end connection 172.28.0.163:52225 (399 connections now open) 2015-10-05T06:36:46.457+0100 [conn1426571] end connection 172.28.0.163:52209 (399 connections now open) 2015-10-05T06:36:46.458+0100 [mongosMain] connection accepted from 172.28.0.163:53343 #1426979 (399 connections now open) 2015-10-05T06:36:46.458+0100 [mongosMain] connection accepted from 172.28.0.163:53344 #1426980 (400 connections now open) 2015-10-05T06:36:46.458+0100 [conn1426979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:46.459+0100 [conn1426980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:47.516+0100 [conn1426589] end connection 172.28.0.164:61586 (399 connections now open) 2015-10-05T06:36:47.517+0100 [conn1426333] end connection 172.28.0.164:60929 (398 connections now open) 2015-10-05T06:36:47.517+0100 [mongosMain] connection accepted from 172.28.0.164:62661 #1426981 (399 connections now open) 2015-10-05T06:36:47.518+0100 [mongosMain] connection accepted from 172.28.0.164:62662 #1426982 (400 connections now open) 2015-10-05T06:36:47.520+0100 [conn1426981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:47.520+0100 [conn1426982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:52.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c735703b51053ec3ee3 2015-10-05T06:36:52.053+0100 [conn1426548] end connection 172.28.0.164:61499 (399 connections now open) 2015-10-05T06:36:52.054+0100 [mongosMain] connection accepted from 172.28.0.164:62666 #1426983 (400 connections now open) 2015-10-05T06:36:52.057+0100 [conn1426983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:52.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:36:52.368+0100 [conn1426593] end connection 172.28.0.163:52246 (399 connections now open) 2015-10-05T06:36:52.369+0100 [mongosMain] connection accepted from 172.28.0.163:53353 #1426984 (400 connections now open) 2015-10-05T06:36:52.370+0100 [conn1426984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:52.600+0100 [conn1426586] end connection 172.28.0.164:61578 (399 connections now open) 2015-10-05T06:36:52.601+0100 [mongosMain] connection accepted from 172.28.0.164:62671 #1426985 (400 connections now open) 2015-10-05T06:36:52.602+0100 [conn1426985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:53.113+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:53.113+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:54.062+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:55.210+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:55.210+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:56.472+0100 [conn1426587] end connection 172.28.0.163:52235 (399 connections now open) 2015-10-05T06:36:56.473+0100 [conn1426457] end connection 172.28.0.163:51896 (398 connections now open) 2015-10-05T06:36:56.473+0100 [mongosMain] connection accepted from 172.28.0.163:53362 #1426986 (399 connections now open) 2015-10-05T06:36:56.474+0100 [mongosMain] connection accepted from 172.28.0.163:53363 #1426987 (400 connections now open) 2015-10-05T06:36:56.474+0100 [conn1426986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:56.475+0100 [conn1426987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:57.530+0100 [conn1426366] end connection 172.28.0.164:61027 (399 connections now open) 2015-10-05T06:36:57.531+0100 [mongosMain] connection accepted from 172.28.0.164:62678 #1426988 (400 connections now open) 2015-10-05T06:36:57.533+0100 [conn1426988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:36:58.213+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:36:58.213+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:36:58.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c7a5703b51053ec3f1e 2015-10-05T06:36:58.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:02.069+0100 [conn1426584] end connection 172.28.0.164:61575 (399 connections now open) 2015-10-05T06:37:02.070+0100 [mongosMain] connection accepted from 172.28.0.164:62683 #1426989 (400 connections now open) 2015-10-05T06:37:02.072+0100 [conn1426989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:02.215+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:02.215+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:02.374+0100 [conn1426600] end connection 172.28.0.163:52266 (399 connections now open) 2015-10-05T06:37:02.376+0100 [mongosMain] connection accepted from 172.28.0.163:53374 #1426990 (400 connections now open) 2015-10-05T06:37:02.377+0100 [conn1426990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:02.615+0100 [conn1426594] end connection 172.28.0.164:61601 (399 connections now open) 2015-10-05T06:37:02.616+0100 [mongosMain] connection accepted from 172.28.0.164:62685 #1426991 (400 connections now open) 2015-10-05T06:37:02.618+0100 [conn1426991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:04.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c805703b51053ec3f6b 2015-10-05T06:37:04.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:05.065+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:06.499+0100 [conn1426609] end connection 172.28.0.163:52299 (399 connections now open) 2015-10-05T06:37:06.499+0100 [conn1426572] end connection 172.28.0.163:52210 (398 connections now open) 2015-10-05T06:37:06.501+0100 [mongosMain] connection accepted from 172.28.0.163:53385 #1426992 (399 connections now open) 2015-10-05T06:37:06.502+0100 [mongosMain] connection accepted from 172.28.0.163:53386 #1426993 (400 connections now open) 2015-10-05T06:37:06.502+0100 [conn1426992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:06.503+0100 [conn1426993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:07.221+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:07.222+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:07.546+0100 [conn1426554] end connection 172.28.0.164:61507 (399 connections now open) 2015-10-05T06:37:07.547+0100 [conn1426536] end connection 172.28.0.164:61463 (398 connections now open) 2015-10-05T06:37:07.548+0100 [mongosMain] connection accepted from 172.28.0.164:62690 #1426994 (399 connections now open) 2015-10-05T06:37:07.548+0100 [mongosMain] connection accepted from 172.28.0.164:62691 #1426995 (400 connections now open) 2015-10-05T06:37:07.550+0100 [conn1426994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:07.550+0100 [conn1426995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:10.552+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:37:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:37:10.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c865703b51053ec3fc6 2015-10-05T06:37:10.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:12.085+0100 [conn1426562] end connection 172.28.0.164:61529 (399 connections now open) 2015-10-05T06:37:12.086+0100 [mongosMain] connection accepted from 172.28.0.164:62693 #1426996 (400 connections now open) 2015-10-05T06:37:12.088+0100 [conn1426996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:12.383+0100 [conn1426606] end connection 172.28.0.163:52288 (399 connections now open) 2015-10-05T06:37:12.384+0100 [mongosMain] connection accepted from 172.28.0.163:53395 #1426997 (400 connections now open) 2015-10-05T06:37:12.385+0100 [conn1426997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:12.633+0100 [conn1426601] end connection 172.28.0.164:61620 (399 connections now open) 2015-10-05T06:37:12.634+0100 [mongosMain] connection accepted from 172.28.0.164:62696 #1426998 (400 connections now open) 2015-10-05T06:37:12.635+0100 [conn1426998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:13.227+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:13.227+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:16.111+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:16.487+0100 [conn1426602] end connection 172.28.0.163:52274 (399 connections now open) 2015-10-05T06:37:16.487+0100 [conn1426495] end connection 172.28.0.163:52003 (399 connections now open) 2015-10-05T06:37:16.489+0100 [mongosMain] connection accepted from 172.28.0.163:53402 #1426999 (399 connections now open) 2015-10-05T06:37:16.489+0100 [mongosMain] connection accepted from 172.28.0.163:53403 #1427000 (400 connections now open) 2015-10-05T06:37:16.490+0100 [conn1426999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:16.490+0100 [conn1427000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:17.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c8d5703b51053ec4008 2015-10-05T06:37:17.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:17.562+0100 [conn1426598] end connection 172.28.0.164:61611 (399 connections now open) 2015-10-05T06:37:17.562+0100 [conn1426597] end connection 172.28.0.164:61610 (398 connections now open) 2015-10-05T06:37:17.563+0100 [mongosMain] connection accepted from 172.28.0.164:62702 #1427001 (399 connections now open) 2015-10-05T06:37:17.564+0100 [mongosMain] connection accepted from 172.28.0.164:62703 #1427002 (400 connections now open) 2015-10-05T06:37:17.565+0100 [conn1427001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:17.565+0100 [conn1427002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:20.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:20.230+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:22.101+0100 [conn1426530] end connection 172.28.0.164:61451 (399 connections now open) 2015-10-05T06:37:22.106+0100 [mongosMain] connection accepted from 172.28.0.164:62709 #1427003 (400 connections now open) 2015-10-05T06:37:22.108+0100 [conn1427003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:22.384+0100 [conn1426613] end connection 172.28.0.163:52313 (399 connections now open) 2015-10-05T06:37:22.385+0100 [mongosMain] connection accepted from 172.28.0.163:53410 #1427004 (400 connections now open) 2015-10-05T06:37:22.387+0100 [conn1427004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:22.646+0100 [conn1426607] end connection 172.28.0.164:61635 (399 connections now open) 2015-10-05T06:37:22.648+0100 [mongosMain] connection accepted from 172.28.0.164:62712 #1427005 (400 connections now open) 2015-10-05T06:37:22.650+0100 [conn1427005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:23.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c935703b51053ec4046 2015-10-05T06:37:23.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:26.503+0100 [conn1426608] end connection 172.28.0.163:52298 (399 connections now open) 2015-10-05T06:37:26.503+0100 [conn1426615] end connection 172.28.0.163:52318 (398 connections now open) 2015-10-05T06:37:26.505+0100 [mongosMain] connection accepted from 172.28.0.163:53413 #1427006 (399 connections now open) 2015-10-05T06:37:26.505+0100 [mongosMain] connection accepted from 172.28.0.163:53414 #1427007 (400 connections now open) 2015-10-05T06:37:26.506+0100 [conn1427006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:26.506+0100 [conn1427007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:27.133+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:27.577+0100 [conn1426604] end connection 172.28.0.164:61628 (399 connections now open) 2015-10-05T06:37:27.577+0100 [conn1426580] end connection 172.28.0.164:61569 (398 connections now open) 2015-10-05T06:37:27.578+0100 [mongosMain] connection accepted from 172.28.0.164:62723 #1427008 (399 connections now open) 2015-10-05T06:37:27.578+0100 [mongosMain] connection accepted from 172.28.0.164:62724 #1427009 (400 connections now open) 2015-10-05T06:37:27.580+0100 [conn1427008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:27.580+0100 [conn1427009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:28.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:28.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:29.171+0100 [mongosMain] connection accepted from 127.0.0.1:53417 #1427010 (401 connections now open) 2015-10-05T06:37:29.174+0100 [conn1427010] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:29.179+0100 [conn1427010] end connection 127.0.0.1:53417 (400 connections now open) 2015-10-05T06:37:29.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120c995703b51053ec4092 2015-10-05T06:37:30.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:32.101+0100 [conn1426568] end connection 172.28.0.164:61540 (399 connections now open) 2015-10-05T06:37:32.102+0100 [mongosMain] connection accepted from 172.28.0.164:62730 #1427011 (400 connections now open) 2015-10-05T06:37:32.103+0100 [conn1427011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:32.399+0100 [conn1426620] end connection 172.28.0.163:52329 (399 connections now open) 2015-10-05T06:37:32.400+0100 [mongosMain] connection accepted from 172.28.0.163:53420 #1427012 (400 connections now open) 2015-10-05T06:37:32.401+0100 [conn1427012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:32.646+0100 [conn1426614] end connection 172.28.0.164:61645 (399 connections now open) 2015-10-05T06:37:32.647+0100 [mongosMain] connection accepted from 172.28.0.164:62733 #1427013 (400 connections now open) 2015-10-05T06:37:32.649+0100 [conn1427013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:36.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ca05703b51053ec40d1 2015-10-05T06:37:36.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:36.505+0100 [conn1426596] end connection 172.28.0.163:52256 (399 connections now open) 2015-10-05T06:37:36.507+0100 [mongosMain] connection accepted from 172.28.0.163:53424 #1427014 (400 connections now open) 2015-10-05T06:37:36.507+0100 [conn1427014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:37.294+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:37.294+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:37.594+0100 [conn1426624] end connection 172.28.0.164:61670 (399 connections now open) 2015-10-05T06:37:37.594+0100 [conn1426611] end connection 172.28.0.164:61641 (399 connections now open) 2015-10-05T06:37:37.594+0100 [mongosMain] connection accepted from 172.28.0.164:62746 #1427015 (399 connections now open) 2015-10-05T06:37:37.595+0100 [mongosMain] connection accepted from 172.28.0.164:62747 #1427016 (400 connections now open) 2015-10-05T06:37:37.596+0100 [conn1427015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:37.596+0100 [conn1427016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:38.141+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:40.053+0100 [mongosMain] connection accepted from 127.0.0.1:53426 #1427017 (401 connections now open) 2015-10-05T06:37:40.055+0100 [conn1427017] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:40.060+0100 [conn1427017] end connection 127.0.0.1:53426 (400 connections now open) 2015-10-05T06:37:40.829+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:37:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:37:41.869+0100 [conn1426547] end connection 172.28.0.163:52139 (399 connections now open) 2015-10-05T06:37:41.870+0100 [mongosMain] connection accepted from 172.28.0.163:53429 #1427018 (400 connections now open) 2015-10-05T06:37:41.871+0100 [conn1427018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:42.102+0100 [conn1426575] end connection 172.28.0.164:61555 (399 connections now open) 2015-10-05T06:37:42.103+0100 [mongosMain] connection accepted from 172.28.0.164:62754 #1427019 (400 connections now open) 2015-10-05T06:37:42.105+0100 [conn1427019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:42.415+0100 [conn1426628] end connection 172.28.0.163:52339 (399 connections now open) 2015-10-05T06:37:42.416+0100 [mongosMain] connection accepted from 172.28.0.163:53431 #1427020 (400 connections now open) 2015-10-05T06:37:42.417+0100 [conn1427020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:42.646+0100 [conn1426621] end connection 172.28.0.164:61661 (399 connections now open) 2015-10-05T06:37:42.648+0100 [mongosMain] connection accepted from 172.28.0.164:62756 #1427021 (400 connections now open) 2015-10-05T06:37:42.650+0100 [conn1427021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:42.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ca65703b51053ec4118 2015-10-05T06:37:42.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:46.518+0100 [conn1426616] end connection 172.28.0.163:52319 (399 connections now open) 2015-10-05T06:37:46.519+0100 [mongosMain] connection accepted from 172.28.0.163:53439 #1427022 (400 connections now open) 2015-10-05T06:37:46.520+0100 [conn1427022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:47.300+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:47.300+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:37:47.608+0100 [conn1426566] end connection 172.28.0.164:61536 (399 connections now open) 2015-10-05T06:37:47.608+0100 [conn1426610] end connection 172.28.0.164:61640 (398 connections now open) 2015-10-05T06:37:47.609+0100 [mongosMain] connection accepted from 172.28.0.164:62764 #1427023 (399 connections now open) 2015-10-05T06:37:47.610+0100 [mongosMain] connection accepted from 172.28.0.164:62765 #1427024 (400 connections now open) 2015-10-05T06:37:47.611+0100 [conn1427023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:47.612+0100 [conn1427024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:48.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cac5703b51053ec4163 2015-10-05T06:37:49.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:49.151+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:52.116+0100 [conn1426599] end connection 172.28.0.164:61617 (399 connections now open) 2015-10-05T06:37:52.117+0100 [mongosMain] connection accepted from 172.28.0.164:62774 #1427025 (400 connections now open) 2015-10-05T06:37:52.119+0100 [conn1427025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:52.418+0100 [conn1426636] end connection 172.28.0.163:52351 (399 connections now open) 2015-10-05T06:37:52.420+0100 [mongosMain] connection accepted from 172.28.0.163:53448 #1427026 (400 connections now open) 2015-10-05T06:37:52.421+0100 [conn1427026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:52.662+0100 [conn1426629] end connection 172.28.0.164:61682 (399 connections now open) 2015-10-05T06:37:52.663+0100 [mongosMain] connection accepted from 172.28.0.164:62776 #1427027 (400 connections now open) 2015-10-05T06:37:52.664+0100 [conn1427027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:55.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cb35703b51053ec41a1 2015-10-05T06:37:55.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:37:56.519+0100 [conn1426631] end connection 172.28.0.163:52342 (399 connections now open) 2015-10-05T06:37:56.520+0100 [conn1426623] end connection 172.28.0.163:52333 (398 connections now open) 2015-10-05T06:37:56.529+0100 [mongosMain] connection accepted from 172.28.0.163:53455 #1427028 (399 connections now open) 2015-10-05T06:37:56.529+0100 [mongosMain] connection accepted from 172.28.0.163:53456 #1427029 (400 connections now open) 2015-10-05T06:37:56.530+0100 [conn1427028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:56.530+0100 [conn1427029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:57.625+0100 [conn1426617] end connection 172.28.0.164:61651 (399 connections now open) 2015-10-05T06:37:57.625+0100 [conn1426560] end connection 172.28.0.164:61525 (398 connections now open) 2015-10-05T06:37:57.626+0100 [mongosMain] connection accepted from 172.28.0.164:62782 #1427030 (399 connections now open) 2015-10-05T06:37:57.627+0100 [mongosMain] connection accepted from 172.28.0.164:62783 #1427031 (400 connections now open) 2015-10-05T06:37:57.628+0100 [conn1427030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:57.629+0100 [conn1427031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:37:58.304+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:37:58.305+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:00.155+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:01.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cb95703b51053ec41e9 2015-10-05T06:38:01.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:02.116+0100 [conn1426619] end connection 172.28.0.164:61657 (399 connections now open) 2015-10-05T06:38:02.117+0100 [mongosMain] connection accepted from 172.28.0.164:62788 #1427032 (400 connections now open) 2015-10-05T06:38:02.118+0100 [conn1427032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:02.431+0100 [conn1426643] end connection 172.28.0.163:52368 (399 connections now open) 2015-10-05T06:38:02.432+0100 [mongosMain] connection accepted from 172.28.0.163:53472 #1427033 (400 connections now open) 2015-10-05T06:38:02.433+0100 [conn1427033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:02.663+0100 [conn1426637] end connection 172.28.0.164:61705 (399 connections now open) 2015-10-05T06:38:02.664+0100 [mongosMain] connection accepted from 172.28.0.164:62790 #1427034 (400 connections now open) 2015-10-05T06:38:02.666+0100 [conn1427034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:06.535+0100 [conn1426638] end connection 172.28.0.163:52358 (399 connections now open) 2015-10-05T06:38:06.535+0100 [conn1426630] end connection 172.28.0.163:52341 (398 connections now open) 2015-10-05T06:38:06.536+0100 [mongosMain] connection accepted from 172.28.0.163:53480 #1427035 (399 connections now open) 2015-10-05T06:38:06.536+0100 [mongosMain] connection accepted from 172.28.0.163:53479 #1427036 (400 connections now open) 2015-10-05T06:38:06.537+0100 [conn1427035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:06.537+0100 [conn1427036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:07.624+0100 [conn1426618] end connection 172.28.0.164:61652 (399 connections now open) 2015-10-05T06:38:07.626+0100 [mongosMain] connection accepted from 172.28.0.164:62795 #1427037 (400 connections now open) 2015-10-05T06:38:07.628+0100 [conn1427037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:07.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cbf5703b51053ec4244 2015-10-05T06:38:07.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:10.311+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:10.311+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:11.057+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:38:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:38:11.159+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:12.132+0100 [conn1426612] end connection 172.28.0.164:61643 (399 connections now open) 2015-10-05T06:38:12.133+0100 [mongosMain] connection accepted from 172.28.0.164:62797 #1427038 (400 connections now open) 2015-10-05T06:38:12.135+0100 [conn1427038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:12.335+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:12.335+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:12.432+0100 [conn1426649] end connection 172.28.0.163:52396 (399 connections now open) 2015-10-05T06:38:12.432+0100 [mongosMain] connection accepted from 172.28.0.163:53489 #1427039 (400 connections now open) 2015-10-05T06:38:12.433+0100 [conn1427039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:12.679+0100 [conn1426644] end connection 172.28.0.164:61725 (399 connections now open) 2015-10-05T06:38:12.680+0100 [mongosMain] connection accepted from 172.28.0.164:62799 #1427040 (400 connections now open) 2015-10-05T06:38:12.683+0100 [conn1427040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:14.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cc55703b51053ec4285 2015-10-05T06:38:14.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:15.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:15.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:16.550+0100 [conn1426645] end connection 172.28.0.163:52380 (399 connections now open) 2015-10-05T06:38:16.550+0100 [conn1426622] end connection 172.28.0.163:52332 (399 connections now open) 2015-10-05T06:38:16.551+0100 [mongosMain] connection accepted from 172.28.0.163:53500 #1427041 (399 connections now open) 2015-10-05T06:38:16.552+0100 [mongosMain] connection accepted from 172.28.0.163:53501 #1427042 (400 connections now open) 2015-10-05T06:38:16.553+0100 [conn1427041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:16.553+0100 [conn1427042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:17.641+0100 [conn1426653] end connection 172.28.0.164:61745 (399 connections now open) 2015-10-05T06:38:17.641+0100 [mongosMain] connection accepted from 172.28.0.164:62807 #1427043 (400 connections now open) 2015-10-05T06:38:17.643+0100 [conn1427043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:19.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:19.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:20.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ccc5703b51053ec42c4 2015-10-05T06:38:20.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:22.149+0100 [conn1426605] end connection 172.28.0.164:61633 (399 connections now open) 2015-10-05T06:38:22.150+0100 [mongosMain] connection accepted from 172.28.0.164:62819 #1427044 (400 connections now open) 2015-10-05T06:38:22.152+0100 [conn1427044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:22.241+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:22.446+0100 [conn1426656] end connection 172.28.0.163:52449 (399 connections now open) 2015-10-05T06:38:22.447+0100 [mongosMain] connection accepted from 172.28.0.163:53508 #1427045 (400 connections now open) 2015-10-05T06:38:22.448+0100 [conn1427045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:22.694+0100 [conn1426650] end connection 172.28.0.164:61739 (399 connections now open) 2015-10-05T06:38:22.695+0100 [mongosMain] connection accepted from 172.28.0.164:62822 #1427046 (400 connections now open) 2015-10-05T06:38:22.697+0100 [conn1427046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:24.364+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:24.365+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:26.553+0100 [conn1426588] end connection 172.28.0.163:52236 (399 connections now open) 2015-10-05T06:38:26.553+0100 [conn1426639] end connection 172.28.0.163:52359 (399 connections now open) 2015-10-05T06:38:26.554+0100 [mongosMain] connection accepted from 172.28.0.163:53512 #1427047 (399 connections now open) 2015-10-05T06:38:26.555+0100 [mongosMain] connection accepted from 172.28.0.163:53513 #1427048 (400 connections now open) 2015-10-05T06:38:26.555+0100 [conn1427047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:26.556+0100 [conn1427048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:26.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cd25703b51053ec430c 2015-10-05T06:38:26.891+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:27.656+0100 [conn1426640] end connection 172.28.0.164:61714 (399 connections now open) 2015-10-05T06:38:27.657+0100 [mongosMain] connection accepted from 172.28.0.164:62834 #1427049 (400 connections now open) 2015-10-05T06:38:27.659+0100 [conn1427049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:28.839+0100 [mongosMain] connection accepted from 127.0.0.1:53515 #1427050 (401 connections now open) 2015-10-05T06:38:28.842+0100 [conn1427050] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:28.848+0100 [conn1427050] end connection 127.0.0.1:53515 (400 connections now open) 2015-10-05T06:38:30.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:30.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:31.901+0100 [conn1426574] end connection 172.28.0.163:52219 (399 connections now open) 2015-10-05T06:38:31.902+0100 [mongosMain] connection accepted from 172.28.0.163:53521 #1427051 (400 connections now open) 2015-10-05T06:38:31.903+0100 [conn1427051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:32.148+0100 [conn1426627] end connection 172.28.0.164:61679 (399 connections now open) 2015-10-05T06:38:32.149+0100 [mongosMain] connection accepted from 172.28.0.164:62839 #1427052 (400 connections now open) 2015-10-05T06:38:32.151+0100 [conn1427052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:32.448+0100 [conn1426663] end connection 172.28.0.163:52466 (399 connections now open) 2015-10-05T06:38:32.449+0100 [mongosMain] connection accepted from 172.28.0.163:53524 #1427053 (400 connections now open) 2015-10-05T06:38:32.450+0100 [conn1427053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:32.694+0100 [conn1426657] end connection 172.28.0.164:61751 (399 connections now open) 2015-10-05T06:38:32.695+0100 [mongosMain] connection accepted from 172.28.0.164:62843 #1427054 (400 connections now open) 2015-10-05T06:38:32.697+0100 [conn1427054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:33.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cd85703b51053ec4359 2015-10-05T06:38:33.252+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:33.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:36.566+0100 [conn1426666] end connection 172.28.0.163:52469 (399 connections now open) 2015-10-05T06:38:36.567+0100 [mongosMain] connection accepted from 172.28.0.163:53527 #1427055 (400 connections now open) 2015-10-05T06:38:36.568+0100 [conn1427055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:37.376+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:37.377+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:37.692+0100 [conn1426646] end connection 172.28.0.164:61733 (399 connections now open) 2015-10-05T06:38:37.692+0100 [mongosMain] connection accepted from 172.28.0.164:62851 #1427056 (400 connections now open) 2015-10-05T06:38:37.692+0100 [conn1427056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:39.330+0100 [mongosMain] connection accepted from 127.0.0.1:53531 #1427057 (401 connections now open) 2015-10-05T06:38:39.330+0100 [conn1427057] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:39.330+0100 [conn1427057] end connection 127.0.0.1:53531 (400 connections now open) 2015-10-05T06:38:39.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cdf5703b51053ec439c 2015-10-05T06:38:39.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:41.390+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:38:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:38:41.917+0100 [conn1426648] end connection 172.28.0.163:52392 (399 connections now open) 2015-10-05T06:38:41.919+0100 [mongosMain] connection accepted from 172.28.0.163:53535 #1427058 (400 connections now open) 2015-10-05T06:38:41.919+0100 [conn1427058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:42.167+0100 [conn1426642] end connection 172.28.0.164:61723 (399 connections now open) 2015-10-05T06:38:42.168+0100 [mongosMain] connection accepted from 172.28.0.164:62864 #1427059 (400 connections now open) 2015-10-05T06:38:42.170+0100 [conn1427059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:42.463+0100 [conn1426671] end connection 172.28.0.163:52485 (399 connections now open) 2015-10-05T06:38:42.464+0100 [mongosMain] connection accepted from 172.28.0.163:53537 #1427060 (400 connections now open) 2015-10-05T06:38:42.465+0100 [conn1427060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:42.711+0100 [conn1426664] end connection 172.28.0.164:61768 (399 connections now open) 2015-10-05T06:38:42.712+0100 [mongosMain] connection accepted from 172.28.0.164:62866 #1427061 (400 connections now open) 2015-10-05T06:38:42.713+0100 [conn1427061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:44.267+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:45.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:45.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:45.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ce55703b51053ec43f3 2015-10-05T06:38:45.799+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:46.566+0100 [conn1426651] end connection 172.28.0.163:52436 (399 connections now open) 2015-10-05T06:38:46.566+0100 [conn1426565] end connection 172.28.0.163:52190 (398 connections now open) 2015-10-05T06:38:46.567+0100 [mongosMain] connection accepted from 172.28.0.163:53546 #1427062 (399 connections now open) 2015-10-05T06:38:46.568+0100 [mongosMain] connection accepted from 172.28.0.163:53547 #1427063 (400 connections now open) 2015-10-05T06:38:46.569+0100 [conn1427062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:46.569+0100 [conn1427063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:47.686+0100 [conn1426660] end connection 172.28.0.164:61758 (399 connections now open) 2015-10-05T06:38:47.687+0100 [mongosMain] connection accepted from 172.28.0.164:62878 #1427064 (400 connections now open) 2015-10-05T06:38:47.689+0100 [conn1427064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:51.918+0100 [conn1426661] end connection 172.28.0.163:52465 (399 connections now open) 2015-10-05T06:38:51.920+0100 [mongosMain] connection accepted from 172.28.0.163:53554 #1427065 (400 connections now open) 2015-10-05T06:38:51.921+0100 [conn1427065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:52.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ceb5703b51053ec4438 2015-10-05T06:38:52.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:38:54.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:54.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:38:55.275+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:38:56.581+0100 [conn1426674] end connection 172.28.0.163:52488 (399 connections now open) 2015-10-05T06:38:56.582+0100 [mongosMain] connection accepted from 172.28.0.163:53567 #1427066 (400 connections now open) 2015-10-05T06:38:56.583+0100 [conn1427066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:57.343+0100 [conn1426595] end connection 172.28.0.163:52254 (399 connections now open) 2015-10-05T06:38:57.344+0100 [mongosMain] connection accepted from 172.28.0.163:53572 #1427067 (400 connections now open) 2015-10-05T06:38:57.345+0100 [conn1427067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:57.703+0100 [conn1426632] end connection 172.28.0.164:61693 (399 connections now open) 2015-10-05T06:38:57.703+0100 [mongosMain] connection accepted from 172.28.0.164:62896 #1427068 (400 connections now open) 2015-10-05T06:38:57.705+0100 [conn1427068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:38:58.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cf25703b51053ec4464 2015-10-05T06:38:58.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:01.933+0100 [conn1426654] end connection 172.28.0.163:52446 (399 connections now open) 2015-10-05T06:39:01.934+0100 [mongosMain] connection accepted from 172.28.0.163:53579 #1427069 (400 connections now open) 2015-10-05T06:39:01.935+0100 [conn1427069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:04.392+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:04.392+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:04.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cf85703b51053ec4489 2015-10-05T06:39:04.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:06.286+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:06.593+0100 [conn1426673] end connection 172.28.0.163:52487 (399 connections now open) 2015-10-05T06:39:06.593+0100 [conn1426658] end connection 172.28.0.163:52457 (399 connections now open) 2015-10-05T06:39:06.595+0100 [mongosMain] connection accepted from 172.28.0.163:53586 #1427070 (399 connections now open) 2015-10-05T06:39:06.595+0100 [mongosMain] connection accepted from 172.28.0.163:53587 #1427071 (400 connections now open) 2015-10-05T06:39:06.596+0100 [conn1427070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:06.597+0100 [conn1427071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:07.720+0100 [conn1426668] end connection 172.28.0.164:61783 (399 connections now open) 2015-10-05T06:39:07.721+0100 [mongosMain] connection accepted from 172.28.0.164:62905 #1427072 (400 connections now open) 2015-10-05T06:39:07.723+0100 [conn1427072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:10.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120cfe5703b51053ec44af 2015-10-05T06:39:11.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:11.605+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:39:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:39:11.948+0100 [conn1426555] end connection 172.28.0.163:52155 (399 connections now open) 2015-10-05T06:39:11.949+0100 [mongosMain] connection accepted from 172.28.0.163:53595 #1427073 (400 connections now open) 2015-10-05T06:39:11.950+0100 [conn1427073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:15.395+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:15.395+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:16.597+0100 [conn1426686] end connection 172.28.0.163:52524 (399 connections now open) 2015-10-05T06:39:16.597+0100 [conn1426685] end connection 172.28.0.163:52523 (399 connections now open) 2015-10-05T06:39:16.598+0100 [mongosMain] connection accepted from 172.28.0.163:53605 #1427074 (399 connections now open) 2015-10-05T06:39:16.598+0100 [mongosMain] connection accepted from 172.28.0.163:53606 #1427075 (400 connections now open) 2015-10-05T06:39:16.599+0100 [conn1427074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:16.599+0100 [conn1427075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:17.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d055703b51053ec44d4 2015-10-05T06:39:17.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:17.296+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:17.734+0100 [conn1426675] end connection 172.28.0.164:61801 (399 connections now open) 2015-10-05T06:39:17.735+0100 [mongosMain] connection accepted from 172.28.0.164:62911 #1427076 (400 connections now open) 2015-10-05T06:39:17.738+0100 [conn1427076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:21.949+0100 [conn1426670] end connection 172.28.0.163:52483 (399 connections now open) 2015-10-05T06:39:21.950+0100 [mongosMain] connection accepted from 172.28.0.163:53610 #1427077 (400 connections now open) 2015-10-05T06:39:21.951+0100 [conn1427077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:22.196+0100 [conn1426655] end connection 172.28.0.164:61749 (399 connections now open) 2015-10-05T06:39:22.197+0100 [mongosMain] connection accepted from 172.28.0.164:62920 #1427078 (400 connections now open) 2015-10-05T06:39:22.198+0100 [conn1427078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:23.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d0b5703b51053ec44fc 2015-10-05T06:39:23.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:26.601+0100 [conn1426680] end connection 172.28.0.163:52503 (399 connections now open) 2015-10-05T06:39:26.601+0100 [conn1426690] end connection 172.28.0.163:52542 (398 connections now open) 2015-10-05T06:39:26.602+0100 [mongosMain] connection accepted from 172.28.0.163:53615 #1427079 (399 connections now open) 2015-10-05T06:39:26.602+0100 [mongosMain] connection accepted from 172.28.0.163:53614 #1427080 (400 connections now open) 2015-10-05T06:39:26.603+0100 [conn1427079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:26.603+0100 [conn1427080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:27.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:27.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:27.749+0100 [conn1426414] end connection 172.28.0.164:61142 (399 connections now open) 2015-10-05T06:39:27.750+0100 [conn1426688] end connection 172.28.0.164:61865 (399 connections now open) 2015-10-05T06:39:27.750+0100 [mongosMain] connection accepted from 172.28.0.164:62927 #1427081 (399 connections now open) 2015-10-05T06:39:27.751+0100 [mongosMain] connection accepted from 172.28.0.164:62928 #1427082 (400 connections now open) 2015-10-05T06:39:27.752+0100 [conn1427081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:27.753+0100 [conn1427082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:28.309+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:28.404+0100 [mongosMain] connection accepted from 127.0.0.1:53620 #1427083 (401 connections now open) 2015-10-05T06:39:28.406+0100 [conn1427083] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:28.412+0100 [conn1427083] end connection 127.0.0.1:53620 (400 connections now open) 2015-10-05T06:39:29.401+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:29.402+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:29.799+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d115703b51053ec4522 2015-10-05T06:39:29.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:32.021+0100 [conn1426694] end connection 172.28.0.163:52552 (399 connections now open) 2015-10-05T06:39:32.023+0100 [mongosMain] connection accepted from 172.28.0.163:53623 #1427084 (400 connections now open) 2015-10-05T06:39:32.027+0100 [conn1427084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:32.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:32.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:36.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d175703b51053ec4539 2015-10-05T06:39:36.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:36.418+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:36.418+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:37.766+0100 [conn1426603] end connection 172.28.0.164:61626 (399 connections now open) 2015-10-05T06:39:37.767+0100 [conn1426683] end connection 172.28.0.164:61834 (398 connections now open) 2015-10-05T06:39:37.768+0100 [mongosMain] connection accepted from 172.28.0.164:62948 #1427085 (399 connections now open) 2015-10-05T06:39:37.768+0100 [mongosMain] connection accepted from 172.28.0.164:62949 #1427086 (400 connections now open) 2015-10-05T06:39:37.770+0100 [conn1427085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:37.771+0100 [conn1427086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:39.313+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:39.829+0100 [mongosMain] connection accepted from 127.0.0.1:53631 #1427087 (401 connections now open) 2015-10-05T06:39:39.846+0100 [conn1427087] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:39.851+0100 [conn1427087] end connection 127.0.0.1:53631 (400 connections now open) 2015-10-05T06:39:41.416+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:41.416+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:41.882+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:39:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:39:41.965+0100 [conn1426561] end connection 172.28.0.163:52179 (399 connections now open) 2015-10-05T06:39:41.966+0100 [mongosMain] connection accepted from 172.28.0.163:53636 #1427088 (400 connections now open) 2015-10-05T06:39:41.967+0100 [conn1427088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:42.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d1e5703b51053ec454d 2015-10-05T06:39:42.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:47.413+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:47.414+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:47.766+0100 [conn1426641] end connection 172.28.0.164:61715 (399 connections now open) 2015-10-05T06:39:47.768+0100 [mongosMain] connection accepted from 172.28.0.164:62967 #1427089 (400 connections now open) 2015-10-05T06:39:47.769+0100 [conn1427089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:49.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d245703b51053ec4567 2015-10-05T06:39:49.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:39:50.321+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:51.980+0100 [conn1426689] end connection 172.28.0.163:52535 (399 connections now open) 2015-10-05T06:39:51.981+0100 [mongosMain] connection accepted from 172.28.0.163:53652 #1427090 (400 connections now open) 2015-10-05T06:39:51.983+0100 [conn1427090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:52.229+0100 [conn1426662] end connection 172.28.0.164:61766 (399 connections now open) 2015-10-05T06:39:52.231+0100 [mongosMain] connection accepted from 172.28.0.164:62973 #1427091 (400 connections now open) 2015-10-05T06:39:52.233+0100 [conn1427091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:39:54.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:39:54.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:39:57.782+0100 [conn1426573] end connection 172.28.0.164:61549 (399 connections now open) 2015-10-05T06:39:57.783+0100 [mongosMain] connection accepted from 172.28.0.164:62979 #1427092 (400 connections now open) 2015-10-05T06:39:57.784+0100 [conn1427092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:01.333+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:01.984+0100 [conn1426684] end connection 172.28.0.163:52516 (399 connections now open) 2015-10-05T06:40:01.986+0100 [mongosMain] connection accepted from 172.28.0.163:53672 #1427093 (400 connections now open) 2015-10-05T06:40:01.987+0100 [conn1427093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:02.542+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:02.542+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:06.657+0100 [conn1426699] end connection 172.28.0.163:52572 (399 connections now open) 2015-10-05T06:40:06.659+0100 [mongosMain] connection accepted from 172.28.0.163:53678 #1427094 (400 connections now open) 2015-10-05T06:40:06.661+0100 [conn1427094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:07.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d375703b51053ec4611 2015-10-05T06:40:07.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:07.797+0100 [conn1426667] end connection 172.28.0.164:61782 (399 connections now open) 2015-10-05T06:40:07.798+0100 [mongosMain] connection accepted from 172.28.0.164:62984 #1427095 (400 connections now open) 2015-10-05T06:40:07.800+0100 [conn1427095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:11.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:11.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:11.996+0100 [conn1426583] end connection 172.28.0.163:52231 (399 connections now open) 2015-10-05T06:40:11.997+0100 [mongosMain] connection accepted from 172.28.0.163:53687 #1427096 (400 connections now open) 2015-10-05T06:40:11.998+0100 [conn1427096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:12.163+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:40:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:40:12.341+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:12.542+0100 [conn1426679] end connection 172.28.0.163:52498 (399 connections now open) 2015-10-05T06:40:12.543+0100 [mongosMain] connection accepted from 172.28.0.163:53688 #1427097 (400 connections now open) 2015-10-05T06:40:12.544+0100 [conn1427097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:16.644+0100 [conn1426696] end connection 172.28.0.163:52557 (399 connections now open) 2015-10-05T06:40:16.645+0100 [mongosMain] connection accepted from 172.28.0.163:53696 #1427098 (400 connections now open) 2015-10-05T06:40:16.646+0100 [conn1427098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:17.813+0100 [conn1426682] end connection 172.28.0.164:61835 (399 connections now open) 2015-10-05T06:40:17.814+0100 [mongosMain] connection accepted from 172.28.0.164:62990 #1427099 (400 connections now open) 2015-10-05T06:40:17.815+0100 [conn1427099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:19.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d435703b51053ec467f 2015-10-05T06:40:19.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:21.548+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:21.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:21.996+0100 [conn1426704] end connection 172.28.0.163:52580 (399 connections now open) 2015-10-05T06:40:21.997+0100 [mongosMain] connection accepted from 172.28.0.163:53701 #1427100 (400 connections now open) 2015-10-05T06:40:21.998+0100 [conn1427100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:23.364+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:26.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d495703b51053ec46be 2015-10-05T06:40:26.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:27.827+0100 [conn1426701] end connection 172.28.0.164:61910 (399 connections now open) 2015-10-05T06:40:27.828+0100 [conn1426647] end connection 172.28.0.164:61734 (398 connections now open) 2015-10-05T06:40:27.829+0100 [mongosMain] connection accepted from 172.28.0.164:63013 #1427101 (399 connections now open) 2015-10-05T06:40:27.829+0100 [mongosMain] connection accepted from 172.28.0.164:63014 #1427102 (400 connections now open) 2015-10-05T06:40:27.830+0100 [conn1427101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:27.831+0100 [conn1427102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:28.883+0100 [mongosMain] connection accepted from 127.0.0.1:53705 #1427103 (401 connections now open) 2015-10-05T06:40:28.885+0100 [conn1427103] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:28.890+0100 [conn1427103] end connection 127.0.0.1:53705 (400 connections now open) 2015-10-05T06:40:32.011+0100 [conn1426678] end connection 172.28.0.163:52496 (399 connections now open) 2015-10-05T06:40:32.012+0100 [mongosMain] connection accepted from 172.28.0.163:53710 #1427104 (400 connections now open) 2015-10-05T06:40:32.013+0100 [conn1427104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:32.258+0100 [conn1426710] end connection 172.28.0.164:61941 (399 connections now open) 2015-10-05T06:40:32.260+0100 [mongosMain] connection accepted from 172.28.0.164:63019 #1427105 (400 connections now open) 2015-10-05T06:40:32.261+0100 [conn1427105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:32.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d505703b51053ec46e4 2015-10-05T06:40:32.552+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:32.553+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:32.557+0100 [conn1426718] end connection 172.28.0.163:52646 (399 connections now open) 2015-10-05T06:40:32.558+0100 [mongosMain] connection accepted from 172.28.0.163:53712 #1427106 (400 connections now open) 2015-10-05T06:40:32.559+0100 [conn1427106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:32.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:32.805+0100 [conn1426672] end connection 172.28.0.164:61793 (399 connections now open) 2015-10-05T06:40:32.807+0100 [mongosMain] connection accepted from 172.28.0.164:63021 #1427107 (400 connections now open) 2015-10-05T06:40:32.808+0100 [conn1427107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:34.365+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:36.663+0100 [conn1426706] end connection 172.28.0.163:52583 (399 connections now open) 2015-10-05T06:40:36.664+0100 [mongosMain] connection accepted from 172.28.0.163:53718 #1427108 (400 connections now open) 2015-10-05T06:40:36.665+0100 [conn1427108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:37.843+0100 [conn1426590] end connection 172.28.0.164:61587 (399 connections now open) 2015-10-05T06:40:37.844+0100 [mongosMain] connection accepted from 172.28.0.164:63032 #1427109 (400 connections now open) 2015-10-05T06:40:37.845+0100 [conn1426721] end connection 172.28.0.164:62001 (399 connections now open) 2015-10-05T06:40:37.846+0100 [mongosMain] connection accepted from 172.28.0.164:63033 #1427110 (400 connections now open) 2015-10-05T06:40:37.847+0100 [conn1427109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:37.848+0100 [conn1427110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:38.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d565703b51053ec4722 2015-10-05T06:40:38.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:39.935+0100 [mongosMain] connection accepted from 127.0.0.1:53720 #1427111 (401 connections now open) 2015-10-05T06:40:39.938+0100 [conn1427111] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:39.942+0100 [conn1427111] end connection 127.0.0.1:53720 (400 connections now open) 2015-10-05T06:40:42.026+0100 [conn1426698] end connection 172.28.0.163:52563 (399 connections now open) 2015-10-05T06:40:42.027+0100 [mongosMain] connection accepted from 172.28.0.163:53723 #1427112 (400 connections now open) 2015-10-05T06:40:42.028+0100 [conn1427112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:42.325+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:40:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:40:42.573+0100 [conn1426726] end connection 172.28.0.163:52671 (399 connections now open) 2015-10-05T06:40:42.574+0100 [mongosMain] connection accepted from 172.28.0.163:53726 #1427113 (400 connections now open) 2015-10-05T06:40:42.575+0100 [conn1427113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:42.820+0100 [conn1426727] end connection 172.28.0.164:62015 (399 connections now open) 2015-10-05T06:40:42.821+0100 [mongosMain] connection accepted from 172.28.0.164:63043 #1427114 (400 connections now open) 2015-10-05T06:40:42.823+0100 [conn1427114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:44.575+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:44.575+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:45.373+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:46.583+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:46.583+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:46.677+0100 [conn1426681] end connection 172.28.0.163:52504 (399 connections now open) 2015-10-05T06:40:46.677+0100 [conn1426719] end connection 172.28.0.163:52652 (399 connections now open) 2015-10-05T06:40:46.678+0100 [mongosMain] connection accepted from 172.28.0.163:53735 #1427115 (399 connections now open) 2015-10-05T06:40:46.678+0100 [mongosMain] connection accepted from 172.28.0.163:53736 #1427116 (400 connections now open) 2015-10-05T06:40:46.679+0100 [conn1427115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:46.679+0100 [conn1427116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:47.860+0100 [conn1426652] end connection 172.28.0.164:61746 (399 connections now open) 2015-10-05T06:40:47.861+0100 [conn1426693] end connection 172.28.0.164:61874 (398 connections now open) 2015-10-05T06:40:47.861+0100 [mongosMain] connection accepted from 172.28.0.164:63050 #1427117 (399 connections now open) 2015-10-05T06:40:47.862+0100 [mongosMain] connection accepted from 172.28.0.164:63051 #1427118 (400 connections now open) 2015-10-05T06:40:47.863+0100 [conn1427117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:47.864+0100 [conn1427118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:49.589+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:49.589+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:51.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d625703b51053ec4786 2015-10-05T06:40:51.302+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:52.034+0100 [conn1426717] end connection 172.28.0.163:52644 (399 connections now open) 2015-10-05T06:40:52.036+0100 [mongosMain] connection accepted from 172.28.0.163:53744 #1427119 (400 connections now open) 2015-10-05T06:40:52.037+0100 [conn1427119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:52.580+0100 [conn1426734] end connection 172.28.0.163:52687 (399 connections now open) 2015-10-05T06:40:52.581+0100 [mongosMain] connection accepted from 172.28.0.163:53745 #1427120 (400 connections now open) 2015-10-05T06:40:52.583+0100 [conn1427120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:52.821+0100 [conn1426735] end connection 172.28.0.164:62035 (399 connections now open) 2015-10-05T06:40:52.822+0100 [mongosMain] connection accepted from 172.28.0.164:63060 #1427121 (400 connections now open) 2015-10-05T06:40:52.824+0100 [conn1427121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:53.595+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:53.595+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:40:56.383+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:56.677+0100 [conn1426737] end connection 172.28.0.163:52696 (399 connections now open) 2015-10-05T06:40:56.679+0100 [mongosMain] connection accepted from 172.28.0.163:53755 #1427122 (400 connections now open) 2015-10-05T06:40:56.680+0100 [conn1427122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:56.934+0100 [conn1426665] end connection 172.28.0.163:52468 (399 connections now open) 2015-10-05T06:40:56.935+0100 [mongosMain] connection accepted from 172.28.0.163:53757 #1427123 (400 connections now open) 2015-10-05T06:40:56.936+0100 [conn1427123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:57.448+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d695703b51053ec47ca 2015-10-05T06:40:57.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:40:57.875+0100 [conn1426697] end connection 172.28.0.164:61883 (399 connections now open) 2015-10-05T06:40:57.875+0100 [conn1426687] end connection 172.28.0.164:61848 (399 connections now open) 2015-10-05T06:40:57.876+0100 [mongosMain] connection accepted from 172.28.0.164:63068 #1427124 (399 connections now open) 2015-10-05T06:40:57.877+0100 [mongosMain] connection accepted from 172.28.0.164:63069 #1427125 (400 connections now open) 2015-10-05T06:40:57.878+0100 [conn1427124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:57.878+0100 [conn1427125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:40:58.596+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:40:58.596+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:02.043+0100 [conn1426733] end connection 172.28.0.163:52683 (399 connections now open) 2015-10-05T06:41:02.044+0100 [mongosMain] connection accepted from 172.28.0.163:53765 #1427126 (400 connections now open) 2015-10-05T06:41:02.046+0100 [conn1427126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:02.290+0100 [conn1426725] end connection 172.28.0.164:62011 (399 connections now open) 2015-10-05T06:41:02.292+0100 [mongosMain] connection accepted from 172.28.0.164:63074 #1427127 (400 connections now open) 2015-10-05T06:41:02.296+0100 [conn1427127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:02.590+0100 [conn1426740] end connection 172.28.0.163:52708 (399 connections now open) 2015-10-05T06:41:02.591+0100 [mongosMain] connection accepted from 172.28.0.163:53766 #1427128 (400 connections now open) 2015-10-05T06:41:02.592+0100 [conn1427128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:02.837+0100 [conn1426741] end connection 172.28.0.164:62055 (399 connections now open) 2015-10-05T06:41:02.838+0100 [mongosMain] connection accepted from 172.28.0.164:63077 #1427129 (400 connections now open) 2015-10-05T06:41:02.839+0100 [conn1427129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:04.605+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:04.605+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:06.692+0100 [conn1426700] end connection 172.28.0.163:52573 (399 connections now open) 2015-10-05T06:41:06.692+0100 [conn1426728] end connection 172.28.0.163:52674 (399 connections now open) 2015-10-05T06:41:06.693+0100 [mongosMain] connection accepted from 172.28.0.163:53775 #1427130 (399 connections now open) 2015-10-05T06:41:06.693+0100 [mongosMain] connection accepted from 172.28.0.163:53776 #1427131 (400 connections now open) 2015-10-05T06:41:06.694+0100 [conn1427130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:06.694+0100 [conn1427131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:07.394+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:07.875+0100 [conn1426625] end connection 172.28.0.164:61671 (399 connections now open) 2015-10-05T06:41:07.875+0100 [conn1426731] end connection 172.28.0.164:62024 (399 connections now open) 2015-10-05T06:41:07.876+0100 [mongosMain] connection accepted from 172.28.0.164:63082 #1427132 (399 connections now open) 2015-10-05T06:41:07.877+0100 [mongosMain] connection accepted from 172.28.0.164:63083 #1427133 (400 connections now open) 2015-10-05T06:41:07.878+0100 [conn1427132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:07.878+0100 [conn1427133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:09.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d755703b51053ec4817 2015-10-05T06:41:09.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:11.613+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:11.613+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:12.044+0100 [conn1426709] end connection 172.28.0.163:52592 (399 connections now open) 2015-10-05T06:41:12.045+0100 [mongosMain] connection accepted from 172.28.0.163:53784 #1427134 (400 connections now open) 2015-10-05T06:41:12.046+0100 [conn1427134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:12.292+0100 [conn1426713] end connection 172.28.0.164:61955 (399 connections now open) 2015-10-05T06:41:12.293+0100 [mongosMain] connection accepted from 172.28.0.164:63085 #1427135 (400 connections now open) 2015-10-05T06:41:12.295+0100 [conn1427135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:12.590+0100 [conn1426747] end connection 172.28.0.163:52731 (399 connections now open) 2015-10-05T06:41:12.591+0100 [mongosMain] connection accepted from 172.28.0.163:53786 #1427136 (400 connections now open) 2015-10-05T06:41:12.593+0100 [conn1427136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:12.601+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:41:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:41:12.836+0100 [conn1426748] end connection 172.28.0.164:62066 (399 connections now open) 2015-10-05T06:41:12.837+0100 [mongosMain] connection accepted from 172.28.0.164:63087 #1427137 (400 connections now open) 2015-10-05T06:41:12.838+0100 [conn1427137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:16.707+0100 [conn1426691] end connection 172.28.0.163:52543 (399 connections now open) 2015-10-05T06:41:16.708+0100 [mongosMain] connection accepted from 172.28.0.163:53790 #1427138 (400 connections now open) 2015-10-05T06:41:16.709+0100 [conn1427138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:17.890+0100 [conn1426745] end connection 172.28.0.164:62061 (399 connections now open) 2015-10-05T06:41:17.891+0100 [conn1426676] end connection 172.28.0.164:61802 (398 connections now open) 2015-10-05T06:41:17.891+0100 [mongosMain] connection accepted from 172.28.0.164:63092 #1427139 (399 connections now open) 2015-10-05T06:41:17.892+0100 [mongosMain] connection accepted from 172.28.0.164:63093 #1427140 (400 connections now open) 2015-10-05T06:41:17.893+0100 [conn1427139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:17.893+0100 [conn1427140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:18.404+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:19.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:19.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:22.059+0100 [conn1426712] end connection 172.28.0.163:52606 (399 connections now open) 2015-10-05T06:41:22.060+0100 [mongosMain] connection accepted from 172.28.0.163:53798 #1427141 (400 connections now open) 2015-10-05T06:41:22.061+0100 [conn1427141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:22.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d815703b51053ec4873 2015-10-05T06:41:22.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:22.605+0100 [conn1426754] end connection 172.28.0.163:52752 (399 connections now open) 2015-10-05T06:41:22.606+0100 [mongosMain] connection accepted from 172.28.0.163:53800 #1427142 (400 connections now open) 2015-10-05T06:41:22.608+0100 [conn1427142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:22.852+0100 [conn1426755] end connection 172.28.0.164:62076 (399 connections now open) 2015-10-05T06:41:22.853+0100 [mongosMain] connection accepted from 172.28.0.164:63104 #1427143 (400 connections now open) 2015-10-05T06:41:22.854+0100 [conn1427143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:27.892+0100 [conn1426633] end connection 172.28.0.164:61694 (399 connections now open) 2015-10-05T06:41:27.893+0100 [mongosMain] connection accepted from 172.28.0.164:63111 #1427144 (400 connections now open) 2015-10-05T06:41:27.895+0100 [conn1427144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:28.623+0100 [mongosMain] connection accepted from 127.0.0.1:53806 #1427145 (401 connections now open) 2015-10-05T06:41:28.625+0100 [conn1427145] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:28.631+0100 [conn1427145] end connection 127.0.0.1:53806 (400 connections now open) 2015-10-05T06:41:28.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:28.676+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:29.413+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:32.059+0100 [conn1426715] end connection 172.28.0.163:52628 (399 connections now open) 2015-10-05T06:41:32.060+0100 [mongosMain] connection accepted from 172.28.0.163:53811 #1427146 (400 connections now open) 2015-10-05T06:41:32.060+0100 [conn1427146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:32.322+0100 [conn1426761] end connection 172.28.0.164:62090 (399 connections now open) 2015-10-05T06:41:32.324+0100 [mongosMain] connection accepted from 172.28.0.164:63122 #1427147 (400 connections now open) 2015-10-05T06:41:32.326+0100 [conn1427147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:32.605+0100 [conn1426762] end connection 172.28.0.163:52768 (399 connections now open) 2015-10-05T06:41:32.606+0100 [mongosMain] connection accepted from 172.28.0.163:53814 #1427148 (400 connections now open) 2015-10-05T06:41:32.607+0100 [conn1427148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:32.868+0100 [conn1426763] end connection 172.28.0.164:62092 (399 connections now open) 2015-10-05T06:41:32.869+0100 [mongosMain] connection accepted from 172.28.0.164:63125 #1427149 (400 connections now open) 2015-10-05T06:41:32.871+0100 [conn1427149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:34.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d8e5703b51053ec48ad 2015-10-05T06:41:34.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:36.723+0100 [conn1426742] end connection 172.28.0.163:52716 (399 connections now open) 2015-10-05T06:41:36.724+0100 [mongosMain] connection accepted from 172.28.0.163:53819 #1427150 (400 connections now open) 2015-10-05T06:41:36.725+0100 [conn1427150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:37.891+0100 [conn1426702] end connection 172.28.0.164:61909 (399 connections now open) 2015-10-05T06:41:37.891+0100 [conn1426750] end connection 172.28.0.164:62069 (398 connections now open) 2015-10-05T06:41:37.892+0100 [mongosMain] connection accepted from 172.28.0.164:63133 #1427151 (399 connections now open) 2015-10-05T06:41:37.893+0100 [mongosMain] connection accepted from 172.28.0.164:63134 #1427152 (400 connections now open) 2015-10-05T06:41:37.894+0100 [conn1427151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:37.895+0100 [conn1427152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:38.687+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:38.688+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:39.764+0100 [mongosMain] connection accepted from 127.0.0.1:53824 #1427153 (401 connections now open) 2015-10-05T06:41:39.766+0100 [conn1427153] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:39.772+0100 [conn1427153] end connection 127.0.0.1:53824 (400 connections now open) 2015-10-05T06:41:40.423+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:41.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d945703b51053ec48ce 2015-10-05T06:41:41.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:42.075+0100 [conn1426752] end connection 172.28.0.163:52747 (399 connections now open) 2015-10-05T06:41:42.076+0100 [mongosMain] connection accepted from 172.28.0.163:53827 #1427154 (400 connections now open) 2015-10-05T06:41:42.077+0100 [conn1427154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:42.322+0100 [conn1426753] end connection 172.28.0.164:62074 (399 connections now open) 2015-10-05T06:41:42.323+0100 [mongosMain] connection accepted from 172.28.0.164:63144 #1427155 (400 connections now open) 2015-10-05T06:41:42.324+0100 [conn1427155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:42.620+0100 [conn1426769] end connection 172.28.0.163:52777 (399 connections now open) 2015-10-05T06:41:42.621+0100 [mongosMain] connection accepted from 172.28.0.163:53829 #1427156 (400 connections now open) 2015-10-05T06:41:42.623+0100 [conn1427156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:42.868+0100 [conn1426770] end connection 172.28.0.164:62109 (399 connections now open) 2015-10-05T06:41:42.870+0100 [mongosMain] connection accepted from 172.28.0.164:63146 #1427157 (400 connections now open) 2015-10-05T06:41:42.871+0100 [conn1427157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:42.887+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:41:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:41:46.725+0100 [conn1426756] end connection 172.28.0.163:52758 (399 connections now open) 2015-10-05T06:41:46.726+0100 [mongosMain] connection accepted from 172.28.0.163:53835 #1427158 (400 connections now open) 2015-10-05T06:41:46.727+0100 [conn1427158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:47.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120d9b5703b51053ec48ee 2015-10-05T06:41:47.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:47.906+0100 [conn1426758] end connection 172.28.0.164:62081 (399 connections now open) 2015-10-05T06:41:47.907+0100 [conn1426716] end connection 172.28.0.164:61980 (398 connections now open) 2015-10-05T06:41:47.907+0100 [mongosMain] connection accepted from 172.28.0.164:63154 #1427159 (399 connections now open) 2015-10-05T06:41:47.908+0100 [mongosMain] connection accepted from 172.28.0.164:63153 #1427160 (400 connections now open) 2015-10-05T06:41:47.909+0100 [conn1427159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:47.909+0100 [conn1427160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:49.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:49.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:41:51.422+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:41:52.090+0100 [conn1426760] end connection 172.28.0.163:52767 (399 connections now open) 2015-10-05T06:41:52.091+0100 [mongosMain] connection accepted from 172.28.0.163:53846 #1427161 (400 connections now open) 2015-10-05T06:41:52.092+0100 [conn1427161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:52.337+0100 [conn1426635] end connection 172.28.0.164:61702 (399 connections now open) 2015-10-05T06:41:52.338+0100 [mongosMain] connection accepted from 172.28.0.164:63160 #1427162 (400 connections now open) 2015-10-05T06:41:52.340+0100 [conn1427162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:52.636+0100 [conn1426776] end connection 172.28.0.163:52791 (399 connections now open) 2015-10-05T06:41:52.638+0100 [mongosMain] connection accepted from 172.28.0.163:53849 #1427163 (400 connections now open) 2015-10-05T06:41:52.639+0100 [conn1427163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:52.883+0100 [conn1426777] end connection 172.28.0.164:62127 (399 connections now open) 2015-10-05T06:41:52.885+0100 [mongosMain] connection accepted from 172.28.0.164:63164 #1427164 (400 connections now open) 2015-10-05T06:41:52.887+0100 [conn1427164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:53.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120da15703b51053ec4912 2015-10-05T06:41:54.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:41:56.732+0100 [conn1426526] end connection 172.28.0.163:52099 (399 connections now open) 2015-10-05T06:41:56.733+0100 [mongosMain] connection accepted from 172.28.0.163:53855 #1427165 (400 connections now open) 2015-10-05T06:41:56.734+0100 [conn1427165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:57.898+0100 [conn1426779] end connection 172.28.0.164:62137 (399 connections now open) 2015-10-05T06:41:57.899+0100 [mongosMain] connection accepted from 172.28.0.164:63169 #1427166 (400 connections now open) 2015-10-05T06:41:57.900+0100 [conn1426714] end connection 172.28.0.164:61964 (399 connections now open) 2015-10-05T06:41:57.901+0100 [mongosMain] connection accepted from 172.28.0.164:63170 #1427167 (400 connections now open) 2015-10-05T06:41:57.901+0100 [conn1427166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:41:57.903+0100 [conn1427167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:00.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120da85703b51053ec493f 2015-10-05T06:42:00.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:01.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:01.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:02.084+0100 [conn1426724] end connection 172.28.0.163:52668 (399 connections now open) 2015-10-05T06:42:02.085+0100 [mongosMain] connection accepted from 172.28.0.163:53867 #1427168 (400 connections now open) 2015-10-05T06:42:02.087+0100 [conn1427168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:02.344+0100 [conn1426592] end connection 172.28.0.164:61598 (399 connections now open) 2015-10-05T06:42:02.345+0100 [mongosMain] connection accepted from 172.28.0.164:63174 #1427169 (400 connections now open) 2015-10-05T06:42:02.349+0100 [conn1427169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:02.417+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:02.630+0100 [conn1426782] end connection 172.28.0.163:52813 (399 connections now open) 2015-10-05T06:42:02.632+0100 [mongosMain] connection accepted from 172.28.0.163:53869 #1427170 (400 connections now open) 2015-10-05T06:42:02.633+0100 [conn1427170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:02.875+0100 [conn1426783] end connection 172.28.0.164:62146 (399 connections now open) 2015-10-05T06:42:02.876+0100 [mongosMain] connection accepted from 172.28.0.164:63176 #1427171 (400 connections now open) 2015-10-05T06:42:02.877+0100 [conn1427171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:03.699+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:03.700+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:06.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dae5703b51053ec497f 2015-10-05T06:42:06.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:06.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:06.716+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:06.736+0100 [conn1426778] end connection 172.28.0.163:52801 (399 connections now open) 2015-10-05T06:42:06.737+0100 [mongosMain] connection accepted from 172.28.0.163:53878 #1427172 (400 connections now open) 2015-10-05T06:42:06.738+0100 [conn1427172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:07.913+0100 [conn1426659] end connection 172.28.0.164:61759 (399 connections now open) 2015-10-05T06:42:07.913+0100 [conn1426786] end connection 172.28.0.164:62156 (399 connections now open) 2015-10-05T06:42:07.914+0100 [mongosMain] connection accepted from 172.28.0.164:63182 #1427173 (399 connections now open) 2015-10-05T06:42:07.914+0100 [mongosMain] connection accepted from 172.28.0.164:63181 #1427174 (400 connections now open) 2015-10-05T06:42:07.915+0100 [conn1427173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:07.916+0100 [conn1427174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:10.711+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:10.712+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:12.097+0100 [conn1426746] end connection 172.28.0.163:52728 (399 connections now open) 2015-10-05T06:42:12.098+0100 [mongosMain] connection accepted from 172.28.0.163:53886 #1427175 (400 connections now open) 2015-10-05T06:42:12.100+0100 [conn1427175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:12.360+0100 [conn1426781] end connection 172.28.0.164:62143 (399 connections now open) 2015-10-05T06:42:12.361+0100 [mongosMain] connection accepted from 172.28.0.164:63185 #1427176 (400 connections now open) 2015-10-05T06:42:12.362+0100 [conn1427176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:12.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120db45703b51053ec49ad 2015-10-05T06:42:12.643+0100 [conn1426789] end connection 172.28.0.163:52835 (399 connections now open) 2015-10-05T06:42:12.645+0100 [mongosMain] connection accepted from 172.28.0.163:53888 #1427177 (400 connections now open) 2015-10-05T06:42:12.646+0100 [conn1427177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:12.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:12.890+0100 [conn1426790] end connection 172.28.0.164:62163 (399 connections now open) 2015-10-05T06:42:12.891+0100 [mongosMain] connection accepted from 172.28.0.164:63188 #1427178 (400 connections now open) 2015-10-05T06:42:12.893+0100 [conn1427178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:13.010+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:42:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:42:13.430+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:15.721+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:15.722+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:16.746+0100 [conn1426764] end connection 172.28.0.163:52772 (399 connections now open) 2015-10-05T06:42:16.747+0100 [conn1426729] end connection 172.28.0.163:52675 (399 connections now open) 2015-10-05T06:42:16.748+0100 [mongosMain] connection accepted from 172.28.0.163:53898 #1427179 (399 connections now open) 2015-10-05T06:42:16.748+0100 [mongosMain] connection accepted from 172.28.0.163:53899 #1427180 (400 connections now open) 2015-10-05T06:42:16.749+0100 [conn1427179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:16.750+0100 [conn1427180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:17.913+0100 [conn1426792] end connection 172.28.0.164:62169 (399 connections now open) 2015-10-05T06:42:17.913+0100 [conn1426707] end connection 172.28.0.164:61930 (398 connections now open) 2015-10-05T06:42:17.914+0100 [mongosMain] connection accepted from 172.28.0.164:63195 #1427181 (399 connections now open) 2015-10-05T06:42:17.914+0100 [mongosMain] connection accepted from 172.28.0.164:63196 #1427182 (400 connections now open) 2015-10-05T06:42:17.915+0100 [conn1427181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:17.916+0100 [conn1427182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:18.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dba5703b51053ec49de 2015-10-05T06:42:19.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:21.767+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:21.767+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:22.098+0100 [conn1426767] end connection 172.28.0.163:52775 (399 connections now open) 2015-10-05T06:42:22.100+0100 [mongosMain] connection accepted from 172.28.0.163:53905 #1427183 (400 connections now open) 2015-10-05T06:42:22.102+0100 [conn1427183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:22.375+0100 [conn1426768] end connection 172.28.0.164:62107 (399 connections now open) 2015-10-05T06:42:22.376+0100 [mongosMain] connection accepted from 172.28.0.164:63204 #1427184 (400 connections now open) 2015-10-05T06:42:22.378+0100 [conn1427184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:22.644+0100 [conn1426796] end connection 172.28.0.163:52859 (399 connections now open) 2015-10-05T06:42:22.645+0100 [mongosMain] connection accepted from 172.28.0.163:53908 #1427185 (400 connections now open) 2015-10-05T06:42:22.647+0100 [conn1427185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:22.907+0100 [conn1426797] end connection 172.28.0.164:62174 (399 connections now open) 2015-10-05T06:42:22.908+0100 [mongosMain] connection accepted from 172.28.0.164:63207 #1427186 (400 connections now open) 2015-10-05T06:42:22.910+0100 [conn1427186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:24.503+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:25.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dc15703b51053ec4a16 2015-10-05T06:42:25.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:26.750+0100 [conn1426720] end connection 172.28.0.163:52660 (399 connections now open) 2015-10-05T06:42:26.751+0100 [mongosMain] connection accepted from 172.28.0.163:53911 #1427187 (400 connections now open) 2015-10-05T06:42:26.752+0100 [conn1427187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:27.929+0100 [conn1426800] end connection 172.28.0.164:62179 (399 connections now open) 2015-10-05T06:42:27.929+0100 [conn1426722] end connection 172.28.0.164:62002 (399 connections now open) 2015-10-05T06:42:27.931+0100 [mongosMain] connection accepted from 172.28.0.164:63216 #1427188 (399 connections now open) 2015-10-05T06:42:27.932+0100 [mongosMain] connection accepted from 172.28.0.164:63217 #1427189 (400 connections now open) 2015-10-05T06:42:27.933+0100 [conn1427188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:27.934+0100 [conn1427189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:28.529+0100 [mongosMain] connection accepted from 127.0.0.1:53915 #1427190 (401 connections now open) 2015-10-05T06:42:28.532+0100 [conn1427190] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:28.537+0100 [conn1427190] end connection 127.0.0.1:53915 (400 connections now open) 2015-10-05T06:42:28.768+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:28.768+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:31.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dc75703b51053ec4a50 2015-10-05T06:42:31.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:32.113+0100 [conn1426780] end connection 172.28.0.163:52809 (399 connections now open) 2015-10-05T06:42:32.115+0100 [mongosMain] connection accepted from 172.28.0.163:53916 #1427191 (400 connections now open) 2015-10-05T06:42:32.116+0100 [conn1427191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:32.376+0100 [conn1426788] end connection 172.28.0.164:62161 (399 connections now open) 2015-10-05T06:42:32.377+0100 [mongosMain] connection accepted from 172.28.0.164:63225 #1427192 (400 connections now open) 2015-10-05T06:42:32.378+0100 [conn1427192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:32.659+0100 [conn1426804] end connection 172.28.0.163:52875 (399 connections now open) 2015-10-05T06:42:32.660+0100 [mongosMain] connection accepted from 172.28.0.163:53918 #1427193 (400 connections now open) 2015-10-05T06:42:32.661+0100 [conn1427193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:32.922+0100 [conn1426805] end connection 172.28.0.164:62193 (399 connections now open) 2015-10-05T06:42:32.923+0100 [mongosMain] connection accepted from 172.28.0.164:63227 #1427194 (400 connections now open) 2015-10-05T06:42:32.924+0100 [conn1427194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:35.510+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:36.761+0100 [conn1426771] end connection 172.28.0.163:52781 (399 connections now open) 2015-10-05T06:42:36.762+0100 [mongosMain] connection accepted from 172.28.0.163:53924 #1427195 (400 connections now open) 2015-10-05T06:42:36.763+0100 [conn1427195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:36.841+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:36.841+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:37.945+0100 [conn1426739] end connection 172.28.0.164:62047 (399 connections now open) 2015-10-05T06:42:37.945+0100 [conn1426730] end connection 172.28.0.164:62025 (399 connections now open) 2015-10-05T06:42:37.946+0100 [mongosMain] connection accepted from 172.28.0.164:63237 #1427196 (399 connections now open) 2015-10-05T06:42:37.946+0100 [mongosMain] connection accepted from 172.28.0.164:63238 #1427197 (400 connections now open) 2015-10-05T06:42:37.948+0100 [conn1427196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:37.948+0100 [conn1427197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:38.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dcd5703b51053ec4a7b 2015-10-05T06:42:38.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:39.881+0100 [mongosMain] connection accepted from 127.0.0.1:53926 #1427198 (401 connections now open) 2015-10-05T06:42:39.884+0100 [conn1427198] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:39.889+0100 [conn1427198] end connection 127.0.0.1:53926 (400 connections now open) 2015-10-05T06:42:42.113+0100 [conn1426787] end connection 172.28.0.163:52832 (399 connections now open) 2015-10-05T06:42:42.114+0100 [mongosMain] connection accepted from 172.28.0.163:53929 #1427199 (400 connections now open) 2015-10-05T06:42:42.115+0100 [conn1427199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:42.376+0100 [conn1426795] end connection 172.28.0.164:62172 (399 connections now open) 2015-10-05T06:42:42.377+0100 [mongosMain] connection accepted from 172.28.0.164:63247 #1427200 (400 connections now open) 2015-10-05T06:42:42.379+0100 [conn1427200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:42.659+0100 [conn1426812] end connection 172.28.0.163:52884 (399 connections now open) 2015-10-05T06:42:42.660+0100 [mongosMain] connection accepted from 172.28.0.163:53931 #1427201 (400 connections now open) 2015-10-05T06:42:42.661+0100 [conn1427201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:42.922+0100 [conn1426813] end connection 172.28.0.164:62213 (399 connections now open) 2015-10-05T06:42:42.923+0100 [mongosMain] connection accepted from 172.28.0.164:63250 #1427202 (400 connections now open) 2015-10-05T06:42:42.925+0100 [conn1427202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:43.140+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:42:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:42:44.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dd45703b51053ec4ab8 2015-10-05T06:42:44.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:45.849+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:45.849+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:46.520+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:46.777+0100 [conn1426695] end connection 172.28.0.163:52556 (399 connections now open) 2015-10-05T06:42:46.777+0100 [conn1426798] end connection 172.28.0.163:52865 (399 connections now open) 2015-10-05T06:42:46.778+0100 [mongosMain] connection accepted from 172.28.0.163:53939 #1427203 (399 connections now open) 2015-10-05T06:42:46.778+0100 [mongosMain] connection accepted from 172.28.0.163:53940 #1427204 (400 connections now open) 2015-10-05T06:42:46.779+0100 [conn1427203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:46.779+0100 [conn1427204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:47.960+0100 [conn1426807] end connection 172.28.0.164:62202 (399 connections now open) 2015-10-05T06:42:47.961+0100 [conn1426711] end connection 172.28.0.164:61949 (398 connections now open) 2015-10-05T06:42:47.962+0100 [mongosMain] connection accepted from 172.28.0.164:63263 #1427205 (399 connections now open) 2015-10-05T06:42:47.962+0100 [mongosMain] connection accepted from 172.28.0.164:63262 #1427206 (400 connections now open) 2015-10-05T06:42:47.964+0100 [conn1427205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:47.964+0100 [conn1427206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:50.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dda5703b51053ec4b02 2015-10-05T06:42:50.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:52.129+0100 [conn1426810] end connection 172.28.0.163:52882 (399 connections now open) 2015-10-05T06:42:52.130+0100 [mongosMain] connection accepted from 172.28.0.163:53948 #1427207 (400 connections now open) 2015-10-05T06:42:52.131+0100 [conn1427207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:52.675+0100 [conn1426818] end connection 172.28.0.163:52900 (399 connections now open) 2015-10-05T06:42:52.676+0100 [mongosMain] connection accepted from 172.28.0.163:53951 #1427208 (400 connections now open) 2015-10-05T06:42:52.677+0100 [conn1427208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:52.937+0100 [conn1426819] end connection 172.28.0.164:62233 (399 connections now open) 2015-10-05T06:42:52.938+0100 [mongosMain] connection accepted from 172.28.0.164:63272 #1427209 (400 connections now open) 2015-10-05T06:42:52.941+0100 [conn1427209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:55.850+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:42:55.850+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:42:56.778+0100 [conn1426772] end connection 172.28.0.163:52782 (399 connections now open) 2015-10-05T06:42:56.779+0100 [conn1426749] end connection 172.28.0.163:52737 (398 connections now open) 2015-10-05T06:42:56.779+0100 [mongosMain] connection accepted from 172.28.0.163:53961 #1427210 (399 connections now open) 2015-10-05T06:42:56.780+0100 [mongosMain] connection accepted from 172.28.0.163:53963 #1427211 (400 connections now open) 2015-10-05T06:42:56.781+0100 [conn1427210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:56.781+0100 [conn1427211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:42:57.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120de05703b51053ec4b29 2015-10-05T06:42:57.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:42:57.579+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:02.407+0100 [conn1426811] end connection 172.28.0.164:62209 (399 connections now open) 2015-10-05T06:43:02.409+0100 [mongosMain] connection accepted from 172.28.0.164:63281 #1427212 (400 connections now open) 2015-10-05T06:43:02.412+0100 [conn1427212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:02.677+0100 [conn1426825] end connection 172.28.0.163:52919 (399 connections now open) 2015-10-05T06:43:02.678+0100 [mongosMain] connection accepted from 172.28.0.163:53974 #1427213 (400 connections now open) 2015-10-05T06:43:02.679+0100 [conn1427213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:02.953+0100 [conn1426826] end connection 172.28.0.164:62252 (399 connections now open) 2015-10-05T06:43:02.954+0100 [mongosMain] connection accepted from 172.28.0.164:63283 #1427214 (400 connections now open) 2015-10-05T06:43:02.956+0100 [conn1427214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:03.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120de75703b51053ec4b56 2015-10-05T06:43:03.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:06.793+0100 [conn1426791] end connection 172.28.0.163:52844 (399 connections now open) 2015-10-05T06:43:06.793+0100 [conn1426821] end connection 172.28.0.163:52907 (399 connections now open) 2015-10-05T06:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.163:53984 #1427215 (399 connections now open) 2015-10-05T06:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.163:53983 #1427216 (400 connections now open) 2015-10-05T06:43:06.795+0100 [conn1427215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:06.796+0100 [conn1427216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:06.847+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:06.848+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:07.992+0100 [conn1426822] end connection 172.28.0.164:62241 (399 connections now open) 2015-10-05T06:43:07.993+0100 [mongosMain] connection accepted from 172.28.0.164:63287 #1427217 (400 connections now open) 2015-10-05T06:43:07.995+0100 [conn1427217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:08.662+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:09.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ded5703b51053ec4ba5 2015-10-05T06:43:09.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:12.144+0100 [conn1426794] end connection 172.28.0.163:52855 (399 connections now open) 2015-10-05T06:43:12.146+0100 [mongosMain] connection accepted from 172.28.0.163:53993 #1427218 (400 connections now open) 2015-10-05T06:43:12.147+0100 [conn1427218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:12.422+0100 [conn1426803] end connection 172.28.0.164:62190 (399 connections now open) 2015-10-05T06:43:12.425+0100 [mongosMain] connection accepted from 172.28.0.164:63292 #1427219 (400 connections now open) 2015-10-05T06:43:12.426+0100 [conn1427219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:12.690+0100 [conn1426832] end connection 172.28.0.163:52944 (399 connections now open) 2015-10-05T06:43:12.691+0100 [mongosMain] connection accepted from 172.28.0.163:53996 #1427220 (400 connections now open) 2015-10-05T06:43:12.693+0100 [conn1427220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:12.969+0100 [conn1426833] end connection 172.28.0.164:62266 (399 connections now open) 2015-10-05T06:43:12.970+0100 [mongosMain] connection accepted from 172.28.0.164:63294 #1427221 (400 connections now open) 2015-10-05T06:43:12.972+0100 [conn1427221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:13.410+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:43:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:43:16.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120df35703b51053ec4bd1 2015-10-05T06:43:16.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:16.795+0100 [conn1426827] end connection 172.28.0.163:52927 (399 connections now open) 2015-10-05T06:43:16.795+0100 [conn1426736] end connection 172.28.0.163:52695 (398 connections now open) 2015-10-05T06:43:16.796+0100 [mongosMain] connection accepted from 172.28.0.163:54002 #1427222 (399 connections now open) 2015-10-05T06:43:16.796+0100 [mongosMain] connection accepted from 172.28.0.163:54003 #1427223 (400 connections now open) 2015-10-05T06:43:16.797+0100 [conn1427222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:16.797+0100 [conn1427223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:18.008+0100 [conn1426815] end connection 172.28.0.164:62220 (399 connections now open) 2015-10-05T06:43:18.009+0100 [mongosMain] connection accepted from 172.28.0.164:63299 #1427224 (400 connections now open) 2015-10-05T06:43:18.011+0100 [conn1427224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:18.865+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:18.866+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:19.671+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:20.873+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:20.873+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:22.160+0100 [conn1426823] end connection 172.28.0.163:52916 (399 connections now open) 2015-10-05T06:43:22.161+0100 [mongosMain] connection accepted from 172.28.0.163:54009 #1427225 (400 connections now open) 2015-10-05T06:43:22.162+0100 [conn1427225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:22.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120dfa5703b51053ec4bf7 2015-10-05T06:43:22.424+0100 [conn1426775] end connection 172.28.0.164:62125 (399 connections now open) 2015-10-05T06:43:22.425+0100 [mongosMain] connection accepted from 172.28.0.164:63307 #1427226 (400 connections now open) 2015-10-05T06:43:22.426+0100 [conn1427226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:22.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:22.706+0100 [conn1426839] end connection 172.28.0.163:52966 (399 connections now open) 2015-10-05T06:43:22.707+0100 [mongosMain] connection accepted from 172.28.0.163:54011 #1427227 (400 connections now open) 2015-10-05T06:43:22.709+0100 [conn1427227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:22.969+0100 [conn1426840] end connection 172.28.0.164:62284 (399 connections now open) 2015-10-05T06:43:22.970+0100 [mongosMain] connection accepted from 172.28.0.164:63309 #1427228 (400 connections now open) 2015-10-05T06:43:22.971+0100 [conn1427228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:23.867+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:23.868+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:26.810+0100 [conn1426799] end connection 172.28.0.163:52866 (399 connections now open) 2015-10-05T06:43:26.810+0100 [conn1426784] end connection 172.28.0.163:52824 (399 connections now open) 2015-10-05T06:43:26.811+0100 [mongosMain] connection accepted from 172.28.0.163:54014 #1427229 (399 connections now open) 2015-10-05T06:43:26.811+0100 [mongosMain] connection accepted from 172.28.0.163:54015 #1427230 (400 connections now open) 2015-10-05T06:43:26.812+0100 [conn1427229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:26.812+0100 [conn1427230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:27.874+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:27.874+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:28.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e005703b51053ec4c28 2015-10-05T06:43:28.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:28.984+0100 [mongosMain] connection accepted from 127.0.0.1:54019 #1427231 (401 connections now open) 2015-10-05T06:43:28.988+0100 [conn1427231] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:28.993+0100 [conn1427231] end connection 127.0.0.1:54019 (400 connections now open) 2015-10-05T06:43:30.679+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:32.161+0100 [conn1426802] end connection 172.28.0.163:52874 (399 connections now open) 2015-10-05T06:43:32.162+0100 [mongosMain] connection accepted from 172.28.0.163:54022 #1427232 (400 connections now open) 2015-10-05T06:43:32.163+0100 [conn1427232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:32.439+0100 [conn1426824] end connection 172.28.0.164:62248 (399 connections now open) 2015-10-05T06:43:32.440+0100 [mongosMain] connection accepted from 172.28.0.164:63326 #1427233 (400 connections now open) 2015-10-05T06:43:32.442+0100 [conn1427233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:32.717+0100 [conn1426845] end connection 172.28.0.163:52984 (399 connections now open) 2015-10-05T06:43:32.718+0100 [mongosMain] connection accepted from 172.28.0.163:54024 #1427234 (400 connections now open) 2015-10-05T06:43:32.719+0100 [conn1427234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:32.878+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:32.878+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:32.985+0100 [conn1426846] end connection 172.28.0.164:62302 (399 connections now open) 2015-10-05T06:43:32.986+0100 [mongosMain] connection accepted from 172.28.0.164:63330 #1427235 (400 connections now open) 2015-10-05T06:43:32.988+0100 [conn1427235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:35.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e065703b51053ec4c56 2015-10-05T06:43:35.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:36.813+0100 [conn1426806] end connection 172.28.0.163:52877 (399 connections now open) 2015-10-05T06:43:36.814+0100 [conn1426834] end connection 172.28.0.163:52953 (398 connections now open) 2015-10-05T06:43:36.814+0100 [mongosMain] connection accepted from 172.28.0.163:54027 #1427236 (399 connections now open) 2015-10-05T06:43:36.815+0100 [mongosMain] connection accepted from 172.28.0.163:54028 #1427237 (400 connections now open) 2015-10-05T06:43:36.815+0100 [conn1427236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:36.816+0100 [conn1427237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:38.024+0100 [conn1426829] end connection 172.28.0.164:62258 (399 connections now open) 2015-10-05T06:43:38.025+0100 [mongosMain] connection accepted from 172.28.0.164:63340 #1427238 (400 connections now open) 2015-10-05T06:43:38.027+0100 [conn1427238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:38.896+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:38.897+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:39.802+0100 [mongosMain] connection accepted from 127.0.0.1:54033 #1427239 (401 connections now open) 2015-10-05T06:43:39.805+0100 [conn1427239] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:39.810+0100 [conn1427239] end connection 127.0.0.1:54033 (400 connections now open) 2015-10-05T06:43:41.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e0d5703b51053ec4c8d 2015-10-05T06:43:41.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:41.694+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:42.176+0100 [conn1426843] end connection 172.28.0.163:52982 (399 connections now open) 2015-10-05T06:43:42.177+0100 [mongosMain] connection accepted from 172.28.0.163:54037 #1427240 (400 connections now open) 2015-10-05T06:43:42.179+0100 [conn1427240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:42.456+0100 [conn1426817] end connection 172.28.0.164:62230 (399 connections now open) 2015-10-05T06:43:42.457+0100 [mongosMain] connection accepted from 172.28.0.164:63349 #1427241 (400 connections now open) 2015-10-05T06:43:42.458+0100 [conn1427241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:42.722+0100 [conn1426852] end connection 172.28.0.163:52996 (399 connections now open) 2015-10-05T06:43:42.723+0100 [mongosMain] connection accepted from 172.28.0.163:54039 #1427242 (400 connections now open) 2015-10-05T06:43:42.724+0100 [conn1427242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:42.985+0100 [conn1426853] end connection 172.28.0.164:62321 (399 connections now open) 2015-10-05T06:43:42.986+0100 [mongosMain] connection accepted from 172.28.0.164:63351 #1427243 (400 connections now open) 2015-10-05T06:43:42.988+0100 [conn1427243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:43.558+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:43:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:43:45.908+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:45.908+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:46.824+0100 [conn1426842] end connection 172.28.0.163:52974 (399 connections now open) 2015-10-05T06:43:46.825+0100 [conn1426828] end connection 172.28.0.163:52928 (399 connections now open) 2015-10-05T06:43:46.825+0100 [mongosMain] connection accepted from 172.28.0.163:54045 #1427244 (399 connections now open) 2015-10-05T06:43:46.826+0100 [mongosMain] connection accepted from 172.28.0.163:54046 #1427245 (400 connections now open) 2015-10-05T06:43:46.827+0100 [conn1427244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:46.827+0100 [conn1427245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:47.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e135703b51053ec4cb9 2015-10-05T06:43:47.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:48.040+0100 [conn1426836] end connection 172.28.0.164:62275 (399 connections now open) 2015-10-05T06:43:48.040+0100 [mongosMain] connection accepted from 172.28.0.164:63359 #1427246 (400 connections now open) 2015-10-05T06:43:48.043+0100 [conn1427246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:52.470+0100 [conn1426831] end connection 172.28.0.164:62263 (399 connections now open) 2015-10-05T06:43:52.471+0100 [mongosMain] connection accepted from 172.28.0.164:63365 #1427247 (400 connections now open) 2015-10-05T06:43:52.473+0100 [conn1427247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:52.704+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:52.722+0100 [conn1426859] end connection 172.28.0.163:53013 (399 connections now open) 2015-10-05T06:43:52.723+0100 [mongosMain] connection accepted from 172.28.0.163:54058 #1427248 (400 connections now open) 2015-10-05T06:43:52.725+0100 [conn1427248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:53.001+0100 [conn1426860] end connection 172.28.0.164:62341 (399 connections now open) 2015-10-05T06:43:53.002+0100 [mongosMain] connection accepted from 172.28.0.164:63369 #1427249 (400 connections now open) 2015-10-05T06:43:53.004+0100 [conn1427249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:53.908+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:43:53.908+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:43:54.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e1a5703b51053ec4ce8 2015-10-05T06:43:54.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:43:56.840+0100 [conn1426743] end connection 172.28.0.163:52717 (399 connections now open) 2015-10-05T06:43:56.840+0100 [conn1426847] end connection 172.28.0.163:52989 (399 connections now open) 2015-10-05T06:43:56.841+0100 [mongosMain] connection accepted from 172.28.0.163:54066 #1427250 (399 connections now open) 2015-10-05T06:43:56.842+0100 [mongosMain] connection accepted from 172.28.0.163:54067 #1427251 (400 connections now open) 2015-10-05T06:43:56.843+0100 [conn1427250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:43:56.843+0100 [conn1427251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:00.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e205703b51053ec4d17 2015-10-05T06:44:00.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:02.486+0100 [conn1426851] end connection 172.28.0.164:62319 (399 connections now open) 2015-10-05T06:44:02.488+0100 [mongosMain] connection accepted from 172.28.0.164:63379 #1427252 (400 connections now open) 2015-10-05T06:44:02.489+0100 [conn1427252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:02.737+0100 [conn1426864] end connection 172.28.0.163:53033 (399 connections now open) 2015-10-05T06:44:02.738+0100 [mongosMain] connection accepted from 172.28.0.163:54079 #1427253 (400 connections now open) 2015-10-05T06:44:02.739+0100 [conn1427253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:02.911+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:02.911+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:03.016+0100 [conn1426865] end connection 172.28.0.164:62358 (399 connections now open) 2015-10-05T06:44:03.017+0100 [mongosMain] connection accepted from 172.28.0.164:63381 #1427254 (400 connections now open) 2015-10-05T06:44:03.019+0100 [conn1427254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:03.714+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:06.844+0100 [conn1426814] end connection 172.28.0.163:52887 (399 connections now open) 2015-10-05T06:44:06.845+0100 [mongosMain] connection accepted from 172.28.0.163:54086 #1427255 (400 connections now open) 2015-10-05T06:44:06.845+0100 [conn1427255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:06.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e265703b51053ec4d64 2015-10-05T06:44:07.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:12.501+0100 [conn1426844] end connection 172.28.0.164:62297 (399 connections now open) 2015-10-05T06:44:12.502+0100 [mongosMain] connection accepted from 172.28.0.164:63388 #1427256 (400 connections now open) 2015-10-05T06:44:12.504+0100 [conn1427256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:12.743+0100 [conn1426870] end connection 172.28.0.163:53054 (399 connections now open) 2015-10-05T06:44:12.744+0100 [mongosMain] connection accepted from 172.28.0.163:54100 #1427257 (400 connections now open) 2015-10-05T06:44:12.746+0100 [conn1427257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:13.001+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:13.001+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:13.032+0100 [conn1426871] end connection 172.28.0.164:62372 (399 connections now open) 2015-10-05T06:44:13.033+0100 [mongosMain] connection accepted from 172.28.0.164:63391 #1427258 (400 connections now open) 2015-10-05T06:44:13.035+0100 [conn1427258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:13.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e2d5703b51053ec4d8d 2015-10-05T06:44:13.451+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:13.794+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:44:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:44:14.726+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:16.856+0100 [conn1426841] end connection 172.28.0.163:52973 (399 connections now open) 2015-10-05T06:44:16.856+0100 [conn1426854] end connection 172.28.0.163:53002 (399 connections now open) 2015-10-05T06:44:16.857+0100 [mongosMain] connection accepted from 172.28.0.163:54107 #1427259 (399 connections now open) 2015-10-05T06:44:16.858+0100 [mongosMain] connection accepted from 172.28.0.163:54108 #1427260 (400 connections now open) 2015-10-05T06:44:16.859+0100 [conn1427259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:16.859+0100 [conn1427260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:18.055+0100 [conn1426855] end connection 172.28.0.164:62331 (399 connections now open) 2015-10-05T06:44:18.056+0100 [mongosMain] connection accepted from 172.28.0.164:63397 #1427261 (400 connections now open) 2015-10-05T06:44:18.058+0100 [conn1427261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:19.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e335703b51053ec4dad 2015-10-05T06:44:19.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:22.517+0100 [conn1426858] end connection 172.28.0.164:62339 (399 connections now open) 2015-10-05T06:44:22.518+0100 [mongosMain] connection accepted from 172.28.0.164:63408 #1427262 (400 connections now open) 2015-10-05T06:44:22.520+0100 [conn1427262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:22.753+0100 [conn1426875] end connection 172.28.0.163:53074 (399 connections now open) 2015-10-05T06:44:22.754+0100 [mongosMain] connection accepted from 172.28.0.163:54113 #1427263 (400 connections now open) 2015-10-05T06:44:22.756+0100 [conn1427263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:23.048+0100 [conn1426876] end connection 172.28.0.164:62383 (399 connections now open) 2015-10-05T06:44:23.049+0100 [mongosMain] connection accepted from 172.28.0.164:63411 #1427264 (400 connections now open) 2015-10-05T06:44:23.050+0100 [conn1427264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:24.005+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:24.006+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:25.737+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:25.980+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e395703b51053ec4ddb 2015-10-05T06:44:26.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:26.861+0100 [conn1426848] end connection 172.28.0.163:52988 (399 connections now open) 2015-10-05T06:44:26.862+0100 [mongosMain] connection accepted from 172.28.0.163:54117 #1427265 (400 connections now open) 2015-10-05T06:44:26.863+0100 [conn1427265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:28.071+0100 [conn1426793] end connection 172.28.0.164:62170 (399 connections now open) 2015-10-05T06:44:28.071+0100 [conn1426849] end connection 172.28.0.164:62312 (399 connections now open) 2015-10-05T06:44:28.072+0100 [mongosMain] connection accepted from 172.28.0.164:63421 #1427266 (399 connections now open) 2015-10-05T06:44:28.073+0100 [mongosMain] connection accepted from 172.28.0.164:63422 #1427267 (400 connections now open) 2015-10-05T06:44:28.074+0100 [conn1427266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:28.074+0100 [conn1427267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:28.215+0100 [mongosMain] connection accepted from 127.0.0.1:54120 #1427268 (401 connections now open) 2015-10-05T06:44:28.218+0100 [conn1427268] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:28.223+0100 [conn1427268] end connection 127.0.0.1:54120 (400 connections now open) 2015-10-05T06:44:32.533+0100 [conn1426838] end connection 172.28.0.164:62281 (399 connections now open) 2015-10-05T06:44:32.534+0100 [mongosMain] connection accepted from 172.28.0.164:63428 #1427269 (400 connections now open) 2015-10-05T06:44:32.536+0100 [conn1427269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:32.760+0100 [conn1426882] end connection 172.28.0.163:53090 (399 connections now open) 2015-10-05T06:44:32.761+0100 [mongosMain] connection accepted from 172.28.0.163:54122 #1427270 (400 connections now open) 2015-10-05T06:44:32.762+0100 [conn1427270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:33.063+0100 [conn1426883] end connection 172.28.0.164:62401 (399 connections now open) 2015-10-05T06:44:33.064+0100 [mongosMain] connection accepted from 172.28.0.164:63430 #1427271 (400 connections now open) 2015-10-05T06:44:33.066+0100 [conn1427271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:36.016+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:36.016+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:36.746+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:36.888+0100 [conn1426579] end connection 172.28.0.163:52226 (399 connections now open) 2015-10-05T06:44:36.890+0100 [mongosMain] connection accepted from 172.28.0.163:54127 #1427272 (400 connections now open) 2015-10-05T06:44:36.891+0100 [conn1427272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:38.017+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:38.017+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:38.070+0100 [conn1426759] end connection 172.28.0.164:62082 (399 connections now open) 2015-10-05T06:44:38.070+0100 [conn1426867] end connection 172.28.0.164:62363 (398 connections now open) 2015-10-05T06:44:38.072+0100 [mongosMain] connection accepted from 172.28.0.164:63442 #1427273 (399 connections now open) 2015-10-05T06:44:38.072+0100 [mongosMain] connection accepted from 172.28.0.164:63443 #1427274 (400 connections now open) 2015-10-05T06:44:38.075+0100 [conn1427273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:38.075+0100 [conn1427274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:38.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e465703b51053ec4e50 2015-10-05T06:44:38.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:39.990+0100 [mongosMain] connection accepted from 127.0.0.1:54129 #1427275 (401 connections now open) 2015-10-05T06:44:39.993+0100 [conn1427275] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:39.997+0100 [conn1427275] end connection 127.0.0.1:54129 (400 connections now open) 2015-10-05T06:44:41.018+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:41.018+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:42.569+0100 [conn1426863] end connection 172.28.0.164:62356 (399 connections now open) 2015-10-05T06:44:42.569+0100 [mongosMain] connection accepted from 172.28.0.164:63452 #1427276 (400 connections now open) 2015-10-05T06:44:42.569+0100 [conn1427276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:42.803+0100 [conn1426889] end connection 172.28.0.163:53105 (399 connections now open) 2015-10-05T06:44:42.803+0100 [mongosMain] connection accepted from 172.28.0.163:54136 #1427277 (400 connections now open) 2015-10-05T06:44:42.803+0100 [conn1427277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:43.099+0100 [conn1426890] end connection 172.28.0.164:62422 (399 connections now open) 2015-10-05T06:44:43.099+0100 [mongosMain] connection accepted from 172.28.0.164:63454 #1427278 (400 connections now open) 2015-10-05T06:44:43.099+0100 [conn1427278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:44.097+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:44:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:44:45.065+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:45.065+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:46.904+0100 [conn1426892] end connection 172.28.0.163:53108 (399 connections now open) 2015-10-05T06:44:46.904+0100 [conn1426835] end connection 172.28.0.163:52954 (398 connections now open) 2015-10-05T06:44:46.905+0100 [mongosMain] connection accepted from 172.28.0.163:54144 #1427279 (399 connections now open) 2015-10-05T06:44:46.905+0100 [mongosMain] connection accepted from 172.28.0.163:54145 #1427280 (400 connections now open) 2015-10-05T06:44:46.906+0100 [conn1427279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:46.907+0100 [conn1427280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:47.760+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:48.071+0100 [conn1426893] end connection 172.28.0.164:62432 (399 connections now open) 2015-10-05T06:44:48.071+0100 [conn1426785] end connection 172.28.0.164:62157 (399 connections now open) 2015-10-05T06:44:48.072+0100 [mongosMain] connection accepted from 172.28.0.164:63466 #1427281 (399 connections now open) 2015-10-05T06:44:48.072+0100 [mongosMain] connection accepted from 172.28.0.164:63465 #1427282 (400 connections now open) 2015-10-05T06:44:48.074+0100 [conn1427281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:48.074+0100 [conn1427282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:50.040+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:50.041+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:50.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e525703b51053ec4ed0 2015-10-05T06:44:50.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:52.563+0100 [conn1426874] end connection 172.28.0.164:62381 (399 connections now open) 2015-10-05T06:44:52.564+0100 [mongosMain] connection accepted from 172.28.0.164:63474 #1427283 (400 connections now open) 2015-10-05T06:44:52.566+0100 [conn1427283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:52.784+0100 [conn1426898] end connection 172.28.0.163:53121 (399 connections now open) 2015-10-05T06:44:52.785+0100 [mongosMain] connection accepted from 172.28.0.163:54153 #1427284 (400 connections now open) 2015-10-05T06:44:52.787+0100 [conn1427284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:53.097+0100 [conn1426899] end connection 172.28.0.164:62445 (399 connections now open) 2015-10-05T06:44:53.098+0100 [mongosMain] connection accepted from 172.28.0.164:63477 #1427285 (400 connections now open) 2015-10-05T06:44:53.100+0100 [conn1427285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:56.044+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:44:56.044+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:44:56.919+0100 [conn1426820] end connection 172.28.0.163:52906 (399 connections now open) 2015-10-05T06:44:56.919+0100 [conn1426877] end connection 172.28.0.163:53080 (398 connections now open) 2015-10-05T06:44:56.920+0100 [mongosMain] connection accepted from 172.28.0.163:54162 #1427286 (399 connections now open) 2015-10-05T06:44:56.920+0100 [mongosMain] connection accepted from 172.28.0.163:54163 #1427287 (400 connections now open) 2015-10-05T06:44:56.921+0100 [conn1427286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:56.921+0100 [conn1427287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:57.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e585703b51053ec4f03 2015-10-05T06:44:57.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:44:58.087+0100 [conn1426879] end connection 172.28.0.164:62388 (399 connections now open) 2015-10-05T06:44:58.087+0100 [conn1426738] end connection 172.28.0.164:62046 (398 connections now open) 2015-10-05T06:44:58.088+0100 [mongosMain] connection accepted from 172.28.0.164:63484 #1427288 (399 connections now open) 2015-10-05T06:44:58.088+0100 [mongosMain] connection accepted from 172.28.0.164:63485 #1427289 (400 connections now open) 2015-10-05T06:44:58.089+0100 [conn1427288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:58.090+0100 [conn1427289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:44:58.769+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:02.563+0100 [conn1426888] end connection 172.28.0.164:62420 (399 connections now open) 2015-10-05T06:45:02.564+0100 [mongosMain] connection accepted from 172.28.0.164:63492 #1427290 (400 connections now open) 2015-10-05T06:45:02.566+0100 [conn1427290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:03.046+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:03.047+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:03.109+0100 [conn1426904] end connection 172.28.0.164:62465 (399 connections now open) 2015-10-05T06:45:03.110+0100 [mongosMain] connection accepted from 172.28.0.164:63494 #1427291 (400 connections now open) 2015-10-05T06:45:03.112+0100 [conn1427291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:03.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e5f5703b51053ec4f42 2015-10-05T06:45:03.524+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:45:06.927+0100 [conn1426861] end connection 172.28.0.163:53022 (399 connections now open) 2015-10-05T06:45:06.929+0100 [mongosMain] connection accepted from 172.28.0.163:54182 #1427292 (400 connections now open) 2015-10-05T06:45:06.930+0100 [conn1427292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:08.118+0100 [conn1426901] end connection 172.28.0.164:62455 (399 connections now open) 2015-10-05T06:45:08.118+0100 [conn1426765] end connection 172.28.0.164:62102 (399 connections now open) 2015-10-05T06:45:08.119+0100 [mongosMain] connection accepted from 172.28.0.164:63498 #1427293 (399 connections now open) 2015-10-05T06:45:08.119+0100 [mongosMain] connection accepted from 172.28.0.164:63499 #1427294 (400 connections now open) 2015-10-05T06:45:08.121+0100 [conn1427293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:08.121+0100 [conn1427294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:09.782+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:09.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e655703b51053ec4f93 2015-10-05T06:45:09.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:45:11.048+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:11.049+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:13.126+0100 [conn1426909] end connection 172.28.0.164:62481 (399 connections now open) 2015-10-05T06:45:13.127+0100 [mongosMain] connection accepted from 172.28.0.164:63507 #1427295 (400 connections now open) 2015-10-05T06:45:13.129+0100 [conn1427295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:14.310+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:45:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:45:16.221+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e6b5703b51053ec4fd4 2015-10-05T06:45:16.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:45:16.936+0100 [conn1426900] end connection 172.28.0.163:53130 (399 connections now open) 2015-10-05T06:45:16.937+0100 [conn1426866] end connection 172.28.0.163:53042 (398 connections now open) 2015-10-05T06:45:16.937+0100 [mongosMain] connection accepted from 172.28.0.163:54198 #1427296 (399 connections now open) 2015-10-05T06:45:16.938+0100 [mongosMain] connection accepted from 172.28.0.163:54199 #1427297 (400 connections now open) 2015-10-05T06:45:16.938+0100 [conn1427296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:16.939+0100 [conn1427297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:18.133+0100 [conn1426751] end connection 172.28.0.164:62070 (399 connections now open) 2015-10-05T06:45:18.133+0100 [conn1426906] end connection 172.28.0.164:62472 (399 connections now open) 2015-10-05T06:45:18.135+0100 [mongosMain] connection accepted from 172.28.0.164:63514 #1427298 (399 connections now open) 2015-10-05T06:45:18.135+0100 [mongosMain] connection accepted from 172.28.0.164:63513 #1427299 (400 connections now open) 2015-10-05T06:45:18.136+0100 [conn1427298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:18.137+0100 [conn1427299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:20.058+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:20.058+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:20.784+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:22.254+0100 [conn1426862] end connection 172.28.0.163:53032 (399 connections now open) 2015-10-05T06:45:22.255+0100 [mongosMain] connection accepted from 172.28.0.163:54205 #1427300 (400 connections now open) 2015-10-05T06:45:22.256+0100 [conn1427300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:22.582+0100 [conn1426897] end connection 172.28.0.164:62443 (399 connections now open) 2015-10-05T06:45:22.583+0100 [mongosMain] connection accepted from 172.28.0.164:63524 #1427301 (400 connections now open) 2015-10-05T06:45:22.584+0100 [conn1427301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:22.800+0100 [conn1426903] end connection 172.28.0.163:53141 (399 connections now open) 2015-10-05T06:45:22.801+0100 [mongosMain] connection accepted from 172.28.0.163:54207 #1427302 (400 connections now open) 2015-10-05T06:45:22.803+0100 [conn1427302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:23.125+0100 [conn1426914] end connection 172.28.0.164:62492 (399 connections now open) 2015-10-05T06:45:23.127+0100 [mongosMain] connection accepted from 172.28.0.164:63526 #1427303 (400 connections now open) 2015-10-05T06:45:23.129+0100 [conn1427303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:26.940+0100 [conn1426916] end connection 172.28.0.163:53189 (399 connections now open) 2015-10-05T06:45:26.940+0100 [conn1426911] end connection 172.28.0.163:53167 (399 connections now open) 2015-10-05T06:45:26.941+0100 [mongosMain] connection accepted from 172.28.0.163:54209 #1427304 (399 connections now open) 2015-10-05T06:45:26.941+0100 [mongosMain] connection accepted from 172.28.0.163:54210 #1427305 (400 connections now open) 2015-10-05T06:45:26.942+0100 [conn1427305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:26.942+0100 [conn1427304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:28.150+0100 [conn1426885] end connection 172.28.0.164:62411 (399 connections now open) 2015-10-05T06:45:28.150+0100 [conn1426801] end connection 172.28.0.164:62182 (398 connections now open) 2015-10-05T06:45:28.151+0100 [mongosMain] connection accepted from 172.28.0.164:63534 #1427306 (399 connections now open) 2015-10-05T06:45:28.152+0100 [mongosMain] connection accepted from 172.28.0.164:63535 #1427307 (400 connections now open) 2015-10-05T06:45:28.153+0100 [conn1427306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:28.154+0100 [conn1427307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:28.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e785703b51053ec5054 2015-10-05T06:45:28.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:45:29.144+0100 [mongosMain] connection accepted from 127.0.0.1:54214 #1427308 (401 connections now open) 2015-10-05T06:45:29.147+0100 [conn1427308] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:29.152+0100 [conn1427308] end connection 127.0.0.1:54214 (400 connections now open) 2015-10-05T06:45:30.060+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:30.060+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:31.790+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:32.270+0100 [conn1426857] end connection 172.28.0.163:53009 (399 connections now open) 2015-10-05T06:45:32.272+0100 [mongosMain] connection accepted from 172.28.0.163:54218 #1427309 (400 connections now open) 2015-10-05T06:45:32.273+0100 [conn1427309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:32.595+0100 [conn1426869] end connection 172.28.0.164:62369 (399 connections now open) 2015-10-05T06:45:32.596+0100 [mongosMain] connection accepted from 172.28.0.164:63541 #1427310 (400 connections now open) 2015-10-05T06:45:32.597+0100 [conn1427310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:32.816+0100 [conn1426921] end connection 172.28.0.163:53195 (399 connections now open) 2015-10-05T06:45:32.818+0100 [mongosMain] connection accepted from 172.28.0.163:54219 #1427311 (400 connections now open) 2015-10-05T06:45:32.818+0100 [conn1427311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:33.141+0100 [conn1426922] end connection 172.28.0.164:62510 (399 connections now open) 2015-10-05T06:45:33.142+0100 [mongosMain] connection accepted from 172.28.0.164:63544 #1427312 (400 connections now open) 2015-10-05T06:45:33.145+0100 [conn1427312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:36.950+0100 [conn1426905] end connection 172.28.0.163:53151 (399 connections now open) 2015-10-05T06:45:36.950+0100 [conn1426915] end connection 172.28.0.163:53188 (399 connections now open) 2015-10-05T06:45:36.952+0100 [mongosMain] connection accepted from 172.28.0.163:54224 #1427313 (399 connections now open) 2015-10-05T06:45:36.952+0100 [mongosMain] connection accepted from 172.28.0.163:54225 #1427314 (400 connections now open) 2015-10-05T06:45:36.953+0100 [conn1427313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:36.953+0100 [conn1427314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:39.620+0100 [mongosMain] connection accepted from 127.0.0.1:54228 #1427315 (401 connections now open) 2015-10-05T06:45:39.623+0100 [conn1427315] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:39.627+0100 [conn1427315] end connection 127.0.0.1:54228 (400 connections now open) 2015-10-05T06:45:41.067+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:41.068+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:42.270+0100 [conn1426868] end connection 172.28.0.163:53052 (399 connections now open) 2015-10-05T06:45:42.271+0100 [mongosMain] connection accepted from 172.28.0.163:54234 #1427316 (400 connections now open) 2015-10-05T06:45:42.272+0100 [conn1427316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:42.611+0100 [conn1426908] end connection 172.28.0.164:62479 (399 connections now open) 2015-10-05T06:45:42.612+0100 [mongosMain] connection accepted from 172.28.0.164:63560 #1427317 (400 connections now open) 2015-10-05T06:45:42.614+0100 [conn1427317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:42.799+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:42.816+0100 [conn1426928] end connection 172.28.0.163:53211 (399 connections now open) 2015-10-05T06:45:42.817+0100 [mongosMain] connection accepted from 172.28.0.163:54236 #1427318 (400 connections now open) 2015-10-05T06:45:42.818+0100 [conn1427318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:44.564+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:45:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:45:46.951+0100 [conn1426884] end connection 172.28.0.163:53094 (399 connections now open) 2015-10-05T06:45:46.952+0100 [mongosMain] connection accepted from 172.28.0.163:54246 #1427319 (400 connections now open) 2015-10-05T06:45:46.953+0100 [conn1427319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:46.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120e8a5703b51053ec50ce 2015-10-05T06:45:47.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:45:48.166+0100 [conn1426924] end connection 172.28.0.164:62522 (399 connections now open) 2015-10-05T06:45:48.167+0100 [mongosMain] connection accepted from 172.28.0.164:63573 #1427320 (400 connections now open) 2015-10-05T06:45:48.169+0100 [conn1427320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:52.285+0100 [conn1426774] end connection 172.28.0.163:52789 (399 connections now open) 2015-10-05T06:45:52.286+0100 [mongosMain] connection accepted from 172.28.0.163:54254 #1427321 (400 connections now open) 2015-10-05T06:45:52.287+0100 [conn1427321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:52.626+0100 [conn1426902] end connection 172.28.0.164:62462 (399 connections now open) 2015-10-05T06:45:52.627+0100 [mongosMain] connection accepted from 172.28.0.164:63577 #1427322 (400 connections now open) 2015-10-05T06:45:52.630+0100 [conn1427322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:52.831+0100 [conn1426935] end connection 172.28.0.163:53229 (399 connections now open) 2015-10-05T06:45:52.832+0100 [mongosMain] connection accepted from 172.28.0.163:54257 #1427323 (400 connections now open) 2015-10-05T06:45:52.833+0100 [conn1427323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:53.068+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:53.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:53.157+0100 [conn1426929] end connection 172.28.0.164:62530 (399 connections now open) 2015-10-05T06:45:53.158+0100 [mongosMain] connection accepted from 172.28.0.164:63580 #1427324 (400 connections now open) 2015-10-05T06:45:53.160+0100 [conn1427324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:53.812+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:55.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:55.073+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:56.966+0100 [conn1426923] end connection 172.28.0.163:53200 (399 connections now open) 2015-10-05T06:45:56.967+0100 [mongosMain] connection accepted from 172.28.0.163:54264 #1427325 (400 connections now open) 2015-10-05T06:45:56.968+0100 [conn1427325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:58.094+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:45:58.094+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:45:58.181+0100 [conn1426912] end connection 172.28.0.164:62486 (399 connections now open) 2015-10-05T06:45:58.181+0100 [conn1426808] end connection 172.28.0.164:62201 (399 connections now open) 2015-10-05T06:45:58.181+0100 [mongosMain] connection accepted from 172.28.0.164:63588 #1427326 (399 connections now open) 2015-10-05T06:45:58.182+0100 [mongosMain] connection accepted from 172.28.0.164:63589 #1427327 (400 connections now open) 2015-10-05T06:45:58.183+0100 [conn1427327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:58.184+0100 [conn1427326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:45:59.209+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:45:59.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:46:02.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:02.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:02.301+0100 [conn1426873] end connection 172.28.0.163:53072 (399 connections now open) 2015-10-05T06:46:02.302+0100 [mongosMain] connection accepted from 172.28.0.163:54274 #1427328 (400 connections now open) 2015-10-05T06:46:02.303+0100 [conn1427328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:02.641+0100 [conn1426934] end connection 172.28.0.164:62546 (399 connections now open) 2015-10-05T06:46:02.643+0100 [mongosMain] connection accepted from 172.28.0.164:63594 #1427329 (400 connections now open) 2015-10-05T06:46:02.644+0100 [conn1427329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:02.847+0100 [conn1426942] end connection 172.28.0.163:53250 (399 connections now open) 2015-10-05T06:46:02.849+0100 [mongosMain] connection accepted from 172.28.0.163:54277 #1427330 (400 connections now open) 2015-10-05T06:46:02.850+0100 [conn1427330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:03.173+0100 [conn1426943] end connection 172.28.0.164:62568 (399 connections now open) 2015-10-05T06:46:03.175+0100 [mongosMain] connection accepted from 172.28.0.164:63595 #1427331 (400 connections now open) 2015-10-05T06:46:03.178+0100 [conn1427331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:04.849+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:06.970+0100 [conn1426944] end connection 172.28.0.163:53260 (399 connections now open) 2015-10-05T06:46:06.970+0100 [conn1426878] end connection 172.28.0.163:53081 (398 connections now open) 2015-10-05T06:46:06.971+0100 [mongosMain] connection accepted from 172.28.0.163:54287 #1427332 (399 connections now open) 2015-10-05T06:46:06.971+0100 [mongosMain] connection accepted from 172.28.0.163:54288 #1427333 (400 connections now open) 2015-10-05T06:46:06.972+0100 [conn1427332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:06.972+0100 [conn1427333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:07.104+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:07.105+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:08.181+0100 [conn1426894] end connection 172.28.0.164:62433 (399 connections now open) 2015-10-05T06:46:08.181+0100 [conn1426939] end connection 172.28.0.164:62559 (398 connections now open) 2015-10-05T06:46:08.183+0100 [mongosMain] connection accepted from 172.28.0.164:63600 #1427334 (399 connections now open) 2015-10-05T06:46:08.183+0100 [mongosMain] connection accepted from 172.28.0.164:63601 #1427335 (400 connections now open) 2015-10-05T06:46:08.185+0100 [conn1427334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:08.185+0100 [conn1427335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:11.355+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:46:11.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:46:12.302+0100 [conn1426887] end connection 172.28.0.163:53102 (399 connections now open) 2015-10-05T06:46:12.303+0100 [mongosMain] connection accepted from 172.28.0.163:54294 #1427336 (400 connections now open) 2015-10-05T06:46:12.304+0100 [conn1427336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:12.643+0100 [conn1426705] end connection 172.28.0.164:61916 (399 connections now open) 2015-10-05T06:46:12.644+0100 [mongosMain] connection accepted from 172.28.0.164:63606 #1427337 (400 connections now open) 2015-10-05T06:46:12.645+0100 [conn1427337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:12.848+0100 [conn1426949] end connection 172.28.0.163:53272 (399 connections now open) 2015-10-05T06:46:12.849+0100 [mongosMain] connection accepted from 172.28.0.163:54297 #1427338 (400 connections now open) 2015-10-05T06:46:12.850+0100 [conn1427338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:13.108+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:13.108+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:13.173+0100 [conn1426950] end connection 172.28.0.164:62581 (399 connections now open) 2015-10-05T06:46:13.174+0100 [mongosMain] connection accepted from 172.28.0.164:63608 #1427339 (400 connections now open) 2015-10-05T06:46:13.176+0100 [conn1427339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:14.702+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:46:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:46:15.853+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:16.982+0100 [conn1426930] end connection 172.28.0.163:53217 (399 connections now open) 2015-10-05T06:46:16.982+0100 [conn1426872] end connection 172.28.0.163:53061 (398 connections now open) 2015-10-05T06:46:16.983+0100 [mongosMain] connection accepted from 172.28.0.163:54304 #1427340 (399 connections now open) 2015-10-05T06:46:16.983+0100 [mongosMain] connection accepted from 172.28.0.163:54305 #1427341 (400 connections now open) 2015-10-05T06:46:16.984+0100 [conn1427340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:16.984+0100 [conn1427341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:17.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ea95703b51053ec51ca 2015-10-05T06:46:17.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:46:18.197+0100 [conn1426907] end connection 172.28.0.164:62473 (399 connections now open) 2015-10-05T06:46:18.197+0100 [conn1426946] end connection 172.28.0.164:62576 (398 connections now open) 2015-10-05T06:46:18.198+0100 [mongosMain] connection accepted from 172.28.0.164:63615 #1427342 (399 connections now open) 2015-10-05T06:46:18.198+0100 [mongosMain] connection accepted from 172.28.0.164:63616 #1427343 (400 connections now open) 2015-10-05T06:46:18.200+0100 [conn1427342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:18.202+0100 [conn1427343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:20.111+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:20.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:22.317+0100 [conn1426830] end connection 172.28.0.163:52940 (399 connections now open) 2015-10-05T06:46:22.318+0100 [mongosMain] connection accepted from 172.28.0.163:54311 #1427344 (400 connections now open) 2015-10-05T06:46:22.319+0100 [conn1427344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:22.658+0100 [conn1426881] end connection 172.28.0.164:62398 (399 connections now open) 2015-10-05T06:46:22.660+0100 [mongosMain] connection accepted from 172.28.0.164:63625 #1427345 (400 connections now open) 2015-10-05T06:46:22.662+0100 [conn1427345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:22.863+0100 [conn1426955] end connection 172.28.0.163:53291 (399 connections now open) 2015-10-05T06:46:22.864+0100 [mongosMain] connection accepted from 172.28.0.163:54313 #1427346 (400 connections now open) 2015-10-05T06:46:22.865+0100 [conn1427346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:23.189+0100 [conn1426956] end connection 172.28.0.164:62593 (399 connections now open) 2015-10-05T06:46:23.190+0100 [mongosMain] connection accepted from 172.28.0.164:63628 #1427347 (400 connections now open) 2015-10-05T06:46:23.194+0100 [conn1427347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:23.747+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:46:23.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:46:26.863+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:26.999+0100 [conn1426951] end connection 172.28.0.163:53281 (399 connections now open) 2015-10-05T06:46:27.000+0100 [mongosMain] connection accepted from 172.28.0.163:54316 #1427348 (400 connections now open) 2015-10-05T06:46:27.001+0100 [conn1427348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:28.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:28.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:28.194+0100 [mongosMain] connection accepted from 127.0.0.1:54319 #1427349 (401 connections now open) 2015-10-05T06:46:28.197+0100 [conn1427349] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:28.202+0100 [conn1427349] end connection 127.0.0.1:54319 (400 connections now open) 2015-10-05T06:46:28.213+0100 [conn1426918] end connection 172.28.0.164:62498 (399 connections now open) 2015-10-05T06:46:28.218+0100 [mongosMain] connection accepted from 172.28.0.164:63637 #1427350 (400 connections now open) 2015-10-05T06:46:28.219+0100 [conn1427350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:29.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120eb55703b51053ec5238 2015-10-05T06:46:30.024+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:46:32.321+0100 [conn1426919] end connection 172.28.0.163:53194 (399 connections now open) 2015-10-05T06:46:32.322+0100 [mongosMain] connection accepted from 172.28.0.163:54320 #1427351 (400 connections now open) 2015-10-05T06:46:32.323+0100 [conn1427351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:32.867+0100 [conn1426962] end connection 172.28.0.163:53310 (399 connections now open) 2015-10-05T06:46:32.868+0100 [mongosMain] connection accepted from 172.28.0.163:54322 #1427352 (400 connections now open) 2015-10-05T06:46:32.870+0100 [conn1427352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:33.204+0100 [conn1426963] end connection 172.28.0.164:62611 (399 connections now open) 2015-10-05T06:46:33.205+0100 [mongosMain] connection accepted from 172.28.0.164:63646 #1427353 (400 connections now open) 2015-10-05T06:46:33.206+0100 [conn1427353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:37.003+0100 [conn1426957] end connection 172.28.0.163:53297 (399 connections now open) 2015-10-05T06:46:37.005+0100 [mongosMain] connection accepted from 172.28.0.163:54326 #1427354 (400 connections now open) 2015-10-05T06:46:37.015+0100 [conn1427354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:37.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:37.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:37.869+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:38.228+0100 [conn1426913] end connection 172.28.0.164:62487 (399 connections now open) 2015-10-05T06:46:38.229+0100 [conn1426967] end connection 172.28.0.164:62623 (398 connections now open) 2015-10-05T06:46:38.229+0100 [mongosMain] connection accepted from 172.28.0.164:63656 #1427355 (399 connections now open) 2015-10-05T06:46:38.230+0100 [mongosMain] connection accepted from 172.28.0.164:63657 #1427356 (400 connections now open) 2015-10-05T06:46:38.231+0100 [conn1427355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:38.231+0100 [conn1427356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:39.923+0100 [mongosMain] connection accepted from 127.0.0.1:54328 #1427357 (401 connections now open) 2015-10-05T06:46:39.928+0100 [conn1427357] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:39.933+0100 [conn1427357] end connection 127.0.0.1:54328 (400 connections now open) 2015-10-05T06:46:42.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ec25703b51053ec52b6 2015-10-05T06:46:42.332+0100 [conn1426880] end connection 172.28.0.163:53089 (399 connections now open) 2015-10-05T06:46:42.333+0100 [mongosMain] connection accepted from 172.28.0.163:54331 #1427358 (400 connections now open) 2015-10-05T06:46:42.334+0100 [conn1427358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:42.448+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:46:42.879+0100 [conn1426970] end connection 172.28.0.163:53322 (399 connections now open) 2015-10-05T06:46:42.880+0100 [mongosMain] connection accepted from 172.28.0.163:54333 #1427359 (400 connections now open) 2015-10-05T06:46:42.881+0100 [conn1427359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:43.219+0100 [conn1426971] end connection 172.28.0.164:62631 (399 connections now open) 2015-10-05T06:46:43.220+0100 [mongosMain] connection accepted from 172.28.0.164:63667 #1427360 (400 connections now open) 2015-10-05T06:46:43.223+0100 [conn1427360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:44.975+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:46:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:46:47.013+0100 [conn1426937] end connection 172.28.0.163:53239 (399 connections now open) 2015-10-05T06:46:47.014+0100 [mongosMain] connection accepted from 172.28.0.163:54341 #1427361 (400 connections now open) 2015-10-05T06:46:47.015+0100 [conn1427361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:47.127+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:47.127+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:48.260+0100 [conn1426917] end connection 172.28.0.164:62499 (399 connections now open) 2015-10-05T06:46:48.260+0100 [conn1426692] end connection 172.28.0.164:61873 (399 connections now open) 2015-10-05T06:46:48.261+0100 [mongosMain] connection accepted from 172.28.0.164:63674 #1427362 (399 connections now open) 2015-10-05T06:46:48.262+0100 [mongosMain] connection accepted from 172.28.0.164:63673 #1427363 (400 connections now open) 2015-10-05T06:46:48.263+0100 [conn1427362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:48.264+0100 [conn1427363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:48.873+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:52.334+0100 [conn1426837] end connection 172.28.0.163:52963 (399 connections now open) 2015-10-05T06:46:52.336+0100 [mongosMain] connection accepted from 172.28.0.163:54355 #1427364 (400 connections now open) 2015-10-05T06:46:52.337+0100 [conn1427364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:52.704+0100 [conn1426941] end connection 172.28.0.164:62565 (399 connections now open) 2015-10-05T06:46:52.705+0100 [mongosMain] connection accepted from 172.28.0.164:63680 #1427365 (400 connections now open) 2015-10-05T06:46:52.706+0100 [conn1427365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:52.880+0100 [conn1426977] end connection 172.28.0.163:53333 (399 connections now open) 2015-10-05T06:46:52.881+0100 [mongosMain] connection accepted from 172.28.0.163:54357 #1427366 (400 connections now open) 2015-10-05T06:46:52.883+0100 [conn1427366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:53.251+0100 [conn1426978] end connection 172.28.0.164:62652 (399 connections now open) 2015-10-05T06:46:53.252+0100 [mongosMain] connection accepted from 172.28.0.164:63683 #1427367 (400 connections now open) 2015-10-05T06:46:53.254+0100 [conn1427367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:54.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ece5703b51053ec533c 2015-10-05T06:46:54.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:46:57.015+0100 [conn1426964] end connection 172.28.0.163:53313 (399 connections now open) 2015-10-05T06:46:57.015+0100 [conn1426931] end connection 172.28.0.163:53218 (398 connections now open) 2015-10-05T06:46:57.016+0100 [mongosMain] connection accepted from 172.28.0.163:54364 #1427368 (399 connections now open) 2015-10-05T06:46:57.017+0100 [mongosMain] connection accepted from 172.28.0.163:54366 #1427369 (400 connections now open) 2015-10-05T06:46:57.018+0100 [conn1427368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:57.018+0100 [conn1427369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:46:58.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:46:58.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:46:59.885+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:00.817+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:47:00.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:47:02.348+0100 [conn1426933] end connection 172.28.0.163:53227 (399 connections now open) 2015-10-05T06:47:02.349+0100 [mongosMain] connection accepted from 172.28.0.163:54378 #1427370 (400 connections now open) 2015-10-05T06:47:02.350+0100 [conn1427370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:02.721+0100 [conn1426920] end connection 172.28.0.164:62508 (399 connections now open) 2015-10-05T06:47:02.722+0100 [mongosMain] connection accepted from 172.28.0.164:63692 #1427371 (400 connections now open) 2015-10-05T06:47:02.724+0100 [conn1427371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:02.894+0100 [conn1426984] end connection 172.28.0.163:53353 (399 connections now open) 2015-10-05T06:47:02.896+0100 [mongosMain] connection accepted from 172.28.0.163:54381 #1427372 (400 connections now open) 2015-10-05T06:47:02.897+0100 [conn1427372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:03.266+0100 [conn1426985] end connection 172.28.0.164:62671 (399 connections now open) 2015-10-05T06:47:03.267+0100 [mongosMain] connection accepted from 172.28.0.164:63695 #1427373 (400 connections now open) 2015-10-05T06:47:03.269+0100 [conn1427373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:07.029+0100 [conn1426980] end connection 172.28.0.163:53344 (399 connections now open) 2015-10-05T06:47:07.029+0100 [conn1426958] end connection 172.28.0.163:53299 (399 connections now open) 2015-10-05T06:47:07.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120eda5703b51053ec5403 2015-10-05T06:47:07.030+0100 [mongosMain] connection accepted from 172.28.0.163:54388 #1427374 (399 connections now open) 2015-10-05T06:47:07.030+0100 [mongosMain] connection accepted from 172.28.0.163:54389 #1427375 (400 connections now open) 2015-10-05T06:47:07.031+0100 [conn1427374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:07.031+0100 [conn1427375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:07.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:08.291+0100 [conn1426974] end connection 172.28.0.164:62639 (399 connections now open) 2015-10-05T06:47:08.291+0100 [conn1426953] end connection 172.28.0.164:62587 (398 connections now open) 2015-10-05T06:47:08.292+0100 [mongosMain] connection accepted from 172.28.0.164:63699 #1427376 (399 connections now open) 2015-10-05T06:47:08.292+0100 [mongosMain] connection accepted from 172.28.0.164:63700 #1427377 (400 connections now open) 2015-10-05T06:47:08.294+0100 [conn1427376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:08.295+0100 [conn1427377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:10.132+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:10.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:10.896+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:12.132+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:12.133+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:12.350+0100 [conn1426896] end connection 172.28.0.163:53119 (399 connections now open) 2015-10-05T06:47:12.351+0100 [mongosMain] connection accepted from 172.28.0.163:54402 #1427378 (400 connections now open) 2015-10-05T06:47:12.353+0100 [conn1427378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:12.721+0100 [conn1426961] end connection 172.28.0.164:62609 (399 connections now open) 2015-10-05T06:47:12.722+0100 [mongosMain] connection accepted from 172.28.0.164:63703 #1427379 (400 connections now open) 2015-10-05T06:47:12.725+0100 [conn1427379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:12.895+0100 [conn1426990] end connection 172.28.0.163:53374 (399 connections now open) 2015-10-05T06:47:12.896+0100 [mongosMain] connection accepted from 172.28.0.163:54404 #1427380 (400 connections now open) 2015-10-05T06:47:12.897+0100 [conn1427380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:13.267+0100 [conn1426991] end connection 172.28.0.164:62685 (399 connections now open) 2015-10-05T06:47:13.268+0100 [mongosMain] connection accepted from 172.28.0.164:63705 #1427381 (400 connections now open) 2015-10-05T06:47:13.270+0100 [conn1427381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:15.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:15.136+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:15.251+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:47:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:47:18.306+0100 [conn1426982] end connection 172.28.0.164:62662 (399 connections now open) 2015-10-05T06:47:18.306+0100 [conn1426994] end connection 172.28.0.164:62690 (399 connections now open) 2015-10-05T06:47:18.308+0100 [mongosMain] connection accepted from 172.28.0.164:63712 #1427382 (399 connections now open) 2015-10-05T06:47:18.308+0100 [mongosMain] connection accepted from 172.28.0.164:63713 #1427383 (400 connections now open) 2015-10-05T06:47:18.310+0100 [conn1427382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:18.311+0100 [conn1427383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:19.138+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:19.138+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:19.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ee75703b51053ec54ab 2015-10-05T06:47:19.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:21.900+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:22.364+0100 [conn1426940] end connection 172.28.0.163:53248 (399 connections now open) 2015-10-05T06:47:22.365+0100 [mongosMain] connection accepted from 172.28.0.163:54418 #1427384 (400 connections now open) 2015-10-05T06:47:22.366+0100 [conn1427384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:22.737+0100 [conn1426989] end connection 172.28.0.164:62683 (399 connections now open) 2015-10-05T06:47:22.738+0100 [mongosMain] connection accepted from 172.28.0.164:63721 #1427385 (400 connections now open) 2015-10-05T06:47:22.740+0100 [conn1427385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:22.910+0100 [conn1426997] end connection 172.28.0.163:53395 (399 connections now open) 2015-10-05T06:47:22.911+0100 [mongosMain] connection accepted from 172.28.0.163:54420 #1427386 (400 connections now open) 2015-10-05T06:47:22.912+0100 [conn1427386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:23.282+0100 [conn1426998] end connection 172.28.0.164:62696 (399 connections now open) 2015-10-05T06:47:23.283+0100 [mongosMain] connection accepted from 172.28.0.164:63727 #1427387 (400 connections now open) 2015-10-05T06:47:23.285+0100 [conn1427387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:24.149+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:24.149+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:25.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120eed5703b51053ec5508 2015-10-05T06:47:25.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:27.045+0100 [conn1426993] end connection 172.28.0.163:53386 (399 connections now open) 2015-10-05T06:47:27.046+0100 [mongosMain] connection accepted from 172.28.0.163:54423 #1427388 (400 connections now open) 2015-10-05T06:47:27.048+0100 [conn1427388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:28.322+0100 [conn1426981] end connection 172.28.0.164:62661 (399 connections now open) 2015-10-05T06:47:28.322+0100 [conn1426966] end connection 172.28.0.164:62622 (398 connections now open) 2015-10-05T06:47:28.323+0100 [mongosMain] connection accepted from 172.28.0.164:63736 #1427389 (399 connections now open) 2015-10-05T06:47:28.323+0100 [mongosMain] connection accepted from 172.28.0.164:63737 #1427390 (400 connections now open) 2015-10-05T06:47:28.324+0100 [conn1427389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:28.326+0100 [conn1427390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:29.068+0100 [mongosMain] connection accepted from 127.0.0.1:54427 #1427391 (401 connections now open) 2015-10-05T06:47:29.071+0100 [conn1427391] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:29.075+0100 [conn1427391] end connection 127.0.0.1:54427 (400 connections now open) 2015-10-05T06:47:30.204+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:30.205+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:31.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ef35703b51053ec5566 2015-10-05T06:47:31.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:32.380+0100 [conn1426926] end connection 172.28.0.163:53209 (399 connections now open) 2015-10-05T06:47:32.386+0100 [mongosMain] connection accepted from 172.28.0.163:54430 #1427392 (400 connections now open) 2015-10-05T06:47:32.387+0100 [conn1427392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:32.737+0100 [conn1426948] end connection 172.28.0.164:62580 (399 connections now open) 2015-10-05T06:47:32.738+0100 [mongosMain] connection accepted from 172.28.0.164:63743 #1427393 (400 connections now open) 2015-10-05T06:47:32.740+0100 [conn1427393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:32.910+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:32.926+0100 [conn1427004] end connection 172.28.0.163:53410 (399 connections now open) 2015-10-05T06:47:32.927+0100 [mongosMain] connection accepted from 172.28.0.163:54432 #1427394 (400 connections now open) 2015-10-05T06:47:32.928+0100 [conn1427394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:33.282+0100 [conn1427005] end connection 172.28.0.164:62712 (399 connections now open) 2015-10-05T06:47:33.283+0100 [mongosMain] connection accepted from 172.28.0.164:63746 #1427395 (400 connections now open) 2015-10-05T06:47:33.285+0100 [conn1427395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:37.061+0100 [conn1426972] end connection 172.28.0.163:53324 (399 connections now open) 2015-10-05T06:47:37.062+0100 [mongosMain] connection accepted from 172.28.0.163:54437 #1427396 (400 connections now open) 2015-10-05T06:47:37.063+0100 [conn1427396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:37.209+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:37.209+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:37.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ef95703b51053ec55a9 2015-10-05T06:47:38.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:38.322+0100 [conn1427002] end connection 172.28.0.164:62703 (399 connections now open) 2015-10-05T06:47:38.328+0100 [conn1426744] end connection 172.28.0.164:62060 (398 connections now open) 2015-10-05T06:47:38.330+0100 [mongosMain] connection accepted from 172.28.0.164:63755 #1427397 (399 connections now open) 2015-10-05T06:47:38.330+0100 [mongosMain] connection accepted from 172.28.0.164:63756 #1427398 (400 connections now open) 2015-10-05T06:47:38.338+0100 [conn1427398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:38.339+0100 [conn1427397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:39.489+0100 [mongosMain] connection accepted from 127.0.0.1:54440 #1427399 (401 connections now open) 2015-10-05T06:47:39.492+0100 [conn1427399] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:39.497+0100 [conn1427399] end connection 127.0.0.1:54440 (400 connections now open) 2015-10-05T06:47:42.380+0100 [conn1426947] end connection 172.28.0.163:53269 (399 connections now open) 2015-10-05T06:47:42.382+0100 [mongosMain] connection accepted from 172.28.0.163:54446 #1427400 (400 connections now open) 2015-10-05T06:47:42.383+0100 [conn1427400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:42.752+0100 [conn1426996] end connection 172.28.0.164:62693 (399 connections now open) 2015-10-05T06:47:42.754+0100 [mongosMain] connection accepted from 172.28.0.164:63764 #1427401 (400 connections now open) 2015-10-05T06:47:42.755+0100 [conn1427401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:42.926+0100 [conn1427012] end connection 172.28.0.163:53420 (399 connections now open) 2015-10-05T06:47:42.928+0100 [mongosMain] connection accepted from 172.28.0.163:54449 #1427402 (400 connections now open) 2015-10-05T06:47:42.929+0100 [conn1427402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:43.298+0100 [conn1427013] end connection 172.28.0.164:62733 (399 connections now open) 2015-10-05T06:47:43.300+0100 [mongosMain] connection accepted from 172.28.0.164:63766 #1427403 (400 connections now open) 2015-10-05T06:47:43.302+0100 [conn1427403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:43.923+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:44.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f005703b51053ec55f6 2015-10-05T06:47:44.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:45.215+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:45.215+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:45.549+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:47:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:47:47.061+0100 [conn1426757] end connection 172.28.0.163:52759 (399 connections now open) 2015-10-05T06:47:47.062+0100 [conn1426987] end connection 172.28.0.163:53363 (398 connections now open) 2015-10-05T06:47:47.062+0100 [mongosMain] connection accepted from 172.28.0.163:54456 #1427404 (399 connections now open) 2015-10-05T06:47:47.063+0100 [mongosMain] connection accepted from 172.28.0.163:54457 #1427405 (400 connections now open) 2015-10-05T06:47:47.063+0100 [conn1427404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:47.064+0100 [conn1427405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:48.338+0100 [conn1427008] end connection 172.28.0.164:62723 (399 connections now open) 2015-10-05T06:47:48.338+0100 [mongosMain] connection accepted from 172.28.0.164:63776 #1427406 (400 connections now open) 2015-10-05T06:47:48.339+0100 [conn1426945] end connection 172.28.0.164:62575 (399 connections now open) 2015-10-05T06:47:48.340+0100 [mongosMain] connection accepted from 172.28.0.164:63777 #1427407 (400 connections now open) 2015-10-05T06:47:48.341+0100 [conn1427406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:48.342+0100 [conn1427407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:52.753+0100 [conn1426927] end connection 172.28.0.164:62528 (399 connections now open) 2015-10-05T06:47:52.756+0100 [mongosMain] connection accepted from 172.28.0.164:63782 #1427408 (400 connections now open) 2015-10-05T06:47:52.757+0100 [conn1427408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:52.942+0100 [conn1427020] end connection 172.28.0.163:53431 (399 connections now open) 2015-10-05T06:47:52.943+0100 [mongosMain] connection accepted from 172.28.0.163:54465 #1427409 (400 connections now open) 2015-10-05T06:47:52.944+0100 [conn1427409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:53.299+0100 [conn1427021] end connection 172.28.0.164:62756 (399 connections now open) 2015-10-05T06:47:53.300+0100 [mongosMain] connection accepted from 172.28.0.164:63785 #1427410 (400 connections now open) 2015-10-05T06:47:53.302+0100 [conn1427410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:54.221+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:54.222+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:47:54.930+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:47:57.076+0100 [conn1426891] end connection 172.28.0.163:53107 (399 connections now open) 2015-10-05T06:47:57.076+0100 [conn1426999] end connection 172.28.0.163:53402 (398 connections now open) 2015-10-05T06:47:57.077+0100 [mongosMain] connection accepted from 172.28.0.163:54473 #1427411 (399 connections now open) 2015-10-05T06:47:57.078+0100 [mongosMain] connection accepted from 172.28.0.163:54474 #1427412 (400 connections now open) 2015-10-05T06:47:57.078+0100 [conn1427411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:57.079+0100 [conn1427412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:57.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f0c5703b51053ec5665 2015-10-05T06:47:57.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:47:58.338+0100 [conn1427001] end connection 172.28.0.164:62702 (399 connections now open) 2015-10-05T06:47:58.338+0100 [conn1427024] end connection 172.28.0.164:62765 (399 connections now open) 2015-10-05T06:47:58.339+0100 [mongosMain] connection accepted from 172.28.0.164:63793 #1427413 (399 connections now open) 2015-10-05T06:47:58.339+0100 [mongosMain] connection accepted from 172.28.0.164:63794 #1427414 (400 connections now open) 2015-10-05T06:47:58.341+0100 [conn1427413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:47:58.341+0100 [conn1427414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:02.768+0100 [conn1427011] end connection 172.28.0.164:62730 (399 connections now open) 2015-10-05T06:48:02.768+0100 [mongosMain] connection accepted from 172.28.0.164:63795 #1427415 (400 connections now open) 2015-10-05T06:48:02.770+0100 [conn1427415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:02.943+0100 [conn1427026] end connection 172.28.0.163:53448 (399 connections now open) 2015-10-05T06:48:02.944+0100 [mongosMain] connection accepted from 172.28.0.163:54484 #1427416 (400 connections now open) 2015-10-05T06:48:02.946+0100 [conn1427416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:03.314+0100 [conn1427027] end connection 172.28.0.164:62776 (399 connections now open) 2015-10-05T06:48:03.315+0100 [mongosMain] connection accepted from 172.28.0.164:63797 #1427417 (400 connections now open) 2015-10-05T06:48:03.316+0100 [conn1427417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:03.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f135703b51053ec569c 2015-10-05T06:48:03.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:48:04.234+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:04.235+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:05.938+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:07.081+0100 [conn1427014] end connection 172.28.0.163:53424 (399 connections now open) 2015-10-05T06:48:07.081+0100 [conn1426992] end connection 172.28.0.163:53385 (399 connections now open) 2015-10-05T06:48:07.082+0100 [mongosMain] connection accepted from 172.28.0.163:54493 #1427418 (399 connections now open) 2015-10-05T06:48:07.082+0100 [mongosMain] connection accepted from 172.28.0.163:54494 #1427419 (400 connections now open) 2015-10-05T06:48:07.083+0100 [conn1427418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:07.083+0100 [conn1427419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:08.354+0100 [conn1427030] end connection 172.28.0.164:62782 (399 connections now open) 2015-10-05T06:48:08.355+0100 [mongosMain] connection accepted from 172.28.0.164:63803 #1427420 (400 connections now open) 2015-10-05T06:48:08.356+0100 [conn1427420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:12.957+0100 [conn1427033] end connection 172.28.0.163:53472 (399 connections now open) 2015-10-05T06:48:12.959+0100 [mongosMain] connection accepted from 172.28.0.163:54501 #1427421 (400 connections now open) 2015-10-05T06:48:12.960+0100 [conn1427421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:13.330+0100 [conn1427034] end connection 172.28.0.164:62790 (399 connections now open) 2015-10-05T06:48:13.332+0100 [mongosMain] connection accepted from 172.28.0.164:63805 #1427422 (400 connections now open) 2015-10-05T06:48:13.333+0100 [conn1427422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:15.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:15.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:15.797+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:48:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:48:16.953+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:17.092+0100 [conn1427022] end connection 172.28.0.163:53439 (399 connections now open) 2015-10-05T06:48:17.093+0100 [conn1426910] end connection 172.28.0.163:53166 (398 connections now open) 2015-10-05T06:48:17.093+0100 [mongosMain] connection accepted from 172.28.0.163:54510 #1427423 (399 connections now open) 2015-10-05T06:48:17.093+0100 [mongosMain] connection accepted from 172.28.0.163:54511 #1427424 (400 connections now open) 2015-10-05T06:48:17.094+0100 [conn1427423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:17.095+0100 [conn1427424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:18.378+0100 [conn1426952] end connection 172.28.0.164:62586 (399 connections now open) 2015-10-05T06:48:18.379+0100 [mongosMain] connection accepted from 172.28.0.164:63812 #1427425 (400 connections now open) 2015-10-05T06:48:18.381+0100 [conn1427425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:21.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f255703b51053ec5760 2015-10-05T06:48:22.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:48:22.958+0100 [conn1427039] end connection 172.28.0.163:53489 (399 connections now open) 2015-10-05T06:48:22.959+0100 [mongosMain] connection accepted from 172.28.0.163:54515 #1427426 (400 connections now open) 2015-10-05T06:48:22.960+0100 [conn1427426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:23.330+0100 [conn1427040] end connection 172.28.0.164:62799 (399 connections now open) 2015-10-05T06:48:23.331+0100 [mongosMain] connection accepted from 172.28.0.164:63822 #1427427 (400 connections now open) 2015-10-05T06:48:23.333+0100 [conn1427427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:27.100+0100 [conn1427029] end connection 172.28.0.163:53456 (399 connections now open) 2015-10-05T06:48:27.100+0100 [conn1426986] end connection 172.28.0.163:53362 (398 connections now open) 2015-10-05T06:48:27.101+0100 [mongosMain] connection accepted from 172.28.0.163:54519 #1427428 (399 connections now open) 2015-10-05T06:48:27.101+0100 [mongosMain] connection accepted from 172.28.0.163:54520 #1427429 (400 connections now open) 2015-10-05T06:48:27.102+0100 [conn1427428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:27.103+0100 [conn1427429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:27.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:27.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:27.957+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:28.386+0100 [conn1427016] end connection 172.28.0.164:62747 (399 connections now open) 2015-10-05T06:48:28.387+0100 [mongosMain] connection accepted from 172.28.0.164:63830 #1427430 (400 connections now open) 2015-10-05T06:48:28.393+0100 [conn1427430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:28.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f2c5703b51053ec5797 2015-10-05T06:48:28.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:48:28.955+0100 [mongosMain] connection accepted from 127.0.0.1:54523 #1427431 (401 connections now open) 2015-10-05T06:48:28.958+0100 [conn1427431] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:28.964+0100 [conn1427431] end connection 127.0.0.1:54523 (400 connections now open) 2015-10-05T06:48:29.340+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:29.341+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:32.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:32.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:32.427+0100 [conn1426954] end connection 172.28.0.163:53289 (399 connections now open) 2015-10-05T06:48:32.428+0100 [mongosMain] connection accepted from 172.28.0.163:54525 #1427432 (400 connections now open) 2015-10-05T06:48:32.430+0100 [conn1427432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:32.814+0100 [conn1427003] end connection 172.28.0.164:62709 (399 connections now open) 2015-10-05T06:48:32.816+0100 [mongosMain] connection accepted from 172.28.0.164:63840 #1427433 (400 connections now open) 2015-10-05T06:48:32.817+0100 [conn1427433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:32.973+0100 [conn1427045] end connection 172.28.0.163:53508 (399 connections now open) 2015-10-05T06:48:32.974+0100 [mongosMain] connection accepted from 172.28.0.163:54527 #1427434 (400 connections now open) 2015-10-05T06:48:32.975+0100 [conn1427434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:33.345+0100 [conn1427046] end connection 172.28.0.164:62822 (399 connections now open) 2015-10-05T06:48:33.346+0100 [mongosMain] connection accepted from 172.28.0.164:63843 #1427435 (400 connections now open) 2015-10-05T06:48:33.349+0100 [conn1427435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:36.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:36.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:37.108+0100 [conn1427035] end connection 172.28.0.163:53480 (399 connections now open) 2015-10-05T06:48:37.108+0100 [conn1426965] end connection 172.28.0.163:53314 (398 connections now open) 2015-10-05T06:48:37.110+0100 [mongosMain] connection accepted from 172.28.0.163:54530 #1427436 (399 connections now open) 2015-10-05T06:48:37.111+0100 [mongosMain] connection accepted from 172.28.0.163:54531 #1427437 (400 connections now open) 2015-10-05T06:48:37.112+0100 [conn1427436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:37.112+0100 [conn1427437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:38.401+0100 [conn1427043] end connection 172.28.0.164:62807 (399 connections now open) 2015-10-05T06:48:38.402+0100 [mongosMain] connection accepted from 172.28.0.164:63855 #1427438 (400 connections now open) 2015-10-05T06:48:38.404+0100 [conn1427438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:38.956+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:39.351+0100 [mongosMain] connection accepted from 127.0.0.1:54534 #1427439 (401 connections now open) 2015-10-05T06:48:39.354+0100 [conn1427439] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:39.359+0100 [conn1427439] end connection 127.0.0.1:54534 (400 connections now open) 2015-10-05T06:48:40.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f385703b51053ec57fc 2015-10-05T06:48:40.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:48:41.362+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:41.363+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:42.429+0100 [conn1426969] end connection 172.28.0.163:53320 (399 connections now open) 2015-10-05T06:48:42.430+0100 [mongosMain] connection accepted from 172.28.0.163:54538 #1427440 (400 connections now open) 2015-10-05T06:48:42.431+0100 [conn1427440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:42.830+0100 [conn1427025] end connection 172.28.0.164:62774 (399 connections now open) 2015-10-05T06:48:42.831+0100 [mongosMain] connection accepted from 172.28.0.164:63863 #1427441 (400 connections now open) 2015-10-05T06:48:42.832+0100 [conn1427441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:42.975+0100 [conn1427053] end connection 172.28.0.163:53524 (399 connections now open) 2015-10-05T06:48:42.976+0100 [mongosMain] connection accepted from 172.28.0.163:54541 #1427442 (400 connections now open) 2015-10-05T06:48:42.977+0100 [conn1427442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:43.361+0100 [conn1427054] end connection 172.28.0.164:62843 (399 connections now open) 2015-10-05T06:48:43.363+0100 [mongosMain] connection accepted from 172.28.0.164:63865 #1427443 (400 connections now open) 2015-10-05T06:48:43.364+0100 [conn1427443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:46.056+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:48:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:48:47.108+0100 [conn1427041] end connection 172.28.0.163:53500 (399 connections now open) 2015-10-05T06:48:47.109+0100 [mongosMain] connection accepted from 172.28.0.163:54549 #1427444 (400 connections now open) 2015-10-05T06:48:47.110+0100 [conn1427444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:47.370+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:47.371+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:47.401+0100 [conn1427007] end connection 172.28.0.163:53414 (399 connections now open) 2015-10-05T06:48:47.405+0100 [mongosMain] connection accepted from 172.28.0.163:54551 #1427445 (400 connections now open) 2015-10-05T06:48:47.407+0100 [conn1427445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:48.416+0100 [conn1427056] end connection 172.28.0.164:62851 (399 connections now open) 2015-10-05T06:48:48.417+0100 [mongosMain] connection accepted from 172.28.0.164:63878 #1427446 (400 connections now open) 2015-10-05T06:48:48.419+0100 [conn1427446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:49.961+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:52.443+0100 [conn1427051] end connection 172.28.0.163:53521 (399 connections now open) 2015-10-05T06:48:52.445+0100 [mongosMain] connection accepted from 172.28.0.163:54560 #1427447 (400 connections now open) 2015-10-05T06:48:52.446+0100 [conn1427447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:52.847+0100 [conn1427032] end connection 172.28.0.164:62788 (399 connections now open) 2015-10-05T06:48:52.848+0100 [mongosMain] connection accepted from 172.28.0.164:63885 #1427448 (400 connections now open) 2015-10-05T06:48:52.850+0100 [conn1427448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:53.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f455703b51053ec5868 2015-10-05T06:48:53.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:48:54.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:48:54.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:48:57.124+0100 [conn1427055] end connection 172.28.0.163:53527 (399 connections now open) 2015-10-05T06:48:57.124+0100 [conn1426936] end connection 172.28.0.163:53238 (399 connections now open) 2015-10-05T06:48:57.126+0100 [mongosMain] connection accepted from 172.28.0.163:54569 #1427449 (399 connections now open) 2015-10-05T06:48:57.126+0100 [mongosMain] connection accepted from 172.28.0.163:54570 #1427450 (400 connections now open) 2015-10-05T06:48:57.127+0100 [conn1427449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:57.127+0100 [conn1427450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:58.416+0100 [conn1427049] end connection 172.28.0.164:62834 (399 connections now open) 2015-10-05T06:48:58.417+0100 [conn1427037] end connection 172.28.0.164:62795 (398 connections now open) 2015-10-05T06:48:58.418+0100 [mongosMain] connection accepted from 172.28.0.164:63896 #1427451 (399 connections now open) 2015-10-05T06:48:58.418+0100 [mongosMain] connection accepted from 172.28.0.164:63897 #1427452 (400 connections now open) 2015-10-05T06:48:58.419+0100 [conn1427451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:58.420+0100 [conn1427452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:48:59.788+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:48:59.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:49:00.988+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:02.372+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:02.372+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:02.862+0100 [conn1427044] end connection 172.28.0.164:62819 (399 connections now open) 2015-10-05T06:49:02.863+0100 [mongosMain] connection accepted from 172.28.0.164:63900 #1427453 (400 connections now open) 2015-10-05T06:49:02.864+0100 [conn1427453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:06.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f515703b51053ec58ee 2015-10-05T06:49:06.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:49:07.140+0100 [conn1426973] end connection 172.28.0.163:53325 (399 connections now open) 2015-10-05T06:49:07.140+0100 [conn1427006] end connection 172.28.0.163:53413 (398 connections now open) 2015-10-05T06:49:07.141+0100 [mongosMain] connection accepted from 172.28.0.163:54586 #1427454 (399 connections now open) 2015-10-05T06:49:07.142+0100 [mongosMain] connection accepted from 172.28.0.163:54587 #1427455 (400 connections now open) 2015-10-05T06:49:07.143+0100 [conn1427455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:07.143+0100 [conn1427454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:08.433+0100 [conn1426938] end connection 172.28.0.164:62558 (399 connections now open) 2015-10-05T06:49:08.433+0100 [mongosMain] connection accepted from 172.28.0.164:63907 #1427456 (400 connections now open) 2015-10-05T06:49:08.435+0100 [conn1427456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:11.368+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:11.368+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:11.990+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:12.459+0100 [conn1427065] end connection 172.28.0.163:53554 (399 connections now open) 2015-10-05T06:49:12.460+0100 [mongosMain] connection accepted from 172.28.0.163:54594 #1427457 (400 connections now open) 2015-10-05T06:49:12.461+0100 [conn1427457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:16.332+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:49:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:49:17.140+0100 [conn1427048] end connection 172.28.0.163:53513 (399 connections now open) 2015-10-05T06:49:17.141+0100 [mongosMain] connection accepted from 172.28.0.163:54601 #1427458 (400 connections now open) 2015-10-05T06:49:17.143+0100 [conn1427458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:18.432+0100 [conn1427064] end connection 172.28.0.164:62878 (399 connections now open) 2015-10-05T06:49:18.433+0100 [conn1427031] end connection 172.28.0.164:62783 (398 connections now open) 2015-10-05T06:49:18.433+0100 [mongosMain] connection accepted from 172.28.0.164:63917 #1427459 (399 connections now open) 2015-10-05T06:49:18.434+0100 [mongosMain] connection accepted from 172.28.0.164:63918 #1427460 (400 connections now open) 2015-10-05T06:49:18.435+0100 [conn1427459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:18.435+0100 [conn1427460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:18.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f5e5703b51053ec594b 2015-10-05T06:49:18.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:49:21.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:21.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:22.894+0100 [conn1427019] end connection 172.28.0.164:62754 (399 connections now open) 2015-10-05T06:49:22.895+0100 [mongosMain] connection accepted from 172.28.0.164:63926 #1427461 (400 connections now open) 2015-10-05T06:49:22.896+0100 [conn1427461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:23.003+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:27.155+0100 [conn1427066] end connection 172.28.0.163:53567 (399 connections now open) 2015-10-05T06:49:27.156+0100 [mongosMain] connection accepted from 172.28.0.163:54609 #1427462 (400 connections now open) 2015-10-05T06:49:27.158+0100 [conn1427462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:28.448+0100 [conn1427068] end connection 172.28.0.164:62896 (399 connections now open) 2015-10-05T06:49:28.449+0100 [conn1426995] end connection 172.28.0.164:62691 (398 connections now open) 2015-10-05T06:49:28.450+0100 [mongosMain] connection accepted from 172.28.0.164:63936 #1427463 (399 connections now open) 2015-10-05T06:49:28.450+0100 [mongosMain] connection accepted from 172.28.0.164:63937 #1427464 (400 connections now open) 2015-10-05T06:49:28.452+0100 [conn1427463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:28.452+0100 [conn1427464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:28.666+0100 [mongosMain] connection accepted from 127.0.0.1:54612 #1427465 (401 connections now open) 2015-10-05T06:49:28.669+0100 [conn1427465] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:28.675+0100 [conn1427465] end connection 127.0.0.1:54612 (400 connections now open) 2015-10-05T06:49:30.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f6a5703b51053ec59c6 2015-10-05T06:49:31.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:49:32.403+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:32.403+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:34.092+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:37.161+0100 [conn1427062] end connection 172.28.0.163:53546 (399 connections now open) 2015-10-05T06:49:37.162+0100 [mongosMain] connection accepted from 172.28.0.163:54617 #1427466 (400 connections now open) 2015-10-05T06:49:37.164+0100 [conn1427466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:38.463+0100 [conn1427015] end connection 172.28.0.164:62746 (399 connections now open) 2015-10-05T06:49:38.464+0100 [mongosMain] connection accepted from 172.28.0.164:63953 #1427467 (400 connections now open) 2015-10-05T06:49:38.465+0100 [conn1427467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:39.265+0100 [mongosMain] connection accepted from 127.0.0.1:54619 #1427468 (401 connections now open) 2015-10-05T06:49:39.268+0100 [conn1427468] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:39.272+0100 [conn1427468] end connection 127.0.0.1:54619 (400 connections now open) 2015-10-05T06:49:42.490+0100 [conn1427058] end connection 172.28.0.163:53535 (399 connections now open) 2015-10-05T06:49:42.492+0100 [mongosMain] connection accepted from 172.28.0.163:54627 #1427469 (400 connections now open) 2015-10-05T06:49:42.493+0100 [conn1427469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:42.926+0100 [conn1426983] end connection 172.28.0.164:62666 (399 connections now open) 2015-10-05T06:49:42.927+0100 [mongosMain] connection accepted from 172.28.0.164:63960 #1427470 (400 connections now open) 2015-10-05T06:49:42.929+0100 [conn1427470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:43.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f775703b51053ec5a56 2015-10-05T06:49:43.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:49:44.400+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:44.400+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:45.107+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:46.399+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:46.399+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:46.611+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:49:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:49:47.171+0100 [conn1427070] end connection 172.28.0.163:53586 (399 connections now open) 2015-10-05T06:49:47.172+0100 [mongosMain] connection accepted from 172.28.0.163:54637 #1427471 (400 connections now open) 2015-10-05T06:49:47.173+0100 [conn1427471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:49.508+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:49.509+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:52.498+0100 [conn1427073] end connection 172.28.0.163:53595 (399 connections now open) 2015-10-05T06:49:52.502+0100 [mongosMain] connection accepted from 172.28.0.163:54650 #1427472 (400 connections now open) 2015-10-05T06:49:52.503+0100 [conn1427472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:53.514+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:53.514+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:49:55.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f835703b51053ec5acd 2015-10-05T06:49:55.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:49:56.114+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:57.181+0100 [conn1427047] end connection 172.28.0.163:53512 (399 connections now open) 2015-10-05T06:49:57.182+0100 [mongosMain] connection accepted from 172.28.0.163:54658 #1427473 (400 connections now open) 2015-10-05T06:49:57.185+0100 [conn1427473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:58.495+0100 [conn1426975] end connection 172.28.0.164:62640 (399 connections now open) 2015-10-05T06:49:58.496+0100 [mongosMain] connection accepted from 172.28.0.164:63985 #1427474 (400 connections now open) 2015-10-05T06:49:58.503+0100 [conn1427474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:49:58.512+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:49:58.513+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:02.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f8a5703b51053ec5b05 2015-10-05T06:50:02.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:02.506+0100 [conn1427018] end connection 172.28.0.163:53429 (399 connections now open) 2015-10-05T06:50:02.507+0100 [mongosMain] connection accepted from 172.28.0.163:54668 #1427475 (400 connections now open) 2015-10-05T06:50:02.508+0100 [conn1427475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:04.519+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:04.519+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:07.128+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:07.187+0100 [conn1427071] end connection 172.28.0.163:53587 (399 connections now open) 2015-10-05T06:50:07.187+0100 [conn1427074] end connection 172.28.0.163:53605 (398 connections now open) 2015-10-05T06:50:07.188+0100 [mongosMain] connection accepted from 172.28.0.163:54678 #1427476 (399 connections now open) 2015-10-05T06:50:07.188+0100 [mongosMain] connection accepted from 172.28.0.163:54677 #1427477 (400 connections now open) 2015-10-05T06:50:07.189+0100 [conn1427476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:07.189+0100 [conn1427477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:08.511+0100 [conn1426988] end connection 172.28.0.164:62678 (399 connections now open) 2015-10-05T06:50:08.512+0100 [mongosMain] connection accepted from 172.28.0.164:63996 #1427478 (400 connections now open) 2015-10-05T06:50:08.514+0100 [conn1427478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:08.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f905703b51053ec5b4c 2015-10-05T06:50:08.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:11.537+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:11.537+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:12.522+0100 [conn1427077] end connection 172.28.0.163:53610 (399 connections now open) 2015-10-05T06:50:12.524+0100 [mongosMain] connection accepted from 172.28.0.163:54686 #1427479 (400 connections now open) 2015-10-05T06:50:12.525+0100 [conn1427479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:13.068+0100 [conn1427060] end connection 172.28.0.163:53537 (399 connections now open) 2015-10-05T06:50:13.069+0100 [mongosMain] connection accepted from 172.28.0.163:54689 #1427480 (400 connections now open) 2015-10-05T06:50:13.070+0100 [conn1427480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:14.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f965703b51053ec5b77 2015-10-05T06:50:15.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:16.883+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:50:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:50:17.229+0100 [conn1427042] end connection 172.28.0.163:53501 (399 connections now open) 2015-10-05T06:50:17.230+0100 [conn1427094] end connection 172.28.0.163:53678 (399 connections now open) 2015-10-05T06:50:17.231+0100 [mongosMain] connection accepted from 172.28.0.163:54696 #1427481 (399 connections now open) 2015-10-05T06:50:17.231+0100 [mongosMain] connection accepted from 172.28.0.163:54697 #1427482 (400 connections now open) 2015-10-05T06:50:17.233+0100 [conn1427482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:17.235+0100 [conn1427481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:18.223+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:18.528+0100 [conn1427086] end connection 172.28.0.164:62949 (399 connections now open) 2015-10-05T06:50:18.528+0100 [conn1427081] end connection 172.28.0.164:62927 (399 connections now open) 2015-10-05T06:50:18.529+0100 [mongosMain] connection accepted from 172.28.0.164:64005 #1427483 (399 connections now open) 2015-10-05T06:50:18.530+0100 [mongosMain] connection accepted from 172.28.0.164:64006 #1427484 (400 connections now open) 2015-10-05T06:50:18.531+0100 [conn1427483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:18.531+0100 [conn1427484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:19.558+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:19.559+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:21.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120f9d5703b51053ec5b9b 2015-10-05T06:50:21.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:22.522+0100 [conn1427084] end connection 172.28.0.163:53623 (399 connections now open) 2015-10-05T06:50:22.523+0100 [mongosMain] connection accepted from 172.28.0.163:54703 #1427485 (400 connections now open) 2015-10-05T06:50:22.524+0100 [conn1427485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:27.234+0100 [conn1427075] end connection 172.28.0.163:53606 (399 connections now open) 2015-10-05T06:50:27.235+0100 [mongosMain] connection accepted from 172.28.0.163:54707 #1427486 (400 connections now open) 2015-10-05T06:50:27.236+0100 [conn1427486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:27.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fa35703b51053ec5be1 2015-10-05T06:50:27.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:28.525+0100 [mongosMain] connection accepted from 127.0.0.1:54710 #1427487 (401 connections now open) 2015-10-05T06:50:28.526+0100 [conn1427023] end connection 172.28.0.164:62764 (400 connections now open) 2015-10-05T06:50:28.527+0100 [conn1427082] end connection 172.28.0.164:62928 (399 connections now open) 2015-10-05T06:50:28.527+0100 [conn1427487] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:28.528+0100 [mongosMain] connection accepted from 172.28.0.164:64023 #1427488 (400 connections now open) 2015-10-05T06:50:28.528+0100 [mongosMain] connection accepted from 172.28.0.164:64024 #1427489 (401 connections now open) 2015-10-05T06:50:28.530+0100 [conn1427488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:28.530+0100 [conn1427489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:28.533+0100 [conn1427487] end connection 127.0.0.1:54710 (400 connections now open) 2015-10-05T06:50:28.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:28.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:29.227+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:32.538+0100 [conn1427093] end connection 172.28.0.163:53672 (399 connections now open) 2015-10-05T06:50:32.540+0100 [mongosMain] connection accepted from 172.28.0.163:54715 #1427490 (400 connections now open) 2015-10-05T06:50:32.540+0100 [conn1427490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:32.973+0100 [conn1427059] end connection 172.28.0.164:62864 (399 connections now open) 2015-10-05T06:50:32.974+0100 [mongosMain] connection accepted from 172.28.0.164:64034 #1427491 (400 connections now open) 2015-10-05T06:50:32.976+0100 [conn1427491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:33.084+0100 [conn1427097] end connection 172.28.0.163:53688 (399 connections now open) 2015-10-05T06:50:33.085+0100 [mongosMain] connection accepted from 172.28.0.163:54717 #1427492 (400 connections now open) 2015-10-05T06:50:33.086+0100 [conn1427492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:33.503+0100 [conn1427061] end connection 172.28.0.164:62866 (399 connections now open) 2015-10-05T06:50:33.505+0100 [mongosMain] connection accepted from 172.28.0.164:64037 #1427493 (400 connections now open) 2015-10-05T06:50:33.507+0100 [conn1427493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:34.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fa95703b51053ec5c27 2015-10-05T06:50:34.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:37.236+0100 [conn1427080] end connection 172.28.0.163:53614 (399 connections now open) 2015-10-05T06:50:37.237+0100 [conn1427000] end connection 172.28.0.163:53403 (399 connections now open) 2015-10-05T06:50:37.238+0100 [mongosMain] connection accepted from 172.28.0.163:54719 #1427494 (399 connections now open) 2015-10-05T06:50:37.238+0100 [mongosMain] connection accepted from 172.28.0.163:54720 #1427495 (400 connections now open) 2015-10-05T06:50:37.239+0100 [conn1427494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:37.239+0100 [conn1427495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:38.543+0100 [conn1427101] end connection 172.28.0.164:63013 (399 connections now open) 2015-10-05T06:50:38.543+0100 [conn1427089] end connection 172.28.0.164:62967 (398 connections now open) 2015-10-05T06:50:38.544+0100 [mongosMain] connection accepted from 172.28.0.164:64044 #1427496 (399 connections now open) 2015-10-05T06:50:38.545+0100 [mongosMain] connection accepted from 172.28.0.164:64045 #1427497 (400 connections now open) 2015-10-05T06:50:38.546+0100 [conn1427496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:38.547+0100 [conn1427497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:38.657+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:38.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:40.132+0100 [mongosMain] connection accepted from 127.0.0.1:54724 #1427498 (401 connections now open) 2015-10-05T06:50:40.135+0100 [conn1427498] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:40.140+0100 [conn1427498] end connection 127.0.0.1:54724 (400 connections now open) 2015-10-05T06:50:40.243+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:40.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fb05703b51053ec5c68 2015-10-05T06:50:40.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:42.539+0100 [conn1426960] end connection 172.28.0.163:53308 (399 connections now open) 2015-10-05T06:50:42.540+0100 [mongosMain] connection accepted from 172.28.0.163:54729 #1427499 (400 connections now open) 2015-10-05T06:50:42.541+0100 [conn1427499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:43.085+0100 [conn1427106] end connection 172.28.0.163:53712 (399 connections now open) 2015-10-05T06:50:43.087+0100 [mongosMain] connection accepted from 172.28.0.163:54730 #1427500 (400 connections now open) 2015-10-05T06:50:43.088+0100 [conn1427500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:43.519+0100 [conn1427107] end connection 172.28.0.164:63021 (399 connections now open) 2015-10-05T06:50:43.520+0100 [mongosMain] connection accepted from 172.28.0.164:64055 #1427501 (400 connections now open) 2015-10-05T06:50:43.521+0100 [conn1427501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:47.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fb65703b51053ec5ca0 2015-10-05T06:50:47.126+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:50:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:50:47.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:47.282+0100 [conn1426979] end connection 172.28.0.163:53343 (399 connections now open) 2015-10-05T06:50:47.282+0100 [mongosMain] connection accepted from 172.28.0.163:54738 #1427502 (400 connections now open) 2015-10-05T06:50:47.282+0100 [conn1427502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:48.577+0100 [conn1427076] end connection 172.28.0.164:62911 (399 connections now open) 2015-10-05T06:50:48.577+0100 [conn1427109] end connection 172.28.0.164:63032 (398 connections now open) 2015-10-05T06:50:48.593+0100 [mongosMain] connection accepted from 172.28.0.164:64061 #1427503 (399 connections now open) 2015-10-05T06:50:48.593+0100 [mongosMain] connection accepted from 172.28.0.164:64062 #1427504 (400 connections now open) 2015-10-05T06:50:48.593+0100 [conn1427503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:48.593+0100 [conn1427504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:49.770+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:49.770+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:50:51.250+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:50:52.555+0100 [conn1427088] end connection 172.28.0.163:53636 (399 connections now open) 2015-10-05T06:50:52.556+0100 [mongosMain] connection accepted from 172.28.0.163:54747 #1427505 (400 connections now open) 2015-10-05T06:50:52.557+0100 [conn1427505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:53.100+0100 [conn1427113] end connection 172.28.0.163:53726 (399 connections now open) 2015-10-05T06:50:53.101+0100 [mongosMain] connection accepted from 172.28.0.163:54750 #1427506 (400 connections now open) 2015-10-05T06:50:53.103+0100 [conn1427506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:53.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fbd5703b51053ec5cd1 2015-10-05T06:50:53.535+0100 [conn1427114] end connection 172.28.0.164:63043 (399 connections now open) 2015-10-05T06:50:53.536+0100 [mongosMain] connection accepted from 172.28.0.164:64074 #1427507 (400 connections now open) 2015-10-05T06:50:53.539+0100 [conn1427507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:53.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:50:57.255+0100 [conn1427108] end connection 172.28.0.163:53718 (399 connections now open) 2015-10-05T06:50:57.255+0100 [conn1427028] end connection 172.28.0.163:53455 (399 connections now open) 2015-10-05T06:50:57.257+0100 [mongosMain] connection accepted from 172.28.0.163:54757 #1427508 (399 connections now open) 2015-10-05T06:50:57.257+0100 [mongosMain] connection accepted from 172.28.0.163:54758 #1427509 (400 connections now open) 2015-10-05T06:50:57.257+0100 [conn1427508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:57.258+0100 [conn1427509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:50:58.559+0100 [conn1427095] end connection 172.28.0.164:62984 (399 connections now open) 2015-10-05T06:50:58.560+0100 [mongosMain] connection accepted from 172.28.0.164:64079 #1427510 (400 connections now open) 2015-10-05T06:50:58.562+0100 [conn1427510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:00.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fc35703b51053ec5d0a 2015-10-05T06:51:00.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:01.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:01.793+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:02.295+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:02.558+0100 [conn1427090] end connection 172.28.0.163:53652 (399 connections now open) 2015-10-05T06:51:02.559+0100 [mongosMain] connection accepted from 172.28.0.163:54770 #1427511 (400 connections now open) 2015-10-05T06:51:02.561+0100 [conn1427511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:03.004+0100 [conn1427052] end connection 172.28.0.164:62839 (399 connections now open) 2015-10-05T06:51:03.006+0100 [mongosMain] connection accepted from 172.28.0.164:64082 #1427512 (400 connections now open) 2015-10-05T06:51:03.008+0100 [conn1427512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:03.105+0100 [conn1427120] end connection 172.28.0.163:53745 (399 connections now open) 2015-10-05T06:51:03.106+0100 [mongosMain] connection accepted from 172.28.0.163:54773 #1427513 (400 connections now open) 2015-10-05T06:51:03.107+0100 [conn1427513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:03.550+0100 [conn1427121] end connection 172.28.0.164:63060 (399 connections now open) 2015-10-05T06:51:03.551+0100 [mongosMain] connection accepted from 172.28.0.164:64085 #1427514 (400 connections now open) 2015-10-05T06:51:03.553+0100 [conn1427514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:03.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:03.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:06.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fca5703b51053ec5d5a 2015-10-05T06:51:06.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:06.809+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:06.810+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:07.265+0100 [conn1427116] end connection 172.28.0.163:53736 (399 connections now open) 2015-10-05T06:51:07.265+0100 [conn1427067] end connection 172.28.0.163:53572 (399 connections now open) 2015-10-05T06:51:07.266+0100 [mongosMain] connection accepted from 172.28.0.163:54780 #1427515 (399 connections now open) 2015-10-05T06:51:07.267+0100 [mongosMain] connection accepted from 172.28.0.163:54781 #1427516 (400 connections now open) 2015-10-05T06:51:07.267+0100 [conn1427515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:07.268+0100 [conn1427516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:08.574+0100 [conn1427124] end connection 172.28.0.164:63068 (399 connections now open) 2015-10-05T06:51:08.574+0100 [conn1427099] end connection 172.28.0.164:62990 (398 connections now open) 2015-10-05T06:51:08.575+0100 [mongosMain] connection accepted from 172.28.0.164:64091 #1427517 (399 connections now open) 2015-10-05T06:51:08.576+0100 [mongosMain] connection accepted from 172.28.0.164:64092 #1427518 (400 connections now open) 2015-10-05T06:51:08.576+0100 [conn1427517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:08.577+0100 [conn1427518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:10.817+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:10.817+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:12.570+0100 [conn1427069] end connection 172.28.0.163:53579 (399 connections now open) 2015-10-05T06:51:12.572+0100 [mongosMain] connection accepted from 172.28.0.163:54791 #1427519 (400 connections now open) 2015-10-05T06:51:12.572+0100 [conn1427519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:12.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fd05703b51053ec5d9c 2015-10-05T06:51:12.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:13.004+0100 [conn1427091] end connection 172.28.0.164:62973 (399 connections now open) 2015-10-05T06:51:13.005+0100 [mongosMain] connection accepted from 172.28.0.164:64094 #1427520 (400 connections now open) 2015-10-05T06:51:13.007+0100 [conn1427520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:13.116+0100 [conn1427128] end connection 172.28.0.163:53766 (399 connections now open) 2015-10-05T06:51:13.118+0100 [mongosMain] connection accepted from 172.28.0.163:54794 #1427521 (400 connections now open) 2015-10-05T06:51:13.119+0100 [conn1427521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:13.302+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:13.550+0100 [conn1427129] end connection 172.28.0.164:63077 (399 connections now open) 2015-10-05T06:51:13.551+0100 [mongosMain] connection accepted from 172.28.0.164:64096 #1427522 (400 connections now open) 2015-10-05T06:51:13.553+0100 [conn1427522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:15.816+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:15.816+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:17.265+0100 [conn1427098] end connection 172.28.0.163:53696 (399 connections now open) 2015-10-05T06:51:17.267+0100 [mongosMain] connection accepted from 172.28.0.163:54800 #1427523 (400 connections now open) 2015-10-05T06:51:17.268+0100 [conn1427523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:17.348+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:51:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:51:18.575+0100 [conn1427092] end connection 172.28.0.164:62979 (399 connections now open) 2015-10-05T06:51:18.575+0100 [conn1427110] end connection 172.28.0.164:63033 (399 connections now open) 2015-10-05T06:51:18.575+0100 [mongosMain] connection accepted from 172.28.0.164:64103 #1427524 (399 connections now open) 2015-10-05T06:51:18.576+0100 [mongosMain] connection accepted from 172.28.0.164:64104 #1427525 (400 connections now open) 2015-10-05T06:51:18.577+0100 [conn1427524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:18.578+0100 [conn1427525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:18.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fd65703b51053ec5dc5 2015-10-05T06:51:19.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:21.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:21.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:22.570+0100 [conn1427100] end connection 172.28.0.163:53701 (399 connections now open) 2015-10-05T06:51:22.571+0100 [mongosMain] connection accepted from 172.28.0.163:54807 #1427526 (400 connections now open) 2015-10-05T06:51:22.572+0100 [conn1427526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:23.020+0100 [conn1427105] end connection 172.28.0.164:63019 (399 connections now open) 2015-10-05T06:51:23.021+0100 [mongosMain] connection accepted from 172.28.0.164:64112 #1427527 (400 connections now open) 2015-10-05T06:51:23.023+0100 [conn1427527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:23.116+0100 [conn1427136] end connection 172.28.0.163:53786 (399 connections now open) 2015-10-05T06:51:23.117+0100 [mongosMain] connection accepted from 172.28.0.163:54809 #1427528 (400 connections now open) 2015-10-05T06:51:23.118+0100 [conn1427528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:23.565+0100 [conn1427137] end connection 172.28.0.164:63087 (399 connections now open) 2015-10-05T06:51:23.566+0100 [mongosMain] connection accepted from 172.28.0.164:64115 #1427529 (400 connections now open) 2015-10-05T06:51:23.568+0100 [conn1427529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:24.308+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:25.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fdd5703b51053ec5dfd 2015-10-05T06:51:25.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:27.281+0100 [conn1427122] end connection 172.28.0.163:53755 (399 connections now open) 2015-10-05T06:51:27.283+0100 [mongosMain] connection accepted from 172.28.0.163:54812 #1427530 (400 connections now open) 2015-10-05T06:51:27.284+0100 [conn1427530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:28.576+0100 [mongosMain] connection accepted from 127.0.0.1:54816 #1427531 (401 connections now open) 2015-10-05T06:51:28.579+0100 [conn1427531] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:28.583+0100 [conn1427531] end connection 127.0.0.1:54816 (400 connections now open) 2015-10-05T06:51:28.592+0100 [conn1427102] end connection 172.28.0.164:63014 (399 connections now open) 2015-10-05T06:51:28.592+0100 [conn1427118] end connection 172.28.0.164:63051 (399 connections now open) 2015-10-05T06:51:28.600+0100 [mongosMain] connection accepted from 172.28.0.164:64124 #1427532 (399 connections now open) 2015-10-05T06:51:28.600+0100 [mongosMain] connection accepted from 172.28.0.164:64123 #1427533 (400 connections now open) 2015-10-05T06:51:28.601+0100 [conn1427532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:28.601+0100 [conn1427533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:28.819+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:28.820+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:31.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fe35703b51053ec5e41 2015-10-05T06:51:31.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:32.585+0100 [conn1427104] end connection 172.28.0.163:53710 (399 connections now open) 2015-10-05T06:51:32.587+0100 [mongosMain] connection accepted from 172.28.0.163:54817 #1427534 (400 connections now open) 2015-10-05T06:51:32.587+0100 [conn1427534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:33.131+0100 [conn1427142] end connection 172.28.0.163:53800 (399 connections now open) 2015-10-05T06:51:33.132+0100 [mongosMain] connection accepted from 172.28.0.163:54818 #1427535 (400 connections now open) 2015-10-05T06:51:33.134+0100 [conn1427535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:33.565+0100 [conn1427143] end connection 172.28.0.164:63104 (399 connections now open) 2015-10-05T06:51:33.566+0100 [mongosMain] connection accepted from 172.28.0.164:64132 #1427536 (400 connections now open) 2015-10-05T06:51:33.571+0100 [conn1427536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:35.315+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:36.834+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:36.834+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:37.296+0100 [conn1427131] end connection 172.28.0.163:53776 (399 connections now open) 2015-10-05T06:51:37.297+0100 [mongosMain] connection accepted from 172.28.0.163:54823 #1427537 (400 connections now open) 2015-10-05T06:51:37.298+0100 [conn1427537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:37.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120fe95703b51053ec5e71 2015-10-05T06:51:38.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:38.590+0100 [conn1427072] end connection 172.28.0.164:62905 (399 connections now open) 2015-10-05T06:51:38.590+0100 [conn1427117] end connection 172.28.0.164:63050 (399 connections now open) 2015-10-05T06:51:38.592+0100 [mongosMain] connection accepted from 172.28.0.164:64142 #1427538 (399 connections now open) 2015-10-05T06:51:38.592+0100 [mongosMain] connection accepted from 172.28.0.164:64143 #1427539 (400 connections now open) 2015-10-05T06:51:38.595+0100 [conn1427538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:38.597+0100 [conn1427539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:39.628+0100 [mongosMain] connection accepted from 127.0.0.1:54826 #1427540 (401 connections now open) 2015-10-05T06:51:39.630+0100 [conn1427540] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:39.635+0100 [conn1427540] end connection 127.0.0.1:54826 (400 connections now open) 2015-10-05T06:51:42.601+0100 [conn1427134] end connection 172.28.0.163:53784 (399 connections now open) 2015-10-05T06:51:42.603+0100 [mongosMain] connection accepted from 172.28.0.163:54830 #1427541 (400 connections now open) 2015-10-05T06:51:42.604+0100 [conn1427541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:43.035+0100 [conn1427147] end connection 172.28.0.164:63122 (399 connections now open) 2015-10-05T06:51:43.036+0100 [mongosMain] connection accepted from 172.28.0.164:64150 #1427542 (400 connections now open) 2015-10-05T06:51:43.039+0100 [conn1427542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:43.147+0100 [conn1427148] end connection 172.28.0.163:53814 (399 connections now open) 2015-10-05T06:51:43.148+0100 [mongosMain] connection accepted from 172.28.0.163:54833 #1427543 (400 connections now open) 2015-10-05T06:51:43.149+0100 [conn1427543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:43.582+0100 [conn1427149] end connection 172.28.0.164:63125 (399 connections now open) 2015-10-05T06:51:43.583+0100 [mongosMain] connection accepted from 172.28.0.164:64153 #1427544 (400 connections now open) 2015-10-05T06:51:43.585+0100 [conn1427544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:44.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ff05703b51053ec5ea0 2015-10-05T06:51:44.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:45.945+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:45.945+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:46.320+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:47.297+0100 [conn1427138] end connection 172.28.0.163:53790 (399 connections now open) 2015-10-05T06:51:47.298+0100 [mongosMain] connection accepted from 172.28.0.163:54843 #1427545 (400 connections now open) 2015-10-05T06:51:47.299+0100 [conn1427545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:47.497+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:51:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:51:48.590+0100 [conn1427151] end connection 172.28.0.164:63133 (399 connections now open) 2015-10-05T06:51:48.591+0100 [conn1427132] end connection 172.28.0.164:63082 (399 connections now open) 2015-10-05T06:51:48.592+0100 [mongosMain] connection accepted from 172.28.0.164:64162 #1427546 (399 connections now open) 2015-10-05T06:51:48.592+0100 [mongosMain] connection accepted from 172.28.0.164:64163 #1427547 (400 connections now open) 2015-10-05T06:51:48.594+0100 [conn1427546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:48.594+0100 [conn1427547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:50.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ff65703b51053ec5ed3 2015-10-05T06:51:50.570+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:52.611+0100 [conn1427126] end connection 172.28.0.163:53765 (399 connections now open) 2015-10-05T06:51:52.612+0100 [mongosMain] connection accepted from 172.28.0.163:54851 #1427548 (400 connections now open) 2015-10-05T06:51:52.613+0100 [conn1427548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:53.157+0100 [conn1427156] end connection 172.28.0.163:53829 (399 connections now open) 2015-10-05T06:51:53.158+0100 [mongosMain] connection accepted from 172.28.0.163:54853 #1427549 (400 connections now open) 2015-10-05T06:51:53.159+0100 [conn1427549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:53.582+0100 [conn1427157] end connection 172.28.0.164:63146 (399 connections now open) 2015-10-05T06:51:53.583+0100 [mongosMain] connection accepted from 172.28.0.164:64169 #1427550 (400 connections now open) 2015-10-05T06:51:53.587+0100 [conn1427550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:56.001+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:56.002+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:51:56.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56120ffc5703b51053ec5ef7 2015-10-05T06:51:56.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:51:57.312+0100 [conn1427079] end connection 172.28.0.163:53615 (399 connections now open) 2015-10-05T06:51:57.314+0100 [mongosMain] connection accepted from 172.28.0.163:54860 #1427551 (400 connections now open) 2015-10-05T06:51:57.315+0100 [conn1427551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:57.345+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:51:58.606+0100 [conn1427152] end connection 172.28.0.164:63134 (399 connections now open) 2015-10-05T06:51:58.606+0100 [conn1427009] end connection 172.28.0.164:62724 (398 connections now open) 2015-10-05T06:51:58.607+0100 [mongosMain] connection accepted from 172.28.0.164:64175 #1427552 (399 connections now open) 2015-10-05T06:51:58.608+0100 [mongosMain] connection accepted from 172.28.0.164:64176 #1427553 (400 connections now open) 2015-10-05T06:51:58.609+0100 [conn1427552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:51:58.610+0100 [conn1427553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:02.617+0100 [conn1427146] end connection 172.28.0.163:53811 (399 connections now open) 2015-10-05T06:52:02.618+0100 [mongosMain] connection accepted from 172.28.0.163:54876 #1427554 (400 connections now open) 2015-10-05T06:52:02.620+0100 [conn1427554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:02.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210025703b51053ec5f2d 2015-10-05T06:52:02.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:03.051+0100 [conn1427127] end connection 172.28.0.164:63074 (399 connections now open) 2015-10-05T06:52:03.052+0100 [mongosMain] connection accepted from 172.28.0.164:64179 #1427555 (400 connections now open) 2015-10-05T06:52:03.054+0100 [conn1427555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:03.163+0100 [conn1427163] end connection 172.28.0.163:53849 (399 connections now open) 2015-10-05T06:52:03.164+0100 [mongosMain] connection accepted from 172.28.0.163:54878 #1427556 (400 connections now open) 2015-10-05T06:52:03.165+0100 [conn1427556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:03.598+0100 [conn1427164] end connection 172.28.0.164:63164 (399 connections now open) 2015-10-05T06:52:03.599+0100 [mongosMain] connection accepted from 172.28.0.164:64181 #1427557 (400 connections now open) 2015-10-05T06:52:03.601+0100 [conn1427557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:07.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:07.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:07.316+0100 [conn1427115] end connection 172.28.0.163:53735 (399 connections now open) 2015-10-05T06:52:07.318+0100 [mongosMain] connection accepted from 172.28.0.163:54885 #1427558 (400 connections now open) 2015-10-05T06:52:07.319+0100 [conn1427558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:08.388+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:08.622+0100 [conn1427160] end connection 172.28.0.164:63153 (399 connections now open) 2015-10-05T06:52:08.623+0100 [conn1427159] end connection 172.28.0.164:63154 (398 connections now open) 2015-10-05T06:52:08.623+0100 [mongosMain] connection accepted from 172.28.0.164:64184 #1427559 (399 connections now open) 2015-10-05T06:52:08.624+0100 [mongosMain] connection accepted from 172.28.0.164:64185 #1427560 (400 connections now open) 2015-10-05T06:52:08.625+0100 [conn1427559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:08.626+0100 [conn1427560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:09.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210095703b51053ec5f71 2015-10-05T06:52:09.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:12.618+0100 [conn1427141] end connection 172.28.0.163:53798 (399 connections now open) 2015-10-05T06:52:12.619+0100 [mongosMain] connection accepted from 172.28.0.163:54894 #1427561 (400 connections now open) 2015-10-05T06:52:12.620+0100 [conn1427561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:13.067+0100 [conn1427135] end connection 172.28.0.164:63085 (399 connections now open) 2015-10-05T06:52:13.068+0100 [mongosMain] connection accepted from 172.28.0.164:64189 #1427562 (400 connections now open) 2015-10-05T06:52:13.070+0100 [conn1427562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:13.164+0100 [conn1427170] end connection 172.28.0.163:53869 (399 connections now open) 2015-10-05T06:52:13.165+0100 [mongosMain] connection accepted from 172.28.0.163:54895 #1427563 (400 connections now open) 2015-10-05T06:52:13.166+0100 [conn1427563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:13.614+0100 [conn1427171] end connection 172.28.0.164:63176 (399 connections now open) 2015-10-05T06:52:13.615+0100 [mongosMain] connection accepted from 172.28.0.164:64191 #1427564 (400 connections now open) 2015-10-05T06:52:13.618+0100 [conn1427564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:15.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612100f5703b51053ec5fae 2015-10-05T06:52:15.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:17.339+0100 [conn1427036] end connection 172.28.0.163:53479 (399 connections now open) 2015-10-05T06:52:17.339+0100 [conn1427158] end connection 172.28.0.163:53835 (399 connections now open) 2015-10-05T06:52:17.342+0100 [mongosMain] connection accepted from 172.28.0.163:54901 #1427565 (399 connections now open) 2015-10-05T06:52:17.343+0100 [mongosMain] connection accepted from 172.28.0.163:54902 #1427566 (400 connections now open) 2015-10-05T06:52:17.343+0100 [conn1427565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:17.344+0100 [conn1427566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:17.772+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:52:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:52:18.637+0100 [conn1427139] end connection 172.28.0.164:63092 (399 connections now open) 2015-10-05T06:52:18.637+0100 [conn1427144] end connection 172.28.0.164:63111 (399 connections now open) 2015-10-05T06:52:18.638+0100 [mongosMain] connection accepted from 172.28.0.164:64198 #1427567 (399 connections now open) 2015-10-05T06:52:18.639+0100 [mongosMain] connection accepted from 172.28.0.164:64199 #1427568 (400 connections now open) 2015-10-05T06:52:18.640+0100 [conn1427567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:18.640+0100 [conn1427568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:19.070+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:19.071+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:19.392+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:21.070+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:21.070+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:21.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210155703b51053ec5ffa 2015-10-05T06:52:22.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:22.633+0100 [conn1427119] end connection 172.28.0.163:53744 (399 connections now open) 2015-10-05T06:52:22.634+0100 [mongosMain] connection accepted from 172.28.0.163:54910 #1427569 (400 connections now open) 2015-10-05T06:52:22.636+0100 [conn1427569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:23.083+0100 [conn1427155] end connection 172.28.0.164:63144 (399 connections now open) 2015-10-05T06:52:23.085+0100 [mongosMain] connection accepted from 172.28.0.164:64208 #1427570 (400 connections now open) 2015-10-05T06:52:23.086+0100 [conn1427570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:23.179+0100 [conn1427177] end connection 172.28.0.163:53888 (399 connections now open) 2015-10-05T06:52:23.180+0100 [mongosMain] connection accepted from 172.28.0.163:54912 #1427571 (400 connections now open) 2015-10-05T06:52:23.181+0100 [conn1427571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:23.628+0100 [conn1427178] end connection 172.28.0.164:63188 (399 connections now open) 2015-10-05T06:52:23.629+0100 [mongosMain] connection accepted from 172.28.0.164:64211 #1427572 (400 connections now open) 2015-10-05T06:52:23.631+0100 [conn1427572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:24.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:24.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:28.081+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:28.081+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:28.228+0100 [mongosMain] connection accepted from 127.0.0.1:54919 #1427573 (401 connections now open) 2015-10-05T06:52:28.230+0100 [conn1427573] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:28.236+0100 [conn1427573] end connection 127.0.0.1:54919 (400 connections now open) 2015-10-05T06:52:28.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612101c5703b51053ec604b 2015-10-05T06:52:28.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:28.657+0100 [conn1427133] end connection 172.28.0.164:63083 (399 connections now open) 2015-10-05T06:52:28.658+0100 [conn1427174] end connection 172.28.0.164:63181 (398 connections now open) 2015-10-05T06:52:28.659+0100 [mongosMain] connection accepted from 172.28.0.164:64222 #1427574 (399 connections now open) 2015-10-05T06:52:28.659+0100 [mongosMain] connection accepted from 172.28.0.164:64223 #1427575 (400 connections now open) 2015-10-05T06:52:28.661+0100 [conn1427575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:28.661+0100 [conn1427574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:30.406+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:32.635+0100 [conn1427112] end connection 172.28.0.163:53723 (399 connections now open) 2015-10-05T06:52:32.636+0100 [mongosMain] connection accepted from 172.28.0.163:54926 #1427576 (400 connections now open) 2015-10-05T06:52:32.638+0100 [conn1427576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:33.084+0100 [conn1427162] end connection 172.28.0.164:63160 (399 connections now open) 2015-10-05T06:52:33.084+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:33.085+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:33.085+0100 [mongosMain] connection accepted from 172.28.0.164:64233 #1427577 (400 connections now open) 2015-10-05T06:52:33.087+0100 [conn1427577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:33.181+0100 [conn1427185] end connection 172.28.0.163:53908 (399 connections now open) 2015-10-05T06:52:33.182+0100 [mongosMain] connection accepted from 172.28.0.163:54927 #1427578 (400 connections now open) 2015-10-05T06:52:33.183+0100 [conn1427578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:33.629+0100 [conn1427186] end connection 172.28.0.164:63207 (399 connections now open) 2015-10-05T06:52:33.630+0100 [mongosMain] connection accepted from 172.28.0.164:64235 #1427579 (400 connections now open) 2015-10-05T06:52:33.632+0100 [conn1427579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:34.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210225703b51053ec608a 2015-10-05T06:52:34.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:38.669+0100 [conn1427181] end connection 172.28.0.164:63195 (399 connections now open) 2015-10-05T06:52:38.670+0100 [conn1426959] end connection 172.28.0.164:62600 (398 connections now open) 2015-10-05T06:52:38.670+0100 [mongosMain] connection accepted from 172.28.0.164:64245 #1427580 (399 connections now open) 2015-10-05T06:52:38.671+0100 [mongosMain] connection accepted from 172.28.0.164:64246 #1427581 (400 connections now open) 2015-10-05T06:52:38.672+0100 [conn1427580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:38.672+0100 [conn1427581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:39.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:39.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:39.231+0100 [mongosMain] connection accepted from 127.0.0.1:54932 #1427582 (401 connections now open) 2015-10-05T06:52:39.234+0100 [conn1427582] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:39.238+0100 [conn1427582] end connection 127.0.0.1:54932 (400 connections now open) 2015-10-05T06:52:40.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210285703b51053ec60c3 2015-10-05T06:52:41.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:41.523+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:42.648+0100 [conn1427161] end connection 172.28.0.163:53846 (399 connections now open) 2015-10-05T06:52:42.649+0100 [mongosMain] connection accepted from 172.28.0.163:54937 #1427583 (400 connections now open) 2015-10-05T06:52:42.650+0100 [conn1427583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:43.173+0100 [conn1427176] end connection 172.28.0.164:63185 (399 connections now open) 2015-10-05T06:52:43.175+0100 [mongosMain] connection accepted from 172.28.0.164:64255 #1427584 (400 connections now open) 2015-10-05T06:52:43.177+0100 [conn1427584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:43.195+0100 [conn1427193] end connection 172.28.0.163:53918 (399 connections now open) 2015-10-05T06:52:43.196+0100 [mongosMain] connection accepted from 172.28.0.163:54938 #1427585 (400 connections now open) 2015-10-05T06:52:43.197+0100 [conn1427585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:43.643+0100 [conn1427194] end connection 172.28.0.164:63227 (399 connections now open) 2015-10-05T06:52:43.645+0100 [mongosMain] connection accepted from 172.28.0.164:64257 #1427586 (400 connections now open) 2015-10-05T06:52:43.646+0100 [conn1427586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:46.143+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:46.144+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:47.359+0100 [conn1427195] end connection 172.28.0.163:53924 (399 connections now open) 2015-10-05T06:52:47.359+0100 [conn1427179] end connection 172.28.0.163:53898 (399 connections now open) 2015-10-05T06:52:47.360+0100 [mongosMain] connection accepted from 172.28.0.163:54946 #1427587 (399 connections now open) 2015-10-05T06:52:47.361+0100 [mongosMain] connection accepted from 172.28.0.163:54945 #1427588 (400 connections now open) 2015-10-05T06:52:47.361+0100 [conn1427587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:47.362+0100 [conn1427588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:47.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612102f5703b51053ec60f9 2015-10-05T06:52:47.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:48.046+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:52:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:52:48.685+0100 [conn1427188] end connection 172.28.0.164:63216 (399 connections now open) 2015-10-05T06:52:48.686+0100 [mongosMain] connection accepted from 172.28.0.164:64265 #1427589 (400 connections now open) 2015-10-05T06:52:48.688+0100 [conn1427589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:52.537+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:52.654+0100 [conn1427154] end connection 172.28.0.163:53827 (399 connections now open) 2015-10-05T06:52:52.655+0100 [mongosMain] connection accepted from 172.28.0.163:54958 #1427590 (400 connections now open) 2015-10-05T06:52:52.656+0100 [conn1427590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:53.114+0100 [conn1427038] end connection 172.28.0.164:62797 (399 connections now open) 2015-10-05T06:52:53.115+0100 [mongosMain] connection accepted from 172.28.0.164:64273 #1427591 (400 connections now open) 2015-10-05T06:52:53.117+0100 [conn1427591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:53.200+0100 [conn1427201] end connection 172.28.0.163:53931 (399 connections now open) 2015-10-05T06:52:53.201+0100 [mongosMain] connection accepted from 172.28.0.163:54961 #1427592 (400 connections now open) 2015-10-05T06:52:53.202+0100 [conn1427592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:53.645+0100 [conn1427202] end connection 172.28.0.164:63250 (399 connections now open) 2015-10-05T06:52:53.647+0100 [mongosMain] connection accepted from 172.28.0.164:64275 #1427593 (400 connections now open) 2015-10-05T06:52:53.649+0100 [conn1427593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:53.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210355703b51053ec6125 2015-10-05T06:52:53.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:52:54.141+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:52:54.142+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:52:57.362+0100 [conn1427204] end connection 172.28.0.163:53940 (399 connections now open) 2015-10-05T06:52:57.362+0100 [conn1427180] end connection 172.28.0.163:53899 (399 connections now open) 2015-10-05T06:52:57.363+0100 [mongosMain] connection accepted from 172.28.0.163:54967 #1427594 (399 connections now open) 2015-10-05T06:52:57.363+0100 [mongosMain] connection accepted from 172.28.0.163:54968 #1427595 (400 connections now open) 2015-10-05T06:52:57.364+0100 [conn1427594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:57.364+0100 [conn1427595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:52:58.684+0100 [conn1427166] end connection 172.28.0.164:63169 (399 connections now open) 2015-10-05T06:52:58.685+0100 [mongosMain] connection accepted from 172.28.0.164:64282 #1427596 (400 connections now open) 2015-10-05T06:52:58.687+0100 [conn1427596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:00.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612103b5703b51053ec6154 2015-10-05T06:53:00.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:02.664+0100 [conn1427175] end connection 172.28.0.163:53886 (399 connections now open) 2015-10-05T06:53:02.666+0100 [mongosMain] connection accepted from 172.28.0.163:54981 #1427597 (400 connections now open) 2015-10-05T06:53:02.667+0100 [conn1427597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:03.130+0100 [conn1427078] end connection 172.28.0.164:62920 (399 connections now open) 2015-10-05T06:53:03.131+0100 [mongosMain] connection accepted from 172.28.0.164:64285 #1427598 (400 connections now open) 2015-10-05T06:53:03.133+0100 [conn1427598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:03.148+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:03.149+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:03.210+0100 [conn1427208] end connection 172.28.0.163:53951 (399 connections now open) 2015-10-05T06:53:03.211+0100 [mongosMain] connection accepted from 172.28.0.163:54983 #1427599 (400 connections now open) 2015-10-05T06:53:03.212+0100 [conn1427599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:03.543+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:03.660+0100 [conn1427209] end connection 172.28.0.164:63272 (399 connections now open) 2015-10-05T06:53:03.663+0100 [mongosMain] connection accepted from 172.28.0.164:64289 #1427600 (400 connections now open) 2015-10-05T06:53:03.664+0100 [conn1427600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:06.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210425703b51053ec61b1 2015-10-05T06:53:06.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:07.378+0100 [conn1427187] end connection 172.28.0.163:53911 (399 connections now open) 2015-10-05T06:53:07.379+0100 [mongosMain] connection accepted from 172.28.0.163:54990 #1427601 (400 connections now open) 2015-10-05T06:53:07.380+0100 [conn1427601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:08.700+0100 [conn1427196] end connection 172.28.0.164:63237 (399 connections now open) 2015-10-05T06:53:08.702+0100 [mongosMain] connection accepted from 172.28.0.164:64294 #1427602 (400 connections now open) 2015-10-05T06:53:08.704+0100 [conn1427602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:12.680+0100 [conn1427096] end connection 172.28.0.163:53687 (399 connections now open) 2015-10-05T06:53:12.681+0100 [mongosMain] connection accepted from 172.28.0.163:54996 #1427603 (400 connections now open) 2015-10-05T06:53:12.682+0100 [conn1427603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:13.145+0100 [conn1427200] end connection 172.28.0.164:63247 (399 connections now open) 2015-10-05T06:53:13.146+0100 [mongosMain] connection accepted from 172.28.0.164:64296 #1427604 (400 connections now open) 2015-10-05T06:53:13.148+0100 [conn1427604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:13.163+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:13.163+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:13.226+0100 [conn1427213] end connection 172.28.0.163:53974 (399 connections now open) 2015-10-05T06:53:13.228+0100 [mongosMain] connection accepted from 172.28.0.163:54999 #1427605 (400 connections now open) 2015-10-05T06:53:13.229+0100 [conn1427605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:13.676+0100 [conn1427214] end connection 172.28.0.164:63283 (399 connections now open) 2015-10-05T06:53:13.677+0100 [mongosMain] connection accepted from 172.28.0.164:64298 #1427606 (400 connections now open) 2015-10-05T06:53:13.679+0100 [conn1427606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:14.554+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:17.384+0100 [conn1427063] end connection 172.28.0.163:53547 (399 connections now open) 2015-10-05T06:53:17.385+0100 [mongosMain] connection accepted from 172.28.0.163:55006 #1427607 (400 connections now open) 2015-10-05T06:53:17.387+0100 [conn1427607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:18.365+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:53:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:53:18.716+0100 [conn1427206] end connection 172.28.0.164:63262 (399 connections now open) 2015-10-05T06:53:18.717+0100 [mongosMain] connection accepted from 172.28.0.164:64306 #1427608 (400 connections now open) 2015-10-05T06:53:18.719+0100 [conn1427608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:19.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612104e5703b51053ec623a 2015-10-05T06:53:19.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:22.682+0100 [conn1427199] end connection 172.28.0.163:53929 (399 connections now open) 2015-10-05T06:53:22.683+0100 [mongosMain] connection accepted from 172.28.0.163:55011 #1427609 (400 connections now open) 2015-10-05T06:53:22.684+0100 [conn1427609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:23.161+0100 [conn1427219] end connection 172.28.0.164:63292 (399 connections now open) 2015-10-05T06:53:23.163+0100 [mongosMain] connection accepted from 172.28.0.164:64312 #1427610 (400 connections now open) 2015-10-05T06:53:23.165+0100 [conn1427610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:23.228+0100 [conn1427220] end connection 172.28.0.163:53996 (399 connections now open) 2015-10-05T06:53:23.229+0100 [mongosMain] connection accepted from 172.28.0.163:55014 #1427611 (400 connections now open) 2015-10-05T06:53:23.231+0100 [conn1427611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:23.692+0100 [conn1427221] end connection 172.28.0.164:63294 (399 connections now open) 2015-10-05T06:53:23.693+0100 [mongosMain] connection accepted from 172.28.0.164:64314 #1427612 (400 connections now open) 2015-10-05T06:53:23.695+0100 [conn1427612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:24.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:24.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:25.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210555703b51053ec6266 2015-10-05T06:53:25.570+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:25.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:27.392+0100 [conn1427165] end connection 172.28.0.163:53855 (399 connections now open) 2015-10-05T06:53:27.393+0100 [conn1427210] end connection 172.28.0.163:53961 (398 connections now open) 2015-10-05T06:53:27.393+0100 [mongosMain] connection accepted from 172.28.0.163:55017 #1427613 (399 connections now open) 2015-10-05T06:53:27.394+0100 [mongosMain] connection accepted from 172.28.0.163:55018 #1427614 (400 connections now open) 2015-10-05T06:53:27.395+0100 [conn1427613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:27.395+0100 [conn1427614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:28.717+0100 [conn1427217] end connection 172.28.0.164:63287 (399 connections now open) 2015-10-05T06:53:28.717+0100 [mongosMain] connection accepted from 172.28.0.164:64326 #1427615 (400 connections now open) 2015-10-05T06:53:28.721+0100 [conn1427615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:28.887+0100 [mongosMain] connection accepted from 127.0.0.1:55021 #1427616 (401 connections now open) 2015-10-05T06:53:28.890+0100 [conn1427616] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:28.896+0100 [conn1427616] end connection 127.0.0.1:55021 (400 connections now open) 2015-10-05T06:53:31.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612105b5703b51053ec629e 2015-10-05T06:53:32.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:32.696+0100 [conn1427191] end connection 172.28.0.163:53916 (399 connections now open) 2015-10-05T06:53:32.697+0100 [mongosMain] connection accepted from 172.28.0.163:55022 #1427617 (400 connections now open) 2015-10-05T06:53:32.697+0100 [conn1427617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:33.162+0100 [conn1427184] end connection 172.28.0.164:63204 (399 connections now open) 2015-10-05T06:53:33.163+0100 [mongosMain] connection accepted from 172.28.0.164:64333 #1427618 (400 connections now open) 2015-10-05T06:53:33.165+0100 [conn1427618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:33.242+0100 [conn1427227] end connection 172.28.0.163:54011 (399 connections now open) 2015-10-05T06:53:33.243+0100 [mongosMain] connection accepted from 172.28.0.163:55024 #1427619 (400 connections now open) 2015-10-05T06:53:33.244+0100 [conn1427619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:33.708+0100 [conn1427228] end connection 172.28.0.164:63309 (399 connections now open) 2015-10-05T06:53:33.709+0100 [mongosMain] connection accepted from 172.28.0.164:64335 #1427620 (400 connections now open) 2015-10-05T06:53:33.712+0100 [conn1427620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:36.177+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:36.178+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:36.590+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:37.396+0100 [conn1427216] end connection 172.28.0.163:53983 (399 connections now open) 2015-10-05T06:53:37.397+0100 [conn1427150] end connection 172.28.0.163:53819 (398 connections now open) 2015-10-05T06:53:37.397+0100 [mongosMain] connection accepted from 172.28.0.163:55031 #1427621 (399 connections now open) 2015-10-05T06:53:37.398+0100 [mongosMain] connection accepted from 172.28.0.163:55033 #1427622 (400 connections now open) 2015-10-05T06:53:37.399+0100 [conn1427621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:37.399+0100 [conn1427622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:38.180+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:38.181+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:38.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210625703b51053ec62c9 2015-10-05T06:53:38.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:40.109+0100 [mongosMain] connection accepted from 127.0.0.1:55036 #1427623 (401 connections now open) 2015-10-05T06:53:40.112+0100 [conn1427623] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:40.116+0100 [conn1427623] end connection 127.0.0.1:55036 (400 connections now open) 2015-10-05T06:53:41.187+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:41.187+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:42.696+0100 [conn1427207] end connection 172.28.0.163:53948 (399 connections now open) 2015-10-05T06:53:42.697+0100 [mongosMain] connection accepted from 172.28.0.163:55041 #1427624 (400 connections now open) 2015-10-05T06:53:42.698+0100 [conn1427624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:43.162+0100 [conn1427169] end connection 172.28.0.164:63174 (399 connections now open) 2015-10-05T06:53:43.163+0100 [mongosMain] connection accepted from 172.28.0.164:64356 #1427625 (400 connections now open) 2015-10-05T06:53:43.165+0100 [conn1427625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:43.707+0100 [conn1427235] end connection 172.28.0.164:63330 (399 connections now open) 2015-10-05T06:53:43.708+0100 [mongosMain] connection accepted from 172.28.0.164:64359 #1427626 (400 connections now open) 2015-10-05T06:53:43.710+0100 [conn1427626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:44.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210685703b51053ec630d 2015-10-05T06:53:44.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:45.185+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:45.186+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:47.407+0100 [conn1427222] end connection 172.28.0.163:54002 (399 connections now open) 2015-10-05T06:53:47.407+0100 [conn1427130] end connection 172.28.0.163:53775 (399 connections now open) 2015-10-05T06:53:47.408+0100 [mongosMain] connection accepted from 172.28.0.163:55051 #1427627 (399 connections now open) 2015-10-05T06:53:47.408+0100 [mongosMain] connection accepted from 172.28.0.163:55052 #1427628 (400 connections now open) 2015-10-05T06:53:47.408+0100 [conn1427627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:47.409+0100 [conn1427628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:47.598+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:48.731+0100 [conn1427224] end connection 172.28.0.164:63299 (399 connections now open) 2015-10-05T06:53:48.732+0100 [mongosMain] connection accepted from 172.28.0.164:64369 #1427629 (400 connections now open) 2015-10-05T06:53:48.734+0100 [conn1427629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:49.117+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:53:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:53:50.189+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:50.189+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:52.711+0100 [conn1427168] end connection 172.28.0.163:53867 (399 connections now open) 2015-10-05T06:53:52.712+0100 [mongosMain] connection accepted from 172.28.0.163:55063 #1427630 (400 connections now open) 2015-10-05T06:53:52.713+0100 [conn1427630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:53.177+0100 [conn1427212] end connection 172.28.0.164:63281 (399 connections now open) 2015-10-05T06:53:53.179+0100 [mongosMain] connection accepted from 172.28.0.164:64377 #1427631 (400 connections now open) 2015-10-05T06:53:53.180+0100 [conn1427631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:53.257+0100 [conn1427242] end connection 172.28.0.163:54039 (399 connections now open) 2015-10-05T06:53:53.258+0100 [mongosMain] connection accepted from 172.28.0.163:55066 #1427632 (400 connections now open) 2015-10-05T06:53:53.259+0100 [conn1427632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:53.723+0100 [conn1427243] end connection 172.28.0.164:63351 (399 connections now open) 2015-10-05T06:53:53.724+0100 [mongosMain] connection accepted from 172.28.0.164:64379 #1427633 (400 connections now open) 2015-10-05T06:53:53.725+0100 [conn1427633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:56.187+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:53:56.187+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:53:56.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210745703b51053ec6355 2015-10-05T06:53:56.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:53:57.407+0100 [conn1427203] end connection 172.28.0.163:53939 (399 connections now open) 2015-10-05T06:53:57.407+0100 [conn1427215] end connection 172.28.0.163:53984 (399 connections now open) 2015-10-05T06:53:57.408+0100 [mongosMain] connection accepted from 172.28.0.163:55073 #1427634 (399 connections now open) 2015-10-05T06:53:57.409+0100 [mongosMain] connection accepted from 172.28.0.163:55074 #1427635 (400 connections now open) 2015-10-05T06:53:57.410+0100 [conn1427634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:57.410+0100 [conn1427635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:53:58.613+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:03.184+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:03.184+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:03.193+0100 [conn1427241] end connection 172.28.0.164:63349 (399 connections now open) 2015-10-05T06:54:03.194+0100 [mongosMain] connection accepted from 172.28.0.164:64393 #1427636 (400 connections now open) 2015-10-05T06:54:03.195+0100 [conn1427636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:03.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612107a5703b51053ec638a 2015-10-05T06:54:03.258+0100 [conn1427234] end connection 172.28.0.163:54024 (399 connections now open) 2015-10-05T06:54:03.259+0100 [mongosMain] connection accepted from 172.28.0.163:55086 #1427637 (400 connections now open) 2015-10-05T06:54:03.260+0100 [conn1427637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:03.390+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:54:03.738+0100 [conn1427249] end connection 172.28.0.164:63369 (399 connections now open) 2015-10-05T06:54:03.739+0100 [mongosMain] connection accepted from 172.28.0.164:64395 #1427638 (400 connections now open) 2015-10-05T06:54:03.745+0100 [conn1427638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:07.423+0100 [conn1427229] end connection 172.28.0.163:54014 (399 connections now open) 2015-10-05T06:54:07.424+0100 [mongosMain] connection accepted from 172.28.0.163:55093 #1427639 (400 connections now open) 2015-10-05T06:54:07.425+0100 [conn1427639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:08.764+0100 [conn1427246] end connection 172.28.0.164:63359 (399 connections now open) 2015-10-05T06:54:08.764+0100 [mongosMain] connection accepted from 172.28.0.164:64399 #1427640 (400 connections now open) 2015-10-05T06:54:08.767+0100 [conn1427640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:09.621+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:11.205+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:11.205+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:13.273+0100 [conn1427248] end connection 172.28.0.163:54058 (399 connections now open) 2015-10-05T06:54:13.274+0100 [mongosMain] connection accepted from 172.28.0.163:55106 #1427641 (400 connections now open) 2015-10-05T06:54:13.276+0100 [conn1427641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:13.739+0100 [conn1427254] end connection 172.28.0.164:63381 (399 connections now open) 2015-10-05T06:54:13.742+0100 [mongosMain] connection accepted from 172.28.0.164:64405 #1427642 (400 connections now open) 2015-10-05T06:54:13.744+0100 [conn1427642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:15.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210875703b51053ec6440 2015-10-05T06:54:15.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:54:17.438+0100 [conn1427245] end connection 172.28.0.163:54046 (399 connections now open) 2015-10-05T06:54:17.439+0100 [mongosMain] connection accepted from 172.28.0.163:55111 #1427643 (400 connections now open) 2015-10-05T06:54:17.440+0100 [conn1427643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:19.258+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:54:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:54:20.237+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:20.237+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:20.622+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:23.209+0100 [conn1427192] end connection 172.28.0.164:63225 (399 connections now open) 2015-10-05T06:54:23.210+0100 [mongosMain] connection accepted from 172.28.0.164:64419 #1427644 (400 connections now open) 2015-10-05T06:54:23.212+0100 [conn1427644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:23.289+0100 [conn1427253] end connection 172.28.0.163:54079 (399 connections now open) 2015-10-05T06:54:23.290+0100 [mongosMain] connection accepted from 172.28.0.163:55120 #1427645 (400 connections now open) 2015-10-05T06:54:23.291+0100 [conn1427645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:23.754+0100 [conn1427258] end connection 172.28.0.164:63391 (399 connections now open) 2015-10-05T06:54:23.755+0100 [mongosMain] connection accepted from 172.28.0.164:64422 #1427646 (400 connections now open) 2015-10-05T06:54:23.757+0100 [conn1427646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:27.443+0100 [conn1427236] end connection 172.28.0.163:54027 (399 connections now open) 2015-10-05T06:54:27.444+0100 [mongosMain] connection accepted from 172.28.0.163:55123 #1427647 (400 connections now open) 2015-10-05T06:54:27.445+0100 [conn1427647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:28.758+0100 [mongosMain] connection accepted from 127.0.0.1:55126 #1427648 (401 connections now open) 2015-10-05T06:54:28.761+0100 [conn1427648] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:28.766+0100 [conn1427648] end connection 127.0.0.1:55126 (400 connections now open) 2015-10-05T06:54:28.797+0100 [conn1427238] end connection 172.28.0.164:63340 (399 connections now open) 2015-10-05T06:54:28.797+0100 [conn1427182] end connection 172.28.0.164:63196 (398 connections now open) 2015-10-05T06:54:28.798+0100 [mongosMain] connection accepted from 172.28.0.164:64431 #1427649 (399 connections now open) 2015-10-05T06:54:28.799+0100 [mongosMain] connection accepted from 172.28.0.164:64432 #1427650 (400 connections now open) 2015-10-05T06:54:28.799+0100 [conn1427649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:28.800+0100 [conn1427650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:30.240+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:30.240+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:31.633+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:33.229+0100 [conn1427252] end connection 172.28.0.164:63379 (399 connections now open) 2015-10-05T06:54:33.230+0100 [mongosMain] connection accepted from 172.28.0.164:64439 #1427651 (400 connections now open) 2015-10-05T06:54:33.232+0100 [conn1427651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:33.294+0100 [conn1427257] end connection 172.28.0.163:54100 (399 connections now open) 2015-10-05T06:54:33.295+0100 [mongosMain] connection accepted from 172.28.0.163:55129 #1427652 (400 connections now open) 2015-10-05T06:54:33.296+0100 [conn1427652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:33.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210995703b51053ec6521 2015-10-05T06:54:33.770+0100 [conn1427264] end connection 172.28.0.164:63411 (399 connections now open) 2015-10-05T06:54:33.771+0100 [mongosMain] connection accepted from 172.28.0.164:64441 #1427653 (400 connections now open) 2015-10-05T06:54:33.773+0100 [conn1427653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:33.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:54:37.454+0100 [conn1427230] end connection 172.28.0.163:54015 (399 connections now open) 2015-10-05T06:54:37.455+0100 [mongosMain] connection accepted from 172.28.0.163:55131 #1427654 (400 connections now open) 2015-10-05T06:54:37.456+0100 [conn1427654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:38.794+0100 [conn1427261] end connection 172.28.0.164:63397 (399 connections now open) 2015-10-05T06:54:38.794+0100 [conn1427205] end connection 172.28.0.164:63263 (398 connections now open) 2015-10-05T06:54:38.795+0100 [mongosMain] connection accepted from 172.28.0.164:64451 #1427655 (399 connections now open) 2015-10-05T06:54:38.797+0100 [mongosMain] connection accepted from 172.28.0.164:64452 #1427656 (400 connections now open) 2015-10-05T06:54:38.797+0100 [conn1427655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:38.798+0100 [conn1427656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:40.100+0100 [mongosMain] connection accepted from 127.0.0.1:55134 #1427657 (401 connections now open) 2015-10-05T06:54:40.103+0100 [conn1427657] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:40.108+0100 [conn1427657] end connection 127.0.0.1:55134 (400 connections now open) 2015-10-05T06:54:41.238+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:41.238+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:42.643+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:43.224+0100 [conn1427226] end connection 172.28.0.164:63307 (399 connections now open) 2015-10-05T06:54:43.226+0100 [mongosMain] connection accepted from 172.28.0.164:64460 #1427658 (400 connections now open) 2015-10-05T06:54:43.227+0100 [conn1427658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:43.306+0100 [conn1427263] end connection 172.28.0.163:54113 (399 connections now open) 2015-10-05T06:54:43.307+0100 [mongosMain] connection accepted from 172.28.0.163:55143 #1427659 (400 connections now open) 2015-10-05T06:54:43.308+0100 [conn1427659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:43.770+0100 [conn1427271] end connection 172.28.0.164:63430 (399 connections now open) 2015-10-05T06:54:43.771+0100 [mongosMain] connection accepted from 172.28.0.164:64464 #1427660 (400 connections now open) 2015-10-05T06:54:43.773+0100 [conn1427660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:46.077+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210a55703b51053ec65d8 2015-10-05T06:54:46.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:54:47.454+0100 [conn1427259] end connection 172.28.0.163:54107 (399 connections now open) 2015-10-05T06:54:47.454+0100 [conn1427260] end connection 172.28.0.163:54108 (398 connections now open) 2015-10-05T06:54:47.456+0100 [mongosMain] connection accepted from 172.28.0.163:55150 #1427661 (399 connections now open) 2015-10-05T06:54:47.456+0100 [mongosMain] connection accepted from 172.28.0.163:55151 #1427662 (400 connections now open) 2015-10-05T06:54:47.457+0100 [conn1427661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:47.457+0100 [conn1427662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:48.815+0100 [conn1427274] end connection 172.28.0.164:63443 (399 connections now open) 2015-10-05T06:54:48.815+0100 [conn1427140] end connection 172.28.0.164:63093 (398 connections now open) 2015-10-05T06:54:48.816+0100 [mongosMain] connection accepted from 172.28.0.164:64473 #1427663 (399 connections now open) 2015-10-05T06:54:48.816+0100 [mongosMain] connection accepted from 172.28.0.164:64474 #1427664 (400 connections now open) 2015-10-05T06:54:48.817+0100 [conn1427663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:48.817+0100 [conn1427664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:49.728+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:54:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:54:52.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210ac5703b51053ec6626 2015-10-05T06:54:52.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:54:52.759+0100 [conn1427225] end connection 172.28.0.163:54009 (399 connections now open) 2015-10-05T06:54:52.760+0100 [mongosMain] connection accepted from 172.28.0.163:55160 #1427665 (400 connections now open) 2015-10-05T06:54:52.762+0100 [conn1427665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:53.240+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:53.241+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:53.241+0100 [conn1427247] end connection 172.28.0.164:63365 (399 connections now open) 2015-10-05T06:54:53.241+0100 [mongosMain] connection accepted from 172.28.0.164:64481 #1427666 (400 connections now open) 2015-10-05T06:54:53.243+0100 [conn1427666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:53.305+0100 [conn1427270] end connection 172.28.0.163:54122 (399 connections now open) 2015-10-05T06:54:53.306+0100 [mongosMain] connection accepted from 172.28.0.163:55162 #1427667 (400 connections now open) 2015-10-05T06:54:53.308+0100 [conn1427667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:53.651+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:53.786+0100 [conn1427278] end connection 172.28.0.164:63454 (399 connections now open) 2015-10-05T06:54:53.787+0100 [mongosMain] connection accepted from 172.28.0.164:64483 #1427668 (400 connections now open) 2015-10-05T06:54:53.789+0100 [conn1427668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:55.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:55.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:57.469+0100 [conn1427123] end connection 172.28.0.163:53757 (399 connections now open) 2015-10-05T06:54:57.469+0100 [conn1427250] end connection 172.28.0.163:54066 (398 connections now open) 2015-10-05T06:54:57.470+0100 [mongosMain] connection accepted from 172.28.0.163:55172 #1427669 (399 connections now open) 2015-10-05T06:54:57.470+0100 [mongosMain] connection accepted from 172.28.0.163:55173 #1427670 (400 connections now open) 2015-10-05T06:54:57.471+0100 [conn1427669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:57.471+0100 [conn1427670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:54:58.256+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:54:58.256+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:54:58.811+0100 [conn1427125] end connection 172.28.0.164:63069 (399 connections now open) 2015-10-05T06:54:58.812+0100 [mongosMain] connection accepted from 172.28.0.164:64497 #1427671 (400 connections now open) 2015-10-05T06:54:58.813+0100 [conn1427671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:02.264+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:02.265+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:03.256+0100 [conn1427256] end connection 172.28.0.164:63388 (399 connections now open) 2015-10-05T06:55:03.257+0100 [mongosMain] connection accepted from 172.28.0.164:64504 #1427672 (400 connections now open) 2015-10-05T06:55:03.259+0100 [conn1427672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:03.320+0100 [conn1427277] end connection 172.28.0.163:54136 (399 connections now open) 2015-10-05T06:55:03.321+0100 [mongosMain] connection accepted from 172.28.0.163:55183 #1427673 (400 connections now open) 2015-10-05T06:55:03.322+0100 [conn1427673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:03.786+0100 [conn1427285] end connection 172.28.0.164:63477 (399 connections now open) 2015-10-05T06:55:03.787+0100 [mongosMain] connection accepted from 172.28.0.164:64506 #1427674 (400 connections now open) 2015-10-05T06:55:03.788+0100 [conn1427674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:04.676+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:04.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210b85703b51053ec66eb 2015-10-05T06:55:04.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:55:07.276+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:07.277+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:07.471+0100 [conn1427255] end connection 172.28.0.163:54086 (399 connections now open) 2015-10-05T06:55:07.471+0100 [conn1427237] end connection 172.28.0.163:54028 (399 connections now open) 2015-10-05T06:55:07.472+0100 [mongosMain] connection accepted from 172.28.0.163:55191 #1427675 (399 connections now open) 2015-10-05T06:55:07.472+0100 [mongosMain] connection accepted from 172.28.0.163:55192 #1427676 (400 connections now open) 2015-10-05T06:55:07.473+0100 [conn1427675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:07.473+0100 [conn1427676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:08.826+0100 [conn1427266] end connection 172.28.0.164:63421 (399 connections now open) 2015-10-05T06:55:08.826+0100 [conn1427189] end connection 172.28.0.164:63217 (398 connections now open) 2015-10-05T06:55:08.827+0100 [mongosMain] connection accepted from 172.28.0.164:64511 #1427677 (399 connections now open) 2015-10-05T06:55:08.827+0100 [mongosMain] connection accepted from 172.28.0.164:64512 #1427678 (400 connections now open) 2015-10-05T06:55:08.828+0100 [conn1427677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:08.829+0100 [conn1427678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:13.272+0100 [conn1427269] end connection 172.28.0.164:63428 (399 connections now open) 2015-10-05T06:55:13.273+0100 [mongosMain] connection accepted from 172.28.0.164:64514 #1427679 (400 connections now open) 2015-10-05T06:55:13.275+0100 [conn1427679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:13.349+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:13.349+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:13.802+0100 [conn1427291] end connection 172.28.0.164:63494 (399 connections now open) 2015-10-05T06:55:13.803+0100 [mongosMain] connection accepted from 172.28.0.164:64516 #1427680 (400 connections now open) 2015-10-05T06:55:13.806+0100 [conn1427680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:15.682+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:16.965+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561210c303838a4537162995') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444024516836), why: "doing balance round", ts: ObjectId('561210c45703b51053ec67a0') } } gle1: { lastOp: Timestamp 1444024516000|3, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } gle2: { lastOp: Timestamp 1444024504000|8, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2015-10-05T06:55:16.970+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T06:55:17.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210c45703b51053ec67a0 2015-10-05T06:55:17.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:55:17.486+0100 [conn1427280] end connection 172.28.0.163:54145 (399 connections now open) 2015-10-05T06:55:17.486+0100 [conn1427223] end connection 172.28.0.163:54003 (398 connections now open) 2015-10-05T06:55:17.487+0100 [mongosMain] connection accepted from 172.28.0.163:55207 #1427681 (399 connections now open) 2015-10-05T06:55:17.487+0100 [mongosMain] connection accepted from 172.28.0.163:55208 #1427682 (400 connections now open) 2015-10-05T06:55:17.488+0100 [conn1427681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:17.488+0100 [conn1427682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:18.842+0100 [conn1427197] end connection 172.28.0.164:63238 (399 connections now open) 2015-10-05T06:55:18.845+0100 [mongosMain] connection accepted from 172.28.0.164:64524 #1427683 (401 connections now open) 2015-10-05T06:55:18.845+0100 [conn1427282] end connection 172.28.0.164:63465 (399 connections now open) 2015-10-05T06:55:18.845+0100 [mongosMain] connection accepted from 172.28.0.164:64525 #1427684 (400 connections now open) 2015-10-05T06:55:18.846+0100 [conn1427684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:18.847+0100 [conn1427683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:20.004+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:55:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:55:20.352+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:20.353+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:22.790+0100 [conn1427218] end connection 172.28.0.163:53993 (399 connections now open) 2015-10-05T06:55:22.791+0100 [mongosMain] connection accepted from 172.28.0.163:55215 #1427685 (400 connections now open) 2015-10-05T06:55:22.792+0100 [conn1427685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:23.286+0100 [conn1427233] end connection 172.28.0.164:63326 (399 connections now open) 2015-10-05T06:55:23.288+0100 [mongosMain] connection accepted from 172.28.0.164:64532 #1427686 (400 connections now open) 2015-10-05T06:55:23.290+0100 [conn1427686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:23.336+0100 [conn1427284] end connection 172.28.0.163:54153 (399 connections now open) 2015-10-05T06:55:23.337+0100 [mongosMain] connection accepted from 172.28.0.163:55217 #1427687 (400 connections now open) 2015-10-05T06:55:23.338+0100 [conn1427687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:23.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210cb5703b51053ec67e1 2015-10-05T06:55:23.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:55:23.818+0100 [conn1427295] end connection 172.28.0.164:63507 (399 connections now open) 2015-10-05T06:55:23.819+0100 [mongosMain] connection accepted from 172.28.0.164:64535 #1427688 (400 connections now open) 2015-10-05T06:55:23.821+0100 [conn1427688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:26.696+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:27.493+0100 [conn1427292] end connection 172.28.0.163:54182 (399 connections now open) 2015-10-05T06:55:27.494+0100 [mongosMain] connection accepted from 172.28.0.163:55221 #1427689 (400 connections now open) 2015-10-05T06:55:27.495+0100 [conn1427689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:28.350+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:28.350+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:28.388+0100 [mongosMain] connection accepted from 127.0.0.1:55224 #1427690 (401 connections now open) 2015-10-05T06:55:28.390+0100 [conn1427690] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:28.395+0100 [conn1427690] end connection 127.0.0.1:55224 (400 connections now open) 2015-10-05T06:55:28.857+0100 [conn1427294] end connection 172.28.0.164:63499 (399 connections now open) 2015-10-05T06:55:28.858+0100 [conn1427173] end connection 172.28.0.164:63182 (398 connections now open) 2015-10-05T06:55:28.859+0100 [mongosMain] connection accepted from 172.28.0.164:64544 #1427691 (399 connections now open) 2015-10-05T06:55:28.859+0100 [mongosMain] connection accepted from 172.28.0.164:64546 #1427692 (400 connections now open) 2015-10-05T06:55:28.861+0100 [conn1427691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:28.861+0100 [conn1427692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:32.794+0100 [conn1427183] end connection 172.28.0.163:53905 (399 connections now open) 2015-10-05T06:55:32.795+0100 [mongosMain] connection accepted from 172.28.0.163:55226 #1427693 (400 connections now open) 2015-10-05T06:55:32.797+0100 [conn1427693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:33.303+0100 [conn1427276] end connection 172.28.0.164:63452 (399 connections now open) 2015-10-05T06:55:33.304+0100 [mongosMain] connection accepted from 172.28.0.164:64553 #1427694 (400 connections now open) 2015-10-05T06:55:33.306+0100 [conn1427694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:33.340+0100 [conn1427302] end connection 172.28.0.163:54207 (399 connections now open) 2015-10-05T06:55:33.342+0100 [mongosMain] connection accepted from 172.28.0.163:55228 #1427695 (400 connections now open) 2015-10-05T06:55:33.343+0100 [conn1427695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:33.833+0100 [conn1427303] end connection 172.28.0.164:63526 (399 connections now open) 2015-10-05T06:55:33.834+0100 [mongosMain] connection accepted from 172.28.0.164:64555 #1427696 (400 connections now open) 2015-10-05T06:55:33.836+0100 [conn1427696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:37.355+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:37.355+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:37.501+0100 [conn1427287] end connection 172.28.0.163:54163 (399 connections now open) 2015-10-05T06:55:37.502+0100 [mongosMain] connection accepted from 172.28.0.163:55235 #1427697 (400 connections now open) 2015-10-05T06:55:37.504+0100 [conn1427697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:37.707+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:38.889+0100 [conn1427281] end connection 172.28.0.164:63466 (399 connections now open) 2015-10-05T06:55:38.890+0100 [mongosMain] connection accepted from 172.28.0.164:64566 #1427698 (400 connections now open) 2015-10-05T06:55:38.892+0100 [conn1427698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:39.187+0100 [mongosMain] connection accepted from 127.0.0.1:55237 #1427699 (401 connections now open) 2015-10-05T06:55:39.190+0100 [conn1427699] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:39.195+0100 [conn1427699] end connection 127.0.0.1:55237 (400 connections now open) 2015-10-05T06:55:41.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210dd5703b51053ec6860 2015-10-05T06:55:41.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:55:42.806+0100 [conn1427232] end connection 172.28.0.163:54022 (399 connections now open) 2015-10-05T06:55:42.807+0100 [mongosMain] connection accepted from 172.28.0.163:55241 #1427700 (400 connections now open) 2015-10-05T06:55:42.808+0100 [conn1427700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:43.318+0100 [conn1427301] end connection 172.28.0.164:63524 (399 connections now open) 2015-10-05T06:55:43.319+0100 [mongosMain] connection accepted from 172.28.0.164:64575 #1427701 (400 connections now open) 2015-10-05T06:55:43.321+0100 [conn1427701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:43.352+0100 [conn1427311] end connection 172.28.0.163:54219 (399 connections now open) 2015-10-05T06:55:43.354+0100 [mongosMain] connection accepted from 172.28.0.163:55245 #1427702 (400 connections now open) 2015-10-05T06:55:43.355+0100 [conn1427702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:47.352+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:47.353+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:47.518+0100 [conn1427296] end connection 172.28.0.163:54198 (399 connections now open) 2015-10-05T06:55:47.519+0100 [mongosMain] connection accepted from 172.28.0.163:55253 #1427703 (400 connections now open) 2015-10-05T06:55:47.520+0100 [conn1427703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:48.795+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:48.889+0100 [conn1427306] end connection 172.28.0.164:63534 (399 connections now open) 2015-10-05T06:55:48.891+0100 [mongosMain] connection accepted from 172.28.0.164:64583 #1427704 (400 connections now open) 2015-10-05T06:55:48.893+0100 [conn1427704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:50.168+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:55:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:55:52.822+0100 [conn1427300] end connection 172.28.0.163:54205 (399 connections now open) 2015-10-05T06:55:52.824+0100 [mongosMain] connection accepted from 172.28.0.163:55260 #1427705 (400 connections now open) 2015-10-05T06:55:52.825+0100 [conn1427705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:53.335+0100 [conn1427290] end connection 172.28.0.164:63492 (399 connections now open) 2015-10-05T06:55:53.336+0100 [mongosMain] connection accepted from 172.28.0.164:64591 #1427706 (400 connections now open) 2015-10-05T06:55:53.338+0100 [conn1427706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:53.368+0100 [conn1427318] end connection 172.28.0.163:54236 (399 connections now open) 2015-10-05T06:55:53.369+0100 [mongosMain] connection accepted from 172.28.0.163:55262 #1427707 (400 connections now open) 2015-10-05T06:55:53.370+0100 [conn1427707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:53.865+0100 [conn1427312] end connection 172.28.0.164:63544 (399 connections now open) 2015-10-05T06:55:53.866+0100 [mongosMain] connection accepted from 172.28.0.164:64594 #1427708 (400 connections now open) 2015-10-05T06:55:53.868+0100 [conn1427708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:57.552+0100 [conn1427313] end connection 172.28.0.163:54224 (399 connections now open) 2015-10-05T06:55:57.552+0100 [conn1427211] end connection 172.28.0.163:53963 (399 connections now open) 2015-10-05T06:55:57.557+0100 [mongosMain] connection accepted from 172.28.0.163:55270 #1427709 (399 connections now open) 2015-10-05T06:55:57.558+0100 [conn1427709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:57.558+0100 [mongosMain] connection accepted from 172.28.0.163:55271 #1427710 (400 connections now open) 2015-10-05T06:55:57.559+0100 [conn1427710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:58.364+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:58.364+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:55:58.905+0100 [conn1427273] end connection 172.28.0.164:63442 (399 connections now open) 2015-10-05T06:55:58.906+0100 [conn1427320] end connection 172.28.0.164:63573 (398 connections now open) 2015-10-05T06:55:58.906+0100 [mongosMain] connection accepted from 172.28.0.164:64599 #1427711 (399 connections now open) 2015-10-05T06:55:58.907+0100 [mongosMain] connection accepted from 172.28.0.164:64600 #1427712 (400 connections now open) 2015-10-05T06:55:58.908+0100 [conn1427711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:58.909+0100 [conn1427712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:55:59.820+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:55:59.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210ef5703b51053ec68d0 2015-10-05T06:56:00.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:03.349+0100 [conn1427283] end connection 172.28.0.164:63474 (399 connections now open) 2015-10-05T06:56:03.351+0100 [mongosMain] connection accepted from 172.28.0.164:64605 #1427713 (400 connections now open) 2015-10-05T06:56:03.353+0100 [conn1427713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:03.370+0100 [conn1427323] end connection 172.28.0.163:54257 (399 connections now open) 2015-10-05T06:56:03.371+0100 [mongosMain] connection accepted from 172.28.0.163:55281 #1427714 (400 connections now open) 2015-10-05T06:56:03.372+0100 [conn1427714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:03.880+0100 [conn1427324] end connection 172.28.0.164:63580 (399 connections now open) 2015-10-05T06:56:03.882+0100 [mongosMain] connection accepted from 172.28.0.164:64606 #1427715 (400 connections now open) 2015-10-05T06:56:03.884+0100 [conn1427715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:07.538+0100 [conn1427286] end connection 172.28.0.163:54162 (399 connections now open) 2015-10-05T06:56:07.539+0100 [mongosMain] connection accepted from 172.28.0.163:55289 #1427716 (400 connections now open) 2015-10-05T06:56:07.540+0100 [conn1427716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:08.905+0100 [conn1427299] end connection 172.28.0.164:63513 (399 connections now open) 2015-10-05T06:56:08.905+0100 [conn1427298] end connection 172.28.0.164:63514 (399 connections now open) 2015-10-05T06:56:08.906+0100 [mongosMain] connection accepted from 172.28.0.164:64612 #1427717 (399 connections now open) 2015-10-05T06:56:08.907+0100 [mongosMain] connection accepted from 172.28.0.164:64611 #1427718 (400 connections now open) 2015-10-05T06:56:08.908+0100 [conn1427717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:08.909+0100 [conn1427718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:10.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:10.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:10.851+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:12.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561210fc5703b51053ec6963 2015-10-05T06:56:12.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:12.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:12.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:12.838+0100 [conn1427240] end connection 172.28.0.163:54037 (399 connections now open) 2015-10-05T06:56:12.839+0100 [mongosMain] connection accepted from 172.28.0.163:55300 #1427719 (400 connections now open) 2015-10-05T06:56:12.841+0100 [conn1427719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:13.350+0100 [conn1427310] end connection 172.28.0.164:63541 (399 connections now open) 2015-10-05T06:56:13.351+0100 [mongosMain] connection accepted from 172.28.0.164:64615 #1427720 (400 connections now open) 2015-10-05T06:56:13.353+0100 [conn1427720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:13.383+0100 [conn1427330] end connection 172.28.0.163:54277 (399 connections now open) 2015-10-05T06:56:13.384+0100 [mongosMain] connection accepted from 172.28.0.163:55302 #1427721 (400 connections now open) 2015-10-05T06:56:13.385+0100 [conn1427721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:13.896+0100 [conn1427331] end connection 172.28.0.164:63595 (399 connections now open) 2015-10-05T06:56:13.897+0100 [mongosMain] connection accepted from 172.28.0.164:64616 #1427722 (400 connections now open) 2015-10-05T06:56:13.899+0100 [conn1427722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:15.395+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:15.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:17.533+0100 [conn1427332] end connection 172.28.0.163:54287 (399 connections now open) 2015-10-05T06:56:17.535+0100 [mongosMain] connection accepted from 172.28.0.163:55309 #1427723 (400 connections now open) 2015-10-05T06:56:17.535+0100 [conn1427723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:18.936+0100 [conn1427288] end connection 172.28.0.164:63484 (399 connections now open) 2015-10-05T06:56:18.937+0100 [mongosMain] connection accepted from 172.28.0.164:64625 #1427724 (400 connections now open) 2015-10-05T06:56:18.938+0100 [conn1427724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:19.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:19.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:20.298+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:56:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:56:21.879+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:23.366+0100 [conn1427322] end connection 172.28.0.164:63577 (399 connections now open) 2015-10-05T06:56:23.367+0100 [mongosMain] connection accepted from 172.28.0.164:64635 #1427725 (400 connections now open) 2015-10-05T06:56:23.369+0100 [conn1427725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:23.384+0100 [conn1427338] end connection 172.28.0.163:54297 (399 connections now open) 2015-10-05T06:56:23.385+0100 [mongosMain] connection accepted from 172.28.0.163:55317 #1427726 (400 connections now open) 2015-10-05T06:56:23.386+0100 [conn1427726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:23.911+0100 [conn1427339] end connection 172.28.0.164:63608 (399 connections now open) 2015-10-05T06:56:23.912+0100 [mongosMain] connection accepted from 172.28.0.164:64639 #1427727 (400 connections now open) 2015-10-05T06:56:23.914+0100 [conn1427727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:24.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:24.396+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:24.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211085703b51053ec69d2 2015-10-05T06:56:24.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:27.554+0100 [conn1427305] end connection 172.28.0.163:54210 (399 connections now open) 2015-10-05T06:56:27.557+0100 [mongosMain] connection accepted from 172.28.0.163:55320 #1427728 (400 connections now open) 2015-10-05T06:56:27.558+0100 [conn1427728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:28.274+0100 [mongosMain] connection accepted from 127.0.0.1:55322 #1427729 (401 connections now open) 2015-10-05T06:56:28.276+0100 [conn1427729] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:28.281+0100 [conn1427729] end connection 127.0.0.1:55322 (400 connections now open) 2015-10-05T06:56:28.952+0100 [conn1427293] end connection 172.28.0.164:63498 (399 connections now open) 2015-10-05T06:56:28.953+0100 [mongosMain] connection accepted from 172.28.0.164:64649 #1427730 (400 connections now open) 2015-10-05T06:56:28.954+0100 [conn1427730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:30.399+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:30.400+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:31.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612110e5703b51053ec6a12 2015-10-05T06:56:31.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:32.853+0100 [conn1427316] end connection 172.28.0.163:54234 (399 connections now open) 2015-10-05T06:56:32.854+0100 [mongosMain] connection accepted from 172.28.0.163:55327 #1427731 (400 connections now open) 2015-10-05T06:56:32.855+0100 [conn1427731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:32.890+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:33.399+0100 [conn1427346] end connection 172.28.0.163:54313 (399 connections now open) 2015-10-05T06:56:33.400+0100 [mongosMain] connection accepted from 172.28.0.163:55329 #1427732 (400 connections now open) 2015-10-05T06:56:33.401+0100 [conn1427732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:33.928+0100 [conn1427347] end connection 172.28.0.164:63628 (399 connections now open) 2015-10-05T06:56:33.929+0100 [mongosMain] connection accepted from 172.28.0.164:64661 #1427733 (400 connections now open) 2015-10-05T06:56:33.931+0100 [conn1427733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:37.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211155703b51053ec6a49 2015-10-05T06:56:37.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:37.422+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:37.422+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:37.550+0100 [conn1427340] end connection 172.28.0.163:54304 (399 connections now open) 2015-10-05T06:56:37.551+0100 [mongosMain] connection accepted from 172.28.0.163:55334 #1427734 (400 connections now open) 2015-10-05T06:56:37.551+0100 [conn1427734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:38.968+0100 [conn1427267] end connection 172.28.0.164:63422 (399 connections now open) 2015-10-05T06:56:38.968+0100 [conn1427343] end connection 172.28.0.164:63616 (399 connections now open) 2015-10-05T06:56:38.969+0100 [mongosMain] connection accepted from 172.28.0.164:64675 #1427735 (399 connections now open) 2015-10-05T06:56:38.970+0100 [mongosMain] connection accepted from 172.28.0.164:64676 #1427736 (400 connections now open) 2015-10-05T06:56:38.971+0100 [conn1427735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:38.972+0100 [conn1427736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:39.195+0100 [mongosMain] connection accepted from 127.0.0.1:55336 #1427737 (401 connections now open) 2015-10-05T06:56:39.199+0100 [conn1427737] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:39.203+0100 [conn1427737] end connection 127.0.0.1:55336 (400 connections now open) 2015-10-05T06:56:42.855+0100 [conn1427309] end connection 172.28.0.163:54218 (399 connections now open) 2015-10-05T06:56:42.856+0100 [mongosMain] connection accepted from 172.28.0.163:55340 #1427738 (400 connections now open) 2015-10-05T06:56:42.857+0100 [conn1427738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:43.382+0100 [conn1427317] end connection 172.28.0.164:63560 (399 connections now open) 2015-10-05T06:56:43.384+0100 [mongosMain] connection accepted from 172.28.0.164:64683 #1427739 (400 connections now open) 2015-10-05T06:56:43.386+0100 [conn1427739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:43.400+0100 [conn1427352] end connection 172.28.0.163:54322 (399 connections now open) 2015-10-05T06:56:43.401+0100 [mongosMain] connection accepted from 172.28.0.163:55343 #1427740 (400 connections now open) 2015-10-05T06:56:43.401+0100 [conn1427740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:43.902+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:43.928+0100 [conn1427353] end connection 172.28.0.164:63646 (399 connections now open) 2015-10-05T06:56:43.930+0100 [mongosMain] connection accepted from 172.28.0.164:64686 #1427741 (400 connections now open) 2015-10-05T06:56:43.932+0100 [conn1427741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:45.475+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:45.476+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:47.564+0100 [conn1427348] end connection 172.28.0.163:54316 (399 connections now open) 2015-10-05T06:56:47.565+0100 [mongosMain] connection accepted from 172.28.0.163:55351 #1427742 (400 connections now open) 2015-10-05T06:56:47.566+0100 [conn1427742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:48.985+0100 [conn1427327] end connection 172.28.0.164:63589 (399 connections now open) 2015-10-05T06:56:48.985+0100 [conn1427085] end connection 172.28.0.164:62948 (398 connections now open) 2015-10-05T06:56:48.985+0100 [mongosMain] connection accepted from 172.28.0.164:64695 #1427743 (399 connections now open) 2015-10-05T06:56:48.985+0100 [mongosMain] connection accepted from 172.28.0.164:64696 #1427744 (400 connections now open) 2015-10-05T06:56:48.985+0100 [conn1427744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:48.985+0100 [conn1427743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:49.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211215703b51053ec6aec 2015-10-05T06:56:49.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:56:50.483+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:56:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:56:52.868+0100 [conn1427344] end connection 172.28.0.163:54311 (399 connections now open) 2015-10-05T06:56:52.869+0100 [mongosMain] connection accepted from 172.28.0.163:55358 #1427745 (400 connections now open) 2015-10-05T06:56:52.870+0100 [conn1427745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:53.382+0100 [conn1427329] end connection 172.28.0.164:63594 (399 connections now open) 2015-10-05T06:56:53.383+0100 [mongosMain] connection accepted from 172.28.0.164:64703 #1427746 (400 connections now open) 2015-10-05T06:56:53.385+0100 [conn1427746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:53.415+0100 [conn1427359] end connection 172.28.0.163:54333 (399 connections now open) 2015-10-05T06:56:53.417+0100 [mongosMain] connection accepted from 172.28.0.163:55360 #1427747 (400 connections now open) 2015-10-05T06:56:53.418+0100 [conn1427747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:53.928+0100 [conn1427360] end connection 172.28.0.164:63667 (399 connections now open) 2015-10-05T06:56:53.929+0100 [mongosMain] connection accepted from 172.28.0.164:64706 #1427748 (400 connections now open) 2015-10-05T06:56:53.930+0100 [conn1427748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:54.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:54.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:56:54.911+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:56:57.581+0100 [conn1427354] end connection 172.28.0.163:54326 (399 connections now open) 2015-10-05T06:56:57.582+0100 [mongosMain] connection accepted from 172.28.0.163:55369 #1427749 (400 connections now open) 2015-10-05T06:56:57.583+0100 [conn1427749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:58.967+0100 [conn1427356] end connection 172.28.0.164:63657 (399 connections now open) 2015-10-05T06:56:58.968+0100 [conn1427334] end connection 172.28.0.164:63600 (398 connections now open) 2015-10-05T06:56:58.969+0100 [mongosMain] connection accepted from 172.28.0.164:64712 #1427750 (399 connections now open) 2015-10-05T06:56:58.969+0100 [mongosMain] connection accepted from 172.28.0.164:64713 #1427751 (400 connections now open) 2015-10-05T06:56:58.971+0100 [conn1427750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:56:58.971+0100 [conn1427751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:02.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612112d5703b51053ec6b70 2015-10-05T06:57:02.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:02.875+0100 [conn1427351] end connection 172.28.0.163:54320 (399 connections now open) 2015-10-05T06:57:02.876+0100 [mongosMain] connection accepted from 172.28.0.163:55379 #1427752 (400 connections now open) 2015-10-05T06:57:02.877+0100 [conn1427752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:03.401+0100 [conn1427337] end connection 172.28.0.164:63606 (399 connections now open) 2015-10-05T06:57:03.402+0100 [mongosMain] connection accepted from 172.28.0.164:64717 #1427753 (400 connections now open) 2015-10-05T06:57:03.404+0100 [conn1427753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:03.944+0100 [conn1427367] end connection 172.28.0.164:63683 (399 connections now open) 2015-10-05T06:57:03.946+0100 [mongosMain] connection accepted from 172.28.0.164:64719 #1427754 (400 connections now open) 2015-10-05T06:57:03.948+0100 [conn1427754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:04.563+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:04.564+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:05.976+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:07.585+0100 [conn1427319] end connection 172.28.0.163:54246 (399 connections now open) 2015-10-05T06:57:07.586+0100 [mongosMain] connection accepted from 172.28.0.163:55387 #1427755 (400 connections now open) 2015-10-05T06:57:07.588+0100 [conn1427755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:08.983+0100 [conn1427326] end connection 172.28.0.164:63588 (399 connections now open) 2015-10-05T06:57:08.983+0100 [conn1427362] end connection 172.28.0.164:63674 (399 connections now open) 2015-10-05T06:57:08.984+0100 [mongosMain] connection accepted from 172.28.0.164:64724 #1427756 (399 connections now open) 2015-10-05T06:57:08.985+0100 [mongosMain] connection accepted from 172.28.0.164:64725 #1427757 (400 connections now open) 2015-10-05T06:57:08.986+0100 [conn1427756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:08.987+0100 [conn1427757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:12.885+0100 [conn1427358] end connection 172.28.0.163:54331 (399 connections now open) 2015-10-05T06:57:12.886+0100 [mongosMain] connection accepted from 172.28.0.163:55395 #1427758 (400 connections now open) 2015-10-05T06:57:12.887+0100 [conn1427758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:13.397+0100 [conn1427371] end connection 172.28.0.164:63692 (399 connections now open) 2015-10-05T06:57:13.398+0100 [mongosMain] connection accepted from 172.28.0.164:64728 #1427759 (400 connections now open) 2015-10-05T06:57:13.400+0100 [conn1427759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:13.431+0100 [conn1427372] end connection 172.28.0.163:54381 (399 connections now open) 2015-10-05T06:57:13.432+0100 [mongosMain] connection accepted from 172.28.0.163:55398 #1427760 (400 connections now open) 2015-10-05T06:57:13.434+0100 [conn1427760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:13.944+0100 [conn1427373] end connection 172.28.0.164:63695 (399 connections now open) 2015-10-05T06:57:13.945+0100 [mongosMain] connection accepted from 172.28.0.164:64730 #1427761 (400 connections now open) 2015-10-05T06:57:13.947+0100 [conn1427761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:14.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612113a5703b51053ec6bf9 2015-10-05T06:57:14.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:15.571+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:15.571+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:16.977+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:20.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211405703b51053ec6c31 2015-10-05T06:57:20.722+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:57:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:57:20.824+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:22.901+0100 [conn1427370] end connection 172.28.0.163:54378 (399 connections now open) 2015-10-05T06:57:22.902+0100 [mongosMain] connection accepted from 172.28.0.163:55410 #1427762 (400 connections now open) 2015-10-05T06:57:22.903+0100 [conn1427762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:23.447+0100 [conn1427366] end connection 172.28.0.163:54357 (399 connections now open) 2015-10-05T06:57:23.448+0100 [mongosMain] connection accepted from 172.28.0.163:55411 #1427763 (400 connections now open) 2015-10-05T06:57:23.449+0100 [conn1427763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:23.960+0100 [conn1427381] end connection 172.28.0.164:63705 (399 connections now open) 2015-10-05T06:57:23.961+0100 [mongosMain] connection accepted from 172.28.0.164:64743 #1427764 (400 connections now open) 2015-10-05T06:57:23.962+0100 [conn1427764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:27.573+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:27.573+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:27.603+0100 [conn1427374] end connection 172.28.0.163:54388 (399 connections now open) 2015-10-05T06:57:27.604+0100 [conn1427297] end connection 172.28.0.163:54199 (398 connections now open) 2015-10-05T06:57:27.604+0100 [mongosMain] connection accepted from 172.28.0.163:55419 #1427765 (399 connections now open) 2015-10-05T06:57:27.605+0100 [mongosMain] connection accepted from 172.28.0.163:55420 #1427766 (400 connections now open) 2015-10-05T06:57:27.606+0100 [conn1427765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:27.606+0100 [conn1427766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:27.984+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:28.902+0100 [mongosMain] connection accepted from 127.0.0.1:55428 #1427767 (401 connections now open) 2015-10-05T06:57:28.905+0100 [conn1427767] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:28.910+0100 [conn1427767] end connection 127.0.0.1:55428 (400 connections now open) 2015-10-05T06:57:28.998+0100 [conn1427342] end connection 172.28.0.164:63615 (399 connections now open) 2015-10-05T06:57:28.998+0100 [conn1427376] end connection 172.28.0.164:63699 (398 connections now open) 2015-10-05T06:57:28.999+0100 [mongosMain] connection accepted from 172.28.0.164:64752 #1427768 (399 connections now open) 2015-10-05T06:57:29.000+0100 [mongosMain] connection accepted from 172.28.0.164:64754 #1427769 (400 connections now open) 2015-10-05T06:57:29.001+0100 [conn1427768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:29.002+0100 [conn1427769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:29.582+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:29.582+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:32.585+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:32.585+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:32.902+0100 [conn1427364] end connection 172.28.0.163:54355 (399 connections now open) 2015-10-05T06:57:32.903+0100 [mongosMain] connection accepted from 172.28.0.163:55430 #1427770 (400 connections now open) 2015-10-05T06:57:32.904+0100 [conn1427770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:33.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612114c5703b51053ec6cac 2015-10-05T06:57:33.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:33.414+0100 [conn1427379] end connection 172.28.0.164:63703 (399 connections now open) 2015-10-05T06:57:33.415+0100 [mongosMain] connection accepted from 172.28.0.164:64764 #1427771 (400 connections now open) 2015-10-05T06:57:33.417+0100 [conn1427771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:33.448+0100 [conn1427380] end connection 172.28.0.163:54404 (399 connections now open) 2015-10-05T06:57:33.449+0100 [mongosMain] connection accepted from 172.28.0.163:55432 #1427772 (400 connections now open) 2015-10-05T06:57:33.450+0100 [conn1427772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:33.959+0100 [conn1427387] end connection 172.28.0.164:63727 (399 connections now open) 2015-10-05T06:57:33.960+0100 [mongosMain] connection accepted from 172.28.0.164:64767 #1427773 (400 connections now open) 2015-10-05T06:57:33.961+0100 [conn1427773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:36.589+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:36.590+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:37.612+0100 [conn1427375] end connection 172.28.0.163:54389 (399 connections now open) 2015-10-05T06:57:37.612+0100 [conn1427369] end connection 172.28.0.163:54366 (399 connections now open) 2015-10-05T06:57:37.613+0100 [mongosMain] connection accepted from 172.28.0.163:55436 #1427774 (399 connections now open) 2015-10-05T06:57:37.613+0100 [mongosMain] connection accepted from 172.28.0.163:55437 #1427775 (400 connections now open) 2015-10-05T06:57:37.614+0100 [conn1427774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:37.614+0100 [conn1427775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:38.988+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:39.013+0100 [conn1427389] end connection 172.28.0.164:63736 (399 connections now open) 2015-10-05T06:57:39.015+0100 [mongosMain] connection accepted from 172.28.0.164:64776 #1427776 (400 connections now open) 2015-10-05T06:57:39.017+0100 [conn1427776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:39.244+0100 [mongosMain] connection accepted from 127.0.0.1:55440 #1427777 (401 connections now open) 2015-10-05T06:57:39.247+0100 [conn1427777] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:39.251+0100 [conn1427777] end connection 127.0.0.1:55440 (400 connections now open) 2015-10-05T06:57:39.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211535703b51053ec6ce3 2015-10-05T06:57:39.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:41.598+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:41.599+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:42.917+0100 [conn1427336] end connection 172.28.0.163:54294 (399 connections now open) 2015-10-05T06:57:42.919+0100 [mongosMain] connection accepted from 172.28.0.163:55446 #1427778 (400 connections now open) 2015-10-05T06:57:42.920+0100 [conn1427778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:43.429+0100 [conn1427345] end connection 172.28.0.164:63625 (399 connections now open) 2015-10-05T06:57:43.434+0100 [mongosMain] connection accepted from 172.28.0.164:64785 #1427779 (400 connections now open) 2015-10-05T06:57:43.435+0100 [conn1427779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:43.463+0100 [conn1427386] end connection 172.28.0.163:54420 (399 connections now open) 2015-10-05T06:57:43.464+0100 [mongosMain] connection accepted from 172.28.0.163:55448 #1427780 (400 connections now open) 2015-10-05T06:57:43.465+0100 [conn1427780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:43.975+0100 [conn1427395] end connection 172.28.0.164:63746 (399 connections now open) 2015-10-05T06:57:43.976+0100 [mongosMain] connection accepted from 172.28.0.164:64787 #1427781 (400 connections now open) 2015-10-05T06:57:43.977+0100 [conn1427781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:47.605+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:47.606+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:47.613+0100 [conn1427251] end connection 172.28.0.163:54067 (399 connections now open) 2015-10-05T06:57:47.613+0100 [conn1427388] end connection 172.28.0.163:54423 (399 connections now open) 2015-10-05T06:57:47.614+0100 [mongosMain] connection accepted from 172.28.0.163:55456 #1427782 (399 connections now open) 2015-10-05T06:57:47.614+0100 [mongosMain] connection accepted from 172.28.0.163:55457 #1427783 (400 connections now open) 2015-10-05T06:57:47.615+0100 [conn1427782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:47.615+0100 [conn1427783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:49.014+0100 [conn1427383] end connection 172.28.0.164:63713 (399 connections now open) 2015-10-05T06:57:49.015+0100 [mongosMain] connection accepted from 172.28.0.164:64797 #1427784 (400 connections now open) 2015-10-05T06:57:49.017+0100 [conn1427784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:49.992+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:50.911+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:57:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:57:51.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612115f5703b51053ec6d51 2015-10-05T06:57:51.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:57:52.919+0100 [conn1427328] end connection 172.28.0.163:54274 (399 connections now open) 2015-10-05T06:57:52.920+0100 [mongosMain] connection accepted from 172.28.0.163:55467 #1427785 (400 connections now open) 2015-10-05T06:57:52.921+0100 [conn1427785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:53.429+0100 [conn1427365] end connection 172.28.0.164:63680 (399 connections now open) 2015-10-05T06:57:53.431+0100 [mongosMain] connection accepted from 172.28.0.164:64805 #1427786 (400 connections now open) 2015-10-05T06:57:53.432+0100 [conn1427786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:53.464+0100 [conn1427394] end connection 172.28.0.163:54432 (399 connections now open) 2015-10-05T06:57:53.465+0100 [mongosMain] connection accepted from 172.28.0.163:55469 #1427787 (400 connections now open) 2015-10-05T06:57:53.467+0100 [conn1427787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:53.975+0100 [conn1427403] end connection 172.28.0.164:63766 (399 connections now open) 2015-10-05T06:57:53.976+0100 [mongosMain] connection accepted from 172.28.0.164:64808 #1427788 (400 connections now open) 2015-10-05T06:57:53.977+0100 [conn1427788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:54.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:57:54.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:57:57.631+0100 [conn1427396] end connection 172.28.0.163:54437 (399 connections now open) 2015-10-05T06:57:57.632+0100 [conn1427279] end connection 172.28.0.163:54144 (398 connections now open) 2015-10-05T06:57:57.633+0100 [mongosMain] connection accepted from 172.28.0.163:55477 #1427789 (399 connections now open) 2015-10-05T06:57:57.633+0100 [conn1427789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:57.634+0100 [mongosMain] connection accepted from 172.28.0.163:55478 #1427790 (400 connections now open) 2015-10-05T06:57:57.635+0100 [conn1427790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:57:59.031+0100 [conn1427406] end connection 172.28.0.164:63776 (399 connections now open) 2015-10-05T06:57:59.032+0100 [mongosMain] connection accepted from 172.28.0.164:64813 #1427791 (400 connections now open) 2015-10-05T06:57:59.033+0100 [conn1427791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:01.004+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:02.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:02.659+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:03.479+0100 [conn1427402] end connection 172.28.0.163:54449 (399 connections now open) 2015-10-05T06:58:03.480+0100 [mongosMain] connection accepted from 172.28.0.163:55488 #1427792 (400 connections now open) 2015-10-05T06:58:03.481+0100 [conn1427792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:03.991+0100 [conn1427410] end connection 172.28.0.164:63785 (399 connections now open) 2015-10-05T06:58:03.992+0100 [mongosMain] connection accepted from 172.28.0.164:64819 #1427793 (400 connections now open) 2015-10-05T06:58:03.994+0100 [conn1427793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:04.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612116b5703b51053ec6de8 2015-10-05T06:58:04.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:58:07.631+0100 [conn1427361] end connection 172.28.0.163:54341 (399 connections now open) 2015-10-05T06:58:07.632+0100 [conn1427341] end connection 172.28.0.163:54305 (398 connections now open) 2015-10-05T06:58:07.633+0100 [mongosMain] connection accepted from 172.28.0.163:55495 #1427794 (399 connections now open) 2015-10-05T06:58:07.633+0100 [mongosMain] connection accepted from 172.28.0.163:55496 #1427795 (400 connections now open) 2015-10-05T06:58:07.634+0100 [conn1427794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:07.634+0100 [conn1427795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:09.045+0100 [conn1427397] end connection 172.28.0.164:63755 (399 connections now open) 2015-10-05T06:58:09.047+0100 [mongosMain] connection accepted from 172.28.0.164:64825 #1427796 (400 connections now open) 2015-10-05T06:58:09.048+0100 [conn1427796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:10.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211725703b51053ec6e4c 2015-10-05T06:58:10.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:58:11.662+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:11.662+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:12.015+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:13.480+0100 [conn1427409] end connection 172.28.0.163:54465 (399 connections now open) 2015-10-05T06:58:13.488+0100 [mongosMain] connection accepted from 172.28.0.163:55506 #1427797 (400 connections now open) 2015-10-05T06:58:13.490+0100 [conn1427797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:14.007+0100 [conn1427417] end connection 172.28.0.164:63797 (399 connections now open) 2015-10-05T06:58:14.008+0100 [mongosMain] connection accepted from 172.28.0.164:64829 #1427798 (400 connections now open) 2015-10-05T06:58:14.010+0100 [conn1427798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:17.644+0100 [conn1427412] end connection 172.28.0.163:54474 (399 connections now open) 2015-10-05T06:58:17.644+0100 [conn1427244] end connection 172.28.0.163:54045 (399 connections now open) 2015-10-05T06:58:17.645+0100 [mongosMain] connection accepted from 172.28.0.163:55512 #1427799 (399 connections now open) 2015-10-05T06:58:17.645+0100 [mongosMain] connection accepted from 172.28.0.163:55513 #1427800 (400 connections now open) 2015-10-05T06:58:17.646+0100 [conn1427799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:17.646+0100 [conn1427800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:19.062+0100 [conn1427414] end connection 172.28.0.164:63794 (399 connections now open) 2015-10-05T06:58:19.063+0100 [mongosMain] connection accepted from 172.28.0.164:64837 #1427801 (400 connections now open) 2015-10-05T06:58:19.065+0100 [conn1427801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:21.183+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:58:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:58:21.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:21.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:22.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612117e5703b51053ec6ed5 2015-10-05T06:58:22.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:58:23.029+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:23.477+0100 [conn1427385] end connection 172.28.0.164:63721 (399 connections now open) 2015-10-05T06:58:23.478+0100 [mongosMain] connection accepted from 172.28.0.164:64844 #1427802 (400 connections now open) 2015-10-05T06:58:23.479+0100 [conn1427802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:23.493+0100 [conn1427416] end connection 172.28.0.163:54484 (399 connections now open) 2015-10-05T06:58:23.495+0100 [mongosMain] connection accepted from 172.28.0.163:55521 #1427803 (400 connections now open) 2015-10-05T06:58:23.496+0100 [conn1427803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:24.023+0100 [conn1427422] end connection 172.28.0.164:63805 (399 connections now open) 2015-10-05T06:58:24.025+0100 [mongosMain] connection accepted from 172.28.0.164:64847 #1427804 (400 connections now open) 2015-10-05T06:58:24.027+0100 [conn1427804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:27.659+0100 [conn1427325] end connection 172.28.0.163:54264 (399 connections now open) 2015-10-05T06:58:27.659+0100 [conn1427405] end connection 172.28.0.163:54457 (398 connections now open) 2015-10-05T06:58:27.660+0100 [mongosMain] connection accepted from 172.28.0.163:55523 #1427805 (399 connections now open) 2015-10-05T06:58:27.661+0100 [mongosMain] connection accepted from 172.28.0.163:55524 #1427806 (400 connections now open) 2015-10-05T06:58:27.661+0100 [conn1427805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:27.662+0100 [conn1427806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:28.580+0100 [mongosMain] connection accepted from 127.0.0.1:55525 #1427807 (401 connections now open) 2015-10-05T06:58:28.582+0100 [conn1427807] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:28.588+0100 [conn1427807] end connection 127.0.0.1:55525 (400 connections now open) 2015-10-05T06:58:29.078+0100 [conn1427335] end connection 172.28.0.164:63601 (399 connections now open) 2015-10-05T06:58:29.079+0100 [mongosMain] connection accepted from 172.28.0.164:64856 #1427808 (400 connections now open) 2015-10-05T06:58:29.082+0100 [conn1427808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:32.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:32.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:33.477+0100 [conn1427401] end connection 172.28.0.164:63764 (399 connections now open) 2015-10-05T06:58:33.478+0100 [mongosMain] connection accepted from 172.28.0.164:64864 #1427809 (400 connections now open) 2015-10-05T06:58:33.480+0100 [conn1427809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:33.510+0100 [conn1427421] end connection 172.28.0.163:54501 (399 connections now open) 2015-10-05T06:58:33.511+0100 [mongosMain] connection accepted from 172.28.0.163:55529 #1427810 (400 connections now open) 2015-10-05T06:58:33.512+0100 [conn1427810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:34.022+0100 [conn1427427] end connection 172.28.0.164:63822 (399 connections now open) 2015-10-05T06:58:34.024+0100 [mongosMain] connection accepted from 172.28.0.164:64866 #1427811 (400 connections now open) 2015-10-05T06:58:34.025+0100 [conn1427811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:34.048+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:34.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612118a5703b51053ec6f6d 2015-10-05T06:58:34.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:58:37.662+0100 [conn1427423] end connection 172.28.0.163:54510 (399 connections now open) 2015-10-05T06:58:37.662+0100 [conn1427265] end connection 172.28.0.163:54117 (399 connections now open) 2015-10-05T06:58:37.663+0100 [mongosMain] connection accepted from 172.28.0.163:55532 #1427812 (399 connections now open) 2015-10-05T06:58:37.664+0100 [mongosMain] connection accepted from 172.28.0.163:55533 #1427813 (400 connections now open) 2015-10-05T06:58:37.664+0100 [conn1427812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:37.665+0100 [conn1427813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:39.092+0100 [conn1427420] end connection 172.28.0.164:63803 (399 connections now open) 2015-10-05T06:58:39.093+0100 [mongosMain] connection accepted from 172.28.0.164:64878 #1427814 (400 connections now open) 2015-10-05T06:58:39.095+0100 [conn1427814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:39.681+0100 [mongosMain] connection accepted from 127.0.0.1:55535 #1427815 (401 connections now open) 2015-10-05T06:58:39.684+0100 [conn1427815] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:39.688+0100 [conn1427815] end connection 127.0.0.1:55535 (400 connections now open) 2015-10-05T06:58:43.492+0100 [conn1427433] end connection 172.28.0.164:63840 (399 connections now open) 2015-10-05T06:58:43.493+0100 [mongosMain] connection accepted from 172.28.0.164:64886 #1427816 (400 connections now open) 2015-10-05T06:58:43.495+0100 [conn1427816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:43.510+0100 [conn1427426] end connection 172.28.0.163:54515 (399 connections now open) 2015-10-05T06:58:43.511+0100 [mongosMain] connection accepted from 172.28.0.163:55542 #1427817 (400 connections now open) 2015-10-05T06:58:43.513+0100 [conn1427817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:44.037+0100 [conn1427435] end connection 172.28.0.164:63843 (399 connections now open) 2015-10-05T06:58:44.039+0100 [mongosMain] connection accepted from 172.28.0.164:64888 #1427818 (400 connections now open) 2015-10-05T06:58:44.040+0100 [conn1427818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:44.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:44.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:45.069+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:46.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:46.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:47.679+0100 [conn1427428] end connection 172.28.0.163:54519 (399 connections now open) 2015-10-05T06:58:47.680+0100 [conn1427314] end connection 172.28.0.163:54225 (398 connections now open) 2015-10-05T06:58:47.680+0100 [mongosMain] connection accepted from 172.28.0.163:55553 #1427819 (400 connections now open) 2015-10-05T06:58:47.681+0100 [mongosMain] connection accepted from 172.28.0.163:55554 #1427820 (400 connections now open) 2015-10-05T06:58:47.681+0100 [conn1427819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:47.682+0100 [conn1427820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:49.108+0100 [conn1427425] end connection 172.28.0.164:63812 (399 connections now open) 2015-10-05T06:58:49.109+0100 [conn1427363] end connection 172.28.0.164:63673 (398 connections now open) 2015-10-05T06:58:49.109+0100 [mongosMain] connection accepted from 172.28.0.164:64896 #1427821 (399 connections now open) 2015-10-05T06:58:49.110+0100 [mongosMain] connection accepted from 172.28.0.164:64897 #1427822 (400 connections now open) 2015-10-05T06:58:49.112+0100 [conn1427821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:49.112+0100 [conn1427822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:49.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:49.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:51.454+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:58:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:58:52.980+0100 [conn1427378] end connection 172.28.0.163:54402 (399 connections now open) 2015-10-05T06:58:52.981+0100 [mongosMain] connection accepted from 172.28.0.163:55561 #1427823 (400 connections now open) 2015-10-05T06:58:52.983+0100 [conn1427823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:53.493+0100 [conn1427262] end connection 172.28.0.164:63408 (399 connections now open) 2015-10-05T06:58:53.494+0100 [mongosMain] connection accepted from 172.28.0.164:64906 #1427824 (400 connections now open) 2015-10-05T06:58:53.496+0100 [conn1427824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:53.526+0100 [conn1427434] end connection 172.28.0.163:54527 (399 connections now open) 2015-10-05T06:58:53.526+0100 [mongosMain] connection accepted from 172.28.0.163:55565 #1427825 (400 connections now open) 2015-10-05T06:58:53.527+0100 [conn1427825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:53.821+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:53.822+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:56.073+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:57.676+0100 [conn1427172] end connection 172.28.0.163:53878 (399 connections now open) 2015-10-05T06:58:57.676+0100 [conn1427437] end connection 172.28.0.163:54531 (399 connections now open) 2015-10-05T06:58:57.677+0100 [mongosMain] connection accepted from 172.28.0.163:55572 #1427826 (399 connections now open) 2015-10-05T06:58:57.677+0100 [mongosMain] connection accepted from 172.28.0.163:55573 #1427827 (400 connections now open) 2015-10-05T06:58:57.678+0100 [conn1427826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:57.678+0100 [conn1427827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:58.828+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:58:58.828+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:58:59.109+0100 [conn1427438] end connection 172.28.0.164:63855 (399 connections now open) 2015-10-05T06:58:59.110+0100 [mongosMain] connection accepted from 172.28.0.164:64917 #1427828 (400 connections now open) 2015-10-05T06:58:59.110+0100 [conn1427398] end connection 172.28.0.164:63756 (398 connections now open) 2015-10-05T06:58:59.112+0100 [mongosMain] connection accepted from 172.28.0.164:64918 #1427829 (400 connections now open) 2015-10-05T06:58:59.112+0100 [conn1427828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:58:59.113+0100 [conn1427829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:02.981+0100 [conn1427392] end connection 172.28.0.163:54430 (399 connections now open) 2015-10-05T06:59:02.983+0100 [mongosMain] connection accepted from 172.28.0.163:55582 #1427830 (400 connections now open) 2015-10-05T06:59:02.984+0100 [conn1427830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:03.508+0100 [conn1427415] end connection 172.28.0.164:63795 (399 connections now open) 2015-10-05T06:59:03.509+0100 [mongosMain] connection accepted from 172.28.0.164:64923 #1427831 (400 connections now open) 2015-10-05T06:59:03.510+0100 [conn1427831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:04.832+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:04.832+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:05.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211a95703b51053ec7179 2015-10-05T06:59:05.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:59:07.090+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:07.691+0100 [conn1427419] end connection 172.28.0.163:54494 (399 connections now open) 2015-10-05T06:59:07.691+0100 [conn1427272] end connection 172.28.0.163:54127 (399 connections now open) 2015-10-05T06:59:07.692+0100 [mongosMain] connection accepted from 172.28.0.163:55591 #1427832 (399 connections now open) 2015-10-05T06:59:07.693+0100 [mongosMain] connection accepted from 172.28.0.163:55592 #1427833 (400 connections now open) 2015-10-05T06:59:07.693+0100 [conn1427832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:07.694+0100 [conn1427833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:09.123+0100 [conn1427377] end connection 172.28.0.164:63700 (399 connections now open) 2015-10-05T06:59:09.124+0100 [conn1427430] end connection 172.28.0.164:63830 (398 connections now open) 2015-10-05T06:59:09.124+0100 [mongosMain] connection accepted from 172.28.0.164:64928 #1427834 (399 connections now open) 2015-10-05T06:59:09.125+0100 [mongosMain] connection accepted from 172.28.0.164:64929 #1427835 (400 connections now open) 2015-10-05T06:59:09.126+0100 [conn1427834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:09.126+0100 [conn1427835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:11.839+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:11.839+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:12.997+0100 [conn1427432] end connection 172.28.0.163:54525 (399 connections now open) 2015-10-05T06:59:12.998+0100 [mongosMain] connection accepted from 172.28.0.163:55603 #1427836 (400 connections now open) 2015-10-05T06:59:12.999+0100 [conn1427836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:13.523+0100 [conn1427408] end connection 172.28.0.164:63782 (399 connections now open) 2015-10-05T06:59:13.524+0100 [mongosMain] connection accepted from 172.28.0.164:64937 #1427837 (400 connections now open) 2015-10-05T06:59:13.525+0100 [conn1427837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:17.396+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:59:17.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:59:17.692+0100 [conn1427404] end connection 172.28.0.163:54456 (399 connections now open) 2015-10-05T06:59:17.692+0100 [conn1427444] end connection 172.28.0.163:54549 (399 connections now open) 2015-10-05T06:59:17.693+0100 [mongosMain] connection accepted from 172.28.0.163:55612 #1427838 (399 connections now open) 2015-10-05T06:59:17.693+0100 [mongosMain] connection accepted from 172.28.0.163:55613 #1427839 (400 connections now open) 2015-10-05T06:59:17.694+0100 [conn1427838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:17.694+0100 [conn1427839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:18.092+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:19.124+0100 [conn1427350] end connection 172.28.0.164:63637 (399 connections now open) 2015-10-05T06:59:19.125+0100 [mongosMain] connection accepted from 172.28.0.164:64946 #1427840 (400 connections now open) 2015-10-05T06:59:19.126+0100 [conn1427840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:19.894+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:19.894+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:21.727+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:59:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:59:22.997+0100 [conn1427384] end connection 172.28.0.163:54418 (399 connections now open) 2015-10-05T06:59:22.998+0100 [mongosMain] connection accepted from 172.28.0.163:55618 #1427841 (400 connections now open) 2015-10-05T06:59:23.000+0100 [conn1427841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:23.524+0100 [conn1427393] end connection 172.28.0.164:63743 (399 connections now open) 2015-10-05T06:59:23.525+0100 [mongosMain] connection accepted from 172.28.0.164:64956 #1427842 (400 connections now open) 2015-10-05T06:59:23.527+0100 [conn1427842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:23.538+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T06:59:23.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T06:59:27.707+0100 [conn1427449] end connection 172.28.0.163:54569 (399 connections now open) 2015-10-05T06:59:27.707+0100 [conn1427368] end connection 172.28.0.163:54364 (399 connections now open) 2015-10-05T06:59:27.708+0100 [mongosMain] connection accepted from 172.28.0.163:55620 #1427843 (399 connections now open) 2015-10-05T06:59:27.709+0100 [mongosMain] connection accepted from 172.28.0.163:55621 #1427844 (400 connections now open) 2015-10-05T06:59:27.709+0100 [conn1427843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:27.710+0100 [conn1427844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:28.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:28.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:28.941+0100 [mongosMain] connection accepted from 127.0.0.1:55626 #1427845 (401 connections now open) 2015-10-05T06:59:28.943+0100 [conn1427845] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:28.949+0100 [conn1427845] end connection 127.0.0.1:55626 (400 connections now open) 2015-10-05T06:59:29.094+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:29.140+0100 [conn1427355] end connection 172.28.0.164:63656 (399 connections now open) 2015-10-05T06:59:29.142+0100 [mongosMain] connection accepted from 172.28.0.164:64966 #1427846 (400 connections now open) 2015-10-05T06:59:29.144+0100 [conn1427846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:33.011+0100 [conn1427400] end connection 172.28.0.163:54446 (399 connections now open) 2015-10-05T06:59:33.012+0100 [mongosMain] connection accepted from 172.28.0.163:55627 #1427847 (400 connections now open) 2015-10-05T06:59:33.013+0100 [conn1427847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:35.824+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211c75703b51053ec736b 2015-10-05T06:59:35.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:59:37.708+0100 [conn1427304] end connection 172.28.0.163:54209 (399 connections now open) 2015-10-05T06:59:37.709+0100 [conn1427455] end connection 172.28.0.163:54587 (399 connections now open) 2015-10-05T06:59:37.709+0100 [mongosMain] connection accepted from 172.28.0.163:55633 #1427848 (399 connections now open) 2015-10-05T06:59:37.710+0100 [mongosMain] connection accepted from 172.28.0.163:55634 #1427849 (400 connections now open) 2015-10-05T06:59:37.710+0100 [conn1427848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:37.711+0100 [conn1427849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:38.901+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:38.901+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:39.141+0100 [conn1427382] end connection 172.28.0.164:63712 (399 connections now open) 2015-10-05T06:59:39.141+0100 [conn1427446] end connection 172.28.0.164:63878 (399 connections now open) 2015-10-05T06:59:39.142+0100 [mongosMain] connection accepted from 172.28.0.164:64985 #1427850 (399 connections now open) 2015-10-05T06:59:39.142+0100 [mongosMain] connection accepted from 172.28.0.164:64984 #1427851 (400 connections now open) 2015-10-05T06:59:39.144+0100 [conn1427850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:39.144+0100 [conn1427851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:39.966+0100 [mongosMain] connection accepted from 127.0.0.1:55638 #1427852 (401 connections now open) 2015-10-05T06:59:39.968+0100 [conn1427852] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:39.973+0100 [conn1427852] end connection 127.0.0.1:55638 (400 connections now open) 2015-10-05T06:59:40.099+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:43.012+0100 [conn1427321] end connection 172.28.0.163:54254 (399 connections now open) 2015-10-05T06:59:43.013+0100 [mongosMain] connection accepted from 172.28.0.163:55642 #1427853 (400 connections now open) 2015-10-05T06:59:43.014+0100 [conn1427853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:47.722+0100 [conn1427424] end connection 172.28.0.163:54511 (399 connections now open) 2015-10-05T06:59:47.722+0100 [conn1427462] end connection 172.28.0.163:54609 (399 connections now open) 2015-10-05T06:59:47.723+0100 [mongosMain] connection accepted from 172.28.0.163:55650 #1427854 (399 connections now open) 2015-10-05T06:59:47.724+0100 [mongosMain] connection accepted from 172.28.0.163:55651 #1427855 (400 connections now open) 2015-10-05T06:59:47.724+0100 [conn1427854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:47.725+0100 [conn1427855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:48.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211d35703b51053ec740d 2015-10-05T06:59:48.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T06:59:49.156+0100 [conn1427451] end connection 172.28.0.164:63896 (399 connections now open) 2015-10-05T06:59:49.157+0100 [conn1427390] end connection 172.28.0.164:63737 (398 connections now open) 2015-10-05T06:59:49.157+0100 [mongosMain] connection accepted from 172.28.0.164:65002 #1427856 (400 connections now open) 2015-10-05T06:59:49.158+0100 [mongosMain] connection accepted from 172.28.0.164:65003 #1427857 (400 connections now open) 2015-10-05T06:59:49.160+0100 [conn1427856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:49.160+0100 [conn1427857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:49.913+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:49.913+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T06:59:51.104+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T06:59:52.030+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 06:59:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T06:59:53.026+0100 [conn1427447] end connection 172.28.0.163:54560 (399 connections now open) 2015-10-05T06:59:53.027+0100 [mongosMain] connection accepted from 172.28.0.163:55659 #1427858 (400 connections now open) 2015-10-05T06:59:53.028+0100 [conn1427858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:57.739+0100 [conn1427466] end connection 172.28.0.163:54617 (399 connections now open) 2015-10-05T06:59:57.739+0100 [conn1427333] end connection 172.28.0.163:54288 (399 connections now open) 2015-10-05T06:59:57.740+0100 [mongosMain] connection accepted from 172.28.0.163:55665 #1427859 (399 connections now open) 2015-10-05T06:59:57.740+0100 [mongosMain] connection accepted from 172.28.0.163:55666 #1427860 (400 connections now open) 2015-10-05T06:59:57.741+0100 [conn1427859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:57.741+0100 [conn1427860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T06:59:59.155+0100 [conn1427167] end connection 172.28.0.164:63170 (399 connections now open) 2015-10-05T06:59:59.155+0100 [mongosMain] connection accepted from 172.28.0.164:65016 #1427861 (400 connections now open) 2015-10-05T06:59:59.157+0100 [conn1427861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:00.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211e05703b51053ec74d4 2015-10-05T07:00:00.799+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:00:01.918+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:01.918+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:02.150+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:03.043+0100 [conn1427457] end connection 172.28.0.163:54594 (399 connections now open) 2015-10-05T07:00:03.044+0100 [mongosMain] connection accepted from 172.28.0.163:55696 #1427862 (400 connections now open) 2015-10-05T07:00:03.045+0100 [conn1427862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:03.925+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:03.925+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:06.926+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:06.926+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:06.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211e65703b51053ec75ef 2015-10-05T07:00:07.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:00:07.739+0100 [conn1427471] end connection 172.28.0.163:54637 (399 connections now open) 2015-10-05T07:00:07.740+0100 [mongosMain] connection accepted from 172.28.0.163:55705 #1427863 (400 connections now open) 2015-10-05T07:00:07.741+0100 [conn1427863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:09.172+0100 [conn1427452] end connection 172.28.0.164:63897 (399 connections now open) 2015-10-05T07:00:09.173+0100 [mongosMain] connection accepted from 172.28.0.164:65042 #1427864 (400 connections now open) 2015-10-05T07:00:09.174+0100 [conn1427864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:10.930+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:10.931+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:13.043+0100 [conn1427469] end connection 172.28.0.163:54627 (399 connections now open) 2015-10-05T07:00:13.044+0100 [mongosMain] connection accepted from 172.28.0.163:55714 #1427865 (400 connections now open) 2015-10-05T07:00:13.045+0100 [conn1427865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:13.232+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:13.329+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:00:13.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:00:13.588+0100 [conn1427442] end connection 172.28.0.163:54541 (399 connections now open) 2015-10-05T07:00:13.589+0100 [mongosMain] connection accepted from 172.28.0.163:55717 #1427866 (400 connections now open) 2015-10-05T07:00:13.590+0100 [conn1427866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:15.941+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:15.941+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:17.888+0100 [conn1427458] end connection 172.28.0.163:54601 (399 connections now open) 2015-10-05T07:00:17.896+0100 [mongosMain] connection accepted from 172.28.0.163:55724 #1427867 (400 connections now open) 2015-10-05T07:00:17.897+0100 [conn1427867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:19.171+0100 [conn1427456] end connection 172.28.0.164:63907 (399 connections now open) 2015-10-05T07:00:19.172+0100 [mongosMain] connection accepted from 172.28.0.164:65059 #1427868 (400 connections now open) 2015-10-05T07:00:19.173+0100 [conn1427868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:19.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561211f35703b51053ec79ae 2015-10-05T07:00:19.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:00:21.937+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:21.938+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:22.195+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:00:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:00:24.243+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:28.347+0100 [mongosMain] connection accepted from 127.0.0.1:55737 #1427869 (401 connections now open) 2015-10-05T07:00:28.350+0100 [conn1427869] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:28.361+0100 [conn1427869] end connection 127.0.0.1:55737 (400 connections now open) 2015-10-05T07:00:28.940+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:28.941+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:29.187+0100 [conn1427484] end connection 172.28.0.164:64006 (399 connections now open) 2015-10-05T07:00:29.187+0100 [conn1427460] end connection 172.28.0.164:63918 (398 connections now open) 2015-10-05T07:00:29.187+0100 [mongosMain] connection accepted from 172.28.0.164:65079 #1427870 (399 connections now open) 2015-10-05T07:00:29.188+0100 [mongosMain] connection accepted from 172.28.0.164:65080 #1427871 (400 connections now open) 2015-10-05T07:00:29.189+0100 [conn1427870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:29.190+0100 [conn1427871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:33.059+0100 [conn1427485] end connection 172.28.0.163:54703 (399 connections now open) 2015-10-05T07:00:33.060+0100 [mongosMain] connection accepted from 172.28.0.163:55744 #1427872 (400 connections now open) 2015-10-05T07:00:33.061+0100 [conn1427872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:33.606+0100 [conn1427480] end connection 172.28.0.163:54689 (399 connections now open) 2015-10-05T07:00:33.607+0100 [mongosMain] connection accepted from 172.28.0.163:55746 #1427873 (400 connections now open) 2015-10-05T07:00:33.608+0100 [conn1427873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:34.133+0100 [conn1427443] end connection 172.28.0.164:63865 (399 connections now open) 2015-10-05T07:00:34.134+0100 [mongosMain] connection accepted from 172.28.0.164:65092 #1427874 (400 connections now open) 2015-10-05T07:00:34.136+0100 [conn1427874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:35.283+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:36.938+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:36.938+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:38.038+0100 [conn1427477] end connection 172.28.0.163:54677 (399 connections now open) 2015-10-05T07:00:38.039+0100 [mongosMain] connection accepted from 172.28.0.163:55750 #1427875 (400 connections now open) 2015-10-05T07:00:38.041+0100 [conn1427875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:39.203+0100 [conn1427464] end connection 172.28.0.164:63937 (399 connections now open) 2015-10-05T07:00:39.203+0100 [conn1427459] end connection 172.28.0.164:63917 (398 connections now open) 2015-10-05T07:00:39.204+0100 [mongosMain] connection accepted from 172.28.0.164:65102 #1427876 (399 connections now open) 2015-10-05T07:00:39.205+0100 [mongosMain] connection accepted from 172.28.0.164:65103 #1427877 (400 connections now open) 2015-10-05T07:00:39.206+0100 [conn1427876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:39.206+0100 [conn1427877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:40.134+0100 [mongosMain] connection accepted from 127.0.0.1:55752 #1427878 (401 connections now open) 2015-10-05T07:00:40.137+0100 [conn1427878] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:40.141+0100 [conn1427878] end connection 127.0.0.1:55752 (400 connections now open) 2015-10-05T07:00:43.620+0100 [conn1427492] end connection 172.28.0.163:54717 (399 connections now open) 2015-10-05T07:00:43.622+0100 [mongosMain] connection accepted from 172.28.0.163:55759 #1427879 (400 connections now open) 2015-10-05T07:00:43.623+0100 [conn1427879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:44.148+0100 [conn1427493] end connection 172.28.0.164:64037 (399 connections now open) 2015-10-05T07:00:44.150+0100 [mongosMain] connection accepted from 172.28.0.164:65111 #1427880 (400 connections now open) 2015-10-05T07:00:44.151+0100 [conn1427880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:45.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612120b5703b51053ec8274 2015-10-05T07:00:45.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:00:45.940+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:45.940+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:46.294+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:49.220+0100 [conn1427489] end connection 172.28.0.164:64024 (399 connections now open) 2015-10-05T07:00:49.220+0100 [conn1427289] end connection 172.28.0.164:63485 (398 connections now open) 2015-10-05T07:00:49.221+0100 [mongosMain] connection accepted from 172.28.0.164:65120 #1427881 (399 connections now open) 2015-10-05T07:00:49.221+0100 [mongosMain] connection accepted from 172.28.0.164:65121 #1427882 (400 connections now open) 2015-10-05T07:00:49.223+0100 [conn1427882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:49.223+0100 [conn1427881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:51.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212135703b51053ec851f 2015-10-05T07:00:51.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:00:52.315+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:00:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:00:53.619+0100 [conn1427461] end connection 172.28.0.164:63926 (399 connections now open) 2015-10-05T07:00:53.620+0100 [mongosMain] connection accepted from 172.28.0.164:65128 #1427883 (400 connections now open) 2015-10-05T07:00:53.622+0100 [conn1427500] end connection 172.28.0.163:54730 (399 connections now open) 2015-10-05T07:00:53.622+0100 [conn1427883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:53.623+0100 [mongosMain] connection accepted from 172.28.0.163:55776 #1427884 (400 connections now open) 2015-10-05T07:00:53.625+0100 [conn1427884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:54.149+0100 [conn1427501] end connection 172.28.0.164:64055 (399 connections now open) 2015-10-05T07:00:54.150+0100 [mongosMain] connection accepted from 172.28.0.164:65130 #1427885 (400 connections now open) 2015-10-05T07:00:54.151+0100 [conn1427885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:55.942+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:55.943+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:00:57.307+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:00:57.739+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:00:57.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:00:59.106+0100 [conn1427481] end connection 172.28.0.163:54696 (399 connections now open) 2015-10-05T07:00:59.111+0100 [mongosMain] connection accepted from 172.28.0.163:55787 #1427886 (400 connections now open) 2015-10-05T07:00:59.112+0100 [conn1427886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:59.318+0100 [conn1427503] end connection 172.28.0.164:64061 (399 connections now open) 2015-10-05T07:00:59.318+0100 [conn1427413] end connection 172.28.0.164:63793 (399 connections now open) 2015-10-05T07:00:59.328+0100 [mongosMain] connection accepted from 172.28.0.164:65135 #1427887 (399 connections now open) 2015-10-05T07:00:59.328+0100 [mongosMain] connection accepted from 172.28.0.164:65136 #1427888 (400 connections now open) 2015-10-05T07:00:59.330+0100 [conn1427887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:00:59.330+0100 [conn1427888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:03.090+0100 [conn1427472] end connection 172.28.0.163:54650 (399 connections now open) 2015-10-05T07:01:03.091+0100 [mongosMain] connection accepted from 172.28.0.163:55797 #1427889 (400 connections now open) 2015-10-05T07:01:03.092+0100 [conn1427889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:03.633+0100 [conn1427441] end connection 172.28.0.164:63863 (399 connections now open) 2015-10-05T07:01:03.634+0100 [mongosMain] connection accepted from 172.28.0.164:65149 #1427890 (400 connections now open) 2015-10-05T07:01:03.635+0100 [conn1427506] end connection 172.28.0.163:54750 (399 connections now open) 2015-10-05T07:01:03.636+0100 [conn1427890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:03.636+0100 [mongosMain] connection accepted from 172.28.0.163:55802 #1427891 (400 connections now open) 2015-10-05T07:01:03.637+0100 [conn1427891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:04.163+0100 [conn1427507] end connection 172.28.0.164:64074 (399 connections now open) 2015-10-05T07:01:04.164+0100 [mongosMain] connection accepted from 172.28.0.164:65153 #1427892 (400 connections now open) 2015-10-05T07:01:04.165+0100 [conn1427892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:06.945+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:06.945+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:08.409+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:09.096+0100 [conn1427508] end connection 172.28.0.163:54757 (399 connections now open) 2015-10-05T07:01:09.097+0100 [mongosMain] connection accepted from 172.28.0.163:55813 #1427893 (400 connections now open) 2015-10-05T07:01:09.099+0100 [conn1427893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:09.301+0100 [conn1427478] end connection 172.28.0.164:63996 (399 connections now open) 2015-10-05T07:01:09.302+0100 [mongosMain] connection accepted from 172.28.0.164:65157 #1427894 (400 connections now open) 2015-10-05T07:01:09.305+0100 [conn1427894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:09.895+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:01:09.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:01:13.092+0100 [conn1427475] end connection 172.28.0.163:54668 (399 connections now open) 2015-10-05T07:01:13.093+0100 [mongosMain] connection accepted from 172.28.0.163:55818 #1427895 (400 connections now open) 2015-10-05T07:01:13.094+0100 [conn1427895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:13.637+0100 [conn1427513] end connection 172.28.0.163:54773 (399 connections now open) 2015-10-05T07:01:13.638+0100 [mongosMain] connection accepted from 172.28.0.163:55821 #1427896 (400 connections now open) 2015-10-05T07:01:13.639+0100 [conn1427896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:14.181+0100 [conn1427514] end connection 172.28.0.164:64085 (399 connections now open) 2015-10-05T07:01:14.182+0100 [mongosMain] connection accepted from 172.28.0.164:65162 #1427897 (400 connections now open) 2015-10-05T07:01:14.183+0100 [conn1427897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:16.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612122b5703b51053ec8d54 2015-10-05T07:01:16.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:01:18.950+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:18.951+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:19.096+0100 [conn1427494] end connection 172.28.0.163:54719 (399 connections now open) 2015-10-05T07:01:19.096+0100 [mongosMain] connection accepted from 172.28.0.163:55827 #1427898 (400 connections now open) 2015-10-05T07:01:19.097+0100 [conn1427898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:19.280+0100 [conn1427407] end connection 172.28.0.164:63777 (399 connections now open) 2015-10-05T07:01:19.281+0100 [conn1427517] end connection 172.28.0.164:64091 (398 connections now open) 2015-10-05T07:01:19.282+0100 [mongosMain] connection accepted from 172.28.0.164:65166 #1427899 (399 connections now open) 2015-10-05T07:01:19.283+0100 [mongosMain] connection accepted from 172.28.0.164:65167 #1427900 (400 connections now open) 2015-10-05T07:01:19.284+0100 [conn1427899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:19.284+0100 [conn1427900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:19.412+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:21.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:21.073+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:22.563+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:01:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:01:23.106+0100 [conn1427490] end connection 172.28.0.163:54715 (399 connections now open) 2015-10-05T07:01:23.108+0100 [mongosMain] connection accepted from 172.28.0.163:55838 #1427901 (400 connections now open) 2015-10-05T07:01:23.109+0100 [conn1427901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:23.651+0100 [conn1427521] end connection 172.28.0.163:54794 (399 connections now open) 2015-10-05T07:01:23.652+0100 [mongosMain] connection accepted from 172.28.0.163:55840 #1427902 (400 connections now open) 2015-10-05T07:01:23.653+0100 [conn1427902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:24.077+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:24.077+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:24.196+0100 [conn1427522] end connection 172.28.0.164:64096 (399 connections now open) 2015-10-05T07:01:24.197+0100 [mongosMain] connection accepted from 172.28.0.164:65178 #1427903 (400 connections now open) 2015-10-05T07:01:24.198+0100 [conn1427903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:28.078+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:28.078+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:28.764+0100 [mongosMain] connection accepted from 127.0.0.1:55843 #1427904 (401 connections now open) 2015-10-05T07:01:28.766+0100 [conn1427904] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:28.771+0100 [conn1427904] end connection 127.0.0.1:55843 (400 connections now open) 2015-10-05T07:01:29.112+0100 [conn1427523] end connection 172.28.0.163:54800 (399 connections now open) 2015-10-05T07:01:29.113+0100 [mongosMain] connection accepted from 172.28.0.163:55844 #1427905 (400 connections now open) 2015-10-05T07:01:29.114+0100 [conn1427905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:29.297+0100 [conn1427463] end connection 172.28.0.164:63936 (399 connections now open) 2015-10-05T07:01:29.297+0100 [conn1427467] end connection 172.28.0.164:63953 (399 connections now open) 2015-10-05T07:01:29.298+0100 [mongosMain] connection accepted from 172.28.0.164:65188 #1427906 (399 connections now open) 2015-10-05T07:01:29.299+0100 [mongosMain] connection accepted from 172.28.0.164:65187 #1427907 (400 connections now open) 2015-10-05T07:01:29.301+0100 [conn1427907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:29.301+0100 [conn1427906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:30.466+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:33.084+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:33.084+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:33.122+0100 [conn1427440] end connection 172.28.0.163:54538 (399 connections now open) 2015-10-05T07:01:33.123+0100 [mongosMain] connection accepted from 172.28.0.163:55850 #1427908 (400 connections now open) 2015-10-05T07:01:33.124+0100 [conn1427908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:33.667+0100 [conn1427528] end connection 172.28.0.163:54809 (399 connections now open) 2015-10-05T07:01:33.668+0100 [mongosMain] connection accepted from 172.28.0.163:55852 #1427909 (400 connections now open) 2015-10-05T07:01:33.669+0100 [conn1427909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:34.211+0100 [conn1427529] end connection 172.28.0.164:64115 (399 connections now open) 2015-10-05T07:01:34.212+0100 [mongosMain] connection accepted from 172.28.0.164:65199 #1427910 (400 connections now open) 2015-10-05T07:01:34.214+0100 [conn1427910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:34.375+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:01:34.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:01:39.100+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:39.101+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:39.126+0100 [conn1427530] end connection 172.28.0.163:54812 (399 connections now open) 2015-10-05T07:01:39.127+0100 [mongosMain] connection accepted from 172.28.0.163:55856 #1427911 (400 connections now open) 2015-10-05T07:01:39.128+0100 [conn1427911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:39.313+0100 [conn1427518] end connection 172.28.0.164:64092 (399 connections now open) 2015-10-05T07:01:39.313+0100 [conn1427524] end connection 172.28.0.164:64103 (398 connections now open) 2015-10-05T07:01:39.314+0100 [mongosMain] connection accepted from 172.28.0.164:65210 #1427912 (399 connections now open) 2015-10-05T07:01:39.314+0100 [mongosMain] connection accepted from 172.28.0.164:65209 #1427913 (400 connections now open) 2015-10-05T07:01:39.315+0100 [conn1427913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:39.315+0100 [conn1427912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:39.944+0100 [mongosMain] connection accepted from 127.0.0.1:55859 #1427914 (401 connections now open) 2015-10-05T07:01:39.946+0100 [conn1427914] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:39.950+0100 [conn1427914] end connection 127.0.0.1:55859 (400 connections now open) 2015-10-05T07:01:40.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212445703b51053ec945d 2015-10-05T07:01:40.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:01:41.522+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:43.123+0100 [conn1427499] end connection 172.28.0.163:54729 (399 connections now open) 2015-10-05T07:01:43.124+0100 [mongosMain] connection accepted from 172.28.0.163:55865 #1427915 (400 connections now open) 2015-10-05T07:01:43.124+0100 [conn1427915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:43.668+0100 [conn1427535] end connection 172.28.0.163:54818 (399 connections now open) 2015-10-05T07:01:43.669+0100 [mongosMain] connection accepted from 172.28.0.163:55868 #1427916 (400 connections now open) 2015-10-05T07:01:43.670+0100 [conn1427916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:43.681+0100 [conn1427491] end connection 172.28.0.164:64034 (399 connections now open) 2015-10-05T07:01:43.682+0100 [mongosMain] connection accepted from 172.28.0.164:65221 #1427917 (400 connections now open) 2015-10-05T07:01:43.683+0100 [conn1427917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:44.227+0100 [conn1427536] end connection 172.28.0.164:64132 (399 connections now open) 2015-10-05T07:01:44.229+0100 [mongosMain] connection accepted from 172.28.0.164:65224 #1427918 (400 connections now open) 2015-10-05T07:01:44.230+0100 [conn1427918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:46.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:46.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:47.112+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:01:47.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:01:49.328+0100 [conn1427496] end connection 172.28.0.164:64044 (399 connections now open) 2015-10-05T07:01:49.329+0100 [mongosMain] connection accepted from 172.28.0.164:65231 #1427919 (400 connections now open) 2015-10-05T07:01:49.330+0100 [conn1427474] end connection 172.28.0.164:63985 (399 connections now open) 2015-10-05T07:01:49.331+0100 [mongosMain] connection accepted from 172.28.0.164:65232 #1427920 (400 connections now open) 2015-10-05T07:01:49.332+0100 [conn1427919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:49.333+0100 [conn1427920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:52.521+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:52.848+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:01:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:01:53.137+0100 [conn1427479] end connection 172.28.0.163:54686 (399 connections now open) 2015-10-05T07:01:53.139+0100 [mongosMain] connection accepted from 172.28.0.163:55886 #1427921 (400 connections now open) 2015-10-05T07:01:53.140+0100 [conn1427921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:53.260+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:01:53.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:01:53.681+0100 [conn1427448] end connection 172.28.0.164:63885 (399 connections now open) 2015-10-05T07:01:53.683+0100 [conn1427543] end connection 172.28.0.163:54833 (398 connections now open) 2015-10-05T07:01:53.683+0100 [mongosMain] connection accepted from 172.28.0.164:65238 #1427922 (399 connections now open) 2015-10-05T07:01:53.684+0100 [mongosMain] connection accepted from 172.28.0.163:55888 #1427923 (400 connections now open) 2015-10-05T07:01:53.685+0100 [conn1427923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:53.685+0100 [conn1427922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:54.120+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:01:54.121+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:01:54.227+0100 [conn1427544] end connection 172.28.0.164:64153 (399 connections now open) 2015-10-05T07:01:54.229+0100 [mongosMain] connection accepted from 172.28.0.164:65241 #1427924 (400 connections now open) 2015-10-05T07:01:54.231+0100 [conn1427924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:59.380+0100 [conn1427532] end connection 172.28.0.164:64124 (399 connections now open) 2015-10-05T07:01:59.381+0100 [mongosMain] connection accepted from 172.28.0.164:65245 #1427925 (400 connections now open) 2015-10-05T07:01:59.388+0100 [conn1427925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:01:59.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212575703b51053ec9944 2015-10-05T07:01:59.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:03.129+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:03.129+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:03.141+0100 [conn1427541] end connection 172.28.0.163:54830 (399 connections now open) 2015-10-05T07:02:03.142+0100 [mongosMain] connection accepted from 172.28.0.163:55913 #1427926 (400 connections now open) 2015-10-05T07:02:03.143+0100 [conn1427926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:03.525+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:03.687+0100 [conn1427549] end connection 172.28.0.163:54853 (399 connections now open) 2015-10-05T07:02:03.689+0100 [mongosMain] connection accepted from 172.28.0.163:55915 #1427927 (400 connections now open) 2015-10-05T07:02:03.690+0100 [conn1427927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:03.697+0100 [conn1427520] end connection 172.28.0.164:64094 (399 connections now open) 2015-10-05T07:02:03.698+0100 [mongosMain] connection accepted from 172.28.0.164:65258 #1427928 (400 connections now open) 2015-10-05T07:02:03.699+0100 [conn1427928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:04.243+0100 [conn1427550] end connection 172.28.0.164:64169 (399 connections now open) 2015-10-05T07:02:04.244+0100 [mongosMain] connection accepted from 172.28.0.164:65260 #1427929 (400 connections now open) 2015-10-05T07:02:04.246+0100 [conn1427929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:09.211+0100 [conn1427537] end connection 172.28.0.163:54823 (399 connections now open) 2015-10-05T07:02:09.211+0100 [conn1427429] end connection 172.28.0.163:54520 (398 connections now open) 2015-10-05T07:02:09.213+0100 [mongosMain] connection accepted from 172.28.0.163:55925 #1427930 (399 connections now open) 2015-10-05T07:02:09.213+0100 [mongosMain] connection accepted from 172.28.0.163:55926 #1427931 (400 connections now open) 2015-10-05T07:02:09.214+0100 [conn1427930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:09.214+0100 [conn1427931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:09.375+0100 [conn1427538] end connection 172.28.0.164:64142 (399 connections now open) 2015-10-05T07:02:09.376+0100 [conn1427553] end connection 172.28.0.164:64176 (398 connections now open) 2015-10-05T07:02:09.376+0100 [mongosMain] connection accepted from 172.28.0.164:65266 #1427932 (400 connections now open) 2015-10-05T07:02:09.378+0100 [mongosMain] connection accepted from 172.28.0.164:65267 #1427933 (400 connections now open) 2015-10-05T07:02:09.379+0100 [conn1427932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:09.379+0100 [conn1427933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:11.639+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:02:11.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:02:13.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:13.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:13.153+0100 [conn1427526] end connection 172.28.0.163:54807 (399 connections now open) 2015-10-05T07:02:13.154+0100 [mongosMain] connection accepted from 172.28.0.163:55934 #1427934 (400 connections now open) 2015-10-05T07:02:13.156+0100 [conn1427934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:13.699+0100 [conn1427556] end connection 172.28.0.163:54878 (399 connections now open) 2015-10-05T07:02:13.700+0100 [mongosMain] connection accepted from 172.28.0.163:55936 #1427935 (400 connections now open) 2015-10-05T07:02:13.701+0100 [conn1427935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:14.242+0100 [conn1427557] end connection 172.28.0.164:64181 (399 connections now open) 2015-10-05T07:02:14.244+0100 [mongosMain] connection accepted from 172.28.0.164:65271 #1427936 (400 connections now open) 2015-10-05T07:02:14.245+0100 [conn1427936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:14.529+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:18.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212695703b51053ec9d58 2015-10-05T07:02:18.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:19.232+0100 [conn1427411] end connection 172.28.0.163:54473 (399 connections now open) 2015-10-05T07:02:19.242+0100 [mongosMain] connection accepted from 172.28.0.163:55948 #1427937 (400 connections now open) 2015-10-05T07:02:19.247+0100 [conn1427937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:19.391+0100 [conn1427559] end connection 172.28.0.164:64184 (399 connections now open) 2015-10-05T07:02:19.391+0100 [conn1427533] end connection 172.28.0.164:64123 (399 connections now open) 2015-10-05T07:02:19.392+0100 [mongosMain] connection accepted from 172.28.0.164:65279 #1427938 (399 connections now open) 2015-10-05T07:02:19.392+0100 [mongosMain] connection accepted from 172.28.0.164:65280 #1427939 (400 connections now open) 2015-10-05T07:02:19.393+0100 [conn1427938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:19.394+0100 [conn1427939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:23.105+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:02:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:02:23.154+0100 [conn1427505] end connection 172.28.0.163:54747 (399 connections now open) 2015-10-05T07:02:23.155+0100 [mongosMain] connection accepted from 172.28.0.163:55951 #1427940 (400 connections now open) 2015-10-05T07:02:23.155+0100 [conn1427940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:23.704+0100 [conn1427563] end connection 172.28.0.163:54895 (399 connections now open) 2015-10-05T07:02:23.705+0100 [mongosMain] connection accepted from 172.28.0.163:55952 #1427941 (400 connections now open) 2015-10-05T07:02:23.707+0100 [conn1427941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:23.713+0100 [conn1427512] end connection 172.28.0.164:64082 (399 connections now open) 2015-10-05T07:02:23.714+0100 [mongosMain] connection accepted from 172.28.0.164:65287 #1427942 (400 connections now open) 2015-10-05T07:02:23.715+0100 [conn1427942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:24.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:24.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:24.259+0100 [conn1427564] end connection 172.28.0.164:64191 (399 connections now open) 2015-10-05T07:02:24.260+0100 [mongosMain] connection accepted from 172.28.0.164:65290 #1427943 (400 connections now open) 2015-10-05T07:02:24.262+0100 [conn1427943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:24.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212705703b51053ec9e96 2015-10-05T07:02:24.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:25.553+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:28.554+0100 [mongosMain] connection accepted from 127.0.0.1:55955 #1427944 (401 connections now open) 2015-10-05T07:02:28.556+0100 [conn1427944] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:28.561+0100 [conn1427944] end connection 127.0.0.1:55955 (400 connections now open) 2015-10-05T07:02:29.221+0100 [conn1427509] end connection 172.28.0.163:54758 (399 connections now open) 2015-10-05T07:02:29.222+0100 [mongosMain] connection accepted from 172.28.0.163:55956 #1427945 (400 connections now open) 2015-10-05T07:02:29.223+0100 [conn1427945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:29.406+0100 [conn1427552] end connection 172.28.0.164:64175 (399 connections now open) 2015-10-05T07:02:29.406+0100 [conn1427504] end connection 172.28.0.164:64062 (399 connections now open) 2015-10-05T07:02:29.407+0100 [mongosMain] connection accepted from 172.28.0.164:65300 #1427946 (399 connections now open) 2015-10-05T07:02:29.407+0100 [mongosMain] connection accepted from 172.28.0.164:65301 #1427947 (400 connections now open) 2015-10-05T07:02:29.408+0100 [conn1427946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:29.408+0100 [conn1427947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:31.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212765703b51053ec9f87 2015-10-05T07:02:31.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:33.169+0100 [conn1427511] end connection 172.28.0.163:54770 (399 connections now open) 2015-10-05T07:02:33.170+0100 [mongosMain] connection accepted from 172.28.0.163:55959 #1427948 (400 connections now open) 2015-10-05T07:02:33.171+0100 [conn1427948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:33.712+0100 [conn1427562] end connection 172.28.0.164:64189 (399 connections now open) 2015-10-05T07:02:33.713+0100 [mongosMain] connection accepted from 172.28.0.164:65308 #1427949 (400 connections now open) 2015-10-05T07:02:33.715+0100 [conn1427949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:33.715+0100 [conn1427571] end connection 172.28.0.163:54912 (399 connections now open) 2015-10-05T07:02:33.716+0100 [mongosMain] connection accepted from 172.28.0.163:55960 #1427950 (400 connections now open) 2015-10-05T07:02:33.717+0100 [conn1427950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:34.259+0100 [conn1427572] end connection 172.28.0.164:64211 (399 connections now open) 2015-10-05T07:02:34.260+0100 [mongosMain] connection accepted from 172.28.0.164:65309 #1427951 (400 connections now open) 2015-10-05T07:02:34.262+0100 [conn1427951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:36.138+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:36.139+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:36.643+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:37.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612127d5703b51053eca05a 2015-10-05T07:02:37.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:38.201+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:38.201+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:39.225+0100 [conn1427515] end connection 172.28.0.163:54780 (399 connections now open) 2015-10-05T07:02:39.226+0100 [mongosMain] connection accepted from 172.28.0.163:55965 #1427952 (400 connections now open) 2015-10-05T07:02:39.228+0100 [conn1427952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:39.539+0100 [conn1427495] end connection 172.28.0.163:54720 (399 connections now open) 2015-10-05T07:02:39.540+0100 [mongosMain] connection accepted from 172.28.0.163:55967 #1427953 (400 connections now open) 2015-10-05T07:02:39.541+0100 [conn1427953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:39.603+0100 [conn1427546] end connection 172.28.0.164:64162 (399 connections now open) 2015-10-05T07:02:39.605+0100 [mongosMain] connection accepted from 172.28.0.164:65318 #1427954 (400 connections now open) 2015-10-05T07:02:39.606+0100 [conn1427483] end connection 172.28.0.164:64005 (399 connections now open) 2015-10-05T07:02:39.607+0100 [conn1427954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:39.610+0100 [mongosMain] connection accepted from 172.28.0.164:65321 #1427955 (400 connections now open) 2015-10-05T07:02:39.612+0100 [conn1427955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:39.742+0100 [mongosMain] connection accepted from 127.0.0.1:55969 #1427956 (401 connections now open) 2015-10-05T07:02:39.745+0100 [conn1427956] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:39.751+0100 [conn1427956] end connection 127.0.0.1:55969 (400 connections now open) 2015-10-05T07:02:41.200+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:41.201+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:43.185+0100 [conn1427519] end connection 172.28.0.163:54791 (399 connections now open) 2015-10-05T07:02:43.186+0100 [mongosMain] connection accepted from 172.28.0.163:55975 #1427957 (400 connections now open) 2015-10-05T07:02:43.187+0100 [conn1427957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:43.716+0100 [conn1427578] end connection 172.28.0.163:54927 (399 connections now open) 2015-10-05T07:02:43.717+0100 [mongosMain] connection accepted from 172.28.0.163:55976 #1427958 (400 connections now open) 2015-10-05T07:02:43.719+0100 [conn1427958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:43.729+0100 [conn1427542] end connection 172.28.0.164:64150 (399 connections now open) 2015-10-05T07:02:43.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212835703b51053eca140 2015-10-05T07:02:43.730+0100 [mongosMain] connection accepted from 172.28.0.164:65330 #1427959 (400 connections now open) 2015-10-05T07:02:43.732+0100 [conn1427959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:43.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:44.274+0100 [conn1427586] end connection 172.28.0.164:64257 (399 connections now open) 2015-10-05T07:02:44.276+0100 [mongosMain] connection accepted from 172.28.0.164:65333 #1427960 (400 connections now open) 2015-10-05T07:02:44.277+0100 [conn1427960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:45.209+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:45.209+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:47.654+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:49.237+0100 [conn1427436] end connection 172.28.0.163:54530 (399 connections now open) 2015-10-05T07:02:49.237+0100 [conn1427565] end connection 172.28.0.163:54901 (399 connections now open) 2015-10-05T07:02:49.238+0100 [mongosMain] connection accepted from 172.28.0.163:55990 #1427961 (399 connections now open) 2015-10-05T07:02:49.238+0100 [mongosMain] connection accepted from 172.28.0.163:55991 #1427962 (400 connections now open) 2015-10-05T07:02:49.239+0100 [conn1427961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:49.239+0100 [conn1427962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:49.595+0100 [conn1427575] end connection 172.28.0.164:64223 (399 connections now open) 2015-10-05T07:02:49.596+0100 [mongosMain] connection accepted from 172.28.0.164:65342 #1427963 (400 connections now open) 2015-10-05T07:02:49.597+0100 [conn1427963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:50.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212895703b51053eca202 2015-10-05T07:02:50.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:50.253+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:50.253+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:53.215+0100 [conn1427548] end connection 172.28.0.163:54851 (399 connections now open) 2015-10-05T07:02:53.215+0100 [mongosMain] connection accepted from 172.28.0.163:55997 #1427964 (400 connections now open) 2015-10-05T07:02:53.215+0100 [conn1427964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:53.278+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:02:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:02:53.746+0100 [conn1427527] end connection 172.28.0.164:64112 (399 connections now open) 2015-10-05T07:02:53.746+0100 [mongosMain] connection accepted from 172.28.0.164:65347 #1427965 (400 connections now open) 2015-10-05T07:02:53.746+0100 [conn1427965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:53.761+0100 [conn1427585] end connection 172.28.0.163:54938 (399 connections now open) 2015-10-05T07:02:53.761+0100 [mongosMain] connection accepted from 172.28.0.163:56000 #1427966 (400 connections now open) 2015-10-05T07:02:53.761+0100 [conn1427966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:54.292+0100 [conn1427579] end connection 172.28.0.164:64235 (399 connections now open) 2015-10-05T07:02:54.292+0100 [mongosMain] connection accepted from 172.28.0.164:65350 #1427967 (400 connections now open) 2015-10-05T07:02:54.307+0100 [conn1427967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:56.258+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:56.259+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:02:56.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212905703b51053eca2c6 2015-10-05T07:02:56.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:02:58.662+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:02:59.238+0100 [conn1427486] end connection 172.28.0.163:54707 (399 connections now open) 2015-10-05T07:02:59.239+0100 [mongosMain] connection accepted from 172.28.0.163:56013 #1427968 (400 connections now open) 2015-10-05T07:02:59.240+0100 [conn1427968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:02:59.594+0100 [conn1427581] end connection 172.28.0.164:64246 (399 connections now open) 2015-10-05T07:02:59.596+0100 [mongosMain] connection accepted from 172.28.0.164:65355 #1427969 (400 connections now open) 2015-10-05T07:02:59.597+0100 [conn1427969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:02.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212965703b51053eca383 2015-10-05T07:03:03.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:03.200+0100 [conn1427561] end connection 172.28.0.163:54894 (399 connections now open) 2015-10-05T07:03:03.201+0100 [mongosMain] connection accepted from 172.28.0.163:56029 #1427970 (400 connections now open) 2015-10-05T07:03:03.202+0100 [conn1427970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:03.371+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:03.371+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:03.744+0100 [conn1427577] end connection 172.28.0.164:64233 (399 connections now open) 2015-10-05T07:03:03.746+0100 [mongosMain] connection accepted from 172.28.0.164:65371 #1427971 (400 connections now open) 2015-10-05T07:03:03.746+0100 [conn1427592] end connection 172.28.0.163:54961 (399 connections now open) 2015-10-05T07:03:03.748+0100 [conn1427971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:03.748+0100 [mongosMain] connection accepted from 172.28.0.163:56031 #1427972 (400 connections now open) 2015-10-05T07:03:03.749+0100 [conn1427972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:09.255+0100 [conn1427454] end connection 172.28.0.163:54586 (399 connections now open) 2015-10-05T07:03:09.256+0100 [mongosMain] connection accepted from 172.28.0.163:56041 #1427973 (400 connections now open) 2015-10-05T07:03:09.257+0100 [conn1427973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:09.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612129d5703b51053eca484 2015-10-05T07:03:09.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:09.609+0100 [conn1427589] end connection 172.28.0.164:64265 (399 connections now open) 2015-10-05T07:03:09.610+0100 [mongosMain] connection accepted from 172.28.0.164:65375 #1427974 (400 connections now open) 2015-10-05T07:03:09.612+0100 [conn1427974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:09.670+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:11.374+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:11.375+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:13.201+0100 [conn1427534] end connection 172.28.0.163:54817 (399 connections now open) 2015-10-05T07:03:13.203+0100 [mongosMain] connection accepted from 172.28.0.163:56046 #1427975 (400 connections now open) 2015-10-05T07:03:13.204+0100 [conn1427975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:13.744+0100 [conn1427584] end connection 172.28.0.164:64255 (399 connections now open) 2015-10-05T07:03:13.745+0100 [mongosMain] connection accepted from 172.28.0.164:65379 #1427976 (400 connections now open) 2015-10-05T07:03:13.746+0100 [conn1427976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:13.746+0100 [conn1427599] end connection 172.28.0.163:54983 (399 connections now open) 2015-10-05T07:03:13.747+0100 [mongosMain] connection accepted from 172.28.0.163:56049 #1427977 (400 connections now open) 2015-10-05T07:03:13.748+0100 [conn1427977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:14.291+0100 [conn1427593] end connection 172.28.0.164:64275 (399 connections now open) 2015-10-05T07:03:14.292+0100 [mongosMain] connection accepted from 172.28.0.164:65381 #1427978 (400 connections now open) 2015-10-05T07:03:14.294+0100 [conn1427978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:15.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212a35703b51053eca55b 2015-10-05T07:03:15.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:19.255+0100 [conn1427594] end connection 172.28.0.163:54967 (399 connections now open) 2015-10-05T07:03:19.256+0100 [mongosMain] connection accepted from 172.28.0.163:56057 #1427979 (400 connections now open) 2015-10-05T07:03:19.257+0100 [conn1427979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:19.258+0100 [conn1427482] end connection 172.28.0.163:54697 (399 connections now open) 2015-10-05T07:03:19.259+0100 [mongosMain] connection accepted from 172.28.0.163:56059 #1427980 (400 connections now open) 2015-10-05T07:03:19.260+0100 [conn1427980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:19.626+0100 [conn1427568] end connection 172.28.0.164:64199 (399 connections now open) 2015-10-05T07:03:19.627+0100 [mongosMain] connection accepted from 172.28.0.164:65389 #1427981 (400 connections now open) 2015-10-05T07:03:19.629+0100 [conn1427981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:20.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:20.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:20.715+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:22.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212a95703b51053eca63d 2015-10-05T07:03:22.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:23.216+0100 [conn1427554] end connection 172.28.0.163:54876 (399 connections now open) 2015-10-05T07:03:23.217+0100 [mongosMain] connection accepted from 172.28.0.163:56063 #1427982 (400 connections now open) 2015-10-05T07:03:23.218+0100 [conn1427982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:23.525+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:03:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:03:23.759+0100 [conn1427453] end connection 172.28.0.164:63900 (399 connections now open) 2015-10-05T07:03:23.760+0100 [mongosMain] connection accepted from 172.28.0.164:65396 #1427983 (400 connections now open) 2015-10-05T07:03:23.761+0100 [conn1427605] end connection 172.28.0.163:54999 (399 connections now open) 2015-10-05T07:03:23.762+0100 [conn1427983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:23.763+0100 [mongosMain] connection accepted from 172.28.0.163:56065 #1427984 (400 connections now open) 2015-10-05T07:03:23.763+0100 [conn1427984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:24.306+0100 [conn1427600] end connection 172.28.0.164:64289 (399 connections now open) 2015-10-05T07:03:24.307+0100 [mongosMain] connection accepted from 172.28.0.164:65399 #1427985 (400 connections now open) 2015-10-05T07:03:24.309+0100 [conn1427985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:28.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212b05703b51053eca737 2015-10-05T07:03:28.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:28.664+0100 [mongosMain] connection accepted from 127.0.0.1:56067 #1427986 (401 connections now open) 2015-10-05T07:03:28.667+0100 [conn1427986] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:28.674+0100 [conn1427986] end connection 127.0.0.1:56067 (400 connections now open) 2015-10-05T07:03:29.269+0100 [conn1427587] end connection 172.28.0.163:54946 (399 connections now open) 2015-10-05T07:03:29.269+0100 [conn1427418] end connection 172.28.0.163:54493 (399 connections now open) 2015-10-05T07:03:29.270+0100 [mongosMain] connection accepted from 172.28.0.163:56068 #1427987 (399 connections now open) 2015-10-05T07:03:29.271+0100 [mongosMain] connection accepted from 172.28.0.163:56069 #1427988 (400 connections now open) 2015-10-05T07:03:29.271+0100 [conn1427987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:29.272+0100 [conn1427988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:29.641+0100 [conn1427596] end connection 172.28.0.164:64282 (399 connections now open) 2015-10-05T07:03:29.642+0100 [mongosMain] connection accepted from 172.28.0.164:65407 #1427989 (400 connections now open) 2015-10-05T07:03:29.644+0100 [conn1427989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:30.453+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:30.453+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:31.720+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:33.220+0100 [conn1427590] end connection 172.28.0.163:54958 (399 connections now open) 2015-10-05T07:03:33.221+0100 [mongosMain] connection accepted from 172.28.0.163:56073 #1427990 (400 connections now open) 2015-10-05T07:03:33.222+0100 [conn1427990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:33.761+0100 [conn1427555] end connection 172.28.0.164:64179 (399 connections now open) 2015-10-05T07:03:33.762+0100 [mongosMain] connection accepted from 172.28.0.164:65414 #1427991 (400 connections now open) 2015-10-05T07:03:33.763+0100 [conn1427991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:33.766+0100 [conn1427611] end connection 172.28.0.163:55014 (399 connections now open) 2015-10-05T07:03:33.767+0100 [mongosMain] connection accepted from 172.28.0.163:56075 #1427992 (400 connections now open) 2015-10-05T07:03:33.768+0100 [conn1427992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:34.307+0100 [conn1427606] end connection 172.28.0.164:64298 (399 connections now open) 2015-10-05T07:03:34.310+0100 [mongosMain] connection accepted from 172.28.0.164:65418 #1427993 (400 connections now open) 2015-10-05T07:03:34.312+0100 [conn1427993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:34.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212b65703b51053eca7f6 2015-10-05T07:03:34.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:39.284+0100 [conn1427473] end connection 172.28.0.163:54658 (399 connections now open) 2015-10-05T07:03:39.284+0100 [conn1427614] end connection 172.28.0.163:55018 (399 connections now open) 2015-10-05T07:03:39.285+0100 [mongosMain] connection accepted from 172.28.0.163:56080 #1427994 (399 connections now open) 2015-10-05T07:03:39.285+0100 [mongosMain] connection accepted from 172.28.0.163:56081 #1427995 (400 connections now open) 2015-10-05T07:03:39.286+0100 [conn1427994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:39.286+0100 [conn1427995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:39.657+0100 [conn1427602] end connection 172.28.0.164:64294 (399 connections now open) 2015-10-05T07:03:39.658+0100 [mongosMain] connection accepted from 172.28.0.164:65429 #1427996 (400 connections now open) 2015-10-05T07:03:39.660+0100 [conn1427996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:39.946+0100 [mongosMain] connection accepted from 127.0.0.1:56084 #1427997 (401 connections now open) 2015-10-05T07:03:39.949+0100 [conn1427997] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:39.953+0100 [conn1427997] end connection 127.0.0.1:56084 (400 connections now open) 2015-10-05T07:03:40.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212bc5703b51053eca8a8 2015-10-05T07:03:41.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:41.452+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:41.453+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:42.822+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:43.232+0100 [conn1427597] end connection 172.28.0.163:54981 (399 connections now open) 2015-10-05T07:03:43.234+0100 [mongosMain] connection accepted from 172.28.0.163:56090 #1427998 (400 connections now open) 2015-10-05T07:03:43.235+0100 [conn1427998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:43.777+0100 [conn1427591] end connection 172.28.0.164:64273 (399 connections now open) 2015-10-05T07:03:43.778+0100 [mongosMain] connection accepted from 172.28.0.164:65436 #1427999 (400 connections now open) 2015-10-05T07:03:43.780+0100 [conn1427999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:44.323+0100 [conn1427612] end connection 172.28.0.164:64314 (399 connections now open) 2015-10-05T07:03:44.323+0100 [mongosMain] connection accepted from 172.28.0.164:65438 #1428000 (400 connections now open) 2015-10-05T07:03:44.325+0100 [conn1428000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:49.285+0100 [conn1427545] end connection 172.28.0.163:54843 (399 connections now open) 2015-10-05T07:03:49.286+0100 [conn1427445] end connection 172.28.0.163:54551 (399 connections now open) 2015-10-05T07:03:49.286+0100 [mongosMain] connection accepted from 172.28.0.163:56099 #1428001 (399 connections now open) 2015-10-05T07:03:49.287+0100 [mongosMain] connection accepted from 172.28.0.163:56100 #1428002 (400 connections now open) 2015-10-05T07:03:49.288+0100 [conn1428001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:49.288+0100 [conn1428002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:49.672+0100 [conn1427608] end connection 172.28.0.164:64306 (399 connections now open) 2015-10-05T07:03:49.673+0100 [mongosMain] connection accepted from 172.28.0.164:65449 #1428003 (400 connections now open) 2015-10-05T07:03:49.675+0100 [conn1428003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:53.234+0100 [conn1427583] end connection 172.28.0.163:54937 (399 connections now open) 2015-10-05T07:03:53.235+0100 [mongosMain] connection accepted from 172.28.0.163:56109 #1428004 (400 connections now open) 2015-10-05T07:03:53.236+0100 [conn1428004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:53.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212c95703b51053ecaa3e 2015-10-05T07:03:53.456+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:53.456+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:53.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:03:53.776+0100 [conn1427470] end connection 172.28.0.164:63960 (399 connections now open) 2015-10-05T07:03:53.778+0100 [mongosMain] connection accepted from 172.28.0.164:65454 #1428005 (400 connections now open) 2015-10-05T07:03:53.780+0100 [conn1428005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:53.780+0100 [conn1427619] end connection 172.28.0.163:55024 (399 connections now open) 2015-10-05T07:03:53.781+0100 [mongosMain] connection accepted from 172.28.0.163:56110 #1428006 (400 connections now open) 2015-10-05T07:03:53.782+0100 [conn1428006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:53.784+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:03:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:03:53.835+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:54.322+0100 [conn1427620] end connection 172.28.0.164:64335 (399 connections now open) 2015-10-05T07:03:54.323+0100 [mongosMain] connection accepted from 172.28.0.164:65457 #1428007 (400 connections now open) 2015-10-05T07:03:54.325+0100 [conn1428007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:55.465+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:55.465+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:58.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:03:58.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:03:59.300+0100 [conn1427622] end connection 172.28.0.163:55033 (399 connections now open) 2015-10-05T07:03:59.300+0100 [conn1427516] end connection 172.28.0.163:54781 (399 connections now open) 2015-10-05T07:03:59.301+0100 [mongosMain] connection accepted from 172.28.0.163:56121 #1428008 (399 connections now open) 2015-10-05T07:03:59.301+0100 [mongosMain] connection accepted from 172.28.0.163:56122 #1428009 (400 connections now open) 2015-10-05T07:03:59.301+0100 [conn1428008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:03:59.302+0100 [conn1428009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:02.481+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:02.481+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:03.248+0100 [conn1427569] end connection 172.28.0.163:54910 (399 connections now open) 2015-10-05T07:04:03.249+0100 [mongosMain] connection accepted from 172.28.0.163:56141 #1428010 (400 connections now open) 2015-10-05T07:04:03.250+0100 [conn1428010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:03.792+0100 [conn1427604] end connection 172.28.0.164:64296 (399 connections now open) 2015-10-05T07:04:03.794+0100 [mongosMain] connection accepted from 172.28.0.164:65473 #1428011 (400 connections now open) 2015-10-05T07:04:03.794+0100 [conn1427632] end connection 172.28.0.163:55066 (398 connections now open) 2015-10-05T07:04:03.794+0100 [mongosMain] connection accepted from 172.28.0.163:56143 #1428012 (400 connections now open) 2015-10-05T07:04:03.795+0100 [conn1428012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:03.795+0100 [conn1428011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:04.338+0100 [conn1427626] end connection 172.28.0.164:64359 (399 connections now open) 2015-10-05T07:04:04.339+0100 [mongosMain] connection accepted from 172.28.0.164:65475 #1428013 (400 connections now open) 2015-10-05T07:04:04.341+0100 [conn1428013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:04.857+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:07.483+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:07.484+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:09.310+0100 [conn1427634] end connection 172.28.0.163:55073 (399 connections now open) 2015-10-05T07:04:09.312+0100 [mongosMain] connection accepted from 172.28.0.163:56153 #1428014 (400 connections now open) 2015-10-05T07:04:09.313+0100 [conn1428014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:09.315+0100 [conn1427551] end connection 172.28.0.163:54860 (399 connections now open) 2015-10-05T07:04:09.316+0100 [mongosMain] connection accepted from 172.28.0.163:56156 #1428015 (400 connections now open) 2015-10-05T07:04:09.316+0100 [conn1428015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:09.704+0100 [conn1427615] end connection 172.28.0.164:64326 (399 connections now open) 2015-10-05T07:04:09.705+0100 [mongosMain] connection accepted from 172.28.0.164:65482 #1428016 (400 connections now open) 2015-10-05T07:04:09.707+0100 [conn1428016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:11.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212db5703b51053ecac8a 2015-10-05T07:04:11.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:04:13.264+0100 [conn1427609] end connection 172.28.0.163:55011 (399 connections now open) 2015-10-05T07:04:13.265+0100 [mongosMain] connection accepted from 172.28.0.163:56163 #1428017 (400 connections now open) 2015-10-05T07:04:13.266+0100 [conn1428017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:13.486+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:13.486+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:13.807+0100 [conn1427610] end connection 172.28.0.164:64312 (399 connections now open) 2015-10-05T07:04:13.808+0100 [conn1427637] end connection 172.28.0.163:55086 (398 connections now open) 2015-10-05T07:04:13.809+0100 [mongosMain] connection accepted from 172.28.0.164:65484 #1428018 (399 connections now open) 2015-10-05T07:04:13.809+0100 [mongosMain] connection accepted from 172.28.0.163:56165 #1428019 (400 connections now open) 2015-10-05T07:04:13.810+0100 [conn1428018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:13.810+0100 [conn1428019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:14.353+0100 [conn1427633] end connection 172.28.0.164:64379 (399 connections now open) 2015-10-05T07:04:14.354+0100 [mongosMain] connection accepted from 172.28.0.164:65486 #1428020 (400 connections now open) 2015-10-05T07:04:14.356+0100 [conn1428020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:15.869+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:17.951+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:04:17.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:04:19.316+0100 [conn1427639] end connection 172.28.0.163:55093 (399 connections now open) 2015-10-05T07:04:19.316+0100 [conn1427566] end connection 172.28.0.163:54902 (398 connections now open) 2015-10-05T07:04:19.317+0100 [mongosMain] connection accepted from 172.28.0.163:56172 #1428021 (399 connections now open) 2015-10-05T07:04:19.317+0100 [mongosMain] connection accepted from 172.28.0.163:56173 #1428022 (400 connections now open) 2015-10-05T07:04:19.318+0100 [conn1428021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:19.318+0100 [conn1428022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:19.720+0100 [conn1427525] end connection 172.28.0.164:64104 (399 connections now open) 2015-10-05T07:04:19.721+0100 [mongosMain] connection accepted from 172.28.0.164:65496 #1428023 (400 connections now open) 2015-10-05T07:04:19.722+0100 [conn1428023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:20.487+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:20.487+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:23.810+0100 [conn1427641] end connection 172.28.0.163:55106 (399 connections now open) 2015-10-05T07:04:23.812+0100 [mongosMain] connection accepted from 172.28.0.163:56179 #1428024 (400 connections now open) 2015-10-05T07:04:23.813+0100 [conn1428024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:23.823+0100 [conn1427570] end connection 172.28.0.164:64208 (399 connections now open) 2015-10-05T07:04:23.824+0100 [mongosMain] connection accepted from 172.28.0.164:65502 #1428025 (400 connections now open) 2015-10-05T07:04:23.826+0100 [conn1428025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:24.063+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:04:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:04:24.368+0100 [conn1427638] end connection 172.28.0.164:64395 (399 connections now open) 2015-10-05T07:04:24.369+0100 [mongosMain] connection accepted from 172.28.0.164:65504 #1428026 (400 connections now open) 2015-10-05T07:04:24.371+0100 [conn1428026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:26.879+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:28.496+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:28.496+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:28.552+0100 [mongosMain] connection accepted from 127.0.0.1:56183 #1428027 (401 connections now open) 2015-10-05T07:04:28.554+0100 [conn1428027] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:28.560+0100 [conn1428027] end connection 127.0.0.1:56183 (400 connections now open) 2015-10-05T07:04:29.321+0100 [conn1427450] end connection 172.28.0.163:54570 (399 connections now open) 2015-10-05T07:04:29.322+0100 [mongosMain] connection accepted from 172.28.0.163:56184 #1428028 (400 connections now open) 2015-10-05T07:04:29.323+0100 [conn1428028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:29.736+0100 [conn1427640] end connection 172.28.0.164:64399 (399 connections now open) 2015-10-05T07:04:29.737+0100 [mongosMain] connection accepted from 172.28.0.164:65514 #1428029 (400 connections now open) 2015-10-05T07:04:29.738+0100 [conn1428029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:30.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212ed5703b51053ecae90 2015-10-05T07:04:30.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:04:33.824+0100 [conn1427625] end connection 172.28.0.164:64356 (399 connections now open) 2015-10-05T07:04:33.825+0100 [mongosMain] connection accepted from 172.28.0.164:65525 #1428030 (400 connections now open) 2015-10-05T07:04:33.825+0100 [conn1427645] end connection 172.28.0.163:55120 (399 connections now open) 2015-10-05T07:04:33.827+0100 [mongosMain] connection accepted from 172.28.0.163:56189 #1428031 (400 connections now open) 2015-10-05T07:04:33.827+0100 [conn1428030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:33.828+0100 [conn1428031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:34.370+0100 [conn1427642] end connection 172.28.0.164:64405 (399 connections now open) 2015-10-05T07:04:34.371+0100 [mongosMain] connection accepted from 172.28.0.164:65527 #1428032 (400 connections now open) 2015-10-05T07:04:34.373+0100 [conn1428032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:37.497+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:37.497+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:37.891+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:39.332+0100 [conn1427595] end connection 172.28.0.163:54968 (399 connections now open) 2015-10-05T07:04:39.334+0100 [mongosMain] connection accepted from 172.28.0.163:56194 #1428033 (400 connections now open) 2015-10-05T07:04:39.335+0100 [conn1428033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:39.754+0100 [conn1427650] end connection 172.28.0.164:64432 (399 connections now open) 2015-10-05T07:04:39.755+0100 [conn1427547] end connection 172.28.0.164:64163 (398 connections now open) 2015-10-05T07:04:39.755+0100 [mongosMain] connection accepted from 172.28.0.164:49159 #1428034 (399 connections now open) 2015-10-05T07:04:39.756+0100 [mongosMain] connection accepted from 172.28.0.164:49160 #1428035 (400 connections now open) 2015-10-05T07:04:39.758+0100 [conn1428034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:39.758+0100 [conn1428035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:40.006+0100 [mongosMain] connection accepted from 127.0.0.1:56197 #1428036 (401 connections now open) 2015-10-05T07:04:40.010+0100 [conn1428036] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:40.015+0100 [conn1428036] end connection 127.0.0.1:56197 (400 connections now open) 2015-10-05T07:04:42.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561212fa5703b51053ecafef 2015-10-05T07:04:42.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:04:43.280+0100 [conn1427617] end connection 172.28.0.163:55022 (399 connections now open) 2015-10-05T07:04:43.281+0100 [mongosMain] connection accepted from 172.28.0.163:56202 #1428037 (400 connections now open) 2015-10-05T07:04:43.282+0100 [conn1428037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:43.824+0100 [conn1427636] end connection 172.28.0.164:64393 (399 connections now open) 2015-10-05T07:04:43.825+0100 [mongosMain] connection accepted from 172.28.0.164:49168 #1428038 (400 connections now open) 2015-10-05T07:04:43.827+0100 [conn1427652] end connection 172.28.0.163:55129 (399 connections now open) 2015-10-05T07:04:43.827+0100 [conn1428038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:43.828+0100 [mongosMain] connection accepted from 172.28.0.163:56204 #1428039 (400 connections now open) 2015-10-05T07:04:43.829+0100 [conn1428039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:44.369+0100 [conn1427646] end connection 172.28.0.164:64422 (399 connections now open) 2015-10-05T07:04:44.371+0100 [mongosMain] connection accepted from 172.28.0.164:49169 #1428040 (400 connections now open) 2015-10-05T07:04:44.373+0100 [conn1428040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:47.511+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:47.511+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:48.900+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:49.333+0100 [conn1427476] end connection 172.28.0.163:54678 (399 connections now open) 2015-10-05T07:04:49.334+0100 [mongosMain] connection accepted from 172.28.0.163:56213 #1428041 (400 connections now open) 2015-10-05T07:04:49.335+0100 [conn1428041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:49.767+0100 [conn1427560] end connection 172.28.0.164:64185 (399 connections now open) 2015-10-05T07:04:49.768+0100 [mongosMain] connection accepted from 172.28.0.164:49186 #1428042 (400 connections now open) 2015-10-05T07:04:49.769+0100 [conn1428042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:53.295+0100 [conn1427630] end connection 172.28.0.163:55063 (399 connections now open) 2015-10-05T07:04:53.297+0100 [mongosMain] connection accepted from 172.28.0.163:56219 #1428043 (400 connections now open) 2015-10-05T07:04:53.298+0100 [conn1428043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:53.839+0100 [conn1427651] end connection 172.28.0.164:64439 (399 connections now open) 2015-10-05T07:04:53.840+0100 [mongosMain] connection accepted from 172.28.0.164:49209 #1428044 (400 connections now open) 2015-10-05T07:04:53.841+0100 [conn1427659] end connection 172.28.0.163:55143 (399 connections now open) 2015-10-05T07:04:53.842+0100 [mongosMain] connection accepted from 172.28.0.163:56220 #1428045 (400 connections now open) 2015-10-05T07:04:53.842+0100 [conn1428044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:53.843+0100 [conn1428045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:54.326+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:04:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:04:54.385+0100 [conn1427653] end connection 172.28.0.164:64441 (399 connections now open) 2015-10-05T07:04:54.386+0100 [mongosMain] connection accepted from 172.28.0.164:49211 #1428046 (400 connections now open) 2015-10-05T07:04:54.388+0100 [conn1428046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:54.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213065703b51053ecb0f9 2015-10-05T07:04:55.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:04:58.516+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:04:58.516+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:04:59.348+0100 [conn1427643] end connection 172.28.0.163:55111 (399 connections now open) 2015-10-05T07:04:59.348+0100 [conn1427502] end connection 172.28.0.163:54738 (399 connections now open) 2015-10-05T07:04:59.350+0100 [mongosMain] connection accepted from 172.28.0.163:56231 #1428047 (399 connections now open) 2015-10-05T07:04:59.350+0100 [mongosMain] connection accepted from 172.28.0.163:56232 #1428048 (400 connections now open) 2015-10-05T07:04:59.351+0100 [conn1428047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:59.352+0100 [conn1428048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:59.783+0100 [conn1427567] end connection 172.28.0.164:64198 (399 connections now open) 2015-10-05T07:04:59.786+0100 [mongosMain] connection accepted from 172.28.0.164:49214 #1428049 (400 connections now open) 2015-10-05T07:04:59.788+0100 [conn1428049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:04:59.920+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:01.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612130d5703b51053ecb170 2015-10-05T07:05:01.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:03.842+0100 [conn1427667] end connection 172.28.0.163:55162 (399 connections now open) 2015-10-05T07:05:03.843+0100 [mongosMain] connection accepted from 172.28.0.163:56247 #1428050 (400 connections now open) 2015-10-05T07:05:03.845+0100 [conn1428050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:03.854+0100 [conn1427658] end connection 172.28.0.164:64460 (399 connections now open) 2015-10-05T07:05:03.855+0100 [mongosMain] connection accepted from 172.28.0.164:49227 #1428051 (400 connections now open) 2015-10-05T07:05:03.857+0100 [conn1428051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:04.400+0100 [conn1427660] end connection 172.28.0.164:64464 (399 connections now open) 2015-10-05T07:05:04.401+0100 [mongosMain] connection accepted from 172.28.0.164:49229 #1428052 (400 connections now open) 2015-10-05T07:05:04.404+0100 [conn1428052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:07.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213135703b51053ecb215 2015-10-05T07:05:07.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:09.375+0100 [conn1427601] end connection 172.28.0.163:54990 (399 connections now open) 2015-10-05T07:05:09.376+0100 [conn1427628] end connection 172.28.0.163:55052 (398 connections now open) 2015-10-05T07:05:09.395+0100 [mongosMain] connection accepted from 172.28.0.163:56256 #1428053 (399 connections now open) 2015-10-05T07:05:09.397+0100 [conn1428053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:09.398+0100 [mongosMain] connection accepted from 172.28.0.163:56258 #1428054 (400 connections now open) 2015-10-05T07:05:09.399+0100 [conn1428054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:09.798+0100 [conn1427655] end connection 172.28.0.164:64451 (399 connections now open) 2015-10-05T07:05:09.799+0100 [conn1427649] end connection 172.28.0.164:64431 (398 connections now open) 2015-10-05T07:05:09.800+0100 [mongosMain] connection accepted from 172.28.0.164:49235 #1428055 (399 connections now open) 2015-10-05T07:05:09.800+0100 [mongosMain] connection accepted from 172.28.0.164:49236 #1428056 (400 connections now open) 2015-10-05T07:05:09.802+0100 [conn1428055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:09.802+0100 [conn1428056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:10.521+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:10.522+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:10.930+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:12.592+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:12.592+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:13.311+0100 [conn1427576] end connection 172.28.0.163:54926 (399 connections now open) 2015-10-05T07:05:13.313+0100 [mongosMain] connection accepted from 172.28.0.163:56265 #1428057 (400 connections now open) 2015-10-05T07:05:13.314+0100 [conn1428057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:13.855+0100 [conn1427598] end connection 172.28.0.164:64285 (399 connections now open) 2015-10-05T07:05:13.856+0100 [mongosMain] connection accepted from 172.28.0.164:49241 #1428058 (400 connections now open) 2015-10-05T07:05:13.858+0100 [conn1428058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:13.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213195703b51053ecb2a3 2015-10-05T07:05:14.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:14.401+0100 [conn1427668] end connection 172.28.0.164:64483 (399 connections now open) 2015-10-05T07:05:14.402+0100 [mongosMain] connection accepted from 172.28.0.164:49243 #1428059 (400 connections now open) 2015-10-05T07:05:14.411+0100 [conn1428059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:15.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:15.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:19.365+0100 [conn1427635] end connection 172.28.0.163:55074 (399 connections now open) 2015-10-05T07:05:19.365+0100 [conn1427662] end connection 172.28.0.163:55151 (398 connections now open) 2015-10-05T07:05:19.366+0100 [mongosMain] connection accepted from 172.28.0.163:56273 #1428060 (399 connections now open) 2015-10-05T07:05:19.366+0100 [mongosMain] connection accepted from 172.28.0.163:56274 #1428061 (400 connections now open) 2015-10-05T07:05:19.367+0100 [conn1428060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:19.367+0100 [conn1428061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:19.613+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:19.614+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:19.798+0100 [conn1427629] end connection 172.28.0.164:64369 (399 connections now open) 2015-10-05T07:05:19.799+0100 [mongosMain] connection accepted from 172.28.0.164:49254 #1428062 (400 connections now open) 2015-10-05T07:05:19.799+0100 [conn1427539] end connection 172.28.0.164:64143 (399 connections now open) 2015-10-05T07:05:19.800+0100 [mongosMain] connection accepted from 172.28.0.164:49255 #1428063 (400 connections now open) 2015-10-05T07:05:19.800+0100 [conn1428062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:19.802+0100 [conn1428063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:20.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213205703b51053ecb32e 2015-10-05T07:05:20.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:21.949+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:23.858+0100 [conn1427673] end connection 172.28.0.163:55183 (399 connections now open) 2015-10-05T07:05:23.859+0100 [mongosMain] connection accepted from 172.28.0.163:56281 #1428064 (400 connections now open) 2015-10-05T07:05:23.860+0100 [conn1428064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:23.874+0100 [conn1427631] end connection 172.28.0.164:64377 (399 connections now open) 2015-10-05T07:05:23.876+0100 [mongosMain] connection accepted from 172.28.0.164:49270 #1428065 (400 connections now open) 2015-10-05T07:05:23.878+0100 [conn1428065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:24.417+0100 [conn1427674] end connection 172.28.0.164:64506 (399 connections now open) 2015-10-05T07:05:24.418+0100 [mongosMain] connection accepted from 172.28.0.164:49272 #1428066 (400 connections now open) 2015-10-05T07:05:24.420+0100 [conn1428066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:24.564+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:05:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:05:24.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:24.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:26.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213265703b51053ecb3b4 2015-10-05T07:05:26.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:28.718+0100 [mongosMain] connection accepted from 127.0.0.1:56288 #1428067 (401 connections now open) 2015-10-05T07:05:28.721+0100 [conn1428067] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:28.727+0100 [conn1428067] end connection 127.0.0.1:56288 (400 connections now open) 2015-10-05T07:05:29.379+0100 [conn1427675] end connection 172.28.0.163:55191 (399 connections now open) 2015-10-05T07:05:29.379+0100 [conn1427676] end connection 172.28.0.163:55192 (399 connections now open) 2015-10-05T07:05:29.380+0100 [mongosMain] connection accepted from 172.28.0.163:56290 #1428068 (399 connections now open) 2015-10-05T07:05:29.381+0100 [mongosMain] connection accepted from 172.28.0.163:56291 #1428069 (400 connections now open) 2015-10-05T07:05:29.381+0100 [conn1428068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:29.381+0100 [conn1428069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:29.833+0100 [conn1427677] end connection 172.28.0.164:64511 (399 connections now open) 2015-10-05T07:05:29.833+0100 [conn1427574] end connection 172.28.0.164:64222 (399 connections now open) 2015-10-05T07:05:29.834+0100 [mongosMain] connection accepted from 172.28.0.164:49282 #1428070 (399 connections now open) 2015-10-05T07:05:29.835+0100 [mongosMain] connection accepted from 172.28.0.164:49283 #1428071 (400 connections now open) 2015-10-05T07:05:29.837+0100 [conn1428070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:29.837+0100 [conn1428071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:30.624+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:30.624+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:32.956+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:33.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612132c5703b51053ecb438 2015-10-05T07:05:33.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:33.873+0100 [conn1427687] end connection 172.28.0.163:55217 (399 connections now open) 2015-10-05T07:05:33.875+0100 [mongosMain] connection accepted from 172.28.0.163:56299 #1428072 (400 connections now open) 2015-10-05T07:05:33.876+0100 [conn1428072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:33.886+0100 [conn1427666] end connection 172.28.0.164:64481 (399 connections now open) 2015-10-05T07:05:33.887+0100 [mongosMain] connection accepted from 172.28.0.164:49289 #1428073 (400 connections now open) 2015-10-05T07:05:33.889+0100 [conn1428073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:34.417+0100 [conn1427680] end connection 172.28.0.164:64516 (399 connections now open) 2015-10-05T07:05:34.418+0100 [mongosMain] connection accepted from 172.28.0.164:49291 #1428074 (400 connections now open) 2015-10-05T07:05:34.420+0100 [conn1428074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:37.630+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:37.630+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:39.215+0100 [mongosMain] connection accepted from 127.0.0.1:56303 #1428075 (401 connections now open) 2015-10-05T07:05:39.218+0100 [conn1428075] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:39.223+0100 [conn1428075] end connection 127.0.0.1:56303 (400 connections now open) 2015-10-05T07:05:39.382+0100 [conn1427681] end connection 172.28.0.163:55207 (399 connections now open) 2015-10-05T07:05:39.383+0100 [conn1427607] end connection 172.28.0.163:55006 (398 connections now open) 2015-10-05T07:05:39.383+0100 [mongosMain] connection accepted from 172.28.0.163:56305 #1428076 (399 connections now open) 2015-10-05T07:05:39.384+0100 [mongosMain] connection accepted from 172.28.0.163:56306 #1428077 (400 connections now open) 2015-10-05T07:05:39.384+0100 [conn1428076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:39.385+0100 [conn1428077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:39.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213335703b51053ecb4b2 2015-10-05T07:05:39.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:39.830+0100 [conn1427663] end connection 172.28.0.164:64473 (399 connections now open) 2015-10-05T07:05:39.830+0100 [conn1427510] end connection 172.28.0.164:64079 (399 connections now open) 2015-10-05T07:05:39.831+0100 [mongosMain] connection accepted from 172.28.0.164:49306 #1428078 (399 connections now open) 2015-10-05T07:05:39.831+0100 [mongosMain] connection accepted from 172.28.0.164:49307 #1428079 (400 connections now open) 2015-10-05T07:05:39.832+0100 [conn1428078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:39.832+0100 [conn1428079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:43.888+0100 [conn1427695] end connection 172.28.0.163:55228 (399 connections now open) 2015-10-05T07:05:43.890+0100 [mongosMain] connection accepted from 172.28.0.163:56313 #1428080 (400 connections now open) 2015-10-05T07:05:43.891+0100 [conn1428080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:43.903+0100 [conn1427644] end connection 172.28.0.164:64419 (399 connections now open) 2015-10-05T07:05:43.904+0100 [mongosMain] connection accepted from 172.28.0.164:49315 #1428081 (400 connections now open) 2015-10-05T07:05:43.906+0100 [conn1428081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:43.963+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:44.433+0100 [conn1427688] end connection 172.28.0.164:64535 (399 connections now open) 2015-10-05T07:05:44.434+0100 [mongosMain] connection accepted from 172.28.0.164:49317 #1428082 (400 connections now open) 2015-10-05T07:05:44.438+0100 [conn1428082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:45.636+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:45.637+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:45.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213395703b51053ecb522 2015-10-05T07:05:46.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:49.396+0100 [conn1427689] end connection 172.28.0.163:55221 (399 connections now open) 2015-10-05T07:05:49.396+0100 [conn1427613] end connection 172.28.0.163:55017 (398 connections now open) 2015-10-05T07:05:49.397+0100 [mongosMain] connection accepted from 172.28.0.163:56322 #1428083 (399 connections now open) 2015-10-05T07:05:49.397+0100 [mongosMain] connection accepted from 172.28.0.163:56323 #1428084 (400 connections now open) 2015-10-05T07:05:49.398+0100 [conn1428083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:49.399+0100 [conn1428084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:49.846+0100 [conn1427684] end connection 172.28.0.164:64525 (399 connections now open) 2015-10-05T07:05:49.846+0100 [mongosMain] connection accepted from 172.28.0.164:49325 #1428085 (400 connections now open) 2015-10-05T07:05:49.846+0100 [conn1427307] end connection 172.28.0.164:63535 (399 connections now open) 2015-10-05T07:05:49.847+0100 [mongosMain] connection accepted from 172.28.0.164:49326 #1428086 (400 connections now open) 2015-10-05T07:05:49.848+0100 [conn1428086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:49.848+0100 [conn1428085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:52.365+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:05:52.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:05:53.891+0100 [conn1427702] end connection 172.28.0.163:55245 (399 connections now open) 2015-10-05T07:05:53.892+0100 [mongosMain] connection accepted from 172.28.0.163:56331 #1428087 (400 connections now open) 2015-10-05T07:05:53.893+0100 [conn1428087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:53.919+0100 [conn1427618] end connection 172.28.0.164:64333 (399 connections now open) 2015-10-05T07:05:53.920+0100 [mongosMain] connection accepted from 172.28.0.164:49332 #1428088 (400 connections now open) 2015-10-05T07:05:53.922+0100 [conn1428088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:54.448+0100 [conn1427696] end connection 172.28.0.164:64555 (399 connections now open) 2015-10-05T07:05:54.449+0100 [mongosMain] connection accepted from 172.28.0.164:49335 #1428089 (400 connections now open) 2015-10-05T07:05:54.450+0100 [conn1428089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:54.639+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:54.640+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:05:54.822+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:05:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:05:54.974+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:05:58.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213465703b51053ecb60c 2015-10-05T07:05:58.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:05:59.397+0100 [conn1427703] end connection 172.28.0.163:55253 (399 connections now open) 2015-10-05T07:05:59.397+0100 [conn1427621] end connection 172.28.0.163:55031 (398 connections now open) 2015-10-05T07:05:59.399+0100 [mongosMain] connection accepted from 172.28.0.163:56341 #1428090 (399 connections now open) 2015-10-05T07:05:59.399+0100 [mongosMain] connection accepted from 172.28.0.163:56342 #1428091 (400 connections now open) 2015-10-05T07:05:59.400+0100 [conn1428091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:59.400+0100 [conn1428090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:59.845+0100 [conn1427488] end connection 172.28.0.164:64023 (399 connections now open) 2015-10-05T07:05:59.846+0100 [conn1427712] end connection 172.28.0.164:64600 (398 connections now open) 2015-10-05T07:05:59.846+0100 [mongosMain] connection accepted from 172.28.0.164:49341 #1428092 (399 connections now open) 2015-10-05T07:05:59.847+0100 [mongosMain] connection accepted from 172.28.0.164:49340 #1428093 (400 connections now open) 2015-10-05T07:05:59.848+0100 [conn1428092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:05:59.849+0100 [conn1428093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:03.904+0100 [conn1427707] end connection 172.28.0.163:55262 (399 connections now open) 2015-10-05T07:06:03.905+0100 [mongosMain] connection accepted from 172.28.0.163:56362 #1428094 (400 connections now open) 2015-10-05T07:06:03.906+0100 [conn1428094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:03.934+0100 [conn1427672] end connection 172.28.0.164:64504 (399 connections now open) 2015-10-05T07:06:03.935+0100 [mongosMain] connection accepted from 172.28.0.164:49351 #1428095 (400 connections now open) 2015-10-05T07:06:03.937+0100 [conn1428095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:04.463+0100 [conn1427708] end connection 172.28.0.164:64594 (399 connections now open) 2015-10-05T07:06:04.464+0100 [mongosMain] connection accepted from 172.28.0.164:49354 #1428096 (400 connections now open) 2015-10-05T07:06:04.465+0100 [conn1428096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:04.645+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:04.645+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:05.984+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:09.411+0100 [conn1427697] end connection 172.28.0.163:55235 (399 connections now open) 2015-10-05T07:06:09.411+0100 [conn1427588] end connection 172.28.0.163:54945 (399 connections now open) 2015-10-05T07:06:09.412+0100 [mongosMain] connection accepted from 172.28.0.163:56370 #1428097 (399 connections now open) 2015-10-05T07:06:09.413+0100 [mongosMain] connection accepted from 172.28.0.163:56371 #1428098 (400 connections now open) 2015-10-05T07:06:09.414+0100 [conn1428097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:09.414+0100 [conn1428098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:09.861+0100 [conn1427678] end connection 172.28.0.164:64512 (399 connections now open) 2015-10-05T07:06:09.862+0100 [mongosMain] connection accepted from 172.28.0.164:49360 #1428099 (400 connections now open) 2015-10-05T07:06:09.864+0100 [conn1428099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:10.926+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:06:10.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:06:13.359+0100 [conn1427665] end connection 172.28.0.163:55160 (399 connections now open) 2015-10-05T07:06:13.360+0100 [mongosMain] connection accepted from 172.28.0.163:56376 #1428100 (400 connections now open) 2015-10-05T07:06:13.361+0100 [conn1428100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:13.905+0100 [conn1427714] end connection 172.28.0.163:55281 (399 connections now open) 2015-10-05T07:06:13.907+0100 [mongosMain] connection accepted from 172.28.0.163:56379 #1428101 (400 connections now open) 2015-10-05T07:06:13.908+0100 [conn1428101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:13.933+0100 [conn1427686] end connection 172.28.0.164:64532 (399 connections now open) 2015-10-05T07:06:13.934+0100 [mongosMain] connection accepted from 172.28.0.164:49364 #1428102 (400 connections now open) 2015-10-05T07:06:13.936+0100 [conn1428102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:14.479+0100 [conn1427715] end connection 172.28.0.164:64606 (399 connections now open) 2015-10-05T07:06:14.480+0100 [mongosMain] connection accepted from 172.28.0.164:49366 #1428103 (400 connections now open) 2015-10-05T07:06:14.481+0100 [conn1428103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:15.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:15.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:16.989+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:17.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213585703b51053ecb733 2015-10-05T07:06:17.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:06:19.426+0100 [conn1427670] end connection 172.28.0.163:55173 (399 connections now open) 2015-10-05T07:06:19.428+0100 [mongosMain] connection accepted from 172.28.0.163:56388 #1428104 (400 connections now open) 2015-10-05T07:06:19.429+0100 [conn1428104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:19.861+0100 [conn1427497] end connection 172.28.0.164:64045 (399 connections now open) 2015-10-05T07:06:19.861+0100 [conn1427704] end connection 172.28.0.164:64583 (399 connections now open) 2015-10-05T07:06:19.862+0100 [mongosMain] connection accepted from 172.28.0.164:49374 #1428105 (399 connections now open) 2015-10-05T07:06:19.863+0100 [mongosMain] connection accepted from 172.28.0.164:49375 #1428106 (400 connections now open) 2015-10-05T07:06:19.864+0100 [conn1428105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:19.865+0100 [conn1428106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:23.374+0100 [conn1427685] end connection 172.28.0.163:55215 (399 connections now open) 2015-10-05T07:06:23.375+0100 [mongosMain] connection accepted from 172.28.0.163:56396 #1428107 (400 connections now open) 2015-10-05T07:06:23.377+0100 [conn1428107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:23.920+0100 [conn1427721] end connection 172.28.0.163:55302 (399 connections now open) 2015-10-05T07:06:23.922+0100 [mongosMain] connection accepted from 172.28.0.163:56398 #1428108 (400 connections now open) 2015-10-05T07:06:23.923+0100 [conn1428108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:23.951+0100 [conn1427706] end connection 172.28.0.164:64591 (399 connections now open) 2015-10-05T07:06:23.952+0100 [mongosMain] connection accepted from 172.28.0.164:49383 #1428109 (400 connections now open) 2015-10-05T07:06:23.954+0100 [conn1428109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:24.496+0100 [conn1427722] end connection 172.28.0.164:64616 (399 connections now open) 2015-10-05T07:06:24.497+0100 [mongosMain] connection accepted from 172.28.0.164:49386 #1428110 (400 connections now open) 2015-10-05T07:06:24.499+0100 [conn1428110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:25.091+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:06:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:06:27.654+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:27.655+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:27.990+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:28.298+0100 [mongosMain] connection accepted from 127.0.0.1:56404 #1428111 (401 connections now open) 2015-10-05T07:06:28.301+0100 [conn1428111] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:28.306+0100 [conn1428111] end connection 127.0.0.1:56404 (400 connections now open) 2015-10-05T07:06:29.427+0100 [conn1427709] end connection 172.28.0.163:55270 (399 connections now open) 2015-10-05T07:06:29.429+0100 [mongosMain] connection accepted from 172.28.0.163:56407 #1428112 (400 connections now open) 2015-10-05T07:06:29.430+0100 [conn1428112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:29.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213655703b51053ecb7f8 2015-10-05T07:06:29.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:06:29.703+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:29.703+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:29.877+0100 [conn1427664] end connection 172.28.0.164:64474 (399 connections now open) 2015-10-05T07:06:29.877+0100 [mongosMain] connection accepted from 172.28.0.164:49393 #1428113 (400 connections now open) 2015-10-05T07:06:29.880+0100 [conn1428113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:32.701+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:32.701+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:33.376+0100 [conn1427603] end connection 172.28.0.163:54996 (399 connections now open) 2015-10-05T07:06:33.377+0100 [mongosMain] connection accepted from 172.28.0.163:56410 #1428114 (400 connections now open) 2015-10-05T07:06:33.378+0100 [conn1428114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:33.922+0100 [conn1427726] end connection 172.28.0.163:55317 (399 connections now open) 2015-10-05T07:06:33.923+0100 [mongosMain] connection accepted from 172.28.0.163:56412 #1428115 (400 connections now open) 2015-10-05T07:06:33.924+0100 [conn1428115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:33.949+0100 [conn1427679] end connection 172.28.0.164:64514 (399 connections now open) 2015-10-05T07:06:33.950+0100 [mongosMain] connection accepted from 172.28.0.164:49400 #1428116 (400 connections now open) 2015-10-05T07:06:33.952+0100 [conn1428116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:34.495+0100 [conn1427727] end connection 172.28.0.164:64639 (399 connections now open) 2015-10-05T07:06:34.496+0100 [mongosMain] connection accepted from 172.28.0.164:49404 #1428117 (400 connections now open) 2015-10-05T07:06:34.498+0100 [conn1428117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:36.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:36.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:39.007+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:39.413+0100 [mongosMain] connection accepted from 127.0.0.1:56417 #1428118 (401 connections now open) 2015-10-05T07:06:39.416+0100 [conn1428118] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:39.421+0100 [conn1428118] end connection 127.0.0.1:56417 (400 connections now open) 2015-10-05T07:06:39.877+0100 [conn1427717] end connection 172.28.0.164:64612 (399 connections now open) 2015-10-05T07:06:39.878+0100 [mongosMain] connection accepted from 172.28.0.164:49416 #1428119 (400 connections now open) 2015-10-05T07:06:39.880+0100 [conn1427671] end connection 172.28.0.164:64497 (399 connections now open) 2015-10-05T07:06:39.880+0100 [conn1428119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:39.881+0100 [mongosMain] connection accepted from 172.28.0.164:49417 #1428120 (400 connections now open) 2015-10-05T07:06:39.883+0100 [conn1428120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:41.724+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:41.724+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:42.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213715703b51053ecb8c9 2015-10-05T07:06:42.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:06:43.390+0100 [conn1427624] end connection 172.28.0.163:55041 (399 connections now open) 2015-10-05T07:06:43.391+0100 [mongosMain] connection accepted from 172.28.0.163:56424 #1428121 (400 connections now open) 2015-10-05T07:06:43.392+0100 [conn1428121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:43.936+0100 [conn1427732] end connection 172.28.0.163:55329 (399 connections now open) 2015-10-05T07:06:43.938+0100 [mongosMain] connection accepted from 172.28.0.163:56427 #1428122 (400 connections now open) 2015-10-05T07:06:43.939+0100 [conn1428122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:43.966+0100 [conn1427720] end connection 172.28.0.164:64615 (399 connections now open) 2015-10-05T07:06:43.967+0100 [mongosMain] connection accepted from 172.28.0.164:49427 #1428123 (400 connections now open) 2015-10-05T07:06:43.969+0100 [conn1428123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:44.511+0100 [conn1427733] end connection 172.28.0.164:64661 (399 connections now open) 2015-10-05T07:06:44.512+0100 [mongosMain] connection accepted from 172.28.0.164:49429 #1428124 (400 connections now open) 2015-10-05T07:06:44.514+0100 [conn1428124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:47.725+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:47.725+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:49.451+0100 [conn1427661] end connection 172.28.0.163:55150 (399 connections now open) 2015-10-05T07:06:49.452+0100 [mongosMain] connection accepted from 172.28.0.163:56438 #1428125 (400 connections now open) 2015-10-05T07:06:49.453+0100 [conn1428125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:49.893+0100 [conn1427692] end connection 172.28.0.164:64546 (399 connections now open) 2015-10-05T07:06:49.894+0100 [conn1427736] end connection 172.28.0.164:64676 (398 connections now open) 2015-10-05T07:06:49.894+0100 [mongosMain] connection accepted from 172.28.0.164:49438 #1428126 (399 connections now open) 2015-10-05T07:06:49.894+0100 [mongosMain] connection accepted from 172.28.0.164:49439 #1428127 (400 connections now open) 2015-10-05T07:06:49.896+0100 [conn1428127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:49.897+0100 [conn1428126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:50.012+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:53.390+0100 [conn1427731] end connection 172.28.0.163:55327 (399 connections now open) 2015-10-05T07:06:53.391+0100 [mongosMain] connection accepted from 172.28.0.163:56444 #1428128 (400 connections now open) 2015-10-05T07:06:53.393+0100 [conn1428128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:53.936+0100 [conn1427740] end connection 172.28.0.163:55343 (399 connections now open) 2015-10-05T07:06:53.937+0100 [mongosMain] connection accepted from 172.28.0.163:56446 #1428129 (400 connections now open) 2015-10-05T07:06:53.938+0100 [conn1428129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:53.981+0100 [conn1427739] end connection 172.28.0.164:64683 (399 connections now open) 2015-10-05T07:06:53.982+0100 [mongosMain] connection accepted from 172.28.0.164:49448 #1428130 (400 connections now open) 2015-10-05T07:06:53.984+0100 [conn1428130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:54.528+0100 [conn1427741] end connection 172.28.0.164:64686 (399 connections now open) 2015-10-05T07:06:54.529+0100 [mongosMain] connection accepted from 172.28.0.164:49452 #1428131 (400 connections now open) 2015-10-05T07:06:54.531+0100 [conn1428131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:54.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612137e5703b51053ecb9ab 2015-10-05T07:06:54.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:06:54.731+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:06:54.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:06:55.345+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:06:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:06:59.458+0100 [conn1427710] end connection 172.28.0.163:55271 (399 connections now open) 2015-10-05T07:06:59.459+0100 [conn1427728] end connection 172.28.0.163:55320 (398 connections now open) 2015-10-05T07:06:59.462+0100 [mongosMain] connection accepted from 172.28.0.163:56455 #1428132 (399 connections now open) 2015-10-05T07:06:59.462+0100 [mongosMain] connection accepted from 172.28.0.163:56457 #1428133 (400 connections now open) 2015-10-05T07:06:59.463+0100 [conn1428132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:59.464+0100 [conn1428133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:59.909+0100 [conn1427580] end connection 172.28.0.164:64245 (399 connections now open) 2015-10-05T07:06:59.909+0100 [conn1427691] end connection 172.28.0.164:64544 (398 connections now open) 2015-10-05T07:06:59.910+0100 [mongosMain] connection accepted from 172.28.0.164:49459 #1428134 (399 connections now open) 2015-10-05T07:06:59.910+0100 [mongosMain] connection accepted from 172.28.0.164:49460 #1428135 (400 connections now open) 2015-10-05T07:06:59.912+0100 [conn1428134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:06:59.912+0100 [conn1428135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:01.012+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:02.737+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:02.737+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:03.405+0100 [conn1427738] end connection 172.28.0.163:55340 (399 connections now open) 2015-10-05T07:07:03.406+0100 [mongosMain] connection accepted from 172.28.0.163:56473 #1428136 (400 connections now open) 2015-10-05T07:07:03.407+0100 [conn1428136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:03.996+0100 [conn1427713] end connection 172.28.0.164:64605 (399 connections now open) 2015-10-05T07:07:03.997+0100 [mongosMain] connection accepted from 172.28.0.164:49471 #1428137 (400 connections now open) 2015-10-05T07:07:04.000+0100 [conn1428137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:04.527+0100 [conn1427748] end connection 172.28.0.164:64706 (399 connections now open) 2015-10-05T07:07:04.528+0100 [mongosMain] connection accepted from 172.28.0.164:49473 #1428138 (400 connections now open) 2015-10-05T07:07:04.530+0100 [conn1428138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:06.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612138a5703b51053ecba5e 2015-10-05T07:07:07.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:09.462+0100 [conn1427734] end connection 172.28.0.163:55334 (399 connections now open) 2015-10-05T07:07:09.462+0100 [conn1427627] end connection 172.28.0.163:55051 (399 connections now open) 2015-10-05T07:07:09.464+0100 [mongosMain] connection accepted from 172.28.0.163:56482 #1428139 (399 connections now open) 2015-10-05T07:07:09.464+0100 [mongosMain] connection accepted from 172.28.0.163:56483 #1428140 (400 connections now open) 2015-10-05T07:07:09.465+0100 [conn1428139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:09.465+0100 [conn1428140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:09.909+0100 [conn1427724] end connection 172.28.0.164:64625 (399 connections now open) 2015-10-05T07:07:09.909+0100 [conn1427735] end connection 172.28.0.164:64675 (399 connections now open) 2015-10-05T07:07:09.910+0100 [mongosMain] connection accepted from 172.28.0.164:49479 #1428141 (399 connections now open) 2015-10-05T07:07:09.910+0100 [mongosMain] connection accepted from 172.28.0.164:49480 #1428142 (400 connections now open) 2015-10-05T07:07:09.912+0100 [conn1428141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:09.912+0100 [conn1428142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:11.742+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:11.743+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:12.018+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:13.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213915703b51053ecbaa9 2015-10-05T07:07:13.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:13.967+0100 [conn1427747] end connection 172.28.0.163:55360 (399 connections now open) 2015-10-05T07:07:13.968+0100 [mongosMain] connection accepted from 172.28.0.163:56492 #1428143 (400 connections now open) 2015-10-05T07:07:13.969+0100 [conn1428143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:14.012+0100 [conn1427701] end connection 172.28.0.164:64575 (399 connections now open) 2015-10-05T07:07:14.013+0100 [mongosMain] connection accepted from 172.28.0.164:49483 #1428144 (400 connections now open) 2015-10-05T07:07:14.015+0100 [conn1428144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:14.526+0100 [conn1427754] end connection 172.28.0.164:64719 (399 connections now open) 2015-10-05T07:07:14.528+0100 [mongosMain] connection accepted from 172.28.0.164:49486 #1428145 (400 connections now open) 2015-10-05T07:07:14.529+0100 [conn1428145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:19.474+0100 [conn1427716] end connection 172.28.0.163:55289 (399 connections now open) 2015-10-05T07:07:19.474+0100 [conn1427723] end connection 172.28.0.163:55309 (398 connections now open) 2015-10-05T07:07:19.475+0100 [mongosMain] connection accepted from 172.28.0.163:56501 #1428146 (399 connections now open) 2015-10-05T07:07:19.476+0100 [mongosMain] connection accepted from 172.28.0.163:56503 #1428147 (400 connections now open) 2015-10-05T07:07:19.476+0100 [conn1428146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:19.477+0100 [conn1428147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:19.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213975703b51053ecbaf5 2015-10-05T07:07:19.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:19.924+0100 [conn1427743] end connection 172.28.0.164:64695 (399 connections now open) 2015-10-05T07:07:19.925+0100 [conn1427744] end connection 172.28.0.164:64696 (398 connections now open) 2015-10-05T07:07:19.925+0100 [mongosMain] connection accepted from 172.28.0.164:49492 #1428148 (399 connections now open) 2015-10-05T07:07:19.926+0100 [mongosMain] connection accepted from 172.28.0.164:49493 #1428149 (400 connections now open) 2015-10-05T07:07:19.927+0100 [conn1428148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:19.927+0100 [conn1428149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:21.757+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:21.757+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:23.024+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:23.969+0100 [conn1427760] end connection 172.28.0.163:55398 (399 connections now open) 2015-10-05T07:07:23.970+0100 [mongosMain] connection accepted from 172.28.0.163:56509 #1428150 (400 connections now open) 2015-10-05T07:07:23.971+0100 [conn1428150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:24.030+0100 [conn1427694] end connection 172.28.0.164:64553 (399 connections now open) 2015-10-05T07:07:24.031+0100 [mongosMain] connection accepted from 172.28.0.164:49501 #1428151 (400 connections now open) 2015-10-05T07:07:24.032+0100 [conn1428151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:24.541+0100 [conn1427761] end connection 172.28.0.164:64730 (399 connections now open) 2015-10-05T07:07:24.544+0100 [mongosMain] connection accepted from 172.28.0.164:49503 #1428152 (400 connections now open) 2015-10-05T07:07:24.546+0100 [conn1428152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:25.633+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:07:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:07:26.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612139d5703b51053ecbb46 2015-10-05T07:07:26.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:29.082+0100 [mongosMain] connection accepted from 127.0.0.1:56511 #1428153 (401 connections now open) 2015-10-05T07:07:29.085+0100 [conn1428153] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:29.090+0100 [conn1428153] end connection 127.0.0.1:56511 (400 connections now open) 2015-10-05T07:07:29.481+0100 [conn1427749] end connection 172.28.0.163:55369 (399 connections now open) 2015-10-05T07:07:29.482+0100 [mongosMain] connection accepted from 172.28.0.163:56512 #1428154 (400 connections now open) 2015-10-05T07:07:29.483+0100 [conn1428154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:29.939+0100 [conn1427750] end connection 172.28.0.164:64712 (399 connections now open) 2015-10-05T07:07:29.940+0100 [conn1427698] end connection 172.28.0.164:64566 (398 connections now open) 2015-10-05T07:07:29.941+0100 [mongosMain] connection accepted from 172.28.0.164:49514 #1428155 (399 connections now open) 2015-10-05T07:07:29.941+0100 [mongosMain] connection accepted from 172.28.0.164:49513 #1428156 (400 connections now open) 2015-10-05T07:07:29.942+0100 [conn1428155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:29.943+0100 [conn1428156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:32.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213a45703b51053ecbb94 2015-10-05T07:07:32.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:32.879+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:32.880+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:33.983+0100 [conn1427763] end connection 172.28.0.163:55411 (399 connections now open) 2015-10-05T07:07:33.985+0100 [mongosMain] connection accepted from 172.28.0.163:56517 #1428157 (400 connections now open) 2015-10-05T07:07:33.986+0100 [conn1428157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:34.044+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:34.558+0100 [conn1427764] end connection 172.28.0.164:64743 (399 connections now open) 2015-10-05T07:07:34.560+0100 [mongosMain] connection accepted from 172.28.0.164:49523 #1428158 (400 connections now open) 2015-10-05T07:07:34.562+0100 [conn1428158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:39.489+0100 [conn1427669] end connection 172.28.0.163:55172 (399 connections now open) 2015-10-05T07:07:39.489+0100 [conn1427755] end connection 172.28.0.163:55387 (399 connections now open) 2015-10-05T07:07:39.491+0100 [mongosMain] connection accepted from 172.28.0.163:56521 #1428159 (399 connections now open) 2015-10-05T07:07:39.491+0100 [mongosMain] connection accepted from 172.28.0.163:56522 #1428160 (400 connections now open) 2015-10-05T07:07:39.492+0100 [conn1428159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:39.492+0100 [conn1428160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:40.001+0100 [mongosMain] connection accepted from 127.0.0.1:56524 #1428161 (401 connections now open) 2015-10-05T07:07:40.003+0100 [conn1428161] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:40.008+0100 [conn1428161] end connection 127.0.0.1:56524 (400 connections now open) 2015-10-05T07:07:43.983+0100 [conn1427772] end connection 172.28.0.163:55432 (399 connections now open) 2015-10-05T07:07:43.984+0100 [mongosMain] connection accepted from 172.28.0.163:56530 #1428162 (400 connections now open) 2015-10-05T07:07:43.985+0100 [conn1428162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:44.574+0100 [conn1427773] end connection 172.28.0.164:64767 (399 connections now open) 2015-10-05T07:07:44.576+0100 [mongosMain] connection accepted from 172.28.0.164:49543 #1428163 (400 connections now open) 2015-10-05T07:07:44.578+0100 [conn1428163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:44.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:44.892+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:44.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213b05703b51053ecbc7f 2015-10-05T07:07:45.053+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:45.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:46.902+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:46.902+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:49.505+0100 [conn1427558] end connection 172.28.0.163:54885 (399 connections now open) 2015-10-05T07:07:49.505+0100 [conn1427766] end connection 172.28.0.163:55420 (398 connections now open) 2015-10-05T07:07:49.506+0100 [mongosMain] connection accepted from 172.28.0.163:56543 #1428164 (399 connections now open) 2015-10-05T07:07:49.506+0100 [mongosMain] connection accepted from 172.28.0.163:56544 #1428165 (400 connections now open) 2015-10-05T07:07:49.507+0100 [conn1428164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:49.507+0100 [conn1428165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:49.955+0100 [conn1427776] end connection 172.28.0.164:64776 (399 connections now open) 2015-10-05T07:07:49.956+0100 [mongosMain] connection accepted from 172.28.0.164:49551 #1428166 (400 connections now open) 2015-10-05T07:07:49.957+0100 [conn1428166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:49.969+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:49.970+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:51.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213b75703b51053ecbced 2015-10-05T07:07:51.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:07:53.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:53.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:53.999+0100 [conn1427780] end connection 172.28.0.163:55448 (399 connections now open) 2015-10-05T07:07:54.000+0100 [mongosMain] connection accepted from 172.28.0.163:56552 #1428167 (400 connections now open) 2015-10-05T07:07:54.001+0100 [conn1428167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:56.055+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:56.117+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:07:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:07:58.988+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:07:58.988+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:07:59.507+0100 [conn1427775] end connection 172.28.0.163:55437 (399 connections now open) 2015-10-05T07:07:59.508+0100 [mongosMain] connection accepted from 172.28.0.163:56561 #1428168 (400 connections now open) 2015-10-05T07:07:59.509+0100 [conn1428168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:07:59.971+0100 [conn1427769] end connection 172.28.0.164:64754 (399 connections now open) 2015-10-05T07:07:59.972+0100 [mongosMain] connection accepted from 172.28.0.164:49566 #1428169 (400 connections now open) 2015-10-05T07:07:59.973+0100 [conn1428169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:03.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213c35703b51053ecbdc6 2015-10-05T07:08:03.490+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:04.002+0100 [conn1427787] end connection 172.28.0.163:55469 (399 connections now open) 2015-10-05T07:08:04.002+0100 [mongosMain] connection accepted from 172.28.0.163:56583 #1428170 (400 connections now open) 2015-10-05T07:08:04.003+0100 [conn1428170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:04.090+0100 [conn1427746] end connection 172.28.0.164:64703 (399 connections now open) 2015-10-05T07:08:04.092+0100 [mongosMain] connection accepted from 172.28.0.164:49575 #1428171 (400 connections now open) 2015-10-05T07:08:04.093+0100 [conn1428171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:04.605+0100 [conn1427788] end connection 172.28.0.164:64808 (399 connections now open) 2015-10-05T07:08:04.607+0100 [mongosMain] connection accepted from 172.28.0.164:49578 #1428172 (400 connections now open) 2015-10-05T07:08:04.609+0100 [conn1428172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:04.993+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:04.993+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:07.056+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:09.521+0100 [conn1427789] end connection 172.28.0.163:55477 (399 connections now open) 2015-10-05T07:08:09.522+0100 [mongosMain] connection accepted from 172.28.0.163:56592 #1428173 (400 connections now open) 2015-10-05T07:08:09.523+0100 [conn1428173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:09.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213c95703b51053ecbe55 2015-10-05T07:08:09.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:09.987+0100 [conn1427757] end connection 172.28.0.164:64725 (399 connections now open) 2015-10-05T07:08:09.988+0100 [mongosMain] connection accepted from 172.28.0.164:49582 #1428174 (400 connections now open) 2015-10-05T07:08:09.991+0100 [conn1428174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:11.999+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:11.999+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:14.017+0100 [conn1427792] end connection 172.28.0.163:55488 (399 connections now open) 2015-10-05T07:08:14.018+0100 [mongosMain] connection accepted from 172.28.0.163:56598 #1428175 (400 connections now open) 2015-10-05T07:08:14.020+0100 [conn1428175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:14.090+0100 [conn1427779] end connection 172.28.0.164:64785 (399 connections now open) 2015-10-05T07:08:14.090+0100 [mongosMain] connection accepted from 172.28.0.164:49587 #1428176 (400 connections now open) 2015-10-05T07:08:14.097+0100 [conn1428176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:14.621+0100 [conn1427781] end connection 172.28.0.164:64787 (399 connections now open) 2015-10-05T07:08:14.622+0100 [mongosMain] connection accepted from 172.28.0.164:49589 #1428177 (400 connections now open) 2015-10-05T07:08:14.623+0100 [conn1428177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:18.164+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:19.521+0100 [conn1427742] end connection 172.28.0.163:55351 (399 connections now open) 2015-10-05T07:08:19.522+0100 [mongosMain] connection accepted from 172.28.0.163:56608 #1428178 (400 connections now open) 2015-10-05T07:08:19.523+0100 [conn1428178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:20.003+0100 [conn1427784] end connection 172.28.0.164:64797 (399 connections now open) 2015-10-05T07:08:20.003+0100 [mongosMain] connection accepted from 172.28.0.164:49597 #1428179 (400 connections now open) 2015-10-05T07:08:20.005+0100 [conn1428179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:20.093+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:20.094+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:22.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213d55703b51053ecbf18 2015-10-05T07:08:22.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:24.030+0100 [conn1427797] end connection 172.28.0.163:55506 (399 connections now open) 2015-10-05T07:08:24.031+0100 [mongosMain] connection accepted from 172.28.0.163:56612 #1428180 (400 connections now open) 2015-10-05T07:08:24.032+0100 [conn1428180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:24.105+0100 [conn1427802] end connection 172.28.0.164:64844 (399 connections now open) 2015-10-05T07:08:24.106+0100 [mongosMain] connection accepted from 172.28.0.164:49605 #1428181 (400 connections now open) 2015-10-05T07:08:24.108+0100 [conn1428181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:24.636+0100 [conn1427793] end connection 172.28.0.164:64819 (399 connections now open) 2015-10-05T07:08:24.637+0100 [mongosMain] connection accepted from 172.28.0.164:49608 #1428182 (400 connections now open) 2015-10-05T07:08:24.638+0100 [conn1428182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:26.364+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:08:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:08:28.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213dc5703b51053ecbf82 2015-10-05T07:08:28.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:28.784+0100 [mongosMain] connection accepted from 127.0.0.1:56617 #1428183 (401 connections now open) 2015-10-05T07:08:28.786+0100 [conn1428183] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:28.793+0100 [conn1428183] end connection 127.0.0.1:56617 (400 connections now open) 2015-10-05T07:08:29.184+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:29.194+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:29.194+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:29.538+0100 [conn1427794] end connection 172.28.0.163:55495 (399 connections now open) 2015-10-05T07:08:29.539+0100 [mongosMain] connection accepted from 172.28.0.163:56618 #1428184 (400 connections now open) 2015-10-05T07:08:29.540+0100 [conn1428184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:30.003+0100 [conn1427801] end connection 172.28.0.164:64837 (399 connections now open) 2015-10-05T07:08:30.004+0100 [mongosMain] connection accepted from 172.28.0.164:49616 #1428185 (400 connections now open) 2015-10-05T07:08:30.006+0100 [conn1428185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:34.030+0100 [conn1427803] end connection 172.28.0.163:55521 (399 connections now open) 2015-10-05T07:08:34.031+0100 [mongosMain] connection accepted from 172.28.0.163:56621 #1428186 (400 connections now open) 2015-10-05T07:08:34.036+0100 [conn1428186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:34.121+0100 [conn1427771] end connection 172.28.0.164:64764 (399 connections now open) 2015-10-05T07:08:34.122+0100 [mongosMain] connection accepted from 172.28.0.164:49624 #1428187 (400 connections now open) 2015-10-05T07:08:34.123+0100 [conn1428187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:34.652+0100 [conn1427798] end connection 172.28.0.164:64829 (399 connections now open) 2015-10-05T07:08:34.653+0100 [mongosMain] connection accepted from 172.28.0.164:49626 #1428188 (400 connections now open) 2015-10-05T07:08:34.654+0100 [conn1428188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:39.289+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:39.289+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:39.415+0100 [mongosMain] connection accepted from 127.0.0.1:56626 #1428189 (401 connections now open) 2015-10-05T07:08:39.418+0100 [conn1428189] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:39.422+0100 [conn1428189] end connection 127.0.0.1:56626 (400 connections now open) 2015-10-05T07:08:39.537+0100 [conn1427806] end connection 172.28.0.163:55524 (399 connections now open) 2015-10-05T07:08:39.538+0100 [mongosMain] connection accepted from 172.28.0.163:56627 #1428190 (400 connections now open) 2015-10-05T07:08:39.539+0100 [conn1428190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:40.019+0100 [conn1427791] end connection 172.28.0.164:64813 (399 connections now open) 2015-10-05T07:08:40.020+0100 [mongosMain] connection accepted from 172.28.0.164:49636 #1428191 (400 connections now open) 2015-10-05T07:08:40.022+0100 [conn1428191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:40.187+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:40.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213e85703b51053ecc05a 2015-10-05T07:08:40.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:43.500+0100 [conn1427693] end connection 172.28.0.163:55226 (399 connections now open) 2015-10-05T07:08:43.501+0100 [mongosMain] connection accepted from 172.28.0.163:56633 #1428192 (400 connections now open) 2015-10-05T07:08:43.502+0100 [conn1428192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:44.046+0100 [conn1427810] end connection 172.28.0.163:55529 (399 connections now open) 2015-10-05T07:08:44.048+0100 [mongosMain] connection accepted from 172.28.0.163:56639 #1428193 (400 connections now open) 2015-10-05T07:08:44.049+0100 [conn1428193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:44.652+0100 [conn1427804] end connection 172.28.0.164:64847 (399 connections now open) 2015-10-05T07:08:44.653+0100 [mongosMain] connection accepted from 172.28.0.164:49647 #1428194 (400 connections now open) 2015-10-05T07:08:44.655+0100 [conn1428194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:49.552+0100 [conn1427782] end connection 172.28.0.163:55456 (399 connections now open) 2015-10-05T07:08:49.553+0100 [mongosMain] connection accepted from 172.28.0.163:56650 #1428195 (400 connections now open) 2015-10-05T07:08:49.554+0100 [conn1428195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:50.019+0100 [conn1427796] end connection 172.28.0.164:64825 (399 connections now open) 2015-10-05T07:08:50.019+0100 [conn1427751] end connection 172.28.0.164:64713 (398 connections now open) 2015-10-05T07:08:50.020+0100 [mongosMain] connection accepted from 172.28.0.164:49653 #1428196 (399 connections now open) 2015-10-05T07:08:50.020+0100 [mongosMain] connection accepted from 172.28.0.164:49654 #1428197 (400 connections now open) 2015-10-05T07:08:50.021+0100 [conn1428196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:50.022+0100 [conn1428197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:50.292+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:50.292+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:08:51.199+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:08:53.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213f45703b51053ecc137 2015-10-05T07:08:53.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:08:53.502+0100 [conn1427705] end connection 172.28.0.163:55260 (399 connections now open) 2015-10-05T07:08:53.503+0100 [mongosMain] connection accepted from 172.28.0.163:56657 #1428198 (400 connections now open) 2015-10-05T07:08:53.504+0100 [conn1428198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:54.049+0100 [conn1427817] end connection 172.28.0.163:55542 (399 connections now open) 2015-10-05T07:08:54.050+0100 [mongosMain] connection accepted from 172.28.0.163:56660 #1428199 (400 connections now open) 2015-10-05T07:08:54.051+0100 [conn1428199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:54.139+0100 [conn1427725] end connection 172.28.0.164:64635 (399 connections now open) 2015-10-05T07:08:54.140+0100 [mongosMain] connection accepted from 172.28.0.164:49662 #1428200 (400 connections now open) 2015-10-05T07:08:54.142+0100 [conn1428200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:56.541+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:08:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:08:59.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561213fb5703b51053ecc1a8 2015-10-05T07:08:59.583+0100 [conn1427799] end connection 172.28.0.163:55512 (399 connections now open) 2015-10-05T07:08:59.583+0100 [mongosMain] connection accepted from 172.28.0.163:56670 #1428201 (400 connections now open) 2015-10-05T07:08:59.583+0100 [conn1428201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:08:59.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:00.051+0100 [conn1427808] end connection 172.28.0.164:64856 (399 connections now open) 2015-10-05T07:09:00.051+0100 [conn1427718] end connection 172.28.0.164:64611 (398 connections now open) 2015-10-05T07:09:00.051+0100 [mongosMain] connection accepted from 172.28.0.164:49670 #1428202 (399 connections now open) 2015-10-05T07:09:00.051+0100 [mongosMain] connection accepted from 172.28.0.164:49671 #1428203 (400 connections now open) 2015-10-05T07:09:00.066+0100 [conn1428202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:00.066+0100 [conn1428203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:02.261+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:02.296+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:02.296+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:03.516+0100 [conn1427770] end connection 172.28.0.163:55430 (399 connections now open) 2015-10-05T07:09:03.517+0100 [mongosMain] connection accepted from 172.28.0.163:56685 #1428204 (400 connections now open) 2015-10-05T07:09:03.518+0100 [conn1428204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:04.153+0100 [conn1427759] end connection 172.28.0.164:64728 (399 connections now open) 2015-10-05T07:09:04.155+0100 [mongosMain] connection accepted from 172.28.0.164:49679 #1428205 (400 connections now open) 2015-10-05T07:09:04.157+0100 [conn1428205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:04.302+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:04.302+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:07.302+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:07.302+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:09.568+0100 [conn1427819] end connection 172.28.0.163:55553 (399 connections now open) 2015-10-05T07:09:09.569+0100 [mongosMain] connection accepted from 172.28.0.163:56695 #1428206 (400 connections now open) 2015-10-05T07:09:09.571+0100 [conn1428206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:10.049+0100 [conn1427730] end connection 172.28.0.164:64649 (399 connections now open) 2015-10-05T07:09:10.051+0100 [mongosMain] connection accepted from 172.28.0.164:49684 #1428207 (400 connections now open) 2015-10-05T07:09:10.052+0100 [conn1428207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:11.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:11.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:11.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214075703b51053ecc2a5 2015-10-05T07:09:12.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:13.265+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:13.788+0100 [conn1427745] end connection 172.28.0.163:55358 (399 connections now open) 2015-10-05T07:09:13.789+0100 [mongosMain] connection accepted from 172.28.0.163:56702 #1428208 (400 connections now open) 2015-10-05T07:09:13.790+0100 [conn1428208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:16.315+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:16.316+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:19.584+0100 [conn1427826] end connection 172.28.0.163:55572 (399 connections now open) 2015-10-05T07:09:19.585+0100 [mongosMain] connection accepted from 172.28.0.163:56708 #1428209 (400 connections now open) 2015-10-05T07:09:19.586+0100 [conn1428209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:20.066+0100 [conn1427711] end connection 172.28.0.164:64599 (399 connections now open) 2015-10-05T07:09:20.067+0100 [mongosMain] connection accepted from 172.28.0.164:49694 #1428210 (400 connections now open) 2015-10-05T07:09:20.069+0100 [conn1428210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:22.327+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:22.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:23.531+0100 [conn1427719] end connection 172.28.0.163:55300 (399 connections now open) 2015-10-05T07:09:23.532+0100 [mongosMain] connection accepted from 172.28.0.163:56712 #1428211 (400 connections now open) 2015-10-05T07:09:23.533+0100 [conn1428211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:24.305+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:24.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214145703b51053ecc35c 2015-10-05T07:09:24.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:26.962+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:09:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:09:28.737+0100 [mongosMain] connection accepted from 127.0.0.1:56716 #1428212 (401 connections now open) 2015-10-05T07:09:28.739+0100 [conn1428212] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:28.745+0100 [conn1428212] end connection 127.0.0.1:56716 (400 connections now open) 2015-10-05T07:09:29.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:29.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:29.585+0100 [conn1427833] end connection 172.28.0.163:55592 (399 connections now open) 2015-10-05T07:09:29.586+0100 [mongosMain] connection accepted from 172.28.0.163:56717 #1428213 (400 connections now open) 2015-10-05T07:09:29.587+0100 [conn1428213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:30.082+0100 [conn1427834] end connection 172.28.0.164:64928 (399 connections now open) 2015-10-05T07:09:30.083+0100 [mongosMain] connection accepted from 172.28.0.164:49713 #1428214 (400 connections now open) 2015-10-05T07:09:30.085+0100 [conn1428214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:30.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612141a5703b51053ecc3a6 2015-10-05T07:09:30.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:33.534+0100 [conn1427700] end connection 172.28.0.163:55241 (399 connections now open) 2015-10-05T07:09:33.535+0100 [mongosMain] connection accepted from 172.28.0.163:56722 #1428215 (400 connections now open) 2015-10-05T07:09:33.536+0100 [conn1428215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:35.309+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:37.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214205703b51053ecc3f9 2015-10-05T07:09:37.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:37.347+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:37.347+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:39.815+0100 [mongosMain] connection accepted from 127.0.0.1:56729 #1428216 (401 connections now open) 2015-10-05T07:09:39.818+0100 [conn1428216] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:39.823+0100 [conn1428216] end connection 127.0.0.1:56729 (400 connections now open) 2015-10-05T07:09:43.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214275703b51053ecc446 2015-10-05T07:09:43.547+0100 [conn1427762] end connection 172.28.0.163:55410 (399 connections now open) 2015-10-05T07:09:43.548+0100 [mongosMain] connection accepted from 172.28.0.163:56735 #1428217 (400 connections now open) 2015-10-05T07:09:43.550+0100 [conn1428217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:43.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:46.347+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:46.351+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:46.352+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:50.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612142d5703b51053ecc494 2015-10-05T07:09:50.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:53.563+0100 [conn1427778] end connection 172.28.0.163:55446 (399 connections now open) 2015-10-05T07:09:53.565+0100 [mongosMain] connection accepted from 172.28.0.163:56748 #1428218 (400 connections now open) 2015-10-05T07:09:53.565+0100 [conn1428218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:09:56.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214345703b51053ecc4dd 2015-10-05T07:09:56.359+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:09:56.359+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:09:56.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:09:57.106+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:09:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:09:57.358+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:02.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612143a5703b51053ecc525 2015-10-05T07:10:02.840+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:10:03.565+0100 [conn1427823] end connection 172.28.0.163:55561 (399 connections now open) 2015-10-05T07:10:03.566+0100 [mongosMain] connection accepted from 172.28.0.163:56777 #1428219 (400 connections now open) 2015-10-05T07:10:03.567+0100 [conn1428219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:07.383+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:07.383+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:08.390+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:08.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214405703b51053ecc5aa 2015-10-05T07:10:09.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:10:13.579+0100 [conn1427785] end connection 172.28.0.163:55467 (399 connections now open) 2015-10-05T07:10:13.581+0100 [mongosMain] connection accepted from 172.28.0.163:56792 #1428220 (400 connections now open) 2015-10-05T07:10:13.582+0100 [conn1428220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:15.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214475703b51053ecc609 2015-10-05T07:10:15.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:10:19.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:19.413+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:19.414+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:19.663+0100 [conn1427854] end connection 172.28.0.163:55650 (399 connections now open) 2015-10-05T07:10:19.664+0100 [mongosMain] connection accepted from 172.28.0.163:56801 #1428221 (400 connections now open) 2015-10-05T07:10:19.665+0100 [conn1428221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:20.128+0100 [conn1427856] end connection 172.28.0.164:65002 (399 connections now open) 2015-10-05T07:10:20.129+0100 [mongosMain] connection accepted from 172.28.0.164:49794 #1428222 (400 connections now open) 2015-10-05T07:10:20.131+0100 [conn1428222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:21.439+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:21.439+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:23.581+0100 [conn1427836] end connection 172.28.0.163:55603 (399 connections now open) 2015-10-05T07:10:23.582+0100 [mongosMain] connection accepted from 172.28.0.163:56809 #1428223 (400 connections now open) 2015-10-05T07:10:23.583+0100 [conn1428223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:24.132+0100 [conn1427825] end connection 172.28.0.163:55565 (399 connections now open) 2015-10-05T07:10:24.134+0100 [mongosMain] connection accepted from 172.28.0.163:56811 #1428224 (400 connections now open) 2015-10-05T07:10:24.134+0100 [conn1428224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:24.449+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:24.450+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:27.255+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:10:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:10:27.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214535703b51053ecc6d8 2015-10-05T07:10:27.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:10:28.317+0100 [mongosMain] connection accepted from 127.0.0.1:56815 #1428225 (401 connections now open) 2015-10-05T07:10:28.319+0100 [conn1428225] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:28.325+0100 [conn1428225] end connection 127.0.0.1:56815 (400 connections now open) 2015-10-05T07:10:28.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:28.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:29.676+0100 [conn1427867] end connection 172.28.0.163:55724 (399 connections now open) 2015-10-05T07:10:29.677+0100 [mongosMain] connection accepted from 172.28.0.163:56818 #1428226 (400 connections now open) 2015-10-05T07:10:29.678+0100 [conn1428226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:30.128+0100 [conn1427814] end connection 172.28.0.164:64878 (399 connections now open) 2015-10-05T07:10:30.128+0100 [conn1427683] end connection 172.28.0.164:64524 (398 connections now open) 2015-10-05T07:10:30.129+0100 [mongosMain] connection accepted from 172.28.0.164:49812 #1428227 (399 connections now open) 2015-10-05T07:10:30.130+0100 [mongosMain] connection accepted from 172.28.0.164:49813 #1428228 (400 connections now open) 2015-10-05T07:10:30.131+0100 [conn1428227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:30.131+0100 [conn1428228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:30.420+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:33.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:33.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:33.594+0100 [conn1427830] end connection 172.28.0.163:55582 (399 connections now open) 2015-10-05T07:10:33.595+0100 [mongosMain] connection accepted from 172.28.0.163:56824 #1428229 (400 connections now open) 2015-10-05T07:10:33.596+0100 [conn1428229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:34.140+0100 [conn1427866] end connection 172.28.0.163:55717 (399 connections now open) 2015-10-05T07:10:34.141+0100 [mongosMain] connection accepted from 172.28.0.163:56826 #1428230 (400 connections now open) 2015-10-05T07:10:34.141+0100 [conn1428230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:34.793+0100 [conn1427818] end connection 172.28.0.164:64888 (399 connections now open) 2015-10-05T07:10:34.794+0100 [mongosMain] connection accepted from 172.28.0.164:49826 #1428231 (400 connections now open) 2015-10-05T07:10:34.795+0100 [conn1428231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:39.453+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:39.453+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:39.594+0100 [mongosMain] connection accepted from 127.0.0.1:56832 #1428232 (401 connections now open) 2015-10-05T07:10:39.597+0100 [conn1428232] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:39.601+0100 [conn1428232] end connection 127.0.0.1:56832 (400 connections now open) 2015-10-05T07:10:39.678+0100 [conn1427863] end connection 172.28.0.163:55705 (399 connections now open) 2015-10-05T07:10:39.680+0100 [mongosMain] connection accepted from 172.28.0.163:56833 #1428233 (400 connections now open) 2015-10-05T07:10:39.681+0100 [conn1428233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:40.144+0100 [conn1427835] end connection 172.28.0.164:64929 (399 connections now open) 2015-10-05T07:10:40.146+0100 [mongosMain] connection accepted from 172.28.0.164:49836 #1428234 (400 connections now open) 2015-10-05T07:10:40.147+0100 [conn1428234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:41.513+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:43.595+0100 [conn1427752] end connection 172.28.0.163:55379 (399 connections now open) 2015-10-05T07:10:43.596+0100 [mongosMain] connection accepted from 172.28.0.163:56843 #1428235 (400 connections now open) 2015-10-05T07:10:43.597+0100 [conn1428235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:44.145+0100 [conn1427873] end connection 172.28.0.163:55746 (399 connections now open) 2015-10-05T07:10:44.146+0100 [mongosMain] connection accepted from 172.28.0.163:56844 #1428236 (400 connections now open) 2015-10-05T07:10:44.147+0100 [conn1428236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:44.793+0100 [conn1427811] end connection 172.28.0.164:64866 (399 connections now open) 2015-10-05T07:10:44.794+0100 [mongosMain] connection accepted from 172.28.0.164:49845 #1428237 (400 connections now open) 2015-10-05T07:10:44.796+0100 [conn1428237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:46.461+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:46.461+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:49.678+0100 [conn1427849] end connection 172.28.0.163:55634 (399 connections now open) 2015-10-05T07:10:49.679+0100 [mongosMain] connection accepted from 172.28.0.163:56854 #1428238 (400 connections now open) 2015-10-05T07:10:49.680+0100 [conn1428238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:50.145+0100 [conn1427821] end connection 172.28.0.164:64896 (399 connections now open) 2015-10-05T07:10:50.146+0100 [mongosMain] connection accepted from 172.28.0.164:49853 #1428239 (400 connections now open) 2015-10-05T07:10:50.148+0100 [conn1428239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:51.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612146b5703b51053ecc833 2015-10-05T07:10:51.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:10:52.553+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:53.610+0100 [conn1427853] end connection 172.28.0.163:55642 (399 connections now open) 2015-10-05T07:10:53.612+0100 [mongosMain] connection accepted from 172.28.0.163:56861 #1428240 (400 connections now open) 2015-10-05T07:10:53.613+0100 [conn1428240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:54.481+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:10:54.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:10:54.809+0100 [conn1427874] end connection 172.28.0.164:65092 (399 connections now open) 2015-10-05T07:10:54.810+0100 [mongosMain] connection accepted from 172.28.0.164:49864 #1428241 (400 connections now open) 2015-10-05T07:10:54.812+0100 [conn1428241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:10:57.492+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:10:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:10:59.694+0100 [conn1427844] end connection 172.28.0.163:55621 (399 connections now open) 2015-10-05T07:10:59.695+0100 [mongosMain] connection accepted from 172.28.0.163:56868 #1428242 (400 connections now open) 2015-10-05T07:10:59.696+0100 [conn1428242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:00.159+0100 [conn1427877] end connection 172.28.0.164:65103 (399 connections now open) 2015-10-05T07:11:00.160+0100 [mongosMain] connection accepted from 172.28.0.164:49869 #1428243 (400 connections now open) 2015-10-05T07:11:00.161+0100 [conn1428243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:03.543+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:03.543+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:03.561+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:03.611+0100 [conn1427847] end connection 172.28.0.163:55627 (399 connections now open) 2015-10-05T07:11:03.612+0100 [mongosMain] connection accepted from 172.28.0.163:56887 #1428244 (400 connections now open) 2015-10-05T07:11:03.613+0100 [conn1428244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:04.162+0100 [conn1427879] end connection 172.28.0.163:55759 (399 connections now open) 2015-10-05T07:11:04.163+0100 [mongosMain] connection accepted from 172.28.0.163:56889 #1428245 (400 connections now open) 2015-10-05T07:11:04.164+0100 [conn1428245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:04.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214775703b51053ecc8f3 2015-10-05T07:11:04.279+0100 [conn1427837] end connection 172.28.0.164:64937 (399 connections now open) 2015-10-05T07:11:04.280+0100 [mongosMain] connection accepted from 172.28.0.164:49878 #1428246 (400 connections now open) 2015-10-05T07:11:04.282+0100 [conn1428246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:04.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:11:04.825+0100 [conn1427880] end connection 172.28.0.164:65111 (399 connections now open) 2015-10-05T07:11:04.825+0100 [mongosMain] connection accepted from 172.28.0.164:49880 #1428247 (400 connections now open) 2015-10-05T07:11:04.827+0100 [conn1428247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:09.699+0100 [conn1427839] end connection 172.28.0.163:55613 (399 connections now open) 2015-10-05T07:11:09.700+0100 [mongosMain] connection accepted from 172.28.0.163:56896 #1428248 (400 connections now open) 2015-10-05T07:11:09.701+0100 [conn1428248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:10.176+0100 [conn1427870] end connection 172.28.0.164:65079 (399 connections now open) 2015-10-05T07:11:10.177+0100 [mongosMain] connection accepted from 172.28.0.164:49887 #1428249 (400 connections now open) 2015-10-05T07:11:10.180+0100 [conn1428249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:13.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:13.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:13.626+0100 [conn1427858] end connection 172.28.0.163:55659 (399 connections now open) 2015-10-05T07:11:13.627+0100 [mongosMain] connection accepted from 172.28.0.163:56902 #1428250 (400 connections now open) 2015-10-05T07:11:13.628+0100 [conn1428250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:14.172+0100 [conn1427884] end connection 172.28.0.163:55776 (399 connections now open) 2015-10-05T07:11:14.173+0100 [mongosMain] connection accepted from 172.28.0.163:56905 #1428251 (400 connections now open) 2015-10-05T07:11:14.174+0100 [conn1428251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:14.279+0100 [conn1427753] end connection 172.28.0.164:64717 (399 connections now open) 2015-10-05T07:11:14.280+0100 [mongosMain] connection accepted from 172.28.0.164:49891 #1428252 (400 connections now open) 2015-10-05T07:11:14.282+0100 [conn1428252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:14.566+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:14.825+0100 [conn1427885] end connection 172.28.0.164:65130 (399 connections now open) 2015-10-05T07:11:14.826+0100 [mongosMain] connection accepted from 172.28.0.164:49893 #1428253 (400 connections now open) 2015-10-05T07:11:14.828+0100 [conn1428253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:16.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214845703b51053ecc9fb 2015-10-05T07:11:16.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:11:19.710+0100 [conn1427859] end connection 172.28.0.163:55665 (399 connections now open) 2015-10-05T07:11:19.711+0100 [mongosMain] connection accepted from 172.28.0.163:56909 #1428254 (400 connections now open) 2015-10-05T07:11:19.712+0100 [conn1428254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:20.192+0100 [conn1427828] end connection 172.28.0.164:64917 (399 connections now open) 2015-10-05T07:11:20.192+0100 [mongosMain] connection accepted from 172.28.0.164:49903 #1428255 (400 connections now open) 2015-10-05T07:11:20.194+0100 [conn1428255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:23.642+0100 [conn1427758] end connection 172.28.0.163:55395 (399 connections now open) 2015-10-05T07:11:23.643+0100 [mongosMain] connection accepted from 172.28.0.163:56915 #1428256 (400 connections now open) 2015-10-05T07:11:23.644+0100 [conn1428256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:24.188+0100 [conn1427891] end connection 172.28.0.163:55802 (399 connections now open) 2015-10-05T07:11:24.189+0100 [mongosMain] connection accepted from 172.28.0.163:56917 #1428257 (400 connections now open) 2015-10-05T07:11:24.191+0100 [conn1428257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:24.295+0100 [conn1427809] end connection 172.28.0.164:64864 (399 connections now open) 2015-10-05T07:11:24.296+0100 [mongosMain] connection accepted from 172.28.0.164:49910 #1428258 (400 connections now open) 2015-10-05T07:11:24.308+0100 [conn1428258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:24.551+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:24.552+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:24.841+0100 [conn1427892] end connection 172.28.0.164:65153 (399 connections now open) 2015-10-05T07:11:24.842+0100 [mongosMain] connection accepted from 172.28.0.164:49912 #1428259 (400 connections now open) 2015-10-05T07:11:24.844+0100 [conn1428259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:25.576+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:27.760+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:11:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:11:28.393+0100 [mongosMain] connection accepted from 127.0.0.1:56920 #1428260 (401 connections now open) 2015-10-05T07:11:28.396+0100 [conn1428260] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:28.400+0100 [conn1428260] end connection 127.0.0.1:56920 (400 connections now open) 2015-10-05T07:11:29.726+0100 [conn1427875] end connection 172.28.0.163:55750 (399 connections now open) 2015-10-05T07:11:29.726+0100 [conn1427820] end connection 172.28.0.163:55554 (399 connections now open) 2015-10-05T07:11:29.727+0100 [mongosMain] connection accepted from 172.28.0.163:56921 #1428261 (399 connections now open) 2015-10-05T07:11:29.727+0100 [mongosMain] connection accepted from 172.28.0.163:56922 #1428262 (400 connections now open) 2015-10-05T07:11:29.728+0100 [conn1428261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:29.729+0100 [conn1428262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:30.229+0100 [conn1427850] end connection 172.28.0.164:64985 (399 connections now open) 2015-10-05T07:11:30.230+0100 [conn1427868] end connection 172.28.0.164:65059 (399 connections now open) 2015-10-05T07:11:30.231+0100 [mongosMain] connection accepted from 172.28.0.164:49924 #1428263 (399 connections now open) 2015-10-05T07:11:30.231+0100 [mongosMain] connection accepted from 172.28.0.164:49923 #1428264 (400 connections now open) 2015-10-05T07:11:30.236+0100 [conn1428263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:30.237+0100 [conn1428264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:33.643+0100 [conn1427841] end connection 172.28.0.163:55618 (399 connections now open) 2015-10-05T07:11:33.644+0100 [mongosMain] connection accepted from 172.28.0.163:56924 #1428265 (400 connections now open) 2015-10-05T07:11:33.646+0100 [conn1428265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:34.190+0100 [conn1427896] end connection 172.28.0.163:55821 (399 connections now open) 2015-10-05T07:11:34.191+0100 [mongosMain] connection accepted from 172.28.0.163:56926 #1428266 (400 connections now open) 2015-10-05T07:11:34.192+0100 [conn1428266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:34.310+0100 [conn1427816] end connection 172.28.0.164:64886 (399 connections now open) 2015-10-05T07:11:34.312+0100 [mongosMain] connection accepted from 172.28.0.164:49930 #1428267 (400 connections now open) 2015-10-05T07:11:34.314+0100 [conn1428267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:34.841+0100 [conn1427897] end connection 172.28.0.164:65162 (399 connections now open) 2015-10-05T07:11:34.842+0100 [mongosMain] connection accepted from 172.28.0.164:49933 #1428268 (400 connections now open) 2015-10-05T07:11:34.844+0100 [conn1428268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:34.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214965703b51053eccb2c 2015-10-05T07:11:35.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:11:36.564+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:36.564+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:36.583+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:38.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:38.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:39.179+0100 [mongosMain] connection accepted from 127.0.0.1:56933 #1428269 (401 connections now open) 2015-10-05T07:11:39.182+0100 [conn1428269] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:39.186+0100 [conn1428269] end connection 127.0.0.1:56933 (400 connections now open) 2015-10-05T07:11:39.727+0100 [conn1427838] end connection 172.28.0.163:55612 (399 connections now open) 2015-10-05T07:11:39.729+0100 [mongosMain] connection accepted from 172.28.0.163:56934 #1428270 (400 connections now open) 2015-10-05T07:11:39.730+0100 [conn1428270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:40.222+0100 [conn1427876] end connection 172.28.0.164:65102 (399 connections now open) 2015-10-05T07:11:40.223+0100 [conn1427887] end connection 172.28.0.164:65135 (398 connections now open) 2015-10-05T07:11:40.224+0100 [mongosMain] connection accepted from 172.28.0.164:49944 #1428271 (399 connections now open) 2015-10-05T07:11:40.225+0100 [mongosMain] connection accepted from 172.28.0.164:49945 #1428272 (400 connections now open) 2015-10-05T07:11:40.226+0100 [conn1428271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:40.226+0100 [conn1428272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:41.272+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:11:41.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:11:41.656+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:41.657+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:43.658+0100 [conn1427895] end connection 172.28.0.163:55818 (399 connections now open) 2015-10-05T07:11:43.660+0100 [mongosMain] connection accepted from 172.28.0.163:56942 #1428273 (400 connections now open) 2015-10-05T07:11:43.661+0100 [conn1428273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:44.203+0100 [conn1427902] end connection 172.28.0.163:55840 (399 connections now open) 2015-10-05T07:11:44.204+0100 [mongosMain] connection accepted from 172.28.0.163:56944 #1428274 (400 connections now open) 2015-10-05T07:11:44.205+0100 [conn1428274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:44.326+0100 [conn1427824] end connection 172.28.0.164:64906 (399 connections now open) 2015-10-05T07:11:44.327+0100 [mongosMain] connection accepted from 172.28.0.164:49953 #1428275 (400 connections now open) 2015-10-05T07:11:44.328+0100 [conn1428275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:44.856+0100 [conn1427903] end connection 172.28.0.164:65178 (399 connections now open) 2015-10-05T07:11:44.857+0100 [mongosMain] connection accepted from 172.28.0.164:49956 #1428276 (400 connections now open) 2015-10-05T07:11:44.859+0100 [conn1428276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:45.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:45.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:47.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214a35703b51053eccbc0 2015-10-05T07:11:47.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:11:47.598+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:49.741+0100 [conn1427790] end connection 172.28.0.163:55478 (399 connections now open) 2015-10-05T07:11:49.742+0100 [conn1427911] end connection 172.28.0.163:55856 (399 connections now open) 2015-10-05T07:11:49.743+0100 [mongosMain] connection accepted from 172.28.0.163:56960 #1428277 (399 connections now open) 2015-10-05T07:11:49.743+0100 [mongosMain] connection accepted from 172.28.0.163:56961 #1428278 (400 connections now open) 2015-10-05T07:11:49.744+0100 [conn1428277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:49.744+0100 [conn1428278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:50.238+0100 [conn1427900] end connection 172.28.0.164:65167 (399 connections now open) 2015-10-05T07:11:50.239+0100 [conn1427846] end connection 172.28.0.164:64966 (398 connections now open) 2015-10-05T07:11:50.240+0100 [mongosMain] connection accepted from 172.28.0.164:49966 #1428279 (399 connections now open) 2015-10-05T07:11:50.240+0100 [mongosMain] connection accepted from 172.28.0.164:49967 #1428280 (400 connections now open) 2015-10-05T07:11:50.241+0100 [conn1428279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:50.242+0100 [conn1428280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:50.725+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:50.725+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:53.661+0100 [conn1427862] end connection 172.28.0.163:55696 (399 connections now open) 2015-10-05T07:11:53.662+0100 [mongosMain] connection accepted from 172.28.0.163:56967 #1428281 (400 connections now open) 2015-10-05T07:11:53.663+0100 [conn1428281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:53.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214a95703b51053eccc19 2015-10-05T07:11:53.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:11:54.207+0100 [conn1427909] end connection 172.28.0.163:55852 (399 connections now open) 2015-10-05T07:11:54.208+0100 [mongosMain] connection accepted from 172.28.0.163:56969 #1428282 (400 connections now open) 2015-10-05T07:11:54.209+0100 [conn1428282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:54.872+0100 [conn1427910] end connection 172.28.0.164:65199 (399 connections now open) 2015-10-05T07:11:54.879+0100 [mongosMain] connection accepted from 172.28.0.164:49975 #1428283 (400 connections now open) 2015-10-05T07:11:54.882+0100 [conn1428283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:56.735+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:56.735+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:11:58.037+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:11:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:11:58.685+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:11:59.742+0100 [conn1427898] end connection 172.28.0.163:55827 (399 connections now open) 2015-10-05T07:11:59.742+0100 [conn1427843] end connection 172.28.0.163:55620 (399 connections now open) 2015-10-05T07:11:59.743+0100 [mongosMain] connection accepted from 172.28.0.163:56981 #1428284 (399 connections now open) 2015-10-05T07:11:59.744+0100 [mongosMain] connection accepted from 172.28.0.163:56982 #1428285 (400 connections now open) 2015-10-05T07:11:59.744+0100 [conn1428284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:11:59.745+0100 [conn1428285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:00.240+0100 [conn1427907] end connection 172.28.0.164:65187 (399 connections now open) 2015-10-05T07:12:00.250+0100 [mongosMain] connection accepted from 172.28.0.164:49987 #1428286 (400 connections now open) 2015-10-05T07:12:00.251+0100 [conn1428286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:03.674+0100 [conn1427908] end connection 172.28.0.163:55850 (399 connections now open) 2015-10-05T07:12:03.675+0100 [mongosMain] connection accepted from 172.28.0.163:56998 #1428287 (400 connections now open) 2015-10-05T07:12:03.676+0100 [conn1428287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:03.791+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:03.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:04.219+0100 [conn1427916] end connection 172.28.0.163:55868 (399 connections now open) 2015-10-05T07:12:04.220+0100 [mongosMain] connection accepted from 172.28.0.163:57000 #1428288 (400 connections now open) 2015-10-05T07:12:04.221+0100 [conn1428288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:04.357+0100 [conn1427922] end connection 172.28.0.164:65238 (399 connections now open) 2015-10-05T07:12:04.360+0100 [mongosMain] connection accepted from 172.28.0.164:50000 #1428289 (400 connections now open) 2015-10-05T07:12:04.361+0100 [conn1428289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:04.888+0100 [conn1427918] end connection 172.28.0.164:65224 (399 connections now open) 2015-10-05T07:12:04.889+0100 [mongosMain] connection accepted from 172.28.0.164:50002 #1428290 (400 connections now open) 2015-10-05T07:12:04.891+0100 [conn1428290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:06.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214b55703b51053eccd36 2015-10-05T07:12:06.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:09.697+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:09.996+0100 [conn1427827] end connection 172.28.0.163:55573 (399 connections now open) 2015-10-05T07:12:09.997+0100 [mongosMain] connection accepted from 172.28.0.163:57012 #1428291 (400 connections now open) 2015-10-05T07:12:09.998+0100 [conn1428291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:10.256+0100 [conn1427919] end connection 172.28.0.164:65231 (399 connections now open) 2015-10-05T07:12:10.256+0100 [conn1427894] end connection 172.28.0.164:65157 (398 connections now open) 2015-10-05T07:12:10.259+0100 [mongosMain] connection accepted from 172.28.0.164:50006 #1428292 (399 connections now open) 2015-10-05T07:12:10.259+0100 [mongosMain] connection accepted from 172.28.0.164:50005 #1428293 (400 connections now open) 2015-10-05T07:12:10.261+0100 [conn1428292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:10.261+0100 [conn1428293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:11.882+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:11.882+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:13.674+0100 [conn1427889] end connection 172.28.0.163:55797 (399 connections now open) 2015-10-05T07:12:13.675+0100 [mongosMain] connection accepted from 172.28.0.163:57017 #1428294 (400 connections now open) 2015-10-05T07:12:13.676+0100 [conn1428294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:14.221+0100 [conn1427923] end connection 172.28.0.163:55888 (399 connections now open) 2015-10-05T07:12:14.222+0100 [mongosMain] connection accepted from 172.28.0.163:57019 #1428295 (400 connections now open) 2015-10-05T07:12:14.223+0100 [conn1428295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:14.358+0100 [conn1427917] end connection 172.28.0.164:65221 (399 connections now open) 2015-10-05T07:12:14.359+0100 [mongosMain] connection accepted from 172.28.0.164:50009 #1428296 (400 connections now open) 2015-10-05T07:12:14.361+0100 [conn1428296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:14.904+0100 [conn1427924] end connection 172.28.0.164:65241 (399 connections now open) 2015-10-05T07:12:14.905+0100 [mongosMain] connection accepted from 172.28.0.164:50011 #1428297 (400 connections now open) 2015-10-05T07:12:14.907+0100 [conn1428297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:18.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214c25703b51053eccde0 2015-10-05T07:12:18.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:19.841+0100 [conn1427805] end connection 172.28.0.163:55523 (399 connections now open) 2015-10-05T07:12:19.842+0100 [mongosMain] connection accepted from 172.28.0.163:57026 #1428298 (400 connections now open) 2015-10-05T07:12:19.843+0100 [conn1428298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:20.254+0100 [conn1427906] end connection 172.28.0.164:65188 (399 connections now open) 2015-10-05T07:12:20.255+0100 [conn1427912] end connection 172.28.0.164:65210 (398 connections now open) 2015-10-05T07:12:20.255+0100 [mongosMain] connection accepted from 172.28.0.164:50020 #1428299 (399 connections now open) 2015-10-05T07:12:20.256+0100 [mongosMain] connection accepted from 172.28.0.164:50021 #1428300 (400 connections now open) 2015-10-05T07:12:20.257+0100 [conn1428299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:20.258+0100 [conn1428300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:20.701+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:20.885+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:20.886+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:23.689+0100 [conn1427872] end connection 172.28.0.163:55744 (399 connections now open) 2015-10-05T07:12:23.691+0100 [mongosMain] connection accepted from 172.28.0.163:57032 #1428301 (400 connections now open) 2015-10-05T07:12:23.692+0100 [conn1428301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:24.235+0100 [conn1427927] end connection 172.28.0.163:55915 (399 connections now open) 2015-10-05T07:12:24.237+0100 [mongosMain] connection accepted from 172.28.0.163:57034 #1428302 (400 connections now open) 2015-10-05T07:12:24.238+0100 [conn1428302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:24.373+0100 [conn1427786] end connection 172.28.0.164:64805 (399 connections now open) 2015-10-05T07:12:24.374+0100 [mongosMain] connection accepted from 172.28.0.164:50028 #1428303 (400 connections now open) 2015-10-05T07:12:24.377+0100 [conn1428303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:24.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214c85703b51053ecce3c 2015-10-05T07:12:24.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:24.919+0100 [conn1427929] end connection 172.28.0.164:65260 (399 connections now open) 2015-10-05T07:12:24.920+0100 [mongosMain] connection accepted from 172.28.0.164:50031 #1428304 (400 connections now open) 2015-10-05T07:12:24.922+0100 [conn1428304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:28.284+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:12:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:12:28.572+0100 [mongosMain] connection accepted from 127.0.0.1:57038 #1428305 (401 connections now open) 2015-10-05T07:12:28.574+0100 [conn1428305] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:28.579+0100 [conn1428305] end connection 127.0.0.1:57038 (400 connections now open) 2015-10-05T07:12:29.773+0100 [conn1427765] end connection 172.28.0.163:55419 (399 connections now open) 2015-10-05T07:12:29.774+0100 [mongosMain] connection accepted from 172.28.0.163:57039 #1428306 (400 connections now open) 2015-10-05T07:12:29.775+0100 [conn1428306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:30.270+0100 [conn1427881] end connection 172.28.0.164:65120 (399 connections now open) 2015-10-05T07:12:30.270+0100 [conn1427857] end connection 172.28.0.164:65003 (399 connections now open) 2015-10-05T07:12:30.271+0100 [mongosMain] connection accepted from 172.28.0.164:50039 #1428307 (399 connections now open) 2015-10-05T07:12:30.272+0100 [mongosMain] connection accepted from 172.28.0.164:50038 #1428308 (400 connections now open) 2015-10-05T07:12:30.273+0100 [conn1428307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:30.273+0100 [conn1428308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:30.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214ce5703b51053ecceaa 2015-10-05T07:12:30.896+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:30.896+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:30.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:31.707+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:33.705+0100 [conn1427926] end connection 172.28.0.163:55913 (399 connections now open) 2015-10-05T07:12:33.707+0100 [mongosMain] connection accepted from 172.28.0.163:57043 #1428309 (400 connections now open) 2015-10-05T07:12:33.708+0100 [conn1428309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:34.251+0100 [conn1427935] end connection 172.28.0.163:55936 (399 connections now open) 2015-10-05T07:12:34.252+0100 [mongosMain] connection accepted from 172.28.0.163:57045 #1428310 (400 connections now open) 2015-10-05T07:12:34.253+0100 [conn1428310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:34.373+0100 [conn1427842] end connection 172.28.0.164:64956 (399 connections now open) 2015-10-05T07:12:34.375+0100 [mongosMain] connection accepted from 172.28.0.164:50049 #1428311 (400 connections now open) 2015-10-05T07:12:34.377+0100 [conn1428311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:34.919+0100 [conn1427936] end connection 172.28.0.164:65271 (399 connections now open) 2015-10-05T07:12:34.921+0100 [mongosMain] connection accepted from 172.28.0.164:50050 #1428312 (400 connections now open) 2015-10-05T07:12:34.922+0100 [conn1428312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:37.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214d45703b51053eccef7 2015-10-05T07:12:37.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:39.748+0100 [mongosMain] connection accepted from 127.0.0.1:57047 #1428313 (401 connections now open) 2015-10-05T07:12:39.751+0100 [conn1428313] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:39.756+0100 [conn1428313] end connection 127.0.0.1:57047 (400 connections now open) 2015-10-05T07:12:39.838+0100 [conn1427800] end connection 172.28.0.163:55513 (399 connections now open) 2015-10-05T07:12:39.839+0100 [mongosMain] connection accepted from 172.28.0.163:57050 #1428314 (400 connections now open) 2015-10-05T07:12:39.841+0100 [conn1428314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:40.387+0100 [conn1427925] end connection 172.28.0.164:65245 (399 connections now open) 2015-10-05T07:12:40.388+0100 [conn1427920] end connection 172.28.0.164:65232 (398 connections now open) 2015-10-05T07:12:40.397+0100 [mongosMain] connection accepted from 172.28.0.164:50061 #1428315 (399 connections now open) 2015-10-05T07:12:40.398+0100 [mongosMain] connection accepted from 172.28.0.164:50062 #1428316 (400 connections now open) 2015-10-05T07:12:40.399+0100 [conn1428315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:40.399+0100 [conn1428316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:41.920+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:41.920+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:42.717+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:43.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214db5703b51053eccf57 2015-10-05T07:12:43.704+0100 [conn1427921] end connection 172.28.0.163:55886 (399 connections now open) 2015-10-05T07:12:43.705+0100 [mongosMain] connection accepted from 172.28.0.163:57057 #1428317 (400 connections now open) 2015-10-05T07:12:43.706+0100 [conn1428317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:43.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:44.251+0100 [conn1427941] end connection 172.28.0.163:55952 (399 connections now open) 2015-10-05T07:12:44.252+0100 [mongosMain] connection accepted from 172.28.0.163:57060 #1428318 (400 connections now open) 2015-10-05T07:12:44.253+0100 [conn1428318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:44.935+0100 [conn1427943] end connection 172.28.0.164:65290 (399 connections now open) 2015-10-05T07:12:44.936+0100 [mongosMain] connection accepted from 172.28.0.164:50071 #1428319 (400 connections now open) 2015-10-05T07:12:44.938+0100 [conn1428319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:49.789+0100 [conn1427654] end connection 172.28.0.163:55131 (399 connections now open) 2015-10-05T07:12:49.791+0100 [mongosMain] connection accepted from 172.28.0.163:57069 #1428320 (400 connections now open) 2015-10-05T07:12:49.792+0100 [conn1428320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:50.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214e15703b51053eccfab 2015-10-05T07:12:50.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:12:50.395+0100 [conn1427938] end connection 172.28.0.164:65279 (399 connections now open) 2015-10-05T07:12:50.395+0100 [conn1427656] end connection 172.28.0.164:64452 (399 connections now open) 2015-10-05T07:12:50.396+0100 [mongosMain] connection accepted from 172.28.0.164:50079 #1428321 (399 connections now open) 2015-10-05T07:12:50.396+0100 [mongosMain] connection accepted from 172.28.0.164:50080 #1428322 (400 connections now open) 2015-10-05T07:12:50.397+0100 [conn1428321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:50.397+0100 [conn1428322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:53.721+0100 [conn1427865] end connection 172.28.0.163:55714 (399 connections now open) 2015-10-05T07:12:53.722+0100 [mongosMain] connection accepted from 172.28.0.163:57078 #1428323 (400 connections now open) 2015-10-05T07:12:53.723+0100 [conn1428323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:53.728+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:53.940+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:53.940+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:54.266+0100 [conn1427950] end connection 172.28.0.163:55960 (399 connections now open) 2015-10-05T07:12:54.267+0100 [mongosMain] connection accepted from 172.28.0.163:57080 #1428324 (400 connections now open) 2015-10-05T07:12:54.269+0100 [conn1428324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:54.389+0100 [conn1427890] end connection 172.28.0.164:65149 (399 connections now open) 2015-10-05T07:12:54.390+0100 [mongosMain] connection accepted from 172.28.0.164:50085 #1428325 (400 connections now open) 2015-10-05T07:12:54.391+0100 [conn1428325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:54.935+0100 [conn1427951] end connection 172.28.0.164:65309 (399 connections now open) 2015-10-05T07:12:54.936+0100 [mongosMain] connection accepted from 172.28.0.164:50089 #1428326 (400 connections now open) 2015-10-05T07:12:54.938+0100 [conn1428326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:12:55.943+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:55.943+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:58.561+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:12:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:12:58.950+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:12:58.950+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:12:59.804+0100 [conn1427647] end connection 172.28.0.163:55123 (399 connections now open) 2015-10-05T07:12:59.806+0100 [mongosMain] connection accepted from 172.28.0.163:57093 #1428327 (400 connections now open) 2015-10-05T07:12:59.807+0100 [conn1428327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:00.396+0100 [conn1427954] end connection 172.28.0.164:65318 (399 connections now open) 2015-10-05T07:13:00.396+0100 [conn1427851] end connection 172.28.0.164:64984 (398 connections now open) 2015-10-05T07:13:00.397+0100 [mongosMain] connection accepted from 172.28.0.164:50096 #1428328 (399 connections now open) 2015-10-05T07:13:00.397+0100 [mongosMain] connection accepted from 172.28.0.164:50095 #1428329 (400 connections now open) 2015-10-05T07:13:00.398+0100 [conn1428328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:00.400+0100 [conn1428329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:02.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214ee5703b51053ecd01d 2015-10-05T07:13:02.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:02.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:02.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:03.724+0100 [conn1427915] end connection 172.28.0.163:55865 (399 connections now open) 2015-10-05T07:13:03.725+0100 [mongosMain] connection accepted from 172.28.0.163:57109 #1428330 (400 connections now open) 2015-10-05T07:13:03.726+0100 [conn1428330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:04.270+0100 [conn1427958] end connection 172.28.0.163:55976 (399 connections now open) 2015-10-05T07:13:04.271+0100 [mongosMain] connection accepted from 172.28.0.163:57111 #1428331 (400 connections now open) 2015-10-05T07:13:04.272+0100 [conn1428331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:04.405+0100 [conn1427949] end connection 172.28.0.164:65308 (399 connections now open) 2015-10-05T07:13:04.406+0100 [mongosMain] connection accepted from 172.28.0.164:50102 #1428332 (400 connections now open) 2015-10-05T07:13:04.408+0100 [conn1428332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:04.746+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:04.951+0100 [conn1427960] end connection 172.28.0.164:65333 (399 connections now open) 2015-10-05T07:13:04.952+0100 [mongosMain] connection accepted from 172.28.0.164:50104 #1428333 (400 connections now open) 2015-10-05T07:13:04.954+0100 [conn1428333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:07.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:07.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:08.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561214f45703b51053ecd055 2015-10-05T07:13:08.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:09.805+0100 [conn1427813] end connection 172.28.0.163:55533 (399 connections now open) 2015-10-05T07:13:09.806+0100 [mongosMain] connection accepted from 172.28.0.163:57120 #1428334 (400 connections now open) 2015-10-05T07:13:09.806+0100 [conn1428334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:10.411+0100 [conn1427963] end connection 172.28.0.164:65342 (399 connections now open) 2015-10-05T07:13:10.411+0100 [conn1427882] end connection 172.28.0.164:65121 (399 connections now open) 2015-10-05T07:13:10.412+0100 [mongosMain] connection accepted from 172.28.0.164:50109 #1428335 (399 connections now open) 2015-10-05T07:13:10.412+0100 [mongosMain] connection accepted from 172.28.0.164:50110 #1428336 (400 connections now open) 2015-10-05T07:13:10.414+0100 [conn1428335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:10.415+0100 [conn1428336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:13.736+0100 [conn1427901] end connection 172.28.0.163:55838 (399 connections now open) 2015-10-05T07:13:13.737+0100 [mongosMain] connection accepted from 172.28.0.163:57125 #1428337 (400 connections now open) 2015-10-05T07:13:13.738+0100 [conn1428337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:13.957+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:13.958+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:14.282+0100 [conn1427966] end connection 172.28.0.163:56000 (399 connections now open) 2015-10-05T07:13:14.293+0100 [mongosMain] connection accepted from 172.28.0.163:57129 #1428338 (400 connections now open) 2015-10-05T07:13:14.294+0100 [conn1428338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:14.950+0100 [conn1427967] end connection 172.28.0.164:65350 (399 connections now open) 2015-10-05T07:13:14.952+0100 [mongosMain] connection accepted from 172.28.0.164:50113 #1428339 (400 connections now open) 2015-10-05T07:13:14.953+0100 [conn1428339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:15.753+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:19.820+0100 [conn1427937] end connection 172.28.0.163:55948 (399 connections now open) 2015-10-05T07:13:19.820+0100 [conn1427962] end connection 172.28.0.163:55991 (399 connections now open) 2015-10-05T07:13:19.821+0100 [mongosMain] connection accepted from 172.28.0.163:57135 #1428340 (399 connections now open) 2015-10-05T07:13:19.822+0100 [mongosMain] connection accepted from 172.28.0.163:57136 #1428341 (400 connections now open) 2015-10-05T07:13:19.822+0100 [conn1428340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:19.822+0100 [conn1428341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:20.410+0100 [conn1427888] end connection 172.28.0.164:65136 (399 connections now open) 2015-10-05T07:13:20.410+0100 [conn1427932] end connection 172.28.0.164:65266 (399 connections now open) 2015-10-05T07:13:20.411+0100 [mongosMain] connection accepted from 172.28.0.164:50121 #1428342 (399 connections now open) 2015-10-05T07:13:20.412+0100 [mongosMain] connection accepted from 172.28.0.164:50122 #1428343 (400 connections now open) 2015-10-05T07:13:20.412+0100 [conn1428342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:20.413+0100 [conn1428343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:20.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:20.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:21.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215005703b51053ecd0d5 2015-10-05T07:13:21.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:23.738+0100 [conn1427940] end connection 172.28.0.163:55951 (399 connections now open) 2015-10-05T07:13:23.739+0100 [mongosMain] connection accepted from 172.28.0.163:57141 #1428344 (400 connections now open) 2015-10-05T07:13:23.740+0100 [conn1428344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:24.283+0100 [conn1427972] end connection 172.28.0.163:56031 (399 connections now open) 2015-10-05T07:13:24.284+0100 [mongosMain] connection accepted from 172.28.0.163:57143 #1428345 (400 connections now open) 2015-10-05T07:13:24.286+0100 [conn1428345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:24.435+0100 [conn1427959] end connection 172.28.0.164:65330 (399 connections now open) 2015-10-05T07:13:24.437+0100 [mongosMain] connection accepted from 172.28.0.164:50130 #1428346 (400 connections now open) 2015-10-05T07:13:24.439+0100 [conn1428346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:24.967+0100 [conn1427978] end connection 172.28.0.164:65381 (399 connections now open) 2015-10-05T07:13:24.967+0100 [mongosMain] connection accepted from 172.28.0.164:50133 #1428347 (400 connections now open) 2015-10-05T07:13:24.969+0100 [conn1428347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:26.759+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:27.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215075703b51053ecd125 2015-10-05T07:13:27.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:28.695+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:13:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:13:29.049+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:29.049+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:29.135+0100 [mongosMain] connection accepted from 127.0.0.1:57147 #1428348 (401 connections now open) 2015-10-05T07:13:29.138+0100 [conn1428348] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:29.143+0100 [conn1428348] end connection 127.0.0.1:57147 (400 connections now open) 2015-10-05T07:13:29.826+0100 [conn1427945] end connection 172.28.0.163:55956 (399 connections now open) 2015-10-05T07:13:29.826+0100 [conn1427952] end connection 172.28.0.163:55965 (399 connections now open) 2015-10-05T07:13:29.827+0100 [mongosMain] connection accepted from 172.28.0.163:57148 #1428349 (399 connections now open) 2015-10-05T07:13:29.827+0100 [mongosMain] connection accepted from 172.28.0.163:57149 #1428350 (400 connections now open) 2015-10-05T07:13:29.828+0100 [conn1428349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:29.828+0100 [conn1428350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:30.426+0100 [conn1427974] end connection 172.28.0.164:65375 (399 connections now open) 2015-10-05T07:13:30.427+0100 [conn1427829] end connection 172.28.0.164:64918 (398 connections now open) 2015-10-05T07:13:30.428+0100 [mongosMain] connection accepted from 172.28.0.164:50143 #1428351 (399 connections now open) 2015-10-05T07:13:30.429+0100 [mongosMain] connection accepted from 172.28.0.164:50144 #1428352 (400 connections now open) 2015-10-05T07:13:30.430+0100 [conn1428352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:30.431+0100 [conn1428351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:33.752+0100 [conn1427934] end connection 172.28.0.163:55934 (399 connections now open) 2015-10-05T07:13:33.754+0100 [mongosMain] connection accepted from 172.28.0.163:57153 #1428353 (400 connections now open) 2015-10-05T07:13:33.755+0100 [conn1428353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:33.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612150d5703b51053ecd178 2015-10-05T07:13:34.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:34.298+0100 [conn1427977] end connection 172.28.0.163:56049 (399 connections now open) 2015-10-05T07:13:34.299+0100 [mongosMain] connection accepted from 172.28.0.163:57155 #1428354 (400 connections now open) 2015-10-05T07:13:34.300+0100 [conn1428354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:34.452+0100 [conn1427831] end connection 172.28.0.164:64923 (399 connections now open) 2015-10-05T07:13:34.453+0100 [mongosMain] connection accepted from 172.28.0.164:50153 #1428355 (400 connections now open) 2015-10-05T07:13:34.455+0100 [conn1428355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:34.983+0100 [conn1427985] end connection 172.28.0.164:65399 (399 connections now open) 2015-10-05T07:13:34.984+0100 [mongosMain] connection accepted from 172.28.0.164:50155 #1428356 (400 connections now open) 2015-10-05T07:13:34.986+0100 [conn1428356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:37.766+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:38.059+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:38.059+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:39.577+0100 [mongosMain] connection accepted from 127.0.0.1:57161 #1428357 (401 connections now open) 2015-10-05T07:13:39.579+0100 [conn1428357] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:39.584+0100 [conn1428357] end connection 127.0.0.1:57161 (400 connections now open) 2015-10-05T07:13:39.836+0100 [conn1427886] end connection 172.28.0.163:55787 (399 connections now open) 2015-10-05T07:13:39.836+0100 [conn1427953] end connection 172.28.0.163:55967 (399 connections now open) 2015-10-05T07:13:39.838+0100 [mongosMain] connection accepted from 172.28.0.163:57162 #1428358 (399 connections now open) 2015-10-05T07:13:39.838+0100 [mongosMain] connection accepted from 172.28.0.163:57163 #1428359 (400 connections now open) 2015-10-05T07:13:39.839+0100 [conn1428358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:39.839+0100 [conn1428359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:40.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215145703b51053ecd1bd 2015-10-05T07:13:40.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:40.426+0100 [conn1427969] end connection 172.28.0.164:65355 (399 connections now open) 2015-10-05T07:13:40.426+0100 [conn1427913] end connection 172.28.0.164:65209 (399 connections now open) 2015-10-05T07:13:40.427+0100 [mongosMain] connection accepted from 172.28.0.164:50168 #1428360 (399 connections now open) 2015-10-05T07:13:40.427+0100 [mongosMain] connection accepted from 172.28.0.164:50166 #1428361 (400 connections now open) 2015-10-05T07:13:40.428+0100 [conn1428360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:40.428+0100 [conn1428361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:43.753+0100 [conn1427948] end connection 172.28.0.163:55959 (399 connections now open) 2015-10-05T07:13:43.754+0100 [mongosMain] connection accepted from 172.28.0.163:57171 #1428362 (400 connections now open) 2015-10-05T07:13:43.755+0100 [conn1428362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:44.299+0100 [conn1427984] end connection 172.28.0.163:56065 (399 connections now open) 2015-10-05T07:13:44.300+0100 [mongosMain] connection accepted from 172.28.0.163:57173 #1428363 (400 connections now open) 2015-10-05T07:13:44.301+0100 [conn1428363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:44.468+0100 [conn1427928] end connection 172.28.0.164:65258 (399 connections now open) 2015-10-05T07:13:44.469+0100 [mongosMain] connection accepted from 172.28.0.164:50176 #1428364 (400 connections now open) 2015-10-05T07:13:44.470+0100 [conn1428364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:44.997+0100 [conn1427993] end connection 172.28.0.164:65418 (399 connections now open) 2015-10-05T07:13:44.998+0100 [mongosMain] connection accepted from 172.28.0.164:50178 #1428365 (400 connections now open) 2015-10-05T07:13:44.999+0100 [conn1428365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:46.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612151a5703b51053ecd213 2015-10-05T07:13:46.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:48.134+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:48.134+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:48.766+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:49.837+0100 [conn1427930] end connection 172.28.0.163:55925 (399 connections now open) 2015-10-05T07:13:49.837+0100 [conn1427968] end connection 172.28.0.163:56013 (399 connections now open) 2015-10-05T07:13:49.838+0100 [mongosMain] connection accepted from 172.28.0.163:57185 #1428366 (399 connections now open) 2015-10-05T07:13:49.838+0100 [mongosMain] connection accepted from 172.28.0.163:57186 #1428367 (400 connections now open) 2015-10-05T07:13:49.839+0100 [conn1428366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:49.839+0100 [conn1428367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:50.442+0100 [conn1427899] end connection 172.28.0.164:65166 (399 connections now open) 2015-10-05T07:13:50.442+0100 [conn1427946] end connection 172.28.0.164:65300 (399 connections now open) 2015-10-05T07:13:50.443+0100 [mongosMain] connection accepted from 172.28.0.164:50186 #1428368 (399 connections now open) 2015-10-05T07:13:50.444+0100 [mongosMain] connection accepted from 172.28.0.164:50187 #1428369 (400 connections now open) 2015-10-05T07:13:50.445+0100 [conn1428368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:50.445+0100 [conn1428369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:52.792+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215205703b51053ecd268 2015-10-05T07:13:52.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:53.768+0100 [conn1427975] end connection 172.28.0.163:56046 (399 connections now open) 2015-10-05T07:13:53.769+0100 [mongosMain] connection accepted from 172.28.0.163:57194 #1428370 (400 connections now open) 2015-10-05T07:13:53.771+0100 [conn1428370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:54.314+0100 [conn1427992] end connection 172.28.0.163:56075 (399 connections now open) 2015-10-05T07:13:54.316+0100 [mongosMain] connection accepted from 172.28.0.163:57196 #1428371 (400 connections now open) 2015-10-05T07:13:54.317+0100 [conn1428371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:54.483+0100 [conn1427883] end connection 172.28.0.164:65128 (399 connections now open) 2015-10-05T07:13:54.484+0100 [mongosMain] connection accepted from 172.28.0.164:50195 #1428372 (400 connections now open) 2015-10-05T07:13:54.487+0100 [conn1428372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:55.013+0100 [conn1428000] end connection 172.28.0.164:65438 (399 connections now open) 2015-10-05T07:13:55.020+0100 [mongosMain] connection accepted from 172.28.0.164:50198 #1428373 (400 connections now open) 2015-10-05T07:13:55.022+0100 [conn1428373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:58.835+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:13:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:13:59.011+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215265703b51053ecd2af 2015-10-05T07:13:59.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:13:59.143+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:59.143+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:13:59.769+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:13:59.863+0100 [conn1427931] end connection 172.28.0.163:55926 (399 connections now open) 2015-10-05T07:13:59.863+0100 [conn1427812] end connection 172.28.0.163:55532 (399 connections now open) 2015-10-05T07:13:59.864+0100 [mongosMain] connection accepted from 172.28.0.163:57208 #1428374 (399 connections now open) 2015-10-05T07:13:59.864+0100 [mongosMain] connection accepted from 172.28.0.163:57209 #1428375 (400 connections now open) 2015-10-05T07:13:59.865+0100 [conn1428374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:13:59.865+0100 [conn1428375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:00.443+0100 [conn1427989] end connection 172.28.0.164:65407 (399 connections now open) 2015-10-05T07:14:00.444+0100 [mongosMain] connection accepted from 172.28.0.164:50202 #1428376 (400 connections now open) 2015-10-05T07:14:00.444+0100 [conn1427840] end connection 172.28.0.164:64946 (398 connections now open) 2015-10-05T07:14:00.445+0100 [mongosMain] connection accepted from 172.28.0.164:50203 #1428377 (400 connections now open) 2015-10-05T07:14:00.446+0100 [conn1428376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:00.447+0100 [conn1428377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:03.784+0100 [conn1427970] end connection 172.28.0.163:56029 (399 connections now open) 2015-10-05T07:14:03.785+0100 [mongosMain] connection accepted from 172.28.0.163:57227 #1428378 (400 connections now open) 2015-10-05T07:14:03.786+0100 [conn1428378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:04.330+0100 [conn1428006] end connection 172.28.0.163:56110 (399 connections now open) 2015-10-05T07:14:04.332+0100 [mongosMain] connection accepted from 172.28.0.163:57230 #1428379 (400 connections now open) 2015-10-05T07:14:04.333+0100 [conn1428379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:04.498+0100 [conn1427965] end connection 172.28.0.164:65347 (399 connections now open) 2015-10-05T07:14:04.500+0100 [mongosMain] connection accepted from 172.28.0.164:50213 #1428380 (400 connections now open) 2015-10-05T07:14:04.502+0100 [conn1428380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:05.029+0100 [conn1428007] end connection 172.28.0.164:65457 (399 connections now open) 2015-10-05T07:14:05.030+0100 [mongosMain] connection accepted from 172.28.0.164:50215 #1428381 (400 connections now open) 2015-10-05T07:14:05.032+0100 [conn1428381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:05.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612152d5703b51053ecd32c 2015-10-05T07:14:05.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:09.868+0100 [conn1427893] end connection 172.28.0.163:55813 (399 connections now open) 2015-10-05T07:14:09.868+0100 [conn1427774] end connection 172.28.0.163:55436 (399 connections now open) 2015-10-05T07:14:09.869+0100 [mongosMain] connection accepted from 172.28.0.163:57239 #1428382 (399 connections now open) 2015-10-05T07:14:09.869+0100 [mongosMain] connection accepted from 172.28.0.163:57240 #1428383 (400 connections now open) 2015-10-05T07:14:09.870+0100 [conn1428382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:09.870+0100 [conn1428383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:10.458+0100 [conn1427939] end connection 172.28.0.164:65280 (399 connections now open) 2015-10-05T07:14:10.460+0100 [mongosMain] connection accepted from 172.28.0.164:50220 #1428384 (400 connections now open) 2015-10-05T07:14:10.462+0100 [conn1428384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:10.779+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:11.152+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:11.152+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:11.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215335703b51053ecd390 2015-10-05T07:14:11.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:13.170+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:13.170+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:13.784+0100 [conn1427957] end connection 172.28.0.163:55975 (399 connections now open) 2015-10-05T07:14:13.785+0100 [mongosMain] connection accepted from 172.28.0.163:57250 #1428385 (400 connections now open) 2015-10-05T07:14:13.786+0100 [conn1428385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:14.330+0100 [conn1428012] end connection 172.28.0.163:56143 (399 connections now open) 2015-10-05T07:14:14.331+0100 [mongosMain] connection accepted from 172.28.0.163:57251 #1428386 (400 connections now open) 2015-10-05T07:14:14.333+0100 [conn1428386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:14.514+0100 [conn1427971] end connection 172.28.0.164:65371 (399 connections now open) 2015-10-05T07:14:14.516+0100 [mongosMain] connection accepted from 172.28.0.164:50222 #1428387 (400 connections now open) 2015-10-05T07:14:14.518+0100 [conn1428387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:15.044+0100 [conn1428013] end connection 172.28.0.164:65475 (399 connections now open) 2015-10-05T07:14:15.045+0100 [mongosMain] connection accepted from 172.28.0.164:50225 #1428388 (400 connections now open) 2015-10-05T07:14:15.046+0100 [conn1428388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:16.214+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:16.214+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:18.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215395703b51053ecd3fa 2015-10-05T07:14:18.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:19.868+0100 [conn1427979] end connection 172.28.0.163:56057 (399 connections now open) 2015-10-05T07:14:19.868+0100 [conn1427860] end connection 172.28.0.163:55666 (399 connections now open) 2015-10-05T07:14:19.869+0100 [mongosMain] connection accepted from 172.28.0.163:57258 #1428389 (399 connections now open) 2015-10-05T07:14:19.870+0100 [mongosMain] connection accepted from 172.28.0.163:57259 #1428390 (400 connections now open) 2015-10-05T07:14:19.870+0100 [conn1428389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:19.871+0100 [conn1428390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:20.223+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:20.223+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:21.782+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:23.798+0100 [conn1427964] end connection 172.28.0.163:55997 (399 connections now open) 2015-10-05T07:14:23.799+0100 [mongosMain] connection accepted from 172.28.0.163:57264 #1428391 (400 connections now open) 2015-10-05T07:14:23.800+0100 [conn1428391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:24.345+0100 [conn1428019] end connection 172.28.0.163:56165 (399 connections now open) 2015-10-05T07:14:24.346+0100 [mongosMain] connection accepted from 172.28.0.163:57267 #1428392 (400 connections now open) 2015-10-05T07:14:24.347+0100 [conn1428392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:24.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215405703b51053ecd435 2015-10-05T07:14:24.531+0100 [conn1427942] end connection 172.28.0.164:65287 (399 connections now open) 2015-10-05T07:14:24.532+0100 [mongosMain] connection accepted from 172.28.0.164:50271 #1428393 (400 connections now open) 2015-10-05T07:14:24.534+0100 [conn1428393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:24.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:25.061+0100 [conn1428020] end connection 172.28.0.164:65486 (399 connections now open) 2015-10-05T07:14:25.063+0100 [mongosMain] connection accepted from 172.28.0.164:50275 #1428394 (400 connections now open) 2015-10-05T07:14:25.064+0100 [conn1428394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:25.244+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:25.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:28.300+0100 [mongosMain] connection accepted from 127.0.0.1:57269 #1428395 (401 connections now open) 2015-10-05T07:14:28.303+0100 [conn1428395] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:28.309+0100 [conn1428395] end connection 127.0.0.1:57269 (400 connections now open) 2015-10-05T07:14:28.976+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:14:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:14:29.883+0100 [conn1427682] end connection 172.28.0.163:55208 (399 connections now open) 2015-10-05T07:14:29.883+0100 [conn1427988] end connection 172.28.0.163:56069 (399 connections now open) 2015-10-05T07:14:29.884+0100 [mongosMain] connection accepted from 172.28.0.163:57270 #1428396 (399 connections now open) 2015-10-05T07:14:29.884+0100 [mongosMain] connection accepted from 172.28.0.163:57271 #1428397 (400 connections now open) 2015-10-05T07:14:29.885+0100 [conn1428396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:29.885+0100 [conn1428397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:30.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215465703b51053ecd456 2015-10-05T07:14:30.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:31.331+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:31.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:32.884+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:33.805+0100 [conn1427990] end connection 172.28.0.163:56073 (399 connections now open) 2015-10-05T07:14:33.806+0100 [mongosMain] connection accepted from 172.28.0.163:57278 #1428398 (400 connections now open) 2015-10-05T07:14:33.808+0100 [conn1428398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:34.351+0100 [conn1428024] end connection 172.28.0.163:56179 (399 connections now open) 2015-10-05T07:14:34.352+0100 [mongosMain] connection accepted from 172.28.0.163:57279 #1428399 (400 connections now open) 2015-10-05T07:14:34.353+0100 [conn1428399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:34.530+0100 [conn1427999] end connection 172.28.0.164:65436 (399 connections now open) 2015-10-05T07:14:34.531+0100 [mongosMain] connection accepted from 172.28.0.164:50304 #1428400 (400 connections now open) 2015-10-05T07:14:34.535+0100 [conn1428400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:35.076+0100 [conn1428026] end connection 172.28.0.164:65504 (399 connections now open) 2015-10-05T07:14:35.079+0100 [mongosMain] connection accepted from 172.28.0.164:50306 #1428401 (400 connections now open) 2015-10-05T07:14:35.080+0100 [conn1428401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:36.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612154c5703b51053ecd485 2015-10-05T07:14:37.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:38.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:38.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:39.804+0100 [mongosMain] connection accepted from 127.0.0.1:57284 #1428402 (401 connections now open) 2015-10-05T07:14:39.806+0100 [conn1428402] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:39.811+0100 [conn1428402] end connection 127.0.0.1:57284 (400 connections now open) 2015-10-05T07:14:39.884+0100 [conn1427961] end connection 172.28.0.163:55990 (399 connections now open) 2015-10-05T07:14:39.884+0100 [conn1427905] end connection 172.28.0.163:55844 (399 connections now open) 2015-10-05T07:14:39.885+0100 [mongosMain] connection accepted from 172.28.0.163:57285 #1428403 (399 connections now open) 2015-10-05T07:14:39.885+0100 [mongosMain] connection accepted from 172.28.0.163:57286 #1428404 (400 connections now open) 2015-10-05T07:14:39.886+0100 [conn1428403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:39.887+0100 [conn1428404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:40.508+0100 [conn1427871] end connection 172.28.0.164:65080 (399 connections now open) 2015-10-05T07:14:40.510+0100 [mongosMain] connection accepted from 172.28.0.164:50330 #1428405 (400 connections now open) 2015-10-05T07:14:40.511+0100 [conn1428405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:43.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215535703b51053ecd4b2 2015-10-05T07:14:43.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:43.815+0100 [conn1427998] end connection 172.28.0.163:56090 (399 connections now open) 2015-10-05T07:14:43.816+0100 [mongosMain] connection accepted from 172.28.0.163:57293 #1428406 (400 connections now open) 2015-10-05T07:14:43.817+0100 [conn1428406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:43.893+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:44.363+0100 [conn1428031] end connection 172.28.0.163:56189 (399 connections now open) 2015-10-05T07:14:44.364+0100 [mongosMain] connection accepted from 172.28.0.163:57296 #1428407 (400 connections now open) 2015-10-05T07:14:44.365+0100 [conn1428407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:44.546+0100 [conn1428011] end connection 172.28.0.164:65473 (399 connections now open) 2015-10-05T07:14:44.547+0100 [mongosMain] connection accepted from 172.28.0.164:50342 #1428408 (400 connections now open) 2015-10-05T07:14:44.549+0100 [conn1428408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:45.077+0100 [conn1428032] end connection 172.28.0.164:65527 (399 connections now open) 2015-10-05T07:14:45.078+0100 [mongosMain] connection accepted from 172.28.0.164:50346 #1428409 (400 connections now open) 2015-10-05T07:14:45.080+0100 [conn1428409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:46.339+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:46.339+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:49.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215595703b51053ecd4ee 2015-10-05T07:14:49.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:49.899+0100 [conn1427995] end connection 172.28.0.163:56081 (399 connections now open) 2015-10-05T07:14:49.899+0100 [conn1428021] end connection 172.28.0.163:56172 (399 connections now open) 2015-10-05T07:14:49.900+0100 [mongosMain] connection accepted from 172.28.0.163:57304 #1428410 (399 connections now open) 2015-10-05T07:14:49.900+0100 [mongosMain] connection accepted from 172.28.0.163:57305 #1428411 (400 connections now open) 2015-10-05T07:14:49.901+0100 [conn1428410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:49.901+0100 [conn1428411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:50.521+0100 [conn1427822] end connection 172.28.0.164:64897 (399 connections now open) 2015-10-05T07:14:50.522+0100 [mongosMain] connection accepted from 172.28.0.164:50374 #1428412 (400 connections now open) 2015-10-05T07:14:50.523+0100 [conn1428412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:53.817+0100 [conn1428010] end connection 172.28.0.163:56141 (399 connections now open) 2015-10-05T07:14:53.818+0100 [mongosMain] connection accepted from 172.28.0.163:57311 #1428413 (400 connections now open) 2015-10-05T07:14:53.819+0100 [conn1428413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:54.363+0100 [conn1428039] end connection 172.28.0.163:56204 (399 connections now open) 2015-10-05T07:14:54.364+0100 [mongosMain] connection accepted from 172.28.0.163:57315 #1428414 (400 connections now open) 2015-10-05T07:14:54.365+0100 [conn1428414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:54.562+0100 [conn1427991] end connection 172.28.0.164:65414 (399 connections now open) 2015-10-05T07:14:54.563+0100 [mongosMain] connection accepted from 172.28.0.164:50398 #1428415 (400 connections now open) 2015-10-05T07:14:54.564+0100 [conn1428415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:54.902+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:55.092+0100 [conn1428040] end connection 172.28.0.164:49169 (399 connections now open) 2015-10-05T07:14:55.093+0100 [mongosMain] connection accepted from 172.28.0.164:50402 #1428416 (400 connections now open) 2015-10-05T07:14:55.095+0100 [conn1428416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:55.341+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:14:55.342+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:14:57.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612155f5703b51053ecd527 2015-10-05T07:14:57.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:14:59.133+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:14:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:14:59.901+0100 [conn1428002] end connection 172.28.0.163:56100 (399 connections now open) 2015-10-05T07:14:59.901+0100 [conn1427783] end connection 172.28.0.163:55457 (399 connections now open) 2015-10-05T07:14:59.902+0100 [mongosMain] connection accepted from 172.28.0.163:57325 #1428417 (399 connections now open) 2015-10-05T07:14:59.902+0100 [mongosMain] connection accepted from 172.28.0.163:57326 #1428418 (400 connections now open) 2015-10-05T07:14:59.903+0100 [conn1428417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:14:59.903+0100 [conn1428418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:00.537+0100 [conn1427933] end connection 172.28.0.164:65267 (399 connections now open) 2015-10-05T07:15:00.537+0100 [mongosMain] connection accepted from 172.28.0.164:50423 #1428419 (400 connections now open) 2015-10-05T07:15:00.553+0100 [conn1428419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:03.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215675703b51053ecd560 2015-10-05T07:15:03.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:03.860+0100 [conn1427982] end connection 172.28.0.163:56063 (399 connections now open) 2015-10-05T07:15:03.860+0100 [mongosMain] connection accepted from 172.28.0.163:57343 #1428420 (400 connections now open) 2015-10-05T07:15:03.860+0100 [conn1428420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:04.406+0100 [conn1428045] end connection 172.28.0.163:56220 (399 connections now open) 2015-10-05T07:15:04.406+0100 [mongosMain] connection accepted from 172.28.0.163:57347 #1428421 (400 connections now open) 2015-10-05T07:15:04.406+0100 [conn1428421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:04.578+0100 [conn1427983] end connection 172.28.0.164:65396 (399 connections now open) 2015-10-05T07:15:04.579+0100 [mongosMain] connection accepted from 172.28.0.164:50460 #1428422 (400 connections now open) 2015-10-05T07:15:04.581+0100 [conn1428422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:05.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:05.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:05.958+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:09.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612156d5703b51053ecd5af 2015-10-05T07:15:09.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:09.915+0100 [conn1427832] end connection 172.28.0.163:55591 (399 connections now open) 2015-10-05T07:15:09.916+0100 [mongosMain] connection accepted from 172.28.0.163:57357 #1428423 (400 connections now open) 2015-10-05T07:15:09.917+0100 [conn1428423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:10.537+0100 [conn1428034] end connection 172.28.0.164:49159 (399 connections now open) 2015-10-05T07:15:10.538+0100 [conn1427861] end connection 172.28.0.164:65016 (398 connections now open) 2015-10-05T07:15:10.538+0100 [mongosMain] connection accepted from 172.28.0.164:50466 #1428424 (399 connections now open) 2015-10-05T07:15:10.539+0100 [mongosMain] connection accepted from 172.28.0.164:50467 #1428425 (400 connections now open) 2015-10-05T07:15:10.540+0100 [conn1428424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:10.541+0100 [conn1428425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:14.594+0100 [conn1428005] end connection 172.28.0.164:65454 (399 connections now open) 2015-10-05T07:15:14.595+0100 [mongosMain] connection accepted from 172.28.0.164:50473 #1428426 (400 connections now open) 2015-10-05T07:15:14.597+0100 [conn1428426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:15.124+0100 [conn1428046] end connection 172.28.0.164:49211 (399 connections now open) 2015-10-05T07:15:15.125+0100 [mongosMain] connection accepted from 172.28.0.164:50477 #1428427 (400 connections now open) 2015-10-05T07:15:15.128+0100 [conn1428427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:15.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215735703b51053ecd619 2015-10-05T07:15:15.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:16.415+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:16.415+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:16.968+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:19.916+0100 [conn1427994] end connection 172.28.0.163:56080 (399 connections now open) 2015-10-05T07:15:19.916+0100 [conn1428015] end connection 172.28.0.163:56156 (399 connections now open) 2015-10-05T07:15:19.917+0100 [mongosMain] connection accepted from 172.28.0.163:57370 #1428428 (399 connections now open) 2015-10-05T07:15:19.917+0100 [mongosMain] connection accepted from 172.28.0.163:57371 #1428429 (400 connections now open) 2015-10-05T07:15:19.918+0100 [conn1428428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:19.918+0100 [conn1428429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:20.552+0100 [conn1428003] end connection 172.28.0.164:65449 (399 connections now open) 2015-10-05T07:15:20.553+0100 [conn1428023] end connection 172.28.0.164:65496 (398 connections now open) 2015-10-05T07:15:20.555+0100 [mongosMain] connection accepted from 172.28.0.164:50494 #1428430 (399 connections now open) 2015-10-05T07:15:20.556+0100 [mongosMain] connection accepted from 172.28.0.164:50504 #1428431 (400 connections now open) 2015-10-05T07:15:20.556+0100 [conn1428430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:20.557+0100 [conn1428431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:22.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215795703b51053ecd680 2015-10-05T07:15:22.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:24.393+0100 [conn1428050] end connection 172.28.0.163:56247 (399 connections now open) 2015-10-05T07:15:24.394+0100 [mongosMain] connection accepted from 172.28.0.163:57376 #1428432 (400 connections now open) 2015-10-05T07:15:24.395+0100 [conn1428432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:24.593+0100 [conn1427976] end connection 172.28.0.164:65379 (399 connections now open) 2015-10-05T07:15:24.595+0100 [mongosMain] connection accepted from 172.28.0.164:50510 #1428433 (400 connections now open) 2015-10-05T07:15:24.597+0100 [conn1428433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:25.124+0100 [conn1428059] end connection 172.28.0.164:49243 (399 connections now open) 2015-10-05T07:15:25.125+0100 [mongosMain] connection accepted from 172.28.0.164:50514 #1428434 (400 connections now open) 2015-10-05T07:15:25.126+0100 [conn1428434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:27.978+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:28.212+0100 [mongosMain] connection accepted from 127.0.0.1:57380 #1428435 (401 connections now open) 2015-10-05T07:15:28.215+0100 [conn1428435] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:28.221+0100 [conn1428435] end connection 127.0.0.1:57380 (400 connections now open) 2015-10-05T07:15:28.418+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:28.418+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:29.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215805703b51053ecd6fa 2015-10-05T07:15:29.532+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:15:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:15:29.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:29.933+0100 [conn1428022] end connection 172.28.0.163:56173 (399 connections now open) 2015-10-05T07:15:29.933+0100 [conn1428054] end connection 172.28.0.163:56258 (398 connections now open) 2015-10-05T07:15:29.934+0100 [mongosMain] connection accepted from 172.28.0.163:57382 #1428436 (399 connections now open) 2015-10-05T07:15:29.934+0100 [mongosMain] connection accepted from 172.28.0.163:57383 #1428437 (400 connections now open) 2015-10-05T07:15:29.935+0100 [conn1428436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:29.935+0100 [conn1428437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:30.435+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:30.435+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:30.569+0100 [conn1428029] end connection 172.28.0.164:65514 (399 connections now open) 2015-10-05T07:15:30.569+0100 [conn1427756] end connection 172.28.0.164:64724 (399 connections now open) 2015-10-05T07:15:30.571+0100 [mongosMain] connection accepted from 172.28.0.164:50548 #1428438 (399 connections now open) 2015-10-05T07:15:30.571+0100 [mongosMain] connection accepted from 172.28.0.164:50549 #1428439 (400 connections now open) 2015-10-05T07:15:30.573+0100 [conn1428439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:30.573+0100 [conn1428438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:33.432+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:33.432+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:34.408+0100 [conn1428064] end connection 172.28.0.163:56281 (399 connections now open) 2015-10-05T07:15:34.409+0100 [mongosMain] connection accepted from 172.28.0.163:57388 #1428440 (400 connections now open) 2015-10-05T07:15:34.410+0100 [conn1428440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:34.610+0100 [conn1428025] end connection 172.28.0.164:65502 (399 connections now open) 2015-10-05T07:15:34.611+0100 [mongosMain] connection accepted from 172.28.0.164:50557 #1428441 (400 connections now open) 2015-10-05T07:15:34.613+0100 [conn1428441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:35.140+0100 [conn1428052] end connection 172.28.0.164:49229 (399 connections now open) 2015-10-05T07:15:35.141+0100 [mongosMain] connection accepted from 172.28.0.164:50560 #1428442 (400 connections now open) 2015-10-05T07:15:35.143+0100 [conn1428442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:35.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215875703b51053ecd751 2015-10-05T07:15:36.066+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:37.437+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:37.437+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:38.989+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:39.752+0100 [mongosMain] connection accepted from 127.0.0.1:57396 #1428443 (401 connections now open) 2015-10-05T07:15:39.755+0100 [conn1428443] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:39.760+0100 [conn1428443] end connection 127.0.0.1:57396 (400 connections now open) 2015-10-05T07:15:39.946+0100 [conn1428014] end connection 172.28.0.163:56153 (399 connections now open) 2015-10-05T07:15:39.946+0100 [conn1427980] end connection 172.28.0.163:56059 (399 connections now open) 2015-10-05T07:15:39.947+0100 [mongosMain] connection accepted from 172.28.0.163:57397 #1428444 (399 connections now open) 2015-10-05T07:15:39.947+0100 [mongosMain] connection accepted from 172.28.0.163:57398 #1428445 (400 connections now open) 2015-10-05T07:15:39.948+0100 [conn1428444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:39.948+0100 [conn1428445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:40.584+0100 [conn1427981] end connection 172.28.0.164:65389 (399 connections now open) 2015-10-05T07:15:40.585+0100 [conn1428049] end connection 172.28.0.164:49214 (398 connections now open) 2015-10-05T07:15:40.586+0100 [mongosMain] connection accepted from 172.28.0.164:50571 #1428446 (399 connections now open) 2015-10-05T07:15:40.586+0100 [mongosMain] connection accepted from 172.28.0.164:50585 #1428447 (400 connections now open) 2015-10-05T07:15:40.587+0100 [conn1428447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:40.587+0100 [conn1428446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:42.437+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:42.437+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:44.412+0100 [conn1428072] end connection 172.28.0.163:56299 (399 connections now open) 2015-10-05T07:15:44.413+0100 [mongosMain] connection accepted from 172.28.0.163:57407 #1428448 (400 connections now open) 2015-10-05T07:15:44.414+0100 [conn1428448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:44.609+0100 [conn1428030] end connection 172.28.0.164:65525 (399 connections now open) 2015-10-05T07:15:44.610+0100 [mongosMain] connection accepted from 172.28.0.164:50612 #1428449 (400 connections now open) 2015-10-05T07:15:44.614+0100 [conn1428449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:45.139+0100 [conn1428066] end connection 172.28.0.164:49272 (399 connections now open) 2015-10-05T07:15:45.140+0100 [mongosMain] connection accepted from 172.28.0.164:50631 #1428450 (400 connections now open) 2015-10-05T07:15:45.142+0100 [conn1428450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:48.218+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:15:48.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:15:48.438+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:48.438+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:49.946+0100 [conn1428009] end connection 172.28.0.163:56122 (399 connections now open) 2015-10-05T07:15:49.946+0100 [conn1428033] end connection 172.28.0.163:56194 (399 connections now open) 2015-10-05T07:15:49.948+0100 [mongosMain] connection accepted from 172.28.0.163:57416 #1428451 (399 connections now open) 2015-10-05T07:15:49.948+0100 [mongosMain] connection accepted from 172.28.0.163:57417 #1428452 (400 connections now open) 2015-10-05T07:15:49.949+0100 [conn1428451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:49.949+0100 [conn1428452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:50.081+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:50.599+0100 [conn1427996] end connection 172.28.0.164:65429 (399 connections now open) 2015-10-05T07:15:50.600+0100 [conn1428042] end connection 172.28.0.164:49186 (398 connections now open) 2015-10-05T07:15:50.602+0100 [mongosMain] connection accepted from 172.28.0.164:50658 #1428453 (399 connections now open) 2015-10-05T07:15:50.603+0100 [mongosMain] connection accepted from 172.28.0.164:50657 #1428454 (400 connections now open) 2015-10-05T07:15:50.604+0100 [conn1428453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:50.604+0100 [conn1428454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:53.878+0100 [conn1428037] end connection 172.28.0.163:56202 (399 connections now open) 2015-10-05T07:15:53.878+0100 [mongosMain] connection accepted from 172.28.0.163:57424 #1428455 (400 connections now open) 2015-10-05T07:15:53.879+0100 [conn1428455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:54.424+0100 [conn1428080] end connection 172.28.0.163:56313 (399 connections now open) 2015-10-05T07:15:54.425+0100 [mongosMain] connection accepted from 172.28.0.163:57426 #1428456 (400 connections now open) 2015-10-05T07:15:54.426+0100 [conn1428456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:54.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612159a5703b51053ecd84b 2015-10-05T07:15:54.626+0100 [conn1428044] end connection 172.28.0.164:49209 (399 connections now open) 2015-10-05T07:15:54.627+0100 [mongosMain] connection accepted from 172.28.0.164:50666 #1428457 (400 connections now open) 2015-10-05T07:15:54.629+0100 [conn1428457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:54.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:15:55.155+0100 [conn1428074] end connection 172.28.0.164:49291 (399 connections now open) 2015-10-05T07:15:55.156+0100 [mongosMain] connection accepted from 172.28.0.164:50670 #1428458 (400 connections now open) 2015-10-05T07:15:55.159+0100 [conn1428458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:55.446+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:15:55.447+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:15:59.816+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:15:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:15:59.963+0100 [conn1427855] end connection 172.28.0.163:55651 (399 connections now open) 2015-10-05T07:15:59.963+0100 [conn1428048] end connection 172.28.0.163:56232 (399 connections now open) 2015-10-05T07:15:59.964+0100 [mongosMain] connection accepted from 172.28.0.163:57436 #1428459 (399 connections now open) 2015-10-05T07:15:59.964+0100 [mongosMain] connection accepted from 172.28.0.163:57438 #1428460 (400 connections now open) 2015-10-05T07:15:59.965+0100 [conn1428459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:15:59.965+0100 [conn1428460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:00.599+0100 [conn1428016] end connection 172.28.0.164:65482 (399 connections now open) 2015-10-05T07:16:00.599+0100 [conn1428070] end connection 172.28.0.164:49282 (398 connections now open) 2015-10-05T07:16:00.599+0100 [mongosMain] connection accepted from 172.28.0.164:50676 #1428461 (399 connections now open) 2015-10-05T07:16:00.600+0100 [mongosMain] connection accepted from 172.28.0.164:50678 #1428462 (400 connections now open) 2015-10-05T07:16:00.600+0100 [conn1428461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:00.601+0100 [conn1428462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:01.096+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:03.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:03.449+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:04.425+0100 [conn1428087] end connection 172.28.0.163:56331 (399 connections now open) 2015-10-05T07:16:04.427+0100 [mongosMain] connection accepted from 172.28.0.163:57457 #1428463 (400 connections now open) 2015-10-05T07:16:04.428+0100 [conn1428463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:04.640+0100 [conn1428038] end connection 172.28.0.164:49168 (399 connections now open) 2015-10-05T07:16:04.641+0100 [mongosMain] connection accepted from 172.28.0.164:50684 #1428464 (400 connections now open) 2015-10-05T07:16:04.642+0100 [conn1428464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:05.171+0100 [conn1428082] end connection 172.28.0.164:49317 (399 connections now open) 2015-10-05T07:16:05.172+0100 [mongosMain] connection accepted from 172.28.0.164:50686 #1428465 (400 connections now open) 2015-10-05T07:16:05.174+0100 [conn1428465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:09.962+0100 [conn1427973] end connection 172.28.0.163:56041 (399 connections now open) 2015-10-05T07:16:09.962+0100 [conn1428076] end connection 172.28.0.163:56305 (399 connections now open) 2015-10-05T07:16:09.963+0100 [mongosMain] connection accepted from 172.28.0.163:57464 #1428466 (399 connections now open) 2015-10-05T07:16:09.964+0100 [mongosMain] connection accepted from 172.28.0.163:57465 #1428467 (400 connections now open) 2015-10-05T07:16:09.965+0100 [conn1428466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:09.965+0100 [conn1428467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:10.615+0100 [conn1428063] end connection 172.28.0.164:49255 (399 connections now open) 2015-10-05T07:16:10.616+0100 [mongosMain] connection accepted from 172.28.0.164:50691 #1428468 (400 connections now open) 2015-10-05T07:16:10.618+0100 [conn1428468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:12.121+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:12.493+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:12.494+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:13.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215ac5703b51053ecd921 2015-10-05T07:16:13.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:13.894+0100 [conn1428004] end connection 172.28.0.163:56109 (399 connections now open) 2015-10-05T07:16:13.895+0100 [mongosMain] connection accepted from 172.28.0.163:57472 #1428469 (400 connections now open) 2015-10-05T07:16:13.896+0100 [conn1428469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:14.440+0100 [conn1428094] end connection 172.28.0.163:56362 (399 connections now open) 2015-10-05T07:16:14.442+0100 [mongosMain] connection accepted from 172.28.0.163:57475 #1428470 (400 connections now open) 2015-10-05T07:16:14.443+0100 [conn1428470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:14.656+0100 [conn1428051] end connection 172.28.0.164:49227 (399 connections now open) 2015-10-05T07:16:14.657+0100 [mongosMain] connection accepted from 172.28.0.164:50694 #1428471 (400 connections now open) 2015-10-05T07:16:14.659+0100 [conn1428471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:15.186+0100 [conn1428089] end connection 172.28.0.164:49335 (399 connections now open) 2015-10-05T07:16:15.188+0100 [mongosMain] connection accepted from 172.28.0.164:50726 #1428472 (400 connections now open) 2015-10-05T07:16:15.189+0100 [conn1428472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:19.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215b35703b51053ecd96c 2015-10-05T07:16:19.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:19.978+0100 [conn1428069] end connection 172.28.0.163:56291 (399 connections now open) 2015-10-05T07:16:19.978+0100 [conn1427848] end connection 172.28.0.163:55633 (399 connections now open) 2015-10-05T07:16:19.979+0100 [mongosMain] connection accepted from 172.28.0.163:57480 #1428473 (399 connections now open) 2015-10-05T07:16:19.979+0100 [mongosMain] connection accepted from 172.28.0.163:57481 #1428474 (400 connections now open) 2015-10-05T07:16:19.980+0100 [conn1428473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:19.980+0100 [conn1428474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:20.630+0100 [conn1427947] end connection 172.28.0.164:65301 (399 connections now open) 2015-10-05T07:16:20.631+0100 [conn1428071] end connection 172.28.0.164:49283 (398 connections now open) 2015-10-05T07:16:20.631+0100 [mongosMain] connection accepted from 172.28.0.164:50745 #1428475 (399 connections now open) 2015-10-05T07:16:20.633+0100 [mongosMain] connection accepted from 172.28.0.164:50746 #1428476 (400 connections now open) 2015-10-05T07:16:20.634+0100 [conn1428475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:20.634+0100 [conn1428476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:22.502+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:22.502+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:23.132+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:24.442+0100 [conn1428101] end connection 172.28.0.163:56379 (399 connections now open) 2015-10-05T07:16:24.443+0100 [mongosMain] connection accepted from 172.28.0.163:57488 #1428477 (400 connections now open) 2015-10-05T07:16:24.444+0100 [conn1428477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:24.658+0100 [conn1428058] end connection 172.28.0.164:49241 (399 connections now open) 2015-10-05T07:16:24.660+0100 [mongosMain] connection accepted from 172.28.0.164:50752 #1428478 (400 connections now open) 2015-10-05T07:16:24.661+0100 [conn1428478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:25.203+0100 [conn1428096] end connection 172.28.0.164:49354 (399 connections now open) 2015-10-05T07:16:25.204+0100 [mongosMain] connection accepted from 172.28.0.164:50755 #1428479 (400 connections now open) 2015-10-05T07:16:25.205+0100 [conn1428479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:25.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215b95703b51053ecd9b3 2015-10-05T07:16:25.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:28.487+0100 [mongosMain] connection accepted from 127.0.0.1:57491 #1428480 (401 connections now open) 2015-10-05T07:16:28.490+0100 [conn1428480] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:28.495+0100 [conn1428480] end connection 127.0.0.1:57491 (400 connections now open) 2015-10-05T07:16:29.978+0100 [conn1428028] end connection 172.28.0.163:56184 (399 connections now open) 2015-10-05T07:16:29.978+0100 [conn1428084] end connection 172.28.0.163:56323 (399 connections now open) 2015-10-05T07:16:29.979+0100 [mongosMain] connection accepted from 172.28.0.163:57494 #1428481 (399 connections now open) 2015-10-05T07:16:29.979+0100 [mongosMain] connection accepted from 172.28.0.163:57495 #1428482 (400 connections now open) 2015-10-05T07:16:29.979+0100 [conn1428481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:29.980+0100 [conn1428482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:30.095+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:16:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:16:30.647+0100 [conn1428085] end connection 172.28.0.164:49325 (399 connections now open) 2015-10-05T07:16:30.647+0100 [conn1428078] end connection 172.28.0.164:49306 (398 connections now open) 2015-10-05T07:16:30.648+0100 [mongosMain] connection accepted from 172.28.0.164:50765 #1428483 (399 connections now open) 2015-10-05T07:16:30.648+0100 [mongosMain] connection accepted from 172.28.0.164:50764 #1428484 (400 connections now open) 2015-10-05T07:16:30.649+0100 [conn1428483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:30.649+0100 [conn1428484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:32.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215bf5703b51053ecda07 2015-10-05T07:16:32.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:33.512+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:33.512+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:33.910+0100 [conn1428043] end connection 172.28.0.163:56219 (399 connections now open) 2015-10-05T07:16:33.911+0100 [mongosMain] connection accepted from 172.28.0.163:57501 #1428485 (400 connections now open) 2015-10-05T07:16:33.913+0100 [conn1428485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:34.247+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:34.456+0100 [conn1428108] end connection 172.28.0.163:56398 (399 connections now open) 2015-10-05T07:16:34.457+0100 [mongosMain] connection accepted from 172.28.0.163:57503 #1428486 (400 connections now open) 2015-10-05T07:16:34.458+0100 [conn1428486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:34.656+0100 [conn1428073] end connection 172.28.0.164:49289 (399 connections now open) 2015-10-05T07:16:34.657+0100 [mongosMain] connection accepted from 172.28.0.164:50775 #1428487 (400 connections now open) 2015-10-05T07:16:34.659+0100 [conn1428487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:35.202+0100 [conn1428103] end connection 172.28.0.164:49366 (399 connections now open) 2015-10-05T07:16:35.203+0100 [mongosMain] connection accepted from 172.28.0.164:50777 #1428488 (400 connections now open) 2015-10-05T07:16:35.205+0100 [conn1428488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:38.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215c65703b51053ecda52 2015-10-05T07:16:38.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:39.829+0100 [mongosMain] connection accepted from 127.0.0.1:57507 #1428489 (401 connections now open) 2015-10-05T07:16:39.832+0100 [conn1428489] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:39.837+0100 [conn1428489] end connection 127.0.0.1:57507 (400 connections now open) 2015-10-05T07:16:39.993+0100 [conn1428090] end connection 172.28.0.163:56341 (399 connections now open) 2015-10-05T07:16:39.993+0100 [conn1428008] end connection 172.28.0.163:56121 (399 connections now open) 2015-10-05T07:16:39.994+0100 [mongosMain] connection accepted from 172.28.0.163:57508 #1428490 (399 connections now open) 2015-10-05T07:16:39.995+0100 [mongosMain] connection accepted from 172.28.0.163:57509 #1428491 (400 connections now open) 2015-10-05T07:16:39.995+0100 [conn1428490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:39.996+0100 [conn1428491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:40.666+0100 [conn1428055] end connection 172.28.0.164:49235 (399 connections now open) 2015-10-05T07:16:40.667+0100 [mongosMain] connection accepted from 172.28.0.164:50790 #1428492 (400 connections now open) 2015-10-05T07:16:40.668+0100 [conn1427768] end connection 172.28.0.164:64752 (399 connections now open) 2015-10-05T07:16:40.669+0100 [mongosMain] connection accepted from 172.28.0.164:50792 #1428493 (400 connections now open) 2015-10-05T07:16:40.669+0100 [conn1428492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:40.670+0100 [conn1428493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:44.471+0100 [conn1428115] end connection 172.28.0.163:56412 (399 connections now open) 2015-10-05T07:16:44.471+0100 [mongosMain] connection accepted from 172.28.0.163:57542 #1428494 (400 connections now open) 2015-10-05T07:16:44.472+0100 [conn1428494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:44.671+0100 [conn1428081] end connection 172.28.0.164:49315 (399 connections now open) 2015-10-05T07:16:44.672+0100 [mongosMain] connection accepted from 172.28.0.164:50835 #1428495 (400 connections now open) 2015-10-05T07:16:44.673+0100 [conn1428495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:44.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215cc5703b51053ecdaa5 2015-10-05T07:16:44.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:45.218+0100 [conn1428110] end connection 172.28.0.164:49386 (399 connections now open) 2015-10-05T07:16:45.220+0100 [mongosMain] connection accepted from 172.28.0.164:50841 #1428496 (400 connections now open) 2015-10-05T07:16:45.222+0100 [conn1428496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:45.252+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:45.517+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:45.518+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:47.537+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:47.537+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:49.994+0100 [conn1428097] end connection 172.28.0.163:56370 (399 connections now open) 2015-10-05T07:16:49.995+0100 [conn1427987] end connection 172.28.0.163:56068 (399 connections now open) 2015-10-05T07:16:49.995+0100 [mongosMain] connection accepted from 172.28.0.163:57569 #1428497 (399 connections now open) 2015-10-05T07:16:49.996+0100 [mongosMain] connection accepted from 172.28.0.163:57570 #1428498 (400 connections now open) 2015-10-05T07:16:49.997+0100 [conn1428497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:49.997+0100 [conn1428498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:50.541+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:50.541+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:50.679+0100 [conn1428113] end connection 172.28.0.164:49393 (399 connections now open) 2015-10-05T07:16:50.679+0100 [conn1428092] end connection 172.28.0.164:49341 (399 connections now open) 2015-10-05T07:16:50.680+0100 [mongosMain] connection accepted from 172.28.0.164:50850 #1428499 (399 connections now open) 2015-10-05T07:16:50.680+0100 [mongosMain] connection accepted from 172.28.0.164:50851 #1428500 (400 connections now open) 2015-10-05T07:16:50.681+0100 [conn1428499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:50.682+0100 [conn1428500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:51.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215d25703b51053ecdb01 2015-10-05T07:16:51.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:53.927+0100 [conn1428100] end connection 172.28.0.163:56376 (399 connections now open) 2015-10-05T07:16:53.928+0100 [mongosMain] connection accepted from 172.28.0.163:57577 #1428501 (400 connections now open) 2015-10-05T07:16:53.929+0100 [conn1428501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:54.473+0100 [conn1428122] end connection 172.28.0.163:56427 (399 connections now open) 2015-10-05T07:16:54.474+0100 [mongosMain] connection accepted from 172.28.0.163:57580 #1428502 (400 connections now open) 2015-10-05T07:16:54.475+0100 [conn1428502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:54.542+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:54.542+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:16:54.672+0100 [conn1428095] end connection 172.28.0.164:49351 (399 connections now open) 2015-10-05T07:16:54.673+0100 [mongosMain] connection accepted from 172.28.0.164:50861 #1428503 (400 connections now open) 2015-10-05T07:16:54.675+0100 [conn1428503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:55.218+0100 [conn1428117] end connection 172.28.0.164:49404 (399 connections now open) 2015-10-05T07:16:55.220+0100 [mongosMain] connection accepted from 172.28.0.164:50863 #1428504 (400 connections now open) 2015-10-05T07:16:55.221+0100 [conn1428504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:16:56.262+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:58.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215d95703b51053ecdb40 2015-10-05T07:16:58.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:16:59.620+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:16:59.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:00.009+0100 [conn1428077] end connection 172.28.0.163:56306 (399 connections now open) 2015-10-05T07:17:00.009+0100 [conn1428061] end connection 172.28.0.163:56274 (399 connections now open) 2015-10-05T07:17:00.010+0100 [mongosMain] connection accepted from 172.28.0.163:57589 #1428505 (399 connections now open) 2015-10-05T07:17:00.010+0100 [mongosMain] connection accepted from 172.28.0.163:57590 #1428506 (400 connections now open) 2015-10-05T07:17:00.011+0100 [conn1428505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:00.011+0100 [conn1428506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:00.352+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:17:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:17:00.693+0100 [conn1428079] end connection 172.28.0.164:49307 (399 connections now open) 2015-10-05T07:17:00.694+0100 [conn1428086] end connection 172.28.0.164:49326 (398 connections now open) 2015-10-05T07:17:00.694+0100 [mongosMain] connection accepted from 172.28.0.164:50873 #1428507 (399 connections now open) 2015-10-05T07:17:00.695+0100 [mongosMain] connection accepted from 172.28.0.164:50874 #1428508 (400 connections now open) 2015-10-05T07:17:00.696+0100 [conn1428507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:00.696+0100 [conn1428508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:03.940+0100 [conn1428114] end connection 172.28.0.163:56410 (399 connections now open) 2015-10-05T07:17:03.941+0100 [mongosMain] connection accepted from 172.28.0.163:57643 #1428509 (400 connections now open) 2015-10-05T07:17:03.942+0100 [conn1428509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:04.688+0100 [conn1428102] end connection 172.28.0.164:49364 (399 connections now open) 2015-10-05T07:17:04.689+0100 [mongosMain] connection accepted from 172.28.0.164:50926 #1428510 (400 connections now open) 2015-10-05T07:17:04.690+0100 [conn1428510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:05.234+0100 [conn1428124] end connection 172.28.0.164:49429 (399 connections now open) 2015-10-05T07:17:05.236+0100 [mongosMain] connection accepted from 172.28.0.164:50929 #1428511 (400 connections now open) 2015-10-05T07:17:05.238+0100 [conn1428511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:05.619+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:05.619+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:07.293+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:10.025+0100 [conn1428001] end connection 172.28.0.163:56099 (399 connections now open) 2015-10-05T07:17:10.025+0100 [conn1428112] end connection 172.28.0.163:56407 (399 connections now open) 2015-10-05T07:17:10.026+0100 [mongosMain] connection accepted from 172.28.0.163:57652 #1428512 (399 connections now open) 2015-10-05T07:17:10.026+0100 [mongosMain] connection accepted from 172.28.0.163:57653 #1428513 (400 connections now open) 2015-10-05T07:17:10.027+0100 [conn1428512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:10.027+0100 [conn1428513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:10.694+0100 [conn1428035] end connection 172.28.0.164:49160 (399 connections now open) 2015-10-05T07:17:10.694+0100 [conn1428127] end connection 172.28.0.164:49439 (399 connections now open) 2015-10-05T07:17:10.696+0100 [mongosMain] connection accepted from 172.28.0.164:50936 #1428514 (399 connections now open) 2015-10-05T07:17:10.696+0100 [mongosMain] connection accepted from 172.28.0.164:50935 #1428515 (400 connections now open) 2015-10-05T07:17:10.698+0100 [conn1428514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:10.698+0100 [conn1428515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:10.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215e65703b51053ecdbf5 2015-10-05T07:17:10.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:17:12.622+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:12.622+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:14.488+0100 [conn1428129] end connection 172.28.0.163:56446 (399 connections now open) 2015-10-05T07:17:14.489+0100 [mongosMain] connection accepted from 172.28.0.163:57662 #1428516 (400 connections now open) 2015-10-05T07:17:14.490+0100 [conn1428516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:14.706+0100 [conn1428018] end connection 172.28.0.164:65484 (399 connections now open) 2015-10-05T07:17:14.708+0100 [mongosMain] connection accepted from 172.28.0.164:50939 #1428517 (400 connections now open) 2015-10-05T07:17:14.711+0100 [conn1428517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:15.234+0100 [conn1428131] end connection 172.28.0.164:49452 (399 connections now open) 2015-10-05T07:17:15.236+0100 [mongosMain] connection accepted from 172.28.0.164:50941 #1428518 (400 connections now open) 2015-10-05T07:17:15.238+0100 [conn1428518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:17.044+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:17:17.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:17:18.296+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:20.025+0100 [conn1428133] end connection 172.28.0.163:56457 (399 connections now open) 2015-10-05T07:17:20.025+0100 [conn1428068] end connection 172.28.0.163:56290 (399 connections now open) 2015-10-05T07:17:20.026+0100 [mongosMain] connection accepted from 172.28.0.163:57669 #1428519 (399 connections now open) 2015-10-05T07:17:20.026+0100 [mongosMain] connection accepted from 172.28.0.163:57670 #1428520 (400 connections now open) 2015-10-05T07:17:20.027+0100 [conn1428519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:20.027+0100 [conn1428520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:20.642+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:20.642+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:20.710+0100 [conn1428099] end connection 172.28.0.164:49360 (399 connections now open) 2015-10-05T07:17:20.710+0100 [conn1428119] end connection 172.28.0.164:49416 (398 connections now open) 2015-10-05T07:17:20.711+0100 [mongosMain] connection accepted from 172.28.0.164:50949 #1428521 (399 connections now open) 2015-10-05T07:17:20.711+0100 [mongosMain] connection accepted from 172.28.0.164:50950 #1428522 (400 connections now open) 2015-10-05T07:17:20.712+0100 [conn1428521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:20.713+0100 [conn1428522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:23.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215f35703b51053ecdc75 2015-10-05T07:17:23.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:17:24.503+0100 [conn1428143] end connection 172.28.0.163:56492 (399 connections now open) 2015-10-05T07:17:24.505+0100 [mongosMain] connection accepted from 172.28.0.163:57714 #1428523 (400 connections now open) 2015-10-05T07:17:24.506+0100 [conn1428523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:24.704+0100 [conn1428123] end connection 172.28.0.164:49427 (399 connections now open) 2015-10-05T07:17:24.705+0100 [mongosMain] connection accepted from 172.28.0.164:51009 #1428524 (400 connections now open) 2015-10-05T07:17:24.708+0100 [conn1428524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:25.249+0100 [conn1428138] end connection 172.28.0.164:49473 (399 connections now open) 2015-10-05T07:17:25.250+0100 [mongosMain] connection accepted from 172.28.0.164:51016 #1428525 (400 connections now open) 2015-10-05T07:17:25.252+0100 [conn1428525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:28.499+0100 [mongosMain] connection accepted from 127.0.0.1:57718 #1428526 (401 connections now open) 2015-10-05T07:17:28.502+0100 [conn1428526] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:28.508+0100 [conn1428526] end connection 127.0.0.1:57718 (400 connections now open) 2015-10-05T07:17:29.305+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:29.506+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:17:29.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:17:29.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:29.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:30.044+0100 [conn1428104] end connection 172.28.0.163:56388 (399 connections now open) 2015-10-05T07:17:30.045+0100 [conn1428083] end connection 172.28.0.163:56322 (399 connections now open) 2015-10-05T07:17:30.046+0100 [mongosMain] connection accepted from 172.28.0.163:57721 #1428527 (399 connections now open) 2015-10-05T07:17:30.046+0100 [mongosMain] connection accepted from 172.28.0.163:57722 #1428528 (400 connections now open) 2015-10-05T07:17:30.047+0100 [conn1428527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:30.047+0100 [conn1428528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:30.598+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:17:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:17:30.710+0100 [conn1428105] end connection 172.28.0.164:49374 (399 connections now open) 2015-10-05T07:17:30.711+0100 [conn1427864] end connection 172.28.0.164:65042 (398 connections now open) 2015-10-05T07:17:30.712+0100 [mongosMain] connection accepted from 172.28.0.164:51024 #1428529 (399 connections now open) 2015-10-05T07:17:30.713+0100 [mongosMain] connection accepted from 172.28.0.164:51025 #1428530 (400 connections now open) 2015-10-05T07:17:30.714+0100 [conn1428529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:30.714+0100 [conn1428530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:34.704+0100 [conn1428109] end connection 172.28.0.164:49383 (399 connections now open) 2015-10-05T07:17:34.706+0100 [mongosMain] connection accepted from 172.28.0.164:51034 #1428531 (400 connections now open) 2015-10-05T07:17:34.707+0100 [conn1428531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:35.250+0100 [conn1428145] end connection 172.28.0.164:49486 (399 connections now open) 2015-10-05T07:17:35.251+0100 [mongosMain] connection accepted from 172.28.0.164:51037 #1428532 (400 connections now open) 2015-10-05T07:17:35.252+0100 [conn1428532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:35.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561215ff5703b51053ecdd0f 2015-10-05T07:17:35.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:17:39.653+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:39.654+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:39.688+0100 [mongosMain] connection accepted from 127.0.0.1:57731 #1428533 (401 connections now open) 2015-10-05T07:17:39.691+0100 [conn1428533] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:39.695+0100 [conn1428533] end connection 127.0.0.1:57731 (400 connections now open) 2015-10-05T07:17:40.048+0100 [conn1428139] end connection 172.28.0.163:56482 (399 connections now open) 2015-10-05T07:17:40.048+0100 [conn1428060] end connection 172.28.0.163:56273 (399 connections now open) 2015-10-05T07:17:40.049+0100 [mongosMain] connection accepted from 172.28.0.163:57732 #1428534 (399 connections now open) 2015-10-05T07:17:40.050+0100 [mongosMain] connection accepted from 172.28.0.163:57733 #1428535 (400 connections now open) 2015-10-05T07:17:40.050+0100 [conn1428534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:40.051+0100 [conn1428535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:40.312+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:40.726+0100 [conn1428141] end connection 172.28.0.164:49479 (399 connections now open) 2015-10-05T07:17:40.727+0100 [mongosMain] connection accepted from 172.28.0.164:51045 #1428536 (400 connections now open) 2015-10-05T07:17:40.729+0100 [conn1428536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:43.973+0100 [conn1428121] end connection 172.28.0.163:56424 (399 connections now open) 2015-10-05T07:17:43.975+0100 [mongosMain] connection accepted from 172.28.0.163:57740 #1428537 (400 connections now open) 2015-10-05T07:17:43.976+0100 [conn1428537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:44.519+0100 [conn1428157] end connection 172.28.0.163:56517 (399 connections now open) 2015-10-05T07:17:44.521+0100 [mongosMain] connection accepted from 172.28.0.163:57741 #1428538 (400 connections now open) 2015-10-05T07:17:44.522+0100 [conn1428538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:44.719+0100 [conn1428130] end connection 172.28.0.164:49448 (399 connections now open) 2015-10-05T07:17:44.720+0100 [mongosMain] connection accepted from 172.28.0.164:51052 #1428539 (400 connections now open) 2015-10-05T07:17:44.722+0100 [conn1428539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:45.266+0100 [conn1428152] end connection 172.28.0.164:49503 (399 connections now open) 2015-10-05T07:17:45.267+0100 [mongosMain] connection accepted from 172.28.0.164:51056 #1428540 (400 connections now open) 2015-10-05T07:17:45.269+0100 [conn1428540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:48.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612160b5703b51053ecdd91 2015-10-05T07:17:48.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:17:50.058+0100 [conn1428154] end connection 172.28.0.163:56512 (399 connections now open) 2015-10-05T07:17:50.060+0100 [mongosMain] connection accepted from 172.28.0.163:57753 #1428541 (400 connections now open) 2015-10-05T07:17:50.062+0100 [conn1428541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:50.660+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:50.661+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:17:50.741+0100 [conn1428135] end connection 172.28.0.164:49460 (399 connections now open) 2015-10-05T07:17:50.742+0100 [mongosMain] connection accepted from 172.28.0.164:51062 #1428542 (400 connections now open) 2015-10-05T07:17:50.744+0100 [conn1428542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:51.324+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:17:54.520+0100 [conn1428150] end connection 172.28.0.163:56509 (399 connections now open) 2015-10-05T07:17:54.521+0100 [mongosMain] connection accepted from 172.28.0.163:57761 #1428543 (400 connections now open) 2015-10-05T07:17:54.522+0100 [conn1428543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:54.735+0100 [conn1428088] end connection 172.28.0.164:49332 (399 connections now open) 2015-10-05T07:17:54.736+0100 [mongosMain] connection accepted from 172.28.0.164:51070 #1428544 (400 connections now open) 2015-10-05T07:17:54.737+0100 [conn1428544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:17:55.281+0100 [conn1428158] end connection 172.28.0.164:49523 (399 connections now open) 2015-10-05T07:17:55.283+0100 [mongosMain] connection accepted from 172.28.0.164:51071 #1428545 (400 connections now open) 2015-10-05T07:17:55.284+0100 [conn1428545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:00.750+0100 [conn1428093] end connection 172.28.0.164:49340 (399 connections now open) 2015-10-05T07:18:00.751+0100 [mongosMain] connection accepted from 172.28.0.164:51083 #1428546 (400 connections now open) 2015-10-05T07:18:00.754+0100 [conn1428546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:00.754+0100 [conn1428062] end connection 172.28.0.164:49254 (399 connections now open) 2015-10-05T07:18:00.756+0100 [mongosMain] connection accepted from 172.28.0.164:51084 #1428547 (400 connections now open) 2015-10-05T07:18:00.758+0100 [conn1428547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:00.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216185703b51053ecde07 2015-10-05T07:18:00.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:00.973+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:18:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:18:02.378+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:02.665+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:02.665+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:04.535+0100 [conn1428162] end connection 172.28.0.163:56530 (399 connections now open) 2015-10-05T07:18:04.536+0100 [mongosMain] connection accepted from 172.28.0.163:57788 #1428548 (400 connections now open) 2015-10-05T07:18:04.537+0100 [conn1428548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:04.659+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:04.659+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:04.751+0100 [conn1428151] end connection 172.28.0.164:49501 (399 connections now open) 2015-10-05T07:18:04.752+0100 [mongosMain] connection accepted from 172.28.0.164:51089 #1428549 (400 connections now open) 2015-10-05T07:18:04.754+0100 [conn1428549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:05.297+0100 [conn1428163] end connection 172.28.0.164:49543 (399 connections now open) 2015-10-05T07:18:05.298+0100 [mongosMain] connection accepted from 172.28.0.164:51092 #1428550 (400 connections now open) 2015-10-05T07:18:05.300+0100 [conn1428550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:07.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:07.677+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:10.757+0100 [conn1428148] end connection 172.28.0.164:49492 (399 connections now open) 2015-10-05T07:18:10.757+0100 [conn1428142] end connection 172.28.0.164:49480 (399 connections now open) 2015-10-05T07:18:10.758+0100 [mongosMain] connection accepted from 172.28.0.164:51097 #1428551 (399 connections now open) 2015-10-05T07:18:10.758+0100 [mongosMain] connection accepted from 172.28.0.164:51096 #1428552 (400 connections now open) 2015-10-05T07:18:10.759+0100 [conn1428551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:10.759+0100 [conn1428552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:11.683+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:11.683+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:13.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216245703b51053ecdebd 2015-10-05T07:18:13.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:13.389+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:14.550+0100 [conn1428167] end connection 172.28.0.163:56552 (399 connections now open) 2015-10-05T07:18:14.552+0100 [mongosMain] connection accepted from 172.28.0.163:57803 #1428553 (400 connections now open) 2015-10-05T07:18:14.553+0100 [conn1428553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:14.750+0100 [conn1428065] end connection 172.28.0.164:49270 (399 connections now open) 2015-10-05T07:18:14.751+0100 [mongosMain] connection accepted from 172.28.0.164:51100 #1428554 (400 connections now open) 2015-10-05T07:18:14.753+0100 [conn1428554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:15.297+0100 [conn1428172] end connection 172.28.0.164:49578 (399 connections now open) 2015-10-05T07:18:15.299+0100 [mongosMain] connection accepted from 172.28.0.164:51103 #1428555 (400 connections now open) 2015-10-05T07:18:15.301+0100 [conn1428555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:16.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:16.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:20.074+0100 [conn1428147] end connection 172.28.0.163:56503 (399 connections now open) 2015-10-05T07:18:20.075+0100 [mongosMain] connection accepted from 172.28.0.163:57811 #1428556 (400 connections now open) 2015-10-05T07:18:20.076+0100 [conn1428556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:20.757+0100 [conn1428166] end connection 172.28.0.164:49551 (399 connections now open) 2015-10-05T07:18:20.759+0100 [mongosMain] connection accepted from 172.28.0.164:51110 #1428557 (400 connections now open) 2015-10-05T07:18:20.761+0100 [conn1428557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:22.692+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:22.693+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:24.397+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:24.551+0100 [conn1428170] end connection 172.28.0.163:56583 (399 connections now open) 2015-10-05T07:18:24.552+0100 [mongosMain] connection accepted from 172.28.0.163:57818 #1428558 (400 connections now open) 2015-10-05T07:18:24.553+0100 [conn1428558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:24.767+0100 [conn1428144] end connection 172.28.0.164:49483 (399 connections now open) 2015-10-05T07:18:24.768+0100 [mongosMain] connection accepted from 172.28.0.164:51119 #1428559 (400 connections now open) 2015-10-05T07:18:24.770+0100 [conn1428559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:25.313+0100 [conn1428177] end connection 172.28.0.164:49589 (399 connections now open) 2015-10-05T07:18:25.314+0100 [mongosMain] connection accepted from 172.28.0.164:51121 #1428560 (400 connections now open) 2015-10-05T07:18:25.315+0100 [conn1428560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:25.714+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216315703b51053ecdf43 2015-10-05T07:18:25.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:29.219+0100 [mongosMain] connection accepted from 127.0.0.1:57821 #1428561 (401 connections now open) 2015-10-05T07:18:29.222+0100 [conn1428561] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:29.228+0100 [conn1428561] end connection 127.0.0.1:57821 (400 connections now open) 2015-10-05T07:18:29.788+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:29.789+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:30.088+0100 [conn1428160] end connection 172.28.0.163:56522 (399 connections now open) 2015-10-05T07:18:30.089+0100 [mongosMain] connection accepted from 172.28.0.163:57822 #1428562 (400 connections now open) 2015-10-05T07:18:30.090+0100 [conn1428562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:30.772+0100 [conn1428174] end connection 172.28.0.164:49582 (399 connections now open) 2015-10-05T07:18:30.783+0100 [mongosMain] connection accepted from 172.28.0.164:51130 #1428563 (400 connections now open) 2015-10-05T07:18:30.785+0100 [conn1428563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:31.239+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:18:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:18:34.566+0100 [conn1428175] end connection 172.28.0.163:56598 (399 connections now open) 2015-10-05T07:18:34.568+0100 [mongosMain] connection accepted from 172.28.0.163:57827 #1428564 (400 connections now open) 2015-10-05T07:18:34.569+0100 [conn1428564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:34.767+0100 [conn1428116] end connection 172.28.0.164:49400 (399 connections now open) 2015-10-05T07:18:34.768+0100 [mongosMain] connection accepted from 172.28.0.164:51137 #1428565 (400 connections now open) 2015-10-05T07:18:34.770+0100 [conn1428565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:35.313+0100 [conn1428182] end connection 172.28.0.164:49608 (399 connections now open) 2015-10-05T07:18:35.314+0100 [mongosMain] connection accepted from 172.28.0.164:51141 #1428566 (400 connections now open) 2015-10-05T07:18:35.316+0100 [conn1428566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:35.404+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:37.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:37.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:38.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612163d5703b51053ecdfd3 2015-10-05T07:18:38.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:39.820+0100 [mongosMain] connection accepted from 127.0.0.1:57830 #1428567 (401 connections now open) 2015-10-05T07:18:39.823+0100 [conn1428567] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:39.828+0100 [conn1428567] end connection 127.0.0.1:57830 (400 connections now open) 2015-10-05T07:18:40.104+0100 [conn1428173] end connection 172.28.0.163:56592 (399 connections now open) 2015-10-05T07:18:40.105+0100 [mongosMain] connection accepted from 172.28.0.163:57831 #1428568 (400 connections now open) 2015-10-05T07:18:40.106+0100 [conn1428568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:40.789+0100 [conn1428155] end connection 172.28.0.164:49514 (399 connections now open) 2015-10-05T07:18:40.792+0100 [mongosMain] connection accepted from 172.28.0.164:51151 #1428569 (400 connections now open) 2015-10-05T07:18:40.794+0100 [conn1428569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:44.020+0100 [conn1428107] end connection 172.28.0.163:56396 (399 connections now open) 2015-10-05T07:18:44.021+0100 [mongosMain] connection accepted from 172.28.0.163:57837 #1428570 (400 connections now open) 2015-10-05T07:18:44.023+0100 [conn1428570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:44.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216445703b51053ece02e 2015-10-05T07:18:44.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:44.566+0100 [conn1428180] end connection 172.28.0.163:56612 (399 connections now open) 2015-10-05T07:18:44.567+0100 [mongosMain] connection accepted from 172.28.0.163:57839 #1428571 (400 connections now open) 2015-10-05T07:18:44.568+0100 [conn1428571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:44.783+0100 [conn1428176] end connection 172.28.0.164:49587 (399 connections now open) 2015-10-05T07:18:44.784+0100 [mongosMain] connection accepted from 172.28.0.164:51159 #1428572 (400 connections now open) 2015-10-05T07:18:44.786+0100 [conn1428572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:45.329+0100 [conn1428188] end connection 172.28.0.164:49626 (399 connections now open) 2015-10-05T07:18:45.332+0100 [mongosMain] connection accepted from 172.28.0.164:51163 #1428573 (400 connections now open) 2015-10-05T07:18:45.333+0100 [conn1428573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:46.406+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:46.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:46.799+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:50.106+0100 [conn1428165] end connection 172.28.0.163:56544 (399 connections now open) 2015-10-05T07:18:50.108+0100 [mongosMain] connection accepted from 172.28.0.163:57852 #1428574 (400 connections now open) 2015-10-05T07:18:50.109+0100 [conn1428574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:51.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612164a5703b51053ece07a 2015-10-05T07:18:51.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:18:54.036+0100 [conn1428136] end connection 172.28.0.163:56473 (399 connections now open) 2015-10-05T07:18:54.037+0100 [mongosMain] connection accepted from 172.28.0.163:57858 #1428575 (400 connections now open) 2015-10-05T07:18:54.037+0100 [conn1428575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:54.582+0100 [conn1428186] end connection 172.28.0.163:56621 (399 connections now open) 2015-10-05T07:18:54.584+0100 [mongosMain] connection accepted from 172.28.0.163:57861 #1428576 (400 connections now open) 2015-10-05T07:18:54.585+0100 [conn1428576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:18:56.849+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:18:56.849+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:18:57.467+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:00.120+0100 [conn1428146] end connection 172.28.0.163:56501 (399 connections now open) 2015-10-05T07:19:00.121+0100 [mongosMain] connection accepted from 172.28.0.163:57873 #1428577 (400 connections now open) 2015-10-05T07:19:00.122+0100 [conn1428577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:00.819+0100 [conn1428056] end connection 172.28.0.164:49236 (399 connections now open) 2015-10-05T07:19:00.821+0100 [mongosMain] connection accepted from 172.28.0.164:51181 #1428578 (400 connections now open) 2015-10-05T07:19:00.822+0100 [conn1428578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:01.383+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:19:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:19:03.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216575703b51053ece0c9 2015-10-05T07:19:03.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:04.039+0100 [conn1428128] end connection 172.28.0.163:56444 (399 connections now open) 2015-10-05T07:19:04.040+0100 [mongosMain] connection accepted from 172.28.0.163:57884 #1428579 (400 connections now open) 2015-10-05T07:19:04.042+0100 [conn1428579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:04.585+0100 [conn1428193] end connection 172.28.0.163:56639 (399 connections now open) 2015-10-05T07:19:04.586+0100 [mongosMain] connection accepted from 172.28.0.163:57887 #1428580 (400 connections now open) 2015-10-05T07:19:04.587+0100 [conn1428580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:07.895+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:07.895+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:08.476+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:09.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612165d5703b51053ece104 2015-10-05T07:19:09.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:10.124+0100 [conn1428178] end connection 172.28.0.163:56608 (399 connections now open) 2015-10-05T07:19:10.124+0100 [conn1428047] end connection 172.28.0.163:56231 (399 connections now open) 2015-10-05T07:19:10.125+0100 [mongosMain] connection accepted from 172.28.0.163:57907 #1428581 (399 connections now open) 2015-10-05T07:19:10.125+0100 [mongosMain] connection accepted from 172.28.0.163:57908 #1428582 (400 connections now open) 2015-10-05T07:19:10.126+0100 [conn1428581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:10.126+0100 [conn1428582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:10.835+0100 [conn1427955] end connection 172.28.0.164:65321 (399 connections now open) 2015-10-05T07:19:10.837+0100 [mongosMain] connection accepted from 172.28.0.164:51196 #1428583 (400 connections now open) 2015-10-05T07:19:10.839+0100 [conn1428583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:14.052+0100 [conn1428198] end connection 172.28.0.163:56657 (399 connections now open) 2015-10-05T07:19:14.053+0100 [mongosMain] connection accepted from 172.28.0.163:57912 #1428584 (400 connections now open) 2015-10-05T07:19:14.054+0100 [conn1428584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:16.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216635703b51053ece13d 2015-10-05T07:19:16.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:19.571+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:19.902+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:19.903+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:20.135+0100 [conn1428190] end connection 172.28.0.163:56627 (399 connections now open) 2015-10-05T07:19:20.136+0100 [mongosMain] connection accepted from 172.28.0.163:57924 #1428585 (400 connections now open) 2015-10-05T07:19:20.138+0100 [conn1428585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:21.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:21.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:22.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612166a5703b51053ece177 2015-10-05T07:19:22.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:24.052+0100 [conn1428057] end connection 172.28.0.163:56265 (399 connections now open) 2015-10-05T07:19:24.053+0100 [mongosMain] connection accepted from 172.28.0.163:57930 #1428586 (400 connections now open) 2015-10-05T07:19:24.054+0100 [conn1428586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:24.985+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:24.985+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:28.440+0100 [mongosMain] connection accepted from 127.0.0.1:57936 #1428587 (401 connections now open) 2015-10-05T07:19:28.443+0100 [conn1428587] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:28.449+0100 [conn1428587] end connection 127.0.0.1:57936 (400 connections now open) 2015-10-05T07:19:29.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:29.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:29.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216715703b51053ece196 2015-10-05T07:19:29.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:30.136+0100 [conn1428184] end connection 172.28.0.163:56618 (399 connections now open) 2015-10-05T07:19:30.138+0100 [mongosMain] connection accepted from 172.28.0.163:57939 #1428588 (400 connections now open) 2015-10-05T07:19:30.139+0100 [conn1428588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:30.581+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:30.852+0100 [conn1428106] end connection 172.28.0.164:49375 (399 connections now open) 2015-10-05T07:19:30.854+0100 [mongosMain] connection accepted from 172.28.0.164:51232 #1428589 (400 connections now open) 2015-10-05T07:19:30.856+0100 [conn1428589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:32.209+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:19:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:19:34.066+0100 [conn1428192] end connection 172.28.0.163:56633 (399 connections now open) 2015-10-05T07:19:34.067+0100 [mongosMain] connection accepted from 172.28.0.163:57941 #1428590 (400 connections now open) 2015-10-05T07:19:34.068+0100 [conn1428590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:34.320+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:34.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:35.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216775703b51053ece1ba 2015-10-05T07:19:35.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:40.142+0100 [mongosMain] connection accepted from 127.0.0.1:57946 #1428591 (401 connections now open) 2015-10-05T07:19:40.145+0100 [conn1428591] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:40.150+0100 [conn1428591] end connection 127.0.0.1:57946 (400 connections now open) 2015-10-05T07:19:40.374+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:40.374+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:40.868+0100 [conn1428210] end connection 172.28.0.164:49694 (399 connections now open) 2015-10-05T07:19:40.869+0100 [mongosMain] connection accepted from 172.28.0.164:51251 #1428592 (400 connections now open) 2015-10-05T07:19:40.881+0100 [conn1428592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:41.586+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:41.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612167d5703b51053ece1eb 2015-10-05T07:19:41.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:44.083+0100 [conn1428017] end connection 172.28.0.163:56163 (399 connections now open) 2015-10-05T07:19:44.084+0100 [mongosMain] connection accepted from 172.28.0.163:57955 #1428593 (400 connections now open) 2015-10-05T07:19:44.085+0100 [conn1428593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:47.376+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:47.377+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:19:48.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216835703b51053ece254 2015-10-05T07:19:48.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:50.882+0100 [conn1428156] end connection 172.28.0.164:49513 (399 connections now open) 2015-10-05T07:19:50.884+0100 [mongosMain] connection accepted from 172.28.0.164:51261 #1428594 (400 connections now open) 2015-10-05T07:19:50.886+0100 [conn1428594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:52.587+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:54.084+0100 [conn1428204] end connection 172.28.0.163:56685 (399 connections now open) 2015-10-05T07:19:54.085+0100 [mongosMain] connection accepted from 172.28.0.163:57975 #1428595 (400 connections now open) 2015-10-05T07:19:54.085+0100 [conn1428595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:19:54.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612168a5703b51053ece2bf 2015-10-05T07:19:54.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:19:55.384+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:19:55.384+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:00.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216905703b51053ece30c 2015-10-05T07:20:00.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:02.437+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:20:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:20:03.593+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:04.099+0100 [conn1428208] end connection 172.28.0.163:56702 (399 connections now open) 2015-10-05T07:20:04.100+0100 [mongosMain] connection accepted from 172.28.0.163:57993 #1428596 (400 connections now open) 2015-10-05T07:20:04.101+0100 [conn1428596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:04.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:04.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:07.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216965703b51053ece37c 2015-10-05T07:20:07.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:13.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612169d5703b51053ece3bf 2015-10-05T07:20:14.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:14.100+0100 [conn1428218] end connection 172.28.0.163:56748 (399 connections now open) 2015-10-05T07:20:14.102+0100 [mongosMain] connection accepted from 172.28.0.163:58021 #1428597 (400 connections now open) 2015-10-05T07:20:14.103+0100 [conn1428597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:14.452+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:14.452+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:14.627+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:20.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216a45703b51053ece3ef 2015-10-05T07:20:20.445+0100 [conn1428209] end connection 172.28.0.163:56708 (399 connections now open) 2015-10-05T07:20:20.452+0100 [mongosMain] connection accepted from 172.28.0.163:58029 #1428598 (400 connections now open) 2015-10-05T07:20:20.453+0100 [conn1428598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:20.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:20.914+0100 [conn1428185] end connection 172.28.0.164:49616 (399 connections now open) 2015-10-05T07:20:20.915+0100 [mongosMain] connection accepted from 172.28.0.164:51297 #1428599 (400 connections now open) 2015-10-05T07:20:20.917+0100 [conn1428599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:24.115+0100 [conn1428217] end connection 172.28.0.163:56735 (399 connections now open) 2015-10-05T07:20:24.116+0100 [mongosMain] connection accepted from 172.28.0.163:58030 #1428600 (400 connections now open) 2015-10-05T07:20:24.117+0100 [conn1428600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:24.662+0100 [conn1428199] end connection 172.28.0.163:56660 (399 connections now open) 2015-10-05T07:20:24.663+0100 [mongosMain] connection accepted from 172.28.0.163:58034 #1428601 (400 connections now open) 2015-10-05T07:20:24.664+0100 [conn1428601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:25.454+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:25.454+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:25.632+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:28.217+0100 [mongosMain] connection accepted from 127.0.0.1:58038 #1428602 (401 connections now open) 2015-10-05T07:20:28.220+0100 [conn1428602] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:28.225+0100 [conn1428602] end connection 127.0.0.1:58038 (400 connections now open) 2015-10-05T07:20:30.433+0100 [conn1428201] end connection 172.28.0.163:56670 (399 connections now open) 2015-10-05T07:20:30.434+0100 [mongosMain] connection accepted from 172.28.0.163:58043 #1428603 (400 connections now open) 2015-10-05T07:20:30.435+0100 [conn1428603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:30.930+0100 [conn1428191] end connection 172.28.0.164:49636 (399 connections now open) 2015-10-05T07:20:30.931+0100 [mongosMain] connection accepted from 172.28.0.164:51312 #1428604 (400 connections now open) 2015-10-05T07:20:30.933+0100 [conn1428604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:33.203+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:20:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:20:33.204+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:20:33.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:20:34.115+0100 [conn1428219] end connection 172.28.0.163:56777 (399 connections now open) 2015-10-05T07:20:34.116+0100 [mongosMain] connection accepted from 172.28.0.163:58045 #1428605 (400 connections now open) 2015-10-05T07:20:34.118+0100 [conn1428605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:34.661+0100 [conn1428224] end connection 172.28.0.163:56811 (399 connections now open) 2015-10-05T07:20:34.663+0100 [mongosMain] connection accepted from 172.28.0.163:58047 #1428606 (400 connections now open) 2015-10-05T07:20:34.663+0100 [conn1428606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:35.423+0100 [conn1428194] end connection 172.28.0.164:49647 (399 connections now open) 2015-10-05T07:20:35.424+0100 [mongosMain] connection accepted from 172.28.0.164:51320 #1428607 (400 connections now open) 2015-10-05T07:20:35.425+0100 [conn1428607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:36.646+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:37.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:37.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:39.477+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:39.477+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:39.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216b75703b51053ece4e7 2015-10-05T07:20:39.613+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:39.935+0100 [mongosMain] connection accepted from 127.0.0.1:58053 #1428608 (401 connections now open) 2015-10-05T07:20:39.938+0100 [conn1428608] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:39.943+0100 [conn1428608] end connection 127.0.0.1:58053 (400 connections now open) 2015-10-05T07:20:40.433+0100 [conn1428206] end connection 172.28.0.163:56695 (399 connections now open) 2015-10-05T07:20:40.434+0100 [mongosMain] connection accepted from 172.28.0.163:58054 #1428609 (400 connections now open) 2015-10-05T07:20:40.435+0100 [conn1428609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:40.931+0100 [conn1428202] end connection 172.28.0.164:49670 (399 connections now open) 2015-10-05T07:20:40.932+0100 [mongosMain] connection accepted from 172.28.0.164:51330 #1428610 (400 connections now open) 2015-10-05T07:20:40.934+0100 [conn1428610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:42.488+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:42.488+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:44.130+0100 [conn1428215] end connection 172.28.0.163:56722 (399 connections now open) 2015-10-05T07:20:44.131+0100 [mongosMain] connection accepted from 172.28.0.163:58065 #1428611 (400 connections now open) 2015-10-05T07:20:44.132+0100 [conn1428611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:44.676+0100 [conn1428230] end connection 172.28.0.163:56826 (399 connections now open) 2015-10-05T07:20:44.677+0100 [mongosMain] connection accepted from 172.28.0.163:58067 #1428612 (400 connections now open) 2015-10-05T07:20:44.678+0100 [conn1428612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:44.924+0100 [conn1428171] end connection 172.28.0.164:49575 (399 connections now open) 2015-10-05T07:20:44.926+0100 [mongosMain] connection accepted from 172.28.0.164:51338 #1428613 (400 connections now open) 2015-10-05T07:20:44.928+0100 [conn1428613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:45.424+0100 [conn1428231] end connection 172.28.0.164:49826 (399 connections now open) 2015-10-05T07:20:45.425+0100 [mongosMain] connection accepted from 172.28.0.164:51341 #1428614 (400 connections now open) 2015-10-05T07:20:45.427+0100 [conn1428614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:46.491+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:46.491+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:47.772+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:50.448+0100 [conn1428195] end connection 172.28.0.163:56650 (399 connections now open) 2015-10-05T07:20:50.449+0100 [mongosMain] connection accepted from 172.28.0.163:58077 #1428615 (400 connections now open) 2015-10-05T07:20:50.450+0100 [conn1428615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:50.931+0100 [conn1428179] end connection 172.28.0.164:49597 (399 connections now open) 2015-10-05T07:20:50.931+0100 [conn1428149] end connection 172.28.0.164:49493 (398 connections now open) 2015-10-05T07:20:50.932+0100 [mongosMain] connection accepted from 172.28.0.164:51348 #1428616 (399 connections now open) 2015-10-05T07:20:50.933+0100 [mongosMain] connection accepted from 172.28.0.164:51349 #1428617 (400 connections now open) 2015-10-05T07:20:50.934+0100 [conn1428616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:50.935+0100 [conn1428617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:51.495+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:51.495+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:51.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216c35703b51053ece59f 2015-10-05T07:20:52.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:20:54.146+0100 [conn1428229] end connection 172.28.0.163:56824 (399 connections now open) 2015-10-05T07:20:54.147+0100 [mongosMain] connection accepted from 172.28.0.163:58083 #1428618 (400 connections now open) 2015-10-05T07:20:54.148+0100 [conn1428618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:54.941+0100 [conn1428205] end connection 172.28.0.164:49679 (399 connections now open) 2015-10-05T07:20:54.942+0100 [mongosMain] connection accepted from 172.28.0.164:51357 #1428619 (400 connections now open) 2015-10-05T07:20:54.944+0100 [conn1428619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:55.439+0100 [conn1428237] end connection 172.28.0.164:49845 (399 connections now open) 2015-10-05T07:20:55.440+0100 [mongosMain] connection accepted from 172.28.0.164:51360 #1428620 (400 connections now open) 2015-10-05T07:20:55.442+0100 [conn1428620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:20:57.578+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:20:57.578+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:20:58.855+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:00.449+0100 [conn1428053] end connection 172.28.0.163:56256 (399 connections now open) 2015-10-05T07:21:00.449+0100 [conn1428221] end connection 172.28.0.163:56801 (399 connections now open) 2015-10-05T07:21:00.450+0100 [mongosMain] connection accepted from 172.28.0.163:58099 #1428621 (399 connections now open) 2015-10-05T07:21:00.451+0100 [mongosMain] connection accepted from 172.28.0.163:58100 #1428622 (400 connections now open) 2015-10-05T07:21:00.451+0100 [conn1428621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:00.451+0100 [conn1428622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:00.946+0100 [conn1428222] end connection 172.28.0.164:49794 (399 connections now open) 2015-10-05T07:21:00.947+0100 [mongosMain] connection accepted from 172.28.0.164:51364 #1428623 (400 connections now open) 2015-10-05T07:21:00.949+0100 [conn1428623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:03.489+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:21:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:21:04.147+0100 [conn1428211] end connection 172.28.0.163:56712 (399 connections now open) 2015-10-05T07:21:04.148+0100 [mongosMain] connection accepted from 172.28.0.163:58107 #1428624 (400 connections now open) 2015-10-05T07:21:04.149+0100 [conn1428624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:04.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216d05703b51053ece650 2015-10-05T07:21:04.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:04.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:04.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:04.736+0100 [conn1428236] end connection 172.28.0.163:56844 (399 connections now open) 2015-10-05T07:21:04.736+0100 [mongosMain] connection accepted from 172.28.0.163:58109 #1428625 (400 connections now open) 2015-10-05T07:21:04.736+0100 [conn1428625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:05.469+0100 [conn1428241] end connection 172.28.0.164:49864 (399 connections now open) 2015-10-05T07:21:05.469+0100 [mongosMain] connection accepted from 172.28.0.164:51369 #1428626 (400 connections now open) 2015-10-05T07:21:05.485+0100 [conn1428626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:09.966+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:10.464+0100 [conn1428233] end connection 172.28.0.163:56833 (399 connections now open) 2015-10-05T07:21:10.464+0100 [conn1428098] end connection 172.28.0.163:56371 (399 connections now open) 2015-10-05T07:21:10.465+0100 [mongosMain] connection accepted from 172.28.0.163:58123 #1428627 (399 connections now open) 2015-10-05T07:21:10.465+0100 [mongosMain] connection accepted from 172.28.0.163:58124 #1428628 (400 connections now open) 2015-10-05T07:21:10.465+0100 [conn1428627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:10.466+0100 [conn1428628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:10.961+0100 [conn1428227] end connection 172.28.0.164:49812 (399 connections now open) 2015-10-05T07:21:10.961+0100 [mongosMain] connection accepted from 172.28.0.164:51380 #1428629 (400 connections now open) 2015-10-05T07:21:10.963+0100 [conn1428629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:12.679+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:12.679+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:14.708+0100 [conn1428245] end connection 172.28.0.163:56889 (399 connections now open) 2015-10-05T07:21:14.709+0100 [mongosMain] connection accepted from 172.28.0.163:58130 #1428630 (400 connections now open) 2015-10-05T07:21:14.710+0100 [conn1428630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:15.471+0100 [conn1428247] end connection 172.28.0.164:49880 (399 connections now open) 2015-10-05T07:21:15.472+0100 [mongosMain] connection accepted from 172.28.0.164:51387 #1428631 (400 connections now open) 2015-10-05T07:21:15.474+0100 [conn1428631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:16.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216dc5703b51053ece751 2015-10-05T07:21:16.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:20.478+0100 [conn1428168] end connection 172.28.0.163:56561 (399 connections now open) 2015-10-05T07:21:20.479+0100 [mongosMain] connection accepted from 172.28.0.163:58135 #1428632 (400 connections now open) 2015-10-05T07:21:20.480+0100 [conn1428632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:20.976+0100 [conn1428169] end connection 172.28.0.164:49566 (399 connections now open) 2015-10-05T07:21:20.977+0100 [mongosMain] connection accepted from 172.28.0.164:51398 #1428633 (400 connections now open) 2015-10-05T07:21:20.979+0100 [conn1428633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:21.052+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:21.684+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:21.684+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:24.169+0100 [conn1428235] end connection 172.28.0.163:56843 (399 connections now open) 2015-10-05T07:21:24.170+0100 [mongosMain] connection accepted from 172.28.0.163:58140 #1428634 (400 connections now open) 2015-10-05T07:21:24.172+0100 [conn1428634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:24.715+0100 [conn1428251] end connection 172.28.0.163:56905 (399 connections now open) 2015-10-05T07:21:24.716+0100 [mongosMain] connection accepted from 172.28.0.163:58142 #1428635 (400 connections now open) 2015-10-05T07:21:24.718+0100 [conn1428635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:24.971+0100 [conn1428137] end connection 172.28.0.164:49471 (399 connections now open) 2015-10-05T07:21:24.972+0100 [mongosMain] connection accepted from 172.28.0.164:51406 #1428636 (400 connections now open) 2015-10-05T07:21:24.974+0100 [conn1428636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:25.486+0100 [conn1428253] end connection 172.28.0.164:49893 (399 connections now open) 2015-10-05T07:21:25.487+0100 [mongosMain] connection accepted from 172.28.0.164:51408 #1428637 (400 connections now open) 2015-10-05T07:21:25.489+0100 [conn1428637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:28.463+0100 [mongosMain] connection accepted from 127.0.0.1:58145 #1428638 (401 connections now open) 2015-10-05T07:21:28.466+0100 [conn1428638] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:28.472+0100 [conn1428638] end connection 127.0.0.1:58145 (400 connections now open) 2015-10-05T07:21:29.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216e85703b51053ece7f1 2015-10-05T07:21:29.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:30.484+0100 [conn1428226] end connection 172.28.0.163:56818 (399 connections now open) 2015-10-05T07:21:30.485+0100 [mongosMain] connection accepted from 172.28.0.163:58146 #1428639 (400 connections now open) 2015-10-05T07:21:30.486+0100 [conn1428639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:30.992+0100 [conn1428196] end connection 172.28.0.164:49653 (399 connections now open) 2015-10-05T07:21:30.992+0100 [conn1428197] end connection 172.28.0.164:49654 (399 connections now open) 2015-10-05T07:21:30.993+0100 [mongosMain] connection accepted from 172.28.0.164:51422 #1428640 (399 connections now open) 2015-10-05T07:21:30.993+0100 [mongosMain] connection accepted from 172.28.0.164:51423 #1428641 (400 connections now open) 2015-10-05T07:21:30.994+0100 [conn1428640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:30.995+0100 [conn1428641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:31.688+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:31.688+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:32.130+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:33.625+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:21:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:21:34.178+0100 [conn1428223] end connection 172.28.0.163:56809 (399 connections now open) 2015-10-05T07:21:34.179+0100 [mongosMain] connection accepted from 172.28.0.163:58152 #1428642 (400 connections now open) 2015-10-05T07:21:34.180+0100 [conn1428642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:34.724+0100 [conn1428257] end connection 172.28.0.163:56917 (399 connections now open) 2015-10-05T07:21:34.725+0100 [mongosMain] connection accepted from 172.28.0.163:58154 #1428643 (400 connections now open) 2015-10-05T07:21:34.726+0100 [conn1428643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:34.971+0100 [conn1428252] end connection 172.28.0.164:49891 (399 connections now open) 2015-10-05T07:21:34.972+0100 [mongosMain] connection accepted from 172.28.0.164:51431 #1428644 (400 connections now open) 2015-10-05T07:21:34.974+0100 [conn1428644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:35.501+0100 [conn1428259] end connection 172.28.0.164:49912 (399 connections now open) 2015-10-05T07:21:35.503+0100 [mongosMain] connection accepted from 172.28.0.164:51433 #1428645 (400 connections now open) 2015-10-05T07:21:35.504+0100 [conn1428645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:39.358+0100 [mongosMain] connection accepted from 127.0.0.1:58157 #1428646 (401 connections now open) 2015-10-05T07:21:39.360+0100 [conn1428646] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:39.365+0100 [conn1428646] end connection 127.0.0.1:58157 (400 connections now open) 2015-10-05T07:21:40.495+0100 [conn1428213] end connection 172.28.0.163:56717 (399 connections now open) 2015-10-05T07:21:40.496+0100 [mongosMain] connection accepted from 172.28.0.163:58159 #1428647 (400 connections now open) 2015-10-05T07:21:40.497+0100 [conn1428647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:41.007+0100 [conn1428203] end connection 172.28.0.164:49671 (399 connections now open) 2015-10-05T07:21:41.007+0100 [conn1428243] end connection 172.28.0.164:49869 (398 connections now open) 2015-10-05T07:21:41.008+0100 [mongosMain] connection accepted from 172.28.0.164:51444 #1428648 (399 connections now open) 2015-10-05T07:21:41.008+0100 [mongosMain] connection accepted from 172.28.0.164:51445 #1428649 (400 connections now open) 2015-10-05T07:21:41.009+0100 [conn1428648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:41.009+0100 [conn1428649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:41.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216f55703b51053ece890 2015-10-05T07:21:41.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:42.740+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:42.740+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:43.231+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:44.178+0100 [conn1428240] end connection 172.28.0.163:56861 (399 connections now open) 2015-10-05T07:21:44.180+0100 [mongosMain] connection accepted from 172.28.0.163:58167 #1428650 (400 connections now open) 2015-10-05T07:21:44.181+0100 [conn1428650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:44.724+0100 [conn1428266] end connection 172.28.0.163:56926 (399 connections now open) 2015-10-05T07:21:44.725+0100 [mongosMain] connection accepted from 172.28.0.163:58169 #1428651 (400 connections now open) 2015-10-05T07:21:44.725+0100 [conn1428651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:45.518+0100 [conn1428268] end connection 172.28.0.164:49933 (399 connections now open) 2015-10-05T07:21:45.519+0100 [mongosMain] connection accepted from 172.28.0.164:51453 #1428652 (400 connections now open) 2015-10-05T07:21:45.521+0100 [conn1428652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:47.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561216fb5703b51053ece8e8 2015-10-05T07:21:47.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:50.499+0100 [conn1428238] end connection 172.28.0.163:56854 (399 connections now open) 2015-10-05T07:21:50.500+0100 [mongosMain] connection accepted from 172.28.0.163:58178 #1428653 (400 connections now open) 2015-10-05T07:21:50.501+0100 [conn1428653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:51.023+0100 [conn1428134] end connection 172.28.0.164:49459 (399 connections now open) 2015-10-05T07:21:51.024+0100 [conn1428234] end connection 172.28.0.164:49836 (398 connections now open) 2015-10-05T07:21:51.024+0100 [mongosMain] connection accepted from 172.28.0.164:51463 #1428654 (399 connections now open) 2015-10-05T07:21:51.025+0100 [mongosMain] connection accepted from 172.28.0.164:51464 #1428655 (400 connections now open) 2015-10-05T07:21:51.027+0100 [conn1428654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:51.027+0100 [conn1428655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:53.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217015703b51053ece93d 2015-10-05T07:21:54.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:21:54.192+0100 [conn1428220] end connection 172.28.0.163:56792 (399 connections now open) 2015-10-05T07:21:54.193+0100 [mongosMain] connection accepted from 172.28.0.163:58186 #1428656 (400 connections now open) 2015-10-05T07:21:54.194+0100 [conn1428656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:54.266+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:54.747+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:54.748+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:55.518+0100 [conn1428276] end connection 172.28.0.164:49956 (399 connections now open) 2015-10-05T07:21:55.519+0100 [mongosMain] connection accepted from 172.28.0.164:51470 #1428657 (400 connections now open) 2015-10-05T07:21:55.520+0100 [conn1428657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:21:56.752+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:56.752+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:21:59.761+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:21:59.761+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:00.511+0100 [conn1428242] end connection 172.28.0.163:56868 (399 connections now open) 2015-10-05T07:22:00.511+0100 [conn1428270] end connection 172.28.0.163:56934 (399 connections now open) 2015-10-05T07:22:00.512+0100 [mongosMain] connection accepted from 172.28.0.163:58197 #1428658 (399 connections now open) 2015-10-05T07:22:00.512+0100 [mongosMain] connection accepted from 172.28.0.163:58196 #1428659 (400 connections now open) 2015-10-05T07:22:00.513+0100 [conn1428658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:00.513+0100 [conn1428659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:01.039+0100 [conn1428207] end connection 172.28.0.164:49684 (399 connections now open) 2015-10-05T07:22:01.039+0100 [conn1428239] end connection 172.28.0.164:49853 (398 connections now open) 2015-10-05T07:22:01.040+0100 [mongosMain] connection accepted from 172.28.0.164:51475 #1428660 (399 connections now open) 2015-10-05T07:22:01.040+0100 [mongosMain] connection accepted from 172.28.0.164:51476 #1428661 (400 connections now open) 2015-10-05T07:22:01.042+0100 [conn1428660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:01.042+0100 [conn1428661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:03.764+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:03.764+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:03.889+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:22:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:22:04.196+0100 [conn1428250] end connection 172.28.0.163:56902 (399 connections now open) 2015-10-05T07:22:04.197+0100 [mongosMain] connection accepted from 172.28.0.163:58204 #1428662 (400 connections now open) 2015-10-05T07:22:04.198+0100 [conn1428662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:04.742+0100 [conn1428282] end connection 172.28.0.163:56969 (399 connections now open) 2015-10-05T07:22:04.744+0100 [mongosMain] connection accepted from 172.28.0.163:58209 #1428663 (400 connections now open) 2015-10-05T07:22:04.745+0100 [conn1428663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:05.003+0100 [conn1428275] end connection 172.28.0.164:49953 (399 connections now open) 2015-10-05T07:22:05.004+0100 [mongosMain] connection accepted from 172.28.0.164:51487 #1428664 (400 connections now open) 2015-10-05T07:22:05.006+0100 [conn1428664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:05.270+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:05.533+0100 [conn1428283] end connection 172.28.0.164:49975 (399 connections now open) 2015-10-05T07:22:05.534+0100 [mongosMain] connection accepted from 172.28.0.164:51489 #1428665 (400 connections now open) 2015-10-05T07:22:05.536+0100 [conn1428665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:08.789+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:08.789+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:10.510+0100 [conn1428254] end connection 172.28.0.163:56909 (399 connections now open) 2015-10-05T07:22:10.510+0100 [conn1428125] end connection 172.28.0.163:56438 (399 connections now open) 2015-10-05T07:22:10.511+0100 [mongosMain] connection accepted from 172.28.0.163:58223 #1428666 (399 connections now open) 2015-10-05T07:22:10.512+0100 [mongosMain] connection accepted from 172.28.0.163:58224 #1428667 (400 connections now open) 2015-10-05T07:22:10.512+0100 [conn1428666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:10.512+0100 [conn1428667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:11.039+0100 [conn1428255] end connection 172.28.0.164:49903 (399 connections now open) 2015-10-05T07:22:11.039+0100 [mongosMain] connection accepted from 172.28.0.164:51498 #1428668 (400 connections now open) 2015-10-05T07:22:11.041+0100 [conn1428668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:11.051+0100 [conn1428228] end connection 172.28.0.164:49813 (399 connections now open) 2015-10-05T07:22:11.052+0100 [mongosMain] connection accepted from 172.28.0.164:51499 #1428669 (400 connections now open) 2015-10-05T07:22:11.054+0100 [conn1428669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:12.360+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:22:12.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:22:14.209+0100 [conn1428265] end connection 172.28.0.163:56924 (399 connections now open) 2015-10-05T07:22:14.210+0100 [mongosMain] connection accepted from 172.28.0.163:58231 #1428670 (400 connections now open) 2015-10-05T07:22:14.211+0100 [conn1428670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:14.755+0100 [conn1428274] end connection 172.28.0.163:56944 (399 connections now open) 2015-10-05T07:22:14.756+0100 [mongosMain] connection accepted from 172.28.0.163:58233 #1428671 (400 connections now open) 2015-10-05T07:22:14.757+0100 [conn1428671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:14.793+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:14.793+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:15.002+0100 [conn1428187] end connection 172.28.0.164:49624 (399 connections now open) 2015-10-05T07:22:15.003+0100 [mongosMain] connection accepted from 172.28.0.164:51504 #1428672 (400 connections now open) 2015-10-05T07:22:15.005+0100 [conn1428672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:15.534+0100 [conn1428290] end connection 172.28.0.164:50002 (399 connections now open) 2015-10-05T07:22:15.535+0100 [mongosMain] connection accepted from 172.28.0.164:51507 #1428673 (400 connections now open) 2015-10-05T07:22:15.537+0100 [conn1428673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:16.283+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:18.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612171a5703b51053eceaf7 2015-10-05T07:22:18.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:22:20.527+0100 [conn1428285] end connection 172.28.0.163:56982 (399 connections now open) 2015-10-05T07:22:20.527+0100 [conn1428248] end connection 172.28.0.163:56896 (399 connections now open) 2015-10-05T07:22:20.528+0100 [mongosMain] connection accepted from 172.28.0.163:58239 #1428674 (399 connections now open) 2015-10-05T07:22:20.528+0100 [mongosMain] connection accepted from 172.28.0.163:58240 #1428675 (400 connections now open) 2015-10-05T07:22:20.529+0100 [conn1428674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:20.529+0100 [conn1428675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:21.055+0100 [conn1428263] end connection 172.28.0.164:49924 (399 connections now open) 2015-10-05T07:22:21.055+0100 [conn1428249] end connection 172.28.0.164:49887 (399 connections now open) 2015-10-05T07:22:21.056+0100 [mongosMain] connection accepted from 172.28.0.164:51517 #1428676 (399 connections now open) 2015-10-05T07:22:21.057+0100 [mongosMain] connection accepted from 172.28.0.164:51518 #1428677 (400 connections now open) 2015-10-05T07:22:21.058+0100 [conn1428676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:21.058+0100 [conn1428677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:21.891+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:21.891+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:24.225+0100 [conn1428244] end connection 172.28.0.163:56887 (399 connections now open) 2015-10-05T07:22:24.226+0100 [mongosMain] connection accepted from 172.28.0.163:58245 #1428678 (400 connections now open) 2015-10-05T07:22:24.227+0100 [conn1428678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:24.771+0100 [conn1428288] end connection 172.28.0.163:57000 (399 connections now open) 2015-10-05T07:22:24.772+0100 [mongosMain] connection accepted from 172.28.0.163:58247 #1428679 (400 connections now open) 2015-10-05T07:22:24.773+0100 [conn1428679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:24.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217205703b51053eceb8a 2015-10-05T07:22:24.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:22:25.018+0100 [conn1428258] end connection 172.28.0.164:49910 (399 connections now open) 2015-10-05T07:22:25.019+0100 [mongosMain] connection accepted from 172.28.0.164:51525 #1428680 (400 connections now open) 2015-10-05T07:22:25.021+0100 [conn1428680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:25.550+0100 [conn1428297] end connection 172.28.0.164:50011 (399 connections now open) 2015-10-05T07:22:25.551+0100 [mongosMain] connection accepted from 172.28.0.164:51527 #1428681 (400 connections now open) 2015-10-05T07:22:25.554+0100 [conn1428681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:27.287+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:28.217+0100 [mongosMain] connection accepted from 127.0.0.1:58250 #1428682 (401 connections now open) 2015-10-05T07:22:28.220+0100 [conn1428682] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:28.230+0100 [conn1428682] end connection 127.0.0.1:58250 (400 connections now open) 2015-10-05T07:22:29.904+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:29.904+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:30.527+0100 [conn1428164] end connection 172.28.0.163:56543 (399 connections now open) 2015-10-05T07:22:30.528+0100 [mongosMain] connection accepted from 172.28.0.163:58252 #1428683 (400 connections now open) 2015-10-05T07:22:30.528+0100 [conn1428683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:31.132+0100 [conn1428279] end connection 172.28.0.164:49966 (399 connections now open) 2015-10-05T07:22:31.134+0100 [mongosMain] connection accepted from 172.28.0.164:51537 #1428684 (400 connections now open) 2015-10-05T07:22:31.136+0100 [conn1428684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:34.036+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:22:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:22:34.224+0100 [conn1428273] end connection 172.28.0.163:56942 (399 connections now open) 2015-10-05T07:22:34.225+0100 [mongosMain] connection accepted from 172.28.0.163:58255 #1428685 (400 connections now open) 2015-10-05T07:22:34.226+0100 [conn1428685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:34.771+0100 [conn1428295] end connection 172.28.0.163:57019 (399 connections now open) 2015-10-05T07:22:34.772+0100 [mongosMain] connection accepted from 172.28.0.163:58257 #1428686 (400 connections now open) 2015-10-05T07:22:34.773+0100 [conn1428686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:35.034+0100 [conn1428181] end connection 172.28.0.164:49605 (399 connections now open) 2015-10-05T07:22:35.035+0100 [mongosMain] connection accepted from 172.28.0.164:51544 #1428687 (400 connections now open) 2015-10-05T07:22:35.037+0100 [conn1428687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:35.564+0100 [conn1428304] end connection 172.28.0.164:50031 (399 connections now open) 2015-10-05T07:22:35.566+0100 [mongosMain] connection accepted from 172.28.0.164:51547 #1428688 (400 connections now open) 2015-10-05T07:22:35.568+0100 [conn1428688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:37.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612172d5703b51053ecec50 2015-10-05T07:22:37.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:22:38.295+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:38.909+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:38.909+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:39.248+0100 [mongosMain] connection accepted from 127.0.0.1:58263 #1428689 (401 connections now open) 2015-10-05T07:22:39.251+0100 [conn1428689] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:39.255+0100 [conn1428689] end connection 127.0.0.1:58263 (400 connections now open) 2015-10-05T07:22:40.543+0100 [conn1428262] end connection 172.28.0.163:56922 (399 connections now open) 2015-10-05T07:22:40.544+0100 [mongosMain] connection accepted from 172.28.0.163:58264 #1428690 (400 connections now open) 2015-10-05T07:22:40.545+0100 [conn1428690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:41.133+0100 [conn1428264] end connection 172.28.0.164:49923 (399 connections now open) 2015-10-05T07:22:41.134+0100 [conn1428299] end connection 172.28.0.164:50020 (398 connections now open) 2015-10-05T07:22:41.140+0100 [mongosMain] connection accepted from 172.28.0.164:51556 #1428691 (399 connections now open) 2015-10-05T07:22:41.140+0100 [mongosMain] connection accepted from 172.28.0.164:51558 #1428692 (400 connections now open) 2015-10-05T07:22:41.142+0100 [conn1428691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:41.143+0100 [conn1428692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:44.241+0100 [conn1428281] end connection 172.28.0.163:56967 (399 connections now open) 2015-10-05T07:22:44.242+0100 [mongosMain] connection accepted from 172.28.0.163:58270 #1428693 (400 connections now open) 2015-10-05T07:22:44.244+0100 [conn1428693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:44.788+0100 [conn1428302] end connection 172.28.0.163:57034 (399 connections now open) 2015-10-05T07:22:44.789+0100 [mongosMain] connection accepted from 172.28.0.163:58273 #1428694 (400 connections now open) 2015-10-05T07:22:44.790+0100 [conn1428694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:45.050+0100 [conn1428200] end connection 172.28.0.164:49662 (399 connections now open) 2015-10-05T07:22:45.051+0100 [mongosMain] connection accepted from 172.28.0.164:51566 #1428695 (400 connections now open) 2015-10-05T07:22:45.053+0100 [conn1428695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:45.581+0100 [conn1428312] end connection 172.28.0.164:50050 (399 connections now open) 2015-10-05T07:22:45.583+0100 [mongosMain] connection accepted from 172.28.0.164:51568 #1428696 (400 connections now open) 2015-10-05T07:22:45.585+0100 [conn1428696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:48.907+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:48.907+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:22:49.302+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:49.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217395703b51053eced30 2015-10-05T07:22:49.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:22:50.764+0100 [conn1428159] end connection 172.28.0.163:56521 (399 connections now open) 2015-10-05T07:22:50.766+0100 [mongosMain] connection accepted from 172.28.0.163:58285 #1428697 (400 connections now open) 2015-10-05T07:22:50.768+0100 [conn1428697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:51.149+0100 [conn1428272] end connection 172.28.0.164:49945 (399 connections now open) 2015-10-05T07:22:51.149+0100 [conn1428120] end connection 172.28.0.164:49417 (398 connections now open) 2015-10-05T07:22:51.150+0100 [mongosMain] connection accepted from 172.28.0.164:51578 #1428698 (399 connections now open) 2015-10-05T07:22:51.150+0100 [mongosMain] connection accepted from 172.28.0.164:51577 #1428699 (400 connections now open) 2015-10-05T07:22:51.151+0100 [conn1428698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:51.151+0100 [conn1428699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:54.242+0100 [conn1428256] end connection 172.28.0.163:56915 (399 connections now open) 2015-10-05T07:22:54.243+0100 [mongosMain] connection accepted from 172.28.0.163:58290 #1428700 (400 connections now open) 2015-10-05T07:22:54.244+0100 [conn1428700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:54.787+0100 [conn1428310] end connection 172.28.0.163:57045 (399 connections now open) 2015-10-05T07:22:54.797+0100 [mongosMain] connection accepted from 172.28.0.163:58293 #1428701 (400 connections now open) 2015-10-05T07:22:54.798+0100 [conn1428701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:55.050+0100 [conn1428296] end connection 172.28.0.164:50009 (399 connections now open) 2015-10-05T07:22:55.051+0100 [mongosMain] connection accepted from 172.28.0.164:51587 #1428702 (400 connections now open) 2015-10-05T07:22:55.052+0100 [conn1428702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:55.596+0100 [conn1428319] end connection 172.28.0.164:50071 (399 connections now open) 2015-10-05T07:22:55.597+0100 [mongosMain] connection accepted from 172.28.0.164:51589 #1428703 (400 connections now open) 2015-10-05T07:22:55.599+0100 [conn1428703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:22:56.249+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:22:56.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:22:59.979+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:22:59.979+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:00.333+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:00.561+0100 [conn1428140] end connection 172.28.0.163:56483 (399 connections now open) 2015-10-05T07:23:00.561+0100 [mongosMain] connection accepted from 172.28.0.163:58315 #1428704 (400 connections now open) 2015-10-05T07:23:00.562+0100 [conn1428704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:01.165+0100 [conn1428280] end connection 172.28.0.164:49967 (399 connections now open) 2015-10-05T07:23:01.165+0100 [conn1428293] end connection 172.28.0.164:50005 (398 connections now open) 2015-10-05T07:23:01.166+0100 [mongosMain] connection accepted from 172.28.0.164:51601 #1428705 (399 connections now open) 2015-10-05T07:23:01.167+0100 [mongosMain] connection accepted from 172.28.0.164:51602 #1428706 (400 connections now open) 2015-10-05T07:23:01.168+0100 [conn1428706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:01.169+0100 [conn1428705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:02.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217465703b51053ecedca 2015-10-05T07:23:02.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:23:04.255+0100 [conn1428309] end connection 172.28.0.163:57043 (399 connections now open) 2015-10-05T07:23:04.256+0100 [mongosMain] connection accepted from 172.28.0.163:58325 #1428707 (400 connections now open) 2015-10-05T07:23:04.257+0100 [conn1428707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:04.303+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:23:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:23:04.802+0100 [conn1428318] end connection 172.28.0.163:57060 (399 connections now open) 2015-10-05T07:23:04.803+0100 [mongosMain] connection accepted from 172.28.0.163:58327 #1428708 (400 connections now open) 2015-10-05T07:23:04.804+0100 [conn1428708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:05.066+0100 [conn1428246] end connection 172.28.0.164:49878 (399 connections now open) 2015-10-05T07:23:05.067+0100 [mongosMain] connection accepted from 172.28.0.164:51607 #1428709 (400 connections now open) 2015-10-05T07:23:05.069+0100 [conn1428709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:05.611+0100 [conn1428326] end connection 172.28.0.164:50089 (399 connections now open) 2015-10-05T07:23:05.613+0100 [mongosMain] connection accepted from 172.28.0.164:51610 #1428710 (400 connections now open) 2015-10-05T07:23:05.614+0100 [conn1428710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:10.574+0100 [conn1427795] end connection 172.28.0.163:55496 (399 connections now open) 2015-10-05T07:23:10.575+0100 [mongosMain] connection accepted from 172.28.0.163:58342 #1428711 (400 connections now open) 2015-10-05T07:23:10.576+0100 [conn1428711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:11.181+0100 [conn1428286] end connection 172.28.0.164:49987 (399 connections now open) 2015-10-05T07:23:11.181+0100 [conn1428308] end connection 172.28.0.164:50038 (399 connections now open) 2015-10-05T07:23:11.182+0100 [mongosMain] connection accepted from 172.28.0.164:51626 #1428712 (399 connections now open) 2015-10-05T07:23:11.182+0100 [mongosMain] connection accepted from 172.28.0.164:51627 #1428713 (400 connections now open) 2015-10-05T07:23:11.184+0100 [conn1428712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:11.184+0100 [conn1428713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:11.351+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:11.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:11.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:14.038+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:14.038+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:14.257+0100 [conn1428330] end connection 172.28.0.163:57109 (399 connections now open) 2015-10-05T07:23:14.258+0100 [mongosMain] connection accepted from 172.28.0.163:58349 #1428714 (400 connections now open) 2015-10-05T07:23:14.259+0100 [conn1428714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:14.803+0100 [conn1428324] end connection 172.28.0.163:57080 (399 connections now open) 2015-10-05T07:23:14.804+0100 [mongosMain] connection accepted from 172.28.0.163:58352 #1428715 (400 connections now open) 2015-10-05T07:23:14.805+0100 [conn1428715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:14.916+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217525703b51053ecee49 2015-10-05T07:23:15.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:23:15.611+0100 [conn1428333] end connection 172.28.0.164:50104 (399 connections now open) 2015-10-05T07:23:15.612+0100 [mongosMain] connection accepted from 172.28.0.164:51631 #1428716 (400 connections now open) 2015-10-05T07:23:15.614+0100 [conn1428716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:17.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:17.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:20.608+0100 [conn1428284] end connection 172.28.0.163:56981 (399 connections now open) 2015-10-05T07:23:20.608+0100 [conn1428306] end connection 172.28.0.163:57039 (399 connections now open) 2015-10-05T07:23:20.609+0100 [mongosMain] connection accepted from 172.28.0.163:58362 #1428717 (399 connections now open) 2015-10-05T07:23:20.610+0100 [mongosMain] connection accepted from 172.28.0.163:58361 #1428718 (400 connections now open) 2015-10-05T07:23:20.611+0100 [conn1428717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:20.611+0100 [conn1428718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:21.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:21.072+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:21.186+0100 [conn1428300] end connection 172.28.0.164:50021 (399 connections now open) 2015-10-05T07:23:21.187+0100 [conn1428292] end connection 172.28.0.164:50006 (398 connections now open) 2015-10-05T07:23:21.188+0100 [mongosMain] connection accepted from 172.28.0.164:51641 #1428719 (399 connections now open) 2015-10-05T07:23:21.188+0100 [mongosMain] connection accepted from 172.28.0.164:51640 #1428720 (400 connections now open) 2015-10-05T07:23:21.189+0100 [conn1428719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:21.190+0100 [conn1428720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:22.366+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:24.272+0100 [conn1428287] end connection 172.28.0.163:56998 (399 connections now open) 2015-10-05T07:23:24.273+0100 [mongosMain] connection accepted from 172.28.0.163:58368 #1428721 (400 connections now open) 2015-10-05T07:23:24.274+0100 [conn1428721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:24.818+0100 [conn1428331] end connection 172.28.0.163:57111 (399 connections now open) 2015-10-05T07:23:24.819+0100 [mongosMain] connection accepted from 172.28.0.163:58370 #1428722 (400 connections now open) 2015-10-05T07:23:24.820+0100 [conn1428722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:25.612+0100 [conn1428339] end connection 172.28.0.164:50113 (399 connections now open) 2015-10-05T07:23:25.613+0100 [mongosMain] connection accepted from 172.28.0.164:51653 #1428723 (400 connections now open) 2015-10-05T07:23:25.615+0100 [conn1428723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:26.076+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:26.076+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:27.267+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612175f5703b51053eceec1 2015-10-05T07:23:27.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:23:27.466+0100 [mongosMain] connection accepted from 127.0.0.1:58374 #1428724 (401 connections now open) 2015-10-05T07:23:27.469+0100 [conn1428724] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:27.474+0100 [conn1428724] end connection 127.0.0.1:58374 (400 connections now open) 2015-10-05T07:23:28.729+0100 [mongosMain] connection accepted from 127.0.0.1:58375 #1428725 (401 connections now open) 2015-10-05T07:23:28.732+0100 [conn1428725] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:28.737+0100 [conn1428725] end connection 127.0.0.1:58375 (400 connections now open) 2015-10-05T07:23:29.814+0100 [mongosMain] connection accepted from 127.0.0.1:58378 #1428726 (401 connections now open) 2015-10-05T07:23:29.816+0100 [conn1428726] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:29.821+0100 [conn1428726] end connection 127.0.0.1:58378 (400 connections now open) 2015-10-05T07:23:30.621+0100 [conn1428277] end connection 172.28.0.163:56960 (399 connections now open) 2015-10-05T07:23:30.622+0100 [conn1428278] end connection 172.28.0.163:56961 (398 connections now open) 2015-10-05T07:23:30.623+0100 [mongosMain] connection accepted from 172.28.0.163:58380 #1428727 (399 connections now open) 2015-10-05T07:23:30.623+0100 [mongosMain] connection accepted from 172.28.0.163:58381 #1428728 (400 connections now open) 2015-10-05T07:23:30.624+0100 [conn1428727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:30.625+0100 [conn1428728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:31.196+0100 [conn1428271] end connection 172.28.0.164:49944 (399 connections now open) 2015-10-05T07:23:31.197+0100 [conn1428321] end connection 172.28.0.164:50079 (398 connections now open) 2015-10-05T07:23:31.197+0100 [mongosMain] connection accepted from 172.28.0.164:51662 #1428729 (400 connections now open) 2015-10-05T07:23:31.198+0100 [mongosMain] connection accepted from 172.28.0.164:51663 #1428730 (400 connections now open) 2015-10-05T07:23:31.200+0100 [conn1428729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:31.200+0100 [conn1428730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:32.091+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:32.091+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:33.479+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:34.273+0100 [conn1428323] end connection 172.28.0.163:57078 (399 connections now open) 2015-10-05T07:23:34.274+0100 [mongosMain] connection accepted from 172.28.0.163:58386 #1428731 (400 connections now open) 2015-10-05T07:23:34.275+0100 [conn1428731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:34.567+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:23:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:23:34.820+0100 [conn1428338] end connection 172.28.0.163:57129 (399 connections now open) 2015-10-05T07:23:34.821+0100 [mongosMain] connection accepted from 172.28.0.163:58388 #1428732 (400 connections now open) 2015-10-05T07:23:34.822+0100 [conn1428732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:35.082+0100 [conn1428267] end connection 172.28.0.164:49930 (399 connections now open) 2015-10-05T07:23:35.083+0100 [mongosMain] connection accepted from 172.28.0.164:51670 #1428733 (400 connections now open) 2015-10-05T07:23:35.086+0100 [conn1428733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:35.627+0100 [conn1428347] end connection 172.28.0.164:50133 (399 connections now open) 2015-10-05T07:23:35.629+0100 [mongosMain] connection accepted from 172.28.0.164:51672 #1428734 (400 connections now open) 2015-10-05T07:23:35.630+0100 [conn1428734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:39.092+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:39.093+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:39.581+0100 [mongosMain] connection accepted from 127.0.0.1:58392 #1428735 (401 connections now open) 2015-10-05T07:23:39.583+0100 [conn1428735] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:39.588+0100 [conn1428735] end connection 127.0.0.1:58392 (400 connections now open) 2015-10-05T07:23:39.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612176b5703b51053ecef30 2015-10-05T07:23:39.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:23:40.621+0100 [conn1428132] end connection 172.28.0.163:56455 (399 connections now open) 2015-10-05T07:23:40.622+0100 [conn1428261] end connection 172.28.0.163:56921 (399 connections now open) 2015-10-05T07:23:40.622+0100 [mongosMain] connection accepted from 172.28.0.163:58393 #1428736 (399 connections now open) 2015-10-05T07:23:40.623+0100 [mongosMain] connection accepted from 172.28.0.163:58394 #1428737 (400 connections now open) 2015-10-05T07:23:40.623+0100 [conn1428736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:40.624+0100 [conn1428737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:41.196+0100 [conn1428315] end connection 172.28.0.164:50061 (399 connections now open) 2015-10-05T07:23:41.197+0100 [conn1428322] end connection 172.28.0.164:50080 (398 connections now open) 2015-10-05T07:23:41.197+0100 [mongosMain] connection accepted from 172.28.0.164:51684 #1428738 (399 connections now open) 2015-10-05T07:23:41.198+0100 [mongosMain] connection accepted from 172.28.0.164:51685 #1428739 (400 connections now open) 2015-10-05T07:23:41.199+0100 [conn1428738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:41.200+0100 [conn1428739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:44.293+0100 [conn1428317] end connection 172.28.0.163:57057 (399 connections now open) 2015-10-05T07:23:44.294+0100 [mongosMain] connection accepted from 172.28.0.163:58409 #1428740 (400 connections now open) 2015-10-05T07:23:44.295+0100 [conn1428740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:44.490+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:44.834+0100 [conn1428345] end connection 172.28.0.163:57143 (399 connections now open) 2015-10-05T07:23:44.835+0100 [mongosMain] connection accepted from 172.28.0.163:58411 #1428741 (400 connections now open) 2015-10-05T07:23:44.837+0100 [conn1428741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:45.097+0100 [conn1428325] end connection 172.28.0.164:50085 (399 connections now open) 2015-10-05T07:23:45.098+0100 [mongosMain] connection accepted from 172.28.0.164:51696 #1428742 (400 connections now open) 2015-10-05T07:23:45.100+0100 [conn1428742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:45.647+0100 [conn1428356] end connection 172.28.0.164:50155 (399 connections now open) 2015-10-05T07:23:45.648+0100 [mongosMain] connection accepted from 172.28.0.164:51698 #1428743 (400 connections now open) 2015-10-05T07:23:45.649+0100 [conn1428743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:47.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:47.098+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:23:50.637+0100 [conn1428041] end connection 172.28.0.163:56213 (399 connections now open) 2015-10-05T07:23:50.637+0100 [conn1428350] end connection 172.28.0.163:57149 (399 connections now open) 2015-10-05T07:23:50.638+0100 [mongosMain] connection accepted from 172.28.0.163:58421 #1428744 (399 connections now open) 2015-10-05T07:23:50.638+0100 [mongosMain] connection accepted from 172.28.0.163:58422 #1428745 (400 connections now open) 2015-10-05T07:23:50.639+0100 [conn1428744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:50.639+0100 [conn1428745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:51.249+0100 [conn1428329] end connection 172.28.0.164:50095 (399 connections now open) 2015-10-05T07:23:51.250+0100 [mongosMain] connection accepted from 172.28.0.164:51706 #1428746 (400 connections now open) 2015-10-05T07:23:51.251+0100 [conn1428746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:54.304+0100 [conn1428337] end connection 172.28.0.163:57125 (399 connections now open) 2015-10-05T07:23:54.306+0100 [mongosMain] connection accepted from 172.28.0.163:58429 #1428747 (400 connections now open) 2015-10-05T07:23:54.307+0100 [conn1428747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:54.850+0100 [conn1428354] end connection 172.28.0.163:57155 (399 connections now open) 2015-10-05T07:23:54.851+0100 [mongosMain] connection accepted from 172.28.0.163:58433 #1428748 (400 connections now open) 2015-10-05T07:23:54.853+0100 [conn1428748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:55.097+0100 [conn1428303] end connection 172.28.0.164:50028 (399 connections now open) 2015-10-05T07:23:55.098+0100 [mongosMain] connection accepted from 172.28.0.164:51713 #1428749 (400 connections now open) 2015-10-05T07:23:55.100+0100 [conn1428749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:55.510+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:55.643+0100 [conn1428365] end connection 172.28.0.164:50178 (399 connections now open) 2015-10-05T07:23:55.644+0100 [mongosMain] connection accepted from 172.28.0.164:51715 #1428750 (400 connections now open) 2015-10-05T07:23:55.646+0100 [conn1428750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:23:56.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:23:56.112+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:00.637+0100 [conn1428358] end connection 172.28.0.163:57162 (399 connections now open) 2015-10-05T07:24:00.637+0100 [conn1428291] end connection 172.28.0.163:57012 (399 connections now open) 2015-10-05T07:24:00.638+0100 [mongosMain] connection accepted from 172.28.0.163:58442 #1428751 (399 connections now open) 2015-10-05T07:24:00.638+0100 [mongosMain] connection accepted from 172.28.0.163:58443 #1428752 (400 connections now open) 2015-10-05T07:24:00.639+0100 [conn1428751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:00.639+0100 [conn1428752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:01.213+0100 [conn1428335] end connection 172.28.0.164:50109 (399 connections now open) 2015-10-05T07:24:01.214+0100 [mongosMain] connection accepted from 172.28.0.164:51720 #1428753 (400 connections now open) 2015-10-05T07:24:01.215+0100 [conn1428753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:04.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217835703b51053ecf0d2 2015-10-05T07:24:04.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:04.306+0100 [conn1428294] end connection 172.28.0.163:57017 (399 connections now open) 2015-10-05T07:24:04.306+0100 [mongosMain] connection accepted from 172.28.0.163:58455 #1428754 (400 connections now open) 2015-10-05T07:24:04.307+0100 [conn1428754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:04.732+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:24:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:24:04.851+0100 [conn1428363] end connection 172.28.0.163:57173 (399 connections now open) 2015-10-05T07:24:04.852+0100 [mongosMain] connection accepted from 172.28.0.163:58459 #1428755 (400 connections now open) 2015-10-05T07:24:04.853+0100 [conn1428755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:05.113+0100 [conn1428332] end connection 172.28.0.164:50102 (399 connections now open) 2015-10-05T07:24:05.114+0100 [mongosMain] connection accepted from 172.28.0.164:51730 #1428756 (400 connections now open) 2015-10-05T07:24:05.115+0100 [conn1428756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:05.658+0100 [conn1428373] end connection 172.28.0.164:50198 (399 connections now open) 2015-10-05T07:24:05.667+0100 [mongosMain] connection accepted from 172.28.0.164:51731 #1428757 (400 connections now open) 2015-10-05T07:24:05.669+0100 [conn1428757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:06.114+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:06.114+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:06.512+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:10.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612178a5703b51053ecf15a 2015-10-05T07:24:10.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:10.653+0100 [conn1428327] end connection 172.28.0.163:57093 (399 connections now open) 2015-10-05T07:24:10.653+0100 [conn1428366] end connection 172.28.0.163:57185 (399 connections now open) 2015-10-05T07:24:10.654+0100 [mongosMain] connection accepted from 172.28.0.163:58471 #1428758 (399 connections now open) 2015-10-05T07:24:10.655+0100 [mongosMain] connection accepted from 172.28.0.163:58472 #1428759 (400 connections now open) 2015-10-05T07:24:10.655+0100 [conn1428758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:10.655+0100 [conn1428759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:11.235+0100 [conn1428351] end connection 172.28.0.164:50143 (399 connections now open) 2015-10-05T07:24:11.237+0100 [mongosMain] connection accepted from 172.28.0.164:51740 #1428760 (400 connections now open) 2015-10-05T07:24:11.239+0100 [conn1428760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:14.319+0100 [conn1428344] end connection 172.28.0.163:57141 (399 connections now open) 2015-10-05T07:24:14.321+0100 [mongosMain] connection accepted from 172.28.0.163:58483 #1428761 (400 connections now open) 2015-10-05T07:24:14.322+0100 [conn1428761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:14.864+0100 [conn1428371] end connection 172.28.0.163:57196 (399 connections now open) 2015-10-05T07:24:14.865+0100 [mongosMain] connection accepted from 172.28.0.163:58490 #1428762 (400 connections now open) 2015-10-05T07:24:14.866+0100 [conn1428762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:15.129+0100 [conn1428346] end connection 172.28.0.164:50130 (399 connections now open) 2015-10-05T07:24:15.131+0100 [mongosMain] connection accepted from 172.28.0.164:51743 #1428763 (400 connections now open) 2015-10-05T07:24:15.132+0100 [conn1428763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:15.675+0100 [conn1428381] end connection 172.28.0.164:50215 (399 connections now open) 2015-10-05T07:24:15.676+0100 [mongosMain] connection accepted from 172.28.0.164:51745 #1428764 (400 connections now open) 2015-10-05T07:24:15.677+0100 [conn1428764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:17.119+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:17.120+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:17.607+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:20.653+0100 [conn1428320] end connection 172.28.0.163:57069 (399 connections now open) 2015-10-05T07:24:20.653+0100 [conn1428374] end connection 172.28.0.163:57208 (399 connections now open) 2015-10-05T07:24:20.655+0100 [mongosMain] connection accepted from 172.28.0.163:58498 #1428765 (399 connections now open) 2015-10-05T07:24:20.655+0100 [mongosMain] connection accepted from 172.28.0.163:58499 #1428766 (400 connections now open) 2015-10-05T07:24:20.656+0100 [conn1428765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:20.656+0100 [conn1428766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:21.227+0100 [conn1428343] end connection 172.28.0.164:50122 (399 connections now open) 2015-10-05T07:24:21.228+0100 [mongosMain] connection accepted from 172.28.0.164:51754 #1428767 (400 connections now open) 2015-10-05T07:24:21.230+0100 [conn1428767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:22.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217965703b51053ecf248 2015-10-05T07:24:22.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:24.319+0100 [conn1428301] end connection 172.28.0.163:57032 (399 connections now open) 2015-10-05T07:24:24.320+0100 [mongosMain] connection accepted from 172.28.0.163:58504 #1428768 (400 connections now open) 2015-10-05T07:24:24.321+0100 [conn1428768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:24.866+0100 [conn1428379] end connection 172.28.0.163:57230 (399 connections now open) 2015-10-05T07:24:24.867+0100 [mongosMain] connection accepted from 172.28.0.163:58506 #1428769 (400 connections now open) 2015-10-05T07:24:24.869+0100 [conn1428769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:25.129+0100 [conn1428355] end connection 172.28.0.164:50153 (399 connections now open) 2015-10-05T07:24:25.130+0100 [mongosMain] connection accepted from 172.28.0.164:51763 #1428770 (400 connections now open) 2015-10-05T07:24:25.133+0100 [conn1428770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:25.675+0100 [conn1428388] end connection 172.28.0.164:50225 (399 connections now open) 2015-10-05T07:24:25.676+0100 [mongosMain] connection accepted from 172.28.0.164:51766 #1428771 (400 connections now open) 2015-10-05T07:24:25.678+0100 [conn1428771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:28.622+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:28.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612179c5703b51053ecf2b7 2015-10-05T07:24:28.997+0100 [mongosMain] connection accepted from 127.0.0.1:58512 #1428772 (401 connections now open) 2015-10-05T07:24:29.000+0100 [conn1428772] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:29.005+0100 [conn1428772] end connection 127.0.0.1:58512 (400 connections now open) 2015-10-05T07:24:29.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:29.149+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:29.150+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:30.668+0100 [conn1428091] end connection 172.28.0.163:56342 (399 connections now open) 2015-10-05T07:24:30.668+0100 [conn1428382] end connection 172.28.0.163:57239 (399 connections now open) 2015-10-05T07:24:30.669+0100 [mongosMain] connection accepted from 172.28.0.163:58515 #1428773 (399 connections now open) 2015-10-05T07:24:30.670+0100 [mongosMain] connection accepted from 172.28.0.163:58516 #1428774 (400 connections now open) 2015-10-05T07:24:30.671+0100 [conn1428773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:30.671+0100 [conn1428774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:31.161+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:31.162+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:34.167+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:34.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:34.335+0100 [conn1428353] end connection 172.28.0.163:57153 (399 connections now open) 2015-10-05T07:24:34.336+0100 [mongosMain] connection accepted from 172.28.0.163:58520 #1428775 (400 connections now open) 2015-10-05T07:24:34.337+0100 [conn1428775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:34.881+0100 [conn1428386] end connection 172.28.0.163:57251 (399 connections now open) 2015-10-05T07:24:34.882+0100 [mongosMain] connection accepted from 172.28.0.163:58521 #1428776 (400 connections now open) 2015-10-05T07:24:34.883+0100 [conn1428776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:34.966+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:24:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:24:35.145+0100 [conn1428289] end connection 172.28.0.164:50000 (399 connections now open) 2015-10-05T07:24:35.146+0100 [mongosMain] connection accepted from 172.28.0.164:51785 #1428777 (400 connections now open) 2015-10-05T07:24:35.147+0100 [conn1428777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:35.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217a35703b51053ecf32f 2015-10-05T07:24:35.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:35.690+0100 [conn1428394] end connection 172.28.0.164:50275 (399 connections now open) 2015-10-05T07:24:35.692+0100 [mongosMain] connection accepted from 172.28.0.164:51787 #1428778 (400 connections now open) 2015-10-05T07:24:35.693+0100 [conn1428778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:38.170+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:38.170+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:39.682+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:39.720+0100 [mongosMain] connection accepted from 127.0.0.1:58525 #1428779 (401 connections now open) 2015-10-05T07:24:39.722+0100 [conn1428779] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:39.727+0100 [conn1428779] end connection 127.0.0.1:58525 (400 connections now open) 2015-10-05T07:24:40.670+0100 [conn1428349] end connection 172.28.0.163:57148 (399 connections now open) 2015-10-05T07:24:40.670+0100 [conn1428341] end connection 172.28.0.163:57136 (399 connections now open) 2015-10-05T07:24:40.671+0100 [mongosMain] connection accepted from 172.28.0.163:58526 #1428780 (399 connections now open) 2015-10-05T07:24:40.671+0100 [mongosMain] connection accepted from 172.28.0.163:58527 #1428781 (400 connections now open) 2015-10-05T07:24:40.671+0100 [conn1428780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:40.678+0100 [conn1428781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:41.620+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217a95703b51053ecf3a6 2015-10-05T07:24:41.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:43.180+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:43.180+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:44.337+0100 [conn1428362] end connection 172.28.0.163:57171 (399 connections now open) 2015-10-05T07:24:44.337+0100 [mongosMain] connection accepted from 172.28.0.163:58537 #1428782 (400 connections now open) 2015-10-05T07:24:44.338+0100 [conn1428782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:44.882+0100 [conn1428392] end connection 172.28.0.163:57267 (399 connections now open) 2015-10-05T07:24:44.884+0100 [mongosMain] connection accepted from 172.28.0.163:58538 #1428783 (400 connections now open) 2015-10-05T07:24:44.885+0100 [conn1428783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:45.161+0100 [conn1428311] end connection 172.28.0.164:50049 (399 connections now open) 2015-10-05T07:24:45.162+0100 [mongosMain] connection accepted from 172.28.0.164:51811 #1428784 (400 connections now open) 2015-10-05T07:24:45.165+0100 [conn1428784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:45.706+0100 [conn1428401] end connection 172.28.0.164:50306 (399 connections now open) 2015-10-05T07:24:45.707+0100 [mongosMain] connection accepted from 172.28.0.164:51813 #1428785 (400 connections now open) 2015-10-05T07:24:45.709+0100 [conn1428785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:48.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217af5703b51053ecf415 2015-10-05T07:24:48.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:49.203+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:49.203+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:24:50.686+0100 [conn1428397] end connection 172.28.0.163:57271 (399 connections now open) 2015-10-05T07:24:50.687+0100 [mongosMain] connection accepted from 172.28.0.163:58548 #1428786 (400 connections now open) 2015-10-05T07:24:50.688+0100 [conn1428786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:50.689+0100 [conn1428334] end connection 172.28.0.163:57120 (399 connections now open) 2015-10-05T07:24:50.690+0100 [mongosMain] connection accepted from 172.28.0.163:58550 #1428787 (400 connections now open) 2015-10-05T07:24:50.691+0100 [conn1428787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:50.697+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:51.266+0100 [conn1428307] end connection 172.28.0.164:50039 (399 connections now open) 2015-10-05T07:24:51.268+0100 [mongosMain] connection accepted from 172.28.0.164:51822 #1428788 (400 connections now open) 2015-10-05T07:24:51.269+0100 [conn1428788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:54.351+0100 [conn1428385] end connection 172.28.0.163:57250 (399 connections now open) 2015-10-05T07:24:54.353+0100 [mongosMain] connection accepted from 172.28.0.163:58554 #1428789 (400 connections now open) 2015-10-05T07:24:54.354+0100 [conn1428789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:54.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217b65703b51053ecf484 2015-10-05T07:24:54.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:24:54.900+0100 [conn1428399] end connection 172.28.0.163:57279 (399 connections now open) 2015-10-05T07:24:54.903+0100 [mongosMain] connection accepted from 172.28.0.163:58556 #1428790 (400 connections now open) 2015-10-05T07:24:54.906+0100 [conn1428790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:55.161+0100 [conn1428372] end connection 172.28.0.164:50195 (399 connections now open) 2015-10-05T07:24:55.162+0100 [mongosMain] connection accepted from 172.28.0.164:51829 #1428791 (400 connections now open) 2015-10-05T07:24:55.163+0100 [conn1428791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:55.722+0100 [conn1428409] end connection 172.28.0.164:50346 (399 connections now open) 2015-10-05T07:24:55.723+0100 [mongosMain] connection accepted from 172.28.0.164:51831 #1428792 (400 connections now open) 2015-10-05T07:24:55.724+0100 [conn1428792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:24:56.209+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:24:56.210+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:00.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217bc5703b51053ecf4d3 2015-10-05T07:25:00.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:00.891+0100 [conn1428403] end connection 172.28.0.163:57285 (399 connections now open) 2015-10-05T07:25:00.891+0100 [conn1428340] end connection 172.28.0.163:57135 (399 connections now open) 2015-10-05T07:25:00.896+0100 [mongosMain] connection accepted from 172.28.0.163:58567 #1428793 (399 connections now open) 2015-10-05T07:25:00.896+0100 [mongosMain] connection accepted from 172.28.0.163:58568 #1428794 (400 connections now open) 2015-10-05T07:25:00.916+0100 [conn1428793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:00.917+0100 [conn1428794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:01.260+0100 [conn1428369] end connection 172.28.0.164:50187 (399 connections now open) 2015-10-05T07:25:01.261+0100 [mongosMain] connection accepted from 172.28.0.164:51835 #1428795 (400 connections now open) 2015-10-05T07:25:01.263+0100 [conn1428795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:01.714+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:04.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:04.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:04.374+0100 [conn1428398] end connection 172.28.0.163:57278 (399 connections now open) 2015-10-05T07:25:04.376+0100 [mongosMain] connection accepted from 172.28.0.163:58586 #1428796 (400 connections now open) 2015-10-05T07:25:04.377+0100 [conn1428796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:04.913+0100 [conn1428407] end connection 172.28.0.163:57296 (399 connections now open) 2015-10-05T07:25:04.914+0100 [mongosMain] connection accepted from 172.28.0.163:58587 #1428797 (400 connections now open) 2015-10-05T07:25:04.916+0100 [conn1428797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:05.159+0100 [conn1428400] end connection 172.28.0.164:50304 (399 connections now open) 2015-10-05T07:25:05.161+0100 [mongosMain] connection accepted from 172.28.0.164:51847 #1428798 (400 connections now open) 2015-10-05T07:25:05.162+0100 [conn1428798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:05.239+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:25:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:25:07.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217c25703b51053ecf568 2015-10-05T07:25:07.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:10.887+0100 [conn1428359] end connection 172.28.0.163:57163 (399 connections now open) 2015-10-05T07:25:10.887+0100 [conn1428390] end connection 172.28.0.163:57259 (399 connections now open) 2015-10-05T07:25:10.888+0100 [mongosMain] connection accepted from 172.28.0.163:58596 #1428799 (399 connections now open) 2015-10-05T07:25:10.889+0100 [mongosMain] connection accepted from 172.28.0.163:58597 #1428800 (400 connections now open) 2015-10-05T07:25:10.890+0100 [conn1428799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:10.890+0100 [conn1428800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:11.275+0100 [conn1428361] end connection 172.28.0.164:50166 (399 connections now open) 2015-10-05T07:25:11.276+0100 [mongosMain] connection accepted from 172.28.0.164:51854 #1428801 (400 connections now open) 2015-10-05T07:25:11.278+0100 [conn1428801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:12.719+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:13.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:13.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:13.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217c95703b51053ecf5cb 2015-10-05T07:25:13.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:14.918+0100 [conn1428414] end connection 172.28.0.163:57315 (399 connections now open) 2015-10-05T07:25:14.918+0100 [mongosMain] connection accepted from 172.28.0.163:58607 #1428802 (400 connections now open) 2015-10-05T07:25:14.919+0100 [conn1428802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:15.176+0100 [conn1428408] end connection 172.28.0.164:50342 (399 connections now open) 2015-10-05T07:25:15.178+0100 [mongosMain] connection accepted from 172.28.0.164:51855 #1428803 (400 connections now open) 2015-10-05T07:25:15.180+0100 [conn1428803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:15.753+0100 [conn1428416] end connection 172.28.0.164:50402 (399 connections now open) 2015-10-05T07:25:15.755+0100 [mongosMain] connection accepted from 172.28.0.164:51859 #1428804 (400 connections now open) 2015-10-05T07:25:15.756+0100 [conn1428804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:19.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217cf5703b51053ecf62c 2015-10-05T07:25:20.084+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:20.887+0100 [conn1428396] end connection 172.28.0.163:57270 (399 connections now open) 2015-10-05T07:25:20.887+0100 [conn1428410] end connection 172.28.0.163:57304 (399 connections now open) 2015-10-05T07:25:20.888+0100 [mongosMain] connection accepted from 172.28.0.163:58612 #1428805 (399 connections now open) 2015-10-05T07:25:20.888+0100 [mongosMain] connection accepted from 172.28.0.163:58613 #1428806 (400 connections now open) 2015-10-05T07:25:20.889+0100 [conn1428805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:20.889+0100 [conn1428806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:21.294+0100 [conn1428328] end connection 172.28.0.164:50096 (399 connections now open) 2015-10-05T07:25:21.295+0100 [mongosMain] connection accepted from 172.28.0.164:51868 #1428807 (400 connections now open) 2015-10-05T07:25:21.296+0100 [conn1428807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:23.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:23.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:23.727+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:24.382+0100 [conn1428413] end connection 172.28.0.163:57311 (399 connections now open) 2015-10-05T07:25:24.384+0100 [mongosMain] connection accepted from 172.28.0.163:58619 #1428808 (400 connections now open) 2015-10-05T07:25:24.385+0100 [conn1428808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:24.928+0100 [conn1428421] end connection 172.28.0.163:57347 (399 connections now open) 2015-10-05T07:25:24.929+0100 [mongosMain] connection accepted from 172.28.0.163:58621 #1428809 (400 connections now open) 2015-10-05T07:25:24.930+0100 [conn1428809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:25.192+0100 [conn1428380] end connection 172.28.0.164:50213 (399 connections now open) 2015-10-05T07:25:25.195+0100 [mongosMain] connection accepted from 172.28.0.164:51875 #1428810 (400 connections now open) 2015-10-05T07:25:25.199+0100 [conn1428810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:25.768+0100 [conn1428427] end connection 172.28.0.164:50477 (399 connections now open) 2015-10-05T07:25:25.769+0100 [mongosMain] connection accepted from 172.28.0.164:51878 #1428811 (400 connections now open) 2015-10-05T07:25:25.770+0100 [conn1428811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:26.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217d65703b51053ecf692 2015-10-05T07:25:26.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:29.106+0100 [mongosMain] connection accepted from 127.0.0.1:58624 #1428812 (401 connections now open) 2015-10-05T07:25:29.109+0100 [conn1428812] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:29.115+0100 [conn1428812] end connection 127.0.0.1:58624 (400 connections now open) 2015-10-05T07:25:30.903+0100 [conn1428314] end connection 172.28.0.163:57050 (399 connections now open) 2015-10-05T07:25:30.904+0100 [mongosMain] connection accepted from 172.28.0.163:58626 #1428813 (400 connections now open) 2015-10-05T07:25:30.905+0100 [conn1428813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:31.306+0100 [conn1428430] end connection 172.28.0.164:50494 (399 connections now open) 2015-10-05T07:25:31.307+0100 [conn1428412] end connection 172.28.0.164:50374 (398 connections now open) 2015-10-05T07:25:31.307+0100 [mongosMain] connection accepted from 172.28.0.164:51887 #1428814 (399 connections now open) 2015-10-05T07:25:31.308+0100 [mongosMain] connection accepted from 172.28.0.164:51888 #1428815 (400 connections now open) 2015-10-05T07:25:31.309+0100 [conn1428814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:31.311+0100 [conn1428815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:32.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217dc5703b51053ecf722 2015-10-05T07:25:32.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:34.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:34.230+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:34.384+0100 [conn1428420] end connection 172.28.0.163:57343 (399 connections now open) 2015-10-05T07:25:34.385+0100 [mongosMain] connection accepted from 172.28.0.163:58631 #1428816 (400 connections now open) 2015-10-05T07:25:34.385+0100 [conn1428816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:34.786+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:34.930+0100 [conn1428432] end connection 172.28.0.163:57376 (399 connections now open) 2015-10-05T07:25:34.932+0100 [mongosMain] connection accepted from 172.28.0.163:58632 #1428817 (400 connections now open) 2015-10-05T07:25:34.933+0100 [conn1428817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:35.191+0100 [conn1428415] end connection 172.28.0.164:50398 (399 connections now open) 2015-10-05T07:25:35.192+0100 [mongosMain] connection accepted from 172.28.0.164:51893 #1428818 (400 connections now open) 2015-10-05T07:25:35.193+0100 [conn1428818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:35.501+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:25:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:25:35.784+0100 [conn1428434] end connection 172.28.0.164:50514 (399 connections now open) 2015-10-05T07:25:35.785+0100 [mongosMain] connection accepted from 172.28.0.164:51896 #1428819 (400 connections now open) 2015-10-05T07:25:35.790+0100 [conn1428819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:39.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217e25703b51053ecf789 2015-10-05T07:25:39.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:39.589+0100 [mongosMain] connection accepted from 127.0.0.1:58639 #1428820 (401 connections now open) 2015-10-05T07:25:39.592+0100 [conn1428820] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:39.596+0100 [conn1428820] end connection 127.0.0.1:58639 (400 connections now open) 2015-10-05T07:25:40.904+0100 [conn1428417] end connection 172.28.0.163:57325 (399 connections now open) 2015-10-05T07:25:40.904+0100 [conn1428404] end connection 172.28.0.163:57286 (399 connections now open) 2015-10-05T07:25:40.905+0100 [mongosMain] connection accepted from 172.28.0.163:58641 #1428821 (399 connections now open) 2015-10-05T07:25:40.906+0100 [mongosMain] connection accepted from 172.28.0.163:58642 #1428822 (400 connections now open) 2015-10-05T07:25:40.907+0100 [conn1428821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:40.907+0100 [conn1428822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:41.322+0100 [conn1428376] end connection 172.28.0.164:50202 (399 connections now open) 2015-10-05T07:25:41.323+0100 [conn1428316] end connection 172.28.0.164:50062 (399 connections now open) 2015-10-05T07:25:41.324+0100 [mongosMain] connection accepted from 172.28.0.164:51908 #1428823 (399 connections now open) 2015-10-05T07:25:41.324+0100 [mongosMain] connection accepted from 172.28.0.164:51909 #1428824 (400 connections now open) 2015-10-05T07:25:41.325+0100 [conn1428823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:41.326+0100 [conn1428824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:44.398+0100 [conn1428391] end connection 172.28.0.163:57264 (399 connections now open) 2015-10-05T07:25:44.399+0100 [mongosMain] connection accepted from 172.28.0.163:58647 #1428825 (400 connections now open) 2015-10-05T07:25:44.401+0100 [conn1428825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:44.944+0100 [conn1428440] end connection 172.28.0.163:57388 (399 connections now open) 2015-10-05T07:25:44.945+0100 [mongosMain] connection accepted from 172.28.0.163:58651 #1428826 (400 connections now open) 2015-10-05T07:25:44.946+0100 [conn1428826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:45.192+0100 [conn1428393] end connection 172.28.0.164:50271 (399 connections now open) 2015-10-05T07:25:45.194+0100 [mongosMain] connection accepted from 172.28.0.164:51915 #1428827 (400 connections now open) 2015-10-05T07:25:45.195+0100 [conn1428827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:45.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217e95703b51053ecf7f3 2015-10-05T07:25:45.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:45.799+0100 [conn1428442] end connection 172.28.0.164:50560 (399 connections now open) 2015-10-05T07:25:45.800+0100 [mongosMain] connection accepted from 172.28.0.164:51916 #1428828 (400 connections now open) 2015-10-05T07:25:45.802+0100 [conn1428828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:45.805+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:46.230+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:46.231+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:48.230+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:48.230+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:50.931+0100 [conn1428437] end connection 172.28.0.163:57383 (399 connections now open) 2015-10-05T07:25:50.931+0100 [conn1428367] end connection 172.28.0.163:57186 (399 connections now open) 2015-10-05T07:25:50.932+0100 [mongosMain] connection accepted from 172.28.0.163:58663 #1428829 (399 connections now open) 2015-10-05T07:25:50.933+0100 [conn1428829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:50.940+0100 [mongosMain] connection accepted from 172.28.0.163:58664 #1428830 (400 connections now open) 2015-10-05T07:25:50.941+0100 [conn1428830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:51.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:51.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:51.323+0100 [conn1428424] end connection 172.28.0.164:50466 (399 connections now open) 2015-10-05T07:25:51.323+0100 [conn1428342] end connection 172.28.0.164:50121 (399 connections now open) 2015-10-05T07:25:51.324+0100 [mongosMain] connection accepted from 172.28.0.164:51925 #1428831 (399 connections now open) 2015-10-05T07:25:51.324+0100 [mongosMain] connection accepted from 172.28.0.164:51924 #1428832 (400 connections now open) 2015-10-05T07:25:51.330+0100 [conn1428831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:51.330+0100 [conn1428832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:52.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217ef5703b51053ecf868 2015-10-05T07:25:52.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:25:54.946+0100 [conn1428448] end connection 172.28.0.163:57407 (399 connections now open) 2015-10-05T07:25:54.947+0100 [mongosMain] connection accepted from 172.28.0.163:58671 #1428833 (400 connections now open) 2015-10-05T07:25:54.948+0100 [conn1428833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:55.208+0100 [conn1428426] end connection 172.28.0.164:50473 (399 connections now open) 2015-10-05T07:25:55.209+0100 [mongosMain] connection accepted from 172.28.0.164:51933 #1428834 (400 connections now open) 2015-10-05T07:25:55.211+0100 [conn1428834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:55.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:55.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:25:55.816+0100 [conn1428450] end connection 172.28.0.164:50631 (399 connections now open) 2015-10-05T07:25:55.817+0100 [mongosMain] connection accepted from 172.28.0.164:51935 #1428835 (400 connections now open) 2015-10-05T07:25:55.819+0100 [conn1428835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:25:56.816+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:25:58.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217f65703b51053ecf8a6 2015-10-05T07:25:58.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:00.295+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:00.296+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:00.933+0100 [conn1428429] end connection 172.28.0.163:57371 (399 connections now open) 2015-10-05T07:26:00.934+0100 [conn1428298] end connection 172.28.0.163:57026 (399 connections now open) 2015-10-05T07:26:00.934+0100 [mongosMain] connection accepted from 172.28.0.163:58684 #1428836 (399 connections now open) 2015-10-05T07:26:00.935+0100 [mongosMain] connection accepted from 172.28.0.163:58685 #1428837 (400 connections now open) 2015-10-05T07:26:00.935+0100 [conn1428836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:00.935+0100 [conn1428837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:01.354+0100 [conn1428419] end connection 172.28.0.164:50423 (399 connections now open) 2015-10-05T07:26:01.354+0100 [conn1428446] end connection 172.28.0.164:50571 (399 connections now open) 2015-10-05T07:26:01.355+0100 [mongosMain] connection accepted from 172.28.0.164:51946 #1428838 (399 connections now open) 2015-10-05T07:26:01.356+0100 [mongosMain] connection accepted from 172.28.0.164:51947 #1428839 (400 connections now open) 2015-10-05T07:26:01.357+0100 [conn1428838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:01.357+0100 [conn1428839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:04.414+0100 [conn1428378] end connection 172.28.0.163:57227 (399 connections now open) 2015-10-05T07:26:04.416+0100 [mongosMain] connection accepted from 172.28.0.163:58700 #1428840 (400 connections now open) 2015-10-05T07:26:04.417+0100 [conn1428840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:04.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561217fc5703b51053ecf927 2015-10-05T07:26:04.960+0100 [conn1428456] end connection 172.28.0.163:57426 (399 connections now open) 2015-10-05T07:26:04.961+0100 [mongosMain] connection accepted from 172.28.0.163:58702 #1428841 (400 connections now open) 2015-10-05T07:26:04.962+0100 [conn1428841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:05.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:05.223+0100 [conn1428422] end connection 172.28.0.164:50460 (399 connections now open) 2015-10-05T07:26:05.223+0100 [mongosMain] connection accepted from 172.28.0.164:51956 #1428842 (400 connections now open) 2015-10-05T07:26:05.225+0100 [conn1428842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:05.777+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:26:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:26:05.832+0100 [conn1428458] end connection 172.28.0.164:50670 (399 connections now open) 2015-10-05T07:26:05.833+0100 [mongosMain] connection accepted from 172.28.0.164:51960 #1428843 (400 connections now open) 2015-10-05T07:26:05.835+0100 [conn1428843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:06.306+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:06.307+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:07.837+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:10.941+0100 [conn1428383] end connection 172.28.0.163:57240 (399 connections now open) 2015-10-05T07:26:10.941+0100 [conn1428451] end connection 172.28.0.163:57416 (398 connections now open) 2015-10-05T07:26:10.942+0100 [mongosMain] connection accepted from 172.28.0.163:58713 #1428844 (399 connections now open) 2015-10-05T07:26:10.942+0100 [mongosMain] connection accepted from 172.28.0.163:58714 #1428845 (400 connections now open) 2015-10-05T07:26:10.943+0100 [conn1428844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:10.944+0100 [conn1428845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:11.354+0100 [conn1428438] end connection 172.28.0.164:50548 (399 connections now open) 2015-10-05T07:26:11.355+0100 [mongosMain] connection accepted from 172.28.0.164:51966 #1428846 (400 connections now open) 2015-10-05T07:26:11.357+0100 [conn1428846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:11.389+0100 [conn1428384] end connection 172.28.0.164:50220 (399 connections now open) 2015-10-05T07:26:11.390+0100 [mongosMain] connection accepted from 172.28.0.164:51967 #1428847 (400 connections now open) 2015-10-05T07:26:11.392+0100 [conn1428847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:13.317+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:13.318+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:14.960+0100 [conn1428463] end connection 172.28.0.163:57457 (399 connections now open) 2015-10-05T07:26:14.961+0100 [mongosMain] connection accepted from 172.28.0.163:58725 #1428848 (400 connections now open) 2015-10-05T07:26:14.962+0100 [conn1428848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:15.242+0100 [conn1428441] end connection 172.28.0.164:50557 (399 connections now open) 2015-10-05T07:26:15.243+0100 [mongosMain] connection accepted from 172.28.0.164:51973 #1428849 (400 connections now open) 2015-10-05T07:26:15.245+0100 [conn1428849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:15.848+0100 [conn1428465] end connection 172.28.0.164:50686 (399 connections now open) 2015-10-05T07:26:15.850+0100 [mongosMain] connection accepted from 172.28.0.164:51975 #1428850 (400 connections now open) 2015-10-05T07:26:15.852+0100 [conn1428850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:17.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218095703b51053ecf9b2 2015-10-05T07:26:17.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:18.855+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:20.950+0100 [conn1428460] end connection 172.28.0.163:57438 (399 connections now open) 2015-10-05T07:26:20.950+0100 [conn1428445] end connection 172.28.0.163:57398 (399 connections now open) 2015-10-05T07:26:20.952+0100 [mongosMain] connection accepted from 172.28.0.163:58733 #1428851 (399 connections now open) 2015-10-05T07:26:20.952+0100 [mongosMain] connection accepted from 172.28.0.163:58734 #1428852 (400 connections now open) 2015-10-05T07:26:20.952+0100 [conn1428851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:20.953+0100 [conn1428852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:21.323+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:21.323+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:21.370+0100 [conn1428126] end connection 172.28.0.164:49438 (399 connections now open) 2015-10-05T07:26:21.370+0100 [conn1428461] end connection 172.28.0.164:50676 (398 connections now open) 2015-10-05T07:26:21.370+0100 [mongosMain] connection accepted from 172.28.0.164:51984 #1428853 (400 connections now open) 2015-10-05T07:26:21.371+0100 [mongosMain] connection accepted from 172.28.0.164:51985 #1428854 (400 connections now open) 2015-10-05T07:26:21.372+0100 [conn1428853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:21.373+0100 [conn1428854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:23.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612180f5703b51053ecf9f1 2015-10-05T07:26:23.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:24.976+0100 [conn1428470] end connection 172.28.0.163:57475 (399 connections now open) 2015-10-05T07:26:24.977+0100 [mongosMain] connection accepted from 172.28.0.163:58739 #1428855 (400 connections now open) 2015-10-05T07:26:24.978+0100 [conn1428855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:25.239+0100 [conn1428387] end connection 172.28.0.164:50222 (399 connections now open) 2015-10-05T07:26:25.240+0100 [mongosMain] connection accepted from 172.28.0.164:51993 #1428856 (400 connections now open) 2015-10-05T07:26:25.241+0100 [conn1428856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:25.863+0100 [conn1428472] end connection 172.28.0.164:50726 (399 connections now open) 2015-10-05T07:26:25.865+0100 [mongosMain] connection accepted from 172.28.0.164:51996 #1428857 (400 connections now open) 2015-10-05T07:26:25.868+0100 [conn1428857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:29.171+0100 [mongosMain] connection accepted from 127.0.0.1:58742 #1428858 (401 connections now open) 2015-10-05T07:26:29.174+0100 [conn1428858] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:29.179+0100 [conn1428858] end connection 127.0.0.1:58742 (400 connections now open) 2015-10-05T07:26:29.873+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:29.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218155703b51053ecfa1f 2015-10-05T07:26:30.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:30.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:30.322+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:30.961+0100 [conn1428452] end connection 172.28.0.163:57417 (399 connections now open) 2015-10-05T07:26:30.961+0100 [conn1428466] end connection 172.28.0.163:57464 (399 connections now open) 2015-10-05T07:26:30.962+0100 [mongosMain] connection accepted from 172.28.0.163:58744 #1428859 (399 connections now open) 2015-10-05T07:26:30.962+0100 [mongosMain] connection accepted from 172.28.0.163:58745 #1428860 (400 connections now open) 2015-10-05T07:26:30.963+0100 [conn1428859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:30.963+0100 [conn1428860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:31.370+0100 [conn1428453] end connection 172.28.0.164:50658 (399 connections now open) 2015-10-05T07:26:31.370+0100 [mongosMain] connection accepted from 172.28.0.164:52006 #1428861 (400 connections now open) 2015-10-05T07:26:31.372+0100 [conn1428861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:31.633+0100 [conn1428336] end connection 172.28.0.164:50110 (399 connections now open) 2015-10-05T07:26:31.635+0100 [mongosMain] connection accepted from 172.28.0.164:52008 #1428862 (400 connections now open) 2015-10-05T07:26:31.638+0100 [conn1428862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:34.991+0100 [conn1428477] end connection 172.28.0.163:57488 (399 connections now open) 2015-10-05T07:26:34.992+0100 [mongosMain] connection accepted from 172.28.0.163:58749 #1428863 (400 connections now open) 2015-10-05T07:26:34.993+0100 [conn1428863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:35.255+0100 [conn1428364] end connection 172.28.0.164:50176 (399 connections now open) 2015-10-05T07:26:35.256+0100 [mongosMain] connection accepted from 172.28.0.164:52016 #1428864 (400 connections now open) 2015-10-05T07:26:35.258+0100 [conn1428864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:35.878+0100 [conn1428479] end connection 172.28.0.164:50755 (399 connections now open) 2015-10-05T07:26:35.879+0100 [mongosMain] connection accepted from 172.28.0.164:52018 #1428865 (400 connections now open) 2015-10-05T07:26:35.881+0100 [conn1428865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:35.913+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:26:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:26:39.577+0100 [mongosMain] connection accepted from 127.0.0.1:58755 #1428866 (401 connections now open) 2015-10-05T07:26:39.580+0100 [conn1428866] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:39.585+0100 [conn1428866] end connection 127.0.0.1:58755 (400 connections now open) 2015-10-05T07:26:40.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:40.338+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:40.967+0100 [conn1428482] end connection 172.28.0.163:57495 (399 connections now open) 2015-10-05T07:26:40.967+0100 [conn1428411] end connection 172.28.0.163:57305 (399 connections now open) 2015-10-05T07:26:40.968+0100 [mongosMain] connection accepted from 172.28.0.163:58759 #1428867 (399 connections now open) 2015-10-05T07:26:40.969+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:40.969+0100 [mongosMain] connection accepted from 172.28.0.163:58760 #1428868 (400 connections now open) 2015-10-05T07:26:40.969+0100 [conn1428867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:40.970+0100 [conn1428868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:41.370+0100 [conn1428476] end connection 172.28.0.164:50746 (399 connections now open) 2015-10-05T07:26:41.370+0100 [mongosMain] connection accepted from 172.28.0.164:52029 #1428869 (400 connections now open) 2015-10-05T07:26:41.371+0100 [conn1428405] end connection 172.28.0.164:50330 (399 connections now open) 2015-10-05T07:26:41.372+0100 [mongosMain] connection accepted from 172.28.0.164:52030 #1428870 (400 connections now open) 2015-10-05T07:26:41.372+0100 [conn1428869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:41.373+0100 [conn1428870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:44.992+0100 [conn1428494] end connection 172.28.0.163:57542 (399 connections now open) 2015-10-05T07:26:44.993+0100 [mongosMain] connection accepted from 172.28.0.163:58768 #1428871 (400 connections now open) 2015-10-05T07:26:44.995+0100 [conn1428871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:45.255+0100 [conn1428457] end connection 172.28.0.164:50666 (399 connections now open) 2015-10-05T07:26:45.256+0100 [mongosMain] connection accepted from 172.28.0.164:52037 #1428872 (400 connections now open) 2015-10-05T07:26:45.258+0100 [conn1428872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:45.878+0100 [conn1428488] end connection 172.28.0.164:50777 (399 connections now open) 2015-10-05T07:26:45.880+0100 [mongosMain] connection accepted from 172.28.0.164:52040 #1428873 (400 connections now open) 2015-10-05T07:26:45.881+0100 [conn1428873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:48.233+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:26:48.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:26:50.968+0100 [conn1428444] end connection 172.28.0.163:57397 (399 connections now open) 2015-10-05T07:26:50.968+0100 [conn1428423] end connection 172.28.0.163:57357 (399 connections now open) 2015-10-05T07:26:50.969+0100 [mongosMain] connection accepted from 172.28.0.163:58777 #1428874 (399 connections now open) 2015-10-05T07:26:50.969+0100 [mongosMain] connection accepted from 172.28.0.163:58778 #1428875 (400 connections now open) 2015-10-05T07:26:50.970+0100 [conn1428874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:50.971+0100 [conn1428875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:51.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:51.346+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:26:51.398+0100 [conn1428484] end connection 172.28.0.164:50764 (399 connections now open) 2015-10-05T07:26:51.398+0100 [conn1428360] end connection 172.28.0.164:50168 (398 connections now open) 2015-10-05T07:26:51.399+0100 [mongosMain] connection accepted from 172.28.0.164:52046 #1428876 (399 connections now open) 2015-10-05T07:26:51.400+0100 [mongosMain] connection accepted from 172.28.0.164:52048 #1428877 (400 connections now open) 2015-10-05T07:26:51.401+0100 [conn1428876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:51.403+0100 [conn1428877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:51.978+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:26:54.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612182e5703b51053ecfb45 2015-10-05T07:26:54.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:26:55.007+0100 [conn1428486] end connection 172.28.0.163:57503 (399 connections now open) 2015-10-05T07:26:55.008+0100 [mongosMain] connection accepted from 172.28.0.163:58788 #1428878 (400 connections now open) 2015-10-05T07:26:55.009+0100 [conn1428878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:55.255+0100 [conn1428471] end connection 172.28.0.164:50694 (399 connections now open) 2015-10-05T07:26:55.257+0100 [mongosMain] connection accepted from 172.28.0.164:52057 #1428879 (400 connections now open) 2015-10-05T07:26:55.259+0100 [conn1428879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:26:55.879+0100 [conn1428496] end connection 172.28.0.164:50841 (399 connections now open) 2015-10-05T07:26:55.880+0100 [mongosMain] connection accepted from 172.28.0.164:52059 #1428880 (400 connections now open) 2015-10-05T07:26:55.882+0100 [conn1428880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:00.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218345703b51053ecfb97 2015-10-05T07:27:00.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:00.982+0100 [conn1428491] end connection 172.28.0.163:57509 (399 connections now open) 2015-10-05T07:27:00.982+0100 [conn1428418] end connection 172.28.0.163:57326 (399 connections now open) 2015-10-05T07:27:00.983+0100 [mongosMain] connection accepted from 172.28.0.163:58797 #1428881 (399 connections now open) 2015-10-05T07:27:00.983+0100 [mongosMain] connection accepted from 172.28.0.163:58798 #1428882 (400 connections now open) 2015-10-05T07:27:00.984+0100 [conn1428881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:00.985+0100 [conn1428882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:01.385+0100 [conn1428368] end connection 172.28.0.164:50186 (399 connections now open) 2015-10-05T07:27:01.386+0100 [mongosMain] connection accepted from 172.28.0.164:52068 #1428883 (400 connections now open) 2015-10-05T07:27:01.387+0100 [conn1428883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:02.986+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:03.345+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:03.345+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:03.871+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 19ms 2015-10-05T07:27:05.270+0100 [conn1428478] end connection 172.28.0.164:50752 (399 connections now open) 2015-10-05T07:27:05.272+0100 [mongosMain] connection accepted from 172.28.0.164:52073 #1428884 (400 connections now open) 2015-10-05T07:27:05.273+0100 [conn1428884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:05.348+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:05.348+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:05.894+0100 [conn1428504] end connection 172.28.0.164:50863 (399 connections now open) 2015-10-05T07:27:05.895+0100 [mongosMain] connection accepted from 172.28.0.164:52075 #1428885 (400 connections now open) 2015-10-05T07:27:05.903+0100 [conn1428885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:06.179+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:27:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:27:08.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:08.467+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:11.026+0100 [conn1428474] end connection 172.28.0.163:57481 (399 connections now open) 2015-10-05T07:27:11.026+0100 [mongosMain] connection accepted from 172.28.0.163:58827 #1428886 (400 connections now open) 2015-10-05T07:27:11.026+0100 [conn1428886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:11.416+0100 [conn1428377] end connection 172.28.0.164:50203 (399 connections now open) 2015-10-05T07:27:11.416+0100 [conn1428492] end connection 172.28.0.164:50790 (399 connections now open) 2015-10-05T07:27:11.431+0100 [mongosMain] connection accepted from 172.28.0.164:52081 #1428887 (399 connections now open) 2015-10-05T07:27:11.431+0100 [mongosMain] connection accepted from 172.28.0.164:52082 #1428888 (400 connections now open) 2015-10-05T07:27:11.431+0100 [conn1428887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:11.431+0100 [conn1428888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:12.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:12.457+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:14.011+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:15.023+0100 [conn1428502] end connection 172.28.0.163:57580 (399 connections now open) 2015-10-05T07:27:15.024+0100 [mongosMain] connection accepted from 172.28.0.163:58835 #1428889 (400 connections now open) 2015-10-05T07:27:15.025+0100 [conn1428889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:15.287+0100 [conn1428510] end connection 172.28.0.164:50926 (399 connections now open) 2015-10-05T07:27:15.289+0100 [mongosMain] connection accepted from 172.28.0.164:52087 #1428890 (400 connections now open) 2015-10-05T07:27:15.290+0100 [conn1428890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:15.911+0100 [conn1428511] end connection 172.28.0.164:50929 (399 connections now open) 2015-10-05T07:27:15.912+0100 [mongosMain] connection accepted from 172.28.0.164:52089 #1428891 (400 connections now open) 2015-10-05T07:27:15.914+0100 [conn1428891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:17.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:17.458+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:19.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218465703b51053ecfc53 2015-10-05T07:27:19.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:20.999+0100 [conn1428497] end connection 172.28.0.163:57569 (399 connections now open) 2015-10-05T07:27:21.001+0100 [mongosMain] connection accepted from 172.28.0.163:58842 #1428892 (400 connections now open) 2015-10-05T07:27:21.002+0100 [conn1428892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:21.417+0100 [conn1428507] end connection 172.28.0.164:50873 (399 connections now open) 2015-10-05T07:27:21.419+0100 [conn1428439] end connection 172.28.0.164:50549 (398 connections now open) 2015-10-05T07:27:21.420+0100 [mongosMain] connection accepted from 172.28.0.164:52096 #1428893 (399 connections now open) 2015-10-05T07:27:21.420+0100 [mongosMain] connection accepted from 172.28.0.164:52097 #1428894 (400 connections now open) 2015-10-05T07:27:21.421+0100 [conn1428893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:21.421+0100 [conn1428894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:23.465+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:23.466+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:25.021+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:25.024+0100 [conn1428516] end connection 172.28.0.163:57662 (399 connections now open) 2015-10-05T07:27:25.026+0100 [mongosMain] connection accepted from 172.28.0.163:58847 #1428895 (400 connections now open) 2015-10-05T07:27:25.027+0100 [conn1428895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:25.286+0100 [conn1428503] end connection 172.28.0.164:50861 (399 connections now open) 2015-10-05T07:27:25.288+0100 [mongosMain] connection accepted from 172.28.0.164:52107 #1428896 (400 connections now open) 2015-10-05T07:27:25.290+0100 [conn1428896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:25.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612184d5703b51053ecfca3 2015-10-05T07:27:25.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:25.913+0100 [conn1428518] end connection 172.28.0.164:50941 (399 connections now open) 2015-10-05T07:27:25.914+0100 [mongosMain] connection accepted from 172.28.0.164:52110 #1428897 (400 connections now open) 2015-10-05T07:27:25.916+0100 [conn1428897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:29.140+0100 [mongosMain] connection accepted from 127.0.0.1:58849 #1428898 (401 connections now open) 2015-10-05T07:27:29.142+0100 [conn1428898] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:29.147+0100 [conn1428898] end connection 127.0.0.1:58849 (400 connections now open) 2015-10-05T07:27:30.468+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:30.468+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:31.015+0100 [conn1428505] end connection 172.28.0.163:57589 (399 connections now open) 2015-10-05T07:27:31.016+0100 [mongosMain] connection accepted from 172.28.0.163:58851 #1428899 (400 connections now open) 2015-10-05T07:27:31.017+0100 [conn1428899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:31.434+0100 [conn1428352] end connection 172.28.0.164:50144 (399 connections now open) 2015-10-05T07:27:31.434+0100 [conn1428515] end connection 172.28.0.164:50935 (399 connections now open) 2015-10-05T07:27:31.434+0100 [mongosMain] connection accepted from 172.28.0.164:52118 #1428900 (399 connections now open) 2015-10-05T07:27:31.435+0100 [mongosMain] connection accepted from 172.28.0.164:52119 #1428901 (400 connections now open) 2015-10-05T07:27:31.436+0100 [conn1428900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:31.437+0100 [conn1428901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:31.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218535703b51053ecfcf0 2015-10-05T07:27:31.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:34.493+0100 [conn1428370] end connection 172.28.0.163:57194 (399 connections now open) 2015-10-05T07:27:34.494+0100 [mongosMain] connection accepted from 172.28.0.163:58853 #1428902 (400 connections now open) 2015-10-05T07:27:34.495+0100 [conn1428902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:35.302+0100 [conn1428433] end connection 172.28.0.164:50510 (399 connections now open) 2015-10-05T07:27:35.303+0100 [mongosMain] connection accepted from 172.28.0.164:52126 #1428903 (400 connections now open) 2015-10-05T07:27:35.304+0100 [conn1428903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:35.926+0100 [conn1428525] end connection 172.28.0.164:51016 (399 connections now open) 2015-10-05T07:27:35.926+0100 [mongosMain] connection accepted from 172.28.0.164:52128 #1428904 (400 connections now open) 2015-10-05T07:27:35.928+0100 [conn1428904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:36.034+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:36.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:27:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:27:37.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218595703b51053ecfd36 2015-10-05T07:27:38.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:38.472+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:38.472+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:40.044+0100 [mongosMain] connection accepted from 127.0.0.1:58858 #1428905 (401 connections now open) 2015-10-05T07:27:40.047+0100 [conn1428905] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:40.052+0100 [conn1428905] end connection 127.0.0.1:58858 (400 connections now open) 2015-10-05T07:27:41.018+0100 [conn1428527] end connection 172.28.0.163:57721 (399 connections now open) 2015-10-05T07:27:41.019+0100 [mongosMain] connection accepted from 172.28.0.163:58860 #1428906 (400 connections now open) 2015-10-05T07:27:41.020+0100 [conn1428906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:41.433+0100 [conn1428431] end connection 172.28.0.164:50504 (399 connections now open) 2015-10-05T07:27:41.434+0100 [conn1428522] end connection 172.28.0.164:50950 (398 connections now open) 2015-10-05T07:27:41.434+0100 [mongosMain] connection accepted from 172.28.0.164:52141 #1428907 (399 connections now open) 2015-10-05T07:27:41.435+0100 [mongosMain] connection accepted from 172.28.0.164:52140 #1428908 (400 connections now open) 2015-10-05T07:27:41.437+0100 [conn1428907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:41.437+0100 [conn1428908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:44.404+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218605703b51053ecfd76 2015-10-05T07:27:44.494+0100 [conn1428455] end connection 172.28.0.163:57424 (399 connections now open) 2015-10-05T07:27:44.496+0100 [mongosMain] connection accepted from 172.28.0.163:58865 #1428909 (400 connections now open) 2015-10-05T07:27:44.497+0100 [conn1428909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:44.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:45.317+0100 [conn1428524] end connection 172.28.0.164:51009 (399 connections now open) 2015-10-05T07:27:45.318+0100 [mongosMain] connection accepted from 172.28.0.164:52148 #1428910 (400 connections now open) 2015-10-05T07:27:45.319+0100 [conn1428910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:45.942+0100 [conn1428532] end connection 172.28.0.164:51037 (399 connections now open) 2015-10-05T07:27:45.943+0100 [mongosMain] connection accepted from 172.28.0.164:52151 #1428911 (400 connections now open) 2015-10-05T07:27:45.944+0100 [conn1428911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:47.041+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:47.489+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:47.489+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:50.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218665703b51053ecfdab 2015-10-05T07:27:50.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:51.030+0100 [conn1428512] end connection 172.28.0.163:57652 (399 connections now open) 2015-10-05T07:27:51.031+0100 [mongosMain] connection accepted from 172.28.0.163:58876 #1428912 (400 connections now open) 2015-10-05T07:27:51.032+0100 [conn1428912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:51.449+0100 [conn1428500] end connection 172.28.0.164:50851 (399 connections now open) 2015-10-05T07:27:51.450+0100 [conn1428468] end connection 172.28.0.164:50691 (398 connections now open) 2015-10-05T07:27:51.450+0100 [mongosMain] connection accepted from 172.28.0.164:52159 #1428913 (399 connections now open) 2015-10-05T07:27:51.451+0100 [mongosMain] connection accepted from 172.28.0.164:52160 #1428914 (400 connections now open) 2015-10-05T07:27:51.452+0100 [conn1428913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:51.454+0100 [conn1428914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:54.508+0100 [conn1428509] end connection 172.28.0.163:57643 (399 connections now open) 2015-10-05T07:27:54.509+0100 [mongosMain] connection accepted from 172.28.0.163:58882 #1428915 (400 connections now open) 2015-10-05T07:27:54.511+0100 [conn1428915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:55.054+0100 [conn1428523] end connection 172.28.0.163:57714 (399 connections now open) 2015-10-05T07:27:55.055+0100 [mongosMain] connection accepted from 172.28.0.163:58885 #1428916 (400 connections now open) 2015-10-05T07:27:55.056+0100 [conn1428916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:55.334+0100 [conn1428517] end connection 172.28.0.164:50939 (399 connections now open) 2015-10-05T07:27:55.335+0100 [mongosMain] connection accepted from 172.28.0.164:52167 #1428917 (400 connections now open) 2015-10-05T07:27:55.337+0100 [conn1428917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:55.941+0100 [conn1428540] end connection 172.28.0.164:51056 (399 connections now open) 2015-10-05T07:27:55.945+0100 [mongosMain] connection accepted from 172.28.0.164:52168 #1428918 (400 connections now open) 2015-10-05T07:27:55.947+0100 [conn1428918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:27:57.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:27:57.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:27:57.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612186c5703b51053ecfde8 2015-10-05T07:27:57.711+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:27:58.050+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:01.449+0100 [conn1428529] end connection 172.28.0.164:51024 (399 connections now open) 2015-10-05T07:28:01.450+0100 [conn1428447] end connection 172.28.0.164:50585 (398 connections now open) 2015-10-05T07:28:01.450+0100 [mongosMain] connection accepted from 172.28.0.164:52179 #1428919 (399 connections now open) 2015-10-05T07:28:01.451+0100 [mongosMain] connection accepted from 172.28.0.164:52180 #1428920 (400 connections now open) 2015-10-05T07:28:01.452+0100 [conn1428919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:01.452+0100 [conn1428920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:03.990+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218735703b51053ecfe33 2015-10-05T07:28:04.126+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:05.069+0100 [conn1428538] end connection 172.28.0.163:57741 (399 connections now open) 2015-10-05T07:28:05.070+0100 [mongosMain] connection accepted from 172.28.0.163:58912 #1428921 (400 connections now open) 2015-10-05T07:28:05.071+0100 [conn1428921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:05.348+0100 [conn1428487] end connection 172.28.0.164:50775 (399 connections now open) 2015-10-05T07:28:05.349+0100 [mongosMain] connection accepted from 172.28.0.164:52187 #1428922 (400 connections now open) 2015-10-05T07:28:05.350+0100 [conn1428922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:05.957+0100 [conn1428545] end connection 172.28.0.164:51071 (399 connections now open) 2015-10-05T07:28:05.958+0100 [mongosMain] connection accepted from 172.28.0.164:52190 #1428923 (400 connections now open) 2015-10-05T07:28:05.960+0100 [conn1428923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:06.718+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:28:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:28:08.502+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:08.502+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:09.084+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:10.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612187a5703b51053ecfe8e 2015-10-05T07:28:10.541+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:11.465+0100 [conn1428475] end connection 172.28.0.164:50745 (399 connections now open) 2015-10-05T07:28:11.465+0100 [conn1428542] end connection 172.28.0.164:51062 (398 connections now open) 2015-10-05T07:28:11.466+0100 [mongosMain] connection accepted from 172.28.0.164:52192 #1428924 (399 connections now open) 2015-10-05T07:28:11.466+0100 [mongosMain] connection accepted from 172.28.0.164:52193 #1428925 (400 connections now open) 2015-10-05T07:28:11.468+0100 [conn1428925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:11.468+0100 [conn1428924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:15.071+0100 [conn1428543] end connection 172.28.0.163:57761 (399 connections now open) 2015-10-05T07:28:15.072+0100 [mongosMain] connection accepted from 172.28.0.163:58927 #1428926 (400 connections now open) 2015-10-05T07:28:15.073+0100 [conn1428926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:15.350+0100 [conn1428531] end connection 172.28.0.164:51034 (399 connections now open) 2015-10-05T07:28:15.352+0100 [mongosMain] connection accepted from 172.28.0.164:52197 #1428927 (400 connections now open) 2015-10-05T07:28:15.355+0100 [conn1428927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:15.957+0100 [conn1428550] end connection 172.28.0.164:51092 (399 connections now open) 2015-10-05T07:28:15.958+0100 [mongosMain] connection accepted from 172.28.0.164:52200 #1428928 (400 connections now open) 2015-10-05T07:28:15.961+0100 [conn1428928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:16.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218805703b51053ecfec7 2015-10-05T07:28:16.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:20.086+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:20.515+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:20.515+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:21.046+0100 [conn1428535] end connection 172.28.0.163:57733 (399 connections now open) 2015-10-05T07:28:21.047+0100 [mongosMain] connection accepted from 172.28.0.163:58936 #1428929 (400 connections now open) 2015-10-05T07:28:21.048+0100 [conn1428929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:21.480+0100 [conn1428493] end connection 172.28.0.164:50792 (399 connections now open) 2015-10-05T07:28:21.481+0100 [conn1428536] end connection 172.28.0.164:51045 (398 connections now open) 2015-10-05T07:28:21.481+0100 [mongosMain] connection accepted from 172.28.0.164:52208 #1428930 (399 connections now open) 2015-10-05T07:28:21.482+0100 [mongosMain] connection accepted from 172.28.0.164:52209 #1428931 (400 connections now open) 2015-10-05T07:28:21.483+0100 [conn1428930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:21.484+0100 [conn1428931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:22.524+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:22.524+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:23.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218865703b51053ecff07 2015-10-05T07:28:23.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:25.086+0100 [conn1428548] end connection 172.28.0.163:57788 (399 connections now open) 2015-10-05T07:28:25.087+0100 [mongosMain] connection accepted from 172.28.0.163:58941 #1428932 (400 connections now open) 2015-10-05T07:28:25.088+0100 [conn1428932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:25.364+0100 [conn1428449] end connection 172.28.0.164:50612 (399 connections now open) 2015-10-05T07:28:25.366+0100 [mongosMain] connection accepted from 172.28.0.164:52216 #1428933 (400 connections now open) 2015-10-05T07:28:25.368+0100 [conn1428933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:25.530+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:25.530+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:25.973+0100 [conn1428555] end connection 172.28.0.164:51103 (399 connections now open) 2015-10-05T07:28:25.975+0100 [mongosMain] connection accepted from 172.28.0.164:52219 #1428934 (400 connections now open) 2015-10-05T07:28:25.977+0100 [conn1428934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:28.885+0100 [mongosMain] connection accepted from 127.0.0.1:58947 #1428935 (401 connections now open) 2015-10-05T07:28:28.887+0100 [conn1428935] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:28.892+0100 [conn1428935] end connection 127.0.0.1:58947 (400 connections now open) 2015-10-05T07:28:29.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612188d5703b51053ecff59 2015-10-05T07:28:29.526+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:29.526+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:29.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:31.060+0100 [conn1428541] end connection 172.28.0.163:57753 (399 connections now open) 2015-10-05T07:28:31.061+0100 [mongosMain] connection accepted from 172.28.0.163:58949 #1428936 (400 connections now open) 2015-10-05T07:28:31.062+0100 [conn1428936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:31.176+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:31.480+0100 [conn1428530] end connection 172.28.0.164:51025 (399 connections now open) 2015-10-05T07:28:31.481+0100 [conn1428552] end connection 172.28.0.164:51096 (398 connections now open) 2015-10-05T07:28:31.482+0100 [mongosMain] connection accepted from 172.28.0.164:52231 #1428937 (399 connections now open) 2015-10-05T07:28:31.482+0100 [mongosMain] connection accepted from 172.28.0.164:52232 #1428938 (400 connections now open) 2015-10-05T07:28:31.483+0100 [conn1428937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:31.483+0100 [conn1428938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:34.555+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:34.555+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:35.087+0100 [conn1428553] end connection 172.28.0.163:57803 (399 connections now open) 2015-10-05T07:28:35.088+0100 [mongosMain] connection accepted from 172.28.0.163:58952 #1428939 (400 connections now open) 2015-10-05T07:28:35.089+0100 [conn1428939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:35.381+0100 [conn1428495] end connection 172.28.0.164:50835 (399 connections now open) 2015-10-05T07:28:35.382+0100 [mongosMain] connection accepted from 172.28.0.164:52238 #1428940 (400 connections now open) 2015-10-05T07:28:35.384+0100 [conn1428940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:35.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218935703b51053ecffa0 2015-10-05T07:28:35.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:35.989+0100 [conn1428560] end connection 172.28.0.164:51121 (399 connections now open) 2015-10-05T07:28:35.990+0100 [mongosMain] connection accepted from 172.28.0.164:52243 #1428941 (400 connections now open) 2015-10-05T07:28:35.992+0100 [conn1428941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:36.865+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:28:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:28:39.713+0100 [mongosMain] connection accepted from 127.0.0.1:58957 #1428942 (401 connections now open) 2015-10-05T07:28:39.719+0100 [conn1428942] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:39.723+0100 [conn1428942] end connection 127.0.0.1:58957 (400 connections now open) 2015-10-05T07:28:40.563+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:40.563+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:41.076+0100 [conn1428556] end connection 172.28.0.163:57811 (399 connections now open) 2015-10-05T07:28:41.078+0100 [mongosMain] connection accepted from 172.28.0.163:58959 #1428943 (400 connections now open) 2015-10-05T07:28:41.078+0100 [conn1428943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:41.481+0100 [conn1428563] end connection 172.28.0.164:51130 (399 connections now open) 2015-10-05T07:28:41.481+0100 [conn1428483] end connection 172.28.0.164:50765 (398 connections now open) 2015-10-05T07:28:41.482+0100 [mongosMain] connection accepted from 172.28.0.164:52257 #1428944 (399 connections now open) 2015-10-05T07:28:41.482+0100 [mongosMain] connection accepted from 172.28.0.164:52258 #1428945 (400 connections now open) 2015-10-05T07:28:41.484+0100 [conn1428944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:41.485+0100 [conn1428945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:42.159+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218995703b51053ecffea 2015-10-05T07:28:42.193+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:42.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:44.563+0100 [conn1428406] end connection 172.28.0.163:57293 (399 connections now open) 2015-10-05T07:28:44.564+0100 [mongosMain] connection accepted from 172.28.0.163:58966 #1428946 (400 connections now open) 2015-10-05T07:28:44.565+0100 [conn1428946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:45.102+0100 [conn1428558] end connection 172.28.0.163:57818 (399 connections now open) 2015-10-05T07:28:45.103+0100 [mongosMain] connection accepted from 172.28.0.163:58969 #1428947 (400 connections now open) 2015-10-05T07:28:45.103+0100 [conn1428947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:45.396+0100 [conn1428544] end connection 172.28.0.164:51070 (399 connections now open) 2015-10-05T07:28:45.397+0100 [mongosMain] connection accepted from 172.28.0.164:52264 #1428948 (400 connections now open) 2015-10-05T07:28:45.398+0100 [conn1428948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:47.561+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:47.562+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:28:48.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218a05703b51053ed0045 2015-10-05T07:28:48.711+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:51.077+0100 [conn1428520] end connection 172.28.0.163:57670 (399 connections now open) 2015-10-05T07:28:51.079+0100 [mongosMain] connection accepted from 172.28.0.163:58980 #1428949 (400 connections now open) 2015-10-05T07:28:51.080+0100 [conn1428949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:51.496+0100 [conn1428462] end connection 172.28.0.164:50678 (399 connections now open) 2015-10-05T07:28:51.497+0100 [mongosMain] connection accepted from 172.28.0.164:52273 #1428950 (400 connections now open) 2015-10-05T07:28:51.499+0100 [conn1428950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:53.242+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:54.556+0100 [conn1428501] end connection 172.28.0.163:57577 (399 connections now open) 2015-10-05T07:28:54.558+0100 [mongosMain] connection accepted from 172.28.0.163:58987 #1428951 (400 connections now open) 2015-10-05T07:28:54.559+0100 [conn1428951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:54.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218a65703b51053ed0094 2015-10-05T07:28:55.102+0100 [conn1428564] end connection 172.28.0.163:57827 (399 connections now open) 2015-10-05T07:28:55.103+0100 [mongosMain] connection accepted from 172.28.0.163:58990 #1428952 (400 connections now open) 2015-10-05T07:28:55.105+0100 [conn1428952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:28:55.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:28:55.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:28:55.616+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:01.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218ad5703b51053ed00d2 2015-10-05T07:29:01.490+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:01.497+0100 [conn1428521] end connection 172.28.0.164:50949 (399 connections now open) 2015-10-05T07:29:01.498+0100 [mongosMain] connection accepted from 172.28.0.164:52293 #1428953 (400 connections now open) 2015-10-05T07:29:01.499+0100 [conn1428953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:04.252+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:04.571+0100 [conn1428469] end connection 172.28.0.163:57472 (399 connections now open) 2015-10-05T07:29:04.573+0100 [mongosMain] connection accepted from 172.28.0.163:59016 #1428954 (400 connections now open) 2015-10-05T07:29:04.574+0100 [conn1428954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:04.633+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:04.633+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:05.117+0100 [conn1428571] end connection 172.28.0.163:57839 (399 connections now open) 2015-10-05T07:29:05.118+0100 [mongosMain] connection accepted from 172.28.0.163:59019 #1428955 (400 connections now open) 2015-10-05T07:29:05.119+0100 [conn1428955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:07.015+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:29:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:29:08.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218b35703b51053ed0115 2015-10-05T07:29:08.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:14.385+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218ba5703b51053ed0145 2015-10-05T07:29:14.451+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:14.587+0100 [conn1428485] end connection 172.28.0.163:57501 (399 connections now open) 2015-10-05T07:29:14.589+0100 [mongosMain] connection accepted from 172.28.0.163:59031 #1428956 (400 connections now open) 2015-10-05T07:29:14.590+0100 [conn1428956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:14.631+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:14.631+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:15.118+0100 [conn1428576] end connection 172.28.0.163:57861 (399 connections now open) 2015-10-05T07:29:15.119+0100 [mongosMain] connection accepted from 172.28.0.163:59035 #1428957 (400 connections now open) 2015-10-05T07:29:15.120+0100 [conn1428957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:15.276+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:16.051+0100 [conn1428573] end connection 172.28.0.164:51163 (399 connections now open) 2015-10-05T07:29:16.053+0100 [mongosMain] connection accepted from 172.28.0.164:52307 #1428958 (400 connections now open) 2015-10-05T07:29:16.056+0100 [conn1428958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:20.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218c05703b51053ed0170 2015-10-05T07:29:20.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:21.109+0100 [conn1428562] end connection 172.28.0.163:57822 (399 connections now open) 2015-10-05T07:29:21.110+0100 [mongosMain] connection accepted from 172.28.0.163:59041 #1428959 (400 connections now open) 2015-10-05T07:29:21.111+0100 [conn1428959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:24.588+0100 [conn1428570] end connection 172.28.0.163:57837 (399 connections now open) 2015-10-05T07:29:24.589+0100 [mongosMain] connection accepted from 172.28.0.163:59045 #1428960 (400 connections now open) 2015-10-05T07:29:24.590+0100 [conn1428960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:25.655+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:25.655+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:26.285+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:27.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218c65703b51053ed0198 2015-10-05T07:29:27.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:29.129+0100 [mongosMain] connection accepted from 127.0.0.1:59051 #1428961 (401 connections now open) 2015-10-05T07:29:29.131+0100 [conn1428961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:29.136+0100 [conn1428961] end connection 127.0.0.1:59051 (400 connections now open) 2015-10-05T07:29:31.115+0100 [conn1428574] end connection 172.28.0.163:57852 (399 connections now open) 2015-10-05T07:29:31.116+0100 [mongosMain] connection accepted from 172.28.0.163:59052 #1428962 (400 connections now open) 2015-10-05T07:29:31.117+0100 [conn1428962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:33.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218cd5703b51053ed01be 2015-10-05T07:29:33.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:34.603+0100 [conn1428584] end connection 172.28.0.163:57912 (399 connections now open) 2015-10-05T07:29:34.604+0100 [mongosMain] connection accepted from 172.28.0.163:59057 #1428963 (400 connections now open) 2015-10-05T07:29:34.606+0100 [conn1428963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:37.280+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:29:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:29:37.291+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:37.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:37.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:39.444+0100 [mongosMain] connection accepted from 127.0.0.1:59063 #1428964 (401 connections now open) 2015-10-05T07:29:39.447+0100 [conn1428964] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:39.451+0100 [conn1428964] end connection 127.0.0.1:59063 (400 connections now open) 2015-10-05T07:29:39.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:39.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:39.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218d35703b51053ed01f6 2015-10-05T07:29:39.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:41.124+0100 [conn1428581] end connection 172.28.0.163:57907 (399 connections now open) 2015-10-05T07:29:41.125+0100 [mongosMain] connection accepted from 172.28.0.163:59067 #1428965 (400 connections now open) 2015-10-05T07:29:41.127+0100 [conn1428965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:42.720+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:42.720+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:44.603+0100 [conn1428575] end connection 172.28.0.163:57858 (399 connections now open) 2015-10-05T07:29:44.604+0100 [mongosMain] connection accepted from 172.28.0.163:59073 #1428966 (400 connections now open) 2015-10-05T07:29:44.605+0100 [conn1428966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:45.474+0100 [conn1428559] end connection 172.28.0.164:51119 (399 connections now open) 2015-10-05T07:29:45.476+0100 [mongosMain] connection accepted from 172.28.0.164:52358 #1428967 (400 connections now open) 2015-10-05T07:29:45.478+0100 [conn1428967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:46.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218d95703b51053ed023d 2015-10-05T07:29:46.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:46.728+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:46.728+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:48.296+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:51.129+0100 [conn1428588] end connection 172.28.0.163:57939 (399 connections now open) 2015-10-05T07:29:51.129+0100 [mongosMain] connection accepted from 172.28.0.163:59085 #1428968 (400 connections now open) 2015-10-05T07:29:51.131+0100 [conn1428968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:51.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:51.732+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:52.385+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218e05703b51053ed027f 2015-10-05T07:29:52.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:29:54.620+0100 [conn1428537] end connection 172.28.0.163:57740 (399 connections now open) 2015-10-05T07:29:54.621+0100 [mongosMain] connection accepted from 172.28.0.163:59092 #1428969 (400 connections now open) 2015-10-05T07:29:54.622+0100 [conn1428969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:29:57.788+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:29:57.788+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:29:59.320+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:01.141+0100 [conn1428490] end connection 172.28.0.163:57508 (399 connections now open) 2015-10-05T07:30:01.142+0100 [mongosMain] connection accepted from 172.28.0.163:59108 #1428970 (400 connections now open) 2015-10-05T07:30:01.143+0100 [conn1428970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:01.605+0100 [conn1428557] end connection 172.28.0.164:51110 (399 connections now open) 2015-10-05T07:30:01.607+0100 [mongosMain] connection accepted from 172.28.0.164:52397 #1428971 (400 connections now open) 2015-10-05T07:30:01.608+0100 [conn1428971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:04.620+0100 [conn1428579] end connection 172.28.0.163:57884 (399 connections now open) 2015-10-05T07:30:04.621+0100 [mongosMain] connection accepted from 172.28.0.163:59118 #1428972 (400 connections now open) 2015-10-05T07:30:04.622+0100 [conn1428972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:04.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218ec5703b51053ed02fb 2015-10-05T07:30:04.883+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:04.884+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:04.916+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:07.546+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:30:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:30:10.329+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:11.156+0100 [conn1428481] end connection 172.28.0.163:57494 (399 connections now open) 2015-10-05T07:30:11.157+0100 [mongosMain] connection accepted from 172.28.0.163:59129 #1428973 (400 connections now open) 2015-10-05T07:30:11.158+0100 [conn1428973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:12.931+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:12.931+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:14.635+0100 [conn1428593] end connection 172.28.0.163:57955 (399 connections now open) 2015-10-05T07:30:14.636+0100 [mongosMain] connection accepted from 172.28.0.163:59138 #1428974 (400 connections now open) 2015-10-05T07:30:14.637+0100 [conn1428974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:17.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218f85703b51053ed039f 2015-10-05T07:30:17.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:21.155+0100 [conn1428473] end connection 172.28.0.163:57480 (399 connections now open) 2015-10-05T07:30:21.156+0100 [mongosMain] connection accepted from 172.28.0.163:59145 #1428975 (400 connections now open) 2015-10-05T07:30:21.157+0100 [conn1428975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:21.372+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:21.622+0100 [conn1428589] end connection 172.28.0.164:51232 (399 connections now open) 2015-10-05T07:30:21.623+0100 [mongosMain] connection accepted from 172.28.0.164:52415 #1428976 (400 connections now open) 2015-10-05T07:30:21.625+0100 [conn1428976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:21.972+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:21.972+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:23.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561218ff5703b51053ed03d9 2015-10-05T07:30:23.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:25.181+0100 [conn1428580] end connection 172.28.0.163:57887 (399 connections now open) 2015-10-05T07:30:25.182+0100 [mongosMain] connection accepted from 172.28.0.163:59149 #1428977 (400 connections now open) 2015-10-05T07:30:25.183+0100 [conn1428977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:25.538+0100 [conn1428539] end connection 172.28.0.164:51052 (399 connections now open) 2015-10-05T07:30:25.539+0100 [mongosMain] connection accepted from 172.28.0.164:52425 #1428978 (400 connections now open) 2015-10-05T07:30:25.541+0100 [conn1428978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:28.366+0100 [mongosMain] connection accepted from 127.0.0.1:59152 #1428979 (401 connections now open) 2015-10-05T07:30:28.368+0100 [conn1428979] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:28.374+0100 [conn1428979] end connection 127.0.0.1:59152 (400 connections now open) 2015-10-05T07:30:29.608+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219055703b51053ed040e 2015-10-05T07:30:29.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:31.172+0100 [conn1428585] end connection 172.28.0.163:57924 (399 connections now open) 2015-10-05T07:30:31.173+0100 [conn1428389] end connection 172.28.0.163:57258 (398 connections now open) 2015-10-05T07:30:31.174+0100 [mongosMain] connection accepted from 172.28.0.163:59155 #1428980 (399 connections now open) 2015-10-05T07:30:31.174+0100 [mongosMain] connection accepted from 172.28.0.163:59156 #1428981 (400 connections now open) 2015-10-05T07:30:31.175+0100 [conn1428980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:31.176+0100 [conn1428981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:31.638+0100 [conn1428583] end connection 172.28.0.164:51196 (399 connections now open) 2015-10-05T07:30:31.639+0100 [mongosMain] connection accepted from 172.28.0.164:52434 #1428982 (400 connections now open) 2015-10-05T07:30:31.642+0100 [conn1428982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:31.977+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:31.977+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:32.389+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:34.650+0100 [conn1428600] end connection 172.28.0.163:58030 (399 connections now open) 2015-10-05T07:30:34.651+0100 [mongosMain] connection accepted from 172.28.0.163:59160 #1428983 (400 connections now open) 2015-10-05T07:30:34.652+0100 [conn1428983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:35.196+0100 [conn1428601] end connection 172.28.0.163:58034 (399 connections now open) 2015-10-05T07:30:35.197+0100 [mongosMain] connection accepted from 172.28.0.163:59162 #1428984 (400 connections now open) 2015-10-05T07:30:35.198+0100 [conn1428984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:35.537+0100 [conn1428464] end connection 172.28.0.164:50684 (399 connections now open) 2015-10-05T07:30:35.538+0100 [mongosMain] connection accepted from 172.28.0.164:52441 #1428985 (400 connections now open) 2015-10-05T07:30:35.539+0100 [conn1428985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:35.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612190b5703b51053ed0456 2015-10-05T07:30:36.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:36.162+0100 [conn1428566] end connection 172.28.0.164:51141 (399 connections now open) 2015-10-05T07:30:36.163+0100 [mongosMain] connection accepted from 172.28.0.164:52444 #1428986 (400 connections now open) 2015-10-05T07:30:36.165+0100 [conn1428986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:37.868+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:30:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:30:40.059+0100 [mongosMain] connection accepted from 127.0.0.1:59164 #1428987 (401 connections now open) 2015-10-05T07:30:40.062+0100 [conn1428987] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:40.066+0100 [conn1428987] end connection 127.0.0.1:59164 (400 connections now open) 2015-10-05T07:30:41.174+0100 [conn1428568] end connection 172.28.0.163:57831 (399 connections now open) 2015-10-05T07:30:41.175+0100 [conn1428428] end connection 172.28.0.163:57370 (399 connections now open) 2015-10-05T07:30:41.176+0100 [mongosMain] connection accepted from 172.28.0.163:59167 #1428988 (399 connections now open) 2015-10-05T07:30:41.176+0100 [mongosMain] connection accepted from 172.28.0.163:59168 #1428989 (400 connections now open) 2015-10-05T07:30:41.177+0100 [conn1428988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:41.177+0100 [conn1428989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:41.653+0100 [conn1428592] end connection 172.28.0.164:51251 (399 connections now open) 2015-10-05T07:30:41.654+0100 [mongosMain] connection accepted from 172.28.0.164:52455 #1428990 (400 connections now open) 2015-10-05T07:30:41.656+0100 [conn1428990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:42.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219125703b51053ed04be 2015-10-05T07:30:42.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:42.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:42.982+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:43.394+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:44.666+0100 [conn1428595] end connection 172.28.0.163:57975 (399 connections now open) 2015-10-05T07:30:44.667+0100 [mongosMain] connection accepted from 172.28.0.163:59176 #1428991 (400 connections now open) 2015-10-05T07:30:44.668+0100 [conn1428991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:45.212+0100 [conn1428606] end connection 172.28.0.163:58047 (399 connections now open) 2015-10-05T07:30:45.213+0100 [mongosMain] connection accepted from 172.28.0.163:59179 #1428992 (400 connections now open) 2015-10-05T07:30:45.214+0100 [conn1428992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:46.161+0100 [conn1428607] end connection 172.28.0.164:51320 (399 connections now open) 2015-10-05T07:30:46.162+0100 [mongosMain] connection accepted from 172.28.0.164:52464 #1428993 (400 connections now open) 2015-10-05T07:30:46.164+0100 [conn1428993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:48.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219185703b51053ed0525 2015-10-05T07:30:48.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:51.187+0100 [conn1428603] end connection 172.28.0.163:58043 (399 connections now open) 2015-10-05T07:30:51.188+0100 [mongosMain] connection accepted from 172.28.0.163:59187 #1428994 (400 connections now open) 2015-10-05T07:30:51.189+0100 [conn1428994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:51.670+0100 [conn1428425] end connection 172.28.0.164:50467 (399 connections now open) 2015-10-05T07:30:51.671+0100 [mongosMain] connection accepted from 172.28.0.164:52474 #1428995 (400 connections now open) 2015-10-05T07:30:51.673+0100 [conn1428995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:54.405+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:54.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612191e5703b51053ed057f 2015-10-05T07:30:54.669+0100 [conn1428586] end connection 172.28.0.163:57930 (399 connections now open) 2015-10-05T07:30:54.670+0100 [mongosMain] connection accepted from 172.28.0.163:59198 #1428996 (400 connections now open) 2015-10-05T07:30:54.671+0100 [conn1428996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:54.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:30:54.985+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:54.985+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:30:55.684+0100 [conn1428572] end connection 172.28.0.164:51159 (399 connections now open) 2015-10-05T07:30:55.686+0100 [mongosMain] connection accepted from 172.28.0.164:52481 #1428997 (400 connections now open) 2015-10-05T07:30:55.688+0100 [conn1428997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:56.177+0100 [conn1428614] end connection 172.28.0.164:51341 (399 connections now open) 2015-10-05T07:30:56.178+0100 [mongosMain] connection accepted from 172.28.0.164:52483 #1428998 (400 connections now open) 2015-10-05T07:30:56.180+0100 [conn1428998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:30:56.990+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:30:56.990+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:00.073+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:00.073+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:01.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219245703b51053ed05cb 2015-10-05T07:31:01.202+0100 [conn1428467] end connection 172.28.0.163:57465 (399 connections now open) 2015-10-05T07:31:01.204+0100 [mongosMain] connection accepted from 172.28.0.163:59217 #1428999 (400 connections now open) 2015-10-05T07:31:01.205+0100 [conn1428999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:01.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:01.685+0100 [conn1428508] end connection 172.28.0.164:50874 (399 connections now open) 2015-10-05T07:31:01.686+0100 [mongosMain] connection accepted from 172.28.0.164:52497 #1429000 (400 connections now open) 2015-10-05T07:31:01.687+0100 [conn1429000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:04.103+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:04.103+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:04.684+0100 [conn1428597] end connection 172.28.0.163:58021 (399 connections now open) 2015-10-05T07:31:04.684+0100 [mongosMain] connection accepted from 172.28.0.163:59232 #1429001 (400 connections now open) 2015-10-05T07:31:04.685+0100 [conn1429001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:05.228+0100 [conn1428612] end connection 172.28.0.163:58067 (399 connections now open) 2015-10-05T07:31:05.237+0100 [mongosMain] connection accepted from 172.28.0.163:59234 #1429002 (400 connections now open) 2015-10-05T07:31:05.239+0100 [conn1429002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:05.415+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:06.192+0100 [conn1428620] end connection 172.28.0.164:51360 (399 connections now open) 2015-10-05T07:31:06.193+0100 [mongosMain] connection accepted from 172.28.0.164:52502 #1429003 (400 connections now open) 2015-10-05T07:31:06.195+0100 [conn1429003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:07.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612192b5703b51053ed0639 2015-10-05T07:31:07.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:08.015+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:31:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:31:09.111+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:09.111+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:11.204+0100 [conn1428577] end connection 172.28.0.163:57873 (399 connections now open) 2015-10-05T07:31:11.205+0100 [mongosMain] connection accepted from 172.28.0.163:59242 #1429004 (400 connections now open) 2015-10-05T07:31:11.206+0100 [conn1429004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:11.723+0100 [conn1428610] end connection 172.28.0.164:51330 (399 connections now open) 2015-10-05T07:31:11.724+0100 [mongosMain] connection accepted from 172.28.0.164:52511 #1429005 (400 connections now open) 2015-10-05T07:31:11.726+0100 [conn1429005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:13.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219315703b51053ed067a 2015-10-05T07:31:13.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:14.683+0100 [conn1428590] end connection 172.28.0.163:57941 (399 connections now open) 2015-10-05T07:31:14.685+0100 [mongosMain] connection accepted from 172.28.0.163:59270 #1429006 (400 connections now open) 2015-10-05T07:31:14.686+0100 [conn1429006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:15.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:15.131+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:15.231+0100 [conn1428625] end connection 172.28.0.163:58109 (399 connections now open) 2015-10-05T07:31:15.232+0100 [mongosMain] connection accepted from 172.28.0.163:59273 #1429007 (400 connections now open) 2015-10-05T07:31:15.233+0100 [conn1429007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:15.584+0100 [conn1428554] end connection 172.28.0.164:51100 (399 connections now open) 2015-10-05T07:31:15.585+0100 [mongosMain] connection accepted from 172.28.0.164:52516 #1429008 (400 connections now open) 2015-10-05T07:31:15.587+0100 [conn1429008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:16.193+0100 [conn1428626] end connection 172.28.0.164:51369 (399 connections now open) 2015-10-05T07:31:16.194+0100 [mongosMain] connection accepted from 172.28.0.164:52519 #1429009 (400 connections now open) 2015-10-05T07:31:16.196+0100 [conn1429009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:16.417+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:20.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219375703b51053ed06ea 2015-10-05T07:31:20.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:21.204+0100 [conn1428598] end connection 172.28.0.163:58029 (399 connections now open) 2015-10-05T07:31:21.205+0100 [conn1428534] end connection 172.28.0.163:57732 (398 connections now open) 2015-10-05T07:31:21.205+0100 [mongosMain] connection accepted from 172.28.0.163:59299 #1429010 (399 connections now open) 2015-10-05T07:31:21.206+0100 [mongosMain] connection accepted from 172.28.0.163:59300 #1429011 (400 connections now open) 2015-10-05T07:31:21.206+0100 [conn1429010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:21.207+0100 [conn1429011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:21.732+0100 [conn1428546] end connection 172.28.0.164:51083 (399 connections now open) 2015-10-05T07:31:21.733+0100 [conn1428623] end connection 172.28.0.164:51364 (398 connections now open) 2015-10-05T07:31:21.734+0100 [mongosMain] connection accepted from 172.28.0.164:52530 #1429012 (399 connections now open) 2015-10-05T07:31:21.734+0100 [mongosMain] connection accepted from 172.28.0.164:52531 #1429013 (400 connections now open) 2015-10-05T07:31:21.735+0100 [conn1429012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:21.737+0100 [conn1429013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:22.134+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:22.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:24.698+0100 [conn1428605] end connection 172.28.0.163:58045 (399 connections now open) 2015-10-05T07:31:24.700+0100 [mongosMain] connection accepted from 172.28.0.163:59305 #1429014 (400 connections now open) 2015-10-05T07:31:24.701+0100 [conn1429014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:25.244+0100 [conn1428630] end connection 172.28.0.163:58130 (399 connections now open) 2015-10-05T07:31:25.245+0100 [mongosMain] connection accepted from 172.28.0.163:59306 #1429015 (400 connections now open) 2015-10-05T07:31:25.246+0100 [conn1429015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:25.600+0100 [conn1428549] end connection 172.28.0.164:51089 (399 connections now open) 2015-10-05T07:31:25.609+0100 [mongosMain] connection accepted from 172.28.0.164:52535 #1429016 (400 connections now open) 2015-10-05T07:31:25.627+0100 [conn1429016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:26.208+0100 [conn1428631] end connection 172.28.0.164:51387 (399 connections now open) 2015-10-05T07:31:26.209+0100 [mongosMain] connection accepted from 172.28.0.164:52541 #1429017 (400 connections now open) 2015-10-05T07:31:26.210+0100 [conn1429017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:26.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612193e5703b51053ed0770 2015-10-05T07:31:26.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:27.420+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:28.227+0100 [mongosMain] connection accepted from 127.0.0.1:59311 #1429018 (401 connections now open) 2015-10-05T07:31:28.229+0100 [conn1429018] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:28.234+0100 [conn1429018] end connection 127.0.0.1:59311 (400 connections now open) 2015-10-05T07:31:30.145+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:30.145+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:31.219+0100 [conn1428609] end connection 172.28.0.163:58054 (399 connections now open) 2015-10-05T07:31:31.219+0100 [conn1428436] end connection 172.28.0.163:57382 (399 connections now open) 2015-10-05T07:31:31.220+0100 [mongosMain] connection accepted from 172.28.0.163:59317 #1429019 (399 connections now open) 2015-10-05T07:31:31.221+0100 [mongosMain] connection accepted from 172.28.0.163:59318 #1429020 (400 connections now open) 2015-10-05T07:31:31.221+0100 [conn1429019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:31.222+0100 [conn1429020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:31.747+0100 [conn1428514] end connection 172.28.0.164:50936 (399 connections now open) 2015-10-05T07:31:31.748+0100 [conn1428616] end connection 172.28.0.164:51348 (398 connections now open) 2015-10-05T07:31:31.749+0100 [mongosMain] connection accepted from 172.28.0.164:52552 #1429021 (399 connections now open) 2015-10-05T07:31:31.749+0100 [mongosMain] connection accepted from 172.28.0.164:52553 #1429022 (400 connections now open) 2015-10-05T07:31:31.750+0100 [conn1429022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:31.750+0100 [conn1429021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:32.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219445703b51053ed07e4 2015-10-05T07:31:33.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:34.708+0100 [conn1428624] end connection 172.28.0.163:58107 (399 connections now open) 2015-10-05T07:31:34.709+0100 [mongosMain] connection accepted from 172.28.0.163:59320 #1429023 (400 connections now open) 2015-10-05T07:31:34.710+0100 [conn1429023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:35.254+0100 [conn1428635] end connection 172.28.0.163:58142 (399 connections now open) 2015-10-05T07:31:35.255+0100 [mongosMain] connection accepted from 172.28.0.163:59321 #1429024 (400 connections now open) 2015-10-05T07:31:35.257+0100 [conn1429024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:36.224+0100 [conn1428637] end connection 172.28.0.164:51408 (399 connections now open) 2015-10-05T07:31:36.225+0100 [mongosMain] connection accepted from 172.28.0.164:52559 #1429025 (400 connections now open) 2015-10-05T07:31:36.228+0100 [conn1429025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:38.152+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:31:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:31:38.420+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:39.154+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:39.154+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:39.320+0100 [mongosMain] connection accepted from 127.0.0.1:59334 #1429026 (401 connections now open) 2015-10-05T07:31:39.323+0100 [conn1429026] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:39.329+0100 [conn1429026] end connection 127.0.0.1:59334 (400 connections now open) 2015-10-05T07:31:39.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612194b5703b51053ed0833 2015-10-05T07:31:39.551+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:41.236+0100 [conn1428622] end connection 172.28.0.163:58100 (399 connections now open) 2015-10-05T07:31:41.237+0100 [mongosMain] connection accepted from 172.28.0.163:59336 #1429027 (400 connections now open) 2015-10-05T07:31:41.238+0100 [conn1429027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:41.748+0100 [conn1428547] end connection 172.28.0.164:51084 (399 connections now open) 2015-10-05T07:31:41.749+0100 [mongosMain] connection accepted from 172.28.0.164:52573 #1429028 (400 connections now open) 2015-10-05T07:31:41.752+0100 [conn1429028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:44.713+0100 [conn1428618] end connection 172.28.0.163:58083 (399 connections now open) 2015-10-05T07:31:44.714+0100 [mongosMain] connection accepted from 172.28.0.163:59343 #1429029 (400 connections now open) 2015-10-05T07:31:44.716+0100 [conn1429029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:45.259+0100 [conn1428643] end connection 172.28.0.163:58154 (399 connections now open) 2015-10-05T07:31:45.260+0100 [mongosMain] connection accepted from 172.28.0.163:59349 #1429030 (400 connections now open) 2015-10-05T07:31:45.261+0100 [conn1429030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:46.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219515703b51053ed0882 2015-10-05T07:31:46.240+0100 [conn1428645] end connection 172.28.0.164:51433 (399 connections now open) 2015-10-05T07:31:46.241+0100 [mongosMain] connection accepted from 172.28.0.164:52582 #1429031 (400 connections now open) 2015-10-05T07:31:46.242+0100 [conn1429031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:46.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:49.164+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:49.165+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:31:49.431+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:31:51.253+0100 [conn1428628] end connection 172.28.0.163:58124 (399 connections now open) 2015-10-05T07:31:51.254+0100 [mongosMain] connection accepted from 172.28.0.163:59367 #1429032 (400 connections now open) 2015-10-05T07:31:51.255+0100 [conn1429032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:51.748+0100 [conn1428569] end connection 172.28.0.164:51151 (399 connections now open) 2015-10-05T07:31:51.749+0100 [mongosMain] connection accepted from 172.28.0.164:52588 #1429033 (400 connections now open) 2015-10-05T07:31:51.752+0100 [conn1429033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:52.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219585703b51053ed08d6 2015-10-05T07:31:52.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:31:54.715+0100 [conn1428634] end connection 172.28.0.163:58140 (399 connections now open) 2015-10-05T07:31:54.716+0100 [mongosMain] connection accepted from 172.28.0.163:59384 #1429034 (400 connections now open) 2015-10-05T07:31:54.717+0100 [conn1429034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:56.256+0100 [conn1428652] end connection 172.28.0.164:51453 (399 connections now open) 2015-10-05T07:31:56.260+0100 [mongosMain] connection accepted from 172.28.0.164:52600 #1429035 (400 connections now open) 2015-10-05T07:31:56.262+0100 [conn1429035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:31:59.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612195e5703b51053ed0932 2015-10-05T07:31:59.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:00.181+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:00.181+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:00.493+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:01.253+0100 [conn1428528] end connection 172.28.0.163:57722 (399 connections now open) 2015-10-05T07:32:01.254+0100 [conn1428632] end connection 172.28.0.163:58135 (398 connections now open) 2015-10-05T07:32:01.254+0100 [mongosMain] connection accepted from 172.28.0.163:59413 #1429036 (399 connections now open) 2015-10-05T07:32:01.255+0100 [mongosMain] connection accepted from 172.28.0.163:59417 #1429037 (400 connections now open) 2015-10-05T07:32:01.255+0100 [conn1429036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:01.256+0100 [conn1429037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:01.764+0100 [conn1428648] end connection 172.28.0.164:51444 (399 connections now open) 2015-10-05T07:32:01.764+0100 [conn1428633] end connection 172.28.0.164:51398 (398 connections now open) 2015-10-05T07:32:01.765+0100 [mongosMain] connection accepted from 172.28.0.164:52612 #1429038 (399 connections now open) 2015-10-05T07:32:01.765+0100 [mongosMain] connection accepted from 172.28.0.164:52613 #1429039 (400 connections now open) 2015-10-05T07:32:01.766+0100 [conn1429038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:01.767+0100 [conn1429039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:05.275+0100 [conn1428651] end connection 172.28.0.163:58169 (399 connections now open) 2015-10-05T07:32:05.276+0100 [mongosMain] connection accepted from 172.28.0.163:59432 #1429040 (400 connections now open) 2015-10-05T07:32:05.277+0100 [conn1429040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:05.632+0100 [conn1428613] end connection 172.28.0.164:51338 (399 connections now open) 2015-10-05T07:32:05.633+0100 [mongosMain] connection accepted from 172.28.0.164:52619 #1429041 (400 connections now open) 2015-10-05T07:32:05.636+0100 [conn1429041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:05.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219655703b51053ed09a2 2015-10-05T07:32:06.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:06.256+0100 [conn1428657] end connection 172.28.0.164:51470 (399 connections now open) 2015-10-05T07:32:06.257+0100 [mongosMain] connection accepted from 172.28.0.164:52621 #1429042 (400 connections now open) 2015-10-05T07:32:06.259+0100 [conn1429042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:08.321+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:32:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:32:11.255+0100 [conn1428506] end connection 172.28.0.163:57590 (399 connections now open) 2015-10-05T07:32:11.255+0100 [conn1428647] end connection 172.28.0.163:58159 (399 connections now open) 2015-10-05T07:32:11.256+0100 [mongosMain] connection accepted from 172.28.0.163:59476 #1429043 (399 connections now open) 2015-10-05T07:32:11.256+0100 [mongosMain] connection accepted from 172.28.0.163:59484 #1429044 (400 connections now open) 2015-10-05T07:32:11.257+0100 [conn1429043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:11.257+0100 [conn1429044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:11.495+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:11.778+0100 [conn1428629] end connection 172.28.0.164:51380 (399 connections now open) 2015-10-05T07:32:11.779+0100 [mongosMain] connection accepted from 172.28.0.164:52625 #1429045 (400 connections now open) 2015-10-05T07:32:11.780+0100 [conn1428454] end connection 172.28.0.164:50657 (399 connections now open) 2015-10-05T07:32:11.781+0100 [conn1429045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:11.793+0100 [mongosMain] connection accepted from 172.28.0.164:52626 #1429046 (400 connections now open) 2015-10-05T07:32:11.794+0100 [conn1429046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:12.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612196c5703b51053ed0a06 2015-10-05T07:32:12.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:12.272+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:12.273+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:14.274+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:14.274+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:15.291+0100 [conn1428663] end connection 172.28.0.163:58209 (399 connections now open) 2015-10-05T07:32:15.292+0100 [mongosMain] connection accepted from 172.28.0.163:59503 #1429047 (400 connections now open) 2015-10-05T07:32:15.294+0100 [conn1429047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:15.647+0100 [conn1428619] end connection 172.28.0.164:51357 (399 connections now open) 2015-10-05T07:32:15.648+0100 [mongosMain] connection accepted from 172.28.0.164:52628 #1429048 (400 connections now open) 2015-10-05T07:32:15.650+0100 [conn1429048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:16.271+0100 [conn1428665] end connection 172.28.0.164:51489 (399 connections now open) 2015-10-05T07:32:16.273+0100 [mongosMain] connection accepted from 172.28.0.164:52631 #1429049 (400 connections now open) 2015-10-05T07:32:16.276+0100 [conn1429049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:17.275+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:17.276+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:18.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219725703b51053ed0a63 2015-10-05T07:32:18.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:21.266+0100 [conn1428639] end connection 172.28.0.163:58146 (399 connections now open) 2015-10-05T07:32:21.267+0100 [mongosMain] connection accepted from 172.28.0.163:59529 #1429050 (400 connections now open) 2015-10-05T07:32:21.268+0100 [conn1429050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:21.283+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:21.283+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:21.795+0100 [conn1428604] end connection 172.28.0.164:51312 (399 connections now open) 2015-10-05T07:32:21.796+0100 [mongosMain] connection accepted from 172.28.0.164:52642 #1429051 (400 connections now open) 2015-10-05T07:32:21.797+0100 [conn1429051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:22.505+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:25.292+0100 [conn1428671] end connection 172.28.0.163:58233 (399 connections now open) 2015-10-05T07:32:25.293+0100 [mongosMain] connection accepted from 172.28.0.163:59533 #1429052 (400 connections now open) 2015-10-05T07:32:25.294+0100 [conn1429052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:25.664+0100 [conn1428565] end connection 172.28.0.164:51137 (399 connections now open) 2015-10-05T07:32:25.665+0100 [mongosMain] connection accepted from 172.28.0.164:52648 #1429053 (400 connections now open) 2015-10-05T07:32:25.667+0100 [conn1429053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:26.287+0100 [conn1428673] end connection 172.28.0.164:51507 (399 connections now open) 2015-10-05T07:32:26.289+0100 [mongosMain] connection accepted from 172.28.0.164:52653 #1429054 (400 connections now open) 2015-10-05T07:32:26.290+0100 [conn1429054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:26.333+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:26.333+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:28.596+0100 [mongosMain] connection accepted from 127.0.0.1:59536 #1429055 (401 connections now open) 2015-10-05T07:32:28.599+0100 [conn1429055] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:28.605+0100 [conn1429055] end connection 127.0.0.1:59536 (400 connections now open) 2015-10-05T07:32:30.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612197e5703b51053ed0b03 2015-10-05T07:32:30.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:31.270+0100 [conn1428683] end connection 172.28.0.163:58252 (399 connections now open) 2015-10-05T07:32:31.271+0100 [mongosMain] connection accepted from 172.28.0.163:59538 #1429056 (400 connections now open) 2015-10-05T07:32:31.272+0100 [conn1429056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:31.796+0100 [conn1428599] end connection 172.28.0.164:51297 (399 connections now open) 2015-10-05T07:32:31.797+0100 [mongosMain] connection accepted from 172.28.0.164:52662 #1429057 (400 connections now open) 2015-10-05T07:32:31.799+0100 [conn1429057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:32.332+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:32.333+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:33.518+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:34.761+0100 [conn1428596] end connection 172.28.0.163:57993 (399 connections now open) 2015-10-05T07:32:34.762+0100 [mongosMain] connection accepted from 172.28.0.163:59546 #1429058 (400 connections now open) 2015-10-05T07:32:34.763+0100 [conn1429058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:35.307+0100 [conn1428679] end connection 172.28.0.163:58247 (399 connections now open) 2015-10-05T07:32:35.309+0100 [mongosMain] connection accepted from 172.28.0.163:59549 #1429059 (400 connections now open) 2015-10-05T07:32:35.310+0100 [conn1429059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:35.664+0100 [conn1428672] end connection 172.28.0.164:51504 (399 connections now open) 2015-10-05T07:32:35.665+0100 [mongosMain] connection accepted from 172.28.0.164:52670 #1429060 (400 connections now open) 2015-10-05T07:32:35.667+0100 [conn1429060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:36.287+0100 [conn1428681] end connection 172.28.0.164:51527 (399 connections now open) 2015-10-05T07:32:36.288+0100 [mongosMain] connection accepted from 172.28.0.164:52671 #1429061 (400 connections now open) 2015-10-05T07:32:36.290+0100 [conn1429061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:36.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219845703b51053ed0b5c 2015-10-05T07:32:37.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:38.592+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:32:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:32:39.339+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:39.339+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:39.974+0100 [mongosMain] connection accepted from 127.0.0.1:59554 #1429062 (401 connections now open) 2015-10-05T07:32:39.976+0100 [conn1429062] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:39.981+0100 [conn1429062] end connection 127.0.0.1:59554 (400 connections now open) 2015-10-05T07:32:41.282+0100 [conn1428658] end connection 172.28.0.163:58197 (399 connections now open) 2015-10-05T07:32:41.283+0100 [mongosMain] connection accepted from 172.28.0.163:59565 #1429063 (400 connections now open) 2015-10-05T07:32:41.284+0100 [conn1429063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:41.796+0100 [conn1428640] end connection 172.28.0.164:51422 (399 connections now open) 2015-10-05T07:32:41.797+0100 [mongosMain] connection accepted from 172.28.0.164:52682 #1429064 (400 connections now open) 2015-10-05T07:32:41.799+0100 [conn1429064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:43.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612198b5703b51053ed0bbf 2015-10-05T07:32:43.269+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:44.542+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:44.761+0100 [conn1428642] end connection 172.28.0.163:58152 (399 connections now open) 2015-10-05T07:32:44.761+0100 [mongosMain] connection accepted from 172.28.0.163:59573 #1429065 (400 connections now open) 2015-10-05T07:32:44.762+0100 [conn1429065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:45.308+0100 [conn1428686] end connection 172.28.0.163:58257 (399 connections now open) 2015-10-05T07:32:45.309+0100 [mongosMain] connection accepted from 172.28.0.163:59575 #1429066 (400 connections now open) 2015-10-05T07:32:45.310+0100 [conn1429066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:46.304+0100 [conn1428688] end connection 172.28.0.164:51547 (399 connections now open) 2015-10-05T07:32:46.304+0100 [mongosMain] connection accepted from 172.28.0.164:52694 #1429067 (400 connections now open) 2015-10-05T07:32:46.306+0100 [conn1429067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:47.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:47.354+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:32:51.303+0100 [conn1428627] end connection 172.28.0.163:58123 (399 connections now open) 2015-10-05T07:32:51.307+0100 [mongosMain] connection accepted from 172.28.0.163:59585 #1429068 (400 connections now open) 2015-10-05T07:32:51.308+0100 [conn1429068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:51.810+0100 [conn1428668] end connection 172.28.0.164:51498 (399 connections now open) 2015-10-05T07:32:51.811+0100 [mongosMain] connection accepted from 172.28.0.164:52703 #1429069 (400 connections now open) 2015-10-05T07:32:51.813+0100 [conn1429069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:54.776+0100 [conn1428678] end connection 172.28.0.163:58245 (399 connections now open) 2015-10-05T07:32:54.777+0100 [mongosMain] connection accepted from 172.28.0.163:59590 #1429070 (400 connections now open) 2015-10-05T07:32:54.778+0100 [conn1429070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:55.322+0100 [conn1428694] end connection 172.28.0.163:58273 (399 connections now open) 2015-10-05T07:32:55.323+0100 [mongosMain] connection accepted from 172.28.0.163:59594 #1429071 (400 connections now open) 2015-10-05T07:32:55.325+0100 [conn1429071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:55.547+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:55.695+0100 [conn1428644] end connection 172.28.0.164:51431 (399 connections now open) 2015-10-05T07:32:55.696+0100 [mongosMain] connection accepted from 172.28.0.164:52709 #1429072 (400 connections now open) 2015-10-05T07:32:55.698+0100 [conn1429072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:55.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219975703b51053ed0c82 2015-10-05T07:32:55.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:32:56.319+0100 [conn1428696] end connection 172.28.0.164:51568 (399 connections now open) 2015-10-05T07:32:56.320+0100 [mongosMain] connection accepted from 172.28.0.164:52711 #1429073 (400 connections now open) 2015-10-05T07:32:56.321+0100 [conn1429073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:32:56.360+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:32:56.360+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:01.300+0100 [conn1428375] end connection 172.28.0.163:57209 (399 connections now open) 2015-10-05T07:33:01.302+0100 [mongosMain] connection accepted from 172.28.0.163:59606 #1429074 (400 connections now open) 2015-10-05T07:33:01.303+0100 [conn1429074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:01.852+0100 [conn1428655] end connection 172.28.0.164:51464 (399 connections now open) 2015-10-05T07:33:01.853+0100 [conn1428578] end connection 172.28.0.164:51181 (398 connections now open) 2015-10-05T07:33:01.854+0100 [mongosMain] connection accepted from 172.28.0.164:52730 #1429075 (399 connections now open) 2015-10-05T07:33:01.854+0100 [mongosMain] connection accepted from 172.28.0.164:52731 #1429076 (400 connections now open) 2015-10-05T07:33:01.856+0100 [conn1429075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:01.856+0100 [conn1429076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:04.779+0100 [conn1428662] end connection 172.28.0.163:58204 (399 connections now open) 2015-10-05T07:33:04.781+0100 [mongosMain] connection accepted from 172.28.0.163:59621 #1429077 (400 connections now open) 2015-10-05T07:33:04.782+0100 [conn1429077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:05.325+0100 [conn1428701] end connection 172.28.0.163:58293 (399 connections now open) 2015-10-05T07:33:05.327+0100 [mongosMain] connection accepted from 172.28.0.163:59623 #1429078 (400 connections now open) 2015-10-05T07:33:05.328+0100 [conn1429078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:05.713+0100 [mongosMain] connection accepted from 172.28.0.164:52739 #1429079 (401 connections now open) 2015-10-05T07:33:05.714+0100 [conn1428687] end connection 172.28.0.164:51544 (400 connections now open) 2015-10-05T07:33:05.717+0100 [conn1429079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:06.320+0100 [conn1428703] end connection 172.28.0.164:51589 (399 connections now open) 2015-10-05T07:33:06.322+0100 [mongosMain] connection accepted from 172.28.0.164:52742 #1429080 (400 connections now open) 2015-10-05T07:33:06.323+0100 [conn1429080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:06.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:06.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:06.561+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:08.816+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:33:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:33:11.314+0100 [conn1428674] end connection 172.28.0.163:58239 (399 connections now open) 2015-10-05T07:33:11.315+0100 [mongosMain] connection accepted from 172.28.0.163:59635 #1429081 (400 connections now open) 2015-10-05T07:33:11.316+0100 [conn1429081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:11.855+0100 [conn1428649] end connection 172.28.0.164:51445 (399 connections now open) 2015-10-05T07:33:11.855+0100 [mongosMain] connection accepted from 172.28.0.164:52747 #1429082 (400 connections now open) 2015-10-05T07:33:11.855+0100 [conn1428654] end connection 172.28.0.164:51463 (399 connections now open) 2015-10-05T07:33:11.855+0100 [mongosMain] connection accepted from 172.28.0.164:52748 #1429083 (400 connections now open) 2015-10-05T07:33:11.855+0100 [conn1429082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:11.855+0100 [conn1429083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:14.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219aa5703b51053ed0d70 2015-10-05T07:33:14.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:14.835+0100 [conn1428611] end connection 172.28.0.163:58065 (399 connections now open) 2015-10-05T07:33:14.835+0100 [mongosMain] connection accepted from 172.28.0.163:59643 #1429084 (400 connections now open) 2015-10-05T07:33:14.835+0100 [conn1429084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:15.412+0100 [conn1428708] end connection 172.28.0.163:58327 (399 connections now open) 2015-10-05T07:33:15.412+0100 [mongosMain] connection accepted from 172.28.0.163:59645 #1429085 (400 connections now open) 2015-10-05T07:33:15.412+0100 [conn1429085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:15.727+0100 [conn1428695] end connection 172.28.0.164:51566 (399 connections now open) 2015-10-05T07:33:15.728+0100 [mongosMain] connection accepted from 172.28.0.164:52753 #1429086 (400 connections now open) 2015-10-05T07:33:15.729+0100 [conn1429086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:16.334+0100 [conn1428710] end connection 172.28.0.164:51610 (399 connections now open) 2015-10-05T07:33:16.336+0100 [mongosMain] connection accepted from 172.28.0.164:52756 #1429087 (400 connections now open) 2015-10-05T07:33:16.337+0100 [conn1429087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:17.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:17.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:17.639+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:21.314+0100 [conn1428459] end connection 172.28.0.163:57436 (399 connections now open) 2015-10-05T07:33:21.314+0100 [conn1428659] end connection 172.28.0.163:58196 (399 connections now open) 2015-10-05T07:33:21.315+0100 [mongosMain] connection accepted from 172.28.0.163:59654 #1429088 (399 connections now open) 2015-10-05T07:33:21.315+0100 [mongosMain] connection accepted from 172.28.0.163:59655 #1429089 (400 connections now open) 2015-10-05T07:33:21.316+0100 [conn1429088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:21.316+0100 [conn1429089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:21.842+0100 [conn1428691] end connection 172.28.0.164:51556 (399 connections now open) 2015-10-05T07:33:21.843+0100 [conn1428684] end connection 172.28.0.164:51537 (398 connections now open) 2015-10-05T07:33:21.844+0100 [mongosMain] connection accepted from 172.28.0.164:52764 #1429090 (399 connections now open) 2015-10-05T07:33:21.844+0100 [mongosMain] connection accepted from 172.28.0.164:52765 #1429091 (400 connections now open) 2015-10-05T07:33:21.846+0100 [conn1429090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:21.847+0100 [conn1429091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:24.793+0100 [conn1428693] end connection 172.28.0.163:58270 (399 connections now open) 2015-10-05T07:33:24.794+0100 [mongosMain] connection accepted from 172.28.0.163:59657 #1429092 (400 connections now open) 2015-10-05T07:33:24.795+0100 [conn1429092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:25.370+0100 [conn1428715] end connection 172.28.0.163:58352 (399 connections now open) 2015-10-05T07:33:25.371+0100 [mongosMain] connection accepted from 172.28.0.163:59659 #1429093 (400 connections now open) 2015-10-05T07:33:25.372+0100 [conn1429093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:25.744+0100 [conn1428709] end connection 172.28.0.164:51607 (399 connections now open) 2015-10-05T07:33:25.748+0100 [mongosMain] connection accepted from 172.28.0.164:52785 #1429094 (400 connections now open) 2015-10-05T07:33:25.753+0100 [conn1429094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:26.350+0100 [conn1428716] end connection 172.28.0.164:51631 (399 connections now open) 2015-10-05T07:33:26.352+0100 [mongosMain] connection accepted from 172.28.0.164:52792 #1429095 (400 connections now open) 2015-10-05T07:33:26.354+0100 [conn1429095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:26.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219b65703b51053ed0dd4 2015-10-05T07:33:26.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:28.650+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:29.029+0100 [mongosMain] connection accepted from 127.0.0.1:59663 #1429096 (401 connections now open) 2015-10-05T07:33:29.031+0100 [conn1429096] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:29.037+0100 [conn1429096] end connection 127.0.0.1:59663 (400 connections now open) 2015-10-05T07:33:29.420+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:29.421+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:31.329+0100 [conn1428519] end connection 172.28.0.163:57669 (399 connections now open) 2015-10-05T07:33:31.329+0100 [conn1428615] end connection 172.28.0.163:58077 (399 connections now open) 2015-10-05T07:33:31.330+0100 [mongosMain] connection accepted from 172.28.0.163:59665 #1429097 (399 connections now open) 2015-10-05T07:33:31.331+0100 [mongosMain] connection accepted from 172.28.0.163:59666 #1429098 (400 connections now open) 2015-10-05T07:33:31.331+0100 [conn1429097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:31.332+0100 [conn1429098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:31.430+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:31.430+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:31.859+0100 [conn1428677] end connection 172.28.0.164:51518 (399 connections now open) 2015-10-05T07:33:31.860+0100 [mongosMain] connection accepted from 172.28.0.164:52799 #1429099 (400 connections now open) 2015-10-05T07:33:31.861+0100 [conn1429099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:33.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219bc5703b51053ed0e15 2015-10-05T07:33:33.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:34.435+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:34.436+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:34.808+0100 [conn1428656] end connection 172.28.0.163:58186 (399 connections now open) 2015-10-05T07:33:34.810+0100 [mongosMain] connection accepted from 172.28.0.163:59673 #1429100 (400 connections now open) 2015-10-05T07:33:34.811+0100 [conn1429100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:35.385+0100 [conn1428722] end connection 172.28.0.163:58370 (399 connections now open) 2015-10-05T07:33:35.386+0100 [mongosMain] connection accepted from 172.28.0.163:59676 #1429101 (400 connections now open) 2015-10-05T07:33:35.387+0100 [conn1429101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:36.367+0100 [conn1428723] end connection 172.28.0.164:51653 (399 connections now open) 2015-10-05T07:33:36.368+0100 [mongosMain] connection accepted from 172.28.0.164:52812 #1429102 (400 connections now open) 2015-10-05T07:33:36.370+0100 [conn1429102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:38.198+0100 [mongosMain] connection accepted from 172.21.40.52:49122 #1429103 (401 connections now open) 2015-10-05T07:33:38.393+0100 [mongosMain] connection accepted from 172.21.40.52:49123 #1429104 (402 connections now open) 2015-10-05T07:33:38.442+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:38.442+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:38.473+0100 [conn1429104] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:38.961+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:33:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:33:39.459+0100 [mongosMain] connection accepted from 127.0.0.1:59681 #1429105 (403 connections now open) 2015-10-05T07:33:39.462+0100 [conn1429105] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:39.462+0100 [conn1429105] end connection 127.0.0.1:59681 (402 connections now open) 2015-10-05T07:33:39.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219c35703b51053ed0e47 2015-10-05T07:33:39.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:39.664+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:41.332+0100 [conn1428675] end connection 172.28.0.163:58240 (401 connections now open) 2015-10-05T07:33:41.332+0100 [conn1428621] end connection 172.28.0.163:58099 (400 connections now open) 2015-10-05T07:33:41.333+0100 [mongosMain] connection accepted from 172.28.0.163:59683 #1429106 (401 connections now open) 2015-10-05T07:33:41.333+0100 [mongosMain] connection accepted from 172.28.0.163:59684 #1429107 (402 connections now open) 2015-10-05T07:33:41.334+0100 [conn1429106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:41.334+0100 [conn1429107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:41.858+0100 [conn1428712] end connection 172.28.0.164:51626 (401 connections now open) 2015-10-05T07:33:41.858+0100 [conn1428705] end connection 172.28.0.164:51601 (400 connections now open) 2015-10-05T07:33:41.859+0100 [mongosMain] connection accepted from 172.28.0.164:52825 #1429108 (401 connections now open) 2015-10-05T07:33:41.860+0100 [mongosMain] connection accepted from 172.28.0.164:52831 #1429109 (402 connections now open) 2015-10-05T07:33:41.861+0100 [conn1429108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:41.862+0100 [conn1429109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:43.505+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:43.505+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:45.386+0100 [conn1428732] end connection 172.28.0.163:58388 (401 connections now open) 2015-10-05T07:33:45.387+0100 [mongosMain] connection accepted from 172.28.0.163:59694 #1429110 (402 connections now open) 2015-10-05T07:33:45.388+0100 [conn1429110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:45.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219c95703b51053ed0e7e 2015-10-05T07:33:46.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:46.382+0100 [conn1428734] end connection 172.28.0.164:51672 (401 connections now open) 2015-10-05T07:33:46.384+0100 [mongosMain] connection accepted from 172.28.0.164:52858 #1429111 (402 connections now open) 2015-10-05T07:33:46.385+0100 [conn1429111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:49.508+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:49.508+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:50.673+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:51.346+0100 [conn1428582] end connection 172.28.0.163:57908 (401 connections now open) 2015-10-05T07:33:51.346+0100 [conn1428653] end connection 172.28.0.163:58178 (401 connections now open) 2015-10-05T07:33:51.347+0100 [mongosMain] connection accepted from 172.28.0.163:59710 #1429112 (401 connections now open) 2015-10-05T07:33:51.347+0100 [mongosMain] connection accepted from 172.28.0.163:59711 #1429113 (402 connections now open) 2015-10-05T07:33:51.348+0100 [conn1429112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:51.348+0100 [conn1429113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:51.873+0100 [conn1428706] end connection 172.28.0.164:51602 (401 connections now open) 2015-10-05T07:33:51.874+0100 [conn1428676] end connection 172.28.0.164:51517 (400 connections now open) 2015-10-05T07:33:51.876+0100 [mongosMain] connection accepted from 172.28.0.164:52865 #1429114 (401 connections now open) 2015-10-05T07:33:51.876+0100 [mongosMain] connection accepted from 172.28.0.164:52866 #1429115 (402 connections now open) 2015-10-05T07:33:51.878+0100 [conn1429114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:51.878+0100 [conn1429115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:52.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219d05703b51053ed0ead 2015-10-05T07:33:52.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:33:55.414+0100 [conn1428741] end connection 172.28.0.163:58411 (401 connections now open) 2015-10-05T07:33:55.415+0100 [mongosMain] connection accepted from 172.28.0.163:59722 #1429116 (402 connections now open) 2015-10-05T07:33:55.417+0100 [conn1429116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:55.773+0100 [conn1428636] end connection 172.28.0.164:51406 (401 connections now open) 2015-10-05T07:33:55.775+0100 [mongosMain] connection accepted from 172.28.0.164:52875 #1429117 (402 connections now open) 2015-10-05T07:33:55.777+0100 [conn1429117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:56.397+0100 [conn1428743] end connection 172.28.0.164:51698 (401 connections now open) 2015-10-05T07:33:56.398+0100 [mongosMain] connection accepted from 172.28.0.164:52877 #1429118 (402 connections now open) 2015-10-05T07:33:56.400+0100 [conn1429118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:33:56.514+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:33:56.515+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:33:58.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219d65703b51053ed0ee1 2015-10-05T07:33:58.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:01.346+0100 [conn1428513] end connection 172.28.0.163:57653 (401 connections now open) 2015-10-05T07:34:01.346+0100 [conn1428667] end connection 172.28.0.163:58224 (401 connections now open) 2015-10-05T07:34:01.347+0100 [mongosMain] connection accepted from 172.28.0.163:59743 #1429119 (401 connections now open) 2015-10-05T07:34:01.348+0100 [mongosMain] connection accepted from 172.28.0.163:59744 #1429120 (402 connections now open) 2015-10-05T07:34:01.348+0100 [conn1429119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:01.348+0100 [conn1429120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:01.679+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:01.889+0100 [conn1428699] end connection 172.28.0.164:51577 (401 connections now open) 2015-10-05T07:34:01.890+0100 [conn1428660] end connection 172.28.0.164:51475 (400 connections now open) 2015-10-05T07:34:01.890+0100 [mongosMain] connection accepted from 172.28.0.164:52887 #1429121 (401 connections now open) 2015-10-05T07:34:01.907+0100 [mongosMain] connection accepted from 172.28.0.164:52888 #1429122 (402 connections now open) 2015-10-05T07:34:01.908+0100 [conn1429121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:01.910+0100 [conn1429122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:04.524+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:04.524+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:05.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219dc5703b51053ed0f3b 2015-10-05T07:34:05.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:05.401+0100 [conn1428748] end connection 172.28.0.163:58433 (401 connections now open) 2015-10-05T07:34:05.402+0100 [mongosMain] connection accepted from 172.28.0.163:59757 #1429123 (402 connections now open) 2015-10-05T07:34:05.404+0100 [conn1429123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:05.789+0100 [conn1428742] end connection 172.28.0.164:51696 (401 connections now open) 2015-10-05T07:34:05.790+0100 [mongosMain] connection accepted from 172.28.0.164:52894 #1429124 (402 connections now open) 2015-10-05T07:34:05.792+0100 [conn1429124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:09.106+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:34:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:34:11.361+0100 [conn1428728] end connection 172.28.0.163:58381 (401 connections now open) 2015-10-05T07:34:11.361+0100 [conn1428498] end connection 172.28.0.163:57570 (401 connections now open) 2015-10-05T07:34:11.362+0100 [mongosMain] connection accepted from 172.28.0.163:59770 #1429125 (401 connections now open) 2015-10-05T07:34:11.362+0100 [mongosMain] connection accepted from 172.28.0.163:59771 #1429126 (402 connections now open) 2015-10-05T07:34:11.363+0100 [conn1429125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:11.363+0100 [conn1429126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:11.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219e35703b51053ed0f92 2015-10-05T07:34:11.711+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:11.904+0100 [conn1428661] end connection 172.28.0.164:51476 (401 connections now open) 2015-10-05T07:34:11.905+0100 [mongosMain] connection accepted from 172.28.0.164:52900 #1429127 (402 connections now open) 2015-10-05T07:34:11.907+0100 [conn1429127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:12.685+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:13.535+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:13.536+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:15.417+0100 [conn1428755] end connection 172.28.0.163:58459 (401 connections now open) 2015-10-05T07:34:15.419+0100 [mongosMain] connection accepted from 172.28.0.163:59781 #1429128 (402 connections now open) 2015-10-05T07:34:15.420+0100 [conn1429128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:15.804+0100 [conn1428680] end connection 172.28.0.164:51525 (401 connections now open) 2015-10-05T07:34:15.805+0100 [mongosMain] connection accepted from 172.28.0.164:52903 #1429129 (402 connections now open) 2015-10-05T07:34:15.807+0100 [conn1429129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:16.413+0100 [conn1428757] end connection 172.28.0.164:51731 (401 connections now open) 2015-10-05T07:34:16.414+0100 [mongosMain] connection accepted from 172.28.0.164:52906 #1429130 (402 connections now open) 2015-10-05T07:34:16.415+0100 [conn1429130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:17.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219e95703b51053ed0fdd 2015-10-05T07:34:18.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:21.377+0100 [conn1428718] end connection 172.28.0.163:58361 (401 connections now open) 2015-10-05T07:34:21.377+0100 [conn1428736] end connection 172.28.0.163:58393 (401 connections now open) 2015-10-05T07:34:21.378+0100 [mongosMain] connection accepted from 172.28.0.163:59785 #1429131 (401 connections now open) 2015-10-05T07:34:21.378+0100 [mongosMain] connection accepted from 172.28.0.163:59786 #1429132 (402 connections now open) 2015-10-05T07:34:21.379+0100 [conn1429131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:21.379+0100 [conn1429132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:21.905+0100 [conn1428692] end connection 172.28.0.164:51558 (401 connections now open) 2015-10-05T07:34:21.906+0100 [mongosMain] connection accepted from 172.28.0.164:52918 #1429133 (402 connections now open) 2015-10-05T07:34:21.907+0100 [conn1429133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:23.538+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:23.538+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:23.694+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:24.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219f05703b51053ed101b 2015-10-05T07:34:24.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:25.432+0100 [conn1428762] end connection 172.28.0.163:58490 (401 connections now open) 2015-10-05T07:34:25.433+0100 [mongosMain] connection accepted from 172.28.0.163:59795 #1429134 (402 connections now open) 2015-10-05T07:34:25.434+0100 [conn1429134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:25.805+0100 [conn1428664] end connection 172.28.0.164:51487 (401 connections now open) 2015-10-05T07:34:25.807+0100 [mongosMain] connection accepted from 172.28.0.164:52923 #1429135 (402 connections now open) 2015-10-05T07:34:25.809+0100 [conn1429135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:26.413+0100 [conn1428750] end connection 172.28.0.164:51715 (401 connections now open) 2015-10-05T07:34:26.414+0100 [mongosMain] connection accepted from 172.28.0.164:52925 #1429136 (402 connections now open) 2015-10-05T07:34:26.416+0100 [conn1429136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:28.389+0100 [mongosMain] connection accepted from 127.0.0.1:59797 #1429137 (403 connections now open) 2015-10-05T07:34:28.392+0100 [conn1429137] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:28.393+0100 [conn1429137] end connection 127.0.0.1:59797 (402 connections now open) 2015-10-05T07:34:30.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219f65703b51053ed1053 2015-10-05T07:34:30.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:31.377+0100 [conn1428758] end connection 172.28.0.163:58471 (401 connections now open) 2015-10-05T07:34:31.377+0100 [conn1428711] end connection 172.28.0.163:58342 (401 connections now open) 2015-10-05T07:34:31.379+0100 [mongosMain] connection accepted from 172.28.0.163:59798 #1429138 (401 connections now open) 2015-10-05T07:34:31.379+0100 [mongosMain] connection accepted from 172.28.0.163:59799 #1429139 (402 connections now open) 2015-10-05T07:34:31.380+0100 [conn1429138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:31.380+0100 [conn1429139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:31.921+0100 [conn1428738] end connection 172.28.0.164:51684 (401 connections now open) 2015-10-05T07:34:31.922+0100 [mongosMain] connection accepted from 172.28.0.164:52936 #1429140 (402 connections now open) 2015-10-05T07:34:31.923+0100 [conn1429140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:34.545+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:34.545+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:34.699+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:35.434+0100 [conn1428769] end connection 172.28.0.163:58506 (401 connections now open) 2015-10-05T07:34:35.435+0100 [mongosMain] connection accepted from 172.28.0.163:59808 #1429141 (402 connections now open) 2015-10-05T07:34:35.436+0100 [conn1429141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:35.820+0100 [conn1428733] end connection 172.28.0.164:51670 (401 connections now open) 2015-10-05T07:34:35.821+0100 [mongosMain] connection accepted from 172.28.0.164:52942 #1429142 (402 connections now open) 2015-10-05T07:34:35.822+0100 [conn1429142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:36.414+0100 [conn1428764] end connection 172.28.0.164:51745 (401 connections now open) 2015-10-05T07:34:36.415+0100 [mongosMain] connection accepted from 172.28.0.164:52946 #1429143 (402 connections now open) 2015-10-05T07:34:36.418+0100 [conn1429143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:36.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561219fc5703b51053ed10a3 2015-10-05T07:34:37.038+0100 [mongosMain] connection accepted from 172.21.40.52:49129 #1429144 (403 connections now open) 2015-10-05T07:34:37.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:37.310+0100 [conn1429144] authenticate db: admin { authenticate: 1, nonce: "xxx", user: "ma", key: "xxx" } 2015-10-05T07:34:39.469+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:34:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:34:39.862+0100 [mongosMain] connection accepted from 127.0.0.1:59813 #1429145 (404 connections now open) 2015-10-05T07:34:39.865+0100 [conn1429145] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:39.865+0100 [conn1429145] end connection 127.0.0.1:59813 (403 connections now open) 2015-10-05T07:34:41.406+0100 [conn1428751] end connection 172.28.0.163:58442 (402 connections now open) 2015-10-05T07:34:41.407+0100 [conn1428727] end connection 172.28.0.163:58380 (401 connections now open) 2015-10-05T07:34:41.409+0100 [mongosMain] connection accepted from 172.28.0.163:59821 #1429146 (402 connections now open) 2015-10-05T07:34:41.409+0100 [mongosMain] connection accepted from 172.28.0.163:59824 #1429147 (403 connections now open) 2015-10-05T07:34:41.410+0100 [conn1429146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:41.410+0100 [conn1429147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:41.937+0100 [conn1428753] end connection 172.28.0.164:51720 (402 connections now open) 2015-10-05T07:34:41.940+0100 [mongosMain] connection accepted from 172.28.0.164:52960 #1429148 (403 connections now open) 2015-10-05T07:34:41.942+0100 [conn1429148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:43.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a035703b51053ed10f7 2015-10-05T07:34:43.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:45.448+0100 [conn1428776] end connection 172.28.0.163:58521 (402 connections now open) 2015-10-05T07:34:45.449+0100 [mongosMain] connection accepted from 172.28.0.163:59842 #1429149 (403 connections now open) 2015-10-05T07:34:45.451+0100 [conn1429149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:45.707+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:45.836+0100 [conn1428763] end connection 172.28.0.164:51743 (402 connections now open) 2015-10-05T07:34:45.838+0100 [mongosMain] connection accepted from 172.28.0.164:52966 #1429150 (403 connections now open) 2015-10-05T07:34:45.839+0100 [conn1429150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:46.429+0100 [conn1428771] end connection 172.28.0.164:51766 (402 connections now open) 2015-10-05T07:34:46.431+0100 [mongosMain] connection accepted from 172.28.0.164:52968 #1429151 (403 connections now open) 2015-10-05T07:34:46.432+0100 [conn1429151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:46.555+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:46.555+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:48.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:48.549+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:50.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a095703b51053ed114b 2015-10-05T07:34:50.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:34:51.394+0100 [conn1428752] end connection 172.28.0.163:58443 (402 connections now open) 2015-10-05T07:34:51.394+0100 [conn1428737] end connection 172.28.0.163:58394 (401 connections now open) 2015-10-05T07:34:51.395+0100 [mongosMain] connection accepted from 172.28.0.163:59925 #1429152 (402 connections now open) 2015-10-05T07:34:51.396+0100 [mongosMain] connection accepted from 172.28.0.163:59926 #1429153 (403 connections now open) 2015-10-05T07:34:51.397+0100 [conn1429152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:51.397+0100 [conn1429153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:51.558+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:51.558+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:51.952+0100 [conn1428760] end connection 172.28.0.164:51740 (402 connections now open) 2015-10-05T07:34:51.953+0100 [mongosMain] connection accepted from 172.28.0.164:52979 #1429154 (403 connections now open) 2015-10-05T07:34:51.955+0100 [conn1429154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:55.449+0100 [conn1428783] end connection 172.28.0.163:58538 (402 connections now open) 2015-10-05T07:34:55.450+0100 [mongosMain] connection accepted from 172.28.0.163:59936 #1429155 (403 connections now open) 2015-10-05T07:34:55.452+0100 [conn1429155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:55.568+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:55.568+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:34:55.836+0100 [conn1428756] end connection 172.28.0.164:51730 (402 connections now open) 2015-10-05T07:34:55.837+0100 [mongosMain] connection accepted from 172.28.0.164:52987 #1429156 (403 connections now open) 2015-10-05T07:34:55.839+0100 [conn1429156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:56.444+0100 [conn1428778] end connection 172.28.0.164:51787 (402 connections now open) 2015-10-05T07:34:56.446+0100 [mongosMain] connection accepted from 172.28.0.164:52989 #1429157 (403 connections now open) 2015-10-05T07:34:56.448+0100 [conn1429157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:34:56.714+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:34:59.226+0100 [mongosMain] connection accepted from 172.21.40.52:49130 #1429158 (404 connections now open) 2015-10-05T07:34:59.498+0100 [conn1429158] authenticate db: admin { authenticate: 1, nonce: "xxx", user: "ma", key: "xxx" } 2015-10-05T07:35:00.574+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:00.574+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:01.408+0100 [conn1428666] end connection 172.28.0.163:58223 (403 connections now open) 2015-10-05T07:35:01.409+0100 [mongosMain] connection accepted from 172.28.0.163:59955 #1429159 (404 connections now open) 2015-10-05T07:35:01.411+0100 [conn1429159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:01.969+0100 [conn1428730] end connection 172.28.0.164:51663 (403 connections now open) 2015-10-05T07:35:01.969+0100 [conn1428720] end connection 172.28.0.164:51640 (403 connections now open) 2015-10-05T07:35:01.970+0100 [mongosMain] connection accepted from 172.28.0.164:53003 #1429160 (403 connections now open) 2015-10-05T07:35:01.971+0100 [mongosMain] connection accepted from 172.28.0.164:53004 #1429161 (404 connections now open) 2015-10-05T07:35:01.972+0100 [conn1429160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:01.974+0100 [conn1429161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:05.463+0100 [conn1428790] end connection 172.28.0.163:58556 (403 connections now open) 2015-10-05T07:35:05.464+0100 [mongosMain] connection accepted from 172.28.0.163:59963 #1429162 (404 connections now open) 2015-10-05T07:35:05.465+0100 [conn1429162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:05.853+0100 [conn1428749] end connection 172.28.0.164:51713 (403 connections now open) 2015-10-05T07:35:05.854+0100 [mongosMain] connection accepted from 172.28.0.164:53009 #1429163 (404 connections now open) 2015-10-05T07:35:05.856+0100 [conn1429163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:06.460+0100 [conn1428785] end connection 172.28.0.164:51813 (403 connections now open) 2015-10-05T07:35:06.461+0100 [mongosMain] connection accepted from 172.28.0.164:53011 #1429164 (404 connections now open) 2015-10-05T07:35:06.463+0100 [conn1429164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:06.572+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:06.573+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:07.720+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:08.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a1c5703b51053ed1231 2015-10-05T07:35:08.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:35:09.647+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:35:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:35:11.919+0100 [conn1428759] end connection 172.28.0.163:58472 (403 connections now open) 2015-10-05T07:35:11.922+0100 [mongosMain] connection accepted from 172.28.0.163:59972 #1429165 (404 connections now open) 2015-10-05T07:35:11.924+0100 [conn1429165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:12.063+0100 [conn1428746] end connection 172.28.0.164:51706 (403 connections now open) 2015-10-05T07:35:12.065+0100 [conn1428641] end connection 172.28.0.164:51423 (402 connections now open) 2015-10-05T07:35:12.066+0100 [mongosMain] connection accepted from 172.28.0.164:53015 #1429166 (403 connections now open) 2015-10-05T07:35:12.067+0100 [mongosMain] connection accepted from 172.28.0.164:53017 #1429167 (404 connections now open) 2015-10-05T07:35:12.070+0100 [conn1429166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:12.071+0100 [conn1429167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:13.579+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:13.580+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:15.449+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:35:15.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:35:15.464+0100 [conn1428797] end connection 172.28.0.163:58587 (403 connections now open) 2015-10-05T07:35:15.465+0100 [mongosMain] connection accepted from 172.28.0.163:59978 #1429168 (404 connections now open) 2015-10-05T07:35:15.466+0100 [conn1429168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:15.868+0100 [conn1428791] end connection 172.28.0.164:51829 (403 connections now open) 2015-10-05T07:35:15.869+0100 [mongosMain] connection accepted from 172.28.0.164:53020 #1429169 (404 connections now open) 2015-10-05T07:35:15.871+0100 [conn1429169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:16.476+0100 [conn1428792] end connection 172.28.0.164:51831 (403 connections now open) 2015-10-05T07:35:16.477+0100 [mongosMain] connection accepted from 172.28.0.164:53022 #1429170 (404 connections now open) 2015-10-05T07:35:16.479+0100 [conn1429170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:18.725+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:21.620+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:21.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:21.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a295703b51053ed12d6 2015-10-05T07:35:21.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:35:21.923+0100 [conn1428773] end connection 172.28.0.163:58515 (403 connections now open) 2015-10-05T07:35:21.924+0100 [conn1428765] end connection 172.28.0.163:58498 (402 connections now open) 2015-10-05T07:35:21.925+0100 [mongosMain] connection accepted from 172.28.0.163:59987 #1429171 (403 connections now open) 2015-10-05T07:35:21.925+0100 [mongosMain] connection accepted from 172.28.0.163:59988 #1429172 (404 connections now open) 2015-10-05T07:35:21.926+0100 [conn1429171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:21.926+0100 [conn1429172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:22.078+0100 [conn1428795] end connection 172.28.0.164:51835 (403 connections now open) 2015-10-05T07:35:22.079+0100 [mongosMain] connection accepted from 172.28.0.164:53032 #1429173 (404 connections now open) 2015-10-05T07:35:22.079+0100 [conn1428499] end connection 172.28.0.164:50850 (403 connections now open) 2015-10-05T07:35:22.080+0100 [mongosMain] connection accepted from 172.28.0.164:53033 #1429174 (404 connections now open) 2015-10-05T07:35:22.081+0100 [conn1429173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:22.082+0100 [conn1429174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:25.480+0100 [conn1428802] end connection 172.28.0.163:58607 (403 connections now open) 2015-10-05T07:35:25.481+0100 [mongosMain] connection accepted from 172.28.0.163:59992 #1429175 (404 connections now open) 2015-10-05T07:35:25.482+0100 [conn1429175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:25.868+0100 [conn1428784] end connection 172.28.0.164:51811 (403 connections now open) 2015-10-05T07:35:25.870+0100 [mongosMain] connection accepted from 172.28.0.164:53039 #1429176 (404 connections now open) 2015-10-05T07:35:25.871+0100 [conn1429176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:26.491+0100 [conn1428804] end connection 172.28.0.164:51859 (403 connections now open) 2015-10-05T07:35:26.492+0100 [mongosMain] connection accepted from 172.28.0.164:53044 #1429177 (404 connections now open) 2015-10-05T07:35:26.495+0100 [conn1429177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:28.231+0100 [mongosMain] connection accepted from 127.0.0.1:59994 #1429178 (405 connections now open) 2015-10-05T07:35:28.238+0100 [conn1429178] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:28.239+0100 [conn1429178] end connection 127.0.0.1:59994 (404 connections now open) 2015-10-05T07:35:29.732+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:30.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:30.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:31.924+0100 [conn1428697] end connection 172.28.0.163:58285 (403 connections now open) 2015-10-05T07:35:31.924+0100 [conn1428781] end connection 172.28.0.163:58527 (403 connections now open) 2015-10-05T07:35:31.926+0100 [mongosMain] connection accepted from 172.28.0.163:60003 #1429179 (403 connections now open) 2015-10-05T07:35:31.926+0100 [mongosMain] connection accepted from 172.28.0.163:60004 #1429180 (404 connections now open) 2015-10-05T07:35:31.926+0100 [conn1429179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:31.927+0100 [conn1429180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:32.077+0100 [conn1428801] end connection 172.28.0.164:51854 (403 connections now open) 2015-10-05T07:35:32.077+0100 [conn1428551] end connection 172.28.0.164:51097 (402 connections now open) 2015-10-05T07:35:32.079+0100 [mongosMain] connection accepted from 172.28.0.164:53053 #1429181 (403 connections now open) 2015-10-05T07:35:32.079+0100 [mongosMain] connection accepted from 172.28.0.164:53054 #1429182 (404 connections now open) 2015-10-05T07:35:32.080+0100 [conn1429181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:32.081+0100 [conn1429182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:34.918+0100 [conn1428685] end connection 172.28.0.163:58255 (403 connections now open) 2015-10-05T07:35:34.919+0100 [mongosMain] connection accepted from 172.28.0.163:60007 #1429183 (404 connections now open) 2015-10-05T07:35:34.920+0100 [conn1429183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:35.480+0100 [conn1428809] end connection 172.28.0.163:58621 (403 connections now open) 2015-10-05T07:35:35.481+0100 [mongosMain] connection accepted from 172.28.0.163:60009 #1429184 (404 connections now open) 2015-10-05T07:35:35.482+0100 [conn1429184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:35.907+0100 [conn1428777] end connection 172.28.0.164:51785 (403 connections now open) 2015-10-05T07:35:35.908+0100 [mongosMain] connection accepted from 172.28.0.164:53060 #1429185 (404 connections now open) 2015-10-05T07:35:35.910+0100 [conn1429185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:36.492+0100 [conn1428811] end connection 172.28.0.164:51878 (403 connections now open) 2015-10-05T07:35:36.493+0100 [mongosMain] connection accepted from 172.28.0.164:53064 #1429186 (404 connections now open) 2015-10-05T07:35:36.495+0100 [conn1429186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:39.725+0100 [mongosMain] connection accepted from 127.0.0.1:60016 #1429187 (405 connections now open) 2015-10-05T07:35:39.727+0100 [conn1429187] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:39.728+0100 [conn1429187] end connection 127.0.0.1:60016 (404 connections now open) 2015-10-05T07:35:40.212+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:35:40.212+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:35:40.280+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:35:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:35:40.625+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:40.626+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:40.737+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:41.990+0100 [conn1428690] end connection 172.28.0.163:58264 (403 connections now open) 2015-10-05T07:35:41.991+0100 [conn1428786] end connection 172.28.0.163:58548 (402 connections now open) 2015-10-05T07:35:41.992+0100 [mongosMain] connection accepted from 172.28.0.163:60020 #1429188 (403 connections now open) 2015-10-05T07:35:41.992+0100 [mongosMain] connection accepted from 172.28.0.163:60021 #1429189 (404 connections now open) 2015-10-05T07:35:41.993+0100 [conn1429188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:41.993+0100 [conn1429189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:42.255+0100 [conn1428767] end connection 172.28.0.164:51754 (403 connections now open) 2015-10-05T07:35:42.265+0100 [conn1428713] end connection 172.28.0.164:51627 (402 connections now open) 2015-10-05T07:35:42.266+0100 [mongosMain] connection accepted from 172.28.0.164:53073 #1429190 (403 connections now open) 2015-10-05T07:35:42.268+0100 [conn1429190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:42.270+0100 [mongosMain] connection accepted from 172.28.0.164:53076 #1429191 (404 connections now open) 2015-10-05T07:35:42.271+0100 [conn1429191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:43.270+0100 [conn1429144] end connection 172.21.40.52:49129 (403 connections now open) 2015-10-05T07:35:43.285+0100 [conn1429158] end connection 172.21.40.52:49130 (402 connections now open) 2015-10-05T07:35:43.298+0100 [conn1429103] end connection 172.21.40.52:49122 (401 connections now open) 2015-10-05T07:35:43.299+0100 [conn1429104] end connection 172.21.40.52:49123 (400 connections now open) 2015-10-05T07:35:44.919+0100 [conn1428707] end connection 172.28.0.163:58325 (399 connections now open) 2015-10-05T07:35:44.920+0100 [mongosMain] connection accepted from 172.28.0.163:60028 #1429192 (400 connections now open) 2015-10-05T07:35:44.921+0100 [conn1429192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:45.496+0100 [conn1428817] end connection 172.28.0.163:58632 (399 connections now open) 2015-10-05T07:35:45.497+0100 [mongosMain] connection accepted from 172.28.0.163:60031 #1429193 (400 connections now open) 2015-10-05T07:35:45.498+0100 [conn1429193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:46.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a425703b51053ed13eb 2015-10-05T07:35:46.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:35:46.507+0100 [conn1428819] end connection 172.28.0.164:51896 (399 connections now open) 2015-10-05T07:35:46.508+0100 [mongosMain] connection accepted from 172.28.0.164:53083 #1429194 (400 connections now open) 2015-10-05T07:35:46.510+0100 [conn1429194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:51.714+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:51.714+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:35:51.748+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:35:51.970+0100 [conn1428766] end connection 172.28.0.163:58499 (399 connections now open) 2015-10-05T07:35:51.971+0100 [mongosMain] connection accepted from 172.28.0.163:60042 #1429195 (400 connections now open) 2015-10-05T07:35:51.972+0100 [conn1429195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:52.264+0100 [conn1428814] end connection 172.28.0.164:51887 (399 connections now open) 2015-10-05T07:35:52.265+0100 [mongosMain] connection accepted from 172.28.0.164:53092 #1429196 (400 connections now open) 2015-10-05T07:35:52.266+0100 [conn1429196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:54.934+0100 [conn1428731] end connection 172.28.0.163:58386 (399 connections now open) 2015-10-05T07:35:54.935+0100 [mongosMain] connection accepted from 172.28.0.163:60048 #1429197 (400 connections now open) 2015-10-05T07:35:54.937+0100 [conn1429197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:55.511+0100 [conn1428826] end connection 172.28.0.163:58651 (399 connections now open) 2015-10-05T07:35:55.512+0100 [mongosMain] connection accepted from 172.28.0.163:60051 #1429198 (400 connections now open) 2015-10-05T07:35:55.513+0100 [conn1429198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:56.507+0100 [conn1428828] end connection 172.28.0.164:51916 (399 connections now open) 2015-10-05T07:35:56.509+0100 [mongosMain] connection accepted from 172.28.0.164:53100 #1429199 (400 connections now open) 2015-10-05T07:35:56.522+0100 [conn1429199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:35:58.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a4e5703b51053ed1473 2015-10-05T07:35:58.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:01.980+0100 [conn1428799] end connection 172.28.0.163:58596 (399 connections now open) 2015-10-05T07:36:01.980+0100 [conn1428787] end connection 172.28.0.163:58550 (399 connections now open) 2015-10-05T07:36:01.984+0100 [mongosMain] connection accepted from 172.28.0.163:60072 #1429200 (399 connections now open) 2015-10-05T07:36:01.984+0100 [mongosMain] connection accepted from 172.28.0.163:60073 #1429201 (400 connections now open) 2015-10-05T07:36:01.985+0100 [conn1429200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:01.985+0100 [conn1429201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:02.279+0100 [conn1428788] end connection 172.28.0.164:51822 (399 connections now open) 2015-10-05T07:36:02.279+0100 [conn1428214] end connection 172.28.0.164:49713 (398 connections now open) 2015-10-05T07:36:02.280+0100 [mongosMain] connection accepted from 172.28.0.164:53119 #1429202 (399 connections now open) 2015-10-05T07:36:02.281+0100 [mongosMain] connection accepted from 172.28.0.164:53118 #1429203 (400 connections now open) 2015-10-05T07:36:02.286+0100 [conn1429203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:02.288+0100 [conn1429202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:02.860+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:03.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:03.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:04.937+0100 [conn1428670] end connection 172.28.0.163:58231 (399 connections now open) 2015-10-05T07:36:04.938+0100 [mongosMain] connection accepted from 172.28.0.163:60083 #1429204 (400 connections now open) 2015-10-05T07:36:04.939+0100 [conn1429204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:05.514+0100 [conn1428833] end connection 172.28.0.163:58671 (399 connections now open) 2015-10-05T07:36:05.515+0100 [mongosMain] connection accepted from 172.28.0.163:60084 #1429205 (400 connections now open) 2015-10-05T07:36:05.517+0100 [conn1429205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:05.713+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:05.713+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:06.523+0100 [conn1428835] end connection 172.28.0.164:51935 (399 connections now open) 2015-10-05T07:36:06.524+0100 [mongosMain] connection accepted from 172.28.0.164:53121 #1429206 (400 connections now open) 2015-10-05T07:36:06.526+0100 [conn1429206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:08.717+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:08.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:10.403+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:36:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:36:11.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a5a5703b51053ed1529 2015-10-05T07:36:11.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:11.986+0100 [conn1428806] end connection 172.28.0.163:58613 (399 connections now open) 2015-10-05T07:36:11.988+0100 [mongosMain] connection accepted from 172.28.0.163:60095 #1429207 (400 connections now open) 2015-10-05T07:36:11.989+0100 [conn1429207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:12.628+0100 [conn1428719] end connection 172.28.0.164:51641 (399 connections now open) 2015-10-05T07:36:12.629+0100 [conn1428617] end connection 172.28.0.164:51349 (398 connections now open) 2015-10-05T07:36:12.630+0100 [mongosMain] connection accepted from 172.28.0.164:53129 #1429208 (399 connections now open) 2015-10-05T07:36:12.630+0100 [mongosMain] connection accepted from 172.28.0.164:53130 #1429209 (400 connections now open) 2015-10-05T07:36:12.632+0100 [conn1429208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:12.633+0100 [conn1429209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:12.691+0100 [conn1428780] end connection 172.28.0.163:58526 (399 connections now open) 2015-10-05T07:36:12.692+0100 [mongosMain] connection accepted from 172.28.0.163:60098 #1429210 (400 connections now open) 2015-10-05T07:36:12.693+0100 [conn1429210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:12.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:12.719+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:13.933+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:14.954+0100 [conn1428714] end connection 172.28.0.163:58349 (399 connections now open) 2015-10-05T07:36:14.956+0100 [mongosMain] connection accepted from 172.28.0.163:60102 #1429211 (400 connections now open) 2015-10-05T07:36:14.958+0100 [conn1429211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:15.527+0100 [conn1428841] end connection 172.28.0.163:58702 (399 connections now open) 2015-10-05T07:36:15.529+0100 [mongosMain] connection accepted from 172.28.0.163:60105 #1429212 (400 connections now open) 2015-10-05T07:36:15.530+0100 [conn1429212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:16.538+0100 [conn1428843] end connection 172.28.0.164:51960 (399 connections now open) 2015-10-05T07:36:16.539+0100 [mongosMain] connection accepted from 172.28.0.164:53136 #1429213 (400 connections now open) 2015-10-05T07:36:16.541+0100 [conn1429213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:17.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a615703b51053ed1577 2015-10-05T07:36:17.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:17.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:17.730+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:22.003+0100 [conn1428774] end connection 172.28.0.163:58516 (399 connections now open) 2015-10-05T07:36:22.003+0100 [conn1428745] end connection 172.28.0.163:58422 (399 connections now open) 2015-10-05T07:36:22.004+0100 [mongosMain] connection accepted from 172.28.0.163:60112 #1429214 (399 connections now open) 2015-10-05T07:36:22.004+0100 [mongosMain] connection accepted from 172.28.0.163:60113 #1429215 (400 connections now open) 2015-10-05T07:36:22.005+0100 [conn1429214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:22.005+0100 [conn1429215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:22.623+0100 [conn1428698] end connection 172.28.0.164:51578 (399 connections now open) 2015-10-05T07:36:22.624+0100 [mongosMain] connection accepted from 172.28.0.164:53148 #1429216 (400 connections now open) 2015-10-05T07:36:22.625+0100 [mongosMain] connection accepted from 172.28.0.164:53149 #1429217 (401 connections now open) 2015-10-05T07:36:22.626+0100 [conn1428838] end connection 172.28.0.164:51946 (400 connections now open) 2015-10-05T07:36:22.630+0100 [conn1429216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:22.631+0100 [conn1429217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:23.775+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:23.775+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:24.934+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:24.966+0100 [conn1428650] end connection 172.28.0.163:58167 (399 connections now open) 2015-10-05T07:36:24.967+0100 [mongosMain] connection accepted from 172.28.0.163:60118 #1429218 (400 connections now open) 2015-10-05T07:36:24.969+0100 [conn1429218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:25.528+0100 [conn1428848] end connection 172.28.0.163:58725 (399 connections now open) 2015-10-05T07:36:25.529+0100 [mongosMain] connection accepted from 172.28.0.163:60119 #1429219 (400 connections now open) 2015-10-05T07:36:25.530+0100 [conn1429219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:26.554+0100 [conn1428850] end connection 172.28.0.164:51975 (399 connections now open) 2015-10-05T07:36:26.555+0100 [mongosMain] connection accepted from 172.28.0.164:53157 #1429220 (400 connections now open) 2015-10-05T07:36:26.557+0100 [conn1429220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:28.721+0100 [mongosMain] connection accepted from 127.0.0.1:60121 #1429221 (401 connections now open) 2015-10-05T07:36:28.724+0100 [conn1429221] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:28.730+0100 [conn1429221] end connection 127.0.0.1:60121 (400 connections now open) 2015-10-05T07:36:29.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a6d5703b51053ed160b 2015-10-05T07:36:29.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:30.779+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:30.779+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:32.011+0100 [conn1428844] end connection 172.28.0.163:58713 (399 connections now open) 2015-10-05T07:36:32.011+0100 [conn1428830] end connection 172.28.0.163:58664 (398 connections now open) 2015-10-05T07:36:32.012+0100 [mongosMain] connection accepted from 172.28.0.163:60123 #1429222 (399 connections now open) 2015-10-05T07:36:32.013+0100 [mongosMain] connection accepted from 172.28.0.163:60124 #1429223 (400 connections now open) 2015-10-05T07:36:32.013+0100 [conn1429222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:32.014+0100 [conn1429223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:32.625+0100 [conn1428669] end connection 172.28.0.164:51499 (399 connections now open) 2015-10-05T07:36:32.625+0100 [conn1428832] end connection 172.28.0.164:51924 (398 connections now open) 2015-10-05T07:36:32.626+0100 [mongosMain] connection accepted from 172.28.0.164:53168 #1429224 (399 connections now open) 2015-10-05T07:36:32.627+0100 [mongosMain] connection accepted from 172.28.0.164:53169 #1429225 (400 connections now open) 2015-10-05T07:36:32.628+0100 [conn1429224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:32.629+0100 [conn1429225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:34.968+0100 [conn1428775] end connection 172.28.0.163:58520 (399 connections now open) 2015-10-05T07:36:34.969+0100 [mongosMain] connection accepted from 172.28.0.163:60128 #1429226 (400 connections now open) 2015-10-05T07:36:34.970+0100 [conn1429226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:35.543+0100 [conn1428855] end connection 172.28.0.163:58739 (399 connections now open) 2015-10-05T07:36:35.544+0100 [mongosMain] connection accepted from 172.28.0.163:60131 #1429227 (400 connections now open) 2015-10-05T07:36:35.545+0100 [conn1429227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:36.059+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:36.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a735703b51053ed1662 2015-10-05T07:36:36.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:36.570+0100 [conn1428857] end connection 172.28.0.164:51996 (399 connections now open) 2015-10-05T07:36:36.572+0100 [mongosMain] connection accepted from 172.28.0.164:53177 #1429228 (400 connections now open) 2015-10-05T07:36:36.574+0100 [conn1429228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:38.775+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:38.775+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:40.032+0100 [mongosMain] connection accepted from 127.0.0.1:60135 #1429229 (401 connections now open) 2015-10-05T07:36:40.035+0100 [conn1429229] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:40.040+0100 [conn1429229] end connection 127.0.0.1:60135 (400 connections now open) 2015-10-05T07:36:40.679+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:36:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:36:42.017+0100 [conn1428794] end connection 172.28.0.163:58568 (399 connections now open) 2015-10-05T07:36:42.018+0100 [conn1428822] end connection 172.28.0.163:58642 (398 connections now open) 2015-10-05T07:36:42.019+0100 [mongosMain] connection accepted from 172.28.0.163:60138 #1429230 (399 connections now open) 2015-10-05T07:36:42.019+0100 [mongosMain] connection accepted from 172.28.0.163:60139 #1429231 (400 connections now open) 2015-10-05T07:36:42.020+0100 [conn1429230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:42.020+0100 [conn1429231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:42.646+0100 [conn1428807] end connection 172.28.0.164:51868 (399 connections now open) 2015-10-05T07:36:42.646+0100 [conn1428854] end connection 172.28.0.164:51985 (399 connections now open) 2015-10-05T07:36:42.647+0100 [mongosMain] connection accepted from 172.28.0.164:53190 #1429232 (399 connections now open) 2015-10-05T07:36:42.648+0100 [mongosMain] connection accepted from 172.28.0.164:53191 #1429233 (400 connections now open) 2015-10-05T07:36:42.649+0100 [conn1429232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:42.650+0100 [conn1429233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:45.525+0100 [conn1428808] end connection 172.28.0.163:58619 (399 connections now open) 2015-10-05T07:36:45.530+0100 [mongosMain] connection accepted from 172.28.0.163:60146 #1429234 (400 connections now open) 2015-10-05T07:36:45.532+0100 [conn1429234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:45.552+0100 [conn1428863] end connection 172.28.0.163:58749 (399 connections now open) 2015-10-05T07:36:45.553+0100 [mongosMain] connection accepted from 172.28.0.163:60147 #1429235 (400 connections now open) 2015-10-05T07:36:45.554+0100 [conn1429235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:45.930+0100 [conn1428770] end connection 172.28.0.164:51763 (399 connections now open) 2015-10-05T07:36:45.931+0100 [mongosMain] connection accepted from 172.28.0.164:53197 #1429236 (400 connections now open) 2015-10-05T07:36:45.932+0100 [conn1429236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:46.588+0100 [conn1428865] end connection 172.28.0.164:52018 (399 connections now open) 2015-10-05T07:36:46.588+0100 [mongosMain] connection accepted from 172.28.0.164:53201 #1429237 (400 connections now open) 2015-10-05T07:36:46.590+0100 [conn1429237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:47.092+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:47.813+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:47.813+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:48.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a805703b51053ed16fc 2015-10-05T07:36:48.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:36:52.018+0100 [conn1428837] end connection 172.28.0.163:58685 (399 connections now open) 2015-10-05T07:36:52.018+0100 [conn1428805] end connection 172.28.0.163:58612 (399 connections now open) 2015-10-05T07:36:52.019+0100 [mongosMain] connection accepted from 172.28.0.163:60158 #1429238 (399 connections now open) 2015-10-05T07:36:52.019+0100 [mongosMain] connection accepted from 172.28.0.163:60159 #1429239 (400 connections now open) 2015-10-05T07:36:52.019+0100 [conn1429238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:52.020+0100 [conn1429239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:52.640+0100 [conn1428824] end connection 172.28.0.164:51909 (399 connections now open) 2015-10-05T07:36:52.641+0100 [mongosMain] connection accepted from 172.28.0.164:53211 #1429240 (400 connections now open) 2015-10-05T07:36:52.642+0100 [conn1429240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:54.832+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:36:54.832+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:36:54.981+0100 [conn1428700] end connection 172.28.0.163:58290 (399 connections now open) 2015-10-05T07:36:54.982+0100 [mongosMain] connection accepted from 172.28.0.163:60166 #1429241 (400 connections now open) 2015-10-05T07:36:54.983+0100 [conn1429241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:55.559+0100 [conn1428871] end connection 172.28.0.163:58768 (399 connections now open) 2015-10-05T07:36:55.560+0100 [mongosMain] connection accepted from 172.28.0.163:60170 #1429242 (400 connections now open) 2015-10-05T07:36:55.562+0100 [conn1429242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:56.265+0100 [conn1428842] end connection 172.28.0.164:51956 (399 connections now open) 2015-10-05T07:36:56.266+0100 [mongosMain] connection accepted from 172.28.0.164:53216 #1429243 (400 connections now open) 2015-10-05T07:36:56.269+0100 [conn1429243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:56.602+0100 [conn1428873] end connection 172.28.0.164:52040 (399 connections now open) 2015-10-05T07:36:56.603+0100 [mongosMain] connection accepted from 172.28.0.164:53218 #1429244 (400 connections now open) 2015-10-05T07:36:56.604+0100 [conn1429244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:36:57.821+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:36:57.821+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:36:58.233+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:01.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a8c5703b51053ed1776 2015-10-05T07:37:01.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:02.033+0100 [conn1428717] end connection 172.28.0.163:58362 (399 connections now open) 2015-10-05T07:37:02.033+0100 [conn1428793] end connection 172.28.0.163:58567 (399 connections now open) 2015-10-05T07:37:02.034+0100 [mongosMain] connection accepted from 172.28.0.163:60182 #1429245 (399 connections now open) 2015-10-05T07:37:02.034+0100 [mongosMain] connection accepted from 172.28.0.163:60183 #1429246 (400 connections now open) 2015-10-05T07:37:02.035+0100 [conn1429245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:02.035+0100 [conn1429246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:02.654+0100 [conn1428861] end connection 172.28.0.164:52006 (399 connections now open) 2015-10-05T07:37:02.655+0100 [conn1428853] end connection 172.28.0.164:51984 (398 connections now open) 2015-10-05T07:37:02.655+0100 [mongosMain] connection accepted from 172.28.0.164:53228 #1429247 (399 connections now open) 2015-10-05T07:37:02.655+0100 [mongosMain] connection accepted from 172.28.0.164:53229 #1429248 (400 connections now open) 2015-10-05T07:37:02.657+0100 [conn1429247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:02.657+0100 [conn1429248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:04.996+0100 [conn1428721] end connection 172.28.0.163:58368 (399 connections now open) 2015-10-05T07:37:04.998+0100 [mongosMain] connection accepted from 172.28.0.163:60189 #1429249 (400 connections now open) 2015-10-05T07:37:04.998+0100 [conn1429249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:05.963+0100 [conn1428803] end connection 172.28.0.164:51855 (399 connections now open) 2015-10-05T07:37:05.964+0100 [mongosMain] connection accepted from 172.28.0.164:53232 #1429250 (400 connections now open) 2015-10-05T07:37:05.965+0100 [conn1429250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:06.617+0100 [conn1428880] end connection 172.28.0.164:52059 (399 connections now open) 2015-10-05T07:37:06.619+0100 [mongosMain] connection accepted from 172.28.0.164:53234 #1429251 (400 connections now open) 2015-10-05T07:37:06.620+0100 [conn1429251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:08.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:08.825+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:09.246+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:10.840+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:37:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:37:12.039+0100 [conn1428704] end connection 172.28.0.163:58315 (399 connections now open) 2015-10-05T07:37:12.039+0100 [conn1428859] end connection 172.28.0.163:58744 (398 connections now open) 2015-10-05T07:37:12.040+0100 [mongosMain] connection accepted from 172.28.0.163:60203 #1429252 (399 connections now open) 2015-10-05T07:37:12.040+0100 [mongosMain] connection accepted from 172.28.0.163:60204 #1429253 (400 connections now open) 2015-10-05T07:37:12.041+0100 [conn1429252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:12.041+0100 [conn1429253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:12.675+0100 [conn1428876] end connection 172.28.0.164:52046 (399 connections now open) 2015-10-05T07:37:12.675+0100 [mongosMain] connection accepted from 172.28.0.164:53239 #1429254 (400 connections now open) 2015-10-05T07:37:12.677+0100 [conn1429254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:12.681+0100 [conn1428729] end connection 172.28.0.164:51662 (399 connections now open) 2015-10-05T07:37:12.681+0100 [mongosMain] connection accepted from 172.28.0.164:53240 #1429255 (400 connections now open) 2015-10-05T07:37:12.683+0100 [conn1429255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:13.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121a995703b51053ed1829 2015-10-05T07:37:13.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:14.997+0100 [conn1428782] end connection 172.28.0.163:58537 (399 connections now open) 2015-10-05T07:37:14.998+0100 [mongosMain] connection accepted from 172.28.0.163:60209 #1429256 (400 connections now open) 2015-10-05T07:37:14.999+0100 [conn1429256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:15.574+0100 [conn1428878] end connection 172.28.0.163:58788 (399 connections now open) 2015-10-05T07:37:15.575+0100 [mongosMain] connection accepted from 172.28.0.163:60213 #1429257 (400 connections now open) 2015-10-05T07:37:15.576+0100 [conn1429257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:15.978+0100 [conn1428856] end connection 172.28.0.164:51993 (399 connections now open) 2015-10-05T07:37:15.979+0100 [mongosMain] connection accepted from 172.28.0.164:53245 #1429258 (400 connections now open) 2015-10-05T07:37:15.981+0100 [conn1429258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:16.617+0100 [conn1428885] end connection 172.28.0.164:52075 (399 connections now open) 2015-10-05T07:37:16.625+0100 [mongosMain] connection accepted from 172.28.0.164:53247 #1429259 (400 connections now open) 2015-10-05T07:37:16.627+0100 [conn1429259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:20.248+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:20.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:20.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:22.049+0100 [conn1428744] end connection 172.28.0.163:58421 (399 connections now open) 2015-10-05T07:37:22.049+0100 [conn1428851] end connection 172.28.0.163:58733 (398 connections now open) 2015-10-05T07:37:22.050+0100 [mongosMain] connection accepted from 172.28.0.163:60222 #1429260 (399 connections now open) 2015-10-05T07:37:22.051+0100 [mongosMain] connection accepted from 172.28.0.163:60223 #1429261 (400 connections now open) 2015-10-05T07:37:22.051+0100 [conn1429260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:22.052+0100 [conn1429261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:22.687+0100 [conn1428823] end connection 172.28.0.164:51908 (399 connections now open) 2015-10-05T07:37:22.687+0100 [conn1428846] end connection 172.28.0.164:51966 (398 connections now open) 2015-10-05T07:37:22.688+0100 [mongosMain] connection accepted from 172.28.0.164:53261 #1429262 (399 connections now open) 2015-10-05T07:37:22.689+0100 [mongosMain] connection accepted from 172.28.0.164:53260 #1429263 (400 connections now open) 2015-10-05T07:37:22.690+0100 [conn1429262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:22.690+0100 [conn1429263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:22.854+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:22.854+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:25.013+0100 [conn1428754] end connection 172.28.0.163:58455 (399 connections now open) 2015-10-05T07:37:25.014+0100 [mongosMain] connection accepted from 172.28.0.163:60227 #1429264 (400 connections now open) 2015-10-05T07:37:25.015+0100 [conn1429264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:25.590+0100 [conn1428889] end connection 172.28.0.163:58835 (399 connections now open) 2015-10-05T07:37:25.592+0100 [mongosMain] connection accepted from 172.28.0.163:60228 #1429265 (400 connections now open) 2015-10-05T07:37:25.593+0100 [conn1429265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:25.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121aa55703b51053ed18b8 2015-10-05T07:37:25.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:25.853+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:25.853+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:25.994+0100 [conn1428849] end connection 172.28.0.164:51973 (399 connections now open) 2015-10-05T07:37:25.995+0100 [mongosMain] connection accepted from 172.28.0.164:53267 #1429266 (400 connections now open) 2015-10-05T07:37:25.997+0100 [conn1429266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:26.617+0100 [conn1428891] end connection 172.28.0.164:52089 (399 connections now open) 2015-10-05T07:37:26.618+0100 [mongosMain] connection accepted from 172.28.0.164:53272 #1429267 (400 connections now open) 2015-10-05T07:37:26.620+0100 [conn1429267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:28.958+0100 [mongosMain] connection accepted from 127.0.0.1:60232 #1429268 (401 connections now open) 2015-10-05T07:37:28.960+0100 [conn1429268] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:28.965+0100 [conn1429268] end connection 127.0.0.1:60232 (400 connections now open) 2015-10-05T07:37:29.864+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:29.865+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:31.250+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:32.065+0100 [conn1428881] end connection 172.28.0.163:58797 (399 connections now open) 2015-10-05T07:37:32.065+0100 [conn1428852] end connection 172.28.0.163:58734 (399 connections now open) 2015-10-05T07:37:32.066+0100 [mongosMain] connection accepted from 172.28.0.163:60235 #1429269 (399 connections now open) 2015-10-05T07:37:32.066+0100 [mongosMain] connection accepted from 172.28.0.163:60236 #1429270 (400 connections now open) 2015-10-05T07:37:32.067+0100 [conn1429269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:32.068+0100 [conn1429270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:32.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121aab5703b51053ed1911 2015-10-05T07:37:32.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:32.703+0100 [conn1428739] end connection 172.28.0.164:51685 (399 connections now open) 2015-10-05T07:37:32.703+0100 [conn1428888] end connection 172.28.0.164:52082 (399 connections now open) 2015-10-05T07:37:32.704+0100 [mongosMain] connection accepted from 172.28.0.164:53284 #1429271 (399 connections now open) 2015-10-05T07:37:32.704+0100 [mongosMain] connection accepted from 172.28.0.164:53283 #1429272 (400 connections now open) 2015-10-05T07:37:32.705+0100 [conn1429271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:32.706+0100 [conn1429272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:34.878+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:34.878+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:35.014+0100 [conn1428747] end connection 172.28.0.163:58429 (399 connections now open) 2015-10-05T07:37:35.015+0100 [mongosMain] connection accepted from 172.28.0.163:60243 #1429273 (400 connections now open) 2015-10-05T07:37:35.016+0100 [conn1429273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:36.009+0100 [conn1428834] end connection 172.28.0.164:51933 (399 connections now open) 2015-10-05T07:37:36.010+0100 [mongosMain] connection accepted from 172.28.0.164:53292 #1429274 (400 connections now open) 2015-10-05T07:37:36.013+0100 [conn1429274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:36.633+0100 [conn1428897] end connection 172.28.0.164:52110 (399 connections now open) 2015-10-05T07:37:36.634+0100 [mongosMain] connection accepted from 172.28.0.164:53296 #1429275 (400 connections now open) 2015-10-05T07:37:36.636+0100 [conn1429275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:38.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ab25703b51053ed1966 2015-10-05T07:37:38.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:39.737+0100 [mongosMain] connection accepted from 127.0.0.1:60247 #1429276 (401 connections now open) 2015-10-05T07:37:39.740+0100 [conn1429276] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:39.744+0100 [conn1429276] end connection 127.0.0.1:60247 (400 connections now open) 2015-10-05T07:37:40.886+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:40.886+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:40.979+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:37:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:37:42.070+0100 [conn1428868] end connection 172.28.0.163:58760 (399 connections now open) 2015-10-05T07:37:42.071+0100 [mongosMain] connection accepted from 172.28.0.163:60254 #1429277 (400 connections now open) 2015-10-05T07:37:42.072+0100 [conn1429277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:42.252+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:42.718+0100 [conn1428893] end connection 172.28.0.164:52096 (399 connections now open) 2015-10-05T07:37:42.718+0100 [conn1428870] end connection 172.28.0.164:52030 (398 connections now open) 2015-10-05T07:37:42.719+0100 [mongosMain] connection accepted from 172.28.0.164:53307 #1429278 (399 connections now open) 2015-10-05T07:37:42.720+0100 [mongosMain] connection accepted from 172.28.0.164:53308 #1429279 (400 connections now open) 2015-10-05T07:37:42.721+0100 [conn1429278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:42.722+0100 [conn1429279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:45.029+0100 [conn1428768] end connection 172.28.0.163:58504 (399 connections now open) 2015-10-05T07:37:45.030+0100 [mongosMain] connection accepted from 172.28.0.163:60259 #1429280 (400 connections now open) 2015-10-05T07:37:45.031+0100 [conn1429280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:45.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ab85703b51053ed19ae 2015-10-05T07:37:45.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:46.025+0100 [conn1428798] end connection 172.28.0.164:51847 (399 connections now open) 2015-10-05T07:37:46.026+0100 [mongosMain] connection accepted from 172.28.0.164:53316 #1429281 (400 connections now open) 2015-10-05T07:37:46.028+0100 [conn1429281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:46.649+0100 [conn1428904] end connection 172.28.0.164:52128 (399 connections now open) 2015-10-05T07:37:46.652+0100 [mongosMain] connection accepted from 172.28.0.164:53319 #1429282 (400 connections now open) 2015-10-05T07:37:46.654+0100 [conn1429282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:47.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:47.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:51.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121abf5703b51053ed1a1f 2015-10-05T07:37:51.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:37:52.080+0100 [conn1428874] end connection 172.28.0.163:58777 (399 connections now open) 2015-10-05T07:37:52.081+0100 [mongosMain] connection accepted from 172.28.0.163:60270 #1429283 (400 connections now open) 2015-10-05T07:37:52.082+0100 [conn1429283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:52.718+0100 [conn1428869] end connection 172.28.0.164:52029 (399 connections now open) 2015-10-05T07:37:52.718+0100 [conn1428847] end connection 172.28.0.164:51967 (398 connections now open) 2015-10-05T07:37:52.719+0100 [mongosMain] connection accepted from 172.28.0.164:53328 #1429284 (399 connections now open) 2015-10-05T07:37:52.720+0100 [mongosMain] connection accepted from 172.28.0.164:53329 #1429285 (400 connections now open) 2015-10-05T07:37:52.721+0100 [conn1429284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:52.722+0100 [conn1429285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:53.265+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:55.044+0100 [conn1428740] end connection 172.28.0.163:58409 (399 connections now open) 2015-10-05T07:37:55.045+0100 [mongosMain] connection accepted from 172.28.0.163:60277 #1429286 (400 connections now open) 2015-10-05T07:37:55.047+0100 [conn1429286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:55.606+0100 [conn1428895] end connection 172.28.0.163:58847 (399 connections now open) 2015-10-05T07:37:55.608+0100 [mongosMain] connection accepted from 172.28.0.163:60279 #1429287 (400 connections now open) 2015-10-05T07:37:55.609+0100 [conn1429287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:55.898+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:37:55.898+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:37:56.040+0100 [conn1428864] end connection 172.28.0.164:52016 (399 connections now open) 2015-10-05T07:37:56.042+0100 [mongosMain] connection accepted from 172.28.0.164:53334 #1429288 (400 connections now open) 2015-10-05T07:37:56.043+0100 [conn1429288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:56.649+0100 [conn1428911] end connection 172.28.0.164:52151 (399 connections now open) 2015-10-05T07:37:56.650+0100 [mongosMain] connection accepted from 172.28.0.164:53335 #1429289 (400 connections now open) 2015-10-05T07:37:56.652+0100 [conn1429289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:37:57.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ac55703b51053ed1a6a 2015-10-05T07:37:58.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:02.082+0100 [conn1428886] end connection 172.28.0.163:58827 (399 connections now open) 2015-10-05T07:38:02.083+0100 [mongosMain] connection accepted from 172.28.0.163:60301 #1429290 (400 connections now open) 2015-10-05T07:38:02.084+0100 [conn1429290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:02.734+0100 [conn1428831] end connection 172.28.0.164:51925 (399 connections now open) 2015-10-05T07:38:02.734+0100 [conn1428913] end connection 172.28.0.164:52159 (399 connections now open) 2015-10-05T07:38:02.735+0100 [mongosMain] connection accepted from 172.28.0.164:53345 #1429291 (399 connections now open) 2015-10-05T07:38:02.736+0100 [mongosMain] connection accepted from 172.28.0.164:53344 #1429292 (400 connections now open) 2015-10-05T07:38:02.737+0100 [conn1429291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:02.738+0100 [conn1429292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:04.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121acc5703b51053ed1ad3 2015-10-05T07:38:04.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:04.274+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:04.904+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:04.904+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:05.045+0100 [conn1428796] end connection 172.28.0.163:58586 (399 connections now open) 2015-10-05T07:38:05.046+0100 [mongosMain] connection accepted from 172.28.0.163:60309 #1429293 (400 connections now open) 2015-10-05T07:38:05.047+0100 [conn1429293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:05.622+0100 [conn1428916] end connection 172.28.0.163:58885 (399 connections now open) 2015-10-05T07:38:05.623+0100 [mongosMain] connection accepted from 172.28.0.163:60311 #1429294 (400 connections now open) 2015-10-05T07:38:05.624+0100 [conn1429294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:06.057+0100 [conn1428818] end connection 172.28.0.164:51893 (399 connections now open) 2015-10-05T07:38:06.058+0100 [mongosMain] connection accepted from 172.28.0.164:53348 #1429295 (400 connections now open) 2015-10-05T07:38:06.060+0100 [conn1429295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:06.665+0100 [conn1428918] end connection 172.28.0.164:52168 (399 connections now open) 2015-10-05T07:38:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:53350 #1429296 (400 connections now open) 2015-10-05T07:38:06.667+0100 [conn1429296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:10.541+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ad25703b51053ed1b35 2015-10-05T07:38:10.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:11.259+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:38:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:38:12.096+0100 [conn1428892] end connection 172.28.0.163:58842 (399 connections now open) 2015-10-05T07:38:12.097+0100 [mongosMain] connection accepted from 172.28.0.163:60316 #1429297 (400 connections now open) 2015-10-05T07:38:12.097+0100 [conn1429297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:12.750+0100 [conn1428919] end connection 172.28.0.164:52179 (399 connections now open) 2015-10-05T07:38:12.750+0100 [conn1428887] end connection 172.28.0.164:52081 (399 connections now open) 2015-10-05T07:38:12.751+0100 [mongosMain] connection accepted from 172.28.0.164:53355 #1429298 (399 connections now open) 2015-10-05T07:38:12.752+0100 [mongosMain] connection accepted from 172.28.0.164:53356 #1429299 (400 connections now open) 2015-10-05T07:38:12.752+0100 [conn1429298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:12.753+0100 [conn1429299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:14.908+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:14.909+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:15.060+0100 [conn1428825] end connection 172.28.0.163:58647 (399 connections now open) 2015-10-05T07:38:15.061+0100 [mongosMain] connection accepted from 172.28.0.163:60325 #1429300 (400 connections now open) 2015-10-05T07:38:15.062+0100 [conn1429300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:15.279+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:15.622+0100 [conn1428921] end connection 172.28.0.163:58912 (399 connections now open) 2015-10-05T07:38:15.624+0100 [mongosMain] connection accepted from 172.28.0.163:60326 #1429301 (400 connections now open) 2015-10-05T07:38:15.625+0100 [conn1429301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:16.073+0100 [conn1428879] end connection 172.28.0.164:52057 (399 connections now open) 2015-10-05T07:38:16.075+0100 [mongosMain] connection accepted from 172.28.0.164:53360 #1429302 (400 connections now open) 2015-10-05T07:38:16.077+0100 [conn1429302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:16.681+0100 [conn1428923] end connection 172.28.0.164:52190 (399 connections now open) 2015-10-05T07:38:16.681+0100 [mongosMain] connection accepted from 172.28.0.164:53362 #1429303 (400 connections now open) 2015-10-05T07:38:16.682+0100 [conn1429303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:16.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ad85703b51053ed1b98 2015-10-05T07:38:17.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:22.098+0100 [conn1428899] end connection 172.28.0.163:58851 (399 connections now open) 2015-10-05T07:38:22.099+0100 [mongosMain] connection accepted from 172.28.0.163:60331 #1429304 (400 connections now open) 2015-10-05T07:38:22.100+0100 [conn1429304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:22.766+0100 [conn1428883] end connection 172.28.0.164:52068 (399 connections now open) 2015-10-05T07:38:22.766+0100 [conn1428901] end connection 172.28.0.164:52119 (399 connections now open) 2015-10-05T07:38:22.767+0100 [mongosMain] connection accepted from 172.28.0.164:53380 #1429305 (399 connections now open) 2015-10-05T07:38:22.767+0100 [mongosMain] connection accepted from 172.28.0.164:53381 #1429306 (400 connections now open) 2015-10-05T07:38:22.768+0100 [conn1429305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:22.768+0100 [conn1429306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:23.302+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121adf5703b51053ed1bf8 2015-10-05T07:38:23.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:25.061+0100 [conn1428816] end connection 172.28.0.163:58631 (399 connections now open) 2015-10-05T07:38:25.062+0100 [mongosMain] connection accepted from 172.28.0.163:60335 #1429307 (400 connections now open) 2015-10-05T07:38:25.063+0100 [conn1429307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:25.637+0100 [conn1428926] end connection 172.28.0.163:58927 (399 connections now open) 2015-10-05T07:38:25.638+0100 [mongosMain] connection accepted from 172.28.0.163:60339 #1429308 (400 connections now open) 2015-10-05T07:38:25.639+0100 [conn1429308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:25.919+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:25.919+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:26.088+0100 [conn1428702] end connection 172.28.0.164:51587 (399 connections now open) 2015-10-05T07:38:26.089+0100 [mongosMain] connection accepted from 172.28.0.164:53387 #1429309 (400 connections now open) 2015-10-05T07:38:26.091+0100 [conn1429309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:26.284+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:26.697+0100 [conn1428928] end connection 172.28.0.164:52200 (399 connections now open) 2015-10-05T07:38:26.698+0100 [mongosMain] connection accepted from 172.28.0.164:53390 #1429310 (400 connections now open) 2015-10-05T07:38:26.700+0100 [conn1429310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:29.250+0100 [mongosMain] connection accepted from 127.0.0.1:60344 #1429311 (401 connections now open) 2015-10-05T07:38:29.253+0100 [conn1429311] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:29.257+0100 [conn1429311] end connection 127.0.0.1:60344 (400 connections now open) 2015-10-05T07:38:29.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ae55703b51053ed1c68 2015-10-05T07:38:29.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:32.113+0100 [conn1428906] end connection 172.28.0.163:58860 (399 connections now open) 2015-10-05T07:38:32.114+0100 [mongosMain] connection accepted from 172.28.0.163:60345 #1429312 (400 connections now open) 2015-10-05T07:38:32.116+0100 [conn1429312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:32.781+0100 [conn1428894] end connection 172.28.0.164:52097 (399 connections now open) 2015-10-05T07:38:32.782+0100 [conn1428924] end connection 172.28.0.164:52192 (398 connections now open) 2015-10-05T07:38:32.783+0100 [mongosMain] connection accepted from 172.28.0.164:53400 #1429313 (399 connections now open) 2015-10-05T07:38:32.783+0100 [mongosMain] connection accepted from 172.28.0.164:53401 #1429314 (400 connections now open) 2015-10-05T07:38:32.790+0100 [conn1429314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:32.790+0100 [conn1429313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:35.078+0100 [conn1428789] end connection 172.28.0.163:58554 (399 connections now open) 2015-10-05T07:38:35.081+0100 [mongosMain] connection accepted from 172.28.0.163:60349 #1429315 (400 connections now open) 2015-10-05T07:38:35.082+0100 [conn1429315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:35.653+0100 [conn1428932] end connection 172.28.0.163:58941 (399 connections now open) 2015-10-05T07:38:35.654+0100 [mongosMain] connection accepted from 172.28.0.163:60351 #1429316 (400 connections now open) 2015-10-05T07:38:35.655+0100 [conn1429316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:35.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121aeb5703b51053ed1cd3 2015-10-05T07:38:36.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:36.087+0100 [conn1428872] end connection 172.28.0.164:52037 (399 connections now open) 2015-10-05T07:38:36.088+0100 [mongosMain] connection accepted from 172.28.0.164:53407 #1429317 (400 connections now open) 2015-10-05T07:38:36.090+0100 [conn1429317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:36.712+0100 [conn1428934] end connection 172.28.0.164:52219 (399 connections now open) 2015-10-05T07:38:36.713+0100 [mongosMain] connection accepted from 172.28.0.164:53412 #1429318 (400 connections now open) 2015-10-05T07:38:36.714+0100 [conn1429318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:37.320+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:37.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:37.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:39.758+0100 [mongosMain] connection accepted from 127.0.0.1:60357 #1429319 (401 connections now open) 2015-10-05T07:38:39.761+0100 [conn1429319] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:39.766+0100 [conn1429319] end connection 127.0.0.1:60357 (400 connections now open) 2015-10-05T07:38:40.025+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:40.025+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:41.532+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:38:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:38:42.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121af25703b51053ed1d49 2015-10-05T07:38:42.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:42.798+0100 [conn1428931] end connection 172.28.0.164:52209 (399 connections now open) 2015-10-05T07:38:42.798+0100 [conn1428877] end connection 172.28.0.164:52048 (398 connections now open) 2015-10-05T07:38:42.806+0100 [mongosMain] connection accepted from 172.28.0.164:53423 #1429320 (399 connections now open) 2015-10-05T07:38:42.806+0100 [mongosMain] connection accepted from 172.28.0.164:53424 #1429321 (400 connections now open) 2015-10-05T07:38:42.808+0100 [conn1429320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:42.808+0100 [conn1429321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:43.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:43.027+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:45.077+0100 [conn1428840] end connection 172.28.0.163:58700 (399 connections now open) 2015-10-05T07:38:45.078+0100 [mongosMain] connection accepted from 172.28.0.163:60366 #1429322 (400 connections now open) 2015-10-05T07:38:45.079+0100 [conn1429322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:45.654+0100 [conn1428939] end connection 172.28.0.163:58952 (399 connections now open) 2015-10-05T07:38:45.655+0100 [mongosMain] connection accepted from 172.28.0.163:60369 #1429323 (400 connections now open) 2015-10-05T07:38:45.656+0100 [conn1429323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:46.104+0100 [conn1428884] end connection 172.28.0.164:52073 (399 connections now open) 2015-10-05T07:38:46.105+0100 [mongosMain] connection accepted from 172.28.0.164:53431 #1429324 (400 connections now open) 2015-10-05T07:38:46.107+0100 [conn1429324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:47.119+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:47.119+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:48.342+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:48.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121af85703b51053ed1da3 2015-10-05T07:38:48.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:52.120+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:52.120+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:54.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121afe5703b51053ed1e12 2015-10-05T07:38:55.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:38:55.092+0100 [conn1428915] end connection 172.28.0.163:58882 (399 connections now open) 2015-10-05T07:38:55.093+0100 [mongosMain] connection accepted from 172.28.0.163:60389 #1429325 (400 connections now open) 2015-10-05T07:38:55.094+0100 [conn1429325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:55.669+0100 [conn1428947] end connection 172.28.0.163:58969 (399 connections now open) 2015-10-05T07:38:55.670+0100 [mongosMain] connection accepted from 172.28.0.163:60391 #1429326 (400 connections now open) 2015-10-05T07:38:55.672+0100 [conn1429326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:56.495+0100 [conn1428810] end connection 172.28.0.164:51875 (399 connections now open) 2015-10-05T07:38:56.509+0100 [mongosMain] connection accepted from 172.28.0.164:53448 #1429327 (400 connections now open) 2015-10-05T07:38:56.511+0100 [conn1429327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:38:58.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:38:58.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:38:59.376+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:01.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b055703b51053ed1e68 2015-10-05T07:39:01.300+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:05.107+0100 [conn1428761] end connection 172.28.0.163:58483 (399 connections now open) 2015-10-05T07:39:05.108+0100 [mongosMain] connection accepted from 172.28.0.163:60416 #1429328 (400 connections now open) 2015-10-05T07:39:05.109+0100 [conn1429328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:05.126+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:05.127+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:05.669+0100 [conn1428952] end connection 172.28.0.163:58990 (399 connections now open) 2015-10-05T07:39:05.670+0100 [mongosMain] connection accepted from 172.28.0.163:60419 #1429329 (400 connections now open) 2015-10-05T07:39:05.671+0100 [conn1429329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:06.120+0100 [conn1428910] end connection 172.28.0.164:52148 (399 connections now open) 2015-10-05T07:39:06.121+0100 [mongosMain] connection accepted from 172.28.0.164:53469 #1429330 (400 connections now open) 2015-10-05T07:39:06.123+0100 [conn1429330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:07.580+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b0b5703b51053ed1ec7 2015-10-05T07:39:07.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:10.391+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:11.820+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:39:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:39:13.141+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:13.141+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:14.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b115703b51053ed1f13 2015-10-05T07:39:14.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:15.108+0100 [conn1428951] end connection 172.28.0.163:58987 (399 connections now open) 2015-10-05T07:39:15.109+0100 [mongosMain] connection accepted from 172.28.0.163:60431 #1429331 (400 connections now open) 2015-10-05T07:39:15.110+0100 [conn1429331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:15.715+0100 [conn1428955] end connection 172.28.0.163:59019 (399 connections now open) 2015-10-05T07:39:15.715+0100 [mongosMain] connection accepted from 172.28.0.163:60434 #1429332 (400 connections now open) 2015-10-05T07:39:15.715+0100 [conn1429332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:16.136+0100 [conn1428903] end connection 172.28.0.164:52126 (399 connections now open) 2015-10-05T07:39:16.136+0100 [mongosMain] connection accepted from 172.28.0.164:53477 #1429333 (400 connections now open) 2015-10-05T07:39:16.151+0100 [conn1429333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:16.760+0100 [conn1428941] end connection 172.28.0.164:52243 (399 connections now open) 2015-10-05T07:39:16.760+0100 [mongosMain] connection accepted from 172.28.0.164:53478 #1429334 (400 connections now open) 2015-10-05T07:39:16.775+0100 [conn1429334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:20.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b185703b51053ed1f57 2015-10-05T07:39:20.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:21.489+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:22.147+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:22.147+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:22.159+0100 [conn1428943] end connection 172.28.0.163:58959 (399 connections now open) 2015-10-05T07:39:22.161+0100 [mongosMain] connection accepted from 172.28.0.163:60443 #1429335 (400 connections now open) 2015-10-05T07:39:22.162+0100 [conn1429335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:25.133+0100 [conn1428954] end connection 172.28.0.163:59016 (399 connections now open) 2015-10-05T07:39:25.134+0100 [mongosMain] connection accepted from 172.28.0.163:60447 #1429336 (400 connections now open) 2015-10-05T07:39:25.135+0100 [conn1429336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:26.135+0100 [conn1428890] end connection 172.28.0.164:52087 (399 connections now open) 2015-10-05T07:39:26.136+0100 [mongosMain] connection accepted from 172.28.0.164:53492 #1429337 (400 connections now open) 2015-10-05T07:39:26.137+0100 [conn1429337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:27.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b1e5703b51053ed1fb8 2015-10-05T07:39:27.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:29.270+0100 [mongosMain] connection accepted from 127.0.0.1:60454 #1429338 (401 connections now open) 2015-10-05T07:39:29.272+0100 [conn1429338] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:29.278+0100 [conn1429338] end connection 127.0.0.1:60454 (400 connections now open) 2015-10-05T07:39:32.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:32.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:32.178+0100 [conn1428936] end connection 172.28.0.163:58949 (399 connections now open) 2015-10-05T07:39:32.179+0100 [mongosMain] connection accepted from 172.28.0.163:60457 #1429339 (400 connections now open) 2015-10-05T07:39:32.179+0100 [conn1429339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:32.504+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:33.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b255703b51053ed2019 2015-10-05T07:39:33.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:35.124+0100 [conn1428909] end connection 172.28.0.163:58865 (399 connections now open) 2015-10-05T07:39:35.125+0100 [mongosMain] connection accepted from 172.28.0.163:60460 #1429340 (400 connections now open) 2015-10-05T07:39:35.127+0100 [conn1429340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:36.150+0100 [conn1428896] end connection 172.28.0.164:52107 (399 connections now open) 2015-10-05T07:39:36.151+0100 [mongosMain] connection accepted from 172.28.0.164:53508 #1429341 (400 connections now open) 2015-10-05T07:39:36.153+0100 [conn1429341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:39.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b2b5703b51053ed2063 2015-10-05T07:39:39.818+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:39.823+0100 [mongosMain] connection accepted from 127.0.0.1:60464 #1429342 (401 connections now open) 2015-10-05T07:39:39.825+0100 [conn1429342] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:39.829+0100 [conn1429342] end connection 127.0.0.1:60464 (400 connections now open) 2015-10-05T07:39:41.967+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:39:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:39:42.182+0100 [conn1428912] end connection 172.28.0.163:58876 (399 connections now open) 2015-10-05T07:39:42.182+0100 [conn1428875] end connection 172.28.0.163:58778 (398 connections now open) 2015-10-05T07:39:42.183+0100 [mongosMain] connection accepted from 172.28.0.163:60469 #1429343 (399 connections now open) 2015-10-05T07:39:42.183+0100 [mongosMain] connection accepted from 172.28.0.163:60470 #1429344 (400 connections now open) 2015-10-05T07:39:42.185+0100 [conn1429343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:42.185+0100 [conn1429344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:43.165+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:43.166+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:43.514+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:45.139+0100 [conn1428902] end connection 172.28.0.163:58853 (399 connections now open) 2015-10-05T07:39:45.140+0100 [mongosMain] connection accepted from 172.28.0.163:60477 #1429345 (400 connections now open) 2015-10-05T07:39:45.141+0100 [conn1429345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:46.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b315703b51053ed20a2 2015-10-05T07:39:46.167+0100 [conn1428927] end connection 172.28.0.164:52197 (399 connections now open) 2015-10-05T07:39:46.168+0100 [mongosMain] connection accepted from 172.28.0.164:53525 #1429346 (400 connections now open) 2015-10-05T07:39:46.170+0100 [conn1429346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:46.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:52.175+0100 [conn1428929] end connection 172.28.0.163:58936 (399 connections now open) 2015-10-05T07:39:52.176+0100 [mongosMain] connection accepted from 172.28.0.163:60488 #1429347 (400 connections now open) 2015-10-05T07:39:52.178+0100 [conn1429347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:52.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b385703b51053ed20dd 2015-10-05T07:39:52.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:39:54.550+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:55.140+0100 [conn1428946] end connection 172.28.0.163:58966 (399 connections now open) 2015-10-05T07:39:55.141+0100 [mongosMain] connection accepted from 172.28.0.163:60495 #1429348 (400 connections now open) 2015-10-05T07:39:55.142+0100 [conn1429348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:55.210+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:55.211+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:39:56.600+0100 [conn1428917] end connection 172.28.0.164:52167 (399 connections now open) 2015-10-05T07:39:56.601+0100 [mongosMain] connection accepted from 172.28.0.164:53539 #1429349 (400 connections now open) 2015-10-05T07:39:56.611+0100 [conn1429349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:39:57.213+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:39:57.213+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:00.222+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:00.222+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:02.191+0100 [conn1428800] end connection 172.28.0.163:58597 (399 connections now open) 2015-10-05T07:40:02.191+0100 [conn1428829] end connection 172.28.0.163:58663 (399 connections now open) 2015-10-05T07:40:02.193+0100 [mongosMain] connection accepted from 172.28.0.163:60520 #1429350 (399 connections now open) 2015-10-05T07:40:02.193+0100 [mongosMain] connection accepted from 172.28.0.163:60521 #1429351 (400 connections now open) 2015-10-05T07:40:02.194+0100 [conn1429350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:02.194+0100 [conn1429351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:02.890+0100 [conn1428815] end connection 172.28.0.164:51888 (399 connections now open) 2015-10-05T07:40:02.892+0100 [mongosMain] connection accepted from 172.28.0.164:53557 #1429352 (400 connections now open) 2015-10-05T07:40:02.893+0100 [conn1429352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:04.217+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:04.217+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:04.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b445703b51053ed2151 2015-10-05T07:40:05.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:05.154+0100 [conn1428966] end connection 172.28.0.163:59073 (399 connections now open) 2015-10-05T07:40:05.155+0100 [mongosMain] connection accepted from 172.28.0.163:60529 #1429353 (400 connections now open) 2015-10-05T07:40:05.157+0100 [conn1429353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:05.552+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:06.198+0100 [conn1428967] end connection 172.28.0.164:52358 (399 connections now open) 2015-10-05T07:40:06.199+0100 [mongosMain] connection accepted from 172.28.0.164:53559 #1429354 (400 connections now open) 2015-10-05T07:40:06.201+0100 [conn1429354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:09.219+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:09.219+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:11.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b4b5703b51053ed21af 2015-10-05T07:40:11.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:12.117+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:40:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:40:12.192+0100 [conn1428949] end connection 172.28.0.163:58980 (399 connections now open) 2015-10-05T07:40:12.193+0100 [conn1428813] end connection 172.28.0.163:58626 (398 connections now open) 2015-10-05T07:40:12.193+0100 [mongosMain] connection accepted from 172.28.0.163:60537 #1429355 (400 connections now open) 2015-10-05T07:40:12.194+0100 [mongosMain] connection accepted from 172.28.0.163:60539 #1429356 (400 connections now open) 2015-10-05T07:40:12.194+0100 [conn1429355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:12.195+0100 [conn1429356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:12.906+0100 [conn1428930] end connection 172.28.0.164:52208 (399 connections now open) 2015-10-05T07:40:12.908+0100 [mongosMain] connection accepted from 172.28.0.164:53566 #1429357 (400 connections now open) 2015-10-05T07:40:12.910+0100 [conn1429357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:15.155+0100 [conn1428956] end connection 172.28.0.163:59031 (399 connections now open) 2015-10-05T07:40:15.156+0100 [mongosMain] connection accepted from 172.28.0.163:60545 #1429358 (400 connections now open) 2015-10-05T07:40:15.158+0100 [conn1429358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:15.236+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:15.236+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:16.198+0100 [conn1428940] end connection 172.28.0.164:52238 (399 connections now open) 2015-10-05T07:40:16.200+0100 [mongosMain] connection accepted from 172.28.0.164:53569 #1429359 (400 connections now open) 2015-10-05T07:40:16.203+0100 [conn1429359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:16.624+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:17.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b515703b51053ed2207 2015-10-05T07:40:17.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:22.206+0100 [conn1428959] end connection 172.28.0.163:59041 (399 connections now open) 2015-10-05T07:40:22.206+0100 [conn1428860] end connection 172.28.0.163:58745 (399 connections now open) 2015-10-05T07:40:22.207+0100 [mongosMain] connection accepted from 172.28.0.163:60555 #1429360 (399 connections now open) 2015-10-05T07:40:22.207+0100 [mongosMain] connection accepted from 172.28.0.163:60556 #1429361 (400 connections now open) 2015-10-05T07:40:22.208+0100 [conn1429360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:22.208+0100 [conn1429361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:22.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:22.245+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:22.922+0100 [conn1428862] end connection 172.28.0.164:52008 (399 connections now open) 2015-10-05T07:40:22.923+0100 [mongosMain] connection accepted from 172.28.0.164:53584 #1429362 (400 connections now open) 2015-10-05T07:40:22.924+0100 [conn1429362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:23.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b575703b51053ed2255 2015-10-05T07:40:24.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:25.748+0100 [conn1428957] end connection 172.28.0.163:59035 (399 connections now open) 2015-10-05T07:40:25.753+0100 [mongosMain] connection accepted from 172.28.0.163:60560 #1429363 (400 connections now open) 2015-10-05T07:40:25.755+0100 [conn1429363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:27.636+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:28.984+0100 [mongosMain] connection accepted from 127.0.0.1:60562 #1429364 (401 connections now open) 2015-10-05T07:40:28.986+0100 [conn1429364] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:28.991+0100 [conn1429364] end connection 127.0.0.1:60562 (400 connections now open) 2015-10-05T07:40:30.258+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:30.259+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:30.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b5e5703b51053ed228d 2015-10-05T07:40:30.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:32.222+0100 [conn1428965] end connection 172.28.0.163:59067 (399 connections now open) 2015-10-05T07:40:32.223+0100 [mongosMain] connection accepted from 172.28.0.163:60565 #1429365 (400 connections now open) 2015-10-05T07:40:32.224+0100 [conn1429365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:32.939+0100 [conn1428920] end connection 172.28.0.164:52180 (399 connections now open) 2015-10-05T07:40:32.940+0100 [mongosMain] connection accepted from 172.28.0.164:53598 #1429366 (400 connections now open) 2015-10-05T07:40:32.942+0100 [conn1429366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:35.186+0100 [conn1428972] end connection 172.28.0.163:59118 (399 connections now open) 2015-10-05T07:40:35.187+0100 [mongosMain] connection accepted from 172.28.0.163:60569 #1429367 (400 connections now open) 2015-10-05T07:40:35.188+0100 [conn1429367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:35.748+0100 [conn1428977] end connection 172.28.0.163:59149 (399 connections now open) 2015-10-05T07:40:35.749+0100 [mongosMain] connection accepted from 172.28.0.163:60571 #1429368 (400 connections now open) 2015-10-05T07:40:35.750+0100 [conn1429368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:36.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b645703b51053ed22d6 2015-10-05T07:40:36.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:36.853+0100 [conn1428958] end connection 172.28.0.164:52307 (399 connections now open) 2015-10-05T07:40:36.854+0100 [mongosMain] connection accepted from 172.28.0.164:53606 #1429369 (400 connections now open) 2015-10-05T07:40:36.857+0100 [conn1429369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:38.747+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:39.347+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:39.347+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:40.154+0100 [mongosMain] connection accepted from 127.0.0.1:60575 #1429370 (401 connections now open) 2015-10-05T07:40:40.157+0100 [conn1429370] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:40.161+0100 [conn1429370] end connection 127.0.0.1:60575 (400 connections now open) 2015-10-05T07:40:42.225+0100 [conn1428962] end connection 172.28.0.163:59052 (399 connections now open) 2015-10-05T07:40:42.226+0100 [mongosMain] connection accepted from 172.28.0.163:60581 #1429371 (400 connections now open) 2015-10-05T07:40:42.227+0100 [conn1429371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:42.368+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:40:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:40:42.954+0100 [conn1428925] end connection 172.28.0.164:52193 (399 connections now open) 2015-10-05T07:40:42.955+0100 [mongosMain] connection accepted from 172.28.0.164:53619 #1429372 (400 connections now open) 2015-10-05T07:40:42.957+0100 [conn1429372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:43.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b6a5703b51053ed2336 2015-10-05T07:40:43.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:45.186+0100 [conn1428963] end connection 172.28.0.163:59057 (399 connections now open) 2015-10-05T07:40:45.187+0100 [mongosMain] connection accepted from 172.28.0.163:60586 #1429373 (400 connections now open) 2015-10-05T07:40:45.189+0100 [conn1429373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:45.763+0100 [conn1428984] end connection 172.28.0.163:59162 (399 connections now open) 2015-10-05T07:40:45.764+0100 [mongosMain] connection accepted from 172.28.0.163:60589 #1429374 (400 connections now open) 2015-10-05T07:40:45.766+0100 [conn1429374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:46.230+0100 [conn1428978] end connection 172.28.0.164:52425 (399 connections now open) 2015-10-05T07:40:46.232+0100 [mongosMain] connection accepted from 172.28.0.164:53624 #1429375 (400 connections now open) 2015-10-05T07:40:46.235+0100 [conn1429375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:46.853+0100 [conn1428986] end connection 172.28.0.164:52444 (399 connections now open) 2015-10-05T07:40:46.855+0100 [mongosMain] connection accepted from 172.28.0.164:53628 #1429376 (400 connections now open) 2015-10-05T07:40:46.857+0100 [conn1429376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:49.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b715703b51053ed2393 2015-10-05T07:40:49.361+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:49.361+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:40:49.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:49.754+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:40:52.969+0100 [conn1428953] end connection 172.28.0.164:52293 (399 connections now open) 2015-10-05T07:40:52.970+0100 [mongosMain] connection accepted from 172.28.0.164:53634 #1429377 (400 connections now open) 2015-10-05T07:40:52.972+0100 [conn1429377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:55.202+0100 [conn1428969] end connection 172.28.0.163:59092 (399 connections now open) 2015-10-05T07:40:55.203+0100 [mongosMain] connection accepted from 172.28.0.163:60603 #1429378 (400 connections now open) 2015-10-05T07:40:55.204+0100 [conn1429378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:56.231+0100 [conn1428922] end connection 172.28.0.164:52187 (399 connections now open) 2015-10-05T07:40:56.231+0100 [mongosMain] connection accepted from 172.28.0.164:53639 #1429379 (400 connections now open) 2015-10-05T07:40:56.233+0100 [conn1429379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:40:56.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b785703b51053ed23ef 2015-10-05T07:40:56.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:40:56.854+0100 [conn1428993] end connection 172.28.0.164:52464 (399 connections now open) 2015-10-05T07:40:56.855+0100 [mongosMain] connection accepted from 172.28.0.164:53642 #1429380 (400 connections now open) 2015-10-05T07:40:56.857+0100 [conn1429380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:00.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:00.369+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:00.792+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:02.239+0100 [conn1428988] end connection 172.28.0.163:59167 (399 connections now open) 2015-10-05T07:41:02.239+0100 [conn1428882] end connection 172.28.0.163:58798 (399 connections now open) 2015-10-05T07:41:02.240+0100 [mongosMain] connection accepted from 172.28.0.163:60625 #1429381 (399 connections now open) 2015-10-05T07:41:02.240+0100 [mongosMain] connection accepted from 172.28.0.163:60626 #1429382 (400 connections now open) 2015-10-05T07:41:02.241+0100 [conn1429381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:02.241+0100 [conn1429382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:02.970+0100 [conn1428976] end connection 172.28.0.164:52415 (399 connections now open) 2015-10-05T07:41:02.970+0100 [mongosMain] connection accepted from 172.28.0.164:53652 #1429383 (400 connections now open) 2015-10-05T07:41:02.973+0100 [conn1429383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:05.203+0100 [conn1428974] end connection 172.28.0.163:59138 (399 connections now open) 2015-10-05T07:41:05.204+0100 [mongosMain] connection accepted from 172.28.0.163:60630 #1429384 (400 connections now open) 2015-10-05T07:41:05.206+0100 [conn1429384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:05.781+0100 [conn1428992] end connection 172.28.0.163:59179 (399 connections now open) 2015-10-05T07:41:05.782+0100 [mongosMain] connection accepted from 172.28.0.163:60632 #1429385 (400 connections now open) 2015-10-05T07:41:05.783+0100 [conn1429385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:06.246+0100 [conn1428985] end connection 172.28.0.164:52441 (399 connections now open) 2015-10-05T07:41:06.247+0100 [mongosMain] connection accepted from 172.28.0.164:53656 #1429386 (400 connections now open) 2015-10-05T07:41:06.248+0100 [conn1429386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:06.869+0100 [conn1428998] end connection 172.28.0.164:52483 (399 connections now open) 2015-10-05T07:41:06.871+0100 [mongosMain] connection accepted from 172.28.0.164:53658 #1429387 (400 connections now open) 2015-10-05T07:41:06.873+0100 [conn1429387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:08.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b845703b51053ed24e1 2015-10-05T07:41:08.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:41:11.799+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:12.309+0100 [conn1428981] end connection 172.28.0.163:59156 (399 connections now open) 2015-10-05T07:41:12.315+0100 [mongosMain] connection accepted from 172.28.0.163:60641 #1429388 (400 connections now open) 2015-10-05T07:41:12.316+0100 [conn1429388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:12.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:12.381+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:12.542+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:41:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:41:12.985+0100 [conn1428950] end connection 172.28.0.164:52273 (399 connections now open) 2015-10-05T07:41:12.986+0100 [mongosMain] connection accepted from 172.28.0.164:53664 #1429389 (400 connections now open) 2015-10-05T07:41:12.988+0100 [conn1429389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:14.385+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:14.385+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:15.306+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:41:15.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:41:15.780+0100 [conn1429002] end connection 172.28.0.163:59234 (399 connections now open) 2015-10-05T07:41:15.781+0100 [mongosMain] connection accepted from 172.28.0.163:60648 #1429390 (400 connections now open) 2015-10-05T07:41:15.782+0100 [conn1429390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:16.260+0100 [conn1428933] end connection 172.28.0.164:52216 (399 connections now open) 2015-10-05T07:41:16.261+0100 [mongosMain] connection accepted from 172.28.0.164:53668 #1429391 (400 connections now open) 2015-10-05T07:41:16.263+0100 [conn1429391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:16.884+0100 [conn1429003] end connection 172.28.0.164:52502 (399 connections now open) 2015-10-05T07:41:16.885+0100 [mongosMain] connection accepted from 172.28.0.164:53670 #1429392 (400 connections now open) 2015-10-05T07:41:16.887+0100 [conn1429392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:17.397+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:17.398+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:21.404+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:21.404+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:22.715+0100 [conn1428867] end connection 172.28.0.163:58759 (399 connections now open) 2015-10-05T07:41:22.715+0100 [conn1428994] end connection 172.28.0.163:59187 (399 connections now open) 2015-10-05T07:41:22.718+0100 [mongosMain] connection accepted from 172.28.0.163:60656 #1429393 (399 connections now open) 2015-10-05T07:41:22.720+0100 [conn1429393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:22.721+0100 [mongosMain] connection accepted from 172.28.0.163:60657 #1429394 (400 connections now open) 2015-10-05T07:41:22.721+0100 [conn1429394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:22.811+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:23.183+0100 [conn1428907] end connection 172.28.0.164:52141 (399 connections now open) 2015-10-05T07:41:23.202+0100 [mongosMain] connection accepted from 172.28.0.164:53682 #1429395 (400 connections now open) 2015-10-05T07:41:23.203+0100 [conn1429395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:25.795+0100 [conn1429007] end connection 172.28.0.163:59273 (399 connections now open) 2015-10-05T07:41:25.796+0100 [mongosMain] connection accepted from 172.28.0.163:60661 #1429396 (400 connections now open) 2015-10-05T07:41:25.797+0100 [conn1429396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:26.261+0100 [conn1428827] end connection 172.28.0.164:51915 (399 connections now open) 2015-10-05T07:41:26.262+0100 [mongosMain] connection accepted from 172.28.0.164:53689 #1429397 (400 connections now open) 2015-10-05T07:41:26.263+0100 [conn1429397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:26.407+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:26.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:26.886+0100 [conn1429009] end connection 172.28.0.164:52519 (399 connections now open) 2015-10-05T07:41:26.887+0100 [mongosMain] connection accepted from 172.28.0.164:53694 #1429398 (400 connections now open) 2015-10-05T07:41:26.889+0100 [conn1429398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:27.398+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:41:27.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:41:28.532+0100 [mongosMain] connection accepted from 127.0.0.1:60663 #1429399 (401 connections now open) 2015-10-05T07:41:28.534+0100 [conn1429399] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:28.540+0100 [conn1429399] end connection 127.0.0.1:60663 (400 connections now open) 2015-10-05T07:41:32.407+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:32.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:32.708+0100 [conn1428970] end connection 172.28.0.163:59108 (399 connections now open) 2015-10-05T07:41:32.709+0100 [mongosMain] connection accepted from 172.28.0.163:60665 #1429400 (400 connections now open) 2015-10-05T07:41:32.710+0100 [conn1429400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:33.175+0100 [conn1428971] end connection 172.28.0.164:52397 (399 connections now open) 2015-10-05T07:41:33.176+0100 [mongosMain] connection accepted from 172.28.0.164:53704 #1429401 (400 connections now open) 2015-10-05T07:41:33.178+0100 [conn1429401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:33.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121b9d5703b51053ed269a 2015-10-05T07:41:33.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:41:33.820+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:35.233+0100 [conn1429001] end connection 172.28.0.163:59232 (399 connections now open) 2015-10-05T07:41:35.234+0100 [mongosMain] connection accepted from 172.28.0.163:60668 #1429402 (400 connections now open) 2015-10-05T07:41:35.235+0100 [conn1429402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:35.812+0100 [conn1429015] end connection 172.28.0.163:59306 (399 connections now open) 2015-10-05T07:41:35.813+0100 [mongosMain] connection accepted from 172.28.0.163:60671 #1429403 (400 connections now open) 2015-10-05T07:41:35.814+0100 [conn1429403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:36.889+0100 [conn1429017] end connection 172.28.0.164:52541 (399 connections now open) 2015-10-05T07:41:36.890+0100 [mongosMain] connection accepted from 172.28.0.164:53713 #1429404 (400 connections now open) 2015-10-05T07:41:36.891+0100 [conn1429404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:39.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:39.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:39.453+0100 [mongosMain] connection accepted from 127.0.0.1:60676 #1429405 (401 connections now open) 2015-10-05T07:41:39.456+0100 [conn1429405] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:39.460+0100 [conn1429405] end connection 127.0.0.1:60676 (400 connections now open) 2015-10-05T07:41:39.766+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:41:39.766+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:41:42.722+0100 [conn1428821] end connection 172.28.0.163:58641 (399 connections now open) 2015-10-05T07:41:42.723+0100 [mongosMain] connection accepted from 172.28.0.163:60679 #1429406 (400 connections now open) 2015-10-05T07:41:42.724+0100 [conn1429406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:42.807+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:41:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:41:43.188+0100 [conn1428938] end connection 172.28.0.164:52232 (399 connections now open) 2015-10-05T07:41:43.190+0100 [mongosMain] connection accepted from 172.28.0.164:53726 #1429407 (400 connections now open) 2015-10-05T07:41:43.191+0100 [conn1429407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:44.832+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:45.810+0100 [conn1429024] end connection 172.28.0.163:59321 (399 connections now open) 2015-10-05T07:41:45.811+0100 [mongosMain] connection accepted from 172.28.0.163:60687 #1429408 (400 connections now open) 2015-10-05T07:41:45.812+0100 [conn1429408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:46.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ba95703b51053ed2783 2015-10-05T07:41:46.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:41:46.916+0100 [conn1429025] end connection 172.28.0.164:52559 (399 connections now open) 2015-10-05T07:41:46.918+0100 [mongosMain] connection accepted from 172.28.0.164:53736 #1429409 (400 connections now open) 2015-10-05T07:41:46.920+0100 [conn1429409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:47.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:47.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:52.724+0100 [conn1428999] end connection 172.28.0.163:59217 (399 connections now open) 2015-10-05T07:41:52.725+0100 [mongosMain] connection accepted from 172.28.0.163:60697 #1429410 (400 connections now open) 2015-10-05T07:41:52.727+0100 [conn1429410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:53.203+0100 [conn1428944] end connection 172.28.0.164:52257 (399 connections now open) 2015-10-05T07:41:53.204+0100 [mongosMain] connection accepted from 172.28.0.164:53743 #1429411 (400 connections now open) 2015-10-05T07:41:53.206+0100 [conn1429411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:55.878+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:56.406+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:41:56.407+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:41:56.910+0100 [conn1429031] end connection 172.28.0.164:52582 (399 connections now open) 2015-10-05T07:41:56.911+0100 [mongosMain] connection accepted from 172.28.0.164:53751 #1429412 (400 connections now open) 2015-10-05T07:41:56.913+0100 [conn1429412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:41:58.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121bb65703b51053ed284e 2015-10-05T07:41:58.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:02.731+0100 [conn1428845] end connection 172.28.0.163:58714 (399 connections now open) 2015-10-05T07:42:02.732+0100 [mongosMain] connection accepted from 172.28.0.163:60721 #1429413 (400 connections now open) 2015-10-05T07:42:02.733+0100 [conn1429413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:03.196+0100 [conn1429022] end connection 172.28.0.164:52553 (399 connections now open) 2015-10-05T07:42:03.197+0100 [conn1428594] end connection 172.28.0.164:51261 (398 connections now open) 2015-10-05T07:42:03.197+0100 [mongosMain] connection accepted from 172.28.0.164:53765 #1429414 (399 connections now open) 2015-10-05T07:42:03.198+0100 [mongosMain] connection accepted from 172.28.0.164:53766 #1429415 (400 connections now open) 2015-10-05T07:42:03.199+0100 [conn1429414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:03.200+0100 [conn1429415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:05.257+0100 [conn1429029] end connection 172.28.0.163:59343 (399 connections now open) 2015-10-05T07:42:05.258+0100 [mongosMain] connection accepted from 172.28.0.163:60725 #1429416 (400 connections now open) 2015-10-05T07:42:05.259+0100 [conn1429416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:05.819+0100 [conn1429030] end connection 172.28.0.163:59349 (399 connections now open) 2015-10-05T07:42:05.820+0100 [mongosMain] connection accepted from 172.28.0.163:60728 #1429417 (400 connections now open) 2015-10-05T07:42:05.820+0100 [conn1429417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:06.464+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:06.464+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:06.893+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:06.909+0100 [conn1429035] end connection 172.28.0.164:52600 (399 connections now open) 2015-10-05T07:42:06.910+0100 [mongosMain] connection accepted from 172.28.0.164:53772 #1429418 (400 connections now open) 2015-10-05T07:42:06.912+0100 [conn1429418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:10.672+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121bc25703b51053ed2958 2015-10-05T07:42:10.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:12.925+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:42:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:42:13.212+0100 [conn1429013] end connection 172.28.0.164:52531 (399 connections now open) 2015-10-05T07:42:13.212+0100 [conn1428982] end connection 172.28.0.164:52434 (399 connections now open) 2015-10-05T07:42:13.213+0100 [mongosMain] connection accepted from 172.28.0.164:53776 #1429419 (399 connections now open) 2015-10-05T07:42:13.213+0100 [mongosMain] connection accepted from 172.28.0.164:53777 #1429420 (400 connections now open) 2015-10-05T07:42:13.214+0100 [conn1429419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:13.215+0100 [conn1429420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:15.273+0100 [conn1428960] end connection 172.28.0.163:59045 (399 connections now open) 2015-10-05T07:42:15.285+0100 [mongosMain] connection accepted from 172.28.0.163:60745 #1429421 (400 connections now open) 2015-10-05T07:42:15.287+0100 [conn1429421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:15.834+0100 [conn1429040] end connection 172.28.0.163:59432 (399 connections now open) 2015-10-05T07:42:15.835+0100 [mongosMain] connection accepted from 172.28.0.163:60747 #1429422 (400 connections now open) 2015-10-05T07:42:15.836+0100 [conn1429422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:16.889+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:42:16.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:42:16.924+0100 [conn1429042] end connection 172.28.0.164:52621 (399 connections now open) 2015-10-05T07:42:16.925+0100 [mongosMain] connection accepted from 172.28.0.164:53783 #1429423 (400 connections now open) 2015-10-05T07:42:16.926+0100 [conn1429423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:17.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:17.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:17.936+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:23.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121bce5703b51053ed2a37 2015-10-05T07:42:23.227+0100 [conn1429000] end connection 172.28.0.164:52497 (399 connections now open) 2015-10-05T07:42:23.228+0100 [mongosMain] connection accepted from 172.28.0.164:53794 #1429424 (400 connections now open) 2015-10-05T07:42:23.229+0100 [conn1429424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:23.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:25.273+0100 [conn1428983] end connection 172.28.0.163:59160 (399 connections now open) 2015-10-05T07:42:25.275+0100 [mongosMain] connection accepted from 172.28.0.163:60754 #1429425 (400 connections now open) 2015-10-05T07:42:25.276+0100 [conn1429425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:25.835+0100 [conn1429047] end connection 172.28.0.163:59503 (399 connections now open) 2015-10-05T07:42:25.836+0100 [mongosMain] connection accepted from 172.28.0.163:60756 #1429426 (400 connections now open) 2015-10-05T07:42:25.837+0100 [conn1429426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:26.939+0100 [conn1429049] end connection 172.28.0.164:52631 (399 connections now open) 2015-10-05T07:42:26.940+0100 [mongosMain] connection accepted from 172.28.0.164:53802 #1429427 (400 connections now open) 2015-10-05T07:42:26.941+0100 [conn1429427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:28.610+0100 [mongosMain] connection accepted from 127.0.0.1:60761 #1429428 (401 connections now open) 2015-10-05T07:42:28.613+0100 [conn1429428] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:28.617+0100 [conn1429428] end connection 127.0.0.1:60761 (400 connections now open) 2015-10-05T07:42:28.944+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:29.492+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121bd55703b51053ed2a8a 2015-10-05T07:42:29.512+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:29.512+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:29.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:31.517+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:31.518+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:33.243+0100 [conn1429039] end connection 172.28.0.164:52613 (399 connections now open) 2015-10-05T07:42:33.243+0100 [conn1428839] end connection 172.28.0.164:51947 (399 connections now open) 2015-10-05T07:42:33.244+0100 [mongosMain] connection accepted from 172.28.0.164:53814 #1429429 (399 connections now open) 2015-10-05T07:42:33.245+0100 [mongosMain] connection accepted from 172.28.0.164:53815 #1429430 (400 connections now open) 2015-10-05T07:42:33.246+0100 [conn1429429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:33.246+0100 [conn1429430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:34.586+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:34.586+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:35.274+0100 [conn1429034] end connection 172.28.0.163:59384 (399 connections now open) 2015-10-05T07:42:35.276+0100 [mongosMain] connection accepted from 172.28.0.163:60768 #1429431 (400 connections now open) 2015-10-05T07:42:35.277+0100 [conn1429431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:35.850+0100 [conn1429052] end connection 172.28.0.163:59533 (399 connections now open) 2015-10-05T07:42:35.851+0100 [mongosMain] connection accepted from 172.28.0.163:60770 #1429432 (400 connections now open) 2015-10-05T07:42:35.852+0100 [conn1429432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:36.316+0100 [conn1429053] end connection 172.28.0.164:52648 (399 connections now open) 2015-10-05T07:42:36.317+0100 [mongosMain] connection accepted from 172.28.0.164:53821 #1429433 (400 connections now open) 2015-10-05T07:42:36.319+0100 [conn1429433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:36.971+0100 [conn1429054] end connection 172.28.0.164:52653 (399 connections now open) 2015-10-05T07:42:36.972+0100 [mongosMain] connection accepted from 172.28.0.164:53823 #1429434 (400 connections now open) 2015-10-05T07:42:36.975+0100 [conn1429434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:38.594+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:38.594+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:39.961+0100 [mongosMain] connection accepted from 127.0.0.1:60774 #1429435 (401 connections now open) 2015-10-05T07:42:39.964+0100 [conn1429435] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:39.968+0100 [conn1429435] end connection 127.0.0.1:60774 (400 connections now open) 2015-10-05T07:42:40.044+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:41.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121be15703b51053ed2afd 2015-10-05T07:42:41.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:42.763+0100 [conn1429010] end connection 172.28.0.163:59299 (399 connections now open) 2015-10-05T07:42:42.764+0100 [mongosMain] connection accepted from 172.28.0.163:60778 #1429436 (400 connections now open) 2015-10-05T07:42:42.765+0100 [conn1429436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:43.054+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:42:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:42:43.274+0100 [conn1429033] end connection 172.28.0.164:52588 (399 connections now open) 2015-10-05T07:42:43.274+0100 [conn1428937] end connection 172.28.0.164:52231 (398 connections now open) 2015-10-05T07:42:43.275+0100 [mongosMain] connection accepted from 172.28.0.164:53833 #1429437 (399 connections now open) 2015-10-05T07:42:43.276+0100 [mongosMain] connection accepted from 172.28.0.164:53834 #1429438 (400 connections now open) 2015-10-05T07:42:43.277+0100 [conn1429438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:43.277+0100 [conn1429437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:43.593+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:43.593+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:45.868+0100 [conn1429059] end connection 172.28.0.163:59549 (399 connections now open) 2015-10-05T07:42:45.870+0100 [mongosMain] connection accepted from 172.28.0.163:60785 #1429439 (400 connections now open) 2015-10-05T07:42:45.871+0100 [conn1429439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:46.987+0100 [conn1429061] end connection 172.28.0.164:52671 (399 connections now open) 2015-10-05T07:42:46.989+0100 [mongosMain] connection accepted from 172.28.0.164:53843 #1429440 (400 connections now open) 2015-10-05T07:42:46.991+0100 [conn1429440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:48.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121be75703b51053ed2b4f 2015-10-05T07:42:48.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:42:49.601+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:49.602+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:51.125+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:53.291+0100 [conn1429051] end connection 172.28.0.164:52642 (399 connections now open) 2015-10-05T07:42:53.292+0100 [mongosMain] connection accepted from 172.28.0.164:53853 #1429441 (400 connections now open) 2015-10-05T07:42:53.296+0100 [conn1429441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:55.869+0100 [conn1429066] end connection 172.28.0.163:59575 (399 connections now open) 2015-10-05T07:42:55.870+0100 [mongosMain] connection accepted from 172.28.0.163:60801 #1429442 (400 connections now open) 2015-10-05T07:42:55.871+0100 [conn1429442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:42:56.607+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:42:56.607+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:42:57.002+0100 [conn1429067] end connection 172.28.0.164:52694 (399 connections now open) 2015-10-05T07:42:57.005+0100 [mongosMain] connection accepted from 172.28.0.164:53862 #1429443 (400 connections now open) 2015-10-05T07:42:57.014+0100 [conn1429443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:00.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121bf45703b51053ed2be6 2015-10-05T07:43:00.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:43:02.138+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:03.672+0100 [conn1429005] end connection 172.28.0.164:52511 (399 connections now open) 2015-10-05T07:43:03.672+0100 [conn1428995] end connection 172.28.0.164:52474 (399 connections now open) 2015-10-05T07:43:03.674+0100 [mongosMain] connection accepted from 172.28.0.164:53876 #1429444 (399 connections now open) 2015-10-05T07:43:03.675+0100 [mongosMain] connection accepted from 172.28.0.164:53877 #1429445 (400 connections now open) 2015-10-05T07:43:03.675+0100 [conn1429444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:03.676+0100 [conn1429445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:03.763+0100 [conn1428989] end connection 172.28.0.163:59168 (399 connections now open) 2015-10-05T07:43:03.766+0100 [mongosMain] connection accepted from 172.28.0.163:60826 #1429446 (400 connections now open) 2015-10-05T07:43:03.767+0100 [conn1429446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:04.629+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:04.629+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:05.305+0100 [conn1429023] end connection 172.28.0.163:59320 (399 connections now open) 2015-10-05T07:43:05.306+0100 [mongosMain] connection accepted from 172.28.0.163:60829 #1429447 (400 connections now open) 2015-10-05T07:43:05.307+0100 [conn1429447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:05.881+0100 [conn1429071] end connection 172.28.0.163:59594 (399 connections now open) 2015-10-05T07:43:05.882+0100 [mongosMain] connection accepted from 172.28.0.163:60832 #1429448 (400 connections now open) 2015-10-05T07:43:05.883+0100 [conn1429448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:06.362+0100 [conn1428948] end connection 172.28.0.164:52264 (399 connections now open) 2015-10-05T07:43:06.363+0100 [mongosMain] connection accepted from 172.28.0.164:53883 #1429449 (400 connections now open) 2015-10-05T07:43:06.364+0100 [conn1429449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:06.422+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:43:06.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:43:07.018+0100 [conn1429073] end connection 172.28.0.164:52711 (399 connections now open) 2015-10-05T07:43:07.019+0100 [mongosMain] connection accepted from 172.28.0.164:53887 #1429450 (400 connections now open) 2015-10-05T07:43:07.021+0100 [conn1429450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:13.160+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:13.324+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:43:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:43:13.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:13.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:13.680+0100 [conn1429046] end connection 172.28.0.164:52626 (399 connections now open) 2015-10-05T07:43:13.681+0100 [mongosMain] connection accepted from 172.28.0.164:53890 #1429451 (400 connections now open) 2015-10-05T07:43:13.683+0100 [conn1429451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:13.760+0100 [conn1428975] end connection 172.28.0.163:59145 (399 connections now open) 2015-10-05T07:43:13.761+0100 [mongosMain] connection accepted from 172.28.0.163:60843 #1429452 (400 connections now open) 2015-10-05T07:43:13.763+0100 [conn1429452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:15.322+0100 [conn1428991] end connection 172.28.0.163:59176 (399 connections now open) 2015-10-05T07:43:15.334+0100 [mongosMain] connection accepted from 172.28.0.163:60848 #1429453 (400 connections now open) 2015-10-05T07:43:15.337+0100 [conn1429453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:15.883+0100 [conn1429078] end connection 172.28.0.163:59623 (399 connections now open) 2015-10-05T07:43:15.884+0100 [mongosMain] connection accepted from 172.28.0.163:60851 #1429454 (400 connections now open) 2015-10-05T07:43:15.885+0100 [conn1429454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:16.379+0100 [conn1429041] end connection 172.28.0.164:52619 (399 connections now open) 2015-10-05T07:43:16.380+0100 [mongosMain] connection accepted from 172.28.0.164:53894 #1429455 (400 connections now open) 2015-10-05T07:43:16.381+0100 [conn1429455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:17.036+0100 [conn1429080] end connection 172.28.0.164:52742 (399 connections now open) 2015-10-05T07:43:17.037+0100 [mongosMain] connection accepted from 172.28.0.164:53895 #1429456 (400 connections now open) 2015-10-05T07:43:17.039+0100 [conn1429456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:18.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c065703b51053ed2ce2 2015-10-05T07:43:18.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:43:23.680+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:23.680+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:23.696+0100 [conn1429069] end connection 172.28.0.164:52703 (399 connections now open) 2015-10-05T07:43:23.696+0100 [conn1428990] end connection 172.28.0.164:52455 (398 connections now open) 2015-10-05T07:43:23.697+0100 [mongosMain] connection accepted from 172.28.0.164:53909 #1429457 (399 connections now open) 2015-10-05T07:43:23.698+0100 [mongosMain] connection accepted from 172.28.0.164:53910 #1429458 (400 connections now open) 2015-10-05T07:43:23.699+0100 [conn1429457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:23.700+0100 [conn1429458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:23.760+0100 [conn1429044] end connection 172.28.0.163:59484 (399 connections now open) 2015-10-05T07:43:23.761+0100 [mongosMain] connection accepted from 172.28.0.163:60859 #1429459 (400 connections now open) 2015-10-05T07:43:23.761+0100 [conn1429036] end connection 172.28.0.163:59413 (398 connections now open) 2015-10-05T07:43:23.762+0100 [mongosMain] connection accepted from 172.28.0.163:60860 #1429460 (400 connections now open) 2015-10-05T07:43:23.763+0100 [conn1429459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:23.763+0100 [conn1429460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:24.163+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:25.321+0100 [conn1429065] end connection 172.28.0.163:59573 (399 connections now open) 2015-10-05T07:43:25.322+0100 [mongosMain] connection accepted from 172.28.0.163:60862 #1429461 (400 connections now open) 2015-10-05T07:43:25.323+0100 [conn1429461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:25.897+0100 [conn1429085] end connection 172.28.0.163:59645 (399 connections now open) 2015-10-05T07:43:25.899+0100 [mongosMain] connection accepted from 172.28.0.163:60864 #1429462 (400 connections now open) 2015-10-05T07:43:25.900+0100 [conn1429462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:26.379+0100 [conn1429048] end connection 172.28.0.164:52628 (399 connections now open) 2015-10-05T07:43:26.380+0100 [mongosMain] connection accepted from 172.28.0.164:53917 #1429463 (400 connections now open) 2015-10-05T07:43:26.381+0100 [conn1429463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:27.049+0100 [conn1429087] end connection 172.28.0.164:52756 (399 connections now open) 2015-10-05T07:43:27.051+0100 [mongosMain] connection accepted from 172.28.0.164:53920 #1429464 (400 connections now open) 2015-10-05T07:43:27.053+0100 [conn1429464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:28.933+0100 [mongosMain] connection accepted from 127.0.0.1:60866 #1429465 (401 connections now open) 2015-10-05T07:43:28.937+0100 [conn1429465] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:28.946+0100 [conn1429465] end connection 127.0.0.1:60866 (400 connections now open) 2015-10-05T07:43:31.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c125703b51053ed2d9d 2015-10-05T07:43:31.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:43:33.712+0100 [conn1428914] end connection 172.28.0.164:52160 (399 connections now open) 2015-10-05T07:43:33.713+0100 [conn1429075] end connection 172.28.0.164:52730 (398 connections now open) 2015-10-05T07:43:33.714+0100 [mongosMain] connection accepted from 172.28.0.164:53931 #1429466 (399 connections now open) 2015-10-05T07:43:33.714+0100 [mongosMain] connection accepted from 172.28.0.164:53932 #1429467 (400 connections now open) 2015-10-05T07:43:33.716+0100 [conn1429466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:33.716+0100 [conn1429467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:33.776+0100 [conn1429068] end connection 172.28.0.163:59585 (399 connections now open) 2015-10-05T07:43:33.777+0100 [conn1429050] end connection 172.28.0.163:59529 (399 connections now open) 2015-10-05T07:43:33.778+0100 [mongosMain] connection accepted from 172.28.0.163:60870 #1429468 (399 connections now open) 2015-10-05T07:43:33.778+0100 [mongosMain] connection accepted from 172.28.0.163:60871 #1429469 (400 connections now open) 2015-10-05T07:43:33.779+0100 [conn1429468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:33.779+0100 [conn1429469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:34.772+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:34.772+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:35.167+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:35.336+0100 [conn1429058] end connection 172.28.0.163:59546 (399 connections now open) 2015-10-05T07:43:35.337+0100 [mongosMain] connection accepted from 172.28.0.163:60874 #1429470 (400 connections now open) 2015-10-05T07:43:35.338+0100 [conn1429470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:35.898+0100 [conn1429093] end connection 172.28.0.163:59659 (399 connections now open) 2015-10-05T07:43:35.899+0100 [mongosMain] connection accepted from 172.28.0.163:60876 #1429471 (400 connections now open) 2015-10-05T07:43:35.900+0100 [conn1429471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:36.379+0100 [conn1429060] end connection 172.28.0.164:52670 (399 connections now open) 2015-10-05T07:43:36.381+0100 [mongosMain] connection accepted from 172.28.0.164:53936 #1429472 (400 connections now open) 2015-10-05T07:43:36.382+0100 [conn1429472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:37.066+0100 [conn1429095] end connection 172.28.0.164:52792 (399 connections now open) 2015-10-05T07:43:37.067+0100 [mongosMain] connection accepted from 172.28.0.164:53940 #1429473 (400 connections now open) 2015-10-05T07:43:37.069+0100 [conn1429473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:37.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c195703b51053ed2dfc 2015-10-05T07:43:37.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:43:39.490+0100 [mongosMain] connection accepted from 127.0.0.1:60879 #1429474 (401 connections now open) 2015-10-05T07:43:39.493+0100 [conn1429474] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:39.497+0100 [conn1429474] end connection 127.0.0.1:60879 (400 connections now open) 2015-10-05T07:43:43.606+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:43:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:43:43.711+0100 [conn1428908] end connection 172.28.0.164:52140 (399 connections now open) 2015-10-05T07:43:43.712+0100 [conn1429064] end connection 172.28.0.164:52682 (398 connections now open) 2015-10-05T07:43:43.713+0100 [mongosMain] connection accepted from 172.28.0.164:53956 #1429475 (399 connections now open) 2015-10-05T07:43:43.713+0100 [mongosMain] connection accepted from 172.28.0.164:53957 #1429476 (400 connections now open) 2015-10-05T07:43:43.715+0100 [conn1429475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:43.715+0100 [conn1429476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:43.777+0100 [conn1429032] end connection 172.28.0.163:59367 (399 connections now open) 2015-10-05T07:43:43.777+0100 [conn1429004] end connection 172.28.0.163:59242 (399 connections now open) 2015-10-05T07:43:43.778+0100 [mongosMain] connection accepted from 172.28.0.163:60884 #1429477 (399 connections now open) 2015-10-05T07:43:43.779+0100 [mongosMain] connection accepted from 172.28.0.163:60885 #1429478 (400 connections now open) 2015-10-05T07:43:43.779+0100 [conn1429477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:43.779+0100 [conn1429478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:45.337+0100 [conn1429014] end connection 172.28.0.163:59305 (399 connections now open) 2015-10-05T07:43:45.338+0100 [mongosMain] connection accepted from 172.28.0.163:60890 #1429479 (400 connections now open) 2015-10-05T07:43:45.339+0100 [conn1429479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:45.913+0100 [conn1429101] end connection 172.28.0.163:59676 (399 connections now open) 2015-10-05T07:43:45.915+0100 [mongosMain] connection accepted from 172.28.0.163:60894 #1429480 (400 connections now open) 2015-10-05T07:43:45.916+0100 [conn1429480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:46.273+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:46.395+0100 [conn1429079] end connection 172.28.0.164:52739 (399 connections now open) 2015-10-05T07:43:46.396+0100 [mongosMain] connection accepted from 172.28.0.164:53961 #1429481 (400 connections now open) 2015-10-05T07:43:46.397+0100 [conn1429481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:46.780+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:46.780+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:47.081+0100 [conn1429102] end connection 172.28.0.164:52812 (399 connections now open) 2015-10-05T07:43:47.082+0100 [mongosMain] connection accepted from 172.28.0.164:53965 #1429482 (400 connections now open) 2015-10-05T07:43:47.084+0100 [conn1429482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:48.812+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:48.812+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:51.866+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:51.866+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:53.727+0100 [conn1428945] end connection 172.28.0.164:52258 (399 connections now open) 2015-10-05T07:43:53.727+0100 [conn1429082] end connection 172.28.0.164:52747 (399 connections now open) 2015-10-05T07:43:53.728+0100 [mongosMain] connection accepted from 172.28.0.164:53974 #1429483 (399 connections now open) 2015-10-05T07:43:53.728+0100 [mongosMain] connection accepted from 172.28.0.164:53975 #1429484 (400 connections now open) 2015-10-05T07:43:53.729+0100 [conn1429483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:53.729+0100 [conn1429484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:53.792+0100 [conn1428973] end connection 172.28.0.163:59129 (399 connections now open) 2015-10-05T07:43:53.792+0100 [conn1429037] end connection 172.28.0.163:59417 (399 connections now open) 2015-10-05T07:43:53.793+0100 [mongosMain] connection accepted from 172.28.0.163:60909 #1429485 (399 connections now open) 2015-10-05T07:43:53.794+0100 [mongosMain] connection accepted from 172.28.0.163:60910 #1429486 (400 connections now open) 2015-10-05T07:43:53.794+0100 [conn1429485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:53.795+0100 [conn1429486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:55.351+0100 [conn1429084] end connection 172.28.0.163:59643 (399 connections now open) 2015-10-05T07:43:55.352+0100 [mongosMain] connection accepted from 172.28.0.163:60916 #1429487 (400 connections now open) 2015-10-05T07:43:55.354+0100 [conn1429487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:55.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c2b5703b51053ed2f18 2015-10-05T07:43:55.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:43:55.871+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:43:55.871+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:43:55.913+0100 [conn1429110] end connection 172.28.0.163:59694 (399 connections now open) 2015-10-05T07:43:55.914+0100 [mongosMain] connection accepted from 172.28.0.163:60918 #1429488 (400 connections now open) 2015-10-05T07:43:55.915+0100 [conn1429488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:57.096+0100 [conn1429111] end connection 172.28.0.164:52858 (399 connections now open) 2015-10-05T07:43:57.097+0100 [mongosMain] connection accepted from 172.28.0.164:53981 #1429489 (400 connections now open) 2015-10-05T07:43:57.098+0100 [conn1429489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:43:57.280+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:00.880+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:00.880+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:02.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c315703b51053ed2f8e 2015-10-05T07:44:02.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:03.728+0100 [conn1429028] end connection 172.28.0.164:52573 (399 connections now open) 2015-10-05T07:44:03.729+0100 [mongosMain] connection accepted from 172.28.0.164:54003 #1429490 (400 connections now open) 2015-10-05T07:44:03.730+0100 [conn1429490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:03.796+0100 [conn1428980] end connection 172.28.0.163:59155 (399 connections now open) 2015-10-05T07:44:03.796+0100 [conn1428836] end connection 172.28.0.163:58684 (399 connections now open) 2015-10-05T07:44:03.797+0100 [mongosMain] connection accepted from 172.28.0.163:60941 #1429491 (399 connections now open) 2015-10-05T07:44:03.797+0100 [mongosMain] connection accepted from 172.28.0.163:60942 #1429492 (400 connections now open) 2015-10-05T07:44:03.798+0100 [conn1429491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:03.798+0100 [conn1429492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:05.355+0100 [conn1429006] end connection 172.28.0.163:59270 (399 connections now open) 2015-10-05T07:44:05.356+0100 [mongosMain] connection accepted from 172.28.0.163:60948 #1429493 (400 connections now open) 2015-10-05T07:44:05.357+0100 [conn1429493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:05.929+0100 [conn1429116] end connection 172.28.0.163:59722 (399 connections now open) 2015-10-05T07:44:05.930+0100 [mongosMain] connection accepted from 172.28.0.163:60953 #1429494 (400 connections now open) 2015-10-05T07:44:05.931+0100 [conn1429494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:06.411+0100 [conn1428997] end connection 172.28.0.164:52481 (399 connections now open) 2015-10-05T07:44:06.412+0100 [mongosMain] connection accepted from 172.28.0.164:54005 #1429495 (400 connections now open) 2015-10-05T07:44:06.414+0100 [conn1429495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:06.975+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:06.975+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:08.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c385703b51053ed300a 2015-10-05T07:44:08.290+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:08.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:13.744+0100 [conn1429057] end connection 172.28.0.164:52662 (399 connections now open) 2015-10-05T07:44:13.745+0100 [mongosMain] connection accepted from 172.28.0.164:54011 #1429496 (400 connections now open) 2015-10-05T07:44:13.747+0100 [conn1429496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:13.807+0100 [conn1428968] end connection 172.28.0.163:59085 (399 connections now open) 2015-10-05T07:44:13.807+0100 [conn1429088] end connection 172.28.0.163:59654 (399 connections now open) 2015-10-05T07:44:13.808+0100 [mongosMain] connection accepted from 172.28.0.163:60965 #1429497 (399 connections now open) 2015-10-05T07:44:13.809+0100 [mongosMain] connection accepted from 172.28.0.163:60966 #1429498 (400 connections now open) 2015-10-05T07:44:13.809+0100 [conn1429497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:13.810+0100 [conn1429498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:13.905+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:44:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:44:14.033+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:14.033+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:14.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c3e5703b51053ed3083 2015-10-05T07:44:14.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:15.367+0100 [conn1428996] end connection 172.28.0.163:59198 (399 connections now open) 2015-10-05T07:44:15.368+0100 [mongosMain] connection accepted from 172.28.0.163:60970 #1429499 (400 connections now open) 2015-10-05T07:44:15.369+0100 [conn1429499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:15.944+0100 [conn1429123] end connection 172.28.0.163:59757 (399 connections now open) 2015-10-05T07:44:15.945+0100 [mongosMain] connection accepted from 172.28.0.163:60973 #1429500 (400 connections now open) 2015-10-05T07:44:15.947+0100 [conn1429500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:16.411+0100 [conn1429086] end connection 172.28.0.164:52753 (399 connections now open) 2015-10-05T07:44:16.412+0100 [mongosMain] connection accepted from 172.28.0.164:54017 #1429501 (400 connections now open) 2015-10-05T07:44:16.413+0100 [conn1429501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:17.112+0100 [conn1429118] end connection 172.28.0.164:52877 (399 connections now open) 2015-10-05T07:44:17.113+0100 [mongosMain] connection accepted from 172.28.0.164:54019 #1429502 (400 connections now open) 2015-10-05T07:44:17.115+0100 [conn1429502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:19.314+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:21.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c445703b51053ed30de 2015-10-05T07:44:21.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:22.043+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:22.044+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:23.759+0100 [conn1429091] end connection 172.28.0.164:52765 (399 connections now open) 2015-10-05T07:44:23.760+0100 [mongosMain] connection accepted from 172.28.0.164:54035 #1429503 (400 connections now open) 2015-10-05T07:44:23.762+0100 [conn1429503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:23.814+0100 [conn1429020] end connection 172.28.0.163:59318 (399 connections now open) 2015-10-05T07:44:23.814+0100 [conn1429063] end connection 172.28.0.163:59565 (398 connections now open) 2015-10-05T07:44:23.815+0100 [mongosMain] connection accepted from 172.28.0.163:60980 #1429504 (399 connections now open) 2015-10-05T07:44:23.815+0100 [mongosMain] connection accepted from 172.28.0.163:60982 #1429505 (400 connections now open) 2015-10-05T07:44:23.816+0100 [conn1429504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:23.816+0100 [conn1429505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:25.947+0100 [conn1429128] end connection 172.28.0.163:59781 (399 connections now open) 2015-10-05T07:44:25.948+0100 [mongosMain] connection accepted from 172.28.0.163:60987 #1429506 (400 connections now open) 2015-10-05T07:44:25.949+0100 [conn1429506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:26.425+0100 [conn1429117] end connection 172.28.0.164:52875 (399 connections now open) 2015-10-05T07:44:26.427+0100 [mongosMain] connection accepted from 172.28.0.164:54039 #1429507 (400 connections now open) 2015-10-05T07:44:26.428+0100 [conn1429507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:27.128+0100 [conn1429130] end connection 172.28.0.164:52906 (399 connections now open) 2015-10-05T07:44:27.129+0100 [mongosMain] connection accepted from 172.28.0.164:54042 #1429508 (400 connections now open) 2015-10-05T07:44:27.130+0100 [conn1429508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:27.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c4b5703b51053ed3153 2015-10-05T07:44:27.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:29.018+0100 [mongosMain] connection accepted from 127.0.0.1:60989 #1429509 (401 connections now open) 2015-10-05T07:44:29.021+0100 [conn1429509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:29.027+0100 [conn1429509] end connection 127.0.0.1:60989 (400 connections now open) 2015-10-05T07:44:30.326+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:31.052+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:31.052+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:33.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c515703b51053ed31b7 2015-10-05T07:44:33.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:33.776+0100 [conn1429108] end connection 172.28.0.164:52825 (399 connections now open) 2015-10-05T07:44:33.777+0100 [mongosMain] connection accepted from 172.28.0.164:54054 #1429510 (400 connections now open) 2015-10-05T07:44:33.780+0100 [conn1429510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:33.823+0100 [conn1429097] end connection 172.28.0.163:59665 (399 connections now open) 2015-10-05T07:44:33.823+0100 [conn1429027] end connection 172.28.0.163:59336 (399 connections now open) 2015-10-05T07:44:33.824+0100 [mongosMain] connection accepted from 172.28.0.163:60996 #1429511 (399 connections now open) 2015-10-05T07:44:33.825+0100 [mongosMain] connection accepted from 172.28.0.163:60998 #1429512 (400 connections now open) 2015-10-05T07:44:33.825+0100 [conn1429511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:33.826+0100 [conn1429512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:35.960+0100 [conn1429134] end connection 172.28.0.163:59795 (399 connections now open) 2015-10-05T07:44:35.961+0100 [mongosMain] connection accepted from 172.28.0.163:61003 #1429513 (400 connections now open) 2015-10-05T07:44:35.962+0100 [conn1429513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:36.442+0100 [conn1429094] end connection 172.28.0.164:52785 (399 connections now open) 2015-10-05T07:44:36.443+0100 [mongosMain] connection accepted from 172.28.0.164:54062 #1429514 (400 connections now open) 2015-10-05T07:44:36.445+0100 [conn1429514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:37.129+0100 [conn1429136] end connection 172.28.0.164:52925 (399 connections now open) 2015-10-05T07:44:37.131+0100 [mongosMain] connection accepted from 172.28.0.164:54064 #1429515 (400 connections now open) 2015-10-05T07:44:37.132+0100 [conn1429515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:39.632+0100 [mongosMain] connection accepted from 127.0.0.1:61007 #1429516 (401 connections now open) 2015-10-05T07:44:39.634+0100 [conn1429516] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:39.639+0100 [conn1429516] end connection 127.0.0.1:61007 (400 connections now open) 2015-10-05T07:44:39.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c575703b51053ed3226 2015-10-05T07:44:39.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:41.061+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:41.062+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:41.333+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:43.790+0100 [conn1429127] end connection 172.28.0.164:52900 (399 connections now open) 2015-10-05T07:44:43.791+0100 [mongosMain] connection accepted from 172.28.0.164:54077 #1429517 (400 connections now open) 2015-10-05T07:44:43.793+0100 [conn1429517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:43.839+0100 [conn1429098] end connection 172.28.0.163:59666 (399 connections now open) 2015-10-05T07:44:43.839+0100 [conn1429081] end connection 172.28.0.163:59635 (399 connections now open) 2015-10-05T07:44:43.840+0100 [mongosMain] connection accepted from 172.28.0.163:61015 #1429518 (399 connections now open) 2015-10-05T07:44:43.841+0100 [mongosMain] connection accepted from 172.28.0.163:61016 #1429519 (400 connections now open) 2015-10-05T07:44:43.841+0100 [conn1429518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:43.842+0100 [conn1429519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:44.088+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:44:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:44:45.966+0100 [conn1429141] end connection 172.28.0.163:59808 (399 connections now open) 2015-10-05T07:44:45.967+0100 [mongosMain] connection accepted from 172.28.0.163:61021 #1429520 (400 connections now open) 2015-10-05T07:44:45.968+0100 [conn1429520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:46.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c5d5703b51053ed32a3 2015-10-05T07:44:46.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:46.458+0100 [conn1429008] end connection 172.28.0.164:52516 (399 connections now open) 2015-10-05T07:44:46.459+0100 [mongosMain] connection accepted from 172.28.0.164:54082 #1429521 (400 connections now open) 2015-10-05T07:44:46.461+0100 [conn1429521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:47.144+0100 [conn1429143] end connection 172.28.0.164:52946 (399 connections now open) 2015-10-05T07:44:47.145+0100 [mongosMain] connection accepted from 172.28.0.164:54084 #1429522 (400 connections now open) 2015-10-05T07:44:47.153+0100 [conn1429522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:52.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:52.069+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:44:52.341+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:44:52.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c645703b51053ed32fd 2015-10-05T07:44:52.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:44:53.805+0100 [conn1429038] end connection 172.28.0.164:52612 (399 connections now open) 2015-10-05T07:44:53.806+0100 [conn1429045] end connection 172.28.0.164:52625 (398 connections now open) 2015-10-05T07:44:53.807+0100 [mongosMain] connection accepted from 172.28.0.164:54093 #1429523 (399 connections now open) 2015-10-05T07:44:53.807+0100 [mongosMain] connection accepted from 172.28.0.164:54094 #1429524 (400 connections now open) 2015-10-05T07:44:53.808+0100 [conn1429523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:53.809+0100 [conn1429524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:53.842+0100 [conn1429089] end connection 172.28.0.163:59655 (399 connections now open) 2015-10-05T07:44:53.842+0100 [conn1429043] end connection 172.28.0.163:59476 (399 connections now open) 2015-10-05T07:44:53.844+0100 [mongosMain] connection accepted from 172.28.0.163:61032 #1429525 (399 connections now open) 2015-10-05T07:44:53.844+0100 [mongosMain] connection accepted from 172.28.0.163:61033 #1429526 (400 connections now open) 2015-10-05T07:44:53.844+0100 [conn1429525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:53.845+0100 [conn1429526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:55.976+0100 [conn1429149] end connection 172.28.0.163:59842 (399 connections now open) 2015-10-05T07:44:55.977+0100 [mongosMain] connection accepted from 172.28.0.163:61040 #1429527 (400 connections now open) 2015-10-05T07:44:55.979+0100 [conn1429527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:56.458+0100 [conn1429124] end connection 172.28.0.164:52894 (399 connections now open) 2015-10-05T07:44:56.459+0100 [mongosMain] connection accepted from 172.28.0.164:54099 #1429528 (400 connections now open) 2015-10-05T07:44:56.462+0100 [conn1429528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:57.160+0100 [conn1429151] end connection 172.28.0.164:52968 (399 connections now open) 2015-10-05T07:44:57.163+0100 [mongosMain] connection accepted from 172.28.0.164:54102 #1429529 (400 connections now open) 2015-10-05T07:44:57.164+0100 [conn1429529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:44:59.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c6a5703b51053ed3350 2015-10-05T07:44:59.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:03.374+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:03.806+0100 [conn1429114] end connection 172.28.0.164:52865 (399 connections now open) 2015-10-05T07:45:03.807+0100 [conn1429109] end connection 172.28.0.164:52831 (398 connections now open) 2015-10-05T07:45:03.807+0100 [mongosMain] connection accepted from 172.28.0.164:54111 #1429530 (399 connections now open) 2015-10-05T07:45:03.808+0100 [mongosMain] connection accepted from 172.28.0.164:54112 #1429531 (400 connections now open) 2015-10-05T07:45:03.809+0100 [conn1429530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:03.810+0100 [conn1429531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:03.855+0100 [conn1429131] end connection 172.28.0.163:59785 (399 connections now open) 2015-10-05T07:45:03.855+0100 [conn1429113] end connection 172.28.0.163:59711 (399 connections now open) 2015-10-05T07:45:03.857+0100 [mongosMain] connection accepted from 172.28.0.163:61059 #1429532 (399 connections now open) 2015-10-05T07:45:03.857+0100 [mongosMain] connection accepted from 172.28.0.163:61060 #1429533 (400 connections now open) 2015-10-05T07:45:03.857+0100 [conn1429532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:03.858+0100 [conn1429533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:04.074+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:04.074+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:05.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c715703b51053ed33c1 2015-10-05T07:45:05.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:05.976+0100 [conn1429155] end connection 172.28.0.163:59936 (399 connections now open) 2015-10-05T07:45:05.977+0100 [mongosMain] connection accepted from 172.28.0.163:61066 #1429534 (400 connections now open) 2015-10-05T07:45:05.978+0100 [conn1429534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:06.092+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:06.092+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:06.473+0100 [conn1429142] end connection 172.28.0.164:52942 (399 connections now open) 2015-10-05T07:45:06.474+0100 [mongosMain] connection accepted from 172.28.0.164:54115 #1429535 (400 connections now open) 2015-10-05T07:45:06.476+0100 [conn1429535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:07.175+0100 [conn1429157] end connection 172.28.0.164:52989 (399 connections now open) 2015-10-05T07:45:07.176+0100 [mongosMain] connection accepted from 172.28.0.164:54117 #1429536 (400 connections now open) 2015-10-05T07:45:07.178+0100 [conn1429536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:09.094+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:09.095+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:11.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c775703b51053ed3441 2015-10-05T07:45:12.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:13.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:13.117+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:13.858+0100 [conn1429056] end connection 172.28.0.163:59538 (399 connections now open) 2015-10-05T07:45:13.858+0100 [conn1429106] end connection 172.28.0.163:59683 (399 connections now open) 2015-10-05T07:45:13.859+0100 [mongosMain] connection accepted from 172.28.0.163:61079 #1429537 (399 connections now open) 2015-10-05T07:45:13.860+0100 [mongosMain] connection accepted from 172.28.0.163:61080 #1429538 (400 connections now open) 2015-10-05T07:45:13.861+0100 [conn1429537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:13.861+0100 [conn1429538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:14.162+0100 [conn1429121] end connection 172.28.0.164:52887 (399 connections now open) 2015-10-05T07:45:14.164+0100 [conn1429083] end connection 172.28.0.164:52748 (398 connections now open) 2015-10-05T07:45:14.165+0100 [mongosMain] connection accepted from 172.28.0.164:54122 #1429539 (399 connections now open) 2015-10-05T07:45:14.167+0100 [conn1429539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:14.185+0100 [mongosMain] connection accepted from 172.28.0.164:54124 #1429540 (400 connections now open) 2015-10-05T07:45:14.186+0100 [conn1429540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:14.461+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:14.865+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:45:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:45:15.992+0100 [conn1429162] end connection 172.28.0.163:59963 (399 connections now open) 2015-10-05T07:45:15.993+0100 [mongosMain] connection accepted from 172.28.0.163:61087 #1429541 (400 connections now open) 2015-10-05T07:45:15.994+0100 [conn1429541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:16.489+0100 [conn1429150] end connection 172.28.0.164:52966 (399 connections now open) 2015-10-05T07:45:16.491+0100 [mongosMain] connection accepted from 172.28.0.164:54127 #1429542 (400 connections now open) 2015-10-05T07:45:16.494+0100 [conn1429542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:17.176+0100 [conn1429164] end connection 172.28.0.164:53011 (399 connections now open) 2015-10-05T07:45:17.177+0100 [mongosMain] connection accepted from 172.28.0.164:54129 #1429543 (400 connections now open) 2015-10-05T07:45:17.179+0100 [conn1429543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:18.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:18.124+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:18.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c7e5703b51053ed349f 2015-10-05T07:45:18.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:23.870+0100 [conn1429011] end connection 172.28.0.163:59300 (399 connections now open) 2015-10-05T07:45:23.870+0100 [conn1429119] end connection 172.28.0.163:59743 (398 connections now open) 2015-10-05T07:45:23.871+0100 [mongosMain] connection accepted from 172.28.0.163:61112 #1429544 (399 connections now open) 2015-10-05T07:45:23.872+0100 [mongosMain] connection accepted from 172.28.0.163:61113 #1429545 (400 connections now open) 2015-10-05T07:45:23.872+0100 [conn1429544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:23.873+0100 [conn1429545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:24.145+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:24.146+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:24.149+0100 [conn1429133] end connection 172.28.0.164:52918 (399 connections now open) 2015-10-05T07:45:24.150+0100 [mongosMain] connection accepted from 172.28.0.164:54140 #1429546 (400 connections now open) 2015-10-05T07:45:24.152+0100 [conn1429546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:24.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c845703b51053ed34ed 2015-10-05T07:45:24.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:25.430+0100 [conn1429077] end connection 172.28.0.163:59621 (399 connections now open) 2015-10-05T07:45:25.431+0100 [mongosMain] connection accepted from 172.28.0.163:61116 #1429547 (400 connections now open) 2015-10-05T07:45:25.432+0100 [conn1429547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:25.474+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:25.992+0100 [conn1429168] end connection 172.28.0.163:59978 (399 connections now open) 2015-10-05T07:45:25.993+0100 [mongosMain] connection accepted from 172.28.0.163:61118 #1429548 (400 connections now open) 2015-10-05T07:45:25.995+0100 [conn1429548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:26.505+0100 [conn1429072] end connection 172.28.0.164:52709 (399 connections now open) 2015-10-05T07:45:26.506+0100 [mongosMain] connection accepted from 172.28.0.164:54144 #1429549 (400 connections now open) 2015-10-05T07:45:26.509+0100 [conn1429549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:27.191+0100 [conn1429170] end connection 172.28.0.164:53022 (399 connections now open) 2015-10-05T07:45:27.193+0100 [mongosMain] connection accepted from 172.28.0.164:54147 #1429550 (400 connections now open) 2015-10-05T07:45:27.195+0100 [conn1429550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:28.985+0100 [mongosMain] connection accepted from 127.0.0.1:61123 #1429551 (401 connections now open) 2015-10-05T07:45:28.988+0100 [conn1429551] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:28.993+0100 [conn1429551] end connection 127.0.0.1:61123 (400 connections now open) 2015-10-05T07:45:30.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c8a5703b51053ed3542 2015-10-05T07:45:30.746+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:31.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:31.155+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:33.871+0100 [conn1429120] end connection 172.28.0.163:59744 (399 connections now open) 2015-10-05T07:45:33.871+0100 [conn1429112] end connection 172.28.0.163:59710 (399 connections now open) 2015-10-05T07:45:33.872+0100 [mongosMain] connection accepted from 172.28.0.163:61126 #1429552 (399 connections now open) 2015-10-05T07:45:33.872+0100 [mongosMain] connection accepted from 172.28.0.163:61127 #1429553 (400 connections now open) 2015-10-05T07:45:33.873+0100 [conn1429552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:33.873+0100 [conn1429553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:34.166+0100 [conn1429099] end connection 172.28.0.164:52799 (399 connections now open) 2015-10-05T07:45:34.167+0100 [mongosMain] connection accepted from 172.28.0.164:54162 #1429554 (400 connections now open) 2015-10-05T07:45:34.168+0100 [conn1429554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:35.431+0100 [conn1429092] end connection 172.28.0.163:59657 (399 connections now open) 2015-10-05T07:45:35.432+0100 [mongosMain] connection accepted from 172.28.0.163:61130 #1429555 (400 connections now open) 2015-10-05T07:45:35.434+0100 [conn1429555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:36.008+0100 [conn1429175] end connection 172.28.0.163:59992 (399 connections now open) 2015-10-05T07:45:36.009+0100 [mongosMain] connection accepted from 172.28.0.163:61133 #1429556 (400 connections now open) 2015-10-05T07:45:36.010+0100 [conn1429556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:36.521+0100 [conn1429129] end connection 172.28.0.164:52903 (399 connections now open) 2015-10-05T07:45:36.522+0100 [mongosMain] connection accepted from 172.28.0.164:54165 #1429557 (400 connections now open) 2015-10-05T07:45:36.524+0100 [conn1429557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:36.573+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:37.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c905703b51053ed35ac 2015-10-05T07:45:37.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:37.207+0100 [conn1429177] end connection 172.28.0.164:53044 (399 connections now open) 2015-10-05T07:45:37.208+0100 [mongosMain] connection accepted from 172.28.0.164:54169 #1429558 (400 connections now open) 2015-10-05T07:45:37.210+0100 [conn1429558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:39.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:39.228+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:40.022+0100 [mongosMain] connection accepted from 127.0.0.1:61138 #1429559 (401 connections now open) 2015-10-05T07:45:40.024+0100 [conn1429559] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:40.030+0100 [conn1429559] end connection 127.0.0.1:61138 (400 connections now open) 2015-10-05T07:45:43.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c975703b51053ed35ef 2015-10-05T07:45:43.448+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:43.886+0100 [conn1429126] end connection 172.28.0.163:59771 (399 connections now open) 2015-10-05T07:45:43.887+0100 [conn1429125] end connection 172.28.0.163:59770 (398 connections now open) 2015-10-05T07:45:43.888+0100 [mongosMain] connection accepted from 172.28.0.163:61143 #1429560 (399 connections now open) 2015-10-05T07:45:43.888+0100 [mongosMain] connection accepted from 172.28.0.163:61144 #1429561 (400 connections now open) 2015-10-05T07:45:43.889+0100 [conn1429560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:43.889+0100 [conn1429561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:44.181+0100 [conn1429154] end connection 172.28.0.164:52979 (399 connections now open) 2015-10-05T07:45:44.183+0100 [mongosMain] connection accepted from 172.28.0.164:54181 #1429562 (400 connections now open) 2015-10-05T07:45:44.185+0100 [conn1429562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:45.051+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:45:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:45:46.023+0100 [conn1429184] end connection 172.28.0.163:60009 (399 connections now open) 2015-10-05T07:45:46.024+0100 [mongosMain] connection accepted from 172.28.0.163:61150 #1429563 (400 connections now open) 2015-10-05T07:45:46.025+0100 [conn1429563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:47.222+0100 [conn1429186] end connection 172.28.0.164:53064 (399 connections now open) 2015-10-05T07:45:47.224+0100 [mongosMain] connection accepted from 172.28.0.164:54187 #1429564 (400 connections now open) 2015-10-05T07:45:47.225+0100 [conn1429564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:47.577+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:48.282+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:48.282+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:49.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121c9d5703b51053ed3644 2015-10-05T07:45:50.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:53.892+0100 [conn1429153] end connection 172.28.0.163:59926 (399 connections now open) 2015-10-05T07:45:53.892+0100 [conn1429159] end connection 172.28.0.163:59955 (399 connections now open) 2015-10-05T07:45:53.893+0100 [mongosMain] connection accepted from 172.28.0.163:61161 #1429565 (399 connections now open) 2015-10-05T07:45:53.893+0100 [mongosMain] connection accepted from 172.28.0.163:61162 #1429566 (400 connections now open) 2015-10-05T07:45:53.894+0100 [conn1429565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:53.894+0100 [conn1429566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:54.196+0100 [conn1429140] end connection 172.28.0.164:52936 (399 connections now open) 2015-10-05T07:45:54.198+0100 [mongosMain] connection accepted from 172.28.0.164:54195 #1429567 (400 connections now open) 2015-10-05T07:45:54.199+0100 [conn1429567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:55.469+0100 [conn1429192] end connection 172.28.0.163:60028 (399 connections now open) 2015-10-05T07:45:55.470+0100 [mongosMain] connection accepted from 172.28.0.163:61166 #1429568 (400 connections now open) 2015-10-05T07:45:55.471+0100 [conn1429568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:56.031+0100 [conn1429193] end connection 172.28.0.163:60031 (399 connections now open) 2015-10-05T07:45:56.032+0100 [mongosMain] connection accepted from 172.28.0.163:61168 #1429569 (400 connections now open) 2015-10-05T07:45:56.033+0100 [conn1429569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:56.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ca45703b51053ed3692 2015-10-05T07:45:56.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:45:57.238+0100 [conn1429194] end connection 172.28.0.164:53083 (399 connections now open) 2015-10-05T07:45:57.239+0100 [mongosMain] connection accepted from 172.28.0.164:54199 #1429570 (400 connections now open) 2015-10-05T07:45:57.242+0100 [conn1429570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:45:58.288+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:45:58.288+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:45:58.636+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:03.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121caa5703b51053ed36fe 2015-10-05T07:46:03.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:03.902+0100 [conn1429019] end connection 172.28.0.163:59317 (399 connections now open) 2015-10-05T07:46:03.902+0100 [conn1429171] end connection 172.28.0.163:59987 (399 connections now open) 2015-10-05T07:46:03.903+0100 [mongosMain] connection accepted from 172.28.0.163:61186 #1429571 (399 connections now open) 2015-10-05T07:46:03.904+0100 [mongosMain] connection accepted from 172.28.0.163:61187 #1429572 (400 connections now open) 2015-10-05T07:46:03.905+0100 [conn1429571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:03.905+0100 [conn1429572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:04.212+0100 [conn1429148] end connection 172.28.0.164:52960 (399 connections now open) 2015-10-05T07:46:04.214+0100 [mongosMain] connection accepted from 172.28.0.164:54210 #1429573 (400 connections now open) 2015-10-05T07:46:04.215+0100 [conn1429174] end connection 172.28.0.164:53033 (399 connections now open) 2015-10-05T07:46:04.216+0100 [conn1429573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:04.217+0100 [mongosMain] connection accepted from 172.28.0.164:54212 #1429574 (400 connections now open) 2015-10-05T07:46:04.218+0100 [conn1429574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:06.038+0100 [conn1429198] end connection 172.28.0.163:60051 (399 connections now open) 2015-10-05T07:46:06.039+0100 [mongosMain] connection accepted from 172.28.0.163:61193 #1429575 (400 connections now open) 2015-10-05T07:46:06.040+0100 [conn1429575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:07.255+0100 [conn1429199] end connection 172.28.0.164:53100 (399 connections now open) 2015-10-05T07:46:07.255+0100 [mongosMain] connection accepted from 172.28.0.164:54217 #1429576 (400 connections now open) 2015-10-05T07:46:07.256+0100 [conn1429576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:09.300+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:09.300+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:09.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cb15703b51053ed377b 2015-10-05T07:46:09.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:09.640+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:13.930+0100 [conn1429107] end connection 172.28.0.163:59684 (399 connections now open) 2015-10-05T07:46:13.930+0100 [conn1429138] end connection 172.28.0.163:59798 (399 connections now open) 2015-10-05T07:46:13.931+0100 [mongosMain] connection accepted from 172.28.0.163:61204 #1429577 (399 connections now open) 2015-10-05T07:46:13.931+0100 [mongosMain] connection accepted from 172.28.0.163:61205 #1429578 (400 connections now open) 2015-10-05T07:46:13.932+0100 [conn1429577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:13.932+0100 [conn1429578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:14.212+0100 [conn1429090] end connection 172.28.0.164:52764 (399 connections now open) 2015-10-05T07:46:14.212+0100 [conn1429166] end connection 172.28.0.164:53015 (399 connections now open) 2015-10-05T07:46:14.213+0100 [mongosMain] connection accepted from 172.28.0.164:54221 #1429579 (399 connections now open) 2015-10-05T07:46:14.214+0100 [mongosMain] connection accepted from 172.28.0.164:54222 #1429580 (400 connections now open) 2015-10-05T07:46:14.215+0100 [conn1429580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:14.216+0100 [conn1429579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:15.324+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:46:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:46:15.478+0100 [conn1429197] end connection 172.28.0.163:60048 (399 connections now open) 2015-10-05T07:46:15.479+0100 [mongosMain] connection accepted from 172.28.0.163:61209 #1429581 (400 connections now open) 2015-10-05T07:46:15.480+0100 [conn1429581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:15.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cb75703b51053ed37d6 2015-10-05T07:46:15.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:16.041+0100 [conn1429205] end connection 172.28.0.163:60084 (399 connections now open) 2015-10-05T07:46:16.041+0100 [mongosMain] connection accepted from 172.28.0.163:61212 #1429582 (400 connections now open) 2015-10-05T07:46:16.042+0100 [conn1429582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:17.254+0100 [conn1429206] end connection 172.28.0.164:53121 (399 connections now open) 2015-10-05T07:46:17.255+0100 [mongosMain] connection accepted from 172.28.0.164:54228 #1429583 (400 connections now open) 2015-10-05T07:46:17.257+0100 [conn1429583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:20.740+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:21.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:21.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:23.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cbd5703b51053ed3836 2015-10-05T07:46:23.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:23.329+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:23.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:23.919+0100 [conn1429147] end connection 172.28.0.163:59824 (399 connections now open) 2015-10-05T07:46:23.920+0100 [mongosMain] connection accepted from 172.28.0.163:61224 #1429584 (400 connections now open) 2015-10-05T07:46:23.922+0100 [conn1429584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:24.228+0100 [conn1429181] end connection 172.28.0.164:53053 (399 connections now open) 2015-10-05T07:46:24.229+0100 [conn1429191] end connection 172.28.0.164:53076 (398 connections now open) 2015-10-05T07:46:24.229+0100 [mongosMain] connection accepted from 172.28.0.164:54241 #1429585 (399 connections now open) 2015-10-05T07:46:24.230+0100 [mongosMain] connection accepted from 172.28.0.164:54242 #1429586 (400 connections now open) 2015-10-05T07:46:24.230+0100 [conn1429585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:24.232+0100 [conn1429586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:25.479+0100 [conn1429183] end connection 172.28.0.163:60007 (399 connections now open) 2015-10-05T07:46:25.480+0100 [mongosMain] connection accepted from 172.28.0.163:61228 #1429587 (400 connections now open) 2015-10-05T07:46:25.482+0100 [conn1429587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:26.055+0100 [conn1429212] end connection 172.28.0.163:60105 (399 connections now open) 2015-10-05T07:46:26.056+0100 [mongosMain] connection accepted from 172.28.0.163:61229 #1429588 (400 connections now open) 2015-10-05T07:46:26.058+0100 [conn1429588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:26.336+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:26.336+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:27.254+0100 [conn1429213] end connection 172.28.0.164:53136 (399 connections now open) 2015-10-05T07:46:27.255+0100 [mongosMain] connection accepted from 172.28.0.164:54249 #1429589 (400 connections now open) 2015-10-05T07:46:27.257+0100 [conn1429589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:28.647+0100 [mongosMain] connection accepted from 127.0.0.1:61231 #1429590 (401 connections now open) 2015-10-05T07:46:28.649+0100 [conn1429590] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:28.655+0100 [conn1429590] end connection 127.0.0.1:61231 (400 connections now open) 2015-10-05T07:46:29.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cc55703b51053ed3898 2015-10-05T07:46:29.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:30.334+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:30.335+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:31.778+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:33.998+0100 [conn1429132] end connection 172.28.0.163:59786 (399 connections now open) 2015-10-05T07:46:34.003+0100 [mongosMain] connection accepted from 172.28.0.163:61235 #1429591 (400 connections now open) 2015-10-05T07:46:34.004+0100 [conn1429591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:34.263+0100 [conn1429160] end connection 172.28.0.164:53003 (399 connections now open) 2015-10-05T07:46:34.267+0100 [conn1429203] end connection 172.28.0.164:53118 (398 connections now open) 2015-10-05T07:46:34.268+0100 [mongosMain] connection accepted from 172.28.0.164:54261 #1429592 (399 connections now open) 2015-10-05T07:46:34.270+0100 [mongosMain] connection accepted from 172.28.0.164:54263 #1429593 (400 connections now open) 2015-10-05T07:46:34.270+0100 [conn1429592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:34.271+0100 [conn1429593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:35.343+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:35.343+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:35.492+0100 [conn1429204] end connection 172.28.0.163:60083 (399 connections now open) 2015-10-05T07:46:35.493+0100 [mongosMain] connection accepted from 172.28.0.163:61239 #1429594 (400 connections now open) 2015-10-05T07:46:35.494+0100 [conn1429594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:36.056+0100 [conn1429219] end connection 172.28.0.163:60119 (399 connections now open) 2015-10-05T07:46:36.057+0100 [mongosMain] connection accepted from 172.28.0.163:61240 #1429595 (400 connections now open) 2015-10-05T07:46:36.058+0100 [conn1429595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:36.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ccb5703b51053ed38f5 2015-10-05T07:46:36.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:36.567+0100 [conn1429176] end connection 172.28.0.164:53039 (399 connections now open) 2015-10-05T07:46:36.568+0100 [mongosMain] connection accepted from 172.28.0.164:54268 #1429596 (400 connections now open) 2015-10-05T07:46:36.570+0100 [conn1429596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:37.273+0100 [conn1429220] end connection 172.28.0.164:53157 (399 connections now open) 2015-10-05T07:46:37.274+0100 [mongosMain] connection accepted from 172.28.0.164:54271 #1429597 (400 connections now open) 2015-10-05T07:46:37.276+0100 [conn1429597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:39.957+0100 [mongosMain] connection accepted from 127.0.0.1:61242 #1429598 (401 connections now open) 2015-10-05T07:46:39.959+0100 [conn1429598] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:39.972+0100 [conn1429598] end connection 127.0.0.1:61242 (400 connections now open) 2015-10-05T07:46:41.350+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:41.350+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:42.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cd25703b51053ed3954 2015-10-05T07:46:42.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:42.798+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:44.005+0100 [conn1429188] end connection 172.28.0.163:60020 (399 connections now open) 2015-10-05T07:46:44.006+0100 [mongosMain] connection accepted from 172.28.0.163:61250 #1429599 (400 connections now open) 2015-10-05T07:46:44.007+0100 [conn1429599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:44.276+0100 [conn1429208] end connection 172.28.0.164:53129 (399 connections now open) 2015-10-05T07:46:44.276+0100 [conn1429076] end connection 172.28.0.164:52731 (399 connections now open) 2015-10-05T07:46:44.277+0100 [mongosMain] connection accepted from 172.28.0.164:54287 #1429600 (399 connections now open) 2015-10-05T07:46:44.278+0100 [mongosMain] connection accepted from 172.28.0.164:54288 #1429601 (400 connections now open) 2015-10-05T07:46:44.279+0100 [conn1429600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:44.279+0100 [conn1429601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:45.494+0100 [conn1429100] end connection 172.28.0.163:59673 (399 connections now open) 2015-10-05T07:46:45.494+0100 [mongosMain] connection accepted from 172.28.0.163:61254 #1429602 (400 connections now open) 2015-10-05T07:46:45.495+0100 [conn1429602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:45.605+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:46:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:46:46.071+0100 [conn1429227] end connection 172.28.0.163:60131 (399 connections now open) 2015-10-05T07:46:46.072+0100 [mongosMain] connection accepted from 172.28.0.163:61256 #1429603 (400 connections now open) 2015-10-05T07:46:46.074+0100 [conn1429603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:46.568+0100 [conn1429185] end connection 172.28.0.164:53060 (399 connections now open) 2015-10-05T07:46:46.569+0100 [mongosMain] connection accepted from 172.28.0.164:54291 #1429604 (400 connections now open) 2015-10-05T07:46:46.570+0100 [conn1429604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:47.269+0100 [conn1429228] end connection 172.28.0.164:53177 (399 connections now open) 2015-10-05T07:46:47.271+0100 [mongosMain] connection accepted from 172.28.0.164:54295 #1429605 (400 connections now open) 2015-10-05T07:46:47.273+0100 [conn1429605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:48.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:48.387+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:53.809+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:54.027+0100 [conn1429179] end connection 172.28.0.163:60003 (399 connections now open) 2015-10-05T07:46:54.029+0100 [mongosMain] connection accepted from 172.28.0.163:61267 #1429606 (400 connections now open) 2015-10-05T07:46:54.030+0100 [conn1429606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:54.275+0100 [conn1429115] end connection 172.28.0.164:52866 (399 connections now open) 2015-10-05T07:46:54.275+0100 [conn1429173] end connection 172.28.0.164:53032 (399 connections now open) 2015-10-05T07:46:54.277+0100 [mongosMain] connection accepted from 172.28.0.164:54306 #1429607 (399 connections now open) 2015-10-05T07:46:54.277+0100 [mongosMain] connection accepted from 172.28.0.164:54307 #1429608 (400 connections now open) 2015-10-05T07:46:54.279+0100 [conn1429608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:54.279+0100 [conn1429607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:54.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cde5703b51053ed3a2f 2015-10-05T07:46:54.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:46:55.508+0100 [conn1429211] end connection 172.28.0.163:60102 (399 connections now open) 2015-10-05T07:46:55.509+0100 [mongosMain] connection accepted from 172.28.0.163:61274 #1429609 (400 connections now open) 2015-10-05T07:46:55.510+0100 [conn1429609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:56.071+0100 [conn1429235] end connection 172.28.0.163:60147 (399 connections now open) 2015-10-05T07:46:56.072+0100 [mongosMain] connection accepted from 172.28.0.163:61276 #1429610 (400 connections now open) 2015-10-05T07:46:56.074+0100 [conn1429610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:56.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:46:56.391+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:46:56.584+0100 [conn1429135] end connection 172.28.0.164:52923 (399 connections now open) 2015-10-05T07:46:56.586+0100 [mongosMain] connection accepted from 172.28.0.164:54310 #1429611 (400 connections now open) 2015-10-05T07:46:56.588+0100 [conn1429611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:46:57.286+0100 [conn1429237] end connection 172.28.0.164:53201 (399 connections now open) 2015-10-05T07:46:57.288+0100 [mongosMain] connection accepted from 172.28.0.164:54312 #1429612 (400 connections now open) 2015-10-05T07:46:57.289+0100 [conn1429612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:04.028+0100 [conn1429152] end connection 172.28.0.163:59925 (399 connections now open) 2015-10-05T07:47:04.028+0100 [conn1429195] end connection 172.28.0.163:60042 (399 connections now open) 2015-10-05T07:47:04.029+0100 [mongosMain] connection accepted from 172.28.0.163:61298 #1429613 (399 connections now open) 2015-10-05T07:47:04.029+0100 [mongosMain] connection accepted from 172.28.0.163:61299 #1429614 (400 connections now open) 2015-10-05T07:47:04.030+0100 [conn1429613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:04.030+0100 [conn1429614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:04.291+0100 [conn1429202] end connection 172.28.0.164:53119 (399 connections now open) 2015-10-05T07:47:04.292+0100 [conn1429122] end connection 172.28.0.164:52888 (398 connections now open) 2015-10-05T07:47:04.292+0100 [mongosMain] connection accepted from 172.28.0.164:54330 #1429615 (399 connections now open) 2015-10-05T07:47:04.293+0100 [mongosMain] connection accepted from 172.28.0.164:54331 #1429616 (400 connections now open) 2015-10-05T07:47:04.294+0100 [conn1429615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:04.295+0100 [conn1429616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:04.908+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:05.405+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:05.406+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:05.511+0100 [conn1429226] end connection 172.28.0.163:60128 (399 connections now open) 2015-10-05T07:47:05.512+0100 [mongosMain] connection accepted from 172.28.0.163:61305 #1429617 (400 connections now open) 2015-10-05T07:47:05.513+0100 [conn1429617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:06.599+0100 [conn1429169] end connection 172.28.0.164:53020 (399 connections now open) 2015-10-05T07:47:06.601+0100 [mongosMain] connection accepted from 172.28.0.164:54333 #1429618 (400 connections now open) 2015-10-05T07:47:06.603+0100 [conn1429618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:07.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ceb5703b51053ed3b1b 2015-10-05T07:47:07.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:07.303+0100 [conn1429244] end connection 172.28.0.164:53218 (399 connections now open) 2015-10-05T07:47:07.305+0100 [mongosMain] connection accepted from 172.28.0.164:54335 #1429619 (400 connections now open) 2015-10-05T07:47:07.306+0100 [conn1429619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:13.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cf15703b51053ed3b6c 2015-10-05T07:47:13.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:14.043+0100 [conn1429172] end connection 172.28.0.163:59988 (399 connections now open) 2015-10-05T07:47:14.043+0100 [conn1429207] end connection 172.28.0.163:60095 (399 connections now open) 2015-10-05T07:47:14.044+0100 [mongosMain] connection accepted from 172.28.0.163:61320 #1429620 (399 connections now open) 2015-10-05T07:47:14.045+0100 [mongosMain] connection accepted from 172.28.0.163:61321 #1429621 (400 connections now open) 2015-10-05T07:47:14.045+0100 [conn1429620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:14.046+0100 [conn1429621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:14.307+0100 [conn1429217] end connection 172.28.0.164:53149 (399 connections now open) 2015-10-05T07:47:14.307+0100 [conn1429182] end connection 172.28.0.164:53054 (398 connections now open) 2015-10-05T07:47:14.308+0100 [mongosMain] connection accepted from 172.28.0.164:54342 #1429622 (399 connections now open) 2015-10-05T07:47:14.309+0100 [mongosMain] connection accepted from 172.28.0.164:54343 #1429623 (400 connections now open) 2015-10-05T07:47:14.311+0100 [conn1429622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:14.311+0100 [conn1429623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:15.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:15.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:15.525+0100 [conn1429218] end connection 172.28.0.163:60118 (399 connections now open) 2015-10-05T07:47:15.526+0100 [mongosMain] connection accepted from 172.28.0.163:61327 #1429624 (400 connections now open) 2015-10-05T07:47:15.527+0100 [conn1429624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:15.886+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:47:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:47:15.983+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:16.102+0100 [conn1429242] end connection 172.28.0.163:60170 (399 connections now open) 2015-10-05T07:47:16.103+0100 [mongosMain] connection accepted from 172.28.0.163:61330 #1429625 (400 connections now open) 2015-10-05T07:47:16.104+0100 [conn1429625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:16.616+0100 [conn1429163] end connection 172.28.0.164:53009 (399 connections now open) 2015-10-05T07:47:16.617+0100 [mongosMain] connection accepted from 172.28.0.164:54346 #1429626 (400 connections now open) 2015-10-05T07:47:16.619+0100 [conn1429626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:17.319+0100 [conn1429251] end connection 172.28.0.164:53234 (399 connections now open) 2015-10-05T07:47:17.320+0100 [mongosMain] connection accepted from 172.28.0.164:54349 #1429627 (400 connections now open) 2015-10-05T07:47:17.323+0100 [conn1429627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:19.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cf75703b51053ed3bcf 2015-10-05T07:47:20.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:24.059+0100 [conn1429180] end connection 172.28.0.163:60004 (399 connections now open) 2015-10-05T07:47:24.059+0100 [conn1429245] end connection 172.28.0.163:60182 (399 connections now open) 2015-10-05T07:47:24.060+0100 [mongosMain] connection accepted from 172.28.0.163:61336 #1429628 (399 connections now open) 2015-10-05T07:47:24.060+0100 [mongosMain] connection accepted from 172.28.0.163:61337 #1429629 (400 connections now open) 2015-10-05T07:47:24.061+0100 [conn1429628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:24.062+0100 [conn1429629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:24.322+0100 [conn1429012] end connection 172.28.0.164:52530 (399 connections now open) 2015-10-05T07:47:24.322+0100 [conn1429196] end connection 172.28.0.164:53092 (398 connections now open) 2015-10-05T07:47:24.323+0100 [mongosMain] connection accepted from 172.28.0.164:54363 #1429630 (399 connections now open) 2015-10-05T07:47:24.324+0100 [mongosMain] connection accepted from 172.28.0.164:54364 #1429631 (400 connections now open) 2015-10-05T07:47:24.325+0100 [conn1429630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:24.325+0100 [conn1429631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:25.541+0100 [conn1429070] end connection 172.28.0.163:59590 (399 connections now open) 2015-10-05T07:47:25.542+0100 [mongosMain] connection accepted from 172.28.0.163:61341 #1429632 (400 connections now open) 2015-10-05T07:47:25.543+0100 [conn1429632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:26.103+0100 [conn1429257] end connection 172.28.0.163:60213 (399 connections now open) 2015-10-05T07:47:26.104+0100 [mongosMain] connection accepted from 172.28.0.163:61344 #1429633 (400 connections now open) 2015-10-05T07:47:26.105+0100 [conn1429633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:26.404+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121cfe5703b51053ed3c20 2015-10-05T07:47:26.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:26.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:26.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:26.614+0100 [conn1429156] end connection 172.28.0.164:52987 (399 connections now open) 2015-10-05T07:47:26.615+0100 [mongosMain] connection accepted from 172.28.0.164:54368 #1429634 (400 connections now open) 2015-10-05T07:47:26.617+0100 [conn1429634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:26.987+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:27.317+0100 [conn1429259] end connection 172.28.0.164:53247 (399 connections now open) 2015-10-05T07:47:27.318+0100 [mongosMain] connection accepted from 172.28.0.164:54371 #1429635 (400 connections now open) 2015-10-05T07:47:27.320+0100 [conn1429635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:28.253+0100 [mongosMain] connection accepted from 127.0.0.1:61346 #1429636 (401 connections now open) 2015-10-05T07:47:28.256+0100 [conn1429636] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:28.260+0100 [conn1429636] end connection 127.0.0.1:61346 (400 connections now open) 2015-10-05T07:47:32.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d045703b51053ed3c8d 2015-10-05T07:47:32.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:34.065+0100 [conn1429201] end connection 172.28.0.163:60073 (399 connections now open) 2015-10-05T07:47:34.065+0100 [conn1429231] end connection 172.28.0.163:60139 (399 connections now open) 2015-10-05T07:47:34.066+0100 [mongosMain] connection accepted from 172.28.0.163:61349 #1429637 (399 connections now open) 2015-10-05T07:47:34.066+0100 [mongosMain] connection accepted from 172.28.0.163:61350 #1429638 (400 connections now open) 2015-10-05T07:47:34.067+0100 [conn1429637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:34.067+0100 [conn1429638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:34.338+0100 [conn1429240] end connection 172.28.0.164:53211 (399 connections now open) 2015-10-05T07:47:34.338+0100 [conn1429161] end connection 172.28.0.164:53004 (398 connections now open) 2015-10-05T07:47:34.339+0100 [mongosMain] connection accepted from 172.28.0.164:54386 #1429639 (399 connections now open) 2015-10-05T07:47:34.339+0100 [mongosMain] connection accepted from 172.28.0.164:54387 #1429640 (400 connections now open) 2015-10-05T07:47:34.341+0100 [conn1429639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:34.341+0100 [conn1429640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:35.541+0100 [conn1429234] end connection 172.28.0.163:60146 (399 connections now open) 2015-10-05T07:47:35.542+0100 [mongosMain] connection accepted from 172.28.0.163:61356 #1429641 (400 connections now open) 2015-10-05T07:47:35.543+0100 [conn1429641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:36.615+0100 [conn1429236] end connection 172.28.0.164:53197 (399 connections now open) 2015-10-05T07:47:36.617+0100 [mongosMain] connection accepted from 172.28.0.164:54391 #1429642 (400 connections now open) 2015-10-05T07:47:36.632+0100 [conn1429642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:37.317+0100 [conn1429267] end connection 172.28.0.164:53272 (399 connections now open) 2015-10-05T07:47:37.319+0100 [mongosMain] connection accepted from 172.28.0.164:54396 #1429643 (400 connections now open) 2015-10-05T07:47:37.321+0100 [conn1429643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:38.018+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:38.446+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:38.446+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:39.179+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d0a5703b51053ed3cda 2015-10-05T07:47:39.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:40.209+0100 [mongosMain] connection accepted from 127.0.0.1:61365 #1429644 (401 connections now open) 2015-10-05T07:47:40.212+0100 [conn1429644] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:40.217+0100 [conn1429644] end connection 127.0.0.1:61365 (400 connections now open) 2015-10-05T07:47:40.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:40.448+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:43.536+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:43.537+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:44.074+0100 [conn1429165] end connection 172.28.0.163:59972 (399 connections now open) 2015-10-05T07:47:44.074+0100 [conn1429222] end connection 172.28.0.163:60123 (399 connections now open) 2015-10-05T07:47:44.075+0100 [mongosMain] connection accepted from 172.28.0.163:61371 #1429645 (399 connections now open) 2015-10-05T07:47:44.075+0100 [mongosMain] connection accepted from 172.28.0.163:61372 #1429646 (400 connections now open) 2015-10-05T07:47:44.076+0100 [conn1429645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:44.076+0100 [conn1429646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:44.353+0100 [conn1429190] end connection 172.28.0.164:53073 (399 connections now open) 2015-10-05T07:47:44.354+0100 [mongosMain] connection accepted from 172.28.0.164:54406 #1429647 (400 connections now open) 2015-10-05T07:47:44.355+0100 [conn1429233] end connection 172.28.0.164:53191 (399 connections now open) 2015-10-05T07:47:44.355+0100 [mongosMain] connection accepted from 172.28.0.164:54407 #1429648 (400 connections now open) 2015-10-05T07:47:44.356+0100 [conn1429647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:44.357+0100 [conn1429648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:45.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d115703b51053ed3d30 2015-10-05T07:47:45.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:46.044+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:47:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:47:46.630+0100 [conn1429016] end connection 172.28.0.164:52535 (399 connections now open) 2015-10-05T07:47:46.631+0100 [mongosMain] connection accepted from 172.28.0.164:54412 #1429649 (400 connections now open) 2015-10-05T07:47:46.634+0100 [conn1429649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:47.333+0100 [conn1429275] end connection 172.28.0.164:53296 (399 connections now open) 2015-10-05T07:47:47.336+0100 [mongosMain] connection accepted from 172.28.0.164:54415 #1429650 (400 connections now open) 2015-10-05T07:47:47.337+0100 [conn1429650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:47.631+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:47.631+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:49.021+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:52.274+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d175703b51053ed3de0 2015-10-05T07:47:52.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:52.634+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:52.634+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:47:54.075+0100 [conn1429230] end connection 172.28.0.163:60138 (399 connections now open) 2015-10-05T07:47:54.075+0100 [conn1429239] end connection 172.28.0.163:60159 (399 connections now open) 2015-10-05T07:47:54.077+0100 [mongosMain] connection accepted from 172.28.0.163:61392 #1429651 (399 connections now open) 2015-10-05T07:47:54.077+0100 [mongosMain] connection accepted from 172.28.0.163:61393 #1429652 (400 connections now open) 2015-10-05T07:47:54.078+0100 [conn1429651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:54.078+0100 [conn1429652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:54.369+0100 [conn1429225] end connection 172.28.0.164:53169 (399 connections now open) 2015-10-05T07:47:54.369+0100 [conn1428900] end connection 172.28.0.164:52118 (399 connections now open) 2015-10-05T07:47:54.377+0100 [mongosMain] connection accepted from 172.28.0.164:54431 #1429653 (399 connections now open) 2015-10-05T07:47:54.377+0100 [mongosMain] connection accepted from 172.28.0.164:54432 #1429654 (400 connections now open) 2015-10-05T07:47:54.378+0100 [conn1429653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:54.378+0100 [conn1429654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:56.134+0100 [conn1429265] end connection 172.28.0.163:60228 (399 connections now open) 2015-10-05T07:47:56.135+0100 [mongosMain] connection accepted from 172.28.0.163:61396 #1429655 (400 connections now open) 2015-10-05T07:47:56.136+0100 [conn1429655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:56.633+0100 [conn1429243] end connection 172.28.0.164:53216 (399 connections now open) 2015-10-05T07:47:56.634+0100 [mongosMain] connection accepted from 172.28.0.164:54436 #1429656 (400 connections now open) 2015-10-05T07:47:56.636+0100 [conn1429656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:57.333+0100 [conn1429282] end connection 172.28.0.164:53319 (399 connections now open) 2015-10-05T07:47:57.334+0100 [mongosMain] connection accepted from 172.28.0.164:54437 #1429657 (400 connections now open) 2015-10-05T07:47:57.335+0100 [conn1429657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:47:58.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d1e5703b51053ed3e1f 2015-10-05T07:47:58.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:47:58.655+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:47:58.655+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:00.028+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:04.090+0100 [conn1429200] end connection 172.28.0.163:60072 (399 connections now open) 2015-10-05T07:48:04.090+0100 [conn1429223] end connection 172.28.0.163:60124 (398 connections now open) 2015-10-05T07:48:04.091+0100 [mongosMain] connection accepted from 172.28.0.163:61418 #1429658 (399 connections now open) 2015-10-05T07:48:04.091+0100 [mongosMain] connection accepted from 172.28.0.163:61419 #1429659 (400 connections now open) 2015-10-05T07:48:04.092+0100 [conn1429658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:04.092+0100 [conn1429659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:04.385+0100 [conn1429247] end connection 172.28.0.164:53228 (399 connections now open) 2015-10-05T07:48:04.385+0100 [conn1429279] end connection 172.28.0.164:53308 (399 connections now open) 2015-10-05T07:48:04.386+0100 [mongosMain] connection accepted from 172.28.0.164:54454 #1429660 (399 connections now open) 2015-10-05T07:48:04.386+0100 [mongosMain] connection accepted from 172.28.0.164:54455 #1429661 (400 connections now open) 2015-10-05T07:48:04.388+0100 [conn1429661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:04.388+0100 [conn1429660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:04.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d245703b51053ed3e86 2015-10-05T07:48:04.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:48:05.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:05.658+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:06.134+0100 [conn1429287] end connection 172.28.0.163:60279 (399 connections now open) 2015-10-05T07:48:06.135+0100 [mongosMain] connection accepted from 172.28.0.163:61425 #1429662 (400 connections now open) 2015-10-05T07:48:06.136+0100 [conn1429662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:06.647+0100 [conn1429250] end connection 172.28.0.164:53232 (399 connections now open) 2015-10-05T07:48:06.648+0100 [mongosMain] connection accepted from 172.28.0.164:54458 #1429663 (400 connections now open) 2015-10-05T07:48:06.650+0100 [conn1429663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:07.348+0100 [conn1429289] end connection 172.28.0.164:53335 (399 connections now open) 2015-10-05T07:48:07.350+0100 [mongosMain] connection accepted from 172.28.0.164:54460 #1429664 (400 connections now open) 2015-10-05T07:48:07.351+0100 [conn1429664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:11.032+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:11.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d2a5703b51053ed3ed3 2015-10-05T07:48:11.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:48:13.687+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:13.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:14.092+0100 [conn1429210] end connection 172.28.0.163:60098 (399 connections now open) 2015-10-05T07:48:14.092+0100 [conn1429253] end connection 172.28.0.163:60204 (399 connections now open) 2015-10-05T07:48:14.093+0100 [mongosMain] connection accepted from 172.28.0.163:61434 #1429665 (399 connections now open) 2015-10-05T07:48:14.094+0100 [mongosMain] connection accepted from 172.28.0.163:61435 #1429666 (400 connections now open) 2015-10-05T07:48:14.094+0100 [conn1429665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:14.094+0100 [conn1429666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:14.401+0100 [conn1429216] end connection 172.28.0.164:53148 (399 connections now open) 2015-10-05T07:48:14.401+0100 [conn1429272] end connection 172.28.0.164:53283 (398 connections now open) 2015-10-05T07:48:14.401+0100 [mongosMain] connection accepted from 172.28.0.164:54469 #1429667 (400 connections now open) 2015-10-05T07:48:14.403+0100 [mongosMain] connection accepted from 172.28.0.164:54470 #1429668 (400 connections now open) 2015-10-05T07:48:14.404+0100 [conn1429667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:14.405+0100 [conn1429668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:15.572+0100 [conn1429249] end connection 172.28.0.163:60189 (399 connections now open) 2015-10-05T07:48:15.574+0100 [mongosMain] connection accepted from 172.28.0.163:61440 #1429669 (400 connections now open) 2015-10-05T07:48:15.575+0100 [conn1429669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:16.148+0100 [conn1429294] end connection 172.28.0.163:60311 (399 connections now open) 2015-10-05T07:48:16.149+0100 [mongosMain] connection accepted from 172.28.0.163:61442 #1429670 (400 connections now open) 2015-10-05T07:48:16.150+0100 [conn1429670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:16.332+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:48:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:48:16.662+0100 [conn1429274] end connection 172.28.0.164:53292 (399 connections now open) 2015-10-05T07:48:16.664+0100 [mongosMain] connection accepted from 172.28.0.164:54474 #1429671 (400 connections now open) 2015-10-05T07:48:16.665+0100 [conn1429671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:17.364+0100 [conn1429296] end connection 172.28.0.164:53350 (399 connections now open) 2015-10-05T07:48:17.365+0100 [mongosMain] connection accepted from 172.28.0.164:54476 #1429672 (400 connections now open) 2015-10-05T07:48:17.368+0100 [conn1429672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:22.128+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:22.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:22.689+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:24.106+0100 [conn1429261] end connection 172.28.0.163:60223 (399 connections now open) 2015-10-05T07:48:24.108+0100 [mongosMain] connection accepted from 172.28.0.163:61448 #1429673 (400 connections now open) 2015-10-05T07:48:24.109+0100 [conn1429673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:24.416+0100 [conn1429232] end connection 172.28.0.164:53190 (399 connections now open) 2015-10-05T07:48:24.419+0100 [mongosMain] connection accepted from 172.28.0.164:54489 #1429674 (400 connections now open) 2015-10-05T07:48:24.423+0100 [conn1429674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:25.588+0100 [conn1429256] end connection 172.28.0.163:60209 (399 connections now open) 2015-10-05T07:48:25.589+0100 [mongosMain] connection accepted from 172.28.0.163:61450 #1429675 (400 connections now open) 2015-10-05T07:48:25.590+0100 [conn1429675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:26.165+0100 [conn1429301] end connection 172.28.0.163:60326 (399 connections now open) 2015-10-05T07:48:26.166+0100 [mongosMain] connection accepted from 172.28.0.163:61452 #1429676 (400 connections now open) 2015-10-05T07:48:26.167+0100 [conn1429676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:27.364+0100 [conn1429303] end connection 172.28.0.164:53362 (399 connections now open) 2015-10-05T07:48:27.365+0100 [mongosMain] connection accepted from 172.28.0.164:54495 #1429677 (400 connections now open) 2015-10-05T07:48:27.366+0100 [conn1429677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:29.118+0100 [mongosMain] connection accepted from 127.0.0.1:61454 #1429678 (401 connections now open) 2015-10-05T07:48:29.121+0100 [conn1429678] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:29.125+0100 [conn1429678] end connection 127.0.0.1:61454 (400 connections now open) 2015-10-05T07:48:32.693+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:32.693+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:33.246+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:34.108+0100 [conn1429215] end connection 172.28.0.163:60113 (399 connections now open) 2015-10-05T07:48:34.109+0100 [mongosMain] connection accepted from 172.28.0.163:61461 #1429679 (400 connections now open) 2015-10-05T07:48:34.109+0100 [conn1429679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:34.434+0100 [conn1429284] end connection 172.28.0.164:53328 (399 connections now open) 2015-10-05T07:48:34.434+0100 [mongosMain] connection accepted from 172.28.0.164:54508 #1429680 (400 connections now open) 2015-10-05T07:48:34.436+0100 [conn1429680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:35.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d435703b51053ed4001 2015-10-05T07:48:35.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:48:35.589+0100 [conn1429273] end connection 172.28.0.163:60243 (399 connections now open) 2015-10-05T07:48:35.590+0100 [mongosMain] connection accepted from 172.28.0.163:61464 #1429681 (400 connections now open) 2015-10-05T07:48:35.591+0100 [conn1429681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:36.166+0100 [conn1429308] end connection 172.28.0.163:60339 (399 connections now open) 2015-10-05T07:48:36.167+0100 [mongosMain] connection accepted from 172.28.0.163:61467 #1429682 (400 connections now open) 2015-10-05T07:48:36.168+0100 [conn1429682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:37.380+0100 [conn1429310] end connection 172.28.0.164:53390 (399 connections now open) 2015-10-05T07:48:37.381+0100 [mongosMain] connection accepted from 172.28.0.164:54514 #1429683 (400 connections now open) 2015-10-05T07:48:37.383+0100 [conn1429683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:39.817+0100 [mongosMain] connection accepted from 127.0.0.1:61469 #1429684 (401 connections now open) 2015-10-05T07:48:39.820+0100 [conn1429684] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:39.824+0100 [conn1429684] end connection 127.0.0.1:61469 (400 connections now open) 2015-10-05T07:48:43.696+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:43.696+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:44.122+0100 [conn1429270] end connection 172.28.0.163:60236 (399 connections now open) 2015-10-05T07:48:44.123+0100 [mongosMain] connection accepted from 172.28.0.163:61479 #1429685 (400 connections now open) 2015-10-05T07:48:44.123+0100 [conn1429685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:44.275+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:44.448+0100 [conn1429278] end connection 172.28.0.164:53307 (399 connections now open) 2015-10-05T07:48:44.450+0100 [mongosMain] connection accepted from 172.28.0.164:54531 #1429686 (400 connections now open) 2015-10-05T07:48:44.451+0100 [conn1429686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:45.604+0100 [conn1429241] end connection 172.28.0.163:60166 (399 connections now open) 2015-10-05T07:48:45.605+0100 [mongosMain] connection accepted from 172.28.0.163:61483 #1429687 (400 connections now open) 2015-10-05T07:48:45.607+0100 [conn1429687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:46.181+0100 [conn1429316] end connection 172.28.0.163:60351 (399 connections now open) 2015-10-05T07:48:46.183+0100 [mongosMain] connection accepted from 172.28.0.163:61485 #1429688 (400 connections now open) 2015-10-05T07:48:46.184+0100 [conn1429688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:46.587+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:48:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:48:47.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d4f5703b51053ed40e9 2015-10-05T07:48:47.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:48:53.930+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:48:53.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:48:54.139+0100 [conn1429277] end connection 172.28.0.163:60254 (399 connections now open) 2015-10-05T07:48:54.140+0100 [mongosMain] connection accepted from 172.28.0.163:61496 #1429689 (400 connections now open) 2015-10-05T07:48:54.142+0100 [conn1429689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:54.447+0100 [conn1429254] end connection 172.28.0.164:53239 (399 connections now open) 2015-10-05T07:48:54.449+0100 [mongosMain] connection accepted from 172.28.0.164:54545 #1429690 (400 connections now open) 2015-10-05T07:48:54.450+0100 [conn1429690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:55.336+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:55.619+0100 [conn1429293] end connection 172.28.0.163:60309 (399 connections now open) 2015-10-05T07:48:55.619+0100 [mongosMain] connection accepted from 172.28.0.163:61501 #1429691 (400 connections now open) 2015-10-05T07:48:55.622+0100 [conn1429691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:55.692+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:55.692+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:48:56.181+0100 [conn1429323] end connection 172.28.0.163:60369 (399 connections now open) 2015-10-05T07:48:56.182+0100 [mongosMain] connection accepted from 172.28.0.163:61504 #1429692 (400 connections now open) 2015-10-05T07:48:56.184+0100 [conn1429692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:56.693+0100 [conn1429324] end connection 172.28.0.164:53431 (399 connections now open) 2015-10-05T07:48:56.694+0100 [mongosMain] connection accepted from 172.28.0.164:54547 #1429693 (400 connections now open) 2015-10-05T07:48:56.696+0100 [conn1429693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:48:57.697+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:48:57.697+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:00.077+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d5b5703b51053ed418f 2015-10-05T07:49:00.144+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:00.702+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:00.703+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:04.141+0100 [conn1429297] end connection 172.28.0.163:60316 (399 connections now open) 2015-10-05T07:49:04.142+0100 [mongosMain] connection accepted from 172.28.0.163:61528 #1429694 (400 connections now open) 2015-10-05T07:49:04.143+0100 [conn1429694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:04.463+0100 [conn1429285] end connection 172.28.0.164:53329 (399 connections now open) 2015-10-05T07:49:04.463+0100 [conn1429262] end connection 172.28.0.164:53261 (398 connections now open) 2015-10-05T07:49:04.464+0100 [mongosMain] connection accepted from 172.28.0.164:54565 #1429695 (399 connections now open) 2015-10-05T07:49:04.464+0100 [mongosMain] connection accepted from 172.28.0.164:54566 #1429696 (400 connections now open) 2015-10-05T07:49:04.465+0100 [conn1429695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:04.465+0100 [conn1429696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:04.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:04.708+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:05.620+0100 [conn1429315] end connection 172.28.0.163:60349 (399 connections now open) 2015-10-05T07:49:05.621+0100 [mongosMain] connection accepted from 172.28.0.163:61535 #1429697 (400 connections now open) 2015-10-05T07:49:05.622+0100 [conn1429697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:06.197+0100 [conn1429326] end connection 172.28.0.163:60391 (399 connections now open) 2015-10-05T07:49:06.198+0100 [mongosMain] connection accepted from 172.28.0.163:61538 #1429698 (400 connections now open) 2015-10-05T07:49:06.199+0100 [conn1429698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:06.350+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:06.710+0100 [conn1429258] end connection 172.28.0.164:53245 (399 connections now open) 2015-10-05T07:49:06.711+0100 [mongosMain] connection accepted from 172.28.0.164:54569 #1429699 (400 connections now open) 2015-10-05T07:49:06.713+0100 [conn1429699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:09.776+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:09.776+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:12.441+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d685703b51053ed4241 2015-10-05T07:49:12.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:14.153+0100 [conn1429304] end connection 172.28.0.163:60331 (399 connections now open) 2015-10-05T07:49:14.155+0100 [mongosMain] connection accepted from 172.28.0.163:61546 #1429700 (400 connections now open) 2015-10-05T07:49:14.156+0100 [conn1429700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:14.479+0100 [conn1429291] end connection 172.28.0.164:53345 (399 connections now open) 2015-10-05T07:49:14.482+0100 [mongosMain] connection accepted from 172.28.0.164:54576 #1429701 (400 connections now open) 2015-10-05T07:49:14.484+0100 [conn1429701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:15.635+0100 [conn1429300] end connection 172.28.0.163:60325 (399 connections now open) 2015-10-05T07:49:15.636+0100 [mongosMain] connection accepted from 172.28.0.163:61552 #1429702 (400 connections now open) 2015-10-05T07:49:15.637+0100 [conn1429702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:15.796+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:15.796+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:16.712+0100 [conn1429302] end connection 172.28.0.164:53360 (399 connections now open) 2015-10-05T07:49:16.713+0100 [mongosMain] connection accepted from 172.28.0.164:54579 #1429703 (400 connections now open) 2015-10-05T07:49:16.716+0100 [conn1429703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:16.745+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:49:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:49:17.390+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:17.411+0100 [conn1429318] end connection 172.28.0.164:53412 (399 connections now open) 2015-10-05T07:49:17.412+0100 [mongosMain] connection accepted from 172.28.0.164:54582 #1429704 (400 connections now open) 2015-10-05T07:49:17.417+0100 [conn1429704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:18.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d6e5703b51053ed429f 2015-10-05T07:49:18.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:22.797+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:22.797+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:24.155+0100 [conn1429290] end connection 172.28.0.163:60301 (399 connections now open) 2015-10-05T07:49:24.156+0100 [mongosMain] connection accepted from 172.28.0.163:61562 #1429705 (400 connections now open) 2015-10-05T07:49:24.157+0100 [conn1429705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:25.636+0100 [conn1429264] end connection 172.28.0.163:60227 (399 connections now open) 2015-10-05T07:49:25.638+0100 [mongosMain] connection accepted from 172.28.0.163:61564 #1429706 (400 connections now open) 2015-10-05T07:49:25.639+0100 [conn1429706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:26.726+0100 [conn1429317] end connection 172.28.0.164:53407 (399 connections now open) 2015-10-05T07:49:26.727+0100 [mongosMain] connection accepted from 172.28.0.164:54601 #1429707 (400 connections now open) 2015-10-05T07:49:26.729+0100 [conn1429707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:28.401+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:28.516+0100 [mongosMain] connection accepted from 127.0.0.1:61568 #1429708 (401 connections now open) 2015-10-05T07:49:28.518+0100 [conn1429708] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:28.523+0100 [conn1429708] end connection 127.0.0.1:61568 (400 connections now open) 2015-10-05T07:49:30.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:30.792+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:32.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d7b5703b51053ed4340 2015-10-05T07:49:32.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:34.169+0100 [conn1429312] end connection 172.28.0.163:60345 (399 connections now open) 2015-10-05T07:49:34.169+0100 [conn1429139] end connection 172.28.0.163:59799 (399 connections now open) 2015-10-05T07:49:34.170+0100 [mongosMain] connection accepted from 172.28.0.163:61572 #1429709 (399 connections now open) 2015-10-05T07:49:34.170+0100 [mongosMain] connection accepted from 172.28.0.163:61573 #1429710 (400 connections now open) 2015-10-05T07:49:34.172+0100 [conn1429709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:34.172+0100 [conn1429710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:34.510+0100 [conn1429313] end connection 172.28.0.164:53400 (399 connections now open) 2015-10-05T07:49:34.511+0100 [mongosMain] connection accepted from 172.28.0.164:54616 #1429711 (400 connections now open) 2015-10-05T07:49:34.513+0100 [conn1429711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:35.651+0100 [conn1429280] end connection 172.28.0.163:60259 (399 connections now open) 2015-10-05T07:49:35.652+0100 [mongosMain] connection accepted from 172.28.0.163:61575 #1429712 (400 connections now open) 2015-10-05T07:49:35.661+0100 [conn1429712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:36.725+0100 [conn1429281] end connection 172.28.0.164:53316 (399 connections now open) 2015-10-05T07:49:36.726+0100 [mongosMain] connection accepted from 172.28.0.164:54620 #1429713 (400 connections now open) 2015-10-05T07:49:36.728+0100 [conn1429713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:38.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d825703b51053ed4386 2015-10-05T07:49:38.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:39.411+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:39.413+0100 [mongosMain] connection accepted from 127.0.0.1:61581 #1429714 (401 connections now open) 2015-10-05T07:49:39.416+0100 [conn1429714] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:39.420+0100 [conn1429714] end connection 127.0.0.1:61581 (400 connections now open) 2015-10-05T07:49:39.796+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:39.796+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:44.170+0100 [conn1429283] end connection 172.28.0.163:60270 (399 connections now open) 2015-10-05T07:49:44.172+0100 [mongosMain] connection accepted from 172.28.0.163:61587 #1429715 (400 connections now open) 2015-10-05T07:49:44.174+0100 [conn1429715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:44.525+0100 [conn1429255] end connection 172.28.0.164:53240 (399 connections now open) 2015-10-05T07:49:44.526+0100 [mongosMain] connection accepted from 172.28.0.164:54632 #1429716 (400 connections now open) 2015-10-05T07:49:44.528+0100 [conn1429716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:44.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d885703b51053ed43bf 2015-10-05T07:49:44.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:45.652+0100 [conn1429286] end connection 172.28.0.163:60277 (399 connections now open) 2015-10-05T07:49:45.653+0100 [mongosMain] connection accepted from 172.28.0.163:61593 #1429717 (400 connections now open) 2015-10-05T07:49:45.654+0100 [conn1429717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:46.742+0100 [conn1429295] end connection 172.28.0.164:53348 (399 connections now open) 2015-10-05T07:49:46.743+0100 [mongosMain] connection accepted from 172.28.0.164:54637 #1429718 (400 connections now open) 2015-10-05T07:49:46.745+0100 [conn1429718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:47.008+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:49:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:49:49.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:49.801+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:49:50.425+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:49:51.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d8e5703b51053ed4406 2015-10-05T07:49:51.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:49:54.543+0100 [conn1429298] end connection 172.28.0.164:53355 (399 connections now open) 2015-10-05T07:49:54.544+0100 [mongosMain] connection accepted from 172.28.0.164:54647 #1429719 (400 connections now open) 2015-10-05T07:49:54.546+0100 [conn1429719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:55.667+0100 [conn1429325] end connection 172.28.0.163:60389 (399 connections now open) 2015-10-05T07:49:55.672+0100 [mongosMain] connection accepted from 172.28.0.163:61610 #1429720 (400 connections now open) 2015-10-05T07:49:55.673+0100 [conn1429720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:56.742+0100 [conn1429288] end connection 172.28.0.164:53334 (399 connections now open) 2015-10-05T07:49:56.743+0100 [mongosMain] connection accepted from 172.28.0.164:54651 #1429721 (400 connections now open) 2015-10-05T07:49:56.744+0100 [conn1429721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:49:57.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121d955703b51053ed4430 2015-10-05T07:49:57.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:00.808+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:00.808+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:01.498+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:04.185+0100 [conn1429343] end connection 172.28.0.163:60469 (399 connections now open) 2015-10-05T07:50:04.186+0100 [conn1429238] end connection 172.28.0.163:60158 (399 connections now open) 2015-10-05T07:50:04.187+0100 [mongosMain] connection accepted from 172.28.0.163:61633 #1429722 (399 connections now open) 2015-10-05T07:50:04.187+0100 [mongosMain] connection accepted from 172.28.0.163:61634 #1429723 (400 connections now open) 2015-10-05T07:50:04.188+0100 [conn1429722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:04.188+0100 [conn1429723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:04.542+0100 [conn1429209] end connection 172.28.0.164:53130 (399 connections now open) 2015-10-05T07:50:04.543+0100 [mongosMain] connection accepted from 172.28.0.164:54667 #1429724 (400 connections now open) 2015-10-05T07:50:04.545+0100 [conn1429724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:05.677+0100 [conn1429336] end connection 172.28.0.163:60447 (399 connections now open) 2015-10-05T07:50:05.679+0100 [mongosMain] connection accepted from 172.28.0.163:61639 #1429725 (400 connections now open) 2015-10-05T07:50:05.681+0100 [conn1429725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:06.757+0100 [conn1429309] end connection 172.28.0.164:53387 (399 connections now open) 2015-10-05T07:50:06.759+0100 [mongosMain] connection accepted from 172.28.0.164:54672 #1429726 (400 connections now open) 2015-10-05T07:50:06.760+0100 [conn1429726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:10.126+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121da15703b51053ed44ef 2015-10-05T07:50:10.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:12.511+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:12.805+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:12.805+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:14.206+0100 [conn1429347] end connection 172.28.0.163:60488 (399 connections now open) 2015-10-05T07:50:14.206+0100 [conn1429269] end connection 172.28.0.163:60235 (399 connections now open) 2015-10-05T07:50:14.214+0100 [mongosMain] connection accepted from 172.28.0.163:61654 #1429727 (399 connections now open) 2015-10-05T07:50:14.214+0100 [conn1429727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:14.215+0100 [mongosMain] connection accepted from 172.28.0.163:61655 #1429728 (400 connections now open) 2015-10-05T07:50:14.216+0100 [conn1429728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:14.810+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:14.810+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:14.814+0100 [conn1429167] end connection 172.28.0.164:53017 (399 connections now open) 2015-10-05T07:50:14.815+0100 [mongosMain] connection accepted from 172.28.0.164:54676 #1429729 (400 connections now open) 2015-10-05T07:50:14.817+0100 [conn1429729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:15.682+0100 [conn1429307] end connection 172.28.0.163:60335 (399 connections now open) 2015-10-05T07:50:15.683+0100 [mongosMain] connection accepted from 172.28.0.163:61657 #1429730 (400 connections now open) 2015-10-05T07:50:15.684+0100 [conn1429730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:16.260+0100 [conn1429329] end connection 172.28.0.163:60419 (399 connections now open) 2015-10-05T07:50:16.261+0100 [mongosMain] connection accepted from 172.28.0.163:61659 #1429731 (400 connections now open) 2015-10-05T07:50:16.262+0100 [conn1429731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:16.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121da85703b51053ed4539 2015-10-05T07:50:16.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:16.757+0100 [conn1429266] end connection 172.28.0.164:53267 (399 connections now open) 2015-10-05T07:50:16.759+0100 [mongosMain] connection accepted from 172.28.0.164:54680 #1429732 (400 connections now open) 2015-10-05T07:50:16.761+0100 [conn1429732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:17.165+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:50:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:50:17.823+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:17.823+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:21.870+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:21.870+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:22.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dae5703b51053ed4585 2015-10-05T07:50:22.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:23.535+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:24.228+0100 [conn1429260] end connection 172.28.0.163:60222 (399 connections now open) 2015-10-05T07:50:24.228+0100 [conn1429339] end connection 172.28.0.163:60457 (398 connections now open) 2015-10-05T07:50:24.229+0100 [mongosMain] connection accepted from 172.28.0.163:61666 #1429733 (399 connections now open) 2015-10-05T07:50:24.229+0100 [mongosMain] connection accepted from 172.28.0.163:61667 #1429734 (400 connections now open) 2015-10-05T07:50:24.230+0100 [conn1429733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:24.230+0100 [conn1429734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:24.813+0100 [conn1429352] end connection 172.28.0.164:53557 (399 connections now open) 2015-10-05T07:50:24.814+0100 [mongosMain] connection accepted from 172.28.0.164:54695 #1429735 (400 connections now open) 2015-10-05T07:50:24.816+0100 [conn1429735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:25.699+0100 [conn1429331] end connection 172.28.0.163:60431 (399 connections now open) 2015-10-05T07:50:25.700+0100 [mongosMain] connection accepted from 172.28.0.163:61670 #1429736 (400 connections now open) 2015-10-05T07:50:25.700+0100 [conn1429736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:26.264+0100 [conn1429332] end connection 172.28.0.163:60434 (399 connections now open) 2015-10-05T07:50:26.265+0100 [mongosMain] connection accepted from 172.28.0.163:61672 #1429737 (400 connections now open) 2015-10-05T07:50:26.266+0100 [conn1429737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:26.773+0100 [conn1429327] end connection 172.28.0.164:53448 (399 connections now open) 2015-10-05T07:50:26.774+0100 [mongosMain] connection accepted from 172.28.0.164:54699 #1429738 (400 connections now open) 2015-10-05T07:50:26.776+0100 [conn1429738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:26.963+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:26.963+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:28.457+0100 [mongosMain] connection accepted from 127.0.0.1:61673 #1429739 (401 connections now open) 2015-10-05T07:50:28.459+0100 [conn1429739] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:28.465+0100 [conn1429739] end connection 127.0.0.1:61673 (400 connections now open) 2015-10-05T07:50:29.154+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121db45703b51053ed45e5 2015-10-05T07:50:29.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:32.974+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:32.975+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:34.217+0100 [conn1429350] end connection 172.28.0.163:60520 (399 connections now open) 2015-10-05T07:50:34.217+0100 [conn1429189] end connection 172.28.0.163:60021 (399 connections now open) 2015-10-05T07:50:34.218+0100 [mongosMain] connection accepted from 172.28.0.163:61683 #1429740 (399 connections now open) 2015-10-05T07:50:34.219+0100 [mongosMain] connection accepted from 172.28.0.163:61684 #1429741 (400 connections now open) 2015-10-05T07:50:34.219+0100 [conn1429740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:34.220+0100 [conn1429741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:34.633+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:35.031+0100 [conn1429021] end connection 172.28.0.164:52552 (399 connections now open) 2015-10-05T07:50:35.033+0100 [mongosMain] connection accepted from 172.28.0.164:54714 #1429742 (400 connections now open) 2015-10-05T07:50:35.034+0100 [conn1429742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:35.700+0100 [conn1429322] end connection 172.28.0.163:60366 (399 connections now open) 2015-10-05T07:50:35.701+0100 [mongosMain] connection accepted from 172.28.0.163:61687 #1429743 (400 connections now open) 2015-10-05T07:50:35.703+0100 [conn1429743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:36.276+0100 [conn1429363] end connection 172.28.0.163:60560 (399 connections now open) 2015-10-05T07:50:36.277+0100 [mongosMain] connection accepted from 172.28.0.163:61697 #1429744 (400 connections now open) 2015-10-05T07:50:36.278+0100 [conn1429744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:36.789+0100 [conn1429337] end connection 172.28.0.164:53492 (399 connections now open) 2015-10-05T07:50:36.790+0100 [mongosMain] connection accepted from 172.28.0.164:54717 #1429745 (400 connections now open) 2015-10-05T07:50:36.791+0100 [conn1429745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:37.491+0100 [conn1429334] end connection 172.28.0.164:53478 (399 connections now open) 2015-10-05T07:50:37.492+0100 [mongosMain] connection accepted from 172.28.0.164:54722 #1429746 (400 connections now open) 2015-10-05T07:50:37.493+0100 [conn1429746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:39.589+0100 [mongosMain] connection accepted from 127.0.0.1:61704 #1429747 (401 connections now open) 2015-10-05T07:50:39.591+0100 [conn1429747] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:39.596+0100 [conn1429747] end connection 127.0.0.1:61704 (400 connections now open) 2015-10-05T07:50:39.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:39.981+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:41.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dc15703b51053ed4666 2015-10-05T07:50:41.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:44.941+0100 [conn1429344] end connection 172.28.0.163:60470 (399 connections now open) 2015-10-05T07:50:44.947+0100 [mongosMain] connection accepted from 172.28.0.163:61715 #1429748 (400 connections now open) 2015-10-05T07:50:44.948+0100 [conn1429748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:45.657+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:45.714+0100 [conn1429348] end connection 172.28.0.163:60495 (399 connections now open) 2015-10-05T07:50:45.715+0100 [mongosMain] connection accepted from 172.28.0.163:61720 #1429749 (400 connections now open) 2015-10-05T07:50:45.716+0100 [conn1429749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:46.276+0100 [conn1429368] end connection 172.28.0.163:60571 (399 connections now open) 2015-10-05T07:50:46.277+0100 [mongosMain] connection accepted from 172.28.0.163:61722 #1429750 (400 connections now open) 2015-10-05T07:50:46.278+0100 [conn1429750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:46.789+0100 [conn1429341] end connection 172.28.0.164:53508 (399 connections now open) 2015-10-05T07:50:46.789+0100 [mongosMain] connection accepted from 172.28.0.164:54736 #1429751 (400 connections now open) 2015-10-05T07:50:46.791+0100 [conn1429751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:47.324+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:50:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:50:47.490+0100 [conn1429369] end connection 172.28.0.164:53606 (399 connections now open) 2015-10-05T07:50:47.491+0100 [mongosMain] connection accepted from 172.28.0.164:54739 #1429752 (400 connections now open) 2015-10-05T07:50:47.493+0100 [conn1429752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:47.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:47.978+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:48.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dc85703b51053ed46fb 2015-10-05T07:50:48.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:54.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dce5703b51053ed476c 2015-10-05T07:50:54.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:50:55.714+0100 [conn1429340] end connection 172.28.0.163:60460 (399 connections now open) 2015-10-05T07:50:55.715+0100 [mongosMain] connection accepted from 172.28.0.163:61737 #1429753 (400 connections now open) 2015-10-05T07:50:55.717+0100 [conn1429753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:50:56.674+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:57.053+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:50:57.053+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:50:57.819+0100 [conn1429346] end connection 172.28.0.164:53525 (399 connections now open) 2015-10-05T07:50:57.821+0100 [mongosMain] connection accepted from 172.28.0.164:54750 #1429754 (400 connections now open) 2015-10-05T07:50:57.822+0100 [conn1429754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:00.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dd45703b51053ed47a0 2015-10-05T07:51:01.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:04.923+0100 [conn1429146] end connection 172.28.0.163:59821 (399 connections now open) 2015-10-05T07:51:04.924+0100 [mongosMain] connection accepted from 172.28.0.163:61767 #1429755 (400 connections now open) 2015-10-05T07:51:04.925+0100 [conn1429755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:05.730+0100 [conn1429367] end connection 172.28.0.163:60569 (399 connections now open) 2015-10-05T07:51:05.731+0100 [mongosMain] connection accepted from 172.28.0.163:61768 #1429756 (400 connections now open) 2015-10-05T07:51:05.733+0100 [conn1429756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:06.820+0100 [conn1429333] end connection 172.28.0.164:53477 (399 connections now open) 2015-10-05T07:51:06.822+0100 [mongosMain] connection accepted from 172.28.0.164:54767 #1429757 (400 connections now open) 2015-10-05T07:51:06.823+0100 [conn1429757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:07.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:07.064+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:07.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ddb5703b51053ed47d6 2015-10-05T07:51:07.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:07.521+0100 [conn1429376] end connection 172.28.0.164:53628 (399 connections now open) 2015-10-05T07:51:07.523+0100 [mongosMain] connection accepted from 172.28.0.164:54769 #1429758 (400 connections now open) 2015-10-05T07:51:07.533+0100 [conn1429758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:07.682+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:13.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121de15703b51053ed47fd 2015-10-05T07:51:13.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:14.934+0100 [conn1429252] end connection 172.28.0.163:60203 (399 connections now open) 2015-10-05T07:51:14.935+0100 [mongosMain] connection accepted from 172.28.0.163:61782 #1429759 (400 connections now open) 2015-10-05T07:51:14.936+0100 [conn1429759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:15.938+0100 [conn1429358] end connection 172.28.0.163:60545 (399 connections now open) 2015-10-05T07:51:15.939+0100 [mongosMain] connection accepted from 172.28.0.163:61785 #1429760 (400 connections now open) 2015-10-05T07:51:15.940+0100 [conn1429760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:16.307+0100 [conn1429374] end connection 172.28.0.163:60589 (399 connections now open) 2015-10-05T07:51:16.308+0100 [mongosMain] connection accepted from 172.28.0.163:61788 #1429761 (400 connections now open) 2015-10-05T07:51:16.309+0100 [conn1429761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:16.836+0100 [conn1429349] end connection 172.28.0.164:53539 (399 connections now open) 2015-10-05T07:51:16.837+0100 [mongosMain] connection accepted from 172.28.0.164:54778 #1429762 (400 connections now open) 2015-10-05T07:51:16.843+0100 [conn1429762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:17.522+0100 [conn1429387] end connection 172.28.0.164:53658 (399 connections now open) 2015-10-05T07:51:17.524+0100 [mongosMain] connection accepted from 172.28.0.164:54780 #1429763 (400 connections now open) 2015-10-05T07:51:17.525+0100 [conn1429763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:17.595+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:51:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:51:18.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:18.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:18.696+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:19.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121de75703b51053ed4864 2015-10-05T07:51:19.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:24.970+0100 [conn1429074] end connection 172.28.0.163:59606 (399 connections now open) 2015-10-05T07:51:24.970+0100 [mongosMain] connection accepted from 172.28.0.163:61798 #1429764 (400 connections now open) 2015-10-05T07:51:24.970+0100 [conn1429764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:25.781+0100 [conn1429345] end connection 172.28.0.163:60477 (399 connections now open) 2015-10-05T07:51:25.781+0100 [mongosMain] connection accepted from 172.28.0.163:61800 #1429765 (400 connections now open) 2015-10-05T07:51:25.781+0100 [conn1429765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:26.359+0100 [conn1429385] end connection 172.28.0.163:60632 (399 connections now open) 2015-10-05T07:51:26.359+0100 [mongosMain] connection accepted from 172.28.0.163:61802 #1429766 (400 connections now open) 2015-10-05T07:51:26.359+0100 [conn1429766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:26.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dee5703b51053ed48dc 2015-10-05T07:51:26.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:26.873+0100 [conn1429330] end connection 172.28.0.164:53469 (399 connections now open) 2015-10-05T07:51:26.873+0100 [mongosMain] connection accepted from 172.28.0.164:54795 #1429767 (400 connections now open) 2015-10-05T07:51:26.873+0100 [conn1429767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:27.538+0100 [conn1429380] end connection 172.28.0.164:53642 (399 connections now open) 2015-10-05T07:51:27.539+0100 [mongosMain] connection accepted from 172.28.0.164:54798 #1429768 (400 connections now open) 2015-10-05T07:51:27.541+0100 [conn1429768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:28.206+0100 [mongosMain] connection accepted from 127.0.0.1:61806 #1429769 (401 connections now open) 2015-10-05T07:51:28.208+0100 [conn1429769] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:28.213+0100 [conn1429769] end connection 127.0.0.1:61806 (400 connections now open) 2015-10-05T07:51:29.786+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:30.215+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:30.216+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:32.226+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:32.226+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:32.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121df45703b51053ed4958 2015-10-05T07:51:32.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:35.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:35.229+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:35.761+0100 [conn1429384] end connection 172.28.0.163:60630 (399 connections now open) 2015-10-05T07:51:35.762+0100 [mongosMain] connection accepted from 172.28.0.163:61813 #1429770 (400 connections now open) 2015-10-05T07:51:35.763+0100 [conn1429770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:36.324+0100 [conn1429390] end connection 172.28.0.163:60648 (399 connections now open) 2015-10-05T07:51:36.325+0100 [mongosMain] connection accepted from 172.28.0.163:61816 #1429771 (400 connections now open) 2015-10-05T07:51:36.326+0100 [conn1429771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:36.851+0100 [conn1429354] end connection 172.28.0.164:53559 (399 connections now open) 2015-10-05T07:51:36.852+0100 [mongosMain] connection accepted from 172.28.0.164:54816 #1429772 (400 connections now open) 2015-10-05T07:51:36.859+0100 [conn1429772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:37.538+0100 [conn1429392] end connection 172.28.0.164:53670 (399 connections now open) 2015-10-05T07:51:37.539+0100 [mongosMain] connection accepted from 172.28.0.164:54818 #1429773 (400 connections now open) 2015-10-05T07:51:37.541+0100 [conn1429773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:39.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121dfa5703b51053ed49b3 2015-10-05T07:51:39.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:39.298+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:39.298+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:39.676+0100 [mongosMain] connection accepted from 127.0.0.1:61820 #1429774 (401 connections now open) 2015-10-05T07:51:39.679+0100 [conn1429774] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:39.684+0100 [conn1429774] end connection 127.0.0.1:61820 (400 connections now open) 2015-10-05T07:51:40.799+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:44.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:44.408+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:45.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e015703b51053ed4a14 2015-10-05T07:51:45.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:45.762+0100 [conn1429328] end connection 172.28.0.163:60416 (399 connections now open) 2015-10-05T07:51:45.769+0100 [mongosMain] connection accepted from 172.28.0.163:61830 #1429775 (400 connections now open) 2015-10-05T07:51:45.770+0100 [conn1429775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:46.339+0100 [conn1429396] end connection 172.28.0.163:60661 (399 connections now open) 2015-10-05T07:51:46.340+0100 [mongosMain] connection accepted from 172.28.0.163:61832 #1429776 (400 connections now open) 2015-10-05T07:51:46.341+0100 [conn1429776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:47.553+0100 [conn1429398] end connection 172.28.0.164:53694 (399 connections now open) 2015-10-05T07:51:47.555+0100 [mongosMain] connection accepted from 172.28.0.164:54843 #1429777 (400 connections now open) 2015-10-05T07:51:47.556+0100 [conn1429777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:47.751+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:51:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:51:50.419+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:50.419+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:51.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e075703b51053ed4a54 2015-10-05T07:51:51.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:51:51.812+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:55.619+0100 [conn1429382] end connection 172.28.0.163:60626 (399 connections now open) 2015-10-05T07:51:55.623+0100 [mongosMain] connection accepted from 172.28.0.163:61849 #1429778 (400 connections now open) 2015-10-05T07:51:55.624+0100 [conn1429778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:55.645+0100 [conn1429411] end connection 172.28.0.164:53743 (399 connections now open) 2015-10-05T07:51:55.648+0100 [mongosMain] connection accepted from 172.28.0.164:54852 #1429779 (400 connections now open) 2015-10-05T07:51:55.648+0100 [conn1429263] end connection 172.28.0.164:53260 (399 connections now open) 2015-10-05T07:51:55.650+0100 [conn1429779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:55.651+0100 [mongosMain] connection accepted from 172.28.0.164:54853 #1429780 (400 connections now open) 2015-10-05T07:51:55.652+0100 [conn1429780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:55.777+0100 [conn1429353] end connection 172.28.0.163:60529 (399 connections now open) 2015-10-05T07:51:55.778+0100 [mongosMain] connection accepted from 172.28.0.163:61850 #1429781 (400 connections now open) 2015-10-05T07:51:55.779+0100 [conn1429781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:56.343+0100 [conn1429403] end connection 172.28.0.163:60671 (399 connections now open) 2015-10-05T07:51:56.345+0100 [mongosMain] connection accepted from 172.28.0.163:61851 #1429782 (400 connections now open) 2015-10-05T07:51:56.348+0100 [conn1429782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:57.454+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:51:57.454+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:51:57.554+0100 [conn1429404] end connection 172.28.0.164:53713 (399 connections now open) 2015-10-05T07:51:57.555+0100 [mongosMain] connection accepted from 172.28.0.164:54857 #1429783 (400 connections now open) 2015-10-05T07:51:57.557+0100 [conn1429783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:51:58.067+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e0d5703b51053ed4a97 2015-10-05T07:51:58.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:02.828+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:04.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e145703b51053ed4b4a 2015-10-05T07:52:04.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:05.450+0100 [conn1429246] end connection 172.28.0.163:60183 (399 connections now open) 2015-10-05T07:52:05.452+0100 [mongosMain] connection accepted from 172.28.0.163:61873 #1429784 (400 connections now open) 2015-10-05T07:52:05.453+0100 [conn1429784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:05.481+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:05.482+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:05.651+0100 [conn1429383] end connection 172.28.0.164:53652 (399 connections now open) 2015-10-05T07:52:05.652+0100 [conn1429401] end connection 172.28.0.164:53704 (398 connections now open) 2015-10-05T07:52:05.652+0100 [mongosMain] connection accepted from 172.28.0.164:54875 #1429785 (399 connections now open) 2015-10-05T07:52:05.653+0100 [mongosMain] connection accepted from 172.28.0.164:54876 #1429786 (400 connections now open) 2015-10-05T07:52:05.654+0100 [conn1429786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:05.654+0100 [conn1429785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:06.354+0100 [conn1429408] end connection 172.28.0.163:60687 (399 connections now open) 2015-10-05T07:52:06.355+0100 [mongosMain] connection accepted from 172.28.0.163:61875 #1429787 (400 connections now open) 2015-10-05T07:52:06.356+0100 [conn1429787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:07.569+0100 [conn1429409] end connection 172.28.0.164:53736 (399 connections now open) 2015-10-05T07:52:07.571+0100 [mongosMain] connection accepted from 172.28.0.164:54882 #1429788 (400 connections now open) 2015-10-05T07:52:07.572+0100 [conn1429788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:10.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e1a5703b51053ed4bb5 2015-10-05T07:52:10.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:13.839+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:14.489+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:14.490+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:15.651+0100 [conn1429321] end connection 172.28.0.164:53424 (399 connections now open) 2015-10-05T07:52:15.651+0100 [conn1429320] end connection 172.28.0.164:53423 (398 connections now open) 2015-10-05T07:52:15.652+0100 [mongosMain] connection accepted from 172.28.0.164:54887 #1429789 (399 connections now open) 2015-10-05T07:52:15.652+0100 [mongosMain] connection accepted from 172.28.0.164:54888 #1429790 (400 connections now open) 2015-10-05T07:52:15.653+0100 [conn1429789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:15.654+0100 [conn1429790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:16.354+0100 [conn1429417] end connection 172.28.0.163:60728 (399 connections now open) 2015-10-05T07:52:16.355+0100 [mongosMain] connection accepted from 172.28.0.163:61890 #1429791 (400 connections now open) 2015-10-05T07:52:16.356+0100 [conn1429791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:17.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e205703b51053ed4bf0 2015-10-05T07:52:17.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:17.585+0100 [conn1429412] end connection 172.28.0.164:53751 (399 connections now open) 2015-10-05T07:52:17.586+0100 [mongosMain] connection accepted from 172.28.0.164:54892 #1429792 (400 connections now open) 2015-10-05T07:52:17.588+0100 [conn1429792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:18.051+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:52:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:52:23.551+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e275703b51053ed4c63 2015-10-05T07:52:23.687+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:24.500+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:24.501+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:24.890+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:25.667+0100 [conn1429372] end connection 172.28.0.164:53619 (399 connections now open) 2015-10-05T07:52:25.667+0100 [conn1429395] end connection 172.28.0.164:53682 (399 connections now open) 2015-10-05T07:52:25.668+0100 [mongosMain] connection accepted from 172.28.0.164:54909 #1429793 (399 connections now open) 2015-10-05T07:52:25.669+0100 [mongosMain] connection accepted from 172.28.0.164:54910 #1429794 (400 connections now open) 2015-10-05T07:52:25.670+0100 [conn1429793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:25.671+0100 [conn1429794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:26.370+0100 [conn1429422] end connection 172.28.0.163:60747 (399 connections now open) 2015-10-05T07:52:26.371+0100 [mongosMain] connection accepted from 172.28.0.163:61899 #1429795 (400 connections now open) 2015-10-05T07:52:26.372+0100 [conn1429795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:27.585+0100 [conn1429418] end connection 172.28.0.164:53772 (399 connections now open) 2015-10-05T07:52:27.586+0100 [mongosMain] connection accepted from 172.28.0.164:54913 #1429796 (400 connections now open) 2015-10-05T07:52:27.588+0100 [conn1429796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:28.964+0100 [mongosMain] connection accepted from 127.0.0.1:61901 #1429797 (401 connections now open) 2015-10-05T07:52:28.967+0100 [conn1429797] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:28.972+0100 [conn1429797] end connection 127.0.0.1:61901 (400 connections now open) 2015-10-05T07:52:29.834+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e2d5703b51053ed4cb1 2015-10-05T07:52:29.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:35.497+0100 [conn1429214] end connection 172.28.0.163:60112 (399 connections now open) 2015-10-05T07:52:35.498+0100 [mongosMain] connection accepted from 172.28.0.163:61907 #1429798 (400 connections now open) 2015-10-05T07:52:35.499+0100 [conn1429798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:35.513+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:35.513+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:35.683+0100 [conn1429299] end connection 172.28.0.164:53356 (399 connections now open) 2015-10-05T07:52:35.683+0100 [conn1429362] end connection 172.28.0.164:53584 (399 connections now open) 2015-10-05T07:52:35.684+0100 [mongosMain] connection accepted from 172.28.0.164:54929 #1429799 (399 connections now open) 2015-10-05T07:52:35.684+0100 [mongosMain] connection accepted from 172.28.0.164:54928 #1429800 (400 connections now open) 2015-10-05T07:52:35.686+0100 [conn1429800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:35.687+0100 [conn1429799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:35.809+0100 [conn1429402] end connection 172.28.0.163:60668 (399 connections now open) 2015-10-05T07:52:35.811+0100 [mongosMain] connection accepted from 172.28.0.163:61909 #1429801 (400 connections now open) 2015-10-05T07:52:35.812+0100 [conn1429801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:35.901+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:36.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e335703b51053ed4cf8 2015-10-05T07:52:36.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:36.391+0100 [conn1429426] end connection 172.28.0.163:60756 (399 connections now open) 2015-10-05T07:52:36.392+0100 [mongosMain] connection accepted from 172.28.0.163:61911 #1429802 (400 connections now open) 2015-10-05T07:52:36.393+0100 [conn1429802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:36.915+0100 [conn1429391] end connection 172.28.0.164:53668 (399 connections now open) 2015-10-05T07:52:36.916+0100 [mongosMain] connection accepted from 172.28.0.164:54934 #1429803 (400 connections now open) 2015-10-05T07:52:36.917+0100 [conn1429803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:37.601+0100 [conn1429423] end connection 172.28.0.164:53783 (399 connections now open) 2015-10-05T07:52:37.602+0100 [mongosMain] connection accepted from 172.28.0.164:54936 #1429804 (400 connections now open) 2015-10-05T07:52:37.604+0100 [conn1429804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:39.723+0100 [mongosMain] connection accepted from 127.0.0.1:61913 #1429805 (401 connections now open) 2015-10-05T07:52:39.726+0100 [conn1429805] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:39.730+0100 [conn1429805] end connection 127.0.0.1:61913 (400 connections now open) 2015-10-05T07:52:42.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e3a5703b51053ed4d48 2015-10-05T07:52:42.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:45.497+0100 [conn1429351] end connection 172.28.0.163:60521 (399 connections now open) 2015-10-05T07:52:45.498+0100 [mongosMain] connection accepted from 172.28.0.163:61919 #1429806 (400 connections now open) 2015-10-05T07:52:45.499+0100 [conn1429806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:45.698+0100 [conn1429407] end connection 172.28.0.164:53726 (399 connections now open) 2015-10-05T07:52:45.698+0100 [conn1429224] end connection 172.28.0.164:53168 (399 connections now open) 2015-10-05T07:52:45.700+0100 [mongosMain] connection accepted from 172.28.0.164:54950 #1429807 (399 connections now open) 2015-10-05T07:52:45.700+0100 [mongosMain] connection accepted from 172.28.0.164:54951 #1429808 (400 connections now open) 2015-10-05T07:52:45.701+0100 [conn1429807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:45.702+0100 [conn1429808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:45.809+0100 [conn1429378] end connection 172.28.0.163:60603 (399 connections now open) 2015-10-05T07:52:45.810+0100 [mongosMain] connection accepted from 172.28.0.163:61921 #1429809 (400 connections now open) 2015-10-05T07:52:45.811+0100 [conn1429809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:46.386+0100 [conn1429432] end connection 172.28.0.163:60770 (399 connections now open) 2015-10-05T07:52:46.387+0100 [mongosMain] connection accepted from 172.28.0.163:61924 #1429810 (400 connections now open) 2015-10-05T07:52:46.388+0100 [conn1429810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:46.915+0100 [conn1429386] end connection 172.28.0.164:53656 (399 connections now open) 2015-10-05T07:52:46.916+0100 [mongosMain] connection accepted from 172.28.0.164:54953 #1429811 (400 connections now open) 2015-10-05T07:52:46.918+0100 [conn1429811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:46.976+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:47.581+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:47.582+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:47.601+0100 [conn1429427] end connection 172.28.0.164:53802 (399 connections now open) 2015-10-05T07:52:47.602+0100 [mongosMain] connection accepted from 172.28.0.164:54955 #1429812 (400 connections now open) 2015-10-05T07:52:47.603+0100 [conn1429812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:48.219+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:52:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:52:48.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e405703b51053ed4d8e 2015-10-05T07:52:49.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:49.595+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:49.595+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:52.614+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:52.614+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:55.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e475703b51053ed4dbc 2015-10-05T07:52:55.713+0100 [conn1429314] end connection 172.28.0.164:53401 (399 connections now open) 2015-10-05T07:52:55.715+0100 [mongosMain] connection accepted from 172.28.0.164:54969 #1429813 (400 connections now open) 2015-10-05T07:52:55.716+0100 [conn1429813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:55.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:52:55.824+0100 [conn1429425] end connection 172.28.0.163:60754 (399 connections now open) 2015-10-05T07:52:55.825+0100 [mongosMain] connection accepted from 172.28.0.163:61939 #1429814 (400 connections now open) 2015-10-05T07:52:55.826+0100 [conn1429814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:56.410+0100 [conn1429439] end connection 172.28.0.163:60785 (399 connections now open) 2015-10-05T07:52:56.411+0100 [mongosMain] connection accepted from 172.28.0.163:61943 #1429815 (400 connections now open) 2015-10-05T07:52:56.412+0100 [conn1429815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:56.630+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:56.630+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:52:57.617+0100 [conn1429434] end connection 172.28.0.164:53823 (399 connections now open) 2015-10-05T07:52:57.619+0100 [mongosMain] connection accepted from 172.28.0.164:54973 #1429816 (400 connections now open) 2015-10-05T07:52:57.620+0100 [conn1429816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:57.913+0100 [conn1429400] end connection 172.28.0.163:60665 (399 connections now open) 2015-10-05T07:52:57.914+0100 [mongosMain] connection accepted from 172.28.0.163:61946 #1429817 (400 connections now open) 2015-10-05T07:52:57.915+0100 [conn1429817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:52:57.975+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:52:58.345+0100 [conn1429375] end connection 172.28.0.164:53624 (399 connections now open) 2015-10-05T07:52:58.372+0100 [mongosMain] connection accepted from 172.28.0.164:54974 #1429818 (400 connections now open) 2015-10-05T07:52:58.374+0100 [conn1429818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:01.647+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:01.647+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:02.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e4e5703b51053ed4df8 2015-10-05T07:53:02.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:05.528+0100 [conn1429436] end connection 172.28.0.163:60778 (399 connections now open) 2015-10-05T07:53:05.529+0100 [mongosMain] connection accepted from 172.28.0.163:61970 #1429819 (400 connections now open) 2015-10-05T07:53:05.530+0100 [conn1429819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:05.713+0100 [conn1429366] end connection 172.28.0.164:53598 (399 connections now open) 2015-10-05T07:53:05.715+0100 [mongosMain] connection accepted from 172.28.0.164:54987 #1429820 (400 connections now open) 2015-10-05T07:53:05.717+0100 [conn1429820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:05.840+0100 [conn1429421] end connection 172.28.0.163:60745 (399 connections now open) 2015-10-05T07:53:05.841+0100 [mongosMain] connection accepted from 172.28.0.163:61972 #1429821 (400 connections now open) 2015-10-05T07:53:05.842+0100 [conn1429821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:06.402+0100 [conn1429442] end connection 172.28.0.163:60801 (399 connections now open) 2015-10-05T07:53:06.403+0100 [mongosMain] connection accepted from 172.28.0.163:61977 #1429822 (400 connections now open) 2015-10-05T07:53:06.404+0100 [conn1429822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:06.946+0100 [conn1429433] end connection 172.28.0.164:53821 (399 connections now open) 2015-10-05T07:53:06.948+0100 [mongosMain] connection accepted from 172.28.0.164:54989 #1429823 (400 connections now open) 2015-10-05T07:53:06.949+0100 [conn1429823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:07.632+0100 [conn1429440] end connection 172.28.0.164:53843 (399 connections now open) 2015-10-05T07:53:07.634+0100 [mongosMain] connection accepted from 172.28.0.164:54991 #1429824 (400 connections now open) 2015-10-05T07:53:07.635+0100 [conn1429824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:07.650+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:07.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:08.976+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:09.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e545703b51053ed4e2f 2015-10-05T07:53:09.221+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:14.651+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:14.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:15.554+0100 [conn1429365] end connection 172.28.0.163:60565 (399 connections now open) 2015-10-05T07:53:15.554+0100 [conn1429413] end connection 172.28.0.163:60721 (398 connections now open) 2015-10-05T07:53:15.556+0100 [mongosMain] connection accepted from 172.28.0.163:61991 #1429825 (399 connections now open) 2015-10-05T07:53:15.556+0100 [mongosMain] connection accepted from 172.28.0.163:61992 #1429826 (400 connections now open) 2015-10-05T07:53:15.557+0100 [conn1429825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:15.557+0100 [conn1429826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:15.729+0100 [conn1429441] end connection 172.28.0.164:53853 (399 connections now open) 2015-10-05T07:53:15.730+0100 [mongosMain] connection accepted from 172.28.0.164:54998 #1429827 (400 connections now open) 2015-10-05T07:53:15.730+0100 [conn1429429] end connection 172.28.0.164:53814 (398 connections now open) 2015-10-05T07:53:15.731+0100 [mongosMain] connection accepted from 172.28.0.164:54999 #1429828 (400 connections now open) 2015-10-05T07:53:15.731+0100 [conn1429827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:15.733+0100 [conn1429828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:15.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e5b5703b51053ed4e4c 2015-10-05T07:53:15.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:16.417+0100 [conn1429448] end connection 172.28.0.163:60832 (399 connections now open) 2015-10-05T07:53:16.418+0100 [mongosMain] connection accepted from 172.28.0.163:61995 #1429829 (400 connections now open) 2015-10-05T07:53:16.419+0100 [conn1429829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:16.961+0100 [conn1429379] end connection 172.28.0.164:53639 (399 connections now open) 2015-10-05T07:53:16.962+0100 [mongosMain] connection accepted from 172.28.0.164:55004 #1429830 (400 connections now open) 2015-10-05T07:53:16.964+0100 [conn1429830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:17.648+0100 [conn1429443] end connection 172.28.0.164:53862 (399 connections now open) 2015-10-05T07:53:17.649+0100 [mongosMain] connection accepted from 172.28.0.164:55006 #1429831 (400 connections now open) 2015-10-05T07:53:17.651+0100 [conn1429831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:18.479+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:53:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:53:20.000+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:22.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e615703b51053ed4e81 2015-10-05T07:53:22.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:22.662+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:22.662+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:25.544+0100 [conn1429393] end connection 172.28.0.163:60656 (399 connections now open) 2015-10-05T07:53:25.544+0100 [conn1429388] end connection 172.28.0.163:60641 (399 connections now open) 2015-10-05T07:53:25.545+0100 [mongosMain] connection accepted from 172.28.0.163:62005 #1429832 (399 connections now open) 2015-10-05T07:53:25.546+0100 [mongosMain] connection accepted from 172.28.0.163:62006 #1429833 (400 connections now open) 2015-10-05T07:53:25.546+0100 [conn1429832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:25.547+0100 [conn1429833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:25.729+0100 [conn1429444] end connection 172.28.0.164:53876 (399 connections now open) 2015-10-05T07:53:25.729+0100 [conn1429389] end connection 172.28.0.164:53664 (398 connections now open) 2015-10-05T07:53:25.731+0100 [mongosMain] connection accepted from 172.28.0.164:55020 #1429834 (399 connections now open) 2015-10-05T07:53:25.731+0100 [mongosMain] connection accepted from 172.28.0.164:55021 #1429835 (400 connections now open) 2015-10-05T07:53:25.732+0100 [conn1429834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:25.733+0100 [conn1429835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:25.856+0100 [conn1429373] end connection 172.28.0.163:60586 (399 connections now open) 2015-10-05T07:53:25.857+0100 [mongosMain] connection accepted from 172.28.0.163:62009 #1429836 (400 connections now open) 2015-10-05T07:53:25.858+0100 [conn1429836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:26.418+0100 [conn1429454] end connection 172.28.0.163:60851 (399 connections now open) 2015-10-05T07:53:26.419+0100 [mongosMain] connection accepted from 172.28.0.163:62011 #1429837 (400 connections now open) 2015-10-05T07:53:26.420+0100 [conn1429837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:26.962+0100 [conn1429359] end connection 172.28.0.164:53569 (399 connections now open) 2015-10-05T07:53:26.963+0100 [mongosMain] connection accepted from 172.28.0.164:55024 #1429838 (400 connections now open) 2015-10-05T07:53:26.965+0100 [conn1429838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:27.663+0100 [conn1429450] end connection 172.28.0.164:53887 (399 connections now open) 2015-10-05T07:53:27.664+0100 [mongosMain] connection accepted from 172.28.0.164:55027 #1429839 (400 connections now open) 2015-10-05T07:53:27.667+0100 [conn1429839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:28.209+0100 [mongosMain] connection accepted from 127.0.0.1:62013 #1429840 (401 connections now open) 2015-10-05T07:53:28.212+0100 [conn1429840] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:28.218+0100 [conn1429840] end connection 127.0.0.1:62013 (400 connections now open) 2015-10-05T07:53:28.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e685703b51053ed4eb9 2015-10-05T07:53:28.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:31.028+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:31.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:31.669+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:35.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e6e5703b51053ed4ed8 2015-10-05T07:53:35.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:35.544+0100 [conn1429356] end connection 172.28.0.163:60539 (399 connections now open) 2015-10-05T07:53:35.544+0100 [conn1429381] end connection 172.28.0.163:60625 (399 connections now open) 2015-10-05T07:53:35.546+0100 [mongosMain] connection accepted from 172.28.0.163:62018 #1429841 (399 connections now open) 2015-10-05T07:53:35.546+0100 [mongosMain] connection accepted from 172.28.0.163:62017 #1429842 (400 connections now open) 2015-10-05T07:53:35.546+0100 [conn1429841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:35.547+0100 [conn1429842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:35.746+0100 [conn1429292] end connection 172.28.0.164:53344 (399 connections now open) 2015-10-05T07:53:35.746+0100 [conn1429420] end connection 172.28.0.164:53777 (399 connections now open) 2015-10-05T07:53:35.747+0100 [mongosMain] connection accepted from 172.28.0.164:55039 #1429843 (399 connections now open) 2015-10-05T07:53:35.748+0100 [mongosMain] connection accepted from 172.28.0.164:55040 #1429844 (400 connections now open) 2015-10-05T07:53:35.749+0100 [conn1429843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:35.750+0100 [conn1429844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:35.862+0100 [conn1429447] end connection 172.28.0.163:60829 (399 connections now open) 2015-10-05T07:53:35.863+0100 [mongosMain] connection accepted from 172.28.0.163:62021 #1429845 (400 connections now open) 2015-10-05T07:53:35.864+0100 [conn1429845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:36.433+0100 [conn1429462] end connection 172.28.0.163:60864 (399 connections now open) 2015-10-05T07:53:36.434+0100 [mongosMain] connection accepted from 172.28.0.163:62025 #1429846 (400 connections now open) 2015-10-05T07:53:36.435+0100 [conn1429846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:37.679+0100 [conn1429456] end connection 172.28.0.164:53895 (399 connections now open) 2015-10-05T07:53:37.680+0100 [mongosMain] connection accepted from 172.28.0.164:55046 #1429847 (400 connections now open) 2015-10-05T07:53:37.682+0100 [conn1429847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:39.732+0100 [mongosMain] connection accepted from 127.0.0.1:62027 #1429848 (401 connections now open) 2015-10-05T07:53:39.734+0100 [conn1429848] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:39.739+0100 [conn1429848] end connection 127.0.0.1:62027 (400 connections now open) 2015-10-05T07:53:41.668+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:41.668+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:42.032+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:45.667+0100 [conn1429355] end connection 172.28.0.163:60537 (399 connections now open) 2015-10-05T07:53:45.672+0100 [mongosMain] connection accepted from 172.28.0.163:62040 #1429849 (400 connections now open) 2015-10-05T07:53:45.672+0100 [conn1429849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:45.745+0100 [conn1429306] end connection 172.28.0.164:53381 (399 connections now open) 2015-10-05T07:53:45.746+0100 [conn1429438] end connection 172.28.0.164:53834 (398 connections now open) 2015-10-05T07:53:45.747+0100 [mongosMain] connection accepted from 172.28.0.164:55059 #1429850 (399 connections now open) 2015-10-05T07:53:45.748+0100 [mongosMain] connection accepted from 172.28.0.164:55060 #1429851 (400 connections now open) 2015-10-05T07:53:45.749+0100 [conn1429850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:45.749+0100 [conn1429851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:45.872+0100 [conn1429453] end connection 172.28.0.163:60848 (399 connections now open) 2015-10-05T07:53:45.873+0100 [mongosMain] connection accepted from 172.28.0.163:62041 #1429852 (400 connections now open) 2015-10-05T07:53:45.874+0100 [conn1429852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:46.434+0100 [conn1429471] end connection 172.28.0.163:60876 (399 connections now open) 2015-10-05T07:53:46.435+0100 [mongosMain] connection accepted from 172.28.0.163:62043 #1429853 (400 connections now open) 2015-10-05T07:53:46.435+0100 [conn1429853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:46.993+0100 [conn1429463] end connection 172.28.0.164:53917 (399 connections now open) 2015-10-05T07:53:46.998+0100 [mongosMain] connection accepted from 172.28.0.164:55063 #1429854 (400 connections now open) 2015-10-05T07:53:47.000+0100 [conn1429854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:47.679+0100 [conn1429464] end connection 172.28.0.164:53920 (399 connections now open) 2015-10-05T07:53:47.681+0100 [mongosMain] connection accepted from 172.28.0.164:55066 #1429855 (400 connections now open) 2015-10-05T07:53:47.682+0100 [conn1429855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:47.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e7b5703b51053ed4f23 2015-10-05T07:53:47.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:53:48.746+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:53:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:53:52.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:52.718+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:53:53.040+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:53:55.761+0100 [conn1429430] end connection 172.28.0.164:53815 (399 connections now open) 2015-10-05T07:53:55.762+0100 [mongosMain] connection accepted from 172.28.0.164:55076 #1429856 (400 connections now open) 2015-10-05T07:53:55.764+0100 [conn1429856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:55.861+0100 [conn1429357] end connection 172.28.0.164:53566 (399 connections now open) 2015-10-05T07:53:55.869+0100 [mongosMain] connection accepted from 172.28.0.164:55077 #1429857 (400 connections now open) 2015-10-05T07:53:55.871+0100 [conn1429857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:55.890+0100 [conn1429361] end connection 172.28.0.163:60556 (399 connections now open) 2015-10-05T07:53:55.891+0100 [mongosMain] connection accepted from 172.28.0.163:62058 #1429858 (400 connections now open) 2015-10-05T07:53:55.892+0100 [conn1429858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:56.449+0100 [conn1429480] end connection 172.28.0.163:60894 (399 connections now open) 2015-10-05T07:53:56.451+0100 [mongosMain] connection accepted from 172.28.0.163:62061 #1429859 (400 connections now open) 2015-10-05T07:53:56.452+0100 [conn1429859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:57.009+0100 [conn1429449] end connection 172.28.0.164:53883 (399 connections now open) 2015-10-05T07:53:57.010+0100 [mongosMain] connection accepted from 172.28.0.164:55079 #1429860 (400 connections now open) 2015-10-05T07:53:57.011+0100 [conn1429860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:53:57.695+0100 [conn1429473] end connection 172.28.0.164:53940 (399 connections now open) 2015-10-05T07:53:57.696+0100 [mongosMain] connection accepted from 172.28.0.164:55082 #1429861 (400 connections now open) 2015-10-05T07:53:57.698+0100 [conn1429861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:04.064+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:04.727+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:04.727+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:05.761+0100 [conn1429424] end connection 172.28.0.164:53794 (399 connections now open) 2015-10-05T07:54:05.761+0100 [conn1429457] end connection 172.28.0.164:53909 (399 connections now open) 2015-10-05T07:54:05.762+0100 [mongosMain] connection accepted from 172.28.0.164:55093 #1429862 (399 connections now open) 2015-10-05T07:54:05.762+0100 [mongosMain] connection accepted from 172.28.0.164:55092 #1429863 (400 connections now open) 2015-10-05T07:54:05.764+0100 [conn1429862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:05.764+0100 [conn1429863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:05.887+0100 [conn1429431] end connection 172.28.0.163:60768 (399 connections now open) 2015-10-05T07:54:05.888+0100 [conn1429371] end connection 172.28.0.163:60581 (398 connections now open) 2015-10-05T07:54:05.889+0100 [mongosMain] connection accepted from 172.28.0.163:62082 #1429864 (399 connections now open) 2015-10-05T07:54:05.889+0100 [mongosMain] connection accepted from 172.28.0.163:62083 #1429865 (400 connections now open) 2015-10-05T07:54:05.890+0100 [conn1429864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:05.890+0100 [conn1429865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:05.968+0100 [conn1429468] end connection 172.28.0.163:60870 (399 connections now open) 2015-10-05T07:54:05.969+0100 [mongosMain] connection accepted from 172.28.0.163:62087 #1429866 (400 connections now open) 2015-10-05T07:54:05.970+0100 [conn1429866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:06.465+0100 [conn1429488] end connection 172.28.0.163:60918 (399 connections now open) 2015-10-05T07:54:06.466+0100 [mongosMain] connection accepted from 172.28.0.163:62090 #1429867 (400 connections now open) 2015-10-05T07:54:06.468+0100 [conn1429867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:06.738+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:06.738+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:06.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e8d5703b51053ed4fc3 2015-10-05T07:54:06.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:07.712+0100 [conn1429482] end connection 172.28.0.164:53965 (399 connections now open) 2015-10-05T07:54:07.713+0100 [mongosMain] connection accepted from 172.28.0.164:55096 #1429868 (400 connections now open) 2015-10-05T07:54:07.716+0100 [conn1429868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:09.747+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:09.748+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:13.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e945703b51053ed500d 2015-10-05T07:54:13.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:13.769+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:13.769+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:15.072+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:15.777+0100 [conn1429414] end connection 172.28.0.164:53765 (399 connections now open) 2015-10-05T07:54:15.777+0100 [conn1429248] end connection 172.28.0.164:53229 (398 connections now open) 2015-10-05T07:54:15.778+0100 [mongosMain] connection accepted from 172.28.0.164:55104 #1429869 (399 connections now open) 2015-10-05T07:54:15.779+0100 [mongosMain] connection accepted from 172.28.0.164:55103 #1429870 (400 connections now open) 2015-10-05T07:54:15.780+0100 [conn1429869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:15.780+0100 [conn1429870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:15.888+0100 [conn1429410] end connection 172.28.0.163:60697 (399 connections now open) 2015-10-05T07:54:15.888+0100 [conn1429335] end connection 172.28.0.163:60443 (399 connections now open) 2015-10-05T07:54:15.888+0100 [conn1429479] end connection 172.28.0.163:60890 (399 connections now open) 2015-10-05T07:54:15.889+0100 [mongosMain] connection accepted from 172.28.0.163:62107 #1429871 (398 connections now open) 2015-10-05T07:54:15.889+0100 [mongosMain] connection accepted from 172.28.0.163:62108 #1429872 (399 connections now open) 2015-10-05T07:54:15.889+0100 [mongosMain] connection accepted from 172.28.0.163:62109 #1429873 (400 connections now open) 2015-10-05T07:54:15.889+0100 [conn1429871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:15.890+0100 [conn1429872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:15.890+0100 [conn1429873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:16.466+0100 [conn1429494] end connection 172.28.0.163:60953 (399 connections now open) 2015-10-05T07:54:16.467+0100 [mongosMain] connection accepted from 172.28.0.163:62113 #1429874 (400 connections now open) 2015-10-05T07:54:16.468+0100 [conn1429874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:17.039+0100 [conn1429472] end connection 172.28.0.164:53936 (399 connections now open) 2015-10-05T07:54:17.040+0100 [mongosMain] connection accepted from 172.28.0.164:55108 #1429875 (400 connections now open) 2015-10-05T07:54:17.042+0100 [conn1429875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:17.726+0100 [conn1429489] end connection 172.28.0.164:53981 (399 connections now open) 2015-10-05T07:54:17.727+0100 [mongosMain] connection accepted from 172.28.0.164:55111 #1429876 (400 connections now open) 2015-10-05T07:54:17.730+0100 [conn1429876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:18.850+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:18.850+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:19.030+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:54:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:54:19.441+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121e9b5703b51053ed5033 2015-10-05T07:54:19.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:24.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:24.852+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:25.792+0100 [conn1429490] end connection 172.28.0.164:54003 (399 connections now open) 2015-10-05T07:54:25.792+0100 [conn1429445] end connection 172.28.0.164:53877 (399 connections now open) 2015-10-05T07:54:25.793+0100 [mongosMain] connection accepted from 172.28.0.164:55126 #1429877 (399 connections now open) 2015-10-05T07:54:25.794+0100 [mongosMain] connection accepted from 172.28.0.164:55125 #1429878 (400 connections now open) 2015-10-05T07:54:25.795+0100 [conn1429877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:25.795+0100 [conn1429878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:25.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ea15703b51053ed5073 2015-10-05T07:54:25.903+0100 [conn1429470] end connection 172.28.0.163:60874 (399 connections now open) 2015-10-05T07:54:25.904+0100 [mongosMain] connection accepted from 172.28.0.163:62122 #1429879 (400 connections now open) 2015-10-05T07:54:25.905+0100 [conn1429879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:25.907+0100 [conn1429459] end connection 172.28.0.163:60859 (399 connections now open) 2015-10-05T07:54:25.908+0100 [mongosMain] connection accepted from 172.28.0.163:62125 #1429880 (400 connections now open) 2015-10-05T07:54:25.909+0100 [conn1429880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:25.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:26.078+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:27.056+0100 [conn1429481] end connection 172.28.0.164:53961 (399 connections now open) 2015-10-05T07:54:27.058+0100 [mongosMain] connection accepted from 172.28.0.164:55132 #1429881 (400 connections now open) 2015-10-05T07:54:27.060+0100 [conn1429881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:27.743+0100 [conn1429502] end connection 172.28.0.164:54019 (399 connections now open) 2015-10-05T07:54:27.744+0100 [mongosMain] connection accepted from 172.28.0.164:55133 #1429882 (400 connections now open) 2015-10-05T07:54:27.746+0100 [conn1429882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:28.542+0100 [mongosMain] connection accepted from 127.0.0.1:62128 #1429883 (401 connections now open) 2015-10-05T07:54:28.545+0100 [conn1429883] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:28.554+0100 [conn1429883] end connection 127.0.0.1:62128 (400 connections now open) 2015-10-05T07:54:31.857+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:31.857+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:32.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ea85703b51053ed509f 2015-10-05T07:54:32.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:35.808+0100 [conn1429484] end connection 172.28.0.164:53975 (399 connections now open) 2015-10-05T07:54:35.809+0100 [conn1429458] end connection 172.28.0.164:53910 (398 connections now open) 2015-10-05T07:54:35.810+0100 [mongosMain] connection accepted from 172.28.0.164:55147 #1429884 (399 connections now open) 2015-10-05T07:54:35.810+0100 [mongosMain] connection accepted from 172.28.0.164:55148 #1429885 (400 connections now open) 2015-10-05T07:54:35.812+0100 [conn1429884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:35.813+0100 [conn1429885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:35.932+0100 [conn1429469] end connection 172.28.0.163:60871 (399 connections now open) 2015-10-05T07:54:35.933+0100 [mongosMain] connection accepted from 172.28.0.163:62135 #1429886 (400 connections now open) 2015-10-05T07:54:35.935+0100 [conn1429886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:36.481+0100 [conn1429506] end connection 172.28.0.163:60987 (399 connections now open) 2015-10-05T07:54:36.483+0100 [mongosMain] connection accepted from 172.28.0.163:62137 #1429887 (400 connections now open) 2015-10-05T07:54:36.484+0100 [conn1429887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:37.072+0100 [conn1429455] end connection 172.28.0.164:53894 (399 connections now open) 2015-10-05T07:54:37.072+0100 [mongosMain] connection accepted from 172.28.0.164:55152 #1429888 (400 connections now open) 2015-10-05T07:54:37.075+0100 [conn1429888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:37.099+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:37.758+0100 [conn1429508] end connection 172.28.0.164:54042 (399 connections now open) 2015-10-05T07:54:37.759+0100 [mongosMain] connection accepted from 172.28.0.164:55155 #1429889 (400 connections now open) 2015-10-05T07:54:37.761+0100 [conn1429889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:38.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121eae5703b51053ed50ef 2015-10-05T07:54:38.834+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:39.813+0100 [mongosMain] connection accepted from 127.0.0.1:62142 #1429890 (401 connections now open) 2015-10-05T07:54:39.816+0100 [conn1429890] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:39.822+0100 [conn1429890] end connection 127.0.0.1:62142 (400 connections now open) 2015-10-05T07:54:39.906+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:39.907+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:44.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121eb45703b51053ed512d 2015-10-05T07:54:45.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:45.808+0100 [conn1429496] end connection 172.28.0.164:54011 (399 connections now open) 2015-10-05T07:54:45.810+0100 [mongosMain] connection accepted from 172.28.0.164:55169 #1429891 (400 connections now open) 2015-10-05T07:54:45.811+0100 [conn1429891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:45.920+0100 [conn1429486] end connection 172.28.0.163:60910 (399 connections now open) 2015-10-05T07:54:45.922+0100 [mongosMain] connection accepted from 172.28.0.163:62150 #1429892 (400 connections now open) 2015-10-05T07:54:45.923+0100 [conn1429892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:46.496+0100 [conn1429500] end connection 172.28.0.163:60973 (399 connections now open) 2015-10-05T07:54:46.497+0100 [mongosMain] connection accepted from 172.28.0.163:62156 #1429893 (400 connections now open) 2015-10-05T07:54:46.497+0100 [conn1429893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:47.087+0100 [conn1429514] end connection 172.28.0.164:54062 (399 connections now open) 2015-10-05T07:54:47.088+0100 [mongosMain] connection accepted from 172.28.0.164:55174 #1429894 (400 connections now open) 2015-10-05T07:54:47.090+0100 [conn1429894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:47.773+0100 [conn1429515] end connection 172.28.0.164:54064 (399 connections now open) 2015-10-05T07:54:47.774+0100 [mongosMain] connection accepted from 172.28.0.164:55179 #1429895 (400 connections now open) 2015-10-05T07:54:47.778+0100 [conn1429895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:48.114+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:48.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:48.910+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:49.178+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:54:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:54:52.560+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ebb5703b51053ed5178 2015-10-05T07:54:52.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:55.824+0100 [conn1429467] end connection 172.28.0.164:53932 (399 connections now open) 2015-10-05T07:54:55.824+0100 [conn1429466] end connection 172.28.0.164:53931 (398 connections now open) 2015-10-05T07:54:55.825+0100 [mongosMain] connection accepted from 172.28.0.164:55189 #1429896 (399 connections now open) 2015-10-05T07:54:55.825+0100 [mongosMain] connection accepted from 172.28.0.164:55190 #1429897 (400 connections now open) 2015-10-05T07:54:55.827+0100 [conn1429896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:55.827+0100 [conn1429897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:56.053+0100 [conn1429478] end connection 172.28.0.163:60885 (399 connections now open) 2015-10-05T07:54:56.059+0100 [mongosMain] connection accepted from 172.28.0.163:62175 #1429898 (400 connections now open) 2015-10-05T07:54:56.060+0100 [conn1429898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:56.497+0100 [conn1429513] end connection 172.28.0.163:61003 (399 connections now open) 2015-10-05T07:54:56.498+0100 [mongosMain] connection accepted from 172.28.0.163:62176 #1429899 (400 connections now open) 2015-10-05T07:54:56.499+0100 [conn1429899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:57.087+0100 [conn1429397] end connection 172.28.0.164:53689 (399 connections now open) 2015-10-05T07:54:57.088+0100 [mongosMain] connection accepted from 172.28.0.164:55193 #1429900 (400 connections now open) 2015-10-05T07:54:57.089+0100 [conn1429900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:57.789+0100 [conn1429522] end connection 172.28.0.164:54084 (399 connections now open) 2015-10-05T07:54:57.793+0100 [mongosMain] connection accepted from 172.28.0.164:55195 #1429901 (400 connections now open) 2015-10-05T07:54:57.795+0100 [conn1429901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:54:58.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ec25703b51053ed51c3 2015-10-05T07:54:58.934+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:54:58.934+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:54:59.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:54:59.160+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:05.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ec95703b51053ed5203 2015-10-05T07:55:05.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:05.858+0100 [conn1429476] end connection 172.28.0.164:53957 (399 connections now open) 2015-10-05T07:55:05.859+0100 [mongosMain] connection accepted from 172.28.0.164:55206 #1429902 (400 connections now open) 2015-10-05T07:55:05.861+0100 [conn1429902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:06.044+0100 [conn1429497] end connection 172.28.0.163:60965 (399 connections now open) 2015-10-05T07:55:06.045+0100 [mongosMain] connection accepted from 172.28.0.163:62201 #1429903 (400 connections now open) 2015-10-05T07:55:06.047+0100 [conn1429903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:06.512+0100 [conn1429520] end connection 172.28.0.163:61021 (399 connections now open) 2015-10-05T07:55:06.513+0100 [mongosMain] connection accepted from 172.28.0.163:62205 #1429904 (400 connections now open) 2015-10-05T07:55:06.514+0100 [conn1429904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:07.102+0100 [conn1429495] end connection 172.28.0.164:54005 (399 connections now open) 2015-10-05T07:55:07.104+0100 [mongosMain] connection accepted from 172.28.0.164:55209 #1429905 (400 connections now open) 2015-10-05T07:55:07.105+0100 [conn1429905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:07.806+0100 [conn1429529] end connection 172.28.0.164:54102 (399 connections now open) 2015-10-05T07:55:07.807+0100 [mongosMain] connection accepted from 172.28.0.164:55211 #1429906 (400 connections now open) 2015-10-05T07:55:07.809+0100 [conn1429906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:09.936+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:09.937+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:10.168+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:11.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ecf5703b51053ed5232 2015-10-05T07:55:11.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:15.855+0100 [conn1429437] end connection 172.28.0.164:53833 (399 connections now open) 2015-10-05T07:55:15.856+0100 [mongosMain] connection accepted from 172.28.0.164:55218 #1429907 (400 connections now open) 2015-10-05T07:55:15.857+0100 [conn1429907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:15.951+0100 [conn1429461] end connection 172.28.0.163:60862 (399 connections now open) 2015-10-05T07:55:15.953+0100 [mongosMain] connection accepted from 172.28.0.163:62218 #1429908 (400 connections now open) 2015-10-05T07:55:15.954+0100 [conn1429908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:16.045+0100 [conn1429491] end connection 172.28.0.163:60941 (399 connections now open) 2015-10-05T07:55:16.047+0100 [mongosMain] connection accepted from 172.28.0.163:62220 #1429909 (400 connections now open) 2015-10-05T07:55:16.048+0100 [conn1429909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:16.514+0100 [conn1429527] end connection 172.28.0.163:61040 (399 connections now open) 2015-10-05T07:55:16.515+0100 [mongosMain] connection accepted from 172.28.0.163:62226 #1429910 (400 connections now open) 2015-10-05T07:55:16.517+0100 [conn1429910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:17.103+0100 [conn1429521] end connection 172.28.0.164:54082 (399 connections now open) 2015-10-05T07:55:17.106+0100 [mongosMain] connection accepted from 172.28.0.164:55222 #1429911 (400 connections now open) 2015-10-05T07:55:17.108+0100 [conn1429911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:17.806+0100 [conn1429536] end connection 172.28.0.164:54117 (399 connections now open) 2015-10-05T07:55:17.807+0100 [mongosMain] connection accepted from 172.28.0.164:55225 #1429912 (400 connections now open) 2015-10-05T07:55:17.810+0100 [conn1429912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:17.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ed55703b51053ed5253 2015-10-05T07:55:18.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:19.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:55:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:55:21.185+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:21.954+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:21.954+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:23.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:23.955+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:24.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121edc5703b51053ed5273 2015-10-05T07:55:24.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:25.872+0100 [conn1429524] end connection 172.28.0.164:54094 (399 connections now open) 2015-10-05T07:55:25.872+0100 [mongosMain] connection accepted from 172.28.0.164:55238 #1429913 (400 connections now open) 2015-10-05T07:55:25.874+0100 [conn1429913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:26.061+0100 [conn1429504] end connection 172.28.0.163:60980 (399 connections now open) 2015-10-05T07:55:26.062+0100 [mongosMain] connection accepted from 172.28.0.163:62236 #1429914 (400 connections now open) 2015-10-05T07:55:26.062+0100 [conn1429914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:26.528+0100 [conn1429534] end connection 172.28.0.163:61066 (399 connections now open) 2015-10-05T07:55:26.530+0100 [mongosMain] connection accepted from 172.28.0.163:62239 #1429915 (400 connections now open) 2015-10-05T07:55:26.531+0100 [conn1429915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:26.962+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:26.962+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:27.805+0100 [conn1429543] end connection 172.28.0.164:54129 (399 connections now open) 2015-10-05T07:55:27.806+0100 [mongosMain] connection accepted from 172.28.0.164:55243 #1429916 (400 connections now open) 2015-10-05T07:55:27.808+0100 [conn1429916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:28.769+0100 [mongosMain] connection accepted from 127.0.0.1:62240 #1429917 (401 connections now open) 2015-10-05T07:55:28.771+0100 [conn1429917] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:28.777+0100 [conn1429917] end connection 127.0.0.1:62240 (400 connections now open) 2015-10-05T07:55:30.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ee25703b51053ed5299 2015-10-05T07:55:30.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:30.972+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:30.972+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:32.186+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:35.888+0100 [conn1429530] end connection 172.28.0.164:54111 (399 connections now open) 2015-10-05T07:55:35.889+0100 [mongosMain] connection accepted from 172.28.0.164:55255 #1429918 (400 connections now open) 2015-10-05T07:55:35.890+0100 [conn1429483] end connection 172.28.0.164:53974 (399 connections now open) 2015-10-05T07:55:35.891+0100 [conn1429918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:35.892+0100 [mongosMain] connection accepted from 172.28.0.164:55257 #1429919 (400 connections now open) 2015-10-05T07:55:35.893+0100 [conn1429919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:35.980+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:35.980+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:36.076+0100 [conn1429533] end connection 172.28.0.163:61060 (399 connections now open) 2015-10-05T07:55:36.077+0100 [mongosMain] connection accepted from 172.28.0.163:62247 #1429920 (400 connections now open) 2015-10-05T07:55:36.078+0100 [conn1429920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:36.543+0100 [conn1429541] end connection 172.28.0.163:61087 (399 connections now open) 2015-10-05T07:55:36.544+0100 [mongosMain] connection accepted from 172.28.0.163:62250 #1429921 (400 connections now open) 2015-10-05T07:55:36.545+0100 [conn1429921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:37.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ee85703b51053ed52b9 2015-10-05T07:55:37.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:37.820+0100 [conn1429550] end connection 172.28.0.164:54147 (399 connections now open) 2015-10-05T07:55:37.821+0100 [mongosMain] connection accepted from 172.28.0.164:55263 #1429922 (400 connections now open) 2015-10-05T07:55:37.824+0100 [conn1429922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:39.364+0100 [mongosMain] connection accepted from 127.0.0.1:62254 #1429923 (401 connections now open) 2015-10-05T07:55:39.367+0100 [conn1429923] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:39.371+0100 [conn1429923] end connection 127.0.0.1:62254 (400 connections now open) 2015-10-05T07:55:42.058+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:42.058+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:43.219+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:44.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121eef5703b51053ed52e4 2015-10-05T07:55:44.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:45.886+0100 [conn1429510] end connection 172.28.0.164:54054 (399 connections now open) 2015-10-05T07:55:45.887+0100 [conn1429415] end connection 172.28.0.164:53766 (398 connections now open) 2015-10-05T07:55:45.887+0100 [mongosMain] connection accepted from 172.28.0.164:55276 #1429924 (399 connections now open) 2015-10-05T07:55:45.888+0100 [mongosMain] connection accepted from 172.28.0.164:55277 #1429925 (400 connections now open) 2015-10-05T07:55:45.889+0100 [conn1429924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:45.890+0100 [conn1429925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:46.091+0100 [conn1429518] end connection 172.28.0.163:61015 (399 connections now open) 2015-10-05T07:55:46.093+0100 [mongosMain] connection accepted from 172.28.0.163:62267 #1429926 (400 connections now open) 2015-10-05T07:55:46.095+0100 [conn1429926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:46.544+0100 [conn1429548] end connection 172.28.0.163:61118 (399 connections now open) 2015-10-05T07:55:46.545+0100 [mongosMain] connection accepted from 172.28.0.163:62270 #1429927 (400 connections now open) 2015-10-05T07:55:46.547+0100 [conn1429927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:47.837+0100 [conn1429558] end connection 172.28.0.164:54169 (399 connections now open) 2015-10-05T07:55:47.838+0100 [mongosMain] connection accepted from 172.28.0.164:55283 #1429928 (400 connections now open) 2015-10-05T07:55:47.840+0100 [conn1429928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:49.105+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:49.105+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:49.706+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:55:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:55:50.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ef65703b51053ed5318 2015-10-05T07:55:50.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:54.246+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:55.902+0100 [conn1429503] end connection 172.28.0.164:54035 (399 connections now open) 2015-10-05T07:55:55.903+0100 [mongosMain] connection accepted from 172.28.0.164:55293 #1429929 (400 connections now open) 2015-10-05T07:55:55.905+0100 [conn1429929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:55.983+0100 [conn1429499] end connection 172.28.0.163:60970 (399 connections now open) 2015-10-05T07:55:55.984+0100 [mongosMain] connection accepted from 172.28.0.163:62283 #1429930 (400 connections now open) 2015-10-05T07:55:55.985+0100 [conn1429930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:56.413+0100 [conn1429512] end connection 172.28.0.163:60998 (399 connections now open) 2015-10-05T07:55:56.417+0100 [mongosMain] connection accepted from 172.28.0.163:62287 #1429931 (400 connections now open) 2015-10-05T07:55:56.418+0100 [conn1429931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:56.559+0100 [conn1429556] end connection 172.28.0.163:61133 (399 connections now open) 2015-10-05T07:55:56.559+0100 [mongosMain] connection accepted from 172.28.0.163:62288 #1429932 (400 connections now open) 2015-10-05T07:55:56.560+0100 [conn1429932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:55:57.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121efc5703b51053ed5355 2015-10-05T07:55:57.165+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:55:57.165+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:55:57.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:55:57.854+0100 [conn1429564] end connection 172.28.0.164:54187 (399 connections now open) 2015-10-05T07:55:57.855+0100 [mongosMain] connection accepted from 172.28.0.164:55297 #1429933 (400 connections now open) 2015-10-05T07:55:57.856+0100 [conn1429933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:03.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f035703b51053ed53a6 2015-10-05T07:56:03.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:56:05.273+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:05.902+0100 [conn1429546] end connection 172.28.0.164:54140 (399 connections now open) 2015-10-05T07:56:05.904+0100 [mongosMain] connection accepted from 172.28.0.164:55317 #1429934 (400 connections now open) 2015-10-05T07:56:05.905+0100 [conn1429934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:06.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:06.168+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:06.411+0100 [conn1429526] end connection 172.28.0.163:61033 (399 connections now open) 2015-10-05T07:56:06.412+0100 [mongosMain] connection accepted from 172.28.0.163:62317 #1429935 (400 connections now open) 2015-10-05T07:56:06.413+0100 [conn1429935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:06.560+0100 [conn1429563] end connection 172.28.0.163:61150 (399 connections now open) 2015-10-05T07:56:06.560+0100 [mongosMain] connection accepted from 172.28.0.163:62320 #1429936 (400 connections now open) 2015-10-05T07:56:06.561+0100 [conn1429936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:07.852+0100 [conn1429570] end connection 172.28.0.164:54199 (399 connections now open) 2015-10-05T07:56:07.853+0100 [mongosMain] connection accepted from 172.28.0.164:55321 #1429937 (400 connections now open) 2015-10-05T07:56:07.855+0100 [conn1429937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:09.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f095703b51053ed5411 2015-10-05T07:56:09.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:56:15.917+0100 [conn1429377] end connection 172.28.0.164:53634 (399 connections now open) 2015-10-05T07:56:15.917+0100 [conn1429562] end connection 172.28.0.164:54181 (399 connections now open) 2015-10-05T07:56:15.918+0100 [mongosMain] connection accepted from 172.28.0.164:55331 #1429938 (399 connections now open) 2015-10-05T07:56:15.918+0100 [mongosMain] connection accepted from 172.28.0.164:55332 #1429939 (400 connections now open) 2015-10-05T07:56:15.919+0100 [conn1429938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:15.920+0100 [conn1429939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:15.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f0f5703b51053ed546b 2015-10-05T07:56:15.998+0100 [conn1429416] end connection 172.28.0.163:60725 (399 connections now open) 2015-10-05T07:56:15.999+0100 [mongosMain] connection accepted from 172.28.0.163:62335 #1429940 (400 connections now open) 2015-10-05T07:56:16.000+0100 [conn1429940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:16.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:56:16.233+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:16.234+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:16.285+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:16.420+0100 [conn1429538] end connection 172.28.0.163:61080 (399 connections now open) 2015-10-05T07:56:16.421+0100 [mongosMain] connection accepted from 172.28.0.163:62337 #1429941 (400 connections now open) 2015-10-05T07:56:16.422+0100 [conn1429941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:16.575+0100 [conn1429569] end connection 172.28.0.163:61168 (399 connections now open) 2015-10-05T07:56:16.576+0100 [mongosMain] connection accepted from 172.28.0.163:62340 #1429942 (400 connections now open) 2015-10-05T07:56:16.577+0100 [conn1429942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:17.869+0100 [conn1429576] end connection 172.28.0.164:54217 (399 connections now open) 2015-10-05T07:56:17.870+0100 [mongosMain] connection accepted from 172.28.0.164:55336 #1429943 (400 connections now open) 2015-10-05T07:56:17.871+0100 [conn1429943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:19.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:56:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:56:22.084+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:56:22.084+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:56:25.933+0100 [conn1429567] end connection 172.28.0.164:54195 (399 connections now open) 2015-10-05T07:56:25.933+0100 [conn1429271] end connection 172.28.0.164:53284 (399 connections now open) 2015-10-05T07:56:25.934+0100 [mongosMain] connection accepted from 172.28.0.164:55351 #1429944 (399 connections now open) 2015-10-05T07:56:25.934+0100 [mongosMain] connection accepted from 172.28.0.164:55352 #1429945 (400 connections now open) 2015-10-05T07:56:25.961+0100 [conn1429944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:25.961+0100 [conn1429945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:26.013+0100 [conn1429487] end connection 172.28.0.163:60916 (399 connections now open) 2015-10-05T07:56:26.014+0100 [mongosMain] connection accepted from 172.28.0.163:62345 #1429946 (400 connections now open) 2015-10-05T07:56:26.015+0100 [conn1429946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:26.419+0100 [conn1429552] end connection 172.28.0.163:61126 (399 connections now open) 2015-10-05T07:56:26.420+0100 [mongosMain] connection accepted from 172.28.0.163:62349 #1429947 (400 connections now open) 2015-10-05T07:56:26.421+0100 [conn1429947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:26.576+0100 [conn1429575] end connection 172.28.0.163:61193 (399 connections now open) 2015-10-05T07:56:26.577+0100 [mongosMain] connection accepted from 172.28.0.163:62351 #1429948 (400 connections now open) 2015-10-05T07:56:26.578+0100 [conn1429948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:27.295+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:27.319+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:27.319+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:27.868+0100 [conn1429583] end connection 172.28.0.164:54228 (399 connections now open) 2015-10-05T07:56:27.870+0100 [mongosMain] connection accepted from 172.28.0.164:55356 #1429949 (400 connections now open) 2015-10-05T07:56:27.871+0100 [conn1429949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:28.251+0100 [mongosMain] connection accepted from 127.0.0.1:62353 #1429950 (401 connections now open) 2015-10-05T07:56:28.253+0100 [conn1429950] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:28.259+0100 [conn1429950] end connection 127.0.0.1:62353 (400 connections now open) 2015-10-05T07:56:28.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f1c5703b51053ed5517 2015-10-05T07:56:28.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:56:35.950+0100 [conn1429573] end connection 172.28.0.164:54210 (399 connections now open) 2015-10-05T07:56:35.953+0100 [mongosMain] connection accepted from 172.28.0.164:55369 #1429951 (400 connections now open) 2015-10-05T07:56:35.955+0100 [conn1429951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:36.014+0100 [conn1429493] end connection 172.28.0.163:60948 (399 connections now open) 2015-10-05T07:56:36.016+0100 [mongosMain] connection accepted from 172.28.0.163:62357 #1429952 (400 connections now open) 2015-10-05T07:56:36.017+0100 [conn1429952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:36.591+0100 [conn1429582] end connection 172.28.0.163:61212 (399 connections now open) 2015-10-05T07:56:36.592+0100 [mongosMain] connection accepted from 172.28.0.163:62358 #1429953 (400 connections now open) 2015-10-05T07:56:36.593+0100 [conn1429953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:37.182+0100 [conn1429542] end connection 172.28.0.164:54127 (399 connections now open) 2015-10-05T07:56:37.183+0100 [mongosMain] connection accepted from 172.28.0.164:55373 #1429954 (400 connections now open) 2015-10-05T07:56:37.184+0100 [conn1429954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:37.337+0100 [conn1429561] end connection 172.28.0.163:61144 (399 connections now open) 2015-10-05T07:56:37.341+0100 [mongosMain] connection accepted from 172.28.0.163:62363 #1429955 (400 connections now open) 2015-10-05T07:56:37.342+0100 [conn1429955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:37.883+0100 [conn1429589] end connection 172.28.0.164:54249 (399 connections now open) 2015-10-05T07:56:37.884+0100 [mongosMain] connection accepted from 172.28.0.164:55375 #1429956 (400 connections now open) 2015-10-05T07:56:37.885+0100 [conn1429956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:38.378+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:39.188+0100 [mongosMain] connection accepted from 127.0.0.1:62365 #1429957 (401 connections now open) 2015-10-05T07:56:39.191+0100 [conn1429957] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:39.195+0100 [conn1429957] end connection 127.0.0.1:62365 (400 connections now open) 2015-10-05T07:56:39.319+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:39.319+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:41.322+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:41.322+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:44.324+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:44.324+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:45.966+0100 [conn1429539] end connection 172.28.0.164:54122 (399 connections now open) 2015-10-05T07:56:45.966+0100 [mongosMain] connection accepted from 172.28.0.164:55388 #1429958 (400 connections now open) 2015-10-05T07:56:45.968+0100 [conn1429958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:46.029+0100 [conn1429555] end connection 172.28.0.163:61130 (399 connections now open) 2015-10-05T07:56:46.030+0100 [mongosMain] connection accepted from 172.28.0.163:62375 #1429959 (400 connections now open) 2015-10-05T07:56:46.032+0100 [conn1429959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:46.607+0100 [conn1429588] end connection 172.28.0.163:61229 (399 connections now open) 2015-10-05T07:56:46.609+0100 [mongosMain] connection accepted from 172.28.0.163:62376 #1429960 (400 connections now open) 2015-10-05T07:56:46.610+0100 [conn1429960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:47.182+0100 [conn1429535] end connection 172.28.0.164:54115 (399 connections now open) 2015-10-05T07:56:47.183+0100 [mongosMain] connection accepted from 172.28.0.164:55391 #1429961 (400 connections now open) 2015-10-05T07:56:47.185+0100 [conn1429961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:47.364+0100 [conn1429571] end connection 172.28.0.163:61186 (399 connections now open) 2015-10-05T07:56:47.367+0100 [mongosMain] connection accepted from 172.28.0.163:62381 #1429962 (400 connections now open) 2015-10-05T07:56:47.368+0100 [conn1429962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:47.883+0100 [conn1429597] end connection 172.28.0.164:54271 (399 connections now open) 2015-10-05T07:56:47.884+0100 [mongosMain] connection accepted from 172.28.0.164:55394 #1429963 (400 connections now open) 2015-10-05T07:56:47.885+0100 [conn1429963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:48.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:48.328+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:49.488+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:50.132+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:56:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:56:52.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f345703b51053ed5662 2015-10-05T07:56:53.069+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:56:53.416+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:53.416+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:56:55.965+0100 [conn1429554] end connection 172.28.0.164:54162 (399 connections now open) 2015-10-05T07:56:55.966+0100 [mongosMain] connection accepted from 172.28.0.164:55406 #1429964 (400 connections now open) 2015-10-05T07:56:55.968+0100 [conn1429964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:56.236+0100 [conn1429587] end connection 172.28.0.163:61228 (399 connections now open) 2015-10-05T07:56:56.237+0100 [mongosMain] connection accepted from 172.28.0.163:62396 #1429965 (400 connections now open) 2015-10-05T07:56:56.238+0100 [conn1429965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:56.615+0100 [conn1429595] end connection 172.28.0.163:61240 (399 connections now open) 2015-10-05T07:56:56.616+0100 [mongosMain] connection accepted from 172.28.0.163:62397 #1429966 (400 connections now open) 2015-10-05T07:56:56.617+0100 [conn1429966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:57.198+0100 [conn1429528] end connection 172.28.0.164:54099 (399 connections now open) 2015-10-05T07:56:57.199+0100 [mongosMain] connection accepted from 172.28.0.164:55407 #1429967 (400 connections now open) 2015-10-05T07:56:57.200+0100 [conn1429967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:57.463+0100 [conn1429577] end connection 172.28.0.163:61204 (399 connections now open) 2015-10-05T07:56:57.468+0100 [mongosMain] connection accepted from 172.28.0.163:62402 #1429968 (400 connections now open) 2015-10-05T07:56:57.469+0100 [conn1429968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:57.899+0100 [conn1429605] end connection 172.28.0.164:54295 (399 connections now open) 2015-10-05T07:56:57.900+0100 [mongosMain] connection accepted from 172.28.0.164:55409 #1429969 (400 connections now open) 2015-10-05T07:56:57.902+0100 [conn1429969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:56:59.429+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:56:59.430+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:00.567+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:05.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f415703b51053ed56b5 2015-10-05T07:57:05.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:57:05.980+0100 [conn1429579] end connection 172.28.0.164:54221 (399 connections now open) 2015-10-05T07:57:05.980+0100 [conn1429593] end connection 172.28.0.164:54263 (398 connections now open) 2015-10-05T07:57:05.981+0100 [mongosMain] connection accepted from 172.28.0.164:55422 #1429970 (399 connections now open) 2015-10-05T07:57:05.981+0100 [mongosMain] connection accepted from 172.28.0.164:55421 #1429971 (400 connections now open) 2015-10-05T07:57:05.983+0100 [conn1429970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:05.983+0100 [conn1429971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:06.045+0100 [conn1429594] end connection 172.28.0.163:61239 (399 connections now open) 2015-10-05T07:57:06.046+0100 [mongosMain] connection accepted from 172.28.0.163:62422 #1429972 (400 connections now open) 2015-10-05T07:57:06.047+0100 [conn1429972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:06.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:06.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:06.622+0100 [conn1429603] end connection 172.28.0.163:61256 (399 connections now open) 2015-10-05T07:57:06.624+0100 [mongosMain] connection accepted from 172.28.0.163:62424 #1429973 (400 connections now open) 2015-10-05T07:57:06.625+0100 [conn1429973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:07.213+0100 [conn1429596] end connection 172.28.0.164:54268 (399 connections now open) 2015-10-05T07:57:07.214+0100 [mongosMain] connection accepted from 172.28.0.164:55425 #1429974 (400 connections now open) 2015-10-05T07:57:07.215+0100 [conn1429974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:07.452+0100 [conn1429565] end connection 172.28.0.163:61161 (399 connections now open) 2015-10-05T07:57:07.452+0100 [conn1429553] end connection 172.28.0.163:61127 (399 connections now open) 2015-10-05T07:57:07.453+0100 [mongosMain] connection accepted from 172.28.0.163:62426 #1429975 (399 connections now open) 2015-10-05T07:57:07.453+0100 [mongosMain] connection accepted from 172.28.0.163:62427 #1429976 (400 connections now open) 2015-10-05T07:57:07.453+0100 [conn1429975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:07.454+0100 [conn1429976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:07.915+0100 [conn1429612] end connection 172.28.0.164:54312 (399 connections now open) 2015-10-05T07:57:07.916+0100 [mongosMain] connection accepted from 172.28.0.164:55427 #1429977 (400 connections now open) 2015-10-05T07:57:07.926+0100 [conn1429977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:11.573+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:11.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f475703b51053ed56d7 2015-10-05T07:57:11.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:57:14.474+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:14.475+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:15.996+0100 [conn1429517] end connection 172.28.0.164:54077 (399 connections now open) 2015-10-05T07:57:15.996+0100 [conn1429475] end connection 172.28.0.164:53956 (398 connections now open) 2015-10-05T07:57:15.997+0100 [mongosMain] connection accepted from 172.28.0.164:55434 #1429978 (399 connections now open) 2015-10-05T07:57:15.998+0100 [mongosMain] connection accepted from 172.28.0.164:55433 #1429979 (400 connections now open) 2015-10-05T07:57:15.999+0100 [conn1429978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:15.999+0100 [conn1429979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:16.061+0100 [conn1429568] end connection 172.28.0.163:61166 (399 connections now open) 2015-10-05T07:57:16.062+0100 [mongosMain] connection accepted from 172.28.0.163:62441 #1429980 (400 connections now open) 2015-10-05T07:57:16.063+0100 [conn1429980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:16.623+0100 [conn1429610] end connection 172.28.0.163:61276 (399 connections now open) 2015-10-05T07:57:16.624+0100 [mongosMain] connection accepted from 172.28.0.163:62443 #1429981 (400 connections now open) 2015-10-05T07:57:16.625+0100 [conn1429981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:17.232+0100 [conn1429507] end connection 172.28.0.164:54039 (399 connections now open) 2015-10-05T07:57:17.233+0100 [mongosMain] connection accepted from 172.28.0.164:55438 #1429982 (400 connections now open) 2015-10-05T07:57:17.235+0100 [conn1429982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:17.467+0100 [conn1429492] end connection 172.28.0.163:60942 (399 connections now open) 2015-10-05T07:57:17.467+0100 [conn1429584] end connection 172.28.0.163:61224 (398 connections now open) 2015-10-05T07:57:17.468+0100 [mongosMain] connection accepted from 172.28.0.163:62446 #1429983 (399 connections now open) 2015-10-05T07:57:17.469+0100 [mongosMain] connection accepted from 172.28.0.163:62447 #1429984 (400 connections now open) 2015-10-05T07:57:17.470+0100 [conn1429983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:17.470+0100 [conn1429984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:17.917+0100 [conn1429619] end connection 172.28.0.164:54335 (399 connections now open) 2015-10-05T07:57:17.918+0100 [mongosMain] connection accepted from 172.28.0.164:55440 #1429985 (400 connections now open) 2015-10-05T07:57:17.920+0100 [conn1429985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:20.403+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:57:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:57:22.620+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:23.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:23.498+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:26.013+0100 [conn1429523] end connection 172.28.0.164:54093 (399 connections now open) 2015-10-05T07:57:26.013+0100 [conn1429601] end connection 172.28.0.164:54288 (399 connections now open) 2015-10-05T07:57:26.014+0100 [mongosMain] connection accepted from 172.28.0.164:55454 #1429986 (399 connections now open) 2015-10-05T07:57:26.014+0100 [mongosMain] connection accepted from 172.28.0.164:55453 #1429987 (400 connections now open) 2015-10-05T07:57:26.016+0100 [conn1429986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:26.016+0100 [conn1429987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:26.061+0100 [conn1429547] end connection 172.28.0.163:61116 (399 connections now open) 2015-10-05T07:57:26.062+0100 [mongosMain] connection accepted from 172.28.0.163:62454 #1429988 (400 connections now open) 2015-10-05T07:57:26.064+0100 [conn1429988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:26.638+0100 [conn1429625] end connection 172.28.0.163:61330 (399 connections now open) 2015-10-05T07:57:26.639+0100 [mongosMain] connection accepted from 172.28.0.163:62456 #1429989 (400 connections now open) 2015-10-05T07:57:26.641+0100 [conn1429989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:27.266+0100 [conn1429549] end connection 172.28.0.164:54144 (399 connections now open) 2015-10-05T07:57:27.266+0100 [mongosMain] connection accepted from 172.28.0.164:55457 #1429990 (400 connections now open) 2015-10-05T07:57:27.266+0100 [conn1429990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:27.500+0100 [conn1429591] end connection 172.28.0.163:61235 (399 connections now open) 2015-10-05T07:57:27.500+0100 [conn1429360] end connection 172.28.0.163:60555 (399 connections now open) 2015-10-05T07:57:27.500+0100 [mongosMain] connection accepted from 172.28.0.163:62459 #1429991 (399 connections now open) 2015-10-05T07:57:27.500+0100 [mongosMain] connection accepted from 172.28.0.163:62460 #1429992 (400 connections now open) 2015-10-05T07:57:27.500+0100 [conn1429991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:27.500+0100 [conn1429992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:27.953+0100 [conn1429627] end connection 172.28.0.164:54349 (399 connections now open) 2015-10-05T07:57:27.953+0100 [mongosMain] connection accepted from 172.28.0.164:55462 #1429993 (400 connections now open) 2015-10-05T07:57:27.953+0100 [conn1429993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:28.920+0100 [mongosMain] connection accepted from 127.0.0.1:62463 #1429994 (401 connections now open) 2015-10-05T07:57:28.920+0100 [conn1429994] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:28.920+0100 [conn1429994] end connection 127.0.0.1:62463 (400 connections now open) 2015-10-05T07:57:33.507+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:33.507+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:33.630+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:36.028+0100 [conn1429592] end connection 172.28.0.164:54261 (399 connections now open) 2015-10-05T07:57:36.029+0100 [mongosMain] connection accepted from 172.28.0.164:55471 #1429995 (400 connections now open) 2015-10-05T07:57:36.030+0100 [conn1429995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:36.076+0100 [conn1429617] end connection 172.28.0.163:61305 (399 connections now open) 2015-10-05T07:57:36.077+0100 [mongosMain] connection accepted from 172.28.0.163:62468 #1429996 (400 connections now open) 2015-10-05T07:57:36.078+0100 [conn1429996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:37.259+0100 [conn1429611] end connection 172.28.0.164:54310 (399 connections now open) 2015-10-05T07:57:37.260+0100 [mongosMain] connection accepted from 172.28.0.164:55477 #1429997 (400 connections now open) 2015-10-05T07:57:37.262+0100 [conn1429997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:37.489+0100 [conn1429578] end connection 172.28.0.163:61205 (399 connections now open) 2015-10-05T07:57:37.490+0100 [conn1429545] end connection 172.28.0.163:61113 (398 connections now open) 2015-10-05T07:57:37.491+0100 [mongosMain] connection accepted from 172.28.0.163:62472 #1429998 (399 connections now open) 2015-10-05T07:57:37.491+0100 [mongosMain] connection accepted from 172.28.0.163:62473 #1429999 (400 connections now open) 2015-10-05T07:57:37.492+0100 [conn1429998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:37.492+0100 [conn1429999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:37.947+0100 [conn1429635] end connection 172.28.0.164:54371 (399 connections now open) 2015-10-05T07:57:37.948+0100 [mongosMain] connection accepted from 172.28.0.164:55479 #1430000 (400 connections now open) 2015-10-05T07:57:37.950+0100 [conn1430000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:40.133+0100 [mongosMain] connection accepted from 127.0.0.1:62474 #1430001 (401 connections now open) 2015-10-05T07:57:40.136+0100 [conn1430001] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:40.141+0100 [conn1430001] end connection 127.0.0.1:62474 (400 connections now open) 2015-10-05T07:57:42.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f655703b51053ed57ab 2015-10-05T07:57:42.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:57:44.510+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:44.510+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:44.639+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:46.045+0100 [conn1429615] end connection 172.28.0.164:54330 (399 connections now open) 2015-10-05T07:57:46.046+0100 [mongosMain] connection accepted from 172.28.0.164:55491 #1430002 (400 connections now open) 2015-10-05T07:57:46.048+0100 [conn1430002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:46.077+0100 [conn1429581] end connection 172.28.0.163:61209 (399 connections now open) 2015-10-05T07:57:46.078+0100 [mongosMain] connection accepted from 172.28.0.163:62489 #1430003 (400 connections now open) 2015-10-05T07:57:46.079+0100 [conn1430003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:47.275+0100 [conn1429501] end connection 172.28.0.164:54017 (399 connections now open) 2015-10-05T07:57:47.276+0100 [mongosMain] connection accepted from 172.28.0.164:55494 #1430004 (400 connections now open) 2015-10-05T07:57:47.278+0100 [conn1430004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:47.482+0100 [conn1429629] end connection 172.28.0.163:61337 (399 connections now open) 2015-10-05T07:57:47.482+0100 [conn1429560] end connection 172.28.0.163:61143 (399 connections now open) 2015-10-05T07:57:47.483+0100 [mongosMain] connection accepted from 172.28.0.163:62494 #1430005 (399 connections now open) 2015-10-05T07:57:47.483+0100 [mongosMain] connection accepted from 172.28.0.163:62495 #1430006 (400 connections now open) 2015-10-05T07:57:47.484+0100 [conn1430005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:47.484+0100 [conn1430006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:47.962+0100 [conn1429643] end connection 172.28.0.164:54396 (399 connections now open) 2015-10-05T07:57:47.963+0100 [mongosMain] connection accepted from 172.28.0.164:55497 #1430007 (400 connections now open) 2015-10-05T07:57:47.965+0100 [conn1430007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:48.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f6c5703b51053ed57fa 2015-10-05T07:57:48.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:57:51.747+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:57:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:57:54.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f725703b51053ed5852 2015-10-05T07:57:54.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:57:55.643+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:56.516+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:56.516+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:57:56.654+0100 [conn1429633] end connection 172.28.0.163:61344 (399 connections now open) 2015-10-05T07:57:56.655+0100 [mongosMain] connection accepted from 172.28.0.163:62508 #1430008 (400 connections now open) 2015-10-05T07:57:56.657+0100 [conn1430008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:57.140+0100 [conn1429616] end connection 172.28.0.164:54331 (399 connections now open) 2015-10-05T07:57:57.143+0100 [mongosMain] connection accepted from 172.28.0.164:55509 #1430009 (400 connections now open) 2015-10-05T07:57:57.145+0100 [conn1430009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:57.959+0100 [mongosMain] connection accepted from 172.28.0.164:55511 #1430010 (401 connections now open) 2015-10-05T07:57:57.960+0100 [conn1429604] end connection 172.28.0.164:54291 (400 connections now open) 2015-10-05T07:57:57.966+0100 [conn1430010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:57.978+0100 [conn1429650] end connection 172.28.0.164:54415 (399 connections now open) 2015-10-05T07:57:57.980+0100 [mongosMain] connection accepted from 172.28.0.164:55512 #1430011 (400 connections now open) 2015-10-05T07:57:57.981+0100 [conn1430011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:58.333+0100 [conn1429620] end connection 172.28.0.163:61320 (399 connections now open) 2015-10-05T07:57:58.334+0100 [conn1429525] end connection 172.28.0.163:61032 (399 connections now open) 2015-10-05T07:57:58.334+0100 [mongosMain] connection accepted from 172.28.0.163:62512 #1430012 (399 connections now open) 2015-10-05T07:57:58.335+0100 [mongosMain] connection accepted from 172.28.0.163:62513 #1430013 (400 connections now open) 2015-10-05T07:57:58.335+0100 [conn1430012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:58.335+0100 [conn1430013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:57:58.592+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:57:58.593+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:01.001+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56121f7826fd57ee9939239f') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444028280930), why: "doing balance round", ts: ObjectId('56121f785703b51053ed58a9') } } gle1: { lastOp: Timestamp 1444028274000|13, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1444028280000|10, connectionId: 5195, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2015-10-05T07:58:01.005+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T07:58:01.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f785703b51053ed58a9 2015-10-05T07:58:01.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:58:01.601+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:01.602+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:05.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:05.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:06.094+0100 [conn1429602] end connection 172.28.0.163:61254 (399 connections now open) 2015-10-05T07:58:06.096+0100 [mongosMain] connection accepted from 172.28.0.163:62545 #1430014 (400 connections now open) 2015-10-05T07:58:06.097+0100 [conn1430014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:06.652+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:06.669+0100 [conn1429655] end connection 172.28.0.163:61396 (399 connections now open) 2015-10-05T07:58:06.670+0100 [mongosMain] connection accepted from 172.28.0.163:62555 #1430015 (400 connections now open) 2015-10-05T07:58:06.671+0100 [conn1430015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:07.026+0100 [conn1429607] end connection 172.28.0.164:54306 (399 connections now open) 2015-10-05T07:58:07.027+0100 [mongosMain] connection accepted from 172.28.0.164:55529 #1430016 (400 connections now open) 2015-10-05T07:58:07.029+0100 [conn1430016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:07.307+0100 [conn1429626] end connection 172.28.0.164:54346 (399 connections now open) 2015-10-05T07:58:07.308+0100 [mongosMain] connection accepted from 172.28.0.164:55530 #1430017 (400 connections now open) 2015-10-05T07:58:07.310+0100 [conn1430017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:07.993+0100 [conn1429657] end connection 172.28.0.164:54437 (399 connections now open) 2015-10-05T07:58:07.994+0100 [mongosMain] connection accepted from 172.28.0.164:55532 #1430018 (400 connections now open) 2015-10-05T07:58:07.995+0100 [conn1430018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:08.339+0100 [conn1429566] end connection 172.28.0.163:61162 (399 connections now open) 2015-10-05T07:58:08.339+0100 [conn1429613] end connection 172.28.0.163:61298 (399 connections now open) 2015-10-05T07:58:08.340+0100 [mongosMain] connection accepted from 172.28.0.163:62561 #1430019 (399 connections now open) 2015-10-05T07:58:08.340+0100 [mongosMain] connection accepted from 172.28.0.163:62562 #1430020 (400 connections now open) 2015-10-05T07:58:08.341+0100 [conn1430019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:08.341+0100 [conn1430020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:10.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:10.652+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:16.108+0100 [conn1429609] end connection 172.28.0.163:61274 (399 connections now open) 2015-10-05T07:58:16.109+0100 [mongosMain] connection accepted from 172.28.0.163:62574 #1430021 (400 connections now open) 2015-10-05T07:58:16.109+0100 [conn1430021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:16.675+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:16.675+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:16.685+0100 [conn1429662] end connection 172.28.0.163:61425 (399 connections now open) 2015-10-05T07:58:16.687+0100 [mongosMain] connection accepted from 172.28.0.163:62578 #1430022 (400 connections now open) 2015-10-05T07:58:16.688+0100 [conn1430022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:17.042+0100 [conn1429639] end connection 172.28.0.164:54386 (399 connections now open) 2015-10-05T07:58:17.042+0100 [conn1429653] end connection 172.28.0.164:54431 (398 connections now open) 2015-10-05T07:58:17.043+0100 [mongosMain] connection accepted from 172.28.0.164:55542 #1430023 (399 connections now open) 2015-10-05T07:58:17.043+0100 [mongosMain] connection accepted from 172.28.0.164:55543 #1430024 (400 connections now open) 2015-10-05T07:58:17.045+0100 [conn1430024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:17.045+0100 [conn1430023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:17.323+0100 [conn1429557] end connection 172.28.0.164:54165 (399 connections now open) 2015-10-05T07:58:17.324+0100 [mongosMain] connection accepted from 172.28.0.164:55544 #1430025 (400 connections now open) 2015-10-05T07:58:17.325+0100 [conn1430025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:17.673+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:18.012+0100 [conn1429664] end connection 172.28.0.164:54460 (399 connections now open) 2015-10-05T07:58:18.014+0100 [mongosMain] connection accepted from 172.28.0.164:55546 #1430026 (400 connections now open) 2015-10-05T07:58:18.015+0100 [conn1430026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:18.339+0100 [conn1429406] end connection 172.28.0.163:60679 (399 connections now open) 2015-10-05T07:58:18.339+0100 [conn1429638] end connection 172.28.0.163:61350 (399 connections now open) 2015-10-05T07:58:18.340+0100 [mongosMain] connection accepted from 172.28.0.163:62580 #1430027 (399 connections now open) 2015-10-05T07:58:18.341+0100 [mongosMain] connection accepted from 172.28.0.163:62581 #1430028 (400 connections now open) 2015-10-05T07:58:18.341+0100 [conn1430027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:18.342+0100 [conn1430028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:19.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f8b5703b51053ed5a12 2015-10-05T07:58:19.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:58:21.989+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:58:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:58:23.682+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:23.683+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:25.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f915703b51053ed5a77 2015-10-05T07:58:25.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:58:26.111+0100 [conn1429641] end connection 172.28.0.163:61356 (399 connections now open) 2015-10-05T07:58:26.117+0100 [mongosMain] connection accepted from 172.28.0.163:62589 #1430029 (400 connections now open) 2015-10-05T07:58:26.118+0100 [conn1430029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:26.686+0100 [conn1429670] end connection 172.28.0.163:61442 (399 connections now open) 2015-10-05T07:58:26.687+0100 [mongosMain] connection accepted from 172.28.0.163:62591 #1430030 (400 connections now open) 2015-10-05T07:58:26.688+0100 [conn1430030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:27.059+0100 [conn1429660] end connection 172.28.0.164:54454 (399 connections now open) 2015-10-05T07:58:27.060+0100 [mongosMain] connection accepted from 172.28.0.164:55565 #1430031 (400 connections now open) 2015-10-05T07:58:27.063+0100 [conn1430031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:28.025+0100 [conn1429672] end connection 172.28.0.164:54476 (399 connections now open) 2015-10-05T07:58:28.026+0100 [mongosMain] connection accepted from 172.28.0.164:55568 #1430032 (400 connections now open) 2015-10-05T07:58:28.029+0100 [conn1430032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:28.354+0100 [conn1429498] end connection 172.28.0.163:60966 (399 connections now open) 2015-10-05T07:58:28.354+0100 [conn1429651] end connection 172.28.0.163:61392 (399 connections now open) 2015-10-05T07:58:28.355+0100 [mongosMain] connection accepted from 172.28.0.163:62595 #1430033 (399 connections now open) 2015-10-05T07:58:28.356+0100 [mongosMain] connection accepted from 172.28.0.163:62596 #1430034 (400 connections now open) 2015-10-05T07:58:28.356+0100 [conn1430033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:28.357+0100 [conn1430034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:28.681+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:29.082+0100 [mongosMain] connection accepted from 127.0.0.1:62598 #1430035 (401 connections now open) 2015-10-05T07:58:29.086+0100 [conn1430035] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:29.092+0100 [conn1430035] end connection 127.0.0.1:62598 (400 connections now open) 2015-10-05T07:58:31.685+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:31.685+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:36.124+0100 [conn1429624] end connection 172.28.0.163:61327 (399 connections now open) 2015-10-05T07:58:36.125+0100 [mongosMain] connection accepted from 172.28.0.163:62602 #1430036 (400 connections now open) 2015-10-05T07:58:36.126+0100 [conn1430036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:36.701+0100 [conn1429676] end connection 172.28.0.163:61452 (399 connections now open) 2015-10-05T07:58:36.702+0100 [mongosMain] connection accepted from 172.28.0.163:62604 #1430037 (400 connections now open) 2015-10-05T07:58:36.703+0100 [conn1430037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:37.074+0100 [conn1429640] end connection 172.28.0.164:54387 (399 connections now open) 2015-10-05T07:58:37.075+0100 [mongosMain] connection accepted from 172.28.0.164:55582 #1430038 (400 connections now open) 2015-10-05T07:58:37.077+0100 [conn1430038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:37.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121f9d5703b51053ed5b68 2015-10-05T07:58:38.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:58:38.041+0100 [conn1429677] end connection 172.28.0.164:54495 (399 connections now open) 2015-10-05T07:58:38.042+0100 [mongosMain] connection accepted from 172.28.0.164:55586 #1430039 (400 connections now open) 2015-10-05T07:58:38.044+0100 [conn1430039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:38.355+0100 [conn1429673] end connection 172.28.0.163:61448 (399 connections now open) 2015-10-05T07:58:38.355+0100 [conn1429505] end connection 172.28.0.163:60982 (399 connections now open) 2015-10-05T07:58:38.356+0100 [mongosMain] connection accepted from 172.28.0.163:62606 #1430040 (399 connections now open) 2015-10-05T07:58:38.357+0100 [mongosMain] connection accepted from 172.28.0.163:62607 #1430041 (400 connections now open) 2015-10-05T07:58:38.357+0100 [conn1430040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:38.358+0100 [conn1430041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:39.703+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:40.195+0100 [mongosMain] connection accepted from 127.0.0.1:62612 #1430042 (401 connections now open) 2015-10-05T07:58:40.198+0100 [conn1430042] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:40.203+0100 [conn1430042] end connection 127.0.0.1:62612 (400 connections now open) 2015-10-05T07:58:40.687+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:40.687+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:44.321+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:58:44.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:58:46.700+0100 [conn1429682] end connection 172.28.0.163:61467 (399 connections now open) 2015-10-05T07:58:46.701+0100 [mongosMain] connection accepted from 172.28.0.163:62621 #1430043 (400 connections now open) 2015-10-05T07:58:46.702+0100 [conn1430043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:47.106+0100 [conn1429668] end connection 172.28.0.164:54470 (399 connections now open) 2015-10-05T07:58:47.107+0100 [mongosMain] connection accepted from 172.28.0.164:55601 #1430044 (400 connections now open) 2015-10-05T07:58:47.109+0100 [conn1430044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:47.355+0100 [conn1429671] end connection 172.28.0.164:54474 (399 connections now open) 2015-10-05T07:58:47.356+0100 [mongosMain] connection accepted from 172.28.0.164:55602 #1430045 (400 connections now open) 2015-10-05T07:58:47.358+0100 [conn1430045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:48.381+0100 [conn1429665] end connection 172.28.0.163:61434 (399 connections now open) 2015-10-05T07:58:48.383+0100 [mongosMain] connection accepted from 172.28.0.163:62624 #1430046 (400 connections now open) 2015-10-05T07:58:48.384+0100 [conn1430046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:50.694+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:50.695+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:58:50.725+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:58:52.275+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:58:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:58:56.142+0100 [conn1429669] end connection 172.28.0.163:61440 (399 connections now open) 2015-10-05T07:58:56.143+0100 [mongosMain] connection accepted from 172.28.0.163:62635 #1430047 (400 connections now open) 2015-10-05T07:58:56.144+0100 [conn1430047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:56.718+0100 [conn1429688] end connection 172.28.0.163:61485 (399 connections now open) 2015-10-05T07:58:56.719+0100 [mongosMain] connection accepted from 172.28.0.163:62637 #1430048 (400 connections now open) 2015-10-05T07:58:56.720+0100 [conn1430048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:57.319+0100 [conn1429622] end connection 172.28.0.164:54342 (399 connections now open) 2015-10-05T07:58:57.371+0100 [conn1429649] end connection 172.28.0.164:54412 (398 connections now open) 2015-10-05T07:58:57.372+0100 [mongosMain] connection accepted from 172.28.0.164:55616 #1430049 (399 connections now open) 2015-10-05T07:58:57.374+0100 [conn1430049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:57.402+0100 [mongosMain] connection accepted from 172.28.0.164:55617 #1430050 (400 connections now open) 2015-10-05T07:58:57.405+0100 [conn1430050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:58:58.506+0100 [conn1429606] end connection 172.28.0.163:61267 (399 connections now open) 2015-10-05T07:58:58.507+0100 [mongosMain] connection accepted from 172.28.0.163:62641 #1430051 (400 connections now open) 2015-10-05T07:58:58.508+0100 [conn1430051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:01.705+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:01.705+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:01.730+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:02.720+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:59:02.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:59:06.155+0100 [conn1429632] end connection 172.28.0.163:61341 (399 connections now open) 2015-10-05T07:59:06.156+0100 [mongosMain] connection accepted from 172.28.0.163:62658 #1430052 (400 connections now open) 2015-10-05T07:59:06.158+0100 [conn1430052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:07.309+0100 [conn1429630] end connection 172.28.0.164:54363 (399 connections now open) 2015-10-05T07:59:07.310+0100 [mongosMain] connection accepted from 172.28.0.164:55629 #1430053 (400 connections now open) 2015-10-05T07:59:07.313+0100 [conn1430053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:07.386+0100 [conn1429634] end connection 172.28.0.164:54368 (399 connections now open) 2015-10-05T07:59:07.388+0100 [mongosMain] connection accepted from 172.28.0.164:55630 #1430054 (400 connections now open) 2015-10-05T07:59:07.389+0100 [conn1430054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:08.495+0100 [conn1429646] end connection 172.28.0.163:61372 (399 connections now open) 2015-10-05T07:59:08.496+0100 [mongosMain] connection accepted from 172.28.0.163:62663 #1430055 (400 connections now open) 2015-10-05T07:59:08.497+0100 [conn1430055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:08.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fbc5703b51053ed5d82 2015-10-05T07:59:08.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:59:12.788+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:13.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:13.710+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:15.780+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:15.781+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:16.156+0100 [conn1429675] end connection 172.28.0.163:61450 (399 connections now open) 2015-10-05T07:59:16.157+0100 [mongosMain] connection accepted from 172.28.0.163:62673 #1430056 (400 connections now open) 2015-10-05T07:59:16.158+0100 [conn1430056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:16.733+0100 [conn1429698] end connection 172.28.0.163:61538 (399 connections now open) 2015-10-05T07:59:16.734+0100 [mongosMain] connection accepted from 172.28.0.163:62676 #1430057 (400 connections now open) 2015-10-05T07:59:16.735+0100 [conn1430057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:17.403+0100 [conn1429642] end connection 172.28.0.164:54391 (399 connections now open) 2015-10-05T07:59:17.404+0100 [mongosMain] connection accepted from 172.28.0.164:55638 #1430058 (400 connections now open) 2015-10-05T07:59:17.406+0100 [conn1430058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:17.728+0100 [conn1429647] end connection 172.28.0.164:54406 (399 connections now open) 2015-10-05T07:59:17.731+0100 [mongosMain] connection accepted from 172.28.0.164:55641 #1430059 (400 connections now open) 2015-10-05T07:59:17.732+0100 [conn1430059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:18.496+0100 [conn1429599] end connection 172.28.0.163:61250 (399 connections now open) 2015-10-05T07:59:18.497+0100 [mongosMain] connection accepted from 172.28.0.163:62680 #1430060 (400 connections now open) 2015-10-05T07:59:18.498+0100 [conn1430060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:18.781+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:18.782+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:21.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fc95703b51053ed5e2c 2015-10-05T07:59:21.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:59:22.425+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:59:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:59:22.807+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:22.807+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:23.824+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:26.171+0100 [conn1429702] end connection 172.28.0.163:61552 (399 connections now open) 2015-10-05T07:59:26.173+0100 [mongosMain] connection accepted from 172.28.0.163:62687 #1430061 (400 connections now open) 2015-10-05T07:59:26.174+0100 [conn1430061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:27.417+0100 [conn1429699] end connection 172.28.0.164:54569 (399 connections now open) 2015-10-05T07:59:27.418+0100 [mongosMain] connection accepted from 172.28.0.164:55662 #1430062 (400 connections now open) 2015-10-05T07:59:27.419+0100 [conn1430062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:27.840+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:27.840+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:28.247+0100 [mongosMain] connection accepted from 127.0.0.1:62690 #1430063 (401 connections now open) 2015-10-05T07:59:28.250+0100 [conn1430063] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:28.255+0100 [conn1430063] end connection 127.0.0.1:62690 (400 connections now open) 2015-10-05T07:59:28.511+0100 [conn1429679] end connection 172.28.0.163:61461 (399 connections now open) 2015-10-05T07:59:28.512+0100 [mongosMain] connection accepted from 172.28.0.163:62693 #1430064 (400 connections now open) 2015-10-05T07:59:28.513+0100 [conn1430064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:33.726+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T07:59:33.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T07:59:33.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:33.893+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:34.838+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:36.172+0100 [conn1429697] end connection 172.28.0.163:61535 (399 connections now open) 2015-10-05T07:59:36.173+0100 [mongosMain] connection accepted from 172.28.0.163:62698 #1430065 (400 connections now open) 2015-10-05T07:59:36.174+0100 [conn1430065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:37.433+0100 [conn1429663] end connection 172.28.0.164:54458 (399 connections now open) 2015-10-05T07:59:37.434+0100 [mongosMain] connection accepted from 172.28.0.164:55683 #1430066 (400 connections now open) 2015-10-05T07:59:37.436+0100 [conn1430066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:38.512+0100 [conn1429689] end connection 172.28.0.163:61496 (399 connections now open) 2015-10-05T07:59:38.513+0100 [mongosMain] connection accepted from 172.28.0.163:62700 #1430067 (400 connections now open) 2015-10-05T07:59:38.514+0100 [conn1430067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:39.477+0100 [mongosMain] connection accepted from 127.0.0.1:62702 #1430068 (401 connections now open) 2015-10-05T07:59:39.480+0100 [conn1430068] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:39.484+0100 [conn1430068] end connection 127.0.0.1:62702 (400 connections now open) 2015-10-05T07:59:40.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fdb5703b51053ed5f3f 2015-10-05T07:59:40.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:59:40.930+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:40.930+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:45.858+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:46.207+0100 [conn1429691] end connection 172.28.0.163:61501 (399 connections now open) 2015-10-05T07:59:46.208+0100 [mongosMain] connection accepted from 172.28.0.163:62712 #1430069 (400 connections now open) 2015-10-05T07:59:46.210+0100 [conn1430069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:47.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fe25703b51053ed5fa7 2015-10-05T07:59:47.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:59:47.448+0100 [conn1429693] end connection 172.28.0.164:54547 (399 connections now open) 2015-10-05T07:59:47.449+0100 [mongosMain] connection accepted from 172.28.0.164:55700 #1430070 (400 connections now open) 2015-10-05T07:59:47.453+0100 [conn1430070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:48.527+0100 [conn1429694] end connection 172.28.0.163:61528 (399 connections now open) 2015-10-05T07:59:48.528+0100 [mongosMain] connection accepted from 172.28.0.163:62717 #1430071 (400 connections now open) 2015-10-05T07:59:48.530+0100 [conn1430071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:48.934+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:48.934+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:52.686+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 07:59:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T07:59:53.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fe95703b51053ed6007 2015-10-05T07:59:53.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T07:59:56.188+0100 [conn1429687] end connection 172.28.0.163:61483 (399 connections now open) 2015-10-05T07:59:56.190+0100 [mongosMain] connection accepted from 172.28.0.163:62729 #1430072 (400 connections now open) 2015-10-05T07:59:56.191+0100 [conn1430072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:56.861+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:57.464+0100 [conn1429703] end connection 172.28.0.164:54579 (399 connections now open) 2015-10-05T07:59:57.465+0100 [mongosMain] connection accepted from 172.28.0.164:55709 #1430073 (400 connections now open) 2015-10-05T07:59:57.467+0100 [conn1430073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:57.933+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T07:59:57.933+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T07:59:58.836+0100 [conn1429700] end connection 172.28.0.163:61546 (399 connections now open) 2015-10-05T07:59:58.841+0100 [mongosMain] connection accepted from 172.28.0.163:62736 #1430074 (400 connections now open) 2015-10-05T07:59:58.842+0100 [conn1430074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T07:59:59.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121fef5703b51053ed6062 2015-10-05T08:00:00.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:06.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56121ff65703b51053ed6172 2015-10-05T08:00:06.203+0100 [conn1429681] end connection 172.28.0.163:61464 (399 connections now open) 2015-10-05T08:00:06.204+0100 [mongosMain] connection accepted from 172.28.0.163:62769 #1430075 (400 connections now open) 2015-10-05T08:00:06.205+0100 [conn1430075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:06.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:07.480+0100 [conn1429656] end connection 172.28.0.164:54436 (399 connections now open) 2015-10-05T08:00:07.483+0100 [mongosMain] connection accepted from 172.28.0.164:55738 #1430076 (400 connections now open) 2015-10-05T08:00:07.485+0100 [conn1430076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:07.879+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:08.033+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:08.034+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:12.395+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:00:12.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:00:16.217+0100 [conn1429720] end connection 172.28.0.163:61610 (399 connections now open) 2015-10-05T08:00:16.218+0100 [mongosMain] connection accepted from 172.28.0.163:62782 #1430077 (400 connections now open) 2015-10-05T08:00:16.220+0100 [conn1430077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:16.781+0100 [conn1429692] end connection 172.28.0.163:61504 (399 connections now open) 2015-10-05T08:00:16.781+0100 [mongosMain] connection accepted from 172.28.0.163:62783 #1430078 (400 connections now open) 2015-10-05T08:00:16.782+0100 [conn1430078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:18.167+0100 [conn1429704] end connection 172.28.0.164:54582 (399 connections now open) 2015-10-05T08:00:18.168+0100 [mongosMain] connection accepted from 172.28.0.164:55747 #1430079 (400 connections now open) 2015-10-05T08:00:18.170+0100 [conn1430079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:18.260+0100 [conn1429701] end connection 172.28.0.164:54576 (399 connections now open) 2015-10-05T08:00:18.261+0100 [mongosMain] connection accepted from 172.28.0.164:55748 #1430080 (400 connections now open) 2015-10-05T08:00:18.263+0100 [conn1430080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:18.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220025703b51053ed6488 2015-10-05T08:00:18.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:18.918+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:19.045+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:19.045+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:22.846+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:00:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:00:26.796+0100 [conn1429731] end connection 172.28.0.163:61659 (399 connections now open) 2015-10-05T08:00:26.797+0100 [mongosMain] connection accepted from 172.28.0.163:62795 #1430081 (400 connections now open) 2015-10-05T08:00:26.798+0100 [conn1430081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:27.480+0100 [conn1429721] end connection 172.28.0.164:54651 (399 connections now open) 2015-10-05T08:00:27.481+0100 [mongosMain] connection accepted from 172.28.0.164:55766 #1430082 (400 connections now open) 2015-10-05T08:00:27.482+0100 [conn1430082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:28.275+0100 [conn1429696] end connection 172.28.0.164:54566 (399 connections now open) 2015-10-05T08:00:28.275+0100 [mongosMain] connection accepted from 172.28.0.164:55768 #1430083 (400 connections now open) 2015-10-05T08:00:28.277+0100 [conn1430083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:28.810+0100 [mongosMain] connection accepted from 127.0.0.1:62796 #1430084 (401 connections now open) 2015-10-05T08:00:28.813+0100 [conn1430084] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:28.819+0100 [conn1430084] end connection 127.0.0.1:62796 (400 connections now open) 2015-10-05T08:00:29.931+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:31.047+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:31.047+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:31.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612200e5703b51053ed6804 2015-10-05T08:00:31.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:33.050+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:33.050+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:36.169+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:36.169+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:36.233+0100 [conn1429725] end connection 172.28.0.163:61639 (399 connections now open) 2015-10-05T08:00:36.234+0100 [mongosMain] connection accepted from 172.28.0.163:62807 #1430085 (400 connections now open) 2015-10-05T08:00:36.235+0100 [conn1430085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:36.796+0100 [conn1429737] end connection 172.28.0.163:61672 (399 connections now open) 2015-10-05T08:00:36.797+0100 [mongosMain] connection accepted from 172.28.0.163:62808 #1430086 (400 connections now open) 2015-10-05T08:00:36.798+0100 [conn1430086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:37.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220155703b51053ed699b 2015-10-05T08:00:37.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:37.497+0100 [conn1429618] end connection 172.28.0.164:54333 (399 connections now open) 2015-10-05T08:00:37.498+0100 [mongosMain] connection accepted from 172.28.0.164:55781 #1430087 (400 connections now open) 2015-10-05T08:00:37.499+0100 [conn1430087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:38.198+0100 [conn1429683] end connection 172.28.0.164:54514 (399 connections now open) 2015-10-05T08:00:38.199+0100 [mongosMain] connection accepted from 172.28.0.164:55785 #1430088 (400 connections now open) 2015-10-05T08:00:38.200+0100 [conn1430088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:38.276+0100 [conn1429690] end connection 172.28.0.164:54545 (399 connections now open) 2015-10-05T08:00:38.277+0100 [mongosMain] connection accepted from 172.28.0.164:55786 #1430089 (400 connections now open) 2015-10-05T08:00:38.279+0100 [conn1430089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:39.472+0100 [mongosMain] connection accepted from 127.0.0.1:62812 #1430090 (401 connections now open) 2015-10-05T08:00:39.475+0100 [conn1430090] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:39.479+0100 [conn1430090] end connection 127.0.0.1:62812 (400 connections now open) 2015-10-05T08:00:40.259+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:40.260+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:40.940+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:43.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612201b5703b51053ed6b8b 2015-10-05T08:00:43.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:45.265+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:45.265+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:46.235+0100 [conn1429717] end connection 172.28.0.163:61593 (399 connections now open) 2015-10-05T08:00:46.236+0100 [mongosMain] connection accepted from 172.28.0.163:62822 #1430091 (400 connections now open) 2015-10-05T08:00:46.237+0100 [conn1430091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:46.810+0100 [conn1429744] end connection 172.28.0.163:61697 (399 connections now open) 2015-10-05T08:00:46.811+0100 [mongosMain] connection accepted from 172.28.0.163:62824 #1430092 (400 connections now open) 2015-10-05T08:00:46.812+0100 [conn1430092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:47.495+0100 [conn1429718] end connection 172.28.0.164:54637 (399 connections now open) 2015-10-05T08:00:47.496+0100 [mongosMain] connection accepted from 172.28.0.164:55804 #1430093 (400 connections now open) 2015-10-05T08:00:47.498+0100 [conn1430093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:48.198+0100 [conn1429746] end connection 172.28.0.164:54722 (399 connections now open) 2015-10-05T08:00:48.199+0100 [mongosMain] connection accepted from 172.28.0.164:55807 #1430094 (400 connections now open) 2015-10-05T08:00:48.202+0100 [conn1430094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:48.277+0100 [conn1429608] end connection 172.28.0.164:54307 (399 connections now open) 2015-10-05T08:00:48.278+0100 [mongosMain] connection accepted from 172.28.0.164:55809 #1430095 (400 connections now open) 2015-10-05T08:00:48.279+0100 [conn1430095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:50.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220215703b51053ed6d28 2015-10-05T08:00:50.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:00:51.271+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:51.271+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:00:51.948+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:53.005+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:00:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:00:57.512+0100 [conn1429745] end connection 172.28.0.164:54717 (399 connections now open) 2015-10-05T08:00:57.513+0100 [mongosMain] connection accepted from 172.28.0.164:55819 #1430096 (400 connections now open) 2015-10-05T08:00:57.515+0100 [conn1430096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:00:58.303+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:00:58.303+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:02.297+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:01:02.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:01:03.057+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:06.255+0100 [conn1429753] end connection 172.28.0.163:61737 (399 connections now open) 2015-10-05T08:01:06.255+0100 [mongosMain] connection accepted from 172.28.0.163:62860 #1430097 (400 connections now open) 2015-10-05T08:01:06.256+0100 [conn1430097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:06.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:06.321+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:07.527+0100 [conn1429726] end connection 172.28.0.164:54672 (399 connections now open) 2015-10-05T08:01:07.528+0100 [mongosMain] connection accepted from 172.28.0.164:55834 #1430098 (400 connections now open) 2015-10-05T08:01:07.529+0100 [conn1430098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:08.229+0100 [conn1429752] end connection 172.28.0.164:54739 (399 connections now open) 2015-10-05T08:01:08.230+0100 [mongosMain] connection accepted from 172.28.0.164:55840 #1430099 (400 connections now open) 2015-10-05T08:01:08.231+0100 [conn1430099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:14.184+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:15.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:15.410+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:16.843+0100 [conn1429750] end connection 172.28.0.163:61722 (399 connections now open) 2015-10-05T08:01:16.845+0100 [mongosMain] connection accepted from 172.28.0.163:62890 #1430100 (400 connections now open) 2015-10-05T08:01:16.846+0100 [conn1430100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:17.530+0100 [conn1429732] end connection 172.28.0.164:54680 (399 connections now open) 2015-10-05T08:01:17.532+0100 [mongosMain] connection accepted from 172.28.0.164:55850 #1430101 (400 connections now open) 2015-10-05T08:01:17.534+0100 [conn1430101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:18.228+0100 [conn1429758] end connection 172.28.0.164:54769 (399 connections now open) 2015-10-05T08:01:18.229+0100 [mongosMain] connection accepted from 172.28.0.164:55852 #1430102 (400 connections now open) 2015-10-05T08:01:18.231+0100 [conn1430102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:21.184+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:01:21.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:01:23.235+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:01:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:01:25.193+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:25.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:25.412+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:26.281+0100 [conn1429730] end connection 172.28.0.163:61657 (399 connections now open) 2015-10-05T08:01:26.282+0100 [mongosMain] connection accepted from 172.28.0.163:62899 #1430103 (400 connections now open) 2015-10-05T08:01:26.283+0100 [conn1430103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:26.843+0100 [conn1429761] end connection 172.28.0.163:61788 (399 connections now open) 2015-10-05T08:01:26.844+0100 [mongosMain] connection accepted from 172.28.0.163:62900 #1430104 (400 connections now open) 2015-10-05T08:01:26.845+0100 [conn1430104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:27.544+0100 [conn1429713] end connection 172.28.0.164:54620 (399 connections now open) 2015-10-05T08:01:27.544+0100 [mongosMain] connection accepted from 172.28.0.164:55869 #1430105 (400 connections now open) 2015-10-05T08:01:27.545+0100 [conn1430105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:28.231+0100 [conn1429763] end connection 172.28.0.164:54780 (399 connections now open) 2015-10-05T08:01:28.236+0100 [mongosMain] connection accepted from 172.28.0.164:55871 #1430106 (400 connections now open) 2015-10-05T08:01:28.238+0100 [conn1430106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:28.594+0100 [mongosMain] connection accepted from 127.0.0.1:62904 #1430107 (401 connections now open) 2015-10-05T08:01:28.597+0100 [conn1430107] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:28.605+0100 [conn1430107] end connection 127.0.0.1:62904 (400 connections now open) 2015-10-05T08:01:33.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612204d5703b51053ed77b8 2015-10-05T08:01:33.613+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:01:36.210+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:36.285+0100 [conn1429749] end connection 172.28.0.163:61720 (399 connections now open) 2015-10-05T08:01:36.286+0100 [mongosMain] connection accepted from 172.28.0.163:62913 #1430108 (400 connections now open) 2015-10-05T08:01:36.287+0100 [conn1430108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:36.507+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:36.507+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:36.859+0100 [conn1429766] end connection 172.28.0.163:61802 (399 connections now open) 2015-10-05T08:01:36.860+0100 [mongosMain] connection accepted from 172.28.0.163:62915 #1430109 (400 connections now open) 2015-10-05T08:01:36.861+0100 [conn1430109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:37.682+0100 [conn1429707] end connection 172.28.0.164:54601 (399 connections now open) 2015-10-05T08:01:37.682+0100 [mongosMain] connection accepted from 172.28.0.164:55891 #1430110 (400 connections now open) 2015-10-05T08:01:37.694+0100 [conn1430110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:38.245+0100 [conn1429768] end connection 172.28.0.164:54798 (399 connections now open) 2015-10-05T08:01:38.246+0100 [mongosMain] connection accepted from 172.28.0.164:55893 #1430111 (400 connections now open) 2015-10-05T08:01:38.249+0100 [conn1430111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:39.355+0100 [mongosMain] connection accepted from 127.0.0.1:62917 #1430112 (401 connections now open) 2015-10-05T08:01:39.357+0100 [conn1430112] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:39.361+0100 [conn1430112] end connection 127.0.0.1:62917 (400 connections now open) 2015-10-05T08:01:41.443+0100 [conn1429674] end connection 172.28.0.164:54489 (399 connections now open) 2015-10-05T08:01:41.445+0100 [mongosMain] connection accepted from 172.28.0.164:55901 #1430113 (400 connections now open) 2015-10-05T08:01:41.449+0100 [conn1430113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:45.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220595703b51053ed79d9 2015-10-05T08:01:45.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:01:46.297+0100 [conn1429743] end connection 172.28.0.163:61687 (399 connections now open) 2015-10-05T08:01:46.298+0100 [mongosMain] connection accepted from 172.28.0.163:62926 #1430114 (400 connections now open) 2015-10-05T08:01:46.298+0100 [conn1430114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:46.859+0100 [conn1429771] end connection 172.28.0.163:61816 (399 connections now open) 2015-10-05T08:01:46.861+0100 [mongosMain] connection accepted from 172.28.0.163:62928 #1430115 (400 connections now open) 2015-10-05T08:01:46.869+0100 [conn1430115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:47.216+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:47.574+0100 [conn1429754] end connection 172.28.0.164:54750 (399 connections now open) 2015-10-05T08:01:47.576+0100 [mongosMain] connection accepted from 172.28.0.164:55911 #1430116 (400 connections now open) 2015-10-05T08:01:47.577+0100 [conn1430116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:48.260+0100 [conn1429773] end connection 172.28.0.164:54818 (399 connections now open) 2015-10-05T08:01:48.262+0100 [mongosMain] connection accepted from 172.28.0.164:55914 #1430117 (400 connections now open) 2015-10-05T08:01:48.263+0100 [conn1430117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:48.510+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:48.510+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:50.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:50.603+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:51.459+0100 [conn1429686] end connection 172.28.0.164:54531 (399 connections now open) 2015-10-05T08:01:51.460+0100 [mongosMain] connection accepted from 172.28.0.164:55918 #1430118 (400 connections now open) 2015-10-05T08:01:51.461+0100 [conn1430118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:53.384+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:01:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:01:53.610+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:53.611+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:56.304+0100 [conn1429712] end connection 172.28.0.163:61575 (399 connections now open) 2015-10-05T08:01:56.305+0100 [mongosMain] connection accepted from 172.28.0.163:62943 #1430119 (400 connections now open) 2015-10-05T08:01:56.305+0100 [conn1430119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:56.874+0100 [conn1429776] end connection 172.28.0.163:61832 (399 connections now open) 2015-10-05T08:01:56.875+0100 [mongosMain] connection accepted from 172.28.0.163:62946 #1430120 (400 connections now open) 2015-10-05T08:01:56.876+0100 [conn1430120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:57.608+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:57.608+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:01:58.218+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:01:58.278+0100 [conn1429777] end connection 172.28.0.164:54843 (399 connections now open) 2015-10-05T08:01:58.278+0100 [mongosMain] connection accepted from 172.28.0.164:55929 #1430121 (400 connections now open) 2015-10-05T08:01:58.280+0100 [conn1430121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:01:58.446+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:01:58.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:02:02.254+0100 [conn1429544] end connection 172.28.0.163:61112 (399 connections now open) 2015-10-05T08:02:02.255+0100 [mongosMain] connection accepted from 172.28.0.163:62958 #1430122 (400 connections now open) 2015-10-05T08:02:02.255+0100 [conn1430122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:02.619+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:02.620+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:04.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612206c5703b51053ed7d15 2015-10-05T08:02:04.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:02:06.312+0100 [conn1429756] end connection 172.28.0.163:61768 (399 connections now open) 2015-10-05T08:02:06.313+0100 [mongosMain] connection accepted from 172.28.0.163:62969 #1430123 (400 connections now open) 2015-10-05T08:02:06.314+0100 [conn1430123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:06.875+0100 [conn1429782] end connection 172.28.0.163:61851 (399 connections now open) 2015-10-05T08:02:06.876+0100 [mongosMain] connection accepted from 172.28.0.163:62972 #1430124 (400 connections now open) 2015-10-05T08:02:06.876+0100 [conn1430124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:08.293+0100 [conn1429783] end connection 172.28.0.164:54857 (399 connections now open) 2015-10-05T08:02:08.295+0100 [mongosMain] connection accepted from 172.28.0.164:55953 #1430125 (400 connections now open) 2015-10-05T08:02:08.297+0100 [conn1430125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:08.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:08.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:09.220+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:12.241+0100 [conn1429460] end connection 172.28.0.163:60860 (399 connections now open) 2015-10-05T08:02:12.242+0100 [mongosMain] connection accepted from 172.28.0.163:62980 #1430126 (400 connections now open) 2015-10-05T08:02:12.243+0100 [conn1430126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:15.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:15.621+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:16.314+0100 [conn1429765] end connection 172.28.0.163:61800 (399 connections now open) 2015-10-05T08:02:16.315+0100 [mongosMain] connection accepted from 172.28.0.163:62988 #1430127 (400 connections now open) 2015-10-05T08:02:16.316+0100 [conn1430127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:16.890+0100 [conn1429787] end connection 172.28.0.163:61875 (399 connections now open) 2015-10-05T08:02:16.891+0100 [mongosMain] connection accepted from 172.28.0.163:62989 #1430128 (400 connections now open) 2015-10-05T08:02:16.892+0100 [conn1430128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:18.307+0100 [conn1429788] end connection 172.28.0.164:54882 (399 connections now open) 2015-10-05T08:02:18.309+0100 [mongosMain] connection accepted from 172.28.0.164:55965 #1430129 (400 connections now open) 2015-10-05T08:02:18.310+0100 [conn1430129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:20.233+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:22.241+0100 [conn1429394] end connection 172.28.0.163:60657 (399 connections now open) 2015-10-05T08:02:22.243+0100 [mongosMain] connection accepted from 172.28.0.163:62995 #1430130 (400 connections now open) 2015-10-05T08:02:22.243+0100 [conn1430130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:23.626+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:23.627+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:23.678+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:02:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:02:26.328+0100 [conn1429736] end connection 172.28.0.163:61670 (399 connections now open) 2015-10-05T08:02:26.329+0100 [mongosMain] connection accepted from 172.28.0.163:62998 #1430131 (400 connections now open) 2015-10-05T08:02:26.330+0100 [conn1430131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:26.914+0100 [conn1429791] end connection 172.28.0.163:61890 (399 connections now open) 2015-10-05T08:02:26.915+0100 [mongosMain] connection accepted from 172.28.0.163:63000 #1430132 (400 connections now open) 2015-10-05T08:02:26.918+0100 [conn1430132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:27.622+0100 [conn1429772] end connection 172.28.0.164:54816 (399 connections now open) 2015-10-05T08:02:27.623+0100 [mongosMain] connection accepted from 172.28.0.164:55984 #1430133 (400 connections now open) 2015-10-05T08:02:27.624+0100 [conn1430133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:28.324+0100 [conn1429792] end connection 172.28.0.164:54892 (399 connections now open) 2015-10-05T08:02:28.324+0100 [mongosMain] connection accepted from 172.28.0.164:55987 #1430134 (400 connections now open) 2015-10-05T08:02:28.325+0100 [conn1430134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:28.904+0100 [mongosMain] connection accepted from 127.0.0.1:63003 #1430135 (401 connections now open) 2015-10-05T08:02:28.907+0100 [conn1430135] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:28.911+0100 [conn1430135] end connection 127.0.0.1:63003 (400 connections now open) 2015-10-05T08:02:29.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220845703b51053ed818b 2015-10-05T08:02:30.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:02:31.244+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:32.256+0100 [conn1429759] end connection 172.28.0.163:61782 (399 connections now open) 2015-10-05T08:02:32.258+0100 [mongosMain] connection accepted from 172.28.0.163:63006 #1430136 (400 connections now open) 2015-10-05T08:02:32.259+0100 [conn1430136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:32.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:32.709+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:36.331+0100 [conn1429770] end connection 172.28.0.163:61813 (399 connections now open) 2015-10-05T08:02:36.332+0100 [mongosMain] connection accepted from 172.28.0.163:63007 #1430137 (400 connections now open) 2015-10-05T08:02:36.333+0100 [conn1430137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:36.908+0100 [conn1429795] end connection 172.28.0.163:61899 (399 connections now open) 2015-10-05T08:02:36.910+0100 [mongosMain] connection accepted from 172.28.0.163:63008 #1430138 (400 connections now open) 2015-10-05T08:02:36.911+0100 [conn1430138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:37.064+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:02:37.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:02:37.622+0100 [conn1429757] end connection 172.28.0.164:54767 (399 connections now open) 2015-10-05T08:02:37.623+0100 [mongosMain] connection accepted from 172.28.0.164:56004 #1430139 (400 connections now open) 2015-10-05T08:02:37.624+0100 [conn1430139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:38.324+0100 [conn1429796] end connection 172.28.0.164:54913 (399 connections now open) 2015-10-05T08:02:38.325+0100 [mongosMain] connection accepted from 172.28.0.164:56007 #1430140 (400 connections now open) 2015-10-05T08:02:38.326+0100 [conn1430140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:40.162+0100 [mongosMain] connection accepted from 127.0.0.1:63012 #1430141 (401 connections now open) 2015-10-05T08:02:40.165+0100 [conn1430141] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:40.169+0100 [conn1430141] end connection 127.0.0.1:63012 (400 connections now open) 2015-10-05T08:02:42.250+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:42.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:42.715+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:44.120+0100 [conn1429511] end connection 172.28.0.163:60996 (399 connections now open) 2015-10-05T08:02:44.122+0100 [mongosMain] connection accepted from 172.28.0.163:63020 #1430142 (400 connections now open) 2015-10-05T08:02:44.124+0100 [conn1430142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:44.134+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:02:44.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:02:46.343+0100 [conn1429706] end connection 172.28.0.163:61564 (399 connections now open) 2015-10-05T08:02:46.344+0100 [mongosMain] connection accepted from 172.28.0.163:63027 #1430143 (400 connections now open) 2015-10-05T08:02:46.345+0100 [conn1430143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:46.922+0100 [conn1429802] end connection 172.28.0.163:61911 (399 connections now open) 2015-10-05T08:02:46.923+0100 [mongosMain] connection accepted from 172.28.0.163:63029 #1430144 (400 connections now open) 2015-10-05T08:02:46.924+0100 [conn1430144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:48.340+0100 [conn1429804] end connection 172.28.0.164:54936 (399 connections now open) 2015-10-05T08:02:48.341+0100 [mongosMain] connection accepted from 172.28.0.164:56024 #1430145 (400 connections now open) 2015-10-05T08:02:48.343+0100 [conn1430145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:51.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612209a5703b51053ed84bd 2015-10-05T08:02:51.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:02:53.319+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:53.807+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:02:53.807+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:02:53.831+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:02:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:02:53.878+0100 [conn1429519] end connection 172.28.0.163:61016 (399 connections now open) 2015-10-05T08:02:53.879+0100 [mongosMain] connection accepted from 172.28.0.163:63039 #1430146 (400 connections now open) 2015-10-05T08:02:53.884+0100 [conn1430146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:56.360+0100 [conn1429781] end connection 172.28.0.163:61850 (399 connections now open) 2015-10-05T08:02:56.361+0100 [mongosMain] connection accepted from 172.28.0.163:63042 #1430147 (400 connections now open) 2015-10-05T08:02:56.362+0100 [conn1430147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:56.923+0100 [conn1429810] end connection 172.28.0.163:61924 (399 connections now open) 2015-10-05T08:02:56.924+0100 [mongosMain] connection accepted from 172.28.0.163:63045 #1430148 (400 connections now open) 2015-10-05T08:02:56.925+0100 [conn1430148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:57.638+0100 [conn1429738] end connection 172.28.0.164:54699 (399 connections now open) 2015-10-05T08:02:57.639+0100 [mongosMain] connection accepted from 172.28.0.164:56034 #1430149 (400 connections now open) 2015-10-05T08:02:57.641+0100 [conn1430149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:02:57.823+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:02:57.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:02:58.355+0100 [conn1429812] end connection 172.28.0.164:54955 (399 connections now open) 2015-10-05T08:02:58.356+0100 [mongosMain] connection accepted from 172.28.0.164:56036 #1430150 (400 connections now open) 2015-10-05T08:02:58.357+0100 [conn1430150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:01.507+0100 [conn1429580] end connection 172.28.0.164:54222 (399 connections now open) 2015-10-05T08:03:01.508+0100 [mongosMain] connection accepted from 172.28.0.164:56041 #1430151 (400 connections now open) 2015-10-05T08:03:01.510+0100 [conn1430151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:03.876+0100 [conn1429652] end connection 172.28.0.163:61393 (399 connections now open) 2015-10-05T08:03:03.876+0100 [conn1429685] end connection 172.28.0.163:61479 (399 connections now open) 2015-10-05T08:03:03.877+0100 [mongosMain] connection accepted from 172.28.0.163:63067 #1430152 (399 connections now open) 2015-10-05T08:03:03.877+0100 [mongosMain] connection accepted from 172.28.0.163:63068 #1430153 (400 connections now open) 2015-10-05T08:03:03.878+0100 [conn1430152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:03.878+0100 [conn1430153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:03.935+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:03:03.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:03:04.368+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:05.859+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:05.859+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:06.937+0100 [conn1429815] end connection 172.28.0.163:61943 (399 connections now open) 2015-10-05T08:03:06.938+0100 [mongosMain] connection accepted from 172.28.0.163:63079 #1430154 (400 connections now open) 2015-10-05T08:03:06.939+0100 [conn1430154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:07.653+0100 [conn1429811] end connection 172.28.0.164:54953 (399 connections now open) 2015-10-05T08:03:07.654+0100 [mongosMain] connection accepted from 172.28.0.164:56051 #1430155 (400 connections now open) 2015-10-05T08:03:07.657+0100 [conn1430155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:07.869+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:07.869+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:08.355+0100 [conn1429816] end connection 172.28.0.164:54973 (399 connections now open) 2015-10-05T08:03:08.356+0100 [mongosMain] connection accepted from 172.28.0.164:56053 #1430156 (400 connections now open) 2015-10-05T08:03:08.358+0100 [conn1430156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:10.081+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:03:10.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:03:10.872+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:10.872+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:11.522+0100 [conn1429586] end connection 172.28.0.164:54242 (399 connections now open) 2015-10-05T08:03:11.523+0100 [mongosMain] connection accepted from 172.28.0.164:56056 #1430157 (400 connections now open) 2015-10-05T08:03:11.525+0100 [conn1430157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:13.880+0100 [conn1429710] end connection 172.28.0.163:61573 (399 connections now open) 2015-10-05T08:03:13.880+0100 [mongosMain] connection accepted from 172.28.0.163:63088 #1430158 (400 connections now open) 2015-10-05T08:03:13.881+0100 [conn1429748] end connection 172.28.0.163:61715 (399 connections now open) 2015-10-05T08:03:13.881+0100 [conn1430158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:13.882+0100 [mongosMain] connection accepted from 172.28.0.163:63091 #1430159 (400 connections now open) 2015-10-05T08:03:13.883+0100 [conn1430159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:14.877+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:14.877+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:15.375+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:16.227+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:03:16.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:03:16.938+0100 [conn1429822] end connection 172.28.0.163:61977 (399 connections now open) 2015-10-05T08:03:16.939+0100 [mongosMain] connection accepted from 172.28.0.163:63099 #1430160 (400 connections now open) 2015-10-05T08:03:16.940+0100 [conn1430160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:17.653+0100 [conn1429767] end connection 172.28.0.164:54795 (399 connections now open) 2015-10-05T08:03:17.654+0100 [mongosMain] connection accepted from 172.28.0.164:56061 #1430161 (400 connections now open) 2015-10-05T08:03:17.656+0100 [conn1430161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:18.356+0100 [conn1429824] end connection 172.28.0.164:54991 (399 connections now open) 2015-10-05T08:03:18.358+0100 [mongosMain] connection accepted from 172.28.0.164:56063 #1430162 (400 connections now open) 2015-10-05T08:03:18.360+0100 [conn1430162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:19.920+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:19.920+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:21.538+0100 [conn1429785] end connection 172.28.0.164:54875 (399 connections now open) 2015-10-05T08:03:21.538+0100 [conn1429680] end connection 172.28.0.164:54508 (399 connections now open) 2015-10-05T08:03:21.539+0100 [mongosMain] connection accepted from 172.28.0.164:56074 #1430163 (399 connections now open) 2015-10-05T08:03:21.540+0100 [mongosMain] connection accepted from 172.28.0.164:56073 #1430164 (400 connections now open) 2015-10-05T08:03:21.542+0100 [conn1430163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:21.542+0100 [conn1430164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:24.152+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:03:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:03:24.579+0100 [conn1429705] end connection 172.28.0.163:61562 (399 connections now open) 2015-10-05T08:03:24.580+0100 [conn1429628] end connection 172.28.0.163:61336 (398 connections now open) 2015-10-05T08:03:24.582+0100 [mongosMain] connection accepted from 172.28.0.163:63104 #1430165 (399 connections now open) 2015-10-05T08:03:24.583+0100 [mongosMain] connection accepted from 172.28.0.163:63105 #1430166 (400 connections now open) 2015-10-05T08:03:24.583+0100 [conn1430165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:24.586+0100 [conn1430166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:25.929+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:25.930+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:26.374+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:26.377+0100 [conn1429760] end connection 172.28.0.163:61785 (399 connections now open) 2015-10-05T08:03:26.378+0100 [mongosMain] connection accepted from 172.28.0.163:63109 #1430167 (400 connections now open) 2015-10-05T08:03:26.380+0100 [conn1430167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:26.953+0100 [conn1429829] end connection 172.28.0.163:61995 (399 connections now open) 2015-10-05T08:03:26.954+0100 [mongosMain] connection accepted from 172.28.0.163:63113 #1430168 (400 connections now open) 2015-10-05T08:03:26.956+0100 [conn1430168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:27.669+0100 [conn1429762] end connection 172.28.0.164:54778 (399 connections now open) 2015-10-05T08:03:27.670+0100 [mongosMain] connection accepted from 172.28.0.164:56086 #1430169 (400 connections now open) 2015-10-05T08:03:27.671+0100 [conn1430169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:28.371+0100 [conn1429831] end connection 172.28.0.164:55006 (399 connections now open) 2015-10-05T08:03:28.372+0100 [mongosMain] connection accepted from 172.28.0.164:56089 #1430170 (400 connections now open) 2015-10-05T08:03:28.374+0100 [conn1430170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:28.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220c05703b51053ed8c68 2015-10-05T08:03:28.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:03:29.200+0100 [mongosMain] connection accepted from 127.0.0.1:63115 #1430171 (401 connections now open) 2015-10-05T08:03:29.202+0100 [conn1430171] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:29.207+0100 [conn1430171] end connection 127.0.0.1:63115 (400 connections now open) 2015-10-05T08:03:31.576+0100 [conn1429305] end connection 172.28.0.164:53380 (399 connections now open) 2015-10-05T08:03:31.576+0100 [conn1429813] end connection 172.28.0.164:54969 (398 connections now open) 2015-10-05T08:03:31.576+0100 [mongosMain] connection accepted from 172.28.0.164:56095 #1430172 (399 connections now open) 2015-10-05T08:03:31.576+0100 [mongosMain] connection accepted from 172.28.0.164:56096 #1430173 (400 connections now open) 2015-10-05T08:03:31.576+0100 [conn1430172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:31.576+0100 [conn1430173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:32.965+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:32.965+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:34.603+0100 [conn1429446] end connection 172.28.0.163:60826 (399 connections now open) 2015-10-05T08:03:34.603+0100 [conn1429740] end connection 172.28.0.163:61683 (399 connections now open) 2015-10-05T08:03:34.603+0100 [mongosMain] connection accepted from 172.28.0.163:63119 #1430174 (399 connections now open) 2015-10-05T08:03:34.603+0100 [conn1430174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:34.603+0100 [mongosMain] connection accepted from 172.28.0.163:63121 #1430175 (400 connections now open) 2015-10-05T08:03:34.603+0100 [conn1430175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:36.392+0100 [conn1429775] end connection 172.28.0.163:61830 (399 connections now open) 2015-10-05T08:03:36.394+0100 [mongosMain] connection accepted from 172.28.0.163:63130 #1430176 (400 connections now open) 2015-10-05T08:03:36.395+0100 [conn1430176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:36.956+0100 [conn1429837] end connection 172.28.0.163:62011 (399 connections now open) 2015-10-05T08:03:36.958+0100 [mongosMain] connection accepted from 172.28.0.163:63133 #1430177 (400 connections now open) 2015-10-05T08:03:36.959+0100 [conn1430177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:37.447+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:37.684+0100 [conn1429803] end connection 172.28.0.164:54934 (399 connections now open) 2015-10-05T08:03:37.686+0100 [mongosMain] connection accepted from 172.28.0.164:56108 #1430178 (400 connections now open) 2015-10-05T08:03:37.688+0100 [conn1430178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:38.387+0100 [conn1429839] end connection 172.28.0.164:55027 (399 connections now open) 2015-10-05T08:03:38.388+0100 [mongosMain] connection accepted from 172.28.0.164:56110 #1430179 (400 connections now open) 2015-10-05T08:03:38.389+0100 [conn1430179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:39.780+0100 [mongosMain] connection accepted from 127.0.0.1:63135 #1430180 (401 connections now open) 2015-10-05T08:03:39.783+0100 [conn1430180] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:39.787+0100 [conn1430180] end connection 127.0.0.1:63135 (400 connections now open) 2015-10-05T08:03:40.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:40.952+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:41.570+0100 [conn1429695] end connection 172.28.0.164:54565 (399 connections now open) 2015-10-05T08:03:41.570+0100 [conn1429585] end connection 172.28.0.164:54241 (399 connections now open) 2015-10-05T08:03:41.571+0100 [mongosMain] connection accepted from 172.28.0.164:56117 #1430181 (399 connections now open) 2015-10-05T08:03:41.572+0100 [mongosMain] connection accepted from 172.28.0.164:56118 #1430182 (400 connections now open) 2015-10-05T08:03:41.584+0100 [conn1430181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:41.586+0100 [conn1430182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:44.582+0100 [conn1429778] end connection 172.28.0.163:61849 (399 connections now open) 2015-10-05T08:03:44.582+0100 [conn1429734] end connection 172.28.0.163:61667 (399 connections now open) 2015-10-05T08:03:44.584+0100 [mongosMain] connection accepted from 172.28.0.163:63143 #1430183 (399 connections now open) 2015-10-05T08:03:44.584+0100 [mongosMain] connection accepted from 172.28.0.163:63144 #1430184 (400 connections now open) 2015-10-05T08:03:44.585+0100 [conn1430183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:44.585+0100 [conn1430184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:46.393+0100 [conn1429836] end connection 172.28.0.163:62009 (399 connections now open) 2015-10-05T08:03:46.394+0100 [mongosMain] connection accepted from 172.28.0.163:63149 #1430185 (400 connections now open) 2015-10-05T08:03:46.396+0100 [conn1430185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:46.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220d25703b51053ed8f63 2015-10-05T08:03:46.969+0100 [conn1429846] end connection 172.28.0.163:62025 (399 connections now open) 2015-10-05T08:03:46.971+0100 [mongosMain] connection accepted from 172.28.0.163:63152 #1430186 (400 connections now open) 2015-10-05T08:03:46.972+0100 [conn1430186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:47.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:03:48.386+0100 [conn1429847] end connection 172.28.0.164:55046 (399 connections now open) 2015-10-05T08:03:48.387+0100 [mongosMain] connection accepted from 172.28.0.164:56130 #1430187 (400 connections now open) 2015-10-05T08:03:48.388+0100 [conn1430187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:48.475+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:49.991+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:49.992+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:03:51.585+0100 [conn1429786] end connection 172.28.0.164:54876 (399 connections now open) 2015-10-05T08:03:51.586+0100 [mongosMain] connection accepted from 172.28.0.164:56135 #1430188 (400 connections now open) 2015-10-05T08:03:51.588+0100 [conn1429724] end connection 172.28.0.164:54667 (399 connections now open) 2015-10-05T08:03:51.588+0100 [conn1430188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:51.589+0100 [mongosMain] connection accepted from 172.28.0.164:56136 #1430189 (400 connections now open) 2015-10-05T08:03:51.591+0100 [conn1430189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:53.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220d95703b51053ed904d 2015-10-05T08:03:53.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:03:54.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:03:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:03:54.582+0100 [conn1429715] end connection 172.28.0.163:61587 (399 connections now open) 2015-10-05T08:03:54.582+0100 [conn1429659] end connection 172.28.0.163:61419 (398 connections now open) 2015-10-05T08:03:54.583+0100 [mongosMain] connection accepted from 172.28.0.163:63171 #1430190 (399 connections now open) 2015-10-05T08:03:54.584+0100 [conn1430190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:54.585+0100 [mongosMain] connection accepted from 172.28.0.163:63172 #1430191 (400 connections now open) 2015-10-05T08:03:54.586+0100 [conn1430191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:56.985+0100 [conn1429853] end connection 172.28.0.163:62043 (399 connections now open) 2015-10-05T08:03:56.986+0100 [mongosMain] connection accepted from 172.28.0.163:63176 #1430192 (400 connections now open) 2015-10-05T08:03:56.988+0100 [conn1430192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:58.388+0100 [conn1429855] end connection 172.28.0.164:55066 (399 connections now open) 2015-10-05T08:03:58.390+0100 [mongosMain] connection accepted from 172.28.0.164:56145 #1430193 (400 connections now open) 2015-10-05T08:03:58.391+0100 [conn1430193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:03:59.474+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:03:59.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220df5703b51053ed90c6 2015-10-05T08:03:59.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:00.090+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:00.090+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:01.619+0100 [conn1429654] end connection 172.28.0.164:54432 (399 connections now open) 2015-10-05T08:04:01.619+0100 [conn1429807] end connection 172.28.0.164:54950 (398 connections now open) 2015-10-05T08:04:01.621+0100 [mongosMain] connection accepted from 172.28.0.164:56153 #1430194 (399 connections now open) 2015-10-05T08:04:01.621+0100 [mongosMain] connection accepted from 172.28.0.164:56154 #1430195 (400 connections now open) 2015-10-05T08:04:01.622+0100 [conn1430194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:01.623+0100 [conn1430195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:04.597+0100 [conn1429723] end connection 172.28.0.163:61634 (399 connections now open) 2015-10-05T08:04:04.597+0100 [conn1429658] end connection 172.28.0.163:61418 (399 connections now open) 2015-10-05T08:04:04.598+0100 [mongosMain] connection accepted from 172.28.0.163:63194 #1430196 (399 connections now open) 2015-10-05T08:04:04.599+0100 [mongosMain] connection accepted from 172.28.0.163:63195 #1430197 (400 connections now open) 2015-10-05T08:04:04.599+0100 [conn1430196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:04.600+0100 [conn1430197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:05.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220e55703b51053ed91a5 2015-10-05T08:04:06.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:06.985+0100 [conn1429859] end connection 172.28.0.163:62061 (399 connections now open) 2015-10-05T08:04:06.986+0100 [mongosMain] connection accepted from 172.28.0.163:63202 #1430198 (400 connections now open) 2015-10-05T08:04:06.987+0100 [conn1430198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:07.717+0100 [conn1429823] end connection 172.28.0.164:54989 (399 connections now open) 2015-10-05T08:04:07.718+0100 [mongosMain] connection accepted from 172.28.0.164:56165 #1430199 (400 connections now open) 2015-10-05T08:04:07.720+0100 [conn1430199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:10.475+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:11.140+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:11.140+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:11.617+0100 [conn1429735] end connection 172.28.0.164:54695 (399 connections now open) 2015-10-05T08:04:11.617+0100 [conn1429793] end connection 172.28.0.164:54909 (398 connections now open) 2015-10-05T08:04:11.618+0100 [mongosMain] connection accepted from 172.28.0.164:56168 #1430200 (399 connections now open) 2015-10-05T08:04:11.619+0100 [mongosMain] connection accepted from 172.28.0.164:56169 #1430201 (400 connections now open) 2015-10-05T08:04:11.620+0100 [conn1430200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:11.621+0100 [conn1430201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:12.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220ec5703b51053ed928f 2015-10-05T08:04:12.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:14.602+0100 [conn1429727] end connection 172.28.0.163:61654 (399 connections now open) 2015-10-05T08:04:14.602+0100 [conn1429733] end connection 172.28.0.163:61666 (398 connections now open) 2015-10-05T08:04:14.603+0100 [mongosMain] connection accepted from 172.28.0.163:63218 #1430202 (399 connections now open) 2015-10-05T08:04:14.604+0100 [mongosMain] connection accepted from 172.28.0.163:63219 #1430203 (400 connections now open) 2015-10-05T08:04:14.605+0100 [conn1430202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:14.605+0100 [conn1430203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:17.001+0100 [conn1429867] end connection 172.28.0.163:62090 (399 connections now open) 2015-10-05T08:04:17.002+0100 [mongosMain] connection accepted from 172.28.0.163:63225 #1430204 (400 connections now open) 2015-10-05T08:04:17.003+0100 [conn1430204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:17.733+0100 [conn1429838] end connection 172.28.0.164:55024 (399 connections now open) 2015-10-05T08:04:17.734+0100 [mongosMain] connection accepted from 172.28.0.164:56177 #1430205 (400 connections now open) 2015-10-05T08:04:17.736+0100 [conn1430205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:18.419+0100 [conn1429868] end connection 172.28.0.164:55096 (399 connections now open) 2015-10-05T08:04:18.420+0100 [mongosMain] connection accepted from 172.28.0.164:56179 #1430206 (400 connections now open) 2015-10-05T08:04:18.422+0100 [conn1430206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:18.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220f25703b51053ed9366 2015-10-05T08:04:18.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:21.482+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:21.738+0100 [conn1429779] end connection 172.28.0.164:54852 (399 connections now open) 2015-10-05T08:04:21.738+0100 [conn1429419] end connection 172.28.0.164:53776 (399 connections now open) 2015-10-05T08:04:21.739+0100 [mongosMain] connection accepted from 172.28.0.164:56185 #1430207 (399 connections now open) 2015-10-05T08:04:21.740+0100 [conn1430207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:21.740+0100 [mongosMain] connection accepted from 172.28.0.164:56186 #1430208 (400 connections now open) 2015-10-05T08:04:21.742+0100 [conn1430208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:23.135+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:23.136+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:24.613+0100 [conn1429849] end connection 172.28.0.163:62040 (399 connections now open) 2015-10-05T08:04:24.613+0100 [conn1429645] end connection 172.28.0.163:61371 (399 connections now open) 2015-10-05T08:04:24.614+0100 [mongosMain] connection accepted from 172.28.0.163:63232 #1430209 (399 connections now open) 2015-10-05T08:04:24.614+0100 [mongosMain] connection accepted from 172.28.0.163:63233 #1430210 (400 connections now open) 2015-10-05T08:04:24.615+0100 [conn1430209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:24.615+0100 [conn1430210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:24.801+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:04:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:04:24.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220f85703b51053ed942e 2015-10-05T08:04:25.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:25.206+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:25.206+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:27.748+0100 [conn1429751] end connection 172.28.0.164:54736 (399 connections now open) 2015-10-05T08:04:27.749+0100 [mongosMain] connection accepted from 172.28.0.164:56199 #1430211 (400 connections now open) 2015-10-05T08:04:27.751+0100 [conn1430211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:28.219+0100 [mongosMain] connection accepted from 127.0.0.1:63239 #1430212 (401 connections now open) 2015-10-05T08:04:28.222+0100 [conn1430212] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:28.227+0100 [conn1430212] end connection 127.0.0.1:63239 (400 connections now open) 2015-10-05T08:04:28.279+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:28.279+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:28.434+0100 [conn1429861] end connection 172.28.0.164:55082 (399 connections now open) 2015-10-05T08:04:28.435+0100 [mongosMain] connection accepted from 172.28.0.164:56203 #1430213 (400 connections now open) 2015-10-05T08:04:28.436+0100 [conn1430213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:31.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561220ff5703b51053ed94fa 2015-10-05T08:04:31.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:31.742+0100 [conn1429790] end connection 172.28.0.164:54888 (399 connections now open) 2015-10-05T08:04:31.743+0100 [conn1429711] end connection 172.28.0.164:54616 (398 connections now open) 2015-10-05T08:04:31.744+0100 [mongosMain] connection accepted from 172.28.0.164:56209 #1430214 (399 connections now open) 2015-10-05T08:04:31.744+0100 [mongosMain] connection accepted from 172.28.0.164:56210 #1430215 (400 connections now open) 2015-10-05T08:04:31.746+0100 [conn1430214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:31.746+0100 [conn1430215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:32.286+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:32.286+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:32.492+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:34.640+0100 [conn1429825] end connection 172.28.0.163:61991 (399 connections now open) 2015-10-05T08:04:34.640+0100 [conn1429764] end connection 172.28.0.163:61798 (398 connections now open) 2015-10-05T08:04:34.641+0100 [mongosMain] connection accepted from 172.28.0.163:63247 #1430216 (399 connections now open) 2015-10-05T08:04:34.641+0100 [mongosMain] connection accepted from 172.28.0.163:63250 #1430217 (400 connections now open) 2015-10-05T08:04:34.642+0100 [conn1430216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:34.642+0100 [conn1430217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:37.016+0100 [conn1429887] end connection 172.28.0.163:62137 (399 connections now open) 2015-10-05T08:04:37.017+0100 [mongosMain] connection accepted from 172.28.0.163:63254 #1430218 (400 connections now open) 2015-10-05T08:04:37.019+0100 [conn1430218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:37.295+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:37.296+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:37.764+0100 [conn1429854] end connection 172.28.0.164:55063 (399 connections now open) 2015-10-05T08:04:37.765+0100 [mongosMain] connection accepted from 172.28.0.164:56223 #1430219 (400 connections now open) 2015-10-05T08:04:37.768+0100 [conn1430219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:37.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221055703b51053ed95e1 2015-10-05T08:04:37.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:38.450+0100 [conn1429876] end connection 172.28.0.164:55111 (399 connections now open) 2015-10-05T08:04:38.451+0100 [mongosMain] connection accepted from 172.28.0.164:56226 #1430220 (400 connections now open) 2015-10-05T08:04:38.453+0100 [conn1430220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:39.378+0100 [mongosMain] connection accepted from 127.0.0.1:63256 #1430221 (401 connections now open) 2015-10-05T08:04:39.381+0100 [conn1430221] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:39.385+0100 [conn1430221] end connection 127.0.0.1:63256 (400 connections now open) 2015-10-05T08:04:41.757+0100 [conn1429600] end connection 172.28.0.164:54287 (399 connections now open) 2015-10-05T08:04:41.757+0100 [conn1429827] end connection 172.28.0.164:54998 (399 connections now open) 2015-10-05T08:04:41.758+0100 [mongosMain] connection accepted from 172.28.0.164:56234 #1430222 (399 connections now open) 2015-10-05T08:04:41.758+0100 [mongosMain] connection accepted from 172.28.0.164:56235 #1430223 (400 connections now open) 2015-10-05T08:04:41.759+0100 [conn1430222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:41.760+0100 [conn1430223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:43.375+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:43.375+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:43.501+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:45.094+0100 [conn1429832] end connection 172.28.0.163:62005 (399 connections now open) 2015-10-05T08:04:45.097+0100 [conn1429532] end connection 172.28.0.163:61059 (398 connections now open) 2015-10-05T08:04:45.099+0100 [mongosMain] connection accepted from 172.28.0.163:63267 #1430224 (399 connections now open) 2015-10-05T08:04:45.099+0100 [conn1430224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:45.100+0100 [mongosMain] connection accepted from 172.28.0.163:63268 #1430225 (400 connections now open) 2015-10-05T08:04:45.101+0100 [conn1430225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:47.017+0100 [conn1429874] end connection 172.28.0.163:62113 (399 connections now open) 2015-10-05T08:04:47.019+0100 [mongosMain] connection accepted from 172.28.0.163:63275 #1430226 (400 connections now open) 2015-10-05T08:04:47.020+0100 [conn1430226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:47.779+0100 [conn1429881] end connection 172.28.0.164:55132 (399 connections now open) 2015-10-05T08:04:47.781+0100 [mongosMain] connection accepted from 172.28.0.164:56248 #1430227 (400 connections now open) 2015-10-05T08:04:47.783+0100 [conn1430227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:48.465+0100 [conn1429882] end connection 172.28.0.164:55133 (399 connections now open) 2015-10-05T08:04:48.466+0100 [mongosMain] connection accepted from 172.28.0.164:56251 #1430228 (400 connections now open) 2015-10-05T08:04:48.468+0100 [conn1430228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:50.384+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:50.384+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:50.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221125703b51053ed9775 2015-10-05T08:04:50.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:04:51.773+0100 [conn1429870] end connection 172.28.0.164:55103 (399 connections now open) 2015-10-05T08:04:51.774+0100 [mongosMain] connection accepted from 172.28.0.164:56261 #1430229 (400 connections now open) 2015-10-05T08:04:51.777+0100 [conn1430229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:54.613+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:55.070+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:04:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:04:55.101+0100 [conn1429722] end connection 172.28.0.163:61633 (399 connections now open) 2015-10-05T08:04:55.101+0100 [conn1429452] end connection 172.28.0.163:60843 (399 connections now open) 2015-10-05T08:04:55.106+0100 [mongosMain] connection accepted from 172.28.0.163:63291 #1430230 (399 connections now open) 2015-10-05T08:04:55.106+0100 [mongosMain] connection accepted from 172.28.0.163:63292 #1430231 (400 connections now open) 2015-10-05T08:04:55.106+0100 [conn1430230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:55.107+0100 [conn1430231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:57.032+0100 [conn1429893] end connection 172.28.0.163:62156 (399 connections now open) 2015-10-05T08:04:57.033+0100 [mongosMain] connection accepted from 172.28.0.163:63296 #1430232 (400 connections now open) 2015-10-05T08:04:57.034+0100 [conn1430232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:57.795+0100 [conn1429818] end connection 172.28.0.164:54974 (399 connections now open) 2015-10-05T08:04:57.796+0100 [mongosMain] connection accepted from 172.28.0.164:56266 #1430233 (400 connections now open) 2015-10-05T08:04:57.798+0100 [conn1430233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:04:58.393+0100 [WriteBackListener-mywdb9.tg-server.net:27017] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:04:58.394+0100 [WriteBackListener-mywdb9.tg-server.net:27017] WriteBackListener exception : socket exception [CONNECT_ERROR] for mywdb9.tg-server.net:27017 2015-10-05T08:04:58.483+0100 [conn1429889] end connection 172.28.0.164:55155 (399 connections now open) 2015-10-05T08:04:58.484+0100 [mongosMain] connection accepted from 172.28.0.164:56269 #1430234 (400 connections now open) 2015-10-05T08:04:58.486+0100 [conn1430234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:01.789+0100 [conn1429844] end connection 172.28.0.164:55040 (399 connections now open) 2015-10-05T08:05:01.789+0100 [conn1429862] end connection 172.28.0.164:55093 (398 connections now open) 2015-10-05T08:05:01.790+0100 [mongosMain] connection accepted from 172.28.0.164:56284 #1430235 (399 connections now open) 2015-10-05T08:05:01.790+0100 [mongosMain] connection accepted from 172.28.0.164:56285 #1430236 (400 connections now open) 2015-10-05T08:05:01.792+0100 [conn1430235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:01.792+0100 [conn1430236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:02.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612211e5703b51053ed98e3 2015-10-05T08:05:03.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:05.098+0100 [conn1429755] end connection 172.28.0.163:61767 (399 connections now open) 2015-10-05T08:05:05.099+0100 [mongosMain] connection accepted from 172.28.0.163:63324 #1430237 (400 connections now open) 2015-10-05T08:05:05.100+0100 [conn1430237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:05.679+0100 [ReplicaSetMonitorWatcher] warning: Failed to connect to 172.31.0.218:27017, reason: errno:10061 No connection could be made because the target machine actively refused it. 2015-10-05T08:05:07.048+0100 [conn1429899] end connection 172.28.0.163:62176 (399 connections now open) 2015-10-05T08:05:07.049+0100 [mongosMain] connection accepted from 172.28.0.163:63330 #1430238 (400 connections now open) 2015-10-05T08:05:07.050+0100 [conn1430238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:07.811+0100 [conn1429830] end connection 172.28.0.164:55004 (399 connections now open) 2015-10-05T08:05:07.813+0100 [mongosMain] connection accepted from 172.28.0.164:56290 #1430239 (400 connections now open) 2015-10-05T08:05:07.816+0100 [conn1430239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:08.497+0100 [conn1429895] end connection 172.28.0.164:55179 (399 connections now open) 2015-10-05T08:05:08.498+0100 [mongosMain] connection accepted from 172.28.0.164:56292 #1430240 (400 connections now open) 2015-10-05T08:05:08.499+0100 [conn1430240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:09.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221255703b51053ed99ce 2015-10-05T08:05:09.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:11.803+0100 [conn1429850] end connection 172.28.0.164:55059 (399 connections now open) 2015-10-05T08:05:11.804+0100 [conn1429648] end connection 172.28.0.164:54407 (398 connections now open) 2015-10-05T08:05:11.805+0100 [mongosMain] connection accepted from 172.28.0.164:56296 #1430241 (399 connections now open) 2015-10-05T08:05:11.805+0100 [mongosMain] connection accepted from 172.28.0.164:56297 #1430242 (400 connections now open) 2015-10-05T08:05:11.806+0100 [conn1430242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:11.806+0100 [conn1430241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:15.390+0100 [conn1429871] end connection 172.28.0.163:62107 (399 connections now open) 2015-10-05T08:05:15.391+0100 [conn1429728] end connection 172.28.0.163:61655 (398 connections now open) 2015-10-05T08:05:15.392+0100 [mongosMain] connection accepted from 172.28.0.163:63342 #1430243 (399 connections now open) 2015-10-05T08:05:15.393+0100 [conn1430243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:15.394+0100 [mongosMain] connection accepted from 172.28.0.163:63344 #1430244 (400 connections now open) 2015-10-05T08:05:15.395+0100 [conn1430244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:15.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612212b5703b51053ed9a92 2015-10-05T08:05:15.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:17.049+0100 [conn1429904] end connection 172.28.0.163:62205 (399 connections now open) 2015-10-05T08:05:17.050+0100 [mongosMain] connection accepted from 172.28.0.163:63349 #1430245 (400 connections now open) 2015-10-05T08:05:17.050+0100 [conn1430245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:17.826+0100 [conn1429875] end connection 172.28.0.164:55108 (399 connections now open) 2015-10-05T08:05:17.828+0100 [mongosMain] connection accepted from 172.28.0.164:56302 #1430246 (400 connections now open) 2015-10-05T08:05:17.830+0100 [conn1430246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:18.514+0100 [conn1429901] end connection 172.28.0.164:55195 (399 connections now open) 2015-10-05T08:05:18.515+0100 [mongosMain] connection accepted from 172.28.0.164:56304 #1430247 (400 connections now open) 2015-10-05T08:05:18.517+0100 [conn1430247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:21.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221315703b51053ed9b30 2015-10-05T08:05:22.014+0100 [conn1429800] end connection 172.28.0.164:54928 (399 connections now open) 2015-10-05T08:05:22.014+0100 [conn1429719] end connection 172.28.0.164:54647 (398 connections now open) 2015-10-05T08:05:22.015+0100 [mongosMain] connection accepted from 172.28.0.164:56311 #1430248 (399 connections now open) 2015-10-05T08:05:22.018+0100 [conn1430248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:22.018+0100 [mongosMain] connection accepted from 172.28.0.164:56313 #1430249 (400 connections now open) 2015-10-05T08:05:22.021+0100 [conn1430249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:22.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:25.231+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:05:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:05:25.705+0100 [conn1429865] end connection 172.28.0.163:62083 (399 connections now open) 2015-10-05T08:05:25.705+0100 [conn1429477] end connection 172.28.0.163:60884 (399 connections now open) 2015-10-05T08:05:25.713+0100 [mongosMain] connection accepted from 172.28.0.163:63357 #1430250 (399 connections now open) 2015-10-05T08:05:25.713+0100 [mongosMain] connection accepted from 172.28.0.163:63358 #1430251 (400 connections now open) 2015-10-05T08:05:25.714+0100 [conn1430250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:25.714+0100 [conn1430251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:27.064+0100 [conn1429910] end connection 172.28.0.163:62226 (399 connections now open) 2015-10-05T08:05:27.065+0100 [mongosMain] connection accepted from 172.28.0.163:63360 #1430252 (400 connections now open) 2015-10-05T08:05:27.066+0100 [conn1430252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:28.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221385703b51053ed9bf1 2015-10-05T08:05:28.461+0100 [mongosMain] connection accepted from 127.0.0.1:63362 #1430253 (401 connections now open) 2015-10-05T08:05:28.464+0100 [conn1430253] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:28.469+0100 [conn1430253] end connection 127.0.0.1:63362 (400 connections now open) 2015-10-05T08:05:28.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:28.528+0100 [conn1429906] end connection 172.28.0.164:55211 (399 connections now open) 2015-10-05T08:05:28.529+0100 [mongosMain] connection accepted from 172.28.0.164:56326 #1430254 (400 connections now open) 2015-10-05T08:05:28.530+0100 [conn1430254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:32.007+0100 [conn1429820] end connection 172.28.0.164:54987 (399 connections now open) 2015-10-05T08:05:32.008+0100 [conn1429843] end connection 172.28.0.164:55039 (398 connections now open) 2015-10-05T08:05:32.008+0100 [mongosMain] connection accepted from 172.28.0.164:56332 #1430255 (399 connections now open) 2015-10-05T08:05:32.009+0100 [mongosMain] connection accepted from 172.28.0.164:56333 #1430256 (400 connections now open) 2015-10-05T08:05:32.010+0100 [conn1430255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:32.011+0100 [conn1430256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:34.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612213e5703b51053ed9c4c 2015-10-05T08:05:34.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:35.665+0100 [conn1429572] end connection 172.28.0.163:61187 (399 connections now open) 2015-10-05T08:05:35.665+0100 [conn1429909] end connection 172.28.0.163:62220 (399 connections now open) 2015-10-05T08:05:35.666+0100 [mongosMain] connection accepted from 172.28.0.163:63368 #1430257 (399 connections now open) 2015-10-05T08:05:35.666+0100 [mongosMain] connection accepted from 172.28.0.163:63369 #1430258 (400 connections now open) 2015-10-05T08:05:35.666+0100 [conn1430257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:35.667+0100 [conn1430258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:37.068+0100 [conn1429915] end connection 172.28.0.163:62239 (399 connections now open) 2015-10-05T08:05:37.070+0100 [mongosMain] connection accepted from 172.28.0.163:63377 #1430259 (400 connections now open) 2015-10-05T08:05:37.071+0100 [conn1430259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:38.545+0100 [conn1429912] end connection 172.28.0.164:55225 (399 connections now open) 2015-10-05T08:05:38.545+0100 [mongosMain] connection accepted from 172.28.0.164:56345 #1430260 (400 connections now open) 2015-10-05T08:05:38.547+0100 [conn1430260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:39.853+0100 [mongosMain] connection accepted from 127.0.0.1:63379 #1430261 (401 connections now open) 2015-10-05T08:05:39.856+0100 [conn1430261] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:39.861+0100 [conn1430261] end connection 127.0.0.1:63379 (400 connections now open) 2015-10-05T08:05:40.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221445703b51053ed9ce3 2015-10-05T08:05:40.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:42.022+0100 [conn1429799] end connection 172.28.0.164:54929 (399 connections now open) 2015-10-05T08:05:42.022+0100 [conn1429856] end connection 172.28.0.164:55076 (398 connections now open) 2015-10-05T08:05:42.023+0100 [mongosMain] connection accepted from 172.28.0.164:56354 #1430262 (399 connections now open) 2015-10-05T08:05:42.023+0100 [mongosMain] connection accepted from 172.28.0.164:56355 #1430263 (400 connections now open) 2015-10-05T08:05:42.024+0100 [conn1430262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:42.025+0100 [conn1430263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:46.032+0100 [conn1429898] end connection 172.28.0.163:62175 (399 connections now open) 2015-10-05T08:05:46.034+0100 [conn1429621] end connection 172.28.0.163:61321 (398 connections now open) 2015-10-05T08:05:46.035+0100 [mongosMain] connection accepted from 172.28.0.163:63386 #1430264 (399 connections now open) 2015-10-05T08:05:46.036+0100 [conn1430264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:46.043+0100 [mongosMain] connection accepted from 172.28.0.163:63389 #1430265 (400 connections now open) 2015-10-05T08:05:46.046+0100 [conn1430265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:47.080+0100 [conn1429921] end connection 172.28.0.163:62250 (399 connections now open) 2015-10-05T08:05:47.081+0100 [mongosMain] connection accepted from 172.28.0.163:63393 #1430266 (400 connections now open) 2015-10-05T08:05:47.083+0100 [conn1430266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:47.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612214a5703b51053ed9d52 2015-10-05T08:05:47.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:48.559+0100 [conn1429916] end connection 172.28.0.164:55243 (399 connections now open) 2015-10-05T08:05:48.561+0100 [mongosMain] connection accepted from 172.28.0.164:56364 #1430267 (400 connections now open) 2015-10-05T08:05:48.562+0100 [conn1430267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:52.022+0100 [conn1429789] end connection 172.28.0.164:54887 (399 connections now open) 2015-10-05T08:05:52.022+0100 [conn1429835] end connection 172.28.0.164:55021 (399 connections now open) 2015-10-05T08:05:52.023+0100 [mongosMain] connection accepted from 172.28.0.164:56371 #1430268 (399 connections now open) 2015-10-05T08:05:52.024+0100 [mongosMain] connection accepted from 172.28.0.164:56372 #1430269 (400 connections now open) 2015-10-05T08:05:52.025+0100 [conn1430268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:52.025+0100 [conn1430269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:53.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221515703b51053ed9dec 2015-10-05T08:05:53.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:05:56.613+0100 [conn1429892] end connection 172.28.0.163:62150 (399 connections now open) 2015-10-05T08:05:56.622+0100 [conn1429485] end connection 172.28.0.163:60909 (398 connections now open) 2015-10-05T08:05:56.625+0100 [mongosMain] connection accepted from 172.28.0.163:63410 #1430270 (399 connections now open) 2015-10-05T08:05:56.625+0100 [mongosMain] connection accepted from 172.28.0.163:63412 #1430271 (400 connections now open) 2015-10-05T08:05:56.626+0100 [conn1430270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:56.627+0100 [conn1430271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:56.717+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:05:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:05:57.080+0100 [conn1429927] end connection 172.28.0.163:62270 (399 connections now open) 2015-10-05T08:05:57.081+0100 [mongosMain] connection accepted from 172.28.0.163:63415 #1430272 (400 connections now open) 2015-10-05T08:05:57.082+0100 [conn1430272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:58.560+0100 [conn1429922] end connection 172.28.0.164:55263 (399 connections now open) 2015-10-05T08:05:58.562+0100 [mongosMain] connection accepted from 172.28.0.164:56378 #1430273 (400 connections now open) 2015-10-05T08:05:58.564+0100 [conn1430273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:05:59.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221575703b51053ed9e4c 2015-10-05T08:06:00.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:02.038+0100 [conn1429877] end connection 172.28.0.164:55126 (399 connections now open) 2015-10-05T08:06:02.039+0100 [conn1429885] end connection 172.28.0.164:55148 (398 connections now open) 2015-10-05T08:06:02.039+0100 [mongosMain] connection accepted from 172.28.0.164:56391 #1430274 (399 connections now open) 2015-10-05T08:06:02.040+0100 [mongosMain] connection accepted from 172.28.0.164:56392 #1430275 (400 connections now open) 2015-10-05T08:06:02.040+0100 [conn1430274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:02.042+0100 [conn1430275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:06.627+0100 [conn1429841] end connection 172.28.0.163:62018 (399 connections now open) 2015-10-05T08:06:06.627+0100 [conn1429666] end connection 172.28.0.163:61435 (398 connections now open) 2015-10-05T08:06:06.628+0100 [mongosMain] connection accepted from 172.28.0.163:63442 #1430276 (400 connections now open) 2015-10-05T08:06:06.628+0100 [conn1430276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:06.629+0100 [mongosMain] connection accepted from 172.28.0.163:63443 #1430277 (400 connections now open) 2015-10-05T08:06:06.630+0100 [conn1430277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:07.095+0100 [conn1429932] end connection 172.28.0.163:62288 (399 connections now open) 2015-10-05T08:06:07.097+0100 [mongosMain] connection accepted from 172.28.0.163:63446 #1430278 (400 connections now open) 2015-10-05T08:06:07.098+0100 [conn1430278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:08.576+0100 [conn1429928] end connection 172.28.0.164:55283 (399 connections now open) 2015-10-05T08:06:08.578+0100 [mongosMain] connection accepted from 172.28.0.164:56404 #1430279 (400 connections now open) 2015-10-05T08:06:08.579+0100 [conn1430279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:12.073+0100 [conn1429891] end connection 172.28.0.164:55169 (399 connections now open) 2015-10-05T08:06:12.074+0100 [mongosMain] connection accepted from 172.28.0.164:56406 #1430280 (400 connections now open) 2015-10-05T08:06:12.075+0100 [conn1430280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:12.101+0100 [conn1429451] end connection 172.28.0.164:53890 (399 connections now open) 2015-10-05T08:06:12.102+0100 [mongosMain] connection accepted from 172.28.0.164:56411 #1430281 (400 connections now open) 2015-10-05T08:06:12.103+0100 [conn1430281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:12.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221645703b51053ed9f6f 2015-10-05T08:06:12.519+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:16.639+0100 [conn1429886] end connection 172.28.0.163:62135 (399 connections now open) 2015-10-05T08:06:16.639+0100 [conn1429741] end connection 172.28.0.163:61684 (399 connections now open) 2015-10-05T08:06:16.640+0100 [mongosMain] connection accepted from 172.28.0.163:63457 #1430282 (399 connections now open) 2015-10-05T08:06:16.641+0100 [mongosMain] connection accepted from 172.28.0.163:63458 #1430283 (400 connections now open) 2015-10-05T08:06:16.641+0100 [conn1430282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:16.642+0100 [conn1430283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:17.096+0100 [conn1429936] end connection 172.28.0.163:62320 (399 connections now open) 2015-10-05T08:06:17.097+0100 [mongosMain] connection accepted from 172.28.0.163:63461 #1430284 (400 connections now open) 2015-10-05T08:06:17.098+0100 [conn1430284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:18.591+0100 [conn1429933] end connection 172.28.0.164:55297 (399 connections now open) 2015-10-05T08:06:18.593+0100 [mongosMain] connection accepted from 172.28.0.164:56418 #1430285 (400 connections now open) 2015-10-05T08:06:18.595+0100 [conn1430285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:22.070+0100 [conn1429834] end connection 172.28.0.164:55020 (399 connections now open) 2015-10-05T08:06:22.070+0100 [conn1429896] end connection 172.28.0.164:55189 (399 connections now open) 2015-10-05T08:06:22.071+0100 [mongosMain] connection accepted from 172.28.0.164:56426 #1430286 (399 connections now open) 2015-10-05T08:06:22.072+0100 [mongosMain] connection accepted from 172.28.0.164:56427 #1430287 (400 connections now open) 2015-10-05T08:06:22.073+0100 [conn1430286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:22.074+0100 [conn1430287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:24.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221705703b51053eda056 2015-10-05T08:06:24.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:26.670+0100 [conn1429858] end connection 172.28.0.163:62058 (399 connections now open) 2015-10-05T08:06:26.672+0100 [conn1429709] end connection 172.28.0.163:61572 (398 connections now open) 2015-10-05T08:06:26.673+0100 [mongosMain] connection accepted from 172.28.0.163:63471 #1430288 (399 connections now open) 2015-10-05T08:06:26.673+0100 [mongosMain] connection accepted from 172.28.0.163:63472 #1430289 (400 connections now open) 2015-10-05T08:06:26.674+0100 [conn1430289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:26.674+0100 [conn1430288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:26.995+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:06:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:06:27.111+0100 [conn1429942] end connection 172.28.0.163:62340 (399 connections now open) 2015-10-05T08:06:27.112+0100 [mongosMain] connection accepted from 172.28.0.163:63473 #1430290 (400 connections now open) 2015-10-05T08:06:27.113+0100 [conn1430290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:28.607+0100 [conn1429937] end connection 172.28.0.164:55321 (399 connections now open) 2015-10-05T08:06:28.608+0100 [mongosMain] connection accepted from 172.28.0.164:56437 #1430291 (400 connections now open) 2015-10-05T08:06:28.611+0100 [conn1430291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:28.753+0100 [mongosMain] connection accepted from 127.0.0.1:63475 #1430292 (401 connections now open) 2015-10-05T08:06:28.756+0100 [conn1430292] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:28.765+0100 [conn1430292] end connection 127.0.0.1:63475 (400 connections now open) 2015-10-05T08:06:31.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221765703b51053eda09f 2015-10-05T08:06:31.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:32.085+0100 [conn1429907] end connection 172.28.0.164:55218 (399 connections now open) 2015-10-05T08:06:32.086+0100 [conn1429780] end connection 172.28.0.164:54853 (399 connections now open) 2015-10-05T08:06:32.086+0100 [mongosMain] connection accepted from 172.28.0.164:56445 #1430293 (399 connections now open) 2015-10-05T08:06:32.087+0100 [mongosMain] connection accepted from 172.28.0.164:56446 #1430294 (400 connections now open) 2015-10-05T08:06:32.088+0100 [conn1430293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:32.088+0100 [conn1430294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:36.550+0100 [conn1429809] end connection 172.28.0.163:61921 (399 connections now open) 2015-10-05T08:06:36.552+0100 [mongosMain] connection accepted from 172.28.0.163:63480 #1430295 (400 connections now open) 2015-10-05T08:06:36.553+0100 [conn1430295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:36.694+0100 [conn1429903] end connection 172.28.0.163:62201 (399 connections now open) 2015-10-05T08:06:36.695+0100 [conn1429798] end connection 172.28.0.163:61907 (398 connections now open) 2015-10-05T08:06:36.696+0100 [mongosMain] connection accepted from 172.28.0.163:63481 #1430296 (399 connections now open) 2015-10-05T08:06:36.696+0100 [mongosMain] connection accepted from 172.28.0.163:63482 #1430297 (400 connections now open) 2015-10-05T08:06:36.697+0100 [conn1430296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:36.697+0100 [conn1430297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:37.126+0100 [conn1429948] end connection 172.28.0.163:62351 (399 connections now open) 2015-10-05T08:06:37.127+0100 [mongosMain] connection accepted from 172.28.0.163:63485 #1430298 (400 connections now open) 2015-10-05T08:06:37.128+0100 [conn1430298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:37.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612217d5703b51053eda157 2015-10-05T08:06:38.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:38.623+0100 [conn1429943] end connection 172.28.0.164:55336 (399 connections now open) 2015-10-05T08:06:38.624+0100 [mongosMain] connection accepted from 172.28.0.164:56457 #1430299 (400 connections now open) 2015-10-05T08:06:38.626+0100 [conn1430299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:39.296+0100 [mongosMain] connection accepted from 127.0.0.1:63489 #1430300 (401 connections now open) 2015-10-05T08:06:39.299+0100 [conn1430300] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:39.302+0100 [conn1430300] end connection 127.0.0.1:63489 (400 connections now open) 2015-10-05T08:06:43.050+0100 [conn1429884] end connection 172.28.0.164:55147 (399 connections now open) 2015-10-05T08:06:43.052+0100 [mongosMain] connection accepted from 172.28.0.164:56463 #1430301 (400 connections now open) 2015-10-05T08:06:43.052+0100 [conn1429531] end connection 172.28.0.164:54112 (399 connections now open) 2015-10-05T08:06:43.054+0100 [conn1430301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:43.057+0100 [mongosMain] connection accepted from 172.28.0.164:56465 #1430302 (400 connections now open) 2015-10-05T08:06:43.061+0100 [conn1430302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:45.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221845703b51053eda1e0 2015-10-05T08:06:45.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:46.550+0100 [conn1429879] end connection 172.28.0.163:62122 (399 connections now open) 2015-10-05T08:06:46.551+0100 [mongosMain] connection accepted from 172.28.0.163:63498 #1430303 (400 connections now open) 2015-10-05T08:06:46.552+0100 [conn1430303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:46.692+0100 [conn1429920] end connection 172.28.0.163:62247 (399 connections now open) 2015-10-05T08:06:46.693+0100 [mongosMain] connection accepted from 172.28.0.163:63499 #1430304 (400 connections now open) 2015-10-05T08:06:46.693+0100 [conn1429614] end connection 172.28.0.163:61299 (399 connections now open) 2015-10-05T08:06:46.694+0100 [conn1430304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:46.694+0100 [mongosMain] connection accepted from 172.28.0.163:63500 #1430305 (400 connections now open) 2015-10-05T08:06:46.694+0100 [conn1430305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:47.127+0100 [conn1429953] end connection 172.28.0.163:62358 (399 connections now open) 2015-10-05T08:06:47.129+0100 [mongosMain] connection accepted from 172.28.0.163:63504 #1430306 (400 connections now open) 2015-10-05T08:06:47.130+0100 [conn1430306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:47.920+0100 [conn1429888] end connection 172.28.0.164:55152 (399 connections now open) 2015-10-05T08:06:47.922+0100 [mongosMain] connection accepted from 172.28.0.164:56475 #1430307 (400 connections now open) 2015-10-05T08:06:47.924+0100 [conn1430307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:48.623+0100 [conn1429949] end connection 172.28.0.164:55356 (399 connections now open) 2015-10-05T08:06:48.624+0100 [mongosMain] connection accepted from 172.28.0.164:56477 #1430308 (400 connections now open) 2015-10-05T08:06:48.626+0100 [conn1430308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:51.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612218b5703b51053eda26e 2015-10-05T08:06:51.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:53.053+0100 [conn1429902] end connection 172.28.0.164:55206 (399 connections now open) 2015-10-05T08:06:53.053+0100 [conn1429574] end connection 172.28.0.164:54212 (398 connections now open) 2015-10-05T08:06:53.054+0100 [mongosMain] connection accepted from 172.28.0.164:56483 #1430309 (399 connections now open) 2015-10-05T08:06:53.054+0100 [mongosMain] connection accepted from 172.28.0.164:56484 #1430310 (400 connections now open) 2015-10-05T08:06:53.055+0100 [conn1430310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:53.056+0100 [conn1430309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:56.565+0100 [conn1429814] end connection 172.28.0.163:61939 (399 connections now open) 2015-10-05T08:06:56.566+0100 [mongosMain] connection accepted from 172.28.0.163:63517 #1430311 (400 connections now open) 2015-10-05T08:06:56.567+0100 [conn1430311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:57.143+0100 [conn1429960] end connection 172.28.0.163:62376 (399 connections now open) 2015-10-05T08:06:57.144+0100 [mongosMain] connection accepted from 172.28.0.163:63518 #1430312 (400 connections now open) 2015-10-05T08:06:57.145+0100 [conn1430312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:57.166+0100 [conn1429914] end connection 172.28.0.163:62236 (399 connections now open) 2015-10-05T08:06:57.196+0100 [mongosMain] connection accepted from 172.28.0.163:63521 #1430313 (400 connections now open) 2015-10-05T08:06:57.197+0100 [conn1430313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:57.201+0100 [conn1429826] end connection 172.28.0.163:61992 (399 connections now open) 2015-10-05T08:06:57.370+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:06:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:06:57.645+0100 [mongosMain] connection accepted from 172.28.0.163:63522 #1430314 (400 connections now open) 2015-10-05T08:06:57.647+0100 [conn1430314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:57.937+0100 [conn1429860] end connection 172.28.0.164:55079 (399 connections now open) 2015-10-05T08:06:57.938+0100 [mongosMain] connection accepted from 172.28.0.164:56489 #1430315 (400 connections now open) 2015-10-05T08:06:57.939+0100 [conn1430315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:06:58.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221915703b51053eda2f5 2015-10-05T08:06:58.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:06:58.639+0100 [conn1429956] end connection 172.28.0.164:55375 (399 connections now open) 2015-10-05T08:06:58.640+0100 [mongosMain] connection accepted from 172.28.0.164:56491 #1430316 (400 connections now open) 2015-10-05T08:06:58.642+0100 [conn1430316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:03.069+0100 [conn1429742] end connection 172.28.0.164:54714 (399 connections now open) 2015-10-05T08:07:03.069+0100 [mongosMain] connection accepted from 172.28.0.164:56513 #1430317 (400 connections now open) 2015-10-05T08:07:03.071+0100 [conn1430317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:04.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221985703b51053eda374 2015-10-05T08:07:04.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:06.580+0100 [conn1429940] end connection 172.28.0.163:62335 (399 connections now open) 2015-10-05T08:07:06.581+0100 [mongosMain] connection accepted from 172.28.0.163:63546 #1430318 (400 connections now open) 2015-10-05T08:07:06.582+0100 [conn1430318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:07.049+0100 [conn1429880] end connection 172.28.0.163:62125 (399 connections now open) 2015-10-05T08:07:07.050+0100 [mongosMain] connection accepted from 172.28.0.163:63547 #1430319 (400 connections now open) 2015-10-05T08:07:07.051+0100 [conn1430319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:07.951+0100 [conn1429961] end connection 172.28.0.164:55391 (399 connections now open) 2015-10-05T08:07:07.953+0100 [mongosMain] connection accepted from 172.28.0.164:56516 #1430320 (400 connections now open) 2015-10-05T08:07:07.954+0100 [conn1430320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:08.655+0100 [conn1429963] end connection 172.28.0.164:55394 (399 connections now open) 2015-10-05T08:07:08.656+0100 [mongosMain] connection accepted from 172.28.0.164:56518 #1430321 (400 connections now open) 2015-10-05T08:07:08.658+0100 [conn1430321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:13.084+0100 [conn1429716] end connection 172.28.0.164:54632 (399 connections now open) 2015-10-05T08:07:13.086+0100 [mongosMain] connection accepted from 172.28.0.164:56521 #1430322 (400 connections now open) 2015-10-05T08:07:13.088+0100 [conn1430322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:16.582+0100 [conn1429946] end connection 172.28.0.163:62345 (399 connections now open) 2015-10-05T08:07:16.583+0100 [mongosMain] connection accepted from 172.28.0.163:63564 #1430323 (400 connections now open) 2015-10-05T08:07:16.584+0100 [conn1430323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:16.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221a45703b51053eda47e 2015-10-05T08:07:17.058+0100 [conn1429931] end connection 172.28.0.163:62287 (399 connections now open) 2015-10-05T08:07:17.059+0100 [mongosMain] connection accepted from 172.28.0.163:63566 #1430324 (400 connections now open) 2015-10-05T08:07:17.060+0100 [conn1430324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:17.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:17.157+0100 [conn1429966] end connection 172.28.0.163:62397 (399 connections now open) 2015-10-05T08:07:17.158+0100 [mongosMain] connection accepted from 172.28.0.163:63570 #1430325 (400 connections now open) 2015-10-05T08:07:17.169+0100 [conn1430325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:17.952+0100 [conn1429900] end connection 172.28.0.164:55193 (399 connections now open) 2015-10-05T08:07:17.954+0100 [mongosMain] connection accepted from 172.28.0.164:56525 #1430326 (400 connections now open) 2015-10-05T08:07:17.955+0100 [conn1430326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:18.655+0100 [conn1429969] end connection 172.28.0.164:55409 (399 connections now open) 2015-10-05T08:07:18.655+0100 [mongosMain] connection accepted from 172.28.0.164:56528 #1430327 (400 connections now open) 2015-10-05T08:07:18.657+0100 [conn1430327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:23.100+0100 [conn1429924] end connection 172.28.0.164:55276 (399 connections now open) 2015-10-05T08:07:23.100+0100 [conn1429661] end connection 172.28.0.164:54455 (399 connections now open) 2015-10-05T08:07:23.101+0100 [mongosMain] connection accepted from 172.28.0.164:56538 #1430328 (399 connections now open) 2015-10-05T08:07:23.101+0100 [mongosMain] connection accepted from 172.28.0.164:56537 #1430329 (400 connections now open) 2015-10-05T08:07:23.103+0100 [conn1430328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:23.103+0100 [conn1430329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:26.597+0100 [conn1429801] end connection 172.28.0.163:61909 (399 connections now open) 2015-10-05T08:07:26.598+0100 [mongosMain] connection accepted from 172.28.0.163:63574 #1430330 (400 connections now open) 2015-10-05T08:07:26.600+0100 [conn1430330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:27.065+0100 [conn1429935] end connection 172.28.0.163:62317 (399 connections now open) 2015-10-05T08:07:27.065+0100 [conn1429866] end connection 172.28.0.163:62087 (399 connections now open) 2015-10-05T08:07:27.066+0100 [mongosMain] connection accepted from 172.28.0.163:63575 #1430331 (399 connections now open) 2015-10-05T08:07:27.066+0100 [mongosMain] connection accepted from 172.28.0.163:63576 #1430332 (400 connections now open) 2015-10-05T08:07:27.067+0100 [conn1430331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:27.067+0100 [conn1430332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:27.159+0100 [conn1429973] end connection 172.28.0.163:62424 (399 connections now open) 2015-10-05T08:07:27.160+0100 [mongosMain] connection accepted from 172.28.0.163:63579 #1430333 (400 connections now open) 2015-10-05T08:07:27.161+0100 [conn1430333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:27.968+0100 [conn1429905] end connection 172.28.0.164:55209 (399 connections now open) 2015-10-05T08:07:27.969+0100 [mongosMain] connection accepted from 172.28.0.164:56543 #1430334 (400 connections now open) 2015-10-05T08:07:27.970+0100 [conn1430334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:27.982+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:07:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:07:28.655+0100 [conn1429977] end connection 172.28.0.164:55427 (399 connections now open) 2015-10-05T08:07:28.655+0100 [mongosMain] connection accepted from 172.28.0.164:56545 #1430335 (400 connections now open) 2015-10-05T08:07:28.657+0100 [conn1430335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:32.262+0100 [mongosMain] connection accepted from 127.0.0.1:63587 #1430336 (401 connections now open) 2015-10-05T08:07:32.264+0100 [conn1430336] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:32.270+0100 [conn1430336] end connection 127.0.0.1:63587 (400 connections now open) 2015-10-05T08:07:33.115+0100 [conn1429897] end connection 172.28.0.164:55190 (399 connections now open) 2015-10-05T08:07:33.115+0100 [conn1429918] end connection 172.28.0.164:55255 (399 connections now open) 2015-10-05T08:07:33.116+0100 [mongosMain] connection accepted from 172.28.0.164:56553 #1430337 (399 connections now open) 2015-10-05T08:07:33.117+0100 [mongosMain] connection accepted from 172.28.0.164:56554 #1430338 (400 connections now open) 2015-10-05T08:07:33.119+0100 [conn1430338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:33.119+0100 [conn1430337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:35.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221b75703b51053eda5b7 2015-10-05T08:07:35.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:36.598+0100 [conn1429930] end connection 172.28.0.163:62283 (399 connections now open) 2015-10-05T08:07:36.599+0100 [mongosMain] connection accepted from 172.28.0.163:63589 #1430339 (400 connections now open) 2015-10-05T08:07:36.600+0100 [conn1430339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:37.070+0100 [conn1429817] end connection 172.28.0.163:61946 (399 connections now open) 2015-10-05T08:07:37.070+0100 [conn1429926] end connection 172.28.0.163:62267 (399 connections now open) 2015-10-05T08:07:37.075+0100 [mongosMain] connection accepted from 172.28.0.163:63594 #1430340 (399 connections now open) 2015-10-05T08:07:37.075+0100 [mongosMain] connection accepted from 172.28.0.163:63595 #1430341 (400 connections now open) 2015-10-05T08:07:37.076+0100 [conn1430340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:37.076+0100 [conn1430341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:37.174+0100 [conn1429981] end connection 172.28.0.163:62443 (399 connections now open) 2015-10-05T08:07:37.175+0100 [mongosMain] connection accepted from 172.28.0.163:63596 #1430342 (400 connections now open) 2015-10-05T08:07:37.176+0100 [conn1430342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:37.984+0100 [conn1429954] end connection 172.28.0.164:55373 (399 connections now open) 2015-10-05T08:07:37.985+0100 [mongosMain] connection accepted from 172.28.0.164:56569 #1430343 (400 connections now open) 2015-10-05T08:07:37.989+0100 [conn1430343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:38.670+0100 [conn1429985] end connection 172.28.0.164:55440 (399 connections now open) 2015-10-05T08:07:38.671+0100 [mongosMain] connection accepted from 172.28.0.164:56573 #1430344 (400 connections now open) 2015-10-05T08:07:38.673+0100 [conn1430344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:39.415+0100 [mongosMain] connection accepted from 127.0.0.1:63598 #1430345 (401 connections now open) 2015-10-05T08:07:39.418+0100 [conn1430345] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:39.421+0100 [conn1430345] end connection 127.0.0.1:63598 (400 connections now open) 2015-10-05T08:07:42.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221bd5703b51053eda667 2015-10-05T08:07:42.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:43.131+0100 [conn1429631] end connection 172.28.0.164:54364 (399 connections now open) 2015-10-05T08:07:43.132+0100 [conn1429913] end connection 172.28.0.164:55238 (398 connections now open) 2015-10-05T08:07:43.133+0100 [mongosMain] connection accepted from 172.28.0.164:56582 #1430346 (399 connections now open) 2015-10-05T08:07:43.133+0100 [mongosMain] connection accepted from 172.28.0.164:56583 #1430347 (400 connections now open) 2015-10-05T08:07:43.134+0100 [conn1430346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:43.134+0100 [conn1430347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:46.613+0100 [conn1429952] end connection 172.28.0.163:62357 (399 connections now open) 2015-10-05T08:07:46.614+0100 [mongosMain] connection accepted from 172.28.0.163:63605 #1430348 (400 connections now open) 2015-10-05T08:07:46.615+0100 [conn1430348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:47.081+0100 [conn1429955] end connection 172.28.0.163:62363 (399 connections now open) 2015-10-05T08:07:47.083+0100 [mongosMain] connection accepted from 172.28.0.163:63608 #1430349 (400 connections now open) 2015-10-05T08:07:47.084+0100 [conn1430349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:47.641+0100 [conn1429806] end connection 172.28.0.163:61919 (399 connections now open) 2015-10-05T08:07:47.642+0100 [mongosMain] connection accepted from 172.28.0.163:63612 #1430350 (400 connections now open) 2015-10-05T08:07:47.642+0100 [conn1430350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:47.999+0100 [conn1429911] end connection 172.28.0.164:55222 (399 connections now open) 2015-10-05T08:07:48.000+0100 [mongosMain] connection accepted from 172.28.0.164:56590 #1430351 (400 connections now open) 2015-10-05T08:07:48.002+0100 [conn1430351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:48.685+0100 [conn1429993] end connection 172.28.0.164:55462 (399 connections now open) 2015-10-05T08:07:48.686+0100 [mongosMain] connection accepted from 172.28.0.164:56593 #1430352 (400 connections now open) 2015-10-05T08:07:48.689+0100 [conn1430352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:49.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221c45703b51053eda713 2015-10-05T08:07:50.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:53.148+0100 [conn1429667] end connection 172.28.0.164:54469 (399 connections now open) 2015-10-05T08:07:53.148+0100 [conn1429964] end connection 172.28.0.164:55406 (399 connections now open) 2015-10-05T08:07:53.149+0100 [mongosMain] connection accepted from 172.28.0.164:56596 #1430353 (399 connections now open) 2015-10-05T08:07:53.150+0100 [mongosMain] connection accepted from 172.28.0.164:56595 #1430354 (400 connections now open) 2015-10-05T08:07:53.158+0100 [conn1430354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:53.158+0100 [conn1430353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:56.614+0100 [conn1429852] end connection 172.28.0.163:62041 (399 connections now open) 2015-10-05T08:07:56.615+0100 [mongosMain] connection accepted from 172.28.0.163:63620 #1430355 (400 connections now open) 2015-10-05T08:07:56.616+0100 [conn1430355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:57.190+0100 [conn1429989] end connection 172.28.0.163:62456 (399 connections now open) 2015-10-05T08:07:57.192+0100 [mongosMain] connection accepted from 172.28.0.163:63622 #1430356 (400 connections now open) 2015-10-05T08:07:57.193+0100 [conn1430356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:58.702+0100 [conn1430000] end connection 172.28.0.164:55479 (399 connections now open) 2015-10-05T08:07:58.703+0100 [mongosMain] connection accepted from 172.28.0.164:56600 #1430357 (400 connections now open) 2015-10-05T08:07:58.704+0100 [conn1430357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:58.870+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561221ca3b0f755fc333c765') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444028876506), why: "doing balance round", ts: ObjectId('561221cc5703b51053eda7c8') } } gle1: { lastOp: Timestamp 1444028869000|3, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 1460, writtenTo: null, err: null, waited: 1460, ok: 1.0 } gle2: { lastOp: Timestamp 1444028877000|1, connectionId: 5195, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2015-10-05T08:07:58.877+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:07:59.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221cc5703b51053eda7c8 2015-10-05T08:07:59.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:07:59.178+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:07:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:07:59.434+0100 [conn1429990] end connection 172.28.0.164:55457 (399 connections now open) 2015-10-05T08:07:59.434+0100 [mongosMain] connection accepted from 172.28.0.164:56601 #1430358 (400 connections now open) 2015-10-05T08:07:59.453+0100 [conn1430358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:59.622+0100 [conn1429975] end connection 172.28.0.163:62426 (399 connections now open) 2015-10-05T08:07:59.622+0100 [conn1429976] end connection 172.28.0.163:62427 (399 connections now open) 2015-10-05T08:07:59.632+0100 [mongosMain] connection accepted from 172.28.0.163:63625 #1430359 (399 connections now open) 2015-10-05T08:07:59.633+0100 [conn1430359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:07:59.634+0100 [mongosMain] connection accepted from 172.28.0.163:63627 #1430360 (400 connections now open) 2015-10-05T08:07:59.635+0100 [conn1430360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:03.164+0100 [conn1429951] end connection 172.28.0.164:55369 (399 connections now open) 2015-10-05T08:08:03.165+0100 [mongosMain] connection accepted from 172.28.0.164:56618 #1430361 (400 connections now open) 2015-10-05T08:08:03.166+0100 [conn1430361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:06.628+0100 [conn1429845] end connection 172.28.0.163:62021 (399 connections now open) 2015-10-05T08:08:06.629+0100 [mongosMain] connection accepted from 172.28.0.163:63656 #1430362 (400 connections now open) 2015-10-05T08:08:06.630+0100 [conn1430362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:07.206+0100 [conn1430008] end connection 172.28.0.163:62508 (399 connections now open) 2015-10-05T08:08:07.207+0100 [mongosMain] connection accepted from 172.28.0.163:63659 #1430363 (400 connections now open) 2015-10-05T08:08:07.209+0100 [conn1430363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:08.016+0100 [conn1429974] end connection 172.28.0.164:55425 (399 connections now open) 2015-10-05T08:08:08.018+0100 [mongosMain] connection accepted from 172.28.0.164:56621 #1430364 (400 connections now open) 2015-10-05T08:08:08.019+0100 [conn1430364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:08.717+0100 [conn1430007] end connection 172.28.0.164:55497 (399 connections now open) 2015-10-05T08:08:08.718+0100 [mongosMain] connection accepted from 172.28.0.164:56622 #1430365 (400 connections now open) 2015-10-05T08:08:08.720+0100 [conn1430365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:09.592+0100 [conn1429968] end connection 172.28.0.163:62402 (399 connections now open) 2015-10-05T08:08:09.593+0100 [mongosMain] connection accepted from 172.28.0.163:63663 #1430366 (400 connections now open) 2015-10-05T08:08:09.593+0100 [conn1430366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:11.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221db5703b51053eda8fb 2015-10-05T08:08:11.551+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:08:13.163+0100 [conn1429944] end connection 172.28.0.164:55351 (399 connections now open) 2015-10-05T08:08:13.164+0100 [mongosMain] connection accepted from 172.28.0.164:56624 #1430367 (400 connections now open) 2015-10-05T08:08:13.166+0100 [conn1430367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:16.630+0100 [conn1429908] end connection 172.28.0.163:62218 (399 connections now open) 2015-10-05T08:08:16.631+0100 [mongosMain] connection accepted from 172.28.0.163:63672 #1430368 (400 connections now open) 2015-10-05T08:08:16.632+0100 [conn1430368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:17.206+0100 [conn1430015] end connection 172.28.0.163:62555 (399 connections now open) 2015-10-05T08:08:17.207+0100 [mongosMain] connection accepted from 172.28.0.163:63674 #1430369 (400 connections now open) 2015-10-05T08:08:17.209+0100 [conn1430369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:18.031+0100 [conn1430004] end connection 172.28.0.164:55494 (399 connections now open) 2015-10-05T08:08:18.031+0100 [mongosMain] connection accepted from 172.28.0.164:56628 #1430370 (400 connections now open) 2015-10-05T08:08:18.033+0100 [conn1430370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:18.733+0100 [conn1430011] end connection 172.28.0.164:55512 (399 connections now open) 2015-10-05T08:08:18.734+0100 [mongosMain] connection accepted from 172.28.0.164:56631 #1430371 (400 connections now open) 2015-10-05T08:08:18.735+0100 [conn1430371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:19.594+0100 [conn1429941] end connection 172.28.0.163:62337 (399 connections now open) 2015-10-05T08:08:19.595+0100 [mongosMain] connection accepted from 172.28.0.163:63678 #1430372 (400 connections now open) 2015-10-05T08:08:19.596+0100 [conn1430372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:23.315+0100 [conn1429938] end connection 172.28.0.164:55331 (399 connections now open) 2015-10-05T08:08:23.319+0100 [mongosMain] connection accepted from 172.28.0.164:56639 #1430373 (400 connections now open) 2015-10-05T08:08:23.320+0100 [conn1430373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:23.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221e75703b51053edaa02 2015-10-05T08:08:23.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:08:26.644+0100 [conn1429959] end connection 172.28.0.163:62375 (399 connections now open) 2015-10-05T08:08:26.645+0100 [mongosMain] connection accepted from 172.28.0.163:63683 #1430374 (400 connections now open) 2015-10-05T08:08:26.646+0100 [conn1430374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:27.221+0100 [conn1430022] end connection 172.28.0.163:62578 (399 connections now open) 2015-10-05T08:08:27.222+0100 [mongosMain] connection accepted from 172.28.0.163:63685 #1430375 (400 connections now open) 2015-10-05T08:08:27.224+0100 [conn1430375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:28.031+0100 [conn1429997] end connection 172.28.0.164:55477 (399 connections now open) 2015-10-05T08:08:28.032+0100 [mongosMain] connection accepted from 172.28.0.164:56647 #1430376 (400 connections now open) 2015-10-05T08:08:28.033+0100 [conn1430376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:28.748+0100 [conn1430018] end connection 172.28.0.164:55532 (399 connections now open) 2015-10-05T08:08:28.749+0100 [mongosMain] connection accepted from 172.28.0.164:56649 #1430377 (400 connections now open) 2015-10-05T08:08:28.754+0100 [conn1430377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:29.166+0100 [mongosMain] connection accepted from 127.0.0.1:63690 #1430378 (401 connections now open) 2015-10-05T08:08:29.169+0100 [conn1430378] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:29.174+0100 [conn1430378] end connection 127.0.0.1:63690 (400 connections now open) 2015-10-05T08:08:29.558+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:08:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:08:29.608+0100 [conn1429947] end connection 172.28.0.163:62349 (399 connections now open) 2015-10-05T08:08:29.609+0100 [mongosMain] connection accepted from 172.28.0.163:63691 #1430379 (400 connections now open) 2015-10-05T08:08:29.610+0100 [conn1430379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:30.125+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:08:30.125+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:08:34.343+0100 [conn1429995] end connection 172.28.0.164:55471 (399 connections now open) 2015-10-05T08:08:34.346+0100 [mongosMain] connection accepted from 172.28.0.164:56657 #1430380 (400 connections now open) 2015-10-05T08:08:34.347+0100 [conn1430380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:36.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221f45703b51053edab2e 2015-10-05T08:08:36.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:08:36.660+0100 [conn1429821] end connection 172.28.0.163:61972 (399 connections now open) 2015-10-05T08:08:36.661+0100 [mongosMain] connection accepted from 172.28.0.163:63693 #1430381 (400 connections now open) 2015-10-05T08:08:36.663+0100 [conn1430381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:38.047+0100 [conn1429967] end connection 172.28.0.164:55407 (399 connections now open) 2015-10-05T08:08:38.048+0100 [mongosMain] connection accepted from 172.28.0.164:56666 #1430382 (400 connections now open) 2015-10-05T08:08:38.050+0100 [conn1430382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:38.753+0100 [conn1430026] end connection 172.28.0.164:55546 (399 connections now open) 2015-10-05T08:08:38.754+0100 [mongosMain] connection accepted from 172.28.0.164:56669 #1430383 (400 connections now open) 2015-10-05T08:08:38.756+0100 [conn1430383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:39.554+0100 [mongosMain] connection accepted from 127.0.0.1:63697 #1430384 (401 connections now open) 2015-10-05T08:08:39.557+0100 [conn1430384] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:39.561+0100 [conn1430384] end connection 127.0.0.1:63697 (400 connections now open) 2015-10-05T08:08:39.624+0100 [conn1430019] end connection 172.28.0.163:62561 (399 connections now open) 2015-10-05T08:08:39.625+0100 [mongosMain] connection accepted from 172.28.0.163:63698 #1430385 (400 connections now open) 2015-10-05T08:08:39.627+0100 [conn1430385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:42.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561221fa5703b51053edabce 2015-10-05T08:08:42.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:08:44.333+0100 [conn1429986] end connection 172.28.0.164:55454 (399 connections now open) 2015-10-05T08:08:44.334+0100 [conn1430009] end connection 172.28.0.164:55509 (398 connections now open) 2015-10-05T08:08:44.335+0100 [mongosMain] connection accepted from 172.28.0.164:56680 #1430386 (399 connections now open) 2015-10-05T08:08:44.335+0100 [mongosMain] connection accepted from 172.28.0.164:56681 #1430387 (400 connections now open) 2015-10-05T08:08:44.337+0100 [conn1430386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:44.337+0100 [conn1430387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:46.660+0100 [conn1429864] end connection 172.28.0.163:62082 (399 connections now open) 2015-10-05T08:08:46.661+0100 [mongosMain] connection accepted from 172.28.0.163:63708 #1430388 (400 connections now open) 2015-10-05T08:08:46.662+0100 [conn1430388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:47.237+0100 [conn1430037] end connection 172.28.0.163:62604 (399 connections now open) 2015-10-05T08:08:47.238+0100 [mongosMain] connection accepted from 172.28.0.163:63711 #1430389 (400 connections now open) 2015-10-05T08:08:47.240+0100 [conn1430389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:48.069+0100 [conn1429894] end connection 172.28.0.164:55174 (399 connections now open) 2015-10-05T08:08:48.071+0100 [mongosMain] connection accepted from 172.28.0.164:56687 #1430390 (400 connections now open) 2015-10-05T08:08:48.072+0100 [conn1430390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:49.624+0100 [conn1430005] end connection 172.28.0.163:62494 (399 connections now open) 2015-10-05T08:08:49.625+0100 [mongosMain] connection accepted from 172.28.0.163:63715 #1430391 (400 connections now open) 2015-10-05T08:08:49.626+0100 [conn1430391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:54.354+0100 [conn1429945] end connection 172.28.0.164:55352 (399 connections now open) 2015-10-05T08:08:54.355+0100 [conn1429979] end connection 172.28.0.164:55433 (398 connections now open) 2015-10-05T08:08:54.355+0100 [mongosMain] connection accepted from 172.28.0.164:56696 #1430392 (400 connections now open) 2015-10-05T08:08:54.356+0100 [mongosMain] connection accepted from 172.28.0.164:56697 #1430393 (400 connections now open) 2015-10-05T08:08:54.357+0100 [conn1430392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:54.357+0100 [conn1430393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:56.676+0100 [conn1429873] end connection 172.28.0.163:62109 (399 connections now open) 2015-10-05T08:08:56.678+0100 [mongosMain] connection accepted from 172.28.0.163:63723 #1430394 (400 connections now open) 2015-10-05T08:08:56.680+0100 [conn1430394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:57.238+0100 [conn1430030] end connection 172.28.0.163:62591 (399 connections now open) 2015-10-05T08:08:57.240+0100 [mongosMain] connection accepted from 172.28.0.163:63725 #1430395 (400 connections now open) 2015-10-05T08:08:57.241+0100 [conn1430395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:57.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222065703b51053edad13 2015-10-05T08:08:58.078+0100 [conn1430010] end connection 172.28.0.164:55511 (399 connections now open) 2015-10-05T08:08:58.079+0100 [mongosMain] connection accepted from 172.28.0.164:56700 #1430396 (400 connections now open) 2015-10-05T08:08:58.081+0100 [conn1430396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:58.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:08:59.641+0100 [conn1429991] end connection 172.28.0.163:62459 (399 connections now open) 2015-10-05T08:08:59.642+0100 [mongosMain] connection accepted from 172.28.0.163:63731 #1430397 (400 connections now open) 2015-10-05T08:08:59.643+0100 [conn1430397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:08:59.823+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:08:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:09:04.349+0100 [conn1429971] end connection 172.28.0.164:55421 (399 connections now open) 2015-10-05T08:09:04.350+0100 [conn1429970] end connection 172.28.0.164:55422 (398 connections now open) 2015-10-05T08:09:04.351+0100 [mongosMain] connection accepted from 172.28.0.164:56717 #1430398 (399 connections now open) 2015-10-05T08:09:04.351+0100 [mongosMain] connection accepted from 172.28.0.164:56718 #1430399 (400 connections now open) 2015-10-05T08:09:04.352+0100 [conn1430398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:04.353+0100 [conn1430399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:04.368+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:09:04.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:09:06.676+0100 [conn1429965] end connection 172.28.0.163:62396 (399 connections now open) 2015-10-05T08:09:06.677+0100 [mongosMain] connection accepted from 172.28.0.163:63747 #1430400 (400 connections now open) 2015-10-05T08:09:06.678+0100 [conn1430400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:07.252+0100 [conn1430043] end connection 172.28.0.163:62621 (399 connections now open) 2015-10-05T08:09:07.253+0100 [mongosMain] connection accepted from 172.28.0.163:63750 #1430401 (400 connections now open) 2015-10-05T08:09:07.254+0100 [conn1430401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:08.094+0100 [conn1430025] end connection 172.28.0.164:55544 (399 connections now open) 2015-10-05T08:09:08.095+0100 [mongosMain] connection accepted from 172.28.0.164:56721 #1430402 (400 connections now open) 2015-10-05T08:09:08.097+0100 [conn1430402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:09.640+0100 [conn1429983] end connection 172.28.0.163:62446 (399 connections now open) 2015-10-05T08:09:09.642+0100 [mongosMain] connection accepted from 172.28.0.163:63755 #1430403 (400 connections now open) 2015-10-05T08:09:09.643+0100 [conn1430403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:14.458+0100 [conn1429934] end connection 172.28.0.164:55317 (399 connections now open) 2015-10-05T08:09:14.458+0100 [conn1429851] end connection 172.28.0.164:55060 (398 connections now open) 2015-10-05T08:09:14.462+0100 [mongosMain] connection accepted from 172.28.0.164:56724 #1430404 (399 connections now open) 2015-10-05T08:09:14.463+0100 [conn1430404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:14.468+0100 [mongosMain] connection accepted from 172.28.0.164:56726 #1430405 (400 connections now open) 2015-10-05T08:09:14.469+0100 [conn1430405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:16.455+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:09:16.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:09:16.691+0100 [conn1429972] end connection 172.28.0.163:62422 (399 connections now open) 2015-10-05T08:09:16.692+0100 [mongosMain] connection accepted from 172.28.0.163:63762 #1430406 (400 connections now open) 2015-10-05T08:09:16.693+0100 [conn1430406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:18.110+0100 [conn1430054] end connection 172.28.0.164:55630 (399 connections now open) 2015-10-05T08:09:18.111+0100 [mongosMain] connection accepted from 172.28.0.164:56730 #1430407 (400 connections now open) 2015-10-05T08:09:18.113+0100 [conn1430407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:19.655+0100 [conn1430012] end connection 172.28.0.163:62512 (399 connections now open) 2015-10-05T08:09:19.656+0100 [mongosMain] connection accepted from 172.28.0.163:63765 #1430408 (400 connections now open) 2015-10-05T08:09:19.669+0100 [conn1430408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:22.579+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612221e03838a4537162b81') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444028962461), why: "doing balance round", ts: ObjectId('561222225703b51053edaf54') } } gle1: { lastOp: Timestamp 1444028938000|1, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } gle2: { lastOp: Timestamp 1444028962000|5, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 12, writtenTo: null, err: null, waited: 12, ok: 1.0 } 2015-10-05T08:09:22.584+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:09:22.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222225703b51053edaf54 2015-10-05T08:09:22.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:09:24.427+0100 [conn1429808] end connection 172.28.0.164:54951 (399 connections now open) 2015-10-05T08:09:24.427+0100 [conn1429958] end connection 172.28.0.164:55388 (399 connections now open) 2015-10-05T08:09:24.429+0100 [mongosMain] connection accepted from 172.28.0.164:56744 #1430409 (399 connections now open) 2015-10-05T08:09:24.429+0100 [mongosMain] connection accepted from 172.28.0.164:56743 #1430410 (400 connections now open) 2015-10-05T08:09:24.431+0100 [conn1430409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:24.431+0100 [conn1430410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:26.692+0100 [conn1429980] end connection 172.28.0.163:62441 (399 connections now open) 2015-10-05T08:09:26.693+0100 [mongosMain] connection accepted from 172.28.0.163:63767 #1430411 (400 connections now open) 2015-10-05T08:09:26.693+0100 [conn1430411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:28.843+0100 [mongosMain] connection accepted from 127.0.0.1:63771 #1430412 (401 connections now open) 2015-10-05T08:09:28.846+0100 [conn1430412] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:28.851+0100 [conn1430412] end connection 127.0.0.1:63771 (400 connections now open) 2015-10-05T08:09:29.655+0100 [conn1429962] end connection 172.28.0.163:62381 (399 connections now open) 2015-10-05T08:09:29.656+0100 [mongosMain] connection accepted from 172.28.0.163:63773 #1430413 (400 connections now open) 2015-10-05T08:09:29.657+0100 [conn1430413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:30.194+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:09:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:09:35.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612222e5703b51053edb007 2015-10-05T08:09:35.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:09:36.742+0100 [conn1430003] end connection 172.28.0.163:62489 (399 connections now open) 2015-10-05T08:09:36.742+0100 [mongosMain] connection accepted from 172.28.0.163:63776 #1430414 (400 connections now open) 2015-10-05T08:09:36.742+0100 [conn1430414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:39.672+0100 [conn1430028] end connection 172.28.0.163:62581 (399 connections now open) 2015-10-05T08:09:39.672+0100 [mongosMain] connection accepted from 172.28.0.163:63779 #1430415 (400 connections now open) 2015-10-05T08:09:39.673+0100 [conn1430415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:40.165+0100 [mongosMain] connection accepted from 127.0.0.1:63780 #1430416 (401 connections now open) 2015-10-05T08:09:40.168+0100 [conn1430416] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:40.172+0100 [conn1430416] end connection 127.0.0.1:63780 (400 connections now open) 2015-10-05T08:09:46.723+0100 [conn1429988] end connection 172.28.0.163:62454 (399 connections now open) 2015-10-05T08:09:46.725+0100 [mongosMain] connection accepted from 172.28.0.163:63792 #1430417 (400 connections now open) 2015-10-05T08:09:46.726+0100 [conn1430417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:53.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222415703b51053edb0cc 2015-10-05T08:09:53.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:09:56.723+0100 [conn1429996] end connection 172.28.0.163:62468 (399 connections now open) 2015-10-05T08:09:56.724+0100 [mongosMain] connection accepted from 172.28.0.163:63803 #1430418 (400 connections now open) 2015-10-05T08:09:56.725+0100 [conn1430418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:09:59.712+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:09:59.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:10:00.645+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:10:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:10:06.739+0100 [conn1430036] end connection 172.28.0.163:62602 (399 connections now open) 2015-10-05T08:10:06.740+0100 [mongosMain] connection accepted from 172.28.0.163:63828 #1430419 (400 connections now open) 2015-10-05T08:10:06.741+0100 [conn1430419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:08.188+0100 [conn1430017] end connection 172.28.0.164:55530 (399 connections now open) 2015-10-05T08:10:08.189+0100 [mongosMain] connection accepted from 172.28.0.164:56806 #1430420 (400 connections now open) 2015-10-05T08:10:08.191+0100 [conn1430420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:08.828+0100 [conn1430032] end connection 172.28.0.164:55568 (399 connections now open) 2015-10-05T08:10:08.829+0100 [mongosMain] connection accepted from 172.28.0.164:56808 #1430421 (400 connections now open) 2015-10-05T08:10:08.831+0100 [conn1430421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:11.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222535703b51053edb1be 2015-10-05T08:10:11.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:10:14.505+0100 [conn1430031] end connection 172.28.0.164:55565 (399 connections now open) 2015-10-05T08:10:14.506+0100 [mongosMain] connection accepted from 172.28.0.164:56811 #1430422 (400 connections now open) 2015-10-05T08:10:14.507+0100 [conn1430422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:16.739+0100 [conn1430014] end connection 172.28.0.163:62545 (399 connections now open) 2015-10-05T08:10:16.740+0100 [mongosMain] connection accepted from 172.28.0.163:63840 #1430423 (400 connections now open) 2015-10-05T08:10:16.741+0100 [conn1430423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:17.316+0100 [conn1430057] end connection 172.28.0.163:62676 (399 connections now open) 2015-10-05T08:10:17.317+0100 [mongosMain] connection accepted from 172.28.0.163:63841 #1430424 (400 connections now open) 2015-10-05T08:10:17.319+0100 [conn1430424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:18.204+0100 [conn1430058] end connection 172.28.0.164:55638 (399 connections now open) 2015-10-05T08:10:18.205+0100 [mongosMain] connection accepted from 172.28.0.164:56818 #1430425 (400 connections now open) 2015-10-05T08:10:18.207+0100 [conn1430425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:18.844+0100 [conn1430039] end connection 172.28.0.164:55586 (399 connections now open) 2015-10-05T08:10:18.845+0100 [mongosMain] connection accepted from 172.28.0.164:56822 #1430426 (400 connections now open) 2015-10-05T08:10:18.846+0100 [conn1430426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:24.601+0100 [conn1430038] end connection 172.28.0.164:55582 (399 connections now open) 2015-10-05T08:10:24.609+0100 [mongosMain] connection accepted from 172.28.0.164:56831 #1430427 (400 connections now open) 2015-10-05T08:10:24.610+0100 [conn1430427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:26.754+0100 [conn1430052] end connection 172.28.0.163:62658 (399 connections now open) 2015-10-05T08:10:26.756+0100 [mongosMain] connection accepted from 172.28.0.163:63849 #1430428 (400 connections now open) 2015-10-05T08:10:26.757+0100 [conn1430428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:27.316+0100 [conn1430048] end connection 172.28.0.163:62637 (399 connections now open) 2015-10-05T08:10:27.317+0100 [mongosMain] connection accepted from 172.28.0.163:63851 #1430429 (400 connections now open) 2015-10-05T08:10:27.318+0100 [conn1430429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:28.219+0100 [conn1430045] end connection 172.28.0.164:55602 (399 connections now open) 2015-10-05T08:10:28.220+0100 [mongosMain] connection accepted from 172.28.0.164:56838 #1430430 (400 connections now open) 2015-10-05T08:10:28.222+0100 [conn1430430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:28.449+0100 [mongosMain] connection accepted from 127.0.0.1:63852 #1430431 (401 connections now open) 2015-10-05T08:10:28.452+0100 [conn1430431] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:28.456+0100 [conn1430431] end connection 127.0.0.1:63852 (400 connections now open) 2015-10-05T08:10:30.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222665703b51053edb313 2015-10-05T08:10:30.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:10:30.903+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:10:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:10:34.616+0100 [conn1430044] end connection 172.28.0.164:55601 (399 connections now open) 2015-10-05T08:10:34.618+0100 [mongosMain] connection accepted from 172.28.0.164:56847 #1430432 (400 connections now open) 2015-10-05T08:10:34.619+0100 [conn1430432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:36.757+0100 [conn1430047] end connection 172.28.0.163:62635 (399 connections now open) 2015-10-05T08:10:36.758+0100 [mongosMain] connection accepted from 172.28.0.163:63855 #1430433 (400 connections now open) 2015-10-05T08:10:36.759+0100 [conn1430433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:37.332+0100 [conn1430078] end connection 172.28.0.163:62783 (399 connections now open) 2015-10-05T08:10:37.334+0100 [mongosMain] connection accepted from 172.28.0.163:63857 #1430434 (400 connections now open) 2015-10-05T08:10:37.335+0100 [conn1430434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:38.234+0100 [conn1430066] end connection 172.28.0.164:55683 (399 connections now open) 2015-10-05T08:10:38.235+0100 [mongosMain] connection accepted from 172.28.0.164:56855 #1430435 (400 connections now open) 2015-10-05T08:10:38.242+0100 [conn1430435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:38.859+0100 [conn1430079] end connection 172.28.0.164:55747 (399 connections now open) 2015-10-05T08:10:38.860+0100 [mongosMain] connection accepted from 172.28.0.164:56857 #1430436 (400 connections now open) 2015-10-05T08:10:38.862+0100 [conn1430436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:39.468+0100 [mongosMain] connection accepted from 127.0.0.1:63859 #1430437 (401 connections now open) 2015-10-05T08:10:39.470+0100 [conn1430437] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:39.474+0100 [conn1430437] end connection 127.0.0.1:63859 (400 connections now open) 2015-10-05T08:10:46.769+0100 [conn1430021] end connection 172.28.0.163:62574 (399 connections now open) 2015-10-05T08:10:46.770+0100 [mongosMain] connection accepted from 172.28.0.163:63871 #1430438 (400 connections now open) 2015-10-05T08:10:46.771+0100 [conn1430438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:47.347+0100 [conn1430081] end connection 172.28.0.163:62795 (399 connections now open) 2015-10-05T08:10:47.348+0100 [mongosMain] connection accepted from 172.28.0.163:63873 #1430439 (400 connections now open) 2015-10-05T08:10:47.349+0100 [conn1430439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:48.235+0100 [conn1430062] end connection 172.28.0.164:55662 (399 connections now open) 2015-10-05T08:10:48.236+0100 [mongosMain] connection accepted from 172.28.0.164:56873 #1430440 (400 connections now open) 2015-10-05T08:10:48.237+0100 [conn1430440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:48.858+0100 [conn1430088] end connection 172.28.0.164:55785 (399 connections now open) 2015-10-05T08:10:48.860+0100 [mongosMain] connection accepted from 172.28.0.164:56874 #1430441 (400 connections now open) 2015-10-05T08:10:48.862+0100 [conn1430441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:56.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612227f5703b51053edb49a 2015-10-05T08:10:56.772+0100 [conn1430056] end connection 172.28.0.163:62673 (399 connections now open) 2015-10-05T08:10:56.773+0100 [mongosMain] connection accepted from 172.28.0.163:63888 #1430442 (400 connections now open) 2015-10-05T08:10:56.774+0100 [conn1430442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:57.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:10:57.349+0100 [conn1430086] end connection 172.28.0.163:62808 (399 connections now open) 2015-10-05T08:10:57.351+0100 [mongosMain] connection accepted from 172.28.0.163:63891 #1430443 (400 connections now open) 2015-10-05T08:10:57.352+0100 [conn1430443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:10:58.250+0100 [conn1429982] end connection 172.28.0.164:55438 (399 connections now open) 2015-10-05T08:10:58.251+0100 [mongosMain] connection accepted from 172.28.0.164:56882 #1430444 (400 connections now open) 2015-10-05T08:10:58.253+0100 [conn1430444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:01.032+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:11:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:11:03.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222875703b51053edb52a 2015-10-05T08:11:03.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:06.786+0100 [conn1430061] end connection 172.28.0.163:62687 (399 connections now open) 2015-10-05T08:11:06.787+0100 [mongosMain] connection accepted from 172.28.0.163:63915 #1430445 (400 connections now open) 2015-10-05T08:11:06.788+0100 [conn1430445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:08.266+0100 [conn1430073] end connection 172.28.0.164:55709 (399 connections now open) 2015-10-05T08:11:08.267+0100 [mongosMain] connection accepted from 172.28.0.164:56899 #1430446 (400 connections now open) 2015-10-05T08:11:08.268+0100 [conn1430446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:08.890+0100 [conn1430094] end connection 172.28.0.164:55807 (399 connections now open) 2015-10-05T08:11:08.891+0100 [mongosMain] connection accepted from 172.28.0.164:56902 #1430447 (400 connections now open) 2015-10-05T08:11:08.894+0100 [conn1430447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:16.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222935703b51053edb63a 2015-10-05T08:11:16.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:16.802+0100 [conn1430029] end connection 172.28.0.163:62589 (399 connections now open) 2015-10-05T08:11:16.803+0100 [mongosMain] connection accepted from 172.28.0.163:63930 #1430448 (400 connections now open) 2015-10-05T08:11:16.804+0100 [conn1430448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:17.364+0100 [conn1430092] end connection 172.28.0.163:62824 (399 connections now open) 2015-10-05T08:11:17.365+0100 [mongosMain] connection accepted from 172.28.0.163:63932 #1430449 (400 connections now open) 2015-10-05T08:11:17.366+0100 [conn1430449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:18.282+0100 [conn1430049] end connection 172.28.0.164:55616 (399 connections now open) 2015-10-05T08:11:18.283+0100 [mongosMain] connection accepted from 172.28.0.164:56904 #1430450 (400 connections now open) 2015-10-05T08:11:18.285+0100 [conn1430450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:18.909+0100 [conn1430099] end connection 172.28.0.164:55840 (399 connections now open) 2015-10-05T08:11:18.910+0100 [mongosMain] connection accepted from 172.28.0.164:56906 #1430451 (400 connections now open) 2015-10-05T08:11:18.918+0100 [conn1430451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:22.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612229a5703b51053edb6e0 2015-10-05T08:11:22.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:25.021+0100 [conn1430083] end connection 172.28.0.164:55768 (399 connections now open) 2015-10-05T08:11:25.022+0100 [mongosMain] connection accepted from 172.28.0.164:56914 #1430452 (400 connections now open) 2015-10-05T08:11:25.024+0100 [conn1430452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:26.803+0100 [conn1430072] end connection 172.28.0.163:62729 (399 connections now open) 2015-10-05T08:11:26.805+0100 [mongosMain] connection accepted from 172.28.0.163:63938 #1430453 (400 connections now open) 2015-10-05T08:11:26.806+0100 [conn1430453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:27.379+0100 [conn1430100] end connection 172.28.0.163:62890 (399 connections now open) 2015-10-05T08:11:27.380+0100 [mongosMain] connection accepted from 172.28.0.163:63940 #1430454 (400 connections now open) 2015-10-05T08:11:27.381+0100 [conn1430454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:28.297+0100 [conn1430070] end connection 172.28.0.164:55700 (399 connections now open) 2015-10-05T08:11:28.299+0100 [mongosMain] connection accepted from 172.28.0.164:56919 #1430455 (400 connections now open) 2015-10-05T08:11:28.300+0100 [conn1430455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:28.696+0100 [mongosMain] connection accepted from 127.0.0.1:63942 #1430456 (401 connections now open) 2015-10-05T08:11:28.698+0100 [conn1430456] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:28.703+0100 [conn1430456] end connection 127.0.0.1:63942 (400 connections now open) 2015-10-05T08:11:28.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222a05703b51053edb76c 2015-10-05T08:11:28.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:28.922+0100 [conn1430102] end connection 172.28.0.164:55852 (399 connections now open) 2015-10-05T08:11:28.923+0100 [mongosMain] connection accepted from 172.28.0.164:56921 #1430457 (400 connections now open) 2015-10-05T08:11:28.925+0100 [conn1430457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:30.578+0100 [conn1429842] end connection 172.28.0.163:62017 (399 connections now open) 2015-10-05T08:11:30.579+0100 [mongosMain] connection accepted from 172.28.0.163:63943 #1430458 (400 connections now open) 2015-10-05T08:11:30.580+0100 [conn1430458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:31.869+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:11:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:11:35.041+0100 [conn1430002] end connection 172.28.0.164:55491 (399 connections now open) 2015-10-05T08:11:35.043+0100 [mongosMain] connection accepted from 172.28.0.164:56930 #1430459 (400 connections now open) 2015-10-05T08:11:35.045+0100 [conn1430459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:36.817+0100 [conn1430065] end connection 172.28.0.163:62698 (399 connections now open) 2015-10-05T08:11:36.817+0100 [mongosMain] connection accepted from 172.28.0.163:63948 #1430460 (400 connections now open) 2015-10-05T08:11:36.818+0100 [conn1430460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:37.379+0100 [conn1430104] end connection 172.28.0.163:62900 (399 connections now open) 2015-10-05T08:11:37.380+0100 [mongosMain] connection accepted from 172.28.0.163:63950 #1430461 (400 connections now open) 2015-10-05T08:11:37.382+0100 [conn1430461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:38.313+0100 [conn1430087] end connection 172.28.0.164:55781 (399 connections now open) 2015-10-05T08:11:38.314+0100 [mongosMain] connection accepted from 172.28.0.164:56935 #1430462 (400 connections now open) 2015-10-05T08:11:38.317+0100 [conn1430462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:38.937+0100 [conn1430106] end connection 172.28.0.164:55871 (399 connections now open) 2015-10-05T08:11:38.938+0100 [mongosMain] connection accepted from 172.28.0.164:56938 #1430463 (400 connections now open) 2015-10-05T08:11:38.940+0100 [conn1430463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:39.723+0100 [mongosMain] connection accepted from 127.0.0.1:63952 #1430464 (401 connections now open) 2015-10-05T08:11:39.725+0100 [conn1430464] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:39.730+0100 [conn1430464] end connection 127.0.0.1:63952 (400 connections now open) 2015-10-05T08:11:40.589+0100 [conn1430006] end connection 172.28.0.163:62495 (399 connections now open) 2015-10-05T08:11:40.590+0100 [mongosMain] connection accepted from 172.28.0.163:63953 #1430465 (400 connections now open) 2015-10-05T08:11:40.591+0100 [conn1430465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:41.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222ac5703b51053edb855 2015-10-05T08:11:41.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:46.820+0100 [conn1430075] end connection 172.28.0.163:62769 (399 connections now open) 2015-10-05T08:11:46.821+0100 [mongosMain] connection accepted from 172.28.0.163:63962 #1430466 (400 connections now open) 2015-10-05T08:11:46.822+0100 [conn1430466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:47.395+0100 [conn1430109] end connection 172.28.0.163:62915 (399 connections now open) 2015-10-05T08:11:47.396+0100 [mongosMain] connection accepted from 172.28.0.163:63964 #1430467 (400 connections now open) 2015-10-05T08:11:47.398+0100 [conn1430467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:48.329+0100 [conn1430101] end connection 172.28.0.164:55850 (399 connections now open) 2015-10-05T08:11:48.331+0100 [mongosMain] connection accepted from 172.28.0.164:56958 #1430468 (400 connections now open) 2015-10-05T08:11:48.333+0100 [conn1430468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:48.937+0100 [conn1430111] end connection 172.28.0.164:55893 (399 connections now open) 2015-10-05T08:11:48.939+0100 [mongosMain] connection accepted from 172.28.0.164:56960 #1430469 (400 connections now open) 2015-10-05T08:11:48.941+0100 [conn1430469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:51.104+0100 [conn1429984] end connection 172.28.0.163:62447 (399 connections now open) 2015-10-05T08:11:51.109+0100 [mongosMain] connection accepted from 172.28.0.163:63969 #1430470 (400 connections now open) 2015-10-05T08:11:51.110+0100 [conn1430470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:53.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222b95703b51053edb923 2015-10-05T08:11:53.675+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:11:56.833+0100 [conn1430077] end connection 172.28.0.163:62782 (399 connections now open) 2015-10-05T08:11:56.834+0100 [mongosMain] connection accepted from 172.28.0.163:63980 #1430471 (400 connections now open) 2015-10-05T08:11:56.835+0100 [conn1430471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:57.395+0100 [conn1430115] end connection 172.28.0.163:62928 (399 connections now open) 2015-10-05T08:11:57.396+0100 [mongosMain] connection accepted from 172.28.0.163:63981 #1430472 (400 connections now open) 2015-10-05T08:11:57.397+0100 [conn1430472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:58.329+0100 [conn1430082] end connection 172.28.0.164:55766 (399 connections now open) 2015-10-05T08:11:58.330+0100 [mongosMain] connection accepted from 172.28.0.164:56968 #1430473 (401 connections now open) 2015-10-05T08:11:58.335+0100 [conn1430473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:11:58.953+0100 [conn1430117] end connection 172.28.0.164:55914 (399 connections now open) 2015-10-05T08:11:58.954+0100 [mongosMain] connection accepted from 172.28.0.164:56971 #1430474 (400 connections now open) 2015-10-05T08:11:58.955+0100 [conn1430474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:02.254+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:12:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:12:06.839+0100 [conn1430091] end connection 172.28.0.163:62822 (399 connections now open) 2015-10-05T08:12:06.840+0100 [mongosMain] connection accepted from 172.28.0.163:64000 #1430475 (400 connections now open) 2015-10-05T08:12:06.841+0100 [conn1430475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:07.410+0100 [conn1430120] end connection 172.28.0.163:62946 (399 connections now open) 2015-10-05T08:12:07.412+0100 [mongosMain] connection accepted from 172.28.0.163:64002 #1430476 (400 connections now open) 2015-10-05T08:12:07.413+0100 [conn1430476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:08.330+0100 [conn1430096] end connection 172.28.0.164:55819 (399 connections now open) 2015-10-05T08:12:08.331+0100 [mongosMain] connection accepted from 172.28.0.164:56990 #1430477 (400 connections now open) 2015-10-05T08:12:08.334+0100 [conn1430477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:08.953+0100 [conn1430121] end connection 172.28.0.164:55929 (399 connections now open) 2015-10-05T08:12:08.953+0100 [mongosMain] connection accepted from 172.28.0.164:56992 #1430478 (400 connections now open) 2015-10-05T08:12:08.955+0100 [conn1430478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:11.945+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561222cb3b0f755fc333ddb2') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444029131817), why: "doing balance round", ts: ObjectId('561222cb5703b51053edbaf9') } } gle1: { lastOp: Timestamp 1444029131000|8, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444029113000|8, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } 2015-10-05T08:12:11.949+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:12:12.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222cb5703b51053edbaf9 2015-10-05T08:12:12.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:16.849+0100 [conn1430097] end connection 172.28.0.163:62860 (399 connections now open) 2015-10-05T08:12:16.851+0100 [mongosMain] connection accepted from 172.28.0.163:64016 #1430479 (400 connections now open) 2015-10-05T08:12:16.854+0100 [conn1430479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:17.427+0100 [conn1430124] end connection 172.28.0.163:62972 (399 connections now open) 2015-10-05T08:12:17.428+0100 [mongosMain] connection accepted from 172.28.0.163:64017 #1430480 (400 connections now open) 2015-10-05T08:12:17.429+0100 [conn1430480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:18.345+0100 [conn1430105] end connection 172.28.0.164:55869 (399 connections now open) 2015-10-05T08:12:18.346+0100 [mongosMain] connection accepted from 172.28.0.164:57001 #1430481 (400 connections now open) 2015-10-05T08:12:18.347+0100 [conn1430481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:18.969+0100 [conn1430125] end connection 172.28.0.164:55953 (399 connections now open) 2015-10-05T08:12:18.971+0100 [mongosMain] connection accepted from 172.28.0.164:57003 #1430482 (400 connections now open) 2015-10-05T08:12:18.972+0100 [conn1430482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:18.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222d25703b51053edbbae 2015-10-05T08:12:19.133+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:25.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222d95703b51053edbc77 2015-10-05T08:12:25.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:26.850+0100 [conn1430114] end connection 172.28.0.163:62926 (399 connections now open) 2015-10-05T08:12:26.851+0100 [mongosMain] connection accepted from 172.28.0.163:64022 #1430483 (400 connections now open) 2015-10-05T08:12:26.853+0100 [conn1430483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:27.427+0100 [conn1430128] end connection 172.28.0.163:62989 (399 connections now open) 2015-10-05T08:12:27.428+0100 [mongosMain] connection accepted from 172.28.0.163:64024 #1430484 (400 connections now open) 2015-10-05T08:12:27.429+0100 [conn1430484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:28.345+0100 [conn1430076] end connection 172.28.0.164:55738 (399 connections now open) 2015-10-05T08:12:28.346+0100 [mongosMain] connection accepted from 172.28.0.164:57020 #1430485 (400 connections now open) 2015-10-05T08:12:28.348+0100 [conn1430485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:28.529+0100 [mongosMain] connection accepted from 127.0.0.1:64026 #1430486 (401 connections now open) 2015-10-05T08:12:28.532+0100 [conn1430486] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:28.537+0100 [conn1430486] end connection 127.0.0.1:64026 (400 connections now open) 2015-10-05T08:12:28.969+0100 [conn1430129] end connection 172.28.0.164:55965 (399 connections now open) 2015-10-05T08:12:28.971+0100 [mongosMain] connection accepted from 172.28.0.164:57022 #1430487 (400 connections now open) 2015-10-05T08:12:28.973+0100 [conn1430487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:31.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222df5703b51053edbd43 2015-10-05T08:12:31.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:33.707+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:12:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:12:36.866+0100 [conn1430119] end connection 172.28.0.163:62943 (399 connections now open) 2015-10-05T08:12:36.867+0100 [mongosMain] connection accepted from 172.28.0.163:64030 #1430488 (400 connections now open) 2015-10-05T08:12:36.868+0100 [conn1430488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:37.442+0100 [conn1430132] end connection 172.28.0.163:63000 (399 connections now open) 2015-10-05T08:12:37.443+0100 [mongosMain] connection accepted from 172.28.0.163:64032 #1430489 (400 connections now open) 2015-10-05T08:12:37.444+0100 [conn1430489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:38.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222e55703b51053edbe0f 2015-10-05T08:12:38.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:38.362+0100 [conn1430098] end connection 172.28.0.164:55834 (399 connections now open) 2015-10-05T08:12:38.363+0100 [mongosMain] connection accepted from 172.28.0.164:57038 #1430490 (400 connections now open) 2015-10-05T08:12:38.366+0100 [conn1430490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:38.985+0100 [conn1430134] end connection 172.28.0.164:55987 (399 connections now open) 2015-10-05T08:12:38.986+0100 [mongosMain] connection accepted from 172.28.0.164:57040 #1430491 (400 connections now open) 2015-10-05T08:12:38.987+0100 [conn1430491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:39.510+0100 [mongosMain] connection accepted from 127.0.0.1:64034 #1430492 (401 connections now open) 2015-10-05T08:12:39.513+0100 [conn1430492] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:39.517+0100 [conn1430492] end connection 127.0.0.1:64034 (400 connections now open) 2015-10-05T08:12:44.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222ec5703b51053edbec2 2015-10-05T08:12:44.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:46.880+0100 [conn1430085] end connection 172.28.0.163:62807 (399 connections now open) 2015-10-05T08:12:46.881+0100 [mongosMain] connection accepted from 172.28.0.163:64047 #1430493 (400 connections now open) 2015-10-05T08:12:46.882+0100 [conn1430493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:47.443+0100 [conn1430138] end connection 172.28.0.163:63008 (399 connections now open) 2015-10-05T08:12:47.444+0100 [mongosMain] connection accepted from 172.28.0.163:64050 #1430494 (400 connections now open) 2015-10-05T08:12:47.445+0100 [conn1430494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:49.000+0100 [conn1430140] end connection 172.28.0.164:56007 (399 connections now open) 2015-10-05T08:12:49.001+0100 [mongosMain] connection accepted from 172.28.0.164:57060 #1430495 (400 connections now open) 2015-10-05T08:12:49.003+0100 [conn1430495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:50.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222f25703b51053edbf46 2015-10-05T08:12:51.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:57.458+0100 [conn1430144] end connection 172.28.0.163:63029 (399 connections now open) 2015-10-05T08:12:57.459+0100 [mongosMain] connection accepted from 172.28.0.163:64065 #1430496 (400 connections now open) 2015-10-05T08:12:57.460+0100 [conn1430496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:12:58.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561222f95703b51053edbfb2 2015-10-05T08:12:58.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:12:59.016+0100 [conn1430145] end connection 172.28.0.164:56024 (399 connections now open) 2015-10-05T08:12:59.017+0100 [mongosMain] connection accepted from 172.28.0.164:57072 #1430497 (400 connections now open) 2015-10-05T08:12:59.019+0100 [conn1430497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:01.165+0100 [conn1430064] end connection 172.28.0.163:62693 (399 connections now open) 2015-10-05T08:13:01.166+0100 [mongosMain] connection accepted from 172.28.0.163:64081 #1430498 (400 connections now open) 2015-10-05T08:13:01.167+0100 [conn1430498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:04.048+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:13:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:13:05.398+0100 [conn1430050] end connection 172.28.0.164:55617 (399 connections now open) 2015-10-05T08:13:05.398+0100 [conn1429939] end connection 172.28.0.164:55332 (398 connections now open) 2015-10-05T08:13:05.398+0100 [mongosMain] connection accepted from 172.28.0.164:57091 #1430499 (399 connections now open) 2015-10-05T08:13:05.399+0100 [mongosMain] connection accepted from 172.28.0.164:57092 #1430500 (400 connections now open) 2015-10-05T08:13:05.400+0100 [conn1430499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:05.401+0100 [conn1430500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:06.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223015703b51053edc048 2015-10-05T08:13:06.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:06.895+0100 [conn1430123] end connection 172.28.0.163:62969 (399 connections now open) 2015-10-05T08:13:06.896+0100 [mongosMain] connection accepted from 172.28.0.163:64095 #1430501 (400 connections now open) 2015-10-05T08:13:06.897+0100 [conn1430501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:07.460+0100 [conn1430148] end connection 172.28.0.163:63045 (399 connections now open) 2015-10-05T08:13:07.462+0100 [mongosMain] connection accepted from 172.28.0.163:64099 #1430502 (400 connections now open) 2015-10-05T08:13:07.463+0100 [conn1430502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:09.016+0100 [conn1430150] end connection 172.28.0.164:56036 (399 connections now open) 2015-10-05T08:13:09.018+0100 [mongosMain] connection accepted from 172.28.0.164:57098 #1430503 (400 connections now open) 2015-10-05T08:13:09.021+0100 [conn1430503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:11.170+0100 [conn1430051] end connection 172.28.0.163:62641 (399 connections now open) 2015-10-05T08:13:11.171+0100 [mongosMain] connection accepted from 172.28.0.163:64104 #1430504 (400 connections now open) 2015-10-05T08:13:11.172+0100 [conn1430504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:12.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223085703b51053edc0cc 2015-10-05T08:13:12.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:16.067+0100 [conn1430118] end connection 172.28.0.164:55918 (399 connections now open) 2015-10-05T08:13:16.068+0100 [conn1429878] end connection 172.28.0.164:55125 (398 connections now open) 2015-10-05T08:13:16.069+0100 [mongosMain] connection accepted from 172.28.0.164:57100 #1430505 (399 connections now open) 2015-10-05T08:13:16.069+0100 [mongosMain] connection accepted from 172.28.0.164:57101 #1430506 (400 connections now open) 2015-10-05T08:13:16.070+0100 [conn1430505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:16.071+0100 [conn1430506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:17.473+0100 [conn1430154] end connection 172.28.0.163:63079 (399 connections now open) 2015-10-05T08:13:17.474+0100 [mongosMain] connection accepted from 172.28.0.163:64116 #1430507 (400 connections now open) 2015-10-05T08:13:17.475+0100 [conn1430507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:18.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612230e5703b51053edc11a 2015-10-05T08:13:19.016+0100 [conn1430156] end connection 172.28.0.164:56053 (399 connections now open) 2015-10-05T08:13:19.017+0100 [mongosMain] connection accepted from 172.28.0.164:57106 #1430508 (400 connections now open) 2015-10-05T08:13:19.018+0100 [conn1430508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:19.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:21.170+0100 [conn1429999] end connection 172.28.0.163:62473 (399 connections now open) 2015-10-05T08:13:21.171+0100 [mongosMain] connection accepted from 172.28.0.163:64120 #1430509 (400 connections now open) 2015-10-05T08:13:21.172+0100 [conn1430509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:25.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223155703b51053edc17a 2015-10-05T08:13:25.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:25.989+0100 [conn1429857] end connection 172.28.0.164:55077 (399 connections now open) 2015-10-05T08:13:25.989+0100 [conn1430059] end connection 172.28.0.164:55641 (399 connections now open) 2015-10-05T08:13:25.990+0100 [mongosMain] connection accepted from 172.28.0.164:57119 #1430510 (399 connections now open) 2015-10-05T08:13:25.991+0100 [mongosMain] connection accepted from 172.28.0.164:57120 #1430511 (400 connections now open) 2015-10-05T08:13:25.991+0100 [conn1430510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:25.992+0100 [conn1430511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:26.912+0100 [conn1430127] end connection 172.28.0.163:62988 (399 connections now open) 2015-10-05T08:13:26.913+0100 [mongosMain] connection accepted from 172.28.0.163:64125 #1430512 (400 connections now open) 2015-10-05T08:13:26.914+0100 [conn1430512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:27.489+0100 [conn1430160] end connection 172.28.0.163:63099 (399 connections now open) 2015-10-05T08:13:27.490+0100 [mongosMain] connection accepted from 172.28.0.163:64127 #1430513 (400 connections now open) 2015-10-05T08:13:27.491+0100 [conn1430513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:28.407+0100 [conn1430161] end connection 172.28.0.164:56061 (399 connections now open) 2015-10-05T08:13:28.409+0100 [mongosMain] connection accepted from 172.28.0.164:57124 #1430514 (400 connections now open) 2015-10-05T08:13:28.411+0100 [conn1430514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:29.031+0100 [conn1430162] end connection 172.28.0.164:56063 (399 connections now open) 2015-10-05T08:13:29.032+0100 [mongosMain] connection accepted from 172.28.0.164:57127 #1430515 (400 connections now open) 2015-10-05T08:13:29.034+0100 [conn1430515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:29.051+0100 [mongosMain] connection accepted from 127.0.0.1:64129 #1430516 (401 connections now open) 2015-10-05T08:13:29.054+0100 [conn1430516] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:29.059+0100 [conn1430516] end connection 127.0.0.1:64129 (400 connections now open) 2015-10-05T08:13:31.171+0100 [conn1430074] end connection 172.28.0.163:62736 (399 connections now open) 2015-10-05T08:13:31.171+0100 [conn1429537] end connection 172.28.0.163:61079 (399 connections now open) 2015-10-05T08:13:31.172+0100 [mongosMain] connection accepted from 172.28.0.163:64131 #1430517 (399 connections now open) 2015-10-05T08:13:31.172+0100 [mongosMain] connection accepted from 172.28.0.163:64132 #1430518 (400 connections now open) 2015-10-05T08:13:31.173+0100 [conn1430517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:31.174+0100 [conn1430518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:32.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612231b5703b51053edc1f4 2015-10-05T08:13:32.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:34.315+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:13:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:13:36.005+0100 [conn1429828] end connection 172.28.0.164:54999 (399 connections now open) 2015-10-05T08:13:36.005+0100 [conn1429929] end connection 172.28.0.164:55293 (399 connections now open) 2015-10-05T08:13:36.007+0100 [mongosMain] connection accepted from 172.28.0.164:57139 #1430519 (399 connections now open) 2015-10-05T08:13:36.007+0100 [mongosMain] connection accepted from 172.28.0.164:57140 #1430520 (400 connections now open) 2015-10-05T08:13:36.008+0100 [conn1430519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:36.008+0100 [conn1430520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:36.912+0100 [conn1430108] end connection 172.28.0.163:62913 (399 connections now open) 2015-10-05T08:13:36.913+0100 [mongosMain] connection accepted from 172.28.0.163:64136 #1430521 (400 connections now open) 2015-10-05T08:13:36.914+0100 [conn1430521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:37.489+0100 [conn1430168] end connection 172.28.0.163:63113 (399 connections now open) 2015-10-05T08:13:37.490+0100 [mongosMain] connection accepted from 172.28.0.163:64138 #1430522 (400 connections now open) 2015-10-05T08:13:37.492+0100 [conn1430522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:38.423+0100 [conn1430155] end connection 172.28.0.164:56051 (399 connections now open) 2015-10-05T08:13:38.425+0100 [mongosMain] connection accepted from 172.28.0.164:57145 #1430523 (400 connections now open) 2015-10-05T08:13:38.427+0100 [conn1430523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:39.047+0100 [conn1430170] end connection 172.28.0.164:56089 (399 connections now open) 2015-10-05T08:13:39.050+0100 [mongosMain] connection accepted from 172.28.0.164:57149 #1430524 (400 connections now open) 2015-10-05T08:13:39.052+0100 [conn1430524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:39.697+0100 [mongosMain] connection accepted from 127.0.0.1:64140 #1430525 (401 connections now open) 2015-10-05T08:13:39.703+0100 [conn1430525] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:39.708+0100 [conn1430525] end connection 127.0.0.1:64140 (400 connections now open) 2015-10-05T08:13:41.186+0100 [conn1430122] end connection 172.28.0.163:62958 (399 connections now open) 2015-10-05T08:13:41.186+0100 [conn1430060] end connection 172.28.0.163:62680 (399 connections now open) 2015-10-05T08:13:41.187+0100 [mongosMain] connection accepted from 172.28.0.163:64142 #1430526 (399 connections now open) 2015-10-05T08:13:41.187+0100 [mongosMain] connection accepted from 172.28.0.163:64143 #1430527 (400 connections now open) 2015-10-05T08:13:41.188+0100 [conn1430526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:41.188+0100 [conn1430527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:44.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223285703b51053edc306 2015-10-05T08:13:44.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:46.006+0100 [conn1430080] end connection 172.28.0.164:55748 (399 connections now open) 2015-10-05T08:13:46.006+0100 [conn1429540] end connection 172.28.0.164:54124 (398 connections now open) 2015-10-05T08:13:46.007+0100 [mongosMain] connection accepted from 172.28.0.164:57159 #1430528 (399 connections now open) 2015-10-05T08:13:46.007+0100 [mongosMain] connection accepted from 172.28.0.164:57161 #1430529 (400 connections now open) 2015-10-05T08:13:46.008+0100 [conn1430528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:46.009+0100 [conn1430529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:46.927+0100 [conn1430103] end connection 172.28.0.163:62899 (399 connections now open) 2015-10-05T08:13:46.929+0100 [mongosMain] connection accepted from 172.28.0.163:64154 #1430530 (400 connections now open) 2015-10-05T08:13:46.929+0100 [conn1430530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:47.505+0100 [conn1430177] end connection 172.28.0.163:63133 (399 connections now open) 2015-10-05T08:13:47.506+0100 [mongosMain] connection accepted from 172.28.0.163:64156 #1430531 (400 connections now open) 2015-10-05T08:13:47.507+0100 [conn1430531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:49.064+0100 [conn1430179] end connection 172.28.0.164:56110 (399 connections now open) 2015-10-05T08:13:49.065+0100 [mongosMain] connection accepted from 172.28.0.164:57165 #1430532 (400 connections now open) 2015-10-05T08:13:49.067+0100 [conn1430532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:51.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612232e5703b51053edc38a 2015-10-05T08:13:51.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:51.187+0100 [conn1430142] end connection 172.28.0.163:63020 (399 connections now open) 2015-10-05T08:13:51.187+0100 [conn1430071] end connection 172.28.0.163:62717 (399 connections now open) 2015-10-05T08:13:51.188+0100 [mongosMain] connection accepted from 172.28.0.163:64163 #1430533 (399 connections now open) 2015-10-05T08:13:51.188+0100 [mongosMain] connection accepted from 172.28.0.163:64164 #1430534 (400 connections now open) 2015-10-05T08:13:51.189+0100 [conn1430533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:51.189+0100 [conn1430534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:56.345+0100 [conn1430113] end connection 172.28.0.164:55901 (399 connections now open) 2015-10-05T08:13:56.346+0100 [mongosMain] connection accepted from 172.28.0.164:57174 #1430535 (400 connections now open) 2015-10-05T08:13:56.347+0100 [conn1429794] end connection 172.28.0.164:54910 (399 connections now open) 2015-10-05T08:13:56.348+0100 [conn1430535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:56.348+0100 [mongosMain] connection accepted from 172.28.0.164:57175 #1430536 (400 connections now open) 2015-10-05T08:13:56.351+0100 [conn1430536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:56.943+0100 [conn1430069] end connection 172.28.0.163:62712 (399 connections now open) 2015-10-05T08:13:56.944+0100 [mongosMain] connection accepted from 172.28.0.163:64174 #1430537 (400 connections now open) 2015-10-05T08:13:56.945+0100 [conn1430537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:57.504+0100 [conn1430186] end connection 172.28.0.163:63152 (399 connections now open) 2015-10-05T08:13:57.505+0100 [mongosMain] connection accepted from 172.28.0.163:64176 #1430538 (400 connections now open) 2015-10-05T08:13:57.506+0100 [conn1430538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:58.455+0100 [conn1430110] end connection 172.28.0.164:55891 (399 connections now open) 2015-10-05T08:13:58.456+0100 [mongosMain] connection accepted from 172.28.0.164:57177 #1430539 (400 connections now open) 2015-10-05T08:13:58.458+0100 [conn1430539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:13:58.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223355703b51053edc3f5 2015-10-05T08:13:58.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:13:59.078+0100 [conn1430187] end connection 172.28.0.164:56130 (399 connections now open) 2015-10-05T08:13:59.079+0100 [mongosMain] connection accepted from 172.28.0.164:57178 #1430540 (400 connections now open) 2015-10-05T08:13:59.081+0100 [conn1430540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:01.202+0100 [conn1430067] end connection 172.28.0.163:62700 (399 connections now open) 2015-10-05T08:14:01.202+0100 [conn1430146] end connection 172.28.0.163:63039 (399 connections now open) 2015-10-05T08:14:01.203+0100 [mongosMain] connection accepted from 172.28.0.163:64191 #1430541 (399 connections now open) 2015-10-05T08:14:01.203+0100 [mongosMain] connection accepted from 172.28.0.163:64192 #1430542 (400 connections now open) 2015-10-05T08:14:01.204+0100 [conn1430541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:01.204+0100 [conn1430542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:05.037+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:14:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:14:06.333+0100 [conn1430089] end connection 172.28.0.164:55786 (399 connections now open) 2015-10-05T08:14:06.333+0100 [conn1430016] end connection 172.28.0.164:55529 (399 connections now open) 2015-10-05T08:14:06.334+0100 [mongosMain] connection accepted from 172.28.0.164:57191 #1430543 (399 connections now open) 2015-10-05T08:14:06.335+0100 [mongosMain] connection accepted from 172.28.0.164:57192 #1430544 (400 connections now open) 2015-10-05T08:14:06.336+0100 [conn1430544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:06.336+0100 [conn1430543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:06.945+0100 [conn1430137] end connection 172.28.0.163:63007 (399 connections now open) 2015-10-05T08:14:06.946+0100 [mongosMain] connection accepted from 172.28.0.163:64204 #1430545 (400 connections now open) 2015-10-05T08:14:06.947+0100 [conn1430545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:07.521+0100 [conn1430192] end connection 172.28.0.163:63176 (399 connections now open) 2015-10-05T08:14:07.523+0100 [mongosMain] connection accepted from 172.28.0.163:64207 #1430546 (400 connections now open) 2015-10-05T08:14:07.524+0100 [conn1430546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:08.471+0100 [conn1430139] end connection 172.28.0.164:56004 (399 connections now open) 2015-10-05T08:14:08.473+0100 [mongosMain] connection accepted from 172.28.0.164:57194 #1430547 (400 connections now open) 2015-10-05T08:14:08.475+0100 [conn1430547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:11.237+0100 [conn1430130] end connection 172.28.0.163:62995 (399 connections now open) 2015-10-05T08:14:11.237+0100 [conn1430040] end connection 172.28.0.163:62606 (399 connections now open) 2015-10-05T08:14:11.238+0100 [mongosMain] connection accepted from 172.28.0.163:64213 #1430548 (399 connections now open) 2015-10-05T08:14:11.238+0100 [mongosMain] connection accepted from 172.28.0.163:64214 #1430549 (400 connections now open) 2015-10-05T08:14:11.239+0100 [conn1430548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:11.239+0100 [conn1430549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:16.350+0100 [conn1430181] end connection 172.28.0.164:56117 (399 connections now open) 2015-10-05T08:14:16.351+0100 [conn1430024] end connection 172.28.0.164:55543 (398 connections now open) 2015-10-05T08:14:16.351+0100 [mongosMain] connection accepted from 172.28.0.164:57201 #1430550 (399 connections now open) 2015-10-05T08:14:16.352+0100 [mongosMain] connection accepted from 172.28.0.164:57202 #1430551 (400 connections now open) 2015-10-05T08:14:16.353+0100 [conn1430550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:16.354+0100 [conn1430551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:17.522+0100 [conn1430198] end connection 172.28.0.163:63202 (399 connections now open) 2015-10-05T08:14:17.523+0100 [mongosMain] connection accepted from 172.28.0.163:64226 #1430552 (400 connections now open) 2015-10-05T08:14:17.524+0100 [conn1430552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:18.489+0100 [conn1430116] end connection 172.28.0.164:55911 (399 connections now open) 2015-10-05T08:14:18.492+0100 [mongosMain] connection accepted from 172.28.0.164:57204 #1430553 (400 connections now open) 2015-10-05T08:14:18.493+0100 [conn1430553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:19.094+0100 [conn1430193] end connection 172.28.0.164:56145 (399 connections now open) 2015-10-05T08:14:19.095+0100 [mongosMain] connection accepted from 172.28.0.164:57207 #1430554 (400 connections now open) 2015-10-05T08:14:19.096+0100 [conn1430554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:21.249+0100 [conn1430033] end connection 172.28.0.163:62595 (399 connections now open) 2015-10-05T08:14:21.249+0100 [conn1429992] end connection 172.28.0.163:62460 (399 connections now open) 2015-10-05T08:14:21.250+0100 [mongosMain] connection accepted from 172.28.0.163:64231 #1430555 (399 connections now open) 2015-10-05T08:14:21.250+0100 [mongosMain] connection accepted from 172.28.0.163:64232 #1430556 (400 connections now open) 2015-10-05T08:14:21.251+0100 [conn1430555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:21.251+0100 [conn1430556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:23.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612234e5703b51053edc605 2015-10-05T08:14:23.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:26.485+0100 [conn1430164] end connection 172.28.0.164:56073 (399 connections now open) 2015-10-05T08:14:26.486+0100 [conn1429863] end connection 172.28.0.164:55092 (398 connections now open) 2015-10-05T08:14:26.487+0100 [mongosMain] connection accepted from 172.28.0.164:57226 #1430557 (399 connections now open) 2015-10-05T08:14:26.488+0100 [mongosMain] connection accepted from 172.28.0.164:57228 #1430558 (400 connections now open) 2015-10-05T08:14:26.489+0100 [conn1430558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:26.489+0100 [conn1430557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:28.485+0100 [conn1430093] end connection 172.28.0.164:55804 (399 connections now open) 2015-10-05T08:14:28.487+0100 [mongosMain] connection accepted from 172.28.0.164:57230 #1430559 (400 connections now open) 2015-10-05T08:14:28.488+0100 [conn1430559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:28.554+0100 [mongosMain] connection accepted from 127.0.0.1:64238 #1430560 (401 connections now open) 2015-10-05T08:14:28.557+0100 [conn1430560] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:28.563+0100 [conn1430560] end connection 127.0.0.1:64238 (400 connections now open) 2015-10-05T08:14:29.111+0100 [conn1430206] end connection 172.28.0.164:56179 (399 connections now open) 2015-10-05T08:14:29.112+0100 [mongosMain] connection accepted from 172.28.0.164:57234 #1430561 (400 connections now open) 2015-10-05T08:14:29.114+0100 [conn1430561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:29.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223555703b51053edc67f 2015-10-05T08:14:29.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:31.251+0100 [conn1430158] end connection 172.28.0.163:63088 (399 connections now open) 2015-10-05T08:14:31.251+0100 [conn1429637] end connection 172.28.0.163:61349 (398 connections now open) 2015-10-05T08:14:31.252+0100 [mongosMain] connection accepted from 172.28.0.163:64239 #1430562 (399 connections now open) 2015-10-05T08:14:31.252+0100 [mongosMain] connection accepted from 172.28.0.163:64241 #1430563 (400 connections now open) 2015-10-05T08:14:31.253+0100 [conn1430562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:31.253+0100 [conn1430563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:35.321+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:14:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:14:35.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612235b5703b51053edc6ef 2015-10-05T08:14:36.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:36.459+0100 [conn1429987] end connection 172.28.0.164:55453 (399 connections now open) 2015-10-05T08:14:36.459+0100 [conn1430095] end connection 172.28.0.164:55809 (399 connections now open) 2015-10-05T08:14:36.460+0100 [mongosMain] connection accepted from 172.28.0.164:57247 #1430564 (399 connections now open) 2015-10-05T08:14:36.461+0100 [mongosMain] connection accepted from 172.28.0.164:57246 #1430565 (400 connections now open) 2015-10-05T08:14:36.462+0100 [conn1430564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:36.463+0100 [conn1430565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:37.537+0100 [conn1430204] end connection 172.28.0.163:63225 (399 connections now open) 2015-10-05T08:14:37.538+0100 [mongosMain] connection accepted from 172.28.0.163:64247 #1430566 (400 connections now open) 2015-10-05T08:14:37.539+0100 [conn1430566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:38.501+0100 [conn1430133] end connection 172.28.0.164:55984 (399 connections now open) 2015-10-05T08:14:38.502+0100 [mongosMain] connection accepted from 172.28.0.164:57252 #1430567 (400 connections now open) 2015-10-05T08:14:38.503+0100 [conn1430567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:39.125+0100 [conn1430213] end connection 172.28.0.164:56203 (399 connections now open) 2015-10-05T08:14:39.126+0100 [mongosMain] connection accepted from 172.28.0.164:57255 #1430568 (400 connections now open) 2015-10-05T08:14:39.127+0100 [conn1430568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:39.966+0100 [mongosMain] connection accepted from 127.0.0.1:64249 #1430569 (401 connections now open) 2015-10-05T08:14:39.969+0100 [conn1430569] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:39.973+0100 [conn1430569] end connection 127.0.0.1:64249 (400 connections now open) 2015-10-05T08:14:41.264+0100 [conn1430174] end connection 172.28.0.163:63119 (399 connections now open) 2015-10-05T08:14:41.264+0100 [conn1430046] end connection 172.28.0.163:62624 (399 connections now open) 2015-10-05T08:14:41.265+0100 [mongosMain] connection accepted from 172.28.0.163:64252 #1430570 (399 connections now open) 2015-10-05T08:14:41.266+0100 [mongosMain] connection accepted from 172.28.0.163:64253 #1430571 (400 connections now open) 2015-10-05T08:14:41.266+0100 [conn1430570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:41.266+0100 [conn1430571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:42.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223625703b51053edc781 2015-10-05T08:14:42.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:46.474+0100 [conn1430163] end connection 172.28.0.164:56074 (399 connections now open) 2015-10-05T08:14:46.474+0100 [conn1430053] end connection 172.28.0.164:55629 (398 connections now open) 2015-10-05T08:14:46.475+0100 [mongosMain] connection accepted from 172.28.0.164:57267 #1430572 (399 connections now open) 2015-10-05T08:14:46.475+0100 [mongosMain] connection accepted from 172.28.0.164:57268 #1430573 (400 connections now open) 2015-10-05T08:14:46.476+0100 [conn1430572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:46.477+0100 [conn1430573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:47.552+0100 [conn1430218] end connection 172.28.0.163:63254 (399 connections now open) 2015-10-05T08:14:47.553+0100 [mongosMain] connection accepted from 172.28.0.163:64263 #1430574 (400 connections now open) 2015-10-05T08:14:47.554+0100 [conn1430574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:48.503+0100 [conn1430149] end connection 172.28.0.164:56034 (399 connections now open) 2015-10-05T08:14:48.505+0100 [mongosMain] connection accepted from 172.28.0.164:57274 #1430575 (400 connections now open) 2015-10-05T08:14:48.507+0100 [conn1430575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:49.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223685703b51053edc806 2015-10-05T08:14:49.142+0100 [conn1430220] end connection 172.28.0.164:56226 (399 connections now open) 2015-10-05T08:14:49.143+0100 [mongosMain] connection accepted from 172.28.0.164:57277 #1430576 (400 connections now open) 2015-10-05T08:14:49.145+0100 [conn1430576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:49.197+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:51.267+0100 [conn1430153] end connection 172.28.0.163:63068 (399 connections now open) 2015-10-05T08:14:51.267+0100 [conn1430027] end connection 172.28.0.163:62580 (398 connections now open) 2015-10-05T08:14:51.271+0100 [mongosMain] connection accepted from 172.28.0.163:64274 #1430577 (399 connections now open) 2015-10-05T08:14:51.274+0100 [mongosMain] connection accepted from 172.28.0.163:64273 #1430578 (400 connections now open) 2015-10-05T08:14:51.316+0100 [conn1430577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:51.316+0100 [conn1430578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:55.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612236f5703b51053edc88b 2015-10-05T08:14:55.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:14:56.476+0100 [conn1430182] end connection 172.28.0.164:56118 (399 connections now open) 2015-10-05T08:14:56.478+0100 [conn1429925] end connection 172.28.0.164:55277 (398 connections now open) 2015-10-05T08:14:56.478+0100 [mongosMain] connection accepted from 172.28.0.164:57288 #1430579 (400 connections now open) 2015-10-05T08:14:56.479+0100 [mongosMain] connection accepted from 172.28.0.164:57289 #1430580 (400 connections now open) 2015-10-05T08:14:56.480+0100 [conn1430579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:56.481+0100 [conn1430580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:57.568+0100 [conn1430226] end connection 172.28.0.163:63275 (399 connections now open) 2015-10-05T08:14:57.569+0100 [mongosMain] connection accepted from 172.28.0.163:64283 #1430581 (400 connections now open) 2015-10-05T08:14:57.570+0100 [conn1430581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:58.502+0100 [conn1430178] end connection 172.28.0.164:56108 (399 connections now open) 2015-10-05T08:14:58.503+0100 [mongosMain] connection accepted from 172.28.0.164:57290 #1430582 (400 connections now open) 2015-10-05T08:14:58.505+0100 [conn1430582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:14:59.157+0100 [conn1430228] end connection 172.28.0.164:56251 (399 connections now open) 2015-10-05T08:14:59.159+0100 [mongosMain] connection accepted from 172.28.0.164:57292 #1430583 (400 connections now open) 2015-10-05T08:14:59.161+0100 [conn1430583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:01.282+0100 [conn1429998] end connection 172.28.0.163:62472 (399 connections now open) 2015-10-05T08:15:01.282+0100 [conn1430165] end connection 172.28.0.163:63104 (398 connections now open) 2015-10-05T08:15:01.283+0100 [mongosMain] connection accepted from 172.28.0.163:64298 #1430584 (399 connections now open) 2015-10-05T08:15:01.283+0100 [mongosMain] connection accepted from 172.28.0.163:64299 #1430585 (400 connections now open) 2015-10-05T08:15:01.284+0100 [conn1430584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:01.284+0100 [conn1430585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:02.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223765703b51053edc8ed 2015-10-05T08:15:02.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:05.461+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:15:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:15:06.490+0100 [conn1430201] end connection 172.28.0.164:56169 (399 connections now open) 2015-10-05T08:15:06.491+0100 [conn1430157] end connection 172.28.0.164:56056 (398 connections now open) 2015-10-05T08:15:06.492+0100 [mongosMain] connection accepted from 172.28.0.164:57320 #1430586 (399 connections now open) 2015-10-05T08:15:06.492+0100 [mongosMain] connection accepted from 172.28.0.164:57319 #1430587 (400 connections now open) 2015-10-05T08:15:06.494+0100 [conn1430586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:06.495+0100 [conn1430587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:07.570+0100 [conn1430232] end connection 172.28.0.163:63296 (399 connections now open) 2015-10-05T08:15:07.571+0100 [mongosMain] connection accepted from 172.28.0.163:64313 #1430588 (400 connections now open) 2015-10-05T08:15:07.572+0100 [conn1430588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:08.518+0100 [conn1430169] end connection 172.28.0.164:56086 (399 connections now open) 2015-10-05T08:15:08.519+0100 [mongosMain] connection accepted from 172.28.0.164:57323 #1430589 (400 connections now open) 2015-10-05T08:15:08.521+0100 [conn1430589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:09.173+0100 [conn1430234] end connection 172.28.0.164:56269 (399 connections now open) 2015-10-05T08:15:09.177+0100 [mongosMain] connection accepted from 172.28.0.164:57326 #1430590 (400 connections now open) 2015-10-05T08:15:09.179+0100 [conn1430590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:11.280+0100 [conn1429872] end connection 172.28.0.163:62108 (399 connections now open) 2015-10-05T08:15:11.280+0100 [conn1430175] end connection 172.28.0.163:63121 (399 connections now open) 2015-10-05T08:15:11.281+0100 [mongosMain] connection accepted from 172.28.0.163:64320 #1430591 (399 connections now open) 2015-10-05T08:15:11.281+0100 [mongosMain] connection accepted from 172.28.0.163:64322 #1430592 (400 connections now open) 2015-10-05T08:15:11.282+0100 [conn1430591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:11.282+0100 [conn1430592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:14.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223825703b51053edca0a 2015-10-05T08:15:15.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:16.490+0100 [conn1430173] end connection 172.28.0.164:56096 (399 connections now open) 2015-10-05T08:15:16.491+0100 [conn1430194] end connection 172.28.0.164:56153 (398 connections now open) 2015-10-05T08:15:16.491+0100 [mongosMain] connection accepted from 172.28.0.164:57330 #1430593 (399 connections now open) 2015-10-05T08:15:16.492+0100 [mongosMain] connection accepted from 172.28.0.164:57331 #1430594 (400 connections now open) 2015-10-05T08:15:16.493+0100 [conn1430593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:16.493+0100 [conn1430594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:17.007+0100 [conn1430176] end connection 172.28.0.163:63130 (399 connections now open) 2015-10-05T08:15:17.008+0100 [mongosMain] connection accepted from 172.28.0.163:64330 #1430595 (400 connections now open) 2015-10-05T08:15:17.009+0100 [conn1430595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:17.584+0100 [conn1430238] end connection 172.28.0.163:63330 (399 connections now open) 2015-10-05T08:15:17.585+0100 [mongosMain] connection accepted from 172.28.0.163:64332 #1430596 (400 connections now open) 2015-10-05T08:15:17.586+0100 [conn1430596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:18.533+0100 [conn1430233] end connection 172.28.0.164:56266 (399 connections now open) 2015-10-05T08:15:18.534+0100 [mongosMain] connection accepted from 172.28.0.164:57336 #1430597 (400 connections now open) 2015-10-05T08:15:18.535+0100 [conn1430597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:19.190+0100 [conn1430240] end connection 172.28.0.164:56292 (399 connections now open) 2015-10-05T08:15:19.191+0100 [mongosMain] connection accepted from 172.28.0.164:57338 #1430598 (400 connections now open) 2015-10-05T08:15:19.193+0100 [conn1430598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:21.296+0100 [conn1430183] end connection 172.28.0.163:63143 (399 connections now open) 2015-10-05T08:15:21.296+0100 [conn1430152] end connection 172.28.0.163:63067 (399 connections now open) 2015-10-05T08:15:21.297+0100 [mongosMain] connection accepted from 172.28.0.163:64336 #1430599 (399 connections now open) 2015-10-05T08:15:21.297+0100 [mongosMain] connection accepted from 172.28.0.163:64337 #1430600 (400 connections now open) 2015-10-05T08:15:21.298+0100 [conn1430599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:21.298+0100 [conn1430600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:21.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223895703b51053edcab5 2015-10-05T08:15:21.492+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:26.506+0100 [conn1430195] end connection 172.28.0.164:56154 (399 connections now open) 2015-10-05T08:15:26.507+0100 [conn1429919] end connection 172.28.0.164:55257 (398 connections now open) 2015-10-05T08:15:26.508+0100 [mongosMain] connection accepted from 172.28.0.164:57350 #1430601 (399 connections now open) 2015-10-05T08:15:26.509+0100 [mongosMain] connection accepted from 172.28.0.164:57351 #1430602 (400 connections now open) 2015-10-05T08:15:26.510+0100 [conn1430601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:26.510+0100 [conn1430602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:27.584+0100 [conn1430245] end connection 172.28.0.163:63349 (399 connections now open) 2015-10-05T08:15:27.585+0100 [mongosMain] connection accepted from 172.28.0.163:64342 #1430603 (400 connections now open) 2015-10-05T08:15:27.587+0100 [conn1430603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:27.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612238f5703b51053edcb3d 2015-10-05T08:15:27.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:28.549+0100 [conn1430219] end connection 172.28.0.164:56223 (399 connections now open) 2015-10-05T08:15:28.550+0100 [mongosMain] connection accepted from 172.28.0.164:57354 #1430604 (400 connections now open) 2015-10-05T08:15:28.552+0100 [conn1430604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:29.000+0100 [mongosMain] connection accepted from 127.0.0.1:64344 #1430605 (401 connections now open) 2015-10-05T08:15:29.003+0100 [conn1430605] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:29.008+0100 [conn1430605] end connection 127.0.0.1:64344 (400 connections now open) 2015-10-05T08:15:29.205+0100 [conn1430247] end connection 172.28.0.164:56304 (399 connections now open) 2015-10-05T08:15:29.206+0100 [mongosMain] connection accepted from 172.28.0.164:57358 #1430606 (400 connections now open) 2015-10-05T08:15:29.208+0100 [conn1430606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:31.384+0100 [conn1430055] end connection 172.28.0.163:62663 (399 connections now open) 2015-10-05T08:15:31.385+0100 [conn1429819] end connection 172.28.0.163:61970 (398 connections now open) 2015-10-05T08:15:31.386+0100 [mongosMain] connection accepted from 172.28.0.163:64349 #1430607 (399 connections now open) 2015-10-05T08:15:31.386+0100 [conn1430607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:31.387+0100 [mongosMain] connection accepted from 172.28.0.163:64350 #1430608 (400 connections now open) 2015-10-05T08:15:31.390+0100 [conn1430608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:34.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223955703b51053edcbc7 2015-10-05T08:15:34.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:35.638+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:15:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:15:37.434+0100 [conn1430207] end connection 172.28.0.164:56185 (399 connections now open) 2015-10-05T08:15:37.434+0100 [conn1430208] end connection 172.28.0.164:56186 (398 connections now open) 2015-10-05T08:15:37.435+0100 [mongosMain] connection accepted from 172.28.0.164:57366 #1430609 (399 connections now open) 2015-10-05T08:15:37.436+0100 [mongosMain] connection accepted from 172.28.0.164:57367 #1430610 (400 connections now open) 2015-10-05T08:15:37.437+0100 [conn1430609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:37.443+0100 [conn1430610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:37.600+0100 [conn1430252] end connection 172.28.0.163:63360 (399 connections now open) 2015-10-05T08:15:37.601+0100 [mongosMain] connection accepted from 172.28.0.163:64360 #1430611 (400 connections now open) 2015-10-05T08:15:37.602+0100 [conn1430611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:39.241+0100 [conn1430254] end connection 172.28.0.164:56326 (399 connections now open) 2015-10-05T08:15:39.241+0100 [mongosMain] connection accepted from 172.28.0.164:57375 #1430612 (400 connections now open) 2015-10-05T08:15:39.241+0100 [conn1430612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:39.491+0100 [mongosMain] connection accepted from 127.0.0.1:64363 #1430613 (401 connections now open) 2015-10-05T08:15:39.491+0100 [conn1430613] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:39.491+0100 [conn1430613] end connection 127.0.0.1:64363 (400 connections now open) 2015-10-05T08:15:40.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612239c5703b51053edcc46 2015-10-05T08:15:40.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:41.409+0100 [conn1430159] end connection 172.28.0.163:63091 (399 connections now open) 2015-10-05T08:15:41.409+0100 [conn1430224] end connection 172.28.0.163:63267 (399 connections now open) 2015-10-05T08:15:41.409+0100 [mongosMain] connection accepted from 172.28.0.163:64365 #1430614 (399 connections now open) 2015-10-05T08:15:41.409+0100 [mongosMain] connection accepted from 172.28.0.163:64366 #1430615 (400 connections now open) 2015-10-05T08:15:41.409+0100 [conn1430614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:41.409+0100 [conn1430615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:46.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223a25703b51053edccba 2015-10-05T08:15:46.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:47.037+0100 [conn1430131] end connection 172.28.0.163:62998 (399 connections now open) 2015-10-05T08:15:47.038+0100 [mongosMain] connection accepted from 172.28.0.163:64376 #1430616 (400 connections now open) 2015-10-05T08:15:47.039+0100 [conn1430616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:47.426+0100 [conn1429729] end connection 172.28.0.164:54676 (399 connections now open) 2015-10-05T08:15:47.427+0100 [conn1430223] end connection 172.28.0.164:56235 (398 connections now open) 2015-10-05T08:15:47.427+0100 [mongosMain] connection accepted from 172.28.0.164:57390 #1430617 (400 connections now open) 2015-10-05T08:15:47.427+0100 [mongosMain] connection accepted from 172.28.0.164:57391 #1430618 (400 connections now open) 2015-10-05T08:15:47.429+0100 [conn1430617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:47.430+0100 [conn1430618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:47.599+0100 [conn1430259] end connection 172.28.0.163:63377 (399 connections now open) 2015-10-05T08:15:47.600+0100 [mongosMain] connection accepted from 172.28.0.163:64379 #1430619 (400 connections now open) 2015-10-05T08:15:47.601+0100 [conn1430619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:49.221+0100 [conn1430260] end connection 172.28.0.164:56345 (399 connections now open) 2015-10-05T08:15:49.222+0100 [mongosMain] connection accepted from 172.28.0.164:57396 #1430620 (400 connections now open) 2015-10-05T08:15:49.224+0100 [conn1430620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:51.384+0100 [conn1430250] end connection 172.28.0.163:63357 (399 connections now open) 2015-10-05T08:15:51.384+0100 [conn1429833] end connection 172.28.0.163:62006 (398 connections now open) 2015-10-05T08:15:51.385+0100 [mongosMain] connection accepted from 172.28.0.163:64387 #1430621 (399 connections now open) 2015-10-05T08:15:51.386+0100 [mongosMain] connection accepted from 172.28.0.163:64388 #1430622 (400 connections now open) 2015-10-05T08:15:51.386+0100 [conn1430621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:51.387+0100 [conn1430622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:53.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223a95703b51053edcd47 2015-10-05T08:15:53.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:57.615+0100 [conn1430266] end connection 172.28.0.163:63393 (399 connections now open) 2015-10-05T08:15:57.616+0100 [mongosMain] connection accepted from 172.28.0.163:64401 #1430623 (400 connections now open) 2015-10-05T08:15:57.617+0100 [conn1430623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:59.237+0100 [conn1430267] end connection 172.28.0.164:56364 (399 connections now open) 2015-10-05T08:15:59.238+0100 [mongosMain] connection accepted from 172.28.0.164:57404 #1430624 (400 connections now open) 2015-10-05T08:15:59.239+0100 [conn1430624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:59.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223af5703b51053edcd77 2015-10-05T08:15:59.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:15:59.828+0100 [conn1430241] end connection 172.28.0.164:56296 (399 connections now open) 2015-10-05T08:15:59.830+0100 [conn1430242] end connection 172.28.0.164:56297 (398 connections now open) 2015-10-05T08:15:59.833+0100 [mongosMain] connection accepted from 172.28.0.164:57407 #1430625 (399 connections now open) 2015-10-05T08:15:59.835+0100 [conn1430625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:15:59.835+0100 [mongosMain] connection accepted from 172.28.0.164:57408 #1430626 (400 connections now open) 2015-10-05T08:15:59.837+0100 [conn1430626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:01.391+0100 [conn1430230] end connection 172.28.0.163:63291 (399 connections now open) 2015-10-05T08:16:01.391+0100 [conn1430136] end connection 172.28.0.163:63006 (399 connections now open) 2015-10-05T08:16:01.392+0100 [mongosMain] connection accepted from 172.28.0.163:64411 #1430627 (399 connections now open) 2015-10-05T08:16:01.393+0100 [mongosMain] connection accepted from 172.28.0.163:64412 #1430628 (400 connections now open) 2015-10-05T08:16:01.393+0100 [conn1430627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:01.394+0100 [conn1430628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:06.548+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:16:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:16:07.615+0100 [conn1430272] end connection 172.28.0.163:63415 (399 connections now open) 2015-10-05T08:16:07.616+0100 [mongosMain] connection accepted from 172.28.0.163:64433 #1430629 (400 connections now open) 2015-10-05T08:16:07.617+0100 [conn1430629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:09.253+0100 [conn1430273] end connection 172.28.0.164:56378 (399 connections now open) 2015-10-05T08:16:09.254+0100 [mongosMain] connection accepted from 172.28.0.164:57423 #1430630 (400 connections now open) 2015-10-05T08:16:09.255+0100 [conn1430630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:09.829+0100 [conn1430256] end connection 172.28.0.164:56333 (399 connections now open) 2015-10-05T08:16:09.829+0100 [conn1430268] end connection 172.28.0.164:56371 (398 connections now open) 2015-10-05T08:16:09.830+0100 [mongosMain] connection accepted from 172.28.0.164:57426 #1430631 (399 connections now open) 2015-10-05T08:16:09.830+0100 [mongosMain] connection accepted from 172.28.0.164:57427 #1430632 (400 connections now open) 2015-10-05T08:16:09.834+0100 [conn1430632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:09.835+0100 [conn1430631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:11.391+0100 [conn1430209] end connection 172.28.0.163:63232 (399 connections now open) 2015-10-05T08:16:11.391+0100 [conn1430166] end connection 172.28.0.163:63105 (399 connections now open) 2015-10-05T08:16:11.392+0100 [mongosMain] connection accepted from 172.28.0.163:64438 #1430633 (399 connections now open) 2015-10-05T08:16:11.392+0100 [mongosMain] connection accepted from 172.28.0.163:64439 #1430634 (400 connections now open) 2015-10-05T08:16:11.393+0100 [conn1430633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:11.393+0100 [conn1430634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:17.631+0100 [conn1430278] end connection 172.28.0.163:63446 (399 connections now open) 2015-10-05T08:16:17.632+0100 [mongosMain] connection accepted from 172.28.0.163:64447 #1430635 (400 connections now open) 2015-10-05T08:16:17.633+0100 [conn1430635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:18.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223c15703b51053edcf4a 2015-10-05T08:16:18.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:16:19.268+0100 [conn1430279] end connection 172.28.0.164:56404 (399 connections now open) 2015-10-05T08:16:19.269+0100 [mongosMain] connection accepted from 172.28.0.164:57434 #1430636 (400 connections now open) 2015-10-05T08:16:19.270+0100 [conn1430636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:19.830+0100 [conn1430200] end connection 172.28.0.164:56168 (399 connections now open) 2015-10-05T08:16:19.830+0100 [conn1430188] end connection 172.28.0.164:56135 (399 connections now open) 2015-10-05T08:16:19.831+0100 [mongosMain] connection accepted from 172.28.0.164:57438 #1430637 (399 connections now open) 2015-10-05T08:16:19.832+0100 [mongosMain] connection accepted from 172.28.0.164:57439 #1430638 (400 connections now open) 2015-10-05T08:16:19.833+0100 [conn1430637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:19.833+0100 [conn1430638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:21.407+0100 [conn1430020] end connection 172.28.0.163:62562 (399 connections now open) 2015-10-05T08:16:21.407+0100 [conn1430243] end connection 172.28.0.163:63342 (398 connections now open) 2015-10-05T08:16:21.408+0100 [mongosMain] connection accepted from 172.28.0.163:64453 #1430639 (399 connections now open) 2015-10-05T08:16:21.409+0100 [mongosMain] connection accepted from 172.28.0.163:64454 #1430640 (400 connections now open) 2015-10-05T08:16:21.409+0100 [conn1430639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:21.410+0100 [conn1430640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:27.646+0100 [conn1430284] end connection 172.28.0.163:63461 (399 connections now open) 2015-10-05T08:16:27.647+0100 [mongosMain] connection accepted from 172.28.0.163:64457 #1430641 (400 connections now open) 2015-10-05T08:16:27.648+0100 [conn1430641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:28.294+0100 [mongosMain] connection accepted from 127.0.0.1:64459 #1430642 (401 connections now open) 2015-10-05T08:16:28.297+0100 [conn1430642] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:28.303+0100 [conn1430642] end connection 127.0.0.1:64459 (400 connections now open) 2015-10-05T08:16:29.268+0100 [conn1430285] end connection 172.28.0.164:56418 (399 connections now open) 2015-10-05T08:16:29.268+0100 [mongosMain] connection accepted from 172.28.0.164:57451 #1430643 (400 connections now open) 2015-10-05T08:16:29.270+0100 [conn1430643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:29.856+0100 [conn1430214] end connection 172.28.0.164:56209 (399 connections now open) 2015-10-05T08:16:29.856+0100 [conn1430023] end connection 172.28.0.164:55542 (399 connections now open) 2015-10-05T08:16:29.857+0100 [mongosMain] connection accepted from 172.28.0.164:57455 #1430644 (399 connections now open) 2015-10-05T08:16:29.858+0100 [mongosMain] connection accepted from 172.28.0.164:57456 #1430645 (400 connections now open) 2015-10-05T08:16:29.859+0100 [conn1430644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:29.859+0100 [conn1430645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:31.419+0100 [conn1430202] end connection 172.28.0.163:63218 (399 connections now open) 2015-10-05T08:16:31.420+0100 [conn1430217] end connection 172.28.0.163:63250 (398 connections now open) 2015-10-05T08:16:31.420+0100 [mongosMain] connection accepted from 172.28.0.163:64464 #1430646 (399 connections now open) 2015-10-05T08:16:31.421+0100 [mongosMain] connection accepted from 172.28.0.163:64465 #1430647 (400 connections now open) 2015-10-05T08:16:31.422+0100 [conn1430646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:31.422+0100 [conn1430647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:36.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223d45703b51053edd06c 2015-10-05T08:16:36.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:16:36.823+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:16:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:16:37.070+0100 [conn1430143] end connection 172.28.0.163:63027 (399 connections now open) 2015-10-05T08:16:37.071+0100 [mongosMain] connection accepted from 172.28.0.163:64468 #1430648 (400 connections now open) 2015-10-05T08:16:37.072+0100 [conn1430648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:37.648+0100 [conn1430290] end connection 172.28.0.163:63473 (399 connections now open) 2015-10-05T08:16:37.649+0100 [mongosMain] connection accepted from 172.28.0.163:64470 #1430649 (400 connections now open) 2015-10-05T08:16:37.650+0100 [conn1430649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:39.206+0100 [mongosMain] connection accepted from 127.0.0.1:64474 #1430650 (401 connections now open) 2015-10-05T08:16:39.209+0100 [conn1430650] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:39.214+0100 [conn1430650] end connection 127.0.0.1:64474 (400 connections now open) 2015-10-05T08:16:39.283+0100 [conn1430291] end connection 172.28.0.164:56437 (399 connections now open) 2015-10-05T08:16:39.284+0100 [mongosMain] connection accepted from 172.28.0.164:57472 #1430651 (400 connections now open) 2015-10-05T08:16:39.286+0100 [conn1430651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:39.861+0100 [conn1430151] end connection 172.28.0.164:56041 (399 connections now open) 2015-10-05T08:16:39.861+0100 [conn1430236] end connection 172.28.0.164:56285 (399 connections now open) 2015-10-05T08:16:39.863+0100 [mongosMain] connection accepted from 172.28.0.164:57475 #1430652 (399 connections now open) 2015-10-05T08:16:39.863+0100 [mongosMain] connection accepted from 172.28.0.164:57476 #1430653 (400 connections now open) 2015-10-05T08:16:39.864+0100 [conn1430652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:39.865+0100 [conn1430653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:42.134+0100 [conn1430251] end connection 172.28.0.163:63358 (399 connections now open) 2015-10-05T08:16:42.134+0100 [conn1430276] end connection 172.28.0.163:63442 (399 connections now open) 2015-10-05T08:16:42.135+0100 [mongosMain] connection accepted from 172.28.0.163:64480 #1430654 (399 connections now open) 2015-10-05T08:16:42.136+0100 [mongosMain] connection accepted from 172.28.0.163:64481 #1430655 (400 connections now open) 2015-10-05T08:16:42.136+0100 [conn1430654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:42.137+0100 [conn1430655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:47.661+0100 [conn1430298] end connection 172.28.0.163:63485 (399 connections now open) 2015-10-05T08:16:47.662+0100 [mongosMain] connection accepted from 172.28.0.163:64490 #1430656 (400 connections now open) 2015-10-05T08:16:47.663+0100 [conn1430656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:48.675+0100 [conn1430239] end connection 172.28.0.164:56290 (399 connections now open) 2015-10-05T08:16:48.677+0100 [mongosMain] connection accepted from 172.28.0.164:57488 #1430657 (400 connections now open) 2015-10-05T08:16:48.679+0100 [conn1430657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:48.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223e05703b51053edd13f 2015-10-05T08:16:49.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:16:49.283+0100 [conn1430299] end connection 172.28.0.164:56457 (399 connections now open) 2015-10-05T08:16:49.284+0100 [mongosMain] connection accepted from 172.28.0.164:57490 #1430658 (400 connections now open) 2015-10-05T08:16:49.285+0100 [conn1430658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:49.877+0100 [conn1430189] end connection 172.28.0.164:56136 (399 connections now open) 2015-10-05T08:16:49.877+0100 [mongosMain] connection accepted from 172.28.0.164:57493 #1430659 (400 connections now open) 2015-10-05T08:16:49.879+0100 [conn1430659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:52.108+0100 [conn1430197] end connection 172.28.0.163:63195 (399 connections now open) 2015-10-05T08:16:52.108+0100 [conn1430196] end connection 172.28.0.163:63194 (399 connections now open) 2015-10-05T08:16:52.109+0100 [mongosMain] connection accepted from 172.28.0.163:64499 #1430660 (399 connections now open) 2015-10-05T08:16:52.110+0100 [mongosMain] connection accepted from 172.28.0.163:64500 #1430661 (400 connections now open) 2015-10-05T08:16:52.110+0100 [conn1430660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:52.110+0100 [conn1430661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:57.662+0100 [conn1430306] end connection 172.28.0.163:63504 (399 connections now open) 2015-10-05T08:16:57.664+0100 [mongosMain] connection accepted from 172.28.0.163:64504 #1430662 (400 connections now open) 2015-10-05T08:16:57.665+0100 [conn1430662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:58.691+0100 [conn1430227] end connection 172.28.0.164:56248 (399 connections now open) 2015-10-05T08:16:58.692+0100 [mongosMain] connection accepted from 172.28.0.164:57499 #1430663 (400 connections now open) 2015-10-05T08:16:58.694+0100 [conn1430663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:59.299+0100 [conn1430308] end connection 172.28.0.164:56477 (399 connections now open) 2015-10-05T08:16:59.301+0100 [mongosMain] connection accepted from 172.28.0.164:57501 #1430664 (400 connections now open) 2015-10-05T08:16:59.302+0100 [conn1430664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:16:59.892+0100 [conn1430215] end connection 172.28.0.164:56210 (399 connections now open) 2015-10-05T08:16:59.893+0100 [mongosMain] connection accepted from 172.28.0.164:57503 #1430665 (400 connections now open) 2015-10-05T08:16:59.895+0100 [conn1430665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:01.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223ed5703b51053edd1e0 2015-10-05T08:17:01.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:02.109+0100 [conn1430191] end connection 172.28.0.163:63172 (399 connections now open) 2015-10-05T08:17:02.109+0100 [conn1430264] end connection 172.28.0.163:63386 (398 connections now open) 2015-10-05T08:17:02.110+0100 [mongosMain] connection accepted from 172.28.0.163:64524 #1430666 (399 connections now open) 2015-10-05T08:17:02.110+0100 [mongosMain] connection accepted from 172.28.0.163:64525 #1430667 (400 connections now open) 2015-10-05T08:17:02.111+0100 [conn1430666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:02.111+0100 [conn1430667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:07.101+0100 [conn1430303] end connection 172.28.0.163:63498 (399 connections now open) 2015-10-05T08:17:07.102+0100 [mongosMain] connection accepted from 172.28.0.163:64538 #1430668 (400 connections now open) 2015-10-05T08:17:07.103+0100 [conn1430668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:07.284+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:17:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:17:07.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223f35703b51053edd232 2015-10-05T08:17:07.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:08.710+0100 [conn1430211] end connection 172.28.0.164:56199 (399 connections now open) 2015-10-05T08:17:08.712+0100 [mongosMain] connection accepted from 172.28.0.164:57518 #1430669 (400 connections now open) 2015-10-05T08:17:08.713+0100 [conn1430669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:09.909+0100 [conn1429623] end connection 172.28.0.164:54343 (399 connections now open) 2015-10-05T08:17:09.910+0100 [mongosMain] connection accepted from 172.28.0.164:57522 #1430670 (400 connections now open) 2015-10-05T08:17:09.911+0100 [conn1430670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:12.125+0100 [conn1430258] end connection 172.28.0.163:63369 (399 connections now open) 2015-10-05T08:17:12.125+0100 [conn1430257] end connection 172.28.0.163:63368 (398 connections now open) 2015-10-05T08:17:12.126+0100 [mongosMain] connection accepted from 172.28.0.163:64547 #1430671 (399 connections now open) 2015-10-05T08:17:12.126+0100 [mongosMain] connection accepted from 172.28.0.163:64548 #1430672 (400 connections now open) 2015-10-05T08:17:12.127+0100 [conn1430671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:12.127+0100 [conn1430672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:13.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561223f95703b51053edd278 2015-10-05T08:17:14.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:17.116+0100 [conn1430167] end connection 172.28.0.163:63109 (399 connections now open) 2015-10-05T08:17:17.117+0100 [mongosMain] connection accepted from 172.28.0.163:64555 #1430673 (400 connections now open) 2015-10-05T08:17:17.118+0100 [conn1430673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:17.677+0100 [conn1430312] end connection 172.28.0.163:63518 (399 connections now open) 2015-10-05T08:17:17.678+0100 [mongosMain] connection accepted from 172.28.0.163:64557 #1430674 (400 connections now open) 2015-10-05T08:17:17.679+0100 [conn1430674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:18.722+0100 [conn1430199] end connection 172.28.0.164:56165 (399 connections now open) 2015-10-05T08:17:18.723+0100 [mongosMain] connection accepted from 172.28.0.164:57526 #1430675 (400 connections now open) 2015-10-05T08:17:18.724+0100 [conn1430675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:19.331+0100 [conn1430321] end connection 172.28.0.164:56518 (399 connections now open) 2015-10-05T08:17:19.332+0100 [mongosMain] connection accepted from 172.28.0.164:57530 #1430676 (400 connections now open) 2015-10-05T08:17:19.334+0100 [conn1430676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:19.908+0100 [conn1430249] end connection 172.28.0.164:56313 (399 connections now open) 2015-10-05T08:17:19.908+0100 [conn1430269] end connection 172.28.0.164:56372 (398 connections now open) 2015-10-05T08:17:19.909+0100 [mongosMain] connection accepted from 172.28.0.164:57533 #1430677 (399 connections now open) 2015-10-05T08:17:19.909+0100 [mongosMain] connection accepted from 172.28.0.164:57534 #1430678 (400 connections now open) 2015-10-05T08:17:19.910+0100 [conn1430677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:19.911+0100 [conn1430678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:20.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224005703b51053edd2e5 2015-10-05T08:17:20.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:22.125+0100 [conn1430313] end connection 172.28.0.163:63521 (399 connections now open) 2015-10-05T08:17:22.125+0100 [conn1430237] end connection 172.28.0.163:63324 (399 connections now open) 2015-10-05T08:17:22.126+0100 [mongosMain] connection accepted from 172.28.0.163:64561 #1430679 (399 connections now open) 2015-10-05T08:17:22.126+0100 [mongosMain] connection accepted from 172.28.0.163:64562 #1430680 (400 connections now open) 2015-10-05T08:17:22.127+0100 [conn1430679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:22.127+0100 [conn1430680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:27.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224065703b51053edd32d 2015-10-05T08:17:27.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:27.122+0100 [conn1430311] end connection 172.28.0.163:63517 (399 connections now open) 2015-10-05T08:17:27.124+0100 [mongosMain] connection accepted from 172.28.0.163:64565 #1430681 (400 connections now open) 2015-10-05T08:17:27.125+0100 [conn1430681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:27.693+0100 [conn1430325] end connection 172.28.0.163:63570 (399 connections now open) 2015-10-05T08:17:27.695+0100 [mongosMain] connection accepted from 172.28.0.163:64566 #1430682 (400 connections now open) 2015-10-05T08:17:27.696+0100 [conn1430682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:29.023+0100 [mongosMain] connection accepted from 127.0.0.1:64568 #1430683 (401 connections now open) 2015-10-05T08:17:29.026+0100 [conn1430683] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:29.031+0100 [conn1430683] end connection 127.0.0.1:64568 (400 connections now open) 2015-10-05T08:17:29.346+0100 [conn1430316] end connection 172.28.0.164:56491 (399 connections now open) 2015-10-05T08:17:29.348+0100 [mongosMain] connection accepted from 172.28.0.164:57551 #1430684 (400 connections now open) 2015-10-05T08:17:29.349+0100 [conn1430684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:29.924+0100 [conn1430281] end connection 172.28.0.164:56411 (399 connections now open) 2015-10-05T08:17:29.924+0100 [conn1430229] end connection 172.28.0.164:56261 (398 connections now open) 2015-10-05T08:17:29.926+0100 [mongosMain] connection accepted from 172.28.0.164:57555 #1430685 (399 connections now open) 2015-10-05T08:17:29.926+0100 [mongosMain] connection accepted from 172.28.0.164:57556 #1430686 (400 connections now open) 2015-10-05T08:17:29.928+0100 [conn1430685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:29.928+0100 [conn1430686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:33.292+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:17:33.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:17:33.699+0100 [conn1430270] end connection 172.28.0.163:63410 (399 connections now open) 2015-10-05T08:17:33.699+0100 [conn1430225] end connection 172.28.0.163:63268 (399 connections now open) 2015-10-05T08:17:33.704+0100 [mongosMain] connection accepted from 172.28.0.163:64570 #1430687 (399 connections now open) 2015-10-05T08:17:33.705+0100 [mongosMain] connection accepted from 172.28.0.163:64571 #1430688 (400 connections now open) 2015-10-05T08:17:33.705+0100 [conn1430687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:33.706+0100 [conn1430688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:37.132+0100 [conn1430147] end connection 172.28.0.163:63042 (399 connections now open) 2015-10-05T08:17:37.133+0100 [mongosMain] connection accepted from 172.28.0.163:64573 #1430689 (400 connections now open) 2015-10-05T08:17:37.134+0100 [conn1430689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:37.544+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:17:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:17:37.694+0100 [conn1430333] end connection 172.28.0.163:63579 (399 connections now open) 2015-10-05T08:17:37.695+0100 [mongosMain] connection accepted from 172.28.0.163:64575 #1430690 (400 connections now open) 2015-10-05T08:17:37.696+0100 [conn1430690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:39.362+0100 [conn1430327] end connection 172.28.0.164:56528 (399 connections now open) 2015-10-05T08:17:39.363+0100 [mongosMain] connection accepted from 172.28.0.164:57570 #1430691 (400 connections now open) 2015-10-05T08:17:39.365+0100 [conn1430691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:39.492+0100 [mongosMain] connection accepted from 127.0.0.1:64577 #1430692 (401 connections now open) 2015-10-05T08:17:39.495+0100 [conn1430692] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:39.499+0100 [conn1430692] end connection 127.0.0.1:64577 (400 connections now open) 2015-10-05T08:17:39.938+0100 [conn1430222] end connection 172.28.0.164:56234 (399 connections now open) 2015-10-05T08:17:39.938+0100 [conn1430301] end connection 172.28.0.164:56463 (399 connections now open) 2015-10-05T08:17:39.939+0100 [mongosMain] connection accepted from 172.28.0.164:57574 #1430693 (399 connections now open) 2015-10-05T08:17:39.939+0100 [mongosMain] connection accepted from 172.28.0.164:57575 #1430694 (400 connections now open) 2015-10-05T08:17:39.940+0100 [conn1430693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:39.940+0100 [conn1430694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:39.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224135703b51053edd3fa 2015-10-05T08:17:40.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:43.661+0100 [conn1430210] end connection 172.28.0.163:63233 (399 connections now open) 2015-10-05T08:17:43.661+0100 [conn1430216] end connection 172.28.0.163:63247 (399 connections now open) 2015-10-05T08:17:43.662+0100 [mongosMain] connection accepted from 172.28.0.163:64582 #1430695 (399 connections now open) 2015-10-05T08:17:43.662+0100 [mongosMain] connection accepted from 172.28.0.163:64583 #1430696 (400 connections now open) 2015-10-05T08:17:43.663+0100 [conn1430695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:43.663+0100 [conn1430696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:46.727+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:17:46.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:17:47.133+0100 [conn1430318] end connection 172.28.0.163:63546 (399 connections now open) 2015-10-05T08:17:47.134+0100 [mongosMain] connection accepted from 172.28.0.163:64588 #1430697 (400 connections now open) 2015-10-05T08:17:47.135+0100 [conn1430697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:48.755+0100 [conn1430205] end connection 172.28.0.164:56177 (399 connections now open) 2015-10-05T08:17:48.758+0100 [mongosMain] connection accepted from 172.28.0.164:57586 #1430698 (400 connections now open) 2015-10-05T08:17:48.760+0100 [conn1430698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:49.362+0100 [conn1430335] end connection 172.28.0.164:56545 (399 connections now open) 2015-10-05T08:17:49.363+0100 [mongosMain] connection accepted from 172.28.0.164:57590 #1430699 (400 connections now open) 2015-10-05T08:17:49.365+0100 [conn1430699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:49.940+0100 [conn1430248] end connection 172.28.0.164:56311 (399 connections now open) 2015-10-05T08:17:49.941+0100 [mongosMain] connection accepted from 172.28.0.164:57592 #1430700 (400 connections now open) 2015-10-05T08:17:49.943+0100 [conn1430700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:52.876+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612241d03838a4537162bbd') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444029472734), why: "doing balance round", ts: ObjectId('561224205703b51053edd4e9') } } gle1: { lastOp: Timestamp 1444029472000|5, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1444029460000|1, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } 2015-10-05T08:17:52.880+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:17:53.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224205703b51053edd4e9 2015-10-05T08:17:53.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:17:53.669+0100 [conn1430034] end connection 172.28.0.163:62596 (399 connections now open) 2015-10-05T08:17:53.669+0100 [conn1430288] end connection 172.28.0.163:63471 (399 connections now open) 2015-10-05T08:17:53.670+0100 [mongosMain] connection accepted from 172.28.0.163:64599 #1430701 (399 connections now open) 2015-10-05T08:17:53.671+0100 [mongosMain] connection accepted from 172.28.0.163:64600 #1430702 (400 connections now open) 2015-10-05T08:17:53.671+0100 [conn1430701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:53.672+0100 [conn1430702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:57.148+0100 [conn1430185] end connection 172.28.0.163:63149 (399 connections now open) 2015-10-05T08:17:57.150+0100 [mongosMain] connection accepted from 172.28.0.163:64607 #1430703 (400 connections now open) 2015-10-05T08:17:57.151+0100 [conn1430703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:57.725+0100 [conn1430342] end connection 172.28.0.163:63596 (399 connections now open) 2015-10-05T08:17:57.726+0100 [mongosMain] connection accepted from 172.28.0.163:64609 #1430704 (400 connections now open) 2015-10-05T08:17:57.728+0100 [conn1430704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:58.769+0100 [conn1430334] end connection 172.28.0.164:56543 (399 connections now open) 2015-10-05T08:17:58.770+0100 [mongosMain] connection accepted from 172.28.0.164:57600 #1430705 (400 connections now open) 2015-10-05T08:17:58.772+0100 [conn1430705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:59.378+0100 [conn1430344] end connection 172.28.0.164:56573 (399 connections now open) 2015-10-05T08:17:59.379+0100 [mongosMain] connection accepted from 172.28.0.164:57602 #1430706 (400 connections now open) 2015-10-05T08:17:59.381+0100 [conn1430706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:17:59.701+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:17:59.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:18:00.410+0100 [conn1430286] end connection 172.28.0.164:56426 (399 connections now open) 2015-10-05T08:18:00.416+0100 [mongosMain] connection accepted from 172.28.0.164:57606 #1430707 (400 connections now open) 2015-10-05T08:18:00.417+0100 [conn1430707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:03.670+0100 [conn1430190] end connection 172.28.0.163:63171 (399 connections now open) 2015-10-05T08:18:03.672+0100 [mongosMain] connection accepted from 172.28.0.163:64631 #1430708 (400 connections now open) 2015-10-05T08:18:03.673+0100 [conn1430708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:07.163+0100 [conn1430330] end connection 172.28.0.163:63574 (399 connections now open) 2015-10-05T08:18:07.164+0100 [mongosMain] connection accepted from 172.28.0.163:64642 #1430709 (400 connections now open) 2015-10-05T08:18:07.165+0100 [conn1430709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:07.726+0100 [conn1430356] end connection 172.28.0.163:63622 (399 connections now open) 2015-10-05T08:18:07.727+0100 [mongosMain] connection accepted from 172.28.0.163:64645 #1430710 (400 connections now open) 2015-10-05T08:18:07.728+0100 [conn1430710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:07.750+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:18:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:18:08.785+0100 [conn1430326] end connection 172.28.0.164:56525 (399 connections now open) 2015-10-05T08:18:08.786+0100 [mongosMain] connection accepted from 172.28.0.164:57624 #1430711 (400 connections now open) 2015-10-05T08:18:08.787+0100 [conn1430711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:09.394+0100 [conn1430357] end connection 172.28.0.164:56600 (399 connections now open) 2015-10-05T08:18:09.395+0100 [mongosMain] connection accepted from 172.28.0.164:57625 #1430712 (400 connections now open) 2015-10-05T08:18:09.396+0100 [conn1430712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:10.378+0100 [conn1430293] end connection 172.28.0.164:56445 (399 connections now open) 2015-10-05T08:18:10.379+0100 [mongosMain] connection accepted from 172.28.0.164:57630 #1430713 (400 connections now open) 2015-10-05T08:18:10.383+0100 [conn1430713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:13.685+0100 [conn1430304] end connection 172.28.0.163:63499 (399 connections now open) 2015-10-05T08:18:13.686+0100 [mongosMain] connection accepted from 172.28.0.163:64651 #1430714 (400 connections now open) 2015-10-05T08:18:13.687+0100 [conn1430714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:17.164+0100 [conn1430355] end connection 172.28.0.163:63620 (399 connections now open) 2015-10-05T08:18:17.165+0100 [mongosMain] connection accepted from 172.28.0.163:64659 #1430715 (400 connections now open) 2015-10-05T08:18:17.166+0100 [conn1430715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:17.741+0100 [conn1430363] end connection 172.28.0.163:63659 (399 connections now open) 2015-10-05T08:18:17.742+0100 [mongosMain] connection accepted from 172.28.0.163:64661 #1430716 (400 connections now open) 2015-10-05T08:18:17.743+0100 [conn1430716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:18.801+0100 [conn1430343] end connection 172.28.0.164:56569 (399 connections now open) 2015-10-05T08:18:18.802+0100 [mongosMain] connection accepted from 172.28.0.164:57637 #1430717 (400 connections now open) 2015-10-05T08:18:18.804+0100 [conn1430717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:19.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612243a5703b51053edd673 2015-10-05T08:18:19.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:18:19.409+0100 [conn1430352] end connection 172.28.0.164:56593 (399 connections now open) 2015-10-05T08:18:19.410+0100 [mongosMain] connection accepted from 172.28.0.164:57640 #1430718 (400 connections now open) 2015-10-05T08:18:19.414+0100 [conn1430718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:20.377+0100 [conn1430280] end connection 172.28.0.164:56406 (399 connections now open) 2015-10-05T08:18:20.377+0100 [mongosMain] connection accepted from 172.28.0.164:57644 #1430719 (400 connections now open) 2015-10-05T08:18:20.379+0100 [conn1430719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:23.693+0100 [conn1430283] end connection 172.28.0.163:63458 (399 connections now open) 2015-10-05T08:18:23.694+0100 [mongosMain] connection accepted from 172.28.0.163:64664 #1430720 (400 connections now open) 2015-10-05T08:18:23.695+0100 [conn1430720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:27.179+0100 [conn1430295] end connection 172.28.0.163:63480 (399 connections now open) 2015-10-05T08:18:27.180+0100 [mongosMain] connection accepted from 172.28.0.163:64666 #1430721 (400 connections now open) 2015-10-05T08:18:27.181+0100 [conn1430721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:27.741+0100 [conn1430369] end connection 172.28.0.163:63674 (399 connections now open) 2015-10-05T08:18:27.742+0100 [mongosMain] connection accepted from 172.28.0.163:64668 #1430722 (400 connections now open) 2015-10-05T08:18:27.743+0100 [conn1430722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:28.621+0100 [mongosMain] connection accepted from 127.0.0.1:64670 #1430723 (401 connections now open) 2015-10-05T08:18:28.624+0100 [conn1430723] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:28.629+0100 [conn1430723] end connection 127.0.0.1:64670 (400 connections now open) 2015-10-05T08:18:28.803+0100 [conn1430320] end connection 172.28.0.164:56516 (399 connections now open) 2015-10-05T08:18:28.805+0100 [mongosMain] connection accepted from 172.28.0.164:57654 #1430724 (400 connections now open) 2015-10-05T08:18:28.809+0100 [conn1430724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:29.426+0100 [conn1430365] end connection 172.28.0.164:56622 (399 connections now open) 2015-10-05T08:18:29.427+0100 [mongosMain] connection accepted from 172.28.0.164:57656 #1430725 (400 connections now open) 2015-10-05T08:18:29.430+0100 [conn1430725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:30.393+0100 [conn1430274] end connection 172.28.0.164:56391 (399 connections now open) 2015-10-05T08:18:30.394+0100 [mongosMain] connection accepted from 172.28.0.164:57661 #1430726 (400 connections now open) 2015-10-05T08:18:30.396+0100 [conn1430726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:31.506+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:18:31.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:18:33.702+0100 [conn1430324] end connection 172.28.0.163:63566 (399 connections now open) 2015-10-05T08:18:33.703+0100 [mongosMain] connection accepted from 172.28.0.163:64672 #1430727 (400 connections now open) 2015-10-05T08:18:33.704+0100 [conn1430727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:37.181+0100 [conn1430323] end connection 172.28.0.163:63564 (399 connections now open) 2015-10-05T08:18:37.183+0100 [mongosMain] connection accepted from 172.28.0.163:64674 #1430728 (400 connections now open) 2015-10-05T08:18:37.184+0100 [conn1430728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:37.644+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:18:37.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:18:38.020+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:18:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:18:38.817+0100 [conn1430351] end connection 172.28.0.164:56590 (399 connections now open) 2015-10-05T08:18:38.818+0100 [mongosMain] connection accepted from 172.28.0.164:57675 #1430729 (400 connections now open) 2015-10-05T08:18:38.820+0100 [conn1430729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:39.441+0100 [conn1430371] end connection 172.28.0.164:56631 (399 connections now open) 2015-10-05T08:18:39.442+0100 [mongosMain] connection accepted from 172.28.0.164:57677 #1430730 (400 connections now open) 2015-10-05T08:18:39.444+0100 [conn1430730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:39.857+0100 [mongosMain] connection accepted from 127.0.0.1:64677 #1430731 (401 connections now open) 2015-10-05T08:18:39.860+0100 [conn1430731] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:39.865+0100 [conn1430731] end connection 127.0.0.1:64677 (400 connections now open) 2015-10-05T08:18:40.408+0100 [conn1430309] end connection 172.28.0.164:56483 (399 connections now open) 2015-10-05T08:18:40.409+0100 [mongosMain] connection accepted from 172.28.0.164:57681 #1430732 (400 connections now open) 2015-10-05T08:18:40.411+0100 [conn1430732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:43.705+0100 [conn1430366] end connection 172.28.0.163:63663 (399 connections now open) 2015-10-05T08:18:43.706+0100 [mongosMain] connection accepted from 172.28.0.163:64682 #1430733 (400 connections now open) 2015-10-05T08:18:43.707+0100 [conn1430733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:43.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224535703b51053edd7a3 2015-10-05T08:18:44.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:18:47.195+0100 [conn1430348] end connection 172.28.0.163:63605 (399 connections now open) 2015-10-05T08:18:47.196+0100 [mongosMain] connection accepted from 172.28.0.163:64685 #1430734 (400 connections now open) 2015-10-05T08:18:47.197+0100 [conn1430734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:47.757+0100 [conn1430375] end connection 172.28.0.163:63685 (399 connections now open) 2015-10-05T08:18:47.757+0100 [mongosMain] connection accepted from 172.28.0.163:64690 #1430735 (400 connections now open) 2015-10-05T08:18:47.758+0100 [conn1430735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:48.832+0100 [conn1430307] end connection 172.28.0.164:56475 (399 connections now open) 2015-10-05T08:18:48.834+0100 [mongosMain] connection accepted from 172.28.0.164:57691 #1430736 (400 connections now open) 2015-10-05T08:18:48.835+0100 [conn1430736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:49.458+0100 [conn1430377] end connection 172.28.0.164:56649 (399 connections now open) 2015-10-05T08:18:49.465+0100 [mongosMain] connection accepted from 172.28.0.164:57693 #1430737 (400 connections now open) 2015-10-05T08:18:49.468+0100 [conn1430737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:50.426+0100 [conn1430338] end connection 172.28.0.164:56554 (399 connections now open) 2015-10-05T08:18:50.430+0100 [mongosMain] connection accepted from 172.28.0.164:57695 #1430738 (400 connections now open) 2015-10-05T08:18:50.432+0100 [conn1430738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:57.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224605703b51053edd809 2015-10-05T08:18:57.240+0100 [conn1430368] end connection 172.28.0.163:63672 (399 connections now open) 2015-10-05T08:18:57.241+0100 [mongosMain] connection accepted from 172.28.0.163:64704 #1430739 (400 connections now open) 2015-10-05T08:18:57.242+0100 [conn1430739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:57.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:18:57.772+0100 [conn1430389] end connection 172.28.0.163:63711 (399 connections now open) 2015-10-05T08:18:57.773+0100 [mongosMain] connection accepted from 172.28.0.163:64707 #1430740 (400 connections now open) 2015-10-05T08:18:57.774+0100 [conn1430740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:18:58.850+0100 [conn1430246] end connection 172.28.0.164:56302 (399 connections now open) 2015-10-05T08:18:58.851+0100 [mongosMain] connection accepted from 172.28.0.164:57703 #1430741 (400 connections now open) 2015-10-05T08:18:58.853+0100 [conn1430741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:00.440+0100 [conn1430354] end connection 172.28.0.164:56595 (399 connections now open) 2015-10-05T08:19:00.441+0100 [mongosMain] connection accepted from 172.28.0.164:57708 #1430742 (400 connections now open) 2015-10-05T08:19:00.442+0100 [conn1430742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:03.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224675703b51053edd876 2015-10-05T08:19:04.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:19:07.211+0100 [conn1430374] end connection 172.28.0.163:63683 (399 connections now open) 2015-10-05T08:19:07.212+0100 [mongosMain] connection accepted from 172.28.0.163:64728 #1430743 (400 connections now open) 2015-10-05T08:19:07.213+0100 [conn1430743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:07.788+0100 [conn1430395] end connection 172.28.0.163:63725 (399 connections now open) 2015-10-05T08:19:07.789+0100 [mongosMain] connection accepted from 172.28.0.163:64729 #1430744 (400 connections now open) 2015-10-05T08:19:07.790+0100 [conn1430744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:08.539+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:19:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:19:08.870+0100 [conn1430315] end connection 172.28.0.164:56489 (399 connections now open) 2015-10-05T08:19:08.870+0100 [mongosMain] connection accepted from 172.28.0.164:57721 #1430745 (400 connections now open) 2015-10-05T08:19:08.871+0100 [conn1430745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:10.456+0100 [conn1430367] end connection 172.28.0.164:56624 (399 connections now open) 2015-10-05T08:19:10.457+0100 [mongosMain] connection accepted from 172.28.0.164:57723 #1430746 (400 connections now open) 2015-10-05T08:19:10.459+0100 [conn1430746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:10.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612246e5703b51053edd8af 2015-10-05T08:19:10.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:19:16.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224745703b51053edd8fb 2015-10-05T08:19:17.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:19:17.211+0100 [conn1430362] end connection 172.28.0.163:63656 (399 connections now open) 2015-10-05T08:19:17.212+0100 [mongosMain] connection accepted from 172.28.0.163:64741 #1430747 (400 connections now open) 2015-10-05T08:19:17.214+0100 [conn1430747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:18.864+0100 [conn1430358] end connection 172.28.0.164:56601 (399 connections now open) 2015-10-05T08:19:18.865+0100 [mongosMain] connection accepted from 172.28.0.164:57728 #1430748 (400 connections now open) 2015-10-05T08:19:18.867+0100 [conn1430748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:20.471+0100 [conn1430361] end connection 172.28.0.164:56618 (399 connections now open) 2015-10-05T08:19:20.472+0100 [mongosMain] connection accepted from 172.28.0.164:57735 #1430749 (400 connections now open) 2015-10-05T08:19:20.474+0100 [conn1430749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:28.277+0100 [mongosMain] connection accepted from 127.0.0.1:64751 #1430750 (401 connections now open) 2015-10-05T08:19:28.280+0100 [conn1430750] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:28.286+0100 [conn1430750] end connection 127.0.0.1:64751 (400 connections now open) 2015-10-05T08:19:28.880+0100 [conn1430364] end connection 172.28.0.164:56621 (399 connections now open) 2015-10-05T08:19:28.881+0100 [mongosMain] connection accepted from 172.28.0.164:57748 #1430751 (400 connections now open) 2015-10-05T08:19:28.883+0100 [conn1430751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:29.519+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224815703b51053edd9b4 2015-10-05T08:19:29.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:19:30.471+0100 [conn1430263] end connection 172.28.0.164:56355 (399 connections now open) 2015-10-05T08:19:30.472+0100 [mongosMain] connection accepted from 172.28.0.164:57752 #1430752 (400 connections now open) 2015-10-05T08:19:30.474+0100 [conn1430752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:37.242+0100 [conn1430339] end connection 172.28.0.163:63589 (399 connections now open) 2015-10-05T08:19:37.244+0100 [mongosMain] connection accepted from 172.28.0.163:64756 #1430753 (400 connections now open) 2015-10-05T08:19:37.245+0100 [conn1430753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:38.895+0100 [conn1430370] end connection 172.28.0.164:56628 (399 connections now open) 2015-10-05T08:19:38.896+0100 [mongosMain] connection accepted from 172.28.0.164:57765 #1430754 (400 connections now open) 2015-10-05T08:19:38.898+0100 [conn1430754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:39.255+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:19:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:19:39.591+0100 [mongosMain] connection accepted from 127.0.0.1:64759 #1430755 (401 connections now open) 2015-10-05T08:19:39.594+0100 [conn1430755] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:39.598+0100 [conn1430755] end connection 127.0.0.1:64759 (400 connections now open) 2015-10-05T08:19:40.487+0100 [conn1430404] end connection 172.28.0.164:56724 (399 connections now open) 2015-10-05T08:19:40.488+0100 [mongosMain] connection accepted from 172.28.0.164:57770 #1430756 (400 connections now open) 2015-10-05T08:19:40.489+0100 [conn1430756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:41.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612248d5703b51053edda86 2015-10-05T08:19:42.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:19:47.242+0100 [conn1430411] end connection 172.28.0.163:63767 (399 connections now open) 2015-10-05T08:19:47.243+0100 [mongosMain] connection accepted from 172.28.0.163:64769 #1430757 (400 connections now open) 2015-10-05T08:19:47.244+0100 [conn1430757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:49.598+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:19:49.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:19:50.486+0100 [conn1430373] end connection 172.28.0.164:56639 (399 connections now open) 2015-10-05T08:19:50.487+0100 [mongosMain] connection accepted from 172.28.0.164:57785 #1430758 (400 connections now open) 2015-10-05T08:19:50.489+0100 [conn1430758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:19:57.258+0100 [conn1430406] end connection 172.28.0.163:63762 (399 connections now open) 2015-10-05T08:19:57.260+0100 [mongosMain] connection accepted from 172.28.0.163:64776 #1430759 (400 connections now open) 2015-10-05T08:19:57.261+0100 [conn1430759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:00.487+0100 [conn1430347] end connection 172.28.0.164:56583 (399 connections now open) 2015-10-05T08:20:00.488+0100 [mongosMain] connection accepted from 172.28.0.164:57797 #1430760 (400 connections now open) 2015-10-05T08:20:00.490+0100 [conn1430760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:02.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224a25703b51053eddb9a 2015-10-05T08:20:03.006+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:07.259+0100 [conn1430381] end connection 172.28.0.163:63693 (399 connections now open) 2015-10-05T08:20:07.260+0100 [mongosMain] connection accepted from 172.28.0.163:64805 #1430761 (400 connections now open) 2015-10-05T08:20:07.262+0100 [conn1430761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:08.927+0100 [conn1430390] end connection 172.28.0.164:56687 (399 connections now open) 2015-10-05T08:20:08.928+0100 [mongosMain] connection accepted from 172.28.0.164:57810 #1430762 (400 connections now open) 2015-10-05T08:20:08.930+0100 [conn1430762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:09.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224a95703b51053eddc1e 2015-10-05T08:20:09.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:09.528+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:20:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:20:09.552+0100 [conn1430383] end connection 172.28.0.164:56669 (399 connections now open) 2015-10-05T08:20:09.553+0100 [mongosMain] connection accepted from 172.28.0.164:57812 #1430763 (400 connections now open) 2015-10-05T08:20:09.554+0100 [conn1430763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:10.504+0100 [conn1430328] end connection 172.28.0.164:56538 (399 connections now open) 2015-10-05T08:20:10.505+0100 [mongosMain] connection accepted from 172.28.0.164:57813 #1430764 (400 connections now open) 2015-10-05T08:20:10.507+0100 [conn1430764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:17.274+0100 [conn1430400] end connection 172.28.0.163:63747 (399 connections now open) 2015-10-05T08:20:17.275+0100 [mongosMain] connection accepted from 172.28.0.163:64820 #1430765 (400 connections now open) 2015-10-05T08:20:17.276+0100 [conn1430765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:17.836+0100 [conn1430401] end connection 172.28.0.163:63750 (399 connections now open) 2015-10-05T08:20:17.838+0100 [mongosMain] connection accepted from 172.28.0.163:64822 #1430766 (400 connections now open) 2015-10-05T08:20:17.839+0100 [conn1430766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:18.927+0100 [conn1430420] end connection 172.28.0.164:56806 (399 connections now open) 2015-10-05T08:20:18.928+0100 [mongosMain] connection accepted from 172.28.0.164:57823 #1430767 (400 connections now open) 2015-10-05T08:20:18.930+0100 [conn1430767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:19.551+0100 [conn1430421] end connection 172.28.0.164:56808 (399 connections now open) 2015-10-05T08:20:19.551+0100 [mongosMain] connection accepted from 172.28.0.164:57826 #1430768 (400 connections now open) 2015-10-05T08:20:19.554+0100 [conn1430768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:20.519+0100 [conn1430398] end connection 172.28.0.164:56717 (399 connections now open) 2015-10-05T08:20:20.520+0100 [mongosMain] connection accepted from 172.28.0.164:57828 #1430769 (400 connections now open) 2015-10-05T08:20:20.523+0100 [conn1430769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:22.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224b55703b51053eddcef 2015-10-05T08:20:22.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:23.843+0100 [conn1430415] end connection 172.28.0.163:63779 (399 connections now open) 2015-10-05T08:20:23.843+0100 [conn1430305] end connection 172.28.0.163:63500 (399 connections now open) 2015-10-05T08:20:23.844+0100 [mongosMain] connection accepted from 172.28.0.163:64825 #1430770 (399 connections now open) 2015-10-05T08:20:23.844+0100 [mongosMain] connection accepted from 172.28.0.163:64826 #1430771 (400 connections now open) 2015-10-05T08:20:23.845+0100 [conn1430770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:23.845+0100 [conn1430771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:27.275+0100 [conn1430414] end connection 172.28.0.163:63776 (399 connections now open) 2015-10-05T08:20:27.276+0100 [mongosMain] connection accepted from 172.28.0.163:64832 #1430772 (400 connections now open) 2015-10-05T08:20:27.278+0100 [conn1430772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:27.851+0100 [conn1430424] end connection 172.28.0.163:63841 (399 connections now open) 2015-10-05T08:20:27.852+0100 [mongosMain] connection accepted from 172.28.0.163:64834 #1430773 (400 connections now open) 2015-10-05T08:20:27.853+0100 [conn1430773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:28.775+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224bc5703b51053eddd5f 2015-10-05T08:20:28.907+0100 [mongosMain] connection accepted from 127.0.0.1:64835 #1430774 (401 connections now open) 2015-10-05T08:20:28.910+0100 [conn1430774] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:28.915+0100 [conn1430774] end connection 127.0.0.1:64835 (400 connections now open) 2015-10-05T08:20:28.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:28.943+0100 [conn1430407] end connection 172.28.0.164:56730 (399 connections now open) 2015-10-05T08:20:28.944+0100 [mongosMain] connection accepted from 172.28.0.164:57840 #1430775 (400 connections now open) 2015-10-05T08:20:28.945+0100 [conn1430775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:33.858+0100 [conn1430231] end connection 172.28.0.163:63292 (399 connections now open) 2015-10-05T08:20:33.859+0100 [conn1430359] end connection 172.28.0.163:63625 (398 connections now open) 2015-10-05T08:20:33.859+0100 [mongosMain] connection accepted from 172.28.0.163:64841 #1430776 (399 connections now open) 2015-10-05T08:20:33.860+0100 [mongosMain] connection accepted from 172.28.0.163:64842 #1430777 (400 connections now open) 2015-10-05T08:20:33.860+0100 [conn1430776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:33.861+0100 [conn1430777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:37.290+0100 [conn1430388] end connection 172.28.0.163:63708 (399 connections now open) 2015-10-05T08:20:37.291+0100 [mongosMain] connection accepted from 172.28.0.163:64845 #1430778 (400 connections now open) 2015-10-05T08:20:37.291+0100 [conn1430778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:37.868+0100 [conn1430429] end connection 172.28.0.163:63851 (399 connections now open) 2015-10-05T08:20:37.869+0100 [mongosMain] connection accepted from 172.28.0.163:64848 #1430779 (400 connections now open) 2015-10-05T08:20:37.870+0100 [conn1430779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:38.943+0100 [conn1430382] end connection 172.28.0.164:56666 (399 connections now open) 2015-10-05T08:20:38.944+0100 [mongosMain] connection accepted from 172.28.0.164:57851 #1430780 (400 connections now open) 2015-10-05T08:20:38.945+0100 [conn1430780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:39.566+0100 [conn1430426] end connection 172.28.0.164:56822 (399 connections now open) 2015-10-05T08:20:39.567+0100 [mongosMain] connection accepted from 172.28.0.164:57854 #1430781 (400 connections now open) 2015-10-05T08:20:39.569+0100 [conn1430781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:40.822+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:20:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:20:41.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224c95703b51053edde4d 2015-10-05T08:20:41.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:42.746+0100 [mongosMain] connection accepted from 127.0.0.1:64853 #1430782 (401 connections now open) 2015-10-05T08:20:42.748+0100 [conn1430782] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:42.753+0100 [conn1430782] end connection 127.0.0.1:64853 (400 connections now open) 2015-10-05T08:20:43.874+0100 [conn1430203] end connection 172.28.0.163:63219 (399 connections now open) 2015-10-05T08:20:43.874+0100 [conn1430385] end connection 172.28.0.163:63698 (398 connections now open) 2015-10-05T08:20:43.875+0100 [mongosMain] connection accepted from 172.28.0.163:64857 #1430783 (399 connections now open) 2015-10-05T08:20:43.875+0100 [mongosMain] connection accepted from 172.28.0.163:64858 #1430784 (400 connections now open) 2015-10-05T08:20:43.876+0100 [conn1430783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:43.876+0100 [conn1430784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:47.290+0100 [conn1430418] end connection 172.28.0.163:63803 (399 connections now open) 2015-10-05T08:20:47.291+0100 [mongosMain] connection accepted from 172.28.0.163:64867 #1430785 (400 connections now open) 2015-10-05T08:20:47.292+0100 [conn1430785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:47.627+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224cf5703b51053eddebb 2015-10-05T08:20:47.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:47.867+0100 [conn1430434] end connection 172.28.0.163:63857 (399 connections now open) 2015-10-05T08:20:47.868+0100 [mongosMain] connection accepted from 172.28.0.163:64869 #1430786 (400 connections now open) 2015-10-05T08:20:47.869+0100 [conn1430786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:48.959+0100 [conn1430402] end connection 172.28.0.164:56721 (399 connections now open) 2015-10-05T08:20:48.960+0100 [mongosMain] connection accepted from 172.28.0.164:57878 #1430787 (400 connections now open) 2015-10-05T08:20:48.962+0100 [conn1430787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:49.584+0100 [conn1430436] end connection 172.28.0.164:56857 (399 connections now open) 2015-10-05T08:20:49.585+0100 [mongosMain] connection accepted from 172.28.0.164:57879 #1430788 (400 connections now open) 2015-10-05T08:20:49.594+0100 [conn1430788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:53.889+0100 [conn1430184] end connection 172.28.0.163:63144 (399 connections now open) 2015-10-05T08:20:53.891+0100 [mongosMain] connection accepted from 172.28.0.163:64877 #1430789 (400 connections now open) 2015-10-05T08:20:53.892+0100 [conn1430789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:53.975+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224d55703b51053eddf25 2015-10-05T08:20:54.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:20:57.402+0100 [conn1430417] end connection 172.28.0.163:63792 (399 connections now open) 2015-10-05T08:20:57.403+0100 [mongosMain] connection accepted from 172.28.0.163:64884 #1430790 (400 connections now open) 2015-10-05T08:20:57.404+0100 [conn1430790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:57.883+0100 [conn1430439] end connection 172.28.0.163:63873 (399 connections now open) 2015-10-05T08:20:57.884+0100 [mongosMain] connection accepted from 172.28.0.163:64885 #1430791 (400 connections now open) 2015-10-05T08:20:57.885+0100 [conn1430791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:20:58.959+0100 [conn1430376] end connection 172.28.0.164:56647 (399 connections now open) 2015-10-05T08:20:58.960+0100 [mongosMain] connection accepted from 172.28.0.164:57888 #1430792 (400 connections now open) 2015-10-05T08:20:58.962+0100 [conn1430792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:00.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224dc5703b51053eddf8a 2015-10-05T08:21:00.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:21:00.565+0100 [conn1430393] end connection 172.28.0.164:56697 (399 connections now open) 2015-10-05T08:21:00.567+0100 [mongosMain] connection accepted from 172.28.0.164:57896 #1430793 (400 connections now open) 2015-10-05T08:21:00.569+0100 [conn1430793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:03.888+0100 [conn1430331] end connection 172.28.0.163:63575 (399 connections now open) 2015-10-05T08:21:03.889+0100 [mongosMain] connection accepted from 172.28.0.163:64902 #1430794 (400 connections now open) 2015-10-05T08:21:03.890+0100 [conn1430794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:07.321+0100 [conn1430423] end connection 172.28.0.163:63840 (399 connections now open) 2015-10-05T08:21:07.322+0100 [mongosMain] connection accepted from 172.28.0.163:64912 #1430795 (400 connections now open) 2015-10-05T08:21:07.324+0100 [conn1430795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:08.975+0100 [conn1430435] end connection 172.28.0.164:56855 (399 connections now open) 2015-10-05T08:21:08.976+0100 [mongosMain] connection accepted from 172.28.0.164:57914 #1430796 (400 connections now open) 2015-10-05T08:21:08.978+0100 [conn1430796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:09.599+0100 [conn1430441] end connection 172.28.0.164:56874 (399 connections now open) 2015-10-05T08:21:09.600+0100 [mongosMain] connection accepted from 172.28.0.164:57916 #1430797 (400 connections now open) 2015-10-05T08:21:09.607+0100 [conn1430797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:10.581+0100 [conn1430422] end connection 172.28.0.164:56811 (399 connections now open) 2015-10-05T08:21:10.583+0100 [mongosMain] connection accepted from 172.28.0.164:57918 #1430798 (400 connections now open) 2015-10-05T08:21:10.584+0100 [conn1430798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:11.247+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:21:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:21:13.890+0100 [conn1430341] end connection 172.28.0.163:63595 (399 connections now open) 2015-10-05T08:21:13.891+0100 [mongosMain] connection accepted from 172.28.0.163:64918 #1430799 (400 connections now open) 2015-10-05T08:21:13.892+0100 [conn1430799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:17.322+0100 [conn1430428] end connection 172.28.0.163:63849 (399 connections now open) 2015-10-05T08:21:17.323+0100 [mongosMain] connection accepted from 172.28.0.163:64927 #1430800 (400 connections now open) 2015-10-05T08:21:17.324+0100 [conn1430800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:17.898+0100 [conn1430443] end connection 172.28.0.163:63891 (399 connections now open) 2015-10-05T08:21:17.900+0100 [mongosMain] connection accepted from 172.28.0.163:64929 #1430801 (400 connections now open) 2015-10-05T08:21:17.901+0100 [conn1430801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:18.990+0100 [conn1430444] end connection 172.28.0.164:56882 (399 connections now open) 2015-10-05T08:21:18.991+0100 [mongosMain] connection accepted from 172.28.0.164:57922 #1430802 (400 connections now open) 2015-10-05T08:21:18.993+0100 [conn1430802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:19.614+0100 [conn1430447] end connection 172.28.0.164:56902 (399 connections now open) 2015-10-05T08:21:19.615+0100 [mongosMain] connection accepted from 172.28.0.164:57926 #1430803 (400 connections now open) 2015-10-05T08:21:19.616+0100 [conn1430803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:20.581+0100 [conn1430386] end connection 172.28.0.164:56680 (399 connections now open) 2015-10-05T08:21:20.582+0100 [mongosMain] connection accepted from 172.28.0.164:57930 #1430804 (400 connections now open) 2015-10-05T08:21:20.583+0100 [conn1430804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:24.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224f45703b51053ede150 2015-10-05T08:21:25.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:21:27.337+0100 [conn1430433] end connection 172.28.0.163:63855 (399 connections now open) 2015-10-05T08:21:27.338+0100 [mongosMain] connection accepted from 172.28.0.163:64936 #1430805 (400 connections now open) 2015-10-05T08:21:27.340+0100 [conn1430805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:27.900+0100 [conn1430449] end connection 172.28.0.163:63932 (399 connections now open) 2015-10-05T08:21:27.901+0100 [mongosMain] connection accepted from 172.28.0.163:64939 #1430806 (400 connections now open) 2015-10-05T08:21:27.902+0100 [conn1430806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:29.006+0100 [conn1430425] end connection 172.28.0.164:56818 (399 connections now open) 2015-10-05T08:21:29.007+0100 [mongosMain] connection accepted from 172.28.0.164:57943 #1430807 (400 connections now open) 2015-10-05T08:21:29.009+0100 [conn1430807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:29.095+0100 [mongosMain] connection accepted from 127.0.0.1:64941 #1430808 (401 connections now open) 2015-10-05T08:21:29.098+0100 [conn1430808] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:29.104+0100 [conn1430808] end connection 127.0.0.1:64941 (400 connections now open) 2015-10-05T08:21:29.614+0100 [conn1430451] end connection 172.28.0.164:56906 (399 connections now open) 2015-10-05T08:21:29.616+0100 [mongosMain] connection accepted from 172.28.0.164:57946 #1430809 (400 connections now open) 2015-10-05T08:21:29.621+0100 [conn1430809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:32.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561224fb5703b51053ede187 2015-10-05T08:21:32.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:21:37.347+0100 [conn1430438] end connection 172.28.0.163:63871 (399 connections now open) 2015-10-05T08:21:37.349+0100 [mongosMain] connection accepted from 172.28.0.163:64949 #1430810 (400 connections now open) 2015-10-05T08:21:37.350+0100 [conn1430810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:37.914+0100 [conn1430454] end connection 172.28.0.163:63940 (399 connections now open) 2015-10-05T08:21:37.915+0100 [mongosMain] connection accepted from 172.28.0.163:64951 #1430811 (400 connections now open) 2015-10-05T08:21:37.916+0100 [conn1430811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:39.022+0100 [conn1430440] end connection 172.28.0.164:56873 (399 connections now open) 2015-10-05T08:21:39.024+0100 [mongosMain] connection accepted from 172.28.0.164:57960 #1430812 (400 connections now open) 2015-10-05T08:21:39.026+0100 [conn1430812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:39.629+0100 [conn1430457] end connection 172.28.0.164:56921 (399 connections now open) 2015-10-05T08:21:39.630+0100 [mongosMain] connection accepted from 172.28.0.164:57962 #1430813 (400 connections now open) 2015-10-05T08:21:39.639+0100 [conn1430813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:40.123+0100 [mongosMain] connection accepted from 127.0.0.1:64956 #1430814 (401 connections now open) 2015-10-05T08:21:40.129+0100 [conn1430814] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:40.134+0100 [conn1430814] end connection 127.0.0.1:64956 (400 connections now open) 2015-10-05T08:21:41.453+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:21:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:21:45.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225085703b51053ede1f1 2015-10-05T08:21:45.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:21:47.353+0100 [conn1430442] end connection 172.28.0.163:63888 (399 connections now open) 2015-10-05T08:21:47.354+0100 [mongosMain] connection accepted from 172.28.0.163:64968 #1430815 (400 connections now open) 2015-10-05T08:21:47.355+0100 [conn1430815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:47.916+0100 [conn1430461] end connection 172.28.0.163:63950 (399 connections now open) 2015-10-05T08:21:47.918+0100 [mongosMain] connection accepted from 172.28.0.163:64970 #1430816 (400 connections now open) 2015-10-05T08:21:47.920+0100 [conn1430816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:49.020+0100 [conn1430396] end connection 172.28.0.164:56700 (399 connections now open) 2015-10-05T08:21:49.021+0100 [mongosMain] connection accepted from 172.28.0.164:57974 #1430817 (400 connections now open) 2015-10-05T08:21:49.023+0100 [conn1430817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:49.629+0100 [conn1430463] end connection 172.28.0.164:56938 (399 connections now open) 2015-10-05T08:21:49.630+0100 [mongosMain] connection accepted from 172.28.0.164:57976 #1430818 (400 connections now open) 2015-10-05T08:21:49.636+0100 [conn1430818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:57.354+0100 [conn1430445] end connection 172.28.0.163:63915 (399 connections now open) 2015-10-05T08:21:57.355+0100 [mongosMain] connection accepted from 172.28.0.163:64986 #1430819 (400 connections now open) 2015-10-05T08:21:57.356+0100 [conn1430819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:57.930+0100 [conn1430467] end connection 172.28.0.163:63964 (399 connections now open) 2015-10-05T08:21:57.932+0100 [mongosMain] connection accepted from 172.28.0.163:64987 #1430820 (400 connections now open) 2015-10-05T08:21:57.933+0100 [conn1430820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:59.037+0100 [conn1430450] end connection 172.28.0.164:56904 (399 connections now open) 2015-10-05T08:21:59.038+0100 [mongosMain] connection accepted from 172.28.0.164:57984 #1430821 (400 connections now open) 2015-10-05T08:21:59.040+0100 [conn1430821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:21:59.644+0100 [conn1430469] end connection 172.28.0.164:56960 (399 connections now open) 2015-10-05T08:21:59.645+0100 [mongosMain] connection accepted from 172.28.0.164:57986 #1430822 (400 connections now open) 2015-10-05T08:21:59.647+0100 [conn1430822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:00.628+0100 [conn1430322] end connection 172.28.0.164:56521 (399 connections now open) 2015-10-05T08:22:00.629+0100 [mongosMain] connection accepted from 172.28.0.164:57991 #1430823 (400 connections now open) 2015-10-05T08:22:00.630+0100 [conn1430823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:07.369+0100 [conn1430453] end connection 172.28.0.163:63938 (399 connections now open) 2015-10-05T08:22:07.370+0100 [mongosMain] connection accepted from 172.28.0.163:65013 #1430824 (400 connections now open) 2015-10-05T08:22:07.371+0100 [conn1430824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:07.946+0100 [conn1430472] end connection 172.28.0.163:63981 (399 connections now open) 2015-10-05T08:22:07.947+0100 [mongosMain] connection accepted from 172.28.0.163:65015 #1430825 (400 connections now open) 2015-10-05T08:22:07.949+0100 [conn1430825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:09.052+0100 [conn1430468] end connection 172.28.0.164:56958 (399 connections now open) 2015-10-05T08:22:09.054+0100 [mongosMain] connection accepted from 172.28.0.164:58003 #1430826 (400 connections now open) 2015-10-05T08:22:09.055+0100 [conn1430826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:09.661+0100 [conn1430474] end connection 172.28.0.164:56971 (399 connections now open) 2015-10-05T08:22:09.662+0100 [mongosMain] connection accepted from 172.28.0.164:58005 #1430827 (400 connections now open) 2015-10-05T08:22:09.664+0100 [conn1430827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:10.628+0100 [conn1430255] end connection 172.28.0.164:56332 (399 connections now open) 2015-10-05T08:22:10.629+0100 [mongosMain] connection accepted from 172.28.0.164:58006 #1430828 (400 connections now open) 2015-10-05T08:22:10.631+0100 [conn1430828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:12.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225215703b51053ede2bc 2015-10-05T08:22:13.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:13.715+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:22:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:22:13.953+0100 [conn1429784] end connection 172.28.0.163:61873 (399 connections now open) 2015-10-05T08:22:13.955+0100 [mongosMain] connection accepted from 172.28.0.163:65021 #1430829 (400 connections now open) 2015-10-05T08:22:13.956+0100 [conn1430829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:17.384+0100 [conn1430460] end connection 172.28.0.163:63948 (399 connections now open) 2015-10-05T08:22:17.385+0100 [mongosMain] connection accepted from 172.28.0.163:65029 #1430830 (400 connections now open) 2015-10-05T08:22:17.386+0100 [conn1430830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:17.946+0100 [conn1430476] end connection 172.28.0.163:64002 (399 connections now open) 2015-10-05T08:22:17.955+0100 [mongosMain] connection accepted from 172.28.0.163:65030 #1430831 (400 connections now open) 2015-10-05T08:22:17.956+0100 [conn1430831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:19.067+0100 [conn1430446] end connection 172.28.0.164:56899 (399 connections now open) 2015-10-05T08:22:19.068+0100 [mongosMain] connection accepted from 172.28.0.164:58012 #1430832 (400 connections now open) 2015-10-05T08:22:19.069+0100 [conn1430832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:19.676+0100 [conn1430478] end connection 172.28.0.164:56992 (399 connections now open) 2015-10-05T08:22:19.678+0100 [mongosMain] connection accepted from 172.28.0.164:58016 #1430833 (400 connections now open) 2015-10-05T08:22:19.680+0100 [conn1430833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:19.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612252b5703b51053ede36a 2015-10-05T08:22:20.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:20.645+0100 [conn1430337] end connection 172.28.0.164:56553 (399 connections now open) 2015-10-05T08:22:20.646+0100 [mongosMain] connection accepted from 172.28.0.164:58018 #1430834 (400 connections now open) 2015-10-05T08:22:20.658+0100 [conn1430834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:26.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225325703b51053ede406 2015-10-05T08:22:26.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:27.385+0100 [conn1430419] end connection 172.28.0.163:63828 (399 connections now open) 2015-10-05T08:22:27.386+0100 [mongosMain] connection accepted from 172.28.0.163:65039 #1430835 (400 connections now open) 2015-10-05T08:22:27.387+0100 [conn1430835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:27.962+0100 [conn1430480] end connection 172.28.0.163:64017 (399 connections now open) 2015-10-05T08:22:27.963+0100 [mongosMain] connection accepted from 172.28.0.163:65041 #1430836 (400 connections now open) 2015-10-05T08:22:27.964+0100 [conn1430836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:28.263+0100 [mongosMain] connection accepted from 127.0.0.1:65043 #1430837 (401 connections now open) 2015-10-05T08:22:28.266+0100 [conn1430837] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:28.273+0100 [conn1430837] end connection 127.0.0.1:65043 (400 connections now open) 2015-10-05T08:22:29.157+0100 [mongosMain] connection accepted from 172.28.0.164:58030 #1430838 (401 connections now open) 2015-10-05T08:22:29.159+0100 [conn1430455] end connection 172.28.0.164:56919 (400 connections now open) 2015-10-05T08:22:29.162+0100 [conn1430838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:29.691+0100 [conn1430482] end connection 172.28.0.164:57003 (399 connections now open) 2015-10-05T08:22:29.692+0100 [mongosMain] connection accepted from 172.28.0.164:58034 #1430839 (400 connections now open) 2015-10-05T08:22:29.693+0100 [conn1430839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:30.644+0100 [conn1430172] end connection 172.28.0.164:56095 (399 connections now open) 2015-10-05T08:22:30.644+0100 [mongosMain] connection accepted from 172.28.0.164:58035 #1430840 (400 connections now open) 2015-10-05T08:22:30.646+0100 [conn1430840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:33.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225385703b51053ede471 2015-10-05T08:22:33.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:37.400+0100 [conn1430448] end connection 172.28.0.163:63930 (399 connections now open) 2015-10-05T08:22:37.401+0100 [mongosMain] connection accepted from 172.28.0.163:65047 #1430841 (400 connections now open) 2015-10-05T08:22:37.402+0100 [conn1430841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:37.962+0100 [conn1430484] end connection 172.28.0.163:64024 (399 connections now open) 2015-10-05T08:22:37.963+0100 [mongosMain] connection accepted from 172.28.0.163:65048 #1430842 (400 connections now open) 2015-10-05T08:22:37.965+0100 [conn1430842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:39.099+0100 [conn1430473] end connection 172.28.0.164:56968 (399 connections now open) 2015-10-05T08:22:39.101+0100 [mongosMain] connection accepted from 172.28.0.164:58048 #1430843 (400 connections now open) 2015-10-05T08:22:39.103+0100 [conn1430843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:39.710+0100 [conn1430487] end connection 172.28.0.164:57022 (399 connections now open) 2015-10-05T08:22:39.711+0100 [mongosMain] connection accepted from 172.28.0.164:58050 #1430844 (400 connections now open) 2015-10-05T08:22:39.713+0100 [conn1430844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:40.237+0100 [mongosMain] connection accepted from 127.0.0.1:65051 #1430845 (401 connections now open) 2015-10-05T08:22:40.241+0100 [conn1430845] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:40.246+0100 [conn1430845] end connection 127.0.0.1:65051 (400 connections now open) 2015-10-05T08:22:40.896+0100 [conn1429869] end connection 172.28.0.164:55104 (399 connections now open) 2015-10-05T08:22:40.898+0100 [mongosMain] connection accepted from 172.28.0.164:58054 #1430846 (400 connections now open) 2015-10-05T08:22:40.900+0100 [conn1430846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:43.970+0100 [conn1430297] end connection 172.28.0.163:63482 (399 connections now open) 2015-10-05T08:22:43.971+0100 [mongosMain] connection accepted from 172.28.0.163:65058 #1430847 (400 connections now open) 2015-10-05T08:22:43.972+0100 [conn1430847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:43.978+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:22:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:22:46.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225455703b51053ede538 2015-10-05T08:22:46.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:47.401+0100 [conn1430466] end connection 172.28.0.163:63962 (399 connections now open) 2015-10-05T08:22:47.402+0100 [mongosMain] connection accepted from 172.28.0.163:65065 #1430848 (400 connections now open) 2015-10-05T08:22:47.403+0100 [conn1430848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:47.978+0100 [conn1430489] end connection 172.28.0.163:64032 (399 connections now open) 2015-10-05T08:22:47.980+0100 [mongosMain] connection accepted from 172.28.0.163:65067 #1430849 (400 connections now open) 2015-10-05T08:22:47.981+0100 [conn1430849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:49.114+0100 [conn1430462] end connection 172.28.0.164:56935 (399 connections now open) 2015-10-05T08:22:49.115+0100 [mongosMain] connection accepted from 172.28.0.164:58065 #1430850 (400 connections now open) 2015-10-05T08:22:49.117+0100 [conn1430850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:49.708+0100 [conn1430491] end connection 172.28.0.164:57040 (399 connections now open) 2015-10-05T08:22:49.708+0100 [mongosMain] connection accepted from 172.28.0.164:58067 #1430851 (400 connections now open) 2015-10-05T08:22:49.711+0100 [conn1430851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:50.893+0100 [conn1430392] end connection 172.28.0.164:56696 (399 connections now open) 2015-10-05T08:22:50.895+0100 [mongosMain] connection accepted from 172.28.0.164:58070 #1430852 (400 connections now open) 2015-10-05T08:22:50.897+0100 [conn1430852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:52.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612254c5703b51053ede593 2015-10-05T08:22:52.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:22:57.416+0100 [conn1430475] end connection 172.28.0.163:64000 (399 connections now open) 2015-10-05T08:22:57.417+0100 [mongosMain] connection accepted from 172.28.0.163:65075 #1430853 (400 connections now open) 2015-10-05T08:22:57.418+0100 [conn1430853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:57.981+0100 [conn1430494] end connection 172.28.0.163:64050 (399 connections now open) 2015-10-05T08:22:57.982+0100 [mongosMain] connection accepted from 172.28.0.163:65077 #1430854 (400 connections now open) 2015-10-05T08:22:57.983+0100 [conn1430854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:59.130+0100 [conn1430481] end connection 172.28.0.164:57001 (399 connections now open) 2015-10-05T08:22:59.132+0100 [mongosMain] connection accepted from 172.28.0.164:58075 #1430855 (400 connections now open) 2015-10-05T08:22:59.136+0100 [conn1430855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:22:59.723+0100 [conn1430495] end connection 172.28.0.164:57060 (399 connections now open) 2015-10-05T08:22:59.725+0100 [mongosMain] connection accepted from 172.28.0.164:58078 #1430856 (400 connections now open) 2015-10-05T08:22:59.727+0100 [conn1430856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:01.301+0100 [conn1430387] end connection 172.28.0.164:56681 (399 connections now open) 2015-10-05T08:23:01.304+0100 [mongosMain] connection accepted from 172.28.0.164:58084 #1430857 (400 connections now open) 2015-10-05T08:23:01.306+0100 [conn1430857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:05.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225595703b51053ede657 2015-10-05T08:23:05.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:07.417+0100 [conn1430483] end connection 172.28.0.163:64022 (399 connections now open) 2015-10-05T08:23:07.418+0100 [mongosMain] connection accepted from 172.28.0.163:65102 #1430858 (400 connections now open) 2015-10-05T08:23:07.419+0100 [conn1430858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:07.993+0100 [conn1430496] end connection 172.28.0.163:64065 (399 connections now open) 2015-10-05T08:23:07.994+0100 [mongosMain] connection accepted from 172.28.0.163:65105 #1430859 (400 connections now open) 2015-10-05T08:23:07.995+0100 [conn1430859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:09.132+0100 [conn1430485] end connection 172.28.0.164:57020 (399 connections now open) 2015-10-05T08:23:09.133+0100 [mongosMain] connection accepted from 172.28.0.164:58100 #1430860 (400 connections now open) 2015-10-05T08:23:09.135+0100 [conn1430860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:09.738+0100 [conn1430497] end connection 172.28.0.164:57072 (399 connections now open) 2015-10-05T08:23:09.740+0100 [mongosMain] connection accepted from 172.28.0.164:58102 #1430861 (400 connections now open) 2015-10-05T08:23:09.742+0100 [conn1430861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:11.285+0100 [conn1430262] end connection 172.28.0.164:56354 (399 connections now open) 2015-10-05T08:23:11.286+0100 [mongosMain] connection accepted from 172.28.0.164:58106 #1430862 (400 connections now open) 2015-10-05T08:23:11.287+0100 [conn1430862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:11.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612255f5703b51053ede6ce 2015-10-05T08:23:12.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:14.249+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:23:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:23:17.433+0100 [conn1430493] end connection 172.28.0.163:64047 (399 connections now open) 2015-10-05T08:23:17.434+0100 [mongosMain] connection accepted from 172.28.0.163:65116 #1430863 (400 connections now open) 2015-10-05T08:23:17.435+0100 [conn1430863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:18.009+0100 [conn1430502] end connection 172.28.0.163:64099 (399 connections now open) 2015-10-05T08:23:18.010+0100 [mongosMain] connection accepted from 172.28.0.163:65118 #1430864 (400 connections now open) 2015-10-05T08:23:18.011+0100 [conn1430864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:19.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225665703b51053ede733 2015-10-05T08:23:19.267+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:19.755+0100 [conn1430503] end connection 172.28.0.164:57098 (399 connections now open) 2015-10-05T08:23:19.756+0100 [mongosMain] connection accepted from 172.28.0.164:58113 #1430865 (400 connections now open) 2015-10-05T08:23:19.758+0100 [conn1430865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:21.299+0100 [conn1430329] end connection 172.28.0.164:56537 (399 connections now open) 2015-10-05T08:23:21.300+0100 [conn1430380] end connection 172.28.0.164:56657 (398 connections now open) 2015-10-05T08:23:21.301+0100 [mongosMain] connection accepted from 172.28.0.164:58119 #1430866 (399 connections now open) 2015-10-05T08:23:21.301+0100 [mongosMain] connection accepted from 172.28.0.164:58118 #1430867 (400 connections now open) 2015-10-05T08:23:21.302+0100 [conn1430866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:21.303+0100 [conn1430867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:24.000+0100 [conn1430504] end connection 172.28.0.163:64104 (399 connections now open) 2015-10-05T08:23:24.001+0100 [mongosMain] connection accepted from 172.28.0.163:65123 #1430868 (400 connections now open) 2015-10-05T08:23:24.002+0100 [conn1430868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:25.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612256d5703b51053ede7b9 2015-10-05T08:23:25.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:28.009+0100 [conn1430507] end connection 172.28.0.163:64116 (399 connections now open) 2015-10-05T08:23:28.010+0100 [mongosMain] connection accepted from 172.28.0.163:65128 #1430869 (400 connections now open) 2015-10-05T08:23:28.011+0100 [conn1430869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:28.293+0100 [mongosMain] connection accepted from 127.0.0.1:65129 #1430870 (401 connections now open) 2015-10-05T08:23:28.295+0100 [conn1430870] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:28.300+0100 [conn1430870] end connection 127.0.0.1:65129 (400 connections now open) 2015-10-05T08:23:29.771+0100 [conn1430508] end connection 172.28.0.164:57106 (399 connections now open) 2015-10-05T08:23:29.785+0100 [mongosMain] connection accepted from 172.28.0.164:58131 #1430871 (400 connections now open) 2015-10-05T08:23:29.786+0100 [conn1430871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:31.332+0100 [conn1430452] end connection 172.28.0.164:56914 (399 connections now open) 2015-10-05T08:23:31.332+0100 [conn1430346] end connection 172.28.0.164:56582 (398 connections now open) 2015-10-05T08:23:31.333+0100 [mongosMain] connection accepted from 172.28.0.164:58135 #1430872 (399 connections now open) 2015-10-05T08:23:31.333+0100 [mongosMain] connection accepted from 172.28.0.164:58136 #1430873 (400 connections now open) 2015-10-05T08:23:31.335+0100 [conn1430872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:31.336+0100 [conn1430873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:32.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225735703b51053ede82c 2015-10-05T08:23:32.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:34.016+0100 [conn1430498] end connection 172.28.0.163:64081 (399 connections now open) 2015-10-05T08:23:34.017+0100 [mongosMain] connection accepted from 172.28.0.163:65131 #1430874 (400 connections now open) 2015-10-05T08:23:34.018+0100 [conn1430874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:37.448+0100 [conn1430501] end connection 172.28.0.163:64095 (399 connections now open) 2015-10-05T08:23:37.449+0100 [mongosMain] connection accepted from 172.28.0.163:65136 #1430875 (400 connections now open) 2015-10-05T08:23:37.450+0100 [conn1430875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:38.025+0100 [conn1430513] end connection 172.28.0.163:64127 (399 connections now open) 2015-10-05T08:23:38.026+0100 [mongosMain] connection accepted from 172.28.0.163:65138 #1430876 (400 connections now open) 2015-10-05T08:23:38.028+0100 [conn1430876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:38.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612257a5703b51053ede8b4 2015-10-05T08:23:38.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:39.736+0100 [mongosMain] connection accepted from 127.0.0.1:65140 #1430877 (401 connections now open) 2015-10-05T08:23:39.740+0100 [conn1430877] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:39.746+0100 [conn1430877] end connection 127.0.0.1:65140 (400 connections now open) 2015-10-05T08:23:39.785+0100 [conn1430515] end connection 172.28.0.164:57127 (399 connections now open) 2015-10-05T08:23:39.787+0100 [mongosMain] connection accepted from 172.28.0.164:58151 #1430878 (400 connections now open) 2015-10-05T08:23:39.791+0100 [conn1430878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:41.347+0100 [conn1430410] end connection 172.28.0.164:56743 (399 connections now open) 2015-10-05T08:23:41.350+0100 [mongosMain] connection accepted from 172.28.0.164:58155 #1430879 (400 connections now open) 2015-10-05T08:23:41.351+0100 [conn1430879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:44.030+0100 [conn1430391] end connection 172.28.0.163:63715 (399 connections now open) 2015-10-05T08:23:44.031+0100 [mongosMain] connection accepted from 172.28.0.163:65147 #1430880 (400 connections now open) 2015-10-05T08:23:44.032+0100 [conn1430880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:44.514+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:23:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:23:45.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225805703b51053ede926 2015-10-05T08:23:45.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:47.463+0100 [conn1430471] end connection 172.28.0.163:63980 (399 connections now open) 2015-10-05T08:23:47.464+0100 [mongosMain] connection accepted from 172.28.0.163:65156 #1430881 (400 connections now open) 2015-10-05T08:23:47.465+0100 [conn1430881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:48.025+0100 [conn1430522] end connection 172.28.0.163:64138 (399 connections now open) 2015-10-05T08:23:48.027+0100 [mongosMain] connection accepted from 172.28.0.163:65157 #1430882 (400 connections now open) 2015-10-05T08:23:48.028+0100 [conn1430882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:49.168+0100 [conn1430430] end connection 172.28.0.164:56838 (399 connections now open) 2015-10-05T08:23:49.169+0100 [mongosMain] connection accepted from 172.28.0.164:58165 #1430883 (400 connections now open) 2015-10-05T08:23:49.170+0100 [conn1430883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:49.786+0100 [conn1430524] end connection 172.28.0.164:57149 (399 connections now open) 2015-10-05T08:23:49.787+0100 [mongosMain] connection accepted from 172.28.0.164:58168 #1430884 (400 connections now open) 2015-10-05T08:23:49.789+0100 [conn1430884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:51.347+0100 [conn1430302] end connection 172.28.0.164:56465 (399 connections now open) 2015-10-05T08:23:51.347+0100 [conn1430427] end connection 172.28.0.164:56831 (398 connections now open) 2015-10-05T08:23:51.348+0100 [mongosMain] connection accepted from 172.28.0.164:58172 #1430885 (399 connections now open) 2015-10-05T08:23:51.349+0100 [mongosMain] connection accepted from 172.28.0.164:58173 #1430886 (400 connections now open) 2015-10-05T08:23:51.350+0100 [conn1430885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:51.350+0100 [conn1430886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:54.033+0100 [conn1430332] end connection 172.28.0.163:63576 (399 connections now open) 2015-10-05T08:23:54.033+0100 [conn1430126] end connection 172.28.0.163:62980 (399 connections now open) 2015-10-05T08:23:54.034+0100 [mongosMain] connection accepted from 172.28.0.163:65165 #1430887 (399 connections now open) 2015-10-05T08:23:54.034+0100 [mongosMain] connection accepted from 172.28.0.163:65166 #1430888 (400 connections now open) 2015-10-05T08:23:54.035+0100 [conn1430887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:54.035+0100 [conn1430888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:57.491+0100 [conn1430394] end connection 172.28.0.163:63723 (399 connections now open) 2015-10-05T08:23:57.492+0100 [mongosMain] connection accepted from 172.28.0.163:65177 #1430889 (400 connections now open) 2015-10-05T08:23:57.493+0100 [conn1430889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:58.041+0100 [conn1430531] end connection 172.28.0.163:64156 (399 connections now open) 2015-10-05T08:23:58.042+0100 [mongosMain] connection accepted from 172.28.0.163:65179 #1430890 (400 connections now open) 2015-10-05T08:23:58.043+0100 [conn1430890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:58.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612258d5703b51053ede9ea 2015-10-05T08:23:58.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:23:59.178+0100 [conn1430477] end connection 172.28.0.164:56990 (399 connections now open) 2015-10-05T08:23:59.179+0100 [mongosMain] connection accepted from 172.28.0.164:58180 #1430891 (400 connections now open) 2015-10-05T08:23:59.180+0100 [conn1430891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:23:59.802+0100 [conn1430532] end connection 172.28.0.164:57165 (399 connections now open) 2015-10-05T08:23:59.804+0100 [mongosMain] connection accepted from 172.28.0.164:58182 #1430892 (400 connections now open) 2015-10-05T08:23:59.805+0100 [conn1430892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:01.371+0100 [conn1430529] end connection 172.28.0.164:57161 (399 connections now open) 2015-10-05T08:24:01.375+0100 [mongosMain] connection accepted from 172.28.0.164:58185 #1430893 (400 connections now open) 2015-10-05T08:24:01.377+0100 [conn1430893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:01.378+0100 [conn1430459] end connection 172.28.0.164:56930 (399 connections now open) 2015-10-05T08:24:01.380+0100 [mongosMain] connection accepted from 172.28.0.164:58188 #1430894 (400 connections now open) 2015-10-05T08:24:01.382+0100 [conn1430894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:04.051+0100 [conn1430277] end connection 172.28.0.163:63443 (399 connections now open) 2015-10-05T08:24:04.051+0100 [conn1430319] end connection 172.28.0.163:63547 (398 connections now open) 2015-10-05T08:24:04.053+0100 [mongosMain] connection accepted from 172.28.0.163:65199 #1430895 (399 connections now open) 2015-10-05T08:24:04.053+0100 [mongosMain] connection accepted from 172.28.0.163:65200 #1430896 (400 connections now open) 2015-10-05T08:24:04.054+0100 [conn1430895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:04.054+0100 [conn1430896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:08.041+0100 [conn1430538] end connection 172.28.0.163:64176 (399 connections now open) 2015-10-05T08:24:08.043+0100 [mongosMain] connection accepted from 172.28.0.163:65209 #1430897 (400 connections now open) 2015-10-05T08:24:08.043+0100 [conn1430897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:11.364+0100 [conn1430499] end connection 172.28.0.164:57091 (399 connections now open) 2015-10-05T08:24:11.364+0100 [conn1430519] end connection 172.28.0.164:57139 (399 connections now open) 2015-10-05T08:24:11.365+0100 [mongosMain] connection accepted from 172.28.0.164:58203 #1430898 (399 connections now open) 2015-10-05T08:24:11.365+0100 [mongosMain] connection accepted from 172.28.0.164:58204 #1430899 (400 connections now open) 2015-10-05T08:24:11.367+0100 [conn1430898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:11.368+0100 [conn1430899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:13.031+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:24:13.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:24:14.048+0100 [conn1430296] end connection 172.28.0.163:63481 (399 connections now open) 2015-10-05T08:24:14.048+0100 [conn1430314] end connection 172.28.0.163:63522 (398 connections now open) 2015-10-05T08:24:14.049+0100 [mongosMain] connection accepted from 172.28.0.163:65218 #1430900 (399 connections now open) 2015-10-05T08:24:14.049+0100 [mongosMain] connection accepted from 172.28.0.163:65219 #1430901 (400 connections now open) 2015-10-05T08:24:14.050+0100 [conn1430900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:14.050+0100 [conn1430901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:15.029+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:24:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:24:18.056+0100 [conn1430546] end connection 172.28.0.163:64207 (399 connections now open) 2015-10-05T08:24:18.058+0100 [mongosMain] connection accepted from 172.28.0.163:65226 #1430902 (400 connections now open) 2015-10-05T08:24:18.059+0100 [conn1430902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:19.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225a35703b51053edeba0 2015-10-05T08:24:19.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:24:19.802+0100 [conn1430540] end connection 172.28.0.164:57178 (399 connections now open) 2015-10-05T08:24:19.803+0100 [mongosMain] connection accepted from 172.28.0.164:58211 #1430903 (400 connections now open) 2015-10-05T08:24:19.805+0100 [conn1430903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:21.378+0100 [conn1430505] end connection 172.28.0.164:57100 (399 connections now open) 2015-10-05T08:24:21.378+0100 [conn1430310] end connection 172.28.0.164:56484 (398 connections now open) 2015-10-05T08:24:21.379+0100 [mongosMain] connection accepted from 172.28.0.164:58218 #1430904 (399 connections now open) 2015-10-05T08:24:21.380+0100 [mongosMain] connection accepted from 172.28.0.164:58219 #1430905 (400 connections now open) 2015-10-05T08:24:21.381+0100 [conn1430904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:21.381+0100 [conn1430905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:24.063+0100 [conn1430340] end connection 172.28.0.163:63594 (399 connections now open) 2015-10-05T08:24:24.063+0100 [conn1430289] end connection 172.28.0.163:63472 (399 connections now open) 2015-10-05T08:24:24.065+0100 [mongosMain] connection accepted from 172.28.0.163:65229 #1430906 (399 connections now open) 2015-10-05T08:24:24.065+0100 [mongosMain] connection accepted from 172.28.0.163:65230 #1430907 (400 connections now open) 2015-10-05T08:24:24.066+0100 [conn1430906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:24.066+0100 [conn1430907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:28.345+0100 [mongosMain] connection accepted from 127.0.0.1:65234 #1430908 (401 connections now open) 2015-10-05T08:24:28.347+0100 [conn1430908] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:28.352+0100 [conn1430908] end connection 127.0.0.1:65234 (400 connections now open) 2015-10-05T08:24:29.818+0100 [conn1430554] end connection 172.28.0.164:57207 (399 connections now open) 2015-10-05T08:24:29.819+0100 [mongosMain] connection accepted from 172.28.0.164:58232 #1430909 (400 connections now open) 2015-10-05T08:24:29.820+0100 [conn1430909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:31.379+0100 [conn1430510] end connection 172.28.0.164:57119 (399 connections now open) 2015-10-05T08:24:31.379+0100 [conn1430317] end connection 172.28.0.164:56513 (399 connections now open) 2015-10-05T08:24:31.380+0100 [mongosMain] connection accepted from 172.28.0.164:58236 #1430910 (399 connections now open) 2015-10-05T08:24:31.380+0100 [mongosMain] connection accepted from 172.28.0.164:58237 #1430911 (400 connections now open) 2015-10-05T08:24:31.381+0100 [conn1430910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:31.382+0100 [conn1430911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:34.063+0100 [conn1430413] end connection 172.28.0.163:63773 (399 connections now open) 2015-10-05T08:24:34.063+0100 [conn1430013] end connection 172.28.0.163:62513 (398 connections now open) 2015-10-05T08:24:34.065+0100 [mongosMain] connection accepted from 172.28.0.163:65235 #1430912 (399 connections now open) 2015-10-05T08:24:34.065+0100 [mongosMain] connection accepted from 172.28.0.163:65236 #1430913 (400 connections now open) 2015-10-05T08:24:34.066+0100 [conn1430912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:34.066+0100 [conn1430913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:37.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225b55703b51053eded25 2015-10-05T08:24:38.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:24:38.072+0100 [conn1430552] end connection 172.28.0.163:64226 (399 connections now open) 2015-10-05T08:24:38.073+0100 [mongosMain] connection accepted from 172.28.0.163:65241 #1430914 (400 connections now open) 2015-10-05T08:24:38.075+0100 [conn1430914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:39.505+0100 [mongosMain] connection accepted from 127.0.0.1:65243 #1430915 (401 connections now open) 2015-10-05T08:24:39.508+0100 [conn1430915] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:39.512+0100 [conn1430915] end connection 127.0.0.1:65243 (400 connections now open) 2015-10-05T08:24:39.833+0100 [conn1430561] end connection 172.28.0.164:57234 (399 connections now open) 2015-10-05T08:24:39.837+0100 [mongosMain] connection accepted from 172.28.0.164:58256 #1430916 (400 connections now open) 2015-10-05T08:24:39.839+0100 [conn1430916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:41.394+0100 [conn1430536] end connection 172.28.0.164:57175 (399 connections now open) 2015-10-05T08:24:41.394+0100 [conn1430528] end connection 172.28.0.164:57159 (398 connections now open) 2015-10-05T08:24:41.395+0100 [mongosMain] connection accepted from 172.28.0.164:58262 #1430917 (399 connections now open) 2015-10-05T08:24:41.396+0100 [mongosMain] connection accepted from 172.28.0.164:58260 #1430918 (400 connections now open) 2015-10-05T08:24:41.397+0100 [conn1430918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:41.397+0100 [conn1430917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:44.079+0100 [conn1430271] end connection 172.28.0.163:63412 (399 connections now open) 2015-10-05T08:24:44.079+0100 [conn1430408] end connection 172.28.0.163:63765 (399 connections now open) 2015-10-05T08:24:44.080+0100 [mongosMain] connection accepted from 172.28.0.163:65252 #1430919 (399 connections now open) 2015-10-05T08:24:44.080+0100 [mongosMain] connection accepted from 172.28.0.163:65253 #1430920 (400 connections now open) 2015-10-05T08:24:44.081+0100 [conn1430919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:44.081+0100 [conn1430920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:45.311+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:24:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:24:48.088+0100 [conn1430566] end connection 172.28.0.163:64247 (399 connections now open) 2015-10-05T08:24:48.089+0100 [mongosMain] connection accepted from 172.28.0.163:65261 #1430921 (400 connections now open) 2015-10-05T08:24:48.091+0100 [conn1430921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:49.848+0100 [conn1430568] end connection 172.28.0.164:57255 (399 connections now open) 2015-10-05T08:24:49.849+0100 [mongosMain] connection accepted from 172.28.0.164:58278 #1430922 (400 connections now open) 2015-10-05T08:24:49.850+0100 [conn1430922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:50.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225c25703b51053edee2d 2015-10-05T08:24:50.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:24:51.394+0100 [conn1430506] end connection 172.28.0.164:57101 (399 connections now open) 2015-10-05T08:24:51.395+0100 [conn1430543] end connection 172.28.0.164:57191 (398 connections now open) 2015-10-05T08:24:51.396+0100 [mongosMain] connection accepted from 172.28.0.164:58283 #1430923 (399 connections now open) 2015-10-05T08:24:51.396+0100 [mongosMain] connection accepted from 172.28.0.164:58284 #1430924 (400 connections now open) 2015-10-05T08:24:51.405+0100 [conn1430924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:51.407+0100 [conn1430923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:54.094+0100 [conn1430350] end connection 172.28.0.163:63612 (399 connections now open) 2015-10-05T08:24:54.095+0100 [conn1430372] end connection 172.28.0.163:63678 (399 connections now open) 2015-10-05T08:24:54.096+0100 [mongosMain] connection accepted from 172.28.0.163:65270 #1430925 (399 connections now open) 2015-10-05T08:24:54.096+0100 [mongosMain] connection accepted from 172.28.0.163:65271 #1430926 (400 connections now open) 2015-10-05T08:24:54.097+0100 [conn1430925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:54.098+0100 [conn1430926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:57.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225c85703b51053edeea4 2015-10-05T08:24:58.091+0100 [conn1430574] end connection 172.28.0.163:64263 (399 connections now open) 2015-10-05T08:24:58.092+0100 [mongosMain] connection accepted from 172.28.0.163:65280 #1430927 (400 connections now open) 2015-10-05T08:24:58.094+0100 [conn1430927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:24:58.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:24:59.849+0100 [conn1430576] end connection 172.28.0.164:57277 (399 connections now open) 2015-10-05T08:24:59.850+0100 [mongosMain] connection accepted from 172.28.0.164:58291 #1430928 (400 connections now open) 2015-10-05T08:24:59.852+0100 [conn1430928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:01.410+0100 [conn1430287] end connection 172.28.0.164:56427 (399 connections now open) 2015-10-05T08:25:01.410+0100 [conn1430520] end connection 172.28.0.164:57140 (399 connections now open) 2015-10-05T08:25:01.411+0100 [mongosMain] connection accepted from 172.28.0.164:58304 #1430929 (399 connections now open) 2015-10-05T08:25:01.412+0100 [mongosMain] connection accepted from 172.28.0.164:58305 #1430930 (400 connections now open) 2015-10-05T08:25:01.414+0100 [conn1430930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:01.415+0100 [conn1430929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:04.094+0100 [conn1430458] end connection 172.28.0.163:63943 (399 connections now open) 2015-10-05T08:25:04.095+0100 [conn1430349] end connection 172.28.0.163:63608 (399 connections now open) 2015-10-05T08:25:04.095+0100 [mongosMain] connection accepted from 172.28.0.163:65303 #1430931 (399 connections now open) 2015-10-05T08:25:04.096+0100 [mongosMain] connection accepted from 172.28.0.163:65304 #1430932 (400 connections now open) 2015-10-05T08:25:04.096+0100 [conn1430931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:04.097+0100 [conn1430932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:05.430+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:25:05.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:25:08.104+0100 [conn1430581] end connection 172.28.0.163:64283 (399 connections now open) 2015-10-05T08:25:08.106+0100 [mongosMain] connection accepted from 172.28.0.163:65313 #1430933 (400 connections now open) 2015-10-05T08:25:08.107+0100 [conn1430933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:11.410+0100 [conn1430500] end connection 172.28.0.164:57092 (399 connections now open) 2015-10-05T08:25:11.410+0100 [mongosMain] connection accepted from 172.28.0.164:58314 #1430934 (400 connections now open) 2015-10-05T08:25:11.412+0100 [conn1430934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:11.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225d75703b51053edef8a 2015-10-05T08:25:11.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:25:14.110+0100 [conn1430041] end connection 172.28.0.163:62607 (399 connections now open) 2015-10-05T08:25:14.110+0100 [conn1430403] end connection 172.28.0.163:63755 (399 connections now open) 2015-10-05T08:25:14.111+0100 [mongosMain] connection accepted from 172.28.0.163:65320 #1430935 (399 connections now open) 2015-10-05T08:25:14.112+0100 [mongosMain] connection accepted from 172.28.0.163:65321 #1430936 (400 connections now open) 2015-10-05T08:25:14.113+0100 [conn1430935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:14.113+0100 [conn1430936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:15.453+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:25:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:25:18.104+0100 [conn1430588] end connection 172.28.0.163:64313 (399 connections now open) 2015-10-05T08:25:18.106+0100 [mongosMain] connection accepted from 172.28.0.163:65330 #1430937 (400 connections now open) 2015-10-05T08:25:18.107+0100 [conn1430937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:19.865+0100 [conn1430590] end connection 172.28.0.164:57326 (399 connections now open) 2015-10-05T08:25:19.866+0100 [mongosMain] connection accepted from 172.28.0.164:58321 #1430938 (400 connections now open) 2015-10-05T08:25:19.867+0100 [conn1430938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:21.425+0100 [conn1430235] end connection 172.28.0.164:56284 (399 connections now open) 2015-10-05T08:25:21.425+0100 [conn1430573] end connection 172.28.0.164:57268 (399 connections now open) 2015-10-05T08:25:21.426+0100 [mongosMain] connection accepted from 172.28.0.164:58324 #1430939 (399 connections now open) 2015-10-05T08:25:21.427+0100 [mongosMain] connection accepted from 172.28.0.164:58325 #1430940 (400 connections now open) 2015-10-05T08:25:21.428+0100 [conn1430939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:21.428+0100 [conn1430940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:24.111+0100 [conn1430534] end connection 172.28.0.163:64164 (399 connections now open) 2015-10-05T08:25:24.111+0100 [conn1430549] end connection 172.28.0.163:64214 (399 connections now open) 2015-10-05T08:25:24.113+0100 [mongosMain] connection accepted from 172.28.0.163:65334 #1430941 (399 connections now open) 2015-10-05T08:25:24.113+0100 [mongosMain] connection accepted from 172.28.0.163:65335 #1430942 (400 connections now open) 2015-10-05T08:25:24.114+0100 [conn1430941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:24.114+0100 [conn1430942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:24.461+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561225e23b0f755fc3341225') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444029923681), why: "doing balance round", ts: ObjectId('561225e35703b51053edf042') } } gle1: { lastOp: Timestamp 1444029924000|2, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1444029911000|8, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } 2015-10-05T08:25:24.464+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1441718816:41' not propagated. 2015-10-05T08:25:24.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:25:28.119+0100 [conn1430596] end connection 172.28.0.163:64332 (399 connections now open) 2015-10-05T08:25:28.120+0100 [mongosMain] connection accepted from 172.28.0.163:65343 #1430943 (400 connections now open) 2015-10-05T08:25:28.121+0100 [conn1430943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:28.264+0100 [mongosMain] connection accepted from 127.0.0.1:65345 #1430944 (401 connections now open) 2015-10-05T08:25:28.267+0100 [conn1430944] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:28.272+0100 [conn1430944] end connection 127.0.0.1:65345 (400 connections now open) 2015-10-05T08:25:29.288+0100 [conn1430553] end connection 172.28.0.164:57204 (399 connections now open) 2015-10-05T08:25:29.289+0100 [mongosMain] connection accepted from 172.28.0.164:58336 #1430945 (400 connections now open) 2015-10-05T08:25:29.291+0100 [conn1430945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:29.881+0100 [conn1430583] end connection 172.28.0.164:57292 (399 connections now open) 2015-10-05T08:25:29.882+0100 [mongosMain] connection accepted from 172.28.0.164:58339 #1430946 (400 connections now open) 2015-10-05T08:25:29.884+0100 [conn1430946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:31.427+0100 [conn1430550] end connection 172.28.0.164:57201 (399 connections now open) 2015-10-05T08:25:31.427+0100 [conn1430579] end connection 172.28.0.164:57288 (399 connections now open) 2015-10-05T08:25:31.428+0100 [mongosMain] connection accepted from 172.28.0.164:58343 #1430947 (399 connections now open) 2015-10-05T08:25:31.429+0100 [mongosMain] connection accepted from 172.28.0.164:58342 #1430948 (400 connections now open) 2015-10-05T08:25:31.431+0100 [conn1430947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:31.431+0100 [conn1430948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:31.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561225ea5703b51053edf0a8 2015-10-05T08:25:31.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:25:34.126+0100 [conn1430517] end connection 172.28.0.163:64131 (399 connections now open) 2015-10-05T08:25:34.126+0100 [conn1430282] end connection 172.28.0.163:63457 (399 connections now open) 2015-10-05T08:25:34.127+0100 [mongosMain] connection accepted from 172.28.0.163:65349 #1430949 (399 connections now open) 2015-10-05T08:25:34.127+0100 [mongosMain] connection accepted from 172.28.0.163:65350 #1430950 (400 connections now open) 2015-10-05T08:25:34.128+0100 [conn1430949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:34.128+0100 [conn1430950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:39.287+0100 [mongosMain] connection accepted from 127.0.0.1:65357 #1430951 (401 connections now open) 2015-10-05T08:25:39.288+0100 [conn1430567] end connection 172.28.0.164:57252 (399 connections now open) 2015-10-05T08:25:39.289+0100 [mongosMain] connection accepted from 172.28.0.164:58356 #1430952 (401 connections now open) 2015-10-05T08:25:39.290+0100 [conn1430952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:39.291+0100 [conn1430951] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:39.296+0100 [conn1430951] end connection 127.0.0.1:65357 (400 connections now open) 2015-10-05T08:25:39.896+0100 [conn1430598] end connection 172.28.0.164:57338 (399 connections now open) 2015-10-05T08:25:39.898+0100 [mongosMain] connection accepted from 172.28.0.164:58359 #1430953 (400 connections now open) 2015-10-05T08:25:39.900+0100 [conn1430953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:41.442+0100 [conn1430587] end connection 172.28.0.164:57319 (399 connections now open) 2015-10-05T08:25:41.442+0100 [conn1430353] end connection 172.28.0.164:56596 (398 connections now open) 2015-10-05T08:25:41.443+0100 [mongosMain] connection accepted from 172.28.0.164:58365 #1430954 (399 connections now open) 2015-10-05T08:25:41.443+0100 [mongosMain] connection accepted from 172.28.0.164:58364 #1430955 (400 connections now open) 2015-10-05T08:25:41.445+0100 [conn1430954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:41.445+0100 [conn1430955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:44.128+0100 [conn1430397] end connection 172.28.0.163:63731 (399 connections now open) 2015-10-05T08:25:44.129+0100 [mongosMain] connection accepted from 172.28.0.163:65362 #1430956 (400 connections now open) 2015-10-05T08:25:44.130+0100 [conn1430526] end connection 172.28.0.163:64142 (399 connections now open) 2015-10-05T08:25:44.130+0100 [conn1430956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:44.131+0100 [mongosMain] connection accepted from 172.28.0.163:65365 #1430957 (400 connections now open) 2015-10-05T08:25:44.132+0100 [conn1430957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:45.584+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:25:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:25:45.585+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1441718816:41 2015-10-05T08:25:45.653+0100 [LockPinger] handled late remove of old distributed lock with ts 561225e35703b51053edf042 2015-10-05T08:25:47.558+0100 [conn1430521] end connection 172.28.0.163:64136 (399 connections now open) 2015-10-05T08:25:47.559+0100 [mongosMain] connection accepted from 172.28.0.163:65370 #1430958 (400 connections now open) 2015-10-05T08:25:47.560+0100 [conn1430958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:48.135+0100 [conn1430603] end connection 172.28.0.163:64342 (399 connections now open) 2015-10-05T08:25:48.136+0100 [mongosMain] connection accepted from 172.28.0.163:65372 #1430959 (400 connections now open) 2015-10-05T08:25:48.138+0100 [conn1430959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:49.912+0100 [conn1430606] end connection 172.28.0.164:57358 (399 connections now open) 2015-10-05T08:25:49.913+0100 [mongosMain] connection accepted from 172.28.0.164:58376 #1430960 (400 connections now open) 2015-10-05T08:25:49.914+0100 [conn1430960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:50.695+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:25:50.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:25:51.458+0100 [conn1430558] end connection 172.28.0.164:57228 (399 connections now open) 2015-10-05T08:25:51.458+0100 [conn1430432] end connection 172.28.0.164:56847 (398 connections now open) 2015-10-05T08:25:51.459+0100 [mongosMain] connection accepted from 172.28.0.164:58380 #1430961 (399 connections now open) 2015-10-05T08:25:51.460+0100 [mongosMain] connection accepted from 172.28.0.164:58381 #1430962 (400 connections now open) 2015-10-05T08:25:51.461+0100 [conn1430961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:51.461+0100 [conn1430962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:54.142+0100 [conn1430379] end connection 172.28.0.163:63691 (399 connections now open) 2015-10-05T08:25:54.143+0100 [mongosMain] connection accepted from 172.28.0.163:65378 #1430963 (400 connections now open) 2015-10-05T08:25:54.144+0100 [conn1430541] end connection 172.28.0.163:64191 (399 connections now open) 2015-10-05T08:25:54.145+0100 [conn1430963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:54.145+0100 [mongosMain] connection accepted from 172.28.0.163:65380 #1430964 (400 connections now open) 2015-10-05T08:25:54.146+0100 [conn1430964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:58.136+0100 [conn1430611] end connection 172.28.0.163:64360 (399 connections now open) 2015-10-05T08:25:58.137+0100 [mongosMain] connection accepted from 172.28.0.163:65383 #1430965 (400 connections now open) 2015-10-05T08:25:58.138+0100 [conn1430965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:25:59.929+0100 [conn1430612] end connection 172.28.0.164:57375 (399 connections now open) 2015-10-05T08:25:59.930+0100 [mongosMain] connection accepted from 172.28.0.164:58389 #1430966 (400 connections now open) 2015-10-05T08:25:59.932+0100 [conn1430966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:01.458+0100 [conn1430564] end connection 172.28.0.164:57247 (399 connections now open) 2015-10-05T08:26:01.458+0100 [conn1430544] end connection 172.28.0.164:57192 (399 connections now open) 2015-10-05T08:26:01.459+0100 [mongosMain] connection accepted from 172.28.0.164:58396 #1430967 (399 connections now open) 2015-10-05T08:26:01.459+0100 [mongosMain] connection accepted from 172.28.0.164:58397 #1430968 (400 connections now open) 2015-10-05T08:26:01.461+0100 [conn1430968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:01.461+0100 [conn1430967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:04.143+0100 [conn1430577] end connection 172.28.0.163:64274 (399 connections now open) 2015-10-05T08:26:04.143+0100 [conn1430527] end connection 172.28.0.163:64143 (399 connections now open) 2015-10-05T08:26:04.144+0100 [mongosMain] connection accepted from 172.28.0.163:65409 #1430969 (399 connections now open) 2015-10-05T08:26:04.145+0100 [mongosMain] connection accepted from 172.28.0.163:65410 #1430970 (400 connections now open) 2015-10-05T08:26:04.145+0100 [conn1430969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:04.146+0100 [conn1430970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:07.574+0100 [conn1430512] end connection 172.28.0.163:64125 (399 connections now open) 2015-10-05T08:26:07.576+0100 [mongosMain] connection accepted from 172.28.0.163:65418 #1430971 (400 connections now open) 2015-10-05T08:26:07.576+0100 [conn1430971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:08.150+0100 [conn1430619] end connection 172.28.0.163:64379 (399 connections now open) 2015-10-05T08:26:08.151+0100 [mongosMain] connection accepted from 172.28.0.163:65421 #1430972 (400 connections now open) 2015-10-05T08:26:08.152+0100 [conn1430972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:09.303+0100 [conn1430597] end connection 172.28.0.164:57336 (399 connections now open) 2015-10-05T08:26:09.305+0100 [mongosMain] connection accepted from 172.28.0.164:58402 #1430973 (400 connections now open) 2015-10-05T08:26:09.307+0100 [conn1430973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:09.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226115703b51053edf30f 2015-10-05T08:26:09.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:26:09.927+0100 [conn1430620] end connection 172.28.0.164:57396 (399 connections now open) 2015-10-05T08:26:09.928+0100 [mongosMain] connection accepted from 172.28.0.164:58404 #1430974 (400 connections now open) 2015-10-05T08:26:09.930+0100 [conn1430974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:11.458+0100 [conn1430557] end connection 172.28.0.164:57226 (399 connections now open) 2015-10-05T08:26:11.458+0100 [conn1430275] end connection 172.28.0.164:56392 (398 connections now open) 2015-10-05T08:26:11.459+0100 [mongosMain] connection accepted from 172.28.0.164:58408 #1430975 (399 connections now open) 2015-10-05T08:26:11.460+0100 [mongosMain] connection accepted from 172.28.0.164:58407 #1430976 (400 connections now open) 2015-10-05T08:26:11.461+0100 [conn1430975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:11.462+0100 [conn1430976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:14.158+0100 [conn1430542] end connection 172.28.0.163:64192 (399 connections now open) 2015-10-05T08:26:14.158+0100 [conn1430584] end connection 172.28.0.163:64298 (399 connections now open) 2015-10-05T08:26:14.159+0100 [mongosMain] connection accepted from 172.28.0.163:65428 #1430977 (399 connections now open) 2015-10-05T08:26:14.159+0100 [mongosMain] connection accepted from 172.28.0.163:65429 #1430978 (400 connections now open) 2015-10-05T08:26:14.160+0100 [conn1430977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:14.160+0100 [conn1430978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:15.933+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:26:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:26:17.589+0100 [conn1430479] end connection 172.28.0.163:64016 (399 connections now open) 2015-10-05T08:26:17.590+0100 [mongosMain] connection accepted from 172.28.0.163:65434 #1430979 (400 connections now open) 2015-10-05T08:26:17.592+0100 [conn1430979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:18.167+0100 [conn1430623] end connection 172.28.0.163:64401 (399 connections now open) 2015-10-05T08:26:18.168+0100 [mongosMain] connection accepted from 172.28.0.163:65437 #1430980 (400 connections now open) 2015-10-05T08:26:18.170+0100 [conn1430980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:19.320+0100 [conn1430490] end connection 172.28.0.164:57038 (399 connections now open) 2015-10-05T08:26:19.321+0100 [mongosMain] connection accepted from 172.28.0.164:58415 #1430981 (400 connections now open) 2015-10-05T08:26:19.323+0100 [conn1430981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:19.943+0100 [conn1430624] end connection 172.28.0.164:57404 (399 connections now open) 2015-10-05T08:26:19.944+0100 [mongosMain] connection accepted from 172.28.0.164:58418 #1430982 (400 connections now open) 2015-10-05T08:26:19.946+0100 [conn1430982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:21.780+0100 [conn1430551] end connection 172.28.0.164:57202 (399 connections now open) 2015-10-05T08:26:21.781+0100 [conn1430594] end connection 172.28.0.164:57331 (398 connections now open) 2015-10-05T08:26:21.783+0100 [mongosMain] connection accepted from 172.28.0.164:58423 #1430983 (399 connections now open) 2015-10-05T08:26:21.785+0100 [mongosMain] connection accepted from 172.28.0.164:58424 #1430984 (400 connections now open) 2015-10-05T08:26:21.785+0100 [conn1430983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:21.786+0100 [conn1430984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:21.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612261d5703b51053edf3b8 2015-10-05T08:26:22.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:26:24.173+0100 [conn1430470] end connection 172.28.0.163:63969 (399 connections now open) 2015-10-05T08:26:24.173+0100 [conn1430556] end connection 172.28.0.163:64232 (398 connections now open) 2015-10-05T08:26:24.174+0100 [mongosMain] connection accepted from 172.28.0.163:65444 #1430985 (399 connections now open) 2015-10-05T08:26:24.175+0100 [mongosMain] connection accepted from 172.28.0.163:65445 #1430986 (400 connections now open) 2015-10-05T08:26:24.175+0100 [conn1430985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:24.176+0100 [conn1430986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:28.169+0100 [conn1430629] end connection 172.28.0.163:64433 (399 connections now open) 2015-10-05T08:26:28.170+0100 [mongosMain] connection accepted from 172.28.0.163:65448 #1430987 (400 connections now open) 2015-10-05T08:26:28.171+0100 [conn1430987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:28.601+0100 [mongosMain] connection accepted from 127.0.0.1:65450 #1430988 (401 connections now open) 2015-10-05T08:26:28.603+0100 [conn1430988] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:28.608+0100 [conn1430988] end connection 127.0.0.1:65450 (400 connections now open) 2015-10-05T08:26:29.335+0100 [conn1430559] end connection 172.28.0.164:57230 (399 connections now open) 2015-10-05T08:26:29.337+0100 [mongosMain] connection accepted from 172.28.0.164:58436 #1430989 (400 connections now open) 2015-10-05T08:26:29.339+0100 [conn1430989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:29.959+0100 [conn1430630] end connection 172.28.0.164:57423 (399 connections now open) 2015-10-05T08:26:29.960+0100 [mongosMain] connection accepted from 172.28.0.164:58439 #1430990 (400 connections now open) 2015-10-05T08:26:29.962+0100 [conn1430990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:31.740+0100 [conn1430601] end connection 172.28.0.164:57350 (399 connections now open) 2015-10-05T08:26:31.743+0100 [mongosMain] connection accepted from 172.28.0.164:58446 #1430991 (400 connections now open) 2015-10-05T08:26:31.745+0100 [conn1430565] end connection 172.28.0.164:57246 (399 connections now open) 2015-10-05T08:26:31.746+0100 [conn1430991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:31.747+0100 [mongosMain] connection accepted from 172.28.0.164:58447 #1430992 (400 connections now open) 2015-10-05T08:26:31.749+0100 [conn1430992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:34.173+0100 [conn1430562] end connection 172.28.0.163:64239 (399 connections now open) 2015-10-05T08:26:34.175+0100 [mongosMain] connection accepted from 172.28.0.163:65453 #1430993 (400 connections now open) 2015-10-05T08:26:34.176+0100 [conn1430993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:37.605+0100 [conn1430488] end connection 172.28.0.163:64030 (399 connections now open) 2015-10-05T08:26:37.607+0100 [mongosMain] connection accepted from 172.28.0.163:65455 #1430994 (400 connections now open) 2015-10-05T08:26:37.608+0100 [conn1430994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:38.182+0100 [conn1430635] end connection 172.28.0.163:64447 (399 connections now open) 2015-10-05T08:26:38.184+0100 [mongosMain] connection accepted from 172.28.0.163:65457 #1430995 (400 connections now open) 2015-10-05T08:26:38.185+0100 [conn1430995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:39.324+0100 [mongosMain] connection accepted from 127.0.0.1:65459 #1430996 (401 connections now open) 2015-10-05T08:26:39.327+0100 [conn1430996] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:39.331+0100 [conn1430996] end connection 127.0.0.1:65459 (400 connections now open) 2015-10-05T08:26:39.351+0100 [conn1430604] end connection 172.28.0.164:57354 (399 connections now open) 2015-10-05T08:26:39.353+0100 [mongosMain] connection accepted from 172.28.0.164:58459 #1430997 (400 connections now open) 2015-10-05T08:26:39.355+0100 [conn1430997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:39.959+0100 [conn1430636] end connection 172.28.0.164:57434 (399 connections now open) 2015-10-05T08:26:39.961+0100 [mongosMain] connection accepted from 172.28.0.164:58461 #1430998 (400 connections now open) 2015-10-05T08:26:39.963+0100 [conn1430998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:40.411+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226305703b51053edf4c9 2015-10-05T08:26:40.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:26:41.762+0100 [conn1430535] end connection 172.28.0.164:57174 (399 connections now open) 2015-10-05T08:26:41.762+0100 [conn1430409] end connection 172.28.0.164:56744 (399 connections now open) 2015-10-05T08:26:41.767+0100 [mongosMain] connection accepted from 172.28.0.164:58464 #1430999 (399 connections now open) 2015-10-05T08:26:41.767+0100 [mongosMain] connection accepted from 172.28.0.164:58463 #1431000 (400 connections now open) 2015-10-05T08:26:41.769+0100 [conn1430999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:41.769+0100 [conn1431000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:44.189+0100 [conn1430578] end connection 172.28.0.163:64273 (399 connections now open) 2015-10-05T08:26:44.191+0100 [mongosMain] connection accepted from 172.28.0.163:65464 #1431001 (400 connections now open) 2015-10-05T08:26:44.192+0100 [conn1431001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:47.661+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:26:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:26:48.183+0100 [conn1430641] end connection 172.28.0.163:64457 (399 connections now open) 2015-10-05T08:26:48.184+0100 [mongosMain] connection accepted from 172.28.0.163:65471 #1431002 (400 connections now open) 2015-10-05T08:26:48.185+0100 [conn1431002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:49.366+0100 [conn1430547] end connection 172.28.0.164:57194 (399 connections now open) 2015-10-05T08:26:49.368+0100 [mongosMain] connection accepted from 172.28.0.164:58474 #1431003 (400 connections now open) 2015-10-05T08:26:49.370+0100 [conn1431003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:49.976+0100 [conn1430643] end connection 172.28.0.164:57451 (399 connections now open) 2015-10-05T08:26:49.977+0100 [mongosMain] connection accepted from 172.28.0.164:58476 #1431004 (400 connections now open) 2015-10-05T08:26:49.978+0100 [conn1431004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:51.769+0100 [conn1430572] end connection 172.28.0.164:57267 (399 connections now open) 2015-10-05T08:26:51.770+0100 [conn1430610] end connection 172.28.0.164:57367 (398 connections now open) 2015-10-05T08:26:51.770+0100 [mongosMain] connection accepted from 172.28.0.164:58479 #1431005 (399 connections now open) 2015-10-05T08:26:51.770+0100 [mongosMain] connection accepted from 172.28.0.164:58480 #1431006 (400 connections now open) 2015-10-05T08:26:51.771+0100 [conn1431005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:51.771+0100 [conn1431006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:54.189+0100 [conn1430571] end connection 172.28.0.163:64253 (399 connections now open) 2015-10-05T08:26:54.190+0100 [mongosMain] connection accepted from 172.28.0.163:65476 #1431007 (400 connections now open) 2015-10-05T08:26:54.191+0100 [conn1431007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:55.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612263c5703b51053edf595 2015-10-05T08:26:56.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:26:58.197+0100 [conn1430649] end connection 172.28.0.163:64470 (399 connections now open) 2015-10-05T08:26:58.199+0100 [mongosMain] connection accepted from 172.28.0.163:65480 #1431008 (400 connections now open) 2015-10-05T08:26:58.200+0100 [conn1431008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:59.383+0100 [conn1430523] end connection 172.28.0.164:57145 (399 connections now open) 2015-10-05T08:26:59.384+0100 [mongosMain] connection accepted from 172.28.0.164:58491 #1431009 (400 connections now open) 2015-10-05T08:26:59.385+0100 [conn1431009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:26:59.991+0100 [conn1430651] end connection 172.28.0.164:57472 (399 connections now open) 2015-10-05T08:26:59.993+0100 [mongosMain] connection accepted from 172.28.0.164:58495 #1431010 (400 connections now open) 2015-10-05T08:26:59.995+0100 [conn1431010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:01.785+0100 [conn1430618] end connection 172.28.0.164:57391 (399 connections now open) 2015-10-05T08:27:01.786+0100 [conn1430617] end connection 172.28.0.164:57390 (398 connections now open) 2015-10-05T08:27:01.787+0100 [mongosMain] connection accepted from 172.28.0.164:58508 #1431011 (399 connections now open) 2015-10-05T08:27:01.787+0100 [mongosMain] connection accepted from 172.28.0.164:58509 #1431012 (400 connections now open) 2015-10-05T08:27:01.789+0100 [conn1431011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:01.789+0100 [conn1431012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:02.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226465703b51053edf623 2015-10-05T08:27:02.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:04.205+0100 [conn1430591] end connection 172.28.0.163:64320 (399 connections now open) 2015-10-05T08:27:04.205+0100 [conn1430244] end connection 172.28.0.163:63344 (399 connections now open) 2015-10-05T08:27:04.206+0100 [mongosMain] connection accepted from 172.28.0.163:65503 #1431013 (399 connections now open) 2015-10-05T08:27:04.206+0100 [mongosMain] connection accepted from 172.28.0.163:65504 #1431014 (400 connections now open) 2015-10-05T08:27:04.207+0100 [conn1431013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:04.207+0100 [conn1431014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:07.637+0100 [conn1430616] end connection 172.28.0.163:64376 (399 connections now open) 2015-10-05T08:27:07.638+0100 [mongosMain] connection accepted from 172.28.0.163:65511 #1431015 (400 connections now open) 2015-10-05T08:27:07.638+0100 [conn1431015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:08.198+0100 [conn1430656] end connection 172.28.0.163:64490 (399 connections now open) 2015-10-05T08:27:08.199+0100 [mongosMain] connection accepted from 172.28.0.163:65515 #1431016 (400 connections now open) 2015-10-05T08:27:08.200+0100 [conn1431016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:09.398+0100 [conn1430575] end connection 172.28.0.164:57274 (399 connections now open) 2015-10-05T08:27:09.399+0100 [mongosMain] connection accepted from 172.28.0.164:58512 #1431017 (400 connections now open) 2015-10-05T08:27:09.402+0100 [conn1431017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:09.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612264c5703b51053edf6b1 2015-10-05T08:27:09.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:10.006+0100 [conn1430658] end connection 172.28.0.164:57490 (399 connections now open) 2015-10-05T08:27:10.007+0100 [mongosMain] connection accepted from 172.28.0.164:58514 #1431018 (400 connections now open) 2015-10-05T08:27:10.008+0100 [conn1431018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:11.786+0100 [conn1430593] end connection 172.28.0.164:57330 (399 connections now open) 2015-10-05T08:27:11.786+0100 [conn1430294] end connection 172.28.0.164:56446 (398 connections now open) 2015-10-05T08:27:11.787+0100 [mongosMain] connection accepted from 172.28.0.164:58516 #1431019 (399 connections now open) 2015-10-05T08:27:11.787+0100 [mongosMain] connection accepted from 172.28.0.164:58517 #1431020 (400 connections now open) 2015-10-05T08:27:11.789+0100 [conn1431019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:11.789+0100 [conn1431020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:14.213+0100 [conn1430585] end connection 172.28.0.163:64299 (399 connections now open) 2015-10-05T08:27:14.213+0100 [conn1430555] end connection 172.28.0.163:64231 (399 connections now open) 2015-10-05T08:27:14.214+0100 [mongosMain] connection accepted from 172.28.0.163:65523 #1431021 (399 connections now open) 2015-10-05T08:27:14.215+0100 [mongosMain] connection accepted from 172.28.0.163:65522 #1431022 (400 connections now open) 2015-10-05T08:27:14.215+0100 [conn1431021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:14.216+0100 [conn1431022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:15.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226535703b51053edf6fe 2015-10-05T08:27:16.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:17.638+0100 [conn1430595] end connection 172.28.0.163:64330 (399 connections now open) 2015-10-05T08:27:17.639+0100 [mongosMain] connection accepted from 172.28.0.163:65528 #1431023 (400 connections now open) 2015-10-05T08:27:17.640+0100 [conn1431023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:17.940+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:27:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:27:18.214+0100 [conn1430662] end connection 172.28.0.163:64504 (399 connections now open) 2015-10-05T08:27:18.215+0100 [mongosMain] connection accepted from 172.28.0.163:65530 #1431024 (400 connections now open) 2015-10-05T08:27:18.217+0100 [conn1431024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:19.414+0100 [conn1430582] end connection 172.28.0.164:57290 (399 connections now open) 2015-10-05T08:27:19.415+0100 [mongosMain] connection accepted from 172.28.0.164:58525 #1431025 (400 connections now open) 2015-10-05T08:27:19.419+0100 [conn1431025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:20.027+0100 [conn1430664] end connection 172.28.0.164:57501 (399 connections now open) 2015-10-05T08:27:20.028+0100 [mongosMain] connection accepted from 172.28.0.164:58527 #1431026 (400 connections now open) 2015-10-05T08:27:20.031+0100 [conn1431026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:21.801+0100 [conn1430626] end connection 172.28.0.164:57408 (399 connections now open) 2015-10-05T08:27:21.802+0100 [mongosMain] connection accepted from 172.28.0.164:58532 #1431027 (400 connections now open) 2015-10-05T08:27:21.803+0100 [conn1431027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:24.221+0100 [conn1430627] end connection 172.28.0.163:64411 (399 connections now open) 2015-10-05T08:27:24.221+0100 [conn1430640] end connection 172.28.0.163:64454 (399 connections now open) 2015-10-05T08:27:24.222+0100 [mongosMain] connection accepted from 172.28.0.163:49157 #1431028 (399 connections now open) 2015-10-05T08:27:24.223+0100 [mongosMain] connection accepted from 172.28.0.163:49158 #1431029 (400 connections now open) 2015-10-05T08:27:24.224+0100 [conn1431028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:24.224+0100 [conn1431029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:27.656+0100 [conn1430545] end connection 172.28.0.163:64204 (399 connections now open) 2015-10-05T08:27:27.659+0100 [mongosMain] connection accepted from 172.28.0.163:49160 #1431030 (400 connections now open) 2015-10-05T08:27:27.660+0100 [conn1431030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:28.232+0100 [conn1430674] end connection 172.28.0.163:64557 (399 connections now open) 2015-10-05T08:27:28.234+0100 [mongosMain] connection accepted from 172.28.0.163:49162 #1431031 (400 connections now open) 2015-10-05T08:27:28.235+0100 [conn1431031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:28.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226605703b51053edf79f 2015-10-05T08:27:28.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:29.036+0100 [mongosMain] connection accepted from 127.0.0.1:49164 #1431032 (401 connections now open) 2015-10-05T08:27:29.039+0100 [conn1431032] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:29.044+0100 [conn1431032] end connection 127.0.0.1:49164 (400 connections now open) 2015-10-05T08:27:29.429+0100 [conn1430657] end connection 172.28.0.164:57488 (399 connections now open) 2015-10-05T08:27:29.431+0100 [mongosMain] connection accepted from 172.28.0.164:58541 #1431033 (400 connections now open) 2015-10-05T08:27:29.433+0100 [conn1431033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:30.037+0100 [conn1430676] end connection 172.28.0.164:57530 (399 connections now open) 2015-10-05T08:27:30.038+0100 [mongosMain] connection accepted from 172.28.0.164:58545 #1431034 (400 connections now open) 2015-10-05T08:27:30.039+0100 [conn1431034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:31.802+0100 [conn1429978] end connection 172.28.0.164:55434 (399 connections now open) 2015-10-05T08:27:31.803+0100 [mongosMain] connection accepted from 172.28.0.164:58550 #1431035 (400 connections now open) 2015-10-05T08:27:31.804+0100 [conn1431035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:34.248+0100 [conn1430509] end connection 172.28.0.163:64120 (399 connections now open) 2015-10-05T08:27:34.249+0100 [conn1430654] end connection 172.28.0.163:64480 (399 connections now open) 2015-10-05T08:27:34.250+0100 [mongosMain] connection accepted from 172.28.0.163:49166 #1431036 (399 connections now open) 2015-10-05T08:27:34.250+0100 [mongosMain] connection accepted from 172.28.0.163:49167 #1431037 (400 connections now open) 2015-10-05T08:27:34.251+0100 [conn1431036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:34.251+0100 [conn1431037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:35.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226675703b51053edf7f6 2015-10-05T08:27:35.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:37.653+0100 [conn1430668] end connection 172.28.0.163:64538 (399 connections now open) 2015-10-05T08:27:37.654+0100 [mongosMain] connection accepted from 172.28.0.163:49170 #1431038 (400 connections now open) 2015-10-05T08:27:37.655+0100 [conn1431038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:38.230+0100 [conn1430682] end connection 172.28.0.163:64566 (399 connections now open) 2015-10-05T08:27:38.232+0100 [mongosMain] connection accepted from 172.28.0.163:49171 #1431039 (400 connections now open) 2015-10-05T08:27:38.233+0100 [conn1431039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:39.929+0100 [mongosMain] connection accepted from 127.0.0.1:49184 #1431040 (401 connections now open) 2015-10-05T08:27:39.932+0100 [conn1431040] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:39.937+0100 [conn1431040] end connection 127.0.0.1:49184 (400 connections now open) 2015-10-05T08:27:40.053+0100 [conn1430684] end connection 172.28.0.164:57551 (399 connections now open) 2015-10-05T08:27:40.054+0100 [mongosMain] connection accepted from 172.28.0.164:58561 #1431041 (400 connections now open) 2015-10-05T08:27:40.057+0100 [conn1431041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:41.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612266d5703b51053edf851 2015-10-05T08:27:42.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:44.241+0100 [conn1430592] end connection 172.28.0.163:64322 (399 connections now open) 2015-10-05T08:27:44.241+0100 [conn1430633] end connection 172.28.0.163:64438 (399 connections now open) 2015-10-05T08:27:44.242+0100 [mongosMain] connection accepted from 172.28.0.163:49204 #1431042 (399 connections now open) 2015-10-05T08:27:44.243+0100 [mongosMain] connection accepted from 172.28.0.163:49206 #1431043 (400 connections now open) 2015-10-05T08:27:44.243+0100 [conn1431042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:44.244+0100 [conn1431043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:47.701+0100 [conn1430537] end connection 172.28.0.163:64174 (399 connections now open) 2015-10-05T08:27:47.701+0100 [mongosMain] connection accepted from 172.28.0.163:49212 #1431044 (400 connections now open) 2015-10-05T08:27:47.701+0100 [conn1431044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:48.247+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:27:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:27:48.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226745703b51053edf8b1 2015-10-05T08:27:48.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:50.069+0100 [conn1430691] end connection 172.28.0.164:57570 (399 connections now open) 2015-10-05T08:27:50.070+0100 [mongosMain] connection accepted from 172.28.0.164:58574 #1431045 (400 connections now open) 2015-10-05T08:27:50.071+0100 [conn1431045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:54.252+0100 [conn1430360] end connection 172.28.0.163:63627 (399 connections now open) 2015-10-05T08:27:54.252+0100 [conn1430621] end connection 172.28.0.163:64387 (398 connections now open) 2015-10-05T08:27:54.253+0100 [mongosMain] connection accepted from 172.28.0.163:49222 #1431046 (399 connections now open) 2015-10-05T08:27:54.253+0100 [mongosMain] connection accepted from 172.28.0.163:49223 #1431047 (400 connections now open) 2015-10-05T08:27:54.254+0100 [conn1431046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:54.255+0100 [conn1431047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:54.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612267a5703b51053edf90b 2015-10-05T08:27:55.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:27:57.684+0100 [conn1430648] end connection 172.28.0.163:64468 (399 connections now open) 2015-10-05T08:27:57.686+0100 [mongosMain] connection accepted from 172.28.0.163:49228 #1431048 (400 connections now open) 2015-10-05T08:27:57.687+0100 [conn1431048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:58.250+0100 [conn1430690] end connection 172.28.0.163:64575 (399 connections now open) 2015-10-05T08:27:58.251+0100 [mongosMain] connection accepted from 172.28.0.163:49230 #1431049 (400 connections now open) 2015-10-05T08:27:58.253+0100 [conn1431049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:27:59.461+0100 [conn1430663] end connection 172.28.0.164:57499 (399 connections now open) 2015-10-05T08:27:59.462+0100 [mongosMain] connection accepted from 172.28.0.164:58583 #1431050 (400 connections now open) 2015-10-05T08:27:59.464+0100 [conn1431050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:00.085+0100 [conn1430699] end connection 172.28.0.164:57590 (399 connections now open) 2015-10-05T08:28:00.089+0100 [mongosMain] connection accepted from 172.28.0.164:58585 #1431051 (400 connections now open) 2015-10-05T08:28:00.090+0100 [conn1431051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:01.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226815703b51053edf942 2015-10-05T08:28:01.833+0100 [conn1430637] end connection 172.28.0.164:57438 (399 connections now open) 2015-10-05T08:28:01.834+0100 [mongosMain] connection accepted from 172.28.0.164:58592 #1431052 (400 connections now open) 2015-10-05T08:28:01.837+0100 [conn1431052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:02.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:04.253+0100 [conn1430646] end connection 172.28.0.163:64464 (399 connections now open) 2015-10-05T08:28:04.253+0100 [conn1430614] end connection 172.28.0.163:64365 (399 connections now open) 2015-10-05T08:28:04.254+0100 [mongosMain] connection accepted from 172.28.0.163:49248 #1431053 (399 connections now open) 2015-10-05T08:28:04.254+0100 [mongosMain] connection accepted from 172.28.0.163:49249 #1431054 (400 connections now open) 2015-10-05T08:28:04.255+0100 [conn1431053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:04.255+0100 [conn1431054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:07.689+0100 [conn1430530] end connection 172.28.0.163:64154 (399 connections now open) 2015-10-05T08:28:07.690+0100 [mongosMain] connection accepted from 172.28.0.163:49259 #1431055 (400 connections now open) 2015-10-05T08:28:07.691+0100 [conn1431055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:08.261+0100 [conn1430704] end connection 172.28.0.163:64609 (399 connections now open) 2015-10-05T08:28:08.262+0100 [mongosMain] connection accepted from 172.28.0.163:49264 #1431056 (400 connections now open) 2015-10-05T08:28:08.263+0100 [conn1431056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:08.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226885703b51053edf997 2015-10-05T08:28:09.477+0100 [conn1430698] end connection 172.28.0.164:57586 (399 connections now open) 2015-10-05T08:28:09.478+0100 [mongosMain] connection accepted from 172.28.0.164:58601 #1431057 (400 connections now open) 2015-10-05T08:28:09.479+0100 [conn1431057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:10.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:11.832+0100 [conn1430631] end connection 172.28.0.164:57426 (399 connections now open) 2015-10-05T08:28:11.834+0100 [mongosMain] connection accepted from 172.28.0.164:58602 #1431058 (400 connections now open) 2015-10-05T08:28:11.836+0100 [conn1431058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:14.268+0100 [conn1430615] end connection 172.28.0.163:64366 (399 connections now open) 2015-10-05T08:28:14.269+0100 [conn1430647] end connection 172.28.0.163:64465 (399 connections now open) 2015-10-05T08:28:14.270+0100 [mongosMain] connection accepted from 172.28.0.163:49273 #1431059 (399 connections now open) 2015-10-05T08:28:14.270+0100 [mongosMain] connection accepted from 172.28.0.163:49274 #1431060 (400 connections now open) 2015-10-05T08:28:14.271+0100 [conn1431059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:14.271+0100 [conn1431060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:16.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226905703b51053edf9f8 2015-10-05T08:28:16.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:17.700+0100 [conn1430673] end connection 172.28.0.163:64555 (399 connections now open) 2015-10-05T08:28:17.701+0100 [mongosMain] connection accepted from 172.28.0.163:49279 #1431061 (400 connections now open) 2015-10-05T08:28:17.702+0100 [conn1431061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:18.262+0100 [conn1430710] end connection 172.28.0.163:64645 (399 connections now open) 2015-10-05T08:28:18.263+0100 [mongosMain] connection accepted from 172.28.0.163:49283 #1431062 (400 connections now open) 2015-10-05T08:28:18.263+0100 [conn1431062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:18.482+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:28:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:28:19.492+0100 [conn1430514] end connection 172.28.0.164:57124 (399 connections now open) 2015-10-05T08:28:19.493+0100 [mongosMain] connection accepted from 172.28.0.164:58610 #1431063 (400 connections now open) 2015-10-05T08:28:19.494+0100 [conn1431063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:20.107+0100 [conn1430712] end connection 172.28.0.164:57625 (399 connections now open) 2015-10-05T08:28:20.108+0100 [mongosMain] connection accepted from 172.28.0.164:58612 #1431064 (400 connections now open) 2015-10-05T08:28:20.109+0100 [conn1431064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:21.848+0100 [conn1430686] end connection 172.28.0.164:57556 (399 connections now open) 2015-10-05T08:28:21.849+0100 [mongosMain] connection accepted from 172.28.0.164:58618 #1431065 (400 connections now open) 2015-10-05T08:28:21.850+0100 [conn1431065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:22.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226965703b51053edfa4a 2015-10-05T08:28:22.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:24.268+0100 [conn1430570] end connection 172.28.0.163:64252 (399 connections now open) 2015-10-05T08:28:24.268+0100 [conn1430600] end connection 172.28.0.163:64337 (399 connections now open) 2015-10-05T08:28:24.269+0100 [mongosMain] connection accepted from 172.28.0.163:49286 #1431066 (399 connections now open) 2015-10-05T08:28:24.270+0100 [mongosMain] connection accepted from 172.28.0.163:49287 #1431067 (400 connections now open) 2015-10-05T08:28:24.270+0100 [conn1431066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:24.270+0100 [conn1431067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:27.700+0100 [conn1430681] end connection 172.28.0.163:64565 (399 connections now open) 2015-10-05T08:28:27.702+0100 [mongosMain] connection accepted from 172.28.0.163:49290 #1431068 (400 connections now open) 2015-10-05T08:28:27.703+0100 [conn1431068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:28.277+0100 [conn1430716] end connection 172.28.0.163:64661 (399 connections now open) 2015-10-05T08:28:28.278+0100 [mongosMain] connection accepted from 172.28.0.163:49292 #1431069 (400 connections now open) 2015-10-05T08:28:28.279+0100 [conn1431069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:28.370+0100 [mongosMain] connection accepted from 127.0.0.1:49294 #1431070 (401 connections now open) 2015-10-05T08:28:28.375+0100 [conn1431070] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:28.383+0100 [conn1431070] end connection 127.0.0.1:49294 (400 connections now open) 2015-10-05T08:28:29.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612269d5703b51053edfa8f 2015-10-05T08:28:29.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:29.507+0100 [conn1430675] end connection 172.28.0.164:57526 (399 connections now open) 2015-10-05T08:28:29.509+0100 [mongosMain] connection accepted from 172.28.0.164:58630 #1431071 (400 connections now open) 2015-10-05T08:28:29.510+0100 [conn1431071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:30.116+0100 [conn1430706] end connection 172.28.0.164:57602 (399 connections now open) 2015-10-05T08:28:30.117+0100 [mongosMain] connection accepted from 172.28.0.164:58632 #1431072 (400 connections now open) 2015-10-05T08:28:30.119+0100 [conn1431072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:32.271+0100 [conn1430645] end connection 172.28.0.164:57456 (399 connections now open) 2015-10-05T08:28:32.276+0100 [mongosMain] connection accepted from 172.28.0.164:58636 #1431073 (400 connections now open) 2015-10-05T08:28:32.278+0100 [conn1431073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:34.285+0100 [conn1430660] end connection 172.28.0.163:64499 (399 connections now open) 2015-10-05T08:28:34.285+0100 [conn1430518] end connection 172.28.0.163:64132 (398 connections now open) 2015-10-05T08:28:34.286+0100 [mongosMain] connection accepted from 172.28.0.163:49297 #1431074 (399 connections now open) 2015-10-05T08:28:34.287+0100 [mongosMain] connection accepted from 172.28.0.163:49299 #1431075 (400 connections now open) 2015-10-05T08:28:34.287+0100 [conn1431074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:34.287+0100 [conn1431075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:35.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226a35703b51053edfae0 2015-10-05T08:28:36.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:37.716+0100 [conn1430703] end connection 172.28.0.163:64607 (399 connections now open) 2015-10-05T08:28:37.717+0100 [mongosMain] connection accepted from 172.28.0.163:49301 #1431076 (400 connections now open) 2015-10-05T08:28:37.718+0100 [conn1431076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:39.523+0100 [conn1430705] end connection 172.28.0.164:57600 (399 connections now open) 2015-10-05T08:28:39.524+0100 [mongosMain] connection accepted from 172.28.0.164:58648 #1431077 (400 connections now open) 2015-10-05T08:28:39.527+0100 [conn1431077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:40.132+0100 [conn1430718] end connection 172.28.0.164:57640 (399 connections now open) 2015-10-05T08:28:40.134+0100 [mongosMain] connection accepted from 172.28.0.164:58650 #1431078 (400 connections now open) 2015-10-05T08:28:40.135+0100 [conn1431078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:42.254+0100 [conn1430707] end connection 172.28.0.164:57606 (399 connections now open) 2015-10-05T08:28:42.256+0100 [mongosMain] connection accepted from 172.28.0.164:58652 #1431079 (400 connections now open) 2015-10-05T08:28:42.259+0100 [conn1431079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:42.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226aa5703b51053edfb47 2015-10-05T08:28:43.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:44.289+0100 [conn1430608] end connection 172.28.0.163:64350 (399 connections now open) 2015-10-05T08:28:44.290+0100 [conn1430607] end connection 172.28.0.163:64349 (399 connections now open) 2015-10-05T08:28:44.291+0100 [mongosMain] connection accepted from 172.28.0.163:49308 #1431080 (399 connections now open) 2015-10-05T08:28:44.291+0100 [mongosMain] connection accepted from 172.28.0.163:49309 #1431081 (400 connections now open) 2015-10-05T08:28:44.292+0100 [conn1431080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:44.292+0100 [conn1431081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:45.832+0100 [mongosMain] connection accepted from 127.0.0.1:49311 #1431082 (401 connections now open) 2015-10-05T08:28:45.835+0100 [conn1431082] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:45.839+0100 [conn1431082] end connection 127.0.0.1:49311 (400 connections now open) 2015-10-05T08:28:47.716+0100 [conn1430689] end connection 172.28.0.163:64573 (399 connections now open) 2015-10-05T08:28:47.717+0100 [mongosMain] connection accepted from 172.28.0.163:49320 #1431083 (400 connections now open) 2015-10-05T08:28:47.717+0100 [conn1431083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:48.293+0100 [conn1430722] end connection 172.28.0.163:64668 (399 connections now open) 2015-10-05T08:28:48.294+0100 [mongosMain] connection accepted from 172.28.0.163:49322 #1431084 (400 connections now open) 2015-10-05T08:28:48.295+0100 [conn1431084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:48.769+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:28:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:28:49.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226b15703b51053edfbb0 2015-10-05T08:28:49.540+0100 [conn1430669] end connection 172.28.0.164:57518 (399 connections now open) 2015-10-05T08:28:49.541+0100 [mongosMain] connection accepted from 172.28.0.164:58666 #1431085 (400 connections now open) 2015-10-05T08:28:49.543+0100 [conn1431085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:49.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:50.148+0100 [conn1430725] end connection 172.28.0.164:57656 (399 connections now open) 2015-10-05T08:28:50.149+0100 [mongosMain] connection accepted from 172.28.0.164:58668 #1431086 (400 connections now open) 2015-10-05T08:28:50.150+0100 [conn1431086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:52.254+0100 [conn1430652] end connection 172.28.0.164:57475 (399 connections now open) 2015-10-05T08:28:52.256+0100 [mongosMain] connection accepted from 172.28.0.164:58674 #1431087 (400 connections now open) 2015-10-05T08:28:52.258+0100 [conn1431087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:54.338+0100 [conn1430655] end connection 172.28.0.163:64481 (399 connections now open) 2015-10-05T08:28:54.354+0100 [conn1430599] end connection 172.28.0.163:64336 (398 connections now open) 2015-10-05T08:28:54.357+0100 [mongosMain] connection accepted from 172.28.0.163:49330 #1431088 (399 connections now open) 2015-10-05T08:28:54.358+0100 [mongosMain] connection accepted from 172.28.0.163:49331 #1431089 (400 connections now open) 2015-10-05T08:28:54.359+0100 [conn1431088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:54.360+0100 [conn1431089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:55.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226b75703b51053edfbfd 2015-10-05T08:28:55.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:28:57.732+0100 [conn1430715] end connection 172.28.0.163:64659 (399 connections now open) 2015-10-05T08:28:57.733+0100 [mongosMain] connection accepted from 172.28.0.163:49338 #1431090 (400 connections now open) 2015-10-05T08:28:57.734+0100 [conn1431090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:58.309+0100 [conn1430735] end connection 172.28.0.163:64690 (399 connections now open) 2015-10-05T08:28:58.310+0100 [mongosMain] connection accepted from 172.28.0.163:49340 #1431091 (400 connections now open) 2015-10-05T08:28:58.311+0100 [conn1431091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:28:59.555+0100 [conn1430711] end connection 172.28.0.164:57624 (399 connections now open) 2015-10-05T08:28:59.556+0100 [mongosMain] connection accepted from 172.28.0.164:58681 #1431092 (400 connections now open) 2015-10-05T08:28:59.557+0100 [conn1431092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:02.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226bd5703b51053edfc4e 2015-10-05T08:29:02.269+0100 [conn1430670] end connection 172.28.0.164:57522 (399 connections now open) 2015-10-05T08:29:02.269+0100 [conn1430678] end connection 172.28.0.164:57534 (399 connections now open) 2015-10-05T08:29:02.270+0100 [mongosMain] connection accepted from 172.28.0.164:58694 #1431093 (399 connections now open) 2015-10-05T08:29:02.270+0100 [mongosMain] connection accepted from 172.28.0.164:58695 #1431094 (400 connections now open) 2015-10-05T08:29:02.271+0100 [conn1431093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:02.271+0100 [conn1431094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:02.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:04.324+0100 [conn1430548] end connection 172.28.0.163:64213 (399 connections now open) 2015-10-05T08:29:04.325+0100 [conn1430628] end connection 172.28.0.163:64412 (399 connections now open) 2015-10-05T08:29:04.326+0100 [mongosMain] connection accepted from 172.28.0.163:49361 #1431095 (399 connections now open) 2015-10-05T08:29:04.326+0100 [mongosMain] connection accepted from 172.28.0.163:49362 #1431096 (400 connections now open) 2015-10-05T08:29:04.326+0100 [conn1431095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:04.327+0100 [conn1431096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:07.733+0100 [conn1430728] end connection 172.28.0.163:64674 (399 connections now open) 2015-10-05T08:29:07.734+0100 [mongosMain] connection accepted from 172.28.0.163:49367 #1431097 (400 connections now open) 2015-10-05T08:29:07.735+0100 [conn1431097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:08.311+0100 [conn1430740] end connection 172.28.0.163:64707 (399 connections now open) 2015-10-05T08:29:08.312+0100 [mongosMain] connection accepted from 172.28.0.163:49368 #1431098 (400 connections now open) 2015-10-05T08:29:08.313+0100 [conn1431098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:09.571+0100 [conn1430717] end connection 172.28.0.164:57637 (399 connections now open) 2015-10-05T08:29:09.572+0100 [mongosMain] connection accepted from 172.28.0.164:58702 #1431099 (400 connections now open) 2015-10-05T08:29:09.575+0100 [conn1431099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:10.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226c45703b51053edfcac 2015-10-05T08:29:10.180+0100 [conn1430730] end connection 172.28.0.164:57677 (399 connections now open) 2015-10-05T08:29:10.181+0100 [mongosMain] connection accepted from 172.28.0.164:58703 #1431100 (400 connections now open) 2015-10-05T08:29:10.183+0100 [conn1431100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:10.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:12.270+0100 [conn1430693] end connection 172.28.0.164:57574 (399 connections now open) 2015-10-05T08:29:12.270+0100 [conn1430586] end connection 172.28.0.164:57320 (399 connections now open) 2015-10-05T08:29:12.271+0100 [mongosMain] connection accepted from 172.28.0.164:58706 #1431101 (399 connections now open) 2015-10-05T08:29:12.271+0100 [mongosMain] connection accepted from 172.28.0.164:58705 #1431102 (400 connections now open) 2015-10-05T08:29:12.272+0100 [conn1431101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:12.273+0100 [conn1431102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:14.316+0100 [conn1430639] end connection 172.28.0.163:64453 (399 connections now open) 2015-10-05T08:29:14.317+0100 [conn1430533] end connection 172.28.0.163:64163 (398 connections now open) 2015-10-05T08:29:14.318+0100 [mongosMain] connection accepted from 172.28.0.163:49375 #1431103 (399 connections now open) 2015-10-05T08:29:14.318+0100 [mongosMain] connection accepted from 172.28.0.163:49376 #1431104 (400 connections now open) 2015-10-05T08:29:14.319+0100 [conn1431103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:14.320+0100 [conn1431104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:16.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226cc5703b51053edfd12 2015-10-05T08:29:16.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:17.747+0100 [conn1430739] end connection 172.28.0.163:64704 (399 connections now open) 2015-10-05T08:29:17.748+0100 [mongosMain] connection accepted from 172.28.0.163:49381 #1431105 (400 connections now open) 2015-10-05T08:29:17.750+0100 [conn1431105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:19.181+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:29:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:29:19.572+0100 [conn1430729] end connection 172.28.0.164:57675 (399 connections now open) 2015-10-05T08:29:19.573+0100 [mongosMain] connection accepted from 172.28.0.164:58716 #1431106 (400 connections now open) 2015-10-05T08:29:19.575+0100 [conn1431106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:22.300+0100 [conn1430700] end connection 172.28.0.164:57592 (399 connections now open) 2015-10-05T08:29:22.301+0100 [mongosMain] connection accepted from 172.28.0.164:58726 #1431107 (400 connections now open) 2015-10-05T08:29:22.307+0100 [conn1431107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:23.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226d25703b51053edfd6c 2015-10-05T08:29:23.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:24.331+0100 [conn1430667] end connection 172.28.0.163:64525 (399 connections now open) 2015-10-05T08:29:24.332+0100 [mongosMain] connection accepted from 172.28.0.163:49386 #1431108 (400 connections now open) 2015-10-05T08:29:24.333+0100 [conn1431108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:27.763+0100 [conn1430709] end connection 172.28.0.163:64642 (399 connections now open) 2015-10-05T08:29:27.764+0100 [mongosMain] connection accepted from 172.28.0.163:49389 #1431109 (400 connections now open) 2015-10-05T08:29:27.764+0100 [conn1431109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:28.879+0100 [mongosMain] connection accepted from 127.0.0.1:49391 #1431110 (401 connections now open) 2015-10-05T08:29:28.882+0100 [conn1431110] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:28.888+0100 [conn1431110] end connection 127.0.0.1:49391 (400 connections now open) 2015-10-05T08:29:29.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226d95703b51053edfdbb 2015-10-05T08:29:29.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:29.588+0100 [conn1430724] end connection 172.28.0.164:57654 (399 connections now open) 2015-10-05T08:29:29.588+0100 [mongosMain] connection accepted from 172.28.0.164:58735 #1431111 (400 connections now open) 2015-10-05T08:29:29.590+0100 [conn1431111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:32.286+0100 [conn1430726] end connection 172.28.0.164:57661 (399 connections now open) 2015-10-05T08:29:32.287+0100 [mongosMain] connection accepted from 172.28.0.164:58741 #1431112 (400 connections now open) 2015-10-05T08:29:32.290+0100 [conn1431112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:34.341+0100 [conn1430687] end connection 172.28.0.163:64570 (399 connections now open) 2015-10-05T08:29:34.342+0100 [mongosMain] connection accepted from 172.28.0.163:49395 #1431113 (400 connections now open) 2015-10-05T08:29:34.343+0100 [conn1431113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:37.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226df5703b51053edfe06 2015-10-05T08:29:37.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:37.763+0100 [conn1430734] end connection 172.28.0.163:64685 (399 connections now open) 2015-10-05T08:29:37.764+0100 [mongosMain] connection accepted from 172.28.0.163:49399 #1431114 (400 connections now open) 2015-10-05T08:29:37.765+0100 [conn1431114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:39.325+0100 [mongosMain] connection accepted from 127.0.0.1:49400 #1431115 (401 connections now open) 2015-10-05T08:29:39.328+0100 [conn1431115] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:39.332+0100 [conn1431115] end connection 127.0.0.1:49400 (400 connections now open) 2015-10-05T08:29:39.602+0100 [conn1430539] end connection 172.28.0.164:57177 (399 connections now open) 2015-10-05T08:29:39.603+0100 [mongosMain] connection accepted from 172.28.0.164:58755 #1431116 (400 connections now open) 2015-10-05T08:29:39.605+0100 [conn1431116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:42.301+0100 [conn1430719] end connection 172.28.0.164:57644 (399 connections now open) 2015-10-05T08:29:42.302+0100 [mongosMain] connection accepted from 172.28.0.164:58761 #1431117 (400 connections now open) 2015-10-05T08:29:42.304+0100 [conn1431117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:43.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226e75703b51053edfe65 2015-10-05T08:29:43.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:44.348+0100 [conn1430695] end connection 172.28.0.163:64582 (399 connections now open) 2015-10-05T08:29:44.349+0100 [mongosMain] connection accepted from 172.28.0.163:49408 #1431118 (400 connections now open) 2015-10-05T08:29:44.350+0100 [conn1431118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:47.779+0100 [conn1430697] end connection 172.28.0.163:64588 (399 connections now open) 2015-10-05T08:29:47.780+0100 [mongosMain] connection accepted from 172.28.0.163:49413 #1431119 (400 connections now open) 2015-10-05T08:29:47.781+0100 [conn1431119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:49.432+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:29:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:29:50.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226ed5703b51053edfead 2015-10-05T08:29:50.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:52.318+0100 [conn1430738] end connection 172.28.0.164:57695 (399 connections now open) 2015-10-05T08:29:52.318+0100 [mongosMain] connection accepted from 172.28.0.164:58772 #1431120 (400 connections now open) 2015-10-05T08:29:52.320+0100 [conn1431120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:54.418+0100 [conn1430679] end connection 172.28.0.163:64561 (399 connections now open) 2015-10-05T08:29:54.421+0100 [mongosMain] connection accepted from 172.28.0.163:49419 #1431121 (400 connections now open) 2015-10-05T08:29:54.422+0100 [conn1431121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:56.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226f45703b51053edfef2 2015-10-05T08:29:56.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:29:57.780+0100 [conn1430721] end connection 172.28.0.163:64666 (399 connections now open) 2015-10-05T08:29:57.781+0100 [mongosMain] connection accepted from 172.28.0.163:49423 #1431122 (400 connections now open) 2015-10-05T08:29:57.783+0100 [conn1431122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:29:59.634+0100 [conn1430589] end connection 172.28.0.164:57323 (399 connections now open) 2015-10-05T08:29:59.635+0100 [mongosMain] connection accepted from 172.28.0.164:58776 #1431123 (400 connections now open) 2015-10-05T08:29:59.636+0100 [conn1431123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:02.333+0100 [conn1430742] end connection 172.28.0.164:57708 (399 connections now open) 2015-10-05T08:30:02.334+0100 [mongosMain] connection accepted from 172.28.0.164:58792 #1431124 (400 connections now open) 2015-10-05T08:30:02.336+0100 [conn1431124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:02.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561226fa5703b51053edff39 2015-10-05T08:30:03.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:04.421+0100 [conn1430702] end connection 172.28.0.163:64600 (399 connections now open) 2015-10-05T08:30:04.422+0100 [mongosMain] connection accepted from 172.28.0.163:49448 #1431125 (400 connections now open) 2015-10-05T08:30:04.423+0100 [conn1431125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:07.798+0100 [conn1430753] end connection 172.28.0.163:64756 (399 connections now open) 2015-10-05T08:30:07.802+0100 [mongosMain] connection accepted from 172.28.0.163:49452 #1431126 (400 connections now open) 2015-10-05T08:30:07.803+0100 [conn1431126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:09.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227015703b51053edffa4 2015-10-05T08:30:09.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:10.257+0100 [conn1430737] end connection 172.28.0.164:57693 (399 connections now open) 2015-10-05T08:30:10.258+0100 [mongosMain] connection accepted from 172.28.0.164:58804 #1431127 (400 connections now open) 2015-10-05T08:30:10.259+0100 [conn1431127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:12.349+0100 [conn1430625] end connection 172.28.0.164:57407 (399 connections now open) 2015-10-05T08:30:12.350+0100 [mongosMain] connection accepted from 172.28.0.164:58806 #1431128 (400 connections now open) 2015-10-05T08:30:12.352+0100 [conn1431128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:14.425+0100 [conn1430714] end connection 172.28.0.163:64651 (399 connections now open) 2015-10-05T08:30:14.426+0100 [mongosMain] connection accepted from 172.28.0.163:49474 #1431129 (400 connections now open) 2015-10-05T08:30:14.428+0100 [conn1431129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:15.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227075703b51053ee000b 2015-10-05T08:30:15.687+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:17.794+0100 [conn1430757] end connection 172.28.0.163:64769 (399 connections now open) 2015-10-05T08:30:17.795+0100 [mongosMain] connection accepted from 172.28.0.163:49480 #1431130 (400 connections now open) 2015-10-05T08:30:17.796+0100 [conn1431130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:18.372+0100 [conn1430744] end connection 172.28.0.163:64729 (399 connections now open) 2015-10-05T08:30:18.374+0100 [mongosMain] connection accepted from 172.28.0.163:49484 #1431131 (400 connections now open) 2015-10-05T08:30:18.374+0100 [conn1431131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:19.665+0100 [conn1430751] end connection 172.28.0.164:57748 (399 connections now open) 2015-10-05T08:30:19.666+0100 [mongosMain] connection accepted from 172.28.0.164:58815 #1431132 (400 connections now open) 2015-10-05T08:30:19.668+0100 [conn1431132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:19.710+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:30:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:30:20.274+0100 [conn1430763] end connection 172.28.0.164:57812 (399 connections now open) 2015-10-05T08:30:20.274+0100 [mongosMain] connection accepted from 172.28.0.164:58818 #1431133 (400 connections now open) 2015-10-05T08:30:20.276+0100 [conn1431133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:22.364+0100 [conn1430732] end connection 172.28.0.164:57681 (399 connections now open) 2015-10-05T08:30:22.365+0100 [mongosMain] connection accepted from 172.28.0.164:58823 #1431134 (400 connections now open) 2015-10-05T08:30:22.368+0100 [conn1431134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:27.810+0100 [conn1430761] end connection 172.28.0.163:64805 (399 connections now open) 2015-10-05T08:30:27.811+0100 [mongosMain] connection accepted from 172.28.0.163:49489 #1431135 (400 connections now open) 2015-10-05T08:30:27.812+0100 [conn1431135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:28.388+0100 [conn1430766] end connection 172.28.0.163:64822 (399 connections now open) 2015-10-05T08:30:28.389+0100 [mongosMain] connection accepted from 172.28.0.163:49492 #1431136 (400 connections now open) 2015-10-05T08:30:28.390+0100 [conn1431136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:28.776+0100 [mongosMain] connection accepted from 127.0.0.1:49493 #1431137 (401 connections now open) 2015-10-05T08:30:28.779+0100 [conn1431137] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:28.783+0100 [conn1431137] end connection 127.0.0.1:49493 (400 connections now open) 2015-10-05T08:30:29.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227135703b51053ee00b3 2015-10-05T08:30:29.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:29.681+0100 [conn1430754] end connection 172.28.0.164:57765 (399 connections now open) 2015-10-05T08:30:29.681+0100 [mongosMain] connection accepted from 172.28.0.164:58833 #1431138 (400 connections now open) 2015-10-05T08:30:29.683+0100 [conn1431138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:32.380+0100 [conn1430749] end connection 172.28.0.164:57735 (399 connections now open) 2015-10-05T08:30:32.380+0100 [mongosMain] connection accepted from 172.28.0.164:58838 #1431139 (400 connections now open) 2015-10-05T08:30:32.382+0100 [conn1431139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:37.810+0100 [conn1430759] end connection 172.28.0.163:64776 (399 connections now open) 2015-10-05T08:30:37.811+0100 [mongosMain] connection accepted from 172.28.0.163:49498 #1431140 (400 connections now open) 2015-10-05T08:30:37.812+0100 [conn1431140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:38.388+0100 [conn1430773] end connection 172.28.0.163:64834 (399 connections now open) 2015-10-05T08:30:38.389+0100 [mongosMain] connection accepted from 172.28.0.163:49502 #1431141 (400 connections now open) 2015-10-05T08:30:38.390+0100 [conn1431141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:39.680+0100 [conn1430748] end connection 172.28.0.164:57728 (399 connections now open) 2015-10-05T08:30:39.682+0100 [mongosMain] connection accepted from 172.28.0.164:58852 #1431142 (400 connections now open) 2015-10-05T08:30:39.684+0100 [conn1431142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:40.020+0100 [mongosMain] connection accepted from 127.0.0.1:49504 #1431143 (401 connections now open) 2015-10-05T08:30:40.022+0100 [conn1431143] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:40.026+0100 [conn1431143] end connection 127.0.0.1:49504 (400 connections now open) 2015-10-05T08:30:40.305+0100 [conn1430768] end connection 172.28.0.164:57826 (399 connections now open) 2015-10-05T08:30:40.306+0100 [mongosMain] connection accepted from 172.28.0.164:58856 #1431144 (400 connections now open) 2015-10-05T08:30:40.307+0100 [conn1431144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:42.679+0100 [conn1430752] end connection 172.28.0.164:57752 (399 connections now open) 2015-10-05T08:30:42.687+0100 [mongosMain] connection accepted from 172.28.0.164:58860 #1431145 (400 connections now open) 2015-10-05T08:30:42.688+0100 [conn1431145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:43.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227215703b51053ee015c 2015-10-05T08:30:43.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:48.403+0100 [conn1430779] end connection 172.28.0.163:64848 (399 connections now open) 2015-10-05T08:30:48.404+0100 [mongosMain] connection accepted from 172.28.0.163:49514 #1431146 (400 connections now open) 2015-10-05T08:30:48.405+0100 [conn1431146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:49.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227295703b51053ee01c1 2015-10-05T08:30:49.697+0100 [conn1430745] end connection 172.28.0.164:57721 (399 connections now open) 2015-10-05T08:30:49.699+0100 [mongosMain] connection accepted from 172.28.0.164:58868 #1431147 (400 connections now open) 2015-10-05T08:30:49.702+0100 [conn1431147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:49.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:30:49.928+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:30:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:30:50.320+0100 [conn1430781] end connection 172.28.0.164:57854 (399 connections now open) 2015-10-05T08:30:50.321+0100 [mongosMain] connection accepted from 172.28.0.164:58869 #1431148 (400 connections now open) 2015-10-05T08:30:50.323+0100 [conn1431148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:52.693+0100 [conn1430713] end connection 172.28.0.164:57630 (399 connections now open) 2015-10-05T08:30:52.694+0100 [mongosMain] connection accepted from 172.28.0.164:58874 #1431149 (400 connections now open) 2015-10-05T08:30:52.695+0100 [conn1431149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:57.842+0100 [conn1430772] end connection 172.28.0.163:64832 (399 connections now open) 2015-10-05T08:30:57.844+0100 [mongosMain] connection accepted from 172.28.0.163:49527 #1431150 (400 connections now open) 2015-10-05T08:30:57.845+0100 [conn1431150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:58.405+0100 [conn1430786] end connection 172.28.0.163:64869 (399 connections now open) 2015-10-05T08:30:58.407+0100 [mongosMain] connection accepted from 172.28.0.163:49528 #1431151 (400 connections now open) 2015-10-05T08:30:58.408+0100 [conn1431151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:30:59.714+0100 [conn1430741] end connection 172.28.0.164:57703 (399 connections now open) 2015-10-05T08:30:59.716+0100 [mongosMain] connection accepted from 172.28.0.164:58880 #1431152 (400 connections now open) 2015-10-05T08:30:59.717+0100 [conn1431152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:02.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227355703b51053ee0263 2015-10-05T08:31:02.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:02.707+0100 [conn1430405] end connection 172.28.0.164:56726 (399 connections now open) 2015-10-05T08:31:02.724+0100 [mongosMain] connection accepted from 172.28.0.164:58900 #1431153 (400 connections now open) 2015-10-05T08:31:02.728+0100 [conn1431153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:07.849+0100 [conn1430747] end connection 172.28.0.163:64741 (399 connections now open) 2015-10-05T08:31:07.850+0100 [mongosMain] connection accepted from 172.28.0.163:49552 #1431154 (400 connections now open) 2015-10-05T08:31:07.851+0100 [conn1431154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:08.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612273c5703b51053ee0300 2015-10-05T08:31:08.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:09.729+0100 [conn1430767] end connection 172.28.0.164:57823 (399 connections now open) 2015-10-05T08:31:09.730+0100 [mongosMain] connection accepted from 172.28.0.164:58905 #1431155 (400 connections now open) 2015-10-05T08:31:09.731+0100 [conn1431155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:10.336+0100 [conn1430788] end connection 172.28.0.164:57879 (399 connections now open) 2015-10-05T08:31:10.336+0100 [mongosMain] connection accepted from 172.28.0.164:58907 #1431156 (400 connections now open) 2015-10-05T08:31:10.340+0100 [conn1431156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:13.234+0100 [conn1430580] end connection 172.28.0.164:57289 (399 connections now open) 2015-10-05T08:31:13.253+0100 [mongosMain] connection accepted from 172.28.0.164:58908 #1431157 (400 connections now open) 2015-10-05T08:31:13.256+0100 [conn1431157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:15.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227435703b51053ee0396 2015-10-05T08:31:16.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:17.858+0100 [conn1430785] end connection 172.28.0.163:64867 (399 connections now open) 2015-10-05T08:31:17.859+0100 [mongosMain] connection accepted from 172.28.0.163:49567 #1431158 (400 connections now open) 2015-10-05T08:31:17.860+0100 [conn1431158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:19.744+0100 [conn1430780] end connection 172.28.0.164:57851 (399 connections now open) 2015-10-05T08:31:19.746+0100 [mongosMain] connection accepted from 172.28.0.164:58918 #1431159 (400 connections now open) 2015-10-05T08:31:19.747+0100 [conn1431159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:20.201+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:31:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:31:20.352+0100 [conn1430797] end connection 172.28.0.164:57916 (399 connections now open) 2015-10-05T08:31:20.353+0100 [mongosMain] connection accepted from 172.28.0.164:58919 #1431160 (400 connections now open) 2015-10-05T08:31:20.354+0100 [conn1431160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:27.859+0100 [conn1430743] end connection 172.28.0.163:64728 (399 connections now open) 2015-10-05T08:31:27.860+0100 [mongosMain] connection accepted from 172.28.0.163:49572 #1431161 (400 connections now open) 2015-10-05T08:31:27.861+0100 [conn1431161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:28.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227505703b51053ee0490 2015-10-05T08:31:28.434+0100 [conn1430801] end connection 172.28.0.163:64929 (399 connections now open) 2015-10-05T08:31:28.435+0100 [mongosMain] connection accepted from 172.28.0.163:49573 #1431162 (400 connections now open) 2015-10-05T08:31:28.436+0100 [conn1431162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:28.437+0100 [mongosMain] connection accepted from 127.0.0.1:49574 #1431163 (401 connections now open) 2015-10-05T08:31:28.440+0100 [conn1431163] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:28.446+0100 [conn1431163] end connection 127.0.0.1:49574 (400 connections now open) 2015-10-05T08:31:28.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:29.759+0100 [conn1430736] end connection 172.28.0.164:57691 (399 connections now open) 2015-10-05T08:31:29.760+0100 [mongosMain] connection accepted from 172.28.0.164:58933 #1431164 (400 connections now open) 2015-10-05T08:31:29.762+0100 [conn1431164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:30.367+0100 [conn1430803] end connection 172.28.0.164:57926 (399 connections now open) 2015-10-05T08:31:30.368+0100 [mongosMain] connection accepted from 172.28.0.164:58935 #1431165 (400 connections now open) 2015-10-05T08:31:30.371+0100 [conn1431165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:34.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227565703b51053ee04f8 2015-10-05T08:31:35.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:37.873+0100 [conn1430765] end connection 172.28.0.163:64820 (399 connections now open) 2015-10-05T08:31:37.874+0100 [mongosMain] connection accepted from 172.28.0.163:49579 #1431166 (400 connections now open) 2015-10-05T08:31:37.875+0100 [conn1431166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:38.451+0100 [conn1430791] end connection 172.28.0.163:64885 (399 connections now open) 2015-10-05T08:31:38.452+0100 [mongosMain] connection accepted from 172.28.0.163:49581 #1431167 (400 connections now open) 2015-10-05T08:31:38.453+0100 [conn1431167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:39.617+0100 [mongosMain] connection accepted from 127.0.0.1:49583 #1431168 (401 connections now open) 2015-10-05T08:31:39.619+0100 [conn1431168] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:39.624+0100 [conn1431168] end connection 127.0.0.1:49583 (400 connections now open) 2015-10-05T08:31:39.760+0100 [conn1430792] end connection 172.28.0.164:57888 (399 connections now open) 2015-10-05T08:31:39.761+0100 [mongosMain] connection accepted from 172.28.0.164:58951 #1431169 (400 connections now open) 2015-10-05T08:31:39.762+0100 [conn1431169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:40.384+0100 [conn1430809] end connection 172.28.0.164:57946 (399 connections now open) 2015-10-05T08:31:40.385+0100 [mongosMain] connection accepted from 172.28.0.164:58953 #1431170 (400 connections now open) 2015-10-05T08:31:40.386+0100 [conn1431170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:47.874+0100 [conn1430778] end connection 172.28.0.163:64845 (399 connections now open) 2015-10-05T08:31:47.875+0100 [mongosMain] connection accepted from 172.28.0.163:49588 #1431171 (400 connections now open) 2015-10-05T08:31:47.876+0100 [conn1431171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:48.451+0100 [conn1430806] end connection 172.28.0.163:64939 (399 connections now open) 2015-10-05T08:31:48.452+0100 [mongosMain] connection accepted from 172.28.0.163:49593 #1431172 (400 connections now open) 2015-10-05T08:31:48.453+0100 [conn1431172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:49.775+0100 [conn1430762] end connection 172.28.0.164:57810 (399 connections now open) 2015-10-05T08:31:49.776+0100 [mongosMain] connection accepted from 172.28.0.164:58962 #1431173 (400 connections now open) 2015-10-05T08:31:49.777+0100 [conn1431173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:50.400+0100 [conn1430813] end connection 172.28.0.164:57962 (399 connections now open) 2015-10-05T08:31:50.402+0100 [mongosMain] connection accepted from 172.28.0.164:58965 #1431174 (400 connections now open) 2015-10-05T08:31:50.404+0100 [conn1431174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:50.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:31:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:31:53.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227695703b51053ee065e 2015-10-05T08:31:54.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:31:57.889+0100 [conn1430790] end connection 172.28.0.163:64884 (399 connections now open) 2015-10-05T08:31:57.891+0100 [mongosMain] connection accepted from 172.28.0.163:49611 #1431175 (400 connections now open) 2015-10-05T08:31:57.892+0100 [conn1431175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:58.466+0100 [conn1430811] end connection 172.28.0.163:64951 (399 connections now open) 2015-10-05T08:31:58.467+0100 [mongosMain] connection accepted from 172.28.0.163:49613 #1431176 (400 connections now open) 2015-10-05T08:31:58.468+0100 [conn1431176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:31:59.776+0100 [conn1430787] end connection 172.28.0.164:57878 (399 connections now open) 2015-10-05T08:31:59.777+0100 [mongosMain] connection accepted from 172.28.0.164:58977 #1431177 (400 connections now open) 2015-10-05T08:31:59.779+0100 [conn1431177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:00.400+0100 [conn1430818] end connection 172.28.0.164:57976 (399 connections now open) 2015-10-05T08:32:00.400+0100 [mongosMain] connection accepted from 172.28.0.164:58979 #1431178 (400 connections now open) 2015-10-05T08:32:00.402+0100 [conn1431178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:00.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227705703b51053ee06d8 2015-10-05T08:32:01.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:02.791+0100 [conn1430653] end connection 172.28.0.164:57476 (399 connections now open) 2015-10-05T08:32:02.792+0100 [mongosMain] connection accepted from 172.28.0.164:58988 #1431179 (400 connections now open) 2015-10-05T08:32:02.794+0100 [conn1431179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:07.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227775703b51053ee076d 2015-10-05T08:32:07.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:07.995+0100 [conn1430795] end connection 172.28.0.163:64912 (399 connections now open) 2015-10-05T08:32:07.996+0100 [mongosMain] connection accepted from 172.28.0.163:49645 #1431180 (400 connections now open) 2015-10-05T08:32:07.997+0100 [conn1431180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:08.467+0100 [conn1430816] end connection 172.28.0.163:64970 (399 connections now open) 2015-10-05T08:32:08.469+0100 [mongosMain] connection accepted from 172.28.0.163:49646 #1431181 (400 connections now open) 2015-10-05T08:32:08.470+0100 [conn1431181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:09.791+0100 [conn1430802] end connection 172.28.0.164:57922 (399 connections now open) 2015-10-05T08:32:09.792+0100 [mongosMain] connection accepted from 172.28.0.164:58995 #1431182 (400 connections now open) 2015-10-05T08:32:09.794+0100 [conn1431182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:10.415+0100 [conn1430822] end connection 172.28.0.164:57986 (399 connections now open) 2015-10-05T08:32:10.416+0100 [mongosMain] connection accepted from 172.28.0.164:58998 #1431183 (400 connections now open) 2015-10-05T08:32:10.417+0100 [conn1431183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:12.802+0100 [conn1430665] end connection 172.28.0.164:57503 (399 connections now open) 2015-10-05T08:32:12.803+0100 [mongosMain] connection accepted from 172.28.0.164:59000 #1431184 (400 connections now open) 2015-10-05T08:32:12.804+0100 [conn1431184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:14.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612277d5703b51053ee07e4 2015-10-05T08:32:14.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:17.906+0100 [conn1430815] end connection 172.28.0.163:64968 (399 connections now open) 2015-10-05T08:32:17.907+0100 [mongosMain] connection accepted from 172.28.0.163:49661 #1431185 (400 connections now open) 2015-10-05T08:32:17.908+0100 [conn1431185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:18.483+0100 [conn1430820] end connection 172.28.0.163:64987 (399 connections now open) 2015-10-05T08:32:18.484+0100 [mongosMain] connection accepted from 172.28.0.163:49662 #1431186 (400 connections now open) 2015-10-05T08:32:18.486+0100 [conn1431186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:19.806+0100 [conn1430775] end connection 172.28.0.164:57840 (399 connections now open) 2015-10-05T08:32:19.807+0100 [mongosMain] connection accepted from 172.28.0.164:59006 #1431187 (400 connections now open) 2015-10-05T08:32:19.808+0100 [conn1431187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:20.430+0100 [conn1430827] end connection 172.28.0.164:58005 (399 connections now open) 2015-10-05T08:32:20.431+0100 [mongosMain] connection accepted from 172.28.0.164:59007 #1431188 (400 connections now open) 2015-10-05T08:32:20.433+0100 [conn1431188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:20.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227845703b51053ee0853 2015-10-05T08:32:21.264+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:32:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:32:21.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:27.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612278b5703b51053ee08cf 2015-10-05T08:32:27.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:27.921+0100 [conn1430805] end connection 172.28.0.163:64936 (399 connections now open) 2015-10-05T08:32:27.922+0100 [mongosMain] connection accepted from 172.28.0.163:49667 #1431189 (400 connections now open) 2015-10-05T08:32:27.924+0100 [conn1431189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:28.191+0100 [mongosMain] connection accepted from 127.0.0.1:49670 #1431190 (401 connections now open) 2015-10-05T08:32:28.194+0100 [conn1431190] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:28.199+0100 [conn1431190] end connection 127.0.0.1:49670 (400 connections now open) 2015-10-05T08:32:28.485+0100 [conn1430825] end connection 172.28.0.163:65015 (399 connections now open) 2015-10-05T08:32:28.486+0100 [mongosMain] connection accepted from 172.28.0.163:49671 #1431191 (400 connections now open) 2015-10-05T08:32:28.488+0100 [conn1431191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:29.807+0100 [conn1430796] end connection 172.28.0.164:57914 (399 connections now open) 2015-10-05T08:32:29.809+0100 [mongosMain] connection accepted from 172.28.0.164:59017 #1431192 (400 connections now open) 2015-10-05T08:32:29.810+0100 [conn1431192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:30.430+0100 [conn1430833] end connection 172.28.0.164:58016 (399 connections now open) 2015-10-05T08:32:30.430+0100 [mongosMain] connection accepted from 172.28.0.164:59021 #1431193 (400 connections now open) 2015-10-05T08:32:30.431+0100 [conn1431193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:32.833+0100 [conn1430511] end connection 172.28.0.164:57120 (399 connections now open) 2015-10-05T08:32:32.834+0100 [mongosMain] connection accepted from 172.28.0.164:59025 #1431194 (400 connections now open) 2015-10-05T08:32:32.835+0100 [conn1431194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:33.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227915703b51053ee093c 2015-10-05T08:32:33.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:37.923+0100 [conn1430830] end connection 172.28.0.163:65029 (399 connections now open) 2015-10-05T08:32:37.924+0100 [mongosMain] connection accepted from 172.28.0.163:49675 #1431195 (400 connections now open) 2015-10-05T08:32:37.925+0100 [conn1431195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:38.498+0100 [conn1430831] end connection 172.28.0.163:65030 (399 connections now open) 2015-10-05T08:32:38.500+0100 [mongosMain] connection accepted from 172.28.0.163:49677 #1431196 (400 connections now open) 2015-10-05T08:32:38.501+0100 [conn1431196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:40.014+0100 [mongosMain] connection accepted from 127.0.0.1:49679 #1431197 (401 connections now open) 2015-10-05T08:32:40.016+0100 [conn1431197] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:40.024+0100 [conn1431197] end connection 127.0.0.1:49679 (400 connections now open) 2015-10-05T08:32:40.052+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:32:40.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:32:40.448+0100 [conn1430839] end connection 172.28.0.164:58034 (399 connections now open) 2015-10-05T08:32:40.456+0100 [mongosMain] connection accepted from 172.28.0.164:59036 #1431198 (400 connections now open) 2015-10-05T08:32:40.457+0100 [conn1431198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:42.849+0100 [conn1430677] end connection 172.28.0.164:57533 (399 connections now open) 2015-10-05T08:32:42.850+0100 [mongosMain] connection accepted from 172.28.0.164:59039 #1431199 (400 connections now open) 2015-10-05T08:32:42.852+0100 [conn1431199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:46.222+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612279e5703b51053ee0a1d 2015-10-05T08:32:46.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:32:47.936+0100 [conn1430810] end connection 172.28.0.163:64949 (399 connections now open) 2015-10-05T08:32:47.938+0100 [mongosMain] connection accepted from 172.28.0.163:49690 #1431200 (400 connections now open) 2015-10-05T08:32:47.939+0100 [conn1431200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:48.498+0100 [conn1430836] end connection 172.28.0.163:65041 (399 connections now open) 2015-10-05T08:32:48.499+0100 [mongosMain] connection accepted from 172.28.0.163:49692 #1431201 (400 connections now open) 2015-10-05T08:32:48.500+0100 [conn1431201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:50.446+0100 [conn1430844] end connection 172.28.0.164:58050 (399 connections now open) 2015-10-05T08:32:50.447+0100 [mongosMain] connection accepted from 172.28.0.164:59051 #1431202 (400 connections now open) 2015-10-05T08:32:50.450+0100 [conn1431202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:52.927+0100 [conn1430644] end connection 172.28.0.164:57455 (399 connections now open) 2015-10-05T08:32:52.940+0100 [mongosMain] connection accepted from 172.28.0.164:59054 #1431203 (400 connections now open) 2015-10-05T08:32:52.943+0100 [conn1431203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:53.270+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:32:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:32:57.937+0100 [conn1430800] end connection 172.28.0.163:64927 (399 connections now open) 2015-10-05T08:32:57.938+0100 [mongosMain] connection accepted from 172.28.0.163:49702 #1431204 (400 connections now open) 2015-10-05T08:32:57.939+0100 [conn1431204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:58.514+0100 [conn1430842] end connection 172.28.0.163:65048 (399 connections now open) 2015-10-05T08:32:58.515+0100 [mongosMain] connection accepted from 172.28.0.163:49704 #1431205 (400 connections now open) 2015-10-05T08:32:58.516+0100 [conn1431205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:32:58.762+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:32:58.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:33:02.926+0100 [conn1430834] end connection 172.28.0.164:58018 (399 connections now open) 2015-10-05T08:33:02.928+0100 [mongosMain] connection accepted from 172.28.0.164:59073 #1431206 (400 connections now open) 2015-10-05T08:33:02.929+0100 [conn1431206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:04.598+0100 [conn1430680] end connection 172.28.0.163:64562 (399 connections now open) 2015-10-05T08:33:04.599+0100 [mongosMain] connection accepted from 172.28.0.163:49734 #1431207 (400 connections now open) 2015-10-05T08:33:04.600+0100 [conn1431207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:05.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227b05703b51053ee0b50 2015-10-05T08:33:05.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:07.952+0100 [conn1430819] end connection 172.28.0.163:64986 (399 connections now open) 2015-10-05T08:33:07.953+0100 [mongosMain] connection accepted from 172.28.0.163:49740 #1431208 (400 connections now open) 2015-10-05T08:33:07.954+0100 [conn1431208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:08.529+0100 [conn1430849] end connection 172.28.0.163:65067 (399 connections now open) 2015-10-05T08:33:08.530+0100 [mongosMain] connection accepted from 172.28.0.163:49743 #1431209 (400 connections now open) 2015-10-05T08:33:08.531+0100 [conn1431209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:10.462+0100 [conn1430856] end connection 172.28.0.164:58078 (399 connections now open) 2015-10-05T08:33:10.463+0100 [mongosMain] connection accepted from 172.28.0.164:59079 #1431210 (400 connections now open) 2015-10-05T08:33:10.465+0100 [conn1431210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:12.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227b75703b51053ee0bd7 2015-10-05T08:33:12.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:12.928+0100 [conn1430828] end connection 172.28.0.164:58006 (399 connections now open) 2015-10-05T08:33:12.929+0100 [mongosMain] connection accepted from 172.28.0.164:59080 #1431211 (400 connections now open) 2015-10-05T08:33:12.931+0100 [conn1431211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:17.952+0100 [conn1430824] end connection 172.28.0.163:65013 (399 connections now open) 2015-10-05T08:33:17.953+0100 [mongosMain] connection accepted from 172.28.0.163:49758 #1431212 (400 connections now open) 2015-10-05T08:33:17.953+0100 [conn1431212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:18.528+0100 [conn1430854] end connection 172.28.0.163:65077 (399 connections now open) 2015-10-05T08:33:18.530+0100 [mongosMain] connection accepted from 172.28.0.163:49760 #1431213 (400 connections now open) 2015-10-05T08:33:18.531+0100 [conn1431213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:18.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227be5703b51053ee0c2f 2015-10-05T08:33:19.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:20.478+0100 [conn1430851] end connection 172.28.0.164:58067 (399 connections now open) 2015-10-05T08:33:20.479+0100 [mongosMain] connection accepted from 172.28.0.164:59088 #1431214 (400 connections now open) 2015-10-05T08:33:20.480+0100 [conn1431214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:22.944+0100 [conn1430399] end connection 172.28.0.164:56718 (399 connections now open) 2015-10-05T08:33:22.946+0100 [mongosMain] connection accepted from 172.28.0.164:59093 #1431215 (400 connections now open) 2015-10-05T08:33:22.948+0100 [conn1431215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:24.980+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:33:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:33:25.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227c55703b51053ee0ca2 2015-10-05T08:33:25.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:27.968+0100 [conn1430848] end connection 172.28.0.163:65065 (399 connections now open) 2015-10-05T08:33:27.969+0100 [mongosMain] connection accepted from 172.28.0.163:49767 #1431216 (400 connections now open) 2015-10-05T08:33:27.971+0100 [conn1431216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:28.545+0100 [conn1430859] end connection 172.28.0.163:65105 (399 connections now open) 2015-10-05T08:33:28.546+0100 [mongosMain] connection accepted from 172.28.0.163:49769 #1431217 (400 connections now open) 2015-10-05T08:33:28.548+0100 [conn1431217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:28.790+0100 [mongosMain] connection accepted from 127.0.0.1:49771 #1431218 (401 connections now open) 2015-10-05T08:33:28.793+0100 [conn1431218] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:28.799+0100 [conn1431218] end connection 127.0.0.1:49771 (400 connections now open) 2015-10-05T08:33:29.854+0100 [conn1430812] end connection 172.28.0.164:57960 (399 connections now open) 2015-10-05T08:33:29.856+0100 [mongosMain] connection accepted from 172.28.0.164:59104 #1431219 (400 connections now open) 2015-10-05T08:33:29.858+0100 [conn1431219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:30.478+0100 [conn1430861] end connection 172.28.0.164:58102 (399 connections now open) 2015-10-05T08:33:30.479+0100 [mongosMain] connection accepted from 172.28.0.164:59106 #1431220 (400 connections now open) 2015-10-05T08:33:30.481+0100 [conn1431220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:32.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227cb5703b51053ee0d5b 2015-10-05T08:33:32.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:32.958+0100 [conn1430685] end connection 172.28.0.164:57555 (399 connections now open) 2015-10-05T08:33:32.958+0100 [mongosMain] connection accepted from 172.28.0.164:59111 #1431221 (400 connections now open) 2015-10-05T08:33:32.961+0100 [conn1431221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:37.984+0100 [conn1430841] end connection 172.28.0.163:65047 (399 connections now open) 2015-10-05T08:33:37.985+0100 [mongosMain] connection accepted from 172.28.0.163:49775 #1431222 (400 connections now open) 2015-10-05T08:33:37.986+0100 [conn1431222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:38.546+0100 [conn1430864] end connection 172.28.0.163:65118 (399 connections now open) 2015-10-05T08:33:38.548+0100 [mongosMain] connection accepted from 172.28.0.163:49777 #1431223 (400 connections now open) 2015-10-05T08:33:38.549+0100 [conn1431223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:38.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227d25703b51053ee0df5 2015-10-05T08:33:39.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:39.707+0100 [mongosMain] connection accepted from 127.0.0.1:49779 #1431224 (401 connections now open) 2015-10-05T08:33:39.709+0100 [conn1431224] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:39.713+0100 [conn1431224] end connection 127.0.0.1:49779 (400 connections now open) 2015-10-05T08:33:39.871+0100 [conn1430807] end connection 172.28.0.164:57943 (399 connections now open) 2015-10-05T08:33:39.872+0100 [mongosMain] connection accepted from 172.28.0.164:59125 #1431225 (400 connections now open) 2015-10-05T08:33:39.875+0100 [conn1431225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:40.495+0100 [conn1430871] end connection 172.28.0.164:58131 (399 connections now open) 2015-10-05T08:33:40.496+0100 [mongosMain] connection accepted from 172.28.0.164:59128 #1431226 (400 connections now open) 2015-10-05T08:33:40.499+0100 [conn1431226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:45.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227d95703b51053ee0e68 2015-10-05T08:33:45.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:47.984+0100 [conn1430853] end connection 172.28.0.163:65075 (399 connections now open) 2015-10-05T08:33:47.985+0100 [mongosMain] connection accepted from 172.28.0.163:49792 #1431227 (400 connections now open) 2015-10-05T08:33:47.986+0100 [conn1431227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:48.561+0100 [conn1430869] end connection 172.28.0.163:65128 (399 connections now open) 2015-10-05T08:33:48.561+0100 [mongosMain] connection accepted from 172.28.0.163:49794 #1431228 (400 connections now open) 2015-10-05T08:33:48.562+0100 [conn1431228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:49.888+0100 [conn1430832] end connection 172.28.0.164:58012 (399 connections now open) 2015-10-05T08:33:49.888+0100 [mongosMain] connection accepted from 172.28.0.164:59140 #1431229 (400 connections now open) 2015-10-05T08:33:49.888+0100 [conn1431229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:50.512+0100 [conn1430865] end connection 172.28.0.164:58113 (399 connections now open) 2015-10-05T08:33:50.512+0100 [mongosMain] connection accepted from 172.28.0.164:59143 #1431230 (400 connections now open) 2015-10-05T08:33:50.528+0100 [conn1431230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:51.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227df5703b51053ee0eed 2015-10-05T08:33:51.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:33:57.311+0100 [conn1430672] end connection 172.28.0.163:64548 (399 connections now open) 2015-10-05T08:33:57.315+0100 [conn1430666] end connection 172.28.0.163:64524 (398 connections now open) 2015-10-05T08:33:57.316+0100 [mongosMain] connection accepted from 172.28.0.163:49810 #1431231 (399 connections now open) 2015-10-05T08:33:57.317+0100 [mongosMain] connection accepted from 172.28.0.163:49811 #1431232 (400 connections now open) 2015-10-05T08:33:57.317+0100 [conn1431231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:57.318+0100 [conn1431232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:57.742+0100 [conn1430829] end connection 172.28.0.163:65021 (399 connections now open) 2015-10-05T08:33:57.743+0100 [mongosMain] connection accepted from 172.28.0.163:49814 #1431233 (400 connections now open) 2015-10-05T08:33:57.744+0100 [mongosMain] connection accepted from 172.28.0.163:49813 #1431234 (401 connections now open) 2015-10-05T08:33:57.744+0100 [mongosMain] connection accepted from 172.28.0.163:49815 #1431235 (402 connections now open) 2015-10-05T08:33:57.744+0100 [conn1431233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:57.744+0100 [conn1431234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:57.745+0100 [conn1431235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:57.824+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:33:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:33:57.875+0100 [mongosMain] connection accepted from 172.28.0.163:49816 #1431236 (403 connections now open) 2015-10-05T08:33:57.876+0100 [conn1431236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:58.000+0100 [conn1430858] end connection 172.28.0.163:65102 (402 connections now open) 2015-10-05T08:33:58.001+0100 [mongosMain] connection accepted from 172.28.0.163:49817 #1431237 (403 connections now open) 2015-10-05T08:33:58.002+0100 [conn1431237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:58.565+0100 [conn1430876] end connection 172.28.0.163:65138 (402 connections now open) 2015-10-05T08:33:58.566+0100 [mongosMain] connection accepted from 172.28.0.163:49819 #1431238 (403 connections now open) 2015-10-05T08:33:58.567+0100 [conn1431238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:59.180+0100 [mongosMain] connection accepted from 172.28.0.163:49822 #1431239 (404 connections now open) 2015-10-05T08:33:59.181+0100 [conn1431239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:59.743+0100 [mongosMain] connection accepted from 172.28.0.163:49825 #1431240 (405 connections now open) 2015-10-05T08:33:59.744+0100 [conn1431240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:33:59.886+0100 [conn1430826] end connection 172.28.0.164:58003 (404 connections now open) 2015-10-05T08:33:59.887+0100 [mongosMain] connection accepted from 172.28.0.164:59150 #1431241 (405 connections now open) 2015-10-05T08:33:59.889+0100 [conn1431241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:00.509+0100 [conn1430878] end connection 172.28.0.164:58151 (404 connections now open) 2015-10-05T08:34:00.511+0100 [mongosMain] connection accepted from 172.28.0.164:59152 #1431242 (405 connections now open) 2015-10-05T08:34:00.512+0100 [conn1431242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:08.576+0100 [conn1430882] end connection 172.28.0.163:65157 (404 connections now open) 2015-10-05T08:34:08.577+0100 [mongosMain] connection accepted from 172.28.0.163:49841 #1431243 (405 connections now open) 2015-10-05T08:34:08.578+0100 [conn1431243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:09.902+0100 [conn1430843] end connection 172.28.0.164:58048 (404 connections now open) 2015-10-05T08:34:09.903+0100 [mongosMain] connection accepted from 172.28.0.164:59171 #1431244 (405 connections now open) 2015-10-05T08:34:09.906+0100 [conn1431244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:10.533+0100 [conn1430884] end connection 172.28.0.164:58168 (404 connections now open) 2015-10-05T08:34:10.535+0100 [mongosMain] connection accepted from 172.28.0.164:59173 #1431245 (405 connections now open) 2015-10-05T08:34:10.536+0100 [conn1431245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:10.861+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:34:10.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:34:14.661+0100 [conn1430868] end connection 172.28.0.163:65123 (404 connections now open) 2015-10-05T08:34:14.662+0100 [mongosMain] connection accepted from 172.28.0.163:49849 #1431246 (405 connections now open) 2015-10-05T08:34:14.663+0100 [conn1431246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:17.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227f85703b51053ee1146 2015-10-05T08:34:17.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:34:18.577+0100 [conn1430890] end connection 172.28.0.163:65179 (404 connections now open) 2015-10-05T08:34:18.578+0100 [mongosMain] connection accepted from 172.28.0.163:49856 #1431247 (405 connections now open) 2015-10-05T08:34:18.579+0100 [conn1431247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:19.918+0100 [conn1430838] end connection 172.28.0.164:58030 (404 connections now open) 2015-10-05T08:34:19.919+0100 [mongosMain] connection accepted from 172.28.0.164:59182 #1431248 (405 connections now open) 2015-10-05T08:34:19.920+0100 [conn1431248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:20.525+0100 [conn1430892] end connection 172.28.0.164:58182 (404 connections now open) 2015-10-05T08:34:20.526+0100 [mongosMain] connection accepted from 172.28.0.164:59184 #1431249 (405 connections now open) 2015-10-05T08:34:20.527+0100 [conn1431249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:23.023+0100 [conn1430898] end connection 172.28.0.164:58203 (404 connections now open) 2015-10-05T08:34:23.024+0100 [mongosMain] connection accepted from 172.28.0.164:59191 #1431250 (405 connections now open) 2015-10-05T08:34:23.026+0100 [conn1431250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:23.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561227ff5703b51053ee1171 2015-10-05T08:34:23.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:34:24.661+0100 [conn1430880] end connection 172.28.0.163:65147 (404 connections now open) 2015-10-05T08:34:24.662+0100 [mongosMain] connection accepted from 172.28.0.163:49861 #1431251 (405 connections now open) 2015-10-05T08:34:24.663+0100 [conn1431251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:28.045+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:34:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:34:28.856+0100 [mongosMain] connection accepted from 127.0.0.1:49865 #1431252 (406 connections now open) 2015-10-05T08:34:28.859+0100 [conn1431252] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:28.865+0100 [conn1431252] end connection 127.0.0.1:49865 (405 connections now open) 2015-10-05T08:34:29.932+0100 [conn1430860] end connection 172.28.0.164:58100 (404 connections now open) 2015-10-05T08:34:29.934+0100 [mongosMain] connection accepted from 172.28.0.164:59200 #1431253 (405 connections now open) 2015-10-05T08:34:29.935+0100 [conn1431253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:30.541+0100 [conn1430903] end connection 172.28.0.164:58211 (404 connections now open) 2015-10-05T08:34:30.543+0100 [mongosMain] connection accepted from 172.28.0.164:59203 #1431254 (405 connections now open) 2015-10-05T08:34:30.545+0100 [conn1431254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:33.022+0100 [conn1430866] end connection 172.28.0.164:58119 (404 connections now open) 2015-10-05T08:34:33.023+0100 [mongosMain] connection accepted from 172.28.0.164:59210 #1431255 (405 connections now open) 2015-10-05T08:34:33.026+0100 [conn1431255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:34.681+0100 [conn1430777] end connection 172.28.0.163:64842 (404 connections now open) 2015-10-05T08:34:34.684+0100 [mongosMain] connection accepted from 172.28.0.163:49869 #1431256 (405 connections now open) 2015-10-05T08:34:34.684+0100 [conn1431256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:35.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612280b5703b51053ee11de 2015-10-05T08:34:35.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:34:38.608+0100 [conn1430897] end connection 172.28.0.163:65209 (404 connections now open) 2015-10-05T08:34:38.610+0100 [mongosMain] connection accepted from 172.28.0.163:49873 #1431257 (405 connections now open) 2015-10-05T08:34:38.611+0100 [conn1431257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:39.278+0100 [mongosMain] connection accepted from 127.0.0.1:49875 #1431258 (406 connections now open) 2015-10-05T08:34:39.280+0100 [conn1431258] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:39.287+0100 [conn1431258] end connection 127.0.0.1:49875 (405 connections now open) 2015-10-05T08:34:39.949+0100 [conn1430817] end connection 172.28.0.164:57974 (404 connections now open) 2015-10-05T08:34:39.950+0100 [mongosMain] connection accepted from 172.28.0.164:59221 #1431259 (405 connections now open) 2015-10-05T08:34:39.952+0100 [conn1431259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:40.564+0100 [conn1430909] end connection 172.28.0.164:58232 (404 connections now open) 2015-10-05T08:34:40.565+0100 [mongosMain] connection accepted from 172.28.0.164:59223 #1431260 (405 connections now open) 2015-10-05T08:34:40.567+0100 [conn1431260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:43.038+0100 [conn1430872] end connection 172.28.0.164:58135 (404 connections now open) 2015-10-05T08:34:43.038+0100 [conn1430632] end connection 172.28.0.164:57427 (403 connections now open) 2015-10-05T08:34:43.042+0100 [mongosMain] connection accepted from 172.28.0.164:59230 #1431261 (404 connections now open) 2015-10-05T08:34:43.042+0100 [mongosMain] connection accepted from 172.28.0.164:59229 #1431262 (405 connections now open) 2015-10-05T08:34:43.043+0100 [conn1431261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:43.043+0100 [conn1431262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:44.693+0100 [conn1430888] end connection 172.28.0.163:65166 (404 connections now open) 2015-10-05T08:34:44.694+0100 [mongosMain] connection accepted from 172.28.0.163:49882 #1431263 (405 connections now open) 2015-10-05T08:34:44.695+0100 [conn1431263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:48.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228175703b51053ee1248 2015-10-05T08:34:48.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:34:48.609+0100 [conn1430902] end connection 172.28.0.163:65226 (404 connections now open) 2015-10-05T08:34:48.610+0100 [mongosMain] connection accepted from 172.28.0.163:49888 #1431264 (405 connections now open) 2015-10-05T08:34:48.611+0100 [conn1431264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:50.573+0100 [conn1430916] end connection 172.28.0.164:58256 (404 connections now open) 2015-10-05T08:34:50.574+0100 [mongosMain] connection accepted from 172.28.0.164:59244 #1431265 (405 connections now open) 2015-10-05T08:34:50.575+0100 [conn1431265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:53.054+0100 [conn1430764] end connection 172.28.0.164:57813 (404 connections now open) 2015-10-05T08:34:53.055+0100 [conn1430885] end connection 172.28.0.164:58172 (403 connections now open) 2015-10-05T08:34:53.055+0100 [mongosMain] connection accepted from 172.28.0.164:59248 #1431266 (405 connections now open) 2015-10-05T08:34:53.056+0100 [mongosMain] connection accepted from 172.28.0.164:59249 #1431267 (405 connections now open) 2015-10-05T08:34:53.058+0100 [conn1431266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:53.058+0100 [conn1431267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:54.693+0100 [conn1430895] end connection 172.28.0.163:65199 (404 connections now open) 2015-10-05T08:34:54.694+0100 [mongosMain] connection accepted from 172.28.0.163:49898 #1431268 (405 connections now open) 2015-10-05T08:34:54.696+0100 [conn1431268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:58.624+0100 [conn1430914] end connection 172.28.0.163:65241 (404 connections now open) 2015-10-05T08:34:58.626+0100 [mongosMain] connection accepted from 172.28.0.163:49901 #1431269 (405 connections now open) 2015-10-05T08:34:58.627+0100 [conn1431269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:34:59.876+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:34:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:35:00.588+0100 [conn1430922] end connection 172.28.0.164:58278 (404 connections now open) 2015-10-05T08:35:00.589+0100 [mongosMain] connection accepted from 172.28.0.164:59254 #1431270 (405 connections now open) 2015-10-05T08:35:00.591+0100 [conn1431270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:03.280+0100 [conn1430760] end connection 172.28.0.164:57797 (404 connections now open) 2015-10-05T08:35:03.280+0100 [conn1430893] end connection 172.28.0.164:58185 (403 connections now open) 2015-10-05T08:35:03.283+0100 [mongosMain] connection accepted from 172.28.0.164:59262 #1431271 (404 connections now open) 2015-10-05T08:35:03.284+0100 [conn1431271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:03.287+0100 [mongosMain] connection accepted from 172.28.0.164:59264 #1431272 (405 connections now open) 2015-10-05T08:35:03.289+0100 [conn1431272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:03.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228255703b51053ee12a0 2015-10-05T08:35:03.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:35:04.708+0100 [conn1430671] end connection 172.28.0.163:64547 (404 connections now open) 2015-10-05T08:35:04.709+0100 [mongosMain] connection accepted from 172.28.0.163:49925 #1431273 (405 connections now open) 2015-10-05T08:35:04.710+0100 [conn1431273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:08.625+0100 [conn1430921] end connection 172.28.0.163:65261 (404 connections now open) 2015-10-05T08:35:08.626+0100 [mongosMain] connection accepted from 172.28.0.163:49930 #1431274 (405 connections now open) 2015-10-05T08:35:08.627+0100 [conn1431274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:10.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612282e5703b51053ee132f 2015-10-05T08:35:10.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:35:13.272+0100 [conn1430886] end connection 172.28.0.164:58173 (404 connections now open) 2015-10-05T08:35:13.276+0100 [mongosMain] connection accepted from 172.28.0.164:59276 #1431275 (405 connections now open) 2015-10-05T08:35:13.276+0100 [conn1430867] end connection 172.28.0.164:58118 (403 connections now open) 2015-10-05T08:35:13.277+0100 [mongosMain] connection accepted from 172.28.0.164:59277 #1431276 (405 connections now open) 2015-10-05T08:35:13.277+0100 [conn1431275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:13.278+0100 [conn1431276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:14.709+0100 [conn1430874] end connection 172.28.0.163:65131 (404 connections now open) 2015-10-05T08:35:14.710+0100 [mongosMain] connection accepted from 172.28.0.163:49949 #1431277 (405 connections now open) 2015-10-05T08:35:14.711+0100 [conn1431277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:18.640+0100 [conn1430927] end connection 172.28.0.163:65280 (404 connections now open) 2015-10-05T08:35:18.641+0100 [mongosMain] connection accepted from 172.28.0.163:49954 #1431278 (405 connections now open) 2015-10-05T08:35:18.642+0100 [conn1431278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:19.979+0100 [conn1430821] end connection 172.28.0.164:57984 (404 connections now open) 2015-10-05T08:35:19.981+0100 [mongosMain] connection accepted from 172.28.0.164:59283 #1431279 (405 connections now open) 2015-10-05T08:35:19.984+0100 [conn1431279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:20.604+0100 [conn1430928] end connection 172.28.0.164:58291 (404 connections now open) 2015-10-05T08:35:20.605+0100 [mongosMain] connection accepted from 172.28.0.164:59286 #1431280 (405 connections now open) 2015-10-05T08:35:20.607+0100 [conn1431280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:24.143+0100 [conn1430894] end connection 172.28.0.164:58188 (404 connections now open) 2015-10-05T08:35:24.152+0100 [conn1430852] end connection 172.28.0.164:58070 (403 connections now open) 2015-10-05T08:35:24.153+0100 [mongosMain] connection accepted from 172.28.0.164:59292 #1431281 (404 connections now open) 2015-10-05T08:35:24.155+0100 [conn1431281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:24.162+0100 [mongosMain] connection accepted from 172.28.0.164:59294 #1431282 (405 connections now open) 2015-10-05T08:35:24.163+0100 [conn1431282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:24.336+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561228393b0f755fc334336a') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444030523415), why: "doing balance round", ts: ObjectId('5612283b5703b51053ee13d0') } } gle1: { lastOp: Timestamp 1444030510000|5, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 52, writtenTo: null, err: null, waited: 52, ok: 1.0 } gle2: { lastOp: Timestamp 1444030524000|1, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2015-10-05T08:35:24.340+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:35:24.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612283b5703b51053ee13d0 2015-10-05T08:35:24.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:35:24.724+0100 [conn1430900] end connection 172.28.0.163:65218 (404 connections now open) 2015-10-05T08:35:24.725+0100 [mongosMain] connection accepted from 172.28.0.163:49958 #1431283 (405 connections now open) 2015-10-05T08:35:24.726+0100 [conn1431283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:28.079+0100 [conn1430875] end connection 172.28.0.163:65136 (404 connections now open) 2015-10-05T08:35:28.080+0100 [mongosMain] connection accepted from 172.28.0.163:49960 #1431284 (405 connections now open) 2015-10-05T08:35:28.081+0100 [conn1431284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:28.643+0100 [conn1430933] end connection 172.28.0.163:65313 (404 connections now open) 2015-10-05T08:35:28.645+0100 [mongosMain] connection accepted from 172.28.0.163:49962 #1431285 (405 connections now open) 2015-10-05T08:35:28.646+0100 [conn1431285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:28.662+0100 [mongosMain] connection accepted from 127.0.0.1:49964 #1431286 (406 connections now open) 2015-10-05T08:35:28.665+0100 [conn1431286] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:28.670+0100 [conn1431286] end connection 127.0.0.1:49964 (405 connections now open) 2015-10-05T08:35:30.028+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:35:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:35:30.619+0100 [conn1430938] end connection 172.28.0.164:58321 (404 connections now open) 2015-10-05T08:35:30.620+0100 [mongosMain] connection accepted from 172.28.0.164:59303 #1431287 (405 connections now open) 2015-10-05T08:35:30.622+0100 [conn1431287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:30.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228425703b51053ee1408 2015-10-05T08:35:31.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:35:33.942+0100 [conn1430758] end connection 172.28.0.164:57785 (404 connections now open) 2015-10-05T08:35:33.943+0100 [conn1430602] end connection 172.28.0.164:57351 (403 connections now open) 2015-10-05T08:35:33.944+0100 [mongosMain] connection accepted from 172.28.0.164:59309 #1431288 (404 connections now open) 2015-10-05T08:35:33.944+0100 [mongosMain] connection accepted from 172.28.0.164:59310 #1431289 (405 connections now open) 2015-10-05T08:35:33.946+0100 [conn1431289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:33.946+0100 [conn1431288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:35.386+0100 [conn1430720] end connection 172.28.0.163:64664 (404 connections now open) 2015-10-05T08:35:35.394+0100 [mongosMain] connection accepted from 172.28.0.163:49973 #1431290 (405 connections now open) 2015-10-05T08:35:35.395+0100 [conn1431290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:38.079+0100 [conn1430863] end connection 172.28.0.163:65116 (404 connections now open) 2015-10-05T08:35:38.080+0100 [mongosMain] connection accepted from 172.28.0.163:49977 #1431291 (405 connections now open) 2015-10-05T08:35:38.082+0100 [conn1431291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:38.655+0100 [conn1430937] end connection 172.28.0.163:65330 (404 connections now open) 2015-10-05T08:35:38.656+0100 [mongosMain] connection accepted from 172.28.0.163:49979 #1431292 (405 connections now open) 2015-10-05T08:35:38.657+0100 [conn1431292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:40.622+0100 [conn1430946] end connection 172.28.0.164:58339 (404 connections now open) 2015-10-05T08:35:40.623+0100 [mongosMain] connection accepted from 172.28.0.164:59321 #1431293 (405 connections now open) 2015-10-05T08:35:40.625+0100 [conn1431293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:43.957+0100 [conn1430857] end connection 172.28.0.164:58084 (404 connections now open) 2015-10-05T08:35:43.958+0100 [conn1430756] end connection 172.28.0.164:57770 (404 connections now open) 2015-10-05T08:35:43.958+0100 [mongosMain] connection accepted from 172.28.0.164:59325 #1431294 (404 connections now open) 2015-10-05T08:35:43.959+0100 [mongosMain] connection accepted from 172.28.0.164:59326 #1431295 (405 connections now open) 2015-10-05T08:35:43.960+0100 [conn1431294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:43.960+0100 [conn1431295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:44.819+0100 [conn1430783] end connection 172.28.0.163:64857 (404 connections now open) 2015-10-05T08:35:44.820+0100 [mongosMain] connection accepted from 172.28.0.163:49983 #1431296 (405 connections now open) 2015-10-05T08:35:44.822+0100 [conn1431296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:48.671+0100 [conn1430943] end connection 172.28.0.163:65343 (404 connections now open) 2015-10-05T08:35:48.672+0100 [mongosMain] connection accepted from 172.28.0.163:49987 #1431297 (405 connections now open) 2015-10-05T08:35:48.672+0100 [conn1431297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:50.636+0100 [conn1430953] end connection 172.28.0.164:58359 (404 connections now open) 2015-10-05T08:35:50.637+0100 [mongosMain] connection accepted from 172.28.0.164:59330 #1431298 (405 connections now open) 2015-10-05T08:35:50.638+0100 [conn1431298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:50.958+0100 [mongosMain] connection accepted from 127.0.0.1:49989 #1431299 (406 connections now open) 2015-10-05T08:35:50.962+0100 [conn1431299] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:50.966+0100 [conn1431299] end connection 127.0.0.1:49989 (405 connections now open) 2015-10-05T08:35:53.959+0100 [conn1430746] end connection 172.28.0.164:57723 (404 connections now open) 2015-10-05T08:35:53.959+0100 [conn1430918] end connection 172.28.0.164:58260 (403 connections now open) 2015-10-05T08:35:53.960+0100 [mongosMain] connection accepted from 172.28.0.164:59346 #1431300 (404 connections now open) 2015-10-05T08:35:53.960+0100 [mongosMain] connection accepted from 172.28.0.164:59347 #1431301 (405 connections now open) 2015-10-05T08:35:53.961+0100 [conn1431300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:53.962+0100 [conn1431301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:54.819+0100 [conn1430265] end connection 172.28.0.163:63389 (404 connections now open) 2015-10-05T08:35:54.819+0100 [conn1430770] end connection 172.28.0.163:64825 (404 connections now open) 2015-10-05T08:35:54.820+0100 [mongosMain] connection accepted from 172.28.0.163:50006 #1431302 (404 connections now open) 2015-10-05T08:35:54.822+0100 [conn1431302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:35:57.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612285b5703b51053ee165c 2015-10-05T08:35:57.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:35:58.674+0100 [conn1430959] end connection 172.28.0.163:65372 (403 connections now open) 2015-10-05T08:35:58.675+0100 [mongosMain] connection accepted from 172.28.0.163:50014 #1431303 (404 connections now open) 2015-10-05T08:35:58.676+0100 [conn1431303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:00.295+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:36:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:36:00.651+0100 [conn1430960] end connection 172.28.0.164:58376 (403 connections now open) 2015-10-05T08:36:00.653+0100 [mongosMain] connection accepted from 172.28.0.164:59353 #1431304 (404 connections now open) 2015-10-05T08:36:00.654+0100 [conn1431304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:03.975+0100 [conn1430846] end connection 172.28.0.164:58054 (403 connections now open) 2015-10-05T08:36:03.975+0100 [conn1430804] end connection 172.28.0.164:57930 (402 connections now open) 2015-10-05T08:36:03.976+0100 [mongosMain] connection accepted from 172.28.0.164:59369 #1431305 (403 connections now open) 2015-10-05T08:36:03.977+0100 [mongosMain] connection accepted from 172.28.0.164:59368 #1431306 (404 connections now open) 2015-10-05T08:36:03.978+0100 [conn1431305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:03.979+0100 [conn1431306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:04.528+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612286138482111da12db6a') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444030564158), why: "doing balance round", ts: ObjectId('561228645703b51053ee172a') } } gle1: { lastOp: Timestamp 1444030564000|1, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1444030557000|3, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2015-10-05T08:36:04.533+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:36:04.834+0100 [conn1430906] end connection 172.28.0.163:65229 (403 connections now open) 2015-10-05T08:36:04.835+0100 [mongosMain] connection accepted from 172.28.0.163:50034 #1431307 (404 connections now open) 2015-10-05T08:36:04.837+0100 [conn1431307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:04.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228645703b51053ee172a 2015-10-05T08:36:05.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:08.110+0100 [conn1430881] end connection 172.28.0.163:65156 (403 connections now open) 2015-10-05T08:36:08.111+0100 [mongosMain] connection accepted from 172.28.0.163:50038 #1431308 (404 connections now open) 2015-10-05T08:36:08.112+0100 [conn1431308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:08.687+0100 [conn1430965] end connection 172.28.0.163:65383 (403 connections now open) 2015-10-05T08:36:08.688+0100 [mongosMain] connection accepted from 172.28.0.163:50042 #1431309 (404 connections now open) 2015-10-05T08:36:08.689+0100 [conn1431309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:10.668+0100 [conn1430966] end connection 172.28.0.164:58389 (403 connections now open) 2015-10-05T08:36:10.669+0100 [mongosMain] connection accepted from 172.28.0.164:59373 #1431310 (404 connections now open) 2015-10-05T08:36:10.672+0100 [conn1431310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:13.990+0100 [conn1430879] end connection 172.28.0.164:58155 (403 connections now open) 2015-10-05T08:36:13.990+0100 [conn1430609] end connection 172.28.0.164:57366 (402 connections now open) 2015-10-05T08:36:13.991+0100 [mongosMain] connection accepted from 172.28.0.164:59375 #1431311 (403 connections now open) 2015-10-05T08:36:13.991+0100 [mongosMain] connection accepted from 172.28.0.164:59376 #1431312 (404 connections now open) 2015-10-05T08:36:13.993+0100 [conn1431311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:13.993+0100 [conn1431312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:15.831+0100 [conn1430733] end connection 172.28.0.163:64682 (403 connections now open) 2015-10-05T08:36:15.836+0100 [mongosMain] connection accepted from 172.28.0.163:50052 #1431313 (404 connections now open) 2015-10-05T08:36:15.838+0100 [conn1431313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:17.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228715703b51053ee188d 2015-10-05T08:36:17.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:18.688+0100 [conn1430972] end connection 172.28.0.163:65421 (403 connections now open) 2015-10-05T08:36:18.689+0100 [mongosMain] connection accepted from 172.28.0.163:50055 #1431314 (404 connections now open) 2015-10-05T08:36:18.691+0100 [conn1431314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:20.060+0100 [conn1430891] end connection 172.28.0.164:58180 (403 connections now open) 2015-10-05T08:36:20.061+0100 [mongosMain] connection accepted from 172.28.0.164:59384 #1431315 (404 connections now open) 2015-10-05T08:36:20.064+0100 [conn1431315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:24.007+0100 [conn1430924] end connection 172.28.0.164:58284 (403 connections now open) 2015-10-05T08:36:24.008+0100 [conn1430923] end connection 172.28.0.164:58283 (402 connections now open) 2015-10-05T08:36:24.009+0100 [mongosMain] connection accepted from 172.28.0.164:59391 #1431316 (403 connections now open) 2015-10-05T08:36:24.011+0100 [conn1431316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:24.011+0100 [mongosMain] connection accepted from 172.28.0.164:59392 #1431317 (404 connections now open) 2015-10-05T08:36:24.013+0100 [conn1431317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:24.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228775703b51053ee1944 2015-10-05T08:36:24.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:25.816+0100 [conn1430925] end connection 172.28.0.163:65270 (403 connections now open) 2015-10-05T08:36:25.817+0100 [mongosMain] connection accepted from 172.28.0.163:50060 #1431318 (404 connections now open) 2015-10-05T08:36:25.818+0100 [conn1431318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:28.703+0100 [conn1430980] end connection 172.28.0.163:65437 (403 connections now open) 2015-10-05T08:36:28.704+0100 [mongosMain] connection accepted from 172.28.0.163:50063 #1431319 (404 connections now open) 2015-10-05T08:36:28.705+0100 [conn1431319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:29.160+0100 [mongosMain] connection accepted from 127.0.0.1:50065 #1431320 (405 connections now open) 2015-10-05T08:36:29.163+0100 [conn1431320] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:29.173+0100 [conn1431320] end connection 127.0.0.1:50065 (404 connections now open) 2015-10-05T08:36:30.074+0100 [conn1430973] end connection 172.28.0.164:58402 (403 connections now open) 2015-10-05T08:36:30.075+0100 [mongosMain] connection accepted from 172.28.0.164:59402 #1431321 (404 connections now open) 2015-10-05T08:36:30.085+0100 [conn1431321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:30.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612287e5703b51053ee19a2 2015-10-05T08:36:30.577+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:36:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:36:30.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:30.698+0100 [conn1430982] end connection 172.28.0.164:58418 (403 connections now open) 2015-10-05T08:36:30.699+0100 [mongosMain] connection accepted from 172.28.0.164:59406 #1431322 (404 connections now open) 2015-10-05T08:36:30.700+0100 [conn1431322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:34.021+0100 [conn1430917] end connection 172.28.0.164:58262 (403 connections now open) 2015-10-05T08:36:34.022+0100 [conn1430694] end connection 172.28.0.164:57575 (402 connections now open) 2015-10-05T08:36:34.023+0100 [mongosMain] connection accepted from 172.28.0.164:59411 #1431323 (403 connections now open) 2015-10-05T08:36:34.024+0100 [mongosMain] connection accepted from 172.28.0.164:59412 #1431324 (404 connections now open) 2015-10-05T08:36:34.025+0100 [conn1431323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:34.026+0100 [conn1431324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:35.821+0100 [conn1430932] end connection 172.28.0.163:65304 (403 connections now open) 2015-10-05T08:36:35.823+0100 [mongosMain] connection accepted from 172.28.0.163:50068 #1431325 (404 connections now open) 2015-10-05T08:36:35.824+0100 [conn1431325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:36.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228845703b51053ee19e7 2015-10-05T08:36:36.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:38.142+0100 [conn1430971] end connection 172.28.0.163:65418 (403 connections now open) 2015-10-05T08:36:38.143+0100 [mongosMain] connection accepted from 172.28.0.163:50070 #1431326 (404 connections now open) 2015-10-05T08:36:38.145+0100 [conn1431326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:38.704+0100 [conn1430987] end connection 172.28.0.163:65448 (403 connections now open) 2015-10-05T08:36:38.705+0100 [mongosMain] connection accepted from 172.28.0.163:50073 #1431327 (404 connections now open) 2015-10-05T08:36:38.707+0100 [conn1431327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:39.267+0100 [mongosMain] connection accepted from 127.0.0.1:50075 #1431328 (405 connections now open) 2015-10-05T08:36:39.269+0100 [conn1431328] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:39.274+0100 [conn1431328] end connection 127.0.0.1:50075 (404 connections now open) 2015-10-05T08:36:40.074+0100 [conn1430850] end connection 172.28.0.164:58065 (403 connections now open) 2015-10-05T08:36:40.075+0100 [mongosMain] connection accepted from 172.28.0.164:59423 #1431329 (404 connections now open) 2015-10-05T08:36:40.081+0100 [conn1431329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:40.704+0100 [conn1430974] end connection 172.28.0.164:58404 (403 connections now open) 2015-10-05T08:36:40.704+0100 [mongosMain] connection accepted from 172.28.0.164:59425 #1431330 (404 connections now open) 2015-10-05T08:36:40.706+0100 [conn1431330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:43.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612288a5703b51053ee1a30 2015-10-05T08:36:43.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:44.037+0100 [conn1430910] end connection 172.28.0.164:58236 (403 connections now open) 2015-10-05T08:36:44.037+0100 [mongosMain] connection accepted from 172.28.0.164:59433 #1431331 (404 connections now open) 2015-10-05T08:36:44.038+0100 [conn1430934] end connection 172.28.0.164:58314 (403 connections now open) 2015-10-05T08:36:44.038+0100 [conn1431331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:44.038+0100 [mongosMain] connection accepted from 172.28.0.164:59434 #1431332 (404 connections now open) 2015-10-05T08:36:44.039+0100 [conn1431332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:45.856+0100 [conn1430919] end connection 172.28.0.163:65252 (403 connections now open) 2015-10-05T08:36:45.862+0100 [mongosMain] connection accepted from 172.28.0.163:50084 #1431333 (404 connections now open) 2015-10-05T08:36:45.863+0100 [conn1431333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:48.141+0100 [conn1430835] end connection 172.28.0.163:65039 (403 connections now open) 2015-10-05T08:36:48.142+0100 [mongosMain] connection accepted from 172.28.0.163:50087 #1431334 (404 connections now open) 2015-10-05T08:36:48.143+0100 [conn1431334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:48.726+0100 [conn1430995] end connection 172.28.0.163:65457 (403 connections now open) 2015-10-05T08:36:48.728+0100 [mongosMain] connection accepted from 172.28.0.163:50091 #1431335 (404 connections now open) 2015-10-05T08:36:48.729+0100 [conn1431335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:50.092+0100 [conn1430855] end connection 172.28.0.164:58075 (403 connections now open) 2015-10-05T08:36:50.093+0100 [mongosMain] connection accepted from 172.28.0.164:59443 #1431336 (404 connections now open) 2015-10-05T08:36:50.095+0100 [conn1431336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:50.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228915703b51053ee1a7e 2015-10-05T08:36:50.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:50.713+0100 [conn1430990] end connection 172.28.0.164:58439 (403 connections now open) 2015-10-05T08:36:50.715+0100 [mongosMain] connection accepted from 172.28.0.164:59444 #1431337 (404 connections now open) 2015-10-05T08:36:50.718+0100 [conn1431337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:54.053+0100 [conn1430905] end connection 172.28.0.164:58219 (403 connections now open) 2015-10-05T08:36:54.053+0100 [conn1430798] end connection 172.28.0.164:57918 (403 connections now open) 2015-10-05T08:36:54.056+0100 [mongosMain] connection accepted from 172.28.0.164:59446 #1431338 (403 connections now open) 2015-10-05T08:36:54.056+0100 [mongosMain] connection accepted from 172.28.0.164:59447 #1431339 (404 connections now open) 2015-10-05T08:36:54.058+0100 [conn1431338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:54.059+0100 [conn1431339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:55.841+0100 [conn1430708] end connection 172.28.0.163:64631 (403 connections now open) 2015-10-05T08:36:55.842+0100 [mongosMain] connection accepted from 172.28.0.163:50095 #1431340 (404 connections now open) 2015-10-05T08:36:55.843+0100 [conn1431340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:57.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228985703b51053ee1abe 2015-10-05T08:36:57.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:36:58.158+0100 [conn1430958] end connection 172.28.0.163:65370 (403 connections now open) 2015-10-05T08:36:58.159+0100 [mongosMain] connection accepted from 172.28.0.163:50096 #1431341 (404 connections now open) 2015-10-05T08:36:58.160+0100 [conn1431341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:36:58.719+0100 [conn1431002] end connection 172.28.0.163:65471 (403 connections now open) 2015-10-05T08:36:58.720+0100 [mongosMain] connection accepted from 172.28.0.163:50097 #1431342 (404 connections now open) 2015-10-05T08:36:58.721+0100 [conn1431342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:00.090+0100 [conn1430952] end connection 172.28.0.164:58356 (403 connections now open) 2015-10-05T08:37:00.091+0100 [mongosMain] connection accepted from 172.28.0.164:59449 #1431343 (404 connections now open) 2015-10-05T08:37:00.093+0100 [conn1431343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:00.714+0100 [conn1430998] end connection 172.28.0.164:58461 (403 connections now open) 2015-10-05T08:37:00.717+0100 [mongosMain] connection accepted from 172.28.0.164:59460 #1431344 (404 connections now open) 2015-10-05T08:37:00.719+0100 [conn1431344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:00.833+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:37:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:37:04.069+0100 [conn1430659] end connection 172.28.0.164:57493 (403 connections now open) 2015-10-05T08:37:04.069+0100 [conn1430793] end connection 172.28.0.164:57896 (403 connections now open) 2015-10-05T08:37:04.070+0100 [mongosMain] connection accepted from 172.28.0.164:59472 #1431345 (403 connections now open) 2015-10-05T08:37:04.070+0100 [mongosMain] connection accepted from 172.28.0.164:59473 #1431346 (404 connections now open) 2015-10-05T08:37:04.071+0100 [conn1431345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:04.071+0100 [conn1431346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:04.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612289f5703b51053ee1b30 2015-10-05T08:37:04.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:05.848+0100 [conn1430913] end connection 172.28.0.163:65236 (403 connections now open) 2015-10-05T08:37:05.850+0100 [mongosMain] connection accepted from 172.28.0.163:50120 #1431347 (404 connections now open) 2015-10-05T08:37:05.851+0100 [conn1431347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:08.158+0100 [conn1430979] end connection 172.28.0.163:65434 (403 connections now open) 2015-10-05T08:37:08.159+0100 [mongosMain] connection accepted from 172.28.0.163:50122 #1431348 (404 connections now open) 2015-10-05T08:37:08.160+0100 [conn1431348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:08.735+0100 [conn1431008] end connection 172.28.0.163:65480 (403 connections now open) 2015-10-05T08:37:08.736+0100 [mongosMain] connection accepted from 172.28.0.163:50124 #1431349 (404 connections now open) 2015-10-05T08:37:08.738+0100 [conn1431349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:10.106+0100 [conn1430945] end connection 172.28.0.164:58336 (403 connections now open) 2015-10-05T08:37:10.107+0100 [mongosMain] connection accepted from 172.28.0.164:59476 #1431350 (404 connections now open) 2015-10-05T08:37:10.109+0100 [conn1431350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:10.729+0100 [conn1431004] end connection 172.28.0.164:58476 (403 connections now open) 2015-10-05T08:37:10.730+0100 [mongosMain] connection accepted from 172.28.0.164:59478 #1431351 (404 connections now open) 2015-10-05T08:37:10.732+0100 [conn1431351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:10.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228a65703b51053ee1bdf 2015-10-05T08:37:11.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:14.084+0100 [conn1430930] end connection 172.28.0.164:58305 (403 connections now open) 2015-10-05T08:37:14.085+0100 [conn1430911] end connection 172.28.0.164:58237 (402 connections now open) 2015-10-05T08:37:14.086+0100 [mongosMain] connection accepted from 172.28.0.164:59481 #1431352 (403 connections now open) 2015-10-05T08:37:14.086+0100 [mongosMain] connection accepted from 172.28.0.164:59482 #1431353 (404 connections now open) 2015-10-05T08:37:14.087+0100 [conn1431352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:14.088+0100 [conn1431353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:15.863+0100 [conn1430935] end connection 172.28.0.163:65320 (403 connections now open) 2015-10-05T08:37:15.863+0100 [mongosMain] connection accepted from 172.28.0.163:50138 #1431354 (404 connections now open) 2015-10-05T08:37:15.864+0100 [conn1431354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:17.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228ad5703b51053ee1c34 2015-10-05T08:37:17.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:18.173+0100 [conn1430994] end connection 172.28.0.163:65455 (403 connections now open) 2015-10-05T08:37:18.174+0100 [mongosMain] connection accepted from 172.28.0.163:50143 #1431355 (404 connections now open) 2015-10-05T08:37:18.175+0100 [conn1431355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:18.750+0100 [conn1431016] end connection 172.28.0.163:65515 (403 connections now open) 2015-10-05T08:37:18.751+0100 [mongosMain] connection accepted from 172.28.0.163:50144 #1431356 (404 connections now open) 2015-10-05T08:37:18.752+0100 [conn1431356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:20.122+0100 [conn1430989] end connection 172.28.0.164:58436 (403 connections now open) 2015-10-05T08:37:20.122+0100 [mongosMain] connection accepted from 172.28.0.164:59487 #1431357 (404 connections now open) 2015-10-05T08:37:20.124+0100 [conn1431357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:20.746+0100 [conn1431010] end connection 172.28.0.164:58495 (403 connections now open) 2015-10-05T08:37:20.747+0100 [mongosMain] connection accepted from 172.28.0.164:59492 #1431358 (404 connections now open) 2015-10-05T08:37:20.749+0100 [conn1431358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:23.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228b35703b51053ee1c8a 2015-10-05T08:37:24.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:24.083+0100 [conn1430873] end connection 172.28.0.164:58136 (403 connections now open) 2015-10-05T08:37:24.084+0100 [conn1430940] end connection 172.28.0.164:58325 (402 connections now open) 2015-10-05T08:37:24.085+0100 [mongosMain] connection accepted from 172.28.0.164:59499 #1431359 (403 connections now open) 2015-10-05T08:37:24.085+0100 [mongosMain] connection accepted from 172.28.0.164:59500 #1431360 (404 connections now open) 2015-10-05T08:37:24.086+0100 [conn1431360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:24.087+0100 [conn1431359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:25.864+0100 [conn1430727] end connection 172.28.0.163:64672 (403 connections now open) 2015-10-05T08:37:25.866+0100 [mongosMain] connection accepted from 172.28.0.163:50148 #1431361 (404 connections now open) 2015-10-05T08:37:25.866+0100 [conn1431361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:28.581+0100 [mongosMain] connection accepted from 127.0.0.1:50150 #1431362 (405 connections now open) 2015-10-05T08:37:28.583+0100 [conn1431362] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:28.588+0100 [conn1431362] end connection 127.0.0.1:50150 (404 connections now open) 2015-10-05T08:37:28.753+0100 [conn1431024] end connection 172.28.0.163:65530 (403 connections now open) 2015-10-05T08:37:28.754+0100 [mongosMain] connection accepted from 172.28.0.163:50151 #1431363 (404 connections now open) 2015-10-05T08:37:28.756+0100 [conn1431363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:30.139+0100 [conn1430981] end connection 172.28.0.164:58415 (403 connections now open) 2015-10-05T08:37:30.139+0100 [mongosMain] connection accepted from 172.28.0.164:59508 #1431364 (404 connections now open) 2015-10-05T08:37:30.141+0100 [conn1431364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:30.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228ba5703b51053ee1d04 2015-10-05T08:37:30.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:30.747+0100 [conn1431018] end connection 172.28.0.164:58514 (403 connections now open) 2015-10-05T08:37:30.749+0100 [mongosMain] connection accepted from 172.28.0.164:59510 #1431365 (404 connections now open) 2015-10-05T08:37:30.752+0100 [conn1431365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:31.084+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:37:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:37:34.099+0100 [conn1430769] end connection 172.28.0.164:57828 (403 connections now open) 2015-10-05T08:37:34.100+0100 [mongosMain] connection accepted from 172.28.0.164:59515 #1431366 (404 connections now open) 2015-10-05T08:37:34.101+0100 [conn1431366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:35.879+0100 [conn1430969] end connection 172.28.0.163:65409 (403 connections now open) 2015-10-05T08:37:35.881+0100 [mongosMain] connection accepted from 172.28.0.163:50156 #1431367 (404 connections now open) 2015-10-05T08:37:35.882+0100 [conn1431367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:36.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228c05703b51053ee1d64 2015-10-05T08:37:37.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:38.766+0100 [conn1431031] end connection 172.28.0.163:49162 (403 connections now open) 2015-10-05T08:37:38.767+0100 [mongosMain] connection accepted from 172.28.0.163:50159 #1431368 (404 connections now open) 2015-10-05T08:37:38.768+0100 [conn1431368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:40.153+0100 [conn1430883] end connection 172.28.0.164:58165 (403 connections now open) 2015-10-05T08:37:40.153+0100 [mongosMain] connection accepted from 172.28.0.164:59523 #1431369 (404 connections now open) 2015-10-05T08:37:40.155+0100 [conn1431369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:40.763+0100 [conn1431026] end connection 172.28.0.164:58527 (403 connections now open) 2015-10-05T08:37:40.765+0100 [mongosMain] connection accepted from 172.28.0.164:59526 #1431370 (404 connections now open) 2015-10-05T08:37:40.766+0100 [conn1431370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:44.119+0100 [conn1430961] end connection 172.28.0.164:58380 (403 connections now open) 2015-10-05T08:37:44.120+0100 [mongosMain] connection accepted from 172.28.0.164:59529 #1431371 (404 connections now open) 2015-10-05T08:37:44.121+0100 [conn1431371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:44.452+0100 [mongosMain] connection accepted from 127.0.0.1:50162 #1431372 (405 connections now open) 2015-10-05T08:37:44.454+0100 [conn1431372] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:44.459+0100 [conn1431372] end connection 127.0.0.1:50162 (404 connections now open) 2015-10-05T08:37:46.164+0100 [conn1431007] end connection 172.28.0.163:65476 (403 connections now open) 2015-10-05T08:37:46.177+0100 [mongosMain] connection accepted from 172.28.0.163:50165 #1431373 (404 connections now open) 2015-10-05T08:37:46.178+0100 [conn1431373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:50.153+0100 [conn1430997] end connection 172.28.0.164:58459 (403 connections now open) 2015-10-05T08:37:50.155+0100 [mongosMain] connection accepted from 172.28.0.164:59545 #1431374 (404 connections now open) 2015-10-05T08:37:50.157+0100 [conn1431374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:50.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228ce5703b51053ee1e3f 2015-10-05T08:37:50.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:37:50.772+0100 [conn1431034] end connection 172.28.0.164:58545 (403 connections now open) 2015-10-05T08:37:50.773+0100 [mongosMain] connection accepted from 172.28.0.164:59549 #1431375 (404 connections now open) 2015-10-05T08:37:50.775+0100 [conn1431375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:54.131+0100 [conn1430955] end connection 172.28.0.164:58364 (403 connections now open) 2015-10-05T08:37:54.133+0100 [mongosMain] connection accepted from 172.28.0.164:59555 #1431376 (404 connections now open) 2015-10-05T08:37:54.134+0100 [conn1431376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:56.129+0100 [conn1430986] end connection 172.28.0.163:65445 (403 connections now open) 2015-10-05T08:37:56.131+0100 [mongosMain] connection accepted from 172.28.0.163:50186 #1431377 (404 connections now open) 2015-10-05T08:37:56.132+0100 [conn1431377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:37:58.782+0100 [conn1431039] end connection 172.28.0.163:49171 (403 connections now open) 2015-10-05T08:37:58.783+0100 [mongosMain] connection accepted from 172.28.0.163:50191 #1431378 (404 connections now open) 2015-10-05T08:37:58.784+0100 [conn1431378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:00.168+0100 [conn1431009] end connection 172.28.0.164:58491 (403 connections now open) 2015-10-05T08:38:00.169+0100 [mongosMain] connection accepted from 172.28.0.164:59557 #1431379 (404 connections now open) 2015-10-05T08:38:00.171+0100 [conn1431379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:00.776+0100 [conn1431041] end connection 172.28.0.164:58561 (403 connections now open) 2015-10-05T08:38:00.777+0100 [mongosMain] connection accepted from 172.28.0.164:59559 #1431380 (404 connections now open) 2015-10-05T08:38:00.779+0100 [conn1431380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:01.335+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:38:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:38:03.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228da5703b51053ee1ef3 2015-10-05T08:38:04.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:38:06.143+0100 [conn1431001] end connection 172.28.0.163:65464 (403 connections now open) 2015-10-05T08:38:06.146+0100 [mongosMain] connection accepted from 172.28.0.163:50214 #1431381 (404 connections now open) 2015-10-05T08:38:06.151+0100 [conn1431381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:08.219+0100 [conn1431030] end connection 172.28.0.163:49160 (403 connections now open) 2015-10-05T08:38:08.220+0100 [mongosMain] connection accepted from 172.28.0.163:50219 #1431382 (404 connections now open) 2015-10-05T08:38:08.221+0100 [conn1431382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:08.782+0100 [conn1431049] end connection 172.28.0.163:49230 (403 connections now open) 2015-10-05T08:38:08.783+0100 [mongosMain] connection accepted from 172.28.0.163:50222 #1431383 (404 connections now open) 2015-10-05T08:38:08.784+0100 [conn1431383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:10.184+0100 [conn1431017] end connection 172.28.0.164:58512 (403 connections now open) 2015-10-05T08:38:10.185+0100 [mongosMain] connection accepted from 172.28.0.164:59575 #1431384 (404 connections now open) 2015-10-05T08:38:10.187+0100 [conn1431384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:10.793+0100 [conn1431045] end connection 172.28.0.164:58574 (403 connections now open) 2015-10-05T08:38:10.794+0100 [mongosMain] connection accepted from 172.28.0.164:59577 #1431385 (404 connections now open) 2015-10-05T08:38:10.796+0100 [conn1431385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:14.163+0100 [conn1431058] end connection 172.28.0.164:58602 (403 connections now open) 2015-10-05T08:38:14.164+0100 [mongosMain] connection accepted from 172.28.0.164:59580 #1431386 (404 connections now open) 2015-10-05T08:38:14.165+0100 [conn1431386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:16.528+0100 [conn1430978] end connection 172.28.0.163:65429 (403 connections now open) 2015-10-05T08:38:16.537+0100 [mongosMain] connection accepted from 172.28.0.163:50231 #1431387 (404 connections now open) 2015-10-05T08:38:16.539+0100 [conn1431387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:18.226+0100 [conn1431023] end connection 172.28.0.163:65528 (403 connections now open) 2015-10-05T08:38:18.227+0100 [mongosMain] connection accepted from 172.28.0.163:50233 #1431388 (404 connections now open) 2015-10-05T08:38:18.228+0100 [conn1431388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:18.797+0100 [conn1431056] end connection 172.28.0.163:49264 (403 connections now open) 2015-10-05T08:38:18.798+0100 [mongosMain] connection accepted from 172.28.0.163:50235 #1431389 (404 connections now open) 2015-10-05T08:38:18.799+0100 [conn1431389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:20.809+0100 [conn1431051] end connection 172.28.0.164:58585 (403 connections now open) 2015-10-05T08:38:20.810+0100 [mongosMain] connection accepted from 172.28.0.164:59590 #1431390 (404 connections now open) 2015-10-05T08:38:20.816+0100 [conn1431390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:24.178+0100 [conn1431011] end connection 172.28.0.164:58508 (403 connections now open) 2015-10-05T08:38:24.179+0100 [mongosMain] connection accepted from 172.28.0.164:59597 #1431391 (404 connections now open) 2015-10-05T08:38:24.180+0100 [conn1431391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:26.520+0100 [conn1430956] end connection 172.28.0.163:65362 (403 connections now open) 2015-10-05T08:38:26.521+0100 [mongosMain] connection accepted from 172.28.0.163:50241 #1431392 (404 connections now open) 2015-10-05T08:38:26.523+0100 [conn1431392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:28.236+0100 [conn1431038] end connection 172.28.0.163:49170 (403 connections now open) 2015-10-05T08:38:28.237+0100 [mongosMain] connection accepted from 172.28.0.163:50244 #1431393 (404 connections now open) 2015-10-05T08:38:28.238+0100 [conn1431393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:28.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228f45703b51053ee208c 2015-10-05T08:38:28.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:38:28.799+0100 [conn1431062] end connection 172.28.0.163:49283 (403 connections now open) 2015-10-05T08:38:28.800+0100 [mongosMain] connection accepted from 172.28.0.163:50246 #1431394 (404 connections now open) 2015-10-05T08:38:28.801+0100 [conn1431394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:28.847+0100 [mongosMain] connection accepted from 127.0.0.1:50248 #1431395 (405 connections now open) 2015-10-05T08:38:28.850+0100 [conn1431395] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:28.855+0100 [conn1431395] end connection 127.0.0.1:50248 (404 connections now open) 2015-10-05T08:38:30.216+0100 [conn1431003] end connection 172.28.0.164:58474 (403 connections now open) 2015-10-05T08:38:30.217+0100 [mongosMain] connection accepted from 172.28.0.164:59607 #1431396 (404 connections now open) 2015-10-05T08:38:30.219+0100 [conn1431396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:30.842+0100 [conn1431064] end connection 172.28.0.164:58612 (403 connections now open) 2015-10-05T08:38:30.843+0100 [mongosMain] connection accepted from 172.28.0.164:59609 #1431397 (404 connections now open) 2015-10-05T08:38:30.844+0100 [conn1431397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:31.607+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:38:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:38:34.196+0100 [conn1430976] end connection 172.28.0.164:58407 (403 connections now open) 2015-10-05T08:38:34.197+0100 [mongosMain] connection accepted from 172.28.0.164:59617 #1431398 (404 connections now open) 2015-10-05T08:38:34.199+0100 [conn1431398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:35.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561228fa5703b51053ee20e6 2015-10-05T08:38:36.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:38:36.664+0100 [conn1431021] end connection 172.28.0.163:65523 (403 connections now open) 2015-10-05T08:38:36.670+0100 [mongosMain] connection accepted from 172.28.0.163:50255 #1431399 (404 connections now open) 2015-10-05T08:38:36.671+0100 [conn1431399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:38.236+0100 [conn1431044] end connection 172.28.0.163:49212 (403 connections now open) 2015-10-05T08:38:38.237+0100 [mongosMain] connection accepted from 172.28.0.163:50256 #1431400 (404 connections now open) 2015-10-05T08:38:38.238+0100 [conn1431400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:39.230+0100 [mongosMain] connection accepted from 127.0.0.1:50265 #1431401 (405 connections now open) 2015-10-05T08:38:39.234+0100 [conn1431401] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:39.240+0100 [conn1431401] end connection 127.0.0.1:50265 (404 connections now open) 2015-10-05T08:38:40.232+0100 [conn1431025] end connection 172.28.0.164:58525 (403 connections now open) 2015-10-05T08:38:40.233+0100 [mongosMain] connection accepted from 172.28.0.164:59631 #1431402 (404 connections now open) 2015-10-05T08:38:40.234+0100 [conn1431402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:40.855+0100 [conn1431072] end connection 172.28.0.164:58632 (403 connections now open) 2015-10-05T08:38:40.856+0100 [mongosMain] connection accepted from 172.28.0.164:59634 #1431403 (404 connections now open) 2015-10-05T08:38:40.858+0100 [conn1431403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:43.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229025703b51053ee215b 2015-10-05T08:38:43.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:38:44.195+0100 [conn1430904] end connection 172.28.0.164:58218 (403 connections now open) 2015-10-05T08:38:44.196+0100 [mongosMain] connection accepted from 172.28.0.164:59640 #1431404 (404 connections now open) 2015-10-05T08:38:44.197+0100 [conn1431404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:46.649+0100 [conn1431028] end connection 172.28.0.163:49157 (403 connections now open) 2015-10-05T08:38:46.650+0100 [mongosMain] connection accepted from 172.28.0.163:50276 #1431405 (404 connections now open) 2015-10-05T08:38:46.651+0100 [conn1431405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:48.251+0100 [conn1431055] end connection 172.28.0.163:49259 (403 connections now open) 2015-10-05T08:38:48.252+0100 [mongosMain] connection accepted from 172.28.0.163:50279 #1431406 (404 connections now open) 2015-10-05T08:38:48.253+0100 [conn1431406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:48.829+0100 [conn1431069] end connection 172.28.0.163:49292 (403 connections now open) 2015-10-05T08:38:48.830+0100 [mongosMain] connection accepted from 172.28.0.163:50283 #1431407 (404 connections now open) 2015-10-05T08:38:48.831+0100 [conn1431407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:50.231+0100 [conn1431057] end connection 172.28.0.164:58601 (403 connections now open) 2015-10-05T08:38:50.232+0100 [mongosMain] connection accepted from 172.28.0.164:59648 #1431408 (404 connections now open) 2015-10-05T08:38:50.236+0100 [conn1431408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:50.856+0100 [conn1431078] end connection 172.28.0.164:58650 (403 connections now open) 2015-10-05T08:38:50.856+0100 [mongosMain] connection accepted from 172.28.0.164:59651 #1431409 (404 connections now open) 2015-10-05T08:38:50.858+0100 [conn1431409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:51.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229095703b51053ee21ba 2015-10-05T08:38:51.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:38:54.211+0100 [conn1430983] end connection 172.28.0.164:58423 (403 connections now open) 2015-10-05T08:38:54.212+0100 [mongosMain] connection accepted from 172.28.0.164:59657 #1431410 (404 connections now open) 2015-10-05T08:38:54.214+0100 [conn1431410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:56.648+0100 [conn1430963] end connection 172.28.0.163:65378 (403 connections now open) 2015-10-05T08:38:56.650+0100 [mongosMain] connection accepted from 172.28.0.163:50292 #1431411 (404 connections now open) 2015-10-05T08:38:56.651+0100 [conn1431411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:58.254+0100 [conn1430889] end connection 172.28.0.163:65177 (403 connections now open) 2015-10-05T08:38:58.255+0100 [mongosMain] connection accepted from 172.28.0.163:50295 #1431412 (404 connections now open) 2015-10-05T08:38:58.256+0100 [conn1431412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:38:58.834+0100 [conn1431084] end connection 172.28.0.163:49322 (403 connections now open) 2015-10-05T08:38:58.836+0100 [mongosMain] connection accepted from 172.28.0.163:50297 #1431413 (404 connections now open) 2015-10-05T08:38:58.837+0100 [conn1431413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:00.247+0100 [conn1431050] end connection 172.28.0.164:58583 (403 connections now open) 2015-10-05T08:39:00.248+0100 [mongosMain] connection accepted from 172.28.0.164:59662 #1431414 (404 connections now open) 2015-10-05T08:39:00.249+0100 [conn1431414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:02.026+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:39:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:39:04.225+0100 [conn1430999] end connection 172.28.0.164:58464 (403 connections now open) 2015-10-05T08:39:04.226+0100 [mongosMain] connection accepted from 172.28.0.164:59678 #1431415 (404 connections now open) 2015-10-05T08:39:04.227+0100 [conn1431415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:05.956+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:39:05.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:39:06.661+0100 [conn1430993] end connection 172.28.0.163:65453 (403 connections now open) 2015-10-05T08:39:06.662+0100 [mongosMain] connection accepted from 172.28.0.163:50329 #1431416 (404 connections now open) 2015-10-05T08:39:06.663+0100 [conn1431416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:08.267+0100 [conn1431061] end connection 172.28.0.163:49279 (403 connections now open) 2015-10-05T08:39:08.268+0100 [mongosMain] connection accepted from 172.28.0.163:50333 #1431417 (404 connections now open) 2015-10-05T08:39:08.269+0100 [conn1431417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:08.844+0100 [conn1431091] end connection 172.28.0.163:49340 (403 connections now open) 2015-10-05T08:39:08.846+0100 [mongosMain] connection accepted from 172.28.0.163:50335 #1431418 (404 connections now open) 2015-10-05T08:39:08.847+0100 [conn1431418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:10.872+0100 [conn1431086] end connection 172.28.0.164:58668 (403 connections now open) 2015-10-05T08:39:10.873+0100 [mongosMain] connection accepted from 172.28.0.164:59681 #1431419 (404 connections now open) 2015-10-05T08:39:10.875+0100 [conn1431419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:12.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612291f5703b51053ee2312 2015-10-05T08:39:12.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:39:14.226+0100 [conn1431019] end connection 172.28.0.164:58516 (403 connections now open) 2015-10-05T08:39:14.227+0100 [mongosMain] connection accepted from 172.28.0.164:59683 #1431420 (404 connections now open) 2015-10-05T08:39:14.229+0100 [conn1431420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:17.258+0100 [conn1431014] end connection 172.28.0.163:65504 (403 connections now open) 2015-10-05T08:39:17.260+0100 [mongosMain] connection accepted from 172.28.0.163:50346 #1431421 (404 connections now open) 2015-10-05T08:39:17.265+0100 [conn1431421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:18.283+0100 [conn1431015] end connection 172.28.0.163:65511 (403 connections now open) 2015-10-05T08:39:18.284+0100 [mongosMain] connection accepted from 172.28.0.163:50348 #1431422 (404 connections now open) 2015-10-05T08:39:18.285+0100 [conn1431422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:19.689+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:39:19.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:39:24.242+0100 [conn1431052] end connection 172.28.0.164:58592 (403 connections now open) 2015-10-05T08:39:24.244+0100 [mongosMain] connection accepted from 172.28.0.164:59697 #1431423 (404 connections now open) 2015-10-05T08:39:24.245+0100 [conn1431423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:26.045+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612292cd5de43e0ed5d37f3') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444030765759), why: "doing balance round", ts: ObjectId('5612292d5703b51053ee23cf') } } gle1: { lastOp: Timestamp 1444030765000|7, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444030752000|5, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2015-10-05T08:39:26.048+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:39:26.183+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612292d5703b51053ee23cf 2015-10-05T08:39:26.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:39:27.254+0100 [conn1431036] end connection 172.28.0.163:49166 (403 connections now open) 2015-10-05T08:39:27.255+0100 [mongosMain] connection accepted from 172.28.0.163:50351 #1431424 (404 connections now open) 2015-10-05T08:39:27.257+0100 [conn1431424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:28.293+0100 [conn1431076] end connection 172.28.0.163:49301 (403 connections now open) 2015-10-05T08:39:28.294+0100 [mongosMain] connection accepted from 172.28.0.163:50352 #1431425 (404 connections now open) 2015-10-05T08:39:28.296+0100 [conn1431425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:28.858+0100 [mongosMain] connection accepted from 127.0.0.1:50354 #1431426 (405 connections now open) 2015-10-05T08:39:28.860+0100 [conn1431426] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:28.866+0100 [conn1431426] end connection 127.0.0.1:50354 (404 connections now open) 2015-10-05T08:39:32.703+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:39:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:39:34.257+0100 [conn1431006] end connection 172.28.0.164:58480 (403 connections now open) 2015-10-05T08:39:34.258+0100 [mongosMain] connection accepted from 172.28.0.164:59714 #1431427 (404 connections now open) 2015-10-05T08:39:34.260+0100 [conn1431427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:37.255+0100 [conn1431103] end connection 172.28.0.163:49375 (403 connections now open) 2015-10-05T08:39:37.256+0100 [mongosMain] connection accepted from 172.28.0.163:50359 #1431428 (404 connections now open) 2015-10-05T08:39:37.257+0100 [conn1431428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:38.299+0100 [conn1431048] end connection 172.28.0.163:49228 (403 connections now open) 2015-10-05T08:39:38.300+0100 [mongosMain] connection accepted from 172.28.0.163:50360 #1431429 (404 connections now open) 2015-10-05T08:39:38.301+0100 [conn1431429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:40.310+0100 [conn1431063] end connection 172.28.0.164:58610 (403 connections now open) 2015-10-05T08:39:40.311+0100 [mongosMain] connection accepted from 172.28.0.164:59721 #1431430 (404 connections now open) 2015-10-05T08:39:40.313+0100 [conn1431430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:42.514+0100 [mongosMain] connection accepted from 127.0.0.1:50361 #1431431 (405 connections now open) 2015-10-05T08:39:42.516+0100 [conn1431431] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:42.520+0100 [conn1431431] end connection 127.0.0.1:50361 (404 connections now open) 2015-10-05T08:39:44.257+0100 [conn1430948] end connection 172.28.0.164:58342 (403 connections now open) 2015-10-05T08:39:44.258+0100 [mongosMain] connection accepted from 172.28.0.164:59732 #1431432 (404 connections now open) 2015-10-05T08:39:44.260+0100 [conn1431432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:44.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229405703b51053ee24f4 2015-10-05T08:39:44.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:39:47.270+0100 [conn1431059] end connection 172.28.0.163:49273 (403 connections now open) 2015-10-05T08:39:47.271+0100 [mongosMain] connection accepted from 172.28.0.163:50372 #1431433 (404 connections now open) 2015-10-05T08:39:47.272+0100 [conn1431433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:48.300+0100 [conn1431090] end connection 172.28.0.163:49338 (403 connections now open) 2015-10-05T08:39:48.302+0100 [mongosMain] connection accepted from 172.28.0.163:50374 #1431434 (404 connections now open) 2015-10-05T08:39:48.303+0100 [conn1431434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:50.311+0100 [conn1431111] end connection 172.28.0.164:58735 (403 connections now open) 2015-10-05T08:39:50.313+0100 [mongosMain] connection accepted from 172.28.0.164:59738 #1431435 (404 connections now open) 2015-10-05T08:39:50.314+0100 [conn1431435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:51.784+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:39:51.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:39:54.274+0100 [conn1431093] end connection 172.28.0.164:58694 (403 connections now open) 2015-10-05T08:39:54.274+0100 [mongosMain] connection accepted from 172.28.0.164:59745 #1431436 (404 connections now open) 2015-10-05T08:39:54.289+0100 [conn1431436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:58.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612294d5703b51053ee259d 2015-10-05T08:39:58.315+0100 [conn1431097] end connection 172.28.0.163:49367 (403 connections now open) 2015-10-05T08:39:58.316+0100 [mongosMain] connection accepted from 172.28.0.163:50386 #1431437 (404 connections now open) 2015-10-05T08:39:58.317+0100 [conn1431437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:39:58.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:39:58.935+0100 [conn1431043] end connection 172.28.0.163:49206 (403 connections now open) 2015-10-05T08:39:58.936+0100 [mongosMain] connection accepted from 172.28.0.163:50387 #1431438 (404 connections now open) 2015-10-05T08:39:58.937+0100 [conn1431438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:00.309+0100 [conn1431085] end connection 172.28.0.164:58666 (403 connections now open) 2015-10-05T08:40:00.311+0100 [mongosMain] connection accepted from 172.28.0.164:59749 #1431439 (404 connections now open) 2015-10-05T08:40:00.312+0100 [conn1431439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:04.277+0100 [conn1431065] end connection 172.28.0.164:58618 (403 connections now open) 2015-10-05T08:40:04.278+0100 [mongosMain] connection accepted from 172.28.0.164:59757 #1431440 (404 connections now open) 2015-10-05T08:40:04.281+0100 [conn1431440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:05.077+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:40:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:40:05.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229545703b51053ee2616 2015-10-05T08:40:06.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:08.316+0100 [conn1431105] end connection 172.28.0.163:49381 (403 connections now open) 2015-10-05T08:40:08.318+0100 [mongosMain] connection accepted from 172.28.0.163:50412 #1431441 (404 connections now open) 2015-10-05T08:40:08.319+0100 [conn1431441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:08.922+0100 [conn1430949] end connection 172.28.0.163:65349 (403 connections now open) 2015-10-05T08:40:08.923+0100 [mongosMain] connection accepted from 172.28.0.163:50415 #1431442 (404 connections now open) 2015-10-05T08:40:08.925+0100 [conn1431442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:10.326+0100 [conn1431033] end connection 172.28.0.164:58541 (403 connections now open) 2015-10-05T08:40:10.327+0100 [mongosMain] connection accepted from 172.28.0.164:59758 #1431443 (404 connections now open) 2015-10-05T08:40:10.330+0100 [conn1431443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:14.289+0100 [conn1431101] end connection 172.28.0.164:58706 (403 connections now open) 2015-10-05T08:40:14.291+0100 [mongosMain] connection accepted from 172.28.0.164:59762 #1431444 (404 connections now open) 2015-10-05T08:40:14.293+0100 [conn1431444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:14.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612295c5703b51053ee26d0 2015-10-05T08:40:14.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:18.330+0100 [conn1431119] end connection 172.28.0.163:49413 (403 connections now open) 2015-10-05T08:40:18.331+0100 [mongosMain] connection accepted from 172.28.0.163:50425 #1431445 (404 connections now open) 2015-10-05T08:40:18.332+0100 [conn1431445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:18.908+0100 [conn1431098] end connection 172.28.0.163:49368 (403 connections now open) 2015-10-05T08:40:18.909+0100 [mongosMain] connection accepted from 172.28.0.163:50427 #1431446 (404 connections now open) 2015-10-05T08:40:18.910+0100 [conn1431446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:18.933+0100 [conn1431047] end connection 172.28.0.163:49223 (403 connections now open) 2015-10-05T08:40:18.934+0100 [mongosMain] connection accepted from 172.28.0.163:50428 #1431447 (404 connections now open) 2015-10-05T08:40:18.935+0100 [conn1431447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:20.326+0100 [conn1431092] end connection 172.28.0.164:58681 (403 connections now open) 2015-10-05T08:40:20.327+0100 [mongosMain] connection accepted from 172.28.0.164:59773 #1431448 (404 connections now open) 2015-10-05T08:40:20.329+0100 [conn1431448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:20.847+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229645703b51053ee2749 2015-10-05T08:40:20.949+0100 [conn1431100] end connection 172.28.0.164:58703 (403 connections now open) 2015-10-05T08:40:20.950+0100 [mongosMain] connection accepted from 172.28.0.164:59776 #1431449 (404 connections now open) 2015-10-05T08:40:20.952+0100 [conn1431449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:20.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:24.304+0100 [conn1430968] end connection 172.28.0.164:58397 (403 connections now open) 2015-10-05T08:40:24.305+0100 [mongosMain] connection accepted from 172.28.0.164:59782 #1431450 (404 connections now open) 2015-10-05T08:40:24.306+0100 [conn1431450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:28.346+0100 [conn1431068] end connection 172.28.0.163:49290 (403 connections now open) 2015-10-05T08:40:28.347+0100 [mongosMain] connection accepted from 172.28.0.163:50434 #1431451 (404 connections now open) 2015-10-05T08:40:28.348+0100 [conn1431451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:28.748+0100 [mongosMain] connection accepted from 127.0.0.1:50436 #1431452 (405 connections now open) 2015-10-05T08:40:28.751+0100 [conn1431452] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:28.757+0100 [conn1431452] end connection 127.0.0.1:50436 (404 connections now open) 2015-10-05T08:40:28.911+0100 [conn1431131] end connection 172.28.0.163:49484 (403 connections now open) 2015-10-05T08:40:28.912+0100 [mongosMain] connection accepted from 172.28.0.163:50437 #1431453 (404 connections now open) 2015-10-05T08:40:28.913+0100 [conn1431453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:28.940+0100 [conn1431096] end connection 172.28.0.163:49362 (403 connections now open) 2015-10-05T08:40:28.941+0100 [mongosMain] connection accepted from 172.28.0.163:50439 #1431454 (404 connections now open) 2015-10-05T08:40:28.942+0100 [conn1431454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:30.342+0100 [conn1431099] end connection 172.28.0.164:58702 (403 connections now open) 2015-10-05T08:40:30.343+0100 [mongosMain] connection accepted from 172.28.0.164:59788 #1431455 (404 connections now open) 2015-10-05T08:40:30.345+0100 [conn1431455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:30.966+0100 [conn1431127] end connection 172.28.0.164:58804 (403 connections now open) 2015-10-05T08:40:30.967+0100 [mongosMain] connection accepted from 172.28.0.164:59789 #1431456 (404 connections now open) 2015-10-05T08:40:30.969+0100 [conn1431456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:33.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229705703b51053ee27cc 2015-10-05T08:40:33.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:34.320+0100 [conn1431087] end connection 172.28.0.164:58674 (403 connections now open) 2015-10-05T08:40:34.321+0100 [mongosMain] connection accepted from 172.28.0.164:59796 #1431457 (404 connections now open) 2015-10-05T08:40:34.322+0100 [conn1431457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:35.214+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:40:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:40:38.346+0100 [conn1431083] end connection 172.28.0.163:49320 (403 connections now open) 2015-10-05T08:40:38.347+0100 [mongosMain] connection accepted from 172.28.0.163:50444 #1431458 (404 connections now open) 2015-10-05T08:40:38.348+0100 [conn1431458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:38.923+0100 [conn1431136] end connection 172.28.0.163:49492 (403 connections now open) 2015-10-05T08:40:38.924+0100 [mongosMain] connection accepted from 172.28.0.163:50446 #1431459 (404 connections now open) 2015-10-05T08:40:38.925+0100 [conn1431459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:38.941+0100 [conn1431080] end connection 172.28.0.163:49308 (403 connections now open) 2015-10-05T08:40:38.942+0100 [mongosMain] connection accepted from 172.28.0.163:50448 #1431460 (404 connections now open) 2015-10-05T08:40:38.943+0100 [conn1431460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:39.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229775703b51053ee280f 2015-10-05T08:40:39.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:40.212+0100 [mongosMain] connection accepted from 127.0.0.1:50451 #1431461 (405 connections now open) 2015-10-05T08:40:40.215+0100 [conn1431461] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:40.223+0100 [conn1431461] end connection 127.0.0.1:50451 (404 connections now open) 2015-10-05T08:40:40.357+0100 [conn1431132] end connection 172.28.0.164:58815 (403 connections now open) 2015-10-05T08:40:40.358+0100 [mongosMain] connection accepted from 172.28.0.164:59807 #1431462 (404 connections now open) 2015-10-05T08:40:40.359+0100 [conn1431462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:40.982+0100 [conn1431133] end connection 172.28.0.164:58818 (403 connections now open) 2015-10-05T08:40:40.983+0100 [mongosMain] connection accepted from 172.28.0.164:59810 #1431463 (404 connections now open) 2015-10-05T08:40:40.985+0100 [conn1431463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:44.352+0100 [conn1430991] end connection 172.28.0.164:58446 (403 connections now open) 2015-10-05T08:40:44.353+0100 [mongosMain] connection accepted from 172.28.0.164:59817 #1431464 (404 connections now open) 2015-10-05T08:40:44.355+0100 [conn1431464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:48.362+0100 [conn1431114] end connection 172.28.0.163:49399 (403 connections now open) 2015-10-05T08:40:48.363+0100 [mongosMain] connection accepted from 172.28.0.163:50461 #1431465 (404 connections now open) 2015-10-05T08:40:48.364+0100 [conn1431465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:48.924+0100 [conn1431141] end connection 172.28.0.163:49502 (403 connections now open) 2015-10-05T08:40:48.925+0100 [mongosMain] connection accepted from 172.28.0.163:50463 #1431466 (404 connections now open) 2015-10-05T08:40:48.927+0100 [conn1431466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:48.955+0100 [conn1431074] end connection 172.28.0.163:49297 (403 connections now open) 2015-10-05T08:40:48.956+0100 [mongosMain] connection accepted from 172.28.0.163:50465 #1431467 (404 connections now open) 2015-10-05T08:40:48.957+0100 [conn1431467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:50.373+0100 [conn1431077] end connection 172.28.0.164:58648 (403 connections now open) 2015-10-05T08:40:50.375+0100 [mongosMain] connection accepted from 172.28.0.164:59827 #1431468 (404 connections now open) 2015-10-05T08:40:50.377+0100 [conn1431468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:50.996+0100 [conn1431144] end connection 172.28.0.164:58856 (403 connections now open) 2015-10-05T08:40:50.998+0100 [mongosMain] connection accepted from 172.28.0.164:59828 #1431469 (404 connections now open) 2015-10-05T08:40:50.999+0100 [conn1431469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:52.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229845703b51053ee28b1 2015-10-05T08:40:53.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:40:54.911+0100 [conn1431073] end connection 172.28.0.164:58636 (403 connections now open) 2015-10-05T08:40:54.923+0100 [mongosMain] connection accepted from 172.28.0.164:59836 #1431470 (404 connections now open) 2015-10-05T08:40:54.925+0100 [conn1431470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:58.362+0100 [conn1431130] end connection 172.28.0.163:49480 (403 connections now open) 2015-10-05T08:40:58.364+0100 [mongosMain] connection accepted from 172.28.0.163:50476 #1431471 (404 connections now open) 2015-10-05T08:40:58.365+0100 [conn1431471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:40:58.939+0100 [conn1431146] end connection 172.28.0.163:49514 (403 connections now open) 2015-10-05T08:40:58.940+0100 [mongosMain] connection accepted from 172.28.0.163:50478 #1431472 (404 connections now open) 2015-10-05T08:40:58.941+0100 [conn1431472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:00.373+0100 [conn1431071] end connection 172.28.0.164:58630 (403 connections now open) 2015-10-05T08:41:00.374+0100 [mongosMain] connection accepted from 172.28.0.164:59842 #1431473 (404 connections now open) 2015-10-05T08:41:00.375+0100 [conn1431473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:04.901+0100 [conn1431112] end connection 172.28.0.164:58741 (403 connections now open) 2015-10-05T08:41:04.902+0100 [mongosMain] connection accepted from 172.28.0.164:59858 #1431474 (404 connections now open) 2015-10-05T08:41:04.904+0100 [conn1431474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:07.377+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:41:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:41:08.378+0100 [conn1431126] end connection 172.28.0.163:49452 (403 connections now open) 2015-10-05T08:41:08.379+0100 [mongosMain] connection accepted from 172.28.0.163:50510 #1431475 (404 connections now open) 2015-10-05T08:41:08.380+0100 [conn1431475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:10.388+0100 [conn1431123] end connection 172.28.0.164:58776 (403 connections now open) 2015-10-05T08:41:10.390+0100 [mongosMain] connection accepted from 172.28.0.164:59861 #1431476 (404 connections now open) 2015-10-05T08:41:10.391+0100 [conn1431476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:11.013+0100 [conn1431148] end connection 172.28.0.164:58869 (403 connections now open) 2015-10-05T08:41:11.013+0100 [mongosMain] connection accepted from 172.28.0.164:59863 #1431477 (404 connections now open) 2015-10-05T08:41:11.015+0100 [conn1431477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:14.913+0100 [conn1431124] end connection 172.28.0.164:58792 (403 connections now open) 2015-10-05T08:41:14.914+0100 [mongosMain] connection accepted from 172.28.0.164:59865 #1431478 (404 connections now open) 2015-10-05T08:41:14.916+0100 [conn1431478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:15.151+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561229963b0f755fc3344699') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444030872937), why: "doing balance round", ts: ObjectId('561229985703b51053ee298f') } } gle1: { lastOp: Timestamp 1444030874000|1, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1444030852000|8, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2015-10-05T08:41:15.155+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:41:16.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229985703b51053ee298f 2015-10-05T08:41:16.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:18.378+0100 [conn1431109] end connection 172.28.0.163:49389 (403 connections now open) 2015-10-05T08:41:18.379+0100 [mongosMain] connection accepted from 172.28.0.163:50524 #1431479 (404 connections now open) 2015-10-05T08:41:18.381+0100 [conn1431479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:21.013+0100 [conn1431156] end connection 172.28.0.164:58907 (403 connections now open) 2015-10-05T08:41:21.015+0100 [mongosMain] connection accepted from 172.28.0.164:59873 #1431480 (404 connections now open) 2015-10-05T08:41:21.017+0100 [conn1431480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:22.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229a25703b51053ee2a38 2015-10-05T08:41:22.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:24.913+0100 [conn1431107] end connection 172.28.0.164:58726 (403 connections now open) 2015-10-05T08:41:24.915+0100 [mongosMain] connection accepted from 172.28.0.164:59880 #1431481 (404 connections now open) 2015-10-05T08:41:24.915+0100 [conn1431481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:28.392+0100 [conn1431135] end connection 172.28.0.163:49489 (403 connections now open) 2015-10-05T08:41:28.393+0100 [mongosMain] connection accepted from 172.28.0.163:50531 #1431482 (404 connections now open) 2015-10-05T08:41:28.394+0100 [conn1431482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:28.401+0100 [mongosMain] connection accepted from 127.0.0.1:50532 #1431483 (405 connections now open) 2015-10-05T08:41:28.403+0100 [conn1431483] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:28.408+0100 [conn1431483] end connection 127.0.0.1:50532 (404 connections now open) 2015-10-05T08:41:28.971+0100 [conn1431151] end connection 172.28.0.163:49528 (403 connections now open) 2015-10-05T08:41:28.973+0100 [mongosMain] connection accepted from 172.28.0.163:50533 #1431484 (404 connections now open) 2015-10-05T08:41:28.974+0100 [conn1431484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:29.183+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229a85703b51053ee2ab5 2015-10-05T08:41:29.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:31.029+0100 [conn1431160] end connection 172.28.0.164:58919 (403 connections now open) 2015-10-05T08:41:31.031+0100 [mongosMain] connection accepted from 172.28.0.164:59888 #1431485 (404 connections now open) 2015-10-05T08:41:31.033+0100 [conn1431485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:34.930+0100 [conn1431117] end connection 172.28.0.164:58761 (403 connections now open) 2015-10-05T08:41:34.933+0100 [mongosMain] connection accepted from 172.28.0.164:59894 #1431486 (404 connections now open) 2015-10-05T08:41:34.935+0100 [conn1431486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:35.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229af5703b51053ee2b45 2015-10-05T08:41:36.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:37.534+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:41:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:41:38.396+0100 [conn1431150] end connection 172.28.0.163:49527 (403 connections now open) 2015-10-05T08:41:38.397+0100 [mongosMain] connection accepted from 172.28.0.163:50540 #1431487 (404 connections now open) 2015-10-05T08:41:38.398+0100 [conn1431487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:38.978+0100 [conn1431162] end connection 172.28.0.163:49573 (403 connections now open) 2015-10-05T08:41:38.980+0100 [mongosMain] connection accepted from 172.28.0.163:50541 #1431488 (404 connections now open) 2015-10-05T08:41:38.981+0100 [conn1431488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:39.700+0100 [mongosMain] connection accepted from 127.0.0.1:50544 #1431489 (405 connections now open) 2015-10-05T08:41:39.703+0100 [conn1431489] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:39.707+0100 [conn1431489] end connection 127.0.0.1:50544 (404 connections now open) 2015-10-05T08:41:41.045+0100 [conn1431165] end connection 172.28.0.164:58935 (403 connections now open) 2015-10-05T08:41:41.046+0100 [mongosMain] connection accepted from 172.28.0.164:59906 #1431490 (404 connections now open) 2015-10-05T08:41:41.048+0100 [conn1431490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:42.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229b65703b51053ee2ba9 2015-10-05T08:41:42.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:48.409+0100 [conn1431140] end connection 172.28.0.163:49498 (403 connections now open) 2015-10-05T08:41:48.410+0100 [mongosMain] connection accepted from 172.28.0.163:50553 #1431491 (404 connections now open) 2015-10-05T08:41:48.411+0100 [conn1431491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:48.986+0100 [conn1431167] end connection 172.28.0.163:49581 (403 connections now open) 2015-10-05T08:41:48.987+0100 [mongosMain] connection accepted from 172.28.0.163:50555 #1431492 (404 connections now open) 2015-10-05T08:41:48.989+0100 [conn1431492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:49.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229bc5703b51053ee2c09 2015-10-05T08:41:49.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:49.501+0100 [conn1430465] end connection 172.28.0.163:63953 (403 connections now open) 2015-10-05T08:41:51.043+0100 [conn1431170] end connection 172.28.0.164:58953 (402 connections now open) 2015-10-05T08:41:51.044+0100 [mongosMain] connection accepted from 172.28.0.164:59919 #1431493 (403 connections now open) 2015-10-05T08:41:51.046+0100 [conn1431493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:55.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229c35703b51053ee2c64 2015-10-05T08:41:55.980+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:41:58.417+0100 [conn1431161] end connection 172.28.0.163:49572 (402 connections now open) 2015-10-05T08:41:58.418+0100 [mongosMain] connection accepted from 172.28.0.163:50567 #1431494 (403 connections now open) 2015-10-05T08:41:58.419+0100 [conn1431494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:41:58.980+0100 [conn1431172] end connection 172.28.0.163:49593 (402 connections now open) 2015-10-05T08:41:58.981+0100 [mongosMain] connection accepted from 172.28.0.163:50569 #1431495 (403 connections now open) 2015-10-05T08:41:58.982+0100 [conn1431495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:01.051+0100 [conn1431174] end connection 172.28.0.164:58965 (402 connections now open) 2015-10-05T08:42:01.052+0100 [mongosMain] connection accepted from 172.28.0.164:59929 #1431496 (403 connections now open) 2015-10-05T08:42:01.053+0100 [conn1431496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:02.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229c95703b51053ee2cab 2015-10-05T08:42:03.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:08.419+0100 [conn1431122] end connection 172.28.0.163:49423 (402 connections now open) 2015-10-05T08:42:08.420+0100 [mongosMain] connection accepted from 172.28.0.163:50595 #1431497 (403 connections now open) 2015-10-05T08:42:08.421+0100 [conn1431497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:08.699+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:42:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:42:08.994+0100 [conn1431176] end connection 172.28.0.163:49613 (402 connections now open) 2015-10-05T08:42:08.995+0100 [mongosMain] connection accepted from 172.28.0.163:50597 #1431498 (403 connections now open) 2015-10-05T08:42:08.997+0100 [conn1431498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:09.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229d15703b51053ee2d35 2015-10-05T08:42:09.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:11.068+0100 [conn1431178] end connection 172.28.0.164:58979 (402 connections now open) 2015-10-05T08:42:11.069+0100 [mongosMain] connection accepted from 172.28.0.164:59941 #1431499 (403 connections now open) 2015-10-05T08:42:11.071+0100 [conn1431499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:16.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229d75703b51053ee2d75 2015-10-05T08:42:16.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:18.433+0100 [conn1431154] end connection 172.28.0.163:49552 (402 connections now open) 2015-10-05T08:42:18.434+0100 [mongosMain] connection accepted from 172.28.0.163:50609 #1431500 (403 connections now open) 2015-10-05T08:42:18.435+0100 [conn1431500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:18.995+0100 [conn1431181] end connection 172.28.0.163:49646 (402 connections now open) 2015-10-05T08:42:18.996+0100 [mongosMain] connection accepted from 172.28.0.163:50611 #1431501 (403 connections now open) 2015-10-05T08:42:18.997+0100 [conn1431501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:21.087+0100 [conn1431183] end connection 172.28.0.164:58998 (402 connections now open) 2015-10-05T08:42:21.088+0100 [mongosMain] connection accepted from 172.28.0.164:59949 #1431502 (403 connections now open) 2015-10-05T08:42:21.090+0100 [conn1431502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:22.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229de5703b51053ee2dcc 2015-10-05T08:42:22.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:28.219+0100 [mongosMain] connection accepted from 127.0.0.1:50617 #1431503 (404 connections now open) 2015-10-05T08:42:28.222+0100 [conn1431503] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:28.228+0100 [conn1431503] end connection 127.0.0.1:50617 (403 connections now open) 2015-10-05T08:42:28.438+0100 [conn1431158] end connection 172.28.0.163:49567 (402 connections now open) 2015-10-05T08:42:28.439+0100 [mongosMain] connection accepted from 172.28.0.163:50618 #1431504 (403 connections now open) 2015-10-05T08:42:28.439+0100 [conn1431504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:28.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229e45703b51053ee2e11 2015-10-05T08:42:29.010+0100 [conn1431186] end connection 172.28.0.163:49662 (402 connections now open) 2015-10-05T08:42:29.011+0100 [mongosMain] connection accepted from 172.28.0.163:50620 #1431505 (403 connections now open) 2015-10-05T08:42:29.012+0100 [conn1431505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:29.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:31.098+0100 [conn1431188] end connection 172.28.0.164:59007 (402 connections now open) 2015-10-05T08:42:31.100+0100 [mongosMain] connection accepted from 172.28.0.164:59965 #1431506 (403 connections now open) 2015-10-05T08:42:31.101+0100 [conn1431506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:38.448+0100 [conn1431175] end connection 172.28.0.163:49611 (402 connections now open) 2015-10-05T08:42:38.449+0100 [mongosMain] connection accepted from 172.28.0.163:50626 #1431507 (403 connections now open) 2015-10-05T08:42:38.451+0100 [conn1431507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:39.010+0100 [conn1431191] end connection 172.28.0.163:49671 (402 connections now open) 2015-10-05T08:42:39.011+0100 [mongosMain] connection accepted from 172.28.0.163:50628 #1431508 (403 connections now open) 2015-10-05T08:42:39.012+0100 [conn1431508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:39.041+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:42:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:42:40.124+0100 [mongosMain] connection accepted from 127.0.0.1:50630 #1431509 (404 connections now open) 2015-10-05T08:42:40.127+0100 [conn1431509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:40.132+0100 [conn1431509] end connection 127.0.0.1:50630 (403 connections now open) 2015-10-05T08:42:40.491+0100 [conn1431106] end connection 172.28.0.164:58716 (402 connections now open) 2015-10-05T08:42:40.491+0100 [mongosMain] connection accepted from 172.28.0.164:59980 #1431510 (403 connections now open) 2015-10-05T08:42:40.494+0100 [conn1431510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:41.115+0100 [conn1431193] end connection 172.28.0.164:59021 (402 connections now open) 2015-10-05T08:42:41.115+0100 [mongosMain] connection accepted from 172.28.0.164:59982 #1431511 (403 connections now open) 2015-10-05T08:42:41.117+0100 [conn1431511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:41.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229f15703b51053ee2ea8 2015-10-05T08:42:42.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:48.449+0100 [conn1431171] end connection 172.28.0.163:49588 (402 connections now open) 2015-10-05T08:42:48.451+0100 [mongosMain] connection accepted from 172.28.0.163:50644 #1431512 (403 connections now open) 2015-10-05T08:42:48.452+0100 [conn1431512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:49.026+0100 [conn1431196] end connection 172.28.0.163:49677 (402 connections now open) 2015-10-05T08:42:49.027+0100 [mongosMain] connection accepted from 172.28.0.163:50648 #1431513 (403 connections now open) 2015-10-05T08:42:49.028+0100 [conn1431513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:49.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229f85703b51053ee2f2c 2015-10-05T08:42:49.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:50.490+0100 [conn1431138] end connection 172.28.0.164:58833 (402 connections now open) 2015-10-05T08:42:50.494+0100 [mongosMain] connection accepted from 172.28.0.164:59994 #1431514 (403 connections now open) 2015-10-05T08:42:50.495+0100 [conn1431514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:51.115+0100 [conn1431198] end connection 172.28.0.164:59036 (402 connections now open) 2015-10-05T08:42:51.116+0100 [mongosMain] connection accepted from 172.28.0.164:59997 #1431515 (403 connections now open) 2015-10-05T08:42:51.119+0100 [conn1431515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:55.891+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561229ff5703b51053ee2f78 2015-10-05T08:42:57.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:42:59.044+0100 [conn1431166] end connection 172.28.0.163:49579 (402 connections now open) 2015-10-05T08:42:59.056+0100 [conn1431201] end connection 172.28.0.163:49692 (401 connections now open) 2015-10-05T08:42:59.059+0100 [mongosMain] connection accepted from 172.28.0.163:50655 #1431516 (402 connections now open) 2015-10-05T08:42:59.060+0100 [conn1431516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:42:59.060+0100 [mongosMain] connection accepted from 172.28.0.163:50656 #1431517 (403 connections now open) 2015-10-05T08:42:59.061+0100 [conn1431517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:00.490+0100 [conn1431116] end connection 172.28.0.164:58755 (402 connections now open) 2015-10-05T08:43:00.491+0100 [mongosMain] connection accepted from 172.28.0.164:60005 #1431518 (403 connections now open) 2015-10-05T08:43:00.492+0100 [conn1431518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:03.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a075703b51053ee2fb7 2015-10-05T08:43:03.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:08.465+0100 [conn1431180] end connection 172.28.0.163:49645 (402 connections now open) 2015-10-05T08:43:08.466+0100 [mongosMain] connection accepted from 172.28.0.163:50691 #1431519 (403 connections now open) 2015-10-05T08:43:08.468+0100 [conn1431519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:09.042+0100 [conn1431205] end connection 172.28.0.163:49704 (402 connections now open) 2015-10-05T08:43:09.043+0100 [mongosMain] connection accepted from 172.28.0.163:50693 #1431520 (403 connections now open) 2015-10-05T08:43:09.044+0100 [conn1431520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:09.190+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:43:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:43:09.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a0d5703b51053ee3036 2015-10-05T08:43:09.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:10.506+0100 [conn1431192] end connection 172.28.0.164:59017 (402 connections now open) 2015-10-05T08:43:10.506+0100 [mongosMain] connection accepted from 172.28.0.164:60022 #1431521 (403 connections now open) 2015-10-05T08:43:10.507+0100 [conn1431521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:11.130+0100 [conn1431202] end connection 172.28.0.164:59051 (402 connections now open) 2015-10-05T08:43:11.132+0100 [mongosMain] connection accepted from 172.28.0.164:60024 #1431522 (403 connections now open) 2015-10-05T08:43:11.134+0100 [conn1431522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:16.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a145703b51053ee308f 2015-10-05T08:43:16.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:18.480+0100 [conn1431185] end connection 172.28.0.163:49661 (402 connections now open) 2015-10-05T08:43:18.481+0100 [mongosMain] connection accepted from 172.28.0.163:50708 #1431523 (403 connections now open) 2015-10-05T08:43:18.481+0100 [conn1431523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:19.057+0100 [conn1431209] end connection 172.28.0.163:49743 (402 connections now open) 2015-10-05T08:43:19.058+0100 [mongosMain] connection accepted from 172.28.0.163:50710 #1431524 (403 connections now open) 2015-10-05T08:43:19.058+0100 [conn1431524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:20.243+0100 [conn1431066] end connection 172.28.0.163:49286 (402 connections now open) 2015-10-05T08:43:20.244+0100 [mongosMain] connection accepted from 172.28.0.163:50712 #1431525 (403 connections now open) 2015-10-05T08:43:20.245+0100 [conn1431525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:20.522+0100 [conn1431177] end connection 172.28.0.164:58977 (402 connections now open) 2015-10-05T08:43:20.523+0100 [mongosMain] connection accepted from 172.28.0.164:60034 #1431526 (403 connections now open) 2015-10-05T08:43:20.524+0100 [conn1431526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:21.145+0100 [conn1431210] end connection 172.28.0.164:59079 (402 connections now open) 2015-10-05T08:43:21.146+0100 [mongosMain] connection accepted from 172.28.0.164:60037 #1431527 (403 connections now open) 2015-10-05T08:43:21.152+0100 [conn1431527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:23.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a1a5703b51053ee30e8 2015-10-05T08:43:23.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:26.288+0100 [conn1431079] end connection 172.28.0.164:58652 (402 connections now open) 2015-10-05T08:43:26.292+0100 [mongosMain] connection accepted from 172.28.0.164:60046 #1431528 (403 connections now open) 2015-10-05T08:43:26.302+0100 [conn1431528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:28.496+0100 [conn1431200] end connection 172.28.0.163:49690 (402 connections now open) 2015-10-05T08:43:28.497+0100 [mongosMain] connection accepted from 172.28.0.163:50718 #1431529 (403 connections now open) 2015-10-05T08:43:28.498+0100 [conn1431529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:28.823+0100 [mongosMain] connection accepted from 127.0.0.1:50720 #1431530 (404 connections now open) 2015-10-05T08:43:28.826+0100 [conn1431530] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:28.831+0100 [conn1431530] end connection 127.0.0.1:50720 (403 connections now open) 2015-10-05T08:43:29.060+0100 [conn1431213] end connection 172.28.0.163:49760 (402 connections now open) 2015-10-05T08:43:29.061+0100 [mongosMain] connection accepted from 172.28.0.163:50721 #1431531 (403 connections now open) 2015-10-05T08:43:29.062+0100 [conn1431531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:29.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a215703b51053ee3143 2015-10-05T08:43:29.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:30.258+0100 [conn1431088] end connection 172.28.0.163:49330 (402 connections now open) 2015-10-05T08:43:30.260+0100 [mongosMain] connection accepted from 172.28.0.163:50723 #1431532 (403 connections now open) 2015-10-05T08:43:30.261+0100 [conn1431532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:30.522+0100 [conn1431155] end connection 172.28.0.164:58905 (402 connections now open) 2015-10-05T08:43:30.523+0100 [mongosMain] connection accepted from 172.28.0.164:60053 #1431533 (403 connections now open) 2015-10-05T08:43:30.524+0100 [conn1431533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:31.146+0100 [conn1431214] end connection 172.28.0.164:59088 (402 connections now open) 2015-10-05T08:43:31.147+0100 [mongosMain] connection accepted from 172.28.0.164:60055 #1431534 (403 connections now open) 2015-10-05T08:43:31.153+0100 [conn1431534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:35.747+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:43:35.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:43:36.141+0100 [conn1431134] end connection 172.28.0.164:58823 (402 connections now open) 2015-10-05T08:43:36.142+0100 [mongosMain] connection accepted from 172.28.0.164:60061 #1431535 (403 connections now open) 2015-10-05T08:43:36.144+0100 [conn1431535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:38.497+0100 [conn1431189] end connection 172.28.0.163:49667 (402 connections now open) 2015-10-05T08:43:38.498+0100 [mongosMain] connection accepted from 172.28.0.163:50730 #1431536 (403 connections now open) 2015-10-05T08:43:38.499+0100 [conn1431536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:39.073+0100 [conn1431217] end connection 172.28.0.163:49769 (402 connections now open) 2015-10-05T08:43:39.074+0100 [mongosMain] connection accepted from 172.28.0.163:50732 #1431537 (403 connections now open) 2015-10-05T08:43:39.075+0100 [conn1431537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:39.414+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:43:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:43:39.883+0100 [mongosMain] connection accepted from 127.0.0.1:50734 #1431538 (404 connections now open) 2015-10-05T08:43:39.886+0100 [conn1431538] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:39.890+0100 [conn1431538] end connection 127.0.0.1:50734 (403 connections now open) 2015-10-05T08:43:40.261+0100 [conn1430941] end connection 172.28.0.163:65334 (402 connections now open) 2015-10-05T08:43:40.262+0100 [mongosMain] connection accepted from 172.28.0.163:50735 #1431539 (403 connections now open) 2015-10-05T08:43:40.264+0100 [conn1431539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:40.538+0100 [conn1431164] end connection 172.28.0.164:58933 (402 connections now open) 2015-10-05T08:43:40.540+0100 [mongosMain] connection accepted from 172.28.0.164:60073 #1431540 (403 connections now open) 2015-10-05T08:43:40.543+0100 [conn1431540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:41.163+0100 [conn1431220] end connection 172.28.0.164:59106 (402 connections now open) 2015-10-05T08:43:41.164+0100 [mongosMain] connection accepted from 172.28.0.164:60076 #1431541 (403 connections now open) 2015-10-05T08:43:41.166+0100 [conn1431541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:42.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a2d5703b51053ee31d8 2015-10-05T08:43:42.792+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:48.512+0100 [conn1431195] end connection 172.28.0.163:49675 (402 connections now open) 2015-10-05T08:43:48.513+0100 [mongosMain] connection accepted from 172.28.0.163:50747 #1431542 (403 connections now open) 2015-10-05T08:43:48.514+0100 [conn1431542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:48.918+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a345703b51053ee3232 2015-10-05T08:43:49.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:49.074+0100 [conn1431223] end connection 172.28.0.163:49777 (402 connections now open) 2015-10-05T08:43:49.075+0100 [mongosMain] connection accepted from 172.28.0.163:50749 #1431543 (403 connections now open) 2015-10-05T08:43:49.075+0100 [conn1431543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:50.538+0100 [conn1431173] end connection 172.28.0.164:58962 (402 connections now open) 2015-10-05T08:43:50.539+0100 [mongosMain] connection accepted from 172.28.0.164:60091 #1431544 (403 connections now open) 2015-10-05T08:43:50.540+0100 [conn1431544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:51.162+0100 [conn1431226] end connection 172.28.0.164:59128 (402 connections now open) 2015-10-05T08:43:51.163+0100 [mongosMain] connection accepted from 172.28.0.164:60094 #1431545 (403 connections now open) 2015-10-05T08:43:51.165+0100 [conn1431545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:43:55.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a3b5703b51053ee327f 2015-10-05T08:43:55.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:43:59.089+0100 [conn1431228] end connection 172.28.0.163:49794 (402 connections now open) 2015-10-05T08:43:59.090+0100 [mongosMain] connection accepted from 172.28.0.163:50764 #1431546 (403 connections now open) 2015-10-05T08:43:59.091+0100 [conn1431546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:00.553+0100 [conn1431169] end connection 172.28.0.164:58951 (402 connections now open) 2015-10-05T08:44:00.554+0100 [mongosMain] connection accepted from 172.28.0.164:60104 #1431547 (403 connections now open) 2015-10-05T08:44:00.556+0100 [conn1431547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:00.798+0100 [conn1430776] end connection 172.28.0.163:64841 (402 connections now open) 2015-10-05T08:44:01.178+0100 [conn1431230] end connection 172.28.0.164:59143 (401 connections now open) 2015-10-05T08:44:01.179+0100 [mongosMain] connection accepted from 172.28.0.164:60107 #1431548 (402 connections now open) 2015-10-05T08:44:01.180+0100 [conn1431548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:01.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a415703b51053ee32b2 2015-10-05T08:44:02.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:44:06.592+0100 [conn1431211] end connection 172.28.0.164:59080 (401 connections now open) 2015-10-05T08:44:06.593+0100 [mongosMain] connection accepted from 172.28.0.164:60117 #1431549 (402 connections now open) 2015-10-05T08:44:06.595+0100 [conn1431549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:08.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a485703b51053ee3320 2015-10-05T08:44:08.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:44:09.671+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:44:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:44:10.553+0100 [conn1431142] end connection 172.28.0.164:58852 (401 connections now open) 2015-10-05T08:44:10.554+0100 [mongosMain] connection accepted from 172.28.0.164:60119 #1431550 (402 connections now open) 2015-10-05T08:44:10.556+0100 [conn1431550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:10.790+0100 [conn1431236] end connection 172.28.0.163:49816 (401 connections now open) 2015-10-05T08:44:11.178+0100 [conn1431242] end connection 172.28.0.164:59152 (400 connections now open) 2015-10-05T08:44:11.180+0100 [mongosMain] connection accepted from 172.28.0.164:60121 #1431551 (401 connections now open) 2015-10-05T08:44:11.183+0100 [conn1431551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:16.799+0100 [conn1431145] end connection 172.28.0.164:58860 (400 connections now open) 2015-10-05T08:44:16.802+0100 [conn1430823] end connection 172.28.0.164:57991 (399 connections now open) 2015-10-05T08:44:16.809+0100 [mongosMain] connection accepted from 172.28.0.164:60125 #1431552 (400 connections now open) 2015-10-05T08:44:16.810+0100 [conn1431552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:16.812+0100 [mongosMain] connection accepted from 172.28.0.164:60126 #1431553 (401 connections now open) 2015-10-05T08:44:16.814+0100 [conn1431553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:18.526+0100 [conn1431216] end connection 172.28.0.163:49767 (400 connections now open) 2015-10-05T08:44:18.528+0100 [mongosMain] connection accepted from 172.28.0.163:50800 #1431554 (401 connections now open) 2015-10-05T08:44:18.528+0100 [conn1431554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:19.105+0100 [conn1431243] end connection 172.28.0.163:49841 (400 connections now open) 2015-10-05T08:44:19.107+0100 [mongosMain] connection accepted from 172.28.0.163:50802 #1431555 (401 connections now open) 2015-10-05T08:44:19.108+0100 [conn1431555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:20.570+0100 [conn1431152] end connection 172.28.0.164:58880 (400 connections now open) 2015-10-05T08:44:20.572+0100 [mongosMain] connection accepted from 172.28.0.164:60132 #1431556 (401 connections now open) 2015-10-05T08:44:20.573+0100 [conn1431556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:20.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a545703b51053ee33b5 2015-10-05T08:44:20.790+0100 [conn1431118] end connection 172.28.0.163:49408 (400 connections now open) 2015-10-05T08:44:20.791+0100 [conn1430896] end connection 172.28.0.163:65200 (399 connections now open) 2015-10-05T08:44:20.792+0100 [mongosMain] connection accepted from 172.28.0.163:50806 #1431557 (400 connections now open) 2015-10-05T08:44:20.793+0100 [conn1431557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:20.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:44:21.193+0100 [conn1431245] end connection 172.28.0.164:59173 (399 connections now open) 2015-10-05T08:44:21.195+0100 [mongosMain] connection accepted from 172.28.0.164:60135 #1431558 (400 connections now open) 2015-10-05T08:44:21.204+0100 [conn1431558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:26.780+0100 [conn1431221] end connection 172.28.0.164:59111 (399 connections now open) 2015-10-05T08:44:26.780+0100 [conn1431128] end connection 172.28.0.164:58806 (399 connections now open) 2015-10-05T08:44:26.781+0100 [mongosMain] connection accepted from 172.28.0.164:60149 #1431559 (399 connections now open) 2015-10-05T08:44:26.781+0100 [mongosMain] connection accepted from 172.28.0.164:60148 #1431560 (400 connections now open) 2015-10-05T08:44:26.783+0100 [conn1431559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:26.783+0100 [conn1431560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:28.706+0100 [mongosMain] connection accepted from 127.0.0.1:50810 #1431561 (401 connections now open) 2015-10-05T08:44:28.708+0100 [conn1431561] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:28.714+0100 [conn1431561] end connection 127.0.0.1:50810 (400 connections now open) 2015-10-05T08:44:29.120+0100 [conn1431238] end connection 172.28.0.163:49819 (399 connections now open) 2015-10-05T08:44:29.121+0100 [mongosMain] connection accepted from 172.28.0.163:50811 #1431562 (400 connections now open) 2015-10-05T08:44:29.122+0100 [conn1431562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:30.569+0100 [conn1431159] end connection 172.28.0.164:58918 (399 connections now open) 2015-10-05T08:44:30.570+0100 [mongosMain] connection accepted from 172.28.0.164:60154 #1431563 (400 connections now open) 2015-10-05T08:44:30.571+0100 [conn1431563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:30.809+0100 [conn1431234] end connection 172.28.0.163:49813 (399 connections now open) 2015-10-05T08:44:30.810+0100 [conn1431054] end connection 172.28.0.163:49249 (398 connections now open) 2015-10-05T08:44:30.813+0100 [mongosMain] connection accepted from 172.28.0.163:50815 #1431564 (399 connections now open) 2015-10-05T08:44:30.814+0100 [conn1431564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:30.815+0100 [mongosMain] connection accepted from 172.28.0.163:50816 #1431565 (400 connections now open) 2015-10-05T08:44:30.816+0100 [conn1431565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:31.193+0100 [conn1431249] end connection 172.28.0.164:59184 (399 connections now open) 2015-10-05T08:44:31.195+0100 [mongosMain] connection accepted from 172.28.0.164:60158 #1431566 (400 connections now open) 2015-10-05T08:44:31.196+0100 [conn1431566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:34.331+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:44:34.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:44:36.794+0100 [conn1431035] end connection 172.28.0.164:58550 (399 connections now open) 2015-10-05T08:44:36.795+0100 [mongosMain] connection accepted from 172.28.0.164:60166 #1431567 (400 connections now open) 2015-10-05T08:44:36.796+0100 [conn1431567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:39.121+0100 [conn1431247] end connection 172.28.0.163:49856 (399 connections now open) 2015-10-05T08:44:39.122+0100 [mongosMain] connection accepted from 172.28.0.163:50818 #1431568 (400 connections now open) 2015-10-05T08:44:39.123+0100 [conn1431568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:40.120+0100 [mongosMain] connection accepted from 127.0.0.1:50820 #1431569 (401 connections now open) 2015-10-05T08:44:40.123+0100 [conn1431569] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:40.126+0100 [conn1431569] end connection 127.0.0.1:50820 (400 connections now open) 2015-10-05T08:44:40.307+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:44:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:44:40.586+0100 [conn1431219] end connection 172.28.0.164:59104 (399 connections now open) 2015-10-05T08:44:40.588+0100 [mongosMain] connection accepted from 172.28.0.164:60174 #1431570 (400 connections now open) 2015-10-05T08:44:40.589+0100 [conn1431570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:40.810+0100 [conn1431108] end connection 172.28.0.163:49386 (399 connections now open) 2015-10-05T08:44:40.811+0100 [conn1430887] end connection 172.28.0.163:65165 (398 connections now open) 2015-10-05T08:44:40.819+0100 [mongosMain] connection accepted from 172.28.0.163:50829 #1431571 (399 connections now open) 2015-10-05T08:44:40.820+0100 [conn1431571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:40.821+0100 [mongosMain] connection accepted from 172.28.0.163:50830 #1431572 (400 connections now open) 2015-10-05T08:44:40.822+0100 [conn1431572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:41.210+0100 [conn1431254] end connection 172.28.0.164:59203 (399 connections now open) 2015-10-05T08:44:41.211+0100 [mongosMain] connection accepted from 172.28.0.164:60176 #1431573 (400 connections now open) 2015-10-05T08:44:41.212+0100 [conn1431573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:41.621+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:44:41.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:44:46.795+0100 [conn1431020] end connection 172.28.0.164:58517 (399 connections now open) 2015-10-05T08:44:46.796+0100 [mongosMain] connection accepted from 172.28.0.164:60180 #1431574 (400 connections now open) 2015-10-05T08:44:46.798+0100 [conn1431574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:47.790+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:44:47.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:44:49.136+0100 [conn1431257] end connection 172.28.0.163:49873 (399 connections now open) 2015-10-05T08:44:49.137+0100 [mongosMain] connection accepted from 172.28.0.163:50841 #1431575 (400 connections now open) 2015-10-05T08:44:49.138+0100 [conn1431575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:50.601+0100 [conn1431182] end connection 172.28.0.164:58995 (399 connections now open) 2015-10-05T08:44:50.602+0100 [mongosMain] connection accepted from 172.28.0.164:60190 #1431576 (400 connections now open) 2015-10-05T08:44:50.604+0100 [conn1431576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:51.225+0100 [conn1431260] end connection 172.28.0.164:59223 (399 connections now open) 2015-10-05T08:44:51.234+0100 [mongosMain] connection accepted from 172.28.0.164:60193 #1431577 (400 connections now open) 2015-10-05T08:44:51.236+0100 [conn1431577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:51.471+0100 [conn1431113] end connection 172.28.0.163:49395 (399 connections now open) 2015-10-05T08:44:51.481+0100 [conn1431046] end connection 172.28.0.163:49222 (398 connections now open) 2015-10-05T08:44:51.490+0100 [mongosMain] connection accepted from 172.28.0.163:50846 #1431578 (399 connections now open) 2015-10-05T08:44:51.490+0100 [conn1431578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:51.495+0100 [mongosMain] connection accepted from 172.28.0.163:50847 #1431579 (400 connections now open) 2015-10-05T08:44:51.496+0100 [conn1431579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:54.342+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:44:54.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:44:57.407+0100 [conn1431215] end connection 172.28.0.164:59093 (399 connections now open) 2015-10-05T08:44:57.717+0100 [mongosMain] connection accepted from 172.28.0.164:60198 #1431580 (400 connections now open) 2015-10-05T08:44:57.719+0100 [conn1431580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:44:59.140+0100 [conn1431264] end connection 172.28.0.163:49888 (399 connections now open) 2015-10-05T08:44:59.141+0100 [mongosMain] connection accepted from 172.28.0.163:50859 #1431581 (400 connections now open) 2015-10-05T08:44:59.142+0100 [conn1431581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:00.496+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:45:00.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:45:00.617+0100 [conn1431147] end connection 172.28.0.164:58868 (399 connections now open) 2015-10-05T08:45:00.618+0100 [mongosMain] connection accepted from 172.28.0.164:60207 #1431582 (400 connections now open) 2015-10-05T08:45:00.620+0100 [conn1431582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:01.225+0100 [conn1431265] end connection 172.28.0.164:59244 (399 connections now open) 2015-10-05T08:45:01.226+0100 [mongosMain] connection accepted from 172.28.0.164:60212 #1431583 (400 connections now open) 2015-10-05T08:45:01.228+0100 [conn1431583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:01.430+0100 [conn1430931] end connection 172.28.0.163:65303 (399 connections now open) 2015-10-05T08:45:01.430+0100 [conn1431121] end connection 172.28.0.163:49419 (399 connections now open) 2015-10-05T08:45:01.431+0100 [mongosMain] connection accepted from 172.28.0.163:50878 #1431584 (399 connections now open) 2015-10-05T08:45:01.432+0100 [mongosMain] connection accepted from 172.28.0.163:50879 #1431585 (400 connections now open) 2015-10-05T08:45:01.432+0100 [conn1431584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:01.432+0100 [conn1431585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:06.842+0100 [conn1431139] end connection 172.28.0.164:58838 (399 connections now open) 2015-10-05T08:45:06.843+0100 [mongosMain] connection accepted from 172.28.0.164:60215 #1431586 (400 connections now open) 2015-10-05T08:45:06.844+0100 [conn1431586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:07.342+0100 [conn1431012] end connection 172.28.0.164:58509 (399 connections now open) 2015-10-05T08:45:07.346+0100 [mongosMain] connection accepted from 172.28.0.164:60216 #1431587 (400 connections now open) 2015-10-05T08:45:07.348+0100 [conn1431587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:08.583+0100 [conn1431204] end connection 172.28.0.163:49702 (399 connections now open) 2015-10-05T08:45:08.585+0100 [mongosMain] connection accepted from 172.28.0.163:50888 #1431588 (400 connections now open) 2015-10-05T08:45:08.586+0100 [conn1431588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:09.151+0100 [conn1431269] end connection 172.28.0.163:49901 (399 connections now open) 2015-10-05T08:45:09.152+0100 [mongosMain] connection accepted from 172.28.0.163:50892 #1431589 (400 connections now open) 2015-10-05T08:45:09.153+0100 [conn1431589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:10.612+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:45:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:45:10.633+0100 [conn1431229] end connection 172.28.0.164:59140 (399 connections now open) 2015-10-05T08:45:10.634+0100 [mongosMain] connection accepted from 172.28.0.164:60218 #1431590 (400 connections now open) 2015-10-05T08:45:10.635+0100 [conn1431590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:11.442+0100 [conn1431268] end connection 172.28.0.163:49898 (399 connections now open) 2015-10-05T08:45:11.442+0100 [conn1431029] end connection 172.28.0.163:49158 (399 connections now open) 2015-10-05T08:45:11.444+0100 [mongosMain] connection accepted from 172.28.0.163:50897 #1431591 (399 connections now open) 2015-10-05T08:45:11.444+0100 [mongosMain] connection accepted from 172.28.0.163:50898 #1431592 (400 connections now open) 2015-10-05T08:45:11.445+0100 [conn1431591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:11.445+0100 [conn1431592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:12.658+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:45:12.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:45:16.865+0100 [conn1431271] end connection 172.28.0.164:59262 (399 connections now open) 2015-10-05T08:45:16.866+0100 [conn1430954] end connection 172.28.0.164:58365 (398 connections now open) 2015-10-05T08:45:16.866+0100 [mongosMain] connection accepted from 172.28.0.164:60224 #1431593 (399 connections now open) 2015-10-05T08:45:16.867+0100 [mongosMain] connection accepted from 172.28.0.164:60225 #1431594 (400 connections now open) 2015-10-05T08:45:16.868+0100 [conn1431593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:16.869+0100 [conn1431594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:18.590+0100 [conn1431227] end connection 172.28.0.163:49792 (399 connections now open) 2015-10-05T08:45:18.592+0100 [mongosMain] connection accepted from 172.28.0.163:50904 #1431595 (400 connections now open) 2015-10-05T08:45:18.593+0100 [conn1431595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:18.727+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:45:18.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:45:19.152+0100 [conn1431274] end connection 172.28.0.163:49930 (399 connections now open) 2015-10-05T08:45:19.153+0100 [mongosMain] connection accepted from 172.28.0.163:50906 #1431596 (400 connections now open) 2015-10-05T08:45:19.155+0100 [conn1431596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:20.648+0100 [conn1431225] end connection 172.28.0.164:59125 (399 connections now open) 2015-10-05T08:45:20.649+0100 [mongosMain] connection accepted from 172.28.0.164:60233 #1431597 (400 connections now open) 2015-10-05T08:45:20.651+0100 [conn1431597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:21.257+0100 [conn1431270] end connection 172.28.0.164:59254 (399 connections now open) 2015-10-05T08:45:21.259+0100 [mongosMain] connection accepted from 172.28.0.164:60235 #1431598 (400 connections now open) 2015-10-05T08:45:21.261+0100 [conn1431598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:21.457+0100 [conn1431256] end connection 172.28.0.163:49869 (399 connections now open) 2015-10-05T08:45:21.458+0100 [conn1431060] end connection 172.28.0.163:49274 (399 connections now open) 2015-10-05T08:45:21.460+0100 [mongosMain] connection accepted from 172.28.0.163:50909 #1431599 (399 connections now open) 2015-10-05T08:45:21.461+0100 [mongosMain] connection accepted from 172.28.0.163:50910 #1431600 (400 connections now open) 2015-10-05T08:45:21.470+0100 [conn1431600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:21.470+0100 [conn1431599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:25.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122a945703b51053ee3703 2015-10-05T08:45:25.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:45:26.866+0100 [conn1431262] end connection 172.28.0.164:59229 (399 connections now open) 2015-10-05T08:45:26.867+0100 [conn1430929] end connection 172.28.0.164:58304 (398 connections now open) 2015-10-05T08:45:26.868+0100 [mongosMain] connection accepted from 172.28.0.164:60245 #1431601 (399 connections now open) 2015-10-05T08:45:26.868+0100 [mongosMain] connection accepted from 172.28.0.164:60246 #1431602 (400 connections now open) 2015-10-05T08:45:26.870+0100 [conn1431601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:26.870+0100 [conn1431602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:28.591+0100 [conn1431208] end connection 172.28.0.163:49740 (399 connections now open) 2015-10-05T08:45:28.593+0100 [mongosMain] connection accepted from 172.28.0.163:50915 #1431603 (400 connections now open) 2015-10-05T08:45:28.594+0100 [conn1431603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:28.898+0100 [mongosMain] connection accepted from 127.0.0.1:50917 #1431604 (401 connections now open) 2015-10-05T08:45:28.901+0100 [conn1431604] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:28.906+0100 [conn1431604] end connection 127.0.0.1:50917 (400 connections now open) 2015-10-05T08:45:29.168+0100 [conn1431278] end connection 172.28.0.163:49954 (399 connections now open) 2015-10-05T08:45:29.169+0100 [mongosMain] connection accepted from 172.28.0.163:50918 #1431605 (400 connections now open) 2015-10-05T08:45:29.171+0100 [conn1431605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:30.664+0100 [conn1431244] end connection 172.28.0.164:59171 (399 connections now open) 2015-10-05T08:45:30.665+0100 [mongosMain] connection accepted from 172.28.0.164:60251 #1431606 (400 connections now open) 2015-10-05T08:45:30.668+0100 [conn1431606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:31.271+0100 [conn1431280] end connection 172.28.0.164:59286 (399 connections now open) 2015-10-05T08:45:31.273+0100 [mongosMain] connection accepted from 172.28.0.164:60254 #1431607 (400 connections now open) 2015-10-05T08:45:31.274+0100 [conn1431607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:31.461+0100 [conn1431129] end connection 172.28.0.163:49474 (399 connections now open) 2015-10-05T08:45:31.461+0100 [conn1431231] end connection 172.28.0.163:49810 (399 connections now open) 2015-10-05T08:45:31.462+0100 [mongosMain] connection accepted from 172.28.0.163:50921 #1431608 (399 connections now open) 2015-10-05T08:45:31.463+0100 [mongosMain] connection accepted from 172.28.0.163:50922 #1431609 (400 connections now open) 2015-10-05T08:45:31.463+0100 [conn1431608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:31.464+0100 [conn1431609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:36.873+0100 [conn1431266] end connection 172.28.0.164:59248 (399 connections now open) 2015-10-05T08:45:36.873+0100 [conn1431184] end connection 172.28.0.164:59000 (399 connections now open) 2015-10-05T08:45:36.875+0100 [mongosMain] connection accepted from 172.28.0.164:60264 #1431610 (399 connections now open) 2015-10-05T08:45:36.875+0100 [mongosMain] connection accepted from 172.28.0.164:60263 #1431611 (400 connections now open) 2015-10-05T08:45:36.877+0100 [conn1431610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:36.877+0100 [conn1431611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:37.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122aa15703b51053ee378e 2015-10-05T08:45:37.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:45:39.183+0100 [conn1431285] end connection 172.28.0.163:49962 (399 connections now open) 2015-10-05T08:45:39.184+0100 [mongosMain] connection accepted from 172.28.0.163:50928 #1431612 (400 connections now open) 2015-10-05T08:45:39.185+0100 [conn1431612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:39.735+0100 [mongosMain] connection accepted from 127.0.0.1:50930 #1431613 (401 connections now open) 2015-10-05T08:45:39.738+0100 [conn1431613] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:39.743+0100 [conn1431613] end connection 127.0.0.1:50930 (400 connections now open) 2015-10-05T08:45:40.679+0100 [conn1431187] end connection 172.28.0.164:59006 (399 connections now open) 2015-10-05T08:45:40.681+0100 [mongosMain] connection accepted from 172.28.0.164:60274 #1431614 (400 connections now open) 2015-10-05T08:45:40.682+0100 [conn1431614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:40.892+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:45:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:45:41.288+0100 [conn1431287] end connection 172.28.0.164:59303 (399 connections now open) 2015-10-05T08:45:41.290+0100 [mongosMain] connection accepted from 172.28.0.164:60276 #1431615 (400 connections now open) 2015-10-05T08:45:41.291+0100 [conn1431615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:41.466+0100 [conn1431251] end connection 172.28.0.163:49861 (399 connections now open) 2015-10-05T08:45:41.469+0100 [conn1431081] end connection 172.28.0.163:49309 (398 connections now open) 2015-10-05T08:45:41.470+0100 [mongosMain] connection accepted from 172.28.0.163:50934 #1431616 (399 connections now open) 2015-10-05T08:45:41.471+0100 [mongosMain] connection accepted from 172.28.0.163:50935 #1431617 (400 connections now open) 2015-10-05T08:45:41.471+0100 [conn1431616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:41.471+0100 [conn1431617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:46.892+0100 [conn1430992] end connection 172.28.0.164:58447 (399 connections now open) 2015-10-05T08:45:46.893+0100 [mongosMain] connection accepted from 172.28.0.164:60281 #1431618 (400 connections now open) 2015-10-05T08:45:46.894+0100 [conn1431618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:49.184+0100 [conn1431292] end connection 172.28.0.163:49979 (399 connections now open) 2015-10-05T08:45:49.185+0100 [mongosMain] connection accepted from 172.28.0.163:50942 #1431619 (400 connections now open) 2015-10-05T08:45:49.186+0100 [conn1431619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:51.306+0100 [conn1431293] end connection 172.28.0.164:59321 (399 connections now open) 2015-10-05T08:45:51.307+0100 [mongosMain] connection accepted from 172.28.0.164:60285 #1431620 (400 connections now open) 2015-10-05T08:45:51.309+0100 [conn1431620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:51.476+0100 [conn1431232] end connection 172.28.0.163:49811 (399 connections now open) 2015-10-05T08:45:51.476+0100 [conn1431246] end connection 172.28.0.163:49849 (398 connections now open) 2015-10-05T08:45:51.477+0100 [mongosMain] connection accepted from 172.28.0.163:50944 #1431621 (399 connections now open) 2015-10-05T08:45:51.478+0100 [mongosMain] connection accepted from 172.28.0.163:50945 #1431622 (400 connections now open) 2015-10-05T08:45:51.478+0100 [conn1431621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:51.479+0100 [conn1431622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:56.971+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:45:56.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:45:57.000+0100 [conn1430962] end connection 172.28.0.164:58381 (399 connections now open) 2015-10-05T08:45:57.004+0100 [mongosMain] connection accepted from 172.28.0.164:60302 #1431623 (400 connections now open) 2015-10-05T08:45:57.005+0100 [conn1431623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:45:59.230+0100 [conn1431297] end connection 172.28.0.163:49987 (399 connections now open) 2015-10-05T08:45:59.230+0100 [mongosMain] connection accepted from 172.28.0.163:50966 #1431624 (400 connections now open) 2015-10-05T08:45:59.230+0100 [conn1431624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:01.320+0100 [conn1431298] end connection 172.28.0.164:59330 (399 connections now open) 2015-10-05T08:46:01.321+0100 [mongosMain] connection accepted from 172.28.0.164:60311 #1431625 (400 connections now open) 2015-10-05T08:46:01.322+0100 [conn1431625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:01.482+0100 [conn1431277] end connection 172.28.0.163:49949 (399 connections now open) 2015-10-05T08:46:01.482+0100 [conn1431240] end connection 172.28.0.163:49825 (399 connections now open) 2015-10-05T08:46:01.483+0100 [mongosMain] connection accepted from 172.28.0.163:50976 #1431626 (399 connections now open) 2015-10-05T08:46:01.483+0100 [mongosMain] connection accepted from 172.28.0.163:50977 #1431627 (400 connections now open) 2015-10-05T08:46:01.484+0100 [conn1431626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:01.484+0100 [conn1431627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:05.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122aba5703b51053ee3876 2015-10-05T08:46:06.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:46:06.968+0100 [conn1430967] end connection 172.28.0.164:58396 (399 connections now open) 2015-10-05T08:46:06.970+0100 [mongosMain] connection accepted from 172.28.0.164:60317 #1431628 (400 connections now open) 2015-10-05T08:46:06.973+0100 [conn1431628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:08.637+0100 [conn1431237] end connection 172.28.0.163:49817 (399 connections now open) 2015-10-05T08:46:08.637+0100 [mongosMain] connection accepted from 172.28.0.163:50991 #1431629 (400 connections now open) 2015-10-05T08:46:08.638+0100 [conn1431629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:10.727+0100 [conn1431248] end connection 172.28.0.164:59182 (399 connections now open) 2015-10-05T08:46:10.729+0100 [mongosMain] connection accepted from 172.28.0.164:60320 #1431630 (400 connections now open) 2015-10-05T08:46:10.731+0100 [conn1431630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:11.102+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:46:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:46:11.336+0100 [conn1431304] end connection 172.28.0.164:59353 (399 connections now open) 2015-10-05T08:46:11.337+0100 [mongosMain] connection accepted from 172.28.0.164:60322 #1431631 (400 connections now open) 2015-10-05T08:46:11.339+0100 [conn1431631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:11.493+0100 [conn1431263] end connection 172.28.0.163:49882 (399 connections now open) 2015-10-05T08:46:11.494+0100 [mongosMain] connection accepted from 172.28.0.163:50994 #1431632 (400 connections now open) 2015-10-05T08:46:11.495+0100 [conn1430970] end connection 172.28.0.163:65410 (399 connections now open) 2015-10-05T08:46:11.496+0100 [conn1431632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:11.496+0100 [mongosMain] connection accepted from 172.28.0.163:50998 #1431633 (400 connections now open) 2015-10-05T08:46:11.497+0100 [conn1431633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:15.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ac45703b51053ee38f5 2015-10-05T08:46:15.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:46:16.982+0100 [conn1431120] end connection 172.28.0.164:58772 (399 connections now open) 2015-10-05T08:46:16.982+0100 [conn1431153] end connection 172.28.0.164:58900 (399 connections now open) 2015-10-05T08:46:16.983+0100 [mongosMain] connection accepted from 172.28.0.164:60327 #1431634 (399 connections now open) 2015-10-05T08:46:16.984+0100 [mongosMain] connection accepted from 172.28.0.164:60328 #1431635 (400 connections now open) 2015-10-05T08:46:16.985+0100 [conn1431634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:16.986+0100 [conn1431635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:19.215+0100 [conn1431309] end connection 172.28.0.163:50042 (399 connections now open) 2015-10-05T08:46:19.216+0100 [mongosMain] connection accepted from 172.28.0.163:51006 #1431636 (400 connections now open) 2015-10-05T08:46:19.216+0100 [conn1431636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:21.494+0100 [conn1431104] end connection 172.28.0.163:49376 (399 connections now open) 2015-10-05T08:46:21.494+0100 [conn1431273] end connection 172.28.0.163:49925 (398 connections now open) 2015-10-05T08:46:21.495+0100 [mongosMain] connection accepted from 172.28.0.163:51012 #1431637 (399 connections now open) 2015-10-05T08:46:21.496+0100 [mongosMain] connection accepted from 172.28.0.163:51013 #1431638 (400 connections now open) 2015-10-05T08:46:21.496+0100 [conn1431637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:21.497+0100 [conn1431638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:26.999+0100 [conn1431300] end connection 172.28.0.164:59346 (399 connections now open) 2015-10-05T08:46:27.002+0100 [mongosMain] connection accepted from 172.28.0.164:60343 #1431639 (400 connections now open) 2015-10-05T08:46:27.004+0100 [conn1431639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:28.315+0100 [mongosMain] connection accepted from 127.0.0.1:51016 #1431640 (401 connections now open) 2015-10-05T08:46:28.317+0100 [conn1431640] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:28.322+0100 [conn1431640] end connection 127.0.0.1:51016 (400 connections now open) 2015-10-05T08:46:28.535+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:46:28.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:46:28.653+0100 [conn1431284] end connection 172.28.0.163:49960 (399 connections now open) 2015-10-05T08:46:28.654+0100 [mongosMain] connection accepted from 172.28.0.163:51017 #1431641 (400 connections now open) 2015-10-05T08:46:28.655+0100 [conn1431641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:29.109+0100 [mongosMain] connection accepted from 172.28.0.164:60346 #1431642 (401 connections now open) 2015-10-05T08:46:29.113+0100 [conn1430947] end connection 172.28.0.164:58343 (400 connections now open) 2015-10-05T08:46:29.121+0100 [conn1431642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:29.218+0100 [conn1431303] end connection 172.28.0.163:50014 (399 connections now open) 2015-10-05T08:46:29.219+0100 [mongosMain] connection accepted from 172.28.0.163:51019 #1431643 (400 connections now open) 2015-10-05T08:46:29.220+0100 [conn1431643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:30.742+0100 [conn1431253] end connection 172.28.0.164:59200 (399 connections now open) 2015-10-05T08:46:30.743+0100 [mongosMain] connection accepted from 172.28.0.164:60351 #1431644 (400 connections now open) 2015-10-05T08:46:30.744+0100 [conn1431644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:31.367+0100 [conn1431310] end connection 172.28.0.164:59373 (399 connections now open) 2015-10-05T08:46:31.368+0100 [mongosMain] connection accepted from 172.28.0.164:60353 #1431645 (400 connections now open) 2015-10-05T08:46:31.370+0100 [conn1431645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:31.510+0100 [conn1431283] end connection 172.28.0.163:49958 (399 connections now open) 2015-10-05T08:46:31.510+0100 [conn1430688] end connection 172.28.0.163:64571 (399 connections now open) 2015-10-05T08:46:31.511+0100 [mongosMain] connection accepted from 172.28.0.163:51021 #1431646 (399 connections now open) 2015-10-05T08:46:31.511+0100 [mongosMain] connection accepted from 172.28.0.163:51022 #1431647 (400 connections now open) 2015-10-05T08:46:31.512+0100 [conn1431646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:31.513+0100 [conn1431647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:35.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ada5703b51053ee39f9 2015-10-05T08:46:35.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:46:37.014+0100 [conn1431311] end connection 172.28.0.164:59375 (399 connections now open) 2015-10-05T08:46:37.014+0100 [conn1431194] end connection 172.28.0.164:59025 (398 connections now open) 2015-10-05T08:46:37.015+0100 [mongosMain] connection accepted from 172.28.0.164:60361 #1431648 (399 connections now open) 2015-10-05T08:46:37.015+0100 [mongosMain] connection accepted from 172.28.0.164:60362 #1431649 (400 connections now open) 2015-10-05T08:46:37.016+0100 [conn1431648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:37.016+0100 [conn1431649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:38.655+0100 [conn1431222] end connection 172.28.0.163:49775 (399 connections now open) 2015-10-05T08:46:38.656+0100 [mongosMain] connection accepted from 172.28.0.163:51027 #1431650 (400 connections now open) 2015-10-05T08:46:38.657+0100 [conn1431650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:39.229+0100 [conn1431314] end connection 172.28.0.163:50055 (399 connections now open) 2015-10-05T08:46:39.230+0100 [mongosMain] connection accepted from 172.28.0.163:51029 #1431651 (400 connections now open) 2015-10-05T08:46:39.231+0100 [conn1431651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:39.790+0100 [mongosMain] connection accepted from 127.0.0.1:51031 #1431652 (401 connections now open) 2015-10-05T08:46:39.794+0100 [conn1431652] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:39.799+0100 [conn1431652] end connection 127.0.0.1:51031 (400 connections now open) 2015-10-05T08:46:40.758+0100 [conn1431315] end connection 172.28.0.164:59384 (399 connections now open) 2015-10-05T08:46:40.759+0100 [mongosMain] connection accepted from 172.28.0.164:60371 #1431653 (400 connections now open) 2015-10-05T08:46:40.761+0100 [conn1431653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:41.366+0100 [conn1431322] end connection 172.28.0.164:59406 (399 connections now open) 2015-10-05T08:46:41.367+0100 [mongosMain] connection accepted from 172.28.0.164:60374 #1431654 (400 connections now open) 2015-10-05T08:46:41.369+0100 [conn1431654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:41.525+0100 [conn1431053] end connection 172.28.0.163:49248 (399 connections now open) 2015-10-05T08:46:41.525+0100 [conn1431302] end connection 172.28.0.163:50006 (399 connections now open) 2015-10-05T08:46:41.526+0100 [mongosMain] connection accepted from 172.28.0.163:51034 #1431655 (399 connections now open) 2015-10-05T08:46:41.526+0100 [mongosMain] connection accepted from 172.28.0.163:51035 #1431656 (400 connections now open) 2015-10-05T08:46:41.527+0100 [conn1431655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:41.527+0100 [conn1431656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:41.751+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:46:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:46:47.030+0100 [conn1431250] end connection 172.28.0.164:59191 (399 connections now open) 2015-10-05T08:46:47.031+0100 [mongosMain] connection accepted from 172.28.0.164:60384 #1431657 (400 connections now open) 2015-10-05T08:46:47.031+0100 [conn1431102] end connection 172.28.0.164:58705 (399 connections now open) 2015-10-05T08:46:47.033+0100 [conn1431657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:47.033+0100 [mongosMain] connection accepted from 172.28.0.164:60385 #1431658 (400 connections now open) 2015-10-05T08:46:47.034+0100 [conn1431658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:47.518+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:46:47.518+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:46:49.231+0100 [conn1431319] end connection 172.28.0.163:50063 (399 connections now open) 2015-10-05T08:46:49.232+0100 [mongosMain] connection accepted from 172.28.0.163:51047 #1431659 (400 connections now open) 2015-10-05T08:46:49.232+0100 [conn1431659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:50.773+0100 [conn1431259] end connection 172.28.0.164:59221 (399 connections now open) 2015-10-05T08:46:50.774+0100 [mongosMain] connection accepted from 172.28.0.164:60390 #1431660 (400 connections now open) 2015-10-05T08:46:50.776+0100 [conn1431660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:51.382+0100 [conn1431330] end connection 172.28.0.164:59425 (399 connections now open) 2015-10-05T08:46:51.383+0100 [mongosMain] connection accepted from 172.28.0.164:60391 #1431661 (400 connections now open) 2015-10-05T08:46:51.385+0100 [conn1431661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:51.530+0100 [conn1431290] end connection 172.28.0.163:49973 (399 connections now open) 2015-10-05T08:46:51.531+0100 [conn1430964] end connection 172.28.0.163:65380 (399 connections now open) 2015-10-05T08:46:51.532+0100 [mongosMain] connection accepted from 172.28.0.163:51050 #1431662 (399 connections now open) 2015-10-05T08:46:51.532+0100 [mongosMain] connection accepted from 172.28.0.163:51051 #1431663 (400 connections now open) 2015-10-05T08:46:51.533+0100 [conn1431662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:51.533+0100 [conn1431663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:54.509+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:46:54.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:46:57.045+0100 [conn1431305] end connection 172.28.0.164:59369 (399 connections now open) 2015-10-05T08:46:57.046+0100 [conn1431005] end connection 172.28.0.164:58479 (398 connections now open) 2015-10-05T08:46:57.046+0100 [mongosMain] connection accepted from 172.28.0.164:60400 #1431664 (400 connections now open) 2015-10-05T08:46:57.047+0100 [mongosMain] connection accepted from 172.28.0.164:60401 #1431665 (400 connections now open) 2015-10-05T08:46:57.048+0100 [conn1431664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:57.048+0100 [conn1431665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:46:59.246+0100 [conn1431327] end connection 172.28.0.163:50073 (399 connections now open) 2015-10-05T08:46:59.247+0100 [mongosMain] connection accepted from 172.28.0.163:51059 #1431666 (400 connections now open) 2015-10-05T08:46:59.249+0100 [conn1431666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:00.789+0100 [conn1431279] end connection 172.28.0.164:59283 (399 connections now open) 2015-10-05T08:47:00.789+0100 [mongosMain] connection accepted from 172.28.0.164:60405 #1431667 (400 connections now open) 2015-10-05T08:47:00.791+0100 [conn1431667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:01.398+0100 [conn1431337] end connection 172.28.0.164:59444 (399 connections now open) 2015-10-05T08:47:01.400+0100 [mongosMain] connection accepted from 172.28.0.164:60408 #1431668 (400 connections now open) 2015-10-05T08:47:01.402+0100 [conn1431668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:01.540+0100 [conn1430771] end connection 172.28.0.163:64826 (399 connections now open) 2015-10-05T08:47:01.540+0100 [conn1431307] end connection 172.28.0.163:50034 (399 connections now open) 2015-10-05T08:47:01.541+0100 [mongosMain] connection accepted from 172.28.0.163:51065 #1431669 (399 connections now open) 2015-10-05T08:47:01.541+0100 [mongosMain] connection accepted from 172.28.0.163:51066 #1431670 (400 connections now open) 2015-10-05T08:47:01.542+0100 [conn1431669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:01.542+0100 [conn1431670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:01.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122af55703b51053ee3b93 2015-10-05T08:47:01.906+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:07.062+0100 [conn1431295] end connection 172.28.0.164:59326 (399 connections now open) 2015-10-05T08:47:07.062+0100 [conn1430939] end connection 172.28.0.164:58324 (398 connections now open) 2015-10-05T08:47:07.063+0100 [mongosMain] connection accepted from 172.28.0.164:60420 #1431671 (399 connections now open) 2015-10-05T08:47:07.064+0100 [mongosMain] connection accepted from 172.28.0.164:60421 #1431672 (400 connections now open) 2015-10-05T08:47:07.064+0100 [conn1431671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:07.065+0100 [conn1431672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:08.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122afc5703b51053ee3c05 2015-10-05T08:47:08.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:09.262+0100 [conn1431335] end connection 172.28.0.163:50091 (399 connections now open) 2015-10-05T08:47:09.263+0100 [mongosMain] connection accepted from 172.28.0.163:51093 #1431673 (400 connections now open) 2015-10-05T08:47:09.264+0100 [conn1431673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:10.805+0100 [conn1431343] end connection 172.28.0.164:59449 (399 connections now open) 2015-10-05T08:47:10.806+0100 [mongosMain] connection accepted from 172.28.0.164:60424 #1431674 (400 connections now open) 2015-10-05T08:47:10.808+0100 [conn1431674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:11.414+0100 [conn1431344] end connection 172.28.0.164:59460 (399 connections now open) 2015-10-05T08:47:11.415+0100 [mongosMain] connection accepted from 172.28.0.164:60426 #1431675 (400 connections now open) 2015-10-05T08:47:11.416+0100 [conn1431675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:11.547+0100 [conn1430950] end connection 172.28.0.163:65350 (399 connections now open) 2015-10-05T08:47:11.547+0100 [conn1431313] end connection 172.28.0.163:50052 (399 connections now open) 2015-10-05T08:47:11.548+0100 [mongosMain] connection accepted from 172.28.0.163:51101 #1431676 (399 connections now open) 2015-10-05T08:47:11.548+0100 [mongosMain] connection accepted from 172.28.0.163:51102 #1431677 (400 connections now open) 2015-10-05T08:47:11.549+0100 [conn1431676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:11.549+0100 [conn1431677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:11.898+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:47:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:47:15.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b025703b51053ee3c5f 2015-10-05T08:47:15.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:17.061+0100 [conn1431275] end connection 172.28.0.164:59276 (399 connections now open) 2015-10-05T08:47:17.062+0100 [conn1431206] end connection 172.28.0.164:59073 (398 connections now open) 2015-10-05T08:47:17.063+0100 [mongosMain] connection accepted from 172.28.0.164:60430 #1431678 (399 connections now open) 2015-10-05T08:47:17.063+0100 [mongosMain] connection accepted from 172.28.0.164:60431 #1431679 (400 connections now open) 2015-10-05T08:47:17.064+0100 [conn1431678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:17.065+0100 [conn1431679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:19.262+0100 [conn1431342] end connection 172.28.0.163:50097 (399 connections now open) 2015-10-05T08:47:19.263+0100 [mongosMain] connection accepted from 172.28.0.163:51115 #1431680 (400 connections now open) 2015-10-05T08:47:19.264+0100 [conn1431680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:20.806+0100 [conn1431336] end connection 172.28.0.164:59443 (399 connections now open) 2015-10-05T08:47:20.807+0100 [mongosMain] connection accepted from 172.28.0.164:60437 #1431681 (400 connections now open) 2015-10-05T08:47:20.809+0100 [conn1431681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:21.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b095703b51053ee3c9c 2015-10-05T08:47:21.430+0100 [conn1431351] end connection 172.28.0.164:59478 (399 connections now open) 2015-10-05T08:47:21.431+0100 [mongosMain] connection accepted from 172.28.0.164:60441 #1431682 (400 connections now open) 2015-10-05T08:47:21.432+0100 [conn1431682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:21.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:21.556+0100 [conn1431296] end connection 172.28.0.163:49983 (399 connections now open) 2015-10-05T08:47:21.556+0100 [conn1430661] end connection 172.28.0.163:64500 (399 connections now open) 2015-10-05T08:47:21.557+0100 [mongosMain] connection accepted from 172.28.0.163:51118 #1431683 (399 connections now open) 2015-10-05T08:47:21.557+0100 [mongosMain] connection accepted from 172.28.0.163:51119 #1431684 (400 connections now open) 2015-10-05T08:47:21.557+0100 [conn1431683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:21.558+0100 [conn1431684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:27.077+0100 [conn1431027] end connection 172.28.0.164:58532 (399 connections now open) 2015-10-05T08:47:27.078+0100 [conn1431255] end connection 172.28.0.164:59210 (398 connections now open) 2015-10-05T08:47:27.079+0100 [mongosMain] connection accepted from 172.28.0.164:60451 #1431685 (399 connections now open) 2015-10-05T08:47:27.079+0100 [mongosMain] connection accepted from 172.28.0.164:60452 #1431686 (400 connections now open) 2015-10-05T08:47:27.081+0100 [conn1431685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:27.081+0100 [conn1431686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:28.459+0100 [mongosMain] connection accepted from 127.0.0.1:51123 #1431687 (401 connections now open) 2015-10-05T08:47:28.462+0100 [conn1431687] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:28.468+0100 [conn1431687] end connection 127.0.0.1:51123 (400 connections now open) 2015-10-05T08:47:29.277+0100 [conn1431349] end connection 172.28.0.163:50124 (399 connections now open) 2015-10-05T08:47:29.278+0100 [mongosMain] connection accepted from 172.28.0.163:51125 #1431688 (400 connections now open) 2015-10-05T08:47:29.279+0100 [conn1431688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:30.821+0100 [conn1431321] end connection 172.28.0.164:59402 (399 connections now open) 2015-10-05T08:47:30.822+0100 [mongosMain] connection accepted from 172.28.0.164:60456 #1431689 (400 connections now open) 2015-10-05T08:47:30.824+0100 [conn1431689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:31.446+0100 [conn1431358] end connection 172.28.0.164:59492 (399 connections now open) 2015-10-05T08:47:31.447+0100 [mongosMain] connection accepted from 172.28.0.164:60459 #1431690 (400 connections now open) 2015-10-05T08:47:31.451+0100 [conn1431690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:31.563+0100 [conn1430563] end connection 172.28.0.163:64241 (399 connections now open) 2015-10-05T08:47:31.564+0100 [conn1431125] end connection 172.28.0.163:49448 (399 connections now open) 2015-10-05T08:47:31.565+0100 [mongosMain] connection accepted from 172.28.0.163:51127 #1431691 (399 connections now open) 2015-10-05T08:47:31.565+0100 [mongosMain] connection accepted from 172.28.0.163:51128 #1431692 (400 connections now open) 2015-10-05T08:47:31.566+0100 [conn1431691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:31.566+0100 [conn1431692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:34.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b165703b51053ee3d51 2015-10-05T08:47:34.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:37.077+0100 [conn1430862] end connection 172.28.0.164:58106 (399 connections now open) 2015-10-05T08:47:37.078+0100 [conn1431289] end connection 172.28.0.164:59310 (398 connections now open) 2015-10-05T08:47:37.078+0100 [mongosMain] connection accepted from 172.28.0.164:60470 #1431693 (399 connections now open) 2015-10-05T08:47:37.079+0100 [mongosMain] connection accepted from 172.28.0.164:60471 #1431694 (400 connections now open) 2015-10-05T08:47:37.080+0100 [conn1431693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:37.080+0100 [conn1431694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:38.716+0100 [conn1431355] end connection 172.28.0.163:50143 (399 connections now open) 2015-10-05T08:47:38.718+0100 [mongosMain] connection accepted from 172.28.0.163:51133 #1431695 (400 connections now open) 2015-10-05T08:47:38.719+0100 [conn1431695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:39.278+0100 [conn1431356] end connection 172.28.0.163:50144 (399 connections now open) 2015-10-05T08:47:39.279+0100 [mongosMain] connection accepted from 172.28.0.163:51134 #1431696 (400 connections now open) 2015-10-05T08:47:39.279+0100 [conn1431696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:40.147+0100 [mongosMain] connection accepted from 127.0.0.1:51136 #1431697 (401 connections now open) 2015-10-05T08:47:40.149+0100 [conn1431697] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:40.154+0100 [conn1431697] end connection 127.0.0.1:51136 (400 connections now open) 2015-10-05T08:47:40.821+0100 [conn1431350] end connection 172.28.0.164:59476 (399 connections now open) 2015-10-05T08:47:40.822+0100 [mongosMain] connection accepted from 172.28.0.164:60480 #1431698 (400 connections now open) 2015-10-05T08:47:40.823+0100 [conn1431698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:41.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b1c5703b51053ee3dc1 2015-10-05T08:47:41.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:41.446+0100 [conn1431365] end connection 172.28.0.164:59510 (399 connections now open) 2015-10-05T08:47:41.448+0100 [mongosMain] connection accepted from 172.28.0.164:60482 #1431699 (400 connections now open) 2015-10-05T08:47:41.450+0100 [conn1431699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:41.572+0100 [conn1431347] end connection 172.28.0.163:50120 (399 connections now open) 2015-10-05T08:47:41.572+0100 [conn1430634] end connection 172.28.0.163:64439 (399 connections now open) 2015-10-05T08:47:41.573+0100 [mongosMain] connection accepted from 172.28.0.163:51140 #1431700 (399 connections now open) 2015-10-05T08:47:41.573+0100 [mongosMain] connection accepted from 172.28.0.163:51141 #1431701 (400 connections now open) 2015-10-05T08:47:41.574+0100 [conn1431700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:41.574+0100 [conn1431701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:42.100+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:47:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:47:47.077+0100 [conn1430638] end connection 172.28.0.164:57439 (399 connections now open) 2015-10-05T08:47:47.077+0100 [conn1431281] end connection 172.28.0.164:59292 (399 connections now open) 2015-10-05T08:47:47.078+0100 [mongosMain] connection accepted from 172.28.0.164:60492 #1431702 (399 connections now open) 2015-10-05T08:47:47.078+0100 [mongosMain] connection accepted from 172.28.0.164:60493 #1431703 (400 connections now open) 2015-10-05T08:47:47.079+0100 [conn1431702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:47.079+0100 [conn1431703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:47.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b235703b51053ee3e3c 2015-10-05T08:47:47.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:48.038+0100 [conn1430696] end connection 172.28.0.163:64583 (399 connections now open) 2015-10-05T08:47:48.039+0100 [mongosMain] connection accepted from 172.28.0.163:51150 #1431704 (400 connections now open) 2015-10-05T08:47:48.040+0100 [conn1431704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:48.942+0100 [conn1431308] end connection 172.28.0.163:50038 (399 connections now open) 2015-10-05T08:47:48.946+0100 [mongosMain] connection accepted from 172.28.0.163:51151 #1431705 (400 connections now open) 2015-10-05T08:47:48.947+0100 [conn1431705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:49.293+0100 [conn1431363] end connection 172.28.0.163:50151 (399 connections now open) 2015-10-05T08:47:49.294+0100 [mongosMain] connection accepted from 172.28.0.163:51153 #1431706 (400 connections now open) 2015-10-05T08:47:49.294+0100 [conn1431706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:50.836+0100 [conn1431364] end connection 172.28.0.164:59508 (399 connections now open) 2015-10-05T08:47:50.837+0100 [mongosMain] connection accepted from 172.28.0.164:60499 #1431707 (400 connections now open) 2015-10-05T08:47:50.838+0100 [conn1431707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:51.461+0100 [conn1431370] end connection 172.28.0.164:59526 (399 connections now open) 2015-10-05T08:47:51.463+0100 [mongosMain] connection accepted from 172.28.0.164:60502 #1431708 (400 connections now open) 2015-10-05T08:47:51.464+0100 [conn1431708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:51.573+0100 [conn1430622] end connection 172.28.0.163:64388 (399 connections now open) 2015-10-05T08:47:51.575+0100 [mongosMain] connection accepted from 172.28.0.163:51158 #1431709 (400 connections now open) 2015-10-05T08:47:51.576+0100 [conn1431709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:53.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b295703b51053ee3e7e 2015-10-05T08:47:53.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:47:57.918+0100 [conn1431149] end connection 172.28.0.164:58874 (399 connections now open) 2015-10-05T08:47:57.919+0100 [conn1431276] end connection 172.28.0.164:59277 (398 connections now open) 2015-10-05T08:47:57.920+0100 [mongosMain] connection accepted from 172.28.0.164:60507 #1431710 (399 connections now open) 2015-10-05T08:47:57.922+0100 [conn1431710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:57.922+0100 [mongosMain] connection accepted from 172.28.0.164:60510 #1431711 (400 connections now open) 2015-10-05T08:47:57.924+0100 [conn1431711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:58.732+0100 [conn1431341] end connection 172.28.0.163:50096 (399 connections now open) 2015-10-05T08:47:58.733+0100 [mongosMain] connection accepted from 172.28.0.163:51168 #1431712 (400 connections now open) 2015-10-05T08:47:58.734+0100 [conn1431712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:47:59.294+0100 [conn1431368] end connection 172.28.0.163:50159 (399 connections now open) 2015-10-05T08:47:59.295+0100 [mongosMain] connection accepted from 172.28.0.163:51170 #1431713 (400 connections now open) 2015-10-05T08:47:59.296+0100 [conn1431713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:00.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b2f5703b51053ee3eb6 2015-10-05T08:48:00.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:00.852+0100 [conn1431329] end connection 172.28.0.164:59423 (399 connections now open) 2015-10-05T08:48:00.853+0100 [mongosMain] connection accepted from 172.28.0.164:60512 #1431714 (400 connections now open) 2015-10-05T08:48:00.854+0100 [conn1431714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:01.461+0100 [conn1431375] end connection 172.28.0.164:59549 (399 connections now open) 2015-10-05T08:48:01.462+0100 [mongosMain] connection accepted from 172.28.0.164:60518 #1431715 (400 connections now open) 2015-10-05T08:48:01.464+0100 [conn1431715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:01.587+0100 [conn1430701] end connection 172.28.0.163:64599 (399 connections now open) 2015-10-05T08:48:01.588+0100 [mongosMain] connection accepted from 172.28.0.163:51183 #1431716 (400 connections now open) 2015-10-05T08:48:01.589+0100 [conn1431716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:06.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b365703b51053ee3f59 2015-10-05T08:48:06.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:07.904+0100 [conn1431338] end connection 172.28.0.164:59446 (399 connections now open) 2015-10-05T08:48:07.904+0100 [conn1431261] end connection 172.28.0.164:59230 (399 connections now open) 2015-10-05T08:48:07.905+0100 [mongosMain] connection accepted from 172.28.0.164:60531 #1431717 (399 connections now open) 2015-10-05T08:48:07.905+0100 [mongosMain] connection accepted from 172.28.0.164:60532 #1431718 (400 connections now open) 2015-10-05T08:48:07.906+0100 [conn1431717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:07.906+0100 [conn1431718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:08.732+0100 [conn1431326] end connection 172.28.0.163:50070 (399 connections now open) 2015-10-05T08:48:08.733+0100 [mongosMain] connection accepted from 172.28.0.163:51199 #1431719 (400 connections now open) 2015-10-05T08:48:08.734+0100 [conn1431719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:09.309+0100 [conn1431378] end connection 172.28.0.163:50191 (399 connections now open) 2015-10-05T08:48:09.310+0100 [mongosMain] connection accepted from 172.28.0.163:51200 #1431720 (400 connections now open) 2015-10-05T08:48:09.311+0100 [conn1431720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:11.478+0100 [conn1431380] end connection 172.28.0.164:59559 (399 connections now open) 2015-10-05T08:48:11.479+0100 [mongosMain] connection accepted from 172.28.0.164:60536 #1431721 (400 connections now open) 2015-10-05T08:48:11.481+0100 [conn1431721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:11.603+0100 [conn1431318] end connection 172.28.0.163:50060 (399 connections now open) 2015-10-05T08:48:11.604+0100 [mongosMain] connection accepted from 172.28.0.163:51203 #1431722 (400 connections now open) 2015-10-05T08:48:11.605+0100 [conn1431722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:12.362+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:48:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:48:13.802+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b3d5703b51053ee3fd3 2015-10-05T08:48:14.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:17.920+0100 [conn1431346] end connection 172.28.0.164:59473 (399 connections now open) 2015-10-05T08:48:17.920+0100 [conn1431267] end connection 172.28.0.164:59249 (398 connections now open) 2015-10-05T08:48:17.921+0100 [mongosMain] connection accepted from 172.28.0.164:60542 #1431723 (399 connections now open) 2015-10-05T08:48:17.922+0100 [mongosMain] connection accepted from 172.28.0.164:60543 #1431724 (400 connections now open) 2015-10-05T08:48:17.923+0100 [conn1431723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:17.923+0100 [conn1431724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:19.310+0100 [conn1431383] end connection 172.28.0.163:50222 (399 connections now open) 2015-10-05T08:48:19.311+0100 [mongosMain] connection accepted from 172.28.0.163:51212 #1431725 (400 connections now open) 2015-10-05T08:48:19.312+0100 [conn1431725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:20.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b445703b51053ee4040 2015-10-05T08:48:20.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:21.477+0100 [conn1431385] end connection 172.28.0.164:59577 (399 connections now open) 2015-10-05T08:48:21.478+0100 [mongosMain] connection accepted from 172.28.0.164:60555 #1431726 (400 connections now open) 2015-10-05T08:48:21.479+0100 [conn1431726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:21.603+0100 [conn1431381] end connection 172.28.0.163:50214 (399 connections now open) 2015-10-05T08:48:21.604+0100 [mongosMain] connection accepted from 172.28.0.163:51216 #1431727 (400 connections now open) 2015-10-05T08:48:21.605+0100 [conn1431727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:27.935+0100 [conn1430984] end connection 172.28.0.164:58424 (399 connections now open) 2015-10-05T08:48:27.935+0100 [conn1431366] end connection 172.28.0.164:59515 (398 connections now open) 2015-10-05T08:48:27.936+0100 [mongosMain] connection accepted from 172.28.0.164:60565 #1431728 (399 connections now open) 2015-10-05T08:48:27.937+0100 [mongosMain] connection accepted from 172.28.0.164:60566 #1431729 (400 connections now open) 2015-10-05T08:48:27.937+0100 [conn1431728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:27.939+0100 [conn1431729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:28.754+0100 [conn1431212] end connection 172.28.0.163:49758 (399 connections now open) 2015-10-05T08:48:28.755+0100 [mongosMain] connection accepted from 172.28.0.163:51219 #1431730 (400 connections now open) 2015-10-05T08:48:28.756+0100 [conn1431730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:29.150+0100 [mongosMain] connection accepted from 127.0.0.1:51221 #1431731 (401 connections now open) 2015-10-05T08:48:29.153+0100 [conn1431731] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:29.158+0100 [conn1431731] end connection 127.0.0.1:51221 (400 connections now open) 2015-10-05T08:48:29.325+0100 [conn1431389] end connection 172.28.0.163:50235 (399 connections now open) 2015-10-05T08:48:29.327+0100 [mongosMain] connection accepted from 172.28.0.163:51222 #1431732 (400 connections now open) 2015-10-05T08:48:29.328+0100 [conn1431732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:30.915+0100 [conn1431369] end connection 172.28.0.164:59523 (399 connections now open) 2015-10-05T08:48:30.922+0100 [mongosMain] connection accepted from 172.28.0.164:60571 #1431733 (400 connections now open) 2015-10-05T08:48:30.923+0100 [conn1431733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:31.493+0100 [conn1431390] end connection 172.28.0.164:59590 (399 connections now open) 2015-10-05T08:48:31.493+0100 [mongosMain] connection accepted from 172.28.0.164:60573 #1431734 (400 connections now open) 2015-10-05T08:48:31.495+0100 [conn1431734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:31.620+0100 [conn1431367] end connection 172.28.0.163:50156 (399 connections now open) 2015-10-05T08:48:31.621+0100 [mongosMain] connection accepted from 172.28.0.163:51225 #1431735 (400 connections now open) 2015-10-05T08:48:31.622+0100 [conn1431735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:34.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b515703b51053ee40f2 2015-10-05T08:48:34.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:38.565+0100 [conn1431352] end connection 172.28.0.164:59481 (399 connections now open) 2015-10-05T08:48:38.567+0100 [conn1430975] end connection 172.28.0.164:58408 (398 connections now open) 2015-10-05T08:48:38.570+0100 [mongosMain] connection accepted from 172.28.0.164:60578 #1431736 (399 connections now open) 2015-10-05T08:48:38.573+0100 [conn1431736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:38.579+0100 [mongosMain] connection accepted from 172.28.0.164:60580 #1431737 (400 connections now open) 2015-10-05T08:48:38.580+0100 [conn1431737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:38.766+0100 [conn1431291] end connection 172.28.0.163:49977 (399 connections now open) 2015-10-05T08:48:38.769+0100 [mongosMain] connection accepted from 172.28.0.163:51228 #1431738 (400 connections now open) 2015-10-05T08:48:38.770+0100 [conn1431738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:40.931+0100 [conn1431357] end connection 172.28.0.164:59487 (399 connections now open) 2015-10-05T08:48:40.933+0100 [mongosMain] connection accepted from 172.28.0.164:60588 #1431739 (400 connections now open) 2015-10-05T08:48:40.934+0100 [conn1431739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:41.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b585703b51053ee4161 2015-10-05T08:48:41.413+0100 [mongosMain] connection accepted from 127.0.0.1:51230 #1431740 (401 connections now open) 2015-10-05T08:48:41.415+0100 [conn1431740] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:41.420+0100 [conn1431740] end connection 127.0.0.1:51230 (400 connections now open) 2015-10-05T08:48:41.509+0100 [conn1431397] end connection 172.28.0.164:59609 (399 connections now open) 2015-10-05T08:48:41.510+0100 [mongosMain] connection accepted from 172.28.0.164:60593 #1431741 (400 connections now open) 2015-10-05T08:48:41.511+0100 [conn1431741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:41.624+0100 [conn1431333] end connection 172.28.0.163:50084 (399 connections now open) 2015-10-05T08:48:41.625+0100 [mongosMain] connection accepted from 172.28.0.163:51232 #1431742 (400 connections now open) 2015-10-05T08:48:41.626+0100 [conn1431742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:42.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:42.504+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:48:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:48:48.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b605703b51053ee41eb 2015-10-05T08:48:48.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:48:48.545+0100 [conn1431179] end connection 172.28.0.164:58988 (399 connections now open) 2015-10-05T08:48:48.545+0100 [conn1431360] end connection 172.28.0.164:59500 (399 connections now open) 2015-10-05T08:48:48.547+0100 [mongosMain] connection accepted from 172.28.0.164:60606 #1431743 (399 connections now open) 2015-10-05T08:48:48.547+0100 [mongosMain] connection accepted from 172.28.0.164:60607 #1431744 (400 connections now open) 2015-10-05T08:48:48.548+0100 [conn1431743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:48.549+0100 [conn1431744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:49.342+0100 [conn1431394] end connection 172.28.0.163:50246 (399 connections now open) 2015-10-05T08:48:49.343+0100 [mongosMain] connection accepted from 172.28.0.163:51244 #1431745 (400 connections now open) 2015-10-05T08:48:49.344+0100 [conn1431745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:50.931+0100 [conn1431384] end connection 172.28.0.164:59575 (399 connections now open) 2015-10-05T08:48:50.933+0100 [mongosMain] connection accepted from 172.28.0.164:60610 #1431746 (400 connections now open) 2015-10-05T08:48:50.935+0100 [conn1431746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:51.508+0100 [conn1431403] end connection 172.28.0.164:59634 (399 connections now open) 2015-10-05T08:48:51.510+0100 [mongosMain] connection accepted from 172.28.0.164:60613 #1431747 (400 connections now open) 2015-10-05T08:48:51.512+0100 [conn1431747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:51.637+0100 [conn1431361] end connection 172.28.0.163:50148 (399 connections now open) 2015-10-05T08:48:51.638+0100 [mongosMain] connection accepted from 172.28.0.163:51251 #1431748 (400 connections now open) 2015-10-05T08:48:51.639+0100 [conn1431748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:58.781+0100 [conn1431388] end connection 172.28.0.163:50233 (399 connections now open) 2015-10-05T08:48:58.783+0100 [mongosMain] connection accepted from 172.28.0.163:51255 #1431749 (400 connections now open) 2015-10-05T08:48:58.784+0100 [conn1431749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:59.357+0100 [conn1431407] end connection 172.28.0.163:50283 (399 connections now open) 2015-10-05T08:48:59.358+0100 [mongosMain] connection accepted from 172.28.0.163:51257 #1431750 (400 connections now open) 2015-10-05T08:48:59.359+0100 [conn1431750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:48:59.992+0100 [conn1431316] end connection 172.28.0.164:59391 (399 connections now open) 2015-10-05T08:48:59.994+0100 [conn1431094] end connection 172.28.0.164:58695 (398 connections now open) 2015-10-05T08:48:59.996+0100 [mongosMain] connection accepted from 172.28.0.164:60620 #1431751 (399 connections now open) 2015-10-05T08:48:59.997+0100 [conn1431751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:00.000+0100 [mongosMain] connection accepted from 172.28.0.164:60622 #1431752 (400 connections now open) 2015-10-05T08:49:00.002+0100 [conn1431752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:00.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b6c5703b51053ee4297 2015-10-05T08:49:00.946+0100 [conn1431241] end connection 172.28.0.164:59150 (399 connections now open) 2015-10-05T08:49:00.947+0100 [mongosMain] connection accepted from 172.28.0.164:60627 #1431753 (400 connections now open) 2015-10-05T08:49:00.949+0100 [conn1431753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:01.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:01.641+0100 [conn1431354] end connection 172.28.0.163:50138 (399 connections now open) 2015-10-05T08:49:01.642+0100 [mongosMain] connection accepted from 172.28.0.163:51267 #1431754 (400 connections now open) 2015-10-05T08:49:01.643+0100 [conn1431754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:09.358+0100 [conn1431413] end connection 172.28.0.163:50297 (399 connections now open) 2015-10-05T08:49:09.359+0100 [mongosMain] connection accepted from 172.28.0.163:51291 #1431755 (400 connections now open) 2015-10-05T08:49:09.360+0100 [conn1431755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:09.917+0100 [conn1431203] end connection 172.28.0.164:59054 (399 connections now open) 2015-10-05T08:49:09.918+0100 [conn1431371] end connection 172.28.0.164:59529 (398 connections now open) 2015-10-05T08:49:09.918+0100 [mongosMain] connection accepted from 172.28.0.164:60646 #1431756 (399 connections now open) 2015-10-05T08:49:09.919+0100 [mongosMain] connection accepted from 172.28.0.164:60647 #1431757 (400 connections now open) 2015-10-05T08:49:09.920+0100 [conn1431756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:09.920+0100 [conn1431757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:10.962+0100 [conn1431379] end connection 172.28.0.164:59557 (399 connections now open) 2015-10-05T08:49:10.963+0100 [mongosMain] connection accepted from 172.28.0.164:60650 #1431758 (400 connections now open) 2015-10-05T08:49:10.965+0100 [conn1431758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:11.541+0100 [conn1431409] end connection 172.28.0.164:59651 (399 connections now open) 2015-10-05T08:49:11.541+0100 [mongosMain] connection accepted from 172.28.0.164:60652 #1431759 (400 connections now open) 2015-10-05T08:49:11.542+0100 [conn1431759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:11.910+0100 [conn1431392] end connection 172.28.0.163:50241 (399 connections now open) 2015-10-05T08:49:11.924+0100 [mongosMain] connection accepted from 172.28.0.163:51295 #1431760 (400 connections now open) 2015-10-05T08:49:11.925+0100 [conn1431760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:12.949+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:49:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:49:18.796+0100 [conn1431382] end connection 172.28.0.163:50219 (399 connections now open) 2015-10-05T08:49:18.797+0100 [mongosMain] connection accepted from 172.28.0.163:51302 #1431761 (400 connections now open) 2015-10-05T08:49:18.798+0100 [conn1431761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:19.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b7f5703b51053ee43f7 2015-10-05T08:49:19.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:20.157+0100 [conn1431410] end connection 172.28.0.164:59657 (399 connections now open) 2015-10-05T08:49:20.159+0100 [mongosMain] connection accepted from 172.28.0.164:60659 #1431762 (400 connections now open) 2015-10-05T08:49:20.161+0100 [conn1431762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:20.978+0100 [conn1431408] end connection 172.28.0.164:59648 (399 connections now open) 2015-10-05T08:49:20.979+0100 [mongosMain] connection accepted from 172.28.0.164:60661 #1431763 (400 connections now open) 2015-10-05T08:49:20.981+0100 [conn1431763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:21.790+0100 [conn1431411] end connection 172.28.0.163:50292 (399 connections now open) 2015-10-05T08:49:21.791+0100 [mongosMain] connection accepted from 172.28.0.163:51308 #1431764 (400 connections now open) 2015-10-05T08:49:21.792+0100 [conn1431764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:25.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b855703b51053ee44a3 2015-10-05T08:49:25.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:28.811+0100 [mongosMain] connection accepted from 127.0.0.1:51309 #1431765 (401 connections now open) 2015-10-05T08:49:28.812+0100 [conn1431412] end connection 172.28.0.163:50295 (400 connections now open) 2015-10-05T08:49:28.814+0100 [conn1431765] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:28.815+0100 [mongosMain] connection accepted from 172.28.0.163:51311 #1431766 (401 connections now open) 2015-10-05T08:49:28.816+0100 [conn1431766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:28.821+0100 [conn1431765] end connection 127.0.0.1:51309 (400 connections now open) 2015-10-05T08:49:30.135+0100 [conn1431323] end connection 172.28.0.164:59411 (399 connections now open) 2015-10-05T08:49:30.137+0100 [mongosMain] connection accepted from 172.28.0.164:60677 #1431767 (400 connections now open) 2015-10-05T08:49:30.138+0100 [conn1431767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:30.992+0100 [conn1431396] end connection 172.28.0.164:59607 (399 connections now open) 2015-10-05T08:49:30.993+0100 [mongosMain] connection accepted from 172.28.0.164:60681 #1431768 (400 connections now open) 2015-10-05T08:49:30.995+0100 [conn1431768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:31.794+0100 [conn1431373] end connection 172.28.0.163:50165 (399 connections now open) 2015-10-05T08:49:31.795+0100 [mongosMain] connection accepted from 172.28.0.163:51313 #1431769 (400 connections now open) 2015-10-05T08:49:31.796+0100 [conn1431769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:31.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b8b5703b51053ee451e 2015-10-05T08:49:32.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:38.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b925703b51053ee45f0 2015-10-05T08:49:38.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:38.813+0100 [conn1431334] end connection 172.28.0.163:50087 (399 connections now open) 2015-10-05T08:49:38.814+0100 [mongosMain] connection accepted from 172.28.0.163:51315 #1431770 (400 connections now open) 2015-10-05T08:49:38.815+0100 [conn1431770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:39.458+0100 [mongosMain] connection accepted from 127.0.0.1:51317 #1431771 (401 connections now open) 2015-10-05T08:49:39.461+0100 [conn1431771] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:39.465+0100 [conn1431771] end connection 127.0.0.1:51317 (400 connections now open) 2015-10-05T08:49:40.152+0100 [conn1431404] end connection 172.28.0.164:59640 (399 connections now open) 2015-10-05T08:49:40.153+0100 [mongosMain] connection accepted from 172.28.0.164:60695 #1431772 (400 connections now open) 2015-10-05T08:49:40.155+0100 [conn1431772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:41.009+0100 [conn1431414] end connection 172.28.0.164:59662 (399 connections now open) 2015-10-05T08:49:41.011+0100 [mongosMain] connection accepted from 172.28.0.164:60698 #1431773 (400 connections now open) 2015-10-05T08:49:41.012+0100 [conn1431773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:41.807+0100 [conn1431340] end connection 172.28.0.163:50095 (399 connections now open) 2015-10-05T08:49:41.808+0100 [mongosMain] connection accepted from 172.28.0.163:51323 #1431774 (400 connections now open) 2015-10-05T08:49:41.809+0100 [conn1431774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:45.519+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:49:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:49:45.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122b995703b51053ee466a 2015-10-05T08:49:45.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:49:48.827+0100 [conn1431393] end connection 172.28.0.163:50244 (399 connections now open) 2015-10-05T08:49:48.828+0100 [mongosMain] connection accepted from 172.28.0.163:51329 #1431775 (400 connections now open) 2015-10-05T08:49:48.829+0100 [conn1431775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:50.151+0100 [conn1431420] end connection 172.28.0.164:59683 (399 connections now open) 2015-10-05T08:49:50.152+0100 [mongosMain] connection accepted from 172.28.0.164:60707 #1431776 (400 connections now open) 2015-10-05T08:49:50.154+0100 [conn1431776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:51.025+0100 [conn1431374] end connection 172.28.0.164:59545 (399 connections now open) 2015-10-05T08:49:51.026+0100 [mongosMain] connection accepted from 172.28.0.164:60708 #1431777 (400 connections now open) 2015-10-05T08:49:51.028+0100 [conn1431777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:51.823+0100 [conn1431416] end connection 172.28.0.163:50329 (399 connections now open) 2015-10-05T08:49:51.825+0100 [mongosMain] connection accepted from 172.28.0.163:51333 #1431778 (400 connections now open) 2015-10-05T08:49:51.826+0100 [conn1431778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:53.538+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:49:53.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:49:58.832+0100 [conn1431417] end connection 172.28.0.163:50333 (399 connections now open) 2015-10-05T08:49:58.836+0100 [mongosMain] connection accepted from 172.28.0.163:51346 #1431779 (400 connections now open) 2015-10-05T08:49:58.837+0100 [conn1431779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:49:59.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ba75703b51053ee479f 2015-10-05T08:49:59.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:50:00.260+0100 [conn1431415] end connection 172.28.0.164:59678 (399 connections now open) 2015-10-05T08:50:00.261+0100 [mongosMain] connection accepted from 172.28.0.164:60716 #1431780 (400 connections now open) 2015-10-05T08:50:00.290+0100 [conn1431780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:01.832+0100 [conn1431387] end connection 172.28.0.163:50231 (399 connections now open) 2015-10-05T08:50:01.833+0100 [mongosMain] connection accepted from 172.28.0.163:51355 #1431781 (400 connections now open) 2015-10-05T08:50:01.834+0100 [conn1431781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:07.253+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:50:07.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:50:08.842+0100 [conn1431429] end connection 172.28.0.163:50360 (399 connections now open) 2015-10-05T08:50:08.843+0100 [mongosMain] connection accepted from 172.28.0.163:51382 #1431782 (400 connections now open) 2015-10-05T08:50:08.844+0100 [conn1431782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:10.247+0100 [conn1431386] end connection 172.28.0.164:59580 (399 connections now open) 2015-10-05T08:50:10.248+0100 [mongosMain] connection accepted from 172.28.0.164:60735 #1431783 (400 connections now open) 2015-10-05T08:50:10.250+0100 [conn1431783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:11.839+0100 [conn1431399] end connection 172.28.0.163:50255 (399 connections now open) 2015-10-05T08:50:11.840+0100 [mongosMain] connection accepted from 172.28.0.163:51388 #1431784 (400 connections now open) 2015-10-05T08:50:11.840+0100 [conn1431784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:14.000+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:50:14.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:50:15.725+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:50:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:50:18.857+0100 [conn1431437] end connection 172.28.0.163:50386 (399 connections now open) 2015-10-05T08:50:18.861+0100 [mongosMain] connection accepted from 172.28.0.163:51398 #1431785 (400 connections now open) 2015-10-05T08:50:18.862+0100 [conn1431785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:19.420+0100 [conn1431418] end connection 172.28.0.163:50335 (399 connections now open) 2015-10-05T08:50:19.421+0100 [mongosMain] connection accepted from 172.28.0.163:51399 #1431786 (400 connections now open) 2015-10-05T08:50:19.423+0100 [conn1431786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:20.260+0100 [conn1431391] end connection 172.28.0.164:59597 (399 connections now open) 2015-10-05T08:50:20.262+0100 [mongosMain] connection accepted from 172.28.0.164:60747 #1431787 (400 connections now open) 2015-10-05T08:50:20.267+0100 [conn1431787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:21.071+0100 [conn1431402] end connection 172.28.0.164:59631 (399 connections now open) 2015-10-05T08:50:21.073+0100 [mongosMain] connection accepted from 172.28.0.164:60749 #1431788 (400 connections now open) 2015-10-05T08:50:21.074+0100 [conn1431788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:21.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122bbc5703b51053ee496e 2015-10-05T08:50:21.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:50:21.649+0100 [conn1431419] end connection 172.28.0.164:59681 (399 connections now open) 2015-10-05T08:50:21.650+0100 [mongosMain] connection accepted from 172.28.0.164:60753 #1431789 (400 connections now open) 2015-10-05T08:50:21.651+0100 [conn1431789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:21.844+0100 [conn1431377] end connection 172.28.0.163:50186 (399 connections now open) 2015-10-05T08:50:21.845+0100 [mongosMain] connection accepted from 172.28.0.163:51401 #1431790 (400 connections now open) 2015-10-05T08:50:21.846+0100 [conn1431790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:28.679+0100 [mongosMain] connection accepted from 127.0.0.1:51402 #1431791 (401 connections now open) 2015-10-05T08:50:28.682+0100 [conn1431791] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:28.687+0100 [conn1431791] end connection 127.0.0.1:51402 (400 connections now open) 2015-10-05T08:50:28.859+0100 [conn1431348] end connection 172.28.0.163:50122 (399 connections now open) 2015-10-05T08:50:28.860+0100 [mongosMain] connection accepted from 172.28.0.163:51403 #1431792 (400 connections now open) 2015-10-05T08:50:28.861+0100 [conn1431792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:29.435+0100 [conn1431446] end connection 172.28.0.163:50427 (399 connections now open) 2015-10-05T08:50:29.436+0100 [mongosMain] connection accepted from 172.28.0.163:51405 #1431793 (400 connections now open) 2015-10-05T08:50:29.438+0100 [conn1431793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:30.278+0100 [conn1431376] end connection 172.28.0.164:59555 (399 connections now open) 2015-10-05T08:50:30.280+0100 [mongosMain] connection accepted from 172.28.0.164:60761 #1431794 (400 connections now open) 2015-10-05T08:50:30.282+0100 [conn1431794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:31.072+0100 [conn1431435] end connection 172.28.0.164:59738 (399 connections now open) 2015-10-05T08:50:31.073+0100 [mongosMain] connection accepted from 172.28.0.164:60763 #1431795 (400 connections now open) 2015-10-05T08:50:31.076+0100 [conn1431795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:31.651+0100 [conn1431449] end connection 172.28.0.164:59776 (399 connections now open) 2015-10-05T08:50:31.658+0100 [mongosMain] connection accepted from 172.28.0.164:60765 #1431796 (400 connections now open) 2015-10-05T08:50:31.660+0100 [conn1431796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:31.854+0100 [conn1431433] end connection 172.28.0.163:50372 (399 connections now open) 2015-10-05T08:50:31.855+0100 [mongosMain] connection accepted from 172.28.0.163:51411 #1431797 (400 connections now open) 2015-10-05T08:50:31.856+0100 [conn1431797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:36.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122bc95703b51053ee4a57 2015-10-05T08:50:37.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:50:38.874+0100 [conn1431425] end connection 172.28.0.163:50352 (399 connections now open) 2015-10-05T08:50:38.875+0100 [mongosMain] connection accepted from 172.28.0.163:51415 #1431798 (400 connections now open) 2015-10-05T08:50:38.876+0100 [conn1431798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:39.436+0100 [conn1431453] end connection 172.28.0.163:50437 (399 connections now open) 2015-10-05T08:50:39.436+0100 [mongosMain] connection accepted from 172.28.0.163:51417 #1431799 (400 connections now open) 2015-10-05T08:50:39.437+0100 [conn1431799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:40.292+0100 [conn1431398] end connection 172.28.0.164:59617 (399 connections now open) 2015-10-05T08:50:40.293+0100 [mongosMain] connection accepted from 172.28.0.164:60780 #1431800 (400 connections now open) 2015-10-05T08:50:40.295+0100 [conn1431800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:40.323+0100 [mongosMain] connection accepted from 127.0.0.1:51419 #1431801 (401 connections now open) 2015-10-05T08:50:40.326+0100 [conn1431801] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:40.330+0100 [conn1431801] end connection 127.0.0.1:51419 (400 connections now open) 2015-10-05T08:50:41.088+0100 [conn1431430] end connection 172.28.0.164:59721 (399 connections now open) 2015-10-05T08:50:41.089+0100 [mongosMain] connection accepted from 172.28.0.164:60782 #1431802 (400 connections now open) 2015-10-05T08:50:41.091+0100 [conn1431802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:41.665+0100 [conn1431456] end connection 172.28.0.164:59789 (399 connections now open) 2015-10-05T08:50:41.667+0100 [mongosMain] connection accepted from 172.28.0.164:60784 #1431803 (400 connections now open) 2015-10-05T08:50:41.675+0100 [conn1431803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:41.855+0100 [conn1431424] end connection 172.28.0.163:50351 (399 connections now open) 2015-10-05T08:50:41.856+0100 [mongosMain] connection accepted from 172.28.0.163:51421 #1431804 (400 connections now open) 2015-10-05T08:50:41.857+0100 [conn1431804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:45.965+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:50:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:50:48.875+0100 [conn1431434] end connection 172.28.0.163:50374 (399 connections now open) 2015-10-05T08:50:48.877+0100 [mongosMain] connection accepted from 172.28.0.163:51431 #1431805 (400 connections now open) 2015-10-05T08:50:48.878+0100 [conn1431805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:49.451+0100 [conn1431459] end connection 172.28.0.163:50446 (399 connections now open) 2015-10-05T08:50:49.452+0100 [mongosMain] connection accepted from 172.28.0.163:51435 #1431806 (400 connections now open) 2015-10-05T08:50:49.453+0100 [conn1431806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:50.308+0100 [conn1431427] end connection 172.28.0.164:59714 (399 connections now open) 2015-10-05T08:50:50.310+0100 [mongosMain] connection accepted from 172.28.0.164:60792 #1431807 (400 connections now open) 2015-10-05T08:50:50.312+0100 [conn1431807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:51.275+0100 [conn1431439] end connection 172.28.0.164:59749 (399 connections now open) 2015-10-05T08:50:51.277+0100 [mongosMain] connection accepted from 172.28.0.164:60794 #1431808 (400 connections now open) 2015-10-05T08:50:51.279+0100 [conn1431808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:51.683+0100 [conn1431463] end connection 172.28.0.164:59810 (399 connections now open) 2015-10-05T08:50:51.685+0100 [mongosMain] connection accepted from 172.28.0.164:60796 #1431809 (400 connections now open) 2015-10-05T08:50:51.687+0100 [conn1431809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:52.213+0100 [conn1431421] end connection 172.28.0.163:50346 (399 connections now open) 2015-10-05T08:50:52.213+0100 [conn1430784] end connection 172.28.0.163:64858 (399 connections now open) 2015-10-05T08:50:52.593+0100 [mongosMain] connection accepted from 172.28.0.163:51439 #1431810 (399 connections now open) 2015-10-05T08:50:52.594+0100 [conn1431810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:52.595+0100 [mongosMain] connection accepted from 172.28.0.163:51440 #1431811 (400 connections now open) 2015-10-05T08:50:52.596+0100 [conn1431811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:56.571+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:50:56.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:50:58.890+0100 [conn1431406] end connection 172.28.0.163:50279 (399 connections now open) 2015-10-05T08:50:58.891+0100 [mongosMain] connection accepted from 172.28.0.163:51447 #1431812 (400 connections now open) 2015-10-05T08:50:58.892+0100 [conn1431812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:50:59.452+0100 [conn1431466] end connection 172.28.0.163:50463 (399 connections now open) 2015-10-05T08:50:59.453+0100 [mongosMain] connection accepted from 172.28.0.163:51449 #1431813 (400 connections now open) 2015-10-05T08:50:59.454+0100 [conn1431813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:00.323+0100 [conn1431331] end connection 172.28.0.164:59433 (399 connections now open) 2015-10-05T08:51:00.324+0100 [mongosMain] connection accepted from 172.28.0.164:60806 #1431814 (400 connections now open) 2015-10-05T08:51:00.326+0100 [conn1431814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:01.119+0100 [conn1431443] end connection 172.28.0.164:59758 (399 connections now open) 2015-10-05T08:51:01.121+0100 [mongosMain] connection accepted from 172.28.0.164:60812 #1431815 (400 connections now open) 2015-10-05T08:51:01.129+0100 [conn1431815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:02.010+0100 [conn1430789] end connection 172.28.0.163:64877 (399 connections now open) 2015-10-05T08:51:02.010+0100 [conn1431438] end connection 172.28.0.163:50387 (399 connections now open) 2015-10-05T08:51:02.011+0100 [mongosMain] connection accepted from 172.28.0.163:51466 #1431816 (399 connections now open) 2015-10-05T08:51:02.012+0100 [mongosMain] connection accepted from 172.28.0.163:51467 #1431817 (400 connections now open) 2015-10-05T08:51:02.012+0100 [conn1431816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:02.013+0100 [conn1431817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:08.891+0100 [conn1431400] end connection 172.28.0.163:50256 (399 connections now open) 2015-10-05T08:51:08.892+0100 [mongosMain] connection accepted from 172.28.0.163:51470 #1431818 (400 connections now open) 2015-10-05T08:51:08.893+0100 [conn1431818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:08.929+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122be938482111da12dbc6') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444031468747), why: "doing balance round", ts: ObjectId('56122bec5703b51053ee4dc7') } } gle1: { lastOp: Timestamp 1444031468000|6, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } gle2: { lastOp: Timestamp 1444031437000|1, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2015-10-05T08:51:08.933+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:51:09.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122bec5703b51053ee4dc7 2015-10-05T08:51:09.792+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:10.339+0100 [conn1431432] end connection 172.28.0.164:59732 (399 connections now open) 2015-10-05T08:51:10.340+0100 [mongosMain] connection accepted from 172.28.0.164:60822 #1431819 (400 connections now open) 2015-10-05T08:51:10.341+0100 [conn1431819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:11.713+0100 [conn1431469] end connection 172.28.0.164:59828 (399 connections now open) 2015-10-05T08:51:11.714+0100 [mongosMain] connection accepted from 172.28.0.164:60824 #1431820 (400 connections now open) 2015-10-05T08:51:11.716+0100 [conn1431820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:12.020+0100 [conn1430794] end connection 172.28.0.163:64902 (399 connections now open) 2015-10-05T08:51:12.021+0100 [mongosMain] connection accepted from 172.28.0.163:51484 #1431821 (400 connections now open) 2015-10-05T08:51:12.022+0100 [conn1431821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:15.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122bf35703b51053ee4e95 2015-10-05T08:51:16.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:16.105+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:51:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:51:18.904+0100 [conn1431422] end connection 172.28.0.163:50348 (399 connections now open) 2015-10-05T08:51:18.905+0100 [mongosMain] connection accepted from 172.28.0.163:51498 #1431822 (400 connections now open) 2015-10-05T08:51:18.906+0100 [conn1431822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:20.340+0100 [conn1431444] end connection 172.28.0.164:59762 (399 connections now open) 2015-10-05T08:51:20.340+0100 [mongosMain] connection accepted from 172.28.0.164:60832 #1431823 (400 connections now open) 2015-10-05T08:51:20.342+0100 [conn1431823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:21.728+0100 [conn1431477] end connection 172.28.0.164:59863 (399 connections now open) 2015-10-05T08:51:21.730+0100 [mongosMain] connection accepted from 172.28.0.164:60835 #1431824 (400 connections now open) 2015-10-05T08:51:21.732+0100 [conn1431824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:22.026+0100 [conn1430799] end connection 172.28.0.163:64918 (399 connections now open) 2015-10-05T08:51:22.027+0100 [mongosMain] connection accepted from 172.28.0.163:51503 #1431825 (400 connections now open) 2015-10-05T08:51:22.029+0100 [conn1431825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:22.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122bfa5703b51053ee4f61 2015-10-05T08:51:22.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:28.216+0100 [mongosMain] connection accepted from 127.0.0.1:51513 #1431826 (401 connections now open) 2015-10-05T08:51:28.218+0100 [conn1431826] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:28.222+0100 [conn1431826] end connection 127.0.0.1:51513 (400 connections now open) 2015-10-05T08:51:28.910+0100 [conn1431445] end connection 172.28.0.163:50425 (399 connections now open) 2015-10-05T08:51:28.912+0100 [mongosMain] connection accepted from 172.28.0.163:51514 #1431827 (400 connections now open) 2015-10-05T08:51:28.913+0100 [conn1431827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:28.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c005703b51053ee5000 2015-10-05T08:51:29.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:29.487+0100 [conn1431472] end connection 172.28.0.163:50478 (399 connections now open) 2015-10-05T08:51:29.489+0100 [mongosMain] connection accepted from 172.28.0.163:51515 #1431828 (400 connections now open) 2015-10-05T08:51:29.490+0100 [conn1431828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:30.355+0100 [conn1431440] end connection 172.28.0.164:59757 (399 connections now open) 2015-10-05T08:51:30.356+0100 [mongosMain] connection accepted from 172.28.0.164:60850 #1431829 (400 connections now open) 2015-10-05T08:51:30.358+0100 [conn1431829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:31.745+0100 [conn1431480] end connection 172.28.0.164:59873 (399 connections now open) 2015-10-05T08:51:31.745+0100 [mongosMain] connection accepted from 172.28.0.164:60854 #1431830 (400 connections now open) 2015-10-05T08:51:31.747+0100 [conn1431830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:35.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c075703b51053ee50cf 2015-10-05T08:51:35.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:38.920+0100 [conn1431441] end connection 172.28.0.163:50412 (399 connections now open) 2015-10-05T08:51:38.921+0100 [mongosMain] connection accepted from 172.28.0.163:51521 #1431831 (400 connections now open) 2015-10-05T08:51:38.922+0100 [conn1431831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:39.498+0100 [conn1431484] end connection 172.28.0.163:50533 (399 connections now open) 2015-10-05T08:51:39.499+0100 [mongosMain] connection accepted from 172.28.0.163:51522 #1431832 (400 connections now open) 2015-10-05T08:51:39.501+0100 [conn1431832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:39.617+0100 [mongosMain] connection accepted from 127.0.0.1:51524 #1431833 (401 connections now open) 2015-10-05T08:51:39.620+0100 [conn1431833] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:39.625+0100 [conn1431833] end connection 127.0.0.1:51524 (400 connections now open) 2015-10-05T08:51:40.356+0100 [conn1431423] end connection 172.28.0.164:59697 (399 connections now open) 2015-10-05T08:51:40.357+0100 [mongosMain] connection accepted from 172.28.0.164:60867 #1431834 (400 connections now open) 2015-10-05T08:51:40.360+0100 [conn1431834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:41.760+0100 [conn1431485] end connection 172.28.0.164:59888 (399 connections now open) 2015-10-05T08:51:41.761+0100 [mongosMain] connection accepted from 172.28.0.164:60870 #1431835 (400 connections now open) 2015-10-05T08:51:41.762+0100 [conn1431835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:42.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c0d5703b51053ee515c 2015-10-05T08:51:42.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:47.272+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:51:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:51:48.707+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c145703b51053ee51ca 2015-10-05T08:51:48.937+0100 [conn1431465] end connection 172.28.0.163:50461 (399 connections now open) 2015-10-05T08:51:48.938+0100 [mongosMain] connection accepted from 172.28.0.163:51539 #1431836 (400 connections now open) 2015-10-05T08:51:48.939+0100 [conn1431836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:49.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:49.499+0100 [conn1431488] end connection 172.28.0.163:50541 (399 connections now open) 2015-10-05T08:51:49.500+0100 [mongosMain] connection accepted from 172.28.0.163:51540 #1431837 (400 connections now open) 2015-10-05T08:51:49.501+0100 [conn1431837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:50.371+0100 [conn1431464] end connection 172.28.0.164:59817 (399 connections now open) 2015-10-05T08:51:50.372+0100 [mongosMain] connection accepted from 172.28.0.164:60880 #1431838 (400 connections now open) 2015-10-05T08:51:50.374+0100 [conn1431838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:51.775+0100 [conn1431490] end connection 172.28.0.164:59906 (399 connections now open) 2015-10-05T08:51:51.776+0100 [mongosMain] connection accepted from 172.28.0.164:60884 #1431839 (400 connections now open) 2015-10-05T08:51:51.778+0100 [conn1431839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:55.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c1b5703b51053ee523f 2015-10-05T08:51:56.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:51:58.939+0100 [conn1431482] end connection 172.28.0.163:50531 (399 connections now open) 2015-10-05T08:51:58.940+0100 [mongosMain] connection accepted from 172.28.0.163:51551 #1431840 (400 connections now open) 2015-10-05T08:51:58.941+0100 [conn1431840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:51:59.514+0100 [conn1431492] end connection 172.28.0.163:50555 (399 connections now open) 2015-10-05T08:51:59.515+0100 [mongosMain] connection accepted from 172.28.0.163:51553 #1431841 (400 connections now open) 2015-10-05T08:51:59.516+0100 [conn1431841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:00.478+0100 [conn1431450] end connection 172.28.0.164:59782 (399 connections now open) 2015-10-05T08:52:00.483+0100 [mongosMain] connection accepted from 172.28.0.164:60892 #1431842 (400 connections now open) 2015-10-05T08:52:00.485+0100 [conn1431842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:01.808+0100 [conn1431493] end connection 172.28.0.164:59919 (399 connections now open) 2015-10-05T08:52:01.808+0100 [mongosMain] connection accepted from 172.28.0.164:60901 #1431843 (400 connections now open) 2015-10-05T08:52:01.823+0100 [conn1431843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:02.104+0100 [conn1431405] end connection 172.28.0.163:50276 (399 connections now open) 2015-10-05T08:52:02.104+0100 [mongosMain] connection accepted from 172.28.0.163:51573 #1431844 (400 connections now open) 2015-10-05T08:52:02.104+0100 [conn1431844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:02.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c225703b51053ee528c 2015-10-05T08:52:02.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:08.953+0100 [conn1431451] end connection 172.28.0.163:50434 (399 connections now open) 2015-10-05T08:52:08.954+0100 [mongosMain] connection accepted from 172.28.0.163:51585 #1431845 (400 connections now open) 2015-10-05T08:52:08.954+0100 [conn1431845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:09.242+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c285703b51053ee5331 2015-10-05T08:52:09.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:09.515+0100 [conn1431495] end connection 172.28.0.163:50569 (399 connections now open) 2015-10-05T08:52:09.516+0100 [mongosMain] connection accepted from 172.28.0.163:51587 #1431846 (400 connections now open) 2015-10-05T08:52:09.517+0100 [conn1431846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:10.465+0100 [conn1431470] end connection 172.28.0.164:59836 (399 connections now open) 2015-10-05T08:52:10.466+0100 [mongosMain] connection accepted from 172.28.0.164:60913 #1431847 (400 connections now open) 2015-10-05T08:52:10.467+0100 [conn1431847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:11.806+0100 [conn1431496] end connection 172.28.0.164:59929 (399 connections now open) 2015-10-05T08:52:11.807+0100 [mongosMain] connection accepted from 172.28.0.164:60915 #1431848 (400 connections now open) 2015-10-05T08:52:11.809+0100 [conn1431848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:12.073+0100 [conn1431428] end connection 172.28.0.163:50359 (399 connections now open) 2015-10-05T08:52:12.074+0100 [mongosMain] connection accepted from 172.28.0.163:51593 #1431849 (400 connections now open) 2015-10-05T08:52:12.075+0100 [conn1431849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:16.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c2f5703b51053ee5409 2015-10-05T08:52:16.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:17.579+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:52:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:52:18.953+0100 [conn1431471] end connection 172.28.0.163:50476 (399 connections now open) 2015-10-05T08:52:18.954+0100 [mongosMain] connection accepted from 172.28.0.163:51600 #1431850 (400 connections now open) 2015-10-05T08:52:18.955+0100 [conn1431850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:19.530+0100 [conn1431498] end connection 172.28.0.163:50597 (399 connections now open) 2015-10-05T08:52:19.531+0100 [mongosMain] connection accepted from 172.28.0.163:51606 #1431851 (400 connections now open) 2015-10-05T08:52:19.532+0100 [conn1431851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:20.480+0100 [conn1431436] end connection 172.28.0.164:59745 (399 connections now open) 2015-10-05T08:52:20.481+0100 [mongosMain] connection accepted from 172.28.0.164:60922 #1431852 (400 connections now open) 2015-10-05T08:52:20.483+0100 [conn1431852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:21.821+0100 [conn1431499] end connection 172.28.0.164:59941 (399 connections now open) 2015-10-05T08:52:21.823+0100 [mongosMain] connection accepted from 172.28.0.164:60925 #1431853 (400 connections now open) 2015-10-05T08:52:21.825+0100 [conn1431853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:22.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c365703b51053ee548f 2015-10-05T08:52:22.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:28.270+0100 [mongosMain] connection accepted from 127.0.0.1:51619 #1431854 (401 connections now open) 2015-10-05T08:52:28.273+0100 [conn1431854] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:28.278+0100 [conn1431854] end connection 127.0.0.1:51619 (400 connections now open) 2015-10-05T08:52:28.969+0100 [conn1431458] end connection 172.28.0.163:50444 (399 connections now open) 2015-10-05T08:52:28.970+0100 [mongosMain] connection accepted from 172.28.0.163:51631 #1431855 (400 connections now open) 2015-10-05T08:52:28.971+0100 [conn1431855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:29.534+0100 [conn1431501] end connection 172.28.0.163:50611 (399 connections now open) 2015-10-05T08:52:29.535+0100 [mongosMain] connection accepted from 172.28.0.163:51639 #1431856 (400 connections now open) 2015-10-05T08:52:29.536+0100 [conn1431856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:29.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c3d5703b51053ee54f7 2015-10-05T08:52:29.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:30.481+0100 [conn1431457] end connection 172.28.0.164:59796 (399 connections now open) 2015-10-05T08:52:30.482+0100 [mongosMain] connection accepted from 172.28.0.164:60942 #1431857 (400 connections now open) 2015-10-05T08:52:30.483+0100 [conn1431857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:31.213+0100 [conn1431476] end connection 172.28.0.164:59861 (399 connections now open) 2015-10-05T08:52:31.214+0100 [mongosMain] connection accepted from 172.28.0.164:60945 #1431858 (400 connections now open) 2015-10-05T08:52:31.215+0100 [conn1431858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:31.838+0100 [conn1431502] end connection 172.28.0.164:59949 (399 connections now open) 2015-10-05T08:52:31.839+0100 [mongosMain] connection accepted from 172.28.0.164:60947 #1431859 (400 connections now open) 2015-10-05T08:52:31.841+0100 [conn1431859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:36.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c435703b51053ee556e 2015-10-05T08:52:36.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:38.970+0100 [conn1431494] end connection 172.28.0.163:50567 (399 connections now open) 2015-10-05T08:52:38.971+0100 [mongosMain] connection accepted from 172.28.0.163:51648 #1431860 (400 connections now open) 2015-10-05T08:52:38.972+0100 [conn1431860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:39.546+0100 [conn1431505] end connection 172.28.0.163:50620 (399 connections now open) 2015-10-05T08:52:39.547+0100 [mongosMain] connection accepted from 172.28.0.163:51650 #1431861 (400 connections now open) 2015-10-05T08:52:39.549+0100 [conn1431861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:40.103+0100 [mongosMain] connection accepted from 127.0.0.1:51652 #1431862 (401 connections now open) 2015-10-05T08:52:40.106+0100 [conn1431862] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:40.110+0100 [conn1431862] end connection 127.0.0.1:51652 (400 connections now open) 2015-10-05T08:52:40.495+0100 [conn1430840] end connection 172.28.0.164:58035 (399 connections now open) 2015-10-05T08:52:40.496+0100 [mongosMain] connection accepted from 172.28.0.164:60965 #1431863 (400 connections now open) 2015-10-05T08:52:40.497+0100 [conn1431863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:41.213+0100 [conn1431473] end connection 172.28.0.164:59842 (399 connections now open) 2015-10-05T08:52:41.214+0100 [mongosMain] connection accepted from 172.28.0.164:60966 #1431864 (400 connections now open) 2015-10-05T08:52:41.216+0100 [conn1431864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:41.837+0100 [conn1431506] end connection 172.28.0.164:59965 (399 connections now open) 2015-10-05T08:52:41.838+0100 [mongosMain] connection accepted from 172.28.0.164:60969 #1431865 (400 connections now open) 2015-10-05T08:52:41.840+0100 [conn1431865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:44.262+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:52:44.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:52:48.984+0100 [conn1431491] end connection 172.28.0.163:50553 (399 connections now open) 2015-10-05T08:52:48.985+0100 [mongosMain] connection accepted from 172.28.0.163:51662 #1431866 (400 connections now open) 2015-10-05T08:52:48.985+0100 [conn1431866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:49.561+0100 [conn1431508] end connection 172.28.0.163:50628 (399 connections now open) 2015-10-05T08:52:49.562+0100 [mongosMain] connection accepted from 172.28.0.163:51665 #1431867 (400 connections now open) 2015-10-05T08:52:49.563+0100 [conn1431867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:49.656+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:52:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:52:50.740+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122c4f38482111da12dbd4') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444031570269), why: "doing balance round", ts: ObjectId('56122c525703b51053ee5675') } } gle1: { lastOp: Timestamp 1444031556000|3, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1444031570000|6, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2015-10-05T08:52:50.748+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T08:52:51.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c525703b51053ee5675 2015-10-05T08:52:51.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:52:51.229+0100 [conn1431468] end connection 172.28.0.164:59827 (399 connections now open) 2015-10-05T08:52:51.231+0100 [mongosMain] connection accepted from 172.28.0.164:60981 #1431868 (400 connections now open) 2015-10-05T08:52:51.234+0100 [conn1431868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:52.104+0100 [conn1430847] end connection 172.28.0.163:65058 (399 connections now open) 2015-10-05T08:52:52.106+0100 [mongosMain] connection accepted from 172.28.0.163:51668 #1431869 (400 connections now open) 2015-10-05T08:52:52.106+0100 [conn1431869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:59.000+0100 [conn1431475] end connection 172.28.0.163:50510 (399 connections now open) 2015-10-05T08:52:59.002+0100 [mongosMain] connection accepted from 172.28.0.163:51677 #1431870 (400 connections now open) 2015-10-05T08:52:59.003+0100 [conn1431870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:52:59.562+0100 [conn1431513] end connection 172.28.0.163:50648 (399 connections now open) 2015-10-05T08:52:59.563+0100 [mongosMain] connection accepted from 172.28.0.163:51680 #1431871 (400 connections now open) 2015-10-05T08:52:59.564+0100 [conn1431871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:01.229+0100 [conn1431448] end connection 172.28.0.164:59773 (399 connections now open) 2015-10-05T08:53:01.231+0100 [mongosMain] connection accepted from 172.28.0.164:60991 #1431872 (400 connections now open) 2015-10-05T08:53:01.232+0100 [conn1431872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:09.001+0100 [conn1431500] end connection 172.28.0.163:50609 (399 connections now open) 2015-10-05T08:53:09.002+0100 [mongosMain] connection accepted from 172.28.0.163:51712 #1431873 (400 connections now open) 2015-10-05T08:53:09.003+0100 [conn1431873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:09.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c655703b51053ee57c4 2015-10-05T08:53:09.577+0100 [conn1431517] end connection 172.28.0.163:50656 (399 connections now open) 2015-10-05T08:53:09.577+0100 [mongosMain] connection accepted from 172.28.0.163:51716 #1431874 (400 connections now open) 2015-10-05T08:53:09.578+0100 [conn1431874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:09.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:53:11.245+0100 [conn1431462] end connection 172.28.0.164:59807 (399 connections now open) 2015-10-05T08:53:11.246+0100 [mongosMain] connection accepted from 172.28.0.164:61013 #1431875 (400 connections now open) 2015-10-05T08:53:11.248+0100 [conn1431875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:11.870+0100 [conn1431511] end connection 172.28.0.164:59982 (399 connections now open) 2015-10-05T08:53:11.871+0100 [mongosMain] connection accepted from 172.28.0.164:61015 #1431876 (400 connections now open) 2015-10-05T08:53:11.873+0100 [conn1431876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:19.016+0100 [conn1431487] end connection 172.28.0.163:50540 (399 connections now open) 2015-10-05T08:53:19.017+0100 [mongosMain] connection accepted from 172.28.0.163:51728 #1431877 (400 connections now open) 2015-10-05T08:53:19.018+0100 [conn1431877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:19.578+0100 [conn1431520] end connection 172.28.0.163:50693 (399 connections now open) 2015-10-05T08:53:19.578+0100 [mongosMain] connection accepted from 172.28.0.163:51730 #1431878 (400 connections now open) 2015-10-05T08:53:19.580+0100 [conn1431878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:20.116+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:53:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:53:21.261+0100 [conn1431455] end connection 172.28.0.164:59788 (399 connections now open) 2015-10-05T08:53:21.262+0100 [mongosMain] connection accepted from 172.28.0.164:61021 #1431879 (400 connections now open) 2015-10-05T08:53:21.263+0100 [conn1431879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:21.884+0100 [conn1431515] end connection 172.28.0.164:59997 (399 connections now open) 2015-10-05T08:53:21.885+0100 [mongosMain] connection accepted from 172.28.0.164:61024 #1431880 (400 connections now open) 2015-10-05T08:53:21.888+0100 [conn1431880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:21.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c715703b51053ee5874 2015-10-05T08:53:22.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:53:22.464+0100 [conn1431467] end connection 172.28.0.163:50465 (399 connections now open) 2015-10-05T08:53:22.465+0100 [mongosMain] connection accepted from 172.28.0.163:51734 #1431881 (400 connections now open) 2015-10-05T08:53:22.466+0100 [conn1431881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:29.024+0100 [conn1431497] end connection 172.28.0.163:50595 (399 connections now open) 2015-10-05T08:53:29.025+0100 [mongosMain] connection accepted from 172.28.0.163:51737 #1431882 (400 connections now open) 2015-10-05T08:53:29.026+0100 [conn1431882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:29.223+0100 [mongosMain] connection accepted from 127.0.0.1:51739 #1431883 (401 connections now open) 2015-10-05T08:53:29.227+0100 [conn1431883] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:29.234+0100 [conn1431883] end connection 127.0.0.1:51739 (400 connections now open) 2015-10-05T08:53:29.593+0100 [conn1431524] end connection 172.28.0.163:50710 (399 connections now open) 2015-10-05T08:53:29.594+0100 [mongosMain] connection accepted from 172.28.0.163:51740 #1431884 (400 connections now open) 2015-10-05T08:53:29.595+0100 [conn1431884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:31.885+0100 [conn1431522] end connection 172.28.0.164:60024 (399 connections now open) 2015-10-05T08:53:31.886+0100 [mongosMain] connection accepted from 172.28.0.164:61041 #1431885 (400 connections now open) 2015-10-05T08:53:31.888+0100 [conn1431885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:32.480+0100 [conn1431233] end connection 172.28.0.163:49814 (399 connections now open) 2015-10-05T08:53:32.480+0100 [conn1431460] end connection 172.28.0.163:50448 (399 connections now open) 2015-10-05T08:53:32.481+0100 [mongosMain] connection accepted from 172.28.0.163:51742 #1431886 (399 connections now open) 2015-10-05T08:53:32.481+0100 [mongosMain] connection accepted from 172.28.0.163:51743 #1431887 (400 connections now open) 2015-10-05T08:53:32.482+0100 [conn1431886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:32.483+0100 [conn1431887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:34.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122c7e5703b51053ee5960 2015-10-05T08:53:34.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:53:39.032+0100 [conn1431507] end connection 172.28.0.163:50626 (399 connections now open) 2015-10-05T08:53:39.033+0100 [mongosMain] connection accepted from 172.28.0.163:51747 #1431888 (400 connections now open) 2015-10-05T08:53:39.034+0100 [conn1431888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:39.605+0100 [conn1431531] end connection 172.28.0.163:50721 (399 connections now open) 2015-10-05T08:53:39.607+0100 [mongosMain] connection accepted from 172.28.0.163:51749 #1431889 (400 connections now open) 2015-10-05T08:53:39.608+0100 [conn1431889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:39.610+0100 [mongosMain] connection accepted from 127.0.0.1:51750 #1431890 (401 connections now open) 2015-10-05T08:53:39.613+0100 [conn1431890] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:39.617+0100 [conn1431890] end connection 127.0.0.1:51750 (400 connections now open) 2015-10-05T08:53:41.901+0100 [conn1431527] end connection 172.28.0.164:60037 (399 connections now open) 2015-10-05T08:53:41.902+0100 [mongosMain] connection accepted from 172.28.0.164:61059 #1431891 (400 connections now open) 2015-10-05T08:53:41.903+0100 [conn1431891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:42.481+0100 [conn1431442] end connection 172.28.0.163:50415 (399 connections now open) 2015-10-05T08:53:42.481+0100 [conn1430977] end connection 172.28.0.163:65428 (399 connections now open) 2015-10-05T08:53:42.482+0100 [mongosMain] connection accepted from 172.28.0.163:51754 #1431892 (399 connections now open) 2015-10-05T08:53:42.482+0100 [mongosMain] connection accepted from 172.28.0.163:51755 #1431893 (400 connections now open) 2015-10-05T08:53:42.483+0100 [conn1431892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:42.483+0100 [conn1431893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:49.032+0100 [conn1431504] end connection 172.28.0.163:50618 (399 connections now open) 2015-10-05T08:53:49.033+0100 [mongosMain] connection accepted from 172.28.0.163:51767 #1431894 (400 connections now open) 2015-10-05T08:53:49.034+0100 [conn1431894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:49.609+0100 [conn1431537] end connection 172.28.0.163:50732 (399 connections now open) 2015-10-05T08:53:49.611+0100 [mongosMain] connection accepted from 172.28.0.163:51769 #1431895 (400 connections now open) 2015-10-05T08:53:49.612+0100 [conn1431895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:50.360+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:53:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:53:51.277+0100 [conn1431540] end connection 172.28.0.164:60073 (399 connections now open) 2015-10-05T08:53:51.278+0100 [mongosMain] connection accepted from 172.28.0.164:61072 #1431896 (400 connections now open) 2015-10-05T08:53:51.279+0100 [conn1431896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:51.901+0100 [conn1431534] end connection 172.28.0.164:60055 (399 connections now open) 2015-10-05T08:53:51.902+0100 [mongosMain] connection accepted from 172.28.0.164:61075 #1431897 (400 connections now open) 2015-10-05T08:53:51.903+0100 [conn1431897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:52.496+0100 [conn1431042] end connection 172.28.0.163:49204 (399 connections now open) 2015-10-05T08:53:52.496+0100 [conn1431325] end connection 172.28.0.163:50068 (399 connections now open) 2015-10-05T08:53:52.497+0100 [mongosMain] connection accepted from 172.28.0.163:51773 #1431898 (399 connections now open) 2015-10-05T08:53:52.497+0100 [mongosMain] connection accepted from 172.28.0.163:51774 #1431899 (400 connections now open) 2015-10-05T08:53:52.498+0100 [conn1431898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:52.499+0100 [conn1431899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:59.118+0100 [conn1431479] end connection 172.28.0.163:50524 (399 connections now open) 2015-10-05T08:53:59.134+0100 [mongosMain] connection accepted from 172.28.0.163:51791 #1431900 (400 connections now open) 2015-10-05T08:53:59.136+0100 [conn1431900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:53:59.176+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:53:59.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:53:59.625+0100 [conn1431543] end connection 172.28.0.163:50749 (399 connections now open) 2015-10-05T08:53:59.627+0100 [mongosMain] connection accepted from 172.28.0.163:51792 #1431901 (400 connections now open) 2015-10-05T08:53:59.628+0100 [conn1431901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:01.292+0100 [conn1431526] end connection 172.28.0.164:60034 (399 connections now open) 2015-10-05T08:54:01.293+0100 [mongosMain] connection accepted from 172.28.0.164:61086 #1431902 (400 connections now open) 2015-10-05T08:54:01.295+0100 [conn1431902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:01.916+0100 [conn1431541] end connection 172.28.0.164:60076 (399 connections now open) 2015-10-05T08:54:01.918+0100 [mongosMain] connection accepted from 172.28.0.164:61090 #1431903 (400 connections now open) 2015-10-05T08:54:01.919+0100 [conn1431903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:01.932+0100 [conn1431486] end connection 172.28.0.164:59894 (399 connections now open) 2015-10-05T08:54:01.933+0100 [mongosMain] connection accepted from 172.28.0.164:61092 #1431904 (400 connections now open) 2015-10-05T08:54:01.934+0100 [conn1431904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:02.497+0100 [conn1430901] end connection 172.28.0.163:65219 (399 connections now open) 2015-10-05T08:54:02.497+0100 [conn1431525] end connection 172.28.0.163:50712 (399 connections now open) 2015-10-05T08:54:02.498+0100 [mongosMain] connection accepted from 172.28.0.163:51812 #1431905 (399 connections now open) 2015-10-05T08:54:02.498+0100 [mongosMain] connection accepted from 172.28.0.163:51813 #1431906 (400 connections now open) 2015-10-05T08:54:02.499+0100 [conn1431905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:02.499+0100 [conn1431906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:05.331+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:54:05.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:54:09.055+0100 [conn1431516] end connection 172.28.0.163:50655 (399 connections now open) 2015-10-05T08:54:09.056+0100 [mongosMain] connection accepted from 172.28.0.163:51832 #1431907 (400 connections now open) 2015-10-05T08:54:09.058+0100 [conn1431907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:11.309+0100 [conn1431510] end connection 172.28.0.164:59980 (399 connections now open) 2015-10-05T08:54:11.310+0100 [mongosMain] connection accepted from 172.28.0.164:61104 #1431908 (400 connections now open) 2015-10-05T08:54:11.312+0100 [conn1431908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:11.933+0100 [conn1431545] end connection 172.28.0.164:60094 (399 connections now open) 2015-10-05T08:54:11.934+0100 [mongosMain] connection accepted from 172.28.0.164:61106 #1431909 (400 connections now open) 2015-10-05T08:54:11.935+0100 [conn1431909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:11.947+0100 [conn1430899] end connection 172.28.0.164:58204 (399 connections now open) 2015-10-05T08:54:11.948+0100 [mongosMain] connection accepted from 172.28.0.164:61108 #1431910 (400 connections now open) 2015-10-05T08:54:11.948+0100 [conn1431535] end connection 172.28.0.164:60061 (398 connections now open) 2015-10-05T08:54:11.949+0100 [mongosMain] connection accepted from 172.28.0.164:61109 #1431911 (400 connections now open) 2015-10-05T08:54:11.969+0100 [conn1431910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:11.974+0100 [conn1431911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:12.511+0100 [conn1431207] end connection 172.28.0.163:49734 (399 connections now open) 2015-10-05T08:54:12.512+0100 [mongosMain] connection accepted from 172.28.0.163:51838 #1431912 (400 connections now open) 2015-10-05T08:54:12.513+0100 [conn1431912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:17.483+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:54:17.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:54:19.063+0100 [conn1431512] end connection 172.28.0.163:50644 (399 connections now open) 2015-10-05T08:54:19.064+0100 [mongosMain] connection accepted from 172.28.0.163:51846 #1431913 (400 connections now open) 2015-10-05T08:54:19.065+0100 [conn1431913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:19.640+0100 [conn1431546] end connection 172.28.0.163:50764 (399 connections now open) 2015-10-05T08:54:19.641+0100 [mongosMain] connection accepted from 172.28.0.163:51848 #1431914 (400 connections now open) 2015-10-05T08:54:19.642+0100 [conn1431914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:20.623+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:54:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:54:21.325+0100 [conn1431514] end connection 172.28.0.164:59994 (399 connections now open) 2015-10-05T08:54:21.326+0100 [mongosMain] connection accepted from 172.28.0.164:61120 #1431915 (400 connections now open) 2015-10-05T08:54:21.328+0100 [conn1431915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:21.932+0100 [conn1431548] end connection 172.28.0.164:60107 (399 connections now open) 2015-10-05T08:54:21.933+0100 [mongosMain] connection accepted from 172.28.0.164:61122 #1431916 (400 connections now open) 2015-10-05T08:54:21.935+0100 [conn1431916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:22.527+0100 [conn1431447] end connection 172.28.0.163:50428 (399 connections now open) 2015-10-05T08:54:22.528+0100 [mongosMain] connection accepted from 172.28.0.163:51852 #1431917 (400 connections now open) 2015-10-05T08:54:22.528+0100 [conn1430912] end connection 172.28.0.163:65235 (399 connections now open) 2015-10-05T08:54:22.528+0100 [conn1431917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:22.529+0100 [mongosMain] connection accepted from 172.28.0.163:51855 #1431918 (400 connections now open) 2015-10-05T08:54:22.530+0100 [conn1431918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:24.957+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:54:24.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:54:28.522+0100 [mongosMain] connection accepted from 127.0.0.1:51856 #1431919 (401 connections now open) 2015-10-05T08:54:28.524+0100 [conn1431919] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:28.529+0100 [conn1431919] end connection 127.0.0.1:51856 (400 connections now open) 2015-10-05T08:54:29.641+0100 [conn1431555] end connection 172.28.0.163:50802 (399 connections now open) 2015-10-05T08:54:29.643+0100 [mongosMain] connection accepted from 172.28.0.163:51858 #1431920 (400 connections now open) 2015-10-05T08:54:29.644+0100 [conn1431920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:31.341+0100 [conn1431521] end connection 172.28.0.164:60022 (399 connections now open) 2015-10-05T08:54:31.342+0100 [mongosMain] connection accepted from 172.28.0.164:61137 #1431921 (400 connections now open) 2015-10-05T08:54:31.345+0100 [conn1431921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:31.948+0100 [conn1431551] end connection 172.28.0.164:60121 (399 connections now open) 2015-10-05T08:54:31.950+0100 [mongosMain] connection accepted from 172.28.0.164:61140 #1431922 (400 connections now open) 2015-10-05T08:54:31.952+0100 [conn1431922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:32.529+0100 [conn1431539] end connection 172.28.0.163:50735 (399 connections now open) 2015-10-05T08:54:32.530+0100 [mongosMain] connection accepted from 172.28.0.163:51861 #1431923 (400 connections now open) 2015-10-05T08:54:32.530+0100 [conn1430907] end connection 172.28.0.163:65230 (399 connections now open) 2015-10-05T08:54:32.530+0100 [conn1431923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:32.531+0100 [mongosMain] connection accepted from 172.28.0.163:51864 #1431924 (400 connections now open) 2015-10-05T08:54:32.532+0100 [conn1431924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:37.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cbc5703b51053ee5cff 2015-10-05T08:54:37.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:54:39.656+0100 [conn1431562] end connection 172.28.0.163:50811 (399 connections now open) 2015-10-05T08:54:39.657+0100 [mongosMain] connection accepted from 172.28.0.163:51867 #1431925 (400 connections now open) 2015-10-05T08:54:39.658+0100 [conn1431925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:39.724+0100 [mongosMain] connection accepted from 127.0.0.1:51869 #1431926 (401 connections now open) 2015-10-05T08:54:39.727+0100 [conn1431926] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:39.733+0100 [conn1431926] end connection 127.0.0.1:51869 (400 connections now open) 2015-10-05T08:54:41.354+0100 [conn1431518] end connection 172.28.0.164:60005 (399 connections now open) 2015-10-05T08:54:41.356+0100 [mongosMain] connection accepted from 172.28.0.164:61157 #1431927 (400 connections now open) 2015-10-05T08:54:41.359+0100 [conn1431927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:41.964+0100 [conn1431558] end connection 172.28.0.164:60135 (399 connections now open) 2015-10-05T08:54:41.965+0100 [mongosMain] connection accepted from 172.28.0.164:61160 #1431928 (400 connections now open) 2015-10-05T08:54:41.966+0100 [conn1431928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:41.995+0100 [conn1431481] end connection 172.28.0.164:59880 (399 connections now open) 2015-10-05T08:54:41.996+0100 [mongosMain] connection accepted from 172.28.0.164:61162 #1431929 (400 connections now open) 2015-10-05T08:54:41.998+0100 [conn1431929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:42.543+0100 [conn1431239] end connection 172.28.0.163:49822 (399 connections now open) 2015-10-05T08:54:42.544+0100 [mongosMain] connection accepted from 172.28.0.163:51874 #1431930 (400 connections now open) 2015-10-05T08:54:42.545+0100 [conn1431930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:43.555+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cc35703b51053ee5d5c 2015-10-05T08:54:43.623+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:54:49.657+0100 [conn1431568] end connection 172.28.0.163:50818 (399 connections now open) 2015-10-05T08:54:49.658+0100 [mongosMain] connection accepted from 172.28.0.163:51886 #1431931 (400 connections now open) 2015-10-05T08:54:49.660+0100 [conn1431931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:49.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cc95703b51053ee5daa 2015-10-05T08:54:49.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:54:50.893+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:54:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:54:51.371+0100 [conn1431556] end connection 172.28.0.164:60132 (399 connections now open) 2015-10-05T08:54:51.374+0100 [mongosMain] connection accepted from 172.28.0.164:61174 #1431932 (400 connections now open) 2015-10-05T08:54:51.376+0100 [conn1431932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:51.980+0100 [conn1431560] end connection 172.28.0.164:60148 (399 connections now open) 2015-10-05T08:54:51.980+0100 [conn1431566] end connection 172.28.0.164:60158 (398 connections now open) 2015-10-05T08:54:51.981+0100 [mongosMain] connection accepted from 172.28.0.164:61178 #1431933 (399 connections now open) 2015-10-05T08:54:51.981+0100 [mongosMain] connection accepted from 172.28.0.164:61177 #1431934 (400 connections now open) 2015-10-05T08:54:51.982+0100 [conn1431933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:51.983+0100 [conn1431934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:52.599+0100 [conn1430942] end connection 172.28.0.163:65335 (399 connections now open) 2015-10-05T08:54:52.626+0100 [mongosMain] connection accepted from 172.28.0.163:51894 #1431935 (400 connections now open) 2015-10-05T08:54:52.627+0100 [conn1431935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:54:59.671+0100 [conn1431575] end connection 172.28.0.163:50841 (399 connections now open) 2015-10-05T08:54:59.672+0100 [mongosMain] connection accepted from 172.28.0.163:51903 #1431936 (400 connections now open) 2015-10-05T08:54:59.673+0100 [conn1431936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:01.386+0100 [conn1431547] end connection 172.28.0.164:60104 (399 connections now open) 2015-10-05T08:55:01.387+0100 [mongosMain] connection accepted from 172.28.0.164:61185 #1431937 (400 connections now open) 2015-10-05T08:55:01.388+0100 [conn1431937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:01.995+0100 [conn1431573] end connection 172.28.0.164:60176 (399 connections now open) 2015-10-05T08:55:01.996+0100 [mongosMain] connection accepted from 172.28.0.164:61189 #1431938 (400 connections now open) 2015-10-05T08:55:01.998+0100 [conn1431938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:02.559+0100 [conn1431022] end connection 172.28.0.163:65522 (399 connections now open) 2015-10-05T08:55:02.560+0100 [mongosMain] connection accepted from 172.28.0.163:51916 #1431939 (400 connections now open) 2015-10-05T08:55:02.561+0100 [conn1431939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:02.687+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cd55703b51053ee5e63 2015-10-05T08:55:02.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:09.110+0100 [conn1431519] end connection 172.28.0.163:50691 (399 connections now open) 2015-10-05T08:55:09.112+0100 [mongosMain] connection accepted from 172.28.0.163:51937 #1431940 (400 connections now open) 2015-10-05T08:55:09.112+0100 [conn1431940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:09.672+0100 [conn1431581] end connection 172.28.0.163:50859 (399 connections now open) 2015-10-05T08:55:09.674+0100 [mongosMain] connection accepted from 172.28.0.163:51939 #1431941 (400 connections now open) 2015-10-05T08:55:09.676+0100 [conn1431941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:11.402+0100 [conn1431570] end connection 172.28.0.164:60174 (399 connections now open) 2015-10-05T08:55:11.403+0100 [mongosMain] connection accepted from 172.28.0.164:61197 #1431942 (400 connections now open) 2015-10-05T08:55:11.406+0100 [conn1431942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:11.996+0100 [conn1431272] end connection 172.28.0.164:59264 (399 connections now open) 2015-10-05T08:55:11.997+0100 [mongosMain] connection accepted from 172.28.0.164:61201 #1431943 (400 connections now open) 2015-10-05T08:55:11.999+0100 [conn1431943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:12.011+0100 [conn1431577] end connection 172.28.0.164:60193 (399 connections now open) 2015-10-05T08:55:12.012+0100 [mongosMain] connection accepted from 172.28.0.164:61203 #1431944 (400 connections now open) 2015-10-05T08:55:12.018+0100 [conn1431944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:12.559+0100 [conn1430957] end connection 172.28.0.163:65365 (399 connections now open) 2015-10-05T08:55:12.561+0100 [mongosMain] connection accepted from 172.28.0.163:51947 #1431945 (400 connections now open) 2015-10-05T08:55:12.562+0100 [conn1431945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:19.112+0100 [conn1431523] end connection 172.28.0.163:50708 (399 connections now open) 2015-10-05T08:55:19.113+0100 [mongosMain] connection accepted from 172.28.0.163:51954 #1431946 (400 connections now open) 2015-10-05T08:55:19.114+0100 [conn1431946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:19.689+0100 [conn1431589] end connection 172.28.0.163:50892 (399 connections now open) 2015-10-05T08:55:19.690+0100 [mongosMain] connection accepted from 172.28.0.163:51956 #1431947 (400 connections now open) 2015-10-05T08:55:19.691+0100 [conn1431947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:21.190+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:55:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:55:21.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ce85703b51053ee5f64 2015-10-05T08:55:21.326+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:21.420+0100 [conn1431550] end connection 172.28.0.164:60119 (399 connections now open) 2015-10-05T08:55:21.421+0100 [mongosMain] connection accepted from 172.28.0.164:61211 #1431948 (400 connections now open) 2015-10-05T08:55:21.423+0100 [conn1431948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:22.011+0100 [conn1431478] end connection 172.28.0.164:59865 (399 connections now open) 2015-10-05T08:55:22.012+0100 [conn1431157] end connection 172.28.0.164:58908 (398 connections now open) 2015-10-05T08:55:22.012+0100 [mongosMain] connection accepted from 172.28.0.164:61215 #1431949 (399 connections now open) 2015-10-05T08:55:22.013+0100 [mongosMain] connection accepted from 172.28.0.164:61216 #1431950 (400 connections now open) 2015-10-05T08:55:22.013+0100 [conn1431949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:22.014+0100 [conn1431950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:22.026+0100 [conn1431583] end connection 172.28.0.164:60212 (399 connections now open) 2015-10-05T08:55:22.027+0100 [mongosMain] connection accepted from 172.28.0.164:61218 #1431951 (400 connections now open) 2015-10-05T08:55:22.028+0100 [conn1431951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:22.575+0100 [conn1431565] end connection 172.28.0.163:50816 (399 connections now open) 2015-10-05T08:55:22.576+0100 [mongosMain] connection accepted from 172.28.0.163:51961 #1431952 (400 connections now open) 2015-10-05T08:55:22.577+0100 [conn1431952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:22.591+0100 [conn1431095] end connection 172.28.0.163:49361 (399 connections now open) 2015-10-05T08:55:22.592+0100 [mongosMain] connection accepted from 172.28.0.163:51963 #1431953 (400 connections now open) 2015-10-05T08:55:22.594+0100 [conn1431953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:27.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cef5703b51053ee5fd2 2015-10-05T08:55:27.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:28.494+0100 [mongosMain] connection accepted from 127.0.0.1:51965 #1431954 (401 connections now open) 2015-10-05T08:55:28.497+0100 [conn1431954] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:28.503+0100 [conn1431954] end connection 127.0.0.1:51965 (400 connections now open) 2015-10-05T08:55:29.126+0100 [conn1431542] end connection 172.28.0.163:50747 (399 connections now open) 2015-10-05T08:55:29.128+0100 [mongosMain] connection accepted from 172.28.0.163:51966 #1431955 (400 connections now open) 2015-10-05T08:55:29.128+0100 [conn1431955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:29.703+0100 [conn1431596] end connection 172.28.0.163:50906 (399 connections now open) 2015-10-05T08:55:29.704+0100 [mongosMain] connection accepted from 172.28.0.163:51968 #1431956 (400 connections now open) 2015-10-05T08:55:29.705+0100 [conn1431956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:31.418+0100 [conn1431544] end connection 172.28.0.164:60091 (399 connections now open) 2015-10-05T08:55:31.419+0100 [mongosMain] connection accepted from 172.28.0.164:61231 #1431957 (400 connections now open) 2015-10-05T08:55:31.420+0100 [conn1431957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:32.010+0100 [conn1431199] end connection 172.28.0.164:59039 (399 connections now open) 2015-10-05T08:55:32.010+0100 [conn1431528] end connection 172.28.0.164:60046 (398 connections now open) 2015-10-05T08:55:32.011+0100 [mongosMain] connection accepted from 172.28.0.164:61234 #1431958 (399 connections now open) 2015-10-05T08:55:32.012+0100 [mongosMain] connection accepted from 172.28.0.164:61235 #1431959 (400 connections now open) 2015-10-05T08:55:32.013+0100 [conn1431958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:32.013+0100 [conn1431959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:32.042+0100 [conn1431598] end connection 172.28.0.164:60235 (399 connections now open) 2015-10-05T08:55:32.043+0100 [mongosMain] connection accepted from 172.28.0.164:61237 #1431960 (400 connections now open) 2015-10-05T08:55:32.046+0100 [conn1431960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:32.590+0100 [conn1431532] end connection 172.28.0.163:50723 (399 connections now open) 2015-10-05T08:55:32.590+0100 [conn1430926] end connection 172.28.0.163:65271 (399 connections now open) 2015-10-05T08:55:32.591+0100 [mongosMain] connection accepted from 172.28.0.163:51972 #1431961 (399 connections now open) 2015-10-05T08:55:32.592+0100 [mongosMain] connection accepted from 172.28.0.163:51973 #1431962 (400 connections now open) 2015-10-05T08:55:32.592+0100 [conn1431961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:32.593+0100 [conn1431962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:34.270+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:55:34.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:55:39.128+0100 [conn1431588] end connection 172.28.0.163:50888 (399 connections now open) 2015-10-05T08:55:39.129+0100 [mongosMain] connection accepted from 172.28.0.163:51978 #1431963 (400 connections now open) 2015-10-05T08:55:39.130+0100 [conn1431963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:39.705+0100 [conn1431605] end connection 172.28.0.163:50918 (399 connections now open) 2015-10-05T08:55:39.706+0100 [mongosMain] connection accepted from 172.28.0.163:51980 #1431964 (400 connections now open) 2015-10-05T08:55:39.707+0100 [conn1431964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:39.936+0100 [mongosMain] connection accepted from 127.0.0.1:51982 #1431965 (401 connections now open) 2015-10-05T08:55:39.941+0100 [conn1431965] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:39.945+0100 [conn1431965] end connection 127.0.0.1:51982 (400 connections now open) 2015-10-05T08:55:40.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122cfc5703b51053ee60ac 2015-10-05T08:55:40.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:41.434+0100 [conn1431563] end connection 172.28.0.164:60154 (399 connections now open) 2015-10-05T08:55:41.434+0100 [mongosMain] connection accepted from 172.28.0.164:61252 #1431966 (400 connections now open) 2015-10-05T08:55:41.436+0100 [conn1431966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:42.027+0100 [conn1431312] end connection 172.28.0.164:59376 (399 connections now open) 2015-10-05T08:55:42.028+0100 [mongosMain] connection accepted from 172.28.0.164:61255 #1431967 (400 connections now open) 2015-10-05T08:55:42.029+0100 [conn1431967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:42.058+0100 [conn1431607] end connection 172.28.0.164:60254 (399 connections now open) 2015-10-05T08:55:42.060+0100 [mongosMain] connection accepted from 172.28.0.164:61257 #1431968 (400 connections now open) 2015-10-05T08:55:42.062+0100 [conn1431968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:42.592+0100 [conn1431578] end connection 172.28.0.163:50846 (399 connections now open) 2015-10-05T08:55:42.592+0100 [conn1430936] end connection 172.28.0.163:65321 (398 connections now open) 2015-10-05T08:55:42.593+0100 [mongosMain] connection accepted from 172.28.0.163:51986 #1431969 (399 connections now open) 2015-10-05T08:55:42.594+0100 [mongosMain] connection accepted from 172.28.0.163:51987 #1431970 (400 connections now open) 2015-10-05T08:55:42.594+0100 [conn1431969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:42.595+0100 [conn1431970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:46.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d025703b51053ee60f7 2015-10-05T08:55:46.891+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:49.719+0100 [conn1431612] end connection 172.28.0.163:50928 (399 connections now open) 2015-10-05T08:55:49.721+0100 [mongosMain] connection accepted from 172.28.0.163:51999 #1431971 (400 connections now open) 2015-10-05T08:55:49.722+0100 [conn1431971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:51.434+0100 [conn1431590] end connection 172.28.0.164:60218 (399 connections now open) 2015-10-05T08:55:51.434+0100 [mongosMain] connection accepted from 172.28.0.164:61268 #1431972 (400 connections now open) 2015-10-05T08:55:51.436+0100 [conn1431972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:52.057+0100 [conn1431615] end connection 172.28.0.164:60276 (399 connections now open) 2015-10-05T08:55:52.059+0100 [mongosMain] connection accepted from 172.28.0.164:61271 #1431973 (400 connections now open) 2015-10-05T08:55:52.061+0100 [conn1431973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:52.486+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:55:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:55:52.558+0100 [conn1431567] end connection 172.28.0.164:60166 (399 connections now open) 2015-10-05T08:55:52.559+0100 [mongosMain] connection accepted from 172.28.0.164:61272 #1431974 (400 connections now open) 2015-10-05T08:55:52.562+0100 [conn1431974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:52.937+0100 [conn1431584] end connection 172.28.0.163:50878 (399 connections now open) 2015-10-05T08:55:52.937+0100 [conn1431075] end connection 172.28.0.163:49299 (399 connections now open) 2015-10-05T08:55:52.953+0100 [mongosMain] connection accepted from 172.28.0.163:52005 #1431975 (399 connections now open) 2015-10-05T08:55:52.954+0100 [conn1431975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:52.955+0100 [mongosMain] connection accepted from 172.28.0.163:52006 #1431976 (400 connections now open) 2015-10-05T08:55:52.956+0100 [conn1431976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:55:53.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d085703b51053ee613b 2015-10-05T08:55:53.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:55:59.720+0100 [conn1431619] end connection 172.28.0.163:50942 (399 connections now open) 2015-10-05T08:55:59.721+0100 [mongosMain] connection accepted from 172.28.0.163:52016 #1431977 (400 connections now open) 2015-10-05T08:55:59.722+0100 [conn1431977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:01.450+0100 [conn1431582] end connection 172.28.0.164:60207 (399 connections now open) 2015-10-05T08:56:01.452+0100 [mongosMain] connection accepted from 172.28.0.164:61299 #1431978 (400 connections now open) 2015-10-05T08:56:01.453+0100 [conn1431978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:02.074+0100 [conn1431620] end connection 172.28.0.164:60285 (399 connections now open) 2015-10-05T08:56:02.075+0100 [mongosMain] connection accepted from 172.28.0.164:61302 #1431979 (400 connections now open) 2015-10-05T08:56:02.076+0100 [conn1431979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:02.558+0100 [conn1431353] end connection 172.28.0.164:59482 (399 connections now open) 2015-10-05T08:56:02.558+0100 [mongosMain] connection accepted from 172.28.0.164:61305 #1431980 (400 connections now open) 2015-10-05T08:56:02.560+0100 [conn1431980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:02.902+0100 [conn1431067] end connection 172.28.0.163:49287 (399 connections now open) 2015-10-05T08:56:02.902+0100 [conn1431591] end connection 172.28.0.163:50897 (399 connections now open) 2015-10-05T08:56:02.903+0100 [mongosMain] connection accepted from 172.28.0.163:52027 #1431981 (399 connections now open) 2015-10-05T08:56:02.904+0100 [mongosMain] connection accepted from 172.28.0.163:52028 #1431982 (400 connections now open) 2015-10-05T08:56:02.904+0100 [conn1431981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:02.905+0100 [conn1431982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:06.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d155703b51053ee621c 2015-10-05T08:56:06.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:11.450+0100 [conn1431597] end connection 172.28.0.164:60233 (399 connections now open) 2015-10-05T08:56:11.451+0100 [mongosMain] connection accepted from 172.28.0.164:61308 #1431983 (400 connections now open) 2015-10-05T08:56:11.453+0100 [conn1431983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:12.073+0100 [conn1431625] end connection 172.28.0.164:60311 (399 connections now open) 2015-10-05T08:56:12.074+0100 [mongosMain] connection accepted from 172.28.0.164:61310 #1431984 (400 connections now open) 2015-10-05T08:56:12.076+0100 [conn1431984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:12.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d1c5703b51053ee629b 2015-10-05T08:56:12.577+0100 [conn1431611] end connection 172.28.0.164:60263 (399 connections now open) 2015-10-05T08:56:12.578+0100 [conn1431317] end connection 172.28.0.164:59392 (398 connections now open) 2015-10-05T08:56:12.581+0100 [mongosMain] connection accepted from 172.28.0.164:61313 #1431985 (399 connections now open) 2015-10-05T08:56:12.583+0100 [mongosMain] connection accepted from 172.28.0.164:61314 #1431986 (400 connections now open) 2015-10-05T08:56:12.583+0100 [conn1431985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:12.584+0100 [conn1431986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:12.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:12.909+0100 [conn1430920] end connection 172.28.0.163:65253 (399 connections now open) 2015-10-05T08:56:12.910+0100 [conn1431571] end connection 172.28.0.163:50829 (398 connections now open) 2015-10-05T08:56:12.910+0100 [mongosMain] connection accepted from 172.28.0.163:52043 #1431987 (399 connections now open) 2015-10-05T08:56:12.910+0100 [mongosMain] connection accepted from 172.28.0.163:52044 #1431988 (400 connections now open) 2015-10-05T08:56:12.911+0100 [conn1431987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:12.911+0100 [conn1431988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:18.906+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d225703b51053ee632f 2015-10-05T08:56:19.173+0100 [conn1431536] end connection 172.28.0.163:50730 (399 connections now open) 2015-10-05T08:56:19.174+0100 [mongosMain] connection accepted from 172.28.0.163:52051 #1431989 (400 connections now open) 2015-10-05T08:56:19.175+0100 [conn1431989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:19.735+0100 [conn1431624] end connection 172.28.0.163:50966 (399 connections now open) 2015-10-05T08:56:19.736+0100 [mongosMain] connection accepted from 172.28.0.163:52052 #1431990 (400 connections now open) 2015-10-05T08:56:19.737+0100 [conn1431990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:20.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:22.589+0100 [conn1431301] end connection 172.28.0.164:59347 (399 connections now open) 2015-10-05T08:56:22.590+0100 [conn1431474] end connection 172.28.0.164:59858 (398 connections now open) 2015-10-05T08:56:22.591+0100 [mongosMain] connection accepted from 172.28.0.164:61329 #1431991 (399 connections now open) 2015-10-05T08:56:22.591+0100 [mongosMain] connection accepted from 172.28.0.164:61330 #1431992 (400 connections now open) 2015-10-05T08:56:22.595+0100 [conn1431992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:22.595+0100 [conn1431991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:22.627+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:56:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:56:22.918+0100 [conn1431600] end connection 172.28.0.163:50910 (399 connections now open) 2015-10-05T08:56:22.918+0100 [conn1431037] end connection 172.28.0.163:49167 (399 connections now open) 2015-10-05T08:56:22.919+0100 [mongosMain] connection accepted from 172.28.0.163:52056 #1431993 (399 connections now open) 2015-10-05T08:56:22.920+0100 [mongosMain] connection accepted from 172.28.0.163:52057 #1431994 (400 connections now open) 2015-10-05T08:56:22.920+0100 [conn1431993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:22.921+0100 [conn1431994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:26.635+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:56:26.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:56:28.810+0100 [mongosMain] connection accepted from 127.0.0.1:52063 #1431995 (401 connections now open) 2015-10-05T08:56:28.813+0100 [conn1431995] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:28.818+0100 [conn1431995] end connection 127.0.0.1:52063 (400 connections now open) 2015-10-05T08:56:29.176+0100 [conn1431629] end connection 172.28.0.163:50991 (399 connections now open) 2015-10-05T08:56:29.177+0100 [mongosMain] connection accepted from 172.28.0.163:52064 #1431996 (400 connections now open) 2015-10-05T08:56:29.178+0100 [conn1431996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:29.751+0100 [conn1431636] end connection 172.28.0.163:51006 (399 connections now open) 2015-10-05T08:56:29.752+0100 [mongosMain] connection accepted from 172.28.0.163:52066 #1431997 (400 connections now open) 2015-10-05T08:56:29.753+0100 [conn1431997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:32.089+0100 [conn1431631] end connection 172.28.0.164:60322 (399 connections now open) 2015-10-05T08:56:32.090+0100 [mongosMain] connection accepted from 172.28.0.164:61345 #1431998 (400 connections now open) 2015-10-05T08:56:32.092+0100 [conn1431998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:32.590+0100 [conn1431339] end connection 172.28.0.164:59447 (399 connections now open) 2015-10-05T08:56:32.590+0100 [conn1431601] end connection 172.28.0.164:60245 (399 connections now open) 2015-10-05T08:56:32.590+0100 [mongosMain] connection accepted from 172.28.0.164:61350 #1431999 (399 connections now open) 2015-10-05T08:56:32.591+0100 [mongosMain] connection accepted from 172.28.0.164:61349 #1432000 (400 connections now open) 2015-10-05T08:56:32.592+0100 [conn1431999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:32.593+0100 [conn1432000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:32.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d305703b51053ee6412 2015-10-05T08:56:32.925+0100 [conn1431089] end connection 172.28.0.163:49331 (399 connections now open) 2015-10-05T08:56:32.926+0100 [conn1431454] end connection 172.28.0.163:50439 (398 connections now open) 2015-10-05T08:56:32.926+0100 [mongosMain] connection accepted from 172.28.0.163:52071 #1432001 (399 connections now open) 2015-10-05T08:56:32.927+0100 [mongosMain] connection accepted from 172.28.0.163:52069 #1432002 (400 connections now open) 2015-10-05T08:56:32.927+0100 [conn1432001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:32.927+0100 [conn1432002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:33.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:39.190+0100 [conn1431554] end connection 172.28.0.163:50800 (399 connections now open) 2015-10-05T08:56:39.191+0100 [mongosMain] connection accepted from 172.28.0.163:52080 #1432003 (400 connections now open) 2015-10-05T08:56:39.192+0100 [conn1432003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:39.249+0100 [mongosMain] connection accepted from 127.0.0.1:52081 #1432004 (401 connections now open) 2015-10-05T08:56:39.252+0100 [conn1432004] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:39.256+0100 [conn1432004] end connection 127.0.0.1:52081 (400 connections now open) 2015-10-05T08:56:39.751+0100 [conn1431643] end connection 172.28.0.163:51019 (399 connections now open) 2015-10-05T08:56:39.752+0100 [mongosMain] connection accepted from 172.28.0.163:52082 #1432005 (400 connections now open) 2015-10-05T08:56:39.754+0100 [conn1432005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:41.480+0100 [conn1431630] end connection 172.28.0.164:60320 (399 connections now open) 2015-10-05T08:56:41.482+0100 [mongosMain] connection accepted from 172.28.0.164:61364 #1432006 (400 connections now open) 2015-10-05T08:56:41.483+0100 [conn1432006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:42.105+0100 [conn1431645] end connection 172.28.0.164:60353 (399 connections now open) 2015-10-05T08:56:42.106+0100 [mongosMain] connection accepted from 172.28.0.164:61366 #1432007 (400 connections now open) 2015-10-05T08:56:42.108+0100 [conn1432007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:42.590+0100 [conn1431549] end connection 172.28.0.164:60117 (399 connections now open) 2015-10-05T08:56:42.591+0100 [conn1431586] end connection 172.28.0.164:60215 (398 connections now open) 2015-10-05T08:56:42.594+0100 [mongosMain] connection accepted from 172.28.0.164:61368 #1432008 (399 connections now open) 2015-10-05T08:56:42.596+0100 [conn1432008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:42.596+0100 [mongosMain] connection accepted from 172.28.0.164:61370 #1432009 (400 connections now open) 2015-10-05T08:56:42.597+0100 [conn1432009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:42.934+0100 [conn1431557] end connection 172.28.0.163:50806 (399 connections now open) 2015-10-05T08:56:42.934+0100 [conn1431013] end connection 172.28.0.163:65503 (398 connections now open) 2015-10-05T08:56:42.935+0100 [mongosMain] connection accepted from 172.28.0.163:52086 #1432010 (399 connections now open) 2015-10-05T08:56:42.935+0100 [mongosMain] connection accepted from 172.28.0.163:52087 #1432011 (400 connections now open) 2015-10-05T08:56:42.936+0100 [conn1432010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:42.936+0100 [conn1432011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:49.190+0100 [conn1431603] end connection 172.28.0.163:50915 (399 connections now open) 2015-10-05T08:56:49.191+0100 [mongosMain] connection accepted from 172.28.0.163:52099 #1432012 (400 connections now open) 2015-10-05T08:56:49.192+0100 [conn1432012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:49.766+0100 [conn1431651] end connection 172.28.0.163:51029 (399 connections now open) 2015-10-05T08:56:49.767+0100 [mongosMain] connection accepted from 172.28.0.163:52102 #1432013 (400 connections now open) 2015-10-05T08:56:49.768+0100 [conn1432013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:51.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d435703b51053ee6552 2015-10-05T08:56:51.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:51.497+0100 [conn1431614] end connection 172.28.0.164:60274 (399 connections now open) 2015-10-05T08:56:51.498+0100 [mongosMain] connection accepted from 172.28.0.164:61380 #1432014 (400 connections now open) 2015-10-05T08:56:51.499+0100 [conn1432014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:52.121+0100 [conn1431654] end connection 172.28.0.164:60374 (399 connections now open) 2015-10-05T08:56:52.123+0100 [mongosMain] connection accepted from 172.28.0.164:61383 #1432015 (400 connections now open) 2015-10-05T08:56:52.125+0100 [conn1432015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:52.605+0100 [conn1431593] end connection 172.28.0.164:60224 (399 connections now open) 2015-10-05T08:56:52.605+0100 [conn1431359] end connection 172.28.0.164:59499 (398 connections now open) 2015-10-05T08:56:52.606+0100 [mongosMain] connection accepted from 172.28.0.164:61386 #1432016 (399 connections now open) 2015-10-05T08:56:52.607+0100 [mongosMain] connection accepted from 172.28.0.164:61387 #1432017 (400 connections now open) 2015-10-05T08:56:52.607+0100 [conn1432016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:52.608+0100 [conn1432017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:52.934+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:56:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:56:52.942+0100 [conn1430985] end connection 172.28.0.163:65444 (399 connections now open) 2015-10-05T08:56:52.943+0100 [mongosMain] connection accepted from 172.28.0.163:52106 #1432018 (400 connections now open) 2015-10-05T08:56:52.943+0100 [conn1431626] end connection 172.28.0.163:50976 (399 connections now open) 2015-10-05T08:56:52.944+0100 [conn1432018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:52.945+0100 [mongosMain] connection accepted from 172.28.0.163:52108 #1432019 (400 connections now open) 2015-10-05T08:56:52.946+0100 [conn1432019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:56:57.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d495703b51053ee65c9 2015-10-05T08:56:57.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:56:59.782+0100 [conn1431659] end connection 172.28.0.163:51047 (399 connections now open) 2015-10-05T08:56:59.783+0100 [mongosMain] connection accepted from 172.28.0.163:52119 #1432020 (400 connections now open) 2015-10-05T08:56:59.784+0100 [conn1432020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:01.496+0100 [conn1431644] end connection 172.28.0.164:60351 (399 connections now open) 2015-10-05T08:57:01.498+0100 [mongosMain] connection accepted from 172.28.0.164:61403 #1432021 (400 connections now open) 2015-10-05T08:57:01.499+0100 [conn1432021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:02.120+0100 [conn1431661] end connection 172.28.0.164:60391 (399 connections now open) 2015-10-05T08:57:02.121+0100 [mongosMain] connection accepted from 172.28.0.164:61411 #1432022 (400 connections now open) 2015-10-05T08:57:02.122+0100 [conn1432022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:02.621+0100 [conn1431324] end connection 172.28.0.164:59412 (399 connections now open) 2015-10-05T08:57:02.622+0100 [conn1431639] end connection 172.28.0.164:60343 (398 connections now open) 2015-10-05T08:57:02.622+0100 [mongosMain] connection accepted from 172.28.0.164:61414 #1432023 (399 connections now open) 2015-10-05T08:57:02.623+0100 [mongosMain] connection accepted from 172.28.0.164:61415 #1432024 (400 connections now open) 2015-10-05T08:57:02.624+0100 [conn1432024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:02.625+0100 [conn1432023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:02.950+0100 [conn1431617] end connection 172.28.0.163:50935 (399 connections now open) 2015-10-05T08:57:02.950+0100 [conn1431616] end connection 172.28.0.163:50934 (399 connections now open) 2015-10-05T08:57:02.950+0100 [mongosMain] connection accepted from 172.28.0.163:52138 #1432025 (399 connections now open) 2015-10-05T08:57:02.951+0100 [mongosMain] connection accepted from 172.28.0.163:52139 #1432026 (400 connections now open) 2015-10-05T08:57:02.951+0100 [conn1432025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:02.951+0100 [conn1432026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:04.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d4f5703b51053ee6634 2015-10-05T08:57:05.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:57:09.783+0100 [conn1431666] end connection 172.28.0.163:51059 (399 connections now open) 2015-10-05T08:57:09.784+0100 [mongosMain] connection accepted from 172.28.0.163:52152 #1432027 (400 connections now open) 2015-10-05T08:57:09.785+0100 [conn1432027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:11.512+0100 [conn1431660] end connection 172.28.0.164:60390 (399 connections now open) 2015-10-05T08:57:11.513+0100 [mongosMain] connection accepted from 172.28.0.164:61421 #1432028 (400 connections now open) 2015-10-05T08:57:11.516+0100 [conn1432028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:11.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d575703b51053ee66b4 2015-10-05T08:57:12.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:57:12.136+0100 [conn1431668] end connection 172.28.0.164:60408 (399 connections now open) 2015-10-05T08:57:12.137+0100 [mongosMain] connection accepted from 172.28.0.164:61423 #1432029 (400 connections now open) 2015-10-05T08:57:12.138+0100 [conn1432029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:12.639+0100 [conn1431282] end connection 172.28.0.164:59294 (399 connections now open) 2015-10-05T08:57:12.639+0100 [mongosMain] connection accepted from 172.28.0.164:61426 #1432030 (400 connections now open) 2015-10-05T08:57:12.643+0100 [conn1432030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:12.956+0100 [conn1431608] end connection 172.28.0.163:50921 (399 connections now open) 2015-10-05T08:57:12.957+0100 [conn1431633] end connection 172.28.0.163:50998 (398 connections now open) 2015-10-05T08:57:12.958+0100 [mongosMain] connection accepted from 172.28.0.163:52160 #1432031 (399 connections now open) 2015-10-05T08:57:12.958+0100 [mongosMain] connection accepted from 172.28.0.163:52162 #1432032 (400 connections now open) 2015-10-05T08:57:12.959+0100 [conn1432031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:12.959+0100 [conn1432032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:19.798+0100 [conn1431673] end connection 172.28.0.163:51093 (399 connections now open) 2015-10-05T08:57:19.799+0100 [mongosMain] connection accepted from 172.28.0.163:52171 #1432033 (400 connections now open) 2015-10-05T08:57:19.800+0100 [conn1432033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:21.528+0100 [conn1431606] end connection 172.28.0.164:60251 (399 connections now open) 2015-10-05T08:57:21.529+0100 [mongosMain] connection accepted from 172.28.0.164:61434 #1432034 (400 connections now open) 2015-10-05T08:57:21.531+0100 [conn1432034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:22.152+0100 [conn1431675] end connection 172.28.0.164:60426 (399 connections now open) 2015-10-05T08:57:22.153+0100 [mongosMain] connection accepted from 172.28.0.164:61438 #1432035 (400 connections now open) 2015-10-05T08:57:22.155+0100 [conn1432035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:22.770+0100 [conn1431306] end connection 172.28.0.164:59368 (399 connections now open) 2015-10-05T08:57:22.771+0100 [mongosMain] connection accepted from 172.28.0.164:61442 #1432036 (400 connections now open) 2015-10-05T08:57:22.773+0100 [conn1432036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:22.966+0100 [conn1431621] end connection 172.28.0.163:50944 (399 connections now open) 2015-10-05T08:57:22.967+0100 [mongosMain] connection accepted from 172.28.0.163:52175 #1432037 (400 connections now open) 2015-10-05T08:57:22.968+0100 [conn1432037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:23.183+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:57:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:57:24.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d645703b51053ee6759 2015-10-05T08:57:24.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:57:28.546+0100 [mongosMain] connection accepted from 127.0.0.1:52178 #1432038 (401 connections now open) 2015-10-05T08:57:28.549+0100 [conn1432038] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:28.553+0100 [conn1432038] end connection 127.0.0.1:52178 (400 connections now open) 2015-10-05T08:57:29.235+0100 [conn1431650] end connection 172.28.0.163:51027 (399 connections now open) 2015-10-05T08:57:29.236+0100 [mongosMain] connection accepted from 172.28.0.163:52179 #1432039 (400 connections now open) 2015-10-05T08:57:29.237+0100 [conn1432039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:29.798+0100 [conn1431680] end connection 172.28.0.163:51115 (399 connections now open) 2015-10-05T08:57:29.799+0100 [mongosMain] connection accepted from 172.28.0.163:52180 #1432040 (400 connections now open) 2015-10-05T08:57:29.800+0100 [conn1432040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:31.544+0100 [conn1431576] end connection 172.28.0.164:60190 (399 connections now open) 2015-10-05T08:57:31.545+0100 [mongosMain] connection accepted from 172.28.0.164:61454 #1432041 (400 connections now open) 2015-10-05T08:57:31.547+0100 [conn1432041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:32.152+0100 [conn1431682] end connection 172.28.0.164:60441 (399 connections now open) 2015-10-05T08:57:32.153+0100 [mongosMain] connection accepted from 172.28.0.164:61456 #1432042 (400 connections now open) 2015-10-05T08:57:32.155+0100 [conn1432042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:32.668+0100 [conn1431580] end connection 172.28.0.164:60198 (399 connections now open) 2015-10-05T08:57:32.669+0100 [mongosMain] connection accepted from 172.28.0.164:61460 #1432043 (400 connections now open) 2015-10-05T08:57:32.670+0100 [conn1432043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:32.990+0100 [conn1431663] end connection 172.28.0.163:51051 (399 connections now open) 2015-10-05T08:57:32.991+0100 [mongosMain] connection accepted from 172.28.0.163:52183 #1432044 (400 connections now open) 2015-10-05T08:57:32.992+0100 [conn1432044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:36.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d705703b51053ee6807 2015-10-05T08:57:36.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:57:39.238+0100 [conn1431595] end connection 172.28.0.163:50904 (399 connections now open) 2015-10-05T08:57:39.239+0100 [mongosMain] connection accepted from 172.28.0.163:52185 #1432045 (400 connections now open) 2015-10-05T08:57:39.240+0100 [conn1432045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:39.722+0100 [mongosMain] connection accepted from 127.0.0.1:52187 #1432046 (401 connections now open) 2015-10-05T08:57:39.725+0100 [conn1432046] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:39.729+0100 [conn1432046] end connection 127.0.0.1:52187 (400 connections now open) 2015-10-05T08:57:41.559+0100 [conn1431533] end connection 172.28.0.164:60053 (399 connections now open) 2015-10-05T08:57:41.560+0100 [mongosMain] connection accepted from 172.28.0.164:61476 #1432047 (400 connections now open) 2015-10-05T08:57:41.562+0100 [conn1432047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:42.169+0100 [conn1431690] end connection 172.28.0.164:60459 (399 connections now open) 2015-10-05T08:57:42.170+0100 [mongosMain] connection accepted from 172.28.0.164:61479 #1432048 (400 connections now open) 2015-10-05T08:57:42.172+0100 [conn1432048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:42.685+0100 [conn1431574] end connection 172.28.0.164:60180 (399 connections now open) 2015-10-05T08:57:42.686+0100 [mongosMain] connection accepted from 172.28.0.164:61483 #1432049 (400 connections now open) 2015-10-05T08:57:42.687+0100 [conn1432049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:42.983+0100 [conn1431656] end connection 172.28.0.163:51035 (399 connections now open) 2015-10-05T08:57:42.983+0100 [mongosMain] connection accepted from 172.28.0.163:52192 #1432050 (400 connections now open) 2015-10-05T08:57:42.985+0100 [conn1432050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:49.253+0100 [conn1431641] end connection 172.28.0.163:51017 (399 connections now open) 2015-10-05T08:57:49.254+0100 [mongosMain] connection accepted from 172.28.0.163:52202 #1432051 (400 connections now open) 2015-10-05T08:57:49.255+0100 [conn1432051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:49.813+0100 [conn1431688] end connection 172.28.0.163:51125 (399 connections now open) 2015-10-05T08:57:49.814+0100 [mongosMain] connection accepted from 172.28.0.163:52205 #1432052 (400 connections now open) 2015-10-05T08:57:49.815+0100 [conn1432052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:52.183+0100 [conn1431699] end connection 172.28.0.164:60482 (399 connections now open) 2015-10-05T08:57:52.185+0100 [mongosMain] connection accepted from 172.28.0.164:61500 #1432053 (400 connections now open) 2015-10-05T08:57:52.186+0100 [conn1432053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:52.684+0100 [conn1431288] end connection 172.28.0.164:59309 (399 connections now open) 2015-10-05T08:57:52.685+0100 [mongosMain] connection accepted from 172.28.0.164:61504 #1432054 (400 connections now open) 2015-10-05T08:57:52.686+0100 [conn1432054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:52.999+0100 [conn1431638] end connection 172.28.0.163:51013 (399 connections now open) 2015-10-05T08:57:53.002+0100 [mongosMain] connection accepted from 172.28.0.163:52209 #1432055 (400 connections now open) 2015-10-05T08:57:53.003+0100 [conn1432055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:53.344+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:57:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:57:56.073+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:57:56.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:57:59.254+0100 [conn1431695] end connection 172.28.0.163:51133 (399 connections now open) 2015-10-05T08:57:59.255+0100 [mongosMain] connection accepted from 172.28.0.163:52218 #1432056 (400 connections now open) 2015-10-05T08:57:59.256+0100 [conn1432056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:57:59.830+0100 [conn1431706] end connection 172.28.0.163:51153 (399 connections now open) 2015-10-05T08:57:59.832+0100 [mongosMain] connection accepted from 172.28.0.163:52220 #1432057 (400 connections now open) 2015-10-05T08:57:59.834+0100 [conn1432057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:01.577+0100 [conn1431698] end connection 172.28.0.164:60480 (399 connections now open) 2015-10-05T08:58:01.578+0100 [mongosMain] connection accepted from 172.28.0.164:61508 #1432058 (400 connections now open) 2015-10-05T08:58:01.582+0100 [conn1432058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:02.259+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:58:02.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:58:03.104+0100 [conn1431332] end connection 172.28.0.164:59434 (399 connections now open) 2015-10-05T08:58:03.106+0100 [mongosMain] connection accepted from 172.28.0.164:61514 #1432059 (400 connections now open) 2015-10-05T08:58:03.108+0100 [conn1432059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:03.371+0100 [conn1431676] end connection 172.28.0.163:51101 (399 connections now open) 2015-10-05T08:58:03.372+0100 [mongosMain] connection accepted from 172.28.0.163:52228 #1432060 (400 connections now open) 2015-10-05T08:58:03.373+0100 [conn1432060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:08.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122d905703b51053ee69f8 2015-10-05T08:58:08.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:58:09.845+0100 [conn1431696] end connection 172.28.0.163:51134 (399 connections now open) 2015-10-05T08:58:09.847+0100 [mongosMain] connection accepted from 172.28.0.163:52251 #1432061 (400 connections now open) 2015-10-05T08:58:09.847+0100 [conn1432061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:11.592+0100 [conn1431674] end connection 172.28.0.164:60424 (399 connections now open) 2015-10-05T08:58:11.593+0100 [mongosMain] connection accepted from 172.28.0.164:61525 #1432062 (400 connections now open) 2015-10-05T08:58:11.595+0100 [conn1432062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:12.215+0100 [conn1431715] end connection 172.28.0.164:60518 (399 connections now open) 2015-10-05T08:58:12.216+0100 [mongosMain] connection accepted from 172.28.0.164:61527 #1432063 (400 connections now open) 2015-10-05T08:58:12.218+0100 [conn1432063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:13.089+0100 [conn1431587] end connection 172.28.0.164:60216 (399 connections now open) 2015-10-05T08:58:13.089+0100 [mongosMain] connection accepted from 172.28.0.164:61531 #1432064 (400 connections now open) 2015-10-05T08:58:13.091+0100 [conn1432064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:13.348+0100 [conn1431709] end connection 172.28.0.163:51158 (399 connections now open) 2015-10-05T08:58:13.349+0100 [mongosMain] connection accepted from 172.28.0.163:52258 #1432065 (400 connections now open) 2015-10-05T08:58:13.350+0100 [conn1432065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:19.846+0100 [conn1431713] end connection 172.28.0.163:51170 (399 connections now open) 2015-10-05T08:58:19.848+0100 [mongosMain] connection accepted from 172.28.0.163:52267 #1432066 (400 connections now open) 2015-10-05T08:58:19.849+0100 [conn1432066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:21.593+0100 [conn1431681] end connection 172.28.0.164:60437 (399 connections now open) 2015-10-05T08:58:21.594+0100 [mongosMain] connection accepted from 172.28.0.164:61541 #1432067 (400 connections now open) 2015-10-05T08:58:21.595+0100 [conn1432067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:22.214+0100 [conn1431708] end connection 172.28.0.164:60502 (399 connections now open) 2015-10-05T08:58:22.216+0100 [mongosMain] connection accepted from 172.28.0.164:61543 #1432068 (400 connections now open) 2015-10-05T08:58:22.217+0100 [conn1432068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:23.104+0100 [conn1431717] end connection 172.28.0.164:60531 (399 connections now open) 2015-10-05T08:58:23.104+0100 [conn1431000] end connection 172.28.0.164:58463 (398 connections now open) 2015-10-05T08:58:23.105+0100 [mongosMain] connection accepted from 172.28.0.164:61547 #1432069 (399 connections now open) 2015-10-05T08:58:23.106+0100 [mongosMain] connection accepted from 172.28.0.164:61548 #1432070 (400 connections now open) 2015-10-05T08:58:23.106+0100 [conn1432069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:23.107+0100 [conn1432070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:23.355+0100 [conn1431716] end connection 172.28.0.163:51183 (399 connections now open) 2015-10-05T08:58:23.355+0100 [conn1431722] end connection 172.28.0.163:51203 (399 connections now open) 2015-10-05T08:58:23.356+0100 [mongosMain] connection accepted from 172.28.0.163:52273 #1432071 (399 connections now open) 2015-10-05T08:58:23.356+0100 [mongosMain] connection accepted from 172.28.0.163:52274 #1432072 (400 connections now open) 2015-10-05T08:58:23.357+0100 [conn1432071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:23.357+0100 [conn1432072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:23.477+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:58:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:58:26.993+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:58:26.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:58:28.904+0100 [mongosMain] connection accepted from 127.0.0.1:52275 #1432073 (401 connections now open) 2015-10-05T08:58:28.906+0100 [conn1432073] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:28.912+0100 [conn1432073] end connection 127.0.0.1:52275 (400 connections now open) 2015-10-05T08:58:29.861+0100 [conn1431720] end connection 172.28.0.163:51200 (399 connections now open) 2015-10-05T08:58:29.862+0100 [mongosMain] connection accepted from 172.28.0.163:52276 #1432074 (400 connections now open) 2015-10-05T08:58:29.863+0100 [conn1432074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:31.607+0100 [conn1431667] end connection 172.28.0.164:60405 (399 connections now open) 2015-10-05T08:58:31.608+0100 [mongosMain] connection accepted from 172.28.0.164:61559 #1432075 (400 connections now open) 2015-10-05T08:58:31.610+0100 [conn1432075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:32.233+0100 [conn1431721] end connection 172.28.0.164:60536 (399 connections now open) 2015-10-05T08:58:32.233+0100 [mongosMain] connection accepted from 172.28.0.164:61561 #1432076 (400 connections now open) 2015-10-05T08:58:32.235+0100 [conn1432076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:33.106+0100 [conn1431710] end connection 172.28.0.164:60507 (399 connections now open) 2015-10-05T08:58:33.107+0100 [mongosMain] connection accepted from 172.28.0.164:61567 #1432077 (400 connections now open) 2015-10-05T08:58:33.108+0100 [conn1432077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:33.372+0100 [conn1431692] end connection 172.28.0.163:51128 (399 connections now open) 2015-10-05T08:58:33.372+0100 [conn1431592] end connection 172.28.0.163:50898 (398 connections now open) 2015-10-05T08:58:33.373+0100 [mongosMain] connection accepted from 172.28.0.163:52279 #1432078 (399 connections now open) 2015-10-05T08:58:33.373+0100 [mongosMain] connection accepted from 172.28.0.163:52280 #1432079 (400 connections now open) 2015-10-05T08:58:33.373+0100 [conn1432078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:33.374+0100 [conn1432079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:39.713+0100 [mongosMain] connection accepted from 127.0.0.1:52283 #1432080 (401 connections now open) 2015-10-05T08:58:39.715+0100 [conn1432080] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:39.720+0100 [conn1432080] end connection 127.0.0.1:52283 (400 connections now open) 2015-10-05T08:58:39.862+0100 [conn1431725] end connection 172.28.0.163:51212 (399 connections now open) 2015-10-05T08:58:39.863+0100 [mongosMain] connection accepted from 172.28.0.163:52284 #1432081 (400 connections now open) 2015-10-05T08:58:39.864+0100 [conn1432081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:41.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122daf5703b51053ee6bfc 2015-10-05T08:58:41.607+0100 [conn1431714] end connection 172.28.0.164:60512 (399 connections now open) 2015-10-05T08:58:41.609+0100 [mongosMain] connection accepted from 172.28.0.164:61580 #1432082 (400 connections now open) 2015-10-05T08:58:41.610+0100 [conn1432082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:41.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:58:42.230+0100 [conn1431726] end connection 172.28.0.164:60555 (399 connections now open) 2015-10-05T08:58:42.231+0100 [mongosMain] connection accepted from 172.28.0.164:61587 #1432083 (400 connections now open) 2015-10-05T08:58:42.232+0100 [conn1432083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:43.119+0100 [conn1431648] end connection 172.28.0.164:60361 (399 connections now open) 2015-10-05T08:58:43.120+0100 [mongosMain] connection accepted from 172.28.0.164:61600 #1432084 (400 connections now open) 2015-10-05T08:58:43.121+0100 [conn1432084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:43.378+0100 [conn1431683] end connection 172.28.0.163:51118 (399 connections now open) 2015-10-05T08:58:43.379+0100 [mongosMain] connection accepted from 172.28.0.163:52291 #1432085 (400 connections now open) 2015-10-05T08:58:43.380+0100 [conn1432085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:47.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122db75703b51053ee6c9d 2015-10-05T08:58:47.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:58:49.878+0100 [conn1431732] end connection 172.28.0.163:51222 (399 connections now open) 2015-10-05T08:58:49.879+0100 [mongosMain] connection accepted from 172.28.0.163:52304 #1432086 (400 connections now open) 2015-10-05T08:58:49.880+0100 [conn1432086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:51.622+0100 [conn1431653] end connection 172.28.0.164:60371 (399 connections now open) 2015-10-05T08:58:51.624+0100 [mongosMain] connection accepted from 172.28.0.164:61613 #1432087 (400 connections now open) 2015-10-05T08:58:51.625+0100 [conn1432087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:52.247+0100 [conn1431734] end connection 172.28.0.164:60573 (399 connections now open) 2015-10-05T08:58:52.248+0100 [mongosMain] connection accepted from 172.28.0.164:61615 #1432088 (400 connections now open) 2015-10-05T08:58:52.249+0100 [conn1432088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:53.136+0100 [conn1431686] end connection 172.28.0.164:60452 (399 connections now open) 2015-10-05T08:58:53.137+0100 [mongosMain] connection accepted from 172.28.0.164:61619 #1432089 (400 connections now open) 2015-10-05T08:58:53.138+0100 [conn1432089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:53.387+0100 [conn1431632] end connection 172.28.0.163:50994 (399 connections now open) 2015-10-05T08:58:53.388+0100 [mongosMain] connection accepted from 172.28.0.163:52312 #1432090 (400 connections now open) 2015-10-05T08:58:53.389+0100 [conn1432090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:58:53.619+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:58:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:58:59.878+0100 [conn1431745] end connection 172.28.0.163:51244 (399 connections now open) 2015-10-05T08:58:59.879+0100 [mongosMain] connection accepted from 172.28.0.163:52319 #1432091 (400 connections now open) 2015-10-05T08:58:59.880+0100 [conn1432091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:01.906+0100 [conn1431689] end connection 172.28.0.164:60456 (399 connections now open) 2015-10-05T08:59:01.907+0100 [mongosMain] connection accepted from 172.28.0.164:61623 #1432092 (400 connections now open) 2015-10-05T08:59:01.911+0100 [conn1432092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:03.137+0100 [conn1431694] end connection 172.28.0.164:60471 (399 connections now open) 2015-10-05T08:59:03.138+0100 [mongosMain] connection accepted from 172.28.0.164:61628 #1432093 (400 connections now open) 2015-10-05T08:59:03.145+0100 [conn1432093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:03.635+0100 [conn1431646] end connection 172.28.0.163:51021 (399 connections now open) 2015-10-05T08:59:03.636+0100 [mongosMain] connection accepted from 172.28.0.163:52330 #1432094 (400 connections now open) 2015-10-05T08:59:03.637+0100 [conn1432094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:09.893+0100 [conn1431750] end connection 172.28.0.163:51257 (399 connections now open) 2015-10-05T08:59:09.894+0100 [mongosMain] connection accepted from 172.28.0.163:52348 #1432095 (400 connections now open) 2015-10-05T08:59:09.895+0100 [conn1432095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:11.639+0100 [conn1431733] end connection 172.28.0.164:60571 (399 connections now open) 2015-10-05T08:59:11.640+0100 [mongosMain] connection accepted from 172.28.0.164:61645 #1432096 (400 connections now open) 2015-10-05T08:59:11.641+0100 [conn1432096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:12.174+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:59:12.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:59:12.265+0100 [conn1431741] end connection 172.28.0.164:60593 (399 connections now open) 2015-10-05T08:59:12.266+0100 [mongosMain] connection accepted from 172.28.0.164:61647 #1432097 (400 connections now open) 2015-10-05T08:59:12.271+0100 [conn1432097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:13.603+0100 [conn1431664] end connection 172.28.0.164:60400 (399 connections now open) 2015-10-05T08:59:13.692+0100 [mongosMain] connection accepted from 172.28.0.164:61652 #1432098 (400 connections now open) 2015-10-05T08:59:13.699+0100 [conn1432098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:13.743+0100 [conn1431701] end connection 172.28.0.163:51141 (399 connections now open) 2015-10-05T08:59:13.744+0100 [mongosMain] connection accepted from 172.28.0.163:52353 #1432099 (400 connections now open) 2015-10-05T08:59:13.745+0100 [conn1432099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:18.618+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T08:59:18.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T08:59:21.654+0100 [conn1431746] end connection 172.28.0.164:60610 (399 connections now open) 2015-10-05T08:59:21.655+0100 [mongosMain] connection accepted from 172.28.0.164:61665 #1432100 (400 connections now open) 2015-10-05T08:59:21.656+0100 [conn1432100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:22.277+0100 [conn1431747] end connection 172.28.0.164:60613 (399 connections now open) 2015-10-05T08:59:22.278+0100 [mongosMain] connection accepted from 172.28.0.164:61667 #1432101 (400 connections now open) 2015-10-05T08:59:22.279+0100 [conn1432101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:23.573+0100 [conn1431672] end connection 172.28.0.164:60421 (399 connections now open) 2015-10-05T08:59:23.574+0100 [mongosMain] connection accepted from 172.28.0.164:61672 #1432102 (400 connections now open) 2015-10-05T08:59:23.576+0100 [conn1432102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:23.872+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:59:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:59:24.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ddc5703b51053ee6f91 2015-10-05T08:59:25.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:59:28.363+0100 [mongosMain] connection accepted from 127.0.0.1:52368 #1432103 (401 connections now open) 2015-10-05T08:59:28.367+0100 [conn1432103] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:28.373+0100 [conn1432103] end connection 127.0.0.1:52368 (400 connections now open) 2015-10-05T08:59:31.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122de35703b51053ee701b 2015-10-05T08:59:31.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:59:31.656+0100 [conn1431707] end connection 172.28.0.164:60499 (399 connections now open) 2015-10-05T08:59:31.657+0100 [mongosMain] connection accepted from 172.28.0.164:61685 #1432104 (400 connections now open) 2015-10-05T08:59:31.658+0100 [conn1432104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:33.574+0100 [conn1431657] end connection 172.28.0.164:60384 (399 connections now open) 2015-10-05T08:59:33.575+0100 [mongosMain] connection accepted from 172.28.0.164:61689 #1432105 (400 connections now open) 2015-10-05T08:59:33.576+0100 [conn1432105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:37.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122de95703b51053ee7073 2015-10-05T08:59:37.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:59:39.290+0100 [mongosMain] connection accepted from 127.0.0.1:52382 #1432106 (401 connections now open) 2015-10-05T08:59:39.293+0100 [conn1432106] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:39.296+0100 [conn1432106] end connection 127.0.0.1:52382 (400 connections now open) 2015-10-05T08:59:43.589+0100 [conn1431634] end connection 172.28.0.164:60327 (399 connections now open) 2015-10-05T08:59:43.590+0100 [mongosMain] connection accepted from 172.28.0.164:61704 #1432107 (400 connections now open) 2015-10-05T08:59:43.592+0100 [conn1432107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:44.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122def5703b51053ee70c9 2015-10-05T08:59:44.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T08:59:53.605+0100 [conn1431702] end connection 172.28.0.164:60492 (399 connections now open) 2015-10-05T08:59:53.606+0100 [mongosMain] connection accepted from 172.28.0.164:61716 #1432108 (400 connections now open) 2015-10-05T08:59:53.607+0100 [conn1432108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:53.754+0100 [conn1431727] end connection 172.28.0.163:51216 (399 connections now open) 2015-10-05T08:59:53.755+0100 [mongosMain] connection accepted from 172.28.0.163:52429 #1432109 (400 connections now open) 2015-10-05T08:59:53.756+0100 [conn1432109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T08:59:54.397+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 08:59:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T08:59:56.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122dfc5703b51053ee7175 2015-10-05T08:59:56.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:01.702+0100 [conn1431773] end connection 172.28.0.164:60698 (399 connections now open) 2015-10-05T09:00:01.703+0100 [mongosMain] connection accepted from 172.28.0.164:61725 #1432110 (400 connections now open) 2015-10-05T09:00:01.707+0100 [conn1432110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:03.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e025703b51053ee71ba 2015-10-05T09:00:03.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:03.761+0100 [conn1431778] end connection 172.28.0.163:51333 (399 connections now open) 2015-10-05T09:00:03.762+0100 [mongosMain] connection accepted from 172.28.0.163:52471 #1432111 (400 connections now open) 2015-10-05T09:00:03.763+0100 [conn1432111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:09.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e095703b51053ee72c1 2015-10-05T09:00:09.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:11.716+0100 [conn1431768] end connection 172.28.0.164:60681 (399 connections now open) 2015-10-05T09:00:11.717+0100 [mongosMain] connection accepted from 172.28.0.164:61748 #1432112 (400 connections now open) 2015-10-05T09:00:11.719+0100 [conn1432112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:15.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e0f5703b51053ee73b2 2015-10-05T09:00:16.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:19.379+0100 [conn1431712] end connection 172.28.0.163:51168 (399 connections now open) 2015-10-05T09:00:19.380+0100 [mongosMain] connection accepted from 172.28.0.163:52497 #1432113 (400 connections now open) 2015-10-05T09:00:19.382+0100 [conn1432113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:19.956+0100 [conn1431755] end connection 172.28.0.163:51291 (399 connections now open) 2015-10-05T09:00:19.957+0100 [mongosMain] connection accepted from 172.28.0.163:52499 #1432114 (400 connections now open) 2015-10-05T09:00:19.958+0100 [conn1432114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:22.340+0100 [conn1431759] end connection 172.28.0.164:60652 (399 connections now open) 2015-10-05T09:00:22.341+0100 [mongosMain] connection accepted from 172.28.0.164:61762 #1432115 (400 connections now open) 2015-10-05T09:00:22.345+0100 [conn1432115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:22.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e165703b51053ee7499 2015-10-05T09:00:22.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:23.698+0100 [conn1431762] end connection 172.28.0.164:60659 (399 connections now open) 2015-10-05T09:00:23.699+0100 [mongosMain] connection accepted from 172.28.0.164:61765 #1432116 (400 connections now open) 2015-10-05T09:00:23.701+0100 [conn1432116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:23.800+0100 [conn1431754] end connection 172.28.0.163:51267 (399 connections now open) 2015-10-05T09:00:23.807+0100 [mongosMain] connection accepted from 172.28.0.163:52503 #1432117 (400 connections now open) 2015-10-05T09:00:23.808+0100 [conn1432117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:24.676+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:00:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:00:28.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e1c5703b51053ee766f 2015-10-05T09:00:28.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:29.049+0100 [mongosMain] connection accepted from 127.0.0.1:52507 #1432118 (401 connections now open) 2015-10-05T09:00:29.053+0100 [conn1432118] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:29.059+0100 [conn1432118] end connection 127.0.0.1:52507 (400 connections now open) 2015-10-05T09:00:29.394+0100 [conn1431775] end connection 172.28.0.163:51329 (399 connections now open) 2015-10-05T09:00:29.394+0100 [mongosMain] connection accepted from 172.28.0.163:52509 #1432119 (400 connections now open) 2015-10-05T09:00:29.395+0100 [conn1432119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:29.956+0100 [conn1431786] end connection 172.28.0.163:51399 (399 connections now open) 2015-10-05T09:00:29.956+0100 [mongosMain] connection accepted from 172.28.0.163:52511 #1432120 (400 connections now open) 2015-10-05T09:00:29.957+0100 [conn1432120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:32.357+0100 [conn1431789] end connection 172.28.0.164:60753 (399 connections now open) 2015-10-05T09:00:32.357+0100 [mongosMain] connection accepted from 172.28.0.164:61782 #1432121 (400 connections now open) 2015-10-05T09:00:32.360+0100 [conn1432121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:33.715+0100 [conn1431757] end connection 172.28.0.164:60647 (399 connections now open) 2015-10-05T09:00:33.716+0100 [mongosMain] connection accepted from 172.28.0.164:61785 #1432122 (400 connections now open) 2015-10-05T09:00:33.718+0100 [conn1432122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:33.809+0100 [conn1431735] end connection 172.28.0.163:51225 (399 connections now open) 2015-10-05T09:00:33.810+0100 [mongosMain] connection accepted from 172.28.0.163:52517 #1432123 (400 connections now open) 2015-10-05T09:00:33.811+0100 [conn1432123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:35.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e225703b51053ee78b0 2015-10-05T09:00:35.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:39.398+0100 [conn1431719] end connection 172.28.0.163:51199 (399 connections now open) 2015-10-05T09:00:39.399+0100 [mongosMain] connection accepted from 172.28.0.163:52522 #1432124 (400 connections now open) 2015-10-05T09:00:39.399+0100 [conn1432124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:39.957+0100 [mongosMain] connection accepted from 127.0.0.1:52524 #1432125 (401 connections now open) 2015-10-05T09:00:39.961+0100 [conn1432125] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:39.967+0100 [conn1432125] end connection 127.0.0.1:52524 (400 connections now open) 2015-10-05T09:00:39.971+0100 [conn1431793] end connection 172.28.0.163:51405 (399 connections now open) 2015-10-05T09:00:39.972+0100 [mongosMain] connection accepted from 172.28.0.163:52525 #1432126 (400 connections now open) 2015-10-05T09:00:39.973+0100 [conn1432126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:41.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e295703b51053ee7aae 2015-10-05T09:00:41.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:42.372+0100 [conn1431796] end connection 172.28.0.164:60765 (399 connections now open) 2015-10-05T09:00:42.373+0100 [mongosMain] connection accepted from 172.28.0.164:61799 #1432127 (400 connections now open) 2015-10-05T09:00:42.375+0100 [conn1432127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:43.811+0100 [conn1431776] end connection 172.28.0.164:60707 (399 connections now open) 2015-10-05T09:00:43.812+0100 [mongosMain] connection accepted from 172.28.0.164:61803 #1432128 (400 connections now open) 2015-10-05T09:00:43.814+0100 [conn1432128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:45.850+0100 [conn1431784] end connection 172.28.0.163:51388 (399 connections now open) 2015-10-05T09:00:45.876+0100 [mongosMain] connection accepted from 172.28.0.163:52535 #1432129 (400 connections now open) 2015-10-05T09:00:45.877+0100 [conn1432129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:49.410+0100 [conn1431761] end connection 172.28.0.163:51302 (399 connections now open) 2015-10-05T09:00:49.411+0100 [mongosMain] connection accepted from 172.28.0.163:52545 #1432130 (400 connections now open) 2015-10-05T09:00:49.413+0100 [conn1432130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:49.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e2f5703b51053ee7bbf 2015-10-05T09:00:49.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:51.764+0100 [conn1431753] end connection 172.28.0.164:60627 (399 connections now open) 2015-10-05T09:00:51.766+0100 [mongosMain] connection accepted from 172.28.0.164:61822 #1432131 (400 connections now open) 2015-10-05T09:00:51.768+0100 [conn1432131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:52.388+0100 [conn1431803] end connection 172.28.0.164:60784 (399 connections now open) 2015-10-05T09:00:52.389+0100 [mongosMain] connection accepted from 172.28.0.164:61824 #1432132 (400 connections now open) 2015-10-05T09:00:52.392+0100 [conn1432132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:53.886+0100 [conn1431780] end connection 172.28.0.164:60716 (399 connections now open) 2015-10-05T09:00:53.887+0100 [mongosMain] connection accepted from 172.28.0.164:61830 #1432133 (400 connections now open) 2015-10-05T09:00:53.892+0100 [conn1432133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:55.421+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:00:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:00:56.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e375703b51053ee7d36 2015-10-05T09:00:56.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:00:56.879+0100 [conn1431748] end connection 172.28.0.163:51251 (399 connections now open) 2015-10-05T09:00:56.893+0100 [mongosMain] connection accepted from 172.28.0.163:52557 #1432134 (400 connections now open) 2015-10-05T09:00:56.894+0100 [conn1432134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:59.704+0100 [conn1431529] end connection 172.28.0.163:50718 (399 connections now open) 2015-10-05T09:00:59.705+0100 [mongosMain] connection accepted from 172.28.0.163:52561 #1432135 (400 connections now open) 2015-10-05T09:00:59.706+0100 [conn1432135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:00:59.986+0100 [conn1431806] end connection 172.28.0.163:51435 (399 connections now open) 2015-10-05T09:00:59.987+0100 [mongosMain] connection accepted from 172.28.0.163:52563 #1432136 (400 connections now open) 2015-10-05T09:00:59.988+0100 [conn1432136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:01.792+0100 [conn1431802] end connection 172.28.0.164:60782 (399 connections now open) 2015-10-05T09:01:01.802+0100 [mongosMain] connection accepted from 172.28.0.164:61835 #1432137 (400 connections now open) 2015-10-05T09:01:01.804+0100 [conn1432137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:02.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e3e5703b51053ee7e12 2015-10-05T09:01:02.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:03.886+0100 [conn1431751] end connection 172.28.0.164:60620 (399 connections now open) 2015-10-05T09:01:03.887+0100 [mongosMain] connection accepted from 172.28.0.164:61839 #1432138 (400 connections now open) 2015-10-05T09:01:03.889+0100 [conn1432138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:06.860+0100 [conn1431764] end connection 172.28.0.163:51308 (399 connections now open) 2015-10-05T09:01:06.865+0100 [mongosMain] connection accepted from 172.28.0.163:52584 #1432139 (400 connections now open) 2015-10-05T09:01:06.870+0100 [conn1432139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:09.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e445703b51053ee80a0 2015-10-05T09:01:09.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:09.426+0100 [conn1431782] end connection 172.28.0.163:51382 (399 connections now open) 2015-10-05T09:01:09.427+0100 [mongosMain] connection accepted from 172.28.0.163:52588 #1432140 (400 connections now open) 2015-10-05T09:01:09.428+0100 [conn1432140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:11.795+0100 [conn1431758] end connection 172.28.0.164:60650 (399 connections now open) 2015-10-05T09:01:11.796+0100 [mongosMain] connection accepted from 172.28.0.164:61866 #1432141 (400 connections now open) 2015-10-05T09:01:11.797+0100 [conn1432141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:12.404+0100 [conn1431809] end connection 172.28.0.164:60796 (399 connections now open) 2015-10-05T09:01:12.405+0100 [mongosMain] connection accepted from 172.28.0.164:61868 #1432142 (400 connections now open) 2015-10-05T09:01:12.406+0100 [conn1432142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:13.902+0100 [conn1431783] end connection 172.28.0.164:60735 (399 connections now open) 2015-10-05T09:01:13.904+0100 [mongosMain] connection accepted from 172.28.0.164:61869 #1432143 (400 connections now open) 2015-10-05T09:01:13.914+0100 [conn1432143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:15.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e4b5703b51053ee8293 2015-10-05T09:01:15.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:19.005+0100 [conn1431742] end connection 172.28.0.163:51232 (399 connections now open) 2015-10-05T09:01:19.022+0100 [mongosMain] connection accepted from 172.28.0.163:52600 #1432144 (400 connections now open) 2015-10-05T09:01:19.024+0100 [conn1432144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:19.434+0100 [conn1431749] end connection 172.28.0.163:51255 (399 connections now open) 2015-10-05T09:01:19.469+0100 [mongosMain] connection accepted from 172.28.0.163:52604 #1432145 (400 connections now open) 2015-10-05T09:01:19.482+0100 [conn1432145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:20.036+0100 [conn1431799] end connection 172.28.0.163:51417 (399 connections now open) 2015-10-05T09:01:20.044+0100 [mongosMain] connection accepted from 172.28.0.163:52607 #1432146 (400 connections now open) 2015-10-05T09:01:20.073+0100 [conn1432146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:21.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e515703b51053ee83be 2015-10-05T09:01:22.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:22.419+0100 [conn1431820] end connection 172.28.0.164:60824 (399 connections now open) 2015-10-05T09:01:22.420+0100 [mongosMain] connection accepted from 172.28.0.164:61884 #1432147 (400 connections now open) 2015-10-05T09:01:22.422+0100 [conn1432147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:25.976+0100 [conn1431767] end connection 172.28.0.164:60677 (399 connections now open) 2015-10-05T09:01:25.978+0100 [mongosMain] connection accepted from 172.28.0.164:61888 #1432148 (400 connections now open) 2015-10-05T09:01:25.979+0100 [conn1432148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:26.045+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:01:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:01:28.735+0100 [mongosMain] connection accepted from 127.0.0.1:52620 #1432149 (401 connections now open) 2015-10-05T09:01:28.737+0100 [conn1432149] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:28.743+0100 [conn1432149] end connection 127.0.0.1:52620 (400 connections now open) 2015-10-05T09:01:29.004+0100 [conn1431781] end connection 172.28.0.163:51355 (399 connections now open) 2015-10-05T09:01:29.005+0100 [mongosMain] connection accepted from 172.28.0.163:52621 #1432150 (400 connections now open) 2015-10-05T09:01:29.005+0100 [conn1432150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:29.442+0100 [conn1431779] end connection 172.28.0.163:51346 (399 connections now open) 2015-10-05T09:01:29.443+0100 [mongosMain] connection accepted from 172.28.0.163:52624 #1432151 (400 connections now open) 2015-10-05T09:01:29.444+0100 [conn1432151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:30.018+0100 [conn1431813] end connection 172.28.0.163:51449 (399 connections now open) 2015-10-05T09:01:30.019+0100 [mongosMain] connection accepted from 172.28.0.163:52626 #1432152 (400 connections now open) 2015-10-05T09:01:30.020+0100 [conn1432152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:32.441+0100 [mongosMain] connection accepted from 172.28.0.164:61911 #1432153 (401 connections now open) 2015-10-05T09:01:32.441+0100 [conn1431824] end connection 172.28.0.164:60835 (400 connections now open) 2015-10-05T09:01:32.443+0100 [conn1432153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:35.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e5f5703b51053ee86e4 2015-10-05T09:01:35.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:36.360+0100 [conn1431678] end connection 172.28.0.164:60430 (399 connections now open) 2015-10-05T09:01:36.363+0100 [mongosMain] connection accepted from 172.28.0.164:61915 #1432154 (400 connections now open) 2015-10-05T09:01:36.380+0100 [conn1432154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:39.021+0100 [conn1431769] end connection 172.28.0.163:51313 (399 connections now open) 2015-10-05T09:01:39.023+0100 [mongosMain] connection accepted from 172.28.0.163:52630 #1432155 (400 connections now open) 2015-10-05T09:01:39.025+0100 [conn1432155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:39.456+0100 [conn1431766] end connection 172.28.0.163:51311 (399 connections now open) 2015-10-05T09:01:39.457+0100 [mongosMain] connection accepted from 172.28.0.163:52632 #1432156 (400 connections now open) 2015-10-05T09:01:39.458+0100 [conn1432156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:39.735+0100 [mongosMain] connection accepted from 127.0.0.1:52634 #1432157 (401 connections now open) 2015-10-05T09:01:39.738+0100 [conn1432157] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:39.743+0100 [conn1432157] end connection 127.0.0.1:52634 (400 connections now open) 2015-10-05T09:01:40.018+0100 [conn1431828] end connection 172.28.0.163:51515 (399 connections now open) 2015-10-05T09:01:40.019+0100 [mongosMain] connection accepted from 172.28.0.163:52635 #1432158 (400 connections now open) 2015-10-05T09:01:40.020+0100 [conn1432158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:41.678+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122e6203838a4537162cd4') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032101613), why: "doing balance round", ts: ObjectId('56122e655703b51053ee88af') } } gle1: { lastOp: Timestamp 1444032095000|8, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444032101000|4, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2015-10-05T09:01:41.686+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:01:41.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e655703b51053ee88af 2015-10-05T09:01:41.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:42.450+0100 [conn1431830] end connection 172.28.0.164:60854 (399 connections now open) 2015-10-05T09:01:42.451+0100 [mongosMain] connection accepted from 172.28.0.164:61929 #1432159 (400 connections now open) 2015-10-05T09:01:42.453+0100 [conn1432159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:46.368+0100 [conn1431552] end connection 172.28.0.164:60125 (399 connections now open) 2015-10-05T09:01:46.369+0100 [mongosMain] connection accepted from 172.28.0.164:61933 #1432160 (400 connections now open) 2015-10-05T09:01:46.371+0100 [conn1432160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:49.021+0100 [conn1431774] end connection 172.28.0.163:51323 (399 connections now open) 2015-10-05T09:01:49.021+0100 [mongosMain] connection accepted from 172.28.0.163:52649 #1432161 (400 connections now open) 2015-10-05T09:01:49.022+0100 [conn1432161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:49.458+0100 [conn1431705] end connection 172.28.0.163:51151 (399 connections now open) 2015-10-05T09:01:49.459+0100 [mongosMain] connection accepted from 172.28.0.163:52651 #1432162 (400 connections now open) 2015-10-05T09:01:49.460+0100 [conn1432162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:50.035+0100 [conn1431832] end connection 172.28.0.163:51522 (399 connections now open) 2015-10-05T09:01:50.036+0100 [mongosMain] connection accepted from 172.28.0.163:52654 #1432163 (400 connections now open) 2015-10-05T09:01:50.038+0100 [conn1432163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:52.467+0100 [conn1431835] end connection 172.28.0.164:60870 (399 connections now open) 2015-10-05T09:01:52.468+0100 [mongosMain] connection accepted from 172.28.0.164:61940 #1432164 (400 connections now open) 2015-10-05T09:01:52.470+0100 [conn1432164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:54.133+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e715703b51053ee8bd2 2015-10-05T09:01:54.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:01:56.214+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:01:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:01:57.305+0100 [conn1431743] end connection 172.28.0.164:60606 (399 connections now open) 2015-10-05T09:01:57.321+0100 [mongosMain] connection accepted from 172.28.0.164:61946 #1432165 (400 connections now open) 2015-10-05T09:01:57.325+0100 [conn1432165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:59.474+0100 [conn1431792] end connection 172.28.0.163:51403 (399 connections now open) 2015-10-05T09:01:59.475+0100 [mongosMain] connection accepted from 172.28.0.163:52665 #1432166 (400 connections now open) 2015-10-05T09:01:59.476+0100 [conn1432166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:01:59.923+0100 [conn1431797] end connection 172.28.0.163:51411 (399 connections now open) 2015-10-05T09:01:59.926+0100 [mongosMain] connection accepted from 172.28.0.163:52667 #1432167 (400 connections now open) 2015-10-05T09:01:59.927+0100 [conn1432167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:00.047+0100 [conn1431837] end connection 172.28.0.163:51540 (399 connections now open) 2015-10-05T09:02:00.049+0100 [mongosMain] connection accepted from 172.28.0.163:52669 #1432168 (400 connections now open) 2015-10-05T09:02:00.050+0100 [conn1432168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:01.874+0100 [conn1431795] end connection 172.28.0.164:60763 (399 connections now open) 2015-10-05T09:02:01.875+0100 [mongosMain] connection accepted from 172.28.0.164:61949 #1432169 (400 connections now open) 2015-10-05T09:02:01.877+0100 [conn1432169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:02.509+0100 [conn1431839] end connection 172.28.0.164:60884 (399 connections now open) 2015-10-05T09:02:02.515+0100 [mongosMain] connection accepted from 172.28.0.164:61951 #1432170 (400 connections now open) 2015-10-05T09:02:02.517+0100 [conn1432170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:07.273+0100 [conn1431729] end connection 172.28.0.164:60566 (399 connections now open) 2015-10-05T09:02:07.274+0100 [mongosMain] connection accepted from 172.28.0.164:61963 #1432171 (400 connections now open) 2015-10-05T09:02:07.276+0100 [conn1432171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:09.474+0100 [conn1431785] end connection 172.28.0.163:51398 (399 connections now open) 2015-10-05T09:02:09.474+0100 [mongosMain] connection accepted from 172.28.0.163:52696 #1432172 (400 connections now open) 2015-10-05T09:02:09.475+0100 [conn1432172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:10.050+0100 [conn1431841] end connection 172.28.0.163:51553 (399 connections now open) 2015-10-05T09:02:10.052+0100 [mongosMain] connection accepted from 172.28.0.163:52700 #1432173 (400 connections now open) 2015-10-05T09:02:10.053+0100 [conn1432173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:12.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e845703b51053ee8f3a 2015-10-05T09:02:12.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:02:18.689+0100 [mongosMain] connection accepted from 172.28.0.164:61972 #1432174 (401 connections now open) 2015-10-05T09:02:18.690+0100 [conn1431794] end connection 172.28.0.164:60761 (400 connections now open) 2015-10-05T09:02:18.718+0100 [conn1432174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:18.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e8a5703b51053ee906e 2015-10-05T09:02:18.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:02:19.488+0100 [conn1431798] end connection 172.28.0.163:51415 (399 connections now open) 2015-10-05T09:02:19.489+0100 [mongosMain] connection accepted from 172.28.0.163:52712 #1432175 (400 connections now open) 2015-10-05T09:02:19.490+0100 [conn1432175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:20.066+0100 [conn1431846] end connection 172.28.0.163:51587 (399 connections now open) 2015-10-05T09:02:20.068+0100 [mongosMain] connection accepted from 172.28.0.163:52715 #1432176 (400 connections now open) 2015-10-05T09:02:20.069+0100 [conn1432176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:22.513+0100 [conn1431848] end connection 172.28.0.164:60915 (399 connections now open) 2015-10-05T09:02:22.514+0100 [mongosMain] connection accepted from 172.28.0.164:61988 #1432177 (400 connections now open) 2015-10-05T09:02:22.515+0100 [conn1432177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:25.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122e905703b51053ee916c 2015-10-05T09:02:25.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:02:27.408+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:02:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:02:27.465+0100 [mongosMain] connection accepted from 172.28.0.164:61996 #1432178 (401 connections now open) 2015-10-05T09:02:27.467+0100 [conn1431807] end connection 172.28.0.164:60792 (400 connections now open) 2015-10-05T09:02:27.474+0100 [conn1432178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:28.212+0100 [mongosMain] connection accepted from 127.0.0.1:52723 #1432179 (401 connections now open) 2015-10-05T09:02:28.214+0100 [conn1432179] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:28.221+0100 [conn1432179] end connection 127.0.0.1:52723 (400 connections now open) 2015-10-05T09:02:29.490+0100 [conn1431730] end connection 172.28.0.163:51219 (399 connections now open) 2015-10-05T09:02:29.491+0100 [mongosMain] connection accepted from 172.28.0.163:52725 #1432180 (400 connections now open) 2015-10-05T09:02:29.492+0100 [conn1432180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:30.067+0100 [conn1431851] end connection 172.28.0.163:51606 (399 connections now open) 2015-10-05T09:02:30.068+0100 [mongosMain] connection accepted from 172.28.0.163:52727 #1432181 (400 connections now open) 2015-10-05T09:02:30.069+0100 [conn1432181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:31.906+0100 [conn1431763] end connection 172.28.0.164:60661 (399 connections now open) 2015-10-05T09:02:31.907+0100 [mongosMain] connection accepted from 172.28.0.164:62004 #1432182 (400 connections now open) 2015-10-05T09:02:31.912+0100 [conn1432182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:32.530+0100 [conn1431843] end connection 172.28.0.164:60901 (399 connections now open) 2015-10-05T09:02:32.531+0100 [mongosMain] connection accepted from 172.28.0.164:62006 #1432183 (400 connections now open) 2015-10-05T09:02:32.533+0100 [conn1432183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:37.465+0100 [conn1431819] end connection 172.28.0.164:60822 (399 connections now open) 2015-10-05T09:02:37.466+0100 [mongosMain] connection accepted from 172.28.0.164:62014 #1432184 (400 connections now open) 2015-10-05T09:02:37.506+0100 [conn1432184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:39.505+0100 [conn1431738] end connection 172.28.0.163:51228 (399 connections now open) 2015-10-05T09:02:39.506+0100 [mongosMain] connection accepted from 172.28.0.163:52736 #1432185 (400 connections now open) 2015-10-05T09:02:39.507+0100 [conn1432185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:39.683+0100 [mongosMain] connection accepted from 127.0.0.1:52738 #1432186 (401 connections now open) 2015-10-05T09:02:39.685+0100 [conn1432186] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:39.688+0100 [conn1432186] end connection 127.0.0.1:52738 (400 connections now open) 2015-10-05T09:02:40.082+0100 [conn1431856] end connection 172.28.0.163:51639 (399 connections now open) 2015-10-05T09:02:40.083+0100 [mongosMain] connection accepted from 172.28.0.163:52741 #1432187 (400 connections now open) 2015-10-05T09:02:40.084+0100 [conn1432187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:41.921+0100 [conn1431808] end connection 172.28.0.164:60794 (399 connections now open) 2015-10-05T09:02:41.922+0100 [mongosMain] connection accepted from 172.28.0.164:62024 #1432188 (400 connections now open) 2015-10-05T09:02:41.924+0100 [conn1432188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:42.546+0100 [conn1431853] end connection 172.28.0.164:60925 (399 connections now open) 2015-10-05T09:02:42.547+0100 [mongosMain] connection accepted from 172.28.0.164:62027 #1432189 (400 connections now open) 2015-10-05T09:02:42.551+0100 [conn1432189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:44.047+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:02:44.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:02:47.480+0100 [conn1431723] end connection 172.28.0.164:60542 (399 connections now open) 2015-10-05T09:02:47.481+0100 [mongosMain] connection accepted from 172.28.0.164:62035 #1432190 (400 connections now open) 2015-10-05T09:02:47.483+0100 [conn1432190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:49.520+0100 [conn1431812] end connection 172.28.0.163:51447 (399 connections now open) 2015-10-05T09:02:49.521+0100 [mongosMain] connection accepted from 172.28.0.163:52755 #1432191 (400 connections now open) 2015-10-05T09:02:49.522+0100 [conn1432191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:49.988+0100 [conn1431849] end connection 172.28.0.163:51593 (399 connections now open) 2015-10-05T09:02:49.990+0100 [mongosMain] connection accepted from 172.28.0.163:52758 #1432192 (400 connections now open) 2015-10-05T09:02:49.991+0100 [conn1432192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:50.082+0100 [conn1431861] end connection 172.28.0.163:51650 (399 connections now open) 2015-10-05T09:02:50.084+0100 [mongosMain] connection accepted from 172.28.0.163:52761 #1432193 (400 connections now open) 2015-10-05T09:02:50.085+0100 [conn1432193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:51.937+0100 [conn1431777] end connection 172.28.0.164:60708 (399 connections now open) 2015-10-05T09:02:51.939+0100 [mongosMain] connection accepted from 172.28.0.164:62041 #1432194 (400 connections now open) 2015-10-05T09:02:51.941+0100 [conn1432194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:52.561+0100 [conn1431859] end connection 172.28.0.164:60947 (399 connections now open) 2015-10-05T09:02:52.561+0100 [mongosMain] connection accepted from 172.28.0.164:62043 #1432195 (400 connections now open) 2015-10-05T09:02:52.562+0100 [conn1432195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:57.067+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122eb05703b51053ee94b0 2015-10-05T09:02:57.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:02:57.613+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:02:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:02:59.417+0100 [conn1431787] end connection 172.28.0.164:60747 (399 connections now open) 2015-10-05T09:02:59.523+0100 [conn1431805] end connection 172.28.0.163:51431 (398 connections now open) 2015-10-05T09:02:59.524+0100 [mongosMain] connection accepted from 172.28.0.163:52777 #1432196 (399 connections now open) 2015-10-05T09:02:59.526+0100 [conn1432196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:59.573+0100 [conn1431711] end connection 172.28.0.164:60510 (398 connections now open) 2015-10-05T09:02:59.582+0100 [mongosMain] connection accepted from 172.28.0.164:62047 #1432197 (399 connections now open) 2015-10-05T09:02:59.582+0100 [mongosMain] connection accepted from 172.28.0.164:62048 #1432198 (400 connections now open) 2015-10-05T09:02:59.588+0100 [conn1432197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:02:59.589+0100 [conn1432198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:00.099+0100 [conn1431867] end connection 172.28.0.163:51665 (399 connections now open) 2015-10-05T09:03:00.102+0100 [mongosMain] connection accepted from 172.28.0.163:52780 #1432199 (400 connections now open) 2015-10-05T09:03:00.103+0100 [conn1432199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:01.953+0100 [conn1431739] end connection 172.28.0.164:60588 (399 connections now open) 2015-10-05T09:03:01.954+0100 [mongosMain] connection accepted from 172.28.0.164:62054 #1432200 (400 connections now open) 2015-10-05T09:03:01.956+0100 [conn1432200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:03.451+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122eb75703b51053ee94d3 2015-10-05T09:03:03.519+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:03:09.415+0100 [conn1431294] end connection 172.28.0.164:59325 (399 connections now open) 2015-10-05T09:03:09.415+0100 [conn1431842] end connection 172.28.0.164:60892 (398 connections now open) 2015-10-05T09:03:09.417+0100 [mongosMain] connection accepted from 172.28.0.164:62064 #1432201 (399 connections now open) 2015-10-05T09:03:09.417+0100 [mongosMain] connection accepted from 172.28.0.164:62063 #1432202 (400 connections now open) 2015-10-05T09:03:09.419+0100 [conn1432201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:09.419+0100 [conn1432202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:09.536+0100 [conn1431822] end connection 172.28.0.163:51498 (399 connections now open) 2015-10-05T09:03:09.538+0100 [mongosMain] connection accepted from 172.28.0.163:52808 #1432203 (400 connections now open) 2015-10-05T09:03:09.539+0100 [conn1432203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:10.097+0100 [conn1431871] end connection 172.28.0.163:51680 (399 connections now open) 2015-10-05T09:03:10.098+0100 [mongosMain] connection accepted from 172.28.0.163:52811 #1432204 (400 connections now open) 2015-10-05T09:03:10.099+0100 [conn1432204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:10.990+0100 [conn1431844] end connection 172.28.0.163:51573 (399 connections now open) 2015-10-05T09:03:10.991+0100 [mongosMain] connection accepted from 172.28.0.163:52813 #1432205 (400 connections now open) 2015-10-05T09:03:10.992+0100 [conn1432205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:11.953+0100 [conn1431858] end connection 172.28.0.164:60945 (399 connections now open) 2015-10-05T09:03:11.955+0100 [mongosMain] connection accepted from 172.28.0.164:62065 #1432206 (400 connections now open) 2015-10-05T09:03:11.956+0100 [conn1432206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:12.577+0100 [conn1431865] end connection 172.28.0.164:60969 (399 connections now open) 2015-10-05T09:03:12.578+0100 [mongosMain] connection accepted from 172.28.0.164:62067 #1432207 (400 connections now open) 2015-10-05T09:03:12.579+0100 [conn1432207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:19.426+0100 [conn1431635] end connection 172.28.0.164:60328 (399 connections now open) 2015-10-05T09:03:19.426+0100 [conn1431847] end connection 172.28.0.164:60913 (398 connections now open) 2015-10-05T09:03:19.426+0100 [mongosMain] connection accepted from 172.28.0.164:62072 #1432208 (400 connections now open) 2015-10-05T09:03:19.427+0100 [mongosMain] connection accepted from 172.28.0.164:62073 #1432209 (400 connections now open) 2015-10-05T09:03:19.428+0100 [conn1432208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:19.428+0100 [conn1432209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:19.538+0100 [conn1431831] end connection 172.28.0.163:51521 (399 connections now open) 2015-10-05T09:03:19.539+0100 [mongosMain] connection accepted from 172.28.0.163:52821 #1432210 (400 connections now open) 2015-10-05T09:03:19.540+0100 [conn1432210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:20.113+0100 [conn1431874] end connection 172.28.0.163:51716 (399 connections now open) 2015-10-05T09:03:20.114+0100 [mongosMain] connection accepted from 172.28.0.163:52823 #1432211 (400 connections now open) 2015-10-05T09:03:20.115+0100 [conn1432211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:21.016+0100 [conn1431670] end connection 172.28.0.163:51066 (399 connections now open) 2015-10-05T09:03:21.016+0100 [conn1431235] end connection 172.28.0.163:49815 (398 connections now open) 2015-10-05T09:03:21.018+0100 [mongosMain] connection accepted from 172.28.0.163:52827 #1432212 (399 connections now open) 2015-10-05T09:03:21.020+0100 [mongosMain] connection accepted from 172.28.0.163:52830 #1432213 (400 connections now open) 2015-10-05T09:03:21.020+0100 [conn1432212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:21.021+0100 [conn1432213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:21.968+0100 [conn1431788] end connection 172.28.0.164:60749 (399 connections now open) 2015-10-05T09:03:21.969+0100 [mongosMain] connection accepted from 172.28.0.164:62078 #1432214 (400 connections now open) 2015-10-05T09:03:21.972+0100 [conn1432214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:22.255+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:03:22.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:03:22.592+0100 [conn1431876] end connection 172.28.0.164:61015 (399 connections now open) 2015-10-05T09:03:22.593+0100 [mongosMain] connection accepted from 172.28.0.164:62080 #1432215 (400 connections now open) 2015-10-05T09:03:22.594+0100 [conn1432215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:27.851+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:03:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:03:28.971+0100 [mongosMain] connection accepted from 127.0.0.1:52832 #1432216 (401 connections now open) 2015-10-05T09:03:28.974+0100 [conn1432216] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:28.978+0100 [conn1432216] end connection 127.0.0.1:52832 (400 connections now open) 2015-10-05T09:03:29.427+0100 [conn1431665] end connection 172.28.0.164:60401 (399 connections now open) 2015-10-05T09:03:29.428+0100 [mongosMain] connection accepted from 172.28.0.164:62091 #1432217 (400 connections now open) 2015-10-05T09:03:29.430+0100 [conn1432217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:29.552+0100 [conn1431827] end connection 172.28.0.163:51514 (399 connections now open) 2015-10-05T09:03:29.553+0100 [mongosMain] connection accepted from 172.28.0.163:52833 #1432218 (400 connections now open) 2015-10-05T09:03:29.555+0100 [conn1432218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:30.114+0100 [conn1431878] end connection 172.28.0.163:51730 (399 connections now open) 2015-10-05T09:03:30.115+0100 [mongosMain] connection accepted from 172.28.0.163:52834 #1432219 (400 connections now open) 2015-10-05T09:03:30.116+0100 [conn1432219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:31.013+0100 [conn1431627] end connection 172.28.0.163:50977 (399 connections now open) 2015-10-05T09:03:31.013+0100 [conn1431760] end connection 172.28.0.163:51295 (399 connections now open) 2015-10-05T09:03:31.015+0100 [mongosMain] connection accepted from 172.28.0.163:52836 #1432220 (399 connections now open) 2015-10-05T09:03:31.015+0100 [mongosMain] connection accepted from 172.28.0.163:52837 #1432221 (400 connections now open) 2015-10-05T09:03:31.016+0100 [conn1432220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:31.016+0100 [conn1432221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:31.984+0100 [conn1431868] end connection 172.28.0.164:60981 (399 connections now open) 2015-10-05T09:03:31.985+0100 [mongosMain] connection accepted from 172.28.0.164:62095 #1432222 (400 connections now open) 2015-10-05T09:03:31.987+0100 [conn1432222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:32.608+0100 [conn1431880] end connection 172.28.0.164:61024 (399 connections now open) 2015-10-05T09:03:32.609+0100 [mongosMain] connection accepted from 172.28.0.164:62097 #1432223 (400 connections now open) 2015-10-05T09:03:32.610+0100 [conn1432223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:34.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ed65703b51053ee9a96 2015-10-05T09:03:34.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:03:39.553+0100 [conn1431845] end connection 172.28.0.163:51585 (399 connections now open) 2015-10-05T09:03:39.554+0100 [mongosMain] connection accepted from 172.28.0.163:52844 #1432224 (400 connections now open) 2015-10-05T09:03:39.556+0100 [conn1432224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:39.603+0100 [mongosMain] connection accepted from 127.0.0.1:52846 #1432225 (401 connections now open) 2015-10-05T09:03:39.606+0100 [conn1432225] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:39.611+0100 [conn1432225] end connection 127.0.0.1:52846 (400 connections now open) 2015-10-05T09:03:39.873+0100 [conn1431553] end connection 172.28.0.164:60126 (399 connections now open) 2015-10-05T09:03:39.878+0100 [mongosMain] connection accepted from 172.28.0.164:62110 #1432226 (400 connections now open) 2015-10-05T09:03:39.880+0100 [conn1432226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:40.129+0100 [conn1431884] end connection 172.28.0.163:51740 (399 connections now open) 2015-10-05T09:03:40.130+0100 [mongosMain] connection accepted from 172.28.0.163:52847 #1432227 (400 connections now open) 2015-10-05T09:03:40.131+0100 [conn1432227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:41.017+0100 [conn1431572] end connection 172.28.0.163:50830 (399 connections now open) 2015-10-05T09:03:41.018+0100 [mongosMain] connection accepted from 172.28.0.163:52849 #1432228 (400 connections now open) 2015-10-05T09:03:41.019+0100 [conn1432228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:42.000+0100 [conn1431864] end connection 172.28.0.164:60966 (399 connections now open) 2015-10-05T09:03:42.001+0100 [mongosMain] connection accepted from 172.28.0.164:62114 #1432229 (400 connections now open) 2015-10-05T09:03:42.003+0100 [conn1432229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:42.609+0100 [conn1431885] end connection 172.28.0.164:61041 (399 connections now open) 2015-10-05T09:03:42.610+0100 [mongosMain] connection accepted from 172.28.0.164:62117 #1432230 (400 connections now open) 2015-10-05T09:03:42.612+0100 [conn1432230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:47.158+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:03:47.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:03:49.568+0100 [conn1431840] end connection 172.28.0.163:51551 (399 connections now open) 2015-10-05T09:03:49.569+0100 [mongosMain] connection accepted from 172.28.0.163:52863 #1432231 (400 connections now open) 2015-10-05T09:03:49.570+0100 [conn1432231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:49.862+0100 [conn1431623] end connection 172.28.0.164:60302 (399 connections now open) 2015-10-05T09:03:49.864+0100 [mongosMain] connection accepted from 172.28.0.164:62127 #1432232 (400 connections now open) 2015-10-05T09:03:49.868+0100 [conn1432232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:50.145+0100 [conn1431889] end connection 172.28.0.163:51749 (399 connections now open) 2015-10-05T09:03:50.146+0100 [mongosMain] connection accepted from 172.28.0.163:52866 #1432233 (400 connections now open) 2015-10-05T09:03:50.147+0100 [conn1432233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:51.019+0100 [conn1431825] end connection 172.28.0.163:51503 (399 connections now open) 2015-10-05T09:03:51.021+0100 [mongosMain] connection accepted from 172.28.0.163:52868 #1432234 (400 connections now open) 2015-10-05T09:03:51.022+0100 [conn1432234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:52.624+0100 [conn1431891] end connection 172.28.0.164:61059 (399 connections now open) 2015-10-05T09:03:52.626+0100 [mongosMain] connection accepted from 172.28.0.164:62132 #1432235 (400 connections now open) 2015-10-05T09:03:52.627+0100 [conn1432235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:03:58.692+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:03:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:03:59.572+0100 [conn1431836] end connection 172.28.0.163:51539 (399 connections now open) 2015-10-05T09:03:59.573+0100 [mongosMain] connection accepted from 172.28.0.163:52884 #1432236 (400 connections now open) 2015-10-05T09:03:59.575+0100 [conn1432236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:00.364+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:04:00.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:04:00.936+0100 [conn1431618] end connection 172.28.0.164:60281 (399 connections now open) 2015-10-05T09:04:00.937+0100 [mongosMain] connection accepted from 172.28.0.164:62137 #1432237 (400 connections now open) 2015-10-05T09:04:00.939+0100 [conn1432237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:01.647+0100 [conn1431662] end connection 172.28.0.163:51050 (399 connections now open) 2015-10-05T09:04:01.665+0100 [mongosMain] connection accepted from 172.28.0.163:52891 #1432238 (400 connections now open) 2015-10-05T09:04:01.666+0100 [conn1432238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:02.031+0100 [conn1431875] end connection 172.28.0.164:61013 (399 connections now open) 2015-10-05T09:04:02.032+0100 [mongosMain] connection accepted from 172.28.0.164:62141 #1432239 (400 connections now open) 2015-10-05T09:04:02.034+0100 [conn1432239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:02.640+0100 [conn1431897] end connection 172.28.0.164:61075 (399 connections now open) 2015-10-05T09:04:02.641+0100 [mongosMain] connection accepted from 172.28.0.164:62144 #1432240 (400 connections now open) 2015-10-05T09:04:02.643+0100 [conn1432240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:06.509+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:04:06.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:04:09.613+0100 [conn1431770] end connection 172.28.0.163:51315 (399 connections now open) 2015-10-05T09:04:09.613+0100 [mongosMain] connection accepted from 172.28.0.163:52915 #1432241 (400 connections now open) 2015-10-05T09:04:09.613+0100 [conn1432241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:11.517+0100 [conn1431609] end connection 172.28.0.163:50922 (399 connections now open) 2015-10-05T09:04:11.517+0100 [mongosMain] connection accepted from 172.28.0.163:52920 #1432242 (400 connections now open) 2015-10-05T09:04:11.517+0100 [conn1432242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:12.063+0100 [conn1431879] end connection 172.28.0.164:61021 (399 connections now open) 2015-10-05T09:04:12.078+0100 [mongosMain] connection accepted from 172.28.0.164:62149 #1432243 (400 connections now open) 2015-10-05T09:04:12.078+0100 [conn1432243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:12.633+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:04:12.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:04:18.792+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:04:18.792+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:04:19.599+0100 [conn1431818] end connection 172.28.0.163:51470 (399 connections now open) 2015-10-05T09:04:19.600+0100 [mongosMain] connection accepted from 172.28.0.163:52931 #1432244 (400 connections now open) 2015-10-05T09:04:19.601+0100 [conn1432244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:20.161+0100 [conn1431901] end connection 172.28.0.163:51792 (399 connections now open) 2015-10-05T09:04:20.162+0100 [mongosMain] connection accepted from 172.28.0.163:52933 #1432245 (400 connections now open) 2015-10-05T09:04:20.164+0100 [conn1432245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:21.688+0100 [conn1431852] end connection 172.28.0.164:60922 (399 connections now open) 2015-10-05T09:04:21.690+0100 [mongosMain] connection accepted from 172.28.0.164:62160 #1432246 (400 connections now open) 2015-10-05T09:04:21.691+0100 [conn1432246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:22.247+0100 [conn1431906] end connection 172.28.0.163:51813 (399 connections now open) 2015-10-05T09:04:22.248+0100 [conn1431684] end connection 172.28.0.163:51119 (398 connections now open) 2015-10-05T09:04:22.272+0100 [mongosMain] connection accepted from 172.28.0.163:52938 #1432247 (399 connections now open) 2015-10-05T09:04:22.273+0100 [conn1432247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:22.279+0100 [mongosMain] connection accepted from 172.28.0.163:52939 #1432248 (400 connections now open) 2015-10-05T09:04:22.280+0100 [conn1432248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:22.672+0100 [conn1431903] end connection 172.28.0.164:61090 (399 connections now open) 2015-10-05T09:04:22.673+0100 [mongosMain] connection accepted from 172.28.0.164:62163 #1432249 (400 connections now open) 2015-10-05T09:04:22.676+0100 [conn1432249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:28.861+0100 [mongosMain] connection accepted from 127.0.0.1:52945 #1432250 (401 connections now open) 2015-10-05T09:04:28.864+0100 [conn1432250] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:28.869+0100 [conn1432250] end connection 127.0.0.1:52945 (400 connections now open) 2015-10-05T09:04:29.101+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:04:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:04:29.603+0100 [conn1431860] end connection 172.28.0.163:51648 (399 connections now open) 2015-10-05T09:04:29.605+0100 [mongosMain] connection accepted from 172.28.0.163:52946 #1432251 (400 connections now open) 2015-10-05T09:04:29.606+0100 [conn1432251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:30.176+0100 [conn1431895] end connection 172.28.0.163:51769 (399 connections now open) 2015-10-05T09:04:30.177+0100 [mongosMain] connection accepted from 172.28.0.163:52948 #1432252 (400 connections now open) 2015-10-05T09:04:30.178+0100 [conn1432252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:31.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f0e5703b51053eea399 2015-10-05T09:04:31.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:04:31.674+0100 [conn1431911] end connection 172.28.0.164:61109 (399 connections now open) 2015-10-05T09:04:31.675+0100 [mongosMain] connection accepted from 172.28.0.164:62176 #1432253 (400 connections now open) 2015-10-05T09:04:31.677+0100 [conn1432253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:32.079+0100 [conn1431915] end connection 172.28.0.164:61120 (399 connections now open) 2015-10-05T09:04:32.080+0100 [mongosMain] connection accepted from 172.28.0.164:62179 #1432254 (400 connections now open) 2015-10-05T09:04:32.083+0100 [conn1432254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:32.236+0100 [conn1431790] end connection 172.28.0.163:51401 (399 connections now open) 2015-10-05T09:04:32.236+0100 [conn1431579] end connection 172.28.0.163:50847 (399 connections now open) 2015-10-05T09:04:32.237+0100 [mongosMain] connection accepted from 172.28.0.163:52950 #1432255 (399 connections now open) 2015-10-05T09:04:32.237+0100 [mongosMain] connection accepted from 172.28.0.163:52951 #1432256 (400 connections now open) 2015-10-05T09:04:32.238+0100 [conn1432255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:32.238+0100 [conn1432256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:32.688+0100 [conn1431909] end connection 172.28.0.164:61106 (399 connections now open) 2015-10-05T09:04:32.689+0100 [mongosMain] connection accepted from 172.28.0.164:62182 #1432257 (400 connections now open) 2015-10-05T09:04:32.691+0100 [conn1432257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:37.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f155703b51053eea47c 2015-10-05T09:04:37.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:04:39.418+0100 [mongosMain] connection accepted from 127.0.0.1:52955 #1432258 (401 connections now open) 2015-10-05T09:04:39.420+0100 [conn1432258] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:39.426+0100 [conn1432258] end connection 127.0.0.1:52955 (400 connections now open) 2015-10-05T09:04:39.615+0100 [conn1431850] end connection 172.28.0.163:51600 (399 connections now open) 2015-10-05T09:04:39.616+0100 [mongosMain] connection accepted from 172.28.0.163:52956 #1432259 (400 connections now open) 2015-10-05T09:04:39.617+0100 [conn1432259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:40.176+0100 [conn1431914] end connection 172.28.0.163:51848 (399 connections now open) 2015-10-05T09:04:40.177+0100 [mongosMain] connection accepted from 172.28.0.163:52958 #1432260 (400 connections now open) 2015-10-05T09:04:40.178+0100 [conn1432260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:41.689+0100 [conn1431736] end connection 172.28.0.164:60578 (399 connections now open) 2015-10-05T09:04:41.690+0100 [mongosMain] connection accepted from 172.28.0.164:62197 #1432261 (400 connections now open) 2015-10-05T09:04:41.691+0100 [conn1432261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:42.094+0100 [conn1431908] end connection 172.28.0.164:61104 (399 connections now open) 2015-10-05T09:04:42.095+0100 [mongosMain] connection accepted from 172.28.0.164:62200 #1432262 (400 connections now open) 2015-10-05T09:04:42.098+0100 [conn1432262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:42.240+0100 [conn1431898] end connection 172.28.0.163:51773 (399 connections now open) 2015-10-05T09:04:42.240+0100 [conn1431564] end connection 172.28.0.163:50815 (398 connections now open) 2015-10-05T09:04:42.243+0100 [mongosMain] connection accepted from 172.28.0.163:52964 #1432263 (399 connections now open) 2015-10-05T09:04:42.244+0100 [conn1432263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:42.245+0100 [mongosMain] connection accepted from 172.28.0.163:52967 #1432264 (400 connections now open) 2015-10-05T09:04:42.246+0100 [conn1432264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:42.703+0100 [conn1431916] end connection 172.28.0.164:61122 (399 connections now open) 2015-10-05T09:04:42.704+0100 [mongosMain] connection accepted from 172.28.0.164:62202 #1432265 (400 connections now open) 2015-10-05T09:04:42.705+0100 [conn1432265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:43.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f1b5703b51053eea5b9 2015-10-05T09:04:43.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:04:49.614+0100 [conn1431866] end connection 172.28.0.163:51662 (399 connections now open) 2015-10-05T09:04:49.615+0100 [mongosMain] connection accepted from 172.28.0.163:52975 #1432266 (400 connections now open) 2015-10-05T09:04:49.616+0100 [conn1432266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:50.192+0100 [conn1431920] end connection 172.28.0.163:51858 (399 connections now open) 2015-10-05T09:04:50.193+0100 [mongosMain] connection accepted from 172.28.0.163:52978 #1432267 (400 connections now open) 2015-10-05T09:04:50.194+0100 [conn1432267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:50.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f215703b51053eea743 2015-10-05T09:04:50.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:04:51.705+0100 [conn1431829] end connection 172.28.0.164:60850 (399 connections now open) 2015-10-05T09:04:51.706+0100 [mongosMain] connection accepted from 172.28.0.164:62214 #1432268 (400 connections now open) 2015-10-05T09:04:51.707+0100 [conn1432268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:52.096+0100 [conn1431902] end connection 172.28.0.164:61086 (399 connections now open) 2015-10-05T09:04:52.097+0100 [mongosMain] connection accepted from 172.28.0.164:62216 #1432269 (400 connections now open) 2015-10-05T09:04:52.098+0100 [conn1432269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:52.252+0100 [conn1431810] end connection 172.28.0.163:51439 (399 connections now open) 2015-10-05T09:04:52.252+0100 [conn1431677] end connection 172.28.0.163:51102 (399 connections now open) 2015-10-05T09:04:52.253+0100 [mongosMain] connection accepted from 172.28.0.163:52983 #1432270 (399 connections now open) 2015-10-05T09:04:52.253+0100 [mongosMain] connection accepted from 172.28.0.163:52984 #1432271 (400 connections now open) 2015-10-05T09:04:52.254+0100 [conn1432270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:52.254+0100 [conn1432271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:52.718+0100 [conn1431922] end connection 172.28.0.164:61140 (399 connections now open) 2015-10-05T09:04:52.719+0100 [mongosMain] connection accepted from 172.28.0.164:62219 #1432272 (400 connections now open) 2015-10-05T09:04:52.720+0100 [conn1432272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:04:56.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f285703b51053eea861 2015-10-05T09:04:56.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:04:59.264+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:04:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:04:59.630+0100 [conn1431855] end connection 172.28.0.163:51631 (399 connections now open) 2015-10-05T09:04:59.631+0100 [mongosMain] connection accepted from 172.28.0.163:52995 #1432273 (400 connections now open) 2015-10-05T09:04:59.632+0100 [conn1432273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:00.192+0100 [conn1431925] end connection 172.28.0.163:51867 (399 connections now open) 2015-10-05T09:05:00.193+0100 [mongosMain] connection accepted from 172.28.0.163:52997 #1432274 (400 connections now open) 2015-10-05T09:05:00.193+0100 [conn1432274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:01.721+0100 [conn1431838] end connection 172.28.0.164:60880 (399 connections now open) 2015-10-05T09:05:01.722+0100 [conn1431703] end connection 172.28.0.164:60493 (398 connections now open) 2015-10-05T09:05:01.722+0100 [mongosMain] connection accepted from 172.28.0.164:62233 #1432275 (399 connections now open) 2015-10-05T09:05:01.723+0100 [mongosMain] connection accepted from 172.28.0.164:62234 #1432276 (400 connections now open) 2015-10-05T09:05:01.725+0100 [conn1432275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:01.725+0100 [conn1432276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:02.111+0100 [conn1431872] end connection 172.28.0.164:60991 (399 connections now open) 2015-10-05T09:05:02.112+0100 [mongosMain] connection accepted from 172.28.0.164:62236 #1432277 (400 connections now open) 2015-10-05T09:05:02.113+0100 [conn1432277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:02.263+0100 [conn1431804] end connection 172.28.0.163:51421 (399 connections now open) 2015-10-05T09:05:02.263+0100 [conn1431821] end connection 172.28.0.163:51484 (399 connections now open) 2015-10-05T09:05:02.264+0100 [mongosMain] connection accepted from 172.28.0.163:53009 #1432278 (399 connections now open) 2015-10-05T09:05:02.264+0100 [mongosMain] connection accepted from 172.28.0.163:53011 #1432279 (400 connections now open) 2015-10-05T09:05:02.265+0100 [conn1432278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:02.265+0100 [conn1432279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:02.734+0100 [conn1431928] end connection 172.28.0.164:61160 (399 connections now open) 2015-10-05T09:05:02.735+0100 [mongosMain] connection accepted from 172.28.0.164:62241 #1432280 (400 connections now open) 2015-10-05T09:05:02.736+0100 [conn1432280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:08.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f345703b51053eeaa8b 2015-10-05T09:05:09.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:09.631+0100 [conn1431888] end connection 172.28.0.163:51747 (399 connections now open) 2015-10-05T09:05:09.633+0100 [mongosMain] connection accepted from 172.28.0.163:53023 #1432281 (400 connections now open) 2015-10-05T09:05:09.634+0100 [conn1432281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:10.208+0100 [conn1431931] end connection 172.28.0.163:51886 (399 connections now open) 2015-10-05T09:05:10.209+0100 [mongosMain] connection accepted from 172.28.0.163:53027 #1432282 (400 connections now open) 2015-10-05T09:05:10.210+0100 [conn1432282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:11.721+0100 [conn1431823] end connection 172.28.0.164:60832 (399 connections now open) 2015-10-05T09:05:11.721+0100 [conn1431671] end connection 172.28.0.164:60420 (398 connections now open) 2015-10-05T09:05:11.722+0100 [mongosMain] connection accepted from 172.28.0.164:62247 #1432283 (399 connections now open) 2015-10-05T09:05:11.722+0100 [mongosMain] connection accepted from 172.28.0.164:62248 #1432284 (400 connections now open) 2015-10-05T09:05:11.724+0100 [conn1432283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:11.724+0100 [conn1432284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:12.126+0100 [conn1431921] end connection 172.28.0.164:61137 (399 connections now open) 2015-10-05T09:05:12.128+0100 [mongosMain] connection accepted from 172.28.0.164:62251 #1432285 (400 connections now open) 2015-10-05T09:05:12.129+0100 [conn1432285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:12.269+0100 [conn1431691] end connection 172.28.0.163:51127 (399 connections now open) 2015-10-05T09:05:12.270+0100 [mongosMain] connection accepted from 172.28.0.163:53031 #1432286 (400 connections now open) 2015-10-05T09:05:12.271+0100 [conn1432286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:12.734+0100 [conn1431933] end connection 172.28.0.164:61178 (399 connections now open) 2015-10-05T09:05:12.735+0100 [mongosMain] connection accepted from 172.28.0.164:62253 #1432287 (400 connections now open) 2015-10-05T09:05:12.737+0100 [conn1432287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:19.646+0100 [conn1431877] end connection 172.28.0.163:51728 (399 connections now open) 2015-10-05T09:05:19.647+0100 [mongosMain] connection accepted from 172.28.0.163:53038 #1432288 (400 connections now open) 2015-10-05T09:05:19.649+0100 [conn1432288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:20.223+0100 [conn1431936] end connection 172.28.0.163:51903 (399 connections now open) 2015-10-05T09:05:20.224+0100 [mongosMain] connection accepted from 172.28.0.163:53040 #1432289 (400 connections now open) 2015-10-05T09:05:20.225+0100 [conn1432289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:21.280+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f415703b51053eeacaa 2015-10-05T09:05:21.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:21.736+0100 [conn1431904] end connection 172.28.0.164:61092 (399 connections now open) 2015-10-05T09:05:21.737+0100 [mongosMain] connection accepted from 172.28.0.164:62269 #1432290 (400 connections now open) 2015-10-05T09:05:21.739+0100 [conn1432290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:22.147+0100 [conn1431896] end connection 172.28.0.164:61072 (399 connections now open) 2015-10-05T09:05:22.148+0100 [mongosMain] connection accepted from 172.28.0.164:62270 #1432291 (400 connections now open) 2015-10-05T09:05:22.150+0100 [conn1432291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:22.269+0100 [conn1431887] end connection 172.28.0.163:51743 (399 connections now open) 2015-10-05T09:05:22.269+0100 [conn1431899] end connection 172.28.0.163:51774 (399 connections now open) 2015-10-05T09:05:22.270+0100 [mongosMain] connection accepted from 172.28.0.163:53043 #1432292 (399 connections now open) 2015-10-05T09:05:22.271+0100 [mongosMain] connection accepted from 172.28.0.163:53044 #1432293 (400 connections now open) 2015-10-05T09:05:22.271+0100 [conn1432292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:22.272+0100 [conn1432293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:22.750+0100 [conn1431938] end connection 172.28.0.164:61189 (399 connections now open) 2015-10-05T09:05:22.752+0100 [mongosMain] connection accepted from 172.28.0.164:62276 #1432294 (400 connections now open) 2015-10-05T09:05:22.753+0100 [conn1432294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:28.776+0100 [mongosMain] connection accepted from 127.0.0.1:53047 #1432295 (401 connections now open) 2015-10-05T09:05:28.779+0100 [conn1432295] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:28.784+0100 [conn1432295] end connection 127.0.0.1:53047 (400 connections now open) 2015-10-05T09:05:29.466+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:05:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:05:29.659+0100 [conn1431870] end connection 172.28.0.163:51677 (399 connections now open) 2015-10-05T09:05:29.661+0100 [mongosMain] connection accepted from 172.28.0.163:53050 #1432296 (400 connections now open) 2015-10-05T09:05:29.662+0100 [conn1432296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:30.237+0100 [conn1431941] end connection 172.28.0.163:51939 (399 connections now open) 2015-10-05T09:05:30.238+0100 [mongosMain] connection accepted from 172.28.0.163:53051 #1432297 (400 connections now open) 2015-10-05T09:05:30.239+0100 [conn1432297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:32.157+0100 [conn1431927] end connection 172.28.0.164:61157 (399 connections now open) 2015-10-05T09:05:32.158+0100 [mongosMain] connection accepted from 172.28.0.164:62295 #1432298 (400 connections now open) 2015-10-05T09:05:32.159+0100 [conn1432298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:32.284+0100 [conn1431917] end connection 172.28.0.163:51852 (399 connections now open) 2015-10-05T09:05:32.285+0100 [conn1431816] end connection 172.28.0.163:51466 (398 connections now open) 2015-10-05T09:05:32.285+0100 [mongosMain] connection accepted from 172.28.0.163:53058 #1432299 (399 connections now open) 2015-10-05T09:05:32.286+0100 [mongosMain] connection accepted from 172.28.0.163:53060 #1432300 (400 connections now open) 2015-10-05T09:05:32.286+0100 [conn1432299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:32.287+0100 [conn1432300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:32.765+0100 [conn1431944] end connection 172.28.0.164:61203 (399 connections now open) 2015-10-05T09:05:32.767+0100 [mongosMain] connection accepted from 172.28.0.164:62300 #1432301 (400 connections now open) 2015-10-05T09:05:32.768+0100 [conn1432301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:33.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f4d5703b51053eeae16 2015-10-05T09:05:33.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:39.662+0100 [conn1431873] end connection 172.28.0.163:51712 (399 connections now open) 2015-10-05T09:05:39.663+0100 [mongosMain] connection accepted from 172.28.0.163:53064 #1432302 (400 connections now open) 2015-10-05T09:05:39.665+0100 [conn1432302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:39.717+0100 [mongosMain] connection accepted from 127.0.0.1:53066 #1432303 (401 connections now open) 2015-10-05T09:05:39.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f535703b51053eeaec1 2015-10-05T09:05:39.720+0100 [conn1432303] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:39.725+0100 [conn1432303] end connection 127.0.0.1:53066 (400 connections now open) 2015-10-05T09:05:39.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:40.238+0100 [conn1431947] end connection 172.28.0.163:51956 (399 connections now open) 2015-10-05T09:05:40.239+0100 [mongosMain] connection accepted from 172.28.0.163:53069 #1432304 (400 connections now open) 2015-10-05T09:05:40.240+0100 [conn1432304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:42.173+0100 [conn1431948] end connection 172.28.0.164:61211 (399 connections now open) 2015-10-05T09:05:42.174+0100 [mongosMain] connection accepted from 172.28.0.164:62315 #1432305 (400 connections now open) 2015-10-05T09:05:42.176+0100 [conn1432305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:42.292+0100 [conn1431704] end connection 172.28.0.163:51150 (399 connections now open) 2015-10-05T09:05:42.292+0100 [conn1431881] end connection 172.28.0.163:51734 (399 connections now open) 2015-10-05T09:05:42.293+0100 [mongosMain] connection accepted from 172.28.0.163:53073 #1432306 (399 connections now open) 2015-10-05T09:05:42.293+0100 [mongosMain] connection accepted from 172.28.0.163:53074 #1432307 (400 connections now open) 2015-10-05T09:05:42.294+0100 [conn1432306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:42.294+0100 [conn1432307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:42.782+0100 [conn1431951] end connection 172.28.0.164:61218 (399 connections now open) 2015-10-05T09:05:42.783+0100 [mongosMain] connection accepted from 172.28.0.164:62317 #1432308 (400 connections now open) 2015-10-05T09:05:42.784+0100 [conn1432308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:46.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f595703b51053eeaf6c 2015-10-05T09:05:46.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:49.678+0100 [conn1431894] end connection 172.28.0.163:51767 (399 connections now open) 2015-10-05T09:05:49.679+0100 [mongosMain] connection accepted from 172.28.0.163:53084 #1432309 (400 connections now open) 2015-10-05T09:05:49.680+0100 [conn1432309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:50.243+0100 [conn1431956] end connection 172.28.0.163:51968 (399 connections now open) 2015-10-05T09:05:50.245+0100 [mongosMain] connection accepted from 172.28.0.163:53087 #1432310 (400 connections now open) 2015-10-05T09:05:50.246+0100 [conn1432310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:52.189+0100 [conn1431815] end connection 172.28.0.164:60812 (399 connections now open) 2015-10-05T09:05:52.190+0100 [mongosMain] connection accepted from 172.28.0.164:62328 #1432311 (400 connections now open) 2015-10-05T09:05:52.192+0100 [conn1432311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:52.300+0100 [conn1431637] end connection 172.28.0.163:51012 (399 connections now open) 2015-10-05T09:05:52.300+0100 [conn1431923] end connection 172.28.0.163:51861 (399 connections now open) 2015-10-05T09:05:52.301+0100 [mongosMain] connection accepted from 172.28.0.163:53091 #1432312 (399 connections now open) 2015-10-05T09:05:52.301+0100 [mongosMain] connection accepted from 172.28.0.163:53092 #1432313 (400 connections now open) 2015-10-05T09:05:52.302+0100 [conn1432312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:52.302+0100 [conn1432313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:52.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f605703b51053eeb00f 2015-10-05T09:05:52.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:05:52.798+0100 [conn1431960] end connection 172.28.0.164:61237 (399 connections now open) 2015-10-05T09:05:52.799+0100 [mongosMain] connection accepted from 172.28.0.164:62330 #1432314 (400 connections now open) 2015-10-05T09:05:52.800+0100 [conn1432314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:59.698+0100 [conn1431907] end connection 172.28.0.163:51832 (399 connections now open) 2015-10-05T09:05:59.699+0100 [mongosMain] connection accepted from 172.28.0.163:53102 #1432315 (400 connections now open) 2015-10-05T09:05:59.700+0100 [conn1432315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:05:59.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f665703b51053eeb06a 2015-10-05T09:05:59.889+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:05:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:05:59.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:06:00.255+0100 [conn1431964] end connection 172.28.0.163:51980 (399 connections now open) 2015-10-05T09:06:00.256+0100 [mongosMain] connection accepted from 172.28.0.163:53106 #1432316 (400 connections now open) 2015-10-05T09:06:00.257+0100 [conn1432316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:01.799+0100 [conn1431610] end connection 172.28.0.164:60264 (399 connections now open) 2015-10-05T09:06:01.800+0100 [mongosMain] connection accepted from 172.28.0.164:62349 #1432317 (400 connections now open) 2015-10-05T09:06:01.801+0100 [conn1432317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:02.205+0100 [conn1431942] end connection 172.28.0.164:61197 (399 connections now open) 2015-10-05T09:06:02.206+0100 [mongosMain] connection accepted from 172.28.0.164:62351 #1432318 (400 connections now open) 2015-10-05T09:06:02.208+0100 [conn1432318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:02.301+0100 [conn1431817] end connection 172.28.0.163:51467 (399 connections now open) 2015-10-05T09:06:02.301+0100 [conn1431647] end connection 172.28.0.163:51022 (399 connections now open) 2015-10-05T09:06:02.302+0100 [mongosMain] connection accepted from 172.28.0.163:53125 #1432319 (399 connections now open) 2015-10-05T09:06:02.302+0100 [mongosMain] connection accepted from 172.28.0.163:53126 #1432320 (400 connections now open) 2015-10-05T09:06:02.303+0100 [conn1432319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:02.303+0100 [conn1432320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:02.814+0100 [conn1431968] end connection 172.28.0.164:61257 (399 connections now open) 2015-10-05T09:06:02.815+0100 [mongosMain] connection accepted from 172.28.0.164:62353 #1432321 (400 connections now open) 2015-10-05T09:06:02.817+0100 [conn1432321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:06.149+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:06:06.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:06:09.733+0100 [conn1431882] end connection 172.28.0.163:51737 (399 connections now open) 2015-10-05T09:06:09.734+0100 [mongosMain] connection accepted from 172.28.0.163:53139 #1432322 (400 connections now open) 2015-10-05T09:06:09.735+0100 [conn1432322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:10.256+0100 [conn1431971] end connection 172.28.0.163:51999 (399 connections now open) 2015-10-05T09:06:10.258+0100 [mongosMain] connection accepted from 172.28.0.163:53140 #1432323 (400 connections now open) 2015-10-05T09:06:10.259+0100 [conn1432323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:11.815+0100 [conn1431949] end connection 172.28.0.164:61215 (399 connections now open) 2015-10-05T09:06:11.815+0100 [conn1431559] end connection 172.28.0.164:60149 (399 connections now open) 2015-10-05T09:06:11.816+0100 [mongosMain] connection accepted from 172.28.0.164:62357 #1432324 (399 connections now open) 2015-10-05T09:06:11.816+0100 [mongosMain] connection accepted from 172.28.0.164:62356 #1432325 (400 connections now open) 2015-10-05T09:06:11.824+0100 [conn1432324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:11.827+0100 [conn1432325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:12.221+0100 [conn1431972] end connection 172.28.0.164:61268 (399 connections now open) 2015-10-05T09:06:12.222+0100 [mongosMain] connection accepted from 172.28.0.164:62359 #1432326 (400 connections now open) 2015-10-05T09:06:12.223+0100 [conn1432326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:12.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f745703b51053eeb198 2015-10-05T09:06:12.315+0100 [conn1431811] end connection 172.28.0.163:51440 (399 connections now open) 2015-10-05T09:06:12.316+0100 [conn1431962] end connection 172.28.0.163:51973 (398 connections now open) 2015-10-05T09:06:12.317+0100 [mongosMain] connection accepted from 172.28.0.163:53144 #1432327 (399 connections now open) 2015-10-05T09:06:12.317+0100 [mongosMain] connection accepted from 172.28.0.163:53145 #1432328 (400 connections now open) 2015-10-05T09:06:12.318+0100 [conn1432327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:12.319+0100 [conn1432328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:12.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:06:12.829+0100 [conn1431973] end connection 172.28.0.164:61271 (399 connections now open) 2015-10-05T09:06:12.830+0100 [mongosMain] connection accepted from 172.28.0.164:62361 #1432329 (400 connections now open) 2015-10-05T09:06:12.832+0100 [conn1432329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:19.694+0100 [conn1431963] end connection 172.28.0.163:51978 (399 connections now open) 2015-10-05T09:06:19.695+0100 [mongosMain] connection accepted from 172.28.0.163:53153 #1432330 (400 connections now open) 2015-10-05T09:06:19.695+0100 [conn1432330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:20.271+0100 [conn1431977] end connection 172.28.0.163:52016 (399 connections now open) 2015-10-05T09:06:20.272+0100 [mongosMain] connection accepted from 172.28.0.163:53155 #1432331 (400 connections now open) 2015-10-05T09:06:20.273+0100 [conn1432331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:21.830+0100 [conn1431772] end connection 172.28.0.164:60695 (399 connections now open) 2015-10-05T09:06:21.831+0100 [mongosMain] connection accepted from 172.28.0.164:62372 #1432332 (400 connections now open) 2015-10-05T09:06:21.832+0100 [conn1432332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:21.845+0100 [conn1431345] end connection 172.28.0.164:59472 (399 connections now open) 2015-10-05T09:06:21.847+0100 [mongosMain] connection accepted from 172.28.0.164:62373 #1432333 (400 connections now open) 2015-10-05T09:06:21.848+0100 [conn1432333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:22.331+0100 [conn1431975] end connection 172.28.0.163:52005 (399 connections now open) 2015-10-05T09:06:22.331+0100 [conn1431918] end connection 172.28.0.163:51855 (399 connections now open) 2015-10-05T09:06:22.332+0100 [mongosMain] connection accepted from 172.28.0.163:53161 #1432334 (399 connections now open) 2015-10-05T09:06:22.332+0100 [mongosMain] connection accepted from 172.28.0.163:53160 #1432335 (400 connections now open) 2015-10-05T09:06:22.332+0100 [conn1432334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:22.333+0100 [conn1432335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:22.844+0100 [conn1431979] end connection 172.28.0.164:61302 (399 connections now open) 2015-10-05T09:06:22.846+0100 [mongosMain] connection accepted from 172.28.0.164:62379 #1432336 (400 connections now open) 2015-10-05T09:06:22.848+0100 [conn1432336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:24.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f805703b51053eeb297 2015-10-05T09:06:24.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:06:28.599+0100 [mongosMain] connection accepted from 127.0.0.1:53165 #1432337 (401 connections now open) 2015-10-05T09:06:28.602+0100 [conn1432337] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:28.608+0100 [conn1432337] end connection 127.0.0.1:53165 (400 connections now open) 2015-10-05T09:06:29.709+0100 [conn1431946] end connection 172.28.0.163:51954 (399 connections now open) 2015-10-05T09:06:29.711+0100 [mongosMain] connection accepted from 172.28.0.163:53167 #1432338 (400 connections now open) 2015-10-05T09:06:29.712+0100 [conn1432338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:30.286+0100 [conn1431990] end connection 172.28.0.163:52052 (399 connections now open) 2015-10-05T09:06:30.287+0100 [mongosMain] connection accepted from 172.28.0.163:53169 #1432339 (400 connections now open) 2015-10-05T09:06:30.289+0100 [conn1432339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:31.564+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:06:31.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:06:31.846+0100 [conn1431910] end connection 172.28.0.164:61108 (399 connections now open) 2015-10-05T09:06:31.846+0100 [conn1431929] end connection 172.28.0.164:61162 (399 connections now open) 2015-10-05T09:06:31.847+0100 [mongosMain] connection accepted from 172.28.0.164:62391 #1432340 (399 connections now open) 2015-10-05T09:06:31.848+0100 [mongosMain] connection accepted from 172.28.0.164:62392 #1432341 (400 connections now open) 2015-10-05T09:06:31.848+0100 [conn1432340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:31.849+0100 [conn1432341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:32.179+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:06:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:06:32.236+0100 [conn1431937] end connection 172.28.0.164:61185 (399 connections now open) 2015-10-05T09:06:32.237+0100 [mongosMain] connection accepted from 172.28.0.164:62395 #1432342 (400 connections now open) 2015-10-05T09:06:32.239+0100 [conn1432342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:32.332+0100 [conn1431969] end connection 172.28.0.163:51986 (399 connections now open) 2015-10-05T09:06:32.332+0100 [conn1431886] end connection 172.28.0.163:51742 (399 connections now open) 2015-10-05T09:06:32.333+0100 [mongosMain] connection accepted from 172.28.0.163:53173 #1432343 (399 connections now open) 2015-10-05T09:06:32.333+0100 [mongosMain] connection accepted from 172.28.0.163:53174 #1432344 (400 connections now open) 2015-10-05T09:06:32.334+0100 [conn1432343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:32.334+0100 [conn1432344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:32.862+0100 [conn1431984] end connection 172.28.0.164:61310 (399 connections now open) 2015-10-05T09:06:32.863+0100 [mongosMain] connection accepted from 172.28.0.164:62397 #1432345 (400 connections now open) 2015-10-05T09:06:32.865+0100 [conn1432345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:37.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f8d5703b51053eeb3c7 2015-10-05T09:06:38.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:06:39.710+0100 [conn1431913] end connection 172.28.0.163:51846 (399 connections now open) 2015-10-05T09:06:39.711+0100 [mongosMain] connection accepted from 172.28.0.163:53177 #1432346 (400 connections now open) 2015-10-05T09:06:39.712+0100 [conn1432346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:39.883+0100 [mongosMain] connection accepted from 127.0.0.1:53178 #1432347 (401 connections now open) 2015-10-05T09:06:39.886+0100 [conn1432347] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:39.891+0100 [conn1432347] end connection 127.0.0.1:53178 (400 connections now open) 2015-10-05T09:06:40.287+0100 [conn1431997] end connection 172.28.0.163:52066 (399 connections now open) 2015-10-05T09:06:40.288+0100 [mongosMain] connection accepted from 172.28.0.163:53179 #1432348 (400 connections now open) 2015-10-05T09:06:40.289+0100 [conn1432348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:41.862+0100 [conn1431728] end connection 172.28.0.164:60565 (399 connections now open) 2015-10-05T09:06:41.863+0100 [conn1431834] end connection 172.28.0.164:60867 (398 connections now open) 2015-10-05T09:06:41.863+0100 [mongosMain] connection accepted from 172.28.0.164:62413 #1432349 (399 connections now open) 2015-10-05T09:06:41.864+0100 [mongosMain] connection accepted from 172.28.0.164:62414 #1432350 (400 connections now open) 2015-10-05T09:06:41.864+0100 [conn1432349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:41.866+0100 [conn1432350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:42.252+0100 [conn1431957] end connection 172.28.0.164:61231 (399 connections now open) 2015-10-05T09:06:42.253+0100 [mongosMain] connection accepted from 172.28.0.164:62416 #1432351 (400 connections now open) 2015-10-05T09:06:42.255+0100 [conn1432351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:42.352+0100 [conn1431994] end connection 172.28.0.163:52057 (399 connections now open) 2015-10-05T09:06:42.352+0100 [conn1431893] end connection 172.28.0.163:51755 (398 connections now open) 2015-10-05T09:06:42.356+0100 [mongosMain] connection accepted from 172.28.0.163:53184 #1432352 (399 connections now open) 2015-10-05T09:06:42.356+0100 [mongosMain] connection accepted from 172.28.0.163:53185 #1432353 (400 connections now open) 2015-10-05T09:06:42.357+0100 [conn1432352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:42.358+0100 [conn1432353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:42.876+0100 [conn1431998] end connection 172.28.0.164:61345 (399 connections now open) 2015-10-05T09:06:42.876+0100 [mongosMain] connection accepted from 172.28.0.164:62419 #1432354 (400 connections now open) 2015-10-05T09:06:42.878+0100 [conn1432354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:44.188+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:06:44.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:06:49.725+0100 [conn1431940] end connection 172.28.0.163:51937 (399 connections now open) 2015-10-05T09:06:49.726+0100 [mongosMain] connection accepted from 172.28.0.163:53196 #1432355 (400 connections now open) 2015-10-05T09:06:49.727+0100 [conn1432355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:50.301+0100 [conn1432005] end connection 172.28.0.163:52082 (399 connections now open) 2015-10-05T09:06:50.302+0100 [mongosMain] connection accepted from 172.28.0.163:53199 #1432356 (400 connections now open) 2015-10-05T09:06:50.303+0100 [conn1432356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:50.330+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122f9703838a4537162cf9') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032410193), why: "doing balance round", ts: ObjectId('56122f9a5703b51053eeb4f7') } } gle1: { lastOp: Timestamp 1444032410000|4, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } gle2: { lastOp: Timestamp 1444032398000|1, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } 2015-10-05T09:06:50.334+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:06:50.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122f9a5703b51053eeb4f7 2015-10-05T09:06:50.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:06:51.863+0100 [conn1431658] end connection 172.28.0.164:60385 (399 connections now open) 2015-10-05T09:06:51.863+0100 [conn1431959] end connection 172.28.0.164:61235 (399 connections now open) 2015-10-05T09:06:51.864+0100 [mongosMain] connection accepted from 172.28.0.164:62432 #1432357 (399 connections now open) 2015-10-05T09:06:51.865+0100 [mongosMain] connection accepted from 172.28.0.164:62433 #1432358 (400 connections now open) 2015-10-05T09:06:51.867+0100 [conn1432357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:51.868+0100 [conn1432358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:52.268+0100 [conn1431978] end connection 172.28.0.164:61299 (399 connections now open) 2015-10-05T09:06:52.268+0100 [mongosMain] connection accepted from 172.28.0.164:62436 #1432359 (400 connections now open) 2015-10-05T09:06:52.269+0100 [conn1432359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:52.354+0100 [conn1431585] end connection 172.28.0.163:50879 (399 connections now open) 2015-10-05T09:06:52.355+0100 [mongosMain] connection accepted from 172.28.0.163:53205 #1432360 (400 connections now open) 2015-10-05T09:06:52.356+0100 [conn1432360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:52.877+0100 [conn1432007] end connection 172.28.0.164:61366 (399 connections now open) 2015-10-05T09:06:52.878+0100 [mongosMain] connection accepted from 172.28.0.164:62438 #1432361 (400 connections now open) 2015-10-05T09:06:52.880+0100 [conn1432361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:06:57.192+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:06:57.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:06:59.741+0100 [conn1431996] end connection 172.28.0.163:52064 (399 connections now open) 2015-10-05T09:06:59.741+0100 [mongosMain] connection accepted from 172.28.0.163:53215 #1432362 (400 connections now open) 2015-10-05T09:06:59.742+0100 [conn1432362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:00.303+0100 [conn1432013] end connection 172.28.0.163:52102 (399 connections now open) 2015-10-05T09:07:00.304+0100 [mongosMain] connection accepted from 172.28.0.163:53218 #1432363 (400 connections now open) 2015-10-05T09:07:00.305+0100 [conn1432363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:01.877+0100 [conn1431679] end connection 172.28.0.164:60431 (399 connections now open) 2015-10-05T09:07:01.878+0100 [mongosMain] connection accepted from 172.28.0.164:62462 #1432364 (400 connections now open) 2015-10-05T09:07:01.880+0100 [conn1432364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:02.283+0100 [conn1431966] end connection 172.28.0.164:61252 (399 connections now open) 2015-10-05T09:07:02.285+0100 [mongosMain] connection accepted from 172.28.0.164:62464 #1432365 (400 connections now open) 2015-10-05T09:07:02.287+0100 [conn1432365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:02.362+0100 [conn1431935] end connection 172.28.0.163:51894 (399 connections now open) 2015-10-05T09:07:02.363+0100 [mongosMain] connection accepted from 172.28.0.163:53230 #1432366 (400 connections now open) 2015-10-05T09:07:02.364+0100 [conn1432366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:02.448+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:07:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:07:02.891+0100 [conn1432015] end connection 172.28.0.164:61383 (399 connections now open) 2015-10-05T09:07:02.892+0100 [mongosMain] connection accepted from 172.28.0.164:62465 #1432367 (400 connections now open) 2015-10-05T09:07:02.899+0100 [conn1432367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:03.348+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:07:03.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:07:09.607+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122faa03838a4537162cfc') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032429480), why: "doing balance round", ts: ObjectId('56122fad5703b51053eeb673') } } gle1: { lastOp: Timestamp 1444032410000|10, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1444032429000|5, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2015-10-05T09:07:09.612+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:07:09.741+0100 [conn1431955] end connection 172.28.0.163:51966 (399 connections now open) 2015-10-05T09:07:09.742+0100 [mongosMain] connection accepted from 172.28.0.163:53242 #1432368 (400 connections now open) 2015-10-05T09:07:09.743+0100 [conn1432368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:09.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fad5703b51053eeb673 2015-10-05T09:07:09.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:07:10.318+0100 [conn1432020] end connection 172.28.0.163:52119 (399 connections now open) 2015-10-05T09:07:10.319+0100 [mongosMain] connection accepted from 172.28.0.163:53245 #1432369 (400 connections now open) 2015-10-05T09:07:10.320+0100 [conn1432369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:11.878+0100 [conn1431724] end connection 172.28.0.164:60543 (399 connections now open) 2015-10-05T09:07:11.879+0100 [mongosMain] connection accepted from 172.28.0.164:62470 #1432370 (400 connections now open) 2015-10-05T09:07:11.880+0100 [conn1432370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:12.299+0100 [conn1431932] end connection 172.28.0.164:61174 (399 connections now open) 2015-10-05T09:07:12.299+0100 [mongosMain] connection accepted from 172.28.0.164:62472 #1432371 (400 connections now open) 2015-10-05T09:07:12.300+0100 [conn1432371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:12.368+0100 [conn1431924] end connection 172.28.0.163:51864 (399 connections now open) 2015-10-05T09:07:12.368+0100 [mongosMain] connection accepted from 172.28.0.163:53249 #1432372 (400 connections now open) 2015-10-05T09:07:12.369+0100 [conn1432372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:12.907+0100 [conn1432022] end connection 172.28.0.164:61411 (399 connections now open) 2015-10-05T09:07:12.909+0100 [mongosMain] connection accepted from 172.28.0.164:62474 #1432373 (400 connections now open) 2015-10-05T09:07:12.910+0100 [conn1432373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:16.024+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fb35703b51053eeb6e8 2015-10-05T09:07:16.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:07:19.757+0100 [conn1431900] end connection 172.28.0.163:51791 (399 connections now open) 2015-10-05T09:07:19.758+0100 [mongosMain] connection accepted from 172.28.0.163:53258 #1432374 (400 connections now open) 2015-10-05T09:07:19.759+0100 [conn1432374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:20.319+0100 [conn1432027] end connection 172.28.0.163:52152 (399 connections now open) 2015-10-05T09:07:20.320+0100 [mongosMain] connection accepted from 172.28.0.163:53260 #1432375 (400 connections now open) 2015-10-05T09:07:20.321+0100 [conn1432375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:21.893+0100 [conn1431958] end connection 172.28.0.164:61234 (399 connections now open) 2015-10-05T09:07:21.894+0100 [conn1432009] end connection 172.28.0.164:61370 (398 connections now open) 2015-10-05T09:07:21.894+0100 [mongosMain] connection accepted from 172.28.0.164:62485 #1432376 (399 connections now open) 2015-10-05T09:07:21.895+0100 [mongosMain] connection accepted from 172.28.0.164:62486 #1432377 (400 connections now open) 2015-10-05T09:07:21.896+0100 [conn1432376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:21.896+0100 [conn1432377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:22.300+0100 [conn1432014] end connection 172.28.0.164:61380 (399 connections now open) 2015-10-05T09:07:22.301+0100 [mongosMain] connection accepted from 172.28.0.164:62490 #1432378 (400 connections now open) 2015-10-05T09:07:22.302+0100 [conn1432378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:22.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fba5703b51053eeb774 2015-10-05T09:07:22.377+0100 [conn1431930] end connection 172.28.0.163:51874 (399 connections now open) 2015-10-05T09:07:22.377+0100 [conn1432010] end connection 172.28.0.163:52086 (399 connections now open) 2015-10-05T09:07:22.378+0100 [mongosMain] connection accepted from 172.28.0.163:53263 #1432379 (399 connections now open) 2015-10-05T09:07:22.379+0100 [mongosMain] connection accepted from 172.28.0.163:53264 #1432380 (400 connections now open) 2015-10-05T09:07:22.379+0100 [conn1432379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:22.379+0100 [conn1432380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:22.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:07:22.907+0100 [conn1432029] end connection 172.28.0.164:61423 (399 connections now open) 2015-10-05T09:07:22.908+0100 [mongosMain] connection accepted from 172.28.0.164:62492 #1432381 (400 connections now open) 2015-10-05T09:07:22.911+0100 [conn1432381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:28.406+0100 [mongosMain] connection accepted from 127.0.0.1:53266 #1432382 (401 connections now open) 2015-10-05T09:07:28.409+0100 [conn1432382] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:28.414+0100 [conn1432382] end connection 127.0.0.1:53266 (400 connections now open) 2015-10-05T09:07:28.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fc05703b51053eeb81a 2015-10-05T09:07:28.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:07:29.759+0100 [conn1432003] end connection 172.28.0.163:52080 (399 connections now open) 2015-10-05T09:07:29.760+0100 [mongosMain] connection accepted from 172.28.0.163:53267 #1432383 (400 connections now open) 2015-10-05T09:07:29.762+0100 [conn1432383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:30.334+0100 [conn1432033] end connection 172.28.0.163:52171 (399 connections now open) 2015-10-05T09:07:30.335+0100 [mongosMain] connection accepted from 172.28.0.163:53269 #1432384 (400 connections now open) 2015-10-05T09:07:30.336+0100 [conn1432384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:31.909+0100 [conn1431649] end connection 172.28.0.164:60362 (399 connections now open) 2015-10-05T09:07:31.910+0100 [conn1431999] end connection 172.28.0.164:61350 (398 connections now open) 2015-10-05T09:07:31.911+0100 [mongosMain] connection accepted from 172.28.0.164:62504 #1432385 (399 connections now open) 2015-10-05T09:07:31.911+0100 [mongosMain] connection accepted from 172.28.0.164:62505 #1432386 (400 connections now open) 2015-10-05T09:07:31.912+0100 [conn1432385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:31.913+0100 [conn1432386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:32.316+0100 [conn1432006] end connection 172.28.0.164:61364 (399 connections now open) 2015-10-05T09:07:32.317+0100 [mongosMain] connection accepted from 172.28.0.164:62507 #1432387 (400 connections now open) 2015-10-05T09:07:32.320+0100 [conn1432387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:32.394+0100 [conn1432025] end connection 172.28.0.163:52138 (399 connections now open) 2015-10-05T09:07:32.394+0100 [conn1431622] end connection 172.28.0.163:50945 (398 connections now open) 2015-10-05T09:07:32.395+0100 [mongosMain] connection accepted from 172.28.0.163:53271 #1432388 (399 connections now open) 2015-10-05T09:07:32.395+0100 [mongosMain] connection accepted from 172.28.0.163:53272 #1432389 (400 connections now open) 2015-10-05T09:07:32.396+0100 [conn1432388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:32.396+0100 [conn1432389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:32.923+0100 [conn1432035] end connection 172.28.0.164:61438 (399 connections now open) 2015-10-05T09:07:32.924+0100 [mongosMain] connection accepted from 172.28.0.164:62510 #1432390 (400 connections now open) 2015-10-05T09:07:32.926+0100 [conn1432390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:33.812+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:07:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:07:39.586+0100 [mongosMain] connection accepted from 127.0.0.1:53281 #1432391 (401 connections now open) 2015-10-05T09:07:39.589+0100 [conn1432391] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:39.594+0100 [conn1432391] end connection 127.0.0.1:53281 (400 connections now open) 2015-10-05T09:07:39.772+0100 [conn1432012] end connection 172.28.0.163:52099 (399 connections now open) 2015-10-05T09:07:39.773+0100 [mongosMain] connection accepted from 172.28.0.163:53282 #1432392 (400 connections now open) 2015-10-05T09:07:39.774+0100 [conn1432392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:41.925+0100 [conn1431863] end connection 172.28.0.164:60965 (399 connections now open) 2015-10-05T09:07:41.926+0100 [mongosMain] connection accepted from 172.28.0.164:62527 #1432393 (400 connections now open) 2015-10-05T09:07:41.927+0100 [conn1432393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:42.462+0100 [conn1431988] end connection 172.28.0.163:52044 (399 connections now open) 2015-10-05T09:07:42.463+0100 [mongosMain] connection accepted from 172.28.0.163:53287 #1432394 (400 connections now open) 2015-10-05T09:07:42.464+0100 [conn1432394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:42.939+0100 [conn1432042] end connection 172.28.0.164:61456 (399 connections now open) 2015-10-05T09:07:42.940+0100 [mongosMain] connection accepted from 172.28.0.164:62532 #1432395 (400 connections now open) 2015-10-05T09:07:42.941+0100 [conn1432395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:48.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fd35703b51053eeb9dc 2015-10-05T09:07:48.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:07:51.942+0100 [conn1431752] end connection 172.28.0.164:60622 (399 connections now open) 2015-10-05T09:07:51.944+0100 [mongosMain] connection accepted from 172.28.0.164:62544 #1432396 (400 connections now open) 2015-10-05T09:07:51.945+0100 [conn1432396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:07:52.954+0100 [conn1432048] end connection 172.28.0.164:61479 (399 connections now open) 2015-10-05T09:07:52.955+0100 [mongosMain] connection accepted from 172.28.0.164:62548 #1432397 (400 connections now open) 2015-10-05T09:07:52.957+0100 [conn1432397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:00.375+0100 [conn1432040] end connection 172.28.0.163:52180 (399 connections now open) 2015-10-05T09:08:00.391+0100 [mongosMain] connection accepted from 172.28.0.163:53311 #1432398 (400 connections now open) 2015-10-05T09:08:00.395+0100 [conn1432398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:02.346+0100 [conn1431983] end connection 172.28.0.164:61308 (399 connections now open) 2015-10-05T09:08:02.347+0100 [mongosMain] connection accepted from 172.28.0.164:62565 #1432399 (400 connections now open) 2015-10-05T09:08:02.349+0100 [conn1432399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:04.061+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:08:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:08:07.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122fe65703b51053eebbbb 2015-10-05T09:08:07.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:08:10.378+0100 [conn1432052] end connection 172.28.0.163:52205 (399 connections now open) 2015-10-05T09:08:10.379+0100 [mongosMain] connection accepted from 172.28.0.163:53337 #1432400 (400 connections now open) 2015-10-05T09:08:10.380+0100 [conn1432400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:12.362+0100 [conn1432028] end connection 172.28.0.164:61421 (399 connections now open) 2015-10-05T09:08:12.363+0100 [mongosMain] connection accepted from 172.28.0.164:62576 #1432401 (400 connections now open) 2015-10-05T09:08:12.364+0100 [conn1432401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:12.986+0100 [conn1432053] end connection 172.28.0.164:61500 (399 connections now open) 2015-10-05T09:08:12.987+0100 [mongosMain] connection accepted from 172.28.0.164:62578 #1432402 (400 connections now open) 2015-10-05T09:08:12.989+0100 [conn1432402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:20.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ff35703b51053eebcba 2015-10-05T09:08:20.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:08:20.381+0100 [conn1432057] end connection 172.28.0.163:52220 (399 connections now open) 2015-10-05T09:08:20.382+0100 [mongosMain] connection accepted from 172.28.0.163:53345 #1432403 (400 connections now open) 2015-10-05T09:08:20.383+0100 [conn1432403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:22.361+0100 [conn1432034] end connection 172.28.0.164:61434 (399 connections now open) 2015-10-05T09:08:22.363+0100 [mongosMain] connection accepted from 172.28.0.164:62592 #1432404 (400 connections now open) 2015-10-05T09:08:22.364+0100 [conn1432404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:22.535+0100 [conn1432050] end connection 172.28.0.163:52192 (399 connections now open) 2015-10-05T09:08:22.536+0100 [mongosMain] connection accepted from 172.28.0.163:53349 #1432405 (400 connections now open) 2015-10-05T09:08:22.537+0100 [conn1432405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:22.986+0100 [conn1432063] end connection 172.28.0.164:61527 (399 connections now open) 2015-10-05T09:08:22.988+0100 [mongosMain] connection accepted from 172.28.0.164:62594 #1432406 (400 connections now open) 2015-10-05T09:08:22.990+0100 [conn1432406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:26.553+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56122ff821e099ca5fa0c958') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032506488), why: "doing balance round", ts: ObjectId('56122ffa5703b51053eebd57') } } gle1: { lastOp: Timestamp 1444032506000|3, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1444032500000|3, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2015-10-05T09:08:26.558+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:08:26.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56122ffa5703b51053eebd57 2015-10-05T09:08:26.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:08:28.783+0100 [mongosMain] connection accepted from 127.0.0.1:53352 #1432407 (401 connections now open) 2015-10-05T09:08:28.787+0100 [conn1432407] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:28.796+0100 [conn1432407] end connection 127.0.0.1:53352 (400 connections now open) 2015-10-05T09:08:30.382+0100 [conn1432061] end connection 172.28.0.163:52251 (399 connections now open) 2015-10-05T09:08:30.383+0100 [mongosMain] connection accepted from 172.28.0.163:53355 #1432408 (400 connections now open) 2015-10-05T09:08:30.384+0100 [conn1432408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:32.377+0100 [conn1432062] end connection 172.28.0.164:61525 (399 connections now open) 2015-10-05T09:08:32.378+0100 [mongosMain] connection accepted from 172.28.0.164:62608 #1432409 (400 connections now open) 2015-10-05T09:08:32.379+0100 [conn1432409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:32.551+0100 [conn1432031] end connection 172.28.0.163:52160 (399 connections now open) 2015-10-05T09:08:32.552+0100 [mongosMain] connection accepted from 172.28.0.163:53357 #1432410 (400 connections now open) 2015-10-05T09:08:32.553+0100 [conn1432410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:33.002+0100 [conn1432068] end connection 172.28.0.164:61543 (399 connections now open) 2015-10-05T09:08:33.003+0100 [mongosMain] connection accepted from 172.28.0.164:62610 #1432411 (400 connections now open) 2015-10-05T09:08:33.005+0100 [conn1432411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:34.296+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:08:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:08:39.277+0100 [mongosMain] connection accepted from 127.0.0.1:53361 #1432412 (401 connections now open) 2015-10-05T09:08:39.280+0100 [conn1432412] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:39.286+0100 [conn1432412] end connection 127.0.0.1:53361 (400 connections now open) 2015-10-05T09:08:40.397+0100 [conn1432066] end connection 172.28.0.163:52267 (399 connections now open) 2015-10-05T09:08:40.398+0100 [mongosMain] connection accepted from 172.28.0.163:53363 #1432413 (400 connections now open) 2015-10-05T09:08:40.399+0100 [conn1432413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:41.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230065703b51053eebe62 2015-10-05T09:08:42.330+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:08:42.408+0100 [mongosMain] connection accepted from 172.28.0.164:62628 #1432414 (401 connections now open) 2015-10-05T09:08:42.415+0100 [conn1432058] end connection 172.28.0.164:61508 (400 connections now open) 2015-10-05T09:08:42.429+0100 [conn1432414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:42.595+0100 [conn1432002] end connection 172.28.0.163:52069 (399 connections now open) 2015-10-05T09:08:42.650+0100 [mongosMain] connection accepted from 172.28.0.163:53369 #1432415 (400 connections now open) 2015-10-05T09:08:42.669+0100 [conn1432415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:43.002+0100 [conn1432076] end connection 172.28.0.164:61561 (399 connections now open) 2015-10-05T09:08:43.003+0100 [mongosMain] connection accepted from 172.28.0.164:62632 #1432416 (400 connections now open) 2015-10-05T09:08:43.005+0100 [conn1432416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:48.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230105703b51053eebf2c 2015-10-05T09:08:48.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:08:50.400+0100 [conn1432074] end connection 172.28.0.163:52276 (399 connections now open) 2015-10-05T09:08:50.401+0100 [mongosMain] connection accepted from 172.28.0.163:53378 #1432417 (400 connections now open) 2015-10-05T09:08:50.402+0100 [conn1432417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:52.409+0100 [conn1432067] end connection 172.28.0.164:61541 (399 connections now open) 2015-10-05T09:08:52.410+0100 [mongosMain] connection accepted from 172.28.0.164:62645 #1432418 (400 connections now open) 2015-10-05T09:08:52.411+0100 [conn1432418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:52.570+0100 [conn1432037] end connection 172.28.0.163:52175 (399 connections now open) 2015-10-05T09:08:52.571+0100 [mongosMain] connection accepted from 172.28.0.163:53384 #1432419 (400 connections now open) 2015-10-05T09:08:52.572+0100 [conn1432419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:53.017+0100 [conn1432083] end connection 172.28.0.164:61587 (399 connections now open) 2015-10-05T09:08:53.019+0100 [mongosMain] connection accepted from 172.28.0.164:62651 #1432420 (400 connections now open) 2015-10-05T09:08:53.020+0100 [conn1432420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:08:55.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230165703b51053eebfc9 2015-10-05T09:08:55.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:00.413+0100 [conn1432081] end connection 172.28.0.163:52284 (399 connections now open) 2015-10-05T09:09:00.414+0100 [mongosMain] connection accepted from 172.28.0.163:53392 #1432421 (400 connections now open) 2015-10-05T09:09:00.416+0100 [conn1432421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:01.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612301d5703b51053eebfec 2015-10-05T09:09:01.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:02.424+0100 [conn1432047] end connection 172.28.0.164:61476 (399 connections now open) 2015-10-05T09:09:02.425+0100 [mongosMain] connection accepted from 172.28.0.164:62665 #1432422 (400 connections now open) 2015-10-05T09:09:02.434+0100 [conn1432422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:02.640+0100 [conn1431982] end connection 172.28.0.163:52028 (399 connections now open) 2015-10-05T09:09:02.646+0100 [mongosMain] connection accepted from 172.28.0.163:53409 #1432423 (400 connections now open) 2015-10-05T09:09:02.647+0100 [conn1432423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:05.139+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:09:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:09:07.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230235703b51053eec0e3 2015-10-05T09:09:07.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:10.413+0100 [conn1432086] end connection 172.28.0.163:52304 (399 connections now open) 2015-10-05T09:09:10.414+0100 [mongosMain] connection accepted from 172.28.0.163:53427 #1432424 (400 connections now open) 2015-10-05T09:09:10.416+0100 [conn1432424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:12.440+0100 [conn1432021] end connection 172.28.0.164:61403 (399 connections now open) 2015-10-05T09:09:12.442+0100 [mongosMain] connection accepted from 172.28.0.164:62674 #1432425 (400 connections now open) 2015-10-05T09:09:12.443+0100 [conn1432425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:12.637+0100 [conn1432055] end connection 172.28.0.163:52209 (399 connections now open) 2015-10-05T09:09:12.638+0100 [mongosMain] connection accepted from 172.28.0.163:53431 #1432426 (400 connections now open) 2015-10-05T09:09:12.639+0100 [conn1432426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:13.048+0100 [conn1432088] end connection 172.28.0.164:61615 (399 connections now open) 2015-10-05T09:09:13.049+0100 [mongosMain] connection accepted from 172.28.0.164:62676 #1432427 (400 connections now open) 2015-10-05T09:09:13.050+0100 [conn1432427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:14.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612302a5703b51053eec173 2015-10-05T09:09:15.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:20.428+0100 [conn1432091] end connection 172.28.0.163:52319 (399 connections now open) 2015-10-05T09:09:20.429+0100 [mongosMain] connection accepted from 172.28.0.163:53441 #1432428 (400 connections now open) 2015-10-05T09:09:20.429+0100 [conn1432428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:21.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230315703b51053eec21a 2015-10-05T09:09:21.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:22.457+0100 [conn1432082] end connection 172.28.0.164:61580 (399 connections now open) 2015-10-05T09:09:22.458+0100 [mongosMain] connection accepted from 172.28.0.164:62688 #1432429 (400 connections now open) 2015-10-05T09:09:22.460+0100 [conn1432429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:22.597+0100 [conn1432024] end connection 172.28.0.164:61415 (399 connections now open) 2015-10-05T09:09:22.598+0100 [mongosMain] connection accepted from 172.28.0.164:62690 #1432430 (400 connections now open) 2015-10-05T09:09:22.600+0100 [conn1432430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:22.644+0100 [conn1432044] end connection 172.28.0.163:52183 (399 connections now open) 2015-10-05T09:09:22.645+0100 [mongosMain] connection accepted from 172.28.0.163:53443 #1432431 (400 connections now open) 2015-10-05T09:09:22.646+0100 [conn1432431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:23.065+0100 [conn1432097] end connection 172.28.0.164:61647 (399 connections now open) 2015-10-05T09:09:23.067+0100 [mongosMain] connection accepted from 172.28.0.164:62693 #1432432 (400 connections now open) 2015-10-05T09:09:23.069+0100 [conn1432432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:27.613+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230375703b51053eec2bd 2015-10-05T09:09:27.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:28.951+0100 [mongosMain] connection accepted from 127.0.0.1:53445 #1432433 (401 connections now open) 2015-10-05T09:09:28.954+0100 [conn1432433] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:28.960+0100 [conn1432433] end connection 127.0.0.1:53445 (400 connections now open) 2015-10-05T09:09:32.472+0100 [conn1432041] end connection 172.28.0.164:61454 (399 connections now open) 2015-10-05T09:09:32.473+0100 [mongosMain] connection accepted from 172.28.0.164:62707 #1432434 (400 connections now open) 2015-10-05T09:09:32.476+0100 [conn1432434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:32.629+0100 [conn1431857] end connection 172.28.0.164:60942 (399 connections now open) 2015-10-05T09:09:32.630+0100 [mongosMain] connection accepted from 172.28.0.164:62709 #1432435 (400 connections now open) 2015-10-05T09:09:32.632+0100 [conn1432435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:32.645+0100 [conn1431952] end connection 172.28.0.163:51961 (399 connections now open) 2015-10-05T09:09:32.646+0100 [mongosMain] connection accepted from 172.28.0.163:53451 #1432436 (400 connections now open) 2015-10-05T09:09:32.647+0100 [conn1432436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:33.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612303d5703b51053eec34d 2015-10-05T09:09:34.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:35.435+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:09:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:09:39.287+0100 [mongosMain] connection accepted from 127.0.0.1:53455 #1432437 (401 connections now open) 2015-10-05T09:09:39.290+0100 [conn1432437] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:39.293+0100 [conn1432437] end connection 127.0.0.1:53455 (400 connections now open) 2015-10-05T09:09:40.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230445703b51053eec3d4 2015-10-05T09:09:40.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:42.487+0100 [conn1432087] end connection 172.28.0.164:61613 (399 connections now open) 2015-10-05T09:09:42.488+0100 [mongosMain] connection accepted from 172.28.0.164:62729 #1432438 (400 connections now open) 2015-10-05T09:09:42.490+0100 [conn1432438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:42.628+0100 [conn1432098] end connection 172.28.0.164:61652 (399 connections now open) 2015-10-05T09:09:42.629+0100 [mongosMain] connection accepted from 172.28.0.164:62731 #1432439 (400 connections now open) 2015-10-05T09:09:42.630+0100 [conn1432439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:42.660+0100 [conn1432090] end connection 172.28.0.163:52312 (399 connections now open) 2015-10-05T09:09:42.661+0100 [mongosMain] connection accepted from 172.28.0.163:53472 #1432440 (400 connections now open) 2015-10-05T09:09:42.662+0100 [conn1432440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:46.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612304a5703b51053eec440 2015-10-05T09:09:46.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:49.883+0100 [conn1432051] end connection 172.28.0.163:52202 (399 connections now open) 2015-10-05T09:09:49.883+0100 [mongosMain] connection accepted from 172.28.0.163:53482 #1432441 (400 connections now open) 2015-10-05T09:09:49.884+0100 [conn1432441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:52.645+0100 [conn1431814] end connection 172.28.0.164:60806 (399 connections now open) 2015-10-05T09:09:52.647+0100 [mongosMain] connection accepted from 172.28.0.164:62746 #1432442 (400 connections now open) 2015-10-05T09:09:52.649+0100 [conn1432442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:09:53.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230505703b51053eec4bd 2015-10-05T09:09:53.144+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:09:59.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230575703b51053eec52a 2015-10-05T09:09:59.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:02.661+0100 [conn1431934] end connection 172.28.0.164:61177 (399 connections now open) 2015-10-05T09:10:02.663+0100 [mongosMain] connection accepted from 172.28.0.164:62757 #1432443 (400 connections now open) 2015-10-05T09:10:02.665+0100 [conn1432443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:02.676+0100 [conn1432071] end connection 172.28.0.163:52273 (399 connections now open) 2015-10-05T09:10:02.676+0100 [mongosMain] connection accepted from 172.28.0.163:53509 #1432444 (400 connections now open) 2015-10-05T09:10:02.677+0100 [conn1432444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:05.901+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:10:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:10:06.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612305d5703b51053eec5cf 2015-10-05T09:10:06.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:09.898+0100 [conn1431989] end connection 172.28.0.163:52051 (399 connections now open) 2015-10-05T09:10:09.899+0100 [mongosMain] connection accepted from 172.28.0.163:53531 #1432445 (400 connections now open) 2015-10-05T09:10:09.900+0100 [conn1432445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:12.693+0100 [conn1431800] end connection 172.28.0.164:60780 (399 connections now open) 2015-10-05T09:10:12.693+0100 [mongosMain] connection accepted from 172.28.0.164:62772 #1432446 (400 connections now open) 2015-10-05T09:10:12.693+0100 [conn1432446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:12.724+0100 [conn1432078] end connection 172.28.0.163:52279 (399 connections now open) 2015-10-05T09:10:12.724+0100 [mongosMain] connection accepted from 172.28.0.163:53537 #1432447 (400 connections now open) 2015-10-05T09:10:12.724+0100 [conn1432447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:20.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612306a5703b51053eec706 2015-10-05T09:10:20.476+0100 [conn1432095] end connection 172.28.0.163:52348 (399 connections now open) 2015-10-05T09:10:20.477+0100 [mongosMain] connection accepted from 172.28.0.163:53545 #1432448 (400 connections now open) 2015-10-05T09:10:20.478+0100 [conn1432448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:20.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:22.698+0100 [conn1431892] end connection 172.28.0.163:51754 (399 connections now open) 2015-10-05T09:10:22.699+0100 [mongosMain] connection accepted from 172.28.0.163:53548 #1432449 (400 connections now open) 2015-10-05T09:10:22.700+0100 [conn1432449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:22.707+0100 [conn1432084] end connection 172.28.0.164:61600 (399 connections now open) 2015-10-05T09:10:22.708+0100 [mongosMain] connection accepted from 172.28.0.164:62784 #1432450 (400 connections now open) 2015-10-05T09:10:22.710+0100 [conn1432450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:23.143+0100 [conn1432101] end connection 172.28.0.164:61667 (399 connections now open) 2015-10-05T09:10:23.144+0100 [mongosMain] connection accepted from 172.28.0.164:62786 #1432451 (400 connections now open) 2015-10-05T09:10:23.146+0100 [conn1432451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:26.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230725703b51053eec7ac 2015-10-05T09:10:26.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:28.648+0100 [mongosMain] connection accepted from 127.0.0.1:53551 #1432452 (401 connections now open) 2015-10-05T09:10:28.651+0100 [conn1432452] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:28.656+0100 [conn1432452] end connection 127.0.0.1:53551 (400 connections now open) 2015-10-05T09:10:30.492+0100 [conn1432114] end connection 172.28.0.163:52499 (399 connections now open) 2015-10-05T09:10:30.493+0100 [mongosMain] connection accepted from 172.28.0.163:53555 #1432453 (400 connections now open) 2015-10-05T09:10:30.494+0100 [conn1432453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:32.722+0100 [conn1432107] end connection 172.28.0.164:61704 (399 connections now open) 2015-10-05T09:10:32.723+0100 [mongosMain] connection accepted from 172.28.0.164:62800 #1432454 (400 connections now open) 2015-10-05T09:10:32.730+0100 [conn1432454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:33.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230785703b51053eec841 2015-10-05T09:10:33.159+0100 [conn1432115] end connection 172.28.0.164:61762 (399 connections now open) 2015-10-05T09:10:33.160+0100 [mongosMain] connection accepted from 172.28.0.164:62802 #1432455 (400 connections now open) 2015-10-05T09:10:33.162+0100 [conn1432455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:33.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:36.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:10:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:10:39.254+0100 [mongosMain] connection accepted from 127.0.0.1:53565 #1432456 (401 connections now open) 2015-10-05T09:10:39.257+0100 [conn1432456] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:39.262+0100 [conn1432456] end connection 127.0.0.1:53565 (400 connections now open) 2015-10-05T09:10:39.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612307f5703b51053eec8d1 2015-10-05T09:10:39.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:40.492+0100 [conn1432120] end connection 172.28.0.163:52511 (399 connections now open) 2015-10-05T09:10:40.493+0100 [mongosMain] connection accepted from 172.28.0.163:53566 #1432457 (400 connections now open) 2015-10-05T09:10:40.494+0100 [conn1432457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:42.738+0100 [conn1432102] end connection 172.28.0.164:61672 (399 connections now open) 2015-10-05T09:10:42.740+0100 [mongosMain] connection accepted from 172.28.0.164:62816 #1432458 (400 connections now open) 2015-10-05T09:10:42.742+0100 [conn1432458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:43.175+0100 [conn1432121] end connection 172.28.0.164:61782 (399 connections now open) 2015-10-05T09:10:43.176+0100 [mongosMain] connection accepted from 172.28.0.164:62818 #1432459 (400 connections now open) 2015-10-05T09:10:43.178+0100 [conn1432459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:45.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230855703b51053eec95b 2015-10-05T09:10:45.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:52.754+0100 [conn1432108] end connection 172.28.0.164:61716 (399 connections now open) 2015-10-05T09:10:52.755+0100 [mongosMain] connection accepted from 172.28.0.164:62829 #1432460 (400 connections now open) 2015-10-05T09:10:52.757+0100 [conn1432460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:53.191+0100 [conn1432127] end connection 172.28.0.164:61799 (399 connections now open) 2015-10-05T09:10:53.192+0100 [mongosMain] connection accepted from 172.28.0.164:62832 #1432461 (400 connections now open) 2015-10-05T09:10:53.194+0100 [conn1432461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:10:54.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612308c5703b51053eec9fa 2015-10-05T09:10:55.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:10:59.945+0100 [conn1432045] end connection 172.28.0.163:52185 (399 connections now open) 2015-10-05T09:10:59.946+0100 [mongosMain] connection accepted from 172.28.0.163:53594 #1432462 (400 connections now open) 2015-10-05T09:10:59.947+0100 [conn1432462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:00.564+0100 [conn1432126] end connection 172.28.0.163:52525 (399 connections now open) 2015-10-05T09:11:00.565+0100 [mongosMain] connection accepted from 172.28.0.163:53597 #1432463 (400 connections now open) 2015-10-05T09:11:00.566+0100 [conn1432463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:01.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230955703b51053eeca90 2015-10-05T09:11:01.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:02.597+0100 [conn1432092] end connection 172.28.0.164:61623 (399 connections now open) 2015-10-05T09:11:02.597+0100 [mongosMain] connection accepted from 172.28.0.164:62849 #1432464 (400 connections now open) 2015-10-05T09:11:02.599+0100 [conn1432464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:02.769+0100 [conn1432093] end connection 172.28.0.164:61628 (399 connections now open) 2015-10-05T09:11:02.771+0100 [mongosMain] connection accepted from 172.28.0.164:62850 #1432465 (400 connections now open) 2015-10-05T09:11:02.773+0100 [conn1432465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:06.308+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:11:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:11:08.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612309b5703b51053eecb63 2015-10-05T09:11:08.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:09.960+0100 [conn1432113] end connection 172.28.0.163:52497 (399 connections now open) 2015-10-05T09:11:09.961+0100 [mongosMain] connection accepted from 172.28.0.163:53621 #1432466 (400 connections now open) 2015-10-05T09:11:09.962+0100 [conn1432466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:12.613+0100 [conn1432104] end connection 172.28.0.164:61685 (399 connections now open) 2015-10-05T09:11:12.614+0100 [mongosMain] connection accepted from 172.28.0.164:62855 #1432467 (400 connections now open) 2015-10-05T09:11:12.616+0100 [conn1432467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:13.221+0100 [conn1432132] end connection 172.28.0.164:61824 (399 connections now open) 2015-10-05T09:11:13.222+0100 [mongosMain] connection accepted from 172.28.0.164:62857 #1432468 (400 connections now open) 2015-10-05T09:11:13.224+0100 [conn1432468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:14.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230a25703b51053eecbfd 2015-10-05T09:11:14.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:19.961+0100 [conn1432119] end connection 172.28.0.163:52509 (399 connections now open) 2015-10-05T09:11:19.962+0100 [mongosMain] connection accepted from 172.28.0.163:53632 #1432469 (400 connections now open) 2015-10-05T09:11:19.963+0100 [conn1432469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:20.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230a85703b51053eecc90 2015-10-05T09:11:20.554+0100 [conn1432136] end connection 172.28.0.163:52563 (399 connections now open) 2015-10-05T09:11:20.555+0100 [mongosMain] connection accepted from 172.28.0.163:53634 #1432470 (400 connections now open) 2015-10-05T09:11:20.556+0100 [conn1432470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:20.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:22.629+0100 [conn1432075] end connection 172.28.0.164:61559 (399 connections now open) 2015-10-05T09:11:22.629+0100 [mongosMain] connection accepted from 172.28.0.164:62869 #1432471 (400 connections now open) 2015-10-05T09:11:22.634+0100 [conn1432471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:22.774+0100 [conn1432099] end connection 172.28.0.163:52353 (399 connections now open) 2015-10-05T09:11:22.776+0100 [mongosMain] connection accepted from 172.28.0.163:53638 #1432472 (400 connections now open) 2015-10-05T09:11:22.777+0100 [conn1432472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:22.800+0100 [conn1431985] end connection 172.28.0.164:61313 (399 connections now open) 2015-10-05T09:11:22.801+0100 [mongosMain] connection accepted from 172.28.0.164:62872 #1432473 (400 connections now open) 2015-10-05T09:11:22.807+0100 [conn1432473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:23.237+0100 [conn1432142] end connection 172.28.0.164:61868 (399 connections now open) 2015-10-05T09:11:23.238+0100 [mongosMain] connection accepted from 172.28.0.164:62874 #1432474 (400 connections now open) 2015-10-05T09:11:23.240+0100 [conn1432474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:28.586+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:11:28.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:11:29.135+0100 [mongosMain] connection accepted from 127.0.0.1:53649 #1432475 (401 connections now open) 2015-10-05T09:11:29.138+0100 [conn1432475] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:29.142+0100 [conn1432475] end connection 127.0.0.1:53649 (400 connections now open) 2015-10-05T09:11:29.977+0100 [conn1432039] end connection 172.28.0.163:52179 (399 connections now open) 2015-10-05T09:11:29.978+0100 [mongosMain] connection accepted from 172.28.0.163:53653 #1432476 (400 connections now open) 2015-10-05T09:11:29.979+0100 [conn1432476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:30.570+0100 [conn1432146] end connection 172.28.0.163:52607 (399 connections now open) 2015-10-05T09:11:30.571+0100 [mongosMain] connection accepted from 172.28.0.163:53657 #1432477 (400 connections now open) 2015-10-05T09:11:30.572+0100 [conn1432477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:32.784+0100 [conn1432089] end connection 172.28.0.164:61619 (399 connections now open) 2015-10-05T09:11:32.786+0100 [mongosMain] connection accepted from 172.28.0.164:62889 #1432478 (400 connections now open) 2015-10-05T09:11:32.786+0100 [conn1432123] end connection 172.28.0.163:52517 (399 connections now open) 2015-10-05T09:11:32.787+0100 [conn1432478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:32.787+0100 [mongosMain] connection accepted from 172.28.0.163:53659 #1432479 (400 connections now open) 2015-10-05T09:11:32.788+0100 [conn1432479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:33.253+0100 [conn1432147] end connection 172.28.0.164:61884 (399 connections now open) 2015-10-05T09:11:33.254+0100 [mongosMain] connection accepted from 172.28.0.164:62891 #1432480 (400 connections now open) 2015-10-05T09:11:33.256+0100 [conn1432480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:36.473+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:11:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:11:39.391+0100 [mongosMain] connection accepted from 127.0.0.1:53662 #1432481 (401 connections now open) 2015-10-05T09:11:39.394+0100 [conn1432481] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:39.400+0100 [conn1432481] end connection 127.0.0.1:53662 (400 connections now open) 2015-10-05T09:11:39.978+0100 [conn1432124] end connection 172.28.0.163:52522 (399 connections now open) 2015-10-05T09:11:39.980+0100 [mongosMain] connection accepted from 172.28.0.163:53663 #1432482 (400 connections now open) 2015-10-05T09:11:39.981+0100 [conn1432482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:40.586+0100 [conn1432152] end connection 172.28.0.163:52626 (399 connections now open) 2015-10-05T09:11:40.587+0100 [mongosMain] connection accepted from 172.28.0.163:53665 #1432483 (400 connections now open) 2015-10-05T09:11:40.588+0100 [conn1432483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:42.784+0100 [conn1432128] end connection 172.28.0.164:61803 (399 connections now open) 2015-10-05T09:11:42.786+0100 [mongosMain] connection accepted from 172.28.0.164:62903 #1432484 (400 connections now open) 2015-10-05T09:11:42.787+0100 [conn1432117] end connection 172.28.0.163:52503 (399 connections now open) 2015-10-05T09:11:42.787+0100 [conn1432484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:42.788+0100 [mongosMain] connection accepted from 172.28.0.163:53670 #1432485 (400 connections now open) 2015-10-05T09:11:42.789+0100 [conn1432485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:43.268+0100 [conn1432153] end connection 172.28.0.164:61911 (399 connections now open) 2015-10-05T09:11:43.269+0100 [mongosMain] connection accepted from 172.28.0.164:62905 #1432486 (400 connections now open) 2015-10-05T09:11:43.270+0100 [conn1432486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:46.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230c25703b51053eecec4 2015-10-05T09:11:46.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:49.992+0100 [conn1432135] end connection 172.28.0.163:52561 (399 connections now open) 2015-10-05T09:11:49.993+0100 [mongosMain] connection accepted from 172.28.0.163:53681 #1432487 (400 connections now open) 2015-10-05T09:11:49.994+0100 [conn1432487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:50.586+0100 [conn1432158] end connection 172.28.0.163:52635 (399 connections now open) 2015-10-05T09:11:50.587+0100 [mongosMain] connection accepted from 172.28.0.163:53684 #1432488 (400 connections now open) 2015-10-05T09:11:50.587+0100 [conn1432488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:52.799+0100 [conn1432105] end connection 172.28.0.164:61689 (399 connections now open) 2015-10-05T09:11:52.800+0100 [mongosMain] connection accepted from 172.28.0.164:62916 #1432489 (400 connections now open) 2015-10-05T09:11:52.801+0100 [conn1432489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:52.802+0100 [conn1432109] end connection 172.28.0.163:52429 (399 connections now open) 2015-10-05T09:11:52.802+0100 [mongosMain] connection accepted from 172.28.0.163:53687 #1432490 (400 connections now open) 2015-10-05T09:11:52.803+0100 [conn1432490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:11:53.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230c85703b51053eecf52 2015-10-05T09:11:53.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:11:53.271+0100 [conn1432159] end connection 172.28.0.164:61929 (399 connections now open) 2015-10-05T09:11:53.273+0100 [mongosMain] connection accepted from 172.28.0.164:62919 #1432491 (400 connections now open) 2015-10-05T09:11:53.274+0100 [conn1432491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:00.455+0100 [conn1432056] end connection 172.28.0.163:52218 (399 connections now open) 2015-10-05T09:12:00.456+0100 [mongosMain] connection accepted from 172.28.0.163:53697 #1432492 (400 connections now open) 2015-10-05T09:12:00.458+0100 [conn1432492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:00.624+0100 [conn1432163] end connection 172.28.0.163:52654 (399 connections now open) 2015-10-05T09:12:00.639+0100 [mongosMain] connection accepted from 172.28.0.163:53699 #1432493 (400 connections now open) 2015-10-05T09:12:00.643+0100 [conn1432493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:00.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230cf5703b51053eecf9b 2015-10-05T09:12:00.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:12:02.661+0100 [conn1432096] end connection 172.28.0.164:61645 (399 connections now open) 2015-10-05T09:12:02.662+0100 [mongosMain] connection accepted from 172.28.0.164:62934 #1432494 (400 connections now open) 2015-10-05T09:12:02.664+0100 [conn1432494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:02.802+0100 [conn1431961] end connection 172.28.0.163:51972 (399 connections now open) 2015-10-05T09:12:02.802+0100 [mongosMain] connection accepted from 172.28.0.163:53715 #1432495 (400 connections now open) 2015-10-05T09:12:02.803+0100 [conn1432495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:02.844+0100 [conn1432016] end connection 172.28.0.164:61386 (399 connections now open) 2015-10-05T09:12:02.845+0100 [mongosMain] connection accepted from 172.28.0.164:62936 #1432496 (400 connections now open) 2015-10-05T09:12:02.847+0100 [conn1432496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:03.283+0100 [conn1432164] end connection 172.28.0.164:61940 (399 connections now open) 2015-10-05T09:12:03.284+0100 [mongosMain] connection accepted from 172.28.0.164:62939 #1432497 (400 connections now open) 2015-10-05T09:12:03.285+0100 [conn1432497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:06.614+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:12:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:12:10.009+0100 [conn1432151] end connection 172.28.0.163:52624 (399 connections now open) 2015-10-05T09:12:10.011+0100 [mongosMain] connection accepted from 172.28.0.163:53724 #1432498 (400 connections now open) 2015-10-05T09:12:10.012+0100 [conn1432498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:10.602+0100 [conn1432168] end connection 172.28.0.163:52669 (399 connections now open) 2015-10-05T09:12:10.602+0100 [mongosMain] connection accepted from 172.28.0.163:53726 #1432499 (400 connections now open) 2015-10-05T09:12:10.603+0100 [conn1432499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:12.677+0100 [conn1432141] end connection 172.28.0.164:61866 (399 connections now open) 2015-10-05T09:12:12.678+0100 [mongosMain] connection accepted from 172.28.0.164:62948 #1432500 (400 connections now open) 2015-10-05T09:12:12.679+0100 [conn1432500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:12.817+0100 [conn1432134] end connection 172.28.0.163:52557 (399 connections now open) 2015-10-05T09:12:12.817+0100 [conn1432001] end connection 172.28.0.163:52071 (399 connections now open) 2015-10-05T09:12:12.818+0100 [mongosMain] connection accepted from 172.28.0.163:53730 #1432501 (399 connections now open) 2015-10-05T09:12:12.818+0100 [mongosMain] connection accepted from 172.28.0.163:53731 #1432502 (400 connections now open) 2015-10-05T09:12:12.819+0100 [conn1432501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:12.819+0100 [conn1432502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:12.848+0100 [conn1432069] end connection 172.28.0.164:61547 (399 connections now open) 2015-10-05T09:12:12.849+0100 [mongosMain] connection accepted from 172.28.0.164:62949 #1432503 (400 connections now open) 2015-10-05T09:12:12.851+0100 [conn1432503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:19.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561230e25703b51053eed152 2015-10-05T09:12:19.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:12:20.012+0100 [conn1432130] end connection 172.28.0.163:52545 (399 connections now open) 2015-10-05T09:12:20.013+0100 [mongosMain] connection accepted from 172.28.0.163:53739 #1432504 (400 connections now open) 2015-10-05T09:12:20.015+0100 [conn1432504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:20.616+0100 [conn1432173] end connection 172.28.0.163:52700 (399 connections now open) 2015-10-05T09:12:20.617+0100 [mongosMain] connection accepted from 172.28.0.163:53742 #1432505 (400 connections now open) 2015-10-05T09:12:20.618+0100 [conn1432505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:22.676+0100 [conn1432137] end connection 172.28.0.164:61835 (399 connections now open) 2015-10-05T09:12:22.677+0100 [mongosMain] connection accepted from 172.28.0.164:62961 #1432506 (400 connections now open) 2015-10-05T09:12:22.680+0100 [conn1432506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:22.863+0100 [conn1432122] end connection 172.28.0.164:61785 (399 connections now open) 2015-10-05T09:12:22.866+0100 [mongosMain] connection accepted from 172.28.0.164:62964 #1432507 (400 connections now open) 2015-10-05T09:12:22.869+0100 [conn1432507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:23.300+0100 [conn1432170] end connection 172.28.0.164:61951 (399 connections now open) 2015-10-05T09:12:23.301+0100 [mongosMain] connection accepted from 172.28.0.164:62967 #1432508 (400 connections now open) 2015-10-05T09:12:23.303+0100 [conn1432508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:28.672+0100 [mongosMain] connection accepted from 127.0.0.1:53746 #1432509 (401 connections now open) 2015-10-05T09:12:28.675+0100 [conn1432509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:28.681+0100 [conn1432509] end connection 127.0.0.1:53746 (400 connections now open) 2015-10-05T09:12:30.024+0100 [conn1432145] end connection 172.28.0.163:52604 (399 connections now open) 2015-10-05T09:12:30.025+0100 [mongosMain] connection accepted from 172.28.0.163:53747 #1432510 (400 connections now open) 2015-10-05T09:12:30.026+0100 [conn1432510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:30.617+0100 [conn1432176] end connection 172.28.0.163:52715 (399 connections now open) 2015-10-05T09:12:30.618+0100 [mongosMain] connection accepted from 172.28.0.163:53749 #1432511 (400 connections now open) 2015-10-05T09:12:30.619+0100 [conn1432511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:32.972+0100 [conn1431992] end connection 172.28.0.164:61330 (399 connections now open) 2015-10-05T09:12:32.972+0100 [conn1432169] end connection 172.28.0.164:61949 (398 connections now open) 2015-10-05T09:12:32.975+0100 [mongosMain] connection accepted from 172.28.0.164:62979 #1432512 (399 connections now open) 2015-10-05T09:12:32.975+0100 [mongosMain] connection accepted from 172.28.0.164:62978 #1432513 (400 connections now open) 2015-10-05T09:12:32.980+0100 [conn1432513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:32.982+0100 [conn1432512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:33.316+0100 [conn1432177] end connection 172.28.0.164:61988 (399 connections now open) 2015-10-05T09:12:33.317+0100 [mongosMain] connection accepted from 172.28.0.164:62986 #1432514 (400 connections now open) 2015-10-05T09:12:33.319+0100 [conn1432514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:34.026+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:12:34.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:12:36.890+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:12:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:12:39.857+0100 [mongosMain] connection accepted from 127.0.0.1:53754 #1432515 (401 connections now open) 2015-10-05T09:12:39.860+0100 [conn1432515] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:39.865+0100 [conn1432515] end connection 127.0.0.1:53754 (400 connections now open) 2015-10-05T09:12:40.040+0100 [conn1432156] end connection 172.28.0.163:52632 (399 connections now open) 2015-10-05T09:12:40.041+0100 [mongosMain] connection accepted from 172.28.0.163:53755 #1432516 (400 connections now open) 2015-10-05T09:12:40.042+0100 [conn1432516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:40.633+0100 [conn1432181] end connection 172.28.0.163:52727 (399 connections now open) 2015-10-05T09:12:40.634+0100 [mongosMain] connection accepted from 172.28.0.163:53757 #1432517 (400 connections now open) 2015-10-05T09:12:40.636+0100 [conn1432517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:42.692+0100 [conn1432112] end connection 172.28.0.164:61748 (399 connections now open) 2015-10-05T09:12:42.693+0100 [mongosMain] connection accepted from 172.28.0.164:63000 #1432518 (400 connections now open) 2015-10-05T09:12:42.695+0100 [conn1432518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:42.897+0100 [conn1432094] end connection 172.28.0.163:52330 (399 connections now open) 2015-10-05T09:12:42.898+0100 [mongosMain] connection accepted from 172.28.0.163:53763 #1432519 (400 connections now open) 2015-10-05T09:12:42.899+0100 [conn1432519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:42.957+0100 [conn1432133] end connection 172.28.0.164:61830 (399 connections now open) 2015-10-05T09:12:42.958+0100 [mongosMain] connection accepted from 172.28.0.164:63001 #1432520 (400 connections now open) 2015-10-05T09:12:42.961+0100 [conn1432520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:43.316+0100 [conn1432183] end connection 172.28.0.164:62006 (399 connections now open) 2015-10-05T09:12:43.317+0100 [mongosMain] connection accepted from 172.28.0.164:63003 #1432521 (400 connections now open) 2015-10-05T09:12:43.319+0100 [conn1432521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:46.172+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:12:46.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:12:50.041+0100 [conn1432140] end connection 172.28.0.163:52588 (399 connections now open) 2015-10-05T09:12:50.042+0100 [mongosMain] connection accepted from 172.28.0.163:53775 #1432522 (400 connections now open) 2015-10-05T09:12:50.044+0100 [conn1432522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:50.634+0100 [conn1432187] end connection 172.28.0.163:52741 (399 connections now open) 2015-10-05T09:12:50.635+0100 [mongosMain] connection accepted from 172.28.0.163:53777 #1432523 (400 connections now open) 2015-10-05T09:12:50.636+0100 [conn1432523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:52.585+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:12:52.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:12:52.708+0100 [conn1432131] end connection 172.28.0.164:61822 (399 connections now open) 2015-10-05T09:12:52.709+0100 [mongosMain] connection accepted from 172.28.0.164:63017 #1432524 (400 connections now open) 2015-10-05T09:12:52.710+0100 [conn1432524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:52.897+0100 [conn1432111] end connection 172.28.0.163:52471 (399 connections now open) 2015-10-05T09:12:52.899+0100 [mongosMain] connection accepted from 172.28.0.163:53782 #1432525 (400 connections now open) 2015-10-05T09:12:52.900+0100 [conn1432525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:52.974+0100 [conn1432138] end connection 172.28.0.164:61839 (399 connections now open) 2015-10-05T09:12:52.975+0100 [mongosMain] connection accepted from 172.28.0.164:63018 #1432526 (400 connections now open) 2015-10-05T09:12:52.978+0100 [conn1432526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:53.332+0100 [conn1432189] end connection 172.28.0.164:62027 (399 connections now open) 2015-10-05T09:12:53.334+0100 [mongosMain] connection accepted from 172.28.0.164:63020 #1432527 (400 connections now open) 2015-10-05T09:12:53.335+0100 [conn1432527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:12:58.726+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:12:58.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:13:00.073+0100 [conn1432162] end connection 172.28.0.163:52651 (399 connections now open) 2015-10-05T09:13:00.075+0100 [mongosMain] connection accepted from 172.28.0.163:53801 #1432528 (400 connections now open) 2015-10-05T09:13:00.098+0100 [conn1432528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:00.663+0100 [conn1432193] end connection 172.28.0.163:52761 (399 connections now open) 2015-10-05T09:13:00.664+0100 [mongosMain] connection accepted from 172.28.0.163:53809 #1432529 (400 connections now open) 2015-10-05T09:13:00.665+0100 [conn1432529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:02.725+0100 [conn1432182] end connection 172.28.0.164:62004 (399 connections now open) 2015-10-05T09:13:02.726+0100 [mongosMain] connection accepted from 172.28.0.164:63036 #1432530 (400 connections now open) 2015-10-05T09:13:02.727+0100 [conn1432530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:02.912+0100 [conn1432161] end connection 172.28.0.163:52649 (399 connections now open) 2015-10-05T09:13:02.913+0100 [mongosMain] connection accepted from 172.28.0.163:53830 #1432531 (400 connections now open) 2015-10-05T09:13:02.914+0100 [conn1432531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:06.379+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:13:06.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:13:07.894+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:13:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:13:10.056+0100 [conn1432166] end connection 172.28.0.163:52665 (399 connections now open) 2015-10-05T09:13:10.057+0100 [mongosMain] connection accepted from 172.28.0.163:53840 #1432532 (400 connections now open) 2015-10-05T09:13:10.058+0100 [conn1432532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:10.665+0100 [conn1432199] end connection 172.28.0.163:52780 (399 connections now open) 2015-10-05T09:13:10.666+0100 [mongosMain] connection accepted from 172.28.0.163:53843 #1432533 (400 connections now open) 2015-10-05T09:13:10.667+0100 [conn1432533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:12.465+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:13:12.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:13:12.739+0100 [conn1432188] end connection 172.28.0.164:62024 (399 connections now open) 2015-10-05T09:13:12.740+0100 [mongosMain] connection accepted from 172.28.0.164:63044 #1432534 (400 connections now open) 2015-10-05T09:13:12.741+0100 [conn1432534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:12.926+0100 [conn1432129] end connection 172.28.0.163:52535 (399 connections now open) 2015-10-05T09:13:12.927+0100 [mongosMain] connection accepted from 172.28.0.163:53847 #1432535 (400 connections now open) 2015-10-05T09:13:12.928+0100 [conn1432535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:18.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612311e5703b51053eed56a 2015-10-05T09:13:18.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:13:20.072+0100 [conn1432180] end connection 172.28.0.163:52725 (399 connections now open) 2015-10-05T09:13:20.073+0100 [mongosMain] connection accepted from 172.28.0.163:53856 #1432536 (400 connections now open) 2015-10-05T09:13:20.074+0100 [conn1432536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:20.664+0100 [conn1432204] end connection 172.28.0.163:52811 (399 connections now open) 2015-10-05T09:13:20.665+0100 [mongosMain] connection accepted from 172.28.0.163:53858 #1432537 (400 connections now open) 2015-10-05T09:13:20.666+0100 [conn1432537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:22.754+0100 [conn1432200] end connection 172.28.0.164:62054 (399 connections now open) 2015-10-05T09:13:22.755+0100 [mongosMain] connection accepted from 172.28.0.164:63058 #1432538 (400 connections now open) 2015-10-05T09:13:22.757+0100 [conn1432538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:22.933+0100 [conn1432192] end connection 172.28.0.163:52758 (399 connections now open) 2015-10-05T09:13:22.935+0100 [mongosMain] connection accepted from 172.28.0.163:53861 #1432539 (400 connections now open) 2015-10-05T09:13:22.936+0100 [conn1432539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:23.363+0100 [conn1432207] end connection 172.28.0.164:62067 (399 connections now open) 2015-10-05T09:13:23.365+0100 [mongosMain] connection accepted from 172.28.0.164:63060 #1432540 (400 connections now open) 2015-10-05T09:13:23.366+0100 [conn1432540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:28.934+0100 [mongosMain] connection accepted from 127.0.0.1:53864 #1432541 (401 connections now open) 2015-10-05T09:13:28.937+0100 [conn1432541] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:28.942+0100 [conn1432541] end connection 127.0.0.1:53864 (400 connections now open) 2015-10-05T09:13:30.074+0100 [conn1432185] end connection 172.28.0.163:52736 (399 connections now open) 2015-10-05T09:13:30.075+0100 [mongosMain] connection accepted from 172.28.0.163:53865 #1432542 (400 connections now open) 2015-10-05T09:13:30.076+0100 [conn1432542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:30.690+0100 [conn1432211] end connection 172.28.0.163:52823 (399 connections now open) 2015-10-05T09:13:30.693+0100 [mongosMain] connection accepted from 172.28.0.163:53867 #1432543 (400 connections now open) 2015-10-05T09:13:30.694+0100 [conn1432543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:30.898+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:13:30.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:13:32.771+0100 [conn1432100] end connection 172.28.0.164:61665 (399 connections now open) 2015-10-05T09:13:32.772+0100 [mongosMain] connection accepted from 172.28.0.164:63074 #1432544 (400 connections now open) 2015-10-05T09:13:32.778+0100 [conn1432544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:32.943+0100 [conn1432019] end connection 172.28.0.163:52108 (399 connections now open) 2015-10-05T09:13:32.944+0100 [conn1432079] end connection 172.28.0.163:52280 (398 connections now open) 2015-10-05T09:13:32.944+0100 [mongosMain] connection accepted from 172.28.0.163:53871 #1432545 (399 connections now open) 2015-10-05T09:13:32.945+0100 [mongosMain] connection accepted from 172.28.0.163:53872 #1432546 (400 connections now open) 2015-10-05T09:13:32.945+0100 [conn1432545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:32.946+0100 [conn1432546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:33.021+0100 [conn1431943] end connection 172.28.0.164:61201 (399 connections now open) 2015-10-05T09:13:33.022+0100 [mongosMain] connection accepted from 172.28.0.164:63076 #1432547 (400 connections now open) 2015-10-05T09:13:33.024+0100 [conn1432547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:33.379+0100 [conn1432195] end connection 172.28.0.164:62043 (399 connections now open) 2015-10-05T09:13:33.380+0100 [mongosMain] connection accepted from 172.28.0.164:63079 #1432548 (400 connections now open) 2015-10-05T09:13:33.382+0100 [conn1432548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:39.822+0100 [mongosMain] connection accepted from 127.0.0.1:53878 #1432549 (401 connections now open) 2015-10-05T09:13:39.825+0100 [conn1432549] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:39.829+0100 [conn1432549] end connection 127.0.0.1:53878 (400 connections now open) 2015-10-05T09:13:40.088+0100 [conn1432175] end connection 172.28.0.163:52712 (399 connections now open) 2015-10-05T09:13:40.089+0100 [mongosMain] connection accepted from 172.28.0.163:53879 #1432550 (400 connections now open) 2015-10-05T09:13:40.090+0100 [conn1432550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:40.680+0100 [conn1432219] end connection 172.28.0.163:52834 (399 connections now open) 2015-10-05T09:13:40.681+0100 [mongosMain] connection accepted from 172.28.0.163:53881 #1432551 (400 connections now open) 2015-10-05T09:13:40.683+0100 [conn1432551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:41.376+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:13:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:13:42.779+0100 [conn1432206] end connection 172.28.0.164:62065 (399 connections now open) 2015-10-05T09:13:42.781+0100 [mongosMain] connection accepted from 172.28.0.164:63095 #1432552 (400 connections now open) 2015-10-05T09:13:42.782+0100 [conn1432552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:42.951+0100 [conn1432205] end connection 172.28.0.163:52813 (399 connections now open) 2015-10-05T09:13:42.952+0100 [mongosMain] connection accepted from 172.28.0.163:53887 #1432553 (400 connections now open) 2015-10-05T09:13:42.953+0100 [conn1432553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:43.036+0100 [conn1432208] end connection 172.28.0.164:62072 (399 connections now open) 2015-10-05T09:13:43.037+0100 [mongosMain] connection accepted from 172.28.0.164:63097 #1432554 (400 connections now open) 2015-10-05T09:13:43.040+0100 [conn1432554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:43.285+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:13:43.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:13:43.395+0100 [conn1432215] end connection 172.28.0.164:62080 (399 connections now open) 2015-10-05T09:13:43.396+0100 [mongosMain] connection accepted from 172.28.0.164:63099 #1432555 (400 connections now open) 2015-10-05T09:13:43.398+0100 [conn1432555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:49.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612313d5703b51053eed763 2015-10-05T09:13:49.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:13:50.088+0100 [conn1432172] end connection 172.28.0.163:52696 (399 connections now open) 2015-10-05T09:13:50.089+0100 [mongosMain] connection accepted from 172.28.0.163:53897 #1432556 (400 connections now open) 2015-10-05T09:13:50.090+0100 [conn1432556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:50.696+0100 [conn1432227] end connection 172.28.0.163:52847 (399 connections now open) 2015-10-05T09:13:50.697+0100 [mongosMain] connection accepted from 172.28.0.163:53900 #1432557 (400 connections now open) 2015-10-05T09:13:50.698+0100 [conn1432557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:52.786+0100 [conn1432214] end connection 172.28.0.164:62078 (399 connections now open) 2015-10-05T09:13:52.787+0100 [mongosMain] connection accepted from 172.28.0.164:63109 #1432558 (400 connections now open) 2015-10-05T09:13:52.788+0100 [conn1432558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:53.037+0100 [conn1431737] end connection 172.28.0.164:60580 (399 connections now open) 2015-10-05T09:13:53.038+0100 [mongosMain] connection accepted from 172.28.0.164:63111 #1432559 (400 connections now open) 2015-10-05T09:13:53.040+0100 [conn1432559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:13:53.411+0100 [conn1432223] end connection 172.28.0.164:62097 (399 connections now open) 2015-10-05T09:13:53.412+0100 [mongosMain] connection accepted from 172.28.0.164:63113 #1432560 (400 connections now open) 2015-10-05T09:13:53.414+0100 [conn1432560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:00.103+0100 [conn1432191] end connection 172.28.0.163:52755 (399 connections now open) 2015-10-05T09:14:00.104+0100 [mongosMain] connection accepted from 172.28.0.163:53913 #1432561 (400 connections now open) 2015-10-05T09:14:00.105+0100 [conn1432561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:02.418+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561231483b0f755fc334f404') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032842069), why: "doing balance round", ts: ObjectId('5612314a5703b51053eed7e5') } } gle1: { lastOp: Timestamp 1444032842000|1, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } gle2: { lastOp: Timestamp 1444032829000|8, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } 2015-10-05T09:14:02.421+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:14:02.541+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612314a5703b51053eed7e5 2015-10-05T09:14:02.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:03.051+0100 [conn1432064] end connection 172.28.0.164:61531 (399 connections now open) 2015-10-05T09:14:03.052+0100 [mongosMain] connection accepted from 172.28.0.164:63126 #1432562 (400 connections now open) 2015-10-05T09:14:03.053+0100 [conn1432562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:03.409+0100 [conn1432230] end connection 172.28.0.164:62117 (399 connections now open) 2015-10-05T09:14:03.410+0100 [mongosMain] connection accepted from 172.28.0.164:63127 #1432563 (400 connections now open) 2015-10-05T09:14:03.411+0100 [conn1432563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:10.120+0100 [conn1432203] end connection 172.28.0.163:52808 (399 connections now open) 2015-10-05T09:14:10.121+0100 [mongosMain] connection accepted from 172.28.0.163:53935 #1432564 (400 connections now open) 2015-10-05T09:14:10.122+0100 [conn1432564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:12.803+0100 [conn1432110] end connection 172.28.0.164:61725 (399 connections now open) 2015-10-05T09:14:12.805+0100 [mongosMain] connection accepted from 172.28.0.164:63137 #1432565 (400 connections now open) 2015-10-05T09:14:12.807+0100 [conn1432565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:13.427+0100 [conn1432235] end connection 172.28.0.164:62132 (399 connections now open) 2015-10-05T09:14:13.428+0100 [mongosMain] connection accepted from 172.28.0.164:63139 #1432566 (400 connections now open) 2015-10-05T09:14:13.429+0100 [conn1432566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:13.698+0100 [conn1431756] end connection 172.28.0.164:60646 (399 connections now open) 2015-10-05T09:14:13.699+0100 [mongosMain] connection accepted from 172.28.0.164:63142 #1432567 (400 connections now open) 2015-10-05T09:14:13.701+0100 [conn1432567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:14.536+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:14:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:14:14.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231565703b51053eed8f9 2015-10-05T09:14:15.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:20.120+0100 [conn1432224] end connection 172.28.0.163:52844 (399 connections now open) 2015-10-05T09:14:20.121+0100 [mongosMain] connection accepted from 172.28.0.163:53950 #1432568 (400 connections now open) 2015-10-05T09:14:20.122+0100 [conn1432568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:20.713+0100 [conn1432233] end connection 172.28.0.163:52866 (399 connections now open) 2015-10-05T09:14:20.714+0100 [mongosMain] connection accepted from 172.28.0.163:53953 #1432569 (400 connections now open) 2015-10-05T09:14:20.715+0100 [conn1432569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:21.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612315d5703b51053eed931 2015-10-05T09:14:21.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:22.803+0100 [conn1432194] end connection 172.28.0.164:62041 (399 connections now open) 2015-10-05T09:14:22.804+0100 [mongosMain] connection accepted from 172.28.0.164:63159 #1432570 (400 connections now open) 2015-10-05T09:14:22.806+0100 [conn1432570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:22.977+0100 [conn1432212] end connection 172.28.0.163:52827 (399 connections now open) 2015-10-05T09:14:22.978+0100 [mongosMain] connection accepted from 172.28.0.163:53956 #1432571 (400 connections now open) 2015-10-05T09:14:22.980+0100 [conn1432571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:23.427+0100 [conn1432240] end connection 172.28.0.164:62144 (399 connections now open) 2015-10-05T09:14:23.428+0100 [mongosMain] connection accepted from 172.28.0.164:63161 #1432572 (400 connections now open) 2015-10-05T09:14:23.430+0100 [conn1432572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:23.630+0100 [conn1431980] end connection 172.28.0.164:61305 (399 connections now open) 2015-10-05T09:14:23.631+0100 [conn1432197] end connection 172.28.0.164:62047 (398 connections now open) 2015-10-05T09:14:23.632+0100 [mongosMain] connection accepted from 172.28.0.164:63162 #1432573 (399 connections now open) 2015-10-05T09:14:23.633+0100 [mongosMain] connection accepted from 172.28.0.164:63164 #1432574 (400 connections now open) 2015-10-05T09:14:23.635+0100 [conn1432574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:23.636+0100 [conn1432573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:27.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231635703b51053eed969 2015-10-05T09:14:27.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:28.478+0100 [mongosMain] connection accepted from 127.0.0.1:53959 #1432575 (401 connections now open) 2015-10-05T09:14:28.481+0100 [conn1432575] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:28.487+0100 [conn1432575] end connection 127.0.0.1:53959 (400 connections now open) 2015-10-05T09:14:30.135+0100 [conn1432210] end connection 172.28.0.163:52821 (399 connections now open) 2015-10-05T09:14:30.136+0100 [mongosMain] connection accepted from 172.28.0.163:53960 #1432576 (400 connections now open) 2015-10-05T09:14:30.138+0100 [conn1432576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:30.727+0100 [conn1432245] end connection 172.28.0.163:52933 (399 connections now open) 2015-10-05T09:14:30.728+0100 [mongosMain] connection accepted from 172.28.0.163:53962 #1432577 (400 connections now open) 2015-10-05T09:14:30.729+0100 [conn1432577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:32.990+0100 [conn1432221] end connection 172.28.0.163:52837 (399 connections now open) 2015-10-05T09:14:32.991+0100 [mongosMain] connection accepted from 172.28.0.163:53964 #1432578 (400 connections now open) 2015-10-05T09:14:32.993+0100 [conn1432578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:33.442+0100 [conn1432249] end connection 172.28.0.164:62163 (399 connections now open) 2015-10-05T09:14:33.443+0100 [mongosMain] connection accepted from 172.28.0.164:63178 #1432579 (400 connections now open) 2015-10-05T09:14:33.445+0100 [conn1432579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:33.644+0100 [conn1432077] end connection 172.28.0.164:61567 (399 connections now open) 2015-10-05T09:14:33.645+0100 [conn1432023] end connection 172.28.0.164:61414 (398 connections now open) 2015-10-05T09:14:33.646+0100 [mongosMain] connection accepted from 172.28.0.164:63181 #1432580 (399 connections now open) 2015-10-05T09:14:33.646+0100 [mongosMain] connection accepted from 172.28.0.164:63182 #1432581 (400 connections now open) 2015-10-05T09:14:33.648+0100 [conn1432581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:33.648+0100 [conn1432580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:34.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612316a5703b51053eed998 2015-10-05T09:14:35.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:40.138+0100 [conn1432218] end connection 172.28.0.163:52833 (399 connections now open) 2015-10-05T09:14:40.139+0100 [mongosMain] connection accepted from 172.28.0.163:53968 #1432582 (400 connections now open) 2015-10-05T09:14:40.139+0100 [conn1432582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:40.201+0100 [mongosMain] connection accepted from 127.0.0.1:53970 #1432583 (401 connections now open) 2015-10-05T09:14:40.203+0100 [conn1432583] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:40.207+0100 [conn1432583] end connection 127.0.0.1:53970 (400 connections now open) 2015-10-05T09:14:40.744+0100 [conn1432252] end connection 172.28.0.163:52948 (399 connections now open) 2015-10-05T09:14:40.745+0100 [mongosMain] connection accepted from 172.28.0.163:53973 #1432584 (400 connections now open) 2015-10-05T09:14:40.756+0100 [conn1432584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:41.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231715703b51053eed9dc 2015-10-05T09:14:41.555+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:14:42.833+0100 [conn1432222] end connection 172.28.0.164:62095 (399 connections now open) 2015-10-05T09:14:42.834+0100 [mongosMain] connection accepted from 172.28.0.164:63198 #1432585 (400 connections now open) 2015-10-05T09:14:42.836+0100 [conn1432585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:43.457+0100 [conn1432257] end connection 172.28.0.164:62182 (399 connections now open) 2015-10-05T09:14:43.458+0100 [mongosMain] connection accepted from 172.28.0.164:63200 #1432586 (400 connections now open) 2015-10-05T09:14:43.460+0100 [conn1432586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:43.660+0100 [conn1432217] end connection 172.28.0.164:62091 (399 connections now open) 2015-10-05T09:14:43.660+0100 [conn1432154] end connection 172.28.0.164:61915 (398 connections now open) 2015-10-05T09:14:43.661+0100 [mongosMain] connection accepted from 172.28.0.164:63204 #1432587 (399 connections now open) 2015-10-05T09:14:43.661+0100 [mongosMain] connection accepted from 172.28.0.164:63203 #1432588 (400 connections now open) 2015-10-05T09:14:43.662+0100 [conn1432587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:43.663+0100 [conn1432588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:44.965+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:14:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:14:50.151+0100 [conn1432236] end connection 172.28.0.163:52884 (399 connections now open) 2015-10-05T09:14:50.152+0100 [mongosMain] connection accepted from 172.28.0.163:53986 #1432589 (400 connections now open) 2015-10-05T09:14:50.153+0100 [conn1432589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:53.457+0100 [conn1432265] end connection 172.28.0.164:62202 (399 connections now open) 2015-10-05T09:14:53.457+0100 [mongosMain] connection accepted from 172.28.0.164:63220 #1432590 (400 connections now open) 2015-10-05T09:14:53.459+0100 [conn1432590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:53.676+0100 [conn1432165] end connection 172.28.0.164:61946 (399 connections now open) 2015-10-05T09:14:53.677+0100 [conn1431991] end connection 172.28.0.164:61329 (398 connections now open) 2015-10-05T09:14:53.678+0100 [mongosMain] connection accepted from 172.28.0.164:63224 #1432591 (399 connections now open) 2015-10-05T09:14:53.678+0100 [mongosMain] connection accepted from 172.28.0.164:63225 #1432592 (400 connections now open) 2015-10-05T09:14:53.679+0100 [conn1432591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:53.680+0100 [conn1432592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:14:53.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612317d5703b51053eeda65 2015-10-05T09:14:53.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:00.161+0100 [conn1432244] end connection 172.28.0.163:52931 (399 connections now open) 2015-10-05T09:15:00.163+0100 [mongosMain] connection accepted from 172.28.0.163:54001 #1432593 (400 connections now open) 2015-10-05T09:15:00.164+0100 [conn1432593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:00.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231835703b51053eeda99 2015-10-05T09:15:00.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:00.759+0100 [conn1432267] end connection 172.28.0.163:52978 (399 connections now open) 2015-10-05T09:15:00.760+0100 [mongosMain] connection accepted from 172.28.0.163:54003 #1432594 (400 connections now open) 2015-10-05T09:15:00.761+0100 [conn1432594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:02.850+0100 [conn1432229] end connection 172.28.0.164:62114 (399 connections now open) 2015-10-05T09:15:02.851+0100 [mongosMain] connection accepted from 172.28.0.164:63242 #1432595 (400 connections now open) 2015-10-05T09:15:02.853+0100 [conn1432595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:03.473+0100 [conn1432272] end connection 172.28.0.164:62219 (399 connections now open) 2015-10-05T09:15:03.474+0100 [mongosMain] connection accepted from 172.28.0.164:63246 #1432596 (400 connections now open) 2015-10-05T09:15:03.476+0100 [conn1432596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:03.677+0100 [conn1432178] end connection 172.28.0.164:61996 (399 connections now open) 2015-10-05T09:15:03.677+0100 [conn1431602] end connection 172.28.0.164:60246 (399 connections now open) 2015-10-05T09:15:03.678+0100 [mongosMain] connection accepted from 172.28.0.164:63249 #1432597 (399 connections now open) 2015-10-05T09:15:03.678+0100 [mongosMain] connection accepted from 172.28.0.164:63250 #1432598 (400 connections now open) 2015-10-05T09:15:03.680+0100 [conn1432598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:03.680+0100 [conn1432597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:07.526+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612318b5703b51053eedb26 2015-10-05T09:15:07.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:10.166+0100 [conn1432231] end connection 172.28.0.163:52863 (399 connections now open) 2015-10-05T09:15:10.167+0100 [mongosMain] connection accepted from 172.28.0.163:54036 #1432599 (400 connections now open) 2015-10-05T09:15:10.168+0100 [conn1432599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:10.759+0100 [conn1432260] end connection 172.28.0.163:52958 (399 connections now open) 2015-10-05T09:15:10.760+0100 [mongosMain] connection accepted from 172.28.0.163:54038 #1432600 (400 connections now open) 2015-10-05T09:15:10.761+0100 [conn1432600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:12.865+0100 [conn1432254] end connection 172.28.0.164:62179 (399 connections now open) 2015-10-05T09:15:12.866+0100 [mongosMain] connection accepted from 172.28.0.164:63262 #1432601 (400 connections now open) 2015-10-05T09:15:12.868+0100 [conn1432601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:13.024+0100 [conn1432255] end connection 172.28.0.163:52950 (399 connections now open) 2015-10-05T09:15:13.025+0100 [mongosMain] connection accepted from 172.28.0.163:54042 #1432602 (400 connections now open) 2015-10-05T09:15:13.027+0100 [conn1432602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:13.473+0100 [conn1432280] end connection 172.28.0.164:62241 (399 connections now open) 2015-10-05T09:15:13.474+0100 [mongosMain] connection accepted from 172.28.0.164:63264 #1432603 (400 connections now open) 2015-10-05T09:15:13.475+0100 [conn1432603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:13.692+0100 [conn1432184] end connection 172.28.0.164:62014 (399 connections now open) 2015-10-05T09:15:13.693+0100 [conn1431986] end connection 172.28.0.164:61314 (398 connections now open) 2015-10-05T09:15:13.694+0100 [mongosMain] connection accepted from 172.28.0.164:63266 #1432604 (399 connections now open) 2015-10-05T09:15:13.694+0100 [mongosMain] connection accepted from 172.28.0.164:63267 #1432605 (400 connections now open) 2015-10-05T09:15:13.696+0100 [conn1432604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:13.696+0100 [conn1432605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:15.136+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:15:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:15:20.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231975703b51053eedbd2 2015-10-05T09:15:20.154+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:20.182+0100 [conn1432196] end connection 172.28.0.163:52777 (399 connections now open) 2015-10-05T09:15:20.183+0100 [mongosMain] connection accepted from 172.28.0.163:54050 #1432606 (400 connections now open) 2015-10-05T09:15:20.184+0100 [conn1432606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:20.775+0100 [conn1432274] end connection 172.28.0.163:52997 (399 connections now open) 2015-10-05T09:15:20.776+0100 [mongosMain] connection accepted from 172.28.0.163:54051 #1432607 (400 connections now open) 2015-10-05T09:15:20.777+0100 [conn1432607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:22.881+0100 [conn1432239] end connection 172.28.0.164:62141 (399 connections now open) 2015-10-05T09:15:22.882+0100 [mongosMain] connection accepted from 172.28.0.164:63280 #1432608 (400 connections now open) 2015-10-05T09:15:22.884+0100 [conn1432608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:23.038+0100 [conn1432167] end connection 172.28.0.163:52667 (399 connections now open) 2015-10-05T09:15:23.039+0100 [conn1431939] end connection 172.28.0.163:51916 (398 connections now open) 2015-10-05T09:15:23.040+0100 [mongosMain] connection accepted from 172.28.0.163:54056 #1432609 (399 connections now open) 2015-10-05T09:15:23.041+0100 [mongosMain] connection accepted from 172.28.0.163:54057 #1432610 (400 connections now open) 2015-10-05T09:15:23.041+0100 [conn1432609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:23.042+0100 [conn1432610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:23.489+0100 [conn1432287] end connection 172.28.0.164:62253 (399 connections now open) 2015-10-05T09:15:23.489+0100 [mongosMain] connection accepted from 172.28.0.164:63282 #1432611 (400 connections now open) 2015-10-05T09:15:23.490+0100 [conn1432611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:23.707+0100 [conn1432226] end connection 172.28.0.164:62110 (399 connections now open) 2015-10-05T09:15:23.707+0100 [conn1432190] end connection 172.28.0.164:62035 (399 connections now open) 2015-10-05T09:15:23.709+0100 [mongosMain] connection accepted from 172.28.0.164:63286 #1432612 (399 connections now open) 2015-10-05T09:15:23.709+0100 [mongosMain] connection accepted from 172.28.0.164:63285 #1432613 (400 connections now open) 2015-10-05T09:15:23.710+0100 [conn1432612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:23.711+0100 [conn1432613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:26.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612319e5703b51053eedc48 2015-10-05T09:15:26.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:28.854+0100 [mongosMain] connection accepted from 127.0.0.1:54062 #1432614 (401 connections now open) 2015-10-05T09:15:28.857+0100 [conn1432614] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:28.863+0100 [conn1432614] end connection 127.0.0.1:54062 (400 connections now open) 2015-10-05T09:15:30.185+0100 [conn1432251] end connection 172.28.0.163:52946 (399 connections now open) 2015-10-05T09:15:30.186+0100 [mongosMain] connection accepted from 172.28.0.163:54063 #1432615 (400 connections now open) 2015-10-05T09:15:30.187+0100 [conn1432615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:30.777+0100 [conn1432282] end connection 172.28.0.163:53027 (399 connections now open) 2015-10-05T09:15:30.778+0100 [mongosMain] connection accepted from 172.28.0.163:54066 #1432616 (400 connections now open) 2015-10-05T09:15:30.779+0100 [conn1432616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:32.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231a45703b51053eedccf 2015-10-05T09:15:32.897+0100 [conn1432277] end connection 172.28.0.164:62236 (399 connections now open) 2015-10-05T09:15:32.898+0100 [mongosMain] connection accepted from 172.28.0.164:63300 #1432617 (400 connections now open) 2015-10-05T09:15:32.900+0100 [conn1432617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:32.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:33.067+0100 [conn1432085] end connection 172.28.0.163:52291 (399 connections now open) 2015-10-05T09:15:33.068+0100 [conn1431945] end connection 172.28.0.163:51947 (398 connections now open) 2015-10-05T09:15:33.069+0100 [mongosMain] connection accepted from 172.28.0.163:54068 #1432618 (399 connections now open) 2015-10-05T09:15:33.070+0100 [conn1432618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:33.070+0100 [mongosMain] connection accepted from 172.28.0.163:54070 #1432619 (400 connections now open) 2015-10-05T09:15:33.071+0100 [conn1432619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:33.505+0100 [conn1432294] end connection 172.28.0.164:62276 (399 connections now open) 2015-10-05T09:15:33.507+0100 [mongosMain] connection accepted from 172.28.0.164:63303 #1432620 (400 connections now open) 2015-10-05T09:15:33.508+0100 [conn1432620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:33.723+0100 [conn1432059] end connection 172.28.0.164:61514 (399 connections now open) 2015-10-05T09:15:33.723+0100 [mongosMain] connection accepted from 172.28.0.164:63305 #1432621 (400 connections now open) 2015-10-05T09:15:33.725+0100 [conn1432621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:39.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231aa5703b51053eedd46 2015-10-05T09:15:39.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:15:39.471+0100 [mongosMain] connection accepted from 127.0.0.1:54077 #1432622 (401 connections now open) 2015-10-05T09:15:39.474+0100 [conn1432622] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:39.478+0100 [conn1432622] end connection 127.0.0.1:54077 (400 connections now open) 2015-10-05T09:15:40.198+0100 [conn1432259] end connection 172.28.0.163:52956 (399 connections now open) 2015-10-05T09:15:40.199+0100 [mongosMain] connection accepted from 172.28.0.163:54078 #1432623 (400 connections now open) 2015-10-05T09:15:40.201+0100 [conn1432623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:40.791+0100 [conn1432289] end connection 172.28.0.163:53040 (399 connections now open) 2015-10-05T09:15:40.792+0100 [mongosMain] connection accepted from 172.28.0.163:54081 #1432624 (400 connections now open) 2015-10-05T09:15:40.793+0100 [conn1432624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:42.912+0100 [conn1432243] end connection 172.28.0.164:62149 (399 connections now open) 2015-10-05T09:15:42.913+0100 [mongosMain] connection accepted from 172.28.0.164:63315 #1432625 (400 connections now open) 2015-10-05T09:15:42.914+0100 [conn1432625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:43.054+0100 [conn1432065] end connection 172.28.0.163:52258 (399 connections now open) 2015-10-05T09:15:43.054+0100 [conn1432139] end connection 172.28.0.163:52584 (399 connections now open) 2015-10-05T09:15:43.055+0100 [mongosMain] connection accepted from 172.28.0.163:54086 #1432626 (399 connections now open) 2015-10-05T09:15:43.055+0100 [mongosMain] connection accepted from 172.28.0.163:54087 #1432627 (400 connections now open) 2015-10-05T09:15:43.056+0100 [conn1432626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:43.056+0100 [conn1432627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:43.520+0100 [conn1432301] end connection 172.28.0.164:62300 (399 connections now open) 2015-10-05T09:15:43.522+0100 [mongosMain] connection accepted from 172.28.0.164:63319 #1432628 (400 connections now open) 2015-10-05T09:15:43.525+0100 [conn1432628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:43.740+0100 [conn1431594] end connection 172.28.0.164:60225 (399 connections now open) 2015-10-05T09:15:43.741+0100 [mongosMain] connection accepted from 172.28.0.164:63321 #1432629 (400 connections now open) 2015-10-05T09:15:43.743+0100 [conn1432629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:45.827+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:15:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:15:50.198+0100 [conn1432281] end connection 172.28.0.163:53023 (399 connections now open) 2015-10-05T09:15:50.199+0100 [mongosMain] connection accepted from 172.28.0.163:54102 #1432630 (400 connections now open) 2015-10-05T09:15:50.201+0100 [conn1432630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:50.806+0100 [conn1432297] end connection 172.28.0.163:53051 (399 connections now open) 2015-10-05T09:15:50.807+0100 [mongosMain] connection accepted from 172.28.0.163:54104 #1432631 (400 connections now open) 2015-10-05T09:15:50.809+0100 [conn1432631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:52.755+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:15:52.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:15:52.915+0100 [conn1432291] end connection 172.28.0.164:62270 (399 connections now open) 2015-10-05T09:15:52.916+0100 [mongosMain] connection accepted from 172.28.0.164:63332 #1432632 (400 connections now open) 2015-10-05T09:15:52.919+0100 [conn1432632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:53.055+0100 [conn1432270] end connection 172.28.0.163:52983 (399 connections now open) 2015-10-05T09:15:53.055+0100 [conn1432011] end connection 172.28.0.163:52087 (399 connections now open) 2015-10-05T09:15:53.056+0100 [mongosMain] connection accepted from 172.28.0.163:54108 #1432633 (399 connections now open) 2015-10-05T09:15:53.056+0100 [mongosMain] connection accepted from 172.28.0.163:54109 #1432634 (400 connections now open) 2015-10-05T09:15:53.057+0100 [conn1432633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:53.057+0100 [conn1432634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:53.538+0100 [conn1432308] end connection 172.28.0.164:62317 (399 connections now open) 2015-10-05T09:15:53.538+0100 [mongosMain] connection accepted from 172.28.0.164:63334 #1432635 (400 connections now open) 2015-10-05T09:15:53.540+0100 [conn1432635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:56.384+0100 [conn1431599] end connection 172.28.0.163:50909 (399 connections now open) 2015-10-05T09:15:56.386+0100 [mongosMain] connection accepted from 172.28.0.163:54115 #1432636 (400 connections now open) 2015-10-05T09:15:56.387+0100 [conn1432636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.819+0100 [conn1432026] end connection 172.28.0.163:52139 (399 connections now open) 2015-10-05T09:15:57.820+0100 [mongosMain] connection accepted from 172.28.0.163:54117 #1432637 (400 connections now open) 2015-10-05T09:15:57.821+0100 [conn1432248] end connection 172.28.0.163:52939 (399 connections now open) 2015-10-05T09:15:57.821+0100 [conn1432637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:54118 #1432638 (400 connections now open) 2015-10-05T09:15:57.823+0100 [conn1432638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.854+0100 [conn1432242] end connection 172.28.0.163:52920 (399 connections now open) 2015-10-05T09:15:57.854+0100 [conn1432234] end connection 172.28.0.163:52868 (399 connections now open) 2015-10-05T09:15:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:54119 #1432639 (399 connections now open) 2015-10-05T09:15:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:54120 #1432640 (400 connections now open) 2015-10-05T09:15:57.856+0100 [conn1432639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.856+0100 [conn1432640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.900+0100 [conn1432213] end connection 172.28.0.163:52830 (399 connections now open) 2015-10-05T09:15:57.900+0100 [conn1432018] end connection 172.28.0.163:52106 (398 connections now open) 2015-10-05T09:15:57.901+0100 [conn1431700] end connection 172.28.0.163:51140 (398 connections now open) 2015-10-05T09:15:57.901+0100 [mongosMain] connection accepted from 172.28.0.163:54121 #1432641 (398 connections now open) 2015-10-05T09:15:57.901+0100 [mongosMain] connection accepted from 172.28.0.163:54122 #1432642 (399 connections now open) 2015-10-05T09:15:57.901+0100 [mongosMain] connection accepted from 172.28.0.163:54123 #1432643 (400 connections now open) 2015-10-05T09:15:57.902+0100 [conn1432641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.902+0100 [conn1432642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.902+0100 [conn1432643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.963+0100 [conn1431987] end connection 172.28.0.163:52043 (399 connections now open) 2015-10-05T09:15:57.964+0100 [mongosMain] connection accepted from 172.28.0.163:54124 #1432644 (400 connections now open) 2015-10-05T09:15:57.965+0100 [conn1432644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:57.988+0100 [conn1431981] end connection 172.28.0.163:52027 (399 connections now open) 2015-10-05T09:15:57.989+0100 [mongosMain] connection accepted from 172.28.0.163:54125 #1432645 (400 connections now open) 2015-10-05T09:15:57.990+0100 [conn1432645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.701+0100 [conn1431970] end connection 172.28.0.163:51987 (399 connections now open) 2015-10-05T09:15:58.701+0100 [conn1431912] end connection 172.28.0.163:51838 (398 connections now open) 2015-10-05T09:15:58.702+0100 [mongosMain] connection accepted from 172.28.0.163:54128 #1432646 (399 connections now open) 2015-10-05T09:15:58.702+0100 [mongosMain] connection accepted from 172.28.0.163:54129 #1432647 (400 connections now open) 2015-10-05T09:15:58.703+0100 [mongosMain] connection accepted from 172.28.0.163:54130 #1432648 (401 connections now open) 2015-10-05T09:15:58.703+0100 [conn1432646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.703+0100 [mongosMain] connection accepted from 172.28.0.163:54131 #1432649 (402 connections now open) 2015-10-05T09:15:58.703+0100 [conn1432647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.703+0100 [conn1432648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.704+0100 [conn1432649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.746+0100 [mongosMain] connection accepted from 172.28.0.163:54132 #1432650 (403 connections now open) 2015-10-05T09:15:58.747+0100 [conn1432650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.764+0100 [mongosMain] connection accepted from 172.28.0.163:54133 #1432651 (404 connections now open) 2015-10-05T09:15:58.765+0100 [conn1432651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.766+0100 [mongosMain] connection accepted from 172.28.0.163:54134 #1432652 (405 connections now open) 2015-10-05T09:15:58.767+0100 [conn1432652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.863+0100 [mongosMain] connection accepted from 172.28.0.163:54135 #1432653 (406 connections now open) 2015-10-05T09:15:58.864+0100 [conn1432653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:58.931+0100 [mongosMain] connection accepted from 172.28.0.163:54136 #1432654 (407 connections now open) 2015-10-05T09:15:58.932+0100 [conn1432654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:15:59.341+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:15:59.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:16:00.214+0100 [conn1432273] end connection 172.28.0.163:52995 (406 connections now open) 2015-10-05T09:16:00.215+0100 [mongosMain] connection accepted from 172.28.0.163:54138 #1432655 (407 connections now open) 2015-10-05T09:16:00.216+0100 [conn1432655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:00.807+0100 [conn1432304] end connection 172.28.0.163:53069 (406 connections now open) 2015-10-05T09:16:00.808+0100 [mongosMain] connection accepted from 172.28.0.163:54142 #1432656 (407 connections now open) 2015-10-05T09:16:00.809+0100 [conn1432656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:02.927+0100 [conn1432269] end connection 172.28.0.164:62216 (406 connections now open) 2015-10-05T09:16:02.928+0100 [mongosMain] connection accepted from 172.28.0.164:63349 #1432657 (407 connections now open) 2015-10-05T09:16:02.929+0100 [conn1432657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:03.068+0100 [conn1432155] end connection 172.28.0.163:52630 (406 connections now open) 2015-10-05T09:16:03.069+0100 [mongosMain] connection accepted from 172.28.0.163:54152 #1432658 (407 connections now open) 2015-10-05T09:16:03.070+0100 [conn1432658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:03.552+0100 [conn1432314] end connection 172.28.0.164:62330 (406 connections now open) 2015-10-05T09:16:03.553+0100 [mongosMain] connection accepted from 172.28.0.164:63352 #1432659 (407 connections now open) 2015-10-05T09:16:03.556+0100 [conn1432659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:03.755+0100 [conn1432036] end connection 172.28.0.164:61442 (406 connections now open) 2015-10-05T09:16:03.756+0100 [mongosMain] connection accepted from 172.28.0.164:63355 #1432660 (407 connections now open) 2015-10-05T09:16:03.758+0100 [conn1432660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:10.215+0100 [conn1432266] end connection 172.28.0.163:52975 (406 connections now open) 2015-10-05T09:16:10.216+0100 [mongosMain] connection accepted from 172.28.0.163:54165 #1432661 (407 connections now open) 2015-10-05T09:16:10.218+0100 [conn1432661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:10.823+0100 [conn1432310] end connection 172.28.0.163:53087 (406 connections now open) 2015-10-05T09:16:10.824+0100 [mongosMain] connection accepted from 172.28.0.163:54167 #1432662 (407 connections now open) 2015-10-05T09:16:10.825+0100 [conn1432662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:13.086+0100 [conn1432144] end connection 172.28.0.163:52600 (406 connections now open) 2015-10-05T09:16:13.087+0100 [mongosMain] connection accepted from 172.28.0.163:54171 #1432663 (407 connections now open) 2015-10-05T09:16:13.088+0100 [conn1432663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:13.552+0100 [conn1432321] end connection 172.28.0.164:62353 (406 connections now open) 2015-10-05T09:16:13.553+0100 [mongosMain] connection accepted from 172.28.0.164:63361 #1432664 (407 connections now open) 2015-10-05T09:16:13.555+0100 [conn1432664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:13.771+0100 [conn1432043] end connection 172.28.0.164:61460 (406 connections now open) 2015-10-05T09:16:13.771+0100 [conn1432201] end connection 172.28.0.164:62064 (406 connections now open) 2015-10-05T09:16:13.772+0100 [mongosMain] connection accepted from 172.28.0.164:63364 #1432665 (406 connections now open) 2015-10-05T09:16:13.772+0100 [mongosMain] connection accepted from 172.28.0.164:63363 #1432666 (407 connections now open) 2015-10-05T09:16:13.773+0100 [conn1432665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:13.774+0100 [conn1432666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:16.373+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:16:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:16:20.262+0100 [conn1432296] end connection 172.28.0.163:53050 (406 connections now open) 2015-10-05T09:16:20.262+0100 [mongosMain] connection accepted from 172.28.0.163:54180 #1432667 (407 connections now open) 2015-10-05T09:16:20.262+0100 [conn1432667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:20.870+0100 [conn1432316] end connection 172.28.0.163:53106 (406 connections now open) 2015-10-05T09:16:20.870+0100 [mongosMain] connection accepted from 172.28.0.163:54184 #1432668 (407 connections now open) 2015-10-05T09:16:20.870+0100 [conn1432668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:22.959+0100 [conn1432318] end connection 172.28.0.164:62351 (406 connections now open) 2015-10-05T09:16:22.961+0100 [mongosMain] connection accepted from 172.28.0.164:63376 #1432669 (407 connections now open) 2015-10-05T09:16:22.963+0100 [conn1432669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:23.086+0100 [conn1432328] end connection 172.28.0.163:53145 (406 connections now open) 2015-10-05T09:16:23.087+0100 [mongosMain] connection accepted from 172.28.0.163:54188 #1432670 (407 connections now open) 2015-10-05T09:16:23.088+0100 [conn1432670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:23.567+0100 [conn1432329] end connection 172.28.0.164:62361 (406 connections now open) 2015-10-05T09:16:23.569+0100 [mongosMain] connection accepted from 172.28.0.164:63378 #1432671 (407 connections now open) 2015-10-05T09:16:23.571+0100 [conn1432671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:23.771+0100 [conn1431642] end connection 172.28.0.164:60346 (406 connections now open) 2015-10-05T09:16:23.771+0100 [conn1432290] end connection 172.28.0.164:62269 (406 connections now open) 2015-10-05T09:16:23.772+0100 [mongosMain] connection accepted from 172.28.0.164:63381 #1432672 (406 connections now open) 2015-10-05T09:16:23.772+0100 [mongosMain] connection accepted from 172.28.0.164:63380 #1432673 (407 connections now open) 2015-10-05T09:16:23.774+0100 [conn1432672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:23.774+0100 [conn1432673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:25.278+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561231d0d5de43e0ed5d38ef') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444032983884), why: "doing balance round", ts: ObjectId('561231d75703b51053eee122') } } gle1: { lastOp: Timestamp 1444032939000|3, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 1230, writtenTo: null, err: null, waited: 1230, ok: 1.0 } gle2: { lastOp: Timestamp 1444032984000|1, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T09:16:25.281+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:16:25.655+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231d75703b51053eee122 2015-10-05T09:16:25.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:16:29.050+0100 [mongosMain] connection accepted from 127.0.0.1:54194 #1432674 (408 connections now open) 2015-10-05T09:16:29.052+0100 [conn1432674] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:29.057+0100 [conn1432674] end connection 127.0.0.1:54194 (407 connections now open) 2015-10-05T09:16:30.231+0100 [conn1432241] end connection 172.28.0.163:52915 (406 connections now open) 2015-10-05T09:16:30.232+0100 [mongosMain] connection accepted from 172.28.0.163:54195 #1432675 (407 connections now open) 2015-10-05T09:16:30.234+0100 [conn1432675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:30.839+0100 [conn1432323] end connection 172.28.0.163:53140 (406 connections now open) 2015-10-05T09:16:30.840+0100 [mongosMain] connection accepted from 172.28.0.163:54197 #1432676 (407 connections now open) 2015-10-05T09:16:30.841+0100 [conn1432676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:31.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231df5703b51053eee1a5 2015-10-05T09:16:32.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:16:32.975+0100 [conn1432298] end connection 172.28.0.164:62295 (406 connections now open) 2015-10-05T09:16:32.976+0100 [mongosMain] connection accepted from 172.28.0.164:63396 #1432677 (407 connections now open) 2015-10-05T09:16:32.979+0100 [conn1432677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:33.101+0100 [conn1432150] end connection 172.28.0.163:52621 (406 connections now open) 2015-10-05T09:16:33.102+0100 [mongosMain] connection accepted from 172.28.0.163:54199 #1432678 (407 connections now open) 2015-10-05T09:16:33.103+0100 [conn1432678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:33.583+0100 [conn1432336] end connection 172.28.0.164:62379 (406 connections now open) 2015-10-05T09:16:33.584+0100 [mongosMain] connection accepted from 172.28.0.164:63399 #1432679 (407 connections now open) 2015-10-05T09:16:33.586+0100 [conn1432679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:33.786+0100 [conn1432209] end connection 172.28.0.164:62073 (406 connections now open) 2015-10-05T09:16:33.786+0100 [conn1431744] end connection 172.28.0.164:60607 (406 connections now open) 2015-10-05T09:16:33.787+0100 [mongosMain] connection accepted from 172.28.0.164:63401 #1432680 (406 connections now open) 2015-10-05T09:16:33.788+0100 [mongosMain] connection accepted from 172.28.0.164:63402 #1432681 (407 connections now open) 2015-10-05T09:16:33.789+0100 [conn1432681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:33.789+0100 [conn1432680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:36.719+0100 [conn1432202] end connection 172.28.0.164:62063 (406 connections now open) 2015-10-05T09:16:36.720+0100 [conn1432276] end connection 172.28.0.164:62234 (406 connections now open) 2015-10-05T09:16:36.721+0100 [mongosMain] connection accepted from 172.28.0.164:63405 #1432682 (406 connections now open) 2015-10-05T09:16:36.721+0100 [conn1432237] end connection 172.28.0.164:62137 (404 connections now open) 2015-10-05T09:16:36.721+0100 [mongosMain] connection accepted from 172.28.0.164:63406 #1432683 (406 connections now open) 2015-10-05T09:16:36.722+0100 [mongosMain] connection accepted from 172.28.0.164:63407 #1432684 (407 connections now open) 2015-10-05T09:16:36.723+0100 [conn1432683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:36.723+0100 [conn1432682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:36.724+0100 [conn1432684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:36.724+0100 [conn1432008] end connection 172.28.0.164:61368 (406 connections now open) 2015-10-05T09:16:36.726+0100 [mongosMain] connection accepted from 172.28.0.164:63408 #1432685 (407 connections now open) 2015-10-05T09:16:36.727+0100 [conn1432685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:36.939+0100 [conn1432198] end connection 172.28.0.164:62048 (406 connections now open) 2015-10-05T09:16:36.941+0100 [mongosMain] connection accepted from 172.28.0.164:63411 #1432686 (407 connections now open) 2015-10-05T09:16:36.943+0100 [conn1432686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:38.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231e65703b51053eee206 2015-10-05T09:16:38.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:16:39.351+0100 [mongosMain] connection accepted from 127.0.0.1:54201 #1432687 (408 connections now open) 2015-10-05T09:16:39.354+0100 [conn1432687] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:39.359+0100 [conn1432687] end connection 127.0.0.1:54201 (407 connections now open) 2015-10-05T09:16:40.244+0100 [conn1432322] end connection 172.28.0.163:53139 (406 connections now open) 2015-10-05T09:16:40.245+0100 [mongosMain] connection accepted from 172.28.0.163:54203 #1432688 (407 connections now open) 2015-10-05T09:16:40.246+0100 [conn1432688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:40.838+0100 [conn1432331] end connection 172.28.0.163:53155 (406 connections now open) 2015-10-05T09:16:40.839+0100 [mongosMain] connection accepted from 172.28.0.163:54205 #1432689 (407 connections now open) 2015-10-05T09:16:40.840+0100 [conn1432689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:42.993+0100 [conn1432311] end connection 172.28.0.164:62328 (406 connections now open) 2015-10-05T09:16:42.995+0100 [mongosMain] connection accepted from 172.28.0.164:63420 #1432690 (407 connections now open) 2015-10-05T09:16:42.997+0100 [conn1432690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:43.421+0100 [conn1431655] end connection 172.28.0.163:51034 (406 connections now open) 2015-10-05T09:16:43.599+0100 [conn1432345] end connection 172.28.0.164:62397 (405 connections now open) 2015-10-05T09:16:43.601+0100 [mongosMain] connection accepted from 172.28.0.164:63424 #1432691 (406 connections now open) 2015-10-05T09:16:43.604+0100 [conn1432691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:43.786+0100 [conn1431628] end connection 172.28.0.164:60317 (405 connections now open) 2015-10-05T09:16:43.787+0100 [conn1432174] end connection 172.28.0.164:61972 (404 connections now open) 2015-10-05T09:16:43.787+0100 [mongosMain] connection accepted from 172.28.0.164:63426 #1432692 (405 connections now open) 2015-10-05T09:16:43.787+0100 [mongosMain] connection accepted from 172.28.0.164:63427 #1432693 (406 connections now open) 2015-10-05T09:16:43.788+0100 [conn1432692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:43.789+0100 [conn1432693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:46.641+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:16:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:16:50.261+0100 [conn1432309] end connection 172.28.0.163:53084 (405 connections now open) 2015-10-05T09:16:50.262+0100 [mongosMain] connection accepted from 172.28.0.163:54218 #1432694 (406 connections now open) 2015-10-05T09:16:50.263+0100 [conn1432694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:50.854+0100 [conn1432339] end connection 172.28.0.163:53169 (405 connections now open) 2015-10-05T09:16:50.856+0100 [mongosMain] connection accepted from 172.28.0.163:54219 #1432695 (406 connections now open) 2015-10-05T09:16:50.857+0100 [conn1432695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:53.006+0100 [conn1432326] end connection 172.28.0.164:62359 (405 connections now open) 2015-10-05T09:16:53.007+0100 [mongosMain] connection accepted from 172.28.0.164:63437 #1432696 (406 connections now open) 2015-10-05T09:16:53.009+0100 [conn1432696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:53.614+0100 [conn1432354] end connection 172.28.0.164:62419 (405 connections now open) 2015-10-05T09:16:53.616+0100 [mongosMain] connection accepted from 172.28.0.164:63440 #1432697 (406 connections now open) 2015-10-05T09:16:53.617+0100 [conn1432697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:53.802+0100 [conn1432253] end connection 172.28.0.164:62176 (405 connections now open) 2015-10-05T09:16:53.803+0100 [mongosMain] connection accepted from 172.28.0.164:63442 #1432698 (406 connections now open) 2015-10-05T09:16:53.805+0100 [conn1432698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:16:57.351+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:16:57.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:17:00.265+0100 [conn1432315] end connection 172.28.0.163:53102 (405 connections now open) 2015-10-05T09:17:00.266+0100 [mongosMain] connection accepted from 172.28.0.163:54236 #1432699 (406 connections now open) 2015-10-05T09:17:00.266+0100 [conn1432699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:00.858+0100 [conn1432348] end connection 172.28.0.163:53179 (405 connections now open) 2015-10-05T09:17:00.860+0100 [mongosMain] connection accepted from 172.28.0.163:54239 #1432700 (406 connections now open) 2015-10-05T09:17:00.861+0100 [conn1432700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:03.023+0100 [conn1432285] end connection 172.28.0.164:62251 (405 connections now open) 2015-10-05T09:17:03.024+0100 [mongosMain] connection accepted from 172.28.0.164:63460 #1432701 (406 connections now open) 2015-10-05T09:17:03.025+0100 [conn1432701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:03.429+0100 [conn1431669] end connection 172.28.0.163:51065 (405 connections now open) 2015-10-05T09:17:03.630+0100 [conn1432361] end connection 172.28.0.164:62438 (404 connections now open) 2015-10-05T09:17:03.632+0100 [mongosMain] connection accepted from 172.28.0.164:63462 #1432702 (405 connections now open) 2015-10-05T09:17:03.633+0100 [conn1432702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:03.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561231ff5703b51053eee3c9 2015-10-05T09:17:03.802+0100 [conn1432275] end connection 172.28.0.164:62233 (404 connections now open) 2015-10-05T09:17:03.802+0100 [mongosMain] connection accepted from 172.28.0.164:63463 #1432703 (405 connections now open) 2015-10-05T09:17:03.811+0100 [conn1432703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:03.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:10.276+0100 [conn1432302] end connection 172.28.0.163:53064 (404 connections now open) 2015-10-05T09:17:10.277+0100 [mongosMain] connection accepted from 172.28.0.163:54256 #1432704 (405 connections now open) 2015-10-05T09:17:10.278+0100 [conn1432704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:10.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232065703b51053eee49c 2015-10-05T09:17:10.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:10.869+0100 [conn1432356] end connection 172.28.0.163:53199 (404 connections now open) 2015-10-05T09:17:10.870+0100 [mongosMain] connection accepted from 172.28.0.163:54259 #1432705 (405 connections now open) 2015-10-05T09:17:10.871+0100 [conn1432705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:13.064+0100 [conn1432262] end connection 172.28.0.164:62200 (404 connections now open) 2015-10-05T09:17:13.065+0100 [mongosMain] connection accepted from 172.28.0.164:63467 #1432706 (405 connections now open) 2015-10-05T09:17:13.067+0100 [conn1432706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:13.444+0100 [conn1432334] end connection 172.28.0.163:53161 (404 connections now open) 2015-10-05T09:17:13.445+0100 [mongosMain] connection accepted from 172.28.0.163:54263 #1432707 (405 connections now open) 2015-10-05T09:17:13.446+0100 [conn1432707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:13.631+0100 [conn1432367] end connection 172.28.0.164:62465 (404 connections now open) 2015-10-05T09:17:13.632+0100 [mongosMain] connection accepted from 172.28.0.164:63469 #1432708 (405 connections now open) 2015-10-05T09:17:13.634+0100 [conn1432708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:13.818+0100 [conn1432268] end connection 172.28.0.164:62214 (404 connections now open) 2015-10-05T09:17:13.819+0100 [mongosMain] connection accepted from 172.28.0.164:63471 #1432709 (405 connections now open) 2015-10-05T09:17:13.820+0100 [conn1432709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:16.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612320c5703b51053eee528 2015-10-05T09:17:16.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:16.908+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:17:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:17:20.278+0100 [conn1432330] end connection 172.28.0.163:53153 (404 connections now open) 2015-10-05T09:17:20.279+0100 [mongosMain] connection accepted from 172.28.0.163:54270 #1432710 (405 connections now open) 2015-10-05T09:17:20.280+0100 [conn1432710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:20.885+0100 [conn1432363] end connection 172.28.0.163:53218 (404 connections now open) 2015-10-05T09:17:20.886+0100 [mongosMain] connection accepted from 172.28.0.163:54273 #1432711 (405 connections now open) 2015-10-05T09:17:20.887+0100 [conn1432711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:23.461+0100 [conn1432292] end connection 172.28.0.163:53043 (404 connections now open) 2015-10-05T09:17:23.462+0100 [mongosMain] connection accepted from 172.28.0.163:54275 #1432712 (405 connections now open) 2015-10-05T09:17:23.463+0100 [conn1432712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:23.646+0100 [conn1432373] end connection 172.28.0.164:62474 (404 connections now open) 2015-10-05T09:17:23.648+0100 [mongosMain] connection accepted from 172.28.0.164:63482 #1432713 (405 connections now open) 2015-10-05T09:17:23.649+0100 [conn1432713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:23.834+0100 [conn1432160] end connection 172.28.0.164:61933 (404 connections now open) 2015-10-05T09:17:23.835+0100 [mongosMain] connection accepted from 172.28.0.164:63484 #1432714 (405 connections now open) 2015-10-05T09:17:23.836+0100 [conn1432714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:28.442+0100 [mongosMain] connection accepted from 127.0.0.1:54277 #1432715 (406 connections now open) 2015-10-05T09:17:28.444+0100 [conn1432715] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:28.449+0100 [conn1432715] end connection 127.0.0.1:54277 (405 connections now open) 2015-10-05T09:17:30.292+0100 [conn1432288] end connection 172.28.0.163:53038 (404 connections now open) 2015-10-05T09:17:30.294+0100 [mongosMain] connection accepted from 172.28.0.163:54278 #1432716 (405 connections now open) 2015-10-05T09:17:30.295+0100 [conn1432716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:30.886+0100 [conn1432369] end connection 172.28.0.163:53245 (404 connections now open) 2015-10-05T09:17:30.887+0100 [mongosMain] connection accepted from 172.28.0.163:54280 #1432717 (405 connections now open) 2015-10-05T09:17:30.888+0100 [conn1432717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:31.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232195703b51053eee62d 2015-10-05T09:17:31.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:33.085+0100 [conn1432359] end connection 172.28.0.164:62436 (404 connections now open) 2015-10-05T09:17:33.086+0100 [mongosMain] connection accepted from 172.28.0.164:63495 #1432718 (405 connections now open) 2015-10-05T09:17:33.089+0100 [conn1432718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:33.460+0100 [conn1432313] end connection 172.28.0.163:53092 (404 connections now open) 2015-10-05T09:17:33.462+0100 [mongosMain] connection accepted from 172.28.0.163:54284 #1432719 (405 connections now open) 2015-10-05T09:17:33.463+0100 [conn1432719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:33.662+0100 [conn1432381] end connection 172.28.0.164:62492 (404 connections now open) 2015-10-05T09:17:33.662+0100 [mongosMain] connection accepted from 172.28.0.164:63497 #1432720 (405 connections now open) 2015-10-05T09:17:33.664+0100 [conn1432720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:33.849+0100 [conn1431685] end connection 172.28.0.164:60451 (404 connections now open) 2015-10-05T09:17:33.850+0100 [mongosMain] connection accepted from 172.28.0.164:63499 #1432721 (405 connections now open) 2015-10-05T09:17:33.852+0100 [conn1432721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:37.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232215703b51053eee6b2 2015-10-05T09:17:37.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:39.970+0100 [mongosMain] connection accepted from 127.0.0.1:54286 #1432722 (406 connections now open) 2015-10-05T09:17:39.973+0100 [conn1432722] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:39.977+0100 [conn1432722] end connection 127.0.0.1:54286 (405 connections now open) 2015-10-05T09:17:40.293+0100 [conn1432338] end connection 172.28.0.163:53167 (404 connections now open) 2015-10-05T09:17:40.294+0100 [mongosMain] connection accepted from 172.28.0.163:54287 #1432723 (405 connections now open) 2015-10-05T09:17:40.295+0100 [conn1432723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:40.901+0100 [conn1432375] end connection 172.28.0.163:53260 (404 connections now open) 2015-10-05T09:17:40.903+0100 [mongosMain] connection accepted from 172.28.0.163:54290 #1432724 (405 connections now open) 2015-10-05T09:17:40.904+0100 [conn1432724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:43.101+0100 [conn1432305] end connection 172.28.0.164:62315 (404 connections now open) 2015-10-05T09:17:43.102+0100 [mongosMain] connection accepted from 172.28.0.164:63513 #1432725 (405 connections now open) 2015-10-05T09:17:43.103+0100 [conn1432725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:43.483+0100 [conn1432256] end connection 172.28.0.163:52951 (404 connections now open) 2015-10-05T09:17:43.484+0100 [mongosMain] connection accepted from 172.28.0.163:54296 #1432726 (405 connections now open) 2015-10-05T09:17:43.486+0100 [conn1432726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:43.661+0100 [conn1432390] end connection 172.28.0.164:62510 (404 connections now open) 2015-10-05T09:17:43.662+0100 [mongosMain] connection accepted from 172.28.0.164:63515 #1432727 (405 connections now open) 2015-10-05T09:17:43.663+0100 [conn1432727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:43.864+0100 [conn1431693] end connection 172.28.0.164:60470 (404 connections now open) 2015-10-05T09:17:43.865+0100 [mongosMain] connection accepted from 172.28.0.164:63518 #1432728 (405 connections now open) 2015-10-05T09:17:43.867+0100 [conn1432728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:44.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232275703b51053eee71e 2015-10-05T09:17:44.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:47.167+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:17:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:17:50.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612322e5703b51053eee78c 2015-10-05T09:17:50.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:17:53.116+0100 [conn1432365] end connection 172.28.0.164:62464 (404 connections now open) 2015-10-05T09:17:53.117+0100 [mongosMain] connection accepted from 172.28.0.164:63529 #1432729 (405 connections now open) 2015-10-05T09:17:53.119+0100 [conn1432729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:53.476+0100 [conn1432306] end connection 172.28.0.163:53073 (404 connections now open) 2015-10-05T09:17:53.477+0100 [mongosMain] connection accepted from 172.28.0.163:54308 #1432730 (405 connections now open) 2015-10-05T09:17:53.478+0100 [conn1432730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:17:53.663+0100 [conn1432395] end connection 172.28.0.164:62532 (404 connections now open) 2015-10-05T09:17:53.664+0100 [mongosMain] connection accepted from 172.28.0.164:63531 #1432731 (405 connections now open) 2015-10-05T09:17:53.665+0100 [conn1432731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:00.917+0100 [conn1432384] end connection 172.28.0.163:53269 (404 connections now open) 2015-10-05T09:18:00.918+0100 [mongosMain] connection accepted from 172.28.0.163:54324 #1432732 (405 connections now open) 2015-10-05T09:18:00.920+0100 [conn1432732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:02.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612323a5703b51053eee848 2015-10-05T09:18:03.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:18:03.131+0100 [conn1432351] end connection 172.28.0.164:62416 (404 connections now open) 2015-10-05T09:18:03.132+0100 [mongosMain] connection accepted from 172.28.0.164:63549 #1432733 (405 connections now open) 2015-10-05T09:18:03.134+0100 [conn1432733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:09.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232415703b51053eee8d3 2015-10-05T09:18:09.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:18:10.917+0100 [conn1432398] end connection 172.28.0.163:53311 (404 connections now open) 2015-10-05T09:18:10.918+0100 [mongosMain] connection accepted from 172.28.0.163:54355 #1432734 (405 connections now open) 2015-10-05T09:18:10.919+0100 [conn1432734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:13.132+0100 [conn1432342] end connection 172.28.0.164:62395 (404 connections now open) 2015-10-05T09:18:13.134+0100 [mongosMain] connection accepted from 172.28.0.164:63556 #1432735 (405 connections now open) 2015-10-05T09:18:13.135+0100 [conn1432735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:13.897+0100 [conn1431718] end connection 172.28.0.164:60532 (404 connections now open) 2015-10-05T09:18:13.898+0100 [mongosMain] connection accepted from 172.28.0.164:63559 #1432736 (405 connections now open) 2015-10-05T09:18:13.900+0100 [conn1432736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:17.443+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:18:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:18:20.932+0100 [conn1432400] end connection 172.28.0.163:53337 (404 connections now open) 2015-10-05T09:18:20.933+0100 [mongosMain] connection accepted from 172.28.0.163:54366 #1432737 (405 connections now open) 2015-10-05T09:18:20.934+0100 [conn1432737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:23.147+0100 [conn1432378] end connection 172.28.0.164:62490 (404 connections now open) 2015-10-05T09:18:23.148+0100 [mongosMain] connection accepted from 172.28.0.164:63575 #1432738 (405 connections now open) 2015-10-05T09:18:23.149+0100 [conn1432738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:23.507+0100 [conn1432299] end connection 172.28.0.163:53058 (404 connections now open) 2015-10-05T09:18:23.508+0100 [mongosMain] connection accepted from 172.28.0.163:54371 #1432739 (405 connections now open) 2015-10-05T09:18:23.509+0100 [conn1432739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:23.695+0100 [conn1432402] end connection 172.28.0.164:62578 (404 connections now open) 2015-10-05T09:18:23.696+0100 [mongosMain] connection accepted from 172.28.0.164:63577 #1432740 (405 connections now open) 2015-10-05T09:18:23.698+0100 [conn1432740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:29.123+0100 [mongosMain] connection accepted from 127.0.0.1:54373 #1432741 (406 connections now open) 2015-10-05T09:18:29.126+0100 [conn1432741] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:29.131+0100 [conn1432741] end connection 127.0.0.1:54373 (405 connections now open) 2015-10-05T09:18:30.934+0100 [conn1432403] end connection 172.28.0.163:53345 (404 connections now open) 2015-10-05T09:18:30.936+0100 [mongosMain] connection accepted from 172.28.0.163:54375 #1432742 (405 connections now open) 2015-10-05T09:18:30.937+0100 [conn1432742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:33.163+0100 [conn1432387] end connection 172.28.0.164:62507 (404 connections now open) 2015-10-05T09:18:33.164+0100 [mongosMain] connection accepted from 172.28.0.164:63594 #1432743 (405 connections now open) 2015-10-05T09:18:33.166+0100 [conn1432743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:33.709+0100 [conn1432397] end connection 172.28.0.164:62548 (404 connections now open) 2015-10-05T09:18:33.710+0100 [mongosMain] connection accepted from 172.28.0.164:63596 #1432744 (405 connections now open) 2015-10-05T09:18:33.714+0100 [conn1432744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:34.430+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:18:34.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:18:39.419+0100 [mongosMain] connection accepted from 127.0.0.1:54378 #1432745 (406 connections now open) 2015-10-05T09:18:39.422+0100 [conn1432745] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:39.426+0100 [conn1432745] end connection 127.0.0.1:54378 (405 connections now open) 2015-10-05T09:18:40.947+0100 [conn1432408] end connection 172.28.0.163:53355 (404 connections now open) 2015-10-05T09:18:40.948+0100 [mongosMain] connection accepted from 172.28.0.163:54383 #1432746 (405 connections now open) 2015-10-05T09:18:40.949+0100 [conn1432746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:43.179+0100 [conn1432414] end connection 172.28.0.164:62628 (404 connections now open) 2015-10-05T09:18:43.180+0100 [mongosMain] connection accepted from 172.28.0.164:63615 #1432747 (405 connections now open) 2015-10-05T09:18:43.182+0100 [conn1432747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:43.710+0100 [conn1432406] end connection 172.28.0.164:62594 (404 connections now open) 2015-10-05T09:18:43.711+0100 [mongosMain] connection accepted from 172.28.0.164:63618 #1432748 (405 connections now open) 2015-10-05T09:18:43.712+0100 [conn1432748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:46.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232665703b51053eeeb48 2015-10-05T09:18:46.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:18:47.586+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:18:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:18:50.964+0100 [conn1432413] end connection 172.28.0.163:53363 (404 connections now open) 2015-10-05T09:18:50.965+0100 [mongosMain] connection accepted from 172.28.0.163:54400 #1432749 (405 connections now open) 2015-10-05T09:18:50.966+0100 [conn1432749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:53.195+0100 [conn1432371] end connection 172.28.0.164:62472 (404 connections now open) 2015-10-05T09:18:53.196+0100 [mongosMain] connection accepted from 172.28.0.164:63629 #1432750 (405 connections now open) 2015-10-05T09:18:53.198+0100 [conn1432750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:18:53.725+0100 [conn1432411] end connection 172.28.0.164:62610 (404 connections now open) 2015-10-05T09:18:53.726+0100 [mongosMain] connection accepted from 172.28.0.164:63631 #1432751 (405 connections now open) 2015-10-05T09:18:53.729+0100 [conn1432751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:00.965+0100 [conn1432417] end connection 172.28.0.163:53378 (404 connections now open) 2015-10-05T09:19:00.966+0100 [mongosMain] connection accepted from 172.28.0.163:54414 #1432752 (405 connections now open) 2015-10-05T09:19:00.967+0100 [conn1432752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:03.210+0100 [conn1432399] end connection 172.28.0.164:62565 (404 connections now open) 2015-10-05T09:19:03.211+0100 [mongosMain] connection accepted from 172.28.0.164:63645 #1432753 (405 connections now open) 2015-10-05T09:19:03.212+0100 [conn1432753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:03.741+0100 [conn1432416] end connection 172.28.0.164:62632 (404 connections now open) 2015-10-05T09:19:03.742+0100 [mongosMain] connection accepted from 172.28.0.164:63648 #1432754 (405 connections now open) 2015-10-05T09:19:03.743+0100 [conn1432754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:10.980+0100 [conn1432421] end connection 172.28.0.163:53392 (404 connections now open) 2015-10-05T09:19:10.981+0100 [mongosMain] connection accepted from 172.28.0.163:54438 #1432755 (405 connections now open) 2015-10-05T09:19:10.982+0100 [conn1432755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:11.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612327f5703b51053eeec9f 2015-10-05T09:19:11.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:19:13.226+0100 [conn1432404] end connection 172.28.0.164:62592 (404 connections now open) 2015-10-05T09:19:13.226+0100 [mongosMain] connection accepted from 172.28.0.164:63658 #1432756 (405 connections now open) 2015-10-05T09:19:13.227+0100 [conn1432756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:13.756+0100 [conn1432420] end connection 172.28.0.164:62651 (404 connections now open) 2015-10-05T09:19:13.757+0100 [mongosMain] connection accepted from 172.28.0.164:63660 #1432757 (405 connections now open) 2015-10-05T09:19:13.759+0100 [conn1432757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:17.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232855703b51053eeecf2 2015-10-05T09:19:17.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:19:17.719+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:19:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:19:20.980+0100 [conn1432424] end connection 172.28.0.163:53427 (404 connections now open) 2015-10-05T09:19:20.981+0100 [mongosMain] connection accepted from 172.28.0.163:54450 #1432758 (405 connections now open) 2015-10-05T09:19:20.982+0100 [conn1432758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:23.226+0100 [conn1432409] end connection 172.28.0.164:62608 (404 connections now open) 2015-10-05T09:19:23.228+0100 [mongosMain] connection accepted from 172.28.0.164:63672 #1432759 (405 connections now open) 2015-10-05T09:19:23.229+0100 [conn1432759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:24.045+0100 [conn1432426] end connection 172.28.0.163:53431 (404 connections now open) 2015-10-05T09:19:24.046+0100 [mongosMain] connection accepted from 172.28.0.163:54452 #1432760 (405 connections now open) 2015-10-05T09:19:24.047+0100 [conn1432760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:24.378+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:19:24.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:19:24.461+0100 [conn1432148] end connection 172.28.0.164:61888 (404 connections now open) 2015-10-05T09:19:24.464+0100 [mongosMain] connection accepted from 172.28.0.164:63676 #1432761 (405 connections now open) 2015-10-05T09:19:24.466+0100 [conn1432761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:28.577+0100 [mongosMain] connection accepted from 127.0.0.1:54458 #1432762 (406 connections now open) 2015-10-05T09:19:28.580+0100 [conn1432762] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:28.586+0100 [conn1432762] end connection 127.0.0.1:54458 (405 connections now open) 2015-10-05T09:19:30.415+0100 [conn1432362] end connection 172.28.0.163:53215 (404 connections now open) 2015-10-05T09:19:30.417+0100 [mongosMain] connection accepted from 172.28.0.163:54460 #1432763 (405 connections now open) 2015-10-05T09:19:30.420+0100 [conn1432763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:31.485+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:19:31.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:19:33.243+0100 [conn1432425] end connection 172.28.0.164:62674 (404 connections now open) 2015-10-05T09:19:33.244+0100 [mongosMain] connection accepted from 172.28.0.164:63688 #1432764 (405 connections now open) 2015-10-05T09:19:33.246+0100 [conn1432764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:33.886+0100 [conn1432263] end connection 172.28.0.163:52964 (404 connections now open) 2015-10-05T09:19:33.887+0100 [mongosMain] connection accepted from 172.28.0.163:54461 #1432765 (405 connections now open) 2015-10-05T09:19:33.888+0100 [conn1432765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:34.413+0100 [conn1432386] end connection 172.28.0.164:62505 (404 connections now open) 2015-10-05T09:19:34.414+0100 [mongosMain] connection accepted from 172.28.0.164:63692 #1432766 (405 connections now open) 2015-10-05T09:19:34.417+0100 [conn1432766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:37.604+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:19:37.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:19:40.113+0100 [mongosMain] connection accepted from 127.0.0.1:54466 #1432767 (406 connections now open) 2015-10-05T09:19:40.116+0100 [conn1432767] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:40.121+0100 [conn1432767] end connection 127.0.0.1:54466 (405 connections now open) 2015-10-05T09:19:40.403+0100 [conn1432368] end connection 172.28.0.163:53242 (404 connections now open) 2015-10-05T09:19:40.405+0100 [mongosMain] connection accepted from 172.28.0.163:54469 #1432768 (405 connections now open) 2015-10-05T09:19:40.406+0100 [conn1432768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:43.779+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:19:43.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:19:43.883+0100 [conn1432320] end connection 172.28.0.163:53126 (404 connections now open) 2015-10-05T09:19:43.884+0100 [mongosMain] connection accepted from 172.28.0.163:54473 #1432769 (405 connections now open) 2015-10-05T09:19:43.885+0100 [conn1432769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:44.412+0100 [conn1432377] end connection 172.28.0.164:62486 (404 connections now open) 2015-10-05T09:19:44.413+0100 [mongosMain] connection accepted from 172.28.0.164:63706 #1432770 (405 connections now open) 2015-10-05T09:19:44.414+0100 [conn1432770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:48.011+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:19:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:19:53.898+0100 [conn1432405] end connection 172.28.0.163:53349 (404 connections now open) 2015-10-05T09:19:53.899+0100 [mongosMain] connection accepted from 172.28.0.163:54485 #1432771 (405 connections now open) 2015-10-05T09:19:53.899+0100 [conn1432771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:54.412+0100 [conn1432324] end connection 172.28.0.164:62357 (404 connections now open) 2015-10-05T09:19:54.413+0100 [mongosMain] connection accepted from 172.28.0.164:63717 #1432772 (405 connections now open) 2015-10-05T09:19:54.414+0100 [conn1432772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:19:56.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232ab5703b51053eeeeec 2015-10-05T09:19:57.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:20:03.819+0100 [conn1432432] end connection 172.28.0.164:62693 (404 connections now open) 2015-10-05T09:20:03.820+0100 [mongosMain] connection accepted from 172.28.0.164:63723 #1432773 (405 connections now open) 2015-10-05T09:20:03.822+0100 [conn1432773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:03.981+0100 [conn1432410] end connection 172.28.0.163:53357 (404 connections now open) 2015-10-05T09:20:03.982+0100 [mongosMain] connection accepted from 172.28.0.163:54511 #1432774 (405 connections now open) 2015-10-05T09:20:03.983+0100 [conn1432774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:04.428+0100 [conn1432116] end connection 172.28.0.164:61765 (404 connections now open) 2015-10-05T09:20:04.429+0100 [mongosMain] connection accepted from 172.28.0.164:63727 #1432775 (405 connections now open) 2015-10-05T09:20:04.430+0100 [conn1432775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:13.304+0100 [conn1432401] end connection 172.28.0.164:62576 (404 connections now open) 2015-10-05T09:20:13.305+0100 [mongosMain] connection accepted from 172.28.0.164:63737 #1432776 (405 connections now open) 2015-10-05T09:20:13.306+0100 [conn1432776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:13.992+0100 [conn1432279] end connection 172.28.0.163:53011 (404 connections now open) 2015-10-05T09:20:13.993+0100 [mongosMain] connection accepted from 172.28.0.163:54530 #1432777 (405 connections now open) 2015-10-05T09:20:13.994+0100 [conn1432777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:14.444+0100 [conn1432350] end connection 172.28.0.164:62414 (404 connections now open) 2015-10-05T09:20:14.445+0100 [mongosMain] connection accepted from 172.28.0.164:63739 #1432778 (405 connections now open) 2015-10-05T09:20:14.446+0100 [conn1432778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:15.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232bf5703b51053eef000 2015-10-05T09:20:15.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:20:18.685+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:20:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:20:21.042+0100 [conn1432428] end connection 172.28.0.163:53441 (404 connections now open) 2015-10-05T09:20:21.043+0100 [mongosMain] connection accepted from 172.28.0.163:54535 #1432779 (405 connections now open) 2015-10-05T09:20:21.044+0100 [conn1432779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:22.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232c55703b51053eef046 2015-10-05T09:20:22.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:20:23.850+0100 [conn1432427] end connection 172.28.0.164:62676 (404 connections now open) 2015-10-05T09:20:23.851+0100 [mongosMain] connection accepted from 172.28.0.164:63753 #1432780 (405 connections now open) 2015-10-05T09:20:23.852+0100 [conn1432780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:24.009+0100 [conn1432394] end connection 172.28.0.163:53287 (404 connections now open) 2015-10-05T09:20:24.010+0100 [mongosMain] connection accepted from 172.28.0.163:54537 #1432781 (405 connections now open) 2015-10-05T09:20:24.011+0100 [conn1432781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:24.444+0100 [conn1432171] end connection 172.28.0.164:61963 (404 connections now open) 2015-10-05T09:20:24.446+0100 [mongosMain] connection accepted from 172.28.0.164:63755 #1432782 (405 connections now open) 2015-10-05T09:20:24.447+0100 [conn1432782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:29.061+0100 [mongosMain] connection accepted from 127.0.0.1:54540 #1432783 (406 connections now open) 2015-10-05T09:20:29.064+0100 [conn1432783] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:29.069+0100 [conn1432783] end connection 127.0.0.1:54540 (405 connections now open) 2015-10-05T09:20:31.045+0100 [conn1432448] end connection 172.28.0.163:53545 (404 connections now open) 2015-10-05T09:20:31.046+0100 [mongosMain] connection accepted from 172.28.0.163:54546 #1432784 (405 connections now open) 2015-10-05T09:20:31.047+0100 [conn1432784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:33.866+0100 [conn1432451] end connection 172.28.0.164:62786 (404 connections now open) 2015-10-05T09:20:33.868+0100 [mongosMain] connection accepted from 172.28.0.164:63771 #1432785 (405 connections now open) 2015-10-05T09:20:33.870+0100 [conn1432785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:34.019+0100 [conn1432353] end connection 172.28.0.163:53185 (404 connections now open) 2015-10-05T09:20:34.020+0100 [mongosMain] connection accepted from 172.28.0.163:54552 #1432786 (405 connections now open) 2015-10-05T09:20:34.021+0100 [conn1432786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:34.458+0100 [conn1432261] end connection 172.28.0.164:62197 (404 connections now open) 2015-10-05T09:20:34.459+0100 [mongosMain] connection accepted from 172.28.0.164:63773 #1432787 (405 connections now open) 2015-10-05T09:20:34.460+0100 [conn1432787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:36.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232d25703b51053eef0f7 2015-10-05T09:20:38.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:20:40.012+0100 [mongosMain] connection accepted from 127.0.0.1:54557 #1432788 (406 connections now open) 2015-10-05T09:20:40.015+0100 [conn1432788] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:40.020+0100 [conn1432788] end connection 127.0.0.1:54557 (405 connections now open) 2015-10-05T09:20:41.059+0100 [conn1432453] end connection 172.28.0.163:53555 (404 connections now open) 2015-10-05T09:20:41.060+0100 [mongosMain] connection accepted from 172.28.0.163:54560 #1432789 (405 connections now open) 2015-10-05T09:20:41.061+0100 [conn1432789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:43.881+0100 [conn1432455] end connection 172.28.0.164:62802 (404 connections now open) 2015-10-05T09:20:43.883+0100 [mongosMain] connection accepted from 172.28.0.164:63787 #1432790 (405 connections now open) 2015-10-05T09:20:43.885+0100 [conn1432790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:44.028+0100 [conn1432423] end connection 172.28.0.163:53409 (404 connections now open) 2015-10-05T09:20:44.029+0100 [mongosMain] connection accepted from 172.28.0.163:54566 #1432791 (405 connections now open) 2015-10-05T09:20:44.030+0100 [conn1432791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:44.475+0100 [conn1432283] end connection 172.28.0.164:62247 (404 connections now open) 2015-10-05T09:20:44.476+0100 [mongosMain] connection accepted from 172.28.0.164:63789 #1432792 (405 connections now open) 2015-10-05T09:20:44.478+0100 [conn1432792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:45.867+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:20:45.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:20:48.837+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:20:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:20:52.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232e35703b51053eef21d 2015-10-05T09:20:52.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:20:53.882+0100 [conn1432459] end connection 172.28.0.164:62818 (404 connections now open) 2015-10-05T09:20:53.883+0100 [mongosMain] connection accepted from 172.28.0.164:63800 #1432793 (405 connections now open) 2015-10-05T09:20:53.885+0100 [conn1432793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:54.036+0100 [conn1432060] end connection 172.28.0.163:52228 (404 connections now open) 2015-10-05T09:20:54.038+0100 [mongosMain] connection accepted from 172.28.0.163:54576 #1432794 (405 connections now open) 2015-10-05T09:20:54.038+0100 [conn1432794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:54.475+0100 [conn1432357] end connection 172.28.0.164:62432 (404 connections now open) 2015-10-05T09:20:54.476+0100 [mongosMain] connection accepted from 172.28.0.164:63802 #1432795 (405 connections now open) 2015-10-05T09:20:54.479+0100 [conn1432795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:20:58.370+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:20:58.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:21:00.483+0100 [conn1432346] end connection 172.28.0.163:53177 (404 connections now open) 2015-10-05T09:21:00.484+0100 [mongosMain] connection accepted from 172.28.0.163:54585 #1432796 (405 connections now open) 2015-10-05T09:21:00.485+0100 [conn1432796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:01.073+0100 [conn1432457] end connection 172.28.0.163:53566 (404 connections now open) 2015-10-05T09:21:01.074+0100 [mongosMain] connection accepted from 172.28.0.163:54593 #1432797 (405 connections now open) 2015-10-05T09:21:01.075+0100 [conn1432797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:04.039+0100 [conn1432379] end connection 172.28.0.163:53263 (404 connections now open) 2015-10-05T09:21:04.040+0100 [mongosMain] connection accepted from 172.28.0.163:54608 #1432798 (405 connections now open) 2015-10-05T09:21:04.040+0100 [conn1432798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:04.491+0100 [conn1432435] end connection 172.28.0.164:62709 (404 connections now open) 2015-10-05T09:21:04.492+0100 [mongosMain] connection accepted from 172.28.0.164:63813 #1432799 (405 connections now open) 2015-10-05T09:21:04.493+0100 [conn1432799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:04.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232f05703b51053eef2f1 2015-10-05T09:21:04.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:21:10.482+0100 [conn1432383] end connection 172.28.0.163:53267 (404 connections now open) 2015-10-05T09:21:10.483+0100 [mongosMain] connection accepted from 172.28.0.163:54615 #1432800 (405 connections now open) 2015-10-05T09:21:10.484+0100 [conn1432800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:13.383+0100 [conn1432422] end connection 172.28.0.164:62665 (404 connections now open) 2015-10-05T09:21:13.384+0100 [mongosMain] connection accepted from 172.28.0.164:63817 #1432801 (405 connections now open) 2015-10-05T09:21:13.386+0100 [conn1432801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:13.913+0100 [conn1432461] end connection 172.28.0.164:62832 (404 connections now open) 2015-10-05T09:21:13.914+0100 [mongosMain] connection accepted from 172.28.0.164:63819 #1432802 (405 connections now open) 2015-10-05T09:21:13.918+0100 [conn1432802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:14.040+0100 [conn1432247] end connection 172.28.0.163:52938 (404 connections now open) 2015-10-05T09:21:14.041+0100 [mongosMain] connection accepted from 172.28.0.163:54617 #1432803 (405 connections now open) 2015-10-05T09:21:14.042+0100 [conn1432803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:14.506+0100 [conn1432439] end connection 172.28.0.164:62731 (404 connections now open) 2015-10-05T09:21:14.507+0100 [mongosMain] connection accepted from 172.28.0.164:63821 #1432804 (405 connections now open) 2015-10-05T09:21:14.509+0100 [conn1432804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:17.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561232fc5703b51053eef3d1 2015-10-05T09:21:17.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:21:19.094+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:21:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:21:20.498+0100 [conn1432392] end connection 172.28.0.163:53282 (404 connections now open) 2015-10-05T09:21:20.499+0100 [mongosMain] connection accepted from 172.28.0.163:54625 #1432805 (405 connections now open) 2015-10-05T09:21:20.500+0100 [conn1432805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:21.090+0100 [conn1432463] end connection 172.28.0.163:53597 (404 connections now open) 2015-10-05T09:21:21.091+0100 [mongosMain] connection accepted from 172.28.0.163:54626 #1432806 (405 connections now open) 2015-10-05T09:21:21.091+0100 [conn1432806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:23.399+0100 [conn1432429] end connection 172.28.0.164:62688 (404 connections now open) 2015-10-05T09:21:23.400+0100 [mongosMain] connection accepted from 172.28.0.164:63836 #1432807 (405 connections now open) 2015-10-05T09:21:23.401+0100 [conn1432807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:23.929+0100 [conn1432468] end connection 172.28.0.164:62857 (404 connections now open) 2015-10-05T09:21:23.930+0100 [mongosMain] connection accepted from 172.28.0.164:63840 #1432808 (405 connections now open) 2015-10-05T09:21:23.932+0100 [conn1432808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:24.080+0100 [conn1432431] end connection 172.28.0.163:53443 (404 connections now open) 2015-10-05T09:21:24.083+0100 [mongosMain] connection accepted from 172.28.0.163:54627 #1432809 (405 connections now open) 2015-10-05T09:21:24.084+0100 [conn1432809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:24.510+0100 [conn1432332] end connection 172.28.0.164:62372 (404 connections now open) 2015-10-05T09:21:24.510+0100 [mongosMain] connection accepted from 172.28.0.164:63842 #1432810 (405 connections now open) 2015-10-05T09:21:24.513+0100 [conn1432810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:28.629+0100 [mongosMain] connection accepted from 127.0.0.1:54628 #1432811 (406 connections now open) 2015-10-05T09:21:28.632+0100 [conn1432811] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:28.637+0100 [conn1432811] end connection 127.0.0.1:54628 (405 connections now open) 2015-10-05T09:21:30.500+0100 [conn1432374] end connection 172.28.0.163:53258 (404 connections now open) 2015-10-05T09:21:30.501+0100 [mongosMain] connection accepted from 172.28.0.163:54629 #1432812 (405 connections now open) 2015-10-05T09:21:30.502+0100 [conn1432812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:31.106+0100 [conn1432470] end connection 172.28.0.163:53634 (404 connections now open) 2015-10-05T09:21:31.107+0100 [mongosMain] connection accepted from 172.28.0.163:54630 #1432813 (405 connections now open) 2015-10-05T09:21:31.108+0100 [conn1432813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:33.945+0100 [conn1432474] end connection 172.28.0.164:62874 (404 connections now open) 2015-10-05T09:21:33.946+0100 [mongosMain] connection accepted from 172.28.0.164:63854 #1432814 (405 connections now open) 2015-10-05T09:21:33.947+0100 [conn1432814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:34.092+0100 [conn1432444] end connection 172.28.0.163:53509 (404 connections now open) 2015-10-05T09:21:34.096+0100 [mongosMain] connection accepted from 172.28.0.163:54633 #1432815 (405 connections now open) 2015-10-05T09:21:34.098+0100 [conn1432815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:34.522+0100 [conn1432143] end connection 172.28.0.164:61869 (404 connections now open) 2015-10-05T09:21:34.523+0100 [mongosMain] connection accepted from 172.28.0.164:63857 #1432816 (405 connections now open) 2015-10-05T09:21:34.524+0100 [conn1432816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:36.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612330f5703b51053eef523 2015-10-05T09:21:36.197+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:21:40.172+0100 [mongosMain] connection accepted from 127.0.0.1:54636 #1432817 (406 connections now open) 2015-10-05T09:21:40.175+0100 [conn1432817] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:40.181+0100 [conn1432817] end connection 127.0.0.1:54636 (405 connections now open) 2015-10-05T09:21:40.513+0100 [conn1432355] end connection 172.28.0.163:53196 (404 connections now open) 2015-10-05T09:21:40.514+0100 [mongosMain] connection accepted from 172.28.0.163:54637 #1432818 (405 connections now open) 2015-10-05T09:21:40.516+0100 [conn1432818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:41.107+0100 [conn1432477] end connection 172.28.0.163:53657 (404 connections now open) 2015-10-05T09:21:41.108+0100 [mongosMain] connection accepted from 172.28.0.163:54638 #1432819 (405 connections now open) 2015-10-05T09:21:41.110+0100 [conn1432819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:43.430+0100 [conn1432418] end connection 172.28.0.164:62645 (404 connections now open) 2015-10-05T09:21:43.431+0100 [mongosMain] connection accepted from 172.28.0.164:63869 #1432820 (405 connections now open) 2015-10-05T09:21:43.433+0100 [conn1432820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:43.961+0100 [conn1432480] end connection 172.28.0.164:62891 (404 connections now open) 2015-10-05T09:21:43.962+0100 [mongosMain] connection accepted from 172.28.0.164:63871 #1432821 (405 connections now open) 2015-10-05T09:21:43.964+0100 [conn1432821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:44.086+0100 [conn1432436] end connection 172.28.0.163:53451 (404 connections now open) 2015-10-05T09:21:44.088+0100 [mongosMain] connection accepted from 172.28.0.163:54645 #1432822 (405 connections now open) 2015-10-05T09:21:44.089+0100 [conn1432822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:44.523+0100 [conn1432246] end connection 172.28.0.164:62160 (404 connections now open) 2015-10-05T09:21:44.524+0100 [mongosMain] connection accepted from 172.28.0.164:63873 #1432823 (405 connections now open) 2015-10-05T09:21:44.525+0100 [conn1432823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:50.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612331c5703b51053eef660 2015-10-05T09:21:50.515+0100 [conn1432462] end connection 172.28.0.163:53594 (404 connections now open) 2015-10-05T09:21:50.516+0100 [mongosMain] connection accepted from 172.28.0.163:54654 #1432824 (405 connections now open) 2015-10-05T09:21:50.517+0100 [conn1432824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:50.826+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:21:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:21:50.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:21:51.122+0100 [conn1432483] end connection 172.28.0.163:53665 (404 connections now open) 2015-10-05T09:21:51.123+0100 [mongosMain] connection accepted from 172.28.0.163:54655 #1432825 (405 connections now open) 2015-10-05T09:21:51.125+0100 [conn1432825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:53.446+0100 [conn1432434] end connection 172.28.0.164:62707 (404 connections now open) 2015-10-05T09:21:53.447+0100 [mongosMain] connection accepted from 172.28.0.164:63886 #1432826 (405 connections now open) 2015-10-05T09:21:53.448+0100 [conn1432826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:53.976+0100 [conn1432486] end connection 172.28.0.164:62905 (404 connections now open) 2015-10-05T09:21:53.978+0100 [mongosMain] connection accepted from 172.28.0.164:63888 #1432827 (405 connections now open) 2015-10-05T09:21:53.980+0100 [conn1432827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:54.087+0100 [conn1432415] end connection 172.28.0.163:53369 (404 connections now open) 2015-10-05T09:21:54.088+0100 [mongosMain] connection accepted from 172.28.0.163:54660 #1432828 (405 connections now open) 2015-10-05T09:21:54.089+0100 [conn1432828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:21:54.538+0100 [conn1432341] end connection 172.28.0.164:62392 (404 connections now open) 2015-10-05T09:21:54.539+0100 [mongosMain] connection accepted from 172.28.0.164:63889 #1432829 (405 connections now open) 2015-10-05T09:21:54.541+0100 [conn1432829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:00.529+0100 [conn1432466] end connection 172.28.0.163:53621 (404 connections now open) 2015-10-05T09:22:00.530+0100 [mongosMain] connection accepted from 172.28.0.163:54678 #1432830 (405 connections now open) 2015-10-05T09:22:00.531+0100 [conn1432830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:01.126+0100 [conn1432488] end connection 172.28.0.163:53684 (404 connections now open) 2015-10-05T09:22:01.129+0100 [mongosMain] connection accepted from 172.28.0.163:54682 #1432831 (405 connections now open) 2015-10-05T09:22:01.130+0100 [conn1432831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:03.461+0100 [conn1432464] end connection 172.28.0.164:62849 (404 connections now open) 2015-10-05T09:22:03.462+0100 [mongosMain] connection accepted from 172.28.0.164:63905 #1432832 (405 connections now open) 2015-10-05T09:22:03.464+0100 [conn1432832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:03.972+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:22:03.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:22:03.991+0100 [conn1432491] end connection 172.28.0.164:62919 (404 connections now open) 2015-10-05T09:22:03.993+0100 [mongosMain] connection accepted from 172.28.0.164:63907 #1432833 (405 connections now open) 2015-10-05T09:22:03.998+0100 [conn1432833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:04.539+0100 [conn1432443] end connection 172.28.0.164:62757 (404 connections now open) 2015-10-05T09:22:04.540+0100 [mongosMain] connection accepted from 172.28.0.164:63909 #1432834 (405 connections now open) 2015-10-05T09:22:04.542+0100 [conn1432834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:10.535+0100 [conn1432445] end connection 172.28.0.163:53531 (404 connections now open) 2015-10-05T09:22:10.536+0100 [mongosMain] connection accepted from 172.28.0.163:54706 #1432835 (405 connections now open) 2015-10-05T09:22:10.537+0100 [conn1432835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:11.137+0100 [conn1432493] end connection 172.28.0.163:53699 (404 connections now open) 2015-10-05T09:22:11.139+0100 [mongosMain] connection accepted from 172.28.0.163:54708 #1432836 (405 connections now open) 2015-10-05T09:22:11.140+0100 [conn1432836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:14.402+0100 [conn1432447] end connection 172.28.0.163:53537 (404 connections now open) 2015-10-05T09:22:14.408+0100 [mongosMain] connection accepted from 172.28.0.163:54716 #1432837 (405 connections now open) 2015-10-05T09:22:14.409+0100 [conn1432837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:14.554+0100 [conn1432442] end connection 172.28.0.164:62746 (404 connections now open) 2015-10-05T09:22:14.555+0100 [mongosMain] connection accepted from 172.28.0.164:63913 #1432838 (405 connections now open) 2015-10-05T09:22:14.557+0100 [conn1432838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:16.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233375703b51053eef812 2015-10-05T09:22:16.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:22:20.545+0100 [conn1432482] end connection 172.28.0.163:53663 (404 connections now open) 2015-10-05T09:22:20.547+0100 [mongosMain] connection accepted from 172.28.0.163:54721 #1432839 (405 connections now open) 2015-10-05T09:22:20.548+0100 [conn1432839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:21.169+0100 [conn1432499] end connection 172.28.0.163:53726 (404 connections now open) 2015-10-05T09:22:21.169+0100 [mongosMain] connection accepted from 172.28.0.163:54725 #1432840 (405 connections now open) 2015-10-05T09:22:21.169+0100 [conn1432840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:21.231+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:22:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:22:23.509+0100 [conn1432438] end connection 172.28.0.164:62729 (404 connections now open) 2015-10-05T09:22:23.509+0100 [mongosMain] connection accepted from 172.28.0.164:63922 #1432841 (405 connections now open) 2015-10-05T09:22:23.525+0100 [conn1432841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:24.039+0100 [conn1432497] end connection 172.28.0.164:62939 (404 connections now open) 2015-10-05T09:22:24.039+0100 [mongosMain] connection accepted from 172.28.0.164:63926 #1432842 (405 connections now open) 2015-10-05T09:22:24.055+0100 [conn1432842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:24.258+0100 [conn1432472] end connection 172.28.0.163:53638 (404 connections now open) 2015-10-05T09:22:24.258+0100 [mongosMain] connection accepted from 172.28.0.163:54729 #1432843 (405 connections now open) 2015-10-05T09:22:24.258+0100 [conn1432843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:24.570+0100 [conn1432460] end connection 172.28.0.164:62829 (404 connections now open) 2015-10-05T09:22:24.570+0100 [mongosMain] connection accepted from 172.28.0.164:63928 #1432844 (405 connections now open) 2015-10-05T09:22:24.585+0100 [conn1432844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:29.138+0100 [mongosMain] connection accepted from 127.0.0.1:54732 #1432845 (406 connections now open) 2015-10-05T09:22:29.141+0100 [conn1432845] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:29.146+0100 [conn1432845] end connection 127.0.0.1:54732 (405 connections now open) 2015-10-05T09:22:29.632+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:22:29.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:22:30.560+0100 [conn1432441] end connection 172.28.0.163:53482 (404 connections now open) 2015-10-05T09:22:30.561+0100 [mongosMain] connection accepted from 172.28.0.163:54733 #1432846 (405 connections now open) 2015-10-05T09:22:30.562+0100 [conn1432846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:31.152+0100 [conn1432505] end connection 172.28.0.163:53742 (404 connections now open) 2015-10-05T09:22:31.154+0100 [mongosMain] connection accepted from 172.28.0.163:54735 #1432847 (405 connections now open) 2015-10-05T09:22:31.154+0100 [conn1432847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:33.509+0100 [conn1432500] end connection 172.28.0.164:62948 (404 connections now open) 2015-10-05T09:22:33.510+0100 [mongosMain] connection accepted from 172.28.0.164:63943 #1432848 (405 connections now open) 2015-10-05T09:22:33.512+0100 [conn1432848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:34.039+0100 [conn1432508] end connection 172.28.0.164:62967 (404 connections now open) 2015-10-05T09:22:34.040+0100 [mongosMain] connection accepted from 172.28.0.164:63945 #1432849 (405 connections now open) 2015-10-05T09:22:34.041+0100 [conn1432849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:34.238+0100 [conn1432419] end connection 172.28.0.163:53384 (404 connections now open) 2015-10-05T09:22:34.239+0100 [mongosMain] connection accepted from 172.28.0.163:54740 #1432850 (405 connections now open) 2015-10-05T09:22:34.240+0100 [conn1432850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:34.554+0100 [conn1432446] end connection 172.28.0.164:62772 (404 connections now open) 2015-10-05T09:22:34.555+0100 [mongosMain] connection accepted from 172.28.0.164:63947 #1432851 (405 connections now open) 2015-10-05T09:22:34.557+0100 [conn1432851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:40.133+0100 [mongosMain] connection accepted from 127.0.0.1:54741 #1432852 (406 connections now open) 2015-10-05T09:22:40.135+0100 [conn1432852] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:40.139+0100 [conn1432852] end connection 127.0.0.1:54741 (405 connections now open) 2015-10-05T09:22:41.157+0100 [conn1432511] end connection 172.28.0.163:53749 (404 connections now open) 2015-10-05T09:22:41.159+0100 [mongosMain] connection accepted from 172.28.0.163:54744 #1432853 (405 connections now open) 2015-10-05T09:22:41.159+0100 [conn1432853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:41.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233515703b51053eef992 2015-10-05T09:22:42.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:22:43.524+0100 [conn1432494] end connection 172.28.0.164:62934 (404 connections now open) 2015-10-05T09:22:43.525+0100 [mongosMain] connection accepted from 172.28.0.164:63961 #1432854 (405 connections now open) 2015-10-05T09:22:43.528+0100 [conn1432854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:44.055+0100 [conn1432514] end connection 172.28.0.164:62986 (404 connections now open) 2015-10-05T09:22:44.056+0100 [mongosMain] connection accepted from 172.28.0.164:63964 #1432855 (405 connections now open) 2015-10-05T09:22:44.058+0100 [conn1432855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:44.258+0100 [conn1432389] end connection 172.28.0.163:53272 (404 connections now open) 2015-10-05T09:22:44.263+0100 [mongosMain] connection accepted from 172.28.0.163:54751 #1432856 (405 connections now open) 2015-10-05T09:22:44.264+0100 [conn1432856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:44.570+0100 [conn1432450] end connection 172.28.0.164:62784 (404 connections now open) 2015-10-05T09:22:44.571+0100 [mongosMain] connection accepted from 172.28.0.164:63965 #1432857 (405 connections now open) 2015-10-05T09:22:44.574+0100 [conn1432857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:48.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233585703b51053eef9d9 2015-10-05T09:22:48.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:22:51.169+0100 [conn1432517] end connection 172.28.0.163:53757 (404 connections now open) 2015-10-05T09:22:51.170+0100 [mongosMain] connection accepted from 172.28.0.163:54760 #1432858 (405 connections now open) 2015-10-05T09:22:51.171+0100 [conn1432858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:52.293+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:22:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:22:53.540+0100 [conn1432467] end connection 172.28.0.164:62855 (404 connections now open) 2015-10-05T09:22:53.542+0100 [mongosMain] connection accepted from 172.28.0.164:63975 #1432859 (405 connections now open) 2015-10-05T09:22:53.543+0100 [conn1432859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:54.070+0100 [conn1432521] end connection 172.28.0.164:63003 (404 connections now open) 2015-10-05T09:22:54.071+0100 [mongosMain] connection accepted from 172.28.0.164:63978 #1432860 (405 connections now open) 2015-10-05T09:22:54.073+0100 [conn1432860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:54.248+0100 [conn1431869] end connection 172.28.0.163:51668 (404 connections now open) 2015-10-05T09:22:54.249+0100 [conn1432449] end connection 172.28.0.163:53548 (403 connections now open) 2015-10-05T09:22:54.250+0100 [mongosMain] connection accepted from 172.28.0.163:54766 #1432861 (404 connections now open) 2015-10-05T09:22:54.251+0100 [conn1432861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:54.571+0100 [conn1432430] end connection 172.28.0.164:62690 (403 connections now open) 2015-10-05T09:22:54.572+0100 [mongosMain] connection accepted from 172.28.0.164:63979 #1432862 (404 connections now open) 2015-10-05T09:22:54.574+0100 [conn1432862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:22:54.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612335e5703b51053eefa2d 2015-10-05T09:22:54.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:01.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233645703b51053eefa67 2015-10-05T09:23:01.187+0100 [conn1432523] end connection 172.28.0.163:53777 (403 connections now open) 2015-10-05T09:23:01.188+0100 [mongosMain] connection accepted from 172.28.0.163:54777 #1432863 (404 connections now open) 2015-10-05T09:23:01.189+0100 [conn1432863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:01.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:03.555+0100 [conn1432506] end connection 172.28.0.164:62961 (403 connections now open) 2015-10-05T09:23:03.557+0100 [mongosMain] connection accepted from 172.28.0.164:63998 #1432864 (404 connections now open) 2015-10-05T09:23:03.558+0100 [conn1432864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:04.243+0100 [conn1432485] end connection 172.28.0.163:53670 (403 connections now open) 2015-10-05T09:23:04.244+0100 [mongosMain] connection accepted from 172.28.0.163:54796 #1432865 (404 connections now open) 2015-10-05T09:23:04.293+0100 [conn1432865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:04.585+0100 [conn1432478] end connection 172.28.0.164:62889 (403 connections now open) 2015-10-05T09:23:04.586+0100 [mongosMain] connection accepted from 172.28.0.164:64003 #1432866 (404 connections now open) 2015-10-05T09:23:04.588+0100 [conn1432866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:07.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612336b5703b51053eefaf5 2015-10-05T09:23:07.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:13.555+0100 [conn1432471] end connection 172.28.0.164:62869 (403 connections now open) 2015-10-05T09:23:13.556+0100 [mongosMain] connection accepted from 172.28.0.164:64007 #1432867 (404 connections now open) 2015-10-05T09:23:13.558+0100 [conn1432867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:14.133+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:23:14.133+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:23:14.259+0100 [conn1432479] end connection 172.28.0.163:53659 (403 connections now open) 2015-10-05T09:23:14.260+0100 [mongosMain] connection accepted from 172.28.0.163:54809 #1432868 (404 connections now open) 2015-10-05T09:23:14.262+0100 [conn1432868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:14.601+0100 [conn1432496] end connection 172.28.0.164:62936 (403 connections now open) 2015-10-05T09:23:14.602+0100 [mongosMain] connection accepted from 172.28.0.164:64008 #1432869 (404 connections now open) 2015-10-05T09:23:14.605+0100 [conn1432869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:21.200+0100 [conn1432529] end connection 172.28.0.163:53809 (403 connections now open) 2015-10-05T09:23:21.202+0100 [mongosMain] connection accepted from 172.28.0.163:54832 #1432870 (404 connections now open) 2015-10-05T09:23:21.203+0100 [conn1432870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:21.243+0100 [conn1432504] end connection 172.28.0.163:53739 (403 connections now open) 2015-10-05T09:23:21.247+0100 [mongosMain] connection accepted from 172.28.0.163:54834 #1432871 (404 connections now open) 2015-10-05T09:23:21.259+0100 [conn1432871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:21.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233785703b51053eefbd6 2015-10-05T09:23:21.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:22.563+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:23:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:23:23.556+0100 [conn1432513] end connection 172.28.0.164:62978 (403 connections now open) 2015-10-05T09:23:23.558+0100 [mongosMain] connection accepted from 172.28.0.164:64022 #1432872 (404 connections now open) 2015-10-05T09:23:23.560+0100 [conn1432872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:24.102+0100 [conn1432527] end connection 172.28.0.164:63020 (403 connections now open) 2015-10-05T09:23:24.103+0100 [mongosMain] connection accepted from 172.28.0.164:64025 #1432873 (404 connections now open) 2015-10-05T09:23:24.104+0100 [conn1432873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:24.267+0100 [conn1432343] end connection 172.28.0.163:53173 (403 connections now open) 2015-10-05T09:23:24.268+0100 [mongosMain] connection accepted from 172.28.0.163:54835 #1432874 (404 connections now open) 2015-10-05T09:23:24.269+0100 [conn1432874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:24.618+0100 [conn1432489] end connection 172.28.0.164:62916 (403 connections now open) 2015-10-05T09:23:24.620+0100 [mongosMain] connection accepted from 172.28.0.164:64026 #1432875 (404 connections now open) 2015-10-05T09:23:24.621+0100 [conn1432875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:27.893+0100 [mongosMain] connection accepted from 127.0.0.1:54838 #1432876 (405 connections now open) 2015-10-05T09:23:27.895+0100 [conn1432876] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:27.901+0100 [conn1432876] end connection 127.0.0.1:54838 (404 connections now open) 2015-10-05T09:23:28.088+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:23:28.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:23:28.230+0100 [mongosMain] connection accepted from 127.0.0.1:54839 #1432877 (405 connections now open) 2015-10-05T09:23:28.233+0100 [conn1432877] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:28.239+0100 [conn1432877] end connection 127.0.0.1:54839 (404 connections now open) 2015-10-05T09:23:29.496+0100 [mongosMain] connection accepted from 127.0.0.1:54840 #1432878 (405 connections now open) 2015-10-05T09:23:29.499+0100 [conn1432878] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:29.504+0100 [conn1432878] end connection 127.0.0.1:54840 (404 connections now open) 2015-10-05T09:23:30.608+0100 [conn1432498] end connection 172.28.0.163:53724 (403 connections now open) 2015-10-05T09:23:30.609+0100 [mongosMain] connection accepted from 172.28.0.163:54841 #1432879 (404 connections now open) 2015-10-05T09:23:30.610+0100 [conn1432879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:31.201+0100 [conn1432533] end connection 172.28.0.163:53843 (403 connections now open) 2015-10-05T09:23:31.202+0100 [mongosMain] connection accepted from 172.28.0.163:54843 #1432880 (404 connections now open) 2015-10-05T09:23:31.203+0100 [conn1432880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:34.117+0100 [conn1432540] end connection 172.28.0.164:63060 (403 connections now open) 2015-10-05T09:23:34.118+0100 [mongosMain] connection accepted from 172.28.0.164:64039 #1432881 (404 connections now open) 2015-10-05T09:23:34.119+0100 [conn1432881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:34.304+0100 [conn1432519] end connection 172.28.0.163:53763 (403 connections now open) 2015-10-05T09:23:34.310+0100 [mongosMain] connection accepted from 172.28.0.163:54847 #1432882 (404 connections now open) 2015-10-05T09:23:34.311+0100 [conn1432882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:34.617+0100 [conn1432503] end connection 172.28.0.164:62949 (403 connections now open) 2015-10-05T09:23:34.619+0100 [mongosMain] connection accepted from 172.28.0.164:64040 #1432883 (404 connections now open) 2015-10-05T09:23:34.620+0100 [conn1432883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:34.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233865703b51053eefcc6 2015-10-05T09:23:35.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:40.141+0100 [mongosMain] connection accepted from 127.0.0.1:54850 #1432884 (405 connections now open) 2015-10-05T09:23:40.143+0100 [conn1432884] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:40.147+0100 [conn1432884] end connection 127.0.0.1:54850 (404 connections now open) 2015-10-05T09:23:40.608+0100 [conn1432487] end connection 172.28.0.163:53681 (403 connections now open) 2015-10-05T09:23:40.609+0100 [mongosMain] connection accepted from 172.28.0.163:54852 #1432885 (404 connections now open) 2015-10-05T09:23:40.610+0100 [conn1432885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:41.216+0100 [conn1432537] end connection 172.28.0.163:53858 (403 connections now open) 2015-10-05T09:23:41.217+0100 [mongosMain] connection accepted from 172.28.0.163:54854 #1432886 (404 connections now open) 2015-10-05T09:23:41.218+0100 [conn1432886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:41.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612338d5703b51053eefd54 2015-10-05T09:23:41.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:44.149+0100 [conn1432548] end connection 172.28.0.164:63079 (403 connections now open) 2015-10-05T09:23:44.149+0100 [mongosMain] connection accepted from 172.28.0.164:64058 #1432887 (404 connections now open) 2015-10-05T09:23:44.151+0100 [conn1432887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:44.290+0100 [conn1432535] end connection 172.28.0.163:53847 (403 connections now open) 2015-10-05T09:23:44.291+0100 [mongosMain] connection accepted from 172.28.0.163:54858 #1432888 (404 connections now open) 2015-10-05T09:23:44.291+0100 [conn1432888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:44.634+0100 [conn1432458] end connection 172.28.0.164:62816 (403 connections now open) 2015-10-05T09:23:44.635+0100 [mongosMain] connection accepted from 172.28.0.164:64060 #1432889 (404 connections now open) 2015-10-05T09:23:44.637+0100 [conn1432889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:48.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233935703b51053eefdb4 2015-10-05T09:23:48.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:50.623+0100 [conn1432510] end connection 172.28.0.163:53747 (403 connections now open) 2015-10-05T09:23:50.623+0100 [mongosMain] connection accepted from 172.28.0.163:54869 #1432890 (404 connections now open) 2015-10-05T09:23:50.624+0100 [conn1432890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:51.216+0100 [conn1432543] end connection 172.28.0.163:53867 (403 connections now open) 2015-10-05T09:23:51.217+0100 [mongosMain] connection accepted from 172.28.0.163:54871 #1432891 (404 connections now open) 2015-10-05T09:23:51.219+0100 [conn1432891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:53.699+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:23:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:23:54.148+0100 [conn1432555] end connection 172.28.0.164:63099 (403 connections now open) 2015-10-05T09:23:54.149+0100 [mongosMain] connection accepted from 172.28.0.164:64071 #1432892 (404 connections now open) 2015-10-05T09:23:54.150+0100 [conn1432892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:23:54.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612339a5703b51053eefdf5 2015-10-05T09:23:54.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:23:54.648+0100 [conn1432454] end connection 172.28.0.164:62800 (403 connections now open) 2015-10-05T09:23:54.649+0100 [mongosMain] connection accepted from 172.28.0.164:64073 #1432893 (404 connections now open) 2015-10-05T09:23:54.650+0100 [conn1432893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:00.638+0100 [conn1432492] end connection 172.28.0.163:53697 (403 connections now open) 2015-10-05T09:24:00.639+0100 [mongosMain] connection accepted from 172.28.0.163:54891 #1432894 (404 connections now open) 2015-10-05T09:24:00.640+0100 [conn1432894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:01.001+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:24:01.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:24:01.232+0100 [conn1432551] end connection 172.28.0.163:53881 (403 connections now open) 2015-10-05T09:24:01.233+0100 [mongosMain] connection accepted from 172.28.0.163:54898 #1432895 (404 connections now open) 2015-10-05T09:24:01.235+0100 [conn1432895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:03.602+0100 [conn1432530] end connection 172.28.0.164:63036 (403 connections now open) 2015-10-05T09:24:03.604+0100 [mongosMain] connection accepted from 172.28.0.164:64084 #1432896 (404 connections now open) 2015-10-05T09:24:03.605+0100 [conn1432896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:04.150+0100 [conn1432560] end connection 172.28.0.164:63113 (403 connections now open) 2015-10-05T09:24:04.151+0100 [mongosMain] connection accepted from 172.28.0.164:64086 #1432897 (404 connections now open) 2015-10-05T09:24:04.153+0100 [conn1432897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:04.311+0100 [conn1431905] end connection 172.28.0.163:51812 (403 connections now open) 2015-10-05T09:24:04.669+0100 [conn1432512] end connection 172.28.0.164:62979 (402 connections now open) 2015-10-05T09:24:04.670+0100 [mongosMain] connection accepted from 172.28.0.164:64087 #1432898 (403 connections now open) 2015-10-05T09:24:04.671+0100 [conn1432898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:07.356+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:24:07.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:24:10.640+0100 [conn1432522] end connection 172.28.0.163:53775 (402 connections now open) 2015-10-05T09:24:10.641+0100 [mongosMain] connection accepted from 172.28.0.163:54913 #1432899 (403 connections now open) 2015-10-05T09:24:10.642+0100 [conn1432899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:13.620+0100 [conn1432534] end connection 172.28.0.164:63044 (402 connections now open) 2015-10-05T09:24:13.621+0100 [mongosMain] connection accepted from 172.28.0.164:64090 #1432900 (403 connections now open) 2015-10-05T09:24:13.622+0100 [conn1432900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:14.164+0100 [conn1432563] end connection 172.28.0.164:63127 (402 connections now open) 2015-10-05T09:24:14.165+0100 [mongosMain] connection accepted from 172.28.0.164:64092 #1432901 (403 connections now open) 2015-10-05T09:24:14.166+0100 [conn1432901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:20.655+0100 [conn1432528] end connection 172.28.0.163:53801 (402 connections now open) 2015-10-05T09:24:20.656+0100 [mongosMain] connection accepted from 172.28.0.163:54928 #1432902 (403 connections now open) 2015-10-05T09:24:20.657+0100 [conn1432902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:21.248+0100 [conn1432557] end connection 172.28.0.163:53900 (402 connections now open) 2015-10-05T09:24:21.249+0100 [mongosMain] connection accepted from 172.28.0.163:54931 #1432903 (403 connections now open) 2015-10-05T09:24:21.250+0100 [conn1432903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:23.634+0100 [conn1432544] end connection 172.28.0.164:63074 (402 connections now open) 2015-10-05T09:24:23.635+0100 [mongosMain] connection accepted from 172.28.0.164:64104 #1432904 (403 connections now open) 2015-10-05T09:24:23.648+0100 [conn1432904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:23.838+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:24:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:24:24.164+0100 [conn1432566] end connection 172.28.0.164:63139 (402 connections now open) 2015-10-05T09:24:24.166+0100 [mongosMain] connection accepted from 172.28.0.164:64105 #1432905 (403 connections now open) 2015-10-05T09:24:24.167+0100 [conn1432905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:24.697+0100 [conn1432473] end connection 172.28.0.164:62872 (402 connections now open) 2015-10-05T09:24:24.700+0100 [mongosMain] connection accepted from 172.28.0.164:64108 #1432906 (403 connections now open) 2015-10-05T09:24:24.702+0100 [conn1432906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:25.019+0100 [conn1432525] end connection 172.28.0.163:53782 (402 connections now open) 2015-10-05T09:24:25.024+0100 [mongosMain] connection accepted from 172.28.0.163:54934 #1432907 (403 connections now open) 2015-10-05T09:24:25.025+0100 [conn1432907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:25.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233b95703b51053eeffd7 2015-10-05T09:24:25.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:24:28.640+0100 [mongosMain] connection accepted from 127.0.0.1:54937 #1432908 (404 connections now open) 2015-10-05T09:24:28.642+0100 [conn1432908] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:28.648+0100 [conn1432908] end connection 127.0.0.1:54937 (403 connections now open) 2015-10-05T09:24:30.656+0100 [conn1432532] end connection 172.28.0.163:53840 (402 connections now open) 2015-10-05T09:24:30.657+0100 [mongosMain] connection accepted from 172.28.0.163:54938 #1432909 (403 connections now open) 2015-10-05T09:24:30.658+0100 [conn1432909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:31.263+0100 [conn1432569] end connection 172.28.0.163:53953 (402 connections now open) 2015-10-05T09:24:31.264+0100 [mongosMain] connection accepted from 172.28.0.163:54940 #1432910 (403 connections now open) 2015-10-05T09:24:31.265+0100 [conn1432910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:31.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233bf5703b51053ef003d 2015-10-05T09:24:32.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:24:33.650+0100 [conn1432558] end connection 172.28.0.164:63109 (402 connections now open) 2015-10-05T09:24:33.651+0100 [mongosMain] connection accepted from 172.28.0.164:64120 #1432911 (403 connections now open) 2015-10-05T09:24:33.653+0100 [conn1432911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:34.180+0100 [conn1432572] end connection 172.28.0.164:63161 (402 connections now open) 2015-10-05T09:24:34.181+0100 [mongosMain] connection accepted from 172.28.0.164:64122 #1432912 (403 connections now open) 2015-10-05T09:24:34.182+0100 [conn1432912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:34.322+0100 [conn1432501] end connection 172.28.0.163:53730 (402 connections now open) 2015-10-05T09:24:34.324+0100 [mongosMain] connection accepted from 172.28.0.163:54942 #1432913 (403 connections now open) 2015-10-05T09:24:34.325+0100 [conn1432913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:34.696+0100 [conn1432520] end connection 172.28.0.164:63001 (402 connections now open) 2015-10-05T09:24:34.697+0100 [mongosMain] connection accepted from 172.28.0.164:64124 #1432914 (403 connections now open) 2015-10-05T09:24:34.699+0100 [conn1432914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:38.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233c65703b51053ef008b 2015-10-05T09:24:38.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:24:39.845+0100 [mongosMain] connection accepted from 127.0.0.1:54950 #1432915 (404 connections now open) 2015-10-05T09:24:39.848+0100 [conn1432915] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:39.852+0100 [conn1432915] end connection 127.0.0.1:54950 (403 connections now open) 2015-10-05T09:24:40.671+0100 [conn1432516] end connection 172.28.0.163:53755 (402 connections now open) 2015-10-05T09:24:40.673+0100 [mongosMain] connection accepted from 172.28.0.163:54953 #1432916 (403 connections now open) 2015-10-05T09:24:40.674+0100 [conn1432916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:41.264+0100 [conn1432577] end connection 172.28.0.163:53962 (402 connections now open) 2015-10-05T09:24:41.265+0100 [mongosMain] connection accepted from 172.28.0.163:54957 #1432917 (403 connections now open) 2015-10-05T09:24:41.266+0100 [conn1432917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:43.666+0100 [conn1432565] end connection 172.28.0.164:63137 (402 connections now open) 2015-10-05T09:24:43.667+0100 [mongosMain] connection accepted from 172.28.0.164:64142 #1432918 (403 connections now open) 2015-10-05T09:24:43.669+0100 [conn1432918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:44.197+0100 [conn1432579] end connection 172.28.0.164:63178 (402 connections now open) 2015-10-05T09:24:44.198+0100 [mongosMain] connection accepted from 172.28.0.164:64144 #1432919 (403 connections now open) 2015-10-05T09:24:44.201+0100 [conn1432919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:44.711+0100 [conn1432507] end connection 172.28.0.164:62964 (402 connections now open) 2015-10-05T09:24:44.711+0100 [mongosMain] connection accepted from 172.28.0.164:64147 #1432920 (403 connections now open) 2015-10-05T09:24:44.713+0100 [conn1432920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:45.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233cc5703b51053ef00e3 2015-10-05T09:24:45.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:24:50.673+0100 [conn1432542] end connection 172.28.0.163:53865 (402 connections now open) 2015-10-05T09:24:50.674+0100 [mongosMain] connection accepted from 172.28.0.163:54977 #1432921 (403 connections now open) 2015-10-05T09:24:50.676+0100 [conn1432921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:51.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233d35703b51053ef0131 2015-10-05T09:24:51.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:24:53.681+0100 [conn1432518] end connection 172.28.0.164:63000 (402 connections now open) 2015-10-05T09:24:53.682+0100 [mongosMain] connection accepted from 172.28.0.164:64161 #1432922 (403 connections now open) 2015-10-05T09:24:53.684+0100 [conn1432922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:54.212+0100 [conn1432586] end connection 172.28.0.164:63200 (402 connections now open) 2015-10-05T09:24:54.214+0100 [mongosMain] connection accepted from 172.28.0.164:64162 #1432923 (403 connections now open) 2015-10-05T09:24:54.215+0100 [conn1432923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:24:54.600+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:24:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:24:54.726+0100 [conn1432484] end connection 172.28.0.164:62903 (402 connections now open) 2015-10-05T09:24:54.727+0100 [mongosMain] connection accepted from 172.28.0.164:64165 #1432924 (403 connections now open) 2015-10-05T09:24:54.728+0100 [conn1432924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:00.687+0100 [conn1432536] end connection 172.28.0.163:53856 (402 connections now open) 2015-10-05T09:25:00.688+0100 [mongosMain] connection accepted from 172.28.0.163:54992 #1432925 (403 connections now open) 2015-10-05T09:25:00.689+0100 [conn1432925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:01.284+0100 [conn1432584] end connection 172.28.0.163:53973 (402 connections now open) 2015-10-05T09:25:01.305+0100 [mongosMain] connection accepted from 172.28.0.163:54995 #1432926 (403 connections now open) 2015-10-05T09:25:01.308+0100 [conn1432926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:03.681+0100 [conn1432570] end connection 172.28.0.164:63159 (402 connections now open) 2015-10-05T09:25:03.682+0100 [mongosMain] connection accepted from 172.28.0.164:64178 #1432927 (403 connections now open) 2015-10-05T09:25:03.684+0100 [conn1432927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:04.227+0100 [conn1432596] end connection 172.28.0.164:63246 (402 connections now open) 2015-10-05T09:25:04.229+0100 [mongosMain] connection accepted from 172.28.0.164:64181 #1432928 (403 connections now open) 2015-10-05T09:25:04.231+0100 [conn1432928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:10.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233e65703b51053ef0269 2015-10-05T09:25:10.702+0100 [conn1432550] end connection 172.28.0.163:53879 (402 connections now open) 2015-10-05T09:25:10.703+0100 [mongosMain] connection accepted from 172.28.0.163:55019 #1432929 (403 connections now open) 2015-10-05T09:25:10.703+0100 [conn1432929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:10.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:11.295+0100 [conn1432594] end connection 172.28.0.163:54003 (402 connections now open) 2015-10-05T09:25:11.296+0100 [mongosMain] connection accepted from 172.28.0.163:55021 #1432930 (403 connections now open) 2015-10-05T09:25:11.297+0100 [conn1432930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:13.697+0100 [conn1432524] end connection 172.28.0.164:63017 (402 connections now open) 2015-10-05T09:25:13.698+0100 [mongosMain] connection accepted from 172.28.0.164:64185 #1432931 (403 connections now open) 2015-10-05T09:25:13.699+0100 [conn1432931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:14.243+0100 [conn1432590] end connection 172.28.0.164:63220 (402 connections now open) 2015-10-05T09:25:14.244+0100 [mongosMain] connection accepted from 172.28.0.164:64189 #1432932 (403 connections now open) 2015-10-05T09:25:14.245+0100 [conn1432932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:17.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233ec5703b51053ef02bf 2015-10-05T09:25:17.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:20.703+0100 [conn1432556] end connection 172.28.0.163:53897 (402 connections now open) 2015-10-05T09:25:20.704+0100 [mongosMain] connection accepted from 172.28.0.163:55033 #1432933 (403 connections now open) 2015-10-05T09:25:20.705+0100 [conn1432933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:21.296+0100 [conn1432600] end connection 172.28.0.163:54038 (402 connections now open) 2015-10-05T09:25:21.297+0100 [mongosMain] connection accepted from 172.28.0.163:55035 #1432934 (403 connections now open) 2015-10-05T09:25:21.298+0100 [conn1432934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:23.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233f35703b51053ef030c 2015-10-05T09:25:23.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:24.261+0100 [conn1432603] end connection 172.28.0.164:63264 (402 connections now open) 2015-10-05T09:25:24.262+0100 [mongosMain] connection accepted from 172.28.0.164:64204 #1432935 (403 connections now open) 2015-10-05T09:25:24.264+0100 [conn1432935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:24.369+0100 [conn1432553] end connection 172.28.0.163:53887 (402 connections now open) 2015-10-05T09:25:24.369+0100 [conn1431953] end connection 172.28.0.163:51963 (402 connections now open) 2015-10-05T09:25:24.370+0100 [mongosMain] connection accepted from 172.28.0.163:55038 #1432936 (402 connections now open) 2015-10-05T09:25:24.371+0100 [conn1432936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:24.774+0100 [conn1431950] end connection 172.28.0.164:61216 (401 connections now open) 2015-10-05T09:25:24.774+0100 [conn1432465] end connection 172.28.0.164:62850 (401 connections now open) 2015-10-05T09:25:24.775+0100 [mongosMain] connection accepted from 172.28.0.164:64207 #1432937 (401 connections now open) 2015-10-05T09:25:24.775+0100 [mongosMain] connection accepted from 172.28.0.164:64208 #1432938 (402 connections now open) 2015-10-05T09:25:24.776+0100 [conn1432937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:24.777+0100 [conn1432938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:24.932+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:25:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:25:28.453+0100 [mongosMain] connection accepted from 127.0.0.1:55041 #1432939 (403 connections now open) 2015-10-05T09:25:28.455+0100 [conn1432939] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:28.461+0100 [conn1432939] end connection 127.0.0.1:55041 (402 connections now open) 2015-10-05T09:25:29.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233f95703b51053ef0356 2015-10-05T09:25:29.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:30.718+0100 [conn1432469] end connection 172.28.0.163:53632 (401 connections now open) 2015-10-05T09:25:30.719+0100 [mongosMain] connection accepted from 172.28.0.163:55043 #1432940 (402 connections now open) 2015-10-05T09:25:30.720+0100 [conn1432940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:31.311+0100 [conn1432607] end connection 172.28.0.163:54051 (401 connections now open) 2015-10-05T09:25:31.312+0100 [mongosMain] connection accepted from 172.28.0.163:55046 #1432941 (402 connections now open) 2015-10-05T09:25:31.313+0100 [conn1432941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:33.729+0100 [conn1432595] end connection 172.28.0.164:63242 (401 connections now open) 2015-10-05T09:25:33.730+0100 [mongosMain] connection accepted from 172.28.0.164:64218 #1432942 (402 connections now open) 2015-10-05T09:25:33.731+0100 [conn1432942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:34.259+0100 [conn1432611] end connection 172.28.0.164:63282 (401 connections now open) 2015-10-05T09:25:34.261+0100 [mongosMain] connection accepted from 172.28.0.164:64222 #1432943 (402 connections now open) 2015-10-05T09:25:34.262+0100 [conn1432943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:34.386+0100 [conn1432578] end connection 172.28.0.163:53964 (401 connections now open) 2015-10-05T09:25:34.387+0100 [mongosMain] connection accepted from 172.28.0.163:55048 #1432944 (402 connections now open) 2015-10-05T09:25:34.388+0100 [conn1432944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:36.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561233ff5703b51053ef03b3 2015-10-05T09:25:36.326+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:39.712+0100 [mongosMain] connection accepted from 127.0.0.1:55055 #1432945 (403 connections now open) 2015-10-05T09:25:39.715+0100 [conn1432945] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:39.719+0100 [conn1432945] end connection 127.0.0.1:55055 (402 connections now open) 2015-10-05T09:25:40.718+0100 [conn1432476] end connection 172.28.0.163:53653 (401 connections now open) 2015-10-05T09:25:40.719+0100 [mongosMain] connection accepted from 172.28.0.163:55056 #1432946 (402 connections now open) 2015-10-05T09:25:40.720+0100 [conn1432946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:41.326+0100 [conn1432616] end connection 172.28.0.163:54066 (401 connections now open) 2015-10-05T09:25:41.327+0100 [mongosMain] connection accepted from 172.28.0.163:55059 #1432947 (402 connections now open) 2015-10-05T09:25:41.328+0100 [conn1432947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:42.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234065703b51053ef041c 2015-10-05T09:25:42.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:43.745+0100 [conn1432585] end connection 172.28.0.164:63198 (401 connections now open) 2015-10-05T09:25:43.745+0100 [mongosMain] connection accepted from 172.28.0.164:64239 #1432948 (402 connections now open) 2015-10-05T09:25:43.747+0100 [conn1432948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:44.275+0100 [conn1432620] end connection 172.28.0.164:63303 (401 connections now open) 2015-10-05T09:25:44.276+0100 [mongosMain] connection accepted from 172.28.0.164:64241 #1432949 (402 connections now open) 2015-10-05T09:25:44.277+0100 [conn1432949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:44.387+0100 [conn1432490] end connection 172.28.0.163:53687 (401 connections now open) 2015-10-05T09:25:44.388+0100 [mongosMain] connection accepted from 172.28.0.163:55064 #1432950 (402 connections now open) 2015-10-05T09:25:44.389+0100 [conn1432950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:44.805+0100 [conn1431967] end connection 172.28.0.164:61255 (401 connections now open) 2015-10-05T09:25:44.806+0100 [mongosMain] connection accepted from 172.28.0.164:64244 #1432951 (402 connections now open) 2015-10-05T09:25:44.808+0100 [conn1432951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:48.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612340c5703b51053ef048b 2015-10-05T09:25:49.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:25:50.733+0100 [conn1432564] end connection 172.28.0.163:53935 (401 connections now open) 2015-10-05T09:25:50.734+0100 [mongosMain] connection accepted from 172.28.0.163:55073 #1432952 (402 connections now open) 2015-10-05T09:25:50.735+0100 [conn1432952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:51.326+0100 [conn1432624] end connection 172.28.0.163:54081 (401 connections now open) 2015-10-05T09:25:51.327+0100 [mongosMain] connection accepted from 172.28.0.163:55075 #1432953 (402 connections now open) 2015-10-05T09:25:51.328+0100 [conn1432953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:53.760+0100 [conn1432552] end connection 172.28.0.164:63095 (401 connections now open) 2015-10-05T09:25:53.761+0100 [mongosMain] connection accepted from 172.28.0.164:64254 #1432954 (402 connections now open) 2015-10-05T09:25:53.762+0100 [conn1432954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:54.291+0100 [conn1432628] end connection 172.28.0.164:63319 (401 connections now open) 2015-10-05T09:25:54.292+0100 [mongosMain] connection accepted from 172.28.0.164:64257 #1432955 (402 connections now open) 2015-10-05T09:25:54.294+0100 [conn1432955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:54.412+0100 [conn1431976] end connection 172.28.0.163:52006 (401 connections now open) 2015-10-05T09:25:54.412+0100 [conn1432571] end connection 172.28.0.163:53956 (401 connections now open) 2015-10-05T09:25:54.413+0100 [mongosMain] connection accepted from 172.28.0.163:55081 #1432956 (401 connections now open) 2015-10-05T09:25:54.414+0100 [conn1432956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:54.820+0100 [conn1431974] end connection 172.28.0.164:61272 (400 connections now open) 2015-10-05T09:25:54.821+0100 [mongosMain] connection accepted from 172.28.0.164:64260 #1432957 (401 connections now open) 2015-10-05T09:25:54.823+0100 [conn1432957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:25:55.164+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:25:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:25:55.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234135703b51053ef04f2 2015-10-05T09:25:55.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:00.747+0100 [conn1432568] end connection 172.28.0.163:53950 (400 connections now open) 2015-10-05T09:26:00.748+0100 [mongosMain] connection accepted from 172.28.0.163:55092 #1432958 (401 connections now open) 2015-10-05T09:26:00.748+0100 [conn1432958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:01.342+0100 [conn1432631] end connection 172.28.0.163:54104 (400 connections now open) 2015-10-05T09:26:01.343+0100 [mongosMain] connection accepted from 172.28.0.163:55096 #1432959 (401 connections now open) 2015-10-05T09:26:01.344+0100 [conn1432959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:01.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234195703b51053ef0542 2015-10-05T09:26:01.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:03.759+0100 [conn1432608] end connection 172.28.0.164:63280 (400 connections now open) 2015-10-05T09:26:03.761+0100 [mongosMain] connection accepted from 172.28.0.164:64283 #1432960 (401 connections now open) 2015-10-05T09:26:03.762+0100 [conn1432960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:04.306+0100 [conn1432635] end connection 172.28.0.164:63334 (400 connections now open) 2015-10-05T09:26:04.307+0100 [mongosMain] connection accepted from 172.28.0.164:64286 #1432961 (401 connections now open) 2015-10-05T09:26:04.309+0100 [conn1432961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:04.404+0100 [conn1432440] end connection 172.28.0.163:53472 (400 connections now open) 2015-10-05T09:26:04.405+0100 [mongosMain] connection accepted from 172.28.0.163:55107 #1432962 (401 connections now open) 2015-10-05T09:26:04.405+0100 [conn1432640] end connection 172.28.0.163:54120 (399 connections now open) 2015-10-05T09:26:04.406+0100 [conn1432962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:08.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612341f5703b51053ef05c4 2015-10-05T09:26:08.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:10.762+0100 [conn1432561] end connection 172.28.0.163:53913 (399 connections now open) 2015-10-05T09:26:10.763+0100 [mongosMain] connection accepted from 172.28.0.163:55117 #1432963 (400 connections now open) 2015-10-05T09:26:10.764+0100 [conn1432963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:11.343+0100 [conn1432656] end connection 172.28.0.163:54142 (399 connections now open) 2015-10-05T09:26:11.344+0100 [mongosMain] connection accepted from 172.28.0.163:55119 #1432964 (400 connections now open) 2015-10-05T09:26:11.345+0100 [conn1432964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:13.776+0100 [conn1432625] end connection 172.28.0.164:63315 (399 connections now open) 2015-10-05T09:26:13.777+0100 [mongosMain] connection accepted from 172.28.0.164:64291 #1432965 (400 connections now open) 2015-10-05T09:26:13.778+0100 [conn1432965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:14.322+0100 [conn1432659] end connection 172.28.0.164:63352 (399 connections now open) 2015-10-05T09:26:14.322+0100 [mongosMain] connection accepted from 172.28.0.164:64293 #1432966 (400 connections now open) 2015-10-05T09:26:14.323+0100 [conn1432966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:14.416+0100 [conn1432610] end connection 172.28.0.163:54057 (399 connections now open) 2015-10-05T09:26:14.417+0100 [mongosMain] connection accepted from 172.28.0.163:55124 #1432967 (400 connections now open) 2015-10-05T09:26:14.419+0100 [conn1432967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:14.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234265703b51053ef0615 2015-10-05T09:26:14.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:20.751+0100 [conn1432589] end connection 172.28.0.163:53986 (399 connections now open) 2015-10-05T09:26:20.752+0100 [mongosMain] connection accepted from 172.28.0.163:55130 #1432968 (400 connections now open) 2015-10-05T09:26:20.753+0100 [conn1432968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:21.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612342c5703b51053ef0677 2015-10-05T09:26:21.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:23.400+0100 [conn1431993] end connection 172.28.0.163:52056 (399 connections now open) 2015-10-05T09:26:23.401+0100 [mongosMain] connection accepted from 172.28.0.163:55136 #1432969 (400 connections now open) 2015-10-05T09:26:23.402+0100 [conn1432969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:23.791+0100 [conn1432617] end connection 172.28.0.164:63300 (399 connections now open) 2015-10-05T09:26:23.800+0100 [mongosMain] connection accepted from 172.28.0.164:64307 #1432970 (400 connections now open) 2015-10-05T09:26:23.802+0100 [conn1432970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:24.337+0100 [conn1432664] end connection 172.28.0.164:63361 (399 connections now open) 2015-10-05T09:26:24.338+0100 [mongosMain] connection accepted from 172.28.0.164:64311 #1432971 (400 connections now open) 2015-10-05T09:26:24.339+0100 [conn1432971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:24.420+0100 [conn1432645] end connection 172.28.0.163:54125 (399 connections now open) 2015-10-05T09:26:24.421+0100 [mongosMain] connection accepted from 172.28.0.163:55138 #1432972 (400 connections now open) 2015-10-05T09:26:24.422+0100 [conn1432972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:24.838+0100 [conn1432580] end connection 172.28.0.164:63181 (399 connections now open) 2015-10-05T09:26:24.839+0100 [mongosMain] connection accepted from 172.28.0.164:64316 #1432973 (400 connections now open) 2015-10-05T09:26:24.841+0100 [conn1432973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:25.326+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:26:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:26:27.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234335703b51053ef06d4 2015-10-05T09:26:27.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:28.643+0100 [mongosMain] connection accepted from 127.0.0.1:55141 #1432974 (401 connections now open) 2015-10-05T09:26:28.645+0100 [conn1432974] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:28.650+0100 [conn1432974] end connection 127.0.0.1:55141 (400 connections now open) 2015-10-05T09:26:30.765+0100 [conn1432593] end connection 172.28.0.163:54001 (399 connections now open) 2015-10-05T09:26:30.766+0100 [mongosMain] connection accepted from 172.28.0.163:55143 #1432975 (400 connections now open) 2015-10-05T09:26:30.767+0100 [conn1432975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:31.358+0100 [conn1432662] end connection 172.28.0.163:54167 (399 connections now open) 2015-10-05T09:26:31.359+0100 [mongosMain] connection accepted from 172.28.0.163:55145 #1432976 (400 connections now open) 2015-10-05T09:26:31.360+0100 [conn1432976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:33.791+0100 [conn1432601] end connection 172.28.0.164:63262 (399 connections now open) 2015-10-05T09:26:33.792+0100 [mongosMain] connection accepted from 172.28.0.164:64331 #1432977 (400 connections now open) 2015-10-05T09:26:33.794+0100 [conn1432977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:34.338+0100 [conn1432671] end connection 172.28.0.164:63378 (399 connections now open) 2015-10-05T09:26:34.339+0100 [mongosMain] connection accepted from 172.28.0.164:64334 #1432978 (400 connections now open) 2015-10-05T09:26:34.341+0100 [conn1432978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:34.432+0100 [conn1432495] end connection 172.28.0.163:53715 (399 connections now open) 2015-10-05T09:26:34.434+0100 [mongosMain] connection accepted from 172.28.0.163:55148 #1432979 (400 connections now open) 2015-10-05T09:26:34.434+0100 [conn1432979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:34.852+0100 [conn1432000] end connection 172.28.0.164:61349 (399 connections now open) 2015-10-05T09:26:34.852+0100 [conn1432587] end connection 172.28.0.164:63204 (398 connections now open) 2015-10-05T09:26:34.853+0100 [mongosMain] connection accepted from 172.28.0.164:64337 #1432980 (399 connections now open) 2015-10-05T09:26:34.853+0100 [mongosMain] connection accepted from 172.28.0.164:64338 #1432981 (400 connections now open) 2015-10-05T09:26:34.854+0100 [conn1432980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:34.855+0100 [conn1432981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:39.660+0100 [mongosMain] connection accepted from 127.0.0.1:55152 #1432982 (401 connections now open) 2015-10-05T09:26:39.663+0100 [conn1432982] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:39.667+0100 [conn1432982] end connection 127.0.0.1:55152 (400 connections now open) 2015-10-05T09:26:40.781+0100 [conn1432599] end connection 172.28.0.163:54036 (399 connections now open) 2015-10-05T09:26:40.782+0100 [mongosMain] connection accepted from 172.28.0.163:55156 #1432983 (400 connections now open) 2015-10-05T09:26:40.783+0100 [conn1432983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:41.374+0100 [conn1432668] end connection 172.28.0.163:54184 (399 connections now open) 2015-10-05T09:26:41.375+0100 [mongosMain] connection accepted from 172.28.0.163:55158 #1432984 (400 connections now open) 2015-10-05T09:26:41.377+0100 [conn1432984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:43.807+0100 [conn1432657] end connection 172.28.0.164:63349 (399 connections now open) 2015-10-05T09:26:43.808+0100 [mongosMain] connection accepted from 172.28.0.164:64349 #1432985 (400 connections now open) 2015-10-05T09:26:43.810+0100 [conn1432985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:44.353+0100 [conn1432679] end connection 172.28.0.164:63399 (399 connections now open) 2015-10-05T09:26:44.354+0100 [mongosMain] connection accepted from 172.28.0.164:64352 #1432986 (400 connections now open) 2015-10-05T09:26:44.356+0100 [conn1432986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:44.463+0100 [conn1432278] end connection 172.28.0.163:53009 (399 connections now open) 2015-10-05T09:26:44.465+0100 [mongosMain] connection accepted from 172.28.0.163:55164 #1432987 (400 connections now open) 2015-10-05T09:26:44.466+0100 [conn1432987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:44.868+0100 [conn1432604] end connection 172.28.0.164:63266 (399 connections now open) 2015-10-05T09:26:44.868+0100 [conn1432232] end connection 172.28.0.164:62127 (398 connections now open) 2015-10-05T09:26:44.869+0100 [mongosMain] connection accepted from 172.28.0.164:64356 #1432988 (399 connections now open) 2015-10-05T09:26:44.870+0100 [mongosMain] connection accepted from 172.28.0.164:64357 #1432989 (400 connections now open) 2015-10-05T09:26:44.870+0100 [conn1432988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:44.871+0100 [conn1432989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:45.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234455703b51053ef07bd 2015-10-05T09:26:45.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:26:50.780+0100 [conn1432582] end connection 172.28.0.163:53968 (399 connections now open) 2015-10-05T09:26:50.781+0100 [mongosMain] connection accepted from 172.28.0.163:55174 #1432990 (400 connections now open) 2015-10-05T09:26:50.782+0100 [conn1432990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:51.374+0100 [conn1432676] end connection 172.28.0.163:54197 (399 connections now open) 2015-10-05T09:26:51.375+0100 [mongosMain] connection accepted from 172.28.0.163:55175 #1432991 (400 connections now open) 2015-10-05T09:26:51.376+0100 [conn1432991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:53.809+0100 [conn1432677] end connection 172.28.0.164:63396 (399 connections now open) 2015-10-05T09:26:53.810+0100 [mongosMain] connection accepted from 172.28.0.164:64368 #1432992 (400 connections now open) 2015-10-05T09:26:53.812+0100 [conn1432992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:54.353+0100 [conn1432691] end connection 172.28.0.164:63424 (399 connections now open) 2015-10-05T09:26:54.354+0100 [mongosMain] connection accepted from 172.28.0.164:64370 #1432993 (400 connections now open) 2015-10-05T09:26:54.357+0100 [conn1432993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:54.728+0100 [conn1432032] end connection 172.28.0.163:52162 (399 connections now open) 2015-10-05T09:26:54.730+0100 [mongosMain] connection accepted from 172.28.0.163:55183 #1432994 (400 connections now open) 2015-10-05T09:26:54.731+0100 [conn1432994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:54.887+0100 [conn1432554] end connection 172.28.0.164:63097 (399 connections now open) 2015-10-05T09:26:54.888+0100 [conn1432591] end connection 172.28.0.164:63224 (398 connections now open) 2015-10-05T09:26:54.890+0100 [mongosMain] connection accepted from 172.28.0.164:64372 #1432995 (399 connections now open) 2015-10-05T09:26:54.891+0100 [mongosMain] connection accepted from 172.28.0.164:64373 #1432996 (400 connections now open) 2015-10-05T09:26:54.892+0100 [conn1432996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:54.892+0100 [conn1432995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:26:55.478+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:26:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:26:58.206+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612344c26fd57ee993925eb') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444033617802), why: "doing balance round", ts: ObjectId('561234515703b51053ef0880') } } gle1: { lastOp: Timestamp 1444033605000|12, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1444033618000|1, connectionId: 5195, updatedExisting: true, n: 1, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } 2015-10-05T09:26:58.215+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:26:58.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234515703b51053ef0880 2015-10-05T09:26:58.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:27:00.797+0100 [conn1432576] end connection 172.28.0.163:53960 (399 connections now open) 2015-10-05T09:27:00.799+0100 [mongosMain] connection accepted from 172.28.0.163:55193 #1432997 (400 connections now open) 2015-10-05T09:27:00.799+0100 [conn1432997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:00.899+0100 [conn1432017] end connection 172.28.0.164:61387 (399 connections now open) 2015-10-05T09:27:00.900+0100 [mongosMain] connection accepted from 172.28.0.164:64377 #1432998 (400 connections now open) 2015-10-05T09:27:00.903+0100 [conn1432998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:01.390+0100 [conn1432689] end connection 172.28.0.163:54205 (399 connections now open) 2015-10-05T09:27:01.391+0100 [mongosMain] connection accepted from 172.28.0.163:55194 #1432999 (400 connections now open) 2015-10-05T09:27:01.392+0100 [conn1432999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:03.823+0100 [conn1432538] end connection 172.28.0.164:63058 (399 connections now open) 2015-10-05T09:27:03.824+0100 [mongosMain] connection accepted from 172.28.0.164:64386 #1433000 (400 connections now open) 2015-10-05T09:27:03.827+0100 [conn1433000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:04.384+0100 [conn1432697] end connection 172.28.0.164:63440 (399 connections now open) 2015-10-05T09:27:04.385+0100 [mongosMain] connection accepted from 172.28.0.164:64390 #1433001 (400 connections now open) 2015-10-05T09:27:04.386+0100 [conn1433001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:04.485+0100 [conn1432651] end connection 172.28.0.163:54133 (399 connections now open) 2015-10-05T09:27:04.486+0100 [mongosMain] connection accepted from 172.28.0.163:55207 #1433002 (400 connections now open) 2015-10-05T09:27:04.487+0100 [conn1433002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:04.883+0100 [conn1432054] end connection 172.28.0.164:61504 (399 connections now open) 2015-10-05T09:27:04.884+0100 [mongosMain] connection accepted from 172.28.0.164:64394 #1433003 (400 connections now open) 2015-10-05T09:27:04.885+0100 [conn1433003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:10.488+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:27:10.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:27:10.800+0100 [conn1432623] end connection 172.28.0.163:54078 (399 connections now open) 2015-10-05T09:27:10.801+0100 [mongosMain] connection accepted from 172.28.0.163:55220 #1433004 (400 connections now open) 2015-10-05T09:27:10.803+0100 [conn1433004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:11.405+0100 [conn1432695] end connection 172.28.0.163:54219 (399 connections now open) 2015-10-05T09:27:11.406+0100 [mongosMain] connection accepted from 172.28.0.163:55221 #1433005 (400 connections now open) 2015-10-05T09:27:11.407+0100 [conn1433005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:13.391+0100 [conn1432030] end connection 172.28.0.164:61426 (399 connections now open) 2015-10-05T09:27:13.392+0100 [mongosMain] connection accepted from 172.28.0.164:64395 #1433006 (400 connections now open) 2015-10-05T09:27:13.396+0100 [conn1433006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:13.823+0100 [conn1432632] end connection 172.28.0.164:63332 (399 connections now open) 2015-10-05T09:27:13.825+0100 [mongosMain] connection accepted from 172.28.0.164:64396 #1433007 (400 connections now open) 2015-10-05T09:27:13.831+0100 [conn1433007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:14.369+0100 [conn1432702] end connection 172.28.0.164:63462 (399 connections now open) 2015-10-05T09:27:14.370+0100 [mongosMain] connection accepted from 172.28.0.164:64400 #1433008 (400 connections now open) 2015-10-05T09:27:14.372+0100 [conn1433008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:14.495+0100 [conn1432678] end connection 172.28.0.163:54199 (399 connections now open) 2015-10-05T09:27:14.495+0100 [conn1432293] end connection 172.28.0.163:53044 (398 connections now open) 2015-10-05T09:27:14.496+0100 [mongosMain] connection accepted from 172.28.0.163:55225 #1433009 (399 connections now open) 2015-10-05T09:27:14.497+0100 [mongosMain] connection accepted from 172.28.0.163:55226 #1433010 (400 connections now open) 2015-10-05T09:27:14.497+0100 [conn1433009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:14.498+0100 [conn1433010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:14.904+0100 [conn1432612] end connection 172.28.0.164:63286 (399 connections now open) 2015-10-05T09:27:14.919+0100 [mongosMain] connection accepted from 172.28.0.164:64402 #1433011 (400 connections now open) 2015-10-05T09:27:14.921+0100 [conn1433011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:16.798+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612346026fd57ee993925ee') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444033636512), why: "doing balance round", ts: ObjectId('561234645703b51053ef091d') } } gle1: { lastOp: Timestamp 1444033618000|9, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } gle2: { lastOp: Timestamp 1444033636000|7, connectionId: 5195, updatedExisting: true, n: 1, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2015-10-05T09:27:16.803+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:27:16.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234645703b51053ef091d 2015-10-05T09:27:17.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:27:20.813+0100 [conn1432630] end connection 172.28.0.163:54102 (399 connections now open) 2015-10-05T09:27:20.814+0100 [mongosMain] connection accepted from 172.28.0.163:55232 #1433012 (400 connections now open) 2015-10-05T09:27:20.814+0100 [conn1433012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:21.406+0100 [conn1432700] end connection 172.28.0.163:54239 (399 connections now open) 2015-10-05T09:27:21.407+0100 [mongosMain] connection accepted from 172.28.0.163:55237 #1433013 (400 connections now open) 2015-10-05T09:27:21.408+0100 [conn1433013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:23.838+0100 [conn1432669] end connection 172.28.0.164:63376 (399 connections now open) 2015-10-05T09:27:23.840+0100 [mongosMain] connection accepted from 172.28.0.164:64414 #1433014 (400 connections now open) 2015-10-05T09:27:23.842+0100 [conn1433014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:24.387+0100 [conn1432708] end connection 172.28.0.164:63469 (399 connections now open) 2015-10-05T09:27:24.388+0100 [mongosMain] connection accepted from 172.28.0.164:64416 #1433015 (400 connections now open) 2015-10-05T09:27:24.389+0100 [conn1433015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:24.495+0100 [conn1432238] end connection 172.28.0.163:52891 (399 connections now open) 2015-10-05T09:27:24.495+0100 [conn1432707] end connection 172.28.0.163:54263 (399 connections now open) 2015-10-05T09:27:24.496+0100 [mongosMain] connection accepted from 172.28.0.163:55239 #1433016 (399 connections now open) 2015-10-05T09:27:24.497+0100 [mongosMain] connection accepted from 172.28.0.163:55240 #1433017 (400 connections now open) 2015-10-05T09:27:24.497+0100 [conn1433016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:24.498+0100 [conn1433017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:24.921+0100 [conn1432393] end connection 172.28.0.164:62527 (399 connections now open) 2015-10-05T09:27:24.922+0100 [mongosMain] connection accepted from 172.28.0.164:64419 #1433018 (400 connections now open) 2015-10-05T09:27:24.924+0100 [conn1433018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:25.743+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:27:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:27:28.930+0100 [mongosMain] connection accepted from 127.0.0.1:55244 #1433019 (401 connections now open) 2015-10-05T09:27:28.933+0100 [conn1433019] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:28.938+0100 [conn1433019] end connection 127.0.0.1:55244 (400 connections now open) 2015-10-05T09:27:30.814+0100 [conn1432661] end connection 172.28.0.163:54165 (399 connections now open) 2015-10-05T09:27:30.815+0100 [mongosMain] connection accepted from 172.28.0.163:55245 #1433020 (400 connections now open) 2015-10-05T09:27:30.817+0100 [conn1433020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:31.421+0100 [conn1432705] end connection 172.28.0.163:54259 (399 connections now open) 2015-10-05T09:27:31.422+0100 [mongosMain] connection accepted from 172.28.0.163:55247 #1433021 (400 connections now open) 2015-10-05T09:27:31.423+0100 [conn1433021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:33.839+0100 [conn1432696] end connection 172.28.0.164:63437 (399 connections now open) 2015-10-05T09:27:33.840+0100 [mongosMain] connection accepted from 172.28.0.164:64433 #1433022 (400 connections now open) 2015-10-05T09:27:33.843+0100 [conn1433022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:34.386+0100 [conn1432713] end connection 172.28.0.164:63482 (399 connections now open) 2015-10-05T09:27:34.387+0100 [mongosMain] connection accepted from 172.28.0.164:64435 #1433023 (400 connections now open) 2015-10-05T09:27:34.389+0100 [conn1433023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:34.511+0100 [conn1432072] end connection 172.28.0.163:52274 (399 connections now open) 2015-10-05T09:27:34.511+0100 [conn1432633] end connection 172.28.0.163:54108 (398 connections now open) 2015-10-05T09:27:34.512+0100 [mongosMain] connection accepted from 172.28.0.163:55249 #1433024 (399 connections now open) 2015-10-05T09:27:34.512+0100 [mongosMain] connection accepted from 172.28.0.163:55250 #1433025 (400 connections now open) 2015-10-05T09:27:34.513+0100 [conn1433024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:34.513+0100 [conn1433025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:37.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234775703b51053ef09bc 2015-10-05T09:27:37.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:27:37.486+0100 [conn1432660] end connection 172.28.0.164:63355 (399 connections now open) 2015-10-05T09:27:37.487+0100 [mongosMain] connection accepted from 172.28.0.164:64441 #1433026 (400 connections now open) 2015-10-05T09:27:37.488+0100 [conn1433026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:40.146+0100 [mongosMain] connection accepted from 127.0.0.1:55264 #1433027 (401 connections now open) 2015-10-05T09:27:40.148+0100 [conn1433027] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:40.153+0100 [conn1433027] end connection 127.0.0.1:55264 (400 connections now open) 2015-10-05T09:27:40.828+0100 [conn1432655] end connection 172.28.0.163:54138 (399 connections now open) 2015-10-05T09:27:40.829+0100 [mongosMain] connection accepted from 172.28.0.163:55266 #1433028 (400 connections now open) 2015-10-05T09:27:40.830+0100 [conn1433028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:41.421+0100 [conn1432711] end connection 172.28.0.163:54273 (399 connections now open) 2015-10-05T09:27:41.422+0100 [mongosMain] connection accepted from 172.28.0.163:55268 #1433029 (400 connections now open) 2015-10-05T09:27:41.424+0100 [conn1433029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:44.407+0100 [conn1432720] end connection 172.28.0.164:63497 (399 connections now open) 2015-10-05T09:27:44.407+0100 [mongosMain] connection accepted from 172.28.0.164:64456 #1433030 (400 connections now open) 2015-10-05T09:27:44.409+0100 [conn1433030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:44.526+0100 [conn1432360] end connection 172.28.0.163:53205 (399 connections now open) 2015-10-05T09:27:44.527+0100 [mongosMain] connection accepted from 172.28.0.163:55273 #1433031 (400 connections now open) 2015-10-05T09:27:44.529+0100 [conn1433031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:44.962+0100 [conn1432559] end connection 172.28.0.164:63111 (399 connections now open) 2015-10-05T09:27:44.963+0100 [mongosMain] connection accepted from 172.28.0.164:64458 #1433032 (400 connections now open) 2015-10-05T09:27:44.964+0100 [conn1433032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:49.476+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:27:49.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:27:50.830+0100 [conn1432667] end connection 172.28.0.163:54180 (399 connections now open) 2015-10-05T09:27:50.831+0100 [mongosMain] connection accepted from 172.28.0.163:55283 #1433033 (400 connections now open) 2015-10-05T09:27:50.832+0100 [conn1433033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:51.437+0100 [conn1432717] end connection 172.28.0.163:54280 (399 connections now open) 2015-10-05T09:27:51.438+0100 [mongosMain] connection accepted from 172.28.0.163:55284 #1433034 (400 connections now open) 2015-10-05T09:27:51.440+0100 [conn1433034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:53.870+0100 [conn1432718] end connection 172.28.0.164:63495 (399 connections now open) 2015-10-05T09:27:53.872+0100 [mongosMain] connection accepted from 172.28.0.164:64473 #1433035 (400 connections now open) 2015-10-05T09:27:53.873+0100 [conn1433035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:54.534+0100 [conn1432646] end connection 172.28.0.163:54128 (399 connections now open) 2015-10-05T09:27:54.535+0100 [mongosMain] connection accepted from 172.28.0.163:55290 #1433036 (400 connections now open) 2015-10-05T09:27:54.537+0100 [conn1433036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:54.978+0100 [conn1432358] end connection 172.28.0.164:62433 (399 connections now open) 2015-10-05T09:27:54.980+0100 [mongosMain] connection accepted from 172.28.0.164:64477 #1433037 (400 connections now open) 2015-10-05T09:27:54.981+0100 [conn1433037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:27:55.786+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:27:55.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:27:56.059+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:27:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:28:00.844+0100 [conn1432606] end connection 172.28.0.163:54050 (399 connections now open) 2015-10-05T09:28:00.845+0100 [mongosMain] connection accepted from 172.28.0.163:55303 #1433038 (400 connections now open) 2015-10-05T09:28:00.846+0100 [conn1433038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:01.437+0100 [conn1432724] end connection 172.28.0.163:54290 (399 connections now open) 2015-10-05T09:28:01.438+0100 [mongosMain] connection accepted from 172.28.0.163:55309 #1433039 (400 connections now open) 2015-10-05T09:28:01.439+0100 [conn1433039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:01.890+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612348d26fd57ee993925f5') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444033681794), why: "doing balance round", ts: ObjectId('561234915703b51053ef0b9b') } } gle1: { lastOp: Timestamp 1444033681000|6, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1444033657000|7, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2015-10-05T09:28:01.894+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:28:01.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234915703b51053ef0b9b 2015-10-05T09:28:02.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:28:03.886+0100 [conn1432725] end connection 172.28.0.164:63513 (399 connections now open) 2015-10-05T09:28:03.888+0100 [mongosMain] connection accepted from 172.28.0.164:64489 #1433040 (400 connections now open) 2015-10-05T09:28:03.889+0100 [conn1433040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:04.542+0100 [conn1432642] end connection 172.28.0.163:54122 (399 connections now open) 2015-10-05T09:28:04.543+0100 [mongosMain] connection accepted from 172.28.0.163:55315 #1433041 (400 connections now open) 2015-10-05T09:28:04.544+0100 [conn1433041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:04.978+0100 [conn1432598] end connection 172.28.0.164:63250 (399 connections now open) 2015-10-05T09:28:04.979+0100 [mongosMain] connection accepted from 172.28.0.164:64493 #1433042 (400 connections now open) 2015-10-05T09:28:04.980+0100 [conn1433042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:08.274+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234985703b51053ef0c1e 2015-10-05T09:28:08.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:28:10.860+0100 [conn1432675] end connection 172.28.0.163:54195 (399 connections now open) 2015-10-05T09:28:10.861+0100 [mongosMain] connection accepted from 172.28.0.163:55324 #1433043 (400 connections now open) 2015-10-05T09:28:10.862+0100 [conn1433043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:11.453+0100 [conn1432732] end connection 172.28.0.163:54324 (399 connections now open) 2015-10-05T09:28:11.454+0100 [mongosMain] connection accepted from 172.28.0.163:55326 #1433044 (400 connections now open) 2015-10-05T09:28:11.455+0100 [conn1433044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:13.903+0100 [conn1432701] end connection 172.28.0.164:63460 (399 connections now open) 2015-10-05T09:28:13.904+0100 [mongosMain] connection accepted from 172.28.0.164:64498 #1433045 (400 connections now open) 2015-10-05T09:28:13.906+0100 [conn1433045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:14.432+0100 [conn1432727] end connection 172.28.0.164:63515 (399 connections now open) 2015-10-05T09:28:14.433+0100 [mongosMain] connection accepted from 172.28.0.164:64499 #1433046 (400 connections now open) 2015-10-05T09:28:14.435+0100 [conn1433046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:14.542+0100 [conn1432726] end connection 172.28.0.163:54296 (399 connections now open) 2015-10-05T09:28:14.543+0100 [mongosMain] connection accepted from 172.28.0.163:55330 #1433047 (400 connections now open) 2015-10-05T09:28:14.544+0100 [conn1433047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:16.359+0100 [conn1432698] end connection 172.28.0.164:63442 (399 connections now open) 2015-10-05T09:28:16.359+0100 [conn1432333] end connection 172.28.0.164:62373 (399 connections now open) 2015-10-05T09:28:16.367+0100 [mongosMain] connection accepted from 172.28.0.164:64503 #1433048 (399 connections now open) 2015-10-05T09:28:16.368+0100 [mongosMain] connection accepted from 172.28.0.164:64502 #1433049 (400 connections now open) 2015-10-05T09:28:16.368+0100 [conn1433048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:16.369+0100 [conn1433049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:20.864+0100 [conn1432615] end connection 172.28.0.163:54063 (399 connections now open) 2015-10-05T09:28:20.865+0100 [mongosMain] connection accepted from 172.28.0.163:55341 #1433050 (400 connections now open) 2015-10-05T09:28:20.866+0100 [conn1433050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:21.457+0100 [conn1432734] end connection 172.28.0.163:54355 (399 connections now open) 2015-10-05T09:28:21.458+0100 [mongosMain] connection accepted from 172.28.0.163:55343 #1433051 (400 connections now open) 2015-10-05T09:28:21.458+0100 [conn1433051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:23.917+0100 [conn1432733] end connection 172.28.0.164:63549 (399 connections now open) 2015-10-05T09:28:23.918+0100 [mongosMain] connection accepted from 172.28.0.164:64518 #1433052 (400 connections now open) 2015-10-05T09:28:23.919+0100 [conn1433052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:24.458+0100 [conn1432731] end connection 172.28.0.164:63531 (399 connections now open) 2015-10-05T09:28:24.516+0100 [mongosMain] connection accepted from 172.28.0.164:64522 #1433053 (400 connections now open) 2015-10-05T09:28:24.519+0100 [conn1433053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:24.559+0100 [conn1432539] end connection 172.28.0.163:53861 (399 connections now open) 2015-10-05T09:28:24.560+0100 [mongosMain] connection accepted from 172.28.0.163:55346 #1433054 (400 connections now open) 2015-10-05T09:28:24.561+0100 [conn1433054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:26.366+0100 [conn1432070] end connection 172.28.0.164:61548 (399 connections now open) 2015-10-05T09:28:26.381+0100 [conn1432703] end connection 172.28.0.164:63463 (398 connections now open) 2015-10-05T09:28:26.381+0100 [mongosMain] connection accepted from 172.28.0.164:64529 #1433055 (399 connections now open) 2015-10-05T09:28:26.381+0100 [mongosMain] connection accepted from 172.28.0.164:64530 #1433056 (400 connections now open) 2015-10-05T09:28:26.381+0100 [conn1433055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:26.381+0100 [conn1433056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:27.099+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:28:27.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:28:27.208+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:28:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:28:28.712+0100 [mongosMain] connection accepted from 127.0.0.1:55349 #1433057 (401 connections now open) 2015-10-05T09:28:28.715+0100 [conn1433057] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:28.721+0100 [conn1433057] end connection 127.0.0.1:55349 (400 connections now open) 2015-10-05T09:28:30.876+0100 [conn1432694] end connection 172.28.0.163:54218 (399 connections now open) 2015-10-05T09:28:30.877+0100 [mongosMain] connection accepted from 172.28.0.163:55350 #1433058 (400 connections now open) 2015-10-05T09:28:30.877+0100 [conn1433058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:31.468+0100 [conn1432737] end connection 172.28.0.163:54366 (399 connections now open) 2015-10-05T09:28:31.469+0100 [mongosMain] connection accepted from 172.28.0.163:55351 #1433059 (400 connections now open) 2015-10-05T09:28:31.470+0100 [conn1433059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:33.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234b15703b51053ef0e31 2015-10-05T09:28:33.916+0100 [conn1432706] end connection 172.28.0.164:63467 (399 connections now open) 2015-10-05T09:28:33.917+0100 [mongosMain] connection accepted from 172.28.0.164:64539 #1433060 (400 connections now open) 2015-10-05T09:28:33.918+0100 [conn1433060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:34.171+0100 [conn1432049] end connection 172.28.0.164:61483 (399 connections now open) 2015-10-05T09:28:34.172+0100 [mongosMain] connection accepted from 172.28.0.164:64540 #1433061 (400 connections now open) 2015-10-05T09:28:34.174+0100 [conn1433061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:34.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:28:34.463+0100 [conn1432740] end connection 172.28.0.164:63577 (399 connections now open) 2015-10-05T09:28:34.463+0100 [mongosMain] connection accepted from 172.28.0.164:64542 #1433062 (400 connections now open) 2015-10-05T09:28:34.465+0100 [conn1433062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:34.557+0100 [conn1432627] end connection 172.28.0.163:54087 (399 connections now open) 2015-10-05T09:28:34.558+0100 [mongosMain] connection accepted from 172.28.0.163:55356 #1433063 (400 connections now open) 2015-10-05T09:28:34.559+0100 [conn1433063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:36.403+0100 [conn1432709] end connection 172.28.0.164:63471 (399 connections now open) 2015-10-05T09:28:36.409+0100 [mongosMain] connection accepted from 172.28.0.164:64547 #1433064 (400 connections now open) 2015-10-05T09:28:36.410+0100 [conn1433064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:39.599+0100 [mongosMain] connection accepted from 127.0.0.1:55358 #1433065 (401 connections now open) 2015-10-05T09:28:39.602+0100 [conn1433065] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:39.606+0100 [conn1433065] end connection 127.0.0.1:55358 (400 connections now open) 2015-10-05T09:28:40.877+0100 [conn1432688] end connection 172.28.0.163:54203 (399 connections now open) 2015-10-05T09:28:40.879+0100 [mongosMain] connection accepted from 172.28.0.163:55360 #1433066 (400 connections now open) 2015-10-05T09:28:40.880+0100 [conn1433066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:41.484+0100 [conn1432742] end connection 172.28.0.163:54375 (399 connections now open) 2015-10-05T09:28:41.485+0100 [mongosMain] connection accepted from 172.28.0.163:55364 #1433067 (400 connections now open) 2015-10-05T09:28:41.486+0100 [conn1433067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:44.479+0100 [conn1432744] end connection 172.28.0.164:63596 (399 connections now open) 2015-10-05T09:28:44.480+0100 [mongosMain] connection accepted from 172.28.0.164:64562 #1433068 (400 connections now open) 2015-10-05T09:28:44.481+0100 [conn1433068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:44.572+0100 [conn1432663] end connection 172.28.0.163:54171 (399 connections now open) 2015-10-05T09:28:44.574+0100 [mongosMain] connection accepted from 172.28.0.163:55370 #1433069 (400 connections now open) 2015-10-05T09:28:44.574+0100 [conn1433069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:46.707+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234be5703b51053ef0f6c 2015-10-05T09:28:46.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:28:51.485+0100 [conn1432746] end connection 172.28.0.163:54383 (399 connections now open) 2015-10-05T09:28:51.486+0100 [mongosMain] connection accepted from 172.28.0.163:55381 #1433070 (400 connections now open) 2015-10-05T09:28:51.487+0100 [conn1433070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:53.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234c45703b51053ef0fef 2015-10-05T09:28:53.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:28:53.948+0100 [conn1432735] end connection 172.28.0.164:63556 (399 connections now open) 2015-10-05T09:28:53.949+0100 [mongosMain] connection accepted from 172.28.0.164:64573 #1433071 (400 connections now open) 2015-10-05T09:28:53.950+0100 [conn1433071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:54.494+0100 [conn1432748] end connection 172.28.0.164:63618 (399 connections now open) 2015-10-05T09:28:54.495+0100 [mongosMain] connection accepted from 172.28.0.164:64575 #1433072 (400 connections now open) 2015-10-05T09:28:54.496+0100 [conn1433072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:28:58.336+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:28:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:29:00.827+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:29:00.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:29:01.500+0100 [conn1432749] end connection 172.28.0.163:54400 (399 connections now open) 2015-10-05T09:29:01.501+0100 [mongosMain] connection accepted from 172.28.0.163:55400 #1433073 (400 connections now open) 2015-10-05T09:29:01.502+0100 [conn1433073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:03.948+0100 [conn1432729] end connection 172.28.0.164:63529 (399 connections now open) 2015-10-05T09:29:03.950+0100 [mongosMain] connection accepted from 172.28.0.164:64591 #1433074 (400 connections now open) 2015-10-05T09:29:03.951+0100 [conn1433074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:04.494+0100 [conn1432751] end connection 172.28.0.164:63631 (399 connections now open) 2015-10-05T09:29:04.495+0100 [mongosMain] connection accepted from 172.28.0.164:64593 #1433075 (400 connections now open) 2015-10-05T09:29:04.497+0100 [conn1433075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:11.500+0100 [conn1432752] end connection 172.28.0.163:54414 (399 connections now open) 2015-10-05T09:29:11.501+0100 [mongosMain] connection accepted from 172.28.0.163:55414 #1433076 (400 connections now open) 2015-10-05T09:29:11.502+0100 [conn1433076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:13.153+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561234d526fd57ee99392600') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444033752844), why: "doing balance round", ts: ObjectId('561234d85703b51053ef11eb') } } gle1: { lastOp: Timestamp 1444033753000|1, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1444033733000|10, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2015-10-05T09:29:13.163+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:29:13.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234d85703b51053ef11eb 2015-10-05T09:29:13.964+0100 [conn1432738] end connection 172.28.0.164:63575 (399 connections now open) 2015-10-05T09:29:13.965+0100 [mongosMain] connection accepted from 172.28.0.164:64598 #1433077 (400 connections now open) 2015-10-05T09:29:13.968+0100 [conn1433077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:14.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:14.510+0100 [conn1432754] end connection 172.28.0.164:63648 (399 connections now open) 2015-10-05T09:29:14.511+0100 [mongosMain] connection accepted from 172.28.0.164:64600 #1433078 (400 connections now open) 2015-10-05T09:29:14.513+0100 [conn1433078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:14.714+0100 [conn1432730] end connection 172.28.0.163:54308 (399 connections now open) 2015-10-05T09:29:14.719+0100 [mongosMain] connection accepted from 172.28.0.163:55423 #1433079 (400 connections now open) 2015-10-05T09:29:14.720+0100 [conn1433079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:16.415+0100 [conn1432714] end connection 172.28.0.164:63484 (399 connections now open) 2015-10-05T09:29:16.417+0100 [mongosMain] connection accepted from 172.28.0.164:64605 #1433080 (400 connections now open) 2015-10-05T09:29:16.420+0100 [conn1433080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:20.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234e05703b51053ef129b 2015-10-05T09:29:20.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:21.516+0100 [conn1432755] end connection 172.28.0.163:54438 (399 connections now open) 2015-10-05T09:29:21.517+0100 [mongosMain] connection accepted from 172.28.0.163:55431 #1433081 (400 connections now open) 2015-10-05T09:29:21.517+0100 [conn1433081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:24.716+0100 [conn1432712] end connection 172.28.0.163:54275 (399 connections now open) 2015-10-05T09:29:24.717+0100 [mongosMain] connection accepted from 172.28.0.163:55434 #1433082 (400 connections now open) 2015-10-05T09:29:24.718+0100 [conn1433082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:26.959+0100 [conn1432666] end connection 172.28.0.164:63363 (399 connections now open) 2015-10-05T09:29:26.960+0100 [mongosMain] connection accepted from 172.28.0.164:64624 #1433083 (400 connections now open) 2015-10-05T09:29:26.962+0100 [conn1433083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:27.161+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234e65703b51053ef132b 2015-10-05T09:29:27.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:28.212+0100 [mongosMain] connection accepted from 127.0.0.1:55436 #1433084 (401 connections now open) 2015-10-05T09:29:28.215+0100 [conn1433084] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:28.219+0100 [conn1433084] end connection 127.0.0.1:55436 (400 connections now open) 2015-10-05T09:29:28.595+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:29:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:29:32.935+0100 [conn1432710] end connection 172.28.0.163:54270 (399 connections now open) 2015-10-05T09:29:32.953+0100 [mongosMain] connection accepted from 172.28.0.163:55439 #1433085 (400 connections now open) 2015-10-05T09:29:32.954+0100 [conn1433085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:34.714+0100 [conn1432670] end connection 172.28.0.163:54188 (399 connections now open) 2015-10-05T09:29:34.714+0100 [mongosMain] connection accepted from 172.28.0.163:55445 #1433086 (400 connections now open) 2015-10-05T09:29:34.715+0100 [conn1433086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:35.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234ed5703b51053ef13cc 2015-10-05T09:29:35.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:36.961+0100 [conn1432574] end connection 172.28.0.164:63164 (399 connections now open) 2015-10-05T09:29:36.961+0100 [mongosMain] connection accepted from 172.28.0.164:64641 #1433087 (400 connections now open) 2015-10-05T09:29:36.963+0100 [conn1433087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:39.268+0100 [mongosMain] connection accepted from 127.0.0.1:55448 #1433088 (401 connections now open) 2015-10-05T09:29:39.271+0100 [conn1433088] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:39.276+0100 [conn1433088] end connection 127.0.0.1:55448 (400 connections now open) 2015-10-05T09:29:40.939+0100 [conn1432699] end connection 172.28.0.163:54236 (399 connections now open) 2015-10-05T09:29:40.941+0100 [mongosMain] connection accepted from 172.28.0.163:55454 #1433089 (400 connections now open) 2015-10-05T09:29:40.942+0100 [conn1433089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:42.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234f55703b51053ef14de 2015-10-05T09:29:42.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:44.730+0100 [conn1432545] end connection 172.28.0.163:53871 (399 connections now open) 2015-10-05T09:29:44.731+0100 [mongosMain] connection accepted from 172.28.0.163:55458 #1433090 (400 connections now open) 2015-10-05T09:29:44.733+0100 [conn1433090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:46.975+0100 [conn1432673] end connection 172.28.0.164:63380 (399 connections now open) 2015-10-05T09:29:46.976+0100 [mongosMain] connection accepted from 172.28.0.164:64653 #1433091 (400 connections now open) 2015-10-05T09:29:46.978+0100 [conn1433091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:49.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561234fc5703b51053ef15d8 2015-10-05T09:29:49.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:54.746+0100 [conn1432719] end connection 172.28.0.163:54284 (399 connections now open) 2015-10-05T09:29:54.747+0100 [mongosMain] connection accepted from 172.28.0.163:55472 #1433092 (400 connections now open) 2015-10-05T09:29:54.748+0100 [conn1433092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:55.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235035703b51053ef16c8 2015-10-05T09:29:55.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:29:56.975+0100 [conn1432597] end connection 172.28.0.164:63249 (399 connections now open) 2015-10-05T09:29:56.977+0100 [mongosMain] connection accepted from 172.28.0.164:64663 #1433093 (400 connections now open) 2015-10-05T09:29:56.978+0100 [conn1433093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:29:58.808+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:29:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:30:02.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235095703b51053ef1756 2015-10-05T09:30:02.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:30:04.558+0100 [conn1432757] end connection 172.28.0.164:63660 (399 connections now open) 2015-10-05T09:30:04.560+0100 [mongosMain] connection accepted from 172.28.0.164:64688 #1433094 (400 connections now open) 2015-10-05T09:30:04.563+0100 [conn1433094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:04.745+0100 [conn1432618] end connection 172.28.0.163:54068 (399 connections now open) 2015-10-05T09:30:04.746+0100 [mongosMain] connection accepted from 172.28.0.163:55499 #1433095 (400 connections now open) 2015-10-05T09:30:04.747+0100 [conn1433095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:06.992+0100 [conn1432680] end connection 172.28.0.164:63401 (399 connections now open) 2015-10-05T09:30:06.994+0100 [mongosMain] connection accepted from 172.28.0.164:64690 #1433096 (400 connections now open) 2015-10-05T09:30:06.996+0100 [conn1433096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:08.415+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:30:08.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:30:14.761+0100 [conn1432609] end connection 172.28.0.163:54056 (399 connections now open) 2015-10-05T09:30:14.762+0100 [mongosMain] connection accepted from 172.28.0.163:55512 #1433097 (400 connections now open) 2015-10-05T09:30:14.763+0100 [conn1433097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:17.060+0100 [conn1432761] end connection 172.28.0.164:63676 (399 connections now open) 2015-10-05T09:30:17.081+0100 [mongosMain] connection accepted from 172.28.0.164:64697 #1433098 (400 connections now open) 2015-10-05T09:30:17.088+0100 [conn1433098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:21.356+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:30:21.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:30:21.563+0100 [conn1432758] end connection 172.28.0.163:54450 (399 connections now open) 2015-10-05T09:30:21.563+0100 [mongosMain] connection accepted from 172.28.0.163:55523 #1433099 (400 connections now open) 2015-10-05T09:30:21.564+0100 [conn1433099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:24.589+0100 [conn1432773] end connection 172.28.0.164:63723 (399 connections now open) 2015-10-05T09:30:24.590+0100 [mongosMain] connection accepted from 172.28.0.164:64712 #1433100 (400 connections now open) 2015-10-05T09:30:24.591+0100 [conn1433100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:24.762+0100 [conn1432658] end connection 172.28.0.163:54152 (399 connections now open) 2015-10-05T09:30:24.764+0100 [mongosMain] connection accepted from 172.28.0.163:55524 #1433101 (400 connections now open) 2015-10-05T09:30:24.764+0100 [conn1433101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:27.057+0100 [conn1432693] end connection 172.28.0.164:63427 (399 connections now open) 2015-10-05T09:30:27.058+0100 [mongosMain] connection accepted from 172.28.0.164:64717 #1433102 (400 connections now open) 2015-10-05T09:30:27.061+0100 [conn1433102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:27.439+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:30:27.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:30:28.446+0100 [mongosMain] connection accepted from 127.0.0.1:55528 #1433103 (401 connections now open) 2015-10-05T09:30:28.449+0100 [conn1433103] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:28.454+0100 [conn1433103] end connection 127.0.0.1:55528 (400 connections now open) 2015-10-05T09:30:28.943+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:30:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:30:31.579+0100 [conn1432779] end connection 172.28.0.163:54535 (399 connections now open) 2015-10-05T09:30:31.580+0100 [mongosMain] connection accepted from 172.28.0.163:55531 #1433104 (400 connections now open) 2015-10-05T09:30:31.581+0100 [conn1433104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:33.650+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235295703b51053ef1a59 2015-10-05T09:30:33.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:30:34.604+0100 [conn1432780] end connection 172.28.0.164:63753 (399 connections now open) 2015-10-05T09:30:34.605+0100 [mongosMain] connection accepted from 172.28.0.164:64729 #1433105 (400 connections now open) 2015-10-05T09:30:34.606+0100 [conn1433105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:34.777+0100 [conn1432739] end connection 172.28.0.163:54371 (399 connections now open) 2015-10-05T09:30:34.778+0100 [mongosMain] connection accepted from 172.28.0.163:55533 #1433106 (400 connections now open) 2015-10-05T09:30:34.779+0100 [conn1433106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:37.070+0100 [conn1432766] end connection 172.28.0.164:63692 (399 connections now open) 2015-10-05T09:30:37.071+0100 [mongosMain] connection accepted from 172.28.0.164:64735 #1433107 (400 connections now open) 2015-10-05T09:30:37.077+0100 [conn1433107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:39.357+0100 [mongosMain] connection accepted from 127.0.0.1:55537 #1433108 (401 connections now open) 2015-10-05T09:30:39.360+0100 [conn1433108] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:39.364+0100 [conn1433108] end connection 127.0.0.1:55537 (400 connections now open) 2015-10-05T09:30:40.987+0100 [conn1432723] end connection 172.28.0.163:54287 (399 connections now open) 2015-10-05T09:30:40.988+0100 [mongosMain] connection accepted from 172.28.0.163:55540 #1433109 (400 connections now open) 2015-10-05T09:30:40.989+0100 [conn1433109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:41.495+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:30:41.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:30:41.585+0100 [conn1432784] end connection 172.28.0.163:54546 (399 connections now open) 2015-10-05T09:30:41.586+0100 [mongosMain] connection accepted from 172.28.0.163:55543 #1433110 (400 connections now open) 2015-10-05T09:30:41.586+0100 [conn1433110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:44.619+0100 [conn1432785] end connection 172.28.0.164:63771 (399 connections now open) 2015-10-05T09:30:44.620+0100 [mongosMain] connection accepted from 172.28.0.164:64745 #1433111 (400 connections now open) 2015-10-05T09:30:44.621+0100 [conn1433111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:44.780+0100 [conn1432765] end connection 172.28.0.163:54461 (399 connections now open) 2015-10-05T09:30:44.781+0100 [mongosMain] connection accepted from 172.28.0.163:55548 #1433112 (400 connections now open) 2015-10-05T09:30:44.782+0100 [conn1433112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:47.071+0100 [conn1432770] end connection 172.28.0.164:63706 (399 connections now open) 2015-10-05T09:30:47.071+0100 [mongosMain] connection accepted from 172.28.0.164:64750 #1433113 (400 connections now open) 2015-10-05T09:30:47.073+0100 [conn1433113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:47.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235375703b51053ef1b45 2015-10-05T09:30:47.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:30:51.002+0100 [conn1432763] end connection 172.28.0.163:54460 (399 connections now open) 2015-10-05T09:30:51.003+0100 [mongosMain] connection accepted from 172.28.0.163:55557 #1433114 (400 connections now open) 2015-10-05T09:30:51.004+0100 [conn1433114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:54.635+0100 [conn1432790] end connection 172.28.0.164:63787 (399 connections now open) 2015-10-05T09:30:54.636+0100 [mongosMain] connection accepted from 172.28.0.164:64758 #1433115 (400 connections now open) 2015-10-05T09:30:54.638+0100 [conn1433115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:54.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612353e5703b51053ef1bde 2015-10-05T09:30:54.818+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:30:56.263+0100 [conn1432771] end connection 172.28.0.163:54485 (399 connections now open) 2015-10-05T09:30:56.264+0100 [mongosMain] connection accepted from 172.28.0.163:55565 #1433116 (400 connections now open) 2015-10-05T09:30:56.265+0100 [conn1433116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:58.747+0100 [conn1432772] end connection 172.28.0.164:63717 (399 connections now open) 2015-10-05T09:30:58.749+0100 [mongosMain] connection accepted from 172.28.0.164:64759 #1433117 (400 connections now open) 2015-10-05T09:30:58.750+0100 [conn1433117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:30:59.252+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:30:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:31:01.002+0100 [conn1432768] end connection 172.28.0.163:54469 (399 connections now open) 2015-10-05T09:31:01.003+0100 [mongosMain] connection accepted from 172.28.0.163:55579 #1433118 (400 connections now open) 2015-10-05T09:31:01.004+0100 [conn1433118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:01.596+0100 [conn1432789] end connection 172.28.0.163:54560 (399 connections now open) 2015-10-05T09:31:01.597+0100 [mongosMain] connection accepted from 172.28.0.163:55588 #1433119 (400 connections now open) 2015-10-05T09:31:01.598+0100 [conn1433119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:06.829+0100 [conn1432531] end connection 172.28.0.163:53830 (399 connections now open) 2015-10-05T09:31:06.841+0100 [mongosMain] connection accepted from 172.28.0.163:55596 #1433120 (400 connections now open) 2015-10-05T09:31:06.871+0100 [conn1433120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:07.054+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:31:07.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:31:14.667+0100 [conn1432793] end connection 172.28.0.164:63800 (399 connections now open) 2015-10-05T09:31:14.668+0100 [mongosMain] connection accepted from 172.28.0.164:64787 #1433121 (400 connections now open) 2015-10-05T09:31:14.669+0100 [conn1433121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:15.314+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:31:15.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:31:16.808+0100 [conn1432760] end connection 172.28.0.163:54452 (399 connections now open) 2015-10-05T09:31:16.808+0100 [mongosMain] connection accepted from 172.28.0.163:55606 #1433122 (400 connections now open) 2015-10-05T09:31:16.809+0100 [conn1433122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:18.742+0100 [conn1432778] end connection 172.28.0.164:63739 (399 connections now open) 2015-10-05T09:31:18.744+0100 [mongosMain] connection accepted from 172.28.0.164:64793 #1433123 (400 connections now open) 2015-10-05T09:31:18.745+0100 [conn1433123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:21.018+0100 [conn1432796] end connection 172.28.0.163:54585 (399 connections now open) 2015-10-05T09:31:21.020+0100 [mongosMain] connection accepted from 172.28.0.163:55611 #1433124 (400 connections now open) 2015-10-05T09:31:21.021+0100 [conn1433124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:21.625+0100 [conn1432797] end connection 172.28.0.163:54593 (399 connections now open) 2015-10-05T09:31:21.626+0100 [mongosMain] connection accepted from 172.28.0.163:55612 #1433125 (400 connections now open) 2015-10-05T09:31:21.627+0100 [conn1433125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:21.715+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:31:21.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:31:24.667+0100 [conn1432802] end connection 172.28.0.164:63819 (399 connections now open) 2015-10-05T09:31:24.668+0100 [mongosMain] connection accepted from 172.28.0.164:64805 #1433126 (400 connections now open) 2015-10-05T09:31:24.670+0100 [conn1433126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:27.384+0100 [conn1432769] end connection 172.28.0.163:54473 (399 connections now open) 2015-10-05T09:31:27.387+0100 [mongosMain] connection accepted from 172.28.0.163:55614 #1433127 (400 connections now open) 2015-10-05T09:31:27.388+0100 [conn1433127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:27.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612355f5703b51053ef1fe0 2015-10-05T09:31:27.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:31:28.200+0100 [mongosMain] connection accepted from 127.0.0.1:55617 #1433128 (401 connections now open) 2015-10-05T09:31:28.204+0100 [conn1433128] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:28.209+0100 [conn1433128] end connection 127.0.0.1:55617 (400 connections now open) 2015-10-05T09:31:29.287+0100 [conn1432795] end connection 172.28.0.164:63802 (399 connections now open) 2015-10-05T09:31:29.395+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:31:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:31:29.466+0100 [mongosMain] connection accepted from 172.28.0.164:64813 #1433129 (400 connections now open) 2015-10-05T09:31:29.468+0100 [conn1433129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:31.627+0100 [conn1432806] end connection 172.28.0.163:54626 (399 connections now open) 2015-10-05T09:31:31.628+0100 [mongosMain] connection accepted from 172.28.0.163:55621 #1433130 (400 connections now open) 2015-10-05T09:31:31.630+0100 [conn1433130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:34.690+0100 [conn1432808] end connection 172.28.0.164:63840 (399 connections now open) 2015-10-05T09:31:34.694+0100 [mongosMain] connection accepted from 172.28.0.164:64823 #1433131 (400 connections now open) 2015-10-05T09:31:34.696+0100 [conn1433131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:37.376+0100 [conn1432786] end connection 172.28.0.163:54552 (399 connections now open) 2015-10-05T09:31:37.377+0100 [mongosMain] connection accepted from 172.28.0.163:55625 #1433132 (400 connections now open) 2015-10-05T09:31:37.378+0100 [conn1433132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:38.757+0100 [conn1432804] end connection 172.28.0.164:63821 (399 connections now open) 2015-10-05T09:31:38.758+0100 [mongosMain] connection accepted from 172.28.0.164:64834 #1433133 (400 connections now open) 2015-10-05T09:31:38.760+0100 [conn1433133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:39.529+0100 [mongosMain] connection accepted from 127.0.0.1:55626 #1433134 (401 connections now open) 2015-10-05T09:31:39.532+0100 [conn1433134] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:39.538+0100 [conn1433134] end connection 127.0.0.1:55626 (400 connections now open) 2015-10-05T09:31:41.033+0100 [conn1432800] end connection 172.28.0.163:54615 (399 connections now open) 2015-10-05T09:31:41.034+0100 [mongosMain] connection accepted from 172.28.0.163:55628 #1433135 (400 connections now open) 2015-10-05T09:31:41.035+0100 [conn1433135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:41.642+0100 [conn1432813] end connection 172.28.0.163:54630 (399 connections now open) 2015-10-05T09:31:41.643+0100 [mongosMain] connection accepted from 172.28.0.163:55630 #1433136 (400 connections now open) 2015-10-05T09:31:41.644+0100 [conn1433136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:44.684+0100 [conn1432814] end connection 172.28.0.164:63854 (399 connections now open) 2015-10-05T09:31:44.685+0100 [mongosMain] connection accepted from 172.28.0.164:64845 #1433137 (400 connections now open) 2015-10-05T09:31:44.686+0100 [conn1433137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:47.384+0100 [conn1432774] end connection 172.28.0.163:54511 (399 connections now open) 2015-10-05T09:31:47.385+0100 [mongosMain] connection accepted from 172.28.0.163:55640 #1433138 (400 connections now open) 2015-10-05T09:31:47.387+0100 [conn1433138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:47.539+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:31:47.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:31:48.772+0100 [conn1432782] end connection 172.28.0.164:63755 (399 connections now open) 2015-10-05T09:31:48.773+0100 [mongosMain] connection accepted from 172.28.0.164:64851 #1433139 (400 connections now open) 2015-10-05T09:31:48.775+0100 [conn1433139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:51.642+0100 [conn1432819] end connection 172.28.0.163:54638 (399 connections now open) 2015-10-05T09:31:51.643+0100 [mongosMain] connection accepted from 172.28.0.163:55647 #1433140 (400 connections now open) 2015-10-05T09:31:51.644+0100 [conn1433140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:53.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235795703b51053ef2281 2015-10-05T09:31:53.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:31:54.684+0100 [conn1432821] end connection 172.28.0.164:63871 (399 connections now open) 2015-10-05T09:31:54.684+0100 [mongosMain] connection accepted from 172.28.0.164:64859 #1433141 (400 connections now open) 2015-10-05T09:31:54.686+0100 [conn1433141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:59.352+0100 [conn1432775] end connection 172.28.0.164:63727 (399 connections now open) 2015-10-05T09:31:59.359+0100 [mongosMain] connection accepted from 172.28.0.164:64863 #1433142 (400 connections now open) 2015-10-05T09:31:59.361+0100 [conn1433142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:31:59.530+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:31:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:31:59.706+0100 [conn1432798] end connection 172.28.0.163:54608 (399 connections now open) 2015-10-05T09:31:59.813+0100 [mongosMain] connection accepted from 172.28.0.163:55657 #1433143 (400 connections now open) 2015-10-05T09:31:59.814+0100 [conn1433143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:01.051+0100 [conn1432704] end connection 172.28.0.163:54256 (399 connections now open) 2015-10-05T09:32:01.052+0100 [mongosMain] connection accepted from 172.28.0.163:55668 #1433144 (400 connections now open) 2015-10-05T09:32:01.053+0100 [conn1433144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:01.658+0100 [conn1432825] end connection 172.28.0.163:54655 (399 connections now open) 2015-10-05T09:32:01.659+0100 [mongosMain] connection accepted from 172.28.0.163:55672 #1433145 (400 connections now open) 2015-10-05T09:32:01.660+0100 [conn1433145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:04.153+0100 [conn1432690] end connection 172.28.0.164:63420 (399 connections now open) 2015-10-05T09:32:04.154+0100 [mongosMain] connection accepted from 172.28.0.164:64877 #1433146 (400 connections now open) 2015-10-05T09:32:04.178+0100 [conn1433146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:04.699+0100 [conn1432827] end connection 172.28.0.164:63888 (399 connections now open) 2015-10-05T09:32:04.700+0100 [mongosMain] connection accepted from 172.28.0.164:64879 #1433147 (400 connections now open) 2015-10-05T09:32:04.702+0100 [conn1433147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:06.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235855703b51053ef247d 2015-10-05T09:32:06.390+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:32:09.303+0100 [conn1432777] end connection 172.28.0.163:54530 (399 connections now open) 2015-10-05T09:32:09.304+0100 [mongosMain] connection accepted from 172.28.0.163:55684 #1433148 (400 connections now open) 2015-10-05T09:32:09.305+0100 [conn1433148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:09.333+0100 [conn1432792] end connection 172.28.0.164:63789 (399 connections now open) 2015-10-05T09:32:09.334+0100 [mongosMain] connection accepted from 172.28.0.164:64881 #1433149 (400 connections now open) 2015-10-05T09:32:09.336+0100 [conn1433149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:11.065+0100 [conn1432812] end connection 172.28.0.163:54629 (399 connections now open) 2015-10-05T09:32:11.066+0100 [mongosMain] connection accepted from 172.28.0.163:55688 #1433150 (400 connections now open) 2015-10-05T09:32:11.066+0100 [conn1433150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:11.658+0100 [conn1432831] end connection 172.28.0.163:54682 (399 connections now open) 2015-10-05T09:32:11.660+0100 [mongosMain] connection accepted from 172.28.0.163:55690 #1433151 (400 connections now open) 2015-10-05T09:32:11.661+0100 [conn1433151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:14.168+0100 [conn1432756] end connection 172.28.0.164:63658 (399 connections now open) 2015-10-05T09:32:14.170+0100 [mongosMain] connection accepted from 172.28.0.164:64883 #1433152 (400 connections now open) 2015-10-05T09:32:14.171+0100 [conn1433152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:19.315+0100 [conn1432781] end connection 172.28.0.163:54537 (399 connections now open) 2015-10-05T09:32:19.316+0100 [mongosMain] connection accepted from 172.28.0.163:55700 #1433153 (400 connections now open) 2015-10-05T09:32:19.317+0100 [conn1433153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:19.335+0100 [conn1432816] end connection 172.28.0.164:63857 (399 connections now open) 2015-10-05T09:32:19.340+0100 [mongosMain] connection accepted from 172.28.0.164:64890 #1433154 (400 connections now open) 2015-10-05T09:32:19.342+0100 [conn1433154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:21.674+0100 [conn1432836] end connection 172.28.0.163:54708 (399 connections now open) 2015-10-05T09:32:21.675+0100 [mongosMain] connection accepted from 172.28.0.163:55704 #1433155 (400 connections now open) 2015-10-05T09:32:21.677+0100 [conn1433155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:24.185+0100 [conn1432747] end connection 172.28.0.164:63615 (399 connections now open) 2015-10-05T09:32:24.186+0100 [mongosMain] connection accepted from 172.28.0.164:64900 #1433156 (400 connections now open) 2015-10-05T09:32:24.189+0100 [conn1433156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:24.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235985703b51053ef27b1 2015-10-05T09:32:24.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:32:24.731+0100 [conn1432833] end connection 172.28.0.164:63907 (399 connections now open) 2015-10-05T09:32:24.731+0100 [mongosMain] connection accepted from 172.28.0.164:64902 #1433157 (400 connections now open) 2015-10-05T09:32:24.733+0100 [conn1433157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:28.818+0100 [mongosMain] connection accepted from 127.0.0.1:55710 #1433158 (401 connections now open) 2015-10-05T09:32:28.821+0100 [conn1433158] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:28.826+0100 [conn1433158] end connection 127.0.0.1:55710 (400 connections now open) 2015-10-05T09:32:29.318+0100 [conn1432791] end connection 172.28.0.163:54566 (399 connections now open) 2015-10-05T09:32:29.319+0100 [mongosMain] connection accepted from 172.28.0.163:55711 #1433159 (400 connections now open) 2015-10-05T09:32:29.320+0100 [conn1433159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:29.348+0100 [conn1432526] end connection 172.28.0.164:63018 (399 connections now open) 2015-10-05T09:32:29.349+0100 [mongosMain] connection accepted from 172.28.0.164:64909 #1433160 (400 connections now open) 2015-10-05T09:32:29.350+0100 [conn1433160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:29.775+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:32:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:32:31.676+0100 [conn1432840] end connection 172.28.0.163:54725 (399 connections now open) 2015-10-05T09:32:31.676+0100 [mongosMain] connection accepted from 172.28.0.163:55716 #1433161 (400 connections now open) 2015-10-05T09:32:31.678+0100 [conn1433161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:34.185+0100 [conn1432750] end connection 172.28.0.164:63629 (399 connections now open) 2015-10-05T09:32:34.185+0100 [mongosMain] connection accepted from 172.28.0.164:64920 #1433162 (400 connections now open) 2015-10-05T09:32:34.187+0100 [conn1433162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:34.730+0100 [conn1432842] end connection 172.28.0.164:63926 (399 connections now open) 2015-10-05T09:32:34.731+0100 [mongosMain] connection accepted from 172.28.0.164:64923 #1433163 (400 connections now open) 2015-10-05T09:32:34.732+0100 [conn1433163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:37.905+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:32:37.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:32:39.326+0100 [conn1432794] end connection 172.28.0.163:54576 (399 connections now open) 2015-10-05T09:32:39.328+0100 [mongosMain] connection accepted from 172.28.0.163:55719 #1433164 (400 connections now open) 2015-10-05T09:32:39.329+0100 [conn1433164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:39.353+0100 [conn1432613] end connection 172.28.0.164:63285 (399 connections now open) 2015-10-05T09:32:39.356+0100 [mongosMain] connection accepted from 172.28.0.164:64931 #1433165 (400 connections now open) 2015-10-05T09:32:39.358+0100 [conn1433165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:39.913+0100 [mongosMain] connection accepted from 127.0.0.1:55723 #1433166 (401 connections now open) 2015-10-05T09:32:39.915+0100 [conn1433166] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:39.919+0100 [conn1433166] end connection 127.0.0.1:55723 (400 connections now open) 2015-10-05T09:32:41.689+0100 [conn1432847] end connection 172.28.0.163:54735 (399 connections now open) 2015-10-05T09:32:41.690+0100 [mongosMain] connection accepted from 172.28.0.163:55728 #1433167 (400 connections now open) 2015-10-05T09:32:41.691+0100 [conn1433167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:44.197+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235ab5703b51053ef2a24 2015-10-05T09:32:44.199+0100 [conn1432764] end connection 172.28.0.164:63688 (399 connections now open) 2015-10-05T09:32:44.200+0100 [mongosMain] connection accepted from 172.28.0.164:64938 #1433168 (400 connections now open) 2015-10-05T09:32:44.202+0100 [conn1433168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:44.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:32:44.745+0100 [conn1432849] end connection 172.28.0.164:63945 (399 connections now open) 2015-10-05T09:32:44.746+0100 [mongosMain] connection accepted from 172.28.0.164:64940 #1433169 (400 connections now open) 2015-10-05T09:32:44.747+0100 [conn1433169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:49.334+0100 [conn1432837] end connection 172.28.0.163:54716 (399 connections now open) 2015-10-05T09:32:49.335+0100 [mongosMain] connection accepted from 172.28.0.163:55739 #1433170 (400 connections now open) 2015-10-05T09:32:49.336+0100 [conn1433170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:49.364+0100 [conn1432834] end connection 172.28.0.164:63909 (399 connections now open) 2015-10-05T09:32:49.366+0100 [mongosMain] connection accepted from 172.28.0.164:64947 #1433171 (400 connections now open) 2015-10-05T09:32:49.368+0100 [conn1433171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:51.704+0100 [conn1432853] end connection 172.28.0.163:54744 (399 connections now open) 2015-10-05T09:32:51.705+0100 [mongosMain] connection accepted from 172.28.0.163:55744 #1433172 (400 connections now open) 2015-10-05T09:32:51.706+0100 [conn1433172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:32:54.217+0100 [conn1432759] end connection 172.28.0.164:63672 (399 connections now open) 2015-10-05T09:32:54.219+0100 [mongosMain] connection accepted from 172.28.0.164:64952 #1433173 (400 connections now open) 2015-10-05T09:32:54.220+0100 [conn1433173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:00.157+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:32:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:33:00.751+0100 [conn1432799] end connection 172.28.0.164:63813 (399 connections now open) 2015-10-05T09:33:00.758+0100 [mongosMain] connection accepted from 172.28.0.164:64956 #1433174 (400 connections now open) 2015-10-05T09:33:00.760+0100 [conn1433174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:00.876+0100 [conn1432828] end connection 172.28.0.163:54660 (399 connections now open) 2015-10-05T09:33:00.998+0100 [mongosMain] connection accepted from 172.28.0.163:55756 #1433175 (400 connections now open) 2015-10-05T09:33:01.023+0100 [conn1433175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:01.115+0100 [conn1432824] end connection 172.28.0.163:54654 (399 connections now open) 2015-10-05T09:33:01.123+0100 [mongosMain] connection accepted from 172.28.0.163:55757 #1433176 (400 connections now open) 2015-10-05T09:33:01.125+0100 [conn1433176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:01.727+0100 [conn1432858] end connection 172.28.0.163:54760 (399 connections now open) 2015-10-05T09:33:01.728+0100 [mongosMain] connection accepted from 172.28.0.163:55765 #1433177 (400 connections now open) 2015-10-05T09:33:01.729+0100 [conn1433177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:04.230+0100 [conn1432776] end connection 172.28.0.164:63737 (399 connections now open) 2015-10-05T09:33:04.231+0100 [mongosMain] connection accepted from 172.28.0.164:64974 #1433178 (400 connections now open) 2015-10-05T09:33:04.232+0100 [conn1433178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:08.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235c45703b51053ef2c2a 2015-10-05T09:33:08.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:33:10.753+0100 [conn1432823] end connection 172.28.0.164:63873 (399 connections now open) 2015-10-05T09:33:10.754+0100 [mongosMain] connection accepted from 172.28.0.164:64978 #1433179 (400 connections now open) 2015-10-05T09:33:10.755+0100 [conn1433179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:10.835+0100 [conn1432815] end connection 172.28.0.163:54633 (399 connections now open) 2015-10-05T09:33:10.836+0100 [mongosMain] connection accepted from 172.28.0.163:55783 #1433180 (400 connections now open) 2015-10-05T09:33:10.837+0100 [conn1433180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:11.114+0100 [conn1432818] end connection 172.28.0.163:54637 (399 connections now open) 2015-10-05T09:33:11.115+0100 [mongosMain] connection accepted from 172.28.0.163:55785 #1433181 (400 connections now open) 2015-10-05T09:33:11.116+0100 [conn1433181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:14.247+0100 [conn1432753] end connection 172.28.0.164:63645 (399 connections now open) 2015-10-05T09:33:14.248+0100 [mongosMain] connection accepted from 172.28.0.164:64981 #1433182 (400 connections now open) 2015-10-05T09:33:14.250+0100 [conn1433182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:14.778+0100 [conn1432855] end connection 172.28.0.164:63964 (399 connections now open) 2015-10-05T09:33:14.780+0100 [mongosMain] connection accepted from 172.28.0.164:64982 #1433183 (400 connections now open) 2015-10-05T09:33:14.782+0100 [conn1433183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:20.769+0100 [conn1432829] end connection 172.28.0.164:63889 (399 connections now open) 2015-10-05T09:33:20.770+0100 [mongosMain] connection accepted from 172.28.0.164:64988 #1433184 (400 connections now open) 2015-10-05T09:33:20.772+0100 [conn1433184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:20.848+0100 [conn1432822] end connection 172.28.0.163:54645 (399 connections now open) 2015-10-05T09:33:20.848+0100 [mongosMain] connection accepted from 172.28.0.163:55795 #1433185 (400 connections now open) 2015-10-05T09:33:20.849+0100 [conn1433185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:21.127+0100 [conn1432716] end connection 172.28.0.163:54278 (399 connections now open) 2015-10-05T09:33:21.128+0100 [mongosMain] connection accepted from 172.28.0.163:55796 #1433186 (400 connections now open) 2015-10-05T09:33:21.129+0100 [conn1433186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:21.721+0100 [conn1432863] end connection 172.28.0.163:54777 (399 connections now open) 2015-10-05T09:33:21.722+0100 [mongosMain] connection accepted from 172.28.0.163:55799 #1433187 (400 connections now open) 2015-10-05T09:33:21.723+0100 [conn1433187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:24.263+0100 [conn1432820] end connection 172.28.0.164:63869 (399 connections now open) 2015-10-05T09:33:24.264+0100 [mongosMain] connection accepted from 172.28.0.164:64995 #1433188 (400 connections now open) 2015-10-05T09:33:24.266+0100 [conn1433188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:24.793+0100 [conn1432860] end connection 172.28.0.164:63978 (399 connections now open) 2015-10-05T09:33:24.793+0100 [mongosMain] connection accepted from 172.28.0.164:64998 #1433189 (400 connections now open) 2015-10-05T09:33:24.795+0100 [conn1433189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:27.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235d65703b51053ef2dd5 2015-10-05T09:33:27.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:33:28.944+0100 [mongosMain] connection accepted from 127.0.0.1:55802 #1433190 (401 connections now open) 2015-10-05T09:33:28.947+0100 [conn1433190] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:28.952+0100 [conn1433190] end connection 127.0.0.1:55802 (400 connections now open) 2015-10-05T09:33:30.433+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:33:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:33:30.769+0100 [conn1432810] end connection 172.28.0.164:63842 (399 connections now open) 2015-10-05T09:33:30.771+0100 [mongosMain] connection accepted from 172.28.0.164:65004 #1433191 (400 connections now open) 2015-10-05T09:33:30.773+0100 [conn1433191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:30.877+0100 [conn1432850] end connection 172.28.0.163:54740 (399 connections now open) 2015-10-05T09:33:30.878+0100 [mongosMain] connection accepted from 172.28.0.163:55806 #1433192 (400 connections now open) 2015-10-05T09:33:30.879+0100 [conn1433192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:31.144+0100 [conn1432830] end connection 172.28.0.163:54678 (399 connections now open) 2015-10-05T09:33:31.145+0100 [mongosMain] connection accepted from 172.28.0.163:55807 #1433193 (400 connections now open) 2015-10-05T09:33:31.146+0100 [conn1433193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:31.737+0100 [conn1432870] end connection 172.28.0.163:54832 (399 connections now open) 2015-10-05T09:33:31.739+0100 [mongosMain] connection accepted from 172.28.0.163:55809 #1433194 (400 connections now open) 2015-10-05T09:33:31.740+0100 [conn1433194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:34.263+0100 [conn1432743] end connection 172.28.0.164:63594 (399 connections now open) 2015-10-05T09:33:34.264+0100 [mongosMain] connection accepted from 172.28.0.164:65009 #1433195 (400 connections now open) 2015-10-05T09:33:34.266+0100 [conn1433195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:34.809+0100 [conn1432873] end connection 172.28.0.164:64025 (399 connections now open) 2015-10-05T09:33:34.810+0100 [mongosMain] connection accepted from 172.28.0.164:65012 #1433196 (400 connections now open) 2015-10-05T09:33:34.812+0100 [conn1433196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:39.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235e35703b51053ef2eef 2015-10-05T09:33:39.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:33:40.000+0100 [mongosMain] connection accepted from 127.0.0.1:55813 #1433197 (401 connections now open) 2015-10-05T09:33:40.003+0100 [conn1433197] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:40.008+0100 [conn1433197] end connection 127.0.0.1:55813 (400 connections now open) 2015-10-05T09:33:40.787+0100 [conn1432851] end connection 172.28.0.164:63947 (399 connections now open) 2015-10-05T09:33:40.788+0100 [mongosMain] connection accepted from 172.28.0.164:65023 #1433198 (400 connections now open) 2015-10-05T09:33:40.789+0100 [conn1433198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:40.864+0100 [conn1432809] end connection 172.28.0.163:54627 (399 connections now open) 2015-10-05T09:33:40.866+0100 [mongosMain] connection accepted from 172.28.0.163:55814 #1433199 (400 connections now open) 2015-10-05T09:33:40.867+0100 [conn1433199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:41.008+0100 [conn1432629] end connection 172.28.0.164:63321 (399 connections now open) 2015-10-05T09:33:41.017+0100 [mongosMain] connection accepted from 172.28.0.164:65025 #1433200 (400 connections now open) 2015-10-05T09:33:41.019+0100 [conn1433200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:41.145+0100 [conn1432846] end connection 172.28.0.163:54733 (399 connections now open) 2015-10-05T09:33:41.146+0100 [mongosMain] connection accepted from 172.28.0.163:55818 #1433201 (400 connections now open) 2015-10-05T09:33:41.147+0100 [conn1433201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:41.738+0100 [conn1432880] end connection 172.28.0.163:54843 (399 connections now open) 2015-10-05T09:33:41.739+0100 [mongosMain] connection accepted from 172.28.0.163:55821 #1433202 (400 connections now open) 2015-10-05T09:33:41.740+0100 [conn1433202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:42.107+0100 [conn1432228] end connection 172.28.0.163:52849 (399 connections now open) 2015-10-05T09:33:42.123+0100 [mongosMain] connection accepted from 172.28.0.163:55822 #1433203 (400 connections now open) 2015-10-05T09:33:42.124+0100 [conn1433203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:44.279+0100 [conn1432807] end connection 172.28.0.164:63836 (399 connections now open) 2015-10-05T09:33:44.280+0100 [mongosMain] connection accepted from 172.28.0.164:65030 #1433204 (400 connections now open) 2015-10-05T09:33:44.282+0100 [conn1433204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:44.824+0100 [conn1432881] end connection 172.28.0.164:64039 (399 connections now open) 2015-10-05T09:33:44.825+0100 [mongosMain] connection accepted from 172.28.0.164:65033 #1433205 (400 connections now open) 2015-10-05T09:33:44.836+0100 [conn1433205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:50.800+0100 [conn1432787] end connection 172.28.0.164:63773 (399 connections now open) 2015-10-05T09:33:50.802+0100 [mongosMain] connection accepted from 172.28.0.164:65039 #1433206 (400 connections now open) 2015-10-05T09:33:50.802+0100 [conn1432284] end connection 172.28.0.164:62248 (399 connections now open) 2015-10-05T09:33:50.803+0100 [mongosMain] connection accepted from 172.28.0.164:65040 #1433207 (400 connections now open) 2015-10-05T09:33:50.804+0100 [conn1433206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:50.807+0100 [conn1433207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:50.868+0100 [conn1432220] end connection 172.28.0.163:52836 (399 connections now open) 2015-10-05T09:33:50.869+0100 [mongosMain] connection accepted from 172.28.0.163:55836 #1433208 (400 connections now open) 2015-10-05T09:33:50.870+0100 [conn1433208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:51.159+0100 [conn1432835] end connection 172.28.0.163:54706 (399 connections now open) 2015-10-05T09:33:51.160+0100 [mongosMain] connection accepted from 172.28.0.163:55840 #1433209 (400 connections now open) 2015-10-05T09:33:51.161+0100 [conn1433209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:51.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235ef5703b51053ef2f95 2015-10-05T09:33:51.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:33:51.752+0100 [conn1432886] end connection 172.28.0.163:54854 (399 connections now open) 2015-10-05T09:33:51.753+0100 [mongosMain] connection accepted from 172.28.0.163:55843 #1433210 (400 connections now open) 2015-10-05T09:33:51.754+0100 [conn1433210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:54.295+0100 [conn1432832] end connection 172.28.0.164:63905 (399 connections now open) 2015-10-05T09:33:54.296+0100 [mongosMain] connection accepted from 172.28.0.164:65046 #1433211 (400 connections now open) 2015-10-05T09:33:54.297+0100 [conn1433211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:33:54.825+0100 [conn1432887] end connection 172.28.0.164:64058 (399 connections now open) 2015-10-05T09:33:54.827+0100 [mongosMain] connection accepted from 172.28.0.164:65049 #1433212 (400 connections now open) 2015-10-05T09:33:54.829+0100 [conn1433212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:00.639+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:34:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:34:00.825+0100 [conn1432875] end connection 172.28.0.164:64026 (399 connections now open) 2015-10-05T09:34:00.826+0100 [conn1432684] end connection 172.28.0.164:63407 (398 connections now open) 2015-10-05T09:34:00.827+0100 [mongosMain] connection accepted from 172.28.0.164:65053 #1433213 (399 connections now open) 2015-10-05T09:34:00.828+0100 [mongosMain] connection accepted from 172.28.0.164:65054 #1433214 (400 connections now open) 2015-10-05T09:34:00.831+0100 [conn1433213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:00.831+0100 [conn1433214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:01.171+0100 [conn1432839] end connection 172.28.0.163:54721 (399 connections now open) 2015-10-05T09:34:01.172+0100 [mongosMain] connection accepted from 172.28.0.163:55859 #1433215 (400 connections now open) 2015-10-05T09:34:01.173+0100 [conn1433215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:01.767+0100 [conn1432891] end connection 172.28.0.163:54871 (399 connections now open) 2015-10-05T09:34:01.768+0100 [mongosMain] connection accepted from 172.28.0.163:55862 #1433216 (400 connections now open) 2015-10-05T09:34:01.769+0100 [conn1433216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:04.310+0100 [conn1432801] end connection 172.28.0.164:63817 (399 connections now open) 2015-10-05T09:34:04.311+0100 [mongosMain] connection accepted from 172.28.0.164:65068 #1433217 (400 connections now open) 2015-10-05T09:34:04.312+0100 [conn1433217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:04.839+0100 [conn1432892] end connection 172.28.0.164:64071 (399 connections now open) 2015-10-05T09:34:04.840+0100 [mongosMain] connection accepted from 172.28.0.164:65073 #1433218 (400 connections now open) 2015-10-05T09:34:04.842+0100 [conn1433218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:05.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561235fd5703b51053ef302c 2015-10-05T09:34:05.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:10.831+0100 [conn1432562] end connection 172.28.0.164:63126 (399 connections now open) 2015-10-05T09:34:10.840+0100 [mongosMain] connection accepted from 172.28.0.164:65078 #1433219 (400 connections now open) 2015-10-05T09:34:10.841+0100 [conn1433219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:11.175+0100 [conn1432805] end connection 172.28.0.163:54625 (399 connections now open) 2015-10-05T09:34:11.176+0100 [mongosMain] connection accepted from 172.28.0.163:55886 #1433220 (400 connections now open) 2015-10-05T09:34:11.177+0100 [conn1433220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:11.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236035703b51053ef306a 2015-10-05T09:34:12.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:14.326+0100 [conn1432841] end connection 172.28.0.164:63922 (399 connections now open) 2015-10-05T09:34:14.327+0100 [mongosMain] connection accepted from 172.28.0.164:65080 #1433221 (400 connections now open) 2015-10-05T09:34:14.328+0100 [conn1433221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:14.856+0100 [conn1432897] end connection 172.28.0.164:64086 (399 connections now open) 2015-10-05T09:34:14.857+0100 [mongosMain] connection accepted from 172.28.0.164:65082 #1433222 (400 connections now open) 2015-10-05T09:34:14.859+0100 [conn1433222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:18.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612360a5703b51053ef30c1 2015-10-05T09:34:18.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:20.847+0100 [conn1432862] end connection 172.28.0.164:63979 (399 connections now open) 2015-10-05T09:34:20.847+0100 [conn1432683] end connection 172.28.0.164:63406 (398 connections now open) 2015-10-05T09:34:20.848+0100 [mongosMain] connection accepted from 172.28.0.164:65091 #1433223 (399 connections now open) 2015-10-05T09:34:20.848+0100 [mongosMain] connection accepted from 172.28.0.164:65092 #1433224 (400 connections now open) 2015-10-05T09:34:20.850+0100 [conn1433224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:20.850+0100 [conn1433223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:21.176+0100 [conn1432871] end connection 172.28.0.163:54834 (399 connections now open) 2015-10-05T09:34:21.177+0100 [mongosMain] connection accepted from 172.28.0.163:55898 #1433225 (400 connections now open) 2015-10-05T09:34:21.178+0100 [conn1433225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:24.357+0100 [conn1432854] end connection 172.28.0.164:63961 (399 connections now open) 2015-10-05T09:34:24.358+0100 [mongosMain] connection accepted from 172.28.0.164:65102 #1433226 (400 connections now open) 2015-10-05T09:34:24.359+0100 [conn1433226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:24.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236105703b51053ef30eb 2015-10-05T09:34:24.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:24.887+0100 [conn1432901] end connection 172.28.0.164:64092 (399 connections now open) 2015-10-05T09:34:24.888+0100 [mongosMain] connection accepted from 172.28.0.164:65103 #1433227 (400 connections now open) 2015-10-05T09:34:24.890+0100 [conn1433227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:28.926+0100 [mongosMain] connection accepted from 127.0.0.1:55904 #1433228 (401 connections now open) 2015-10-05T09:34:28.926+0100 [conn1433228] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:28.926+0100 [conn1433228] end connection 127.0.0.1:55904 (400 connections now open) 2015-10-05T09:34:30.908+0100 [conn1432883] end connection 172.28.0.164:64040 (399 connections now open) 2015-10-05T09:34:30.908+0100 [mongosMain] connection accepted from 172.28.0.164:65110 #1433229 (400 connections now open) 2015-10-05T09:34:30.908+0100 [conn1433229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:31.220+0100 [conn1432879] end connection 172.28.0.163:54841 (399 connections now open) 2015-10-05T09:34:31.220+0100 [mongosMain] connection accepted from 172.28.0.163:55908 #1433230 (400 connections now open) 2015-10-05T09:34:31.220+0100 [conn1433230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:31.703+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:34:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:34:31.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236175703b51053ef3135 2015-10-05T09:34:31.766+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:31.828+0100 [conn1432903] end connection 172.28.0.163:54931 (399 connections now open) 2015-10-05T09:34:31.828+0100 [mongosMain] connection accepted from 172.28.0.163:55910 #1433231 (400 connections now open) 2015-10-05T09:34:31.828+0100 [conn1433231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:34.373+0100 [conn1432859] end connection 172.28.0.164:63975 (399 connections now open) 2015-10-05T09:34:34.374+0100 [mongosMain] connection accepted from 172.28.0.164:65118 #1433232 (400 connections now open) 2015-10-05T09:34:34.375+0100 [conn1433232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:34.903+0100 [conn1432905] end connection 172.28.0.164:64105 (399 connections now open) 2015-10-05T09:34:34.904+0100 [mongosMain] connection accepted from 172.28.0.164:65121 #1433233 (400 connections now open) 2015-10-05T09:34:34.905+0100 [conn1433233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:37.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612361d5703b51053ef319a 2015-10-05T09:34:37.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:39.822+0100 [mongosMain] connection accepted from 127.0.0.1:55912 #1433234 (401 connections now open) 2015-10-05T09:34:39.825+0100 [conn1433234] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:39.830+0100 [conn1433234] end connection 127.0.0.1:55912 (400 connections now open) 2015-10-05T09:34:40.894+0100 [conn1432889] end connection 172.28.0.164:64060 (399 connections now open) 2015-10-05T09:34:40.895+0100 [mongosMain] connection accepted from 172.28.0.164:65131 #1433235 (400 connections now open) 2015-10-05T09:34:40.897+0100 [conn1433235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:41.192+0100 [conn1432885] end connection 172.28.0.163:54852 (399 connections now open) 2015-10-05T09:34:41.194+0100 [mongosMain] connection accepted from 172.28.0.163:55917 #1433236 (400 connections now open) 2015-10-05T09:34:41.195+0100 [conn1433236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:41.800+0100 [conn1432895] end connection 172.28.0.163:54898 (399 connections now open) 2015-10-05T09:34:41.801+0100 [mongosMain] connection accepted from 172.28.0.163:55920 #1433237 (400 connections now open) 2015-10-05T09:34:41.802+0100 [conn1433237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:44.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236235703b51053ef3228 2015-10-05T09:34:44.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:34:44.389+0100 [conn1432867] end connection 172.28.0.164:64007 (399 connections now open) 2015-10-05T09:34:44.393+0100 [mongosMain] connection accepted from 172.28.0.164:65138 #1433238 (400 connections now open) 2015-10-05T09:34:44.397+0100 [conn1433238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:44.919+0100 [conn1432912] end connection 172.28.0.164:64122 (399 connections now open) 2015-10-05T09:34:44.920+0100 [mongosMain] connection accepted from 172.28.0.164:65141 #1433239 (400 connections now open) 2015-10-05T09:34:44.922+0100 [conn1433239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:50.926+0100 [conn1432264] end connection 172.28.0.163:52967 (399 connections now open) 2015-10-05T09:34:50.928+0100 [mongosMain] connection accepted from 172.28.0.163:55931 #1433240 (400 connections now open) 2015-10-05T09:34:50.929+0100 [conn1433240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:51.207+0100 [conn1432902] end connection 172.28.0.163:54928 (399 connections now open) 2015-10-05T09:34:51.208+0100 [mongosMain] connection accepted from 172.28.0.163:55934 #1433241 (400 connections now open) 2015-10-05T09:34:51.209+0100 [conn1433241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:51.376+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:34:51.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:34:51.799+0100 [conn1432910] end connection 172.28.0.163:54940 (399 connections now open) 2015-10-05T09:34:51.800+0100 [mongosMain] connection accepted from 172.28.0.163:55937 #1433242 (400 connections now open) 2015-10-05T09:34:51.801+0100 [conn1433242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:54.405+0100 [conn1432848] end connection 172.28.0.164:63943 (399 connections now open) 2015-10-05T09:34:54.406+0100 [mongosMain] connection accepted from 172.28.0.164:65157 #1433243 (400 connections now open) 2015-10-05T09:34:54.407+0100 [conn1433243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:54.935+0100 [conn1432919] end connection 172.28.0.164:64144 (399 connections now open) 2015-10-05T09:34:54.937+0100 [mongosMain] connection accepted from 172.28.0.164:65160 #1433244 (400 connections now open) 2015-10-05T09:34:54.938+0100 [conn1433244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:34:58.133+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236315703b51053ef32e2 2015-10-05T09:34:58.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:35:00.927+0100 [conn1432652] end connection 172.28.0.163:54134 (399 connections now open) 2015-10-05T09:35:00.928+0100 [mongosMain] connection accepted from 172.28.0.163:55960 #1433245 (400 connections now open) 2015-10-05T09:35:00.929+0100 [conn1433245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:01.222+0100 [conn1432909] end connection 172.28.0.163:54938 (399 connections now open) 2015-10-05T09:35:01.223+0100 [mongosMain] connection accepted from 172.28.0.163:55965 #1433246 (400 connections now open) 2015-10-05T09:35:01.224+0100 [conn1433246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:01.814+0100 [conn1432917] end connection 172.28.0.163:54957 (399 connections now open) 2015-10-05T09:35:01.815+0100 [mongosMain] connection accepted from 172.28.0.163:55971 #1433247 (400 connections now open) 2015-10-05T09:35:01.816+0100 [conn1433247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:03.788+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:35:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:35:04.420+0100 [conn1432826] end connection 172.28.0.164:63886 (399 connections now open) 2015-10-05T09:35:04.421+0100 [mongosMain] connection accepted from 172.28.0.164:65177 #1433248 (400 connections now open) 2015-10-05T09:35:04.422+0100 [conn1433248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:04.956+0100 [conn1432923] end connection 172.28.0.164:64162 (399 connections now open) 2015-10-05T09:35:04.957+0100 [mongosMain] connection accepted from 172.28.0.164:65179 #1433249 (400 connections now open) 2015-10-05T09:35:04.958+0100 [conn1433249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:10.714+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612363b3b0f755fc33549f6') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444034110572), why: "doing balance round", ts: ObjectId('5612363e5703b51053ef33f0') } } gle1: { lastOp: Timestamp 1444034110000|5, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } gle2: { lastOp: Timestamp 1444034098000|3, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T09:35:10.718+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:35:10.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612363e5703b51053ef33f0 2015-10-05T09:35:10.941+0100 [conn1432271] end connection 172.28.0.163:52984 (399 connections now open) 2015-10-05T09:35:10.942+0100 [mongosMain] connection accepted from 172.28.0.163:55985 #1433250 (400 connections now open) 2015-10-05T09:35:10.943+0100 [conn1433250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:10.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:35:11.223+0100 [conn1432894] end connection 172.28.0.163:54891 (399 connections now open) 2015-10-05T09:35:11.224+0100 [mongosMain] connection accepted from 172.28.0.163:55986 #1433251 (400 connections now open) 2015-10-05T09:35:11.225+0100 [conn1433251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:11.816+0100 [conn1432926] end connection 172.28.0.163:54995 (399 connections now open) 2015-10-05T09:35:11.817+0100 [mongosMain] connection accepted from 172.28.0.163:55988 #1433252 (400 connections now open) 2015-10-05T09:35:11.818+0100 [conn1433252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:14.420+0100 [conn1432900] end connection 172.28.0.164:64090 (399 connections now open) 2015-10-05T09:35:14.422+0100 [mongosMain] connection accepted from 172.28.0.164:65185 #1433253 (400 connections now open) 2015-10-05T09:35:14.423+0100 [conn1433253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:14.967+0100 [conn1432928] end connection 172.28.0.164:64181 (399 connections now open) 2015-10-05T09:35:14.968+0100 [mongosMain] connection accepted from 172.28.0.164:65187 #1433254 (400 connections now open) 2015-10-05T09:35:14.970+0100 [conn1433254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:20.944+0100 [conn1432286] end connection 172.28.0.163:53031 (399 connections now open) 2015-10-05T09:35:20.945+0100 [mongosMain] connection accepted from 172.28.0.163:55997 #1433255 (400 connections now open) 2015-10-05T09:35:20.946+0100 [conn1433255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:21.238+0100 [conn1432899] end connection 172.28.0.163:54913 (399 connections now open) 2015-10-05T09:35:21.239+0100 [mongosMain] connection accepted from 172.28.0.163:55999 #1433256 (400 connections now open) 2015-10-05T09:35:21.241+0100 [conn1433256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:21.831+0100 [conn1432930] end connection 172.28.0.163:55021 (399 connections now open) 2015-10-05T09:35:21.832+0100 [mongosMain] connection accepted from 172.28.0.163:56001 #1433257 (400 connections now open) 2015-10-05T09:35:21.833+0100 [conn1433257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:24.129+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:35:24.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:35:24.423+0100 [conn1432896] end connection 172.28.0.164:64084 (399 connections now open) 2015-10-05T09:35:24.424+0100 [mongosMain] connection accepted from 172.28.0.164:65202 #1433258 (400 connections now open) 2015-10-05T09:35:24.425+0100 [conn1433258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:24.967+0100 [conn1432932] end connection 172.28.0.164:64189 (399 connections now open) 2015-10-05T09:35:24.968+0100 [mongosMain] connection accepted from 172.28.0.164:65205 #1433259 (400 connections now open) 2015-10-05T09:35:24.970+0100 [conn1433259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:28.855+0100 [mongosMain] connection accepted from 127.0.0.1:56004 #1433260 (401 connections now open) 2015-10-05T09:35:28.857+0100 [conn1433260] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:28.862+0100 [conn1433260] end connection 127.0.0.1:56004 (400 connections now open) 2015-10-05T09:35:30.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236525703b51053ef352b 2015-10-05T09:35:30.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:35:31.240+0100 [conn1432921] end connection 172.28.0.163:54977 (399 connections now open) 2015-10-05T09:35:31.241+0100 [mongosMain] connection accepted from 172.28.0.163:56012 #1433261 (400 connections now open) 2015-10-05T09:35:31.242+0100 [conn1433261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:31.847+0100 [conn1432934] end connection 172.28.0.163:55035 (399 connections now open) 2015-10-05T09:35:31.848+0100 [mongosMain] connection accepted from 172.28.0.163:56014 #1433262 (400 connections now open) 2015-10-05T09:35:31.849+0100 [conn1433262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:32.161+0100 [conn1432890] end connection 172.28.0.163:54869 (399 connections now open) 2015-10-05T09:35:32.161+0100 [conn1433119] end connection 172.28.0.163:55588 (399 connections now open) 2015-10-05T09:35:32.161+0100 [conn1433140] end connection 172.28.0.163:55647 (399 connections now open) 2015-10-05T09:35:32.161+0100 [conn1432984] end connection 172.28.0.163:55158 (398 connections now open) 2015-10-05T09:35:32.161+0100 [conn1433004] end connection 172.28.0.163:55220 (397 connections now open) 2015-10-05T09:35:32.161+0100 [conn1432929] end connection 172.28.0.163:55019 (397 connections now open) 2015-10-05T09:35:32.161+0100 [conn1433177] end connection 172.28.0.163:55765 (393 connections now open) 2015-10-05T09:35:32.161+0100 [conn1433059] end connection 172.28.0.163:55351 (393 connections now open) 2015-10-05T09:35:32.161+0100 [conn1432925] end connection 172.28.0.163:54992 (393 connections now open) 2015-10-05T09:35:32.162+0100 [conn1432916] end connection 172.28.0.163:54953 (392 connections now open) 2015-10-05T09:35:32.162+0100 [conn1432946] end connection 172.28.0.163:55056 (391 connections now open) 2015-10-05T09:35:32.162+0100 [conn1432941] end connection 172.28.0.163:55046 (389 connections now open) 2015-10-05T09:35:32.162+0100 [conn1433099] end connection 172.28.0.163:55523 (388 connections now open) 2015-10-05T09:35:33.663+0100 [conn1432968] end connection 172.28.0.163:55130 (386 connections now open) 2015-10-05T09:35:33.666+0100 [conn1433236] end connection 172.28.0.163:55917 (386 connections now open) 2015-10-05T09:35:33.666+0100 [conn1433186] end connection 172.28.0.163:55796 (386 connections now open) 2015-10-05T09:35:33.666+0100 [conn1433050] end connection 172.28.0.163:55341 (385 connections now open) 2015-10-05T09:35:33.666+0100 [conn1432983] end connection 172.28.0.163:55156 (383 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433043] end connection 172.28.0.163:55324 (382 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433155] end connection 172.28.0.163:55704 (382 connections now open) 2015-10-05T09:35:33.667+0100 [conn1432947] end connection 172.28.0.163:55059 (380 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433230] end connection 172.28.0.163:55908 (379 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433216] end connection 172.28.0.163:55862 (379 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433020] end connection 172.28.0.163:55245 (382 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433246] end connection 172.28.0.163:55965 (375 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433067] end connection 172.28.0.163:55364 (375 connections now open) 2015-10-05T09:35:33.668+0100 [conn1432958] end connection 172.28.0.163:55092 (373 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433130] end connection 172.28.0.163:55621 (373 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433167] end connection 172.28.0.163:55728 (379 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433242] end connection 172.28.0.163:55937 (371 connections now open) 2015-10-05T09:35:33.667+0100 [conn1433257] end connection 172.28.0.163:56001 (380 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433262] end connection 172.28.0.163:56014 (369 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433012] end connection 172.28.0.163:55232 (373 connections now open) 2015-10-05T09:35:33.667+0100 [conn1432990] end connection 172.28.0.163:55174 (377 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433051] end connection 172.28.0.163:55343 (373 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433176] end connection 172.28.0.163:55757 (373 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433210] end connection 172.28.0.163:55843 (373 connections now open) 2015-10-05T09:35:33.668+0100 [conn1433058] end connection 172.28.0.163:55350 (367 connections now open) 2015-10-05T09:35:33.669+0100 [conn1432953] end connection 172.28.0.163:55075 (363 connections now open) 2015-10-05T09:35:33.669+0100 [conn1432991] end connection 172.28.0.163:55175 (360 connections now open) 2015-10-05T09:35:33.669+0100 [conn1433161] end connection 172.28.0.163:55716 (362 connections now open) 2015-10-05T09:35:33.669+0100 [conn1432964] end connection 172.28.0.163:55119 (360 connections now open) 2015-10-05T09:35:33.669+0100 [conn1433144] end connection 172.28.0.163:55668 (358 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433136] end connection 172.28.0.163:55630 (356 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433261] end connection 172.28.0.163:56012 (356 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433225] end connection 172.28.0.163:55898 (356 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433114] end connection 172.28.0.163:55557 (356 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433073] end connection 172.28.0.163:55400 (353 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433135] end connection 172.28.0.163:55628 (354 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433033] end connection 172.28.0.163:55283 (354 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433251] end connection 172.28.0.163:55986 (350 connections now open) 2015-10-05T09:35:33.670+0100 [conn1433044] end connection 172.28.0.163:55326 (352 connections now open) 2015-10-05T09:35:33.670+0100 [conn1432940] end connection 172.28.0.163:55043 (355 connections now open) 2015-10-05T09:35:33.671+0100 [conn1432959] end connection 172.28.0.163:55096 (348 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433241] end connection 172.28.0.163:55934 (348 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433231] end connection 172.28.0.163:55910 (347 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433104] end connection 172.28.0.163:55531 (344 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433215] end connection 172.28.0.163:55859 (346 connections now open) 2015-10-05T09:35:33.671+0100 [conn1432999] end connection 172.28.0.163:55194 (343 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433202] end connection 172.28.0.163:55821 (342 connections now open) 2015-10-05T09:35:33.671+0100 [conn1433070] end connection 172.28.0.163:55381 (340 connections now open) 2015-10-05T09:35:33.672+0100 [conn1433039] end connection 172.28.0.163:55309 (338 connections now open) 2015-10-05T09:35:33.672+0100 [conn1433021] end connection 172.28.0.163:55247 (337 connections now open) 2015-10-05T09:35:33.672+0100 [conn1433252] end connection 172.28.0.163:55988 (337 connections now open) 2015-10-05T09:35:33.672+0100 [conn1433220] end connection 172.28.0.163:55886 (335 connections now open) 2015-10-05T09:35:33.672+0100 [conn1432997] end connection 172.28.0.163:55193 (335 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433089] end connection 172.28.0.163:55454 (333 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433034] end connection 172.28.0.163:55284 (333 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433038] end connection 172.28.0.163:55303 (331 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433085] end connection 172.28.0.163:55439 (331 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433151] end connection 172.28.0.163:55690 (330 connections now open) 2015-10-05T09:35:33.673+0100 [conn1432976] end connection 172.28.0.163:55145 (329 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433066] end connection 172.28.0.163:55360 (327 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433194] end connection 172.28.0.163:55809 (327 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433247] end connection 172.28.0.163:55971 (327 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433013] end connection 172.28.0.163:55237 (325 connections now open) 2015-10-05T09:35:33.673+0100 [conn1433237] end connection 172.28.0.163:55920 (326 connections now open) 2015-10-05T09:35:33.674+0100 [conn1433005] end connection 172.28.0.163:55221 (324 connections now open) 2015-10-05T09:35:33.674+0100 [conn1433110] end connection 172.28.0.163:55543 (322 connections now open) 2015-10-05T09:35:33.674+0100 [conn1433118] end connection 172.28.0.163:55579 (323 connections now open) 2015-10-05T09:35:33.674+0100 [conn1433029] end connection 172.28.0.163:55268 (319 connections now open) 2015-10-05T09:35:33.674+0100 [conn1432975] end connection 172.28.0.163:55143 (318 connections now open) 2015-10-05T09:35:33.674+0100 [conn1433076] end connection 172.28.0.163:55414 (318 connections now open) 2015-10-05T09:35:33.675+0100 [conn1432963] end connection 172.28.0.163:55117 (316 connections now open) 2015-10-05T09:35:33.675+0100 [conn1433172] end connection 172.28.0.163:55744 (316 connections now open) 2015-10-05T09:35:33.675+0100 [conn1433124] end connection 172.28.0.163:55611 (314 connections now open) 2015-10-05T09:35:33.675+0100 [conn1433193] end connection 172.28.0.163:55807 (314 connections now open) 2015-10-05T09:35:33.676+0100 [conn1432952] end connection 172.28.0.163:55073 (312 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433150] end connection 172.28.0.163:55688 (312 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433256] end connection 172.28.0.163:55999 (310 connections now open) 2015-10-05T09:35:33.676+0100 [conn1432933] end connection 172.28.0.163:55033 (310 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433201] end connection 172.28.0.163:55818 (308 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433081] end connection 172.28.0.163:55431 (308 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433028] end connection 172.28.0.163:55266 (307 connections now open) 2015-10-05T09:35:33.676+0100 [conn1433181] end connection 172.28.0.163:55785 (306 connections now open) 2015-10-05T09:35:33.677+0100 [conn1433125] end connection 172.28.0.163:55612 (304 connections now open) 2015-10-05T09:35:33.677+0100 [conn1433209] end connection 172.28.0.163:55840 (303 connections now open) 2015-10-05T09:35:33.677+0100 [conn1433109] end connection 172.28.0.163:55540 (302 connections now open) 2015-10-05T09:35:33.677+0100 [conn1433187] end connection 172.28.0.163:55799 (302 connections now open) 2015-10-05T09:35:33.678+0100 [conn1433145] end connection 172.28.0.163:55672 (301 connections now open) 2015-10-05T09:35:34.045+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:35:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:35:34.436+0100 [conn1432911] end connection 172.28.0.164:64120 (299 connections now open) 2015-10-05T09:35:34.438+0100 [mongosMain] connection accepted from 172.28.0.164:65217 #1433263 (300 connections now open) 2015-10-05T09:35:34.439+0100 [conn1433263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:34.983+0100 [conn1432935] end connection 172.28.0.164:64204 (299 connections now open) 2015-10-05T09:35:34.984+0100 [mongosMain] connection accepted from 172.28.0.164:65219 #1433264 (300 connections now open) 2015-10-05T09:35:34.986+0100 [conn1433264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:39.988+0100 [mongosMain] connection accepted from 127.0.0.1:56020 #1433265 (301 connections now open) 2015-10-05T09:35:39.991+0100 [conn1433265] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:39.996+0100 [conn1433265] end connection 127.0.0.1:56020 (300 connections now open) 2015-10-05T09:35:40.959+0100 [conn1432300] end connection 172.28.0.163:53060 (299 connections now open) 2015-10-05T09:35:40.960+0100 [mongosMain] connection accepted from 172.28.0.163:56022 #1433266 (300 connections now open) 2015-10-05T09:35:40.962+0100 [conn1433266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:43.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612365e5703b51053ef3619 2015-10-05T09:35:43.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:35:44.437+0100 [conn1432872] end connection 172.28.0.164:64022 (299 connections now open) 2015-10-05T09:35:44.438+0100 [mongosMain] connection accepted from 172.28.0.164:65234 #1433267 (300 connections now open) 2015-10-05T09:35:44.441+0100 [conn1433267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:44.982+0100 [conn1432943] end connection 172.28.0.164:64222 (299 connections now open) 2015-10-05T09:35:44.983+0100 [mongosMain] connection accepted from 172.28.0.164:65237 #1433268 (300 connections now open) 2015-10-05T09:35:44.984+0100 [conn1433268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:50.974+0100 [conn1432307] end connection 172.28.0.163:53074 (299 connections now open) 2015-10-05T09:35:50.975+0100 [mongosMain] connection accepted from 172.28.0.163:56032 #1433269 (300 connections now open) 2015-10-05T09:35:50.976+0100 [conn1433269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:52.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236665703b51053ef366b 2015-10-05T09:35:54.452+0100 [conn1432904] end connection 172.28.0.164:64104 (299 connections now open) 2015-10-05T09:35:54.453+0100 [mongosMain] connection accepted from 172.28.0.164:65243 #1433270 (300 connections now open) 2015-10-05T09:35:54.455+0100 [conn1433270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:35:54.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:35:54.997+0100 [conn1432949] end connection 172.28.0.164:64241 (299 connections now open) 2015-10-05T09:35:54.998+0100 [mongosMain] connection accepted from 172.28.0.164:65246 #1433271 (300 connections now open) 2015-10-05T09:35:54.999+0100 [conn1433271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:00.807+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236705703b51053ef36d3 2015-10-05T09:36:00.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:01.076+0100 [conn1432312] end connection 172.28.0.163:53091 (299 connections now open) 2015-10-05T09:36:01.077+0100 [mongosMain] connection accepted from 172.28.0.163:56041 #1433272 (300 connections now open) 2015-10-05T09:36:01.077+0100 [conn1433272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:02.267+0100 [conn1432317] end connection 172.28.0.164:62349 (299 connections now open) 2015-10-05T09:36:02.268+0100 [mongosMain] connection accepted from 172.28.0.164:65267 #1433273 (300 connections now open) 2015-10-05T09:36:02.270+0100 [conn1433273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:04.309+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:36:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:36:04.452+0100 [conn1432927] end connection 172.28.0.164:64178 (299 connections now open) 2015-10-05T09:36:04.452+0100 [mongosMain] connection accepted from 172.28.0.164:65276 #1433274 (300 connections now open) 2015-10-05T09:36:04.454+0100 [conn1433274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:04.997+0100 [conn1432955] end connection 172.28.0.164:64257 (299 connections now open) 2015-10-05T09:36:04.998+0100 [mongosMain] connection accepted from 172.28.0.164:65279 #1433275 (300 connections now open) 2015-10-05T09:36:04.999+0100 [conn1433275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:07.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236765703b51053ef3763 2015-10-05T09:36:07.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:11.051+0100 [conn1432319] end connection 172.28.0.163:53125 (299 connections now open) 2015-10-05T09:36:11.052+0100 [mongosMain] connection accepted from 172.28.0.163:56068 #1433276 (300 connections now open) 2015-10-05T09:36:11.053+0100 [conn1433276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:14.468+0100 [conn1432864] end connection 172.28.0.164:63998 (299 connections now open) 2015-10-05T09:36:14.469+0100 [mongosMain] connection accepted from 172.28.0.164:65284 #1433277 (300 connections now open) 2015-10-05T09:36:14.470+0100 [conn1433277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:15.014+0100 [conn1432961] end connection 172.28.0.164:64286 (299 connections now open) 2015-10-05T09:36:15.015+0100 [mongosMain] connection accepted from 172.28.0.164:65287 #1433278 (300 connections now open) 2015-10-05T09:36:15.017+0100 [conn1433278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:19.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236835703b51053ef3836 2015-10-05T09:36:19.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:21.054+0100 [conn1432944] end connection 172.28.0.163:55048 (299 connections now open) 2015-10-05T09:36:21.054+0100 [conn1432327] end connection 172.28.0.163:53144 (299 connections now open) 2015-10-05T09:36:21.055+0100 [mongosMain] connection accepted from 172.28.0.163:56081 #1433279 (299 connections now open) 2015-10-05T09:36:21.055+0100 [mongosMain] connection accepted from 172.28.0.163:56082 #1433280 (300 connections now open) 2015-10-05T09:36:21.056+0100 [conn1433279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:21.056+0100 [conn1433280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:21.225+0100 [conn1432857] end connection 172.28.0.164:63965 (299 connections now open) 2015-10-05T09:36:21.226+0100 [conn1432325] end connection 172.28.0.164:62356 (298 connections now open) 2015-10-05T09:36:21.231+0100 [mongosMain] connection accepted from 172.28.0.164:65297 #1433281 (299 connections now open) 2015-10-05T09:36:21.231+0100 [mongosMain] connection accepted from 172.28.0.164:65298 #1433282 (300 connections now open) 2015-10-05T09:36:21.233+0100 [conn1433281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:21.233+0100 [conn1433282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:24.492+0100 [conn1432931] end connection 172.28.0.164:64185 (299 connections now open) 2015-10-05T09:36:24.493+0100 [mongosMain] connection accepted from 172.28.0.164:65305 #1433283 (300 connections now open) 2015-10-05T09:36:24.497+0100 [conn1433283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:25.657+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:36:25.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:36:29.102+0100 [mongosMain] connection accepted from 127.0.0.1:56085 #1433284 (301 connections now open) 2015-10-05T09:36:29.105+0100 [conn1433284] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:29.111+0100 [conn1433284] end connection 127.0.0.1:56085 (300 connections now open) 2015-10-05T09:36:31.067+0100 [conn1432882] end connection 172.28.0.163:54847 (299 connections now open) 2015-10-05T09:36:31.067+0100 [conn1432335] end connection 172.28.0.163:53160 (299 connections now open) 2015-10-05T09:36:31.068+0100 [mongosMain] connection accepted from 172.28.0.163:56086 #1433285 (299 connections now open) 2015-10-05T09:36:31.068+0100 [mongosMain] connection accepted from 172.28.0.163:56087 #1433286 (300 connections now open) 2015-10-05T09:36:31.069+0100 [conn1433285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:31.069+0100 [conn1433286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:31.254+0100 [conn1432906] end connection 172.28.0.164:64108 (299 connections now open) 2015-10-05T09:36:31.259+0100 [mongosMain] connection accepted from 172.28.0.164:65317 #1433287 (300 connections now open) 2015-10-05T09:36:31.261+0100 [conn1433287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:31.818+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612368f5703b51053ef392b 2015-10-05T09:36:31.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:34.499+0100 [conn1432942] end connection 172.28.0.164:64218 (299 connections now open) 2015-10-05T09:36:34.501+0100 [mongosMain] connection accepted from 172.28.0.164:65323 #1433288 (300 connections now open) 2015-10-05T09:36:34.502+0100 [conn1433288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:35.047+0100 [conn1432971] end connection 172.28.0.164:64311 (299 connections now open) 2015-10-05T09:36:35.048+0100 [mongosMain] connection accepted from 172.28.0.164:65325 #1433289 (300 connections now open) 2015-10-05T09:36:35.050+0100 [conn1433289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:36.221+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:36:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:36:38.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236955703b51053ef39a1 2015-10-05T09:36:38.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:39.680+0100 [mongosMain] connection accepted from 127.0.0.1:56092 #1433290 (301 connections now open) 2015-10-05T09:36:39.684+0100 [conn1433290] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:39.689+0100 [conn1433290] end connection 127.0.0.1:56092 (300 connections now open) 2015-10-05T09:36:41.068+0100 [conn1432344] end connection 172.28.0.163:53174 (299 connections now open) 2015-10-05T09:36:41.068+0100 [conn1432962] end connection 172.28.0.163:55107 (299 connections now open) 2015-10-05T09:36:41.069+0100 [mongosMain] connection accepted from 172.28.0.163:56095 #1433291 (299 connections now open) 2015-10-05T09:36:41.069+0100 [mongosMain] connection accepted from 172.28.0.163:56096 #1433292 (300 connections now open) 2015-10-05T09:36:41.070+0100 [conn1433291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:41.070+0100 [conn1433292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:41.238+0100 [conn1432920] end connection 172.28.0.164:64147 (299 connections now open) 2015-10-05T09:36:41.246+0100 [mongosMain] connection accepted from 172.28.0.164:65334 #1433293 (300 connections now open) 2015-10-05T09:36:41.247+0100 [conn1432340] end connection 172.28.0.164:62391 (299 connections now open) 2015-10-05T09:36:41.248+0100 [mongosMain] connection accepted from 172.28.0.164:65335 #1433294 (300 connections now open) 2015-10-05T09:36:41.249+0100 [conn1433293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:41.255+0100 [conn1433294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:43.936+0100 [conn1432349] end connection 172.28.0.164:62413 (299 connections now open) 2015-10-05T09:36:43.938+0100 [mongosMain] connection accepted from 172.28.0.164:65341 #1433295 (300 connections now open) 2015-10-05T09:36:43.939+0100 [conn1433295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:44.499+0100 [conn1432922] end connection 172.28.0.164:64161 (299 connections now open) 2015-10-05T09:36:44.500+0100 [mongosMain] connection accepted from 172.28.0.164:65344 #1433296 (300 connections now open) 2015-10-05T09:36:44.504+0100 [conn1433296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:45.045+0100 [conn1432966] end connection 172.28.0.164:64293 (299 connections now open) 2015-10-05T09:36:45.046+0100 [mongosMain] connection accepted from 172.28.0.164:65346 #1433297 (300 connections now open) 2015-10-05T09:36:45.047+0100 [conn1433297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:51.083+0100 [conn1432907] end connection 172.28.0.163:54934 (299 connections now open) 2015-10-05T09:36:51.083+0100 [conn1432352] end connection 172.28.0.163:53184 (299 connections now open) 2015-10-05T09:36:51.084+0100 [mongosMain] connection accepted from 172.28.0.163:56109 #1433298 (299 connections now open) 2015-10-05T09:36:51.085+0100 [mongosMain] connection accepted from 172.28.0.163:56108 #1433299 (300 connections now open) 2015-10-05T09:36:51.085+0100 [conn1433298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:51.085+0100 [conn1433299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:51.254+0100 [conn1432924] end connection 172.28.0.164:64165 (299 connections now open) 2015-10-05T09:36:51.255+0100 [mongosMain] connection accepted from 172.28.0.164:65351 #1433300 (300 connections now open) 2015-10-05T09:36:51.258+0100 [conn1433300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:51.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236a35703b51053ef3aaf 2015-10-05T09:36:51.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:36:54.515+0100 [conn1432954] end connection 172.28.0.164:64254 (299 connections now open) 2015-10-05T09:36:54.516+0100 [mongosMain] connection accepted from 172.28.0.164:65359 #1433301 (300 connections now open) 2015-10-05T09:36:54.518+0100 [conn1433301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:55.061+0100 [conn1432978] end connection 172.28.0.164:64334 (299 connections now open) 2015-10-05T09:36:55.063+0100 [mongosMain] connection accepted from 172.28.0.164:65361 #1433302 (300 connections now open) 2015-10-05T09:36:55.064+0100 [conn1433302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:36:58.706+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:36:58.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:37:01.615+0100 [conn1432844] end connection 172.28.0.164:63928 (299 connections now open) 2015-10-05T09:37:01.617+0100 [conn1432843] end connection 172.28.0.163:54729 (298 connections now open) 2015-10-05T09:37:01.620+0100 [mongosMain] connection accepted from 172.28.0.163:56125 #1433303 (299 connections now open) 2015-10-05T09:37:01.623+0100 [mongosMain] connection accepted from 172.28.0.164:65364 #1433304 (300 connections now open) 2015-10-05T09:37:01.635+0100 [conn1433304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:01.674+0100 [conn1433303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:04.515+0100 [conn1432918] end connection 172.28.0.164:64142 (299 connections now open) 2015-10-05T09:37:04.516+0100 [mongosMain] connection accepted from 172.28.0.164:65376 #1433305 (300 connections now open) 2015-10-05T09:37:04.517+0100 [conn1433305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:05.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236b05703b51053ef3c14 2015-10-05T09:37:05.061+0100 [conn1432986] end connection 172.28.0.164:64352 (299 connections now open) 2015-10-05T09:37:05.062+0100 [mongosMain] connection accepted from 172.28.0.164:65378 #1433306 (300 connections now open) 2015-10-05T09:37:05.064+0100 [conn1433306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:05.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:37:06.415+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:37:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:37:11.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236b75703b51053ef3ccd 2015-10-05T09:37:11.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:37:11.535+0100 [conn1432364] end connection 172.28.0.164:62462 (299 connections now open) 2015-10-05T09:37:11.536+0100 [conn1432869] end connection 172.28.0.164:64008 (298 connections now open) 2015-10-05T09:37:11.536+0100 [mongosMain] connection accepted from 172.28.0.164:65382 #1433307 (299 connections now open) 2015-10-05T09:37:11.537+0100 [mongosMain] connection accepted from 172.28.0.164:65383 #1433308 (300 connections now open) 2015-10-05T09:37:11.538+0100 [conn1433307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:11.540+0100 [conn1433308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:11.610+0100 [conn1432861] end connection 172.28.0.163:54766 (299 connections now open) 2015-10-05T09:37:11.610+0100 [conn1432366] end connection 172.28.0.163:53230 (298 connections now open) 2015-10-05T09:37:11.611+0100 [mongosMain] connection accepted from 172.28.0.163:56154 #1433309 (299 connections now open) 2015-10-05T09:37:11.611+0100 [mongosMain] connection accepted from 172.28.0.163:56155 #1433310 (300 connections now open) 2015-10-05T09:37:11.612+0100 [conn1433309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:11.612+0100 [conn1433310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:12.232+0100 [conn1432370] end connection 172.28.0.164:62470 (299 connections now open) 2015-10-05T09:37:12.233+0100 [mongosMain] connection accepted from 172.28.0.164:65384 #1433311 (300 connections now open) 2015-10-05T09:37:12.235+0100 [conn1433311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:14.532+0100 [conn1432948] end connection 172.28.0.164:64239 (299 connections now open) 2015-10-05T09:37:14.533+0100 [mongosMain] connection accepted from 172.28.0.164:65386 #1433312 (300 connections now open) 2015-10-05T09:37:14.535+0100 [conn1433312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:15.077+0100 [conn1432993] end connection 172.28.0.164:64370 (299 connections now open) 2015-10-05T09:37:15.078+0100 [mongosMain] connection accepted from 172.28.0.164:65388 #1433313 (300 connections now open) 2015-10-05T09:37:15.081+0100 [conn1433313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:21.535+0100 [conn1432893] end connection 172.28.0.164:64073 (299 connections now open) 2015-10-05T09:37:21.537+0100 [mongosMain] connection accepted from 172.28.0.164:65394 #1433314 (300 connections now open) 2015-10-05T09:37:21.538+0100 [conn1433314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:21.601+0100 [conn1432856] end connection 172.28.0.163:54751 (299 connections now open) 2015-10-05T09:37:21.601+0100 [conn1432372] end connection 172.28.0.163:53249 (299 connections now open) 2015-10-05T09:37:21.602+0100 [mongosMain] connection accepted from 172.28.0.163:56170 #1433315 (299 connections now open) 2015-10-05T09:37:21.602+0100 [mongosMain] connection accepted from 172.28.0.163:56171 #1433316 (300 connections now open) 2015-10-05T09:37:21.603+0100 [conn1433315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:21.603+0100 [conn1433316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:21.940+0100 [conn1432376] end connection 172.28.0.164:62485 (299 connections now open) 2015-10-05T09:37:24.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236c35703b51053ef3e7d 2015-10-05T09:37:24.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:37:24.531+0100 [conn1432970] end connection 172.28.0.164:64307 (298 connections now open) 2015-10-05T09:37:24.533+0100 [mongosMain] connection accepted from 172.28.0.164:65401 #1433317 (299 connections now open) 2015-10-05T09:37:24.534+0100 [conn1433317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:25.079+0100 [conn1433001] end connection 172.28.0.164:64390 (298 connections now open) 2015-10-05T09:37:25.081+0100 [mongosMain] connection accepted from 172.28.0.164:65404 #1433318 (299 connections now open) 2015-10-05T09:37:25.083+0100 [conn1433318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:28.748+0100 [mongosMain] connection accepted from 127.0.0.1:56175 #1433319 (300 connections now open) 2015-10-05T09:37:28.750+0100 [conn1433319] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:28.755+0100 [conn1433319] end connection 127.0.0.1:56175 (299 connections now open) 2015-10-05T09:37:30.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236ca5703b51053ef3f73 2015-10-05T09:37:30.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:37:31.551+0100 [conn1432937] end connection 172.28.0.164:64207 (298 connections now open) 2015-10-05T09:37:31.552+0100 [mongosMain] connection accepted from 172.28.0.164:65415 #1433320 (299 connections now open) 2015-10-05T09:37:31.553+0100 [mongosMain] connection accepted from 172.28.0.164:65416 #1433321 (300 connections now open) 2015-10-05T09:37:31.555+0100 [conn1433320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:31.555+0100 [conn1433321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:31.614+0100 [conn1432956] end connection 172.28.0.163:55081 (299 connections now open) 2015-10-05T09:37:31.615+0100 [mongosMain] connection accepted from 172.28.0.163:56176 #1433322 (300 connections now open) 2015-10-05T09:37:31.615+0100 [conn1432380] end connection 172.28.0.163:53264 (299 connections now open) 2015-10-05T09:37:31.616+0100 [conn1433322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:31.616+0100 [mongosMain] connection accepted from 172.28.0.163:56177 #1433323 (300 connections now open) 2015-10-05T09:37:31.617+0100 [conn1433323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:34.563+0100 [conn1432977] end connection 172.28.0.164:64331 (299 connections now open) 2015-10-05T09:37:34.565+0100 [mongosMain] connection accepted from 172.28.0.164:65421 #1433324 (300 connections now open) 2015-10-05T09:37:34.567+0100 [conn1433324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:35.092+0100 [conn1433008] end connection 172.28.0.164:64400 (299 connections now open) 2015-10-05T09:37:35.093+0100 [mongosMain] connection accepted from 172.28.0.164:65426 #1433325 (300 connections now open) 2015-10-05T09:37:35.095+0100 [conn1433325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:36.569+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:37:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:37:40.202+0100 [mongosMain] connection accepted from 127.0.0.1:56180 #1433326 (301 connections now open) 2015-10-05T09:37:40.205+0100 [conn1433326] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:40.209+0100 [conn1433326] end connection 127.0.0.1:56180 (300 connections now open) 2015-10-05T09:37:41.558+0100 [conn1432898] end connection 172.28.0.164:64087 (299 connections now open) 2015-10-05T09:37:41.558+0100 [conn1432567] end connection 172.28.0.164:63142 (298 connections now open) 2015-10-05T09:37:41.559+0100 [mongosMain] connection accepted from 172.28.0.164:65435 #1433327 (299 connections now open) 2015-10-05T09:37:41.560+0100 [mongosMain] connection accepted from 172.28.0.164:65436 #1433328 (300 connections now open) 2015-10-05T09:37:41.561+0100 [conn1433328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:41.561+0100 [conn1433327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:41.616+0100 [conn1432388] end connection 172.28.0.163:53271 (299 connections now open) 2015-10-05T09:37:41.617+0100 [mongosMain] connection accepted from 172.28.0.163:56182 #1433329 (300 connections now open) 2015-10-05T09:37:41.618+0100 [conn1433329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:43.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236d65703b51053ef40e4 2015-10-05T09:37:43.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:37:44.579+0100 [conn1433014] end connection 172.28.0.164:64414 (299 connections now open) 2015-10-05T09:37:44.580+0100 [mongosMain] connection accepted from 172.28.0.164:65442 #1433330 (300 connections now open) 2015-10-05T09:37:44.582+0100 [conn1433330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:45.109+0100 [conn1433015] end connection 172.28.0.164:64416 (299 connections now open) 2015-10-05T09:37:45.110+0100 [mongosMain] connection accepted from 172.28.0.164:65446 #1433331 (300 connections now open) 2015-10-05T09:37:45.111+0100 [conn1433331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:51.567+0100 [conn1432866] end connection 172.28.0.164:64003 (299 connections now open) 2015-10-05T09:37:51.567+0100 [conn1432547] end connection 172.28.0.164:63076 (298 connections now open) 2015-10-05T09:37:51.568+0100 [mongosMain] connection accepted from 172.28.0.164:65454 #1433332 (299 connections now open) 2015-10-05T09:37:51.569+0100 [mongosMain] connection accepted from 172.28.0.164:65455 #1433333 (300 connections now open) 2015-10-05T09:37:51.570+0100 [conn1433332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:51.570+0100 [conn1433333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:54.578+0100 [conn1432965] end connection 172.28.0.164:64291 (299 connections now open) 2015-10-05T09:37:54.579+0100 [mongosMain] connection accepted from 172.28.0.164:65461 #1433334 (300 connections now open) 2015-10-05T09:37:54.582+0100 [conn1433334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:37:55.109+0100 [conn1433023] end connection 172.28.0.164:64435 (299 connections now open) 2015-10-05T09:37:55.110+0100 [mongosMain] connection accepted from 172.28.0.164:65464 #1433335 (300 connections now open) 2015-10-05T09:37:55.112+0100 [conn1433335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:01.570+0100 [conn1432672] end connection 172.28.0.164:63381 (299 connections now open) 2015-10-05T09:38:01.572+0100 [mongosMain] connection accepted from 172.28.0.164:65469 #1433336 (300 connections now open) 2015-10-05T09:38:01.595+0100 [conn1433336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:01.662+0100 [conn1432502] end connection 172.28.0.163:53731 (299 connections now open) 2015-10-05T09:38:01.679+0100 [mongosMain] connection accepted from 172.28.0.163:56218 #1433337 (300 connections now open) 2015-10-05T09:38:01.681+0100 [conn1433337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:01.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236e95703b51053ef42a6 2015-10-05T09:38:01.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:38:04.594+0100 [conn1433022] end connection 172.28.0.164:64433 (299 connections now open) 2015-10-05T09:38:04.595+0100 [mongosMain] connection accepted from 172.28.0.164:65481 #1433338 (300 connections now open) 2015-10-05T09:38:04.596+0100 [conn1433338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:06.717+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:38:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:38:11.608+0100 [conn1432938] end connection 172.28.0.164:64208 (299 connections now open) 2015-10-05T09:38:11.610+0100 [mongosMain] connection accepted from 172.28.0.164:65483 #1433339 (300 connections now open) 2015-10-05T09:38:11.612+0100 [conn1433339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:14.610+0100 [conn1433035] end connection 172.28.0.164:64473 (299 connections now open) 2015-10-05T09:38:14.611+0100 [mongosMain] connection accepted from 172.28.0.164:65487 #1433340 (300 connections now open) 2015-10-05T09:38:14.613+0100 [conn1433340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:15.140+0100 [conn1433030] end connection 172.28.0.164:64456 (299 connections now open) 2015-10-05T09:38:15.142+0100 [mongosMain] connection accepted from 172.28.0.164:65488 #1433341 (300 connections now open) 2015-10-05T09:38:15.143+0100 [conn1433341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:20.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561236fc5703b51053ef450b 2015-10-05T09:38:20.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:38:21.597+0100 [conn1432721] end connection 172.28.0.164:63499 (299 connections now open) 2015-10-05T09:38:21.598+0100 [conn1432996] end connection 172.28.0.164:64373 (298 connections now open) 2015-10-05T09:38:21.598+0100 [mongosMain] connection accepted from 172.28.0.164:65499 #1433342 (299 connections now open) 2015-10-05T09:38:21.599+0100 [mongosMain] connection accepted from 172.28.0.164:65500 #1433343 (300 connections now open) 2015-10-05T09:38:21.599+0100 [conn1433342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:21.600+0100 [conn1433343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:21.649+0100 [conn1433024] end connection 172.28.0.163:55249 (299 connections now open) 2015-10-05T09:38:21.650+0100 [mongosMain] connection accepted from 172.28.0.163:56251 #1433344 (300 connections now open) 2015-10-05T09:38:21.651+0100 [conn1433344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:24.625+0100 [conn1432985] end connection 172.28.0.164:64349 (299 connections now open) 2015-10-05T09:38:24.627+0100 [mongosMain] connection accepted from 172.28.0.164:65503 #1433345 (300 connections now open) 2015-10-05T09:38:24.630+0100 [conn1433345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:25.156+0100 [conn1433046] end connection 172.28.0.164:64499 (299 connections now open) 2015-10-05T09:38:25.157+0100 [mongosMain] connection accepted from 172.28.0.164:65506 #1433346 (300 connections now open) 2015-10-05T09:38:25.158+0100 [conn1433346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:29.046+0100 [mongosMain] connection accepted from 127.0.0.1:56254 #1433347 (301 connections now open) 2015-10-05T09:38:29.050+0100 [conn1433347] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:29.057+0100 [conn1433347] end connection 127.0.0.1:56254 (300 connections now open) 2015-10-05T09:38:31.614+0100 [conn1432581] end connection 172.28.0.164:63182 (299 connections now open) 2015-10-05T09:38:31.614+0100 [conn1432838] end connection 172.28.0.164:63913 (299 connections now open) 2015-10-05T09:38:31.615+0100 [mongosMain] connection accepted from 172.28.0.164:65514 #1433348 (299 connections now open) 2015-10-05T09:38:31.615+0100 [mongosMain] connection accepted from 172.28.0.164:65515 #1433349 (300 connections now open) 2015-10-05T09:38:31.616+0100 [conn1433348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:31.617+0100 [conn1433349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:31.661+0100 [conn1433016] end connection 172.28.0.163:55239 (299 connections now open) 2015-10-05T09:38:31.662+0100 [conn1432636] end connection 172.28.0.163:54115 (299 connections now open) 2015-10-05T09:38:31.663+0100 [mongosMain] connection accepted from 172.28.0.163:56257 #1433350 (299 connections now open) 2015-10-05T09:38:31.663+0100 [mongosMain] connection accepted from 172.28.0.163:56258 #1433351 (300 connections now open) 2015-10-05T09:38:31.664+0100 [conn1433350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:31.664+0100 [conn1433351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:33.778+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:38:33.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:38:34.625+0100 [conn1432992] end connection 172.28.0.164:64368 (299 connections now open) 2015-10-05T09:38:34.626+0100 [mongosMain] connection accepted from 172.28.0.164:65524 #1433352 (300 connections now open) 2015-10-05T09:38:34.628+0100 [conn1433352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:35.171+0100 [conn1433053] end connection 172.28.0.164:64522 (299 connections now open) 2015-10-05T09:38:35.174+0100 [mongosMain] connection accepted from 172.28.0.164:65526 #1433353 (300 connections now open) 2015-10-05T09:38:35.176+0100 [conn1433353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:36.845+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:38:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:38:40.055+0100 [mongosMain] connection accepted from 127.0.0.1:56264 #1433354 (301 connections now open) 2015-10-05T09:38:40.059+0100 [conn1433354] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:40.064+0100 [conn1433354] end connection 127.0.0.1:56264 (300 connections now open) 2015-10-05T09:38:41.614+0100 [conn1432592] end connection 172.28.0.164:63225 (299 connections now open) 2015-10-05T09:38:41.615+0100 [mongosMain] connection accepted from 172.28.0.164:49157 #1433355 (300 connections now open) 2015-10-05T09:38:41.616+0100 [conn1433355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:41.701+0100 [conn1433047] end connection 172.28.0.163:55330 (299 connections now open) 2015-10-05T09:38:41.701+0100 [mongosMain] connection accepted from 172.28.0.163:56267 #1433356 (300 connections now open) 2015-10-05T09:38:41.702+0100 [conn1433356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:44.641+0100 [conn1433007] end connection 172.28.0.164:64396 (299 connections now open) 2015-10-05T09:38:44.642+0100 [mongosMain] connection accepted from 172.28.0.164:49163 #1433357 (300 connections now open) 2015-10-05T09:38:44.644+0100 [conn1433357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:45.186+0100 [conn1433062] end connection 172.28.0.164:64542 (299 connections now open) 2015-10-05T09:38:45.187+0100 [mongosMain] connection accepted from 172.28.0.164:49165 #1433358 (300 connections now open) 2015-10-05T09:38:45.188+0100 [conn1433358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:46.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237165703b51053ef480f 2015-10-05T09:38:46.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:38:51.630+0100 [conn1432396] end connection 172.28.0.164:62544 (299 connections now open) 2015-10-05T09:38:51.632+0100 [mongosMain] connection accepted from 172.28.0.164:49179 #1433359 (300 connections now open) 2015-10-05T09:38:51.634+0100 [conn1433359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:51.708+0100 [conn1432950] end connection 172.28.0.163:55064 (299 connections now open) 2015-10-05T09:38:51.709+0100 [mongosMain] connection accepted from 172.28.0.163:56288 #1433360 (300 connections now open) 2015-10-05T09:38:51.709+0100 [conn1433360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:55.187+0100 [conn1433068] end connection 172.28.0.164:64562 (299 connections now open) 2015-10-05T09:38:55.189+0100 [mongosMain] connection accepted from 172.28.0.164:49204 #1433361 (300 connections now open) 2015-10-05T09:38:55.190+0100 [conn1433361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:38:59.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237225703b51053ef48f2 2015-10-05T09:38:59.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:39:01.709+0100 [conn1432868] end connection 172.28.0.163:54809 (299 connections now open) 2015-10-05T09:39:01.710+0100 [mongosMain] connection accepted from 172.28.0.163:56307 #1433362 (300 connections now open) 2015-10-05T09:39:01.711+0100 [conn1433362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:01.711+0100 [conn1432385] end connection 172.28.0.164:62504 (299 connections now open) 2015-10-05T09:39:01.713+0100 [mongosMain] connection accepted from 172.28.0.164:49210 #1433363 (300 connections now open) 2015-10-05T09:39:01.714+0100 [conn1433363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:05.203+0100 [conn1433072] end connection 172.28.0.164:64575 (299 connections now open) 2015-10-05T09:39:05.204+0100 [mongosMain] connection accepted from 172.28.0.164:49221 #1433364 (300 connections now open) 2015-10-05T09:39:05.205+0100 [conn1433364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:07.103+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:39:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:39:12.371+0100 [conn1432913] end connection 172.28.0.163:54942 (299 connections now open) 2015-10-05T09:39:12.376+0100 [mongosMain] connection accepted from 172.28.0.163:56350 #1433365 (300 connections now open) 2015-10-05T09:39:12.378+0100 [conn1433365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:12.492+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:39:12.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:39:15.203+0100 [conn1433075] end connection 172.28.0.164:64593 (299 connections now open) 2015-10-05T09:39:15.204+0100 [mongosMain] connection accepted from 172.28.0.164:49242 #1433366 (300 connections now open) 2015-10-05T09:39:15.206+0100 [conn1433366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:18.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237365703b51053ef4a6b 2015-10-05T09:39:18.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:39:22.353+0100 [conn1433054] end connection 172.28.0.163:55346 (299 connections now open) 2015-10-05T09:39:22.354+0100 [mongosMain] connection accepted from 172.28.0.163:56362 #1433367 (300 connections now open) 2015-10-05T09:39:22.355+0100 [conn1433367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:22.363+0100 [conn1433056] end connection 172.28.0.164:64530 (299 connections now open) 2015-10-05T09:39:22.364+0100 [mongosMain] connection accepted from 172.28.0.164:49253 #1433368 (300 connections now open) 2015-10-05T09:39:22.365+0100 [conn1433368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:29.117+0100 [mongosMain] connection accepted from 127.0.0.1:56366 #1433369 (301 connections now open) 2015-10-05T09:39:29.120+0100 [conn1433369] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:29.126+0100 [conn1433369] end connection 127.0.0.1:56366 (300 connections now open) 2015-10-05T09:39:32.365+0100 [conn1432936] end connection 172.28.0.163:55038 (299 connections now open) 2015-10-05T09:39:32.366+0100 [mongosMain] connection accepted from 172.28.0.163:56370 #1433370 (300 connections now open) 2015-10-05T09:39:32.368+0100 [conn1433370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:37.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237485703b51053ef4ba6 2015-10-05T09:39:37.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:39:37.389+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:39:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:39:39.784+0100 [mongosMain] connection accepted from 127.0.0.1:56372 #1433371 (301 connections now open) 2015-10-05T09:39:39.787+0100 [conn1433371] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:39.791+0100 [conn1433371] end connection 127.0.0.1:56372 (300 connections now open) 2015-10-05T09:39:42.379+0100 [conn1432874] end connection 172.28.0.163:54835 (299 connections now open) 2015-10-05T09:39:42.380+0100 [mongosMain] connection accepted from 172.28.0.163:56379 #1433372 (300 connections now open) 2015-10-05T09:39:42.381+0100 [conn1433372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:52.663+0100 [conn1433009] end connection 172.28.0.163:55225 (299 connections now open) 2015-10-05T09:39:52.670+0100 [mongosMain] connection accepted from 172.28.0.163:56395 #1433373 (300 connections now open) 2015-10-05T09:39:52.673+0100 [conn1433373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:39:55.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612375b5703b51053ef4cb8 2015-10-05T09:39:55.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:40:02.652+0100 [conn1433079] end connection 172.28.0.163:55423 (299 connections now open) 2015-10-05T09:40:02.653+0100 [mongosMain] connection accepted from 172.28.0.163:56424 #1433374 (300 connections now open) 2015-10-05T09:40:02.654+0100 [conn1433374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:05.266+0100 [conn1433078] end connection 172.28.0.164:64600 (299 connections now open) 2015-10-05T09:40:05.267+0100 [mongosMain] connection accepted from 172.28.0.164:49323 #1433375 (300 connections now open) 2015-10-05T09:40:05.270+0100 [conn1433375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:07.668+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:40:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:40:12.660+0100 [conn1432888] end connection 172.28.0.163:54858 (299 connections now open) 2015-10-05T09:40:12.661+0100 [mongosMain] connection accepted from 172.28.0.163:56437 #1433376 (300 connections now open) 2015-10-05T09:40:12.662+0100 [conn1433376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:14.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612376d5703b51053ef4dd6 2015-10-05T09:40:15.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:40:22.664+0100 [conn1433086] end connection 172.28.0.163:55445 (299 connections now open) 2015-10-05T09:40:22.665+0100 [mongosMain] connection accepted from 172.28.0.163:56445 #1433377 (300 connections now open) 2015-10-05T09:40:22.666+0100 [conn1433377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:23.269+0100 [conn1432988] end connection 172.28.0.164:64356 (299 connections now open) 2015-10-05T09:40:23.271+0100 [mongosMain] connection accepted from 172.28.0.164:49344 #1433378 (300 connections now open) 2015-10-05T09:40:23.274+0100 [conn1433378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:25.281+0100 [conn1433094] end connection 172.28.0.164:64688 (299 connections now open) 2015-10-05T09:40:25.282+0100 [mongosMain] connection accepted from 172.28.0.164:49349 #1433379 (300 connections now open) 2015-10-05T09:40:25.284+0100 [conn1433379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:27.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612377b5703b51053ef4e6b 2015-10-05T09:40:27.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:40:28.688+0100 [mongosMain] connection accepted from 127.0.0.1:56449 #1433380 (301 connections now open) 2015-10-05T09:40:28.691+0100 [conn1433380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:28.696+0100 [conn1433380] end connection 127.0.0.1:56449 (300 connections now open) 2015-10-05T09:40:32.705+0100 [conn1432803] end connection 172.28.0.163:54617 (299 connections now open) 2015-10-05T09:40:32.705+0100 [mongosMain] connection accepted from 172.28.0.163:56452 #1433381 (300 connections now open) 2015-10-05T09:40:32.705+0100 [conn1433381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:33.297+0100 [conn1433087] end connection 172.28.0.164:64641 (299 connections now open) 2015-10-05T09:40:33.297+0100 [mongosMain] connection accepted from 172.28.0.164:49360 #1433382 (300 connections now open) 2015-10-05T09:40:33.297+0100 [conn1433382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:35.325+0100 [conn1433100] end connection 172.28.0.164:64712 (299 connections now open) 2015-10-05T09:40:35.325+0100 [mongosMain] connection accepted from 172.28.0.164:49365 #1433383 (300 connections now open) 2015-10-05T09:40:35.325+0100 [conn1433383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:38.139+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:40:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:40:39.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237875703b51053ef4efc 2015-10-05T09:40:39.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:40:40.180+0100 [mongosMain] connection accepted from 127.0.0.1:56458 #1433384 (301 connections now open) 2015-10-05T09:40:40.183+0100 [conn1433384] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:40.187+0100 [conn1433384] end connection 127.0.0.1:56458 (300 connections now open) 2015-10-05T09:40:42.694+0100 [conn1432865] end connection 172.28.0.163:54796 (299 connections now open) 2015-10-05T09:40:42.695+0100 [mongosMain] connection accepted from 172.28.0.163:56463 #1433385 (300 connections now open) 2015-10-05T09:40:42.696+0100 [conn1433385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:43.286+0100 [conn1432981] end connection 172.28.0.164:64338 (299 connections now open) 2015-10-05T09:40:43.286+0100 [mongosMain] connection accepted from 172.28.0.164:49376 #1433386 (300 connections now open) 2015-10-05T09:40:43.287+0100 [conn1433386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:45.312+0100 [conn1433105] end connection 172.28.0.164:64729 (299 connections now open) 2015-10-05T09:40:45.314+0100 [mongosMain] connection accepted from 172.28.0.164:49380 #1433387 (300 connections now open) 2015-10-05T09:40:45.316+0100 [conn1433387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:45.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612378d5703b51053ef4f6b 2015-10-05T09:40:46.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:40:52.702+0100 [conn1433082] end connection 172.28.0.163:55434 (299 connections now open) 2015-10-05T09:40:52.703+0100 [mongosMain] connection accepted from 172.28.0.163:56481 #1433388 (300 connections now open) 2015-10-05T09:40:52.704+0100 [conn1433388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:53.285+0100 [conn1433080] end connection 172.28.0.164:64605 (299 connections now open) 2015-10-05T09:40:53.286+0100 [mongosMain] connection accepted from 172.28.0.164:49390 #1433389 (300 connections now open) 2015-10-05T09:40:53.287+0100 [conn1433389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:40:59.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612379a5703b51053ef4fea 2015-10-05T09:40:59.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:02.708+0100 [conn1433095] end connection 172.28.0.163:55499 (299 connections now open) 2015-10-05T09:41:02.709+0100 [mongosMain] connection accepted from 172.28.0.163:56503 #1433390 (300 connections now open) 2015-10-05T09:41:02.710+0100 [conn1433390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:03.300+0100 [conn1433064] end connection 172.28.0.164:64547 (299 connections now open) 2015-10-05T09:41:03.301+0100 [mongosMain] connection accepted from 172.28.0.164:49403 #1433391 (300 connections now open) 2015-10-05T09:41:03.302+0100 [conn1433391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:04.781+0100 [conn1433074] end connection 172.28.0.164:64591 (299 connections now open) 2015-10-05T09:41:04.783+0100 [mongosMain] connection accepted from 172.28.0.164:49408 #1433392 (300 connections now open) 2015-10-05T09:41:04.784+0100 [conn1433392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:08.290+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:41:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:41:12.710+0100 [conn1433092] end connection 172.28.0.163:55472 (299 connections now open) 2015-10-05T09:41:12.711+0100 [mongosMain] connection accepted from 172.28.0.163:56518 #1433393 (300 connections now open) 2015-10-05T09:41:12.712+0100 [conn1433393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:12.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237a85703b51053ef50ef 2015-10-05T09:41:12.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:13.317+0100 [conn1433083] end connection 172.28.0.164:64624 (299 connections now open) 2015-10-05T09:41:13.318+0100 [mongosMain] connection accepted from 172.28.0.164:49414 #1433394 (300 connections now open) 2015-10-05T09:41:13.320+0100 [conn1433394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:15.344+0100 [conn1433111] end connection 172.28.0.164:64745 (299 connections now open) 2015-10-05T09:41:15.345+0100 [mongosMain] connection accepted from 172.28.0.164:49417 #1433395 (300 connections now open) 2015-10-05T09:41:15.347+0100 [conn1433395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:19.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237ae5703b51053ef5137 2015-10-05T09:41:20.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:22.736+0100 [conn1433063] end connection 172.28.0.163:55356 (299 connections now open) 2015-10-05T09:41:22.737+0100 [mongosMain] connection accepted from 172.28.0.163:56528 #1433396 (300 connections now open) 2015-10-05T09:41:22.739+0100 [conn1433396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:23.316+0100 [conn1433093] end connection 172.28.0.164:64663 (299 connections now open) 2015-10-05T09:41:23.317+0100 [mongosMain] connection accepted from 172.28.0.164:49427 #1433397 (300 connections now open) 2015-10-05T09:41:23.320+0100 [conn1433397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:24.814+0100 [conn1433077] end connection 172.28.0.164:64598 (299 connections now open) 2015-10-05T09:41:24.815+0100 [mongosMain] connection accepted from 172.28.0.164:49431 #1433398 (300 connections now open) 2015-10-05T09:41:24.816+0100 [conn1433398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:25.344+0100 [conn1433115] end connection 172.28.0.164:64758 (299 connections now open) 2015-10-05T09:41:25.345+0100 [mongosMain] connection accepted from 172.28.0.164:49433 #1433399 (300 connections now open) 2015-10-05T09:41:25.346+0100 [conn1433399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:26.775+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237b65703b51053ef51a8 2015-10-05T09:41:26.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:28.757+0100 [mongosMain] connection accepted from 127.0.0.1:56531 #1433400 (301 connections now open) 2015-10-05T09:41:28.760+0100 [conn1433400] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:28.765+0100 [conn1433400] end connection 127.0.0.1:56531 (300 connections now open) 2015-10-05T09:41:32.729+0100 [conn1433101] end connection 172.28.0.163:55524 (299 connections now open) 2015-10-05T09:41:32.730+0100 [mongosMain] connection accepted from 172.28.0.163:56534 #1433401 (300 connections now open) 2015-10-05T09:41:32.731+0100 [conn1433401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:33.317+0100 [conn1433091] end connection 172.28.0.164:64653 (299 connections now open) 2015-10-05T09:41:33.318+0100 [mongosMain] connection accepted from 172.28.0.164:49443 #1433402 (300 connections now open) 2015-10-05T09:41:33.320+0100 [conn1433402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:34.829+0100 [conn1433000] end connection 172.28.0.164:64386 (299 connections now open) 2015-10-05T09:41:34.831+0100 [mongosMain] connection accepted from 172.28.0.164:49447 #1433403 (300 connections now open) 2015-10-05T09:41:34.832+0100 [conn1433403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:35.359+0100 [conn1433121] end connection 172.28.0.164:64787 (299 connections now open) 2015-10-05T09:41:35.361+0100 [mongosMain] connection accepted from 172.28.0.164:49450 #1433404 (300 connections now open) 2015-10-05T09:41:35.363+0100 [conn1433404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:38.587+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:41:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:41:39.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237c25703b51053ef5248 2015-10-05T09:41:39.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:39.639+0100 [mongosMain] connection accepted from 127.0.0.1:56545 #1433405 (301 connections now open) 2015-10-05T09:41:39.642+0100 [conn1433405] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:39.646+0100 [conn1433405] end connection 127.0.0.1:56545 (300 connections now open) 2015-10-05T09:41:43.333+0100 [conn1433096] end connection 172.28.0.164:64690 (299 connections now open) 2015-10-05T09:41:43.334+0100 [mongosMain] connection accepted from 172.28.0.164:49461 #1433406 (300 connections now open) 2015-10-05T09:41:43.335+0100 [conn1433406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:44.845+0100 [conn1433060] end connection 172.28.0.164:64539 (299 connections now open) 2015-10-05T09:41:44.846+0100 [mongosMain] connection accepted from 172.28.0.164:49464 #1433407 (300 connections now open) 2015-10-05T09:41:44.848+0100 [conn1433407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:45.374+0100 [conn1433126] end connection 172.28.0.164:64805 (299 connections now open) 2015-10-05T09:41:45.375+0100 [mongosMain] connection accepted from 172.28.0.164:49466 #1433408 (300 connections now open) 2015-10-05T09:41:45.378+0100 [conn1433408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:45.424+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:41:45.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:41:51.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237cf5703b51053ef52f8 2015-10-05T09:41:51.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:41:53.619+0100 [conn1432914] end connection 172.28.0.164:64124 (299 connections now open) 2015-10-05T09:41:53.622+0100 [mongosMain] connection accepted from 172.28.0.164:49477 #1433409 (300 connections now open) 2015-10-05T09:41:53.623+0100 [conn1433409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:54.861+0100 [conn1433052] end connection 172.28.0.164:64518 (299 connections now open) 2015-10-05T09:41:54.864+0100 [mongosMain] connection accepted from 172.28.0.164:49482 #1433410 (300 connections now open) 2015-10-05T09:41:54.876+0100 [conn1433410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:41:55.389+0100 [conn1433131] end connection 172.28.0.164:64823 (299 connections now open) 2015-10-05T09:41:55.391+0100 [mongosMain] connection accepted from 172.28.0.164:49485 #1433411 (300 connections now open) 2015-10-05T09:41:55.392+0100 [conn1433411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:00.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237d55703b51053ef535a 2015-10-05T09:42:00.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:03.573+0100 [conn1432665] end connection 172.28.0.164:63364 (299 connections now open) 2015-10-05T09:42:03.574+0100 [mongosMain] connection accepted from 172.28.0.164:49502 #1433412 (300 connections now open) 2015-10-05T09:42:03.577+0100 [conn1433412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:05.398+0100 [conn1433137] end connection 172.28.0.164:64845 (299 connections now open) 2015-10-05T09:42:05.400+0100 [mongosMain] connection accepted from 172.28.0.164:49505 #1433413 (300 connections now open) 2015-10-05T09:42:05.401+0100 [conn1433413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:06.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237de5703b51053ef53f2 2015-10-05T09:42:06.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:10.661+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:42:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:42:12.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237e45703b51053ef5447 2015-10-05T09:42:12.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:13.590+0100 [conn1432605] end connection 172.28.0.164:63267 (299 connections now open) 2015-10-05T09:42:13.591+0100 [mongosMain] connection accepted from 172.28.0.164:49509 #1433414 (300 connections now open) 2015-10-05T09:42:13.593+0100 [conn1433414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:14.877+0100 [conn1432960] end connection 172.28.0.164:64283 (299 connections now open) 2015-10-05T09:42:14.879+0100 [mongosMain] connection accepted from 172.28.0.164:49510 #1433415 (300 connections now open) 2015-10-05T09:42:14.881+0100 [conn1433415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:15.415+0100 [conn1433141] end connection 172.28.0.164:64859 (299 connections now open) 2015-10-05T09:42:15.416+0100 [mongosMain] connection accepted from 172.28.0.164:49511 #1433416 (300 connections now open) 2015-10-05T09:42:15.419+0100 [conn1433416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:19.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237ea5703b51053ef54a7 2015-10-05T09:42:19.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:23.185+0100 [conn1433106] end connection 172.28.0.163:55533 (299 connections now open) 2015-10-05T09:42:23.187+0100 [mongosMain] connection accepted from 172.28.0.163:56607 #1433417 (300 connections now open) 2015-10-05T09:42:23.188+0100 [conn1433417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:23.606+0100 [conn1433139] end connection 172.28.0.164:64851 (299 connections now open) 2015-10-05T09:42:23.606+0100 [conn1432692] end connection 172.28.0.164:63426 (299 connections now open) 2015-10-05T09:42:23.607+0100 [mongosMain] connection accepted from 172.28.0.164:49526 #1433418 (299 connections now open) 2015-10-05T09:42:23.607+0100 [mongosMain] connection accepted from 172.28.0.164:49525 #1433419 (300 connections now open) 2015-10-05T09:42:23.608+0100 [conn1433418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:23.610+0100 [conn1433419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:24.884+0100 [conn1433040] end connection 172.28.0.164:64489 (299 connections now open) 2015-10-05T09:42:24.886+0100 [mongosMain] connection accepted from 172.28.0.164:49529 #1433420 (300 connections now open) 2015-10-05T09:42:24.887+0100 [conn1433420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:25.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237f15703b51053ef54fb 2015-10-05T09:42:25.414+0100 [conn1433147] end connection 172.28.0.164:64879 (299 connections now open) 2015-10-05T09:42:25.415+0100 [mongosMain] connection accepted from 172.28.0.164:49531 #1433421 (300 connections now open) 2015-10-05T09:42:25.420+0100 [conn1433421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:25.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:28.513+0100 [mongosMain] connection accepted from 127.0.0.1:56611 #1433422 (301 connections now open) 2015-10-05T09:42:28.516+0100 [conn1433422] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:28.521+0100 [conn1433422] end connection 127.0.0.1:56611 (300 connections now open) 2015-10-05T09:42:31.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237f75703b51053ef559e 2015-10-05T09:42:31.746+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:33.191+0100 [conn1433148] end connection 172.28.0.163:55684 (299 connections now open) 2015-10-05T09:42:33.192+0100 [mongosMain] connection accepted from 172.28.0.163:56615 #1433423 (300 connections now open) 2015-10-05T09:42:33.193+0100 [conn1433423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:33.621+0100 [conn1433098] end connection 172.28.0.164:64697 (299 connections now open) 2015-10-05T09:42:33.621+0100 [conn1432980] end connection 172.28.0.164:64337 (299 connections now open) 2015-10-05T09:42:33.622+0100 [mongosMain] connection accepted from 172.28.0.164:49543 #1433424 (299 connections now open) 2015-10-05T09:42:33.623+0100 [mongosMain] connection accepted from 172.28.0.164:49544 #1433425 (300 connections now open) 2015-10-05T09:42:33.624+0100 [conn1433424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:33.624+0100 [conn1433425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:34.901+0100 [conn1433152] end connection 172.28.0.164:64883 (299 connections now open) 2015-10-05T09:42:34.902+0100 [mongosMain] connection accepted from 172.28.0.164:49547 #1433426 (300 connections now open) 2015-10-05T09:42:34.903+0100 [conn1433426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:35.430+0100 [conn1433157] end connection 172.28.0.164:64902 (299 connections now open) 2015-10-05T09:42:35.430+0100 [mongosMain] connection accepted from 172.28.0.164:49549 #1433427 (300 connections now open) 2015-10-05T09:42:35.433+0100 [conn1433427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:36.838+0100 [mongosMain] connection accepted from 172.28.0.163:56627 #1433428 (301 connections now open) 2015-10-05T09:42:36.839+0100 [mongosMain] connection accepted from 172.28.0.163:56628 #1433429 (302 connections now open) 2015-10-05T09:42:37.325+0100 [conn1433428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.325+0100 [conn1433429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.343+0100 [mongosMain] connection accepted from 172.28.0.163:56632 #1433430 (303 connections now open) 2015-10-05T09:42:37.350+0100 [conn1433430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.355+0100 [mongosMain] connection accepted from 172.28.0.163:56634 #1433431 (304 connections now open) 2015-10-05T09:42:37.360+0100 [conn1433431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.367+0100 [mongosMain] connection accepted from 172.28.0.163:56636 #1433432 (305 connections now open) 2015-10-05T09:42:37.408+0100 [conn1433432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.411+0100 [mongosMain] connection accepted from 172.28.0.163:56638 #1433433 (306 connections now open) 2015-10-05T09:42:37.414+0100 [conn1433433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.416+0100 [mongosMain] connection accepted from 172.28.0.163:56640 #1433434 (307 connections now open) 2015-10-05T09:42:37.418+0100 [conn1433434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.422+0100 [mongosMain] connection accepted from 172.28.0.163:56641 #1433435 (308 connections now open) 2015-10-05T09:42:37.425+0100 [conn1433435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.427+0100 [mongosMain] connection accepted from 172.28.0.163:56642 #1433436 (309 connections now open) 2015-10-05T09:42:37.429+0100 [conn1433436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.430+0100 [mongosMain] connection accepted from 172.28.0.163:56643 #1433437 (310 connections now open) 2015-10-05T09:42:37.448+0100 [conn1433437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.452+0100 [mongosMain] connection accepted from 172.28.0.163:56645 #1433438 (311 connections now open) 2015-10-05T09:42:37.455+0100 [conn1433438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.457+0100 [mongosMain] connection accepted from 172.28.0.163:56648 #1433439 (312 connections now open) 2015-10-05T09:42:37.458+0100 [conn1433439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.459+0100 [mongosMain] connection accepted from 172.28.0.163:56649 #1433440 (313 connections now open) 2015-10-05T09:42:37.461+0100 [conn1433440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.463+0100 [mongosMain] connection accepted from 172.28.0.163:56651 #1433441 (314 connections now open) 2015-10-05T09:42:37.464+0100 [conn1433441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.465+0100 [mongosMain] connection accepted from 172.28.0.163:56653 #1433442 (315 connections now open) 2015-10-05T09:42:37.466+0100 [conn1433442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.468+0100 [mongosMain] connection accepted from 172.28.0.163:56654 #1433443 (316 connections now open) 2015-10-05T09:42:37.470+0100 [conn1433443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.471+0100 [mongosMain] connection accepted from 172.28.0.163:56656 #1433444 (317 connections now open) 2015-10-05T09:42:37.472+0100 [conn1433444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.504+0100 [mongosMain] connection accepted from 172.28.0.163:56658 #1433445 (318 connections now open) 2015-10-05T09:42:37.525+0100 [conn1433445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.531+0100 [mongosMain] connection accepted from 172.28.0.163:56661 #1433446 (319 connections now open) 2015-10-05T09:42:37.534+0100 [conn1433446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.541+0100 [mongosMain] connection accepted from 172.28.0.163:56662 #1433447 (320 connections now open) 2015-10-05T09:42:37.542+0100 [conn1433447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.543+0100 [mongosMain] connection accepted from 172.28.0.163:56664 #1433448 (321 connections now open) 2015-10-05T09:42:37.545+0100 [conn1433448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.546+0100 [mongosMain] connection accepted from 172.28.0.163:56665 #1433449 (322 connections now open) 2015-10-05T09:42:37.547+0100 [conn1433449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.549+0100 [mongosMain] connection accepted from 172.28.0.163:56667 #1433450 (323 connections now open) 2015-10-05T09:42:37.550+0100 [conn1433450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.553+0100 [mongosMain] connection accepted from 172.28.0.163:56669 #1433451 (324 connections now open) 2015-10-05T09:42:37.555+0100 [conn1433451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.557+0100 [mongosMain] connection accepted from 172.28.0.163:56670 #1433452 (325 connections now open) 2015-10-05T09:42:37.561+0100 [conn1433452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.563+0100 [mongosMain] connection accepted from 172.28.0.163:56672 #1433453 (326 connections now open) 2015-10-05T09:42:37.564+0100 [conn1433453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.565+0100 [mongosMain] connection accepted from 172.28.0.163:56673 #1433454 (327 connections now open) 2015-10-05T09:42:37.566+0100 [conn1433454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.569+0100 [mongosMain] connection accepted from 172.28.0.163:56675 #1433455 (328 connections now open) 2015-10-05T09:42:37.570+0100 [conn1433455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.574+0100 [mongosMain] connection accepted from 172.28.0.163:56677 #1433456 (329 connections now open) 2015-10-05T09:42:37.587+0100 [conn1433456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.589+0100 [mongosMain] connection accepted from 172.28.0.163:56679 #1433457 (330 connections now open) 2015-10-05T09:42:37.592+0100 [conn1433457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.595+0100 [mongosMain] connection accepted from 172.28.0.163:56680 #1433458 (331 connections now open) 2015-10-05T09:42:37.598+0100 [conn1433458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.602+0100 [mongosMain] connection accepted from 172.28.0.163:56682 #1433459 (332 connections now open) 2015-10-05T09:42:37.631+0100 [conn1433459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.633+0100 [mongosMain] connection accepted from 172.28.0.163:56685 #1433460 (333 connections now open) 2015-10-05T09:42:37.657+0100 [conn1433460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.678+0100 [mongosMain] connection accepted from 172.28.0.163:56688 #1433461 (334 connections now open) 2015-10-05T09:42:37.698+0100 [conn1433461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.707+0100 [mongosMain] connection accepted from 172.28.0.163:56691 #1433462 (335 connections now open) 2015-10-05T09:42:37.714+0100 [conn1433462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.727+0100 [mongosMain] connection accepted from 172.28.0.163:56693 #1433463 (336 connections now open) 2015-10-05T09:42:37.730+0100 [conn1433463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.735+0100 [mongosMain] connection accepted from 172.28.0.163:56696 #1433464 (337 connections now open) 2015-10-05T09:42:37.738+0100 [conn1433464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.742+0100 [mongosMain] connection accepted from 172.28.0.163:56697 #1433465 (338 connections now open) 2015-10-05T09:42:37.746+0100 [conn1433465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.747+0100 [mongosMain] connection accepted from 172.28.0.163:56699 #1433466 (339 connections now open) 2015-10-05T09:42:37.749+0100 [conn1433466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.751+0100 [mongosMain] connection accepted from 172.28.0.163:56700 #1433467 (340 connections now open) 2015-10-05T09:42:37.753+0100 [conn1433467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.755+0100 [mongosMain] connection accepted from 172.28.0.163:56702 #1433468 (341 connections now open) 2015-10-05T09:42:37.756+0100 [conn1433468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.757+0100 [mongosMain] connection accepted from 172.28.0.163:56704 #1433469 (342 connections now open) 2015-10-05T09:42:37.759+0100 [conn1433469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.761+0100 [mongosMain] connection accepted from 172.28.0.163:56705 #1433470 (343 connections now open) 2015-10-05T09:42:37.764+0100 [conn1433470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.767+0100 [mongosMain] connection accepted from 172.28.0.163:56707 #1433471 (344 connections now open) 2015-10-05T09:42:37.771+0100 [conn1433471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.773+0100 [mongosMain] connection accepted from 172.28.0.163:56709 #1433472 (345 connections now open) 2015-10-05T09:42:37.774+0100 [conn1433472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.775+0100 [mongosMain] connection accepted from 172.28.0.163:56711 #1433473 (346 connections now open) 2015-10-05T09:42:37.777+0100 [conn1433473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.778+0100 [mongosMain] connection accepted from 172.28.0.163:56712 #1433474 (347 connections now open) 2015-10-05T09:42:37.779+0100 [conn1433474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.780+0100 [mongosMain] connection accepted from 172.28.0.163:56713 #1433475 (348 connections now open) 2015-10-05T09:42:37.782+0100 [conn1433475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.783+0100 [mongosMain] connection accepted from 172.28.0.163:56715 #1433476 (349 connections now open) 2015-10-05T09:42:37.785+0100 [conn1433476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.786+0100 [mongosMain] connection accepted from 172.28.0.163:56716 #1433477 (350 connections now open) 2015-10-05T09:42:37.787+0100 [conn1433477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.789+0100 [mongosMain] connection accepted from 172.28.0.163:56718 #1433478 (351 connections now open) 2015-10-05T09:42:37.790+0100 [conn1433478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:37.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561237fd5703b51053ef5600 2015-10-05T09:42:37.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:39.673+0100 [mongosMain] connection accepted from 127.0.0.1:56731 #1433479 (352 connections now open) 2015-10-05T09:42:39.676+0100 [conn1433479] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:39.680+0100 [conn1433479] end connection 127.0.0.1:56731 (351 connections now open) 2015-10-05T09:42:42.429+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:42:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:42:43.200+0100 [conn1433132] end connection 172.28.0.163:55625 (350 connections now open) 2015-10-05T09:42:43.200+0100 [conn1432979] end connection 172.28.0.163:55148 (350 connections now open) 2015-10-05T09:42:43.200+0100 [mongosMain] connection accepted from 172.28.0.163:56737 #1433480 (350 connections now open) 2015-10-05T09:42:43.201+0100 [mongosMain] connection accepted from 172.28.0.163:56738 #1433481 (351 connections now open) 2015-10-05T09:42:43.201+0100 [conn1433480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:43.201+0100 [conn1433481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:43.667+0100 [conn1433113] end connection 172.28.0.164:64750 (350 connections now open) 2015-10-05T09:42:43.667+0100 [conn1433006] end connection 172.28.0.164:64395 (349 connections now open) 2015-10-05T09:42:43.668+0100 [mongosMain] connection accepted from 172.28.0.164:49566 #1433482 (350 connections now open) 2015-10-05T09:42:43.668+0100 [mongosMain] connection accepted from 172.28.0.164:49567 #1433483 (351 connections now open) 2015-10-05T09:42:43.669+0100 [conn1433482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:43.669+0100 [conn1433483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:44.916+0100 [conn1433071] end connection 172.28.0.164:64573 (350 connections now open) 2015-10-05T09:42:44.917+0100 [mongosMain] connection accepted from 172.28.0.164:49569 #1433484 (351 connections now open) 2015-10-05T09:42:44.919+0100 [conn1433484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:45.446+0100 [conn1433163] end connection 172.28.0.164:64923 (350 connections now open) 2015-10-05T09:42:45.447+0100 [mongosMain] connection accepted from 172.28.0.164:49571 #1433485 (351 connections now open) 2015-10-05T09:42:45.448+0100 [conn1433485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:50.555+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612380a5703b51053ef5735 2015-10-05T09:42:50.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:42:53.216+0100 [conn1433002] end connection 172.28.0.163:55207 (350 connections now open) 2015-10-05T09:42:53.216+0100 [conn1433112] end connection 172.28.0.163:55548 (350 connections now open) 2015-10-05T09:42:53.217+0100 [mongosMain] connection accepted from 172.28.0.163:56754 #1433486 (350 connections now open) 2015-10-05T09:42:53.217+0100 [mongosMain] connection accepted from 172.28.0.163:56755 #1433487 (351 connections now open) 2015-10-05T09:42:53.218+0100 [conn1433486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:53.218+0100 [conn1433487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:53.683+0100 [conn1432957] end connection 172.28.0.164:64260 (350 connections now open) 2015-10-05T09:42:53.683+0100 [conn1432973] end connection 172.28.0.164:64316 (350 connections now open) 2015-10-05T09:42:53.684+0100 [mongosMain] connection accepted from 172.28.0.164:49584 #1433488 (350 connections now open) 2015-10-05T09:42:53.684+0100 [mongosMain] connection accepted from 172.28.0.164:49585 #1433489 (351 connections now open) 2015-10-05T09:42:53.686+0100 [conn1433488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:53.686+0100 [conn1433489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:42:58.282+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:42:58.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:43:03.218+0100 [conn1432644] end connection 172.28.0.163:54124 (350 connections now open) 2015-10-05T09:43:03.218+0100 [conn1433138] end connection 172.28.0.163:55640 (350 connections now open) 2015-10-05T09:43:03.219+0100 [mongosMain] connection accepted from 172.28.0.163:56775 #1433490 (350 connections now open) 2015-10-05T09:43:03.219+0100 [mongosMain] connection accepted from 172.28.0.163:56776 #1433491 (351 connections now open) 2015-10-05T09:43:03.220+0100 [conn1433490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:03.220+0100 [conn1433491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:03.699+0100 [conn1432995] end connection 172.28.0.164:64372 (350 connections now open) 2015-10-05T09:43:03.699+0100 [conn1433129] end connection 172.28.0.164:64813 (349 connections now open) 2015-10-05T09:43:03.700+0100 [mongosMain] connection accepted from 172.28.0.164:49605 #1433492 (350 connections now open) 2015-10-05T09:43:03.700+0100 [mongosMain] connection accepted from 172.28.0.164:49606 #1433493 (351 connections now open) 2015-10-05T09:43:03.701+0100 [conn1433492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:03.701+0100 [conn1433493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:04.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238185703b51053ef584b 2015-10-05T09:43:04.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:04.931+0100 [conn1433168] end connection 172.28.0.164:64938 (350 connections now open) 2015-10-05T09:43:04.932+0100 [mongosMain] connection accepted from 172.28.0.164:49608 #1433494 (351 connections now open) 2015-10-05T09:43:04.933+0100 [conn1433494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:11.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612381e5703b51053ef58e7 2015-10-05T09:43:11.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:12.599+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:43:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:43:13.243+0100 [conn1433122] end connection 172.28.0.163:55606 (350 connections now open) 2015-10-05T09:43:13.244+0100 [conn1433031] end connection 172.28.0.163:55273 (349 connections now open) 2015-10-05T09:43:13.248+0100 [mongosMain] connection accepted from 172.28.0.163:56793 #1433495 (350 connections now open) 2015-10-05T09:43:13.248+0100 [mongosMain] connection accepted from 172.28.0.163:56794 #1433496 (351 connections now open) 2015-10-05T09:43:13.249+0100 [conn1433495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:13.249+0100 [conn1433496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:13.715+0100 [conn1433117] end connection 172.28.0.164:64759 (350 connections now open) 2015-10-05T09:43:13.716+0100 [conn1433003] end connection 172.28.0.164:64394 (349 connections now open) 2015-10-05T09:43:13.717+0100 [mongosMain] connection accepted from 172.28.0.164:49616 #1433497 (350 connections now open) 2015-10-05T09:43:13.717+0100 [mongosMain] connection accepted from 172.28.0.164:49617 #1433498 (351 connections now open) 2015-10-05T09:43:13.719+0100 [conn1433497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:13.719+0100 [conn1433498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:14.946+0100 [conn1433045] end connection 172.28.0.164:64498 (350 connections now open) 2015-10-05T09:43:14.948+0100 [mongosMain] connection accepted from 172.28.0.164:49619 #1433499 (351 connections now open) 2015-10-05T09:43:14.951+0100 [conn1433499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:15.495+0100 [conn1433169] end connection 172.28.0.164:64940 (350 connections now open) 2015-10-05T09:43:15.498+0100 [mongosMain] connection accepted from 172.28.0.164:49621 #1433500 (351 connections now open) 2015-10-05T09:43:15.499+0100 [conn1433500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:17.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238255703b51053ef594d 2015-10-05T09:43:17.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:23.234+0100 [conn1432649] end connection 172.28.0.163:54131 (350 connections now open) 2015-10-05T09:43:23.235+0100 [conn1433143] end connection 172.28.0.163:55657 (350 connections now open) 2015-10-05T09:43:23.236+0100 [mongosMain] connection accepted from 172.28.0.163:56801 #1433501 (350 connections now open) 2015-10-05T09:43:23.236+0100 [mongosMain] connection accepted from 172.28.0.163:56802 #1433502 (351 connections now open) 2015-10-05T09:43:23.237+0100 [conn1433501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:23.237+0100 [conn1433502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:23.731+0100 [conn1433026] end connection 172.28.0.164:64441 (350 connections now open) 2015-10-05T09:43:23.731+0100 [conn1433107] end connection 172.28.0.164:64735 (350 connections now open) 2015-10-05T09:43:23.732+0100 [mongosMain] connection accepted from 172.28.0.164:49637 #1433503 (350 connections now open) 2015-10-05T09:43:23.732+0100 [mongosMain] connection accepted from 172.28.0.164:49638 #1433504 (351 connections now open) 2015-10-05T09:43:23.734+0100 [conn1433503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:23.734+0100 [conn1433504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:23.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612382b5703b51053ef59b5 2015-10-05T09:43:23.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:25.494+0100 [conn1433183] end connection 172.28.0.164:64982 (350 connections now open) 2015-10-05T09:43:25.496+0100 [mongosMain] connection accepted from 172.28.0.164:49642 #1433505 (351 connections now open) 2015-10-05T09:43:25.498+0100 [conn1433505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:28.225+0100 [mongosMain] connection accepted from 127.0.0.1:56804 #1433506 (352 connections now open) 2015-10-05T09:43:28.228+0100 [conn1433506] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:28.234+0100 [conn1433506] end connection 127.0.0.1:56804 (351 connections now open) 2015-10-05T09:43:30.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238315703b51053ef5a0d 2015-10-05T09:43:30.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:33.248+0100 [conn1432967] end connection 172.28.0.163:55124 (350 connections now open) 2015-10-05T09:43:33.249+0100 [conn1433127] end connection 172.28.0.163:55614 (350 connections now open) 2015-10-05T09:43:33.250+0100 [mongosMain] connection accepted from 172.28.0.163:56806 #1433507 (350 connections now open) 2015-10-05T09:43:33.250+0100 [mongosMain] connection accepted from 172.28.0.163:56807 #1433508 (351 connections now open) 2015-10-05T09:43:33.251+0100 [conn1433507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:33.251+0100 [conn1433508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:33.731+0100 [conn1433037] end connection 172.28.0.164:64477 (350 connections now open) 2015-10-05T09:43:33.731+0100 [conn1433142] end connection 172.28.0.164:64863 (350 connections now open) 2015-10-05T09:43:33.732+0100 [mongosMain] connection accepted from 172.28.0.164:49654 #1433509 (350 connections now open) 2015-10-05T09:43:33.733+0100 [mongosMain] connection accepted from 172.28.0.164:49653 #1433510 (351 connections now open) 2015-10-05T09:43:33.735+0100 [conn1433509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:33.735+0100 [conn1433510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:34.964+0100 [conn1433162] end connection 172.28.0.164:64920 (350 connections now open) 2015-10-05T09:43:34.965+0100 [mongosMain] connection accepted from 172.28.0.164:49658 #1433511 (351 connections now open) 2015-10-05T09:43:34.966+0100 [conn1433511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:37.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238385703b51053ef5a71 2015-10-05T09:43:37.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:40.135+0100 [mongosMain] connection accepted from 127.0.0.1:56813 #1433512 (352 connections now open) 2015-10-05T09:43:40.138+0100 [conn1433512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:40.142+0100 [conn1433512] end connection 127.0.0.1:56813 (351 connections now open) 2015-10-05T09:43:43.235+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:43:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:43:43.335+0100 [conn1433097] end connection 172.28.0.163:55512 (350 connections now open) 2015-10-05T09:43:43.337+0100 [conn1432637] end connection 172.28.0.163:54117 (349 connections now open) 2015-10-05T09:43:43.353+0100 [mongosMain] connection accepted from 172.28.0.163:56818 #1433513 (350 connections now open) 2015-10-05T09:43:43.353+0100 [mongosMain] connection accepted from 172.28.0.163:56819 #1433514 (351 connections now open) 2015-10-05T09:43:43.355+0100 [conn1433514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:43.360+0100 [conn1433513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:43.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612383f5703b51053ef5aac 2015-10-05T09:43:43.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:43:43.746+0100 [conn1433133] end connection 172.28.0.164:64834 (350 connections now open) 2015-10-05T09:43:43.747+0100 [mongosMain] connection accepted from 172.28.0.164:49678 #1433515 (351 connections now open) 2015-10-05T09:43:43.748+0100 [conn1433515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:44.978+0100 [conn1433146] end connection 172.28.0.164:64877 (350 connections now open) 2015-10-05T09:43:44.979+0100 [mongosMain] connection accepted from 172.28.0.164:49685 #1433516 (351 connections now open) 2015-10-05T09:43:44.981+0100 [conn1433516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:45.509+0100 [conn1433196] end connection 172.28.0.164:65012 (350 connections now open) 2015-10-05T09:43:45.510+0100 [mongosMain] connection accepted from 172.28.0.164:49687 #1433517 (351 connections now open) 2015-10-05T09:43:45.511+0100 [conn1433517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:53.297+0100 [conn1433041] end connection 172.28.0.163:55315 (350 connections now open) 2015-10-05T09:43:53.298+0100 [mongosMain] connection accepted from 172.28.0.163:56833 #1433518 (351 connections now open) 2015-10-05T09:43:53.299+0100 [conn1433518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:53.762+0100 [conn1433165] end connection 172.28.0.164:64931 (350 connections now open) 2015-10-05T09:43:53.763+0100 [mongosMain] connection accepted from 172.28.0.164:49698 #1433519 (351 connections now open) 2015-10-05T09:43:53.765+0100 [conn1433519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:55.524+0100 [conn1433189] end connection 172.28.0.164:64998 (350 connections now open) 2015-10-05T09:43:55.525+0100 [mongosMain] connection accepted from 172.28.0.164:49701 #1433520 (351 connections now open) 2015-10-05T09:43:55.526+0100 [conn1433520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:43:55.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612384b5703b51053ef5b65 2015-10-05T09:43:56.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:03.299+0100 [conn1432654] end connection 172.28.0.163:54136 (350 connections now open) 2015-10-05T09:44:03.300+0100 [mongosMain] connection accepted from 172.28.0.163:56856 #1433521 (351 connections now open) 2015-10-05T09:44:03.301+0100 [conn1433521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:03.778+0100 [conn1433179] end connection 172.28.0.164:64978 (350 connections now open) 2015-10-05T09:44:03.779+0100 [mongosMain] connection accepted from 172.28.0.164:49721 #1433522 (351 connections now open) 2015-10-05T09:44:03.781+0100 [conn1433522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:05.010+0100 [conn1433178] end connection 172.28.0.164:64974 (350 connections now open) 2015-10-05T09:44:05.011+0100 [mongosMain] connection accepted from 172.28.0.164:49725 #1433523 (351 connections now open) 2015-10-05T09:44:05.012+0100 [conn1433523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:05.540+0100 [conn1433212] end connection 172.28.0.164:65049 (350 connections now open) 2015-10-05T09:44:05.541+0100 [mongosMain] connection accepted from 172.28.0.164:49727 #1433524 (351 connections now open) 2015-10-05T09:44:05.542+0100 [conn1433524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:08.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238585703b51053ef5c12 2015-10-05T09:44:08.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:13.336+0100 [conn1433010] end connection 172.28.0.163:55226 (350 connections now open) 2015-10-05T09:44:13.339+0100 [mongosMain] connection accepted from 172.28.0.163:56870 #1433525 (351 connections now open) 2015-10-05T09:44:13.341+0100 [conn1433525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:13.368+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:44:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:44:13.793+0100 [conn1433171] end connection 172.28.0.164:64947 (350 connections now open) 2015-10-05T09:44:13.794+0100 [mongosMain] connection accepted from 172.28.0.164:49731 #1433526 (351 connections now open) 2015-10-05T09:44:13.796+0100 [conn1433526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:14.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612385e5703b51053ef5c39 2015-10-05T09:44:15.025+0100 [conn1433173] end connection 172.28.0.164:64952 (350 connections now open) 2015-10-05T09:44:15.026+0100 [mongosMain] connection accepted from 172.28.0.164:49733 #1433527 (351 connections now open) 2015-10-05T09:44:15.028+0100 [conn1433527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:15.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:15.558+0100 [conn1433205] end connection 172.28.0.164:65033 (350 connections now open) 2015-10-05T09:44:15.558+0100 [mongosMain] connection accepted from 172.28.0.164:49737 #1433528 (351 connections now open) 2015-10-05T09:44:15.560+0100 [conn1433528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:21.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238655703b51053ef5c78 2015-10-05T09:44:21.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:23.342+0100 [conn1432602] end connection 172.28.0.163:54042 (350 connections now open) 2015-10-05T09:44:23.344+0100 [mongosMain] connection accepted from 172.28.0.163:56880 #1433529 (351 connections now open) 2015-10-05T09:44:23.346+0100 [conn1433529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:23.809+0100 [conn1433154] end connection 172.28.0.164:64890 (350 connections now open) 2015-10-05T09:44:23.809+0100 [conn1432573] end connection 172.28.0.164:63162 (349 connections now open) 2015-10-05T09:44:23.810+0100 [mongosMain] connection accepted from 172.28.0.164:49751 #1433530 (350 connections now open) 2015-10-05T09:44:23.811+0100 [mongosMain] connection accepted from 172.28.0.164:49750 #1433531 (351 connections now open) 2015-10-05T09:44:23.812+0100 [conn1433530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:23.813+0100 [conn1433531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:25.571+0100 [conn1433222] end connection 172.28.0.164:65082 (350 connections now open) 2015-10-05T09:44:25.573+0100 [mongosMain] connection accepted from 172.28.0.164:49760 #1433532 (351 connections now open) 2015-10-05T09:44:25.574+0100 [conn1433532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:28.902+0100 [mongosMain] connection accepted from 127.0.0.1:56886 #1433533 (352 connections now open) 2015-10-05T09:44:28.905+0100 [conn1433533] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:28.909+0100 [conn1433533] end connection 127.0.0.1:56886 (351 connections now open) 2015-10-05T09:44:33.345+0100 [conn1432626] end connection 172.28.0.163:54086 (350 connections now open) 2015-10-05T09:44:33.346+0100 [mongosMain] connection accepted from 172.28.0.163:56887 #1433534 (351 connections now open) 2015-10-05T09:44:33.347+0100 [conn1433534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:33.825+0100 [conn1433049] end connection 172.28.0.164:64502 (350 connections now open) 2015-10-05T09:44:33.826+0100 [mongosMain] connection accepted from 172.28.0.164:49775 #1433535 (351 connections now open) 2015-10-05T09:44:33.828+0100 [conn1433535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:34.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238715703b51053ef5ced 2015-10-05T09:44:34.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:35.588+0100 [conn1433218] end connection 172.28.0.164:65073 (350 connections now open) 2015-10-05T09:44:35.588+0100 [mongosMain] connection accepted from 172.28.0.164:49781 #1433536 (351 connections now open) 2015-10-05T09:44:35.592+0100 [conn1433536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:39.941+0100 [mongosMain] connection accepted from 127.0.0.1:56894 #1433537 (352 connections now open) 2015-10-05T09:44:39.944+0100 [conn1433537] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:39.948+0100 [conn1433537] end connection 127.0.0.1:56894 (351 connections now open) 2015-10-05T09:44:43.356+0100 [conn1433017] end connection 172.28.0.163:55240 (350 connections now open) 2015-10-05T09:44:43.357+0100 [mongosMain] connection accepted from 172.28.0.163:56899 #1433538 (351 connections now open) 2015-10-05T09:44:43.358+0100 [conn1433538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:43.826+0100 [conn1432588] end connection 172.28.0.164:63203 (350 connections now open) 2015-10-05T09:44:43.826+0100 [conn1433160] end connection 172.28.0.164:64909 (350 connections now open) 2015-10-05T09:44:43.826+0100 [mongosMain] connection accepted from 172.28.0.164:49797 #1433539 (350 connections now open) 2015-10-05T09:44:43.827+0100 [mongosMain] connection accepted from 172.28.0.164:49798 #1433540 (351 connections now open) 2015-10-05T09:44:43.827+0100 [conn1433539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:43.828+0100 [conn1433540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:44.112+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:44:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:44:45.587+0100 [conn1433227] end connection 172.28.0.164:65103 (350 connections now open) 2015-10-05T09:44:45.588+0100 [mongosMain] connection accepted from 172.28.0.164:49801 #1433541 (351 connections now open) 2015-10-05T09:44:45.589+0100 [conn1433541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:46.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612387e5703b51053ef5d4f 2015-10-05T09:44:46.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:44:53.373+0100 [conn1432972] end connection 172.28.0.163:55138 (350 connections now open) 2015-10-05T09:44:53.374+0100 [mongosMain] connection accepted from 172.28.0.163:56915 #1433542 (351 connections now open) 2015-10-05T09:44:53.375+0100 [conn1433542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:53.841+0100 [conn1433174] end connection 172.28.0.164:64956 (350 connections now open) 2015-10-05T09:44:53.842+0100 [mongosMain] connection accepted from 172.28.0.164:49814 #1433543 (351 connections now open) 2015-10-05T09:44:53.843+0100 [conn1433543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:54.213+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:44:54.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:44:55.073+0100 [conn1433221] end connection 172.28.0.164:65080 (350 connections now open) 2015-10-05T09:44:55.075+0100 [mongosMain] connection accepted from 172.28.0.164:49817 #1433544 (351 connections now open) 2015-10-05T09:44:55.076+0100 [conn1433544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:44:55.604+0100 [conn1433233] end connection 172.28.0.164:65121 (350 connections now open) 2015-10-05T09:44:55.605+0100 [mongosMain] connection accepted from 172.28.0.164:49818 #1433545 (351 connections now open) 2015-10-05T09:44:55.611+0100 [conn1433545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:00.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612388c5703b51053ef5dec 2015-10-05T09:45:00.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:03.374+0100 [conn1432994] end connection 172.28.0.163:55183 (350 connections now open) 2015-10-05T09:45:03.375+0100 [mongosMain] connection accepted from 172.28.0.163:56938 #1433546 (351 connections now open) 2015-10-05T09:45:03.376+0100 [conn1433546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:03.841+0100 [conn1433191] end connection 172.28.0.164:65004 (350 connections now open) 2015-10-05T09:45:03.842+0100 [mongosMain] connection accepted from 172.28.0.164:49832 #1433547 (351 connections now open) 2015-10-05T09:45:03.844+0100 [conn1433547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:05.088+0100 [conn1433238] end connection 172.28.0.164:65138 (350 connections now open) 2015-10-05T09:45:05.090+0100 [mongosMain] connection accepted from 172.28.0.164:49834 #1433548 (351 connections now open) 2015-10-05T09:45:05.091+0100 [conn1433548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:05.619+0100 [conn1433239] end connection 172.28.0.164:65141 (350 connections now open) 2015-10-05T09:45:05.620+0100 [mongosMain] connection accepted from 172.28.0.164:49836 #1433549 (351 connections now open) 2015-10-05T09:45:05.622+0100 [conn1433549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:12.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238985703b51053ef5ebe 2015-10-05T09:45:12.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:13.389+0100 [conn1432641] end connection 172.28.0.163:54121 (350 connections now open) 2015-10-05T09:45:13.391+0100 [mongosMain] connection accepted from 172.28.0.163:56950 #1433550 (351 connections now open) 2015-10-05T09:45:13.392+0100 [conn1433550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:13.857+0100 [conn1433198] end connection 172.28.0.164:65023 (350 connections now open) 2015-10-05T09:45:13.858+0100 [mongosMain] connection accepted from 172.28.0.164:49845 #1433551 (351 connections now open) 2015-10-05T09:45:13.859+0100 [conn1433551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:14.272+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:45:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:45:15.104+0100 [conn1433226] end connection 172.28.0.164:65102 (350 connections now open) 2015-10-05T09:45:15.105+0100 [mongosMain] connection accepted from 172.28.0.164:49847 #1433552 (351 connections now open) 2015-10-05T09:45:15.106+0100 [conn1433552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:15.635+0100 [conn1433244] end connection 172.28.0.164:65160 (350 connections now open) 2015-10-05T09:45:15.636+0100 [mongosMain] connection accepted from 172.28.0.164:49850 #1433553 (351 connections now open) 2015-10-05T09:45:15.638+0100 [conn1433553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:19.015+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:45:19.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:45:19.149+0100 [conn1433548] end connection 172.28.0.164:49834 (350 connections now open) 2015-10-05T09:45:19.149+0100 [conn1433407] end connection 172.28.0.164:49464 (349 connections now open) 2015-10-05T09:45:19.149+0100 [conn1433340] end connection 172.28.0.164:65487 (349 connections now open) 2015-10-05T09:45:19.149+0100 [conn1433264] end connection 172.28.0.164:65219 (348 connections now open) 2015-10-05T09:45:19.149+0100 [conn1433324] end connection 172.28.0.164:65421 (348 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433517] end connection 172.28.0.164:49687 (345 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433268] end connection 172.28.0.164:65237 (344 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433413] end connection 172.28.0.164:49505 (344 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433346] end connection 172.28.0.164:65506 (342 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433248] end connection 172.28.0.164:65177 (342 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433345] end connection 172.28.0.164:65503 (342 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433259] end connection 172.28.0.164:65205 (341 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433254] end connection 172.28.0.164:65187 (341 connections now open) 2015-10-05T09:45:19.150+0100 [conn1433313] end connection 172.28.0.164:65388 (339 connections now open) 2015-10-05T09:45:19.151+0100 [conn1433387] end connection 172.28.0.164:49380 (336 connections now open) 2015-10-05T09:45:19.151+0100 [conn1433352] end connection 172.28.0.164:65524 (336 connections now open) 2015-10-05T09:45:19.151+0100 [conn1433516] end connection 172.28.0.164:49685 (335 connections now open) 2015-10-05T09:45:19.151+0100 [conn1433274] end connection 172.28.0.164:65276 (334 connections now open) 2015-10-05T09:45:19.152+0100 [conn1433267] end connection 172.28.0.164:65234 (332 connections now open) 2015-10-05T09:45:19.157+0100 [conn1433523] end connection 172.28.0.164:49725 (331 connections now open) 2015-10-05T09:45:19.157+0100 [conn1433410] end connection 172.28.0.164:49482 (330 connections now open) 2015-10-05T09:45:19.157+0100 [conn1433275] end connection 172.28.0.164:65279 (330 connections now open) 2015-10-05T09:45:19.157+0100 [conn1433335] end connection 172.28.0.164:65464 (329 connections now open) 2015-10-05T09:45:19.157+0100 [conn1433156] end connection 172.28.0.164:64900 (328 connections now open) 2015-10-05T09:45:19.158+0100 [conn1433301] end connection 172.28.0.164:65359 (327 connections now open) 2015-10-05T09:45:19.158+0100 [conn1433536] end connection 172.28.0.164:49781 (326 connections now open) 2015-10-05T09:45:19.158+0100 [conn1433182] end connection 172.28.0.164:64981 (324 connections now open) 2015-10-05T09:45:19.158+0100 [conn1433528] end connection 172.28.0.164:49737 (323 connections now open) 2015-10-05T09:45:19.158+0100 [conn1433545] end connection 172.28.0.164:49818 (323 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433243] end connection 172.28.0.164:65157 (323 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433317] end connection 172.28.0.164:65401 (321 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433549] end connection 172.28.0.164:49836 (321 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433532] end connection 172.28.0.164:49760 (318 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433358] end connection 172.28.0.164:49165 (318 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433399] end connection 172.28.0.164:49433 (318 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433379] end connection 172.28.0.164:49349 (318 connections now open) 2015-10-05T09:45:19.159+0100 [conn1433426] end connection 172.28.0.164:49547 (317 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433318] end connection 172.28.0.164:65404 (313 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433494] end connection 172.28.0.164:49608 (312 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433544] end connection 172.28.0.164:49817 (312 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433283] end connection 172.28.0.164:65305 (312 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433217] end connection 172.28.0.164:65068 (312 connections now open) 2015-10-05T09:45:19.160+0100 [conn1433338] end connection 172.28.0.164:65481 (312 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433411] end connection 172.28.0.164:49485 (308 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433204] end connection 172.28.0.164:65030 (308 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433249] end connection 172.28.0.164:65179 (306 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433334] end connection 172.28.0.164:65461 (304 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433312] end connection 172.28.0.164:65386 (304 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433278] end connection 172.28.0.164:65287 (304 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433420] end connection 172.28.0.164:49529 (304 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433552] end connection 172.28.0.164:49847 (303 connections now open) 2015-10-05T09:45:19.161+0100 [conn1433398] end connection 172.28.0.164:49431 (301 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433270] end connection 172.28.0.164:65243 (298 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433499] end connection 172.28.0.164:49619 (297 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433364] end connection 172.28.0.164:49221 (297 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433403] end connection 172.28.0.164:49447 (297 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433366] end connection 172.28.0.164:49242 (295 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433211] end connection 172.28.0.164:65046 (295 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433416] end connection 172.28.0.164:49511 (295 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433306] end connection 172.28.0.164:65378 (294 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433383] end connection 172.28.0.164:49365 (292 connections now open) 2015-10-05T09:45:19.162+0100 [conn1433296] end connection 172.28.0.164:65344 (292 connections now open) 2015-10-05T09:45:19.163+0100 [conn1433404] end connection 172.28.0.164:49450 (288 connections now open) 2015-10-05T09:45:19.163+0100 [conn1433500] end connection 172.28.0.164:49621 (287 connections now open) 2015-10-05T09:45:19.171+0100 [conn1433302] end connection 172.28.0.164:65361 (286 connections now open) 2015-10-05T09:45:19.171+0100 [conn1433341] end connection 172.28.0.164:65488 (286 connections now open) 2015-10-05T09:45:19.172+0100 [conn1433427] end connection 172.28.0.164:49549 (286 connections now open) 2015-10-05T09:45:20.812+0100 [conn1433527] end connection 172.28.0.164:49733 (283 connections now open) 2015-10-05T09:45:20.812+0100 [conn1433520] end connection 172.28.0.164:49701 (282 connections now open) 2015-10-05T09:45:20.812+0100 [conn1433263] end connection 172.28.0.164:65217 (281 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433421] end connection 172.28.0.164:49531 (280 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433289] end connection 172.28.0.164:65325 (280 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433330] end connection 172.28.0.164:65442 (280 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433484] end connection 172.28.0.164:49569 (279 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433408] end connection 172.28.0.164:49466 (279 connections now open) 2015-10-05T09:45:20.813+0100 [conn1433361] end connection 172.28.0.164:49204 (278 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433297] end connection 172.28.0.164:65346 (274 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433392] end connection 172.28.0.164:49408 (273 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433325] end connection 172.28.0.164:65426 (273 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433195] end connection 172.28.0.164:65009 (272 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433375] end connection 172.28.0.164:49323 (271 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433232] end connection 172.28.0.164:65118 (273 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433277] end connection 172.28.0.164:65284 (273 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433524] end connection 172.28.0.164:49727 (272 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433357] end connection 172.28.0.164:49163 (274 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433511] end connection 172.28.0.164:49658 (273 connections now open) 2015-10-05T09:45:20.814+0100 [conn1433258] end connection 172.28.0.164:65202 (270 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433271] end connection 172.28.0.164:65246 (268 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433353] end connection 172.28.0.164:65526 (268 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433485] end connection 172.28.0.164:49571 (268 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433331] end connection 172.28.0.164:65446 (268 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433188] end connection 172.28.0.164:64995 (260 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433305] end connection 172.28.0.164:65376 (259 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433395] end connection 172.28.0.164:49417 (263 connections now open) 2015-10-05T09:45:20.816+0100 [conn1433541] end connection 172.28.0.164:49801 (257 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433288] end connection 172.28.0.164:65323 (259 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433415] end connection 172.28.0.164:49510 (264 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433253] end connection 172.28.0.164:65185 (259 connections now open) 2015-10-05T09:45:20.815+0100 [conn1433505] end connection 172.28.0.164:49642 (267 connections now open) 2015-10-05T09:45:20.817+0100 [conn1433553] end connection 172.28.0.164:49850 (251 connections now open) 2015-10-05T09:45:23.392+0100 [conn1432650] end connection 172.28.0.163:54132 (250 connections now open) 2015-10-05T09:45:23.393+0100 [mongosMain] connection accepted from 172.28.0.163:56964 #1433554 (251 connections now open) 2015-10-05T09:45:23.394+0100 [conn1433554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:23.856+0100 [conn1433229] end connection 172.28.0.164:65110 (250 connections now open) 2015-10-05T09:45:23.857+0100 [mongosMain] connection accepted from 172.28.0.164:49862 #1433555 (251 connections now open) 2015-10-05T09:45:23.859+0100 [conn1433555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:25.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238a55703b51053ef5f40 2015-10-05T09:45:25.580+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:28.210+0100 [mongosMain] connection accepted from 127.0.0.1:56967 #1433556 (252 connections now open) 2015-10-05T09:45:28.212+0100 [conn1433556] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:28.217+0100 [conn1433556] end connection 127.0.0.1:56967 (251 connections now open) 2015-10-05T09:45:33.405+0100 [conn1432653] end connection 172.28.0.163:54135 (250 connections now open) 2015-10-05T09:45:33.407+0100 [mongosMain] connection accepted from 172.28.0.163:56970 #1433557 (251 connections now open) 2015-10-05T09:45:33.408+0100 [conn1433557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:34.226+0100 [conn1432621] end connection 172.28.0.164:63305 (250 connections now open) 2015-10-05T09:45:34.229+0100 [mongosMain] connection accepted from 172.28.0.164:49875 #1433558 (251 connections now open) 2015-10-05T09:45:34.230+0100 [conn1433558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:38.337+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238b25703b51053ef5fd9 2015-10-05T09:45:38.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:39.681+0100 [mongosMain] connection accepted from 127.0.0.1:56975 #1433559 (252 connections now open) 2015-10-05T09:45:39.683+0100 [conn1433559] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:39.688+0100 [conn1433559] end connection 127.0.0.1:56975 (251 connections now open) 2015-10-05T09:45:43.411+0100 [conn1433159] end connection 172.28.0.163:55711 (250 connections now open) 2015-10-05T09:45:43.411+0100 [conn1432643] end connection 172.28.0.163:54123 (249 connections now open) 2015-10-05T09:45:43.412+0100 [mongosMain] connection accepted from 172.28.0.163:56980 #1433560 (250 connections now open) 2015-10-05T09:45:43.412+0100 [mongosMain] connection accepted from 172.28.0.163:56981 #1433561 (251 connections now open) 2015-10-05T09:45:43.413+0100 [conn1433560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:43.413+0100 [conn1433561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:44.459+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:45:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:45:44.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238b85703b51053ef6027 2015-10-05T09:45:44.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:52.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238be5703b51053ef6073 2015-10-05T09:45:52.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:45:53.421+0100 [conn1433164] end connection 172.28.0.163:55719 (250 connections now open) 2015-10-05T09:45:53.421+0100 [conn1433208] end connection 172.28.0.163:55836 (250 connections now open) 2015-10-05T09:45:53.422+0100 [mongosMain] connection accepted from 172.28.0.163:56992 #1433562 (250 connections now open) 2015-10-05T09:45:53.422+0100 [mongosMain] connection accepted from 172.28.0.163:56993 #1433563 (251 connections now open) 2015-10-05T09:45:53.422+0100 [conn1433562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:45:53.423+0100 [conn1433563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:03.430+0100 [conn1433153] end connection 172.28.0.163:55700 (250 connections now open) 2015-10-05T09:46:03.431+0100 [conn1432546] end connection 172.28.0.163:53872 (249 connections now open) 2015-10-05T09:46:03.437+0100 [mongosMain] connection accepted from 172.28.0.163:57014 #1433564 (250 connections now open) 2015-10-05T09:46:03.437+0100 [mongosMain] connection accepted from 172.28.0.163:57015 #1433565 (251 connections now open) 2015-10-05T09:46:03.438+0100 [conn1433565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:03.438+0100 [conn1433564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:05.001+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:46:05.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:46:11.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238d35703b51053ef61b1 2015-10-05T09:46:11.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:46:13.436+0100 [conn1433199] end connection 172.28.0.163:55814 (250 connections now open) 2015-10-05T09:46:13.436+0100 [conn1433025] end connection 172.28.0.163:55250 (250 connections now open) 2015-10-05T09:46:13.437+0100 [mongosMain] connection accepted from 172.28.0.163:57028 #1433566 (250 connections now open) 2015-10-05T09:46:13.438+0100 [mongosMain] connection accepted from 172.28.0.163:57029 #1433567 (251 connections now open) 2015-10-05T09:46:13.439+0100 [conn1433566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:13.439+0100 [conn1433567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:15.310+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:46:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:46:23.369+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561238ddd5de43e0ed5d39b3') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444034783230), why: "doing balance round", ts: ObjectId('561238df5703b51053ef624e') } } gle1: { lastOp: Timestamp 1444034783000|3, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1444034771000|8, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2015-10-05T09:46:23.373+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:46:23.541+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238df5703b51053ef624e 2015-10-05T09:46:23.620+0100 [conn1433175] end connection 172.28.0.163:55756 (250 connections now open) 2015-10-05T09:46:23.622+0100 [conn1432987] end connection 172.28.0.163:55164 (249 connections now open) 2015-10-05T09:46:23.627+0100 [mongosMain] connection accepted from 172.28.0.163:57046 #1433568 (250 connections now open) 2015-10-05T09:46:23.628+0100 [mongosMain] connection accepted from 172.28.0.163:57047 #1433569 (251 connections now open) 2015-10-05T09:46:23.629+0100 [conn1433568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:23.629+0100 [conn1433569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:23.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:46:28.383+0100 [mongosMain] connection accepted from 127.0.0.1:57051 #1433570 (252 connections now open) 2015-10-05T09:46:28.386+0100 [conn1433570] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:28.393+0100 [conn1433570] end connection 127.0.0.1:57051 (251 connections now open) 2015-10-05T09:46:29.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238e55703b51053ef62b6 2015-10-05T09:46:29.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:46:33.613+0100 [conn1433116] end connection 172.28.0.163:55565 (250 connections now open) 2015-10-05T09:46:33.613+0100 [conn1432619] end connection 172.28.0.163:54070 (250 connections now open) 2015-10-05T09:46:33.615+0100 [mongosMain] connection accepted from 172.28.0.163:57052 #1433571 (250 connections now open) 2015-10-05T09:46:33.615+0100 [mongosMain] connection accepted from 172.28.0.163:57053 #1433572 (251 connections now open) 2015-10-05T09:46:33.616+0100 [conn1433571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:33.616+0100 [conn1433572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:34.263+0100 [conn1432681] end connection 172.28.0.164:63402 (250 connections now open) 2015-10-05T09:46:34.264+0100 [mongosMain] connection accepted from 172.28.0.164:49941 #1433573 (251 connections now open) 2015-10-05T09:46:34.266+0100 [conn1433573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:36.023+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:46:36.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:46:36.912+0100 [conn1432685] end connection 172.28.0.164:63408 (250 connections now open) 2015-10-05T09:46:36.912+0100 [mongosMain] connection accepted from 172.28.0.164:49947 #1433574 (251 connections now open) 2015-10-05T09:46:36.912+0100 [conn1433574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:37.770+0100 [conn1432682] end connection 172.28.0.164:63405 (250 connections now open) 2015-10-05T09:46:37.770+0100 [mongosMain] connection accepted from 172.28.0.164:49948 #1433575 (251 connections now open) 2015-10-05T09:46:37.770+0100 [conn1433575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:38.378+0100 [conn1432686] end connection 172.28.0.164:63411 (250 connections now open) 2015-10-05T09:46:38.394+0100 [mongosMain] connection accepted from 172.28.0.164:49952 #1433576 (251 connections now open) 2015-10-05T09:46:38.394+0100 [conn1433576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:40.182+0100 [mongosMain] connection accepted from 127.0.0.1:57058 #1433577 (252 connections now open) 2015-10-05T09:46:40.185+0100 [conn1433577] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:40.190+0100 [conn1433577] end connection 127.0.0.1:57058 (251 connections now open) 2015-10-05T09:46:43.924+0100 [conn1433180] end connection 172.28.0.163:55783 (250 connections now open) 2015-10-05T09:46:43.925+0100 [conn1433203] end connection 172.28.0.163:55822 (249 connections now open) 2015-10-05T09:46:43.926+0100 [mongosMain] connection accepted from 172.28.0.163:57064 #1433578 (250 connections now open) 2015-10-05T09:46:43.927+0100 [conn1433578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:43.929+0100 [mongosMain] connection accepted from 172.28.0.163:57066 #1433579 (251 connections now open) 2015-10-05T09:46:43.930+0100 [conn1433579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:45.593+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:46:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:46:53.920+0100 [conn1433170] end connection 172.28.0.163:55739 (250 connections now open) 2015-10-05T09:46:53.920+0100 [conn1432648] end connection 172.28.0.163:54130 (250 connections now open) 2015-10-05T09:46:53.921+0100 [mongosMain] connection accepted from 172.28.0.163:57081 #1433580 (250 connections now open) 2015-10-05T09:46:53.922+0100 [mongosMain] connection accepted from 172.28.0.163:57082 #1433581 (251 connections now open) 2015-10-05T09:46:53.922+0100 [conn1433580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:53.923+0100 [conn1433581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:46:56.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561238ff5703b51053ef641a 2015-10-05T09:46:56.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:47:03.860+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:47:03.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:47:03.920+0100 [conn1432639] end connection 172.28.0.163:54119 (250 connections now open) 2015-10-05T09:47:03.920+0100 [conn1433279] end connection 172.28.0.163:56081 (250 connections now open) 2015-10-05T09:47:03.920+0100 [mongosMain] connection accepted from 172.28.0.163:57108 #1433582 (250 connections now open) 2015-10-05T09:47:03.921+0100 [mongosMain] connection accepted from 172.28.0.163:57109 #1433583 (251 connections now open) 2015-10-05T09:47:03.921+0100 [conn1433582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:03.922+0100 [conn1433583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:04.378+0100 [conn1433295] end connection 172.28.0.164:65341 (250 connections now open) 2015-10-05T09:47:04.380+0100 [mongosMain] connection accepted from 172.28.0.164:49988 #1433584 (251 connections now open) 2015-10-05T09:47:04.382+0100 [conn1433584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:10.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612390d5703b51053ef6551 2015-10-05T09:47:10.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:47:13.936+0100 [conn1432634] end connection 172.28.0.163:54109 (250 connections now open) 2015-10-05T09:47:13.936+0100 [conn1433285] end connection 172.28.0.163:56086 (249 connections now open) 2015-10-05T09:47:13.938+0100 [mongosMain] connection accepted from 172.28.0.163:57123 #1433585 (250 connections now open) 2015-10-05T09:47:13.938+0100 [mongosMain] connection accepted from 172.28.0.163:57124 #1433586 (251 connections now open) 2015-10-05T09:47:13.939+0100 [conn1433585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:13.939+0100 [conn1433586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:14.513+0100 [conn1433207] end connection 172.28.0.164:65040 (250 connections now open) 2015-10-05T09:47:14.519+0100 [mongosMain] connection accepted from 172.28.0.164:49994 #1433587 (251 connections now open) 2015-10-05T09:47:14.521+0100 [conn1433587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:15.860+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:47:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:47:22.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612391a5703b51053ef65fc 2015-10-05T09:47:22.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:47:23.967+0100 [conn1432647] end connection 172.28.0.163:54129 (250 connections now open) 2015-10-05T09:47:23.967+0100 [conn1433310] end connection 172.28.0.163:56155 (250 connections now open) 2015-10-05T09:47:23.969+0100 [mongosMain] connection accepted from 172.28.0.163:57136 #1433588 (250 connections now open) 2015-10-05T09:47:23.969+0100 [mongosMain] connection accepted from 172.28.0.163:57137 #1433589 (251 connections now open) 2015-10-05T09:47:23.970+0100 [conn1433588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:23.970+0100 [conn1433589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:24.403+0100 [conn1433061] end connection 172.28.0.164:64540 (250 connections now open) 2015-10-05T09:47:24.403+0100 [conn1433149] end connection 172.28.0.164:64881 (249 connections now open) 2015-10-05T09:47:24.404+0100 [mongosMain] connection accepted from 172.28.0.164:50007 #1433590 (251 connections now open) 2015-10-05T09:47:24.404+0100 [mongosMain] connection accepted from 172.28.0.164:50008 #1433591 (251 connections now open) 2015-10-05T09:47:24.405+0100 [conn1433590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:24.406+0100 [conn1433591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:28.277+0100 [mongosMain] connection accepted from 127.0.0.1:57141 #1433592 (252 connections now open) 2015-10-05T09:47:28.280+0100 [conn1433592] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:28.285+0100 [conn1433592] end connection 127.0.0.1:57141 (251 connections now open) 2015-10-05T09:47:28.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239205703b51053ef664d 2015-10-05T09:47:28.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:47:33.983+0100 [conn1433192] end connection 172.28.0.163:55806 (250 connections now open) 2015-10-05T09:47:33.983+0100 [conn1432638] end connection 172.28.0.163:54118 (250 connections now open) 2015-10-05T09:47:33.984+0100 [mongosMain] connection accepted from 172.28.0.163:57142 #1433593 (250 connections now open) 2015-10-05T09:47:33.985+0100 [mongosMain] connection accepted from 172.28.0.163:57143 #1433594 (251 connections now open) 2015-10-05T09:47:33.985+0100 [conn1433593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:33.986+0100 [conn1433594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:34.434+0100 [conn1433018] end connection 172.28.0.164:64419 (250 connections now open) 2015-10-05T09:47:34.434+0100 [conn1433308] end connection 172.28.0.164:65383 (249 connections now open) 2015-10-05T09:47:34.435+0100 [mongosMain] connection accepted from 172.28.0.164:50023 #1433595 (250 connections now open) 2015-10-05T09:47:34.435+0100 [mongosMain] connection accepted from 172.28.0.164:50022 #1433596 (251 connections now open) 2015-10-05T09:47:34.437+0100 [conn1433595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:34.437+0100 [conn1433596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:39.241+0100 [mongosMain] connection accepted from 127.0.0.1:57149 #1433597 (252 connections now open) 2015-10-05T09:47:39.244+0100 [conn1433597] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:39.249+0100 [conn1433597] end connection 127.0.0.1:57149 (251 connections now open) 2015-10-05T09:47:41.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612392c5703b51053ef6706 2015-10-05T09:47:41.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:47:44.450+0100 [conn1433223] end connection 172.28.0.164:65091 (250 connections now open) 2015-10-05T09:47:44.451+0100 [conn1433011] end connection 172.28.0.164:64402 (249 connections now open) 2015-10-05T09:47:44.452+0100 [mongosMain] connection accepted from 172.28.0.164:50041 #1433598 (250 connections now open) 2015-10-05T09:47:44.453+0100 [mongosMain] connection accepted from 172.28.0.164:50042 #1433599 (251 connections now open) 2015-10-05T09:47:44.454+0100 [conn1433598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:44.455+0100 [conn1433599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:46.109+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:47:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:47:48.740+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:47:48.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:47:54.466+0100 [conn1433281] end connection 172.28.0.164:65297 (250 connections now open) 2015-10-05T09:47:54.466+0100 [conn1433032] end connection 172.28.0.164:64458 (250 connections now open) 2015-10-05T09:47:54.467+0100 [mongosMain] connection accepted from 172.28.0.164:50055 #1433600 (250 connections now open) 2015-10-05T09:47:54.468+0100 [mongosMain] connection accepted from 172.28.0.164:50056 #1433601 (251 connections now open) 2015-10-05T09:47:54.469+0100 [conn1433600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:47:54.470+0100 [conn1433601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:00.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239405703b51053ef6792 2015-10-05T09:48:00.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:48:04.465+0100 [conn1433300] end connection 172.28.0.164:65351 (250 connections now open) 2015-10-05T09:48:04.466+0100 [conn1433273] end connection 172.28.0.164:65267 (249 connections now open) 2015-10-05T09:48:04.467+0100 [mongosMain] connection accepted from 172.28.0.164:50073 #1433602 (250 connections now open) 2015-10-05T09:48:04.467+0100 [mongosMain] connection accepted from 172.28.0.164:50074 #1433603 (251 connections now open) 2015-10-05T09:48:04.468+0100 [conn1433602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:04.468+0100 [conn1433603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:14.810+0100 [conn1432736] end connection 172.28.0.164:63559 (250 connections now open) 2015-10-05T09:48:14.810+0100 [conn1433304] end connection 172.28.0.164:65364 (250 connections now open) 2015-10-05T09:48:14.811+0100 [mongosMain] connection accepted from 172.28.0.164:50075 #1433604 (250 connections now open) 2015-10-05T09:48:14.811+0100 [mongosMain] connection accepted from 172.28.0.164:50076 #1433605 (251 connections now open) 2015-10-05T09:48:14.812+0100 [conn1433604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:14.813+0100 [conn1433605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:16.317+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:48:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:48:20.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239525703b51053ef68d8 2015-10-05T09:48:20.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:48:24.015+0100 [conn1433090] end connection 172.28.0.163:55458 (250 connections now open) 2015-10-05T09:48:24.017+0100 [mongosMain] connection accepted from 172.28.0.163:57210 #1433606 (251 connections now open) 2015-10-05T09:48:24.018+0100 [conn1433606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:24.794+0100 [conn1432728] end connection 172.28.0.164:63518 (250 connections now open) 2015-10-05T09:48:24.794+0100 [conn1433206] end connection 172.28.0.164:65039 (249 connections now open) 2015-10-05T09:48:24.794+0100 [mongosMain] connection accepted from 172.28.0.164:50091 #1433607 (250 connections now open) 2015-10-05T09:48:24.795+0100 [mongosMain] connection accepted from 172.28.0.164:50092 #1433608 (251 connections now open) 2015-10-05T09:48:24.796+0100 [conn1433607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:24.797+0100 [conn1433608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:28.193+0100 [mongosMain] connection accepted from 127.0.0.1:57212 #1433609 (252 connections now open) 2015-10-05T09:48:28.195+0100 [conn1433609] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:28.200+0100 [conn1433609] end connection 127.0.0.1:57212 (251 connections now open) 2015-10-05T09:48:34.030+0100 [conn1433299] end connection 172.28.0.163:56108 (250 connections now open) 2015-10-05T09:48:34.031+0100 [mongosMain] connection accepted from 172.28.0.163:57215 #1433610 (251 connections now open) 2015-10-05T09:48:34.032+0100 [conn1433610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:36.037+0100 [conn1433287] end connection 172.28.0.164:65317 (250 connections now open) 2015-10-05T09:48:36.043+0100 [mongosMain] connection accepted from 172.28.0.164:50106 #1433611 (251 connections now open) 2015-10-05T09:48:36.050+0100 [conn1433611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:40.029+0100 [mongosMain] connection accepted from 127.0.0.1:57217 #1433612 (252 connections now open) 2015-10-05T09:48:40.032+0100 [conn1433612] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:40.036+0100 [conn1433612] end connection 127.0.0.1:57217 (251 connections now open) 2015-10-05T09:48:40.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239665703b51053ef6a1a 2015-10-05T09:48:40.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:48:44.030+0100 [conn1433185] end connection 172.28.0.163:55795 (250 connections now open) 2015-10-05T09:48:44.031+0100 [mongosMain] connection accepted from 172.28.0.163:57223 #1433613 (251 connections now open) 2015-10-05T09:48:44.031+0100 [conn1433613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:46.042+0100 [conn1433102] end connection 172.28.0.164:64717 (250 connections now open) 2015-10-05T09:48:46.043+0100 [mongosMain] connection accepted from 172.28.0.164:50126 #1433614 (251 connections now open) 2015-10-05T09:48:46.044+0100 [conn1433614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:46.445+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:48:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:48:46.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612396e5703b51053ef6ad1 2015-10-05T09:48:46.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:48:52.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239745703b51053ef6b4d 2015-10-05T09:48:52.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:48:54.046+0100 [conn1433069] end connection 172.28.0.163:55370 (250 connections now open) 2015-10-05T09:48:54.047+0100 [mongosMain] connection accepted from 172.28.0.163:57239 #1433615 (251 connections now open) 2015-10-05T09:48:54.048+0100 [conn1433615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:56.060+0100 [conn1433235] end connection 172.28.0.164:65131 (250 connections now open) 2015-10-05T09:48:56.061+0100 [mongosMain] connection accepted from 172.28.0.164:50137 #1433616 (251 connections now open) 2015-10-05T09:48:56.063+0100 [conn1433616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:48:59.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612397a5703b51053ef6bad 2015-10-05T09:49:00.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:49:04.060+0100 [conn1433303] end connection 172.28.0.163:56125 (250 connections now open) 2015-10-05T09:49:04.062+0100 [mongosMain] connection accepted from 172.28.0.163:57258 #1433617 (251 connections now open) 2015-10-05T09:49:04.062+0100 [conn1433617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:05.033+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6ms 2015-10-05T09:49:06.074+0100 [conn1433213] end connection 172.28.0.164:65053 (250 connections now open) 2015-10-05T09:49:06.075+0100 [mongosMain] connection accepted from 172.28.0.164:50159 #1433618 (251 connections now open) 2015-10-05T09:49:06.077+0100 [conn1433618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:07.032+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612397f03838a4537162e29') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444034946899), why: "doing balance round", ts: ObjectId('561239825703b51053ef6c51') } } gle1: { lastOp: Timestamp 1444034946000|2, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } gle2: { lastOp: Timestamp 1444034939000|8, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } 2015-10-05T09:49:07.040+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:49:07.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239825703b51053ef6c51 2015-10-05T09:49:07.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:49:16.089+0100 [conn1433293] end connection 172.28.0.164:65334 (250 connections now open) 2015-10-05T09:49:16.090+0100 [mongosMain] connection accepted from 172.28.0.164:50164 #1433619 (251 connections now open) 2015-10-05T09:49:16.092+0100 [conn1433619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:16.718+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:49:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:49:19.898+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:49:19.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:49:24.078+0100 [conn1433362] end connection 172.28.0.163:56307 (250 connections now open) 2015-10-05T09:49:24.079+0100 [mongosMain] connection accepted from 172.28.0.163:57284 #1433620 (251 connections now open) 2015-10-05T09:49:24.083+0100 [conn1433620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:26.466+0100 [conn1433320] end connection 172.28.0.164:65415 (250 connections now open) 2015-10-05T09:49:26.468+0100 [mongosMain] connection accepted from 172.28.0.164:50181 #1433621 (251 connections now open) 2015-10-05T09:49:26.469+0100 [conn1433621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:26.487+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:49:26.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:49:29.071+0100 [mongosMain] connection accepted from 127.0.0.1:57287 #1433622 (252 connections now open) 2015-10-05T09:49:29.074+0100 [conn1433622] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:29.080+0100 [conn1433622] end connection 127.0.0.1:57287 (251 connections now open) 2015-10-05T09:49:34.085+0100 [conn1433365] end connection 172.28.0.163:56350 (250 connections now open) 2015-10-05T09:49:34.086+0100 [mongosMain] connection accepted from 172.28.0.163:57288 #1433623 (251 connections now open) 2015-10-05T09:49:34.087+0100 [conn1433623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:36.493+0100 [conn1433314] end connection 172.28.0.164:65394 (250 connections now open) 2015-10-05T09:49:36.494+0100 [mongosMain] connection accepted from 172.28.0.164:50196 #1433624 (251 connections now open) 2015-10-05T09:49:36.496+0100 [conn1433624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:38.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239a25703b51053ef6e89 2015-10-05T09:49:38.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:49:39.906+0100 [mongosMain] connection accepted from 127.0.0.1:57294 #1433625 (252 connections now open) 2015-10-05T09:49:39.909+0100 [conn1433625] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:39.913+0100 [conn1433625] end connection 127.0.0.1:57294 (251 connections now open) 2015-10-05T09:49:44.104+0100 [conn1433350] end connection 172.28.0.163:56257 (250 connections now open) 2015-10-05T09:49:44.105+0100 [mongosMain] connection accepted from 172.28.0.163:57300 #1433626 (251 connections now open) 2015-10-05T09:49:44.106+0100 [conn1433626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:49:46.506+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:49:46.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:49:47.052+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:49:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:49:52.678+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561239a803838a4537162e2c') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444034992517), why: "doing balance round", ts: ObjectId('561239b05703b51053ef6f95') } } gle1: { lastOp: Timestamp 1444034978000|16, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } gle2: { lastOp: Timestamp 1444034992000|7, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2015-10-05T09:49:52.683+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T09:49:52.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239b05703b51053ef6f95 2015-10-05T09:49:53.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:49:54.094+0100 [conn1433356] end connection 172.28.0.163:56267 (250 connections now open) 2015-10-05T09:49:54.095+0100 [mongosMain] connection accepted from 172.28.0.163:57317 #1433627 (251 connections now open) 2015-10-05T09:49:54.096+0100 [conn1433627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:01.346+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:50:01.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:50:04.108+0100 [conn1433292] end connection 172.28.0.163:56096 (250 connections now open) 2015-10-05T09:50:04.112+0100 [mongosMain] connection accepted from 172.28.0.163:57339 #1433628 (251 connections now open) 2015-10-05T09:50:04.113+0100 [conn1433628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:14.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239c55703b51053ef7074 2015-10-05T09:50:14.109+0100 [conn1433344] end connection 172.28.0.163:56251 (250 connections now open) 2015-10-05T09:50:14.110+0100 [mongosMain] connection accepted from 172.28.0.163:57363 #1433629 (251 connections now open) 2015-10-05T09:50:14.111+0100 [conn1433629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:14.347+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:17.131+0100 [conn1433327] end connection 172.28.0.164:65435 (250 connections now open) 2015-10-05T09:50:17.136+0100 [mongosMain] connection accepted from 172.28.0.164:50257 #1433630 (251 connections now open) 2015-10-05T09:50:17.138+0100 [conn1433630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:17.737+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:50:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:50:20.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239cc5703b51053ef70bf 2015-10-05T09:50:20.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:24.128+0100 [conn1433372] end connection 172.28.0.163:56379 (250 connections now open) 2015-10-05T09:50:24.130+0100 [mongosMain] connection accepted from 172.28.0.163:57375 #1433631 (251 connections now open) 2015-10-05T09:50:24.131+0100 [conn1433631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:27.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239d25703b51053ef7116 2015-10-05T09:50:27.120+0100 [conn1433343] end connection 172.28.0.164:65500 (250 connections now open) 2015-10-05T09:50:27.122+0100 [mongosMain] connection accepted from 172.28.0.164:50280 #1433632 (251 connections now open) 2015-10-05T09:50:27.123+0100 [conn1433632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:27.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:28.518+0100 [mongosMain] connection accepted from 127.0.0.1:57378 #1433633 (252 connections now open) 2015-10-05T09:50:28.521+0100 [conn1433633] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:28.525+0100 [conn1433633] end connection 127.0.0.1:57378 (251 connections now open) 2015-10-05T09:50:33.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239d95703b51053ef717d 2015-10-05T09:50:33.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:34.140+0100 [conn1433370] end connection 172.28.0.163:56370 (250 connections now open) 2015-10-05T09:50:34.141+0100 [mongosMain] connection accepted from 172.28.0.163:57383 #1433634 (251 connections now open) 2015-10-05T09:50:34.142+0100 [conn1433634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:37.136+0100 [conn1433368] end connection 172.28.0.164:49253 (250 connections now open) 2015-10-05T09:50:37.137+0100 [mongosMain] connection accepted from 172.28.0.164:50314 #1433635 (251 connections now open) 2015-10-05T09:50:37.138+0100 [conn1433635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:39.789+0100 [mongosMain] connection accepted from 127.0.0.1:57388 #1433636 (252 connections now open) 2015-10-05T09:50:39.792+0100 [conn1433636] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:39.797+0100 [conn1433636] end connection 127.0.0.1:57388 (251 connections now open) 2015-10-05T09:50:39.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239df5703b51053ef71bc 2015-10-05T09:50:40.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:44.141+0100 [conn1433367] end connection 172.28.0.163:56362 (250 connections now open) 2015-10-05T09:50:44.142+0100 [mongosMain] connection accepted from 172.28.0.163:57395 #1433637 (251 connections now open) 2015-10-05T09:50:44.144+0100 [conn1433637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:46.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239e65703b51053ef7222 2015-10-05T09:50:46.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:50:47.151+0100 [conn1433332] end connection 172.28.0.164:65454 (250 connections now open) 2015-10-05T09:50:47.152+0100 [mongosMain] connection accepted from 172.28.0.164:50346 #1433638 (251 connections now open) 2015-10-05T09:50:47.154+0100 [conn1433638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:50:47.938+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:50:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:50:54.888+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:50:54.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:50:57.410+0100 [conn1433382] end connection 172.28.0.164:49360 (250 connections now open) 2015-10-05T09:50:57.416+0100 [mongosMain] connection accepted from 172.28.0.164:50383 #1433639 (251 connections now open) 2015-10-05T09:50:57.417+0100 [conn1433639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:01.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239f45703b51053ef7339 2015-10-05T09:51:01.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:04.156+0100 [conn1433316] end connection 172.28.0.163:56171 (250 connections now open) 2015-10-05T09:51:04.157+0100 [mongosMain] connection accepted from 172.28.0.163:57423 #1433640 (251 connections now open) 2015-10-05T09:51:04.158+0100 [conn1433640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:07.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561239fb5703b51053ef7420 2015-10-05T09:51:07.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:07.400+0100 [conn1433378] end connection 172.28.0.164:49344 (250 connections now open) 2015-10-05T09:51:07.400+0100 [mongosMain] connection accepted from 172.28.0.164:50430 #1433641 (251 connections now open) 2015-10-05T09:51:07.403+0100 [conn1433641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:14.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a015703b51053ef74c1 2015-10-05T09:51:14.171+0100 [conn1433322] end connection 172.28.0.163:56176 (250 connections now open) 2015-10-05T09:51:14.172+0100 [mongosMain] connection accepted from 172.28.0.163:57440 #1433642 (251 connections now open) 2015-10-05T09:51:14.173+0100 [conn1433642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:14.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:17.416+0100 [conn1433386] end connection 172.28.0.164:49376 (250 connections now open) 2015-10-05T09:51:17.417+0100 [mongosMain] connection accepted from 172.28.0.164:50444 #1433643 (251 connections now open) 2015-10-05T09:51:17.419+0100 [conn1433643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:18.063+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:51:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:51:24.172+0100 [conn1433381] end connection 172.28.0.163:56452 (250 connections now open) 2015-10-05T09:51:24.173+0100 [mongosMain] connection accepted from 172.28.0.163:57449 #1433644 (251 connections now open) 2015-10-05T09:51:24.174+0100 [conn1433644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:26.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a0e5703b51053ef7622 2015-10-05T09:51:26.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:27.432+0100 [conn1433123] end connection 172.28.0.164:64793 (250 connections now open) 2015-10-05T09:51:27.433+0100 [mongosMain] connection accepted from 172.28.0.164:50478 #1433645 (251 connections now open) 2015-10-05T09:51:27.435+0100 [conn1433645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:28.861+0100 [mongosMain] connection accepted from 127.0.0.1:57457 #1433646 (252 connections now open) 2015-10-05T09:51:28.864+0100 [conn1433646] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:28.869+0100 [conn1433646] end connection 127.0.0.1:57457 (251 connections now open) 2015-10-05T09:51:32.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a145703b51053ef76dc 2015-10-05T09:51:33.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:37.432+0100 [conn1433184] end connection 172.28.0.164:64988 (250 connections now open) 2015-10-05T09:51:37.433+0100 [mongosMain] connection accepted from 172.28.0.164:50510 #1433647 (251 connections now open) 2015-10-05T09:51:37.434+0100 [conn1433647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:39.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a1b5703b51053ef7803 2015-10-05T09:51:39.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:39.922+0100 [mongosMain] connection accepted from 127.0.0.1:57460 #1433648 (252 connections now open) 2015-10-05T09:51:39.924+0100 [conn1433648] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:51:39.928+0100 [conn1433648] end connection 127.0.0.1:57460 (251 connections now open) 2015-10-05T09:51:46.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a215703b51053ef7940 2015-10-05T09:51:47.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:51:48.325+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:51:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:51:53.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a295703b51053ef7a6a 2015-10-05T09:51:54.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:01.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a305703b51053ef7b54 2015-10-05T09:52:02.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:19.786+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:52:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:52:20.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a445703b51053ef7f41 2015-10-05T09:52:20.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:28.815+0100 [mongosMain] connection accepted from 127.0.0.1:57519 #1433649 (252 connections now open) 2015-10-05T09:52:28.818+0100 [conn1433649] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:28.822+0100 [conn1433649] end connection 127.0.0.1:57519 (251 connections now open) 2015-10-05T09:52:29.819+0100 [conn1433363] end connection 172.28.0.164:49210 (250 connections now open) 2015-10-05T09:52:29.821+0100 [mongosMain] connection accepted from 172.28.0.164:50660 #1433650 (251 connections now open) 2015-10-05T09:52:29.822+0100 [conn1433650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:33.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a505703b51053ef8161 2015-10-05T09:52:33.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:37.952+0100 [conn1433428] end connection 172.28.0.163:56627 (250 connections now open) 2015-10-05T09:52:37.955+0100 [mongosMain] connection accepted from 172.28.0.163:57523 #1433651 (251 connections now open) 2015-10-05T09:52:37.956+0100 [conn1433651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:39.300+0100 [mongosMain] connection accepted from 127.0.0.1:57526 #1433652 (252 connections now open) 2015-10-05T09:52:39.303+0100 [conn1433652] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:39.308+0100 [conn1433652] end connection 127.0.0.1:57526 (251 connections now open) 2015-10-05T09:52:40.097+0100 [conn1433055] end connection 172.28.0.164:64529 (250 connections now open) 2015-10-05T09:52:40.113+0100 [mongosMain] connection accepted from 172.28.0.164:50675 #1433653 (251 connections now open) 2015-10-05T09:52:40.113+0100 [conn1433653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:40.191+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:52:40.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:52:44.264+0100 [conn1433360] end connection 172.28.0.163:56288 (250 connections now open) 2015-10-05T09:52:44.264+0100 [conn1433240] end connection 172.28.0.163:55931 (249 connections now open) 2015-10-05T09:52:44.265+0100 [mongosMain] connection accepted from 172.28.0.163:57536 #1433654 (250 connections now open) 2015-10-05T09:52:44.265+0100 [mongosMain] connection accepted from 172.28.0.163:57538 #1433655 (251 connections now open) 2015-10-05T09:52:44.266+0100 [conn1433654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:44.267+0100 [conn1433655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:46.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a5e5703b51053ef8304 2015-10-05T09:52:46.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:49.940+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:52:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:52:50.069+0100 [conn1433402] end connection 172.28.0.164:49443 (250 connections now open) 2015-10-05T09:52:50.070+0100 [conn1433348] end connection 172.28.0.164:65514 (249 connections now open) 2015-10-05T09:52:50.071+0100 [mongosMain] connection accepted from 172.28.0.164:50689 #1433656 (250 connections now open) 2015-10-05T09:52:50.071+0100 [mongosMain] connection accepted from 172.28.0.164:50690 #1433657 (251 connections now open) 2015-10-05T09:52:50.072+0100 [conn1433656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:50.073+0100 [conn1433657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:52.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a645703b51053ef8390 2015-10-05T09:52:52.807+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:52:54.251+0100 [conn1433276] end connection 172.28.0.163:56068 (250 connections now open) 2015-10-05T09:52:54.251+0100 [conn1433388] end connection 172.28.0.163:56481 (250 connections now open) 2015-10-05T09:52:54.251+0100 [mongosMain] connection accepted from 172.28.0.163:57565 #1433658 (250 connections now open) 2015-10-05T09:52:54.252+0100 [mongosMain] connection accepted from 172.28.0.163:57566 #1433659 (251 connections now open) 2015-10-05T09:52:54.252+0100 [conn1433658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:52:54.253+0100 [conn1433659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:00.423+0100 [conn1433425] end connection 172.28.0.164:49544 (250 connections now open) 2015-10-05T09:53:00.424+0100 [conn1433311] end connection 172.28.0.164:65384 (249 connections now open) 2015-10-05T09:53:00.426+0100 [mongosMain] connection accepted from 172.28.0.164:50747 #1433660 (250 connections now open) 2015-10-05T09:53:00.430+0100 [mongosMain] connection accepted from 172.28.0.164:50748 #1433661 (251 connections now open) 2015-10-05T09:53:00.431+0100 [conn1433660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:00.434+0100 [conn1433661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:04.266+0100 [conn1433036] end connection 172.28.0.163:55290 (250 connections now open) 2015-10-05T09:53:04.266+0100 [conn1433417] end connection 172.28.0.163:56607 (250 connections now open) 2015-10-05T09:53:04.267+0100 [mongosMain] connection accepted from 172.28.0.163:57583 #1433662 (250 connections now open) 2015-10-05T09:53:04.267+0100 [mongosMain] connection accepted from 172.28.0.163:57584 #1433663 (251 connections now open) 2015-10-05T09:53:04.267+0100 [conn1433662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:04.268+0100 [conn1433663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:06.284+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:53:06.284+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:53:10.397+0100 [conn1433412] end connection 172.28.0.164:49502 (250 connections now open) 2015-10-05T09:53:10.397+0100 [conn1433394] end connection 172.28.0.164:49414 (249 connections now open) 2015-10-05T09:53:10.398+0100 [mongosMain] connection accepted from 172.28.0.164:50766 #1433664 (250 connections now open) 2015-10-05T09:53:10.398+0100 [mongosMain] connection accepted from 172.28.0.164:50767 #1433665 (251 connections now open) 2015-10-05T09:53:10.399+0100 [conn1433664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:10.399+0100 [conn1433665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:13.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a785703b51053ef8582 2015-10-05T09:53:13.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:53:14.378+0100 [conn1433255] end connection 172.28.0.163:55997 (250 connections now open) 2015-10-05T09:53:14.378+0100 [conn1433376] end connection 172.28.0.163:56437 (250 connections now open) 2015-10-05T09:53:14.386+0100 [mongosMain] connection accepted from 172.28.0.163:57607 #1433666 (250 connections now open) 2015-10-05T09:53:14.387+0100 [conn1433666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:14.388+0100 [mongosMain] connection accepted from 172.28.0.163:57608 #1433667 (251 connections now open) 2015-10-05T09:53:14.389+0100 [conn1433667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:20.204+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:53:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:53:20.413+0100 [conn1432951] end connection 172.28.0.164:64244 (250 connections now open) 2015-10-05T09:53:20.413+0100 [conn1433397] end connection 172.28.0.164:49427 (250 connections now open) 2015-10-05T09:53:20.414+0100 [mongosMain] connection accepted from 172.28.0.164:50778 #1433668 (250 connections now open) 2015-10-05T09:53:20.414+0100 [mongosMain] connection accepted from 172.28.0.164:50779 #1433669 (251 connections now open) 2015-10-05T09:53:20.430+0100 [conn1433668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:20.435+0100 [conn1433669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:24.363+0100 [conn1433377] end connection 172.28.0.163:56445 (250 connections now open) 2015-10-05T09:53:24.364+0100 [mongosMain] connection accepted from 172.28.0.163:57614 #1433670 (251 connections now open) 2015-10-05T09:53:24.365+0100 [conn1433670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:24.371+0100 [conn1433486] end connection 172.28.0.163:56754 (250 connections now open) 2015-10-05T09:53:24.372+0100 [mongosMain] connection accepted from 172.28.0.163:57616 #1433671 (251 connections now open) 2015-10-05T09:53:24.373+0100 [conn1433671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:25.563+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:53:25.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:53:28.459+0100 [mongosMain] connection accepted from 127.0.0.1:57619 #1433672 (252 connections now open) 2015-10-05T09:53:28.461+0100 [conn1433672] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:28.467+0100 [conn1433672] end connection 127.0.0.1:57619 (251 connections now open) 2015-10-05T09:53:30.413+0100 [conn1433349] end connection 172.28.0.164:65515 (250 connections now open) 2015-10-05T09:53:30.413+0100 [conn1433336] end connection 172.28.0.164:65469 (249 connections now open) 2015-10-05T09:53:30.414+0100 [mongosMain] connection accepted from 172.28.0.164:50806 #1433673 (250 connections now open) 2015-10-05T09:53:30.414+0100 [mongosMain] connection accepted from 172.28.0.164:50807 #1433674 (251 connections now open) 2015-10-05T09:53:30.415+0100 [conn1433673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:30.416+0100 [conn1433674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:31.709+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a8b5703b51053ef8772 2015-10-05T09:53:31.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:53:33.319+0100 [mongosMain] connection accepted from 172.28.0.164:50812 #1433675 (252 connections now open) 2015-10-05T09:53:33.319+0100 [mongosMain] connection accepted from 172.28.0.164:50813 #1433676 (253 connections now open) 2015-10-05T09:53:34.376+0100 [conn1433423] end connection 172.28.0.163:56615 (252 connections now open) 2015-10-05T09:53:34.376+0100 [conn1433337] end connection 172.28.0.163:56218 (252 connections now open) 2015-10-05T09:53:34.377+0100 [mongosMain] connection accepted from 172.28.0.163:57622 #1433677 (252 connections now open) 2015-10-05T09:53:34.377+0100 [mongosMain] connection accepted from 172.28.0.163:57623 #1433678 (253 connections now open) 2015-10-05T09:53:34.378+0100 [conn1433677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:34.378+0100 [conn1433678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:37.964+0100 [conn1433430] end connection 172.28.0.163:56632 (252 connections now open) 2015-10-05T09:53:37.965+0100 [mongosMain] connection accepted from 172.28.0.163:57628 #1433679 (253 connections now open) 2015-10-05T09:53:37.967+0100 [conn1433679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:38.264+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:53:38.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:53:40.080+0100 [mongosMain] connection accepted from 127.0.0.1:57631 #1433680 (254 connections now open) 2015-10-05T09:53:40.082+0100 [conn1433680] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:40.086+0100 [conn1433680] end connection 127.0.0.1:57631 (253 connections now open) 2015-10-05T09:53:40.430+0100 [conn1433391] end connection 172.28.0.164:49403 (252 connections now open) 2015-10-05T09:53:40.430+0100 [conn1433483] end connection 172.28.0.164:49567 (251 connections now open) 2015-10-05T09:53:40.431+0100 [mongosMain] connection accepted from 172.28.0.164:50831 #1433681 (252 connections now open) 2015-10-05T09:53:40.431+0100 [mongosMain] connection accepted from 172.28.0.164:50832 #1433682 (253 connections now open) 2015-10-05T09:53:40.433+0100 [conn1433681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:40.433+0100 [conn1433682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:44.394+0100 [conn1433374] end connection 172.28.0.163:56424 (252 connections now open) 2015-10-05T09:53:44.395+0100 [mongosMain] connection accepted from 172.28.0.163:57638 #1433683 (253 connections now open) 2015-10-05T09:53:44.396+0100 [conn1433683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:49.836+0100 [conn1433676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:50.445+0100 [conn1432989] end connection 172.28.0.164:64357 (252 connections now open) 2015-10-05T09:53:50.445+0100 [conn1433419] end connection 172.28.0.164:49525 (251 connections now open) 2015-10-05T09:53:50.446+0100 [mongosMain] connection accepted from 172.28.0.164:50848 #1433684 (252 connections now open) 2015-10-05T09:53:50.446+0100 [mongosMain] connection accepted from 172.28.0.164:50849 #1433685 (253 connections now open) 2015-10-05T09:53:50.447+0100 [conn1433684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:50.448+0100 [conn1433685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:50.517+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:53:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:53:50.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123a9e5703b51053ef88f7 2015-10-05T09:53:50.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:53:54.394+0100 [conn1433401] end connection 172.28.0.163:56534 (252 connections now open) 2015-10-05T09:53:54.399+0100 [mongosMain] connection accepted from 172.28.0.163:57659 #1433686 (253 connections now open) 2015-10-05T09:53:54.400+0100 [conn1433686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.557+0100 [mongosMain] connection accepted from 172.28.0.164:50910 #1433687 (254 connections now open) 2015-10-05T09:53:55.558+0100 [mongosMain] connection accepted from 172.28.0.164:50911 #1433688 (255 connections now open) 2015-10-05T09:53:55.563+0100 [conn1433688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.573+0100 [mongosMain] connection accepted from 172.28.0.164:50913 #1433689 (256 connections now open) 2015-10-05T09:53:55.578+0100 [mongosMain] connection accepted from 172.28.0.164:50914 #1433690 (257 connections now open) 2015-10-05T09:53:55.579+0100 [conn1433687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.591+0100 [conn1433689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.594+0100 [conn1433690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.595+0100 [conn1433675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.601+0100 [mongosMain] connection accepted from 172.28.0.164:50915 #1433691 (258 connections now open) 2015-10-05T09:53:55.605+0100 [conn1433691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.611+0100 [mongosMain] connection accepted from 172.28.0.164:50918 #1433692 (259 connections now open) 2015-10-05T09:53:55.615+0100 [conn1433692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.626+0100 [mongosMain] connection accepted from 172.28.0.164:50919 #1433693 (260 connections now open) 2015-10-05T09:53:55.633+0100 [conn1433693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.641+0100 [mongosMain] connection accepted from 172.28.0.164:50920 #1433694 (261 connections now open) 2015-10-05T09:53:55.652+0100 [conn1433694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.677+0100 [mongosMain] connection accepted from 172.28.0.164:50921 #1433695 (262 connections now open) 2015-10-05T09:53:55.690+0100 [mongosMain] connection accepted from 172.28.0.164:50922 #1433696 (263 connections now open) 2015-10-05T09:53:55.700+0100 [conn1433695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.701+0100 [conn1433696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.708+0100 [mongosMain] connection accepted from 172.28.0.164:50923 #1433697 (264 connections now open) 2015-10-05T09:53:55.708+0100 [mongosMain] connection accepted from 172.28.0.164:50924 #1433698 (265 connections now open) 2015-10-05T09:53:55.709+0100 [mongosMain] connection accepted from 172.28.0.164:50925 #1433699 (266 connections now open) 2015-10-05T09:53:55.709+0100 [mongosMain] connection accepted from 172.28.0.164:50926 #1433700 (267 connections now open) 2015-10-05T09:53:55.709+0100 [mongosMain] connection accepted from 172.28.0.164:50928 #1433701 (268 connections now open) 2015-10-05T09:53:55.709+0100 [mongosMain] connection accepted from 172.28.0.164:50931 #1433702 (269 connections now open) 2015-10-05T09:53:55.710+0100 [mongosMain] connection accepted from 172.28.0.164:50927 #1433703 (270 connections now open) 2015-10-05T09:53:55.710+0100 [mongosMain] connection accepted from 172.28.0.164:50930 #1433704 (271 connections now open) 2015-10-05T09:53:55.710+0100 [mongosMain] connection accepted from 172.28.0.164:50929 #1433705 (272 connections now open) 2015-10-05T09:53:55.710+0100 [mongosMain] connection accepted from 172.28.0.164:50932 #1433706 (273 connections now open) 2015-10-05T09:53:55.712+0100 [conn1433697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.713+0100 [conn1433698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.713+0100 [conn1433702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.713+0100 [conn1433699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.714+0100 [conn1433703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.714+0100 [conn1433704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.714+0100 [conn1433700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.715+0100 [conn1433705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.717+0100 [conn1433701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.719+0100 [conn1433706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.722+0100 [mongosMain] connection accepted from 172.28.0.164:50933 #1433707 (274 connections now open) 2015-10-05T09:53:55.725+0100 [conn1433707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.727+0100 [mongosMain] connection accepted from 172.28.0.164:50934 #1433708 (275 connections now open) 2015-10-05T09:53:55.729+0100 [conn1433708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.736+0100 [mongosMain] connection accepted from 172.28.0.164:50937 #1433709 (276 connections now open) 2015-10-05T09:53:55.742+0100 [conn1433709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.745+0100 [mongosMain] connection accepted from 172.28.0.164:50938 #1433710 (277 connections now open) 2015-10-05T09:53:55.747+0100 [conn1433710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.749+0100 [mongosMain] connection accepted from 172.28.0.164:50939 #1433711 (278 connections now open) 2015-10-05T09:53:55.752+0100 [conn1433711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.754+0100 [mongosMain] connection accepted from 172.28.0.164:50940 #1433712 (279 connections now open) 2015-10-05T09:53:55.756+0100 [conn1433712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.758+0100 [mongosMain] connection accepted from 172.28.0.164:50941 #1433713 (280 connections now open) 2015-10-05T09:53:55.760+0100 [conn1433713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.762+0100 [mongosMain] connection accepted from 172.28.0.164:50942 #1433714 (281 connections now open) 2015-10-05T09:53:55.764+0100 [conn1433714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.766+0100 [mongosMain] connection accepted from 172.28.0.164:50943 #1433715 (282 connections now open) 2015-10-05T09:53:55.768+0100 [conn1433715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.771+0100 [mongosMain] connection accepted from 172.28.0.164:50944 #1433716 (283 connections now open) 2015-10-05T09:53:55.773+0100 [conn1433716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.775+0100 [mongosMain] connection accepted from 172.28.0.164:50945 #1433717 (284 connections now open) 2015-10-05T09:53:55.777+0100 [conn1433717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.779+0100 [mongosMain] connection accepted from 172.28.0.164:50946 #1433718 (285 connections now open) 2015-10-05T09:53:55.782+0100 [conn1433718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.785+0100 [mongosMain] connection accepted from 172.28.0.164:50947 #1433719 (286 connections now open) 2015-10-05T09:53:55.787+0100 [conn1433719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.790+0100 [mongosMain] connection accepted from 172.28.0.164:50948 #1433720 (287 connections now open) 2015-10-05T09:53:55.795+0100 [conn1433720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.798+0100 [mongosMain] connection accepted from 172.28.0.164:50949 #1433721 (288 connections now open) 2015-10-05T09:53:55.801+0100 [conn1433721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.803+0100 [mongosMain] connection accepted from 172.28.0.164:50950 #1433722 (289 connections now open) 2015-10-05T09:53:55.806+0100 [conn1433722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.808+0100 [mongosMain] connection accepted from 172.28.0.164:50951 #1433723 (290 connections now open) 2015-10-05T09:53:55.812+0100 [conn1433723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.815+0100 [mongosMain] connection accepted from 172.28.0.164:50952 #1433724 (291 connections now open) 2015-10-05T09:53:55.817+0100 [conn1433724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.819+0100 [mongosMain] connection accepted from 172.28.0.164:50953 #1433725 (292 connections now open) 2015-10-05T09:53:55.821+0100 [conn1433725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.823+0100 [mongosMain] connection accepted from 172.28.0.164:50954 #1433726 (293 connections now open) 2015-10-05T09:53:55.825+0100 [conn1433726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.828+0100 [mongosMain] connection accepted from 172.28.0.164:50956 #1433727 (294 connections now open) 2015-10-05T09:53:55.830+0100 [conn1433727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.833+0100 [mongosMain] connection accepted from 172.28.0.164:50957 #1433728 (295 connections now open) 2015-10-05T09:53:55.835+0100 [conn1433728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.837+0100 [mongosMain] connection accepted from 172.28.0.164:50958 #1433729 (296 connections now open) 2015-10-05T09:53:55.844+0100 [conn1433729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.846+0100 [mongosMain] connection accepted from 172.28.0.164:50959 #1433730 (297 connections now open) 2015-10-05T09:53:55.848+0100 [conn1433730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.851+0100 [mongosMain] connection accepted from 172.28.0.164:50960 #1433731 (298 connections now open) 2015-10-05T09:53:55.853+0100 [conn1433731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.855+0100 [mongosMain] connection accepted from 172.28.0.164:50961 #1433732 (299 connections now open) 2015-10-05T09:53:55.858+0100 [conn1433732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.859+0100 [mongosMain] connection accepted from 172.28.0.164:50962 #1433733 (300 connections now open) 2015-10-05T09:53:55.862+0100 [conn1433733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.863+0100 [mongosMain] connection accepted from 172.28.0.164:50963 #1433734 (301 connections now open) 2015-10-05T09:53:55.865+0100 [conn1433734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:55.867+0100 [mongosMain] connection accepted from 172.28.0.164:50964 #1433735 (302 connections now open) 2015-10-05T09:53:55.870+0100 [conn1433735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:53:56.962+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:53:56.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:54:01.022+0100 [conn1433409] end connection 172.28.0.164:49477 (301 connections now open) 2015-10-05T09:54:01.026+0100 [conn1433294] end connection 172.28.0.164:65335 (300 connections now open) 2015-10-05T09:54:01.032+0100 [mongosMain] connection accepted from 172.28.0.164:50969 #1433736 (301 connections now open) 2015-10-05T09:54:01.035+0100 [conn1433736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:01.038+0100 [mongosMain] connection accepted from 172.28.0.164:50970 #1433737 (302 connections now open) 2015-10-05T09:54:01.079+0100 [conn1433737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:04.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123aab5703b51053ef8a45 2015-10-05T09:54:04.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:54:04.395+0100 [conn1433373] end connection 172.28.0.163:56395 (301 connections now open) 2015-10-05T09:54:04.395+0100 [conn1432969] end connection 172.28.0.163:55136 (301 connections now open) 2015-10-05T09:54:04.398+0100 [mongosMain] connection accepted from 172.28.0.163:57681 #1433738 (301 connections now open) 2015-10-05T09:54:04.398+0100 [conn1433738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:04.399+0100 [mongosMain] connection accepted from 172.28.0.163:57682 #1433739 (302 connections now open) 2015-10-05T09:54:04.399+0100 [conn1433739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:05.071+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 8ms 2015-10-05T09:54:10.465+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:54:10.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:54:11.022+0100 [conn1433355] end connection 172.28.0.164:49157 (301 connections now open) 2015-10-05T09:54:11.022+0100 [conn1433389] end connection 172.28.0.164:49390 (301 connections now open) 2015-10-05T09:54:11.023+0100 [mongosMain] connection accepted from 172.28.0.164:51019 #1433740 (301 connections now open) 2015-10-05T09:54:11.024+0100 [mongosMain] connection accepted from 172.28.0.164:51020 #1433741 (302 connections now open) 2015-10-05T09:54:11.025+0100 [conn1433740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:11.025+0100 [conn1433741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:14.407+0100 [conn1433396] end connection 172.28.0.163:56528 (301 connections now open) 2015-10-05T09:54:14.407+0100 [conn1433298] end connection 172.28.0.163:56109 (301 connections now open) 2015-10-05T09:54:14.408+0100 [mongosMain] connection accepted from 172.28.0.163:57708 #1433742 (301 connections now open) 2015-10-05T09:54:14.417+0100 [mongosMain] connection accepted from 172.28.0.163:57709 #1433743 (302 connections now open) 2015-10-05T09:54:14.481+0100 [conn1433743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:14.481+0100 [conn1433742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:16.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ab85703b51053ef8b6e 2015-10-05T09:54:16.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:54:20.678+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:54:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:54:21.037+0100 [conn1433526] end connection 172.28.0.164:49731 (301 connections now open) 2015-10-05T09:54:21.038+0100 [conn1433359] end connection 172.28.0.164:49179 (300 connections now open) 2015-10-05T09:54:21.038+0100 [mongosMain] connection accepted from 172.28.0.164:51032 #1433744 (302 connections now open) 2015-10-05T09:54:21.039+0100 [mongosMain] connection accepted from 172.28.0.164:51033 #1433745 (302 connections now open) 2015-10-05T09:54:21.040+0100 [conn1433744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:21.041+0100 [conn1433745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:25.073+0100 [conn1433309] end connection 172.28.0.163:56154 (301 connections now open) 2015-10-05T09:54:25.096+0100 [mongosMain] connection accepted from 172.28.0.163:57725 #1433746 (302 connections now open) 2015-10-05T09:54:25.097+0100 [conn1433746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:28.641+0100 [mongosMain] connection accepted from 127.0.0.1:57727 #1433747 (303 connections now open) 2015-10-05T09:54:28.644+0100 [conn1433747] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:28.648+0100 [conn1433747] end connection 127.0.0.1:57727 (302 connections now open) 2015-10-05T09:54:31.053+0100 [conn1433424] end connection 172.28.0.164:49543 (301 connections now open) 2015-10-05T09:54:31.053+0100 [conn1433509] end connection 172.28.0.164:49654 (300 connections now open) 2015-10-05T09:54:31.054+0100 [mongosMain] connection accepted from 172.28.0.164:51049 #1433748 (301 connections now open) 2015-10-05T09:54:31.055+0100 [mongosMain] connection accepted from 172.28.0.164:51050 #1433749 (302 connections now open) 2015-10-05T09:54:31.055+0100 [conn1433748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:31.057+0100 [conn1433749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:35.051+0100 [conn1433480] end connection 172.28.0.163:56737 (301 connections now open) 2015-10-05T09:54:35.053+0100 [mongosMain] connection accepted from 172.28.0.163:57730 #1433750 (302 connections now open) 2015-10-05T09:54:35.054+0100 [conn1433750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:36.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123acb5703b51053ef8d0a 2015-10-05T09:54:36.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:54:37.980+0100 [conn1433431] end connection 172.28.0.163:56634 (301 connections now open) 2015-10-05T09:54:37.981+0100 [mongosMain] connection accepted from 172.28.0.163:57733 #1433751 (302 connections now open) 2015-10-05T09:54:37.983+0100 [conn1433751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:39.356+0100 [mongosMain] connection accepted from 127.0.0.1:57735 #1433752 (303 connections now open) 2015-10-05T09:54:39.358+0100 [conn1433752] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:39.364+0100 [conn1433752] end connection 127.0.0.1:57735 (302 connections now open) 2015-10-05T09:54:41.054+0100 [conn1433489] end connection 172.28.0.164:49585 (301 connections now open) 2015-10-05T09:54:41.055+0100 [mongosMain] connection accepted from 172.28.0.164:51066 #1433753 (302 connections now open) 2015-10-05T09:54:41.055+0100 [conn1433492] end connection 172.28.0.164:49605 (300 connections now open) 2015-10-05T09:54:41.056+0100 [mongosMain] connection accepted from 172.28.0.164:51067 #1433754 (302 connections now open) 2015-10-05T09:54:41.057+0100 [conn1433753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:41.058+0100 [conn1433754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:45.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ad25703b51053ef8d9e 2015-10-05T09:54:45.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:54:50.826+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:54:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:54:51.054+0100 [conn1433321] end connection 172.28.0.164:65416 (301 connections now open) 2015-10-05T09:54:51.054+0100 [mongosMain] connection accepted from 172.28.0.164:51085 #1433755 (302 connections now open) 2015-10-05T09:54:51.055+0100 [conn1433406] end connection 172.28.0.164:49461 (301 connections now open) 2015-10-05T09:54:51.056+0100 [mongosMain] connection accepted from 172.28.0.164:51086 #1433756 (302 connections now open) 2015-10-05T09:54:51.057+0100 [conn1433755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:51.058+0100 [conn1433756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:51.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123adb5703b51053ef8e55 2015-10-05T09:54:51.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:54:55.073+0100 [conn1433495] end connection 172.28.0.163:56793 (301 connections now open) 2015-10-05T09:54:55.074+0100 [mongosMain] connection accepted from 172.28.0.163:57761 #1433757 (302 connections now open) 2015-10-05T09:54:55.075+0100 [conn1433757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:54:58.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ae15703b51053ef8ebd 2015-10-05T09:54:58.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:01.739+0100 [conn1433519] end connection 172.28.0.164:49698 (301 connections now open) 2015-10-05T09:55:01.740+0100 [conn1433042] end connection 172.28.0.164:64493 (300 connections now open) 2015-10-05T09:55:01.742+0100 [mongosMain] connection accepted from 172.28.0.164:51099 #1433758 (301 connections now open) 2015-10-05T09:55:01.744+0100 [conn1433758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:01.745+0100 [mongosMain] connection accepted from 172.28.0.164:51101 #1433759 (302 connections now open) 2015-10-05T09:55:01.747+0100 [conn1433759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:05.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ae85703b51053ef8f3f 2015-10-05T09:55:05.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:11.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123aef5703b51053ef8fee 2015-10-05T09:55:11.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:11.760+0100 [conn1433048] end connection 172.28.0.164:64503 (301 connections now open) 2015-10-05T09:55:11.761+0100 [conn1433522] end connection 172.28.0.164:49721 (300 connections now open) 2015-10-05T09:55:11.761+0100 [mongosMain] connection accepted from 172.28.0.164:51121 #1433760 (302 connections now open) 2015-10-05T09:55:11.762+0100 [mongosMain] connection accepted from 172.28.0.164:51122 #1433761 (302 connections now open) 2015-10-05T09:55:11.762+0100 [conn1433760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:11.763+0100 [conn1433761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:15.141+0100 [conn1433385] end connection 172.28.0.163:56463 (301 connections now open) 2015-10-05T09:55:15.141+0100 [mongosMain] connection accepted from 172.28.0.163:57799 #1433762 (302 connections now open) 2015-10-05T09:55:15.142+0100 [conn1433762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:17.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123af55703b51053ef906c 2015-10-05T09:55:17.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:20.975+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:55:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:55:21.756+0100 [conn1433219] end connection 172.28.0.164:65078 (301 connections now open) 2015-10-05T09:55:21.756+0100 [conn1433482] end connection 172.28.0.164:49566 (300 connections now open) 2015-10-05T09:55:21.757+0100 [mongosMain] connection accepted from 172.28.0.164:51135 #1433763 (301 connections now open) 2015-10-05T09:55:21.757+0100 [mongosMain] connection accepted from 172.28.0.164:51136 #1433764 (302 connections now open) 2015-10-05T09:55:21.759+0100 [conn1433763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:21.759+0100 [conn1433764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:24.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123afb5703b51053ef90d1 2015-10-05T09:55:25.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:25.177+0100 [conn1433390] end connection 172.28.0.163:56503 (301 connections now open) 2015-10-05T09:55:25.184+0100 [mongosMain] connection accepted from 172.28.0.163:57807 #1433765 (302 connections now open) 2015-10-05T09:55:25.185+0100 [conn1433765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:28.932+0100 [mongosMain] connection accepted from 127.0.0.1:57809 #1433766 (303 connections now open) 2015-10-05T09:55:28.934+0100 [conn1433766] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:28.940+0100 [conn1433766] end connection 127.0.0.1:57809 (302 connections now open) 2015-10-05T09:55:31.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b035703b51053ef914c 2015-10-05T09:55:31.626+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:55:31.773+0100 [conn1433515] end connection 172.28.0.164:49678 (301 connections now open) 2015-10-05T09:55:31.773+0100 [conn1433328] end connection 172.28.0.164:65436 (301 connections now open) 2015-10-05T09:55:31.774+0100 [mongosMain] connection accepted from 172.28.0.164:51148 #1433767 (301 connections now open) 2015-10-05T09:55:31.774+0100 [mongosMain] connection accepted from 172.28.0.164:51149 #1433768 (302 connections now open) 2015-10-05T09:55:31.778+0100 [conn1433768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:31.779+0100 [conn1433767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:35.164+0100 [conn1433487] end connection 172.28.0.163:56755 (301 connections now open) 2015-10-05T09:55:35.165+0100 [mongosMain] connection accepted from 172.28.0.163:57814 #1433769 (302 connections now open) 2015-10-05T09:55:35.166+0100 [conn1433769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:38.015+0100 [conn1433432] end connection 172.28.0.163:56636 (301 connections now open) 2015-10-05T09:55:38.017+0100 [mongosMain] connection accepted from 172.28.0.163:57818 #1433770 (302 connections now open) 2015-10-05T09:55:38.019+0100 [conn1433770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:39.658+0100 [mongosMain] connection accepted from 127.0.0.1:57820 #1433771 (303 connections now open) 2015-10-05T09:55:39.660+0100 [conn1433771] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:39.664+0100 [conn1433771] end connection 127.0.0.1:57820 (302 connections now open) 2015-10-05T09:55:41.831+0100 [conn1433493] end connection 172.28.0.164:49606 (301 connections now open) 2015-10-05T09:55:41.833+0100 [mongosMain] connection accepted from 172.28.0.164:51168 #1433772 (302 connections now open) 2015-10-05T09:55:41.833+0100 [conn1432998] end connection 172.28.0.164:64377 (301 connections now open) 2015-10-05T09:55:41.834+0100 [conn1433772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:41.834+0100 [mongosMain] connection accepted from 172.28.0.164:51170 #1433773 (302 connections now open) 2015-10-05T09:55:41.836+0100 [conn1433773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:43.714+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:55:43.714+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:55:45.200+0100 [conn1433120] end connection 172.28.0.163:55596 (301 connections now open) 2015-10-05T09:55:45.202+0100 [mongosMain] connection accepted from 172.28.0.163:57826 #1433774 (302 connections now open) 2015-10-05T09:55:45.203+0100 [conn1433774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:51.211+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:55:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:55:51.834+0100 [conn1433498] end connection 172.28.0.164:49617 (301 connections now open) 2015-10-05T09:55:51.834+0100 [conn1433540] end connection 172.28.0.164:49798 (300 connections now open) 2015-10-05T09:55:51.835+0100 [mongosMain] connection accepted from 172.28.0.164:51184 #1433775 (301 connections now open) 2015-10-05T09:55:51.836+0100 [mongosMain] connection accepted from 172.28.0.164:51185 #1433776 (302 connections now open) 2015-10-05T09:55:51.837+0100 [conn1433775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:51.837+0100 [conn1433776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:55.173+0100 [conn1433502] end connection 172.28.0.163:56802 (301 connections now open) 2015-10-05T09:55:55.174+0100 [mongosMain] connection accepted from 172.28.0.163:57844 #1433777 (302 connections now open) 2015-10-05T09:55:55.175+0100 [conn1433777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:55:56.024+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b1b5703b51053ef92e3 2015-10-05T09:55:56.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:56:01.921+0100 [conn1433339] end connection 172.28.0.164:65483 (301 connections now open) 2015-10-05T09:56:01.923+0100 [conn1433547] end connection 172.28.0.164:49832 (300 connections now open) 2015-10-05T09:56:01.923+0100 [mongosMain] connection accepted from 172.28.0.164:51191 #1433778 (301 connections now open) 2015-10-05T09:56:01.924+0100 [mongosMain] connection accepted from 172.28.0.164:51192 #1433779 (302 connections now open) 2015-10-05T09:56:01.928+0100 [conn1433779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:01.929+0100 [conn1433778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:05.178+0100 [conn1433393] end connection 172.28.0.163:56518 (301 connections now open) 2015-10-05T09:56:05.179+0100 [mongosMain] connection accepted from 172.28.0.163:57877 #1433780 (302 connections now open) 2015-10-05T09:56:05.180+0100 [conn1433780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:08.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b285703b51053ef93b5 2015-10-05T09:56:08.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:56:11.927+0100 [conn1433551] end connection 172.28.0.164:49845 (301 connections now open) 2015-10-05T09:56:11.928+0100 [conn1433200] end connection 172.28.0.164:65025 (300 connections now open) 2015-10-05T09:56:11.928+0100 [mongosMain] connection accepted from 172.28.0.164:51211 #1433781 (302 connections now open) 2015-10-05T09:56:11.929+0100 [mongosMain] connection accepted from 172.28.0.164:51212 #1433782 (302 connections now open) 2015-10-05T09:56:11.930+0100 [conn1433782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:11.930+0100 [conn1433781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:15.188+0100 [conn1433508] end connection 172.28.0.163:56807 (301 connections now open) 2015-10-05T09:56:15.189+0100 [mongosMain] connection accepted from 172.28.0.163:57891 #1433783 (302 connections now open) 2015-10-05T09:56:15.189+0100 [conn1433783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:21.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b345703b51053ef9455 2015-10-05T09:56:21.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:56:21.518+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:56:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:56:21.943+0100 [conn1433510] end connection 172.28.0.164:49653 (301 connections now open) 2015-10-05T09:56:21.944+0100 [mongosMain] connection accepted from 172.28.0.164:51226 #1433784 (302 connections now open) 2015-10-05T09:56:21.945+0100 [conn1433784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:25.204+0100 [conn1433491] end connection 172.28.0.163:56776 (301 connections now open) 2015-10-05T09:56:25.205+0100 [mongosMain] connection accepted from 172.28.0.163:57898 #1433785 (302 connections now open) 2015-10-05T09:56:25.206+0100 [conn1433785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:28.605+0100 [mongosMain] connection accepted from 127.0.0.1:57900 #1433786 (303 connections now open) 2015-10-05T09:56:28.608+0100 [conn1433786] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:28.612+0100 [conn1433786] end connection 127.0.0.1:57900 (302 connections now open) 2015-10-05T09:56:31.943+0100 [conn1433307] end connection 172.28.0.164:65382 (301 connections now open) 2015-10-05T09:56:31.952+0100 [mongosMain] connection accepted from 172.28.0.164:51239 #1433787 (302 connections now open) 2015-10-05T09:56:31.954+0100 [conn1433787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:35.312+0100 [conn1433481] end connection 172.28.0.163:56738 (301 connections now open) 2015-10-05T09:56:35.314+0100 [mongosMain] connection accepted from 172.28.0.163:57902 #1433788 (302 connections now open) 2015-10-05T09:56:35.315+0100 [conn1433788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:38.028+0100 [conn1433433] end connection 172.28.0.163:56638 (301 connections now open) 2015-10-05T09:56:38.029+0100 [mongosMain] connection accepted from 172.28.0.163:57906 #1433789 (302 connections now open) 2015-10-05T09:56:38.031+0100 [conn1433789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:39.308+0100 [mongosMain] connection accepted from 127.0.0.1:57908 #1433790 (303 connections now open) 2015-10-05T09:56:39.311+0100 [conn1433790] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:39.315+0100 [conn1433790] end connection 127.0.0.1:57908 (302 connections now open) 2015-10-05T09:56:41.959+0100 [conn1433214] end connection 172.28.0.164:65054 (301 connections now open) 2015-10-05T09:56:41.961+0100 [mongosMain] connection accepted from 172.28.0.164:51252 #1433791 (302 connections now open) 2015-10-05T09:56:41.962+0100 [conn1433791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:45.229+0100 [conn1433560] end connection 172.28.0.163:56980 (301 connections now open) 2015-10-05T09:56:45.230+0100 [mongosMain] connection accepted from 172.28.0.163:57914 #1433792 (302 connections now open) 2015-10-05T09:56:45.231+0100 [conn1433792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:52.083+0100 [conn1433333] end connection 172.28.0.164:65455 (301 connections now open) 2015-10-05T09:56:52.084+0100 [mongosMain] connection accepted from 172.28.0.164:51267 #1433793 (302 connections now open) 2015-10-05T09:56:52.086+0100 [conn1433793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:52.293+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:56:52.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:56:53.623+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:56:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:56:55.223+0100 [conn1433513] end connection 172.28.0.163:56818 (301 connections now open) 2015-10-05T09:56:55.224+0100 [mongosMain] connection accepted from 172.28.0.163:57931 #1433794 (302 connections now open) 2015-10-05T09:56:55.225+0100 [conn1433794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:56:58.879+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:56:58.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:57:02.187+0100 [conn1433504] end connection 172.28.0.164:49638 (301 connections now open) 2015-10-05T09:57:02.188+0100 [conn1433530] end connection 172.28.0.164:49751 (300 connections now open) 2015-10-05T09:57:02.189+0100 [mongosMain] connection accepted from 172.28.0.164:51283 #1433795 (301 connections now open) 2015-10-05T09:57:02.190+0100 [conn1433795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:02.190+0100 [mongosMain] connection accepted from 172.28.0.164:51284 #1433796 (302 connections now open) 2015-10-05T09:57:02.192+0100 [conn1433796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:05.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b605703b51053ef97ca 2015-10-05T09:57:05.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:57:05.235+0100 [conn1433567] end connection 172.28.0.163:57029 (301 connections now open) 2015-10-05T09:57:05.236+0100 [mongosMain] connection accepted from 172.28.0.163:57960 #1433797 (302 connections now open) 2015-10-05T09:57:05.237+0100 [conn1433797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:12.147+0100 [conn1433535] end connection 172.28.0.164:49775 (301 connections now open) 2015-10-05T09:57:12.147+0100 [mongosMain] connection accepted from 172.28.0.164:51300 #1433798 (302 connections now open) 2015-10-05T09:57:12.149+0100 [conn1433798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:15.236+0100 [conn1433565] end connection 172.28.0.163:57015 (301 connections now open) 2015-10-05T09:57:15.238+0100 [mongosMain] connection accepted from 172.28.0.163:57972 #1433799 (302 connections now open) 2015-10-05T09:57:15.239+0100 [conn1433799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:22.162+0100 [conn1433497] end connection 172.28.0.164:49616 (301 connections now open) 2015-10-05T09:57:22.164+0100 [mongosMain] connection accepted from 172.28.0.164:51311 #1433800 (302 connections now open) 2015-10-05T09:57:22.166+0100 [conn1433800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:23.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b735703b51053ef993b 2015-10-05T09:57:23.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:57:24.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:57:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:57:28.483+0100 [mongosMain] connection accepted from 127.0.0.1:57978 #1433801 (303 connections now open) 2015-10-05T09:57:28.486+0100 [conn1433801] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:28.490+0100 [conn1433801] end connection 127.0.0.1:57978 (302 connections now open) 2015-10-05T09:57:38.044+0100 [conn1433434] end connection 172.28.0.163:56640 (301 connections now open) 2015-10-05T09:57:38.046+0100 [mongosMain] connection accepted from 172.28.0.163:57986 #1433802 (302 connections now open) 2015-10-05T09:57:38.048+0100 [conn1433802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:39.410+0100 [mongosMain] connection accepted from 127.0.0.1:57988 #1433803 (303 connections now open) 2015-10-05T09:57:39.412+0100 [conn1433803] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:57:39.417+0100 [conn1433803] end connection 127.0.0.1:57988 (302 connections now open) 2015-10-05T09:57:54.152+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:57:54.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:57:55.110+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:57:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:58:00.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b985703b51053ef9b82 2015-10-05T09:58:00.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:06.583+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123b9e5703b51053ef9c11 2015-10-05T09:58:06.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:15.331+0100 [conn1433568] end connection 172.28.0.163:57046 (301 connections now open) 2015-10-05T09:58:15.332+0100 [mongosMain] connection accepted from 172.28.0.163:58047 #1433804 (302 connections now open) 2015-10-05T09:58:15.333+0100 [conn1433804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:18.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123baa5703b51053ef9cd1 2015-10-05T09:58:18.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:22.303+0100 [conn1433555] end connection 172.28.0.164:49862 (301 connections now open) 2015-10-05T09:58:22.305+0100 [mongosMain] connection accepted from 172.28.0.164:51390 #1433805 (302 connections now open) 2015-10-05T09:58:22.306+0100 [conn1433805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:25.337+0100 [conn1433589] end connection 172.28.0.163:57137 (301 connections now open) 2015-10-05T09:58:25.339+0100 [mongosMain] connection accepted from 172.28.0.163:58053 #1433806 (302 connections now open) 2015-10-05T09:58:25.340+0100 [conn1433806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:25.564+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:58:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:58:25.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bb15703b51053ef9d59 2015-10-05T09:58:25.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:28.681+0100 [mongosMain] connection accepted from 127.0.0.1:58055 #1433807 (303 connections now open) 2015-10-05T09:58:28.683+0100 [conn1433807] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:28.689+0100 [conn1433807] end connection 127.0.0.1:58055 (302 connections now open) 2015-10-05T09:58:31.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bb75703b51053ef9db3 2015-10-05T09:58:32.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:32.319+0100 [conn1433600] end connection 172.28.0.164:50055 (301 connections now open) 2015-10-05T09:58:32.321+0100 [mongosMain] connection accepted from 172.28.0.164:51403 #1433808 (302 connections now open) 2015-10-05T09:58:32.323+0100 [conn1433808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:35.349+0100 [conn1433586] end connection 172.28.0.163:57124 (301 connections now open) 2015-10-05T09:58:35.350+0100 [mongosMain] connection accepted from 172.28.0.163:58058 #1433809 (302 connections now open) 2015-10-05T09:58:35.352+0100 [conn1433809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:38.060+0100 [conn1433435] end connection 172.28.0.163:56641 (301 connections now open) 2015-10-05T09:58:38.061+0100 [mongosMain] connection accepted from 172.28.0.163:58060 #1433810 (302 connections now open) 2015-10-05T09:58:38.064+0100 [conn1433810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:38.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bbe5703b51053ef9e22 2015-10-05T09:58:38.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:58:39.541+0100 [mongosMain] connection accepted from 127.0.0.1:58062 #1433811 (303 connections now open) 2015-10-05T09:58:39.544+0100 [conn1433811] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:39.551+0100 [conn1433811] end connection 127.0.0.1:58062 (302 connections now open) 2015-10-05T09:58:42.335+0100 [conn1433602] end connection 172.28.0.164:50073 (301 connections now open) 2015-10-05T09:58:42.335+0100 [mongosMain] connection accepted from 172.28.0.164:51426 #1433812 (302 connections now open) 2015-10-05T09:58:42.337+0100 [conn1433812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:45.404+0100 [conn1433496] end connection 172.28.0.163:56794 (301 connections now open) 2015-10-05T09:58:45.404+0100 [mongosMain] connection accepted from 172.28.0.163:58074 #1433813 (302 connections now open) 2015-10-05T09:58:45.404+0100 [conn1433813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:52.336+0100 [conn1433543] end connection 172.28.0.164:49814 (301 connections now open) 2015-10-05T09:58:52.336+0100 [mongosMain] connection accepted from 172.28.0.164:51441 #1433814 (302 connections now open) 2015-10-05T09:58:52.337+0100 [conn1433814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:55.365+0100 [conn1433571] end connection 172.28.0.163:57052 (301 connections now open) 2015-10-05T09:58:55.366+0100 [mongosMain] connection accepted from 172.28.0.163:58086 #1433815 (302 connections now open) 2015-10-05T09:58:55.367+0100 [conn1433815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:58:55.850+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:58:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:58:57.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bd05703b51053ef9fb6 2015-10-05T09:58:58.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:02.907+0100 [conn1433611] end connection 172.28.0.164:50106 (301 connections now open) 2015-10-05T09:59:02.910+0100 [conn1433596] end connection 172.28.0.164:50022 (300 connections now open) 2015-10-05T09:59:02.912+0100 [mongosMain] connection accepted from 172.28.0.164:51452 #1433816 (301 connections now open) 2015-10-05T09:59:02.915+0100 [conn1433816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:02.916+0100 [mongosMain] connection accepted from 172.28.0.164:51454 #1433817 (302 connections now open) 2015-10-05T09:59:02.918+0100 [conn1433817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:04.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bd85703b51053efa018 2015-10-05T09:59:04.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:05.369+0100 [conn1433563] end connection 172.28.0.163:56993 (301 connections now open) 2015-10-05T09:59:05.382+0100 [mongosMain] connection accepted from 172.28.0.163:58112 #1433818 (302 connections now open) 2015-10-05T09:59:05.383+0100 [conn1433818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:10.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bde5703b51053efa0a4 2015-10-05T09:59:10.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:12.993+0100 [conn1433576] end connection 172.28.0.164:49952 (301 connections now open) 2015-10-05T09:59:12.999+0100 [mongosMain] connection accepted from 172.28.0.164:51464 #1433819 (302 connections now open) 2015-10-05T09:59:13.000+0100 [conn1433819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:15.378+0100 [conn1433578] end connection 172.28.0.163:57064 (301 connections now open) 2015-10-05T09:59:15.379+0100 [mongosMain] connection accepted from 172.28.0.163:58123 #1433820 (302 connections now open) 2015-10-05T09:59:15.380+0100 [conn1433820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:16.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123be45703b51053efa0fe 2015-10-05T09:59:17.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:22.991+0100 [conn1433614] end connection 172.28.0.164:50126 (301 connections now open) 2015-10-05T09:59:22.992+0100 [conn1433558] end connection 172.28.0.164:49875 (300 connections now open) 2015-10-05T09:59:22.992+0100 [mongosMain] connection accepted from 172.28.0.164:51481 #1433821 (301 connections now open) 2015-10-05T09:59:22.993+0100 [mongosMain] connection accepted from 172.28.0.164:51482 #1433822 (302 connections now open) 2015-10-05T09:59:22.994+0100 [conn1433821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:22.995+0100 [conn1433822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:23.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123beb5703b51053efa175 2015-10-05T09:59:23.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:25.764+0100 [conn1433606] end connection 172.28.0.163:57210 (301 connections now open) 2015-10-05T09:59:25.768+0100 [mongosMain] connection accepted from 172.28.0.163:58130 #1433823 (302 connections now open) 2015-10-05T09:59:25.768+0100 [conn1433823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:26.603+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:59:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T09:59:28.327+0100 [mongosMain] connection accepted from 127.0.0.1:58135 #1433824 (303 connections now open) 2015-10-05T09:59:28.331+0100 [conn1433824] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:28.336+0100 [conn1433824] end connection 127.0.0.1:58135 (302 connections now open) 2015-10-05T09:59:29.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bf15703b51053efa22c 2015-10-05T09:59:29.918+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:32.991+0100 [conn1433414] end connection 172.28.0.164:49509 (301 connections now open) 2015-10-05T09:59:32.992+0100 [conn1433591] end connection 172.28.0.164:50008 (300 connections now open) 2015-10-05T09:59:32.993+0100 [mongosMain] connection accepted from 172.28.0.164:51497 #1433825 (301 connections now open) 2015-10-05T09:59:32.993+0100 [mongosMain] connection accepted from 172.28.0.164:51496 #1433826 (302 connections now open) 2015-10-05T09:59:32.995+0100 [conn1433825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:32.996+0100 [conn1433826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:35.631+0100 [conn1433583] end connection 172.28.0.163:57109 (301 connections now open) 2015-10-05T09:59:35.632+0100 [mongosMain] connection accepted from 172.28.0.163:58136 #1433827 (302 connections now open) 2015-10-05T09:59:35.632+0100 [conn1433827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:36.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bf75703b51053efa2f8 2015-10-05T09:59:36.154+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:38.075+0100 [conn1433436] end connection 172.28.0.163:56642 (301 connections now open) 2015-10-05T09:59:38.076+0100 [mongosMain] connection accepted from 172.28.0.163:58138 #1433828 (302 connections now open) 2015-10-05T09:59:38.079+0100 [conn1433828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:39.935+0100 [mongosMain] connection accepted from 127.0.0.1:58140 #1433829 (303 connections now open) 2015-10-05T09:59:39.937+0100 [conn1433829] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:39.942+0100 [conn1433829] end connection 127.0.0.1:58140 (302 connections now open) 2015-10-05T09:59:43.431+0100 [conn1433595] end connection 172.28.0.164:50023 (301 connections now open) 2015-10-05T09:59:43.436+0100 [mongosMain] connection accepted from 172.28.0.164:51514 #1433830 (302 connections now open) 2015-10-05T09:59:43.441+0100 [conn1433830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:43.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123bff5703b51053efa3be 2015-10-05T09:59:43.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:45.630+0100 [conn1433581] end connection 172.28.0.163:57082 (301 connections now open) 2015-10-05T09:59:45.631+0100 [mongosMain] connection accepted from 172.28.0.163:58152 #1433831 (302 connections now open) 2015-10-05T09:59:45.637+0100 [conn1433831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:50.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c055703b51053efa489 2015-10-05T09:59:50.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T09:59:53.427+0100 [conn1433619] end connection 172.28.0.164:50164 (301 connections now open) 2015-10-05T09:59:53.428+0100 [mongosMain] connection accepted from 172.28.0.164:51529 #1433832 (302 connections now open) 2015-10-05T09:59:53.429+0100 [conn1433832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T09:59:57.095+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T09:59:57.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T09:59:57.232+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 09:59:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:00:03.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c135703b51053efa5ef 2015-10-05T10:00:03.834+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:00:16.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c1f5703b51053efa971 2015-10-05T10:00:16.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:00:23.459+0100 [conn1433616] end connection 172.28.0.164:50137 (301 connections now open) 2015-10-05T10:00:23.460+0100 [mongosMain] connection accepted from 172.28.0.164:51578 #1433833 (302 connections now open) 2015-10-05T10:00:23.461+0100 [conn1433833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:27.386+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:00:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:00:28.690+0100 [mongosMain] connection accepted from 127.0.0.1:58213 #1433834 (303 connections now open) 2015-10-05T10:00:28.693+0100 [conn1433834] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:28.699+0100 [conn1433834] end connection 127.0.0.1:58213 (302 connections now open) 2015-10-05T10:00:28.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c2c5703b51053efacbf 2015-10-05T10:00:29.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:00:33.476+0100 [conn1433531] end connection 172.28.0.164:49750 (301 connections now open) 2015-10-05T10:00:33.476+0100 [mongosMain] connection accepted from 172.28.0.164:51589 #1433835 (302 connections now open) 2015-10-05T10:00:33.478+0100 [conn1433835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:37.948+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:00:37.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:00:38.092+0100 [conn1433437] end connection 172.28.0.163:56643 (301 connections now open) 2015-10-05T10:00:38.093+0100 [mongosMain] connection accepted from 172.28.0.163:58219 #1433836 (302 connections now open) 2015-10-05T10:00:38.094+0100 [conn1433836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:39.685+0100 [mongosMain] connection accepted from 127.0.0.1:58224 #1433837 (303 connections now open) 2015-10-05T10:00:39.694+0100 [conn1433837] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:39.700+0100 [conn1433837] end connection 127.0.0.1:58224 (302 connections now open) 2015-10-05T10:00:43.506+0100 [conn1433608] end connection 172.28.0.164:50092 (301 connections now open) 2015-10-05T10:00:43.507+0100 [mongosMain] connection accepted from 172.28.0.164:51616 #1433838 (302 connections now open) 2015-10-05T10:00:43.508+0100 [conn1433838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:45.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c3b5703b51053efb0e7 2015-10-05T10:00:45.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:00:53.521+0100 [conn1433624] end connection 172.28.0.164:50196 (301 connections now open) 2015-10-05T10:00:53.522+0100 [mongosMain] connection accepted from 172.28.0.164:51630 #1433839 (302 connections now open) 2015-10-05T10:00:53.524+0100 [conn1433839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:00:58.108+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:00:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:01:03.538+0100 [conn1433599] end connection 172.28.0.164:50042 (301 connections now open) 2015-10-05T10:01:03.538+0100 [conn1433598] end connection 172.28.0.164:50041 (301 connections now open) 2015-10-05T10:01:03.538+0100 [mongosMain] connection accepted from 172.28.0.164:51652 #1433840 (301 connections now open) 2015-10-05T10:01:03.539+0100 [mongosMain] connection accepted from 172.28.0.164:51653 #1433841 (302 connections now open) 2015-10-05T10:01:03.540+0100 [conn1433841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:03.541+0100 [conn1433840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:04.799+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123c4b03838a4537162e85') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444035664606), why: "doing balance round", ts: ObjectId('56123c505703b51053efb6f9') } } gle1: { lastOp: Timestamp 1444035645000|8, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 25, writtenTo: null, err: null, waited: 25, ok: 1.0 } gle2: { lastOp: Timestamp 1444035664000|5, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2015-10-05T10:01:04.802+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:01:04.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c505703b51053efb6f9 2015-10-05T10:01:05.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:01:11.414+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:01:11.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:01:17.239+0100 [mongosMain] connection accepted from 172.28.0.163:58325 #1433842 (303 connections now open) 2015-10-05T10:01:17.240+0100 [conn1433842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:17.671+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:01:17.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:01:19.054+0100 [conn1433637] end connection 172.28.0.163:57395 (302 connections now open) 2015-10-05T10:01:19.063+0100 [mongosMain] connection accepted from 172.28.0.163:58338 #1433843 (303 connections now open) 2015-10-05T10:01:19.064+0100 [conn1433843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:19.648+0100 [mongosMain] connection accepted from 172.21.40.52:53125 #1433844 (304 connections now open) 2015-10-05T10:01:19.781+0100 [mongosMain] connection accepted from 172.21.40.52:53126 #1433845 (305 connections now open) 2015-10-05T10:01:19.860+0100 [conn1433845] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:22.633+0100 [conn1433845] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:01:22.641+0100 [conn1433845] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:01:22.646+0100 [conn1433845] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:01:24.454+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:01:24.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:01:28.275+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:01:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:01:28.696+0100 [mongosMain] connection accepted from 127.0.0.1:58348 #1433846 (306 connections now open) 2015-10-05T10:01:28.703+0100 [conn1433846] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:28.704+0100 [conn1433846] end connection 127.0.0.1:58348 (305 connections now open) 2015-10-05T10:01:29.071+0100 [conn1433642] end connection 172.28.0.163:57440 (304 connections now open) 2015-10-05T10:01:29.072+0100 [mongosMain] connection accepted from 172.28.0.163:58349 #1433847 (305 connections now open) 2015-10-05T10:01:29.072+0100 [conn1433847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:30.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c6a5703b51053efbea2 2015-10-05T10:01:30.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:01:38.109+0100 [conn1433438] end connection 172.28.0.163:56645 (304 connections now open) 2015-10-05T10:01:38.110+0100 [mongosMain] connection accepted from 172.28.0.163:58356 #1433848 (305 connections now open) 2015-10-05T10:01:38.111+0100 [conn1433848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:39.075+0100 [conn1433626] end connection 172.28.0.163:57300 (304 connections now open) 2015-10-05T10:01:39.076+0100 [mongosMain] connection accepted from 172.28.0.163:58358 #1433849 (305 connections now open) 2015-10-05T10:01:39.077+0100 [conn1433849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:39.457+0100 [mongosMain] connection accepted from 127.0.0.1:58361 #1433850 (306 connections now open) 2015-10-05T10:01:39.460+0100 [conn1433850] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:39.460+0100 [conn1433850] end connection 127.0.0.1:58361 (305 connections now open) 2015-10-05T10:01:40.037+0100 [conn1433845] DROP: audits.AppError 2015-10-05T10:01:40.037+0100 [conn1433845] drop going to do passthrough 2015-10-05T10:01:43.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c765703b51053efc1ce 2015-10-05T10:01:43.284+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:01:50.611+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:01:50.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:01:56.269+0100 [conn1433590] end connection 172.28.0.164:50007 (304 connections now open) 2015-10-05T10:01:56.270+0100 [mongosMain] connection accepted from 172.28.0.164:51736 #1433851 (305 connections now open) 2015-10-05T10:01:56.271+0100 [conn1433851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:01:59.616+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:01:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:02:06.270+0100 [conn1433605] end connection 172.28.0.164:50076 (304 connections now open) 2015-10-05T10:02:06.273+0100 [mongosMain] connection accepted from 172.28.0.164:51748 #1433852 (305 connections now open) 2015-10-05T10:02:06.275+0100 [conn1433852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:16.283+0100 [conn1433639] end connection 172.28.0.164:50383 (304 connections now open) 2015-10-05T10:02:16.284+0100 [mongosMain] connection accepted from 172.28.0.164:51754 #1433853 (305 connections now open) 2015-10-05T10:02:16.286+0100 [conn1433853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:16.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123c965703b51053efc7a4 2015-10-05T10:02:16.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:02:19.139+0100 [conn1433634] end connection 172.28.0.163:57383 (304 connections now open) 2015-10-05T10:02:19.140+0100 [mongosMain] connection accepted from 172.28.0.163:58429 #1433854 (305 connections now open) 2015-10-05T10:02:19.141+0100 [conn1433854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:26.283+0100 [conn1433638] end connection 172.28.0.164:50346 (304 connections now open) 2015-10-05T10:02:26.288+0100 [mongosMain] connection accepted from 172.28.0.164:51769 #1433855 (305 connections now open) 2015-10-05T10:02:26.290+0100 [conn1433855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:29.203+0100 [conn1433617] end connection 172.28.0.163:57258 (304 connections now open) 2015-10-05T10:02:29.206+0100 [mongosMain] connection accepted from 172.28.0.163:58433 #1433856 (305 connections now open) 2015-10-05T10:02:29.208+0100 [conn1433856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:29.344+0100 [mongosMain] connection accepted from 127.0.0.1:58436 #1433857 (306 connections now open) 2015-10-05T10:02:29.359+0100 [conn1433857] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:29.361+0100 [conn1433857] end connection 127.0.0.1:58436 (305 connections now open) 2015-10-05T10:02:29.763+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:02:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:02:34.711+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123caa5703b51053efcaca 2015-10-05T10:02:34.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:02:36.298+0100 [conn1433647] end connection 172.28.0.164:50510 (304 connections now open) 2015-10-05T10:02:36.299+0100 [mongosMain] connection accepted from 172.28.0.164:51780 #1433858 (305 connections now open) 2015-10-05T10:02:36.301+0100 [conn1433858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:38.124+0100 [conn1433439] end connection 172.28.0.163:56648 (304 connections now open) 2015-10-05T10:02:38.125+0100 [mongosMain] connection accepted from 172.28.0.163:58440 #1433859 (305 connections now open) 2015-10-05T10:02:38.128+0100 [conn1433859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:39.386+0100 [conn1433631] end connection 172.28.0.163:57375 (304 connections now open) 2015-10-05T10:02:39.388+0100 [mongosMain] connection accepted from 172.28.0.163:58442 #1433860 (305 connections now open) 2015-10-05T10:02:39.389+0100 [conn1433860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:39.770+0100 [mongosMain] connection accepted from 127.0.0.1:58443 #1433861 (306 connections now open) 2015-10-05T10:02:39.773+0100 [conn1433861] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:39.773+0100 [conn1433861] end connection 127.0.0.1:58443 (305 connections now open) 2015-10-05T10:02:46.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cb65703b51053efcd41 2015-10-05T10:02:47.015+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:02:49.375+0100 [conn1433615] end connection 172.28.0.163:57239 (304 connections now open) 2015-10-05T10:02:49.376+0100 [mongosMain] connection accepted from 172.28.0.163:58457 #1433862 (305 connections now open) 2015-10-05T10:02:49.376+0100 [conn1433862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:02:53.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cbd5703b51053efce63 2015-10-05T10:02:53.302+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:02:59.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cc35703b51053efcf08 2015-10-05T10:02:59.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:02:59.911+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:02:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:03:06.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cc95703b51053efd020 2015-10-05T10:03:06.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:06.591+0100 [conn1433282] end connection 172.28.0.164:65298 (304 connections now open) 2015-10-05T10:03:06.592+0100 [mongosMain] connection accepted from 172.28.0.164:51822 #1433863 (305 connections now open) 2015-10-05T10:03:06.594+0100 [conn1433863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:12.627+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cd05703b51053efd13e 2015-10-05T10:03:12.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:16.597+0100 [conn1433488] end connection 172.28.0.164:49584 (304 connections now open) 2015-10-05T10:03:16.598+0100 [conn1433660] end connection 172.28.0.164:50747 (303 connections now open) 2015-10-05T10:03:16.598+0100 [mongosMain] connection accepted from 172.28.0.164:51828 #1433864 (305 connections now open) 2015-10-05T10:03:16.599+0100 [mongosMain] connection accepted from 172.28.0.164:51829 #1433865 (305 connections now open) 2015-10-05T10:03:16.600+0100 [conn1433864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:16.600+0100 [conn1433865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:19.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cd65703b51053efd232 2015-10-05T10:03:19.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:21.560+0100 [conn1433644] end connection 172.28.0.163:57449 (304 connections now open) 2015-10-05T10:03:21.561+0100 [mongosMain] connection accepted from 172.28.0.163:58503 #1433866 (305 connections now open) 2015-10-05T10:03:21.561+0100 [conn1433866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:26.595+0100 [conn1433630] end connection 172.28.0.164:50257 (304 connections now open) 2015-10-05T10:03:26.595+0100 [conn1433573] end connection 172.28.0.164:49941 (303 connections now open) 2015-10-05T10:03:26.596+0100 [mongosMain] connection accepted from 172.28.0.164:51849 #1433867 (304 connections now open) 2015-10-05T10:03:26.597+0100 [mongosMain] connection accepted from 172.28.0.164:51850 #1433868 (305 connections now open) 2015-10-05T10:03:26.598+0100 [conn1433868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:26.599+0100 [conn1433867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:28.935+0100 [mongosMain] connection accepted from 127.0.0.1:58512 #1433869 (306 connections now open) 2015-10-05T10:03:28.938+0100 [conn1433869] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:28.939+0100 [conn1433869] end connection 127.0.0.1:58512 (305 connections now open) 2015-10-05T10:03:32.458+0100 [conn1433666] end connection 172.28.0.163:57607 (304 connections now open) 2015-10-05T10:03:32.462+0100 [mongosMain] connection accepted from 172.28.0.163:58517 #1433870 (305 connections now open) 2015-10-05T10:03:32.463+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123ce03b0f755fc335cca9') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444035811279), why: "doing balance round", ts: ObjectId('56123ce35703b51053efd404') } } gle1: { lastOp: Timestamp 1444035799000|1, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 605, writtenTo: null, err: null, waited: 605, ok: 1.0 } gle2: { lastOp: Timestamp 1444035811000|4, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } 2015-10-05T10:03:32.464+0100 [conn1433870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:32.467+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:03:32.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:03:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:03:32.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ce35703b51053efd404 2015-10-05T10:03:33.555+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:36.612+0100 [conn1433632] end connection 172.28.0.164:50280 (304 connections now open) 2015-10-05T10:03:36.612+0100 [conn1433653] end connection 172.28.0.164:50675 (304 connections now open) 2015-10-05T10:03:36.613+0100 [mongosMain] connection accepted from 172.28.0.164:51866 #1433871 (304 connections now open) 2015-10-05T10:03:36.613+0100 [mongosMain] connection accepted from 172.28.0.164:51867 #1433872 (305 connections now open) 2015-10-05T10:03:36.614+0100 [conn1433871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:36.614+0100 [conn1433872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:38.141+0100 [conn1433440] end connection 172.28.0.163:56649 (304 connections now open) 2015-10-05T10:03:38.142+0100 [mongosMain] connection accepted from 172.28.0.163:58524 #1433873 (305 connections now open) 2015-10-05T10:03:38.144+0100 [conn1433873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:39.382+0100 [mongosMain] connection accepted from 127.0.0.1:58526 #1433874 (306 connections now open) 2015-10-05T10:03:39.385+0100 [conn1433874] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:39.386+0100 [conn1433874] end connection 127.0.0.1:58526 (305 connections now open) 2015-10-05T10:03:39.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ceb5703b51053efd512 2015-10-05T10:03:39.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:42.466+0100 [conn1433620] end connection 172.28.0.163:57284 (304 connections now open) 2015-10-05T10:03:42.474+0100 [mongosMain] connection accepted from 172.28.0.163:58530 #1433875 (305 connections now open) 2015-10-05T10:03:42.475+0100 [conn1433875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:46.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cf15703b51053efd60b 2015-10-05T10:03:46.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:46.627+0100 [conn1433621] end connection 172.28.0.164:50181 (304 connections now open) 2015-10-05T10:03:46.628+0100 [conn1433574] end connection 172.28.0.164:49947 (304 connections now open) 2015-10-05T10:03:46.628+0100 [mongosMain] connection accepted from 172.28.0.164:51883 #1433876 (304 connections now open) 2015-10-05T10:03:46.629+0100 [mongosMain] connection accepted from 172.28.0.164:51884 #1433877 (305 connections now open) 2015-10-05T10:03:46.630+0100 [conn1433876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:46.630+0100 [conn1433877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:52.479+0100 [conn1433610] end connection 172.28.0.163:57215 (304 connections now open) 2015-10-05T10:03:52.480+0100 [mongosMain] connection accepted from 172.28.0.163:58548 #1433878 (305 connections now open) 2015-10-05T10:03:52.481+0100 [conn1433878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:52.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123cf85703b51053efd6dd 2015-10-05T10:03:52.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:03:56.033+0100 [conn1433690] end connection 172.28.0.164:50914 (304 connections now open) 2015-10-05T10:03:56.035+0100 [mongosMain] connection accepted from 172.28.0.164:51892 #1433879 (305 connections now open) 2015-10-05T10:03:56.039+0100 [conn1433879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:56.643+0100 [conn1433618] end connection 172.28.0.164:50159 (304 connections now open) 2015-10-05T10:03:56.643+0100 [conn1433601] end connection 172.28.0.164:50056 (303 connections now open) 2015-10-05T10:03:56.643+0100 [mongosMain] connection accepted from 172.28.0.164:51894 #1433880 (304 connections now open) 2015-10-05T10:03:56.644+0100 [mongosMain] connection accepted from 172.28.0.164:51895 #1433881 (305 connections now open) 2015-10-05T10:03:56.644+0100 [conn1433880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:03:56.645+0100 [conn1433881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:02.480+0100 [conn1433662] end connection 172.28.0.163:57583 (304 connections now open) 2015-10-05T10:04:02.481+0100 [mongosMain] connection accepted from 172.28.0.163:58569 #1433882 (305 connections now open) 2015-10-05T10:04:02.481+0100 [conn1433882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:02.977+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:04:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:04:06.681+0100 [conn1433664] end connection 172.28.0.164:50766 (304 connections now open) 2015-10-05T10:04:06.682+0100 [mongosMain] connection accepted from 172.28.0.164:51904 #1433883 (305 connections now open) 2015-10-05T10:04:06.682+0100 [conn1433635] end connection 172.28.0.164:50314 (304 connections now open) 2015-10-05T10:04:06.683+0100 [mongosMain] connection accepted from 172.28.0.164:51905 #1433884 (305 connections now open) 2015-10-05T10:04:06.684+0100 [conn1433884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:06.684+0100 [conn1433883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:12.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d0c5703b51053efd90c 2015-10-05T10:04:12.495+0100 [conn1433640] end connection 172.28.0.163:57423 (304 connections now open) 2015-10-05T10:04:12.496+0100 [mongosMain] connection accepted from 172.28.0.163:58585 #1433885 (305 connections now open) 2015-10-05T10:04:12.496+0100 [conn1433885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:12.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:04:16.739+0100 [conn1433575] end connection 172.28.0.164:49948 (304 connections now open) 2015-10-05T10:04:16.739+0100 [conn1433604] end connection 172.28.0.164:50075 (304 connections now open) 2015-10-05T10:04:16.740+0100 [mongosMain] connection accepted from 172.28.0.164:51909 #1433886 (304 connections now open) 2015-10-05T10:04:16.741+0100 [mongosMain] connection accepted from 172.28.0.164:51910 #1433887 (305 connections now open) 2015-10-05T10:04:16.742+0100 [conn1433886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:16.743+0100 [conn1433887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:24.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d185703b51053efdaa6 2015-10-05T10:04:24.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:04:26.752+0100 [conn1433607] end connection 172.28.0.164:50091 (304 connections now open) 2015-10-05T10:04:26.752+0100 [conn1433643] end connection 172.28.0.164:50444 (303 connections now open) 2015-10-05T10:04:26.753+0100 [mongosMain] connection accepted from 172.28.0.164:51928 #1433888 (304 connections now open) 2015-10-05T10:04:26.753+0100 [mongosMain] connection accepted from 172.28.0.164:51927 #1433889 (305 connections now open) 2015-10-05T10:04:26.754+0100 [conn1433889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:26.754+0100 [conn1433888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:28.770+0100 [mongosMain] connection accepted from 127.0.0.1:58604 #1433890 (306 connections now open) 2015-10-05T10:04:28.772+0100 [conn1433890] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:28.773+0100 [conn1433890] end connection 127.0.0.1:58604 (305 connections now open) 2015-10-05T10:04:31.566+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:04:31.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:04:33.237+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:04:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:04:36.768+0100 [conn1433656] end connection 172.28.0.164:50689 (304 connections now open) 2015-10-05T10:04:36.770+0100 [mongosMain] connection accepted from 172.28.0.164:51943 #1433891 (305 connections now open) 2015-10-05T10:04:36.772+0100 [conn1433891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:38.156+0100 [conn1433441] end connection 172.28.0.163:56651 (304 connections now open) 2015-10-05T10:04:38.157+0100 [mongosMain] connection accepted from 172.28.0.163:58609 #1433892 (305 connections now open) 2015-10-05T10:04:38.159+0100 [conn1433892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:38.755+0100 [conn1433224] end connection 172.28.0.164:65092 (304 connections now open) 2015-10-05T10:04:38.756+0100 [mongosMain] connection accepted from 172.28.0.164:51947 #1433893 (305 connections now open) 2015-10-05T10:04:38.757+0100 [conn1433893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:39.422+0100 [conn1433657] end connection 172.28.0.164:50690 (304 connections now open) 2015-10-05T10:04:39.425+0100 [mongosMain] connection accepted from 172.28.0.164:51950 #1433894 (305 connections now open) 2015-10-05T10:04:39.434+0100 [conn1433894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:39.705+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:04:39.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:04:40.013+0100 [mongosMain] connection accepted from 127.0.0.1:58611 #1433895 (306 connections now open) 2015-10-05T10:04:40.016+0100 [conn1433895] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:40.017+0100 [conn1433895] end connection 127.0.0.1:58611 (305 connections now open) 2015-10-05T10:04:45.880+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:04:45.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:04:46.783+0100 [conn1433645] end connection 172.28.0.164:50478 (304 connections now open) 2015-10-05T10:04:46.784+0100 [mongosMain] connection accepted from 172.28.0.164:51973 #1433896 (305 connections now open) 2015-10-05T10:04:46.785+0100 [conn1433682] end connection 172.28.0.164:50832 (304 connections now open) 2015-10-05T10:04:46.785+0100 [mongosMain] connection accepted from 172.28.0.164:51974 #1433897 (305 connections now open) 2015-10-05T10:04:46.796+0100 [conn1433897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:46.797+0100 [conn1433896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:52.018+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:04:52.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:04:56.049+0100 [conn1433675] end connection 172.28.0.164:50812 (304 connections now open) 2015-10-05T10:04:56.051+0100 [mongosMain] connection accepted from 172.28.0.164:51987 #1433898 (305 connections now open) 2015-10-05T10:04:56.055+0100 [conn1433898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:56.860+0100 [conn1433681] end connection 172.28.0.164:50831 (304 connections now open) 2015-10-05T10:04:56.862+0100 [mongosMain] connection accepted from 172.28.0.164:51989 #1433899 (305 connections now open) 2015-10-05T10:04:56.863+0100 [conn1433899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:04:59.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d3a5703b51053efde99 2015-10-05T10:04:59.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:05:04.149+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:05:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:05:04.671+0100 [conn1433245] end connection 172.28.0.163:55960 (304 connections now open) 2015-10-05T10:05:10.945+0100 [conn1433250] end connection 172.28.0.163:55985 (303 connections now open) 2015-10-05T10:05:10.947+0100 [mongosMain] connection accepted from 172.28.0.163:58668 #1433900 (304 connections now open) 2015-10-05T10:05:10.948+0100 [conn1433900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:12.320+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:05:12.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:05:16.849+0100 [conn1433665] end connection 172.28.0.164:50767 (303 connections now open) 2015-10-05T10:05:16.851+0100 [mongosMain] connection accepted from 172.28.0.164:51999 #1433901 (304 connections now open) 2015-10-05T10:05:16.860+0100 [conn1433901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:18.459+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123d4903838a4537162ea5') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444035918335), why: "doing balance round", ts: ObjectId('56123d4e5703b51053efe0f3') } } gle1: { lastOp: Timestamp 1444035899000|1, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1444035918000|5, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T10:05:18.463+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:05:18.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d4e5703b51053efe0f3 2015-10-05T10:05:18.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:05:24.681+0100 [conn1433678] end connection 172.28.0.163:57623 (303 connections now open) 2015-10-05T10:05:24.682+0100 [mongosMain] connection accepted from 172.28.0.163:58677 #1433902 (304 connections now open) 2015-10-05T10:05:24.683+0100 [conn1433902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:26.863+0100 [conn1433754] end connection 172.28.0.164:51067 (303 connections now open) 2015-10-05T10:05:26.863+0100 [conn1433744] end connection 172.28.0.164:51032 (302 connections now open) 2015-10-05T10:05:26.864+0100 [mongosMain] connection accepted from 172.28.0.164:52020 #1433903 (303 connections now open) 2015-10-05T10:05:26.865+0100 [mongosMain] connection accepted from 172.28.0.164:52019 #1433904 (304 connections now open) 2015-10-05T10:05:26.866+0100 [conn1433904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:26.866+0100 [conn1433903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:28.874+0100 [mongosMain] connection accepted from 127.0.0.1:58679 #1433905 (305 connections now open) 2015-10-05T10:05:28.877+0100 [conn1433905] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:28.878+0100 [conn1433905] end connection 127.0.0.1:58679 (304 connections now open) 2015-10-05T10:05:34.280+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:05:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:05:34.695+0100 [conn1433613] end connection 172.28.0.163:57223 (303 connections now open) 2015-10-05T10:05:34.696+0100 [mongosMain] connection accepted from 172.28.0.163:58689 #1433906 (304 connections now open) 2015-10-05T10:05:34.697+0100 [conn1433906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:36.879+0100 [conn1433668] end connection 172.28.0.164:50778 (303 connections now open) 2015-10-05T10:05:36.881+0100 [mongosMain] connection accepted from 172.28.0.164:52032 #1433907 (304 connections now open) 2015-10-05T10:05:36.881+0100 [conn1433673] end connection 172.28.0.164:50806 (303 connections now open) 2015-10-05T10:05:36.885+0100 [mongosMain] connection accepted from 172.28.0.164:52033 #1433908 (304 connections now open) 2015-10-05T10:05:36.895+0100 [conn1433907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:36.897+0100 [conn1433908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:37.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d615703b51053efe225 2015-10-05T10:05:37.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:05:38.173+0100 [conn1433442] end connection 172.28.0.163:56653 (303 connections now open) 2015-10-05T10:05:38.174+0100 [mongosMain] connection accepted from 172.28.0.163:58693 #1433909 (304 connections now open) 2015-10-05T10:05:38.175+0100 [conn1433909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:39.810+0100 [mongosMain] connection accepted from 127.0.0.1:58695 #1433910 (305 connections now open) 2015-10-05T10:05:39.815+0100 [conn1433910] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:39.816+0100 [conn1433910] end connection 127.0.0.1:58695 (304 connections now open) 2015-10-05T10:05:44.753+0100 [conn1433686] end connection 172.28.0.163:57659 (303 connections now open) 2015-10-05T10:05:44.754+0100 [conn1433266] end connection 172.28.0.163:56022 (302 connections now open) 2015-10-05T10:05:44.754+0100 [mongosMain] connection accepted from 172.28.0.163:58706 #1433911 (303 connections now open) 2015-10-05T10:05:44.754+0100 [mongosMain] connection accepted from 172.28.0.163:58707 #1433912 (304 connections now open) 2015-10-05T10:05:44.755+0100 [conn1433911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:44.755+0100 [conn1433912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:44.909+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:05:44.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:05:46.878+0100 [conn1433685] end connection 172.28.0.164:50849 (303 connections now open) 2015-10-05T10:05:46.879+0100 [conn1433539] end connection 172.28.0.164:49797 (302 connections now open) 2015-10-05T10:05:46.879+0100 [mongosMain] connection accepted from 172.28.0.164:52050 #1433913 (304 connections now open) 2015-10-05T10:05:46.880+0100 [mongosMain] connection accepted from 172.28.0.164:52051 #1433914 (304 connections now open) 2015-10-05T10:05:46.881+0100 [conn1433913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:46.881+0100 [conn1433914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:54.746+0100 [conn1433269] end connection 172.28.0.163:56032 (303 connections now open) 2015-10-05T10:05:54.746+0100 [conn1433762] end connection 172.28.0.163:57799 (303 connections now open) 2015-10-05T10:05:54.747+0100 [mongosMain] connection accepted from 172.28.0.163:58721 #1433915 (303 connections now open) 2015-10-05T10:05:54.747+0100 [mongosMain] connection accepted from 172.28.0.163:58722 #1433916 (304 connections now open) 2015-10-05T10:05:54.747+0100 [conn1433915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:54.748+0100 [conn1433916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:56.065+0100 [conn1433692] end connection 172.28.0.164:50918 (303 connections now open) 2015-10-05T10:05:56.067+0100 [mongosMain] connection accepted from 172.28.0.164:52063 #1433917 (304 connections now open) 2015-10-05T10:05:56.069+0100 [conn1433917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:59.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123d745703b51053efe349 2015-10-05T10:05:59.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:05:59.332+0100 [conn1433756] end connection 172.28.0.164:51086 (303 connections now open) 2015-10-05T10:05:59.335+0100 [conn1433674] end connection 172.28.0.164:50807 (302 connections now open) 2015-10-05T10:05:59.344+0100 [mongosMain] connection accepted from 172.28.0.164:52064 #1433918 (303 connections now open) 2015-10-05T10:05:59.345+0100 [mongosMain] connection accepted from 172.28.0.164:52065 #1433919 (304 connections now open) 2015-10-05T10:05:59.346+0100 [conn1433918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:05:59.348+0100 [conn1433919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:04.747+0100 [conn1433272] end connection 172.28.0.163:56041 (303 connections now open) 2015-10-05T10:06:04.748+0100 [conn1433628] end connection 172.28.0.163:57339 (302 connections now open) 2015-10-05T10:06:04.749+0100 [mongosMain] connection accepted from 172.28.0.163:58741 #1433920 (303 connections now open) 2015-10-05T10:06:04.749+0100 [mongosMain] connection accepted from 172.28.0.163:58742 #1433921 (304 connections now open) 2015-10-05T10:06:04.750+0100 [conn1433920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:04.750+0100 [conn1433921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:04.820+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:06:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:06:09.327+0100 [conn1433753] end connection 172.28.0.164:51066 (303 connections now open) 2015-10-05T10:06:09.327+0100 [conn1433760] end connection 172.28.0.164:51121 (303 connections now open) 2015-10-05T10:06:09.328+0100 [mongosMain] connection accepted from 172.28.0.164:52085 #1433922 (303 connections now open) 2015-10-05T10:06:09.328+0100 [mongosMain] connection accepted from 172.28.0.164:52084 #1433923 (304 connections now open) 2015-10-05T10:06:09.329+0100 [conn1433922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:09.330+0100 [conn1433923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:14.775+0100 [conn1433627] end connection 172.28.0.163:57317 (303 connections now open) 2015-10-05T10:06:14.783+0100 [mongosMain] connection accepted from 172.28.0.163:58755 #1433924 (304 connections now open) 2015-10-05T10:06:14.783+0100 [conn1433924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:17.543+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:17.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:22.070+0100 [conn1433280] end connection 172.28.0.163:56082 (303 connections now open) 2015-10-05T10:06:22.071+0100 [mongosMain] connection accepted from 172.28.0.163:58762 #1433925 (304 connections now open) 2015-10-05T10:06:22.072+0100 [conn1433925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:24.230+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:24.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:24.776+0100 [conn1433655] end connection 172.28.0.163:57538 (303 connections now open) 2015-10-05T10:06:24.777+0100 [mongosMain] connection accepted from 172.28.0.163:58764 #1433926 (304 connections now open) 2015-10-05T10:06:24.779+0100 [conn1433926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:29.135+0100 [mongosMain] connection accepted from 127.0.0.1:58767 #1433927 (305 connections now open) 2015-10-05T10:06:29.138+0100 [conn1433927] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:29.139+0100 [conn1433927] end connection 127.0.0.1:58767 (304 connections now open) 2015-10-05T10:06:34.783+0100 [conn1433286] end connection 172.28.0.163:56087 (303 connections now open) 2015-10-05T10:06:34.783+0100 [conn1433670] end connection 172.28.0.163:57614 (302 connections now open) 2015-10-05T10:06:34.784+0100 [mongosMain] connection accepted from 172.28.0.163:58768 #1433928 (303 connections now open) 2015-10-05T10:06:34.785+0100 [mongosMain] connection accepted from 172.28.0.163:58769 #1433929 (304 connections now open) 2015-10-05T10:06:34.785+0100 [conn1433928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:34.786+0100 [conn1433929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:35.074+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:06:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:06:36.374+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:36.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:38.189+0100 [conn1433443] end connection 172.28.0.163:56654 (303 connections now open) 2015-10-05T10:06:38.191+0100 [mongosMain] connection accepted from 172.28.0.163:58771 #1433930 (304 connections now open) 2015-10-05T10:06:38.192+0100 [conn1433930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:39.853+0100 [mongosMain] connection accepted from 127.0.0.1:58773 #1433931 (305 connections now open) 2015-10-05T10:06:39.856+0100 [conn1433931] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:39.856+0100 [conn1433931] end connection 127.0.0.1:58773 (304 connections now open) 2015-10-05T10:06:43.931+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:43.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:44.789+0100 [conn1433743] end connection 172.28.0.163:57709 (303 connections now open) 2015-10-05T10:06:44.789+0100 [conn1433291] end connection 172.28.0.163:56095 (303 connections now open) 2015-10-05T10:06:44.790+0100 [mongosMain] connection accepted from 172.28.0.163:58778 #1433932 (303 connections now open) 2015-10-05T10:06:44.790+0100 [mongosMain] connection accepted from 172.28.0.163:58779 #1433933 (304 connections now open) 2015-10-05T10:06:44.791+0100 [conn1433932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:44.791+0100 [conn1433933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:52.091+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:52.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:54.792+0100 [conn1433738] end connection 172.28.0.163:57681 (303 connections now open) 2015-10-05T10:06:54.793+0100 [mongosMain] connection accepted from 172.28.0.163:58792 #1433934 (304 connections now open) 2015-10-05T10:06:54.794+0100 [conn1433934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:56.081+0100 [conn1433708] end connection 172.28.0.164:50934 (303 connections now open) 2015-10-05T10:06:56.083+0100 [mongosMain] connection accepted from 172.28.0.164:52142 #1433935 (304 connections now open) 2015-10-05T10:06:56.086+0100 [conn1433935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:06:59.217+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:06:59.218+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:06:59.508+0100 [conn1433740] end connection 172.28.0.164:51019 (303 connections now open) 2015-10-05T10:06:59.508+0100 [mongosMain] connection accepted from 172.28.0.164:52144 #1433936 (304 connections now open) 2015-10-05T10:06:59.511+0100 [conn1433936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:04.805+0100 [conn1433769] end connection 172.28.0.163:57814 (303 connections now open) 2015-10-05T10:07:04.806+0100 [mongosMain] connection accepted from 172.28.0.163:58814 #1433937 (304 connections now open) 2015-10-05T10:07:04.807+0100 [conn1433937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:05.480+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:07:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:07:05.481+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123db303838a4537162eb2') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036025272), why: "doing balance round", ts: ObjectId('56123db95703b51053efe965') } } gle1: { lastOp: Timestamp 1444035959000|1, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } gle2: { lastOp: Timestamp 1444036025000|9, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2015-10-05T10:07:05.485+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:07:05.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123db95703b51053efe965 2015-10-05T10:07:05.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:07:09.516+0100 [conn1433776] end connection 172.28.0.164:51185 (303 connections now open) 2015-10-05T10:07:09.517+0100 [mongosMain] connection accepted from 172.28.0.164:52156 #1433938 (304 connections now open) 2015-10-05T10:07:09.519+0100 [conn1433938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:12.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123dbf5703b51053efe9b3 2015-10-05T10:07:12.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:07:14.806+0100 [conn1433659] end connection 172.28.0.163:57566 (303 connections now open) 2015-10-05T10:07:14.807+0100 [mongosMain] connection accepted from 172.28.0.163:58827 #1433939 (304 connections now open) 2015-10-05T10:07:14.808+0100 [conn1433939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:18.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123dc65703b51053efe9f0 2015-10-05T10:07:18.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:07:19.546+0100 [conn1433768] end connection 172.28.0.164:51149 (303 connections now open) 2015-10-05T10:07:19.547+0100 [mongosMain] connection accepted from 172.28.0.164:52163 #1433940 (304 connections now open) 2015-10-05T10:07:19.549+0100 [conn1433940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:23.385+0100 [conn1433315] end connection 172.28.0.163:56170 (303 connections now open) 2015-10-05T10:07:23.386+0100 [mongosMain] connection accepted from 172.28.0.163:58835 #1433941 (304 connections now open) 2015-10-05T10:07:23.387+0100 [conn1433941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:24.821+0100 [conn1433788] end connection 172.28.0.163:57902 (303 connections now open) 2015-10-05T10:07:24.822+0100 [mongosMain] connection accepted from 172.28.0.163:58837 #1433942 (304 connections now open) 2015-10-05T10:07:24.823+0100 [conn1433942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:28.837+0100 [mongosMain] connection accepted from 127.0.0.1:58840 #1433943 (305 connections now open) 2015-10-05T10:07:28.839+0100 [conn1433943] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:28.840+0100 [conn1433943] end connection 127.0.0.1:58840 (304 connections now open) 2015-10-05T10:07:29.547+0100 [conn1433641] end connection 172.28.0.164:50430 (303 connections now open) 2015-10-05T10:07:29.548+0100 [mongosMain] connection accepted from 172.28.0.164:52177 #1433944 (304 connections now open) 2015-10-05T10:07:29.550+0100 [conn1433944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:32.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123dd35703b51053efea43 2015-10-05T10:07:32.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:07:34.829+0100 [conn1433323] end connection 172.28.0.163:56177 (303 connections now open) 2015-10-05T10:07:34.829+0100 [conn1433792] end connection 172.28.0.163:57914 (302 connections now open) 2015-10-05T10:07:34.830+0100 [mongosMain] connection accepted from 172.28.0.163:58841 #1433945 (303 connections now open) 2015-10-05T10:07:34.831+0100 [mongosMain] connection accepted from 172.28.0.163:58842 #1433946 (304 connections now open) 2015-10-05T10:07:34.831+0100 [conn1433945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:34.832+0100 [conn1433946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:35.754+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:07:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:07:38.205+0100 [conn1433444] end connection 172.28.0.163:56656 (303 connections now open) 2015-10-05T10:07:38.206+0100 [mongosMain] connection accepted from 172.28.0.163:58846 #1433947 (304 connections now open) 2015-10-05T10:07:38.208+0100 [conn1433947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:39.529+0100 [mongosMain] connection accepted from 127.0.0.1:58848 #1433948 (305 connections now open) 2015-10-05T10:07:39.531+0100 [conn1433948] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:39.532+0100 [conn1433948] end connection 127.0.0.1:58848 (304 connections now open) 2015-10-05T10:07:39.548+0100 [conn1433736] end connection 172.28.0.164:50969 (303 connections now open) 2015-10-05T10:07:39.549+0100 [mongosMain] connection accepted from 172.28.0.164:52193 #1433949 (304 connections now open) 2015-10-05T10:07:39.551+0100 [conn1433949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:44.454+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:07:44.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:07:44.836+0100 [conn1433329] end connection 172.28.0.163:56182 (303 connections now open) 2015-10-05T10:07:44.837+0100 [mongosMain] connection accepted from 172.28.0.163:58855 #1433950 (304 connections now open) 2015-10-05T10:07:44.838+0100 [conn1433950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:49.562+0100 [conn1433772] end connection 172.28.0.164:51168 (303 connections now open) 2015-10-05T10:07:49.563+0100 [mongosMain] connection accepted from 172.28.0.164:52205 #1433951 (304 connections now open) 2015-10-05T10:07:49.565+0100 [conn1433951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:07:50.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123de65703b51053efeb05 2015-10-05T10:07:50.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:07:56.098+0100 [conn1433700] end connection 172.28.0.164:50926 (303 connections now open) 2015-10-05T10:07:56.099+0100 [mongosMain] connection accepted from 172.28.0.164:52214 #1433952 (304 connections now open) 2015-10-05T10:07:56.103+0100 [conn1433952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:05.992+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:08:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:08:08.995+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:08:08.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:08:14.889+0100 [conn1433777] end connection 172.28.0.163:57844 (303 connections now open) 2015-10-05T10:08:14.891+0100 [mongosMain] connection accepted from 172.28.0.163:58916 #1433953 (304 connections now open) 2015-10-05T10:08:14.892+0100 [conn1433953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:15.374+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:08:15.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:08:20.686+0100 [conn1433795] end connection 172.28.0.164:51283 (303 connections now open) 2015-10-05T10:08:20.687+0100 [mongosMain] connection accepted from 172.28.0.164:52243 #1433954 (304 connections now open) 2015-10-05T10:08:20.689+0100 [conn1433954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:22.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e055703b51053efeceb 2015-10-05T10:08:22.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:08:24.898+0100 [conn1433785] end connection 172.28.0.163:57898 (303 connections now open) 2015-10-05T10:08:24.899+0100 [mongosMain] connection accepted from 172.28.0.163:58923 #1433955 (304 connections now open) 2015-10-05T10:08:24.900+0100 [conn1433955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:28.638+0100 [mongosMain] connection accepted from 127.0.0.1:58927 #1433956 (305 connections now open) 2015-10-05T10:08:28.641+0100 [conn1433956] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:28.643+0100 [conn1433956] end connection 127.0.0.1:58927 (304 connections now open) 2015-10-05T10:08:28.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e0c5703b51053efed84 2015-10-05T10:08:28.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:08:30.740+0100 [conn1433342] end connection 172.28.0.164:65499 (303 connections now open) 2015-10-05T10:08:30.741+0100 [mongosMain] connection accepted from 172.28.0.164:52255 #1433957 (304 connections now open) 2015-10-05T10:08:30.743+0100 [conn1433957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:34.908+0100 [conn1433804] end connection 172.28.0.163:58047 (303 connections now open) 2015-10-05T10:08:34.908+0100 [conn1433351] end connection 172.28.0.163:56258 (303 connections now open) 2015-10-05T10:08:34.908+0100 [mongosMain] connection accepted from 172.28.0.163:58928 #1433958 (303 connections now open) 2015-10-05T10:08:34.909+0100 [mongosMain] connection accepted from 172.28.0.163:58929 #1433959 (304 connections now open) 2015-10-05T10:08:34.909+0100 [conn1433958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:34.909+0100 [conn1433959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:38.222+0100 [conn1433445] end connection 172.28.0.163:56658 (303 connections now open) 2015-10-05T10:08:38.224+0100 [mongosMain] connection accepted from 172.28.0.163:58931 #1433960 (304 connections now open) 2015-10-05T10:08:38.226+0100 [conn1433960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:38.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e125703b51053efee3a 2015-10-05T10:08:38.963+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:08:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:08:39.716+0100 [mongosMain] connection accepted from 127.0.0.1:58933 #1433961 (305 connections now open) 2015-10-05T10:08:39.720+0100 [conn1433961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:08:39.721+0100 [conn1433961] end connection 127.0.0.1:58933 (304 connections now open) 2015-10-05T10:08:40.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:08:46.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e1e5703b51053efef7e 2015-10-05T10:08:46.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:08:53.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e245703b51053eff07c 2015-10-05T10:08:53.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:08:56.114+0100 [conn1433699] end connection 172.28.0.164:50925 (303 connections now open) 2015-10-05T10:08:56.115+0100 [mongosMain] connection accepted from 172.28.0.164:52300 #1433962 (304 connections now open) 2015-10-05T10:08:56.118+0100 [conn1433962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:05.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e315703b51053eff25e 2015-10-05T10:09:06.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:09:09.081+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:09:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:09:14.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e385703b51053eff398 2015-10-05T10:09:14.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:09:15.121+0100 [conn1433783] end connection 172.28.0.163:57891 (303 connections now open) 2015-10-05T10:09:15.123+0100 [mongosMain] connection accepted from 172.28.0.163:58989 #1433963 (304 connections now open) 2015-10-05T10:09:15.125+0100 [conn1433963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:21.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e405703b51053eff4e6 2015-10-05T10:09:21.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:09:25.134+0100 [conn1433774] end connection 172.28.0.163:57826 (303 connections now open) 2015-10-05T10:09:25.135+0100 [mongosMain] connection accepted from 172.28.0.163:58998 #1433964 (304 connections now open) 2015-10-05T10:09:25.136+0100 [conn1433964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:29.101+0100 [mongosMain] connection accepted from 127.0.0.1:58999 #1433965 (305 connections now open) 2015-10-05T10:09:29.104+0100 [conn1433965] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:29.105+0100 [conn1433965] end connection 127.0.0.1:58999 (304 connections now open) 2015-10-05T10:09:33.900+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:09:33.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:09:38.237+0100 [conn1433446] end connection 172.28.0.163:56661 (303 connections now open) 2015-10-05T10:09:38.238+0100 [mongosMain] connection accepted from 172.28.0.163:59004 #1433966 (304 connections now open) 2015-10-05T10:09:38.240+0100 [conn1433966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:39.232+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:09:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:09:39.473+0100 [mongosMain] connection accepted from 127.0.0.1:59006 #1433967 (305 connections now open) 2015-10-05T10:09:39.476+0100 [conn1433967] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:09:39.476+0100 [conn1433967] end connection 127.0.0.1:59006 (304 connections now open) 2015-10-05T10:09:41.726+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:09:41.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:09:48.823+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:09:48.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:09:55.069+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:09:55.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:09:56.130+0100 [conn1433697] end connection 172.28.0.164:50923 (303 connections now open) 2015-10-05T10:09:56.131+0100 [mongosMain] connection accepted from 172.28.0.164:52372 #1433968 (304 connections now open) 2015-10-05T10:09:56.133+0100 [conn1433968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:02.031+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:10:02.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:10:08.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e705703b51053effcd0 2015-10-05T10:10:08.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:10:09.488+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:10:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:10:14.410+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:10:14.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:10:21.366+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:10:21.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:10:27.471+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123e813b0f755fc335f7cb') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036227382), why: "doing balance round", ts: ObjectId('56123e835703b51053efffe1') } } gle1: { lastOp: Timestamp 1444036227000|4, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } gle2: { lastOp: Timestamp 1444036208000|10, connectionId: 11, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2015-10-05T10:10:27.476+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:10:27.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e835703b51053efffe1 2015-10-05T10:10:27.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:10:29.008+0100 [mongosMain] connection accepted from 127.0.0.1:59066 #1433969 (305 connections now open) 2015-10-05T10:10:29.011+0100 [conn1433969] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:29.012+0100 [conn1433969] end connection 127.0.0.1:59066 (304 connections now open) 2015-10-05T10:10:33.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123e895703b51053f00093 2015-10-05T10:10:34.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:10:38.254+0100 [conn1433447] end connection 172.28.0.163:56662 (303 connections now open) 2015-10-05T10:10:38.255+0100 [mongosMain] connection accepted from 172.28.0.163:59073 #1433970 (304 connections now open) 2015-10-05T10:10:38.257+0100 [conn1433970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:39.239+0100 [mongosMain] connection accepted from 127.0.0.1:59075 #1433971 (305 connections now open) 2015-10-05T10:10:39.241+0100 [conn1433971] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:39.241+0100 [conn1433971] end connection 127.0.0.1:59075 (304 connections now open) 2015-10-05T10:10:40.501+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:10:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:10:41.843+0100 [conn1433791] end connection 172.28.0.164:51252 (303 connections now open) 2015-10-05T10:10:41.844+0100 [mongosMain] connection accepted from 172.28.0.164:52421 #1433972 (304 connections now open) 2015-10-05T10:10:41.846+0100 [conn1433972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:45.228+0100 [conn1433794] end connection 172.28.0.163:57931 (303 connections now open) 2015-10-05T10:10:45.228+0100 [mongosMain] connection accepted from 172.28.0.163:59082 #1433973 (304 connections now open) 2015-10-05T10:10:45.229+0100 [conn1433973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:46.376+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:10:46.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:10:51.885+0100 [conn1433835] end connection 172.28.0.164:51589 (303 connections now open) 2015-10-05T10:10:51.885+0100 [conn1433817] end connection 172.28.0.164:51454 (302 connections now open) 2015-10-05T10:10:51.885+0100 [mongosMain] connection accepted from 172.28.0.164:52437 #1433974 (303 connections now open) 2015-10-05T10:10:51.885+0100 [mongosMain] connection accepted from 172.28.0.164:52438 #1433975 (304 connections now open) 2015-10-05T10:10:51.885+0100 [conn1433974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:51.885+0100 [conn1433975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:52.477+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:10:52.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:10:55.245+0100 [conn1433809] end connection 172.28.0.163:58058 (303 connections now open) 2015-10-05T10:10:55.246+0100 [mongosMain] connection accepted from 172.28.0.163:59096 #1433976 (304 connections now open) 2015-10-05T10:10:55.247+0100 [conn1433976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:10:56.146+0100 [conn1433709] end connection 172.28.0.164:50937 (303 connections now open) 2015-10-05T10:10:56.147+0100 [mongosMain] connection accepted from 172.28.0.164:52444 #1433977 (304 connections now open) 2015-10-05T10:10:56.151+0100 [conn1433977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:00.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ea25703b51053f002d8 2015-10-05T10:11:00.179+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:11:01.872+0100 [conn1433584] end connection 172.28.0.164:49988 (303 connections now open) 2015-10-05T10:11:01.873+0100 [conn1433825] end connection 172.28.0.164:51497 (302 connections now open) 2015-10-05T10:11:01.873+0100 [mongosMain] connection accepted from 172.28.0.164:52453 #1433978 (303 connections now open) 2015-10-05T10:11:01.874+0100 [mongosMain] connection accepted from 172.28.0.164:52454 #1433979 (304 connections now open) 2015-10-05T10:11:01.878+0100 [conn1433979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:01.889+0100 [conn1433978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:05.244+0100 [conn1433765] end connection 172.28.0.163:57807 (303 connections now open) 2015-10-05T10:11:05.245+0100 [mongosMain] connection accepted from 172.28.0.163:59125 #1433980 (304 connections now open) 2015-10-05T10:11:05.246+0100 [conn1433980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:11.874+0100 [conn1433808] end connection 172.28.0.164:51403 (303 connections now open) 2015-10-05T10:11:11.874+0100 [conn1433503] end connection 172.28.0.164:49637 (303 connections now open) 2015-10-05T10:11:11.875+0100 [mongosMain] connection accepted from 172.28.0.164:52457 #1433981 (303 connections now open) 2015-10-05T10:11:11.876+0100 [mongosMain] connection accepted from 172.28.0.164:52458 #1433982 (304 connections now open) 2015-10-05T10:11:11.876+0100 [conn1433981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:11.877+0100 [conn1433982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:12.024+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:11:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:11:15.260+0100 [conn1433831] end connection 172.28.0.163:58152 (303 connections now open) 2015-10-05T10:11:15.261+0100 [mongosMain] connection accepted from 172.28.0.163:59135 #1433983 (304 connections now open) 2015-10-05T10:11:15.261+0100 [conn1433983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:19.566+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:11:19.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:11:21.889+0100 [conn1433749] end connection 172.28.0.164:51050 (303 connections now open) 2015-10-05T10:11:21.890+0100 [mongosMain] connection accepted from 172.28.0.164:52467 #1433984 (304 connections now open) 2015-10-05T10:11:21.892+0100 [conn1433984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:25.262+0100 [conn1433569] end connection 172.28.0.163:57047 (303 connections now open) 2015-10-05T10:11:25.262+0100 [conn1433815] end connection 172.28.0.163:58086 (303 connections now open) 2015-10-05T10:11:25.263+0100 [mongosMain] connection accepted from 172.28.0.163:59145 #1433985 (303 connections now open) 2015-10-05T10:11:25.263+0100 [mongosMain] connection accepted from 172.28.0.163:59146 #1433986 (304 connections now open) 2015-10-05T10:11:25.263+0100 [conn1433985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:25.263+0100 [conn1433986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:25.708+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56123ebc26fd57ee99392734') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036285573), why: "doing balance round", ts: ObjectId('56123ebd5703b51053f00670') } } gle1: { lastOp: Timestamp 1444036285000|3, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1444036260000|3, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T10:11:25.712+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:11:25.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ebd5703b51053f00670 2015-10-05T10:11:25.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:11:28.518+0100 [mongosMain] connection accepted from 127.0.0.1:59149 #1433987 (305 connections now open) 2015-10-05T10:11:28.521+0100 [conn1433987] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:28.522+0100 [conn1433987] end connection 127.0.0.1:59149 (304 connections now open) 2015-10-05T10:11:32.103+0100 [conn1433830] end connection 172.28.0.164:51514 (303 connections now open) 2015-10-05T10:11:32.114+0100 [mongosMain] connection accepted from 172.28.0.164:52479 #1433988 (304 connections now open) 2015-10-05T10:11:32.117+0100 [conn1433988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:35.275+0100 [conn1433806] end connection 172.28.0.163:58053 (303 connections now open) 2015-10-05T10:11:35.275+0100 [conn1433582] end connection 172.28.0.163:57108 (303 connections now open) 2015-10-05T10:11:35.276+0100 [mongosMain] connection accepted from 172.28.0.163:59151 #1433989 (303 connections now open) 2015-10-05T10:11:35.276+0100 [mongosMain] connection accepted from 172.28.0.163:59152 #1433990 (304 connections now open) 2015-10-05T10:11:35.277+0100 [conn1433989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:35.277+0100 [conn1433990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:38.195+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:11:38.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:11:38.270+0100 [conn1433448] end connection 172.28.0.163:56664 (303 connections now open) 2015-10-05T10:11:38.271+0100 [mongosMain] connection accepted from 172.28.0.163:59156 #1433991 (304 connections now open) 2015-10-05T10:11:38.273+0100 [conn1433991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:39.564+0100 [mongosMain] connection accepted from 127.0.0.1:59158 #1433992 (305 connections now open) 2015-10-05T10:11:39.567+0100 [conn1433992] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:39.567+0100 [conn1433992] end connection 127.0.0.1:59158 (304 connections now open) 2015-10-05T10:11:42.109+0100 [conn1433833] end connection 172.28.0.164:51578 (303 connections now open) 2015-10-05T10:11:42.110+0100 [mongosMain] connection accepted from 172.28.0.164:52496 #1433993 (304 connections now open) 2015-10-05T10:11:42.111+0100 [conn1433993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:42.356+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:11:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:11:44.338+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:11:44.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:11:45.276+0100 [conn1433623] end connection 172.28.0.163:57288 (303 connections now open) 2015-10-05T10:11:45.276+0100 [conn1433501] end connection 172.28.0.163:56801 (303 connections now open) 2015-10-05T10:11:45.277+0100 [mongosMain] connection accepted from 172.28.0.163:59167 #1433994 (303 connections now open) 2015-10-05T10:11:45.278+0100 [mongosMain] connection accepted from 172.28.0.163:59168 #1433995 (304 connections now open) 2015-10-05T10:11:45.278+0100 [conn1433994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:45.279+0100 [conn1433995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:52.124+0100 [conn1433669] end connection 172.28.0.164:50779 (303 connections now open) 2015-10-05T10:11:52.130+0100 [mongosMain] connection accepted from 172.28.0.164:52508 #1433996 (304 connections now open) 2015-10-05T10:11:52.132+0100 [conn1433996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:55.290+0100 [conn1433677] end connection 172.28.0.163:57622 (303 connections now open) 2015-10-05T10:11:55.290+0100 [conn1433813] end connection 172.28.0.163:58074 (303 connections now open) 2015-10-05T10:11:55.291+0100 [mongosMain] connection accepted from 172.28.0.163:59183 #1433997 (303 connections now open) 2015-10-05T10:11:55.292+0100 [mongosMain] connection accepted from 172.28.0.163:59184 #1433998 (304 connections now open) 2015-10-05T10:11:55.292+0100 [conn1433997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:55.292+0100 [conn1433998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:56.162+0100 [conn1433711] end connection 172.28.0.164:50939 (303 connections now open) 2015-10-05T10:11:56.164+0100 [mongosMain] connection accepted from 172.28.0.164:52514 #1433999 (304 connections now open) 2015-10-05T10:11:56.168+0100 [conn1433999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:11:57.760+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:11:57.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:12:02.140+0100 [conn1433650] end connection 172.28.0.164:50660 (303 connections now open) 2015-10-05T10:12:02.141+0100 [mongosMain] connection accepted from 172.28.0.164:52522 #1434000 (304 connections now open) 2015-10-05T10:12:02.143+0100 [conn1434000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:04.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ee35703b51053f008f7 2015-10-05T10:12:04.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:12:05.303+0100 [conn1433818] end connection 172.28.0.163:58112 (303 connections now open) 2015-10-05T10:12:05.303+0100 [conn1433521] end connection 172.28.0.163:56856 (303 connections now open) 2015-10-05T10:12:05.304+0100 [mongosMain] connection accepted from 172.28.0.163:59211 #1434001 (303 connections now open) 2015-10-05T10:12:05.304+0100 [mongosMain] connection accepted from 172.28.0.163:59212 #1434002 (304 connections now open) 2015-10-05T10:12:05.304+0100 [conn1434001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:05.305+0100 [conn1434002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:12.621+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:12:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:12:16.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123ef05703b51053f0095f 2015-10-05T10:12:16.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:12:18.003+0100 [conn1433629] end connection 172.28.0.163:57363 (303 connections now open) 2015-10-05T10:12:18.003+0100 [conn1433667] end connection 172.28.0.163:57608 (303 connections now open) 2015-10-05T10:12:18.004+0100 [mongosMain] connection accepted from 172.28.0.163:59225 #1434003 (303 connections now open) 2015-10-05T10:12:18.005+0100 [mongosMain] connection accepted from 172.28.0.163:59226 #1434004 (304 connections now open) 2015-10-05T10:12:18.009+0100 [conn1434004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:18.013+0100 [conn1434003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:22.176+0100 [conn1433761] end connection 172.28.0.164:51122 (303 connections now open) 2015-10-05T10:12:22.180+0100 [mongosMain] connection accepted from 172.28.0.164:52543 #1434005 (304 connections now open) 2015-10-05T10:12:22.181+0100 [conn1434005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:27.999+0100 [conn1433797] end connection 172.28.0.163:57960 (303 connections now open) 2015-10-05T10:12:28.000+0100 [conn1433557] end connection 172.28.0.163:56970 (302 connections now open) 2015-10-05T10:12:28.000+0100 [mongosMain] connection accepted from 172.28.0.163:59235 #1434006 (303 connections now open) 2015-10-05T10:12:28.001+0100 [mongosMain] connection accepted from 172.28.0.163:59236 #1434007 (304 connections now open) 2015-10-05T10:12:28.001+0100 [conn1434006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:28.001+0100 [conn1434007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:28.270+0100 [mongosMain] connection accepted from 127.0.0.1:59239 #1434008 (305 connections now open) 2015-10-05T10:12:28.276+0100 [conn1434008] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:28.277+0100 [conn1434008] end connection 127.0.0.1:59239 (304 connections now open) 2015-10-05T10:12:30.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123efd5703b51053f009e9 2015-10-05T10:12:30.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:12:32.171+0100 [conn1433418] end connection 172.28.0.164:49526 (303 connections now open) 2015-10-05T10:12:32.171+0100 [conn1433841] end connection 172.28.0.164:51653 (303 connections now open) 2015-10-05T10:12:32.172+0100 [mongosMain] connection accepted from 172.28.0.164:52562 #1434009 (303 connections now open) 2015-10-05T10:12:32.172+0100 [mongosMain] connection accepted from 172.28.0.164:52561 #1434010 (304 connections now open) 2015-10-05T10:12:32.173+0100 [conn1434009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:32.173+0100 [conn1434010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:36.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f045703b51053f00a01 2015-10-05T10:12:36.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:12:38.005+0100 [conn1433671] end connection 172.28.0.163:57616 (303 connections now open) 2015-10-05T10:12:38.005+0100 [conn1433594] end connection 172.28.0.163:57143 (303 connections now open) 2015-10-05T10:12:38.006+0100 [mongosMain] connection accepted from 172.28.0.163:59244 #1434011 (303 connections now open) 2015-10-05T10:12:38.007+0100 [mongosMain] connection accepted from 172.28.0.163:59245 #1434012 (304 connections now open) 2015-10-05T10:12:38.007+0100 [conn1434011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:38.007+0100 [conn1434012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:38.286+0100 [conn1433449] end connection 172.28.0.163:56665 (303 connections now open) 2015-10-05T10:12:38.287+0100 [mongosMain] connection accepted from 172.28.0.163:59272 #1434013 (304 connections now open) 2015-10-05T10:12:38.289+0100 [conn1434013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:38.836+0100 [conn1433473] end connection 172.28.0.163:56711 (303 connections now open) 2015-10-05T10:12:38.837+0100 [mongosMain] connection accepted from 172.28.0.163:59275 #1434014 (304 connections now open) 2015-10-05T10:12:38.839+0100 [conn1434014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:39.300+0100 [mongosMain] connection accepted from 127.0.0.1:59277 #1434015 (305 connections now open) 2015-10-05T10:12:39.302+0100 [conn1434015] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:39.303+0100 [conn1434015] end connection 127.0.0.1:59277 (304 connections now open) 2015-10-05T10:12:42.186+0100 [conn1433781] end connection 172.28.0.164:51211 (303 connections now open) 2015-10-05T10:12:42.187+0100 [mongosMain] connection accepted from 172.28.0.164:52577 #1434016 (304 connections now open) 2015-10-05T10:12:42.189+0100 [conn1434016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:42.882+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:12:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:12:48.011+0100 [conn1433820] end connection 172.28.0.163:58123 (303 connections now open) 2015-10-05T10:12:48.011+0100 [conn1433562] end connection 172.28.0.163:56992 (302 connections now open) 2015-10-05T10:12:48.012+0100 [mongosMain] connection accepted from 172.28.0.163:59306 #1434017 (303 connections now open) 2015-10-05T10:12:48.013+0100 [mongosMain] connection accepted from 172.28.0.163:59307 #1434018 (304 connections now open) 2015-10-05T10:12:48.014+0100 [conn1434017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:48.014+0100 [conn1434018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:52.187+0100 [conn1433798] end connection 172.28.0.164:51300 (303 connections now open) 2015-10-05T10:12:52.187+0100 [conn1433748] end connection 172.28.0.164:51049 (302 connections now open) 2015-10-05T10:12:52.188+0100 [mongosMain] connection accepted from 172.28.0.164:52591 #1434019 (303 connections now open) 2015-10-05T10:12:52.188+0100 [mongosMain] connection accepted from 172.28.0.164:52592 #1434020 (304 connections now open) 2015-10-05T10:12:52.189+0100 [conn1434019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:52.189+0100 [conn1434020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:12:54.563+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:12:54.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:12:56.179+0100 [conn1433712] end connection 172.28.0.164:50940 (303 connections now open) 2015-10-05T10:12:56.180+0100 [mongosMain] connection accepted from 172.28.0.164:52597 #1434021 (304 connections now open) 2015-10-05T10:12:56.184+0100 [conn1434021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:00.639+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:13:00.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:13:02.202+0100 [conn1433779] end connection 172.28.0.164:51192 (303 connections now open) 2015-10-05T10:13:02.202+0100 [conn1433737] end connection 172.28.0.164:50970 (302 connections now open) 2015-10-05T10:13:02.203+0100 [mongosMain] connection accepted from 172.28.0.164:52609 #1434022 (303 connections now open) 2015-10-05T10:13:02.203+0100 [mongosMain] connection accepted from 172.28.0.164:52610 #1434023 (304 connections now open) 2015-10-05T10:13:02.203+0100 [conn1434022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:02.204+0100 [conn1434023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:03.508+0100 [conn1433490] end connection 172.28.0.163:56775 (303 connections now open) 2015-10-05T10:13:03.509+0100 [mongosMain] connection accepted from 172.28.0.163:59355 #1434024 (304 connections now open) 2015-10-05T10:13:03.509+0100 [conn1434024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:12.218+0100 [conn1433816] end connection 172.28.0.164:51452 (303 connections now open) 2015-10-05T10:13:12.219+0100 [conn1433826] end connection 172.28.0.164:51496 (302 connections now open) 2015-10-05T10:13:12.219+0100 [mongosMain] connection accepted from 172.28.0.164:52613 #1434025 (303 connections now open) 2015-10-05T10:13:12.220+0100 [mongosMain] connection accepted from 172.28.0.164:52614 #1434026 (304 connections now open) 2015-10-05T10:13:12.221+0100 [conn1434025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:12.223+0100 [conn1434026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:13.197+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f285703b51053f00c7c 2015-10-05T10:13:13.229+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:13:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:13:13.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:18.817+0100 [conn1433854] end connection 172.28.0.163:58429 (303 connections now open) 2015-10-05T10:13:18.819+0100 [mongosMain] connection accepted from 172.28.0.163:59387 #1434027 (304 connections now open) 2015-10-05T10:13:18.820+0100 [conn1434027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:19.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f2f5703b51053f00ccf 2015-10-05T10:13:19.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:22.234+0100 [conn1433800] end connection 172.28.0.164:51311 (303 connections now open) 2015-10-05T10:13:22.234+0100 [conn1433587] end connection 172.28.0.164:49994 (302 connections now open) 2015-10-05T10:13:22.235+0100 [mongosMain] connection accepted from 172.28.0.164:52626 #1434028 (303 connections now open) 2015-10-05T10:13:22.235+0100 [mongosMain] connection accepted from 172.28.0.164:52625 #1434029 (304 connections now open) 2015-10-05T10:13:22.236+0100 [conn1434028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:22.237+0100 [conn1434029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:25.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f355703b51053f00d31 2015-10-05T10:13:25.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:28.458+0100 [mongosMain] connection accepted from 127.0.0.1:59390 #1434030 (305 connections now open) 2015-10-05T10:13:28.461+0100 [conn1434030] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:28.462+0100 [conn1434030] end connection 127.0.0.1:59390 (304 connections now open) 2015-10-05T10:13:29.018+0100 [conn1433847] end connection 172.28.0.163:58349 (303 connections now open) 2015-10-05T10:13:29.020+0100 [mongosMain] connection accepted from 172.28.0.163:59392 #1434031 (304 connections now open) 2015-10-05T10:13:29.021+0100 [conn1434031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:31.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f3b5703b51053f00d96 2015-10-05T10:13:32.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:32.258+0100 [conn1433745] end connection 172.28.0.164:51033 (303 connections now open) 2015-10-05T10:13:32.259+0100 [conn1433812] end connection 172.28.0.164:51426 (302 connections now open) 2015-10-05T10:13:32.259+0100 [mongosMain] connection accepted from 172.28.0.164:52639 #1434032 (303 connections now open) 2015-10-05T10:13:32.260+0100 [mongosMain] connection accepted from 172.28.0.164:52640 #1434033 (304 connections now open) 2015-10-05T10:13:32.261+0100 [conn1434032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:32.262+0100 [conn1434033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:33.412+0100 [conn1433507] end connection 172.28.0.163:56806 (303 connections now open) 2015-10-05T10:13:33.413+0100 [mongosMain] connection accepted from 172.28.0.163:59393 #1434034 (304 connections now open) 2015-10-05T10:13:33.414+0100 [conn1434034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:38.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f425703b51053f00df7 2015-10-05T10:13:38.302+0100 [conn1433450] end connection 172.28.0.163:56667 (303 connections now open) 2015-10-05T10:13:38.303+0100 [mongosMain] connection accepted from 172.28.0.163:59405 #1434035 (304 connections now open) 2015-10-05T10:13:38.305+0100 [conn1434035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:38.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:39.020+0100 [conn1433780] end connection 172.28.0.163:57877 (303 connections now open) 2015-10-05T10:13:39.022+0100 [mongosMain] connection accepted from 172.28.0.163:59408 #1434036 (304 connections now open) 2015-10-05T10:13:39.023+0100 [conn1434036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:39.739+0100 [mongosMain] connection accepted from 127.0.0.1:59410 #1434037 (305 connections now open) 2015-10-05T10:13:39.742+0100 [conn1434037] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:39.743+0100 [conn1434037] end connection 127.0.0.1:59410 (304 connections now open) 2015-10-05T10:13:42.448+0100 [conn1433759] end connection 172.28.0.164:51101 (303 connections now open) 2015-10-05T10:13:42.504+0100 [mongosMain] connection accepted from 172.28.0.164:52656 #1434038 (304 connections now open) 2015-10-05T10:13:42.507+0100 [conn1434038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:43.496+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:13:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:13:44.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f485703b51053f00e55 2015-10-05T10:13:44.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:49.041+0100 [conn1433849] end connection 172.28.0.163:58358 (303 connections now open) 2015-10-05T10:13:49.041+0100 [conn1433514] end connection 172.28.0.163:56819 (303 connections now open) 2015-10-05T10:13:49.042+0100 [mongosMain] connection accepted from 172.28.0.163:59429 #1434039 (303 connections now open) 2015-10-05T10:13:49.042+0100 [mongosMain] connection accepted from 172.28.0.163:59431 #1434040 (304 connections now open) 2015-10-05T10:13:49.043+0100 [conn1434039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:49.043+0100 [conn1434040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:51.067+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f4e5703b51053f00eb8 2015-10-05T10:13:51.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:13:52.375+0100 [conn1433767] end connection 172.28.0.164:51148 (303 connections now open) 2015-10-05T10:13:52.376+0100 [mongosMain] connection accepted from 172.28.0.164:52668 #1434041 (304 connections now open) 2015-10-05T10:13:52.377+0100 [conn1434041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:56.205+0100 [conn1433714] end connection 172.28.0.164:50942 (303 connections now open) 2015-10-05T10:13:56.209+0100 [mongosMain] connection accepted from 172.28.0.164:52674 #1434042 (304 connections now open) 2015-10-05T10:13:56.216+0100 [conn1434042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:13:59.350+0100 [conn1433518] end connection 172.28.0.163:56833 (303 connections now open) 2015-10-05T10:13:59.352+0100 [mongosMain] connection accepted from 172.28.0.163:59484 #1434043 (304 connections now open) 2015-10-05T10:13:59.353+0100 [conn1434043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:02.640+0100 [conn1433784] end connection 172.28.0.164:51226 (303 connections now open) 2015-10-05T10:14:02.661+0100 [mongosMain] connection accepted from 172.28.0.164:52681 #1434044 (304 connections now open) 2015-10-05T10:14:02.664+0100 [conn1434044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:04.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f5c5703b51053f00f66 2015-10-05T10:14:04.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:14:12.640+0100 [conn1433603] end connection 172.28.0.164:50074 (303 connections now open) 2015-10-05T10:14:12.642+0100 [mongosMain] connection accepted from 172.28.0.164:52687 #1434045 (304 connections now open) 2015-10-05T10:14:12.643+0100 [conn1434045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:13.916+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:14:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:14:19.056+0100 [conn1433525] end connection 172.28.0.163:56870 (303 connections now open) 2015-10-05T10:14:19.057+0100 [mongosMain] connection accepted from 172.28.0.163:59549 #1434046 (304 connections now open) 2015-10-05T10:14:19.057+0100 [conn1433827] end connection 172.28.0.163:58136 (303 connections now open) 2015-10-05T10:14:19.057+0100 [mongosMain] connection accepted from 172.28.0.163:59552 #1434047 (304 connections now open) 2015-10-05T10:14:19.058+0100 [conn1434046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:19.058+0100 [conn1434047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:22.640+0100 [conn1433839] end connection 172.28.0.164:51630 (303 connections now open) 2015-10-05T10:14:22.641+0100 [mongosMain] connection accepted from 172.28.0.164:52701 #1434048 (304 connections now open) 2015-10-05T10:14:22.642+0100 [conn1434048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:22.858+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:22.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:28.495+0100 [mongosMain] connection accepted from 127.0.0.1:59555 #1434049 (305 connections now open) 2015-10-05T10:14:28.497+0100 [conn1434049] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:28.499+0100 [conn1434049] end connection 127.0.0.1:59555 (304 connections now open) 2015-10-05T10:14:29.067+0100 [conn1433529] end connection 172.28.0.163:56880 (303 connections now open) 2015-10-05T10:14:29.068+0100 [conn1433885] end connection 172.28.0.163:58585 (302 connections now open) 2015-10-05T10:14:29.070+0100 [mongosMain] connection accepted from 172.28.0.163:59565 #1434050 (303 connections now open) 2015-10-05T10:14:29.070+0100 [mongosMain] connection accepted from 172.28.0.163:59556 #1434051 (304 connections now open) 2015-10-05T10:14:29.071+0100 [conn1434051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:29.072+0100 [conn1434050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:30.924+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:30.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:32.715+0100 [conn1433858] end connection 172.28.0.164:51780 (303 connections now open) 2015-10-05T10:14:32.717+0100 [mongosMain] connection accepted from 172.28.0.164:52728 #1434052 (304 connections now open) 2015-10-05T10:14:32.719+0100 [conn1434052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:38.318+0100 [conn1433451] end connection 172.28.0.163:56669 (303 connections now open) 2015-10-05T10:14:38.319+0100 [mongosMain] connection accepted from 172.28.0.163:59570 #1434053 (304 connections now open) 2015-10-05T10:14:38.321+0100 [conn1434053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:38.353+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:38.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:39.070+0100 [conn1433534] end connection 172.28.0.163:56887 (303 connections now open) 2015-10-05T10:14:39.071+0100 [mongosMain] connection accepted from 172.28.0.163:59572 #1434054 (304 connections now open) 2015-10-05T10:14:39.072+0100 [conn1434054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:39.422+0100 [mongosMain] connection accepted from 127.0.0.1:59574 #1434055 (305 connections now open) 2015-10-05T10:14:39.425+0100 [conn1434055] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:39.425+0100 [conn1434055] end connection 127.0.0.1:59574 (304 connections now open) 2015-10-05T10:14:42.703+0100 [conn1433880] end connection 172.28.0.164:51894 (303 connections now open) 2015-10-05T10:14:42.704+0100 [mongosMain] connection accepted from 172.28.0.164:52744 #1434056 (304 connections now open) 2015-10-05T10:14:42.706+0100 [conn1434056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:44.194+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:14:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:14:44.503+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:44.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:49.083+0100 [conn1433538] end connection 172.28.0.163:56899 (303 connections now open) 2015-10-05T10:14:49.084+0100 [mongosMain] connection accepted from 172.28.0.163:59585 #1434057 (304 connections now open) 2015-10-05T10:14:49.085+0100 [conn1434057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:50.609+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:50.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:52.744+0100 [conn1433832] end connection 172.28.0.164:51529 (303 connections now open) 2015-10-05T10:14:52.746+0100 [mongosMain] connection accepted from 172.28.0.164:52762 #1434058 (304 connections now open) 2015-10-05T10:14:52.748+0100 [conn1434058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:56.227+0100 [conn1433691] end connection 172.28.0.164:50915 (303 connections now open) 2015-10-05T10:14:56.228+0100 [mongosMain] connection accepted from 172.28.0.164:52772 #1434059 (304 connections now open) 2015-10-05T10:14:56.230+0100 [conn1434059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:14:57.329+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:14:57.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:14:59.087+0100 [conn1433542] end connection 172.28.0.163:56915 (303 connections now open) 2015-10-05T10:14:59.088+0100 [mongosMain] connection accepted from 172.28.0.163:59595 #1434060 (304 connections now open) 2015-10-05T10:14:59.089+0100 [conn1434060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:02.750+0100 [conn1433884] end connection 172.28.0.164:51905 (303 connections now open) 2015-10-05T10:15:02.751+0100 [mongosMain] connection accepted from 172.28.0.164:52795 #1434061 (304 connections now open) 2015-10-05T10:15:02.752+0100 [conn1434061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:05.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f975703b51053f01221 2015-10-05T10:15:05.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:09.099+0100 [conn1433546] end connection 172.28.0.163:56938 (303 connections now open) 2015-10-05T10:15:09.100+0100 [mongosMain] connection accepted from 172.28.0.163:59611 #1434062 (304 connections now open) 2015-10-05T10:15:09.101+0100 [conn1434062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:11.655+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123f9f5703b51053f012ad 2015-10-05T10:15:11.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:12.766+0100 [conn1433821] end connection 172.28.0.164:51481 (303 connections now open) 2015-10-05T10:15:12.767+0100 [mongosMain] connection accepted from 172.28.0.164:52800 #1434063 (304 connections now open) 2015-10-05T10:15:12.768+0100 [conn1434063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:14.452+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:15:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:15:17.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fa55703b51053f012fd 2015-10-05T10:15:18.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:19.099+0100 [conn1433550] end connection 172.28.0.163:56950 (303 connections now open) 2015-10-05T10:15:19.100+0100 [mongosMain] connection accepted from 172.28.0.163:59620 #1434064 (304 connections now open) 2015-10-05T10:15:19.101+0100 [conn1434064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:22.823+0100 [conn1433876] end connection 172.28.0.164:51883 (303 connections now open) 2015-10-05T10:15:22.843+0100 [mongosMain] connection accepted from 172.28.0.164:52818 #1434065 (304 connections now open) 2015-10-05T10:15:22.844+0100 [conn1434065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:24.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fac5703b51053f0134e 2015-10-05T10:15:24.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:28.609+0100 [mongosMain] connection accepted from 127.0.0.1:59624 #1434066 (305 connections now open) 2015-10-05T10:15:28.611+0100 [conn1434066] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:28.613+0100 [conn1434066] end connection 127.0.0.1:59624 (304 connections now open) 2015-10-05T10:15:29.115+0100 [conn1433554] end connection 172.28.0.163:56964 (303 connections now open) 2015-10-05T10:15:29.116+0100 [mongosMain] connection accepted from 172.28.0.163:59625 #1434067 (304 connections now open) 2015-10-05T10:15:29.117+0100 [conn1434067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:30.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fb25703b51053f013fe 2015-10-05T10:15:30.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:32.802+0100 [conn1433838] end connection 172.28.0.164:51616 (303 connections now open) 2015-10-05T10:15:32.803+0100 [mongosMain] connection accepted from 172.28.0.164:52853 #1434068 (304 connections now open) 2015-10-05T10:15:32.805+0100 [conn1434068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:37.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fb85703b51053f0148e 2015-10-05T10:15:37.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:38.335+0100 [conn1433452] end connection 172.28.0.163:56670 (303 connections now open) 2015-10-05T10:15:38.336+0100 [mongosMain] connection accepted from 172.28.0.163:59631 #1434069 (304 connections now open) 2015-10-05T10:15:38.338+0100 [conn1434069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:39.609+0100 [mongosMain] connection accepted from 127.0.0.1:59634 #1434070 (305 connections now open) 2015-10-05T10:15:39.612+0100 [conn1434070] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:39.613+0100 [conn1434070] end connection 127.0.0.1:59634 (304 connections now open) 2015-10-05T10:15:42.813+0100 [conn1433887] end connection 172.28.0.164:51910 (303 connections now open) 2015-10-05T10:15:42.814+0100 [mongosMain] connection accepted from 172.28.0.164:52872 #1434071 (304 connections now open) 2015-10-05T10:15:42.815+0100 [conn1434071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:43.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fbf5703b51053f014fd 2015-10-05T10:15:43.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:44.609+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:15:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:15:49.151+0100 [conn1433882] end connection 172.28.0.163:58569 (303 connections now open) 2015-10-05T10:15:49.152+0100 [conn1433561] end connection 172.28.0.163:56981 (302 connections now open) 2015-10-05T10:15:49.154+0100 [mongosMain] connection accepted from 172.28.0.163:59645 #1434072 (303 connections now open) 2015-10-05T10:15:49.154+0100 [mongosMain] connection accepted from 172.28.0.163:59646 #1434073 (304 connections now open) 2015-10-05T10:15:49.155+0100 [conn1434072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:49.155+0100 [conn1434073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:49.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fc55703b51053f0157c 2015-10-05T10:15:49.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:52.828+0100 [conn1433896] end connection 172.28.0.164:51973 (303 connections now open) 2015-10-05T10:15:52.830+0100 [mongosMain] connection accepted from 172.28.0.164:52886 #1434074 (304 connections now open) 2015-10-05T10:15:52.832+0100 [conn1434074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:55.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fcb5703b51053f015e4 2015-10-05T10:15:55.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:15:56.243+0100 [conn1433715] end connection 172.28.0.164:50943 (303 connections now open) 2015-10-05T10:15:56.244+0100 [mongosMain] connection accepted from 172.28.0.164:52891 #1434075 (304 connections now open) 2015-10-05T10:15:56.247+0100 [conn1434075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:15:59.146+0100 [conn1433906] end connection 172.28.0.163:58689 (303 connections now open) 2015-10-05T10:15:59.148+0100 [mongosMain] connection accepted from 172.28.0.163:59657 #1434076 (304 connections now open) 2015-10-05T10:15:59.149+0100 [conn1434076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:02.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fd15703b51053f01676 2015-10-05T10:16:02.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:16:02.930+0100 [conn1433853] end connection 172.28.0.164:51754 (303 connections now open) 2015-10-05T10:16:02.932+0100 [mongosMain] connection accepted from 172.28.0.164:52903 #1434077 (304 connections now open) 2015-10-05T10:16:02.934+0100 [conn1434077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:06.273+0100 [conn1433985] end connection 172.28.0.163:59145 (303 connections now open) 2015-10-05T10:16:06.273+0100 [conn1433997] end connection 172.28.0.163:59183 (302 connections now open) 2015-10-05T10:16:06.274+0100 [conn1434047] end connection 172.28.0.163:59552 (301 connections now open) 2015-10-05T10:16:06.274+0100 [conn1434043] end connection 172.28.0.163:59484 (300 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433823] end connection 172.28.0.163:58130 (299 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433939] end connection 172.28.0.163:58827 (299 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433945] end connection 172.28.0.163:58841 (299 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433924] end connection 172.28.0.163:58755 (297 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433980] end connection 172.28.0.163:59125 (297 connections now open) 2015-10-05T10:16:06.275+0100 [conn1433959] end connection 172.28.0.163:58929 (295 connections now open) 2015-10-05T10:16:06.275+0100 [conn1434031] end connection 172.28.0.163:59392 (295 connections now open) 2015-10-05T10:16:06.276+0100 [conn1433934] end connection 172.28.0.163:58792 (292 connections now open) 2015-10-05T10:16:06.276+0100 [conn1433976] end connection 172.28.0.163:59096 (292 connections now open) 2015-10-05T10:16:06.276+0100 [conn1434001] end connection 172.28.0.163:59211 (291 connections now open) 2015-10-05T10:16:06.276+0100 [conn1433933] end connection 172.28.0.163:58779 (291 connections now open) 2015-10-05T10:16:06.276+0100 [conn1433955] end connection 172.28.0.163:58923 (288 connections now open) 2015-10-05T10:16:06.276+0100 [conn1433875] end connection 172.28.0.163:58530 (288 connections now open) 2015-10-05T10:16:06.276+0100 [conn1434064] end connection 172.28.0.163:59620 (286 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433950] end connection 172.28.0.163:58855 (286 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433983] end connection 172.28.0.163:59135 (284 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433946] end connection 172.28.0.163:58842 (284 connections now open) 2015-10-05T10:16:06.277+0100 [conn1434012] end connection 172.28.0.163:59245 (282 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433739] end connection 172.28.0.163:57682 (282 connections now open) 2015-10-05T10:16:06.277+0100 [conn1434072] end connection 172.28.0.163:59645 (282 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433911] end connection 172.28.0.163:58706 (281 connections now open) 2015-10-05T10:16:06.277+0100 [conn1434067] end connection 172.28.0.163:59625 (280 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433572] end connection 172.28.0.163:57053 (280 connections now open) 2015-10-05T10:16:06.277+0100 [conn1433799] end connection 172.28.0.163:57972 (278 connections now open) 2015-10-05T10:16:06.277+0100 [conn1434051] end connection 172.28.0.163:59556 (278 connections now open) 2015-10-05T10:16:06.278+0100 [conn1433973] end connection 172.28.0.163:59082 (274 connections now open) 2015-10-05T10:16:06.278+0100 [conn1434057] end connection 172.28.0.163:59585 (274 connections now open) 2015-10-05T10:16:06.278+0100 [conn1433757] end connection 172.28.0.163:57761 (274 connections now open) 2015-10-05T10:16:06.278+0100 [conn1434054] end connection 172.28.0.163:59572 (272 connections now open) 2015-10-05T10:16:06.278+0100 [conn1433986] end connection 172.28.0.163:59146 (270 connections now open) 2015-10-05T10:16:06.278+0100 [conn1433663] end connection 172.28.0.163:57584 (270 connections now open) 2015-10-05T10:16:06.279+0100 [conn1434024] end connection 172.28.0.163:59355 (268 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433937] end connection 172.28.0.163:58814 (268 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433902] end connection 172.28.0.163:58677 (268 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433916] end connection 172.28.0.163:58722 (265 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433928] end connection 172.28.0.163:58768 (264 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433588] end connection 172.28.0.163:57136 (265 connections now open) 2015-10-05T10:16:06.279+0100 [conn1434006] end connection 172.28.0.163:59235 (263 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433866] end connection 172.28.0.163:58503 (262 connections now open) 2015-10-05T10:16:06.279+0100 [conn1433964] end connection 172.28.0.163:58998 (260 connections now open) 2015-10-05T10:16:06.280+0100 [conn1434036] end connection 172.28.0.163:59408 (259 connections now open) 2015-10-05T10:16:06.280+0100 [conn1433995] end connection 172.28.0.163:59168 (258 connections now open) 2015-10-05T10:16:06.280+0100 [conn1434002] end connection 172.28.0.163:59212 (257 connections now open) 2015-10-05T10:16:06.280+0100 [conn1433942] end connection 172.28.0.163:58837 (257 connections now open) 2015-10-05T10:16:06.281+0100 [conn1434062] end connection 172.28.0.163:59611 (256 connections now open) 2015-10-05T10:16:06.281+0100 [conn1433963] end connection 172.28.0.163:58989 (256 connections now open) 2015-10-05T10:16:06.281+0100 [conn1433994] end connection 172.28.0.163:59167 (253 connections now open) 2015-10-05T10:16:06.281+0100 [conn1433593] end connection 172.28.0.163:57142 (252 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433921] end connection 172.28.0.163:58742 (251 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433742] end connection 172.28.0.163:57708 (250 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433932] end connection 172.28.0.163:58778 (250 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433925] end connection 172.28.0.163:58762 (248 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433915] end connection 172.28.0.163:58721 (248 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433658] end connection 172.28.0.163:57565 (248 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433860] end connection 172.28.0.163:58442 (246 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433929] end connection 172.28.0.163:58769 (247 connections now open) 2015-10-05T10:16:06.282+0100 [conn1433989] end connection 172.28.0.163:59151 (247 connections now open) 2015-10-05T10:16:06.282+0100 [conn1434004] end connection 172.28.0.163:59226 (248 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433900] end connection 172.28.0.163:58668 (242 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433941] end connection 172.28.0.163:58835 (241 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433842] end connection 172.28.0.163:58325 (241 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433953] end connection 172.28.0.163:58916 (240 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433912] end connection 172.28.0.163:58707 (238 connections now open) 2015-10-05T10:16:06.283+0100 [conn1433566] end connection 172.28.0.163:57028 (237 connections now open) 2015-10-05T10:16:06.283+0100 [conn1434007] end connection 172.28.0.163:59236 (236 connections now open) 2015-10-05T10:16:06.283+0100 [conn1434017] end connection 172.28.0.163:59306 (236 connections now open) 2015-10-05T10:16:06.284+0100 [conn1433862] end connection 172.28.0.163:58457 (233 connections now open) 2015-10-05T10:16:06.284+0100 [conn1434027] end connection 172.28.0.163:59387 (233 connections now open) 2015-10-05T10:16:06.284+0100 [conn1433564] end connection 172.28.0.163:57014 (231 connections now open) 2015-10-05T10:16:06.284+0100 [conn1433683] end connection 172.28.0.163:57638 (230 connections now open) 2015-10-05T10:16:06.284+0100 [conn1434039] end connection 172.28.0.163:59429 (229 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434046] end connection 172.28.0.163:59549 (229 connections now open) 2015-10-05T10:16:06.285+0100 [conn1433750] end connection 172.28.0.163:57730 (229 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434011] end connection 172.28.0.163:59244 (227 connections now open) 2015-10-05T10:16:06.285+0100 [conn1433654] end connection 172.28.0.163:57536 (226 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434076] end connection 172.28.0.163:59657 (225 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434050] end connection 172.28.0.163:59565 (224 connections now open) 2015-10-05T10:16:06.285+0100 [conn1433585] end connection 172.28.0.163:57123 (223 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434018] end connection 172.28.0.163:59307 (222 connections now open) 2015-10-05T10:16:06.285+0100 [conn1433998] end connection 172.28.0.163:59184 (221 connections now open) 2015-10-05T10:16:06.285+0100 [conn1433580] end connection 172.28.0.163:57081 (219 connections now open) 2015-10-05T10:16:06.285+0100 [conn1434060] end connection 172.28.0.163:59595 (218 connections now open) 2015-10-05T10:16:06.286+0100 [conn1434034] end connection 172.28.0.163:59393 (217 connections now open) 2015-10-05T10:16:06.286+0100 [conn1433926] end connection 172.28.0.163:58764 (216 connections now open) 2015-10-05T10:16:06.286+0100 [conn1433878] end connection 172.28.0.163:58548 (215 connections now open) 2015-10-05T10:16:06.286+0100 [conn1434040] end connection 172.28.0.163:59431 (214 connections now open) 2015-10-05T10:16:06.287+0100 [conn1433856] end connection 172.28.0.163:58433 (213 connections now open) 2015-10-05T10:16:06.287+0100 [conn1433990] end connection 172.28.0.163:59152 (212 connections now open) 2015-10-05T10:16:06.287+0100 [conn1433843] end connection 172.28.0.163:58338 (211 connections now open) 2015-10-05T10:16:06.287+0100 [conn1433746] end connection 172.28.0.163:57725 (210 connections now open) 2015-10-05T10:16:06.288+0100 [conn1433870] end connection 172.28.0.163:58517 (209 connections now open) 2015-10-05T10:16:07.788+0100 [conn1434003] end connection 172.28.0.163:59225 (208 connections now open) 2015-10-05T10:16:07.788+0100 [conn1433920] end connection 172.28.0.163:58741 (207 connections now open) 2015-10-05T10:16:07.789+0100 [conn1434073] end connection 172.28.0.163:59646 (206 connections now open) 2015-10-05T10:16:07.789+0100 [conn1433958] end connection 172.28.0.163:58928 (206 connections now open) 2015-10-05T10:16:07.789+0100 [conn1433579] end connection 172.28.0.163:57066 (205 connections now open) 2015-10-05T10:16:12.937+0100 [conn1433891] end connection 172.28.0.164:51943 (203 connections now open) 2015-10-05T10:16:12.939+0100 [mongosMain] connection accepted from 172.28.0.164:52910 #1434078 (204 connections now open) 2015-10-05T10:16:12.940+0100 [conn1434078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:14.929+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:16:14.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:16:15.133+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:16:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:16:21.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 56123fe45703b51053f017c8 2015-10-05T10:16:21.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:16:22.954+0100 [conn1433871] end connection 172.28.0.164:51866 (203 connections now open) 2015-10-05T10:16:22.956+0100 [mongosMain] connection accepted from 172.28.0.164:52920 #1434079 (204 connections now open) 2015-10-05T10:16:22.958+0100 [conn1434079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:28.198+0100 [mongosMain] connection accepted from 127.0.0.1:59690 #1434080 (205 connections now open) 2015-10-05T10:16:28.201+0100 [conn1434080] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:28.203+0100 [conn1434080] end connection 127.0.0.1:59690 (204 connections now open) 2015-10-05T10:16:28.501+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:16:28.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:16:32.954+0100 [conn1433865] end connection 172.28.0.164:51829 (203 connections now open) 2015-10-05T10:16:32.955+0100 [mongosMain] connection accepted from 172.28.0.164:52934 #1434081 (204 connections now open) 2015-10-05T10:16:32.956+0100 [conn1434081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:34.637+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:16:34.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:16:38.350+0100 [conn1433453] end connection 172.28.0.163:56672 (203 connections now open) 2015-10-05T10:16:38.353+0100 [mongosMain] connection accepted from 172.28.0.163:59692 #1434082 (204 connections now open) 2015-10-05T10:16:38.355+0100 [conn1434082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:39.871+0100 [mongosMain] connection accepted from 127.0.0.1:59694 #1434083 (205 connections now open) 2015-10-05T10:16:39.873+0100 [conn1434083] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:16:39.874+0100 [conn1434083] end connection 127.0.0.1:59694 (204 connections now open) 2015-10-05T10:16:42.485+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:16:42.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:16:45.592+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:16:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:16:54.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240065703b51053f01952 2015-10-05T10:16:54.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:16:56.286+0100 [conn1433710] end connection 172.28.0.164:50938 (203 connections now open) 2015-10-05T10:16:56.286+0100 [mongosMain] connection accepted from 172.28.0.164:52970 #1434084 (204 connections now open) 2015-10-05T10:16:56.286+0100 [conn1434084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:06.876+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:17:06.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:17:14.651+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:17:14.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:17:15.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:17:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:17:20.722+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612401a03838a4537162eeb') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036640658), why: "doing balance round", ts: ObjectId('561240205703b51053f01a86') } } gle1: { lastOp: Timestamp 1444036640000|11, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 12, writtenTo: null, err: null, waited: 12, ok: 1.0 } gle2: { lastOp: Timestamp 1444036614000|13, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } 2015-10-05T10:17:20.737+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:17:20.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240205703b51053f01a86 2015-10-05T10:17:20.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:17:23.016+0100 [conn1433903] end connection 172.28.0.164:52020 (203 connections now open) 2015-10-05T10:17:23.018+0100 [mongosMain] connection accepted from 172.28.0.164:52998 #1434085 (204 connections now open) 2015-10-05T10:17:23.019+0100 [conn1434085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:28.513+0100 [mongosMain] connection accepted from 127.0.0.1:59744 #1434086 (205 connections now open) 2015-10-05T10:17:28.516+0100 [conn1434086] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:28.517+0100 [conn1434086] end connection 127.0.0.1:59744 (204 connections now open) 2015-10-05T10:17:33.309+0100 [conn1433758] end connection 172.28.0.164:51099 (203 connections now open) 2015-10-05T10:17:33.319+0100 [mongosMain] connection accepted from 172.28.0.164:53013 #1434087 (204 connections now open) 2015-10-05T10:17:33.323+0100 [conn1434087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:33.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612402d5703b51053f01b27 2015-10-05T10:17:33.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:17:38.367+0100 [conn1433454] end connection 172.28.0.163:56673 (203 connections now open) 2015-10-05T10:17:38.368+0100 [mongosMain] connection accepted from 172.28.0.163:59746 #1434088 (204 connections now open) 2015-10-05T10:17:38.370+0100 [conn1434088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:39.574+0100 [mongosMain] connection accepted from 127.0.0.1:59748 #1434089 (205 connections now open) 2015-10-05T10:17:39.577+0100 [conn1434089] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:39.578+0100 [conn1434089] end connection 127.0.0.1:59748 (204 connections now open) 2015-10-05T10:17:43.314+0100 [conn1433901] end connection 172.28.0.164:51999 (203 connections now open) 2015-10-05T10:17:43.315+0100 [mongosMain] connection accepted from 172.28.0.164:53038 #1434090 (204 connections now open) 2015-10-05T10:17:43.317+0100 [conn1434090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:46.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240395703b51053f01bd8 2015-10-05T10:17:47.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:17:48.749+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:17:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:17:53.313+0100 [conn1433936] end connection 172.28.0.164:52144 (203 connections now open) 2015-10-05T10:17:53.314+0100 [mongosMain] connection accepted from 172.28.0.164:53048 #1434091 (204 connections now open) 2015-10-05T10:17:53.315+0100 [conn1434091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:53.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240415703b51053f01c27 2015-10-05T10:17:53.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:17:56.275+0100 [conn1433717] end connection 172.28.0.164:50945 (203 connections now open) 2015-10-05T10:17:56.277+0100 [mongosMain] connection accepted from 172.28.0.164:53052 #1434092 (204 connections now open) 2015-10-05T10:17:56.279+0100 [conn1434092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:17:59.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240475703b51053f01c53 2015-10-05T10:18:00.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:03.329+0100 [conn1433764] end connection 172.28.0.164:51136 (203 connections now open) 2015-10-05T10:18:03.330+0100 [mongosMain] connection accepted from 172.28.0.164:53060 #1434093 (204 connections now open) 2015-10-05T10:18:03.331+0100 [conn1434093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:18:06.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612404e5703b51053f01cb0 2015-10-05T10:18:06.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:12.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240545703b51053f01cf3 2015-10-05T10:18:12.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:13.345+0100 [conn1433899] end connection 172.28.0.164:51989 (203 connections now open) 2015-10-05T10:18:13.346+0100 [mongosMain] connection accepted from 172.28.0.164:53064 #1434094 (204 connections now open) 2015-10-05T10:18:13.347+0100 [conn1434094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:18:19.018+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:18:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:18:19.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612405a5703b51053f01d43 2015-10-05T10:18:19.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:28.582+0100 [mongosMain] connection accepted from 127.0.0.1:59792 #1434095 (205 connections now open) 2015-10-05T10:18:28.584+0100 [conn1434095] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:18:28.585+0100 [conn1434095] end connection 127.0.0.1:59792 (204 connections now open) 2015-10-05T10:18:31.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240675703b51053f01dd5 2015-10-05T10:18:31.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:37.609+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:18:37.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:18:38.383+0100 [conn1433455] end connection 172.28.0.163:56675 (203 connections now open) 2015-10-05T10:18:38.384+0100 [mongosMain] connection accepted from 172.28.0.163:59799 #1434096 (204 connections now open) 2015-10-05T10:18:38.386+0100 [conn1434096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:18:39.938+0100 [mongosMain] connection accepted from 127.0.0.1:59801 #1434097 (205 connections now open) 2015-10-05T10:18:39.940+0100 [conn1434097] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:18:39.940+0100 [conn1434097] end connection 127.0.0.1:59801 (204 connections now open) 2015-10-05T10:18:43.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240735703b51053f01e6c 2015-10-05T10:18:44.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:49.302+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:18:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:18:50.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612407a5703b51053f01ea2 2015-10-05T10:18:50.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:18:56.291+0100 [conn1433725] end connection 172.28.0.164:50953 (203 connections now open) 2015-10-05T10:18:56.293+0100 [mongosMain] connection accepted from 172.28.0.164:53127 #1434098 (204 connections now open) 2015-10-05T10:18:56.296+0100 [conn1434098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:03.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240875703b51053f01efc 2015-10-05T10:19:03.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:09.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612408d5703b51053f01f09 2015-10-05T10:19:09.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:19.458+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:19:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:19:21.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240995703b51053f01f28 2015-10-05T10:19:21.930+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:25.451+0100 [conn1433923] end connection 172.28.0.164:52084 (203 connections now open) 2015-10-05T10:19:25.451+0100 [conn1433819] end connection 172.28.0.164:51464 (203 connections now open) 2015-10-05T10:19:25.452+0100 [mongosMain] connection accepted from 172.28.0.164:53160 #1434099 (203 connections now open) 2015-10-05T10:19:25.452+0100 [mongosMain] connection accepted from 172.28.0.164:53161 #1434100 (204 connections now open) 2015-10-05T10:19:25.453+0100 [conn1434099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:25.454+0100 [conn1434100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:28.821+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:19:28.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:19:28.919+0100 [mongosMain] connection accepted from 127.0.0.1:59937 #1434101 (205 connections now open) 2015-10-05T10:19:28.921+0100 [conn1434101] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:28.923+0100 [conn1434101] end connection 127.0.0.1:59937 (204 connections now open) 2015-10-05T10:19:34.908+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561240a53b0f755fc3361588') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036774829), why: "doing balance round", ts: ObjectId('561240a65703b51053f01f52') } } gle1: { lastOp: Timestamp 1444036774000|5, connectionId: 1565, updatedExisting: true, n: 1, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } gle2: { lastOp: Timestamp 1444036761000|16, connectionId: 5195, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } 2015-10-05T10:19:34.912+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1441718816:41' 2015-10-05T10:19:35.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240a65703b51053f01f52 2015-10-05T10:19:35.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:35.467+0100 [conn1433940] end connection 172.28.0.164:52163 (203 connections now open) 2015-10-05T10:19:35.467+0100 [conn1433684] end connection 172.28.0.164:50848 (202 connections now open) 2015-10-05T10:19:35.467+0100 [mongosMain] connection accepted from 172.28.0.164:53177 #1434102 (203 connections now open) 2015-10-05T10:19:35.468+0100 [mongosMain] connection accepted from 172.28.0.164:53178 #1434103 (204 connections now open) 2015-10-05T10:19:35.469+0100 [conn1434102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:35.473+0100 [conn1434103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:38.399+0100 [conn1433456] end connection 172.28.0.163:56677 (203 connections now open) 2015-10-05T10:19:38.400+0100 [mongosMain] connection accepted from 172.28.0.163:59941 #1434104 (204 connections now open) 2015-10-05T10:19:38.402+0100 [conn1434104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:39.935+0100 [mongosMain] connection accepted from 127.0.0.1:59943 #1434105 (205 connections now open) 2015-10-05T10:19:39.937+0100 [conn1434105] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:39.938+0100 [conn1434105] end connection 127.0.0.1:59943 (204 connections now open) 2015-10-05T10:19:45.498+0100 [conn1433822] end connection 172.28.0.164:51482 (203 connections now open) 2015-10-05T10:19:45.499+0100 [mongosMain] connection accepted from 172.28.0.164:53194 #1434106 (204 connections now open) 2015-10-05T10:19:45.502+0100 [conn1434106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:47.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240b35703b51053f01f70 2015-10-05T10:19:47.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:49.743+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:19:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:19:54.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240b95703b51053f01faa 2015-10-05T10:19:54.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:19:56.307+0100 [conn1433724] end connection 172.28.0.164:50952 (203 connections now open) 2015-10-05T10:19:56.309+0100 [mongosMain] connection accepted from 172.28.0.164:53208 #1434107 (204 connections now open) 2015-10-05T10:19:56.312+0100 [conn1434107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:19:57.475+0100 [conn1433957] end connection 172.28.0.164:52255 (203 connections now open) 2015-10-05T10:19:57.497+0100 [mongosMain] connection accepted from 172.28.0.164:53209 #1434108 (204 connections now open) 2015-10-05T10:19:57.499+0100 [conn1434108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:02.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240c05703b51053f01fd7 2015-10-05T10:20:02.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:20:07.464+0100 [conn1433868] end connection 172.28.0.164:51850 (203 connections now open) 2015-10-05T10:20:07.465+0100 [mongosMain] connection accepted from 172.28.0.164:53225 #1434109 (204 connections now open) 2015-10-05T10:20:07.467+0100 [conn1434109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:15.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240ce5703b51053f020d0 2015-10-05T10:20:15.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:20:17.463+0100 [conn1433914] end connection 172.28.0.164:52051 (203 connections now open) 2015-10-05T10:20:17.464+0100 [conn1433949] end connection 172.28.0.164:52193 (202 connections now open) 2015-10-05T10:20:17.465+0100 [mongosMain] connection accepted from 172.28.0.164:53234 #1434110 (203 connections now open) 2015-10-05T10:20:17.465+0100 [mongosMain] connection accepted from 172.28.0.164:53235 #1434111 (204 connections now open) 2015-10-05T10:20:17.467+0100 [conn1434110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:17.467+0100 [conn1434111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:20.032+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:20:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:20:27.495+0100 [conn1433852] end connection 172.28.0.164:51748 (203 connections now open) 2015-10-05T10:20:27.496+0100 [mongosMain] connection accepted from 172.28.0.164:53250 #1434112 (204 connections now open) 2015-10-05T10:20:27.497+0100 [conn1434112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:28.362+0100 [mongosMain] connection accepted from 127.0.0.1:59989 #1434113 (205 connections now open) 2015-10-05T10:20:28.365+0100 [conn1434113] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:28.366+0100 [conn1434113] end connection 127.0.0.1:59989 (204 connections now open) 2015-10-05T10:20:29.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240dc5703b51053f021b1 2015-10-05T10:20:29.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:20:36.922+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:20:36.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:20:37.803+0100 [conn1433881] end connection 172.28.0.164:51895 (203 connections now open) 2015-10-05T10:20:37.808+0100 [mongosMain] connection accepted from 172.28.0.164:53263 #1434114 (204 connections now open) 2015-10-05T10:20:37.810+0100 [conn1434114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:38.415+0100 [conn1433457] end connection 172.28.0.163:56679 (203 connections now open) 2015-10-05T10:20:38.416+0100 [mongosMain] connection accepted from 172.28.0.163:59995 #1434115 (204 connections now open) 2015-10-05T10:20:38.418+0100 [conn1434115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:39.855+0100 [mongosMain] connection accepted from 127.0.0.1:59997 #1434116 (205 connections now open) 2015-10-05T10:20:39.858+0100 [conn1434116] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:39.858+0100 [conn1434116] end connection 127.0.0.1:59997 (204 connections now open) 2015-10-05T10:20:47.714+0100 [conn1433755] end connection 172.28.0.164:51085 (203 connections now open) 2015-10-05T10:20:47.715+0100 [mongosMain] connection accepted from 172.28.0.164:53281 #1434117 (204 connections now open) 2015-10-05T10:20:47.716+0100 [conn1434117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:49.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240f05703b51053f022f0 2015-10-05T10:20:49.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:20:50.293+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:20:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:20:56.323+0100 [conn1433727] end connection 172.28.0.164:50956 (203 connections now open) 2015-10-05T10:20:56.325+0100 [mongosMain] connection accepted from 172.28.0.164:53294 #1434118 (204 connections now open) 2015-10-05T10:20:56.328+0100 [conn1434118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:20:59.746+0100 [conn1433889] end connection 172.28.0.164:51927 (203 connections now open) 2015-10-05T10:20:59.748+0100 [mongosMain] connection accepted from 172.28.0.164:53295 #1434119 (204 connections now open) 2015-10-05T10:20:59.749+0100 [conn1434119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:03.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561240fd5703b51053f023bb 2015-10-05T10:21:04.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:09.726+0100 [conn1433787] end connection 172.28.0.164:51239 (203 connections now open) 2015-10-05T10:21:09.727+0100 [mongosMain] connection accepted from 172.28.0.164:53314 #1434120 (204 connections now open) 2015-10-05T10:21:09.729+0100 [conn1434120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:10.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241065703b51053f02497 2015-10-05T10:21:10.941+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:17.221+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612410c5703b51053f02516 2015-10-05T10:21:17.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:19.730+0100 [conn1433897] end connection 172.28.0.164:51974 (203 connections now open) 2015-10-05T10:21:19.731+0100 [mongosMain] connection accepted from 172.28.0.164:53319 #1434121 (204 connections now open) 2015-10-05T10:21:19.733+0100 [conn1434121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:20.701+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:21:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:21:23.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241135703b51053f02593 2015-10-05T10:21:23.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:28.766+0100 [mongosMain] connection accepted from 127.0.0.1:60042 #1434122 (205 connections now open) 2015-10-05T10:21:28.769+0100 [conn1434122] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:28.770+0100 [conn1434122] end connection 127.0.0.1:60042 (204 connections now open) 2015-10-05T10:21:29.742+0100 [conn1433840] end connection 172.28.0.164:51652 (203 connections now open) 2015-10-05T10:21:29.743+0100 [mongosMain] connection accepted from 172.28.0.164:53333 #1434123 (204 connections now open) 2015-10-05T10:21:29.744+0100 [conn1434123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:30.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241195703b51053f0260d 2015-10-05T10:21:30.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:37.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241205703b51053f02685 2015-10-05T10:21:38.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:38.431+0100 [conn1433458] end connection 172.28.0.163:56680 (203 connections now open) 2015-10-05T10:21:38.432+0100 [mongosMain] connection accepted from 172.28.0.163:60044 #1434124 (204 connections now open) 2015-10-05T10:21:38.434+0100 [conn1434124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:39.678+0100 [mongosMain] connection accepted from 127.0.0.1:60046 #1434125 (205 connections now open) 2015-10-05T10:21:39.681+0100 [conn1434125] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:39.681+0100 [conn1434125] end connection 127.0.0.1:60046 (204 connections now open) 2015-10-05T10:21:39.758+0100 [conn1433872] end connection 172.28.0.164:51867 (203 connections now open) 2015-10-05T10:21:39.759+0100 [mongosMain] connection accepted from 172.28.0.164:53349 #1434126 (204 connections now open) 2015-10-05T10:21:39.761+0100 [conn1434126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:47.943+0100 [mongosMain] connection accepted from 172.21.40.52:53467 #1434127 (205 connections now open) 2015-10-05T10:21:48.229+0100 [conn1434127] authenticate db: admin { authenticate: 1, nonce: "xxx", user: "ma", key: "xxx" } 2015-10-05T10:21:49.758+0100 [conn1433775] end connection 172.28.0.164:51184 (204 connections now open) 2015-10-05T10:21:49.760+0100 [mongosMain] connection accepted from 172.28.0.164:53364 #1434128 (205 connections now open) 2015-10-05T10:21:49.762+0100 [conn1434128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:50.206+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612412b38482111da12de3b') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1441718816:41:Balancer:18467", process: "402929-MYWAPP1:27017:1441718816:41", when: new Date(1444036910073), why: "doing balance round", ts: ObjectId('5612412e5703b51053f02786') } } gle1: { lastOp: Timestamp 1444036898000|2, connectionId: 1565, updatedExisting: false, n: 0, syncMillis: 12, writtenTo: null, err: null, waited: 12, ok: 1.0 } gle2: { lastOp: Timestamp 1444036910000|3, connectionId: 11, updatedExisting: true, n: 1, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } 2015-10-05T10:21:50.208+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1441718816:41' not propagated. 2015-10-05T10:21:50.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:21:50.991+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:21:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:21:50.991+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1441718816:41 2015-10-05T10:21:51.127+0100 [LockPinger] handled late remove of old distributed lock with ts 5612412e5703b51053f02786 2015-10-05T10:21:56.340+0100 [conn1433728] end connection 172.28.0.164:50957 (204 connections now open) 2015-10-05T10:21:56.341+0100 [mongosMain] connection accepted from 172.28.0.164:53373 #1434129 (205 connections now open) 2015-10-05T10:21:56.344+0100 [conn1434129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:21:56.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241345703b51053f027cf 2015-10-05T10:21:56.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:21:59.930+0100 [conn1433782] end connection 172.28.0.164:51212 (204 connections now open) 2015-10-05T10:21:59.945+0100 [mongosMain] connection accepted from 172.28.0.164:53378 #1434130 (205 connections now open) 2015-10-05T10:21:59.948+0100 [conn1434130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:09.930+0100 [conn1433793] end connection 172.28.0.164:51267 (204 connections now open) 2015-10-05T10:22:09.931+0100 [mongosMain] connection accepted from 172.28.0.164:53393 #1434131 (205 connections now open) 2015-10-05T10:22:09.932+0100 [conn1434131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:11.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241415703b51053f028c2 2015-10-05T10:22:11.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:22:19.945+0100 [conn1433944] end connection 172.28.0.164:52177 (204 connections now open) 2015-10-05T10:22:19.946+0100 [mongosMain] connection accepted from 172.28.0.164:53402 #1434132 (205 connections now open) 2015-10-05T10:22:19.947+0100 [conn1434132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:21.283+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:22:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:22:28.415+0100 [mongosMain] connection accepted from 127.0.0.1:60103 #1434133 (206 connections now open) 2015-10-05T10:22:28.418+0100 [conn1434133] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:28.419+0100 [conn1434133] end connection 127.0.0.1:60103 (205 connections now open) 2015-10-05T10:22:29.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241555703b51053f02a4b 2015-10-05T10:22:29.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:22:29.961+0100 [conn1433974] end connection 172.28.0.164:52437 (204 connections now open) 2015-10-05T10:22:29.963+0100 [mongosMain] connection accepted from 172.28.0.164:53418 #1434134 (205 connections now open) 2015-10-05T10:22:29.964+0100 [conn1434134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:38.447+0100 [conn1433459] end connection 172.28.0.163:56682 (204 connections now open) 2015-10-05T10:22:38.448+0100 [mongosMain] connection accepted from 172.28.0.163:60105 #1434135 (205 connections now open) 2015-10-05T10:22:38.450+0100 [conn1434135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:39.923+0100 [mongosMain] connection accepted from 127.0.0.1:60108 #1434136 (206 connections now open) 2015-10-05T10:22:39.925+0100 [conn1434136] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:39.926+0100 [conn1434136] end connection 127.0.0.1:60108 (205 connections now open) 2015-10-05T10:22:39.961+0100 [conn1433978] end connection 172.28.0.164:52453 (204 connections now open) 2015-10-05T10:22:39.962+0100 [mongosMain] connection accepted from 172.28.0.164:53430 #1434137 (205 connections now open) 2015-10-05T10:22:39.964+0100 [conn1434137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:43.194+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:22:43.194+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:22:49.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241695703b51053f02b56 2015-10-05T10:22:49.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:22:49.961+0100 [conn1433988] end connection 172.28.0.164:52479 (204 connections now open) 2015-10-05T10:22:49.963+0100 [mongosMain] connection accepted from 172.28.0.164:53446 #1434138 (205 connections now open) 2015-10-05T10:22:49.964+0100 [conn1434138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:22:51.563+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:22:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:22:56.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612416f5703b51053f02b7a 2015-10-05T10:22:56.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:22:56.356+0100 [conn1433719] end connection 172.28.0.164:50947 (204 connections now open) 2015-10-05T10:22:56.358+0100 [mongosMain] connection accepted from 172.28.0.164:53454 #1434139 (205 connections now open) 2015-10-05T10:22:56.361+0100 [conn1434139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:00.002+0100 [conn1433993] end connection 172.28.0.164:52496 (204 connections now open) 2015-10-05T10:23:00.002+0100 [mongosMain] connection accepted from 172.28.0.164:53460 #1434140 (205 connections now open) 2015-10-05T10:23:00.002+0100 [conn1434140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:07.004+0100 [mongosMain] connection accepted from 172.28.0.163:60151 #1434141 (206 connections now open) 2015-10-05T10:23:07.005+0100 [mongosMain] connection accepted from 172.28.0.163:60152 #1434142 (207 connections now open) 2015-10-05T10:23:08.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612417c5703b51053f02bd1 2015-10-05T10:23:08.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:23:09.993+0100 [conn1433867] end connection 172.28.0.164:51849 (206 connections now open) 2015-10-05T10:23:09.993+0100 [conn1433661] end connection 172.28.0.164:50748 (205 connections now open) 2015-10-05T10:23:09.994+0100 [mongosMain] connection accepted from 172.28.0.164:53464 #1434143 (206 connections now open) 2015-10-05T10:23:09.996+0100 [mongosMain] connection accepted from 172.28.0.164:53465 #1434144 (207 connections now open) 2015-10-05T10:23:09.996+0100 [conn1434143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:09.997+0100 [conn1434144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:15.157+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:23:15.157+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:23:19.995+0100 [conn1433951] end connection 172.28.0.164:52205 (206 connections now open) 2015-10-05T10:23:19.996+0100 [mongosMain] connection accepted from 172.28.0.164:53475 #1434145 (207 connections now open) 2015-10-05T10:23:19.998+0100 [conn1434145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:21.262+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:23:21.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:23:21.707+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:23:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:23:27.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612418f5703b51053f02c0c 2015-10-05T10:23:27.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:23:28.545+0100 [mongosMain] connection accepted from 127.0.0.1:60165 #1434146 (208 connections now open) 2015-10-05T10:23:28.548+0100 [conn1434146] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:28.550+0100 [conn1434146] end connection 127.0.0.1:60165 (207 connections now open) 2015-10-05T10:23:30.058+0100 [conn1433908] end connection 172.28.0.164:52033 (206 connections now open) 2015-10-05T10:23:30.060+0100 [mongosMain] connection accepted from 172.28.0.164:53488 #1434147 (207 connections now open) 2015-10-05T10:23:30.061+0100 [conn1434147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:38.464+0100 [conn1433460] end connection 172.28.0.163:56685 (206 connections now open) 2015-10-05T10:23:38.465+0100 [mongosMain] connection accepted from 172.28.0.163:60167 #1434148 (207 connections now open) 2015-10-05T10:23:38.467+0100 [conn1434148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:39.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612419b5703b51053f02c2e 2015-10-05T10:23:39.855+0100 [mongosMain] connection accepted from 127.0.0.1:60169 #1434149 (208 connections now open) 2015-10-05T10:23:39.857+0100 [conn1434149] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:39.858+0100 [conn1434149] end connection 127.0.0.1:60169 (207 connections now open) 2015-10-05T10:23:39.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:23:40.071+0100 [conn1433981] end connection 172.28.0.164:52457 (206 connections now open) 2015-10-05T10:23:40.072+0100 [mongosMain] connection accepted from 172.28.0.164:53503 #1434150 (207 connections now open) 2015-10-05T10:23:40.074+0100 [conn1434150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:46.529+0100 [conn1434142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:50.087+0100 [conn1433996] end connection 172.28.0.164:52508 (206 connections now open) 2015-10-05T10:23:50.088+0100 [mongosMain] connection accepted from 172.28.0.164:53516 #1434151 (207 connections now open) 2015-10-05T10:23:50.089+0100 [conn1434151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:51.972+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:23:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:23:56.371+0100 [conn1433729] end connection 172.28.0.164:50958 (206 connections now open) 2015-10-05T10:23:56.372+0100 [mongosMain] connection accepted from 172.28.0.164:53524 #1434152 (207 connections now open) 2015-10-05T10:23:56.375+0100 [conn1434152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:23:58.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241ad5703b51053f02c4b 2015-10-05T10:23:58.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:00.103+0100 [conn1433918] end connection 172.28.0.164:52064 (206 connections now open) 2015-10-05T10:24:00.104+0100 [mongosMain] connection accepted from 172.28.0.164:53526 #1434153 (207 connections now open) 2015-10-05T10:24:00.106+0100 [conn1434153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:10.118+0100 [conn1433855] end connection 172.28.0.164:51769 (206 connections now open) 2015-10-05T10:24:10.120+0100 [mongosMain] connection accepted from 172.28.0.164:53531 #1434154 (207 connections now open) 2015-10-05T10:24:10.122+0100 [conn1434154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:16.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241c05703b51053f02c6e 2015-10-05T10:24:16.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:20.135+0100 [conn1433814] end connection 172.28.0.164:51441 (206 connections now open) 2015-10-05T10:24:20.135+0100 [conn1433741] end connection 172.28.0.164:51020 (205 connections now open) 2015-10-05T10:24:20.136+0100 [mongosMain] connection accepted from 172.28.0.164:53539 #1434155 (206 connections now open) 2015-10-05T10:24:20.136+0100 [mongosMain] connection accepted from 172.28.0.164:53540 #1434156 (207 connections now open) 2015-10-05T10:24:20.137+0100 [conn1434155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:20.138+0100 [conn1434156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:22.264+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:24:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:24:22.508+0100 [conn1434141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:28.583+0100 [mongosMain] connection accepted from 127.0.0.1:60210 #1434157 (208 connections now open) 2015-10-05T10:24:28.586+0100 [conn1434157] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:28.587+0100 [conn1434157] end connection 127.0.0.1:60210 (207 connections now open) 2015-10-05T10:24:28.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241cc5703b51053f02c87 2015-10-05T10:24:29.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:30.139+0100 [conn1433888] end connection 172.28.0.164:51928 (206 connections now open) 2015-10-05T10:24:30.140+0100 [mongosMain] connection accepted from 172.28.0.164:53554 #1434158 (207 connections now open) 2015-10-05T10:24:30.142+0100 [conn1434158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:35.172+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:24:35.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:24:38.480+0100 [conn1433461] end connection 172.28.0.163:56688 (206 connections now open) 2015-10-05T10:24:38.481+0100 [mongosMain] connection accepted from 172.28.0.163:60212 #1434159 (207 connections now open) 2015-10-05T10:24:38.483+0100 [conn1434159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:39.819+0100 [mongosMain] connection accepted from 127.0.0.1:60214 #1434160 (208 connections now open) 2015-10-05T10:24:39.822+0100 [conn1434160] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:39.822+0100 [conn1434160] end connection 127.0.0.1:60214 (207 connections now open) 2015-10-05T10:24:40.135+0100 [conn1433805] end connection 172.28.0.164:51390 (206 connections now open) 2015-10-05T10:24:40.135+0100 [mongosMain] connection accepted from 172.28.0.164:53567 #1434161 (207 connections now open) 2015-10-05T10:24:40.136+0100 [conn1434161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:41.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241d95703b51053f02cac 2015-10-05T10:24:41.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:47.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241df5703b51053f02cbd 2015-10-05T10:24:47.980+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:50.150+0100 [conn1434005] end connection 172.28.0.164:52543 (206 connections now open) 2015-10-05T10:24:50.151+0100 [mongosMain] connection accepted from 172.28.0.164:53579 #1434162 (207 connections now open) 2015-10-05T10:24:50.153+0100 [conn1434162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:24:52.519+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:24:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:24:54.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241e55703b51053f02cd5 2015-10-05T10:24:54.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:24:56.388+0100 [conn1433720] end connection 172.28.0.164:50948 (206 connections now open) 2015-10-05T10:24:56.389+0100 [mongosMain] connection accepted from 172.28.0.164:53586 #1434163 (207 connections now open) 2015-10-05T10:24:56.391+0100 [conn1434163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:00.166+0100 [conn1434025] end connection 172.28.0.164:52613 (206 connections now open) 2015-10-05T10:25:00.167+0100 [mongosMain] connection accepted from 172.28.0.164:53589 #1434164 (207 connections now open) 2015-10-05T10:25:00.168+0100 [conn1434164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:00.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241ec5703b51053f02cdc 2015-10-05T10:25:00.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:07.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241f25703b51053f02ce3 2015-10-05T10:25:07.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:09.011+0100 [mongosMain] connection accepted from 172.28.0.163:60245 #1434165 (208 connections now open) 2015-10-05T10:25:09.036+0100 [conn1434165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:10.181+0100 [conn1434019] end connection 172.28.0.164:52591 (207 connections now open) 2015-10-05T10:25:10.183+0100 [mongosMain] connection accepted from 172.28.0.164:53592 #1434166 (208 connections now open) 2015-10-05T10:25:10.185+0100 [conn1434166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:13.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241f95703b51053f02cf1 2015-10-05T10:25:13.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:19.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561241ff5703b51053f02d0b 2015-10-05T10:25:19.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:20.198+0100 [conn1434052] end connection 172.28.0.164:52728 (207 connections now open) 2015-10-05T10:25:20.199+0100 [mongosMain] connection accepted from 172.28.0.164:53598 #1434167 (208 connections now open) 2015-10-05T10:25:20.201+0100 [conn1434167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:22.777+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:25:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:25:26.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242055703b51053f02d14 2015-10-05T10:25:26.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:28.739+0100 [mongosMain] connection accepted from 127.0.0.1:60253 #1434168 (209 connections now open) 2015-10-05T10:25:28.742+0100 [conn1434168] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:28.743+0100 [conn1434168] end connection 127.0.0.1:60253 (208 connections now open) 2015-10-05T10:25:30.213+0100 [conn1433763] end connection 172.28.0.164:51135 (207 connections now open) 2015-10-05T10:25:30.213+0100 [conn1434016] end connection 172.28.0.164:52577 (207 connections now open) 2015-10-05T10:25:30.214+0100 [mongosMain] connection accepted from 172.28.0.164:53612 #1434169 (207 connections now open) 2015-10-05T10:25:30.215+0100 [mongosMain] connection accepted from 172.28.0.164:53611 #1434170 (208 connections now open) 2015-10-05T10:25:30.216+0100 [conn1434169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:30.216+0100 [conn1434170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:32.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612420c5703b51053f02d35 2015-10-05T10:25:32.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:38.497+0100 [conn1433462] end connection 172.28.0.163:56691 (207 connections now open) 2015-10-05T10:25:38.498+0100 [mongosMain] connection accepted from 172.28.0.163:60257 #1434171 (208 connections now open) 2015-10-05T10:25:38.500+0100 [conn1434171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:38.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242125703b51053f02d4d 2015-10-05T10:25:38.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:39.942+0100 [mongosMain] connection accepted from 127.0.0.1:60259 #1434172 (209 connections now open) 2015-10-05T10:25:39.944+0100 [conn1434172] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:39.945+0100 [conn1434172] end connection 127.0.0.1:60259 (208 connections now open) 2015-10-05T10:25:40.229+0100 [conn1434033] end connection 172.28.0.164:52640 (207 connections now open) 2015-10-05T10:25:40.229+0100 [conn1433894] end connection 172.28.0.164:51950 (207 connections now open) 2015-10-05T10:25:40.231+0100 [mongosMain] connection accepted from 172.28.0.164:53624 #1434173 (207 connections now open) 2015-10-05T10:25:40.232+0100 [mongosMain] connection accepted from 172.28.0.164:53625 #1434174 (208 connections now open) 2015-10-05T10:25:40.233+0100 [conn1434173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.233+0100 [conn1434174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.511+0100 [mongosMain] connection accepted from 172.28.0.163:60261 #1434175 (209 connections now open) 2015-10-05T10:25:40.513+0100 [conn1434175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.515+0100 [mongosMain] connection accepted from 172.28.0.163:60263 #1434176 (210 connections now open) 2015-10-05T10:25:40.518+0100 [conn1434176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.520+0100 [mongosMain] connection accepted from 172.28.0.163:60264 #1434177 (211 connections now open) 2015-10-05T10:25:40.522+0100 [conn1434177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.525+0100 [mongosMain] connection accepted from 172.28.0.163:60265 #1434178 (212 connections now open) 2015-10-05T10:25:40.535+0100 [mongosMain] connection accepted from 172.28.0.163:60266 #1434179 (213 connections now open) 2015-10-05T10:25:40.536+0100 [mongosMain] connection accepted from 172.28.0.163:60267 #1434180 (214 connections now open) 2015-10-05T10:25:40.536+0100 [mongosMain] connection accepted from 172.28.0.163:60268 #1434181 (215 connections now open) 2015-10-05T10:25:40.537+0100 [mongosMain] connection accepted from 172.28.0.163:60269 #1434182 (216 connections now open) 2015-10-05T10:25:40.537+0100 [mongosMain] connection accepted from 172.28.0.163:60270 #1434183 (217 connections now open) 2015-10-05T10:25:40.537+0100 [conn1434178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.538+0100 [mongosMain] connection accepted from 172.28.0.163:60271 #1434184 (218 connections now open) 2015-10-05T10:25:40.538+0100 [mongosMain] connection accepted from 172.28.0.163:60272 #1434185 (219 connections now open) 2015-10-05T10:25:40.538+0100 [conn1434181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.539+0100 [conn1434182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.539+0100 [mongosMain] connection accepted from 172.28.0.163:60273 #1434186 (220 connections now open) 2015-10-05T10:25:40.540+0100 [conn1434180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.541+0100 [mongosMain] connection accepted from 172.28.0.163:60274 #1434187 (221 connections now open) 2015-10-05T10:25:40.541+0100 [conn1434183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.543+0100 [conn1434184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.544+0100 [conn1434186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.548+0100 [mongosMain] connection accepted from 172.28.0.163:60275 #1434188 (222 connections now open) 2015-10-05T10:25:40.549+0100 [mongosMain] connection accepted from 172.28.0.163:60276 #1434189 (223 connections now open) 2015-10-05T10:25:40.550+0100 [mongosMain] connection accepted from 172.28.0.163:60277 #1434190 (224 connections now open) 2015-10-05T10:25:40.550+0100 [mongosMain] connection accepted from 172.28.0.163:60278 #1434191 (225 connections now open) 2015-10-05T10:25:40.551+0100 [mongosMain] connection accepted from 172.28.0.163:60279 #1434192 (226 connections now open) 2015-10-05T10:25:40.552+0100 [mongosMain] connection accepted from 172.28.0.163:60280 #1434193 (227 connections now open) 2015-10-05T10:25:40.555+0100 [conn1434193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.556+0100 [conn1434192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.558+0100 [conn1434188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.560+0100 [mongosMain] connection accepted from 172.28.0.163:60281 #1434194 (228 connections now open) 2015-10-05T10:25:40.560+0100 [mongosMain] connection accepted from 172.28.0.163:60282 #1434195 (229 connections now open) 2015-10-05T10:25:40.560+0100 [mongosMain] connection accepted from 172.28.0.163:60283 #1434196 (230 connections now open) 2015-10-05T10:25:40.561+0100 [mongosMain] connection accepted from 172.28.0.163:60284 #1434197 (231 connections now open) 2015-10-05T10:25:40.562+0100 [mongosMain] connection accepted from 172.28.0.163:60285 #1434198 (232 connections now open) 2015-10-05T10:25:40.562+0100 [conn1434194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.562+0100 [mongosMain] connection accepted from 172.28.0.163:60286 #1434199 (233 connections now open) 2015-10-05T10:25:40.562+0100 [conn1434195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.562+0100 [conn1434196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.563+0100 [mongosMain] connection accepted from 172.28.0.163:60287 #1434200 (234 connections now open) 2015-10-05T10:25:40.563+0100 [conn1434198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.564+0100 [conn1434199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.564+0100 [mongosMain] connection accepted from 172.28.0.163:60288 #1434201 (235 connections now open) 2015-10-05T10:25:40.564+0100 [mongosMain] connection accepted from 172.28.0.163:60289 #1434202 (236 connections now open) 2015-10-05T10:25:40.564+0100 [conn1434200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.566+0100 [mongosMain] connection accepted from 172.28.0.163:60290 #1434203 (237 connections now open) 2015-10-05T10:25:40.566+0100 [conn1434202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.567+0100 [mongosMain] connection accepted from 172.28.0.163:60291 #1434204 (238 connections now open) 2015-10-05T10:25:40.568+0100 [mongosMain] connection accepted from 172.28.0.163:60292 #1434205 (239 connections now open) 2015-10-05T10:25:40.568+0100 [mongosMain] connection accepted from 172.28.0.163:60293 #1434206 (240 connections now open) 2015-10-05T10:25:40.569+0100 [mongosMain] connection accepted from 172.28.0.163:60294 #1434207 (241 connections now open) 2015-10-05T10:25:40.569+0100 [mongosMain] connection accepted from 172.28.0.163:60295 #1434208 (242 connections now open) 2015-10-05T10:25:40.570+0100 [mongosMain] connection accepted from 172.28.0.163:60296 #1434209 (243 connections now open) 2015-10-05T10:25:40.570+0100 [mongosMain] connection accepted from 172.28.0.163:60297 #1434210 (244 connections now open) 2015-10-05T10:25:40.573+0100 [mongosMain] connection accepted from 172.28.0.163:60298 #1434211 (245 connections now open) 2015-10-05T10:25:40.573+0100 [mongosMain] connection accepted from 172.28.0.163:60300 #1434212 (246 connections now open) 2015-10-05T10:25:40.573+0100 [mongosMain] connection accepted from 172.28.0.163:60301 #1434213 (247 connections now open) 2015-10-05T10:25:40.573+0100 [mongosMain] connection accepted from 172.28.0.163:60303 #1434214 (248 connections now open) 2015-10-05T10:25:40.574+0100 [mongosMain] connection accepted from 172.28.0.163:60299 #1434215 (249 connections now open) 2015-10-05T10:25:40.575+0100 [mongosMain] connection accepted from 172.28.0.163:60305 #1434216 (250 connections now open) 2015-10-05T10:25:40.575+0100 [mongosMain] connection accepted from 172.28.0.163:60306 #1434217 (251 connections now open) 2015-10-05T10:25:40.575+0100 [mongosMain] connection accepted from 172.28.0.163:60307 #1434218 (252 connections now open) 2015-10-05T10:25:40.575+0100 [mongosMain] connection accepted from 172.28.0.163:60308 #1434219 (253 connections now open) 2015-10-05T10:25:40.576+0100 [mongosMain] connection accepted from 172.28.0.163:60309 #1434220 (254 connections now open) 2015-10-05T10:25:40.576+0100 [mongosMain] connection accepted from 172.28.0.163:60310 #1434221 (255 connections now open) 2015-10-05T10:25:40.577+0100 [mongosMain] connection accepted from 172.28.0.163:60312 #1434222 (256 connections now open) 2015-10-05T10:25:40.577+0100 [mongosMain] connection accepted from 172.28.0.163:60313 #1434223 (257 connections now open) 2015-10-05T10:25:40.577+0100 [mongosMain] connection accepted from 172.28.0.163:60311 #1434224 (258 connections now open) 2015-10-05T10:25:40.578+0100 [mongosMain] connection accepted from 172.28.0.163:60314 #1434225 (259 connections now open) 2015-10-05T10:25:40.578+0100 [mongosMain] connection accepted from 172.28.0.163:60315 #1434226 (260 connections now open) 2015-10-05T10:25:40.578+0100 [mongosMain] connection accepted from 172.28.0.163:60316 #1434227 (261 connections now open) 2015-10-05T10:25:40.578+0100 [mongosMain] connection accepted from 172.28.0.163:60318 #1434228 (262 connections now open) 2015-10-05T10:25:40.579+0100 [mongosMain] connection accepted from 172.28.0.163:60317 #1434229 (263 connections now open) 2015-10-05T10:25:40.579+0100 [mongosMain] connection accepted from 172.28.0.163:60319 #1434230 (264 connections now open) 2015-10-05T10:25:40.580+0100 [mongosMain] connection accepted from 172.28.0.163:60320 #1434231 (265 connections now open) 2015-10-05T10:25:40.580+0100 [mongosMain] connection accepted from 172.28.0.163:60321 #1434232 (266 connections now open) 2015-10-05T10:25:40.580+0100 [mongosMain] connection accepted from 172.28.0.163:60322 #1434233 (267 connections now open) 2015-10-05T10:25:40.580+0100 [mongosMain] connection accepted from 172.28.0.163:60323 #1434234 (268 connections now open) 2015-10-05T10:25:40.581+0100 [mongosMain] connection accepted from 172.28.0.163:60325 #1434235 (269 connections now open) 2015-10-05T10:25:40.581+0100 [mongosMain] connection accepted from 172.28.0.163:60324 #1434236 (270 connections now open) 2015-10-05T10:25:40.581+0100 [mongosMain] connection accepted from 172.28.0.163:60326 #1434237 (271 connections now open) 2015-10-05T10:25:40.581+0100 [mongosMain] connection accepted from 172.28.0.163:60327 #1434238 (272 connections now open) 2015-10-05T10:25:40.582+0100 [mongosMain] connection accepted from 172.28.0.163:60328 #1434239 (273 connections now open) 2015-10-05T10:25:40.582+0100 [mongosMain] connection accepted from 172.28.0.163:60329 #1434240 (274 connections now open) 2015-10-05T10:25:40.582+0100 [mongosMain] connection accepted from 172.28.0.163:60330 #1434241 (275 connections now open) 2015-10-05T10:25:40.582+0100 [mongosMain] connection accepted from 172.28.0.163:60331 #1434242 (276 connections now open) 2015-10-05T10:25:40.583+0100 [mongosMain] connection accepted from 172.28.0.163:60332 #1434243 (277 connections now open) 2015-10-05T10:25:40.583+0100 [mongosMain] connection accepted from 172.28.0.163:60333 #1434244 (278 connections now open) 2015-10-05T10:25:40.587+0100 [conn1434206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.588+0100 [conn1434212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.588+0100 [conn1434214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.589+0100 [conn1434224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.590+0100 [conn1434236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.592+0100 [conn1434207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.591+0100 [conn1434210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.594+0100 [mongosMain] connection accepted from 172.28.0.163:60334 #1434245 (279 connections now open) 2015-10-05T10:25:40.595+0100 [conn1434213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.596+0100 [conn1434211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.596+0100 [conn1434205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.597+0100 [conn1434216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.598+0100 [mongosMain] connection accepted from 172.28.0.163:60335 #1434246 (280 connections now open) 2015-10-05T10:25:40.606+0100 [mongosMain] connection accepted from 172.28.0.163:60336 #1434247 (281 connections now open) 2015-10-05T10:25:40.608+0100 [conn1434228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.608+0100 [conn1434185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.608+0100 [conn1434234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.609+0100 [conn1434219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.612+0100 [mongosMain] connection accepted from 172.28.0.163:60338 #1434248 (282 connections now open) 2015-10-05T10:25:40.612+0100 [mongosMain] connection accepted from 172.28.0.163:60339 #1434249 (283 connections now open) 2015-10-05T10:25:40.617+0100 [conn1434222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.620+0100 [mongosMain] connection accepted from 172.28.0.163:60340 #1434250 (284 connections now open) 2015-10-05T10:25:40.620+0100 [mongosMain] connection accepted from 172.28.0.163:60341 #1434251 (285 connections now open) 2015-10-05T10:25:40.622+0100 [mongosMain] connection accepted from 172.28.0.163:60342 #1434252 (286 connections now open) 2015-10-05T10:25:40.623+0100 [mongosMain] connection accepted from 172.28.0.163:60343 #1434253 (287 connections now open) 2015-10-05T10:25:40.623+0100 [mongosMain] connection accepted from 172.28.0.163:60344 #1434254 (288 connections now open) 2015-10-05T10:25:40.624+0100 [mongosMain] connection accepted from 172.28.0.163:60345 #1434255 (289 connections now open) 2015-10-05T10:25:40.627+0100 [conn1434231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.627+0100 [conn1434225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.629+0100 [conn1434237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.630+0100 [conn1434243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.631+0100 [mongosMain] connection accepted from 172.28.0.163:60346 #1434256 (290 connections now open) 2015-10-05T10:25:40.632+0100 [conn1434217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.632+0100 [conn1434223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.632+0100 [conn1434229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.633+0100 [mongosMain] connection accepted from 172.28.0.163:60347 #1434257 (291 connections now open) 2015-10-05T10:25:40.634+0100 [mongosMain] connection accepted from 172.28.0.163:60348 #1434258 (292 connections now open) 2015-10-05T10:25:40.634+0100 [mongosMain] connection accepted from 172.28.0.163:60349 #1434259 (293 connections now open) 2015-10-05T10:25:40.634+0100 [mongosMain] connection accepted from 172.28.0.163:60350 #1434260 (294 connections now open) 2015-10-05T10:25:40.634+0100 [mongosMain] connection accepted from 172.28.0.163:60351 #1434261 (295 connections now open) 2015-10-05T10:25:40.635+0100 [mongosMain] connection accepted from 172.28.0.163:60352 #1434262 (296 connections now open) 2015-10-05T10:25:40.635+0100 [mongosMain] connection accepted from 172.28.0.163:60353 #1434263 (297 connections now open) 2015-10-05T10:25:40.638+0100 [mongosMain] connection accepted from 172.28.0.163:60354 #1434264 (298 connections now open) 2015-10-05T10:25:40.638+0100 [mongosMain] connection accepted from 172.28.0.163:60355 #1434265 (299 connections now open) 2015-10-05T10:25:40.638+0100 [mongosMain] connection accepted from 172.28.0.163:60356 #1434266 (300 connections now open) 2015-10-05T10:25:40.639+0100 [mongosMain] connection accepted from 172.28.0.163:60357 #1434267 (301 connections now open) 2015-10-05T10:25:40.640+0100 [mongosMain] connection accepted from 172.28.0.163:60358 #1434268 (302 connections now open) 2015-10-05T10:25:40.640+0100 [mongosMain] connection accepted from 172.28.0.163:60359 #1434269 (303 connections now open) 2015-10-05T10:25:40.641+0100 [mongosMain] connection accepted from 172.28.0.163:60360 #1434270 (304 connections now open) 2015-10-05T10:25:40.641+0100 [mongosMain] connection accepted from 172.28.0.163:60361 #1434271 (305 connections now open) 2015-10-05T10:25:40.642+0100 [mongosMain] connection accepted from 172.28.0.163:60362 #1434272 (306 connections now open) 2015-10-05T10:25:40.642+0100 [mongosMain] connection accepted from 172.28.0.163:60363 #1434273 (307 connections now open) 2015-10-05T10:25:40.643+0100 [mongosMain] connection accepted from 172.28.0.163:60364 #1434274 (308 connections now open) 2015-10-05T10:25:40.643+0100 [mongosMain] connection accepted from 172.28.0.163:60365 #1434275 (309 connections now open) 2015-10-05T10:25:40.644+0100 [mongosMain] connection accepted from 172.28.0.163:60366 #1434276 (310 connections now open) 2015-10-05T10:25:40.644+0100 [mongosMain] connection accepted from 172.28.0.163:60367 #1434277 (311 connections now open) 2015-10-05T10:25:40.645+0100 [mongosMain] connection accepted from 172.28.0.163:60368 #1434278 (312 connections now open) 2015-10-05T10:25:40.645+0100 [mongosMain] connection accepted from 172.28.0.163:60369 #1434279 (313 connections now open) 2015-10-05T10:25:40.645+0100 [mongosMain] connection accepted from 172.28.0.163:60370 #1434280 (314 connections now open) 2015-10-05T10:25:40.646+0100 [mongosMain] connection accepted from 172.28.0.163:60371 #1434281 (315 connections now open) 2015-10-05T10:25:40.646+0100 [mongosMain] connection accepted from 172.28.0.163:60372 #1434282 (316 connections now open) 2015-10-05T10:25:40.646+0100 [mongosMain] connection accepted from 172.28.0.163:60373 #1434283 (317 connections now open) 2015-10-05T10:25:40.647+0100 [mongosMain] connection accepted from 172.28.0.163:60374 #1434284 (318 connections now open) 2015-10-05T10:25:40.649+0100 [conn1434240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.650+0100 [mongosMain] connection accepted from 172.28.0.163:60375 #1434285 (319 connections now open) 2015-10-05T10:25:40.650+0100 [mongosMain] connection accepted from 172.28.0.163:60376 #1434286 (320 connections now open) 2015-10-05T10:25:40.650+0100 [mongosMain] connection accepted from 172.28.0.163:60377 #1434287 (321 connections now open) 2015-10-05T10:25:40.651+0100 [conn1434189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.651+0100 [mongosMain] connection accepted from 172.28.0.163:60378 #1434288 (322 connections now open) 2015-10-05T10:25:40.653+0100 [mongosMain] connection accepted from 172.28.0.163:60379 #1434289 (323 connections now open) 2015-10-05T10:25:40.654+0100 [mongosMain] connection accepted from 172.28.0.163:60380 #1434290 (324 connections now open) 2015-10-05T10:25:40.654+0100 [mongosMain] connection accepted from 172.28.0.163:60381 #1434291 (325 connections now open) 2015-10-05T10:25:40.660+0100 [conn1434235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.666+0100 [mongosMain] connection accepted from 172.28.0.163:60383 #1434292 (326 connections now open) 2015-10-05T10:25:40.669+0100 [mongosMain] connection accepted from 172.28.0.163:60384 #1434293 (327 connections now open) 2015-10-05T10:25:40.669+0100 [mongosMain] connection accepted from 172.28.0.163:60385 #1434294 (328 connections now open) 2015-10-05T10:25:40.669+0100 [mongosMain] connection accepted from 172.28.0.163:60386 #1434295 (329 connections now open) 2015-10-05T10:25:40.669+0100 [mongosMain] connection accepted from 172.28.0.163:60387 #1434296 (330 connections now open) 2015-10-05T10:25:40.679+0100 [mongosMain] connection accepted from 172.28.0.163:60388 #1434297 (331 connections now open) 2015-10-05T10:25:40.680+0100 [conn1434241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.681+0100 [conn1434242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.681+0100 [conn1434190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.682+0100 [conn1434203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.682+0100 [conn1434191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.682+0100 [conn1434215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.683+0100 [conn1434221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.683+0100 [conn1434227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.683+0100 [conn1434233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.683+0100 [conn1434239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.684+0100 [conn1434245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.685+0100 [conn1434209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.686+0100 [conn1434197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.694+0100 [conn1434247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.697+0100 [conn1434248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.698+0100 [conn1434252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.698+0100 [conn1434254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.700+0100 [conn1434253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.700+0100 [conn1434258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.701+0100 [conn1434257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.701+0100 [conn1434264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.700+0100 [conn1434251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.701+0100 [conn1434255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.701+0100 [conn1434272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.702+0100 [conn1434263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.702+0100 [conn1434265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.702+0100 [conn1434283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.703+0100 [conn1434266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.703+0100 [conn1434270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.703+0100 [conn1434276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.704+0100 [conn1434284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.704+0100 [conn1434250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.705+0100 [conn1434256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.705+0100 [conn1434262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.705+0100 [conn1434268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.706+0100 [conn1434275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.707+0100 [conn1434260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.707+0100 [conn1434274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.708+0100 [conn1434287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.708+0100 [conn1434286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.708+0100 [conn1434259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.708+0100 [conn1434271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.708+0100 [conn1434280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.709+0100 [conn1434290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.709+0100 [conn1434267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.709+0100 [conn1434249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.709+0100 [conn1434269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.710+0100 [conn1434293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.710+0100 [conn1434296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.710+0100 [conn1434292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.710+0100 [conn1434282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.711+0100 [conn1434279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.712+0100 [conn1434295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.712+0100 [conn1434285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.712+0100 [conn1434273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.712+0100 [mongosMain] connection accepted from 172.28.0.163:60391 #1434298 (332 connections now open) 2015-10-05T10:25:40.713+0100 [conn1434261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.713+0100 [mongosMain] connection accepted from 172.28.0.163:60392 #1434299 (333 connections now open) 2015-10-05T10:25:40.713+0100 [conn1434291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.714+0100 [conn1434281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.714+0100 [conn1434246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.714+0100 [conn1434277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.715+0100 [mongosMain] connection accepted from 172.28.0.163:60394 #1434300 (334 connections now open) 2015-10-05T10:25:40.716+0100 [conn1434278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.732+0100 [mongosMain] connection accepted from 172.28.0.163:60396 #1434301 (335 connections now open) 2015-10-05T10:25:40.754+0100 [conn1434297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.755+0100 [conn1434298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.755+0100 [mongosMain] connection accepted from 172.28.0.163:60398 #1434302 (336 connections now open) 2015-10-05T10:25:40.762+0100 [mongosMain] connection accepted from 172.28.0.163:60399 #1434303 (337 connections now open) 2015-10-05T10:25:40.767+0100 [conn1434302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.771+0100 [conn1434294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.771+0100 [conn1434300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.772+0100 [conn1434299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.782+0100 [conn1434301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.796+0100 [conn1434303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.833+0100 [mongosMain] connection accepted from 172.28.0.163:60401 #1434304 (338 connections now open) 2015-10-05T10:25:40.859+0100 [mongosMain] connection accepted from 172.28.0.163:60402 #1434305 (339 connections now open) 2015-10-05T10:25:40.859+0100 [mongosMain] connection accepted from 172.28.0.163:60405 #1434306 (340 connections now open) 2015-10-05T10:25:40.860+0100 [mongosMain] connection accepted from 172.28.0.163:60418 #1434307 (341 connections now open) 2015-10-05T10:25:40.860+0100 [mongosMain] connection accepted from 172.28.0.163:60419 #1434308 (342 connections now open) 2015-10-05T10:25:40.860+0100 [mongosMain] connection accepted from 172.28.0.163:60420 #1434309 (343 connections now open) 2015-10-05T10:25:40.860+0100 [mongosMain] connection accepted from 172.28.0.163:60421 #1434310 (344 connections now open) 2015-10-05T10:25:40.861+0100 [mongosMain] connection accepted from 172.28.0.163:60422 #1434311 (345 connections now open) 2015-10-05T10:25:40.864+0100 [mongosMain] connection accepted from 172.28.0.163:60411 #1434312 (346 connections now open) 2015-10-05T10:25:40.864+0100 [mongosMain] connection accepted from 172.28.0.163:60424 #1434313 (347 connections now open) 2015-10-05T10:25:40.864+0100 [mongosMain] connection accepted from 172.28.0.163:60407 #1434314 (348 connections now open) 2015-10-05T10:25:40.865+0100 [mongosMain] connection accepted from 172.28.0.163:60425 #1434315 (349 connections now open) 2015-10-05T10:25:40.865+0100 [mongosMain] connection accepted from 172.28.0.163:60409 #1434316 (350 connections now open) 2015-10-05T10:25:40.865+0100 [mongosMain] connection accepted from 172.28.0.163:60416 #1434317 (351 connections now open) 2015-10-05T10:25:40.870+0100 [mongosMain] connection accepted from 172.28.0.163:60406 #1434318 (352 connections now open) 2015-10-05T10:25:40.870+0100 [mongosMain] connection accepted from 172.28.0.163:60403 #1434319 (353 connections now open) 2015-10-05T10:25:40.870+0100 [mongosMain] connection accepted from 172.28.0.163:60429 #1434320 (354 connections now open) 2015-10-05T10:25:40.870+0100 [mongosMain] connection accepted from 172.28.0.163:60427 #1434321 (355 connections now open) 2015-10-05T10:25:40.871+0100 [mongosMain] connection accepted from 172.28.0.163:60428 #1434322 (356 connections now open) 2015-10-05T10:25:40.871+0100 [mongosMain] connection accepted from 172.28.0.163:60430 #1434323 (357 connections now open) 2015-10-05T10:25:40.874+0100 [mongosMain] connection accepted from 172.28.0.163:60404 #1434324 (358 connections now open) 2015-10-05T10:25:40.878+0100 [mongosMain] connection accepted from 172.28.0.163:60431 #1434325 (359 connections now open) 2015-10-05T10:25:40.878+0100 [mongosMain] connection accepted from 172.28.0.163:60433 #1434326 (360 connections now open) 2015-10-05T10:25:40.879+0100 [mongosMain] connection accepted from 172.28.0.163:60414 #1434327 (361 connections now open) 2015-10-05T10:25:40.880+0100 [mongosMain] connection accepted from 172.28.0.163:60417 #1434328 (362 connections now open) 2015-10-05T10:25:40.888+0100 [mongosMain] connection accepted from 172.28.0.163:60415 #1434329 (363 connections now open) 2015-10-05T10:25:40.890+0100 [mongosMain] connection accepted from 172.28.0.163:60434 #1434330 (364 connections now open) 2015-10-05T10:25:40.891+0100 [mongosMain] connection accepted from 172.28.0.163:60435 #1434331 (365 connections now open) 2015-10-05T10:25:40.897+0100 [conn1434319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.898+0100 [conn1434316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.898+0100 [conn1434307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.899+0100 [conn1434304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.900+0100 [conn1434331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.901+0100 [mongosMain] connection accepted from 172.28.0.163:60410 #1434332 (366 connections now open) 2015-10-05T10:25:40.901+0100 [mongosMain] connection accepted from 172.28.0.163:60412 #1434333 (367 connections now open) 2015-10-05T10:25:40.904+0100 [conn1434309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.904+0100 [conn1434321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.904+0100 [conn1434327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.905+0100 [conn1434315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.917+0100 [conn1434310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.919+0100 [conn1434333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.919+0100 [conn1434322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.920+0100 [conn1434308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.924+0100 [conn1434326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.924+0100 [conn1434325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:40.931+0100 [conn1434314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.075+0100 [mongosMain] connection accepted from 172.28.0.163:60413 #1434334 (368 connections now open) 2015-10-05T10:25:41.078+0100 [mongosMain] connection accepted from 172.28.0.163:60437 #1434335 (369 connections now open) 2015-10-05T10:25:41.079+0100 [mongosMain] connection accepted from 172.28.0.163:60447 #1434336 (370 connections now open) 2015-10-05T10:25:41.114+0100 [mongosMain] connection accepted from 172.28.0.163:60436 #1434337 (371 connections now open) 2015-10-05T10:25:41.133+0100 [mongosMain] connection accepted from 172.28.0.163:60408 #1434338 (372 connections now open) 2015-10-05T10:25:41.134+0100 [mongosMain] connection accepted from 172.28.0.163:60446 #1434339 (373 connections now open) 2015-10-05T10:25:41.135+0100 [mongosMain] connection accepted from 172.28.0.163:60442 #1434340 (374 connections now open) 2015-10-05T10:25:41.136+0100 [mongosMain] connection accepted from 172.28.0.163:60444 #1434341 (375 connections now open) 2015-10-05T10:25:41.139+0100 [mongosMain] connection accepted from 172.28.0.163:60441 #1434342 (376 connections now open) 2015-10-05T10:25:41.140+0100 [mongosMain] connection accepted from 172.28.0.163:60443 #1434343 (377 connections now open) 2015-10-05T10:25:41.144+0100 [mongosMain] connection accepted from 172.28.0.163:60452 #1434344 (378 connections now open) 2015-10-05T10:25:41.153+0100 [mongosMain] connection accepted from 172.28.0.163:60455 #1434345 (379 connections now open) 2015-10-05T10:25:41.160+0100 [mongosMain] connection accepted from 172.28.0.163:60454 #1434346 (380 connections now open) 2015-10-05T10:25:41.161+0100 [mongosMain] connection accepted from 172.28.0.163:60456 #1434347 (381 connections now open) 2015-10-05T10:25:41.167+0100 [mongosMain] connection accepted from 172.28.0.163:60457 #1434348 (382 connections now open) 2015-10-05T10:25:41.167+0100 [conn1434328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.187+0100 [conn1434208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.188+0100 [conn1434201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.188+0100 [conn1434312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.189+0100 [conn1434317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.196+0100 [conn1434305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.197+0100 [conn1434329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.217+0100 [conn1434330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.218+0100 [conn1434311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.218+0100 [conn1434187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.219+0100 [conn1434313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.220+0100 [conn1434332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.221+0100 [conn1434179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.221+0100 [conn1434334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.221+0100 [conn1434342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.221+0100 [conn1434340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.221+0100 [conn1434336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.222+0100 [conn1434337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.222+0100 [conn1434346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.223+0100 [conn1434344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.229+0100 [conn1434323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.229+0100 [conn1434339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.229+0100 [conn1434204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.230+0100 [conn1434345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.235+0100 [conn1434306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.235+0100 [conn1434343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.252+0100 [conn1434324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.335+0100 [conn1434289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.383+0100 [conn1434318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.397+0100 [conn1434288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:41.843+0100 [conn1434320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:45.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242185703b51053f02d88 2015-10-05T10:25:45.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:47.280+0100 [conn1434164] end connection 172.28.0.164:53589 (381 connections now open) 2015-10-05T10:25:47.280+0100 [conn1433904] end connection 172.28.0.164:52019 (381 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434166] end connection 172.28.0.164:53592 (380 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434140] end connection 172.28.0.164:53460 (378 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434108] end connection 172.28.0.164:53209 (378 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434090] end connection 172.28.0.164:53038 (378 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434120] end connection 172.28.0.164:53314 (378 connections now open) 2015-10-05T10:25:47.280+0100 [conn1434087] end connection 172.28.0.164:53013 (378 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434111] end connection 172.28.0.164:53235 (374 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434130] end connection 172.28.0.164:53378 (373 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434093] end connection 172.28.0.164:53060 (374 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434091] end connection 172.28.0.164:53048 (374 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434038] end connection 172.28.0.164:52656 (370 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434156] end connection 172.28.0.164:53540 (373 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434150] end connection 172.28.0.164:53503 (374 connections now open) 2015-10-05T10:25:47.282+0100 [conn1433893] end connection 172.28.0.164:51947 (367 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434022] end connection 172.28.0.164:52609 (371 connections now open) 2015-10-05T10:25:47.282+0100 [conn1433851] end connection 172.28.0.164:51736 (367 connections now open) 2015-10-05T10:25:47.281+0100 [conn1434134] end connection 172.28.0.164:53418 (373 connections now open) 2015-10-05T10:25:48.916+0100 [conn1434174] end connection 172.28.0.164:53625 (362 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434058] end connection 172.28.0.164:52762 (361 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434068] end connection 172.28.0.164:52853 (360 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434162] end connection 172.28.0.164:53579 (359 connections now open) 2015-10-05T10:25:48.917+0100 [conn1433907] end connection 172.28.0.164:52032 (358 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434023] end connection 172.28.0.164:52610 (358 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434094] end connection 172.28.0.164:53064 (358 connections now open) 2015-10-05T10:25:48.917+0100 [conn1434151] end connection 172.28.0.164:53516 (357 connections now open) 2015-10-05T10:25:48.918+0100 [conn1434114] end connection 172.28.0.164:53263 (354 connections now open) 2015-10-05T10:25:48.918+0100 [conn1434077] end connection 172.28.0.164:52903 (354 connections now open) 2015-10-05T10:25:48.918+0100 [conn1433778] end connection 172.28.0.164:51191 (353 connections now open) 2015-10-05T10:25:48.918+0100 [conn1434000] end connection 172.28.0.164:52522 (352 connections now open) 2015-10-05T10:25:48.918+0100 [conn1434009] end connection 172.28.0.164:52562 (351 connections now open) 2015-10-05T10:25:48.918+0100 [conn1433773] end connection 172.28.0.164:51170 (352 connections now open) 2015-10-05T10:25:48.919+0100 [conn1434029] end connection 172.28.0.164:52625 (348 connections now open) 2015-10-05T10:25:48.919+0100 [conn1434100] end connection 172.28.0.164:53161 (348 connections now open) 2015-10-05T10:25:48.919+0100 [conn1434121] end connection 172.28.0.164:53319 (348 connections now open) 2015-10-05T10:25:48.919+0100 [conn1433877] end connection 172.28.0.164:51884 (346 connections now open) 2015-10-05T10:25:48.919+0100 [conn1433975] end connection 172.28.0.164:52438 (346 connections now open) 2015-10-05T10:25:48.919+0100 [conn1434128] end connection 172.28.0.164:53364 (345 connections now open) 2015-10-05T10:25:48.919+0100 [conn1433982] end connection 172.28.0.164:52458 (343 connections now open) 2015-10-05T10:25:48.919+0100 [conn1434056] end connection 172.28.0.164:52744 (342 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434044] end connection 172.28.0.164:52681 (341 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434132] end connection 172.28.0.164:53402 (339 connections now open) 2015-10-05T10:25:48.920+0100 [conn1433922] end connection 172.28.0.164:52085 (339 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434131] end connection 172.28.0.164:53393 (339 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434078] end connection 172.28.0.164:52910 (338 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434154] end connection 172.28.0.164:53531 (338 connections now open) 2015-10-05T10:25:48.920+0100 [conn1433796] end connection 172.28.0.164:51284 (337 connections now open) 2015-10-05T10:25:48.920+0100 [conn1433883] end connection 172.28.0.164:51904 (335 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434010] end connection 172.28.0.164:52561 (334 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434020] end connection 172.28.0.164:52592 (333 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434137] end connection 172.28.0.164:53430 (333 connections now open) 2015-10-05T10:25:48.920+0100 [conn1434144] end connection 172.28.0.164:53465 (333 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434026] end connection 172.28.0.164:52614 (331 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434032] end connection 172.28.0.164:52639 (329 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434173] end connection 172.28.0.164:53624 (328 connections now open) 2015-10-05T10:25:48.921+0100 [conn1433919] end connection 172.28.0.164:52065 (327 connections now open) 2015-10-05T10:25:48.921+0100 [conn1433864] end connection 172.28.0.164:51828 (326 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434167] end connection 172.28.0.164:53598 (323 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434103] end connection 172.28.0.164:53178 (323 connections now open) 2015-10-05T10:25:48.921+0100 [conn1433972] end connection 172.28.0.164:52421 (323 connections now open) 2015-10-05T10:25:48.921+0100 [conn1434112] end connection 172.28.0.164:53250 (322 connections now open) 2015-10-05T10:25:48.922+0100 [conn1434048] end connection 172.28.0.164:52701 (319 connections now open) 2015-10-05T10:25:48.922+0100 [conn1434153] end connection 172.28.0.164:53526 (319 connections now open) 2015-10-05T10:25:48.922+0100 [conn1433938] end connection 172.28.0.164:52156 (319 connections now open) 2015-10-05T10:25:48.922+0100 [conn1433863] end connection 172.28.0.164:51822 (317 connections now open) 2015-10-05T10:25:48.922+0100 [conn1434063] end connection 172.28.0.164:52800 (315 connections now open) 2015-10-05T10:25:48.922+0100 [conn1434143] end connection 172.28.0.164:53464 (314 connections now open) 2015-10-05T10:25:48.922+0100 [conn1434161] end connection 172.28.0.164:53567 (314 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434061] end connection 172.28.0.164:52795 (314 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434170] end connection 172.28.0.164:53611 (312 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434099] end connection 172.28.0.164:53160 (312 connections now open) 2015-10-05T10:25:48.923+0100 [conn1433984] end connection 172.28.0.164:52467 (310 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434155] end connection 172.28.0.164:53539 (308 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434109] end connection 172.28.0.164:53225 (307 connections now open) 2015-10-05T10:25:48.923+0100 [conn1434102] end connection 172.28.0.164:53177 (307 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434145] end connection 172.28.0.164:53475 (305 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434106] end connection 172.28.0.164:53194 (304 connections now open) 2015-10-05T10:25:48.924+0100 [conn1433886] end connection 172.28.0.164:51909 (304 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434074] end connection 172.28.0.164:52886 (302 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434071] end connection 172.28.0.164:52872 (302 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434147] end connection 172.28.0.164:53488 (301 connections now open) 2015-10-05T10:25:48.924+0100 [conn1434158] end connection 172.28.0.164:53554 (299 connections now open) 2015-10-05T10:25:48.924+0100 [conn1433954] end connection 172.28.0.164:52243 (299 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434123] end connection 172.28.0.164:53333 (297 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434169] end connection 172.28.0.164:53612 (297 connections now open) 2015-10-05T10:25:48.925+0100 [conn1433913] end connection 172.28.0.164:52050 (297 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434138] end connection 172.28.0.164:53446 (295 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434028] end connection 172.28.0.164:52626 (296 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434085] end connection 172.28.0.164:52998 (294 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434065] end connection 172.28.0.164:52818 (293 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434079] end connection 172.28.0.164:52920 (290 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434126] end connection 172.28.0.164:53349 (290 connections now open) 2015-10-05T10:25:48.925+0100 [conn1434081] end connection 172.28.0.164:52934 (290 connections now open) 2015-10-05T10:25:48.926+0100 [conn1434110] end connection 172.28.0.164:53234 (288 connections now open) 2015-10-05T10:25:48.926+0100 [conn1434041] end connection 172.28.0.164:52668 (287 connections now open) 2015-10-05T10:25:48.926+0100 [conn1434045] end connection 172.28.0.164:52687 (286 connections now open) 2015-10-05T10:25:48.926+0100 [conn1433979] end connection 172.28.0.164:52454 (285 connections now open) 2015-10-05T10:25:48.926+0100 [conn1434119] end connection 172.28.0.164:53295 (285 connections now open) 2015-10-05T10:25:48.926+0100 [conn1434117] end connection 172.28.0.164:53281 (284 connections now open) 2015-10-05T10:25:51.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612421f5703b51053f02dc0 2015-10-05T10:25:51.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:25:53.036+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:25:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:25:56.404+0100 [conn1433695] end connection 172.28.0.164:50921 (281 connections now open) 2015-10-05T10:25:56.405+0100 [mongosMain] connection accepted from 172.28.0.164:53640 #1434349 (282 connections now open) 2015-10-05T10:25:56.408+0100 [conn1434349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:25:57.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242255703b51053f02de9 2015-10-05T10:25:57.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:04.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612422b5703b51053f02df8 2015-10-05T10:26:04.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:10.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242325703b51053f02e04 2015-10-05T10:26:10.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:16.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242385703b51053f02e24 2015-10-05T10:26:16.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:23.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612423e5703b51053f02e6f 2015-10-05T10:26:23.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:23.184+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:26:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:26:29.161+0100 [mongosMain] connection accepted from 127.0.0.1:60725 #1434350 (283 connections now open) 2015-10-05T10:26:29.163+0100 [conn1434350] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:26:29.164+0100 [conn1434350] end connection 127.0.0.1:60725 (282 connections now open) 2015-10-05T10:26:29.267+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242455703b51053f02e9b 2015-10-05T10:26:29.334+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:35.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612424b5703b51053f02eba 2015-10-05T10:26:35.755+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:38.512+0100 [conn1433463] end connection 172.28.0.163:56693 (281 connections now open) 2015-10-05T10:26:38.513+0100 [mongosMain] connection accepted from 172.28.0.163:60726 #1434351 (282 connections now open) 2015-10-05T10:26:38.515+0100 [conn1434351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:26:39.603+0100 [mongosMain] connection accepted from 127.0.0.1:60728 #1434352 (283 connections now open) 2015-10-05T10:26:39.606+0100 [conn1434352] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:26:39.607+0100 [conn1434352] end connection 127.0.0.1:60728 (282 connections now open) 2015-10-05T10:26:47.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242575703b51053f02ee7 2015-10-05T10:26:47.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:53.457+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:26:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:26:54.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612425e5703b51053f02f38 2015-10-05T10:26:54.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:26:56.420+0100 [conn1433696] end connection 172.28.0.164:50922 (281 connections now open) 2015-10-05T10:26:56.421+0100 [mongosMain] connection accepted from 172.28.0.164:53700 #1434353 (282 connections now open) 2015-10-05T10:26:56.424+0100 [conn1434353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:27:06.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612426a5703b51053f02f60 2015-10-05T10:27:06.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:27:23.742+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:27:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:27:25.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612427c5703b51053f02fe9 2015-10-05T10:27:25.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:27:28.768+0100 [mongosMain] connection accepted from 127.0.0.1:60798 #1434354 (283 connections now open) 2015-10-05T10:27:28.771+0100 [conn1434354] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:27:28.772+0100 [conn1434354] end connection 127.0.0.1:60798 (282 connections now open) 2015-10-05T10:27:37.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242895703b51053f0302c 2015-10-05T10:27:37.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:27:38.529+0100 [conn1433464] end connection 172.28.0.163:56696 (281 connections now open) 2015-10-05T10:27:38.530+0100 [mongosMain] connection accepted from 172.28.0.163:60801 #1434355 (282 connections now open) 2015-10-05T10:27:38.532+0100 [conn1434355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:27:40.149+0100 [mongosMain] connection accepted from 127.0.0.1:60803 #1434356 (283 connections now open) 2015-10-05T10:27:40.152+0100 [conn1434356] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:27:40.152+0100 [conn1434356] end connection 127.0.0.1:60803 (282 connections now open) 2015-10-05T10:27:43.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612428f5703b51053f03043 2015-10-05T10:27:43.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:27:54.036+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:27:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:27:56.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612429c5703b51053f0307f 2015-10-05T10:27:56.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:27:56.436+0100 [conn1433688] end connection 172.28.0.164:50911 (281 connections now open) 2015-10-05T10:27:56.437+0100 [mongosMain] connection accepted from 172.28.0.164:53743 #1434357 (282 connections now open) 2015-10-05T10:27:56.440+0100 [conn1434357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:28:08.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242a85703b51053f03107 2015-10-05T10:28:08.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:28:14.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242ae5703b51053f0311c 2015-10-05T10:28:15.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:28:24.198+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:28:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:28:28.242+0100 [mongosMain] connection accepted from 127.0.0.1:60857 #1434358 (283 connections now open) 2015-10-05T10:28:28.245+0100 [conn1434358] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:28:28.246+0100 [conn1434358] end connection 127.0.0.1:60857 (282 connections now open) 2015-10-05T10:28:28.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242bb5703b51053f03141 2015-10-05T10:28:28.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:28:38.545+0100 [conn1433465] end connection 172.28.0.163:56697 (281 connections now open) 2015-10-05T10:28:38.546+0100 [mongosMain] connection accepted from 172.28.0.163:60859 #1434359 (282 connections now open) 2015-10-05T10:28:38.548+0100 [conn1434359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:28:39.844+0100 [mongosMain] connection accepted from 127.0.0.1:60861 #1434360 (283 connections now open) 2015-10-05T10:28:39.847+0100 [conn1434360] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:28:39.848+0100 [conn1434360] end connection 127.0.0.1:60861 (282 connections now open) 2015-10-05T10:28:40.738+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:28:40.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:28:47.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242ce5703b51053f03177 2015-10-05T10:28:47.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:28:53.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242d55703b51053f03185 2015-10-05T10:28:53.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:28:54.332+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:28:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:28:56.452+0100 [conn1433703] end connection 172.28.0.164:50927 (281 connections now open) 2015-10-05T10:28:56.454+0100 [mongosMain] connection accepted from 172.28.0.164:53784 #1434361 (282 connections now open) 2015-10-05T10:28:56.456+0100 [conn1434361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:28:59.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242db5703b51053f0318f 2015-10-05T10:28:59.764+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:06.050+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242e15703b51053f0319c 2015-10-05T10:29:06.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:12.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242e85703b51053f031e1 2015-10-05T10:29:12.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:20.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242ee5703b51053f03219 2015-10-05T10:29:20.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:25.996+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:29:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:29:27.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242f65703b51053f03296 2015-10-05T10:29:27.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:28.677+0100 [mongosMain] connection accepted from 127.0.0.1:61015 #1434362 (283 connections now open) 2015-10-05T10:29:28.680+0100 [conn1434362] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:29:28.681+0100 [conn1434362] end connection 127.0.0.1:61015 (282 connections now open) 2015-10-05T10:29:33.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561242fd5703b51053f032a6 2015-10-05T10:29:33.567+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:38.560+0100 [conn1433466] end connection 172.28.0.163:56699 (281 connections now open) 2015-10-05T10:29:38.561+0100 [mongosMain] connection accepted from 172.28.0.163:61017 #1434363 (282 connections now open) 2015-10-05T10:29:38.563+0100 [conn1434363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:29:39.591+0100 [mongosMain] connection accepted from 127.0.0.1:61019 #1434364 (283 connections now open) 2015-10-05T10:29:39.594+0100 [conn1434364] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:29:39.594+0100 [conn1434364] end connection 127.0.0.1:61019 (282 connections now open) 2015-10-05T10:29:39.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243035703b51053f032b7 2015-10-05T10:29:39.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:45.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243095703b51053f032cd 2015-10-05T10:29:46.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:52.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243105703b51053f032e0 2015-10-05T10:29:52.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:29:56.116+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:29:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:29:56.469+0100 [conn1433702] end connection 172.28.0.164:50931 (281 connections now open) 2015-10-05T10:29:56.471+0100 [mongosMain] connection accepted from 172.28.0.164:53831 #1434365 (282 connections now open) 2015-10-05T10:29:56.473+0100 [conn1434365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:29:58.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243165703b51053f032ec 2015-10-05T10:29:58.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:04.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612431c5703b51053f032f3 2015-10-05T10:30:04.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:11.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243225703b51053f032fa 2015-10-05T10:30:11.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:17.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243295703b51053f03311 2015-10-05T10:30:17.502+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:23.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612432f5703b51053f03329 2015-10-05T10:30:23.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:26.358+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:30:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:30:29.176+0100 [mongosMain] connection accepted from 127.0.0.1:61061 #1434366 (283 connections now open) 2015-10-05T10:30:29.179+0100 [conn1434366] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:30:29.180+0100 [conn1434366] end connection 127.0.0.1:61061 (282 connections now open) 2015-10-05T10:30:30.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243355703b51053f03341 2015-10-05T10:30:30.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:36.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612433c5703b51053f03351 2015-10-05T10:30:36.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:38.577+0100 [conn1433467] end connection 172.28.0.163:56700 (281 connections now open) 2015-10-05T10:30:38.578+0100 [mongosMain] connection accepted from 172.28.0.163:61063 #1434367 (282 connections now open) 2015-10-05T10:30:38.580+0100 [conn1434367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:30:39.232+0100 [mongosMain] connection accepted from 127.0.0.1:61065 #1434368 (283 connections now open) 2015-10-05T10:30:39.234+0100 [conn1434368] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:30:39.235+0100 [conn1434368] end connection 127.0.0.1:61065 (282 connections now open) 2015-10-05T10:30:43.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243425703b51053f03365 2015-10-05T10:30:43.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:49.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243495703b51053f03370 2015-10-05T10:30:49.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:55.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612434f5703b51053f03381 2015-10-05T10:30:55.812+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:30:56.501+0100 [conn1433706] end connection 172.28.0.164:50932 (281 connections now open) 2015-10-05T10:30:56.502+0100 [mongosMain] connection accepted from 172.28.0.164:53877 #1434369 (282 connections now open) 2015-10-05T10:30:56.505+0100 [conn1434369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:30:56.632+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:30:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:31:01.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243555703b51053f03393 2015-10-05T10:31:02.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:08.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612435c5703b51053f033ae 2015-10-05T10:31:08.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:14.873+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243625703b51053f033c2 2015-10-05T10:31:15.009+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:21.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243695703b51053f033ce 2015-10-05T10:31:21.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:26.828+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:31:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:31:27.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612436f5703b51053f033d2 2015-10-05T10:31:27.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:28.553+0100 [mongosMain] connection accepted from 127.0.0.1:61102 #1434370 (283 connections now open) 2015-10-05T10:31:28.556+0100 [conn1434370] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:31:28.557+0100 [conn1434370] end connection 127.0.0.1:61102 (282 connections now open) 2015-10-05T10:31:33.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243755703b51053f033e1 2015-10-05T10:31:34.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:38.593+0100 [conn1433468] end connection 172.28.0.163:56702 (281 connections now open) 2015-10-05T10:31:38.594+0100 [mongosMain] connection accepted from 172.28.0.163:61106 #1434371 (282 connections now open) 2015-10-05T10:31:38.596+0100 [conn1434371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:31:39.418+0100 [mongosMain] connection accepted from 127.0.0.1:61108 #1434372 (283 connections now open) 2015-10-05T10:31:39.420+0100 [conn1434372] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:31:39.421+0100 [conn1434372] end connection 127.0.0.1:61108 (282 connections now open) 2015-10-05T10:31:40.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612437c5703b51053f033f0 2015-10-05T10:31:40.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:46.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243825703b51053f03403 2015-10-05T10:31:46.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:53.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243885703b51053f03429 2015-10-05T10:31:53.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:31:56.517+0100 [conn1433704] end connection 172.28.0.164:50930 (281 connections now open) 2015-10-05T10:31:56.519+0100 [mongosMain] connection accepted from 172.28.0.164:53917 #1434373 (282 connections now open) 2015-10-05T10:31:56.522+0100 [conn1434373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:31:57.082+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:31:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:32:05.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243955703b51053f03448 2015-10-05T10:32:05.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:32:17.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243a15703b51053f03473 2015-10-05T10:32:17.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:32:24.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243a75703b51053f03480 2015-10-05T10:32:24.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:32:27.358+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:32:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:32:28.221+0100 [mongosMain] connection accepted from 127.0.0.1:61148 #1434374 (283 connections now open) 2015-10-05T10:32:28.223+0100 [conn1434374] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:32:28.225+0100 [conn1434374] end connection 127.0.0.1:61148 (282 connections now open) 2015-10-05T10:32:36.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243b45703b51053f03499 2015-10-05T10:32:36.552+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:32:38.609+0100 [conn1433476] end connection 172.28.0.163:56715 (281 connections now open) 2015-10-05T10:32:38.610+0100 [mongosMain] connection accepted from 172.28.0.163:61149 #1434375 (282 connections now open) 2015-10-05T10:32:38.612+0100 [conn1434375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:32:39.749+0100 [mongosMain] connection accepted from 127.0.0.1:61151 #1434376 (283 connections now open) 2015-10-05T10:32:39.752+0100 [conn1434376] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:32:39.753+0100 [conn1434376] end connection 127.0.0.1:61151 (282 connections now open) 2015-10-05T10:32:48.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243c05703b51053f034ad 2015-10-05T10:32:48.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:32:56.533+0100 [conn1433701] end connection 172.28.0.164:50928 (281 connections now open) 2015-10-05T10:32:56.534+0100 [mongosMain] connection accepted from 172.28.0.164:53964 #1434377 (282 connections now open) 2015-10-05T10:32:56.537+0100 [conn1434377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:32:57.625+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:32:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:33:01.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243cc5703b51053f034d6 2015-10-05T10:33:01.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:33:19.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243df5703b51053f034f1 2015-10-05T10:33:19.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:33:27.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:33:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:33:28.870+0100 [mongosMain] connection accepted from 127.0.0.1:61189 #1434378 (283 connections now open) 2015-10-05T10:33:28.873+0100 [conn1434378] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:33:28.875+0100 [conn1434378] end connection 127.0.0.1:61189 (282 connections now open) 2015-10-05T10:33:31.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243eb5703b51053f0350d 2015-10-05T10:33:31.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:33:38.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243f15703b51053f0351b 2015-10-05T10:33:38.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:33:38.626+0100 [conn1433477] end connection 172.28.0.163:56716 (281 connections now open) 2015-10-05T10:33:38.627+0100 [mongosMain] connection accepted from 172.28.0.163:61191 #1434379 (282 connections now open) 2015-10-05T10:33:38.629+0100 [conn1434379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:33:39.741+0100 [mongosMain] connection accepted from 127.0.0.1:61193 #1434380 (283 connections now open) 2015-10-05T10:33:39.744+0100 [conn1434380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:33:39.744+0100 [conn1434380] end connection 127.0.0.1:61193 (282 connections now open) 2015-10-05T10:33:50.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561243fe5703b51053f0353f 2015-10-05T10:33:50.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:33:56.549+0100 [conn1433707] end connection 172.28.0.164:50933 (281 connections now open) 2015-10-05T10:33:56.551+0100 [mongosMain] connection accepted from 172.28.0.164:54004 #1434381 (282 connections now open) 2015-10-05T10:33:56.554+0100 [conn1434381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:33:57.991+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:33:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:34:03.084+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612440a5703b51053f03563 2015-10-05T10:34:03.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:15.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244175703b51053f03584 2015-10-05T10:34:15.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:21.561+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1441718816:41' (another update won) 2015-10-05T10:34:21.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' was not acquired. 2015-10-05T10:34:27.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244235703b51053f035ae 2015-10-05T10:34:28.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:28.243+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:34:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:34:28.457+0100 [mongosMain] connection accepted from 127.0.0.1:61235 #1434382 (283 connections now open) 2015-10-05T10:34:28.482+0100 [conn1434382] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:34:28.484+0100 [conn1434382] end connection 127.0.0.1:61235 (282 connections now open) 2015-10-05T10:34:34.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612442a5703b51053f035bf 2015-10-05T10:34:34.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:38.641+0100 [conn1433472] end connection 172.28.0.163:56709 (281 connections now open) 2015-10-05T10:34:38.642+0100 [mongosMain] connection accepted from 172.28.0.163:61242 #1434383 (282 connections now open) 2015-10-05T10:34:38.644+0100 [conn1434383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:34:39.635+0100 [mongosMain] connection accepted from 127.0.0.1:61244 #1434384 (283 connections now open) 2015-10-05T10:34:39.638+0100 [conn1434384] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:34:39.638+0100 [conn1434384] end connection 127.0.0.1:61244 (282 connections now open) 2015-10-05T10:34:40.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244305703b51053f035d0 2015-10-05T10:34:40.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:46.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244365703b51053f035e2 2015-10-05T10:34:46.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:53.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612443c5703b51053f035ef 2015-10-05T10:34:53.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:34:56.565+0100 [conn1433731] end connection 172.28.0.164:50960 (281 connections now open) 2015-10-05T10:34:56.569+0100 [mongosMain] connection accepted from 172.28.0.164:54050 #1434385 (282 connections now open) 2015-10-05T10:34:56.571+0100 [conn1434385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:34:58.506+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:34:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:34:59.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244435703b51053f035fb 2015-10-05T10:34:59.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:05.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244495703b51053f0360c 2015-10-05T10:35:06.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:12.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244505703b51053f03623 2015-10-05T10:35:12.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:18.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244565703b51053f03636 2015-10-05T10:35:18.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:24.445+0100 [mongosMain] connection accepted from 172.28.0.164:54079 #1434386 (283 connections now open) 2015-10-05T10:35:24.446+0100 [mongosMain] connection accepted from 172.28.0.164:54080 #1434387 (284 connections now open) 2015-10-05T10:35:25.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612445c5703b51053f03648 2015-10-05T10:35:25.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:28.664+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:35:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:35:28.952+0100 [mongosMain] connection accepted from 127.0.0.1:61300 #1434388 (285 connections now open) 2015-10-05T10:35:28.954+0100 [conn1434388] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:28.955+0100 [conn1434388] end connection 127.0.0.1:61300 (284 connections now open) 2015-10-05T10:35:31.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244635703b51053f0365f 2015-10-05T10:35:31.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:32.037+0100 [mongosMain] connection accepted from 172.28.0.163:61305 #1434389 (285 connections now open) 2015-10-05T10:35:32.037+0100 [mongosMain] connection accepted from 172.28.0.163:61306 #1434390 (286 connections now open) 2015-10-05T10:35:37.775+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244695703b51053f03674 2015-10-05T10:35:37.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:38.658+0100 [conn1433470] end connection 172.28.0.163:56705 (285 connections now open) 2015-10-05T10:35:38.659+0100 [mongosMain] connection accepted from 172.28.0.163:61310 #1434391 (286 connections now open) 2015-10-05T10:35:38.661+0100 [conn1434391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:39.069+0100 [conn1434389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:39.491+0100 [mongosMain] connection accepted from 127.0.0.1:61312 #1434392 (287 connections now open) 2015-10-05T10:35:39.493+0100 [conn1434392] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:39.494+0100 [conn1434392] end connection 127.0.0.1:61312 (286 connections now open) 2015-10-05T10:35:41.038+0100 [conn1434390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:41.047+0100 [mongosMain] connection accepted from 172.28.0.163:61314 #1434393 (287 connections now open) 2015-10-05T10:35:41.050+0100 [conn1434393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:41.052+0100 [mongosMain] connection accepted from 172.28.0.163:61316 #1434394 (288 connections now open) 2015-10-05T10:35:41.064+0100 [conn1434394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:41.300+0100 [mongosMain] connection accepted from 172.28.0.163:61317 #1434395 (289 connections now open) 2015-10-05T10:35:41.302+0100 [conn1434395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.082+0100 [mongosMain] connection accepted from 172.28.0.163:61322 #1434396 (290 connections now open) 2015-10-05T10:35:44.084+0100 [mongosMain] connection accepted from 172.28.0.163:61324 #1434397 (291 connections now open) 2015-10-05T10:35:44.085+0100 [conn1434396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.085+0100 [mongosMain] connection accepted from 172.28.0.163:61325 #1434398 (292 connections now open) 2015-10-05T10:35:44.086+0100 [mongosMain] connection accepted from 172.28.0.163:61326 #1434399 (293 connections now open) 2015-10-05T10:35:44.086+0100 [conn1434397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.087+0100 [conn1434398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.087+0100 [mongosMain] connection accepted from 172.28.0.163:61327 #1434400 (294 connections now open) 2015-10-05T10:35:44.088+0100 [mongosMain] connection accepted from 172.28.0.163:61328 #1434401 (295 connections now open) 2015-10-05T10:35:44.088+0100 [conn1434399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.089+0100 [mongosMain] connection accepted from 172.28.0.163:61329 #1434402 (296 connections now open) 2015-10-05T10:35:44.089+0100 [conn1434400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.089+0100 [conn1434401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.090+0100 [mongosMain] connection accepted from 172.28.0.163:61330 #1434403 (297 connections now open) 2015-10-05T10:35:44.090+0100 [conn1434402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.091+0100 [mongosMain] connection accepted from 172.28.0.163:61331 #1434404 (298 connections now open) 2015-10-05T10:35:44.091+0100 [conn1434403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.092+0100 [mongosMain] connection accepted from 172.28.0.163:61332 #1434405 (299 connections now open) 2015-10-05T10:35:44.092+0100 [conn1434404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.093+0100 [mongosMain] connection accepted from 172.28.0.163:61333 #1434406 (300 connections now open) 2015-10-05T10:35:44.094+0100 [conn1434405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.094+0100 [mongosMain] connection accepted from 172.28.0.163:61334 #1434407 (301 connections now open) 2015-10-05T10:35:44.095+0100 [mongosMain] connection accepted from 172.28.0.163:61335 #1434408 (302 connections now open) 2015-10-05T10:35:44.095+0100 [conn1434406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.096+0100 [conn1434407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.096+0100 [mongosMain] connection accepted from 172.28.0.163:61336 #1434409 (303 connections now open) 2015-10-05T10:35:44.096+0100 [conn1434408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.097+0100 [mongosMain] connection accepted from 172.28.0.163:61337 #1434410 (304 connections now open) 2015-10-05T10:35:44.097+0100 [conn1434409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.098+0100 [mongosMain] connection accepted from 172.28.0.163:61338 #1434411 (305 connections now open) 2015-10-05T10:35:44.099+0100 [mongosMain] connection accepted from 172.28.0.163:61339 #1434412 (306 connections now open) 2015-10-05T10:35:44.100+0100 [mongosMain] connection accepted from 172.28.0.163:61340 #1434413 (307 connections now open) 2015-10-05T10:35:44.100+0100 [conn1434410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.100+0100 [mongosMain] connection accepted from 172.28.0.163:61341 #1434414 (308 connections now open) 2015-10-05T10:35:44.100+0100 [conn1434411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.102+0100 [conn1434414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.103+0100 [mongosMain] connection accepted from 172.28.0.163:61342 #1434415 (309 connections now open) 2015-10-05T10:35:44.103+0100 [mongosMain] connection accepted from 172.28.0.163:61343 #1434416 (310 connections now open) 2015-10-05T10:35:44.105+0100 [conn1434412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.106+0100 [conn1434416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.106+0100 [conn1434415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.107+0100 [conn1434413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.108+0100 [mongosMain] connection accepted from 172.28.0.163:61344 #1434417 (311 connections now open) 2015-10-05T10:35:44.108+0100 [mongosMain] connection accepted from 172.28.0.163:61345 #1434418 (312 connections now open) 2015-10-05T10:35:44.109+0100 [mongosMain] connection accepted from 172.28.0.163:61346 #1434419 (313 connections now open) 2015-10-05T10:35:44.110+0100 [mongosMain] connection accepted from 172.28.0.163:61347 #1434420 (314 connections now open) 2015-10-05T10:35:44.110+0100 [conn1434417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.112+0100 [conn1434420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.112+0100 [mongosMain] connection accepted from 172.28.0.163:61348 #1434421 (315 connections now open) 2015-10-05T10:35:44.112+0100 [mongosMain] connection accepted from 172.28.0.163:61350 #1434422 (316 connections now open) 2015-10-05T10:35:44.113+0100 [mongosMain] connection accepted from 172.28.0.163:61349 #1434423 (317 connections now open) 2015-10-05T10:35:44.113+0100 [conn1434419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.114+0100 [conn1434422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.114+0100 [conn1434421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.115+0100 [conn1434423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.116+0100 [mongosMain] connection accepted from 172.28.0.163:61353 #1434424 (318 connections now open) 2015-10-05T10:35:44.116+0100 [mongosMain] connection accepted from 172.28.0.163:61354 #1434425 (319 connections now open) 2015-10-05T10:35:44.117+0100 [mongosMain] connection accepted from 172.28.0.163:61355 #1434426 (320 connections now open) 2015-10-05T10:35:44.119+0100 [conn1434426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.121+0100 [conn1434425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.124+0100 [mongosMain] connection accepted from 172.28.0.163:61356 #1434427 (321 connections now open) 2015-10-05T10:35:44.126+0100 [conn1434427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.153+0100 [conn1434418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.160+0100 [conn1434424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612446f5703b51053f03680 2015-10-05T10:35:44.200+0100 [mongosMain] connection accepted from 172.28.0.163:61373 #1434428 (322 connections now open) 2015-10-05T10:35:44.207+0100 [conn1434428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.321+0100 [mongosMain] connection accepted from 172.28.0.163:61375 #1434429 (323 connections now open) 2015-10-05T10:35:44.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:44.381+0100 [conn1434429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.509+0100 [mongosMain] connection accepted from 172.28.0.163:61379 #1434430 (324 connections now open) 2015-10-05T10:35:44.525+0100 [conn1434430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.549+0100 [mongosMain] connection accepted from 172.28.0.163:61380 #1434431 (325 connections now open) 2015-10-05T10:35:44.550+0100 [conn1434431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.583+0100 [mongosMain] connection accepted from 172.28.0.163:61382 #1434432 (326 connections now open) 2015-10-05T10:35:44.590+0100 [conn1434432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.617+0100 [mongosMain] connection accepted from 172.28.0.163:61385 #1434433 (327 connections now open) 2015-10-05T10:35:44.627+0100 [conn1434433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.737+0100 [mongosMain] connection accepted from 172.28.0.163:61387 #1434434 (328 connections now open) 2015-10-05T10:35:44.742+0100 [conn1434434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.779+0100 [mongosMain] connection accepted from 172.28.0.163:61390 #1434435 (329 connections now open) 2015-10-05T10:35:44.781+0100 [conn1434435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.792+0100 [mongosMain] connection accepted from 172.28.0.163:61391 #1434436 (330 connections now open) 2015-10-05T10:35:44.804+0100 [conn1434436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.865+0100 [mongosMain] connection accepted from 172.28.0.163:61404 #1434437 (331 connections now open) 2015-10-05T10:35:44.873+0100 [conn1434437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:44.957+0100 [mongosMain] connection accepted from 172.28.0.163:61406 #1434438 (332 connections now open) 2015-10-05T10:35:44.962+0100 [conn1434438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:45.018+0100 [mongosMain] connection accepted from 172.28.0.163:61408 #1434439 (333 connections now open) 2015-10-05T10:35:45.212+0100 [conn1434439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:45.727+0100 [mongosMain] connection accepted from 172.28.0.163:61412 #1434440 (334 connections now open) 2015-10-05T10:35:45.729+0100 [conn1434440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:45.788+0100 [mongosMain] connection accepted from 172.28.0.163:61415 #1434441 (335 connections now open) 2015-10-05T10:35:45.790+0100 [conn1434441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:49.037+0100 [conn1434387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:50.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244765703b51053f0371f 2015-10-05T10:35:50.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:35:56.581+0100 [conn1433716] end connection 172.28.0.164:50944 (334 connections now open) 2015-10-05T10:35:56.584+0100 [mongosMain] connection accepted from 172.28.0.164:54125 #1434442 (335 connections now open) 2015-10-05T10:35:56.588+0100 [conn1434442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:35:58.933+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:35:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:36:02.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244825703b51053f037c2 2015-10-05T10:36:02.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:07.490+0100 [mongosMain] connection accepted from 172.28.0.164:54195 #1434443 (336 connections now open) 2015-10-05T10:36:07.491+0100 [mongosMain] connection accepted from 172.28.0.164:54196 #1434444 (337 connections now open) 2015-10-05T10:36:07.491+0100 [mongosMain] connection accepted from 172.28.0.164:54197 #1434445 (338 connections now open) 2015-10-05T10:36:07.492+0100 [mongosMain] connection accepted from 172.28.0.164:54198 #1434446 (339 connections now open) 2015-10-05T10:36:07.492+0100 [mongosMain] connection accepted from 172.28.0.164:54199 #1434447 (340 connections now open) 2015-10-05T10:36:07.492+0100 [mongosMain] connection accepted from 172.28.0.164:54200 #1434448 (341 connections now open) 2015-10-05T10:36:07.493+0100 [mongosMain] connection accepted from 172.28.0.164:54201 #1434449 (342 connections now open) 2015-10-05T10:36:07.493+0100 [mongosMain] connection accepted from 172.28.0.164:54203 #1434450 (343 connections now open) 2015-10-05T10:36:07.493+0100 [mongosMain] connection accepted from 172.28.0.164:54202 #1434451 (344 connections now open) 2015-10-05T10:36:07.494+0100 [conn1434443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.494+0100 [conn1434446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.494+0100 [mongosMain] connection accepted from 172.28.0.164:54205 #1434452 (345 connections now open) 2015-10-05T10:36:07.494+0100 [conn1434444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.495+0100 [mongosMain] connection accepted from 172.28.0.164:54206 #1434453 (346 connections now open) 2015-10-05T10:36:07.495+0100 [mongosMain] connection accepted from 172.28.0.164:54204 #1434454 (347 connections now open) 2015-10-05T10:36:07.495+0100 [mongosMain] connection accepted from 172.28.0.164:54207 #1434455 (348 connections now open) 2015-10-05T10:36:07.495+0100 [mongosMain] connection accepted from 172.28.0.164:54208 #1434456 (349 connections now open) 2015-10-05T10:36:07.496+0100 [mongosMain] connection accepted from 172.28.0.164:54209 #1434457 (350 connections now open) 2015-10-05T10:36:07.496+0100 [mongosMain] connection accepted from 172.28.0.164:54210 #1434458 (351 connections now open) 2015-10-05T10:36:07.496+0100 [mongosMain] connection accepted from 172.28.0.164:54211 #1434459 (352 connections now open) 2015-10-05T10:36:07.497+0100 [conn1434451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.497+0100 [mongosMain] connection accepted from 172.28.0.164:54212 #1434460 (353 connections now open) 2015-10-05T10:36:07.497+0100 [conn1434449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.497+0100 [conn1434450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.497+0100 [conn1434453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.497+0100 [mongosMain] connection accepted from 172.28.0.164:54213 #1434461 (354 connections now open) 2015-10-05T10:36:07.498+0100 [mongosMain] connection accepted from 172.28.0.164:54214 #1434462 (355 connections now open) 2015-10-05T10:36:07.498+0100 [conn1434454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.498+0100 [conn1434452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.498+0100 [conn1434456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.498+0100 [conn1434447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.499+0100 [mongosMain] connection accepted from 172.28.0.164:54215 #1434463 (356 connections now open) 2015-10-05T10:36:07.499+0100 [conn1434459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.499+0100 [conn1434460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.500+0100 [mongosMain] connection accepted from 172.28.0.164:54216 #1434464 (357 connections now open) 2015-10-05T10:36:07.501+0100 [conn1434462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.501+0100 [conn1434455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.502+0100 [conn1434461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.502+0100 [mongosMain] connection accepted from 172.28.0.164:54217 #1434465 (358 connections now open) 2015-10-05T10:36:07.502+0100 [conn1434463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.503+0100 [conn1434464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.505+0100 [mongosMain] connection accepted from 172.28.0.164:54218 #1434466 (359 connections now open) 2015-10-05T10:36:07.513+0100 [mongosMain] connection accepted from 172.28.0.164:54223 #1434467 (360 connections now open) 2015-10-05T10:36:07.513+0100 [mongosMain] connection accepted from 172.28.0.164:54224 #1434468 (361 connections now open) 2015-10-05T10:36:07.518+0100 [conn1434445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.519+0100 [conn1434468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.519+0100 [conn1434467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.520+0100 [mongosMain] connection accepted from 172.28.0.164:54225 #1434469 (362 connections now open) 2015-10-05T10:36:07.522+0100 [mongosMain] connection accepted from 172.28.0.164:54226 #1434470 (363 connections now open) 2015-10-05T10:36:07.523+0100 [mongosMain] connection accepted from 172.28.0.164:54227 #1434471 (364 connections now open) 2015-10-05T10:36:07.523+0100 [conn1434469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.523+0100 [mongosMain] connection accepted from 172.28.0.164:54229 #1434472 (365 connections now open) 2015-10-05T10:36:07.523+0100 [mongosMain] connection accepted from 172.28.0.164:54228 #1434473 (366 connections now open) 2015-10-05T10:36:07.524+0100 [mongosMain] connection accepted from 172.28.0.164:54230 #1434474 (367 connections now open) 2015-10-05T10:36:07.525+0100 [conn1434470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.525+0100 [conn1434473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.526+0100 [mongosMain] connection accepted from 172.28.0.164:54231 #1434475 (368 connections now open) 2015-10-05T10:36:07.527+0100 [conn1434448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.527+0100 [mongosMain] connection accepted from 172.28.0.164:54232 #1434476 (369 connections now open) 2015-10-05T10:36:07.530+0100 [conn1434457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.537+0100 [conn1434475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.537+0100 [conn1434476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.538+0100 [mongosMain] connection accepted from 172.28.0.164:54233 #1434477 (370 connections now open) 2015-10-05T10:36:07.538+0100 [mongosMain] connection accepted from 172.28.0.164:54234 #1434478 (371 connections now open) 2015-10-05T10:36:07.539+0100 [mongosMain] connection accepted from 172.28.0.164:54236 #1434479 (372 connections now open) 2015-10-05T10:36:07.539+0100 [mongosMain] connection accepted from 172.28.0.164:54235 #1434480 (373 connections now open) 2015-10-05T10:36:07.539+0100 [conn1434458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.540+0100 [mongosMain] connection accepted from 172.28.0.164:54237 #1434481 (374 connections now open) 2015-10-05T10:36:07.540+0100 [conn1434465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.547+0100 [conn1434466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.549+0100 [mongosMain] connection accepted from 172.28.0.164:54238 #1434482 (375 connections now open) 2015-10-05T10:36:07.549+0100 [mongosMain] connection accepted from 172.28.0.164:54239 #1434483 (376 connections now open) 2015-10-05T10:36:07.549+0100 [mongosMain] connection accepted from 172.28.0.164:54240 #1434484 (377 connections now open) 2015-10-05T10:36:07.552+0100 [conn1434478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.553+0100 [conn1434477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.556+0100 [mongosMain] connection accepted from 172.28.0.164:54241 #1434485 (378 connections now open) 2015-10-05T10:36:07.557+0100 [mongosMain] connection accepted from 172.28.0.164:54242 #1434486 (379 connections now open) 2015-10-05T10:36:07.559+0100 [mongosMain] connection accepted from 172.28.0.164:54243 #1434487 (380 connections now open) 2015-10-05T10:36:07.598+0100 [conn1434472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.599+0100 [conn1434474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.601+0100 [conn1434471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.607+0100 [conn1434486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.608+0100 [conn1434487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.608+0100 [conn1434485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.616+0100 [conn1434480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.616+0100 [mongosMain] connection accepted from 172.28.0.164:54244 #1434488 (381 connections now open) 2015-10-05T10:36:07.617+0100 [mongosMain] connection accepted from 172.28.0.164:54246 #1434489 (382 connections now open) 2015-10-05T10:36:07.617+0100 [mongosMain] connection accepted from 172.28.0.164:54245 #1434490 (383 connections now open) 2015-10-05T10:36:07.617+0100 [mongosMain] connection accepted from 172.28.0.164:54247 #1434491 (384 connections now open) 2015-10-05T10:36:07.617+0100 [mongosMain] connection accepted from 172.28.0.164:54248 #1434492 (385 connections now open) 2015-10-05T10:36:07.618+0100 [mongosMain] connection accepted from 172.28.0.164:54249 #1434493 (386 connections now open) 2015-10-05T10:36:07.618+0100 [mongosMain] connection accepted from 172.28.0.164:54250 #1434494 (387 connections now open) 2015-10-05T10:36:07.619+0100 [conn1434489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.620+0100 [conn1434491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.620+0100 [conn1434492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.620+0100 [conn1434493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.621+0100 [conn1434488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.631+0100 [mongosMain] connection accepted from 172.28.0.164:54252 #1434495 (388 connections now open) 2015-10-05T10:36:07.635+0100 [mongosMain] connection accepted from 172.28.0.164:54255 #1434496 (389 connections now open) 2015-10-05T10:36:07.637+0100 [mongosMain] connection accepted from 172.28.0.164:54256 #1434497 (390 connections now open) 2015-10-05T10:36:07.639+0100 [mongosMain] connection accepted from 172.28.0.164:54257 #1434498 (391 connections now open) 2015-10-05T10:36:07.640+0100 [mongosMain] connection accepted from 172.28.0.164:54258 #1434499 (392 connections now open) 2015-10-05T10:36:07.641+0100 [mongosMain] connection accepted from 172.28.0.164:54259 #1434500 (393 connections now open) 2015-10-05T10:36:07.647+0100 [conn1434495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.656+0100 [mongosMain] connection accepted from 172.28.0.164:54260 #1434501 (394 connections now open) 2015-10-05T10:36:07.666+0100 [conn1434497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.666+0100 [conn1434496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.666+0100 [conn1434499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.667+0100 [conn1434498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.667+0100 [conn1434500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.680+0100 [mongosMain] connection accepted from 172.28.0.164:54261 #1434502 (395 connections now open) 2015-10-05T10:36:07.681+0100 [mongosMain] connection accepted from 172.28.0.164:54262 #1434503 (396 connections now open) 2015-10-05T10:36:07.681+0100 [mongosMain] connection accepted from 172.28.0.164:54264 #1434504 (397 connections now open) 2015-10-05T10:36:07.681+0100 [mongosMain] connection accepted from 172.28.0.164:54263 #1434505 (398 connections now open) 2015-10-05T10:36:07.683+0100 [mongosMain] connection accepted from 172.28.0.164:54265 #1434506 (399 connections now open) 2015-10-05T10:36:07.683+0100 [mongosMain] connection accepted from 172.28.0.164:54266 #1434507 (400 connections now open) 2015-10-05T10:36:07.683+0100 [mongosMain] connection accepted from 172.28.0.164:54267 #1434508 (401 connections now open) 2015-10-05T10:36:07.683+0100 [mongosMain] connection accepted from 172.28.0.164:54268 #1434509 (402 connections now open) 2015-10-05T10:36:07.692+0100 [mongosMain] connection accepted from 172.28.0.164:54269 #1434510 (403 connections now open) 2015-10-05T10:36:07.705+0100 [conn1434494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.725+0100 [conn1434503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.725+0100 [conn1434506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.727+0100 [conn1434505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.728+0100 [conn1434507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.728+0100 [conn1434509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.729+0100 [conn1434508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.731+0100 [conn1434504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.731+0100 [conn1434502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.744+0100 [conn1434510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.745+0100 [conn1434490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:07.770+0100 [conn1434501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:09.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244885703b51053f03837 2015-10-05T10:36:09.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:14.446+0100 [mongosMain] connection accepted from 172.28.0.164:54275 #1434511 (404 connections now open) 2015-10-05T10:36:14.446+0100 [mongosMain] connection accepted from 172.28.0.164:54276 #1434512 (405 connections now open) 2015-10-05T10:36:14.448+0100 [conn1434511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:14.449+0100 [conn1434512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:15.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612448f5703b51053f03873 2015-10-05T10:36:15.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:21.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244955703b51053f03893 2015-10-05T10:36:22.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:28.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 5612449c5703b51053f038a4 2015-10-05T10:36:28.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:28.658+0100 [mongosMain] connection accepted from 127.0.0.1:61490 #1434513 (406 connections now open) 2015-10-05T10:36:28.660+0100 [conn1434513] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:28.661+0100 [conn1434513] end connection 127.0.0.1:61490 (405 connections now open) 2015-10-05T10:36:29.206+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:36:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:36:34.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244a25703b51053f038bb 2015-10-05T10:36:34.894+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:38.675+0100 [conn1433471] end connection 172.28.0.163:56707 (404 connections now open) 2015-10-05T10:36:38.677+0100 [mongosMain] connection accepted from 172.28.0.163:61493 #1434514 (405 connections now open) 2015-10-05T10:36:38.679+0100 [conn1434514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:40.109+0100 [mongosMain] connection accepted from 127.0.0.1:61495 #1434515 (406 connections now open) 2015-10-05T10:36:40.113+0100 [conn1434515] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:40.113+0100 [conn1434515] end connection 127.0.0.1:61495 (405 connections now open) 2015-10-05T10:36:41.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244a85703b51053f038cf 2015-10-05T10:36:41.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:42.739+0100 [mongosMain] connection accepted from 172.28.0.164:54307 #1434516 (406 connections now open) 2015-10-05T10:36:42.742+0100 [conn1434516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.746+0100 [mongosMain] connection accepted from 172.28.0.164:54308 #1434517 (407 connections now open) 2015-10-05T10:36:42.747+0100 [mongosMain] connection accepted from 172.28.0.164:54309 #1434518 (408 connections now open) 2015-10-05T10:36:42.749+0100 [conn1434517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.750+0100 [conn1434518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.752+0100 [mongosMain] connection accepted from 172.28.0.164:54310 #1434519 (409 connections now open) 2015-10-05T10:36:42.753+0100 [mongosMain] connection accepted from 172.28.0.164:54311 #1434520 (410 connections now open) 2015-10-05T10:36:42.755+0100 [conn1434519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.756+0100 [mongosMain] connection accepted from 172.28.0.164:54312 #1434521 (411 connections now open) 2015-10-05T10:36:42.756+0100 [mongosMain] connection accepted from 172.28.0.164:54313 #1434522 (412 connections now open) 2015-10-05T10:36:42.757+0100 [mongosMain] connection accepted from 172.28.0.164:54314 #1434523 (413 connections now open) 2015-10-05T10:36:42.758+0100 [mongosMain] connection accepted from 172.28.0.164:54315 #1434524 (414 connections now open) 2015-10-05T10:36:42.759+0100 [conn1434522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.760+0100 [conn1434523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.761+0100 [conn1434524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.763+0100 [mongosMain] connection accepted from 172.28.0.164:54316 #1434525 (415 connections now open) 2015-10-05T10:36:42.764+0100 [mongosMain] connection accepted from 172.28.0.164:54317 #1434526 (416 connections now open) 2015-10-05T10:36:42.766+0100 [mongosMain] connection accepted from 172.28.0.164:54318 #1434527 (417 connections now open) 2015-10-05T10:36:42.766+0100 [conn1434525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.766+0100 [mongosMain] connection accepted from 172.28.0.164:54319 #1434528 (418 connections now open) 2015-10-05T10:36:42.766+0100 [conn1434526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.767+0100 [mongosMain] connection accepted from 172.28.0.164:54320 #1434529 (419 connections now open) 2015-10-05T10:36:42.767+0100 [mongosMain] connection accepted from 172.28.0.164:54321 #1434530 (420 connections now open) 2015-10-05T10:36:42.768+0100 [conn1434527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.768+0100 [conn1434528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.769+0100 [conn1434529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.772+0100 [mongosMain] connection accepted from 172.28.0.164:54322 #1434531 (421 connections now open) 2015-10-05T10:36:42.772+0100 [mongosMain] connection accepted from 172.28.0.164:54323 #1434532 (422 connections now open) 2015-10-05T10:36:42.773+0100 [mongosMain] connection accepted from 172.28.0.164:54324 #1434533 (423 connections now open) 2015-10-05T10:36:42.773+0100 [mongosMain] connection accepted from 172.28.0.164:54325 #1434534 (424 connections now open) 2015-10-05T10:36:42.774+0100 [mongosMain] connection accepted from 172.28.0.164:54326 #1434535 (425 connections now open) 2015-10-05T10:36:42.775+0100 [conn1434532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.775+0100 [mongosMain] connection accepted from 172.28.0.164:54327 #1434536 (426 connections now open) 2015-10-05T10:36:42.775+0100 [conn1434533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.775+0100 [mongosMain] connection accepted from 172.28.0.164:54328 #1434537 (427 connections now open) 2015-10-05T10:36:42.775+0100 [conn1434534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.776+0100 [conn1434535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.777+0100 [conn1434536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.778+0100 [mongosMain] connection accepted from 172.28.0.164:54329 #1434538 (428 connections now open) 2015-10-05T10:36:42.778+0100 [mongosMain] connection accepted from 172.28.0.164:54330 #1434539 (429 connections now open) 2015-10-05T10:36:42.779+0100 [mongosMain] connection accepted from 172.28.0.164:54332 #1434540 (430 connections now open) 2015-10-05T10:36:42.779+0100 [mongosMain] connection accepted from 172.28.0.164:54331 #1434541 (431 connections now open) 2015-10-05T10:36:42.780+0100 [mongosMain] connection accepted from 172.28.0.164:54333 #1434542 (432 connections now open) 2015-10-05T10:36:42.780+0100 [mongosMain] connection accepted from 172.28.0.164:54334 #1434543 (433 connections now open) 2015-10-05T10:36:42.780+0100 [conn1434538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.781+0100 [mongosMain] connection accepted from 172.28.0.164:54335 #1434544 (434 connections now open) 2015-10-05T10:36:42.781+0100 [conn1434539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.781+0100 [mongosMain] connection accepted from 172.28.0.164:54336 #1434545 (435 connections now open) 2015-10-05T10:36:42.781+0100 [conn1434540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.781+0100 [conn1434541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.782+0100 [conn1434542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.782+0100 [conn1434543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.783+0100 [mongosMain] connection accepted from 172.28.0.164:54337 #1434546 (436 connections now open) 2015-10-05T10:36:42.783+0100 [mongosMain] connection accepted from 172.28.0.164:54338 #1434547 (437 connections now open) 2015-10-05T10:36:42.783+0100 [conn1434545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.784+0100 [mongosMain] connection accepted from 172.28.0.164:54339 #1434548 (438 connections now open) 2015-10-05T10:36:42.784+0100 [mongosMain] connection accepted from 172.28.0.164:54341 #1434549 (439 connections now open) 2015-10-05T10:36:42.784+0100 [mongosMain] connection accepted from 172.28.0.164:54340 #1434550 (440 connections now open) 2015-10-05T10:36:42.785+0100 [mongosMain] connection accepted from 172.28.0.164:54342 #1434551 (441 connections now open) 2015-10-05T10:36:42.785+0100 [conn1434546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.785+0100 [mongosMain] connection accepted from 172.28.0.164:54343 #1434552 (442 connections now open) 2015-10-05T10:36:42.786+0100 [conn1434547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.786+0100 [mongosMain] connection accepted from 172.28.0.164:54344 #1434553 (443 connections now open) 2015-10-05T10:36:42.786+0100 [conn1434549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.786+0100 [conn1434548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.787+0100 [conn1434550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.787+0100 [conn1434552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.788+0100 [conn1434553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.821+0100 [conn1434520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.826+0100 [conn1434530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.831+0100 [conn1434531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.832+0100 [conn1434537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.833+0100 [conn1434544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.837+0100 [conn1434551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.850+0100 [conn1434521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:42.913+0100 [conn1434386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:47.570+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244af5703b51053f03a52 2015-10-05T10:36:47.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:47.927+0100 [conn1434141] end connection 172.28.0.163:60151 (442 connections now open) 2015-10-05T10:36:47.927+0100 [conn1434142] end connection 172.28.0.163:60152 (442 connections now open) 2015-10-05T10:36:47.928+0100 [conn1434165] end connection 172.28.0.163:60245 (440 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434336] end connection 172.28.0.163:60447 (439 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434175] end connection 172.28.0.163:60261 (439 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434176] end connection 172.28.0.163:60263 (438 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434177] end connection 172.28.0.163:60264 (438 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434181] end connection 172.28.0.163:60268 (436 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434183] end connection 172.28.0.163:60270 (435 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434180] end connection 172.28.0.163:60267 (437 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434178] end connection 172.28.0.163:60265 (437 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434182] end connection 172.28.0.163:60269 (435 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434179] end connection 172.28.0.163:60266 (437 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434184] end connection 172.28.0.163:60271 (435 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434185] end connection 172.28.0.163:60272 (434 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434198] end connection 172.28.0.163:60285 (428 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434187] end connection 172.28.0.163:60274 (433 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434188] end connection 172.28.0.163:60275 (433 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434189] end connection 172.28.0.163:60276 (433 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434190] end connection 172.28.0.163:60277 (433 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434191] end connection 172.28.0.163:60278 (432 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434192] end connection 172.28.0.163:60279 (431 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434193] end connection 172.28.0.163:60280 (430 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434195] end connection 172.28.0.163:60282 (430 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434194] end connection 172.28.0.163:60281 (430 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434196] end connection 172.28.0.163:60283 (429 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434197] end connection 172.28.0.163:60284 (429 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434220] end connection 172.28.0.163:60309 (416 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434199] end connection 172.28.0.163:60286 (428 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434201] end connection 172.28.0.163:60288 (427 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434200] end connection 172.28.0.163:60287 (426 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434202] end connection 172.28.0.163:60289 (426 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434231] end connection 172.28.0.163:60320 (411 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434203] end connection 172.28.0.163:60290 (424 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434206] end connection 172.28.0.163:60293 (424 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434205] end connection 172.28.0.163:60292 (423 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434208] end connection 172.28.0.163:60295 (422 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434213] end connection 172.28.0.163:60301 (422 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434210] end connection 172.28.0.163:60297 (421 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434245] end connection 172.28.0.163:60334 (404 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434207] end connection 172.28.0.163:60294 (421 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434215] end connection 172.28.0.163:60299 (420 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434211] end connection 172.28.0.163:60298 (419 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434212] end connection 172.28.0.163:60300 (418 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434214] end connection 172.28.0.163:60303 (418 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434216] end connection 172.28.0.163:60305 (417 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434256] end connection 172.28.0.163:60346 (397 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434219] end connection 172.28.0.163:60308 (417 connections now open) 2015-10-05T10:36:47.929+0100 [conn1434186] end connection 172.28.0.163:60273 (433 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434218] end connection 172.28.0.163:60307 (416 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434222] end connection 172.28.0.163:60312 (415 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434221] end connection 172.28.0.163:60310 (415 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434224] end connection 172.28.0.163:60311 (414 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434271] end connection 172.28.0.163:60361 (390 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434225] end connection 172.28.0.163:60314 (413 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434226] end connection 172.28.0.163:60315 (413 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434228] end connection 172.28.0.163:60318 (412 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434229] end connection 172.28.0.163:60317 (412 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434227] end connection 172.28.0.163:60316 (412 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434230] end connection 172.28.0.163:60319 (411 connections now open) 2015-10-05T10:36:47.930+0100 [conn1434204] end connection 172.28.0.163:60291 (425 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434234] end connection 172.28.0.163:60323 (410 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434232] end connection 172.28.0.163:60321 (410 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434233] end connection 172.28.0.163:60322 (410 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434235] end connection 172.28.0.163:60325 (408 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434236] end connection 172.28.0.163:60324 (408 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434237] end connection 172.28.0.163:60326 (408 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434238] end connection 172.28.0.163:60327 (407 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434240] end connection 172.28.0.163:60329 (407 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434239] end connection 172.28.0.163:60328 (407 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434241] end connection 172.28.0.163:60330 (406 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434242] end connection 172.28.0.163:60331 (406 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434298] end connection 172.28.0.163:60391 (371 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434321] end connection 172.28.0.163:60427 (370 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434209] end connection 172.28.0.163:60296 (421 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434317] end connection 172.28.0.163:60416 (368 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434326] end connection 172.28.0.163:60433 (367 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434247] end connection 172.28.0.163:60336 (402 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434283] end connection 172.28.0.163:60373 (402 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434249] end connection 172.28.0.163:60339 (402 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434251] end connection 172.28.0.163:60341 (401 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434250] end connection 172.28.0.163:60340 (401 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434253] end connection 172.28.0.163:60343 (400 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434252] end connection 172.28.0.163:60342 (400 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434259] end connection 172.28.0.163:60349 (399 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434254] end connection 172.28.0.163:60344 (398 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434255] end connection 172.28.0.163:60345 (398 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434217] end connection 172.28.0.163:60306 (417 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434257] end connection 172.28.0.163:60347 (397 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434258] end connection 172.28.0.163:60348 (396 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434260] end connection 172.28.0.163:60350 (396 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434261] end connection 172.28.0.163:60351 (395 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434262] end connection 172.28.0.163:60352 (395 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434263] end connection 172.28.0.163:60353 (394 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434264] end connection 172.28.0.163:60354 (394 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434265] end connection 172.28.0.163:60355 (394 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434266] end connection 172.28.0.163:60356 (393 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434337] end connection 172.28.0.163:60436 (346 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434272] end connection 172.28.0.163:60362 (392 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434268] end connection 172.28.0.163:60358 (391 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434269] end connection 172.28.0.163:60359 (391 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434270] end connection 172.28.0.163:60360 (390 connections now open) 2015-10-05T10:36:47.931+0100 [conn1434223] end connection 172.28.0.163:60313 (413 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434273] end connection 172.28.0.163:60363 (389 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434274] end connection 172.28.0.163:60364 (389 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434276] end connection 172.28.0.163:60366 (388 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434275] end connection 172.28.0.163:60365 (388 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434278] end connection 172.28.0.163:60368 (387 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434279] end connection 172.28.0.163:60369 (387 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434277] end connection 172.28.0.163:60367 (387 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434284] end connection 172.28.0.163:60374 (387 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434280] end connection 172.28.0.163:60370 (386 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434281] end connection 172.28.0.163:60371 (385 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434282] end connection 172.28.0.163:60372 (384 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434285] end connection 172.28.0.163:60375 (383 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434286] end connection 172.28.0.163:60376 (382 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434288] end connection 172.28.0.163:60378 (382 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434287] end connection 172.28.0.163:60377 (381 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434290] end connection 172.28.0.163:60380 (380 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434289] end connection 172.28.0.163:60379 (380 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434291] end connection 172.28.0.163:60381 (379 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434292] end connection 172.28.0.163:60383 (378 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434295] end connection 172.28.0.163:60386 (378 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434293] end connection 172.28.0.163:60384 (377 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434294] end connection 172.28.0.163:60385 (376 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434296] end connection 172.28.0.163:60387 (375 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434297] end connection 172.28.0.163:60388 (374 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434301] end connection 172.28.0.163:60396 (374 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434299] end connection 172.28.0.163:60392 (374 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434302] end connection 172.28.0.163:60398 (373 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434303] end connection 172.28.0.163:60399 (373 connections now open) 2015-10-05T10:36:47.934+0100 [conn1434318] end connection 172.28.0.163:60406 (372 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434243] end connection 172.28.0.163:60332 (405 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434244] end connection 172.28.0.163:60333 (404 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434308] end connection 172.28.0.163:60419 (368 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434300] end connection 172.28.0.163:60394 (368 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434246] end connection 172.28.0.163:60335 (403 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434327] end connection 172.28.0.163:60414 (368 connections now open) 2015-10-05T10:36:47.932+0100 [conn1434248] end connection 172.28.0.163:60338 (403 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434307] end connection 172.28.0.163:60418 (367 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434304] end connection 172.28.0.163:60401 (366 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434324] end connection 172.28.0.163:60404 (366 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434319] end connection 172.28.0.163:60403 (365 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434329] end connection 172.28.0.163:60415 (365 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434322] end connection 172.28.0.163:60428 (364 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434330] end connection 172.28.0.163:60434 (364 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434314] end connection 172.28.0.163:60407 (364 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434312] end connection 172.28.0.163:60411 (363 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434309] end connection 172.28.0.163:60420 (362 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434315] end connection 172.28.0.163:60425 (361 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434320] end connection 172.28.0.163:60429 (362 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434316] end connection 172.28.0.163:60409 (360 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434306] end connection 172.28.0.163:60405 (359 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434333] end connection 172.28.0.163:60412 (358 connections now open) 2015-10-05T10:36:47.935+0100 [conn1434310] end connection 172.28.0.163:60421 (358 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434305] end connection 172.28.0.163:60402 (358 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434338] end connection 172.28.0.163:60408 (357 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434311] end connection 172.28.0.163:60422 (356 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434332] end connection 172.28.0.163:60410 (356 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434323] end connection 172.28.0.163:60430 (355 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434334] end connection 172.28.0.163:60413 (355 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434325] end connection 172.28.0.163:60431 (354 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434328] end connection 172.28.0.163:60417 (353 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434331] end connection 172.28.0.163:60435 (352 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434313] end connection 172.28.0.163:60424 (352 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434335] end connection 172.28.0.163:60437 (350 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434339] end connection 172.28.0.163:60446 (349 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434342] end connection 172.28.0.163:60441 (349 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434340] end connection 172.28.0.163:60442 (348 connections now open) 2015-10-05T10:36:47.936+0100 [conn1434343] end connection 172.28.0.163:60443 (347 connections now open) 2015-10-05T10:36:47.933+0100 [conn1434267] end connection 172.28.0.163:60357 (392 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434341] end connection 172.28.0.163:60444 (342 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434344] end connection 172.28.0.163:60452 (341 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434346] end connection 172.28.0.163:60454 (340 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434345] end connection 172.28.0.163:60455 (340 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434347] end connection 172.28.0.163:60456 (339 connections now open) 2015-10-05T10:36:47.937+0100 [conn1434348] end connection 172.28.0.163:60457 (338 connections now open) 2015-10-05T10:36:48.179+0100 [mongosMain] connection accepted from 172.28.0.164:54371 #1434554 (267 connections now open) 2015-10-05T10:36:48.188+0100 [conn1434554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.193+0100 [mongosMain] connection accepted from 172.28.0.164:54372 #1434555 (268 connections now open) 2015-10-05T10:36:48.193+0100 [mongosMain] connection accepted from 172.28.0.164:54373 #1434556 (269 connections now open) 2015-10-05T10:36:48.197+0100 [conn1434555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.198+0100 [mongosMain] connection accepted from 172.28.0.164:54374 #1434557 (270 connections now open) 2015-10-05T10:36:48.200+0100 [conn1434557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.247+0100 [mongosMain] connection accepted from 172.28.0.164:54375 #1434558 (271 connections now open) 2015-10-05T10:36:48.249+0100 [conn1434558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.264+0100 [conn1434556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.300+0100 [mongosMain] connection accepted from 172.28.0.164:54376 #1434559 (272 connections now open) 2015-10-05T10:36:48.300+0100 [mongosMain] connection accepted from 172.28.0.164:54377 #1434560 (273 connections now open) 2015-10-05T10:36:48.303+0100 [conn1434559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.303+0100 [conn1434560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.311+0100 [mongosMain] connection accepted from 172.28.0.164:54378 #1434561 (274 connections now open) 2015-10-05T10:36:48.312+0100 [mongosMain] connection accepted from 172.28.0.164:54379 #1434562 (275 connections now open) 2015-10-05T10:36:48.313+0100 [conn1434561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.315+0100 [conn1434562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.315+0100 [mongosMain] connection accepted from 172.28.0.164:54380 #1434563 (276 connections now open) 2015-10-05T10:36:48.315+0100 [mongosMain] connection accepted from 172.28.0.164:54381 #1434564 (277 connections now open) 2015-10-05T10:36:48.318+0100 [mongosMain] connection accepted from 172.28.0.164:54382 #1434565 (278 connections now open) 2015-10-05T10:36:48.318+0100 [conn1434563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.318+0100 [conn1434564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.321+0100 [mongosMain] connection accepted from 172.28.0.164:54383 #1434566 (279 connections now open) 2015-10-05T10:36:48.323+0100 [mongosMain] connection accepted from 172.28.0.164:54384 #1434567 (280 connections now open) 2015-10-05T10:36:48.323+0100 [conn1434566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.325+0100 [conn1434567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:48.328+0100 [conn1434565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:49.145+0100 [mongosMain] connection accepted from 172.28.0.164:54386 #1434568 (281 connections now open) 2015-10-05T10:36:49.148+0100 [conn1434568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:49.154+0100 [mongosMain] connection accepted from 172.28.0.164:54387 #1434569 (282 connections now open) 2015-10-05T10:36:49.157+0100 [conn1434569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:54.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244b55703b51053f03be2 2015-10-05T10:36:54.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:36:56.597+0100 [conn1433698] end connection 172.28.0.164:50924 (281 connections now open) 2015-10-05T10:36:56.599+0100 [mongosMain] connection accepted from 172.28.0.164:54421 #1434570 (282 connections now open) 2015-10-05T10:36:56.609+0100 [conn1434570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:36:59.502+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:36:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:37:00.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244bc5703b51053f03c13 2015-10-05T10:37:00.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:06.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244c25703b51053f03c35 2015-10-05T10:37:07.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:08.825+0100 [mongosMain] connection accepted from 172.28.0.164:54427 #1434571 (283 connections now open) 2015-10-05T10:37:08.826+0100 [mongosMain] connection accepted from 172.28.0.164:54428 #1434572 (284 connections now open) 2015-10-05T10:37:08.827+0100 [mongosMain] connection accepted from 172.28.0.164:54429 #1434573 (285 connections now open) 2015-10-05T10:37:08.828+0100 [conn1434571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.829+0100 [conn1434572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.829+0100 [mongosMain] connection accepted from 172.28.0.164:54430 #1434574 (286 connections now open) 2015-10-05T10:37:08.830+0100 [mongosMain] connection accepted from 172.28.0.164:54431 #1434575 (287 connections now open) 2015-10-05T10:37:08.833+0100 [conn1434575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.833+0100 [conn1434574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.839+0100 [mongosMain] connection accepted from 172.28.0.164:54432 #1434576 (288 connections now open) 2015-10-05T10:37:08.839+0100 [mongosMain] connection accepted from 172.28.0.164:54433 #1434577 (289 connections now open) 2015-10-05T10:37:08.852+0100 [mongosMain] connection accepted from 172.28.0.164:54434 #1434578 (290 connections now open) 2015-10-05T10:37:08.854+0100 [conn1434578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.869+0100 [conn1434573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.874+0100 [conn1434577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:08.875+0100 [conn1434576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:10.398+0100 [mongosMain] connection accepted from 172.28.0.164:54436 #1434579 (291 connections now open) 2015-10-05T10:37:10.399+0100 [mongosMain] connection accepted from 172.28.0.164:54437 #1434580 (292 connections now open) 2015-10-05T10:37:10.694+0100 [mongosMain] connection accepted from 172.28.0.164:54438 #1434581 (293 connections now open) 2015-10-05T10:37:10.696+0100 [conn1434581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:10.907+0100 [conn1434579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:10.908+0100 [conn1434580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:13.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244c95703b51053f03d1f 2015-10-05T10:37:13.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:16.317+0100 [mongosMain] connection accepted from 172.28.0.164:54441 #1434582 (294 connections now open) 2015-10-05T10:37:16.321+0100 [conn1434582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:19.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244cf5703b51053f03eed 2015-10-05T10:37:19.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:26.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244d55703b51053f03f53 2015-10-05T10:37:26.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:28.771+0100 [mongosMain] connection accepted from 127.0.0.1:61537 #1434583 (295 connections now open) 2015-10-05T10:37:28.774+0100 [conn1434583] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:28.775+0100 [conn1434583] end connection 127.0.0.1:61537 (294 connections now open) 2015-10-05T10:37:29.635+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:37:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1441718816:41', sleeping for 30000ms 2015-10-05T10:37:32.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244dc5703b51053f03f78 2015-10-05T10:37:32.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:38.690+0100 [conn1433651] end connection 172.28.0.163:57523 (293 connections now open) 2015-10-05T10:37:38.691+0100 [mongosMain] connection accepted from 172.28.0.163:61540 #1434584 (294 connections now open) 2015-10-05T10:37:38.693+0100 [conn1434584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:38.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244e25703b51053f03f85 2015-10-05T10:37:38.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:39.306+0100 [mongosMain] connection accepted from 127.0.0.1:61542 #1434585 (295 connections now open) 2015-10-05T10:37:39.308+0100 [conn1434585] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:37:39.308+0100 [conn1434585] end connection 127.0.0.1:61542 (294 connections now open) 2015-10-05T10:37:45.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' acquired, ts : 561244e85703b51053f03f98 2015-10-05T10:37:45.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1441718816:41' unlocked. 2015-10-05T10:37:50.458+0100 CTRL_SHUTDOWN_EVENT signal 2015-10-05T10:37:50.458+0100 [consoleTerminate] got CTRL_SHUTDOWN_EVENT, will terminate after current cmd ends 2015-10-05T10:37:50.458+0100 [consoleTerminate] dbexit: rc:12 2015-10-05T10:40:32.986+0100 ***** SERVER RESTARTED ***** 2015-10-05T10:40:33.064+0100 Hotfix KB2731284 or later update is not installed, will zero-out data files 2015-10-05T10:40:33.080+0100 Trying to start Windows service 'MongoS' 2015-10-05T10:40:33.080+0100 Service running 2015-10-05T10:40:33.095+0100 [mongosMain] MongoS version 2.6.11 starting: pid=1244 port=27017 64-bit host=402929-MYWAPP1 (--help for usage) 2015-10-05T10:40:33.095+0100 [mongosMain] db version v2.6.11 2015-10-05T10:40:33.095+0100 [mongosMain] git version: d00c1735675c457f75a12d530bee85421f0c5548 2015-10-05T10:40:33.095+0100 [mongosMain] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 2015-10-05T10:40:33.095+0100 [mongosMain] allocator: system 2015-10-05T10:40:33.095+0100 [mongosMain] options: { security: { keyFile: "C:\mongo\mongo_keyfile" }, service: true, sharding: { configDB: "mywdb7:27019,mywdb8:27019,mywdb9:27019" }, systemLog: { destination: "file", logAppend: true, path: "c:\mongo\data\log\mongos.log" } } 2015-10-05T10:40:33.158+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:40:33.158+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:40:33.158+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:40:33.189+0100 [mongosMain] creating WriteBackListener for: mywdb7:27019 serverID: 000000000000000000000000 2015-10-05T10:40:33.204+0100 [mongosMain] creating WriteBackListener for: mywdb8:27019 serverID: 000000000000000000000000 2015-10-05T10:40:33.204+0100 [mongosMain] creating WriteBackListener for: mywdb9:27019 serverID: 000000000000000000000000 2015-10-05T10:40:33.251+0100 [mongosMain] scoped connection to mywdb7:27019,mywdb8:27019,mywdb9:27019 not being returned to the pool 2015-10-05T10:40:33.267+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:40:33.267+0100 [Balancer] about to contact config servers and shards 2015-10-05T10:40:33.267+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:40:33.267+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:40:33.267+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:40:33.267+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:40:33.267+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:40:33.267+0100 [mongosMain] waiting for connections on port 27017 2015-10-05T10:40:33.267+0100 [Balancer] starting new replica set monitor for replica set replset1 with seeds mywdb7.tg-server.net:27017,mywdb8.tg-server.net:27017,mywdb9.tg-server.net:27017 2015-10-05T10:40:33.267+0100 [ReplicaSetMonitorWatcher] starting 2015-10-05T10:40:33.298+0100 [Balancer] config servers and shards contacted successfully 2015-10-05T10:40:33.298+0100 [Balancer] balancer id: 402929-MYWAPP1:27017 started at Oct 05 10:40:33 2015-10-05T10:40:33.329+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:40:33.329+0100 [LockPinger] creating distributed lock ping thread for mywdb7:27019,mywdb8:27019,mywdb9:27019 and process 402929-MYWAPP1:27017:1444038033:41 (sleeping for 30000ms) 2015-10-05T10:40:33.329+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:40:33.329+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:40:33.485+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:40:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:40:33.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124591bc91fc8b3b376432 2015-10-05T10:40:33.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:40:34.530+0100 [mongosMain] connection accepted from 172.28.0.164:55174 #1 (1 connection now open) 2015-10-05T10:40:34.562+0100 [conn1] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.577+0100 [mongosMain] connection accepted from 172.28.0.164:55175 #2 (2 connections now open) 2015-10-05T10:40:34.577+0100 [conn2] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.655+0100 [mongosMain] connection accepted from 172.28.0.164:55176 #3 (3 connections now open) 2015-10-05T10:40:34.655+0100 [conn3] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.655+0100 [mongosMain] connection accepted from 172.28.0.164:55177 #4 (4 connections now open) 2015-10-05T10:40:34.671+0100 [conn4] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.671+0100 [mongosMain] connection accepted from 172.28.0.164:55178 #5 (5 connections now open) 2015-10-05T10:40:34.671+0100 [conn5] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.686+0100 [mongosMain] connection accepted from 172.28.0.164:55179 #6 (6 connections now open) 2015-10-05T10:40:34.686+0100 [conn6] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.686+0100 [mongosMain] connection accepted from 172.28.0.164:55180 #7 (7 connections now open) 2015-10-05T10:40:34.702+0100 [conn7] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.702+0100 [mongosMain] connection accepted from 172.28.0.164:55181 #8 (8 connections now open) 2015-10-05T10:40:34.702+0100 [conn8] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.702+0100 [mongosMain] connection accepted from 172.28.0.164:55182 #9 (9 connections now open) 2015-10-05T10:40:34.702+0100 [conn9] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.702+0100 [mongosMain] connection accepted from 172.28.0.164:55183 #10 (10 connections now open) 2015-10-05T10:40:34.702+0100 [conn10] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.702+0100 [mongosMain] connection accepted from 172.28.0.164:55184 #11 (11 connections now open) 2015-10-05T10:40:34.718+0100 [conn11] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.718+0100 [mongosMain] connection accepted from 172.28.0.164:55185 #12 (12 connections now open) 2015-10-05T10:40:34.718+0100 [conn12] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.718+0100 [mongosMain] connection accepted from 172.28.0.164:55186 #13 (13 connections now open) 2015-10-05T10:40:34.718+0100 [conn13] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.718+0100 [mongosMain] connection accepted from 172.28.0.164:55187 #14 (14 connections now open) 2015-10-05T10:40:34.718+0100 [conn14] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.733+0100 [mongosMain] connection accepted from 172.28.0.164:55188 #15 (15 connections now open) 2015-10-05T10:40:34.733+0100 [conn15] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.733+0100 [mongosMain] connection accepted from 172.28.0.164:55189 #16 (16 connections now open) 2015-10-05T10:40:34.733+0100 [conn16] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.733+0100 [mongosMain] connection accepted from 172.28.0.164:55190 #17 (17 connections now open) 2015-10-05T10:40:34.733+0100 [conn17] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.733+0100 [mongosMain] connection accepted from 172.28.0.164:55191 #18 (18 connections now open) 2015-10-05T10:40:34.749+0100 [conn18] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.749+0100 [mongosMain] connection accepted from 172.28.0.164:55192 #19 (19 connections now open) 2015-10-05T10:40:34.749+0100 [conn19] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.749+0100 [mongosMain] connection accepted from 172.28.0.164:55193 #20 (20 connections now open) 2015-10-05T10:40:34.749+0100 [conn20] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.764+0100 [mongosMain] connection accepted from 172.28.0.164:55194 #21 (21 connections now open) 2015-10-05T10:40:34.764+0100 [conn21] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.764+0100 [mongosMain] connection accepted from 172.28.0.164:55195 #22 (22 connections now open) 2015-10-05T10:40:34.764+0100 [conn22] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.780+0100 [mongosMain] connection accepted from 172.28.0.164:55196 #23 (23 connections now open) 2015-10-05T10:40:34.780+0100 [conn23] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.780+0100 [mongosMain] connection accepted from 172.28.0.164:55197 #24 (24 connections now open) 2015-10-05T10:40:34.780+0100 [conn24] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.780+0100 [mongosMain] connection accepted from 172.28.0.164:55198 #25 (25 connections now open) 2015-10-05T10:40:34.780+0100 [conn25] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.796+0100 [mongosMain] connection accepted from 172.28.0.164:55199 #26 (26 connections now open) 2015-10-05T10:40:34.796+0100 [conn26] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.796+0100 [mongosMain] connection accepted from 172.28.0.164:55200 #27 (27 connections now open) 2015-10-05T10:40:34.796+0100 [conn27] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:34.936+0100 [mongosMain] connection accepted from 172.28.0.164:55201 #28 (28 connections now open) 2015-10-05T10:40:34.936+0100 [conn28] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:35.607+0100 [mongosMain] connection accepted from 172.28.0.164:55203 #29 (29 connections now open) 2015-10-05T10:40:35.607+0100 [conn29] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.028+0100 [mongosMain] connection accepted from 172.28.0.164:55205 #30 (30 connections now open) 2015-10-05T10:40:36.028+0100 [conn30] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.106+0100 [mongosMain] connection accepted from 172.28.0.164:55206 #31 (31 connections now open) 2015-10-05T10:40:36.106+0100 [conn31] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.122+0100 [mongosMain] connection accepted from 172.28.0.164:55207 #32 (32 connections now open) 2015-10-05T10:40:36.122+0100 [conn32] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.168+0100 [mongosMain] connection accepted from 172.28.0.164:55208 #33 (33 connections now open) 2015-10-05T10:40:36.168+0100 [conn33] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.184+0100 [mongosMain] connection accepted from 172.28.0.164:55209 #34 (34 connections now open) 2015-10-05T10:40:36.184+0100 [conn34] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.200+0100 [mongosMain] connection accepted from 172.28.0.164:55210 #35 (35 connections now open) 2015-10-05T10:40:36.200+0100 [conn35] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.215+0100 [mongosMain] connection accepted from 172.28.0.164:55211 #36 (36 connections now open) 2015-10-05T10:40:36.215+0100 [conn36] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.215+0100 [mongosMain] connection accepted from 172.28.0.164:55212 #37 (37 connections now open) 2015-10-05T10:40:36.215+0100 [conn37] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.231+0100 [mongosMain] connection accepted from 172.28.0.164:55213 #38 (38 connections now open) 2015-10-05T10:40:36.231+0100 [conn38] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.231+0100 [mongosMain] connection accepted from 172.28.0.164:55215 #39 (39 connections now open) 2015-10-05T10:40:36.231+0100 [conn39] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.246+0100 [mongosMain] connection accepted from 172.28.0.164:55217 #40 (40 connections now open) 2015-10-05T10:40:36.246+0100 [conn40] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.262+0100 [mongosMain] connection accepted from 172.28.0.164:55218 #41 (41 connections now open) 2015-10-05T10:40:36.262+0100 [conn41] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.293+0100 [mongosMain] connection accepted from 172.28.0.164:55219 #42 (42 connections now open) 2015-10-05T10:40:36.293+0100 [conn42] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.387+0100 [mongosMain] connection accepted from 172.28.0.164:55221 #43 (43 connections now open) 2015-10-05T10:40:36.387+0100 [conn43] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:36.590+0100 [mongosMain] connection accepted from 172.28.0.164:55222 #44 (44 connections now open) 2015-10-05T10:40:37.136+0100 [conn44] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:37.838+0100 [mongosMain] connection accepted from 172.28.0.164:55224 #45 (45 connections now open) 2015-10-05T10:40:37.853+0100 [conn45] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:38.586+0100 [mongosMain] connection accepted from 172.28.0.164:55228 #46 (46 connections now open) 2015-10-05T10:40:38.602+0100 [conn46] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:39.990+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:40:39.990+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:40:40.380+0100 [mongosMain] connection accepted from 172.28.0.164:55242 #47 (47 connections now open) 2015-10-05T10:40:40.380+0100 [conn47] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:40.490+0100 [conn27] creating WriteBackListener for: mywdb7.tg-server.net:27017 serverID: 56124591bc91fc8b3b376430 2015-10-05T10:40:40.505+0100 [conn26] creating WriteBackListener for: mywdb8.tg-server.net:27017 serverID: 56124591bc91fc8b3b376430 2015-10-05T10:40:40.505+0100 [conn26] creating WriteBackListener for: mywdb9.tg-server.net:27017 serverID: 56124591bc91fc8b3b376430 2015-10-05T10:40:40.848+0100 [mongosMain] connection accepted from 172.28.0.164:55243 #48 (48 connections now open) 2015-10-05T10:40:40.848+0100 [conn48] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:41.628+0100 [mongosMain] connection accepted from 172.28.0.164:55255 #49 (49 connections now open) 2015-10-05T10:40:41.644+0100 [conn49] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:41.800+0100 [mongosMain] connection accepted from 172.28.0.164:55257 #50 (50 connections now open) 2015-10-05T10:40:41.940+0100 [conn50] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.050+0100 [mongosMain] connection accepted from 172.28.0.164:55258 #51 (51 connections now open) 2015-10-05T10:40:42.050+0100 [conn51] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.346+0100 [mongosMain] connection accepted from 172.28.0.164:55262 #52 (52 connections now open) 2015-10-05T10:40:42.346+0100 [conn52] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.377+0100 [mongosMain] connection accepted from 172.28.0.164:55263 #53 (53 connections now open) 2015-10-05T10:40:42.393+0100 [conn53] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.393+0100 [mongosMain] connection accepted from 172.28.0.164:55264 #54 (54 connections now open) 2015-10-05T10:40:42.393+0100 [conn54] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.393+0100 [mongosMain] connection accepted from 172.28.0.164:55265 #55 (55 connections now open) 2015-10-05T10:40:42.408+0100 [conn55] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.502+0100 [mongosMain] connection accepted from 172.28.0.164:55267 #56 (56 connections now open) 2015-10-05T10:40:42.502+0100 [conn56] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.720+0100 [mongosMain] connection accepted from 172.28.0.164:55268 #57 (57 connections now open) 2015-10-05T10:40:42.720+0100 [conn57] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:42.986+0100 [mongosMain] connection accepted from 172.28.0.164:55272 #58 (58 connections now open) 2015-10-05T10:40:42.986+0100 [conn58] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:43.688+0100 [mongosMain] connection accepted from 172.28.0.164:55275 #59 (59 connections now open) 2015-10-05T10:40:43.688+0100 [conn59] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:44.717+0100 [mongosMain] connection accepted from 172.28.0.164:55277 #60 (60 connections now open) 2015-10-05T10:40:44.717+0100 [conn60] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:46.714+0100 [mongosMain] connection accepted from 172.28.0.164:55280 #61 (61 connections now open) 2015-10-05T10:40:46.714+0100 [conn61] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:46.932+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:40:46.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:40:50.536+0100 [mongosMain] connection accepted from 172.28.0.164:55286 #62 (62 connections now open) 2015-10-05T10:40:50.536+0100 [conn62] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:50.988+0100 [mongosMain] connection accepted from 172.28.0.164:55289 #63 (63 connections now open) 2015-10-05T10:40:50.988+0100 [conn63] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.300+0100 [mongosMain] connection accepted from 172.28.0.164:55291 #64 (64 connections now open) 2015-10-05T10:40:51.300+0100 [conn64] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.472+0100 [mongosMain] connection accepted from 172.28.0.164:55292 #65 (65 connections now open) 2015-10-05T10:40:51.472+0100 [conn65] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.675+0100 [mongosMain] connection accepted from 172.28.0.164:55293 #66 (66 connections now open) 2015-10-05T10:40:51.675+0100 [conn66] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.753+0100 [mongosMain] connection accepted from 172.28.0.164:55294 #67 (67 connections now open) 2015-10-05T10:40:51.800+0100 [conn67] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.815+0100 [mongosMain] connection accepted from 172.28.0.164:55295 #68 (68 connections now open) 2015-10-05T10:40:51.846+0100 [conn68] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.924+0100 [mongosMain] connection accepted from 172.28.0.164:55296 #69 (69 connections now open) 2015-10-05T10:40:51.940+0100 [conn69] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55297 #70 (70 connections now open) 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55298 #71 (71 connections now open) 2015-10-05T10:40:51.956+0100 [conn70] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.956+0100 [conn71] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55299 #72 (72 connections now open) 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55300 #73 (73 connections now open) 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55301 #74 (74 connections now open) 2015-10-05T10:40:51.956+0100 [mongosMain] connection accepted from 172.28.0.164:55302 #75 (75 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55303 #76 (76 connections now open) 2015-10-05T10:40:51.971+0100 [conn72] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn74] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn73] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55304 #77 (77 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55305 #78 (78 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55306 #79 (79 connections now open) 2015-10-05T10:40:51.971+0100 [conn76] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn75] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55307 #80 (80 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55308 #81 (81 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55309 #82 (82 connections now open) 2015-10-05T10:40:51.971+0100 [conn78] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn77] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55310 #83 (83 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55311 #84 (84 connections now open) 2015-10-05T10:40:51.971+0100 [conn79] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55312 #85 (85 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55313 #86 (86 connections now open) 2015-10-05T10:40:51.971+0100 [conn81] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn80] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55314 #87 (87 connections now open) 2015-10-05T10:40:51.971+0100 [conn82] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55315 #88 (88 connections now open) 2015-10-05T10:40:51.971+0100 [conn84] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55316 #89 (89 connections now open) 2015-10-05T10:40:51.971+0100 [conn83] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn85] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55317 #90 (90 connections now open) 2015-10-05T10:40:51.971+0100 [conn86] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn87] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55318 #91 (91 connections now open) 2015-10-05T10:40:51.971+0100 [conn88] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55319 #92 (92 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55320 #93 (93 connections now open) 2015-10-05T10:40:51.971+0100 [conn89] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn90] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55322 #94 (94 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55321 #95 (95 connections now open) 2015-10-05T10:40:51.971+0100 [conn91] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55323 #96 (96 connections now open) 2015-10-05T10:40:51.971+0100 [conn92] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55324 #97 (97 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55325 #98 (98 connections now open) 2015-10-05T10:40:51.971+0100 [conn93] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55326 #99 (99 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55327 #100 (100 connections now open) 2015-10-05T10:40:51.971+0100 [conn94] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55328 #101 (101 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55329 #102 (102 connections now open) 2015-10-05T10:40:51.971+0100 [conn96] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55330 #103 (103 connections now open) 2015-10-05T10:40:51.971+0100 [conn97] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55331 #104 (104 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55332 #105 (105 connections now open) 2015-10-05T10:40:51.971+0100 [conn98] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55333 #106 (106 connections now open) 2015-10-05T10:40:51.971+0100 [conn99] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55334 #107 (107 connections now open) 2015-10-05T10:40:51.971+0100 [conn100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55335 #108 (108 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55336 #109 (109 connections now open) 2015-10-05T10:40:51.971+0100 [conn102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55337 #110 (110 connections now open) 2015-10-05T10:40:51.971+0100 [conn101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55338 #111 (111 connections now open) 2015-10-05T10:40:51.971+0100 [conn105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55339 #112 (112 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55340 #113 (113 connections now open) 2015-10-05T10:40:51.971+0100 [conn108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55341 #114 (114 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55342 #115 (115 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55343 #116 (116 connections now open) 2015-10-05T10:40:51.971+0100 [conn110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [conn111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55345 #117 (117 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55344 #118 (118 connections now open) 2015-10-05T10:40:51.971+0100 [conn112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55347 #119 (119 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55346 #120 (120 connections now open) 2015-10-05T10:40:51.971+0100 [conn113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55348 #121 (121 connections now open) 2015-10-05T10:40:51.971+0100 [conn114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55349 #122 (122 connections now open) 2015-10-05T10:40:51.971+0100 [conn115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55350 #123 (123 connections now open) 2015-10-05T10:40:51.971+0100 [conn116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55351 #124 (124 connections now open) 2015-10-05T10:40:51.971+0100 [mongosMain] connection accepted from 172.28.0.164:55352 #125 (125 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55353 #126 (126 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55354 #127 (127 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55355 #128 (128 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55356 #129 (129 connections now open) 2015-10-05T10:40:51.987+0100 [conn118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55357 #130 (130 connections now open) 2015-10-05T10:40:51.987+0100 [conn117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55358 #131 (131 connections now open) 2015-10-05T10:40:51.987+0100 [conn125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55359 #132 (132 connections now open) 2015-10-05T10:40:51.987+0100 [conn129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55360 #133 (133 connections now open) 2015-10-05T10:40:51.987+0100 [conn128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55361 #134 (134 connections now open) 2015-10-05T10:40:51.987+0100 [conn131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55362 #135 (135 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55363 #136 (136 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55364 #137 (137 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55366 #138 (138 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55367 #139 (139 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55365 #140 (140 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55368 #141 (141 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55369 #142 (142 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55370 #143 (143 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55371 #144 (144 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55372 #145 (145 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55373 #146 (146 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55374 #147 (147 connections now open) 2015-10-05T10:40:51.987+0100 [conn134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55375 #148 (148 connections now open) 2015-10-05T10:40:51.987+0100 [conn140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [conn141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55376 #149 (149 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55377 #150 (150 connections now open) 2015-10-05T10:40:51.987+0100 [conn135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55378 #151 (151 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55379 #152 (152 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55380 #153 (153 connections now open) 2015-10-05T10:40:51.987+0100 [mongosMain] connection accepted from 172.28.0.164:55381 #154 (154 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55382 #155 (155 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55383 #156 (156 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55384 #157 (157 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55385 #158 (158 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55386 #159 (159 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55387 #160 (160 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55388 #161 (161 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55389 #162 (162 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55390 #163 (163 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55391 #164 (164 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55392 #165 (165 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55393 #166 (166 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55395 #167 (167 connections now open) 2015-10-05T10:40:52.002+0100 [mongosMain] connection accepted from 172.28.0.164:55394 #168 (168 connections now open) 2015-10-05T10:40:52.002+0100 [conn152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.002+0100 [conn165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.190+0100 [conn158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.190+0100 [conn159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.221+0100 [conn164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.221+0100 [conn150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.236+0100 [conn156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.252+0100 [mongosMain] connection accepted from 172.28.0.164:55396 #169 (169 connections now open) 2015-10-05T10:40:52.252+0100 [mongosMain] connection accepted from 172.28.0.164:55397 #170 (170 connections now open) 2015-10-05T10:40:52.252+0100 [mongosMain] connection accepted from 172.28.0.164:55398 #171 (171 connections now open) 2015-10-05T10:40:52.283+0100 [conn169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.283+0100 [mongosMain] connection accepted from 172.28.0.164:55399 #172 (172 connections now open) 2015-10-05T10:40:52.283+0100 [conn171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.283+0100 [conn170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.283+0100 [mongosMain] connection accepted from 172.28.0.164:55400 #173 (173 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55402 #174 (174 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55401 #175 (175 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55403 #176 (176 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55404 #177 (177 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55405 #178 (178 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55406 #179 (179 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55407 #180 (180 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55409 #181 (181 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55408 #182 (182 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55410 #183 (183 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55411 #184 (184 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55413 #185 (185 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55414 #186 (186 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55412 #187 (187 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55416 #188 (188 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55417 #189 (189 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55418 #190 (190 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55415 #191 (191 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55419 #192 (192 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55420 #193 (193 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55421 #194 (194 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55422 #195 (195 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55424 #196 (196 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55423 #197 (197 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55427 #198 (198 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55426 #199 (199 connections now open) 2015-10-05T10:40:52.299+0100 [mongosMain] connection accepted from 172.28.0.164:55425 #200 (200 connections now open) 2015-10-05T10:40:52.299+0100 [conn182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.314+0100 [conn194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55428 #201 (201 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55431 #202 (202 connections now open) 2015-10-05T10:40:52.314+0100 [conn185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55432 #203 (203 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55433 #204 (204 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55434 #205 (205 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55437 #206 (206 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55435 #207 (207 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55436 #208 (208 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55438 #209 (209 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55439 #210 (210 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55440 #211 (211 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55441 #212 (212 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55444 #213 (213 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55442 #214 (214 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55443 #215 (215 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55445 #216 (216 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55447 #217 (217 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55449 #218 (218 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55448 #219 (219 connections now open) 2015-10-05T10:40:52.314+0100 [conn198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55452 #220 (220 connections now open) 2015-10-05T10:40:52.314+0100 [conn199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55450 #221 (221 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55451 #222 (222 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55453 #223 (223 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55456 #224 (224 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55454 #225 (225 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55457 #226 (226 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55455 #227 (227 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55458 #228 (228 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55459 #229 (229 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55429 #230 (230 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55460 #231 (231 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55461 #232 (232 connections now open) 2015-10-05T10:40:52.314+0100 [mongosMain] connection accepted from 172.28.0.164:55462 #233 (233 connections now open) 2015-10-05T10:40:52.330+0100 [conn197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.330+0100 [conn181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55472 #234 (234 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55471 #235 (235 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55464 #236 (236 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55473 #237 (237 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55469 #238 (238 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55475 #239 (239 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55474 #240 (240 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55467 #241 (241 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55476 #242 (242 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55477 #243 (243 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55478 #244 (244 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55479 #245 (245 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55480 #246 (246 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55463 #247 (247 connections now open) 2015-10-05T10:40:52.330+0100 [conn200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55465 #248 (248 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55487 #249 (249 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55488 #250 (250 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55489 #251 (251 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55493 #252 (252 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55490 #253 (253 connections now open) 2015-10-05T10:40:52.330+0100 [conn193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55486 #254 (254 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55491 #255 (255 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55492 #256 (256 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55494 #257 (257 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55495 #258 (258 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55497 #259 (259 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55496 #260 (260 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55498 #261 (261 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55499 #262 (262 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55502 #263 (263 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55500 #264 (264 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55504 #265 (265 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55503 #266 (266 connections now open) 2015-10-05T10:40:52.330+0100 [mongosMain] connection accepted from 172.28.0.164:55505 #267 (267 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55506 #268 (268 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55484 #269 (269 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55508 #270 (270 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55510 #271 (271 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55482 #272 (272 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55509 #273 (273 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55512 #274 (274 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55511 #275 (275 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55513 #276 (276 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55507 #277 (277 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55430 #278 (278 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55470 #279 (279 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55501 #280 (280 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55515 #281 (281 connections now open) 2015-10-05T10:40:52.346+0100 [conn201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55485 #282 (282 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55481 #283 (283 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55514 #284 (284 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55468 #285 (285 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55483 #286 (286 connections now open) 2015-10-05T10:40:52.346+0100 [mongosMain] connection accepted from 172.28.0.164:55466 #287 (287 connections now open) 2015-10-05T10:40:52.361+0100 [mongosMain] connection accepted from 172.28.0.164:55517 #288 (288 connections now open) 2015-10-05T10:40:52.361+0100 [conn192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [mongosMain] connection accepted from 172.28.0.164:55516 #289 (289 connections now open) 2015-10-05T10:40:52.361+0100 [conn202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [conn184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.361+0100 [mongosMain] connection accepted from 172.28.0.164:55518 #290 (290 connections now open) 2015-10-05T10:40:52.377+0100 [conn210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.377+0100 [conn203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.392+0100 [conn269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [mongosMain] connection accepted from 172.28.0.164:55520 #291 (291 connections now open) 2015-10-05T10:40:52.408+0100 [mongosMain] connection accepted from 172.28.0.164:55521 #292 (292 connections now open) 2015-10-05T10:40:52.408+0100 [mongosMain] connection accepted from 172.28.0.164:55522 #293 (293 connections now open) 2015-10-05T10:40:52.408+0100 [mongosMain] connection accepted from 172.28.0.164:55523 #294 (294 connections now open) 2015-10-05T10:40:52.408+0100 [conn282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.408+0100 [conn283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.424+0100 [conn279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.424+0100 [conn286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.424+0100 [conn287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.424+0100 [conn262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.424+0100 [conn288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.455+0100 [conn290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.455+0100 [conn289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.455+0100 [conn285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.470+0100 [conn95] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.470+0100 [conn106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.470+0100 [conn139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.486+0100 [conn292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.673+0100 [conn133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.673+0100 [conn293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.673+0100 [conn163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:52.689+0100 [conn268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.406+0100 [mongosMain] connection accepted from 172.28.0.164:55525 #295 (295 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55526 #296 (296 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55527 #297 (297 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55529 #298 (298 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55532 #299 (299 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55528 #300 (300 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55530 #301 (301 connections now open) 2015-10-05T10:40:53.422+0100 [mongosMain] connection accepted from 172.28.0.164:55531 #302 (302 connections now open) 2015-10-05T10:40:53.422+0100 [conn296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.422+0100 [conn297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.422+0100 [conn300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.422+0100 [conn301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.422+0100 [conn302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.422+0100 [conn299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:53.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245a5bc91fc8b3b37651a 2015-10-05T10:40:53.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:40:54.249+0100 [conn295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:54.249+0100 [conn298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.200+0100 [mongosMain] connection accepted from 172.28.0.164:55534 #303 (303 connections now open) 2015-10-05T10:40:55.200+0100 [mongosMain] connection accepted from 172.28.0.164:55535 #304 (304 connections now open) 2015-10-05T10:40:55.200+0100 [mongosMain] connection accepted from 172.28.0.164:55536 #305 (305 connections now open) 2015-10-05T10:40:55.200+0100 [conn303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.200+0100 [conn304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.200+0100 [conn305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.294+0100 [mongosMain] connection accepted from 172.28.0.164:55537 #306 (306 connections now open) 2015-10-05T10:40:55.294+0100 [mongosMain] connection accepted from 172.28.0.164:55538 #307 (307 connections now open) 2015-10-05T10:40:55.294+0100 [conn306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.294+0100 [conn307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.310+0100 [mongosMain] connection accepted from 172.28.0.164:55539 #308 (308 connections now open) 2015-10-05T10:40:55.310+0100 [conn308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.341+0100 [mongosMain] connection accepted from 172.28.0.164:55540 #309 (309 connections now open) 2015-10-05T10:40:55.341+0100 [conn309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.466+0100 [mongosMain] connection accepted from 172.28.0.164:55541 #310 (310 connections now open) 2015-10-05T10:40:55.466+0100 [mongosMain] connection accepted from 172.28.0.164:55542 #311 (311 connections now open) 2015-10-05T10:40:55.466+0100 [mongosMain] connection accepted from 172.28.0.164:55543 #312 (312 connections now open) 2015-10-05T10:40:55.481+0100 [conn310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.481+0100 [conn311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.481+0100 [conn312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:55.481+0100 [mongosMain] connection accepted from 172.28.0.164:55544 #313 (313 connections now open) 2015-10-05T10:40:55.497+0100 [conn313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:56.355+0100 [mongosMain] connection accepted from 172.28.0.164:55546 #314 (314 connections now open) 2015-10-05T10:40:56.355+0100 [mongosMain] connection accepted from 172.28.0.164:55547 #315 (315 connections now open) 2015-10-05T10:40:56.355+0100 [conn314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:56.386+0100 [mongosMain] connection accepted from 172.28.0.164:55549 #316 (316 connections now open) 2015-10-05T10:40:56.386+0100 [mongosMain] connection accepted from 172.28.0.164:55551 #317 (317 connections now open) 2015-10-05T10:40:56.386+0100 [mongosMain] connection accepted from 172.28.0.164:55552 #318 (318 connections now open) 2015-10-05T10:40:56.386+0100 [conn317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:56.386+0100 [conn318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.336+0100 [mongosMain] connection accepted from 172.28.0.164:55553 #319 (319 connections now open) 2015-10-05T10:40:58.336+0100 [conn319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.398+0100 [mongosMain] connection accepted from 172.28.0.164:55554 #320 (320 connections now open) 2015-10-05T10:40:58.398+0100 [mongosMain] connection accepted from 172.28.0.164:55555 #321 (321 connections now open) 2015-10-05T10:40:58.398+0100 [mongosMain] connection accepted from 172.28.0.164:55556 #322 (322 connections now open) 2015-10-05T10:40:58.398+0100 [conn320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.398+0100 [conn322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.398+0100 [conn321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.601+0100 [mongosMain] connection accepted from 172.28.0.164:55557 #323 (323 connections now open) 2015-10-05T10:40:58.601+0100 [conn323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.664+0100 [conn315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:40:58.664+0100 [conn316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:00.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245acbc91fc8b3b376607 2015-10-05T10:41:00.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:41:03.749+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:41:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:41:07.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245b2bc91fc8b3b3766ef 2015-10-05T10:41:07.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:41:12.173+0100 [mongosMain] connection accepted from 172.28.0.164:55579 #324 (324 connections now open) 2015-10-05T10:41:12.173+0100 [conn324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.875+0100 [mongosMain] connection accepted from 172.28.0.164:55580 #325 (325 connections now open) 2015-10-05T10:41:12.875+0100 [conn325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.891+0100 [mongosMain] connection accepted from 172.28.0.164:55581 #326 (326 connections now open) 2015-10-05T10:41:12.891+0100 [conn326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55582 #327 (327 connections now open) 2015-10-05T10:41:12.906+0100 [conn327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55583 #328 (328 connections now open) 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55584 #329 (329 connections now open) 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55585 #330 (330 connections now open) 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55586 #331 (331 connections now open) 2015-10-05T10:41:12.906+0100 [conn328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [conn329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [mongosMain] connection accepted from 172.28.0.164:55587 #332 (332 connections now open) 2015-10-05T10:41:12.906+0100 [conn330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [conn331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.906+0100 [conn332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:12.922+0100 [mongosMain] connection accepted from 172.28.0.164:55588 #333 (333 connections now open) 2015-10-05T10:41:12.922+0100 [conn333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:13.203+0100 [mongosMain] connection accepted from 172.28.0.164:55589 #334 (334 connections now open) 2015-10-05T10:41:13.203+0100 [conn334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:13.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245b9bc91fc8b3b37682f 2015-10-05T10:41:13.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:41:24.952+0100 [mongosMain] connection accepted from 172.28.0.164:55609 #335 (335 connections now open) 2015-10-05T10:41:24.952+0100 [conn335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:25.003+0100 [mongosMain] connection accepted from 172.28.0.164:55610 #336 (336 connections now open) 2015-10-05T10:41:25.003+0100 [conn336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:25.226+0100 [mongosMain] connection accepted from 172.28.0.164:55611 #337 (337 connections now open) 2015-10-05T10:41:25.226+0100 [mongosMain] connection accepted from 172.28.0.164:55612 #338 (338 connections now open) 2015-10-05T10:41:25.226+0100 [conn337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:25.226+0100 [conn338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:26.867+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:41:26.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:41:27.246+0100 [conn23] end connection 172.28.0.164:55196 (337 connections now open) 2015-10-05T10:41:27.246+0100 [conn24] end connection 172.28.0.164:55197 (337 connections now open) 2015-10-05T10:41:27.372+0100 [conn236] end connection 172.28.0.164:55464 (335 connections now open) 2015-10-05T10:41:27.372+0100 [conn103] end connection 172.28.0.164:55330 (334 connections now open) 2015-10-05T10:41:27.372+0100 [conn59] end connection 172.28.0.164:55275 (333 connections now open) 2015-10-05T10:41:27.372+0100 [conn159] end connection 172.28.0.164:55386 (332 connections now open) 2015-10-05T10:41:27.372+0100 [conn261] end connection 172.28.0.164:55498 (331 connections now open) 2015-10-05T10:41:27.372+0100 [conn202] end connection 172.28.0.164:55431 (331 connections now open) 2015-10-05T10:41:27.388+0100 [conn106] end connection 172.28.0.164:55333 (329 connections now open) 2015-10-05T10:41:27.388+0100 [conn163] end connection 172.28.0.164:55390 (328 connections now open) 2015-10-05T10:41:27.388+0100 [conn63] end connection 172.28.0.164:55289 (327 connections now open) 2015-10-05T10:41:27.388+0100 [conn172] end connection 172.28.0.164:55399 (326 connections now open) 2015-10-05T10:41:27.388+0100 [conn139] end connection 172.28.0.164:55367 (325 connections now open) 2015-10-05T10:41:27.404+0100 [conn30] end connection 172.28.0.164:55205 (324 connections now open) 2015-10-05T10:41:27.404+0100 [conn337] end connection 172.28.0.164:55611 (323 connections now open) 2015-10-05T10:41:27.404+0100 [conn309] end connection 172.28.0.164:55540 (322 connections now open) 2015-10-05T10:41:27.467+0100 [conn224] end connection 172.28.0.164:55456 (321 connections now open) 2015-10-05T10:41:27.483+0100 [conn242] end connection 172.28.0.164:55476 (320 connections now open) 2015-10-05T10:41:27.483+0100 [conn220] end connection 172.28.0.164:55452 (319 connections now open) 2015-10-05T10:41:27.483+0100 [conn326] end connection 172.28.0.164:55581 (319 connections now open) 2015-10-05T10:41:27.562+0100 [conn19] end connection 172.28.0.164:55192 (317 connections now open) 2015-10-05T10:41:27.562+0100 [conn21] end connection 172.28.0.164:55194 (316 connections now open) 2015-10-05T10:41:27.578+0100 [mongosMain] connection accepted from 172.28.0.164:55628 #339 (317 connections now open) 2015-10-05T10:41:27.578+0100 [mongosMain] connection accepted from 172.28.0.164:55629 #340 (318 connections now open) 2015-10-05T10:41:27.578+0100 [conn340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:27.578+0100 [conn339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:27.704+0100 [conn214] end connection 172.28.0.164:55442 (317 connections now open) 2015-10-05T10:41:27.846+0100 [conn50] end connection 172.28.0.164:55257 (316 connections now open) 2015-10-05T10:41:27.861+0100 [conn278] end connection 172.28.0.164:55430 (315 connections now open) 2015-10-05T10:41:27.877+0100 [conn190] end connection 172.28.0.164:55418 (314 connections now open) 2015-10-05T10:41:27.893+0100 [conn287] end connection 172.28.0.164:55466 (313 connections now open) 2015-10-05T10:41:28.018+0100 [conn313] end connection 172.28.0.164:55544 (312 connections now open) 2015-10-05T10:41:28.065+0100 [conn65] end connection 172.28.0.164:55292 (311 connections now open) 2015-10-05T10:41:28.081+0100 [conn197] end connection 172.28.0.164:55423 (311 connections now open) 2015-10-05T10:41:28.096+0100 [conn174] end connection 172.28.0.164:55402 (309 connections now open) 2015-10-05T10:41:28.096+0100 [conn340] end connection 172.28.0.164:55629 (308 connections now open) 2015-10-05T10:41:28.096+0100 [mongosMain] connection accepted from 172.28.0.164:55630 #341 (309 connections now open) 2015-10-05T10:41:28.096+0100 [conn341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.112+0100 [conn258] end connection 172.28.0.164:55495 (308 connections now open) 2015-10-05T10:41:28.128+0100 [conn143] end connection 172.28.0.164:55370 (307 connections now open) 2015-10-05T10:41:28.128+0100 [conn154] end connection 172.28.0.164:55381 (306 connections now open) 2015-10-05T10:41:28.143+0100 [conn282] end connection 172.28.0.164:55485 (305 connections now open) 2015-10-05T10:41:28.143+0100 [conn338] end connection 172.28.0.164:55612 (304 connections now open) 2015-10-05T10:41:28.175+0100 [conn158] end connection 172.28.0.164:55385 (303 connections now open) 2015-10-05T10:41:28.237+0100 [conn201] end connection 172.28.0.164:55428 (302 connections now open) 2015-10-05T10:41:28.237+0100 [conn91] end connection 172.28.0.164:55318 (301 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55632 #342 (302 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55634 #343 (303 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55633 #344 (304 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55635 #345 (305 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55637 #346 (306 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55638 #347 (307 connections now open) 2015-10-05T10:41:28.253+0100 [conn343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55639 #348 (308 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55641 #349 (309 connections now open) 2015-10-05T10:41:28.253+0100 [conn344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55640 #350 (310 connections now open) 2015-10-05T10:41:28.253+0100 [conn346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn344] end connection 172.28.0.164:55633 (309 connections now open) 2015-10-05T10:41:28.253+0100 [conn342] end connection 172.28.0.164:55632 (309 connections now open) 2015-10-05T10:41:28.253+0100 [conn343] end connection 172.28.0.164:55634 (309 connections now open) 2015-10-05T10:41:28.253+0100 [conn348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55642 #351 (308 connections now open) 2015-10-05T10:41:28.253+0100 [mongosMain] connection accepted from 172.28.0.164:55643 #352 (309 connections now open) 2015-10-05T10:41:28.253+0100 [conn346] end connection 172.28.0.164:55637 (308 connections now open) 2015-10-05T10:41:28.253+0100 [conn345] end connection 172.28.0.164:55635 (307 connections now open) 2015-10-05T10:41:28.253+0100 [conn347] end connection 172.28.0.164:55638 (306 connections now open) 2015-10-05T10:41:28.253+0100 [conn349] end connection 172.28.0.164:55641 (305 connections now open) 2015-10-05T10:41:28.253+0100 [conn348] end connection 172.28.0.164:55639 (304 connections now open) 2015-10-05T10:41:28.253+0100 [conn350] end connection 172.28.0.164:55640 (304 connections now open) 2015-10-05T10:41:28.253+0100 [conn352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.253+0100 [conn351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:28.284+0100 [conn351] end connection 172.28.0.164:55642 (302 connections now open) 2015-10-05T10:41:28.676+0100 [conn352] end connection 172.28.0.164:55643 (301 connections now open) 2015-10-05T10:41:28.817+0100 [conn141] end connection 172.28.0.164:55368 (300 connections now open) 2015-10-05T10:41:28.895+0100 [conn218] end connection 172.28.0.164:55449 (299 connections now open) 2015-10-05T10:41:28.942+0100 [conn81] end connection 172.28.0.164:55308 (298 connections now open) 2015-10-05T10:41:28.942+0100 [conn96] end connection 172.28.0.164:55323 (297 connections now open) 2015-10-05T10:41:28.942+0100 [conn232] end connection 172.28.0.164:55461 (296 connections now open) 2015-10-05T10:41:28.942+0100 [conn76] end connection 172.28.0.164:55303 (296 connections now open) 2015-10-05T10:41:28.942+0100 [conn315] end connection 172.28.0.164:55547 (295 connections now open) 2015-10-05T10:41:28.942+0100 [conn135] end connection 172.28.0.164:55362 (296 connections now open) 2015-10-05T10:41:28.942+0100 [conn284] end connection 172.28.0.164:55514 (294 connections now open) 2015-10-05T10:41:28.942+0100 [conn104] end connection 172.28.0.164:55331 (296 connections now open) 2015-10-05T10:41:28.942+0100 [conn317] end connection 172.28.0.164:55551 (294 connections now open) 2015-10-05T10:41:28.942+0100 [conn97] end connection 172.28.0.164:55324 (294 connections now open) 2015-10-05T10:41:28.942+0100 [conn215] end connection 172.28.0.164:55443 (294 connections now open) 2015-10-05T10:41:28.942+0100 [conn118] end connection 172.28.0.164:55344 (294 connections now open) 2015-10-05T10:41:28.942+0100 [conn131] end connection 172.28.0.164:55358 (293 connections now open) 2015-10-05T10:41:28.942+0100 [conn39] end connection 172.28.0.164:55215 (293 connections now open) 2015-10-05T10:41:28.942+0100 [conn148] end connection 172.28.0.164:55375 (286 connections now open) 2015-10-05T10:41:28.942+0100 [conn161] end connection 172.28.0.164:55388 (284 connections now open) 2015-10-05T10:41:28.942+0100 [conn74] end connection 172.28.0.164:55301 (284 connections now open) 2015-10-05T10:41:28.942+0100 [conn305] end connection 172.28.0.164:55536 (282 connections now open) 2015-10-05T10:41:28.942+0100 [conn129] end connection 172.28.0.164:55356 (282 connections now open) 2015-10-05T10:41:28.942+0100 [conn254] end connection 172.28.0.164:55486 (284 connections now open) 2015-10-05T10:41:28.942+0100 [conn60] end connection 172.28.0.164:55277 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn46] end connection 172.28.0.164:55228 (284 connections now open) 2015-10-05T10:41:28.942+0100 [conn318] end connection 172.28.0.164:55552 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn263] end connection 172.28.0.164:55502 (277 connections now open) 2015-10-05T10:41:28.942+0100 [conn40] end connection 172.28.0.164:55217 (277 connections now open) 2015-10-05T10:41:28.942+0100 [conn89] end connection 172.28.0.164:55316 (275 connections now open) 2015-10-05T10:41:28.942+0100 [conn283] end connection 172.28.0.164:55481 (284 connections now open) 2015-10-05T10:41:28.942+0100 [conn301] end connection 172.28.0.164:55530 (282 connections now open) 2015-10-05T10:41:28.942+0100 [conn200] end connection 172.28.0.164:55425 (272 connections now open) 2015-10-05T10:41:28.942+0100 [conn93] end connection 172.28.0.164:55320 (281 connections now open) 2015-10-05T10:41:28.942+0100 [conn266] end connection 172.28.0.164:55503 (281 connections now open) 2015-10-05T10:41:28.942+0100 [conn116] end connection 172.28.0.164:55343 (280 connections now open) 2015-10-05T10:41:28.942+0100 [conn285] end connection 172.28.0.164:55468 (269 connections now open) 2015-10-05T10:41:28.942+0100 [conn247] end connection 172.28.0.164:55463 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn132] end connection 172.28.0.164:55359 (265 connections now open) 2015-10-05T10:41:28.942+0100 [conn165] end connection 172.28.0.164:55392 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn137] end connection 172.28.0.164:55364 (263 connections now open) 2015-10-05T10:41:28.942+0100 [conn290] end connection 172.28.0.164:55518 (262 connections now open) 2015-10-05T10:41:28.942+0100 [conn43] end connection 172.28.0.164:55221 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn144] end connection 172.28.0.164:55371 (260 connections now open) 2015-10-05T10:41:28.942+0100 [conn64] end connection 172.28.0.164:55291 (259 connections now open) 2015-10-05T10:41:28.942+0100 [conn213] end connection 172.28.0.164:55444 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn312] end connection 172.28.0.164:55543 (277 connections now open) 2015-10-05T10:41:28.942+0100 [conn240] end connection 172.28.0.164:55474 (257 connections now open) 2015-10-05T10:41:28.942+0100 [conn37] end connection 172.28.0.164:55212 (282 connections now open) 2015-10-05T10:41:28.942+0100 [conn117] end connection 172.28.0.164:55345 (256 connections now open) 2015-10-05T10:41:28.942+0100 [conn179] end connection 172.28.0.164:55406 (274 connections now open) 2015-10-05T10:41:28.942+0100 [conn238] end connection 172.28.0.164:55469 (273 connections now open) 2015-10-05T10:41:28.942+0100 [conn182] end connection 172.28.0.164:55408 (251 connections now open) 2015-10-05T10:41:28.942+0100 [conn142] end connection 172.28.0.164:55369 (272 connections now open) 2015-10-05T10:41:28.942+0100 [conn45] end connection 172.28.0.164:55224 (249 connections now open) 2015-10-05T10:41:28.942+0100 [conn127] end connection 172.28.0.164:55354 (271 connections now open) 2015-10-05T10:41:28.942+0100 [conn308] end connection 172.28.0.164:55539 (249 connections now open) 2015-10-05T10:41:28.942+0100 [conn212] end connection 172.28.0.164:55441 (271 connections now open) 2015-10-05T10:41:28.942+0100 [conn88] end connection 172.28.0.164:55315 (271 connections now open) 2015-10-05T10:41:28.942+0100 [conn140] end connection 172.28.0.164:55365 (269 connections now open) 2015-10-05T10:41:28.942+0100 [conn330] end connection 172.28.0.164:55585 (280 connections now open) 2015-10-05T10:41:28.942+0100 [conn223] end connection 172.28.0.164:55453 (242 connections now open) 2015-10-05T10:41:28.942+0100 [conn181] end connection 172.28.0.164:55409 (241 connections now open) 2015-10-05T10:41:28.942+0100 [conn233] end connection 172.28.0.164:55462 (240 connections now open) 2015-10-05T10:41:28.942+0100 [conn155] end connection 172.28.0.164:55382 (280 connections now open) 2015-10-05T10:41:28.942+0100 [conn94] end connection 172.28.0.164:55322 (239 connections now open) 2015-10-05T10:41:28.942+0100 [conn120] end connection 172.28.0.164:55346 (238 connections now open) 2015-10-05T10:41:28.942+0100 [conn136] end connection 172.28.0.164:55363 (239 connections now open) 2015-10-05T10:41:28.942+0100 [conn168] end connection 172.28.0.164:55394 (236 connections now open) 2015-10-05T10:41:28.942+0100 [conn162] end connection 172.28.0.164:55389 (235 connections now open) 2015-10-05T10:41:28.942+0100 [conn152] end connection 172.28.0.164:55379 (233 connections now open) 2015-10-05T10:41:28.942+0100 [conn164] end connection 172.28.0.164:55391 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn78] end connection 172.28.0.164:55305 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn160] end connection 172.28.0.164:55387 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn255] end connection 172.28.0.164:55491 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn256] end connection 172.28.0.164:55492 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn109] end connection 172.28.0.164:55336 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn288] end connection 172.28.0.164:55517 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn69] end connection 172.28.0.164:55296 (225 connections now open) 2015-10-05T10:41:28.942+0100 [conn205] end connection 172.28.0.164:55434 (224 connections now open) 2015-10-05T10:41:28.942+0100 [conn149] end connection 172.28.0.164:55376 (263 connections now open) 2015-10-05T10:41:28.958+0100 [conn226] end connection 172.28.0.164:55457 (223 connections now open) 2015-10-05T10:41:28.958+0100 [conn257] end connection 172.28.0.164:55494 (222 connections now open) 2015-10-05T10:41:28.942+0100 [conn268] end connection 172.28.0.164:55506 (263 connections now open) 2015-10-05T10:41:28.942+0100 [conn41] end connection 172.28.0.164:55218 (263 connections now open) 2015-10-05T10:41:28.942+0100 [conn134] end connection 172.28.0.164:55361 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn151] end connection 172.28.0.164:55378 (261 connections now open) 2015-10-05T10:41:28.942+0100 [conn269] end connection 172.28.0.164:55484 (261 connections now open) 2015-10-05T10:41:28.942+0100 [conn175] end connection 172.28.0.164:55401 (261 connections now open) 2015-10-05T10:41:28.942+0100 [conn319] end connection 172.28.0.164:55553 (260 connections now open) 2015-10-05T10:41:28.942+0100 [conn184] end connection 172.28.0.164:55411 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn311] end connection 172.28.0.164:55542 (260 connections now open) 2015-10-05T10:41:28.942+0100 [conn320] end connection 172.28.0.164:55554 (260 connections now open) 2015-10-05T10:41:28.958+0100 [conn211] end connection 172.28.0.164:55440 (210 connections now open) 2015-10-05T10:41:28.942+0100 [conn209] end connection 172.28.0.164:55438 (260 connections now open) 2015-10-05T10:41:28.942+0100 [conn241] end connection 172.28.0.164:55467 (283 connections now open) 2015-10-05T10:41:28.942+0100 [conn260] end connection 172.28.0.164:55496 (259 connections now open) 2015-10-05T10:41:28.942+0100 [conn138] end connection 172.28.0.164:55366 (259 connections now open) 2015-10-05T10:41:28.942+0100 [conn328] end connection 172.28.0.164:55583 (275 connections now open) 2015-10-05T10:41:28.942+0100 [conn245] end connection 172.28.0.164:55479 (257 connections now open) 2015-10-05T10:41:28.942+0100 [conn322] end connection 172.28.0.164:55556 (257 connections now open) 2015-10-05T10:41:28.942+0100 [conn33] end connection 172.28.0.164:55208 (256 connections now open) 2015-10-05T10:41:28.942+0100 [conn293] end connection 172.28.0.164:55522 (255 connections now open) 2015-10-05T10:41:28.942+0100 [conn42] end connection 172.28.0.164:55219 (255 connections now open) 2015-10-05T10:41:28.942+0100 [conn171] end connection 172.28.0.164:55398 (254 connections now open) 2015-10-05T10:41:28.942+0100 [conn310] end connection 172.28.0.164:55541 (254 connections now open) 2015-10-05T10:41:28.942+0100 [conn243] end connection 172.28.0.164:55477 (253 connections now open) 2015-10-05T10:41:28.942+0100 [conn265] end connection 172.28.0.164:55504 (252 connections now open) 2015-10-05T10:41:28.942+0100 [conn31] end connection 172.28.0.164:55206 (251 connections now open) 2015-10-05T10:41:28.942+0100 [conn208] end connection 172.28.0.164:55436 (273 connections now open) 2015-10-05T10:41:28.942+0100 [conn188] end connection 172.28.0.164:55416 (251 connections now open) 2015-10-05T10:41:28.942+0100 [conn125] end connection 172.28.0.164:55352 (250 connections now open) 2015-10-05T10:41:28.942+0100 [conn52] end connection 172.28.0.164:55262 (250 connections now open) 2015-10-05T10:41:28.942+0100 [conn250] end connection 172.28.0.164:55488 (249 connections now open) 2015-10-05T10:41:28.942+0100 [conn95] end connection 172.28.0.164:55321 (281 connections now open) 2015-10-05T10:41:28.942+0100 [conn56] end connection 172.28.0.164:55267 (249 connections now open) 2015-10-05T10:41:28.942+0100 [conn248] end connection 172.28.0.164:55465 (249 connections now open) 2015-10-05T10:41:28.942+0100 [conn276] end connection 172.28.0.164:55513 (247 connections now open) 2015-10-05T10:41:28.942+0100 [conn157] end connection 172.28.0.164:55384 (271 connections now open) 2015-10-05T10:41:28.942+0100 [conn49] end connection 172.28.0.164:55255 (247 connections now open) 2015-10-05T10:41:28.942+0100 [conn235] end connection 172.28.0.164:55471 (247 connections now open) 2015-10-05T10:41:28.942+0100 [conn219] end connection 172.28.0.164:55448 (247 connections now open) 2015-10-05T10:41:28.942+0100 [conn210] end connection 172.28.0.164:55439 (246 connections now open) 2015-10-05T10:41:28.942+0100 [conn295] end connection 172.28.0.164:55525 (246 connections now open) 2015-10-05T10:41:28.942+0100 [conn300] end connection 172.28.0.164:55528 (243 connections now open) 2015-10-05T10:41:28.942+0100 [conn298] end connection 172.28.0.164:55529 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn169] end connection 172.28.0.164:55396 (241 connections now open) 2015-10-05T10:41:28.942+0100 [conn147] end connection 172.28.0.164:55374 (240 connections now open) 2015-10-05T10:41:28.942+0100 [conn272] end connection 172.28.0.164:55482 (239 connections now open) 2015-10-05T10:41:28.942+0100 [conn332] end connection 172.28.0.164:55587 (238 connections now open) 2015-10-05T10:41:28.942+0100 [conn1] end connection 172.28.0.164:55174 (238 connections now open) 2015-10-05T10:41:28.942+0100 [conn58] end connection 172.28.0.164:55272 (238 connections now open) 2015-10-05T10:41:28.942+0100 [conn249] end connection 172.28.0.164:55487 (238 connections now open) 2015-10-05T10:41:28.942+0100 [conn270] end connection 172.28.0.164:55508 (236 connections now open) 2015-10-05T10:41:28.942+0100 [conn207] end connection 172.28.0.164:55435 (236 connections now open) 2015-10-05T10:41:28.942+0100 [conn271] end connection 172.28.0.164:55510 (235 connections now open) 2015-10-05T10:41:28.942+0100 [conn153] end connection 172.28.0.164:55380 (235 connections now open) 2015-10-05T10:41:28.942+0100 [conn146] end connection 172.28.0.164:55373 (235 connections now open) 2015-10-05T10:41:28.942+0100 [conn68] end connection 172.28.0.164:55295 (237 connections now open) 2015-10-05T10:41:28.942+0100 [conn186] end connection 172.28.0.164:55414 (235 connections now open) 2015-10-05T10:41:28.942+0100 [conn53] end connection 172.28.0.164:55263 (233 connections now open) 2015-10-05T10:41:28.942+0100 [conn101] end connection 172.28.0.164:55328 (233 connections now open) 2015-10-05T10:41:28.942+0100 [conn286] end connection 172.28.0.164:55483 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn195] end connection 172.28.0.164:55422 (233 connections now open) 2015-10-05T10:41:28.942+0100 [conn66] end connection 172.28.0.164:55293 (233 connections now open) 2015-10-05T10:41:28.942+0100 [conn327] end connection 172.28.0.164:55582 (232 connections now open) 2015-10-05T10:41:28.942+0100 [conn281] end connection 172.28.0.164:55515 (232 connections now open) 2015-10-05T10:41:28.942+0100 [conn303] end connection 172.28.0.164:55534 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn77] end connection 172.28.0.164:55304 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn206] end connection 172.28.0.164:55437 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn156] end connection 172.28.0.164:55383 (231 connections now open) 2015-10-05T10:41:28.942+0100 [conn57] end connection 172.28.0.164:55268 (230 connections now open) 2015-10-05T10:41:28.942+0100 [conn280] end connection 172.28.0.164:55501 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn246] end connection 172.28.0.164:55480 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn297] end connection 172.28.0.164:55527 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn167] end connection 172.28.0.164:55395 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn273] end connection 172.28.0.164:55509 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn302] end connection 172.28.0.164:55531 (266 connections now open) 2015-10-05T10:41:28.942+0100 [conn335] end connection 172.28.0.164:55609 (229 connections now open) 2015-10-05T10:41:28.942+0100 [conn323] end connection 172.28.0.164:55557 (228 connections now open) 2015-10-05T10:41:28.942+0100 [conn170] end connection 172.28.0.164:55397 (228 connections now open) 2015-10-05T10:41:28.942+0100 [conn62] end connection 172.28.0.164:55286 (228 connections now open) 2015-10-05T10:41:28.942+0100 [conn145] end connection 172.28.0.164:55372 (228 connections now open) 2015-10-05T10:41:28.942+0100 [conn105] end connection 172.28.0.164:55332 (226 connections now open) 2015-10-05T10:41:28.942+0100 [conn35] end connection 172.28.0.164:55210 (226 connections now open) 2015-10-05T10:41:28.942+0100 [conn277] end connection 172.28.0.164:55507 (226 connections now open) 2015-10-05T10:41:28.942+0100 [conn314] end connection 172.28.0.164:55546 (279 connections now open) 2015-10-05T10:41:28.942+0100 [conn150] end connection 172.28.0.164:55377 (225 connections now open) 2015-10-05T10:41:28.942+0100 [conn75] end connection 172.28.0.164:55302 (224 connections now open) 2015-10-05T10:41:28.942+0100 [conn176] end connection 172.28.0.164:55403 (224 connections now open) 2015-10-05T10:41:28.942+0100 [conn324] end connection 172.28.0.164:55579 (224 connections now open) 2015-10-05T10:41:28.942+0100 [conn228] end connection 172.28.0.164:55458 (224 connections now open) 2015-10-05T10:41:28.958+0100 [conn331] end connection 172.28.0.164:55586 (222 connections now open) 2015-10-05T10:41:28.958+0100 [conn296] end connection 172.28.0.164:55526 (222 connections now open) 2015-10-05T10:41:28.942+0100 [conn196] end connection 172.28.0.164:55424 (263 connections now open) 2015-10-05T10:41:28.958+0100 [conn54] end connection 172.28.0.164:55264 (221 connections now open) 2015-10-05T10:41:28.958+0100 [conn133] end connection 172.28.0.164:55360 (220 connections now open) 2015-10-05T10:41:28.958+0100 [conn114] end connection 172.28.0.164:55341 (221 connections now open) 2015-10-05T10:41:28.958+0100 [conn111] end connection 172.28.0.164:55338 (220 connections now open) 2015-10-05T10:41:28.958+0100 [conn252] end connection 172.28.0.164:55493 (220 connections now open) 2015-10-05T10:41:28.958+0100 [conn187] end connection 172.28.0.164:55412 (215 connections now open) 2015-10-05T10:41:28.958+0100 [conn99] end connection 172.28.0.164:55326 (206 connections now open) 2015-10-05T10:41:28.958+0100 [conn73] end connection 172.28.0.164:55300 (204 connections now open) 2015-10-05T10:41:28.958+0100 [conn244] end connection 172.28.0.164:55478 (204 connections now open) 2015-10-05T10:41:28.958+0100 [conn86] end connection 172.28.0.164:55313 (201 connections now open) 2015-10-05T10:41:28.958+0100 [conn239] end connection 172.28.0.164:55475 (201 connections now open) 2015-10-05T10:41:28.958+0100 [conn191] end connection 172.28.0.164:55415 (200 connections now open) 2015-10-05T10:41:28.958+0100 [conn216] end connection 172.28.0.164:55445 (115 connections now open) 2015-10-05T10:41:28.958+0100 [conn333] end connection 172.28.0.164:55588 (114 connections now open) 2015-10-05T10:41:28.973+0100 [conn193] end connection 172.28.0.164:55420 (113 connections now open) 2015-10-05T10:41:28.973+0100 [conn115] end connection 172.28.0.164:55342 (112 connections now open) 2015-10-05T10:41:28.973+0100 [conn38] end connection 172.28.0.164:55213 (111 connections now open) 2015-10-05T10:41:28.973+0100 [conn123] end connection 172.28.0.164:55350 (110 connections now open) 2015-10-05T10:41:28.973+0100 [conn166] end connection 172.28.0.164:55393 (109 connections now open) 2015-10-05T10:41:28.973+0100 [conn299] end connection 172.28.0.164:55532 (108 connections now open) 2015-10-05T10:41:28.973+0100 [conn90] end connection 172.28.0.164:55317 (107 connections now open) 2015-10-05T10:41:29.036+0100 [conn222] end connection 172.28.0.164:55451 (106 connections now open) 2015-10-05T10:41:29.114+0100 [conn339] end connection 172.28.0.164:55628 (105 connections now open) 2015-10-05T10:41:29.114+0100 [conn25] end connection 172.28.0.164:55198 (104 connections now open) 2015-10-05T10:41:29.114+0100 [mongosMain] connection accepted from 172.28.0.164:55645 #353 (106 connections now open) 2015-10-05T10:41:29.114+0100 [mongosMain] connection accepted from 172.28.0.164:55646 #354 (106 connections now open) 2015-10-05T10:41:29.114+0100 [conn353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:29.114+0100 [conn354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:29.176+0100 [mongosMain] connection accepted from 172.28.0.164:55647 #355 (107 connections now open) 2015-10-05T10:41:29.176+0100 [conn355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:29.223+0100 [conn173] end connection 172.28.0.164:55400 (106 connections now open) 2015-10-05T10:41:30.894+0100 [conn26] end connection 172.28.0.164:55199 (105 connections now open) 2015-10-05T10:41:30.894+0100 [mongosMain] connection accepted from 172.28.0.164:55650 #356 (106 connections now open) 2015-10-05T10:41:30.909+0100 [conn356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:30.941+0100 [conn22] end connection 172.28.0.164:55195 (105 connections now open) 2015-10-05T10:41:30.941+0100 [mongosMain] connection accepted from 172.28.0.164:55651 #357 (106 connections now open) 2015-10-05T10:41:30.941+0100 [conn357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.097+0100 [conn27] end connection 172.28.0.164:55200 (105 connections now open) 2015-10-05T10:41:31.097+0100 [conn20] end connection 172.28.0.164:55193 (104 connections now open) 2015-10-05T10:41:31.097+0100 [conn18] end connection 172.28.0.164:55191 (103 connections now open) 2015-10-05T10:41:31.097+0100 [mongosMain] connection accepted from 172.28.0.164:55653 #358 (104 connections now open) 2015-10-05T10:41:31.097+0100 [conn17] end connection 172.28.0.164:55190 (103 connections now open) 2015-10-05T10:41:31.097+0100 [mongosMain] connection accepted from 172.28.0.164:55654 #359 (105 connections now open) 2015-10-05T10:41:31.097+0100 [mongosMain] connection accepted from 172.28.0.164:55655 #360 (105 connections now open) 2015-10-05T10:41:31.097+0100 [conn16] end connection 172.28.0.164:55189 (104 connections now open) 2015-10-05T10:41:31.097+0100 [mongosMain] connection accepted from 172.28.0.164:55656 #361 (105 connections now open) 2015-10-05T10:41:31.097+0100 [conn360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.097+0100 [conn358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.097+0100 [conn359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.097+0100 [mongosMain] connection accepted from 172.28.0.164:55657 #362 (106 connections now open) 2015-10-05T10:41:31.097+0100 [conn361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.112+0100 [conn362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:31.221+0100 [conn28] end connection 172.28.0.164:55201 (105 connections now open) 2015-10-05T10:41:32.501+0100 [conn44] end connection 172.28.0.164:55222 (104 connections now open) 2015-10-05T10:41:32.501+0100 [conn122] end connection 172.28.0.164:55349 (104 connections now open) 2015-10-05T10:41:32.501+0100 [conn98] end connection 172.28.0.164:55325 (103 connections now open) 2015-10-05T10:41:32.501+0100 [conn71] end connection 172.28.0.164:55298 (102 connections now open) 2015-10-05T10:41:32.501+0100 [conn48] end connection 172.28.0.164:55243 (100 connections now open) 2015-10-05T10:41:32.501+0100 [conn189] end connection 172.28.0.164:55417 (99 connections now open) 2015-10-05T10:41:32.501+0100 [conn82] end connection 172.28.0.164:55309 (98 connections now open) 2015-10-05T10:41:32.501+0100 [conn204] end connection 172.28.0.164:55433 (97 connections now open) 2015-10-05T10:41:32.501+0100 [conn102] end connection 172.28.0.164:55329 (96 connections now open) 2015-10-05T10:41:32.501+0100 [conn334] end connection 172.28.0.164:55589 (95 connections now open) 2015-10-05T10:41:32.501+0100 [conn51] end connection 172.28.0.164:55258 (94 connections now open) 2015-10-05T10:41:32.501+0100 [conn274] end connection 172.28.0.164:55512 (93 connections now open) 2015-10-05T10:41:32.501+0100 [conn112] end connection 172.28.0.164:55339 (93 connections now open) 2015-10-05T10:41:32.501+0100 [conn107] end connection 172.28.0.164:55334 (92 connections now open) 2015-10-05T10:41:32.501+0100 [conn198] end connection 172.28.0.164:55427 (91 connections now open) 2015-10-05T10:41:32.501+0100 [conn178] end connection 172.28.0.164:55405 (89 connections now open) 2015-10-05T10:41:32.501+0100 [conn225] end connection 172.28.0.164:55454 (89 connections now open) 2015-10-05T10:41:32.501+0100 [conn84] end connection 172.28.0.164:55311 (87 connections now open) 2015-10-05T10:41:32.501+0100 [conn264] end connection 172.28.0.164:55500 (87 connections now open) 2015-10-05T10:41:32.501+0100 [conn108] end connection 172.28.0.164:55335 (85 connections now open) 2015-10-05T10:41:32.501+0100 [conn251] end connection 172.28.0.164:55489 (84 connections now open) 2015-10-05T10:41:32.501+0100 [conn110] end connection 172.28.0.164:55337 (84 connections now open) 2015-10-05T10:41:32.501+0100 [conn306] end connection 172.28.0.164:55537 (82 connections now open) 2015-10-05T10:41:32.501+0100 [conn267] end connection 172.28.0.164:55505 (82 connections now open) 2015-10-05T10:41:32.501+0100 [conn80] end connection 172.28.0.164:55307 (82 connections now open) 2015-10-05T10:41:32.501+0100 [conn119] end connection 172.28.0.164:55347 (82 connections now open) 2015-10-05T10:41:32.501+0100 [conn259] end connection 172.28.0.164:55497 (82 connections now open) 2015-10-05T10:41:32.501+0100 [conn291] end connection 172.28.0.164:55520 (78 connections now open) 2015-10-05T10:41:32.501+0100 [conn100] end connection 172.28.0.164:55327 (77 connections now open) 2015-10-05T10:41:32.501+0100 [conn217] end connection 172.28.0.164:55447 (77 connections now open) 2015-10-05T10:41:32.501+0100 [conn92] end connection 172.28.0.164:55319 (77 connections now open) 2015-10-05T10:41:32.501+0100 [conn128] end connection 172.28.0.164:55355 (78 connections now open) 2015-10-05T10:41:32.501+0100 [conn130] end connection 172.28.0.164:55357 (78 connections now open) 2015-10-05T10:41:32.501+0100 [conn321] end connection 172.28.0.164:55555 (72 connections now open) 2015-10-05T10:41:32.501+0100 [conn124] end connection 172.28.0.164:55351 (71 connections now open) 2015-10-05T10:41:32.501+0100 [conn83] end connection 172.28.0.164:55310 (72 connections now open) 2015-10-05T10:41:32.501+0100 [conn199] end connection 172.28.0.164:55426 (71 connections now open) 2015-10-05T10:41:32.501+0100 [conn180] end connection 172.28.0.164:55407 (72 connections now open) 2015-10-05T10:41:32.501+0100 [conn292] end connection 172.28.0.164:55521 (68 connections now open) 2015-10-05T10:41:32.501+0100 [conn329] end connection 172.28.0.164:55584 (68 connections now open) 2015-10-05T10:41:32.501+0100 [conn229] end connection 172.28.0.164:55459 (65 connections now open) 2015-10-05T10:41:32.501+0100 [conn55] end connection 172.28.0.164:55265 (64 connections now open) 2015-10-05T10:41:32.501+0100 [conn234] end connection 172.28.0.164:55472 (68 connections now open) 2015-10-05T10:41:32.501+0100 [conn325] end connection 172.28.0.164:55580 (70 connections now open) 2015-10-05T10:41:32.501+0100 [conn336] end connection 172.28.0.164:55610 (65 connections now open) 2015-10-05T10:41:32.501+0100 [conn72] end connection 172.28.0.164:55299 (63 connections now open) 2015-10-05T10:41:32.501+0100 [conn177] end connection 172.28.0.164:55404 (71 connections now open) 2015-10-05T10:41:32.501+0100 [conn237] end connection 172.28.0.164:55473 (57 connections now open) 2015-10-05T10:41:32.501+0100 [conn32] end connection 172.28.0.164:55207 (56 connections now open) 2015-10-05T10:41:33.156+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:41:33.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:41:34.232+0100 [conn29] end connection 172.28.0.164:55203 (55 connections now open) 2015-10-05T10:41:34.839+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:41:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:41:35.149+0100 [conn307] end connection 172.28.0.164:55538 (54 connections now open) 2015-10-05T10:41:35.149+0100 [conn355] end connection 172.28.0.164:55647 (53 connections now open) 2015-10-05T10:41:35.244+0100 [mongosMain] connection accepted from 172.28.0.164:55667 #363 (54 connections now open) 2015-10-05T10:41:35.247+0100 [conn363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:35.249+0100 [mongosMain] connection accepted from 172.28.0.164:55668 #364 (55 connections now open) 2015-10-05T10:41:35.253+0100 [conn364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:35.256+0100 [mongosMain] connection accepted from 172.28.0.164:55669 #365 (56 connections now open) 2015-10-05T10:41:35.259+0100 [conn365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:38.174+0100 [conn230] end connection 172.28.0.164:55429 (55 connections now open) 2015-10-05T10:41:39.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245d3bc91fc8b3b376aa6 2015-10-05T10:41:39.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:41:41.802+0100 [mongosMain] connection accepted from 127.0.0.1:49731 #366 (56 connections now open) 2015-10-05T10:41:41.841+0100 [conn366] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:41:41.847+0100 [conn366] end connection 127.0.0.1:49731 (55 connections now open) 2015-10-05T10:41:46.953+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:41:46.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:41:53.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245e0bc91fc8b3b376ac7 2015-10-05T10:41:53.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:03.781+0100 [mongosMain] connection accepted from 172.28.0.164:55709 #367 (56 connections now open) 2015-10-05T10:42:03.784+0100 [conn367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:05.021+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:42:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:42:05.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245edbc91fc8b3b376ad6 2015-10-05T10:42:05.534+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:11.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245f3bc91fc8b3b376adf 2015-10-05T10:42:11.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:15.185+0100 [mongosMain] connection accepted from 172.28.0.163:49803 #368 (57 connections now open) 2015-10-05T10:42:15.186+0100 [mongosMain] connection accepted from 172.28.0.163:49804 #369 (58 connections now open) 2015-10-05T10:42:20.674+0100 [mongosMain] connection accepted from 172.28.0.163:49812 #370 (59 connections now open) 2015-10-05T10:42:20.675+0100 [mongosMain] connection accepted from 172.28.0.163:49813 #371 (60 connections now open) 2015-10-05T10:42:23.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561245ffbc91fc8b3b376af0 2015-10-05T10:42:24.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:25.204+0100 [conn369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:26.175+0100 [conn368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.175+0100 [mongosMain] connection accepted from 172.28.0.163:49819 #372 (61 connections now open) 2015-10-05T10:42:28.177+0100 [conn372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.179+0100 [mongosMain] connection accepted from 172.28.0.163:49820 #373 (62 connections now open) 2015-10-05T10:42:28.181+0100 [conn373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.182+0100 [mongosMain] connection accepted from 172.28.0.163:49822 #374 (63 connections now open) 2015-10-05T10:42:28.183+0100 [conn374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.185+0100 [mongosMain] connection accepted from 172.28.0.163:49824 #375 (64 connections now open) 2015-10-05T10:42:28.187+0100 [conn375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.188+0100 [mongosMain] connection accepted from 172.28.0.163:49825 #376 (65 connections now open) 2015-10-05T10:42:28.189+0100 [conn376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.191+0100 [mongosMain] connection accepted from 172.28.0.163:49827 #377 (66 connections now open) 2015-10-05T10:42:28.192+0100 [conn377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.194+0100 [mongosMain] connection accepted from 172.28.0.163:49828 #378 (67 connections now open) 2015-10-05T10:42:28.195+0100 [conn378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.196+0100 [mongosMain] connection accepted from 172.28.0.163:49830 #379 (68 connections now open) 2015-10-05T10:42:28.197+0100 [conn379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.328+0100 [mongosMain] connection accepted from 127.0.0.1:49831 #380 (69 connections now open) 2015-10-05T10:42:28.330+0100 [conn380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.336+0100 [conn380] end connection 127.0.0.1:49831 (68 connections now open) 2015-10-05T10:42:28.554+0100 [mongosMain] connection accepted from 172.28.0.163:49832 #381 (69 connections now open) 2015-10-05T10:42:28.554+0100 [mongosMain] connection accepted from 172.28.0.163:49833 #382 (70 connections now open) 2015-10-05T10:42:28.557+0100 [conn382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.561+0100 [conn381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.563+0100 [mongosMain] connection accepted from 172.28.0.163:49835 #383 (71 connections now open) 2015-10-05T10:42:28.565+0100 [conn383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.565+0100 [mongosMain] connection accepted from 172.28.0.163:49836 #384 (72 connections now open) 2015-10-05T10:42:28.566+0100 [mongosMain] connection accepted from 172.28.0.163:49837 #385 (73 connections now open) 2015-10-05T10:42:28.566+0100 [mongosMain] connection accepted from 172.28.0.163:49838 #386 (74 connections now open) 2015-10-05T10:42:28.567+0100 [mongosMain] connection accepted from 172.28.0.163:49839 #387 (75 connections now open) 2015-10-05T10:42:28.568+0100 [mongosMain] connection accepted from 172.28.0.163:49840 #388 (76 connections now open) 2015-10-05T10:42:28.569+0100 [mongosMain] connection accepted from 172.28.0.163:49841 #389 (77 connections now open) 2015-10-05T10:42:28.569+0100 [mongosMain] connection accepted from 172.28.0.163:49842 #390 (78 connections now open) 2015-10-05T10:42:28.570+0100 [mongosMain] connection accepted from 172.28.0.163:49843 #391 (79 connections now open) 2015-10-05T10:42:28.570+0100 [mongosMain] connection accepted from 172.28.0.163:49844 #392 (80 connections now open) 2015-10-05T10:42:28.571+0100 [mongosMain] connection accepted from 172.28.0.163:49846 #393 (81 connections now open) 2015-10-05T10:42:28.571+0100 [mongosMain] connection accepted from 172.28.0.163:49845 #394 (82 connections now open) 2015-10-05T10:42:28.571+0100 [conn390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.572+0100 [conn384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.572+0100 [conn385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.572+0100 [mongosMain] connection accepted from 172.28.0.163:49847 #395 (83 connections now open) 2015-10-05T10:42:28.573+0100 [conn387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.573+0100 [conn388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.574+0100 [mongosMain] connection accepted from 172.28.0.163:49848 #396 (84 connections now open) 2015-10-05T10:42:28.574+0100 [conn391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.575+0100 [conn392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.577+0100 [conn396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.577+0100 [conn389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.577+0100 [conn395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.578+0100 [conn386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.578+0100 [conn394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.580+0100 [mongosMain] connection accepted from 172.28.0.163:49850 #397 (85 connections now open) 2015-10-05T10:42:28.581+0100 [conn393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.583+0100 [conn397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.589+0100 [mongosMain] connection accepted from 172.28.0.163:49851 #398 (86 connections now open) 2015-10-05T10:42:28.591+0100 [conn398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.592+0100 [mongosMain] connection accepted from 172.28.0.163:49853 #399 (87 connections now open) 2015-10-05T10:42:28.608+0100 [conn399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.609+0100 [mongosMain] connection accepted from 172.28.0.163:49860 #400 (88 connections now open) 2015-10-05T10:42:28.613+0100 [conn400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.615+0100 [mongosMain] connection accepted from 172.28.0.163:49863 #401 (89 connections now open) 2015-10-05T10:42:28.616+0100 [conn401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.617+0100 [mongosMain] connection accepted from 172.28.0.163:49864 #402 (90 connections now open) 2015-10-05T10:42:28.625+0100 [conn402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.628+0100 [mongosMain] connection accepted from 172.28.0.163:49866 #403 (91 connections now open) 2015-10-05T10:42:28.646+0100 [conn403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.649+0100 [mongosMain] connection accepted from 172.28.0.163:49868 #404 (92 connections now open) 2015-10-05T10:42:28.651+0100 [conn404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.652+0100 [mongosMain] connection accepted from 172.28.0.163:49870 #405 (93 connections now open) 2015-10-05T10:42:28.654+0100 [conn405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.655+0100 [mongosMain] connection accepted from 172.28.0.163:49872 #406 (94 connections now open) 2015-10-05T10:42:28.658+0100 [conn406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.659+0100 [mongosMain] connection accepted from 172.28.0.163:49874 #407 (95 connections now open) 2015-10-05T10:42:28.660+0100 [conn407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.662+0100 [mongosMain] connection accepted from 172.28.0.163:49875 #408 (96 connections now open) 2015-10-05T10:42:28.663+0100 [conn408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.664+0100 [mongosMain] connection accepted from 172.28.0.163:49877 #409 (97 connections now open) 2015-10-05T10:42:28.665+0100 [conn409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.667+0100 [mongosMain] connection accepted from 172.28.0.163:49879 #410 (98 connections now open) 2015-10-05T10:42:28.668+0100 [conn410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.669+0100 [mongosMain] connection accepted from 172.28.0.163:49880 #411 (99 connections now open) 2015-10-05T10:42:28.670+0100 [conn411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.671+0100 [mongosMain] connection accepted from 172.28.0.163:49882 #412 (100 connections now open) 2015-10-05T10:42:28.673+0100 [conn412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.674+0100 [mongosMain] connection accepted from 172.28.0.163:49883 #413 (101 connections now open) 2015-10-05T10:42:28.675+0100 [conn413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.676+0100 [mongosMain] connection accepted from 172.28.0.163:49885 #414 (102 connections now open) 2015-10-05T10:42:28.677+0100 [conn414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.679+0100 [mongosMain] connection accepted from 172.28.0.163:49888 #415 (103 connections now open) 2015-10-05T10:42:28.680+0100 [conn415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.681+0100 [mongosMain] connection accepted from 172.28.0.163:49890 #416 (104 connections now open) 2015-10-05T10:42:28.682+0100 [conn416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.683+0100 [mongosMain] connection accepted from 172.28.0.163:49891 #417 (105 connections now open) 2015-10-05T10:42:28.684+0100 [conn417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.686+0100 [mongosMain] connection accepted from 172.28.0.163:49893 #418 (106 connections now open) 2015-10-05T10:42:28.687+0100 [conn418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.688+0100 [mongosMain] connection accepted from 172.28.0.163:49895 #419 (107 connections now open) 2015-10-05T10:42:28.690+0100 [conn419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.691+0100 [mongosMain] connection accepted from 172.28.0.163:49896 #420 (108 connections now open) 2015-10-05T10:42:28.692+0100 [conn420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:28.693+0100 [mongosMain] connection accepted from 172.28.0.163:49898 #421 (109 connections now open) 2015-10-05T10:42:28.694+0100 [conn421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:30.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124606bc91fc8b3b376afb 2015-10-05T10:42:30.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:35.288+0100 [mongosMain] connection accepted from 172.28.0.164:55769 #422 (110 connections now open) 2015-10-05T10:42:35.290+0100 [conn422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:35.316+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:42:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:42:39.693+0100 [mongosMain] connection accepted from 127.0.0.1:49929 #423 (111 connections now open) 2015-10-05T10:42:39.695+0100 [conn423] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:39.699+0100 [conn423] end connection 127.0.0.1:49929 (110 connections now open) 2015-10-05T10:42:42.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124612bc91fc8b3b376b32 2015-10-05T10:42:42.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:43.679+0100 [conn370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:48.676+0100 [conn371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:48.677+0100 [mongosMain] connection accepted from 172.28.0.163:49941 #424 (111 connections now open) 2015-10-05T10:42:48.679+0100 [conn424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.177+0100 [mongosMain] connection accepted from 172.28.0.163:49951 #425 (112 connections now open) 2015-10-05T10:42:54.300+0100 [conn425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.410+0100 [mongosMain] connection accepted from 172.28.0.163:50010 #426 (113 connections now open) 2015-10-05T10:42:54.416+0100 [conn426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.468+0100 [mongosMain] connection accepted from 172.28.0.163:50011 #427 (114 connections now open) 2015-10-05T10:42:54.477+0100 [conn427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.574+0100 [mongosMain] connection accepted from 172.28.0.163:50012 #428 (115 connections now open) 2015-10-05T10:42:54.599+0100 [conn428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.636+0100 [mongosMain] connection accepted from 172.28.0.163:50013 #429 (116 connections now open) 2015-10-05T10:42:54.691+0100 [conn429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:54.919+0100 [mongosMain] connection accepted from 172.28.0.163:50014 #430 (117 connections now open) 2015-10-05T10:42:54.928+0100 [conn430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.003+0100 [mongosMain] connection accepted from 172.28.0.163:50015 #431 (118 connections now open) 2015-10-05T10:42:55.004+0100 [conn431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612461ebc91fc8b3b376b54 2015-10-05T10:42:55.065+0100 [mongosMain] connection accepted from 172.28.0.163:50016 #432 (119 connections now open) 2015-10-05T10:42:55.069+0100 [conn432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:42:55.126+0100 [mongosMain] connection accepted from 172.28.0.163:50017 #433 (120 connections now open) 2015-10-05T10:42:55.129+0100 [conn433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.284+0100 [mongosMain] connection accepted from 172.28.0.163:50018 #434 (121 connections now open) 2015-10-05T10:42:55.286+0100 [conn434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.393+0100 [mongosMain] connection accepted from 172.28.0.163:50022 #435 (122 connections now open) 2015-10-05T10:42:55.394+0100 [conn435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.601+0100 [mongosMain] connection accepted from 172.28.0.163:50024 #436 (123 connections now open) 2015-10-05T10:42:55.601+0100 [conn436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.632+0100 [mongosMain] connection accepted from 172.28.0.163:50026 #437 (124 connections now open) 2015-10-05T10:42:55.632+0100 [conn437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.648+0100 [mongosMain] connection accepted from 172.28.0.163:50028 #438 (125 connections now open) 2015-10-05T10:42:55.648+0100 [conn438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.648+0100 [mongosMain] connection accepted from 172.28.0.163:50030 #439 (126 connections now open) 2015-10-05T10:42:55.741+0100 [conn439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.773+0100 [mongosMain] connection accepted from 172.28.0.163:50033 #440 (127 connections now open) 2015-10-05T10:42:55.773+0100 [conn440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.788+0100 [mongosMain] connection accepted from 172.28.0.163:50034 #441 (128 connections now open) 2015-10-05T10:42:55.804+0100 [conn441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.804+0100 [mongosMain] connection accepted from 172.28.0.163:50035 #442 (129 connections now open) 2015-10-05T10:42:55.819+0100 [conn442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.835+0100 [mongosMain] connection accepted from 172.28.0.163:50037 #443 (130 connections now open) 2015-10-05T10:42:55.851+0100 [conn443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.866+0100 [mongosMain] connection accepted from 172.28.0.163:50039 #444 (131 connections now open) 2015-10-05T10:42:55.866+0100 [conn444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.866+0100 [mongosMain] connection accepted from 172.28.0.163:50041 #445 (132 connections now open) 2015-10-05T10:42:55.866+0100 [conn445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.866+0100 [mongosMain] connection accepted from 172.28.0.163:50042 #446 (133 connections now open) 2015-10-05T10:42:55.897+0100 [conn446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:55.975+0100 [mongosMain] connection accepted from 172.28.0.163:50045 #447 (134 connections now open) 2015-10-05T10:42:56.022+0100 [conn447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.053+0100 [mongosMain] connection accepted from 172.28.0.163:50046 #448 (135 connections now open) 2015-10-05T10:42:56.085+0100 [conn448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.319+0100 [mongosMain] connection accepted from 172.28.0.163:50048 #449 (136 connections now open) 2015-10-05T10:42:56.334+0100 [conn449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.350+0100 [mongosMain] connection accepted from 172.28.0.163:50049 #450 (137 connections now open) 2015-10-05T10:42:56.350+0100 [conn450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.350+0100 [mongosMain] connection accepted from 172.28.0.163:50050 #451 (138 connections now open) 2015-10-05T10:42:56.350+0100 [conn451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.365+0100 [mongosMain] connection accepted from 172.28.0.163:50052 #452 (139 connections now open) 2015-10-05T10:42:56.381+0100 [conn452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.412+0100 [mongosMain] connection accepted from 172.28.0.163:50053 #453 (140 connections now open) 2015-10-05T10:42:56.428+0100 [conn453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.490+0100 [mongosMain] connection accepted from 172.28.0.163:50054 #454 (141 connections now open) 2015-10-05T10:42:56.490+0100 [conn454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.506+0100 [mongosMain] connection accepted from 172.28.0.163:50055 #455 (142 connections now open) 2015-10-05T10:42:56.506+0100 [conn455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.521+0100 [mongosMain] connection accepted from 172.28.0.163:50056 #456 (143 connections now open) 2015-10-05T10:42:56.537+0100 [conn456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.537+0100 [mongosMain] connection accepted from 172.28.0.163:50058 #457 (144 connections now open) 2015-10-05T10:42:56.553+0100 [conn457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.568+0100 [mongosMain] connection accepted from 172.28.0.163:50059 #458 (145 connections now open) 2015-10-05T10:42:56.584+0100 [conn458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.631+0100 [mongosMain] connection accepted from 172.28.0.163:50060 #459 (146 connections now open) 2015-10-05T10:42:56.631+0100 [conn459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.755+0100 [mongosMain] connection accepted from 172.28.0.163:50061 #460 (147 connections now open) 2015-10-05T10:42:56.755+0100 [conn460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:56.865+0100 [mongosMain] connection accepted from 172.28.0.163:50063 #461 (148 connections now open) 2015-10-05T10:42:56.880+0100 [conn461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:57.130+0100 [mongosMain] connection accepted from 172.28.0.163:50064 #462 (149 connections now open) 2015-10-05T10:42:57.130+0100 [conn462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:58.019+0100 [mongosMain] connection accepted from 172.28.0.163:50066 #463 (150 connections now open) 2015-10-05T10:42:58.019+0100 [conn463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:59.251+0100 [mongosMain] connection accepted from 172.28.0.163:50068 #464 (151 connections now open) 2015-10-05T10:42:59.251+0100 [conn464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:42:59.882+0100 [mongosMain] connection accepted from 172.28.0.163:50069 #465 (152 connections now open) 2015-10-05T10:42:59.884+0100 [conn465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:00.696+0100 [mongosMain] connection accepted from 172.28.0.163:50073 #466 (153 connections now open) 2015-10-05T10:43:00.698+0100 [conn466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:00.849+0100 [mongosMain] connection accepted from 172.28.0.163:50074 #467 (154 connections now open) 2015-10-05T10:43:00.851+0100 [conn467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:00.881+0100 [mongosMain] connection accepted from 172.28.0.163:50075 #468 (155 connections now open) 2015-10-05T10:43:00.883+0100 [conn468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:01.233+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:43:01.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:43:03.677+0100 [mongosMain] connection accepted from 172.28.0.163:50078 #469 (156 connections now open) 2015-10-05T10:43:03.680+0100 [conn469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:05.581+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:43:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:43:06.442+0100 [mongosMain] connection accepted from 172.28.0.164:55791 #470 (157 connections now open) 2015-10-05T10:43:06.443+0100 [mongosMain] connection accepted from 172.28.0.164:55792 #471 (158 connections now open) 2015-10-05T10:43:06.443+0100 [mongosMain] connection accepted from 172.28.0.164:55793 #472 (159 connections now open) 2015-10-05T10:43:06.444+0100 [mongosMain] connection accepted from 172.28.0.164:55794 #473 (160 connections now open) 2015-10-05T10:43:06.445+0100 [conn470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.445+0100 [mongosMain] connection accepted from 172.28.0.164:55795 #474 (161 connections now open) 2015-10-05T10:43:06.445+0100 [conn471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.446+0100 [conn472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.446+0100 [conn473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.456+0100 [mongosMain] connection accepted from 172.28.0.164:55796 #475 (162 connections now open) 2015-10-05T10:43:06.456+0100 [mongosMain] connection accepted from 172.28.0.164:55797 #476 (163 connections now open) 2015-10-05T10:43:06.456+0100 [mongosMain] connection accepted from 172.28.0.164:55798 #477 (164 connections now open) 2015-10-05T10:43:06.457+0100 [mongosMain] connection accepted from 172.28.0.164:55799 #478 (165 connections now open) 2015-10-05T10:43:06.460+0100 [conn477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.461+0100 [mongosMain] connection accepted from 172.28.0.164:55800 #479 (166 connections now open) 2015-10-05T10:43:06.461+0100 [mongosMain] connection accepted from 172.28.0.164:55801 #480 (167 connections now open) 2015-10-05T10:43:06.461+0100 [conn475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.461+0100 [conn476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.465+0100 [conn480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.465+0100 [conn478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.465+0100 [conn479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.473+0100 [mongosMain] connection accepted from 172.28.0.164:55802 #481 (168 connections now open) 2015-10-05T10:43:06.473+0100 [mongosMain] connection accepted from 172.28.0.164:55803 #482 (169 connections now open) 2015-10-05T10:43:06.474+0100 [mongosMain] connection accepted from 172.28.0.164:55804 #483 (170 connections now open) 2015-10-05T10:43:06.476+0100 [conn481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.476+0100 [mongosMain] connection accepted from 172.28.0.164:55805 #484 (171 connections now open) 2015-10-05T10:43:06.476+0100 [conn482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.477+0100 [conn483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.477+0100 [mongosMain] connection accepted from 172.28.0.164:55806 #485 (172 connections now open) 2015-10-05T10:43:06.478+0100 [conn484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.478+0100 [mongosMain] connection accepted from 172.28.0.164:55807 #486 (173 connections now open) 2015-10-05T10:43:06.479+0100 [mongosMain] connection accepted from 172.28.0.164:55808 #487 (174 connections now open) 2015-10-05T10:43:06.479+0100 [mongosMain] connection accepted from 172.28.0.164:55809 #488 (175 connections now open) 2015-10-05T10:43:06.479+0100 [mongosMain] connection accepted from 172.28.0.164:55810 #489 (176 connections now open) 2015-10-05T10:43:06.480+0100 [mongosMain] connection accepted from 172.28.0.164:55811 #490 (177 connections now open) 2015-10-05T10:43:06.480+0100 [conn485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.480+0100 [mongosMain] connection accepted from 172.28.0.164:55812 #491 (178 connections now open) 2015-10-05T10:43:06.481+0100 [conn486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.481+0100 [conn488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.481+0100 [conn487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.482+0100 [conn490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.483+0100 [mongosMain] connection accepted from 172.28.0.164:55813 #492 (179 connections now open) 2015-10-05T10:43:06.483+0100 [mongosMain] connection accepted from 172.28.0.164:55814 #493 (180 connections now open) 2015-10-05T10:43:06.484+0100 [mongosMain] connection accepted from 172.28.0.164:55815 #494 (181 connections now open) 2015-10-05T10:43:06.485+0100 [conn492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.485+0100 [mongosMain] connection accepted from 172.28.0.164:55817 #495 (182 connections now open) 2015-10-05T10:43:06.486+0100 [mongosMain] connection accepted from 172.28.0.164:55818 #496 (183 connections now open) 2015-10-05T10:43:06.486+0100 [mongosMain] connection accepted from 172.28.0.164:55819 #497 (184 connections now open) 2015-10-05T10:43:06.486+0100 [conn494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.487+0100 [mongosMain] connection accepted from 172.28.0.164:55821 #498 (185 connections now open) 2015-10-05T10:43:06.487+0100 [mongosMain] connection accepted from 172.28.0.164:55820 #499 (186 connections now open) 2015-10-05T10:43:06.487+0100 [mongosMain] connection accepted from 172.28.0.164:55822 #500 (187 connections now open) 2015-10-05T10:43:06.488+0100 [mongosMain] connection accepted from 172.28.0.164:55823 #501 (188 connections now open) 2015-10-05T10:43:06.488+0100 [mongosMain] connection accepted from 172.28.0.164:55824 #502 (189 connections now open) 2015-10-05T10:43:06.488+0100 [conn496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.488+0100 [conn497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.488+0100 [mongosMain] connection accepted from 172.28.0.164:55825 #503 (190 connections now open) 2015-10-05T10:43:06.489+0100 [mongosMain] connection accepted from 172.28.0.164:55826 #504 (191 connections now open) 2015-10-05T10:43:06.489+0100 [mongosMain] connection accepted from 172.28.0.164:55828 #505 (192 connections now open) 2015-10-05T10:43:06.489+0100 [mongosMain] connection accepted from 172.28.0.164:55829 #506 (193 connections now open) 2015-10-05T10:43:06.489+0100 [mongosMain] connection accepted from 172.28.0.164:55827 #507 (194 connections now open) 2015-10-05T10:43:06.490+0100 [conn500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.490+0100 [mongosMain] connection accepted from 172.28.0.164:55830 #508 (195 connections now open) 2015-10-05T10:43:06.490+0100 [mongosMain] connection accepted from 172.28.0.164:55832 #509 (196 connections now open) 2015-10-05T10:43:06.490+0100 [conn502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.490+0100 [mongosMain] connection accepted from 172.28.0.164:55831 #510 (197 connections now open) 2015-10-05T10:43:06.491+0100 [conn503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.491+0100 [mongosMain] connection accepted from 172.28.0.164:55833 #511 (198 connections now open) 2015-10-05T10:43:06.491+0100 [conn505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.491+0100 [mongosMain] connection accepted from 172.28.0.164:55834 #512 (199 connections now open) 2015-10-05T10:43:06.491+0100 [conn506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.491+0100 [mongosMain] connection accepted from 172.28.0.164:55835 #513 (200 connections now open) 2015-10-05T10:43:06.491+0100 [mongosMain] connection accepted from 172.28.0.164:55836 #514 (201 connections now open) 2015-10-05T10:43:06.492+0100 [mongosMain] connection accepted from 172.28.0.164:55840 #515 (202 connections now open) 2015-10-05T10:43:06.492+0100 [conn504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.492+0100 [mongosMain] connection accepted from 172.28.0.164:55837 #516 (203 connections now open) 2015-10-05T10:43:06.492+0100 [conn510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.492+0100 [conn507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.492+0100 [conn509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.493+0100 [mongosMain] connection accepted from 172.28.0.164:55841 #517 (204 connections now open) 2015-10-05T10:43:06.493+0100 [mongosMain] connection accepted from 172.28.0.164:55842 #518 (205 connections now open) 2015-10-05T10:43:06.493+0100 [conn512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.493+0100 [mongosMain] connection accepted from 172.28.0.164:55844 #519 (206 connections now open) 2015-10-05T10:43:06.494+0100 [conn511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.494+0100 [conn513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.494+0100 [mongosMain] connection accepted from 172.28.0.164:55843 #520 (207 connections now open) 2015-10-05T10:43:06.495+0100 [mongosMain] connection accepted from 172.28.0.164:55845 #521 (208 connections now open) 2015-10-05T10:43:06.495+0100 [mongosMain] connection accepted from 172.28.0.164:55847 #522 (209 connections now open) 2015-10-05T10:43:06.495+0100 [conn515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.495+0100 [mongosMain] connection accepted from 172.28.0.164:55846 #523 (210 connections now open) 2015-10-05T10:43:06.495+0100 [conn517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.496+0100 [mongosMain] connection accepted from 172.28.0.164:55848 #524 (211 connections now open) 2015-10-05T10:43:06.496+0100 [mongosMain] connection accepted from 172.28.0.164:55849 #525 (212 connections now open) 2015-10-05T10:43:06.496+0100 [mongosMain] connection accepted from 172.28.0.164:55850 #526 (213 connections now open) 2015-10-05T10:43:06.497+0100 [mongosMain] connection accepted from 172.28.0.164:55851 #527 (214 connections now open) 2015-10-05T10:43:06.497+0100 [mongosMain] connection accepted from 172.28.0.164:55852 #528 (215 connections now open) 2015-10-05T10:43:06.497+0100 [mongosMain] connection accepted from 172.28.0.164:55853 #529 (216 connections now open) 2015-10-05T10:43:06.498+0100 [mongosMain] connection accepted from 172.28.0.164:55854 #530 (217 connections now open) 2015-10-05T10:43:06.498+0100 [mongosMain] connection accepted from 172.28.0.164:55855 #531 (218 connections now open) 2015-10-05T10:43:06.498+0100 [mongosMain] connection accepted from 172.28.0.164:55856 #532 (219 connections now open) 2015-10-05T10:43:06.498+0100 [mongosMain] connection accepted from 172.28.0.164:55857 #533 (220 connections now open) 2015-10-05T10:43:06.498+0100 [mongosMain] connection accepted from 172.28.0.164:55858 #534 (221 connections now open) 2015-10-05T10:43:06.499+0100 [mongosMain] connection accepted from 172.28.0.164:55859 #535 (222 connections now open) 2015-10-05T10:43:06.499+0100 [mongosMain] connection accepted from 172.28.0.164:55860 #536 (223 connections now open) 2015-10-05T10:43:06.500+0100 [mongosMain] connection accepted from 172.28.0.164:55861 #537 (224 connections now open) 2015-10-05T10:43:06.500+0100 [mongosMain] connection accepted from 172.28.0.164:55862 #538 (225 connections now open) 2015-10-05T10:43:06.501+0100 [mongosMain] connection accepted from 172.28.0.164:55863 #539 (226 connections now open) 2015-10-05T10:43:06.501+0100 [conn530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.501+0100 [conn532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [mongosMain] connection accepted from 172.28.0.164:55864 #540 (227 connections now open) 2015-10-05T10:43:06.502+0100 [conn529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.502+0100 [conn522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.503+0100 [mongosMain] connection accepted from 172.28.0.164:55865 #541 (228 connections now open) 2015-10-05T10:43:06.503+0100 [conn520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.503+0100 [mongosMain] connection accepted from 172.28.0.164:55868 #542 (229 connections now open) 2015-10-05T10:43:06.503+0100 [mongosMain] connection accepted from 172.28.0.164:55867 #543 (230 connections now open) 2015-10-05T10:43:06.503+0100 [mongosMain] connection accepted from 172.28.0.164:55866 #544 (231 connections now open) 2015-10-05T10:43:06.504+0100 [mongosMain] connection accepted from 172.28.0.164:55871 #545 (232 connections now open) 2015-10-05T10:43:06.504+0100 [mongosMain] connection accepted from 172.28.0.164:55870 #546 (233 connections now open) 2015-10-05T10:43:06.504+0100 [mongosMain] connection accepted from 172.28.0.164:55869 #547 (234 connections now open) 2015-10-05T10:43:06.602+0100 [mongosMain] connection accepted from 172.28.0.164:55872 #548 (235 connections now open) 2015-10-05T10:43:06.607+0100 [conn534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.607+0100 [conn536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.608+0100 [mongosMain] connection accepted from 172.28.0.164:55873 #549 (236 connections now open) 2015-10-05T10:43:06.619+0100 [mongosMain] connection accepted from 172.28.0.164:55874 #550 (237 connections now open) 2015-10-05T10:43:06.620+0100 [mongosMain] connection accepted from 172.28.0.164:55875 #551 (238 connections now open) 2015-10-05T10:43:06.620+0100 [mongosMain] connection accepted from 172.28.0.164:55876 #552 (239 connections now open) 2015-10-05T10:43:06.624+0100 [mongosMain] connection accepted from 172.28.0.164:55878 #553 (240 connections now open) 2015-10-05T10:43:06.625+0100 [mongosMain] connection accepted from 172.28.0.164:55879 #554 (241 connections now open) 2015-10-05T10:43:06.625+0100 [mongosMain] connection accepted from 172.28.0.164:55877 #555 (242 connections now open) 2015-10-05T10:43:06.625+0100 [mongosMain] connection accepted from 172.28.0.164:55880 #556 (243 connections now open) 2015-10-05T10:43:06.628+0100 [mongosMain] connection accepted from 172.28.0.164:55881 #557 (244 connections now open) 2015-10-05T10:43:06.629+0100 [mongosMain] connection accepted from 172.28.0.164:55884 #558 (245 connections now open) 2015-10-05T10:43:06.629+0100 [mongosMain] connection accepted from 172.28.0.164:55883 #559 (246 connections now open) 2015-10-05T10:43:06.629+0100 [mongosMain] connection accepted from 172.28.0.164:55882 #560 (247 connections now open) 2015-10-05T10:43:06.630+0100 [mongosMain] connection accepted from 172.28.0.164:55885 #561 (248 connections now open) 2015-10-05T10:43:06.630+0100 [mongosMain] connection accepted from 172.28.0.164:55886 #562 (249 connections now open) 2015-10-05T10:43:06.630+0100 [mongosMain] connection accepted from 172.28.0.164:55887 #563 (250 connections now open) 2015-10-05T10:43:06.631+0100 [mongosMain] connection accepted from 172.28.0.164:55888 #564 (251 connections now open) 2015-10-05T10:43:06.631+0100 [mongosMain] connection accepted from 172.28.0.164:55889 #565 (252 connections now open) 2015-10-05T10:43:06.632+0100 [mongosMain] connection accepted from 172.28.0.164:55890 #566 (253 connections now open) 2015-10-05T10:43:06.632+0100 [mongosMain] connection accepted from 172.28.0.164:55891 #567 (254 connections now open) 2015-10-05T10:43:06.632+0100 [mongosMain] connection accepted from 172.28.0.164:55892 #568 (255 connections now open) 2015-10-05T10:43:06.632+0100 [mongosMain] connection accepted from 172.28.0.164:55893 #569 (256 connections now open) 2015-10-05T10:43:06.633+0100 [mongosMain] connection accepted from 172.28.0.164:55894 #570 (257 connections now open) 2015-10-05T10:43:06.633+0100 [mongosMain] connection accepted from 172.28.0.164:55895 #571 (258 connections now open) 2015-10-05T10:43:06.633+0100 [mongosMain] connection accepted from 172.28.0.164:55896 #572 (259 connections now open) 2015-10-05T10:43:06.634+0100 [mongosMain] connection accepted from 172.28.0.164:55897 #573 (260 connections now open) 2015-10-05T10:43:06.634+0100 [mongosMain] connection accepted from 172.28.0.164:55899 #574 (261 connections now open) 2015-10-05T10:43:06.635+0100 [mongosMain] connection accepted from 172.28.0.164:55900 #575 (262 connections now open) 2015-10-05T10:43:06.635+0100 [mongosMain] connection accepted from 172.28.0.164:55898 #576 (263 connections now open) 2015-10-05T10:43:06.635+0100 [mongosMain] connection accepted from 172.28.0.164:55901 #577 (264 connections now open) 2015-10-05T10:43:06.635+0100 [mongosMain] connection accepted from 172.28.0.164:55902 #578 (265 connections now open) 2015-10-05T10:43:06.635+0100 [mongosMain] connection accepted from 172.28.0.164:55903 #579 (266 connections now open) 2015-10-05T10:43:06.636+0100 [mongosMain] connection accepted from 172.28.0.164:55904 #580 (267 connections now open) 2015-10-05T10:43:06.636+0100 [mongosMain] connection accepted from 172.28.0.164:55905 #581 (268 connections now open) 2015-10-05T10:43:06.636+0100 [mongosMain] connection accepted from 172.28.0.164:55907 #582 (269 connections now open) 2015-10-05T10:43:06.637+0100 [mongosMain] connection accepted from 172.28.0.164:55908 #583 (270 connections now open) 2015-10-05T10:43:06.637+0100 [mongosMain] connection accepted from 172.28.0.164:55909 #584 (271 connections now open) 2015-10-05T10:43:06.637+0100 [mongosMain] connection accepted from 172.28.0.164:55906 #585 (272 connections now open) 2015-10-05T10:43:06.638+0100 [mongosMain] connection accepted from 172.28.0.164:55910 #586 (273 connections now open) 2015-10-05T10:43:06.638+0100 [mongosMain] connection accepted from 172.28.0.164:55912 #587 (274 connections now open) 2015-10-05T10:43:06.638+0100 [mongosMain] connection accepted from 172.28.0.164:55913 #588 (275 connections now open) 2015-10-05T10:43:06.639+0100 [mongosMain] connection accepted from 172.28.0.164:55911 #589 (276 connections now open) 2015-10-05T10:43:06.639+0100 [mongosMain] connection accepted from 172.28.0.164:55917 #590 (277 connections now open) 2015-10-05T10:43:06.639+0100 [mongosMain] connection accepted from 172.28.0.164:55920 #591 (278 connections now open) 2015-10-05T10:43:06.640+0100 [mongosMain] connection accepted from 172.28.0.164:55915 #592 (279 connections now open) 2015-10-05T10:43:06.640+0100 [mongosMain] connection accepted from 172.28.0.164:55918 #593 (280 connections now open) 2015-10-05T10:43:06.640+0100 [mongosMain] connection accepted from 172.28.0.164:55914 #594 (281 connections now open) 2015-10-05T10:43:06.640+0100 [mongosMain] connection accepted from 172.28.0.164:55919 #595 (282 connections now open) 2015-10-05T10:43:06.641+0100 [mongosMain] connection accepted from 172.28.0.164:55922 #596 (283 connections now open) 2015-10-05T10:43:06.641+0100 [mongosMain] connection accepted from 172.28.0.164:55921 #597 (284 connections now open) 2015-10-05T10:43:06.641+0100 [mongosMain] connection accepted from 172.28.0.164:55925 #598 (285 connections now open) 2015-10-05T10:43:06.641+0100 [mongosMain] connection accepted from 172.28.0.164:55924 #599 (286 connections now open) 2015-10-05T10:43:06.641+0100 [mongosMain] connection accepted from 172.28.0.164:55916 #600 (287 connections now open) 2015-10-05T10:43:06.642+0100 [mongosMain] connection accepted from 172.28.0.164:55923 #601 (288 connections now open) 2015-10-05T10:43:06.642+0100 [mongosMain] connection accepted from 172.28.0.164:55926 #602 (289 connections now open) 2015-10-05T10:43:06.642+0100 [mongosMain] connection accepted from 172.28.0.164:55927 #603 (290 connections now open) 2015-10-05T10:43:06.642+0100 [mongosMain] connection accepted from 172.28.0.164:55928 #604 (291 connections now open) 2015-10-05T10:43:06.643+0100 [mongosMain] connection accepted from 172.28.0.164:55930 #605 (292 connections now open) 2015-10-05T10:43:06.643+0100 [mongosMain] connection accepted from 172.28.0.164:55929 #606 (293 connections now open) 2015-10-05T10:43:06.643+0100 [mongosMain] connection accepted from 172.28.0.164:55931 #607 (294 connections now open) 2015-10-05T10:43:06.643+0100 [mongosMain] connection accepted from 172.28.0.164:55932 #608 (295 connections now open) 2015-10-05T10:43:06.644+0100 [mongosMain] connection accepted from 172.28.0.164:55934 #609 (296 connections now open) 2015-10-05T10:43:06.644+0100 [mongosMain] connection accepted from 172.28.0.164:55933 #610 (297 connections now open) 2015-10-05T10:43:06.644+0100 [mongosMain] connection accepted from 172.28.0.164:55936 #611 (298 connections now open) 2015-10-05T10:43:06.644+0100 [mongosMain] connection accepted from 172.28.0.164:55935 #612 (299 connections now open) 2015-10-05T10:43:06.645+0100 [mongosMain] connection accepted from 172.28.0.164:55937 #613 (300 connections now open) 2015-10-05T10:43:06.645+0100 [mongosMain] connection accepted from 172.28.0.164:55938 #614 (301 connections now open) 2015-10-05T10:43:06.645+0100 [mongosMain] connection accepted from 172.28.0.164:55940 #615 (302 connections now open) 2015-10-05T10:43:06.645+0100 [mongosMain] connection accepted from 172.28.0.164:55939 #616 (303 connections now open) 2015-10-05T10:43:06.645+0100 [mongosMain] connection accepted from 172.28.0.164:55942 #617 (304 connections now open) 2015-10-05T10:43:06.646+0100 [mongosMain] connection accepted from 172.28.0.164:55944 #618 (305 connections now open) 2015-10-05T10:43:06.646+0100 [mongosMain] connection accepted from 172.28.0.164:55945 #619 (306 connections now open) 2015-10-05T10:43:06.646+0100 [mongosMain] connection accepted from 172.28.0.164:55943 #620 (307 connections now open) 2015-10-05T10:43:06.646+0100 [mongosMain] connection accepted from 172.28.0.164:55946 #621 (308 connections now open) 2015-10-05T10:43:06.647+0100 [mongosMain] connection accepted from 172.28.0.164:55948 #622 (309 connections now open) 2015-10-05T10:43:06.647+0100 [mongosMain] connection accepted from 172.28.0.164:55949 #623 (310 connections now open) 2015-10-05T10:43:06.647+0100 [mongosMain] connection accepted from 172.28.0.164:55951 #624 (311 connections now open) 2015-10-05T10:43:06.647+0100 [mongosMain] connection accepted from 172.28.0.164:55947 #625 (312 connections now open) 2015-10-05T10:43:06.647+0100 [mongosMain] connection accepted from 172.28.0.164:55950 #626 (313 connections now open) 2015-10-05T10:43:06.648+0100 [mongosMain] connection accepted from 172.28.0.164:55952 #627 (314 connections now open) 2015-10-05T10:43:06.648+0100 [mongosMain] connection accepted from 172.28.0.164:55954 #628 (315 connections now open) 2015-10-05T10:43:06.648+0100 [mongosMain] connection accepted from 172.28.0.164:55953 #629 (316 connections now open) 2015-10-05T10:43:06.648+0100 [mongosMain] connection accepted from 172.28.0.164:55956 #630 (317 connections now open) 2015-10-05T10:43:06.649+0100 [mongosMain] connection accepted from 172.28.0.164:55955 #631 (318 connections now open) 2015-10-05T10:43:06.649+0100 [mongosMain] connection accepted from 172.28.0.164:55959 #632 (319 connections now open) 2015-10-05T10:43:06.649+0100 [mongosMain] connection accepted from 172.28.0.164:55958 #633 (320 connections now open) 2015-10-05T10:43:06.649+0100 [mongosMain] connection accepted from 172.28.0.164:55957 #634 (321 connections now open) 2015-10-05T10:43:06.650+0100 [mongosMain] connection accepted from 172.28.0.164:55960 #635 (322 connections now open) 2015-10-05T10:43:06.650+0100 [mongosMain] connection accepted from 172.28.0.164:55961 #636 (323 connections now open) 2015-10-05T10:43:06.650+0100 [mongosMain] connection accepted from 172.28.0.164:55962 #637 (324 connections now open) 2015-10-05T10:43:06.650+0100 [mongosMain] connection accepted from 172.28.0.164:55963 #638 (325 connections now open) 2015-10-05T10:43:06.651+0100 [mongosMain] connection accepted from 172.28.0.164:55965 #639 (326 connections now open) 2015-10-05T10:43:06.651+0100 [mongosMain] connection accepted from 172.28.0.164:55964 #640 (327 connections now open) 2015-10-05T10:43:06.651+0100 [mongosMain] connection accepted from 172.28.0.164:55966 #641 (328 connections now open) 2015-10-05T10:43:06.652+0100 [mongosMain] connection accepted from 172.28.0.164:55967 #642 (329 connections now open) 2015-10-05T10:43:06.652+0100 [mongosMain] connection accepted from 172.28.0.164:55968 #643 (330 connections now open) 2015-10-05T10:43:06.652+0100 [mongosMain] connection accepted from 172.28.0.164:55969 #644 (331 connections now open) 2015-10-05T10:43:06.653+0100 [mongosMain] connection accepted from 172.28.0.164:55970 #645 (332 connections now open) 2015-10-05T10:43:06.653+0100 [mongosMain] connection accepted from 172.28.0.164:55971 #646 (333 connections now open) 2015-10-05T10:43:06.653+0100 [mongosMain] connection accepted from 172.28.0.164:55972 #647 (334 connections now open) 2015-10-05T10:43:06.654+0100 [mongosMain] connection accepted from 172.28.0.164:55973 #648 (335 connections now open) 2015-10-05T10:43:06.654+0100 [mongosMain] connection accepted from 172.28.0.164:55974 #649 (336 connections now open) 2015-10-05T10:43:06.654+0100 [mongosMain] connection accepted from 172.28.0.164:55975 #650 (337 connections now open) 2015-10-05T10:43:06.654+0100 [mongosMain] connection accepted from 172.28.0.164:55976 #651 (338 connections now open) 2015-10-05T10:43:06.655+0100 [mongosMain] connection accepted from 172.28.0.164:55977 #652 (339 connections now open) 2015-10-05T10:43:06.655+0100 [mongosMain] connection accepted from 172.28.0.164:55980 #653 (340 connections now open) 2015-10-05T10:43:06.655+0100 [mongosMain] connection accepted from 172.28.0.164:55978 #654 (341 connections now open) 2015-10-05T10:43:06.656+0100 [mongosMain] connection accepted from 172.28.0.164:55979 #655 (342 connections now open) 2015-10-05T10:43:06.656+0100 [mongosMain] connection accepted from 172.28.0.164:55981 #656 (343 connections now open) 2015-10-05T10:43:06.656+0100 [mongosMain] connection accepted from 172.28.0.164:55982 #657 (344 connections now open) 2015-10-05T10:43:06.656+0100 [conn539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.656+0100 [mongosMain] connection accepted from 172.28.0.164:55983 #658 (345 connections now open) 2015-10-05T10:43:06.656+0100 [conn535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.656+0100 [mongosMain] connection accepted from 172.28.0.164:55984 #659 (346 connections now open) 2015-10-05T10:43:06.657+0100 [conn538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.657+0100 [mongosMain] connection accepted from 172.28.0.164:55985 #660 (347 connections now open) 2015-10-05T10:43:06.657+0100 [mongosMain] connection accepted from 172.28.0.164:55986 #661 (348 connections now open) 2015-10-05T10:43:06.657+0100 [mongosMain] connection accepted from 172.28.0.164:55987 #662 (349 connections now open) 2015-10-05T10:43:06.657+0100 [mongosMain] connection accepted from 172.28.0.164:55988 #663 (350 connections now open) 2015-10-05T10:43:06.658+0100 [mongosMain] connection accepted from 172.28.0.164:55989 #664 (351 connections now open) 2015-10-05T10:43:06.658+0100 [mongosMain] connection accepted from 172.28.0.164:55990 #665 (352 connections now open) 2015-10-05T10:43:06.658+0100 [mongosMain] connection accepted from 172.28.0.164:55992 #666 (353 connections now open) 2015-10-05T10:43:06.658+0100 [mongosMain] connection accepted from 172.28.0.164:55991 #667 (354 connections now open) 2015-10-05T10:43:06.659+0100 [mongosMain] connection accepted from 172.28.0.164:55994 #668 (355 connections now open) 2015-10-05T10:43:06.659+0100 [mongosMain] connection accepted from 172.28.0.164:55993 #669 (356 connections now open) 2015-10-05T10:43:06.659+0100 [mongosMain] connection accepted from 172.28.0.164:55995 #670 (357 connections now open) 2015-10-05T10:43:06.659+0100 [mongosMain] connection accepted from 172.28.0.164:55996 #671 (358 connections now open) 2015-10-05T10:43:06.660+0100 [mongosMain] connection accepted from 172.28.0.164:55997 #672 (359 connections now open) 2015-10-05T10:43:06.660+0100 [mongosMain] connection accepted from 172.28.0.164:55998 #673 (360 connections now open) 2015-10-05T10:43:06.660+0100 [mongosMain] connection accepted from 172.28.0.164:56000 #674 (361 connections now open) 2015-10-05T10:43:06.660+0100 [mongosMain] connection accepted from 172.28.0.164:56001 #675 (362 connections now open) 2015-10-05T10:43:06.661+0100 [mongosMain] connection accepted from 172.28.0.164:55999 #676 (363 connections now open) 2015-10-05T10:43:06.661+0100 [mongosMain] connection accepted from 172.28.0.164:56002 #677 (364 connections now open) 2015-10-05T10:43:06.661+0100 [mongosMain] connection accepted from 172.28.0.164:56003 #678 (365 connections now open) 2015-10-05T10:43:06.661+0100 [mongosMain] connection accepted from 172.28.0.164:56004 #679 (366 connections now open) 2015-10-05T10:43:06.661+0100 [mongosMain] connection accepted from 172.28.0.164:56005 #680 (367 connections now open) 2015-10-05T10:43:06.662+0100 [mongosMain] connection accepted from 172.28.0.164:56006 #681 (368 connections now open) 2015-10-05T10:43:06.662+0100 [mongosMain] connection accepted from 172.28.0.164:56007 #682 (369 connections now open) 2015-10-05T10:43:06.662+0100 [mongosMain] connection accepted from 172.28.0.164:56008 #683 (370 connections now open) 2015-10-05T10:43:06.662+0100 [mongosMain] connection accepted from 172.28.0.164:56009 #684 (371 connections now open) 2015-10-05T10:43:06.663+0100 [mongosMain] connection accepted from 172.28.0.164:56010 #685 (372 connections now open) 2015-10-05T10:43:06.663+0100 [mongosMain] connection accepted from 172.28.0.164:56011 #686 (373 connections now open) 2015-10-05T10:43:06.663+0100 [mongosMain] connection accepted from 172.28.0.164:56012 #687 (374 connections now open) 2015-10-05T10:43:06.663+0100 [mongosMain] connection accepted from 172.28.0.164:56013 #688 (375 connections now open) 2015-10-05T10:43:06.664+0100 [mongosMain] connection accepted from 172.28.0.164:56014 #689 (376 connections now open) 2015-10-05T10:43:06.664+0100 [mongosMain] connection accepted from 172.28.0.164:56015 #690 (377 connections now open) 2015-10-05T10:43:06.664+0100 [mongosMain] connection accepted from 172.28.0.164:56016 #691 (378 connections now open) 2015-10-05T10:43:06.664+0100 [mongosMain] connection accepted from 172.28.0.164:56017 #692 (379 connections now open) 2015-10-05T10:43:06.664+0100 [mongosMain] connection accepted from 172.28.0.164:56019 #693 (380 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56018 #694 (381 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56020 #695 (382 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56021 #696 (383 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56022 #697 (384 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56024 #698 (385 connections now open) 2015-10-05T10:43:06.665+0100 [mongosMain] connection accepted from 172.28.0.164:56023 #699 (386 connections now open) 2015-10-05T10:43:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:56025 #700 (387 connections now open) 2015-10-05T10:43:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:56026 #701 (388 connections now open) 2015-10-05T10:43:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:56028 #702 (389 connections now open) 2015-10-05T10:43:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:56027 #703 (390 connections now open) 2015-10-05T10:43:06.666+0100 [mongosMain] connection accepted from 172.28.0.164:56029 #704 (391 connections now open) 2015-10-05T10:43:06.674+0100 [mongosMain] connection accepted from 172.28.0.164:56030 #705 (392 connections now open) 2015-10-05T10:43:06.675+0100 [mongosMain] connection accepted from 172.28.0.164:56031 #706 (393 connections now open) 2015-10-05T10:43:06.676+0100 [mongosMain] connection accepted from 172.28.0.164:56032 #707 (394 connections now open) 2015-10-05T10:43:06.677+0100 [mongosMain] connection accepted from 172.28.0.164:56033 #708 (395 connections now open) 2015-10-05T10:43:06.677+0100 [mongosMain] connection accepted from 172.28.0.164:56034 #709 (396 connections now open) 2015-10-05T10:43:06.677+0100 [mongosMain] connection accepted from 172.28.0.164:56035 #710 (397 connections now open) 2015-10-05T10:43:06.680+0100 [mongosMain] connection accepted from 172.28.0.163:50085 #711 (398 connections now open) 2015-10-05T10:43:06.681+0100 [conn711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.725+0100 [conn537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.725+0100 [conn545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.726+0100 [conn554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.726+0100 [conn541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.726+0100 [conn552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.727+0100 [conn542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.726+0100 [mongosMain] connection accepted from 172.28.0.164:56036 #712 (399 connections now open) 2015-10-05T10:43:06.727+0100 [conn546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.727+0100 [conn551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.727+0100 [conn553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.727+0100 [mongosMain] connection accepted from 172.28.0.164:56037 #713 (400 connections now open) 2015-10-05T10:43:06.727+0100 [conn550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.727+0100 [conn555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.729+0100 [mongosMain] connection accepted from 172.28.0.164:56038 #714 (401 connections now open) 2015-10-05T10:43:06.730+0100 [mongosMain] connection accepted from 172.28.0.163:50089 #715 (402 connections now open) 2015-10-05T10:43:06.731+0100 [conn557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.731+0100 [mongosMain] connection accepted from 172.28.0.164:56039 #716 (403 connections now open) 2015-10-05T10:43:06.731+0100 [conn543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.731+0100 [mongosMain] connection accepted from 172.28.0.164:56040 #717 (404 connections now open) 2015-10-05T10:43:06.731+0100 [conn540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.731+0100 [conn544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.731+0100 [conn560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.731+0100 [conn715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.732+0100 [mongosMain] connection accepted from 172.28.0.164:56041 #718 (405 connections now open) 2015-10-05T10:43:06.732+0100 [mongosMain] connection accepted from 172.28.0.164:56042 #719 (406 connections now open) 2015-10-05T10:43:06.732+0100 [conn562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.732+0100 [mongosMain] connection accepted from 172.28.0.164:56043 #720 (407 connections now open) 2015-10-05T10:43:06.732+0100 [conn556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.733+0100 [conn563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.733+0100 [mongosMain] connection accepted from 172.28.0.164:56044 #721 (408 connections now open) 2015-10-05T10:43:06.733+0100 [mongosMain] connection accepted from 172.28.0.163:50090 #722 (409 connections now open) 2015-10-05T10:43:06.733+0100 [mongosMain] connection accepted from 172.28.0.164:56045 #723 (410 connections now open) 2015-10-05T10:43:06.734+0100 [conn567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [conn561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [conn564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [conn570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [mongosMain] connection accepted from 172.28.0.164:56046 #724 (411 connections now open) 2015-10-05T10:43:06.734+0100 [conn572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [conn558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.734+0100 [conn566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.735+0100 [conn580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.737+0100 [mongosMain] connection accepted from 172.28.0.164:56047 #725 (412 connections now open) 2015-10-05T10:43:06.736+0100 [conn588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.736+0100 [conn586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.737+0100 [conn559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.739+0100 [conn582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.739+0100 [conn591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.738+0100 [conn595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.739+0100 [conn662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.737+0100 [conn565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.739+0100 [conn665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.739+0100 [conn663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.741+0100 [conn668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.741+0100 [conn592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.741+0100 [conn670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.741+0100 [conn676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.743+0100 [conn677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.743+0100 [mongosMain] connection accepted from 172.28.0.164:56048 #726 (413 connections now open) 2015-10-05T10:43:06.744+0100 [conn678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.744+0100 [mongosMain] connection accepted from 172.28.0.164:56049 #727 (414 connections now open) 2015-10-05T10:43:06.744+0100 [conn680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.744+0100 [conn672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.745+0100 [conn671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.745+0100 [conn664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.745+0100 [conn667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.747+0100 [conn682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.747+0100 [conn685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.747+0100 [mongosMain] connection accepted from 172.28.0.164:56050 #728 (415 connections now open) 2015-10-05T10:43:06.748+0100 [conn683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.746+0100 [conn679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.748+0100 [conn547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.751+0100 [conn666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.752+0100 [conn689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.751+0100 [conn688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.752+0100 [conn690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.752+0100 [conn687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.753+0100 [conn704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.753+0100 [conn699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.753+0100 [conn693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.753+0100 [conn603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [mongosMain] connection accepted from 172.28.0.164:56051 #729 (416 connections now open) 2015-10-05T10:43:06.754+0100 [conn598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.754+0100 [conn609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.755+0100 [conn621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.756+0100 [conn617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.757+0100 [conn654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.759+0100 [conn650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.759+0100 [conn645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.758+0100 [conn634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.760+0100 [conn608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.762+0100 [mongosMain] connection accepted from 172.28.0.164:56052 #730 (417 connections now open) 2015-10-05T10:43:06.763+0100 [mongosMain] connection accepted from 172.28.0.164:56053 #731 (418 connections now open) 2015-10-05T10:43:06.763+0100 [mongosMain] connection accepted from 172.28.0.164:56054 #732 (419 connections now open) 2015-10-05T10:43:06.763+0100 [mongosMain] connection accepted from 172.28.0.164:56056 #733 (420 connections now open) 2015-10-05T10:43:06.763+0100 [mongosMain] connection accepted from 172.28.0.164:56055 #734 (421 connections now open) 2015-10-05T10:43:06.763+0100 [mongosMain] connection accepted from 172.28.0.164:56057 #735 (422 connections now open) 2015-10-05T10:43:06.763+0100 [conn697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.764+0100 [mongosMain] connection accepted from 172.28.0.164:56058 #736 (423 connections now open) 2015-10-05T10:43:06.764+0100 [conn661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.764+0100 [mongosMain] connection accepted from 172.28.0.164:56059 #737 (424 connections now open) 2015-10-05T10:43:06.764+0100 [conn631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.764+0100 [mongosMain] connection accepted from 172.28.0.164:56061 #738 (425 connections now open) 2015-10-05T10:43:06.764+0100 [conn625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.764+0100 [mongosMain] connection accepted from 172.28.0.164:56060 #739 (426 connections now open) 2015-10-05T10:43:06.764+0100 [mongosMain] connection accepted from 172.28.0.164:56062 #740 (427 connections now open) 2015-10-05T10:43:06.765+0100 [conn700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.765+0100 [conn674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.765+0100 [conn701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.765+0100 [mongosMain] connection accepted from 172.28.0.164:56063 #741 (428 connections now open) 2015-10-05T10:43:06.765+0100 [conn698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.765+0100 [conn596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.765+0100 [mongosMain] connection accepted from 172.28.0.164:56064 #742 (429 connections now open) 2015-10-05T10:43:06.765+0100 [mongosMain] connection accepted from 172.28.0.164:56065 #743 (430 connections now open) 2015-10-05T10:43:06.765+0100 [mongosMain] connection accepted from 172.28.0.164:56067 #744 (431 connections now open) 2015-10-05T10:43:06.765+0100 [mongosMain] connection accepted from 172.28.0.164:56066 #745 (432 connections now open) 2015-10-05T10:43:06.766+0100 [mongosMain] connection accepted from 172.28.0.164:56068 #746 (433 connections now open) 2015-10-05T10:43:06.766+0100 [mongosMain] connection accepted from 172.28.0.164:56069 #747 (434 connections now open) 2015-10-05T10:43:06.766+0100 [mongosMain] connection accepted from 172.28.0.164:56070 #748 (435 connections now open) 2015-10-05T10:43:06.767+0100 [mongosMain] connection accepted from 172.28.0.164:56071 #749 (436 connections now open) 2015-10-05T10:43:06.767+0100 [mongosMain] connection accepted from 172.28.0.164:56072 #750 (437 connections now open) 2015-10-05T10:43:06.767+0100 [mongosMain] connection accepted from 172.28.0.164:56073 #751 (438 connections now open) 2015-10-05T10:43:06.768+0100 [conn702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.768+0100 [conn703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.768+0100 [conn696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.770+0100 [conn691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.771+0100 [conn692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.771+0100 [conn706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.771+0100 [conn709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.771+0100 [conn710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.774+0100 [conn601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.774+0100 [conn708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.776+0100 [conn707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.778+0100 [mongosMain] connection accepted from 172.28.0.164:56074 #752 (439 connections now open) 2015-10-05T10:43:06.778+0100 [mongosMain] connection accepted from 172.28.0.164:56075 #753 (440 connections now open) 2015-10-05T10:43:06.778+0100 [mongosMain] connection accepted from 172.28.0.164:56076 #754 (441 connections now open) 2015-10-05T10:43:06.784+0100 [mongosMain] connection accepted from 172.28.0.164:56077 #755 (442 connections now open) 2015-10-05T10:43:06.784+0100 [mongosMain] connection accepted from 172.28.0.164:56078 #756 (443 connections now open) 2015-10-05T10:43:06.791+0100 [mongosMain] connection accepted from 172.28.0.164:56079 #757 (444 connections now open) 2015-10-05T10:43:06.792+0100 [mongosMain] connection accepted from 172.28.0.164:56080 #758 (445 connections now open) 2015-10-05T10:43:06.792+0100 [mongosMain] connection accepted from 172.28.0.164:56083 #759 (446 connections now open) 2015-10-05T10:43:06.792+0100 [mongosMain] connection accepted from 172.28.0.164:56082 #760 (447 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56081 #761 (448 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56084 #762 (449 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56085 #763 (450 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56086 #764 (451 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56087 #765 (452 connections now open) 2015-10-05T10:43:06.793+0100 [mongosMain] connection accepted from 172.28.0.164:56088 #766 (453 connections now open) 2015-10-05T10:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.164:56090 #767 (454 connections now open) 2015-10-05T10:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.164:56089 #768 (455 connections now open) 2015-10-05T10:43:06.794+0100 [conn718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.164:56092 #769 (456 connections now open) 2015-10-05T10:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.164:56093 #770 (457 connections now open) 2015-10-05T10:43:06.794+0100 [mongosMain] connection accepted from 172.28.0.164:56094 #771 (458 connections now open) 2015-10-05T10:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.164:56095 #772 (459 connections now open) 2015-10-05T10:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.164:56097 #773 (460 connections now open) 2015-10-05T10:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.164:56096 #774 (461 connections now open) 2015-10-05T10:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.164:56098 #775 (462 connections now open) 2015-10-05T10:43:06.795+0100 [mongosMain] connection accepted from 172.28.0.164:56099 #776 (463 connections now open) 2015-10-05T10:43:06.796+0100 [mongosMain] connection accepted from 172.28.0.164:56100 #777 (464 connections now open) 2015-10-05T10:43:06.796+0100 [mongosMain] connection accepted from 172.28.0.164:56101 #778 (465 connections now open) 2015-10-05T10:43:06.796+0100 [mongosMain] connection accepted from 172.28.0.164:56091 #779 (466 connections now open) 2015-10-05T10:43:06.796+0100 [conn724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.800+0100 [mongosMain] connection accepted from 172.28.0.164:56102 #780 (467 connections now open) 2015-10-05T10:43:06.804+0100 [mongosMain] connection accepted from 172.28.0.164:56103 #781 (468 connections now open) 2015-10-05T10:43:06.808+0100 [mongosMain] connection accepted from 172.28.0.164:56105 #782 (469 connections now open) 2015-10-05T10:43:06.808+0100 [mongosMain] connection accepted from 172.28.0.164:56104 #783 (470 connections now open) 2015-10-05T10:43:06.809+0100 [mongosMain] connection accepted from 172.28.0.164:56106 #784 (471 connections now open) 2015-10-05T10:43:06.820+0100 [conn717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.837+0100 [conn714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.839+0100 [conn727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.849+0100 [conn705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.849+0100 [conn729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.850+0100 [conn720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.851+0100 [conn721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.851+0100 [conn728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.890+0100 [conn713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.892+0100 [conn712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.894+0100 [conn723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.897+0100 [conn733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.898+0100 [conn523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.898+0100 [conn748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.898+0100 [conn489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.899+0100 [conn742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.900+0100 [conn719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.901+0100 [conn749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.901+0100 [conn743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.901+0100 [conn731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.901+0100 [conn737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.911+0100 [conn735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.911+0100 [conn514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.911+0100 [conn726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.916+0100 [conn739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.916+0100 [conn716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.916+0100 [conn730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.917+0100 [conn738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.921+0100 [conn498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.922+0100 [conn744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.922+0100 [conn736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.922+0100 [conn752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.923+0100 [conn732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.932+0100 [conn750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.935+0100 [conn763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.937+0100 [conn745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.939+0100 [conn761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.940+0100 [conn495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.958+0100 [conn474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.958+0100 [conn756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.959+0100 [conn779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.959+0100 [conn774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.959+0100 [conn767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.960+0100 [conn780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.960+0100 [conn778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.960+0100 [conn508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.966+0100 [conn776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:06.967+0100 [conn781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.032+0100 [conn773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.035+0100 [conn755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.039+0100 [conn784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.040+0100 [conn766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.040+0100 [conn491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.043+0100 [conn783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.044+0100 [conn759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.049+0100 [conn782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:07.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612462bbc91fc8b3b376b9b 2015-10-05T10:43:07.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:43:12.343+0100 [mongosMain] connection accepted from 172.28.0.164:56115 #785 (472 connections now open) 2015-10-05T10:43:12.345+0100 [conn785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.387+0100 [mongosMain] connection accepted from 172.28.0.164:56116 #786 (473 connections now open) 2015-10-05T10:43:12.388+0100 [mongosMain] connection accepted from 172.28.0.164:56117 #787 (474 connections now open) 2015-10-05T10:43:12.388+0100 [mongosMain] connection accepted from 172.28.0.164:56118 #788 (475 connections now open) 2015-10-05T10:43:12.388+0100 [mongosMain] connection accepted from 172.28.0.164:56119 #789 (476 connections now open) 2015-10-05T10:43:12.389+0100 [mongosMain] connection accepted from 172.28.0.164:56120 #790 (477 connections now open) 2015-10-05T10:43:12.389+0100 [conn786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.390+0100 [mongosMain] connection accepted from 172.28.0.164:56121 #791 (478 connections now open) 2015-10-05T10:43:12.390+0100 [conn788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.390+0100 [conn789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.391+0100 [mongosMain] connection accepted from 172.28.0.164:56122 #792 (479 connections now open) 2015-10-05T10:43:12.391+0100 [mongosMain] connection accepted from 172.28.0.164:56123 #793 (480 connections now open) 2015-10-05T10:43:12.391+0100 [conn791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.391+0100 [mongosMain] connection accepted from 172.28.0.164:56124 #794 (481 connections now open) 2015-10-05T10:43:12.392+0100 [mongosMain] connection accepted from 172.28.0.164:56125 #795 (482 connections now open) 2015-10-05T10:43:12.392+0100 [mongosMain] connection accepted from 172.28.0.164:56126 #796 (483 connections now open) 2015-10-05T10:43:12.392+0100 [mongosMain] connection accepted from 172.28.0.164:56127 #797 (484 connections now open) 2015-10-05T10:43:12.393+0100 [mongosMain] connection accepted from 172.28.0.164:56128 #798 (485 connections now open) 2015-10-05T10:43:12.393+0100 [mongosMain] connection accepted from 172.28.0.164:56129 #799 (486 connections now open) 2015-10-05T10:43:12.393+0100 [conn795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.393+0100 [mongosMain] connection accepted from 172.28.0.164:56130 #800 (487 connections now open) 2015-10-05T10:43:12.393+0100 [conn793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.394+0100 [conn794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.394+0100 [conn797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.395+0100 [conn799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.395+0100 [conn800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.473+0100 [mongosMain] connection accepted from 172.28.0.164:56131 #801 (488 connections now open) 2015-10-05T10:43:12.473+0100 [mongosMain] connection accepted from 172.28.0.164:56132 #802 (489 connections now open) 2015-10-05T10:43:12.474+0100 [mongosMain] connection accepted from 172.28.0.164:56134 #803 (490 connections now open) 2015-10-05T10:43:12.474+0100 [mongosMain] connection accepted from 172.28.0.164:56135 #804 (491 connections now open) 2015-10-05T10:43:12.474+0100 [mongosMain] connection accepted from 172.28.0.164:56136 #805 (492 connections now open) 2015-10-05T10:43:12.474+0100 [mongosMain] connection accepted from 172.28.0.164:56137 #806 (493 connections now open) 2015-10-05T10:43:12.475+0100 [mongosMain] connection accepted from 172.28.0.164:56138 #807 (494 connections now open) 2015-10-05T10:43:12.475+0100 [conn801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.475+0100 [conn802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.475+0100 [mongosMain] connection accepted from 172.28.0.164:56139 #808 (495 connections now open) 2015-10-05T10:43:12.475+0100 [conn803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.476+0100 [mongosMain] connection accepted from 172.28.0.164:56140 #809 (496 connections now open) 2015-10-05T10:43:12.476+0100 [conn805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.476+0100 [conn804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.476+0100 [conn806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.477+0100 [conn807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.477+0100 [conn808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.478+0100 [conn809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.514+0100 [mongosMain] connection accepted from 172.28.0.164:56141 #810 (497 connections now open) 2015-10-05T10:43:12.514+0100 [mongosMain] connection accepted from 172.28.0.164:56144 #811 (498 connections now open) 2015-10-05T10:43:12.514+0100 [mongosMain] connection accepted from 172.28.0.164:56143 #812 (499 connections now open) 2015-10-05T10:43:12.515+0100 [mongosMain] connection accepted from 172.28.0.164:56145 #813 (500 connections now open) 2015-10-05T10:43:12.516+0100 [conn810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.516+0100 [conn811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.517+0100 [conn812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.517+0100 [conn813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.578+0100 [mongosMain] connection accepted from 172.28.0.164:56146 #814 (501 connections now open) 2015-10-05T10:43:12.578+0100 [mongosMain] connection accepted from 172.28.0.164:56147 #815 (502 connections now open) 2015-10-05T10:43:12.580+0100 [conn814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:12.580+0100 [conn815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.102+0100 [mongosMain] connection accepted from 172.28.0.164:56148 #816 (503 connections now open) 2015-10-05T10:43:13.103+0100 [mongosMain] connection accepted from 172.28.0.164:56149 #817 (504 connections now open) 2015-10-05T10:43:13.103+0100 [mongosMain] connection accepted from 172.28.0.164:56150 #818 (505 connections now open) 2015-10-05T10:43:13.104+0100 [mongosMain] connection accepted from 172.28.0.164:56151 #819 (506 connections now open) 2015-10-05T10:43:13.105+0100 [conn816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.106+0100 [conn817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.106+0100 [conn819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.108+0100 [mongosMain] connection accepted from 172.28.0.164:56152 #820 (507 connections now open) 2015-10-05T10:43:13.109+0100 [mongosMain] connection accepted from 172.28.0.164:56153 #821 (508 connections now open) 2015-10-05T10:43:13.109+0100 [mongosMain] connection accepted from 172.28.0.164:56154 #822 (509 connections now open) 2015-10-05T10:43:13.110+0100 [mongosMain] connection accepted from 172.28.0.164:56155 #823 (510 connections now open) 2015-10-05T10:43:13.111+0100 [mongosMain] connection accepted from 172.28.0.164:56156 #824 (511 connections now open) 2015-10-05T10:43:13.111+0100 [mongosMain] connection accepted from 172.28.0.164:56158 #825 (512 connections now open) 2015-10-05T10:43:13.111+0100 [mongosMain] connection accepted from 172.28.0.164:56157 #826 (513 connections now open) 2015-10-05T10:43:13.112+0100 [mongosMain] connection accepted from 172.28.0.164:56159 #827 (514 connections now open) 2015-10-05T10:43:13.113+0100 [conn822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.113+0100 [conn821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.113+0100 [conn824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.113+0100 [conn823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.114+0100 [conn825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.114+0100 [conn827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.116+0100 [mongosMain] connection accepted from 172.28.0.164:56160 #828 (515 connections now open) 2015-10-05T10:43:13.118+0100 [conn828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.141+0100 [mongosMain] connection accepted from 172.28.0.164:56161 #829 (516 connections now open) 2015-10-05T10:43:13.141+0100 [mongosMain] connection accepted from 172.28.0.164:56162 #830 (517 connections now open) 2015-10-05T10:43:13.142+0100 [mongosMain] connection accepted from 172.28.0.164:56163 #831 (518 connections now open) 2015-10-05T10:43:13.142+0100 [mongosMain] connection accepted from 172.28.0.164:56164 #832 (519 connections now open) 2015-10-05T10:43:13.143+0100 [conn829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.144+0100 [conn831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.144+0100 [conn830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.145+0100 [conn832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.145+0100 [mongosMain] connection accepted from 172.28.0.164:56165 #833 (520 connections now open) 2015-10-05T10:43:13.146+0100 [mongosMain] connection accepted from 172.28.0.164:56166 #834 (521 connections now open) 2015-10-05T10:43:13.146+0100 [conn787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.146+0100 [mongosMain] connection accepted from 172.28.0.164:56167 #835 (522 connections now open) 2015-10-05T10:43:13.146+0100 [mongosMain] connection accepted from 172.28.0.164:56169 #836 (523 connections now open) 2015-10-05T10:43:13.146+0100 [conn790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.146+0100 [mongosMain] connection accepted from 172.28.0.164:56168 #837 (524 connections now open) 2015-10-05T10:43:13.147+0100 [mongosMain] connection accepted from 172.28.0.164:56170 #838 (525 connections now open) 2015-10-05T10:43:13.147+0100 [conn796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.147+0100 [conn798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.148+0100 [conn792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.148+0100 [conn834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.148+0100 [conn836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.149+0100 [conn838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.149+0100 [conn837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.181+0100 [mongosMain] connection accepted from 172.28.0.164:56171 #839 (526 connections now open) 2015-10-05T10:43:13.181+0100 [mongosMain] connection accepted from 172.28.0.164:56172 #840 (527 connections now open) 2015-10-05T10:43:13.182+0100 [mongosMain] connection accepted from 172.28.0.164:56173 #841 (528 connections now open) 2015-10-05T10:43:13.182+0100 [mongosMain] connection accepted from 172.28.0.164:56174 #842 (529 connections now open) 2015-10-05T10:43:13.182+0100 [mongosMain] connection accepted from 172.28.0.164:56175 #843 (530 connections now open) 2015-10-05T10:43:13.183+0100 [conn839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.183+0100 [conn840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.184+0100 [conn841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.184+0100 [conn842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.184+0100 [conn843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.197+0100 [mongosMain] connection accepted from 172.28.0.164:56176 #844 (531 connections now open) 2015-10-05T10:43:13.198+0100 [mongosMain] connection accepted from 172.28.0.164:56177 #845 (532 connections now open) 2015-10-05T10:43:13.199+0100 [conn844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.200+0100 [conn845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.311+0100 [mongosMain] connection accepted from 172.28.0.164:56178 #846 (533 connections now open) 2015-10-05T10:43:13.312+0100 [mongosMain] connection accepted from 172.28.0.164:56179 #847 (534 connections now open) 2015-10-05T10:43:13.314+0100 [conn846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.320+0100 [mongosMain] connection accepted from 172.28.0.164:56180 #848 (535 connections now open) 2015-10-05T10:43:13.320+0100 [mongosMain] connection accepted from 172.28.0.164:56181 #849 (536 connections now open) 2015-10-05T10:43:13.322+0100 [conn849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.323+0100 [mongosMain] connection accepted from 172.28.0.164:56182 #850 (537 connections now open) 2015-10-05T10:43:13.470+0100 [conn820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.470+0100 [conn818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.474+0100 [conn826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.558+0100 [conn833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.560+0100 [conn835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.856+0100 [conn847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.856+0100 [conn850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.856+0100 [conn848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:13.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124631bc91fc8b3b376cb0 2015-10-05T10:43:13.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:43:14.132+0100 [mongosMain] connection accepted from 172.28.0.164:56183 #851 (538 connections now open) 2015-10-05T10:43:14.136+0100 [conn851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:26.577+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612463dbc91fc8b3b376d97 2015-10-05T10:43:26.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:43:28.482+0100 [mongosMain] connection accepted from 127.0.0.1:50119 #852 (539 connections now open) 2015-10-05T10:43:28.484+0100 [conn852] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:28.489+0100 [conn852] end connection 127.0.0.1:50119 (538 connections now open) 2015-10-05T10:43:35.303+0100 [mongosMain] connection accepted from 172.28.0.164:56213 #853 (539 connections now open) 2015-10-05T10:43:35.306+0100 [conn853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:35.831+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:43:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:43:38.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612464abc91fc8b3b376db3 2015-10-05T10:43:38.939+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:43:39.826+0100 [mongosMain] connection accepted from 127.0.0.1:50120 #854 (540 connections now open) 2015-10-05T10:43:39.828+0100 [conn854] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:43:39.833+0100 [conn854] end connection 127.0.0.1:50120 (539 connections now open) 2015-10-05T10:43:45.069+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:43:45.069+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:43:51.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124657bc91fc8b3b376dcd 2015-10-05T10:43:51.284+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:43:57.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612465dbc91fc8b3b376de5 2015-10-05T10:43:57.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:06.079+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:44:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:44:09.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124669bc91fc8b3b376dff 2015-10-05T10:44:09.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:16.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612466fbc91fc8b3b376e0b 2015-10-05T10:44:16.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:22.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124676bc91fc8b3b376e23 2015-10-05T10:44:22.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:28.245+0100 [mongosMain] connection accepted from 127.0.0.1:50229 #855 (540 connections now open) 2015-10-05T10:44:28.248+0100 [conn855] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:44:28.253+0100 [conn855] end connection 127.0.0.1:50229 (539 connections now open) 2015-10-05T10:44:28.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612467cbc91fc8b3b376e36 2015-10-05T10:44:28.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:35.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124682bc91fc8b3b376e41 2015-10-05T10:44:35.320+0100 [mongosMain] connection accepted from 172.28.0.164:56261 #856 (540 connections now open) 2015-10-05T10:44:35.323+0100 [conn856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:44:35.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:36.365+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:44:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:44:39.242+0100 [mongosMain] connection accepted from 127.0.0.1:50296 #857 (541 connections now open) 2015-10-05T10:44:39.245+0100 [conn857] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:44:39.248+0100 [conn857] end connection 127.0.0.1:50296 (540 connections now open) 2015-10-05T10:44:41.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124689bc91fc8b3b376e50 2015-10-05T10:44:41.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:47.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612468fbc91fc8b3b376e5a 2015-10-05T10:44:48.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:44:54.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124696bc91fc8b3b376e5f 2015-10-05T10:44:54.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:00.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612469cbc91fc8b3b376e81 2015-10-05T10:45:00.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:06.491+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:45:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:45:06.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246a2bc91fc8b3b376eab 2015-10-05T10:45:07.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:08.440+0100 [mongosMain] connection accepted from 172.28.0.164:56287 #858 (541 connections now open) 2015-10-05T10:45:08.441+0100 [mongosMain] connection accepted from 172.28.0.164:56289 #859 (542 connections now open) 2015-10-05T10:45:08.443+0100 [conn858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:45:08.444+0100 [conn859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:45:13.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246a9bc91fc8b3b376ecf 2015-10-05T10:45:13.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:25.760+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246b5bc91fc8b3b376eee 2015-10-05T10:45:25.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:28.179+0100 [mongosMain] connection accepted from 127.0.0.1:50359 #860 (543 connections now open) 2015-10-05T10:45:28.181+0100 [conn860] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:45:28.187+0100 [conn860] end connection 127.0.0.1:50359 (542 connections now open) 2015-10-05T10:45:32.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246bbbc91fc8b3b376ef2 2015-10-05T10:45:32.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:45:35.336+0100 [mongosMain] connection accepted from 172.28.0.164:56313 #861 (543 connections now open) 2015-10-05T10:45:35.339+0100 [conn861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:45:36.620+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:45:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:45:39.691+0100 [mongosMain] connection accepted from 127.0.0.1:50361 #862 (544 connections now open) 2015-10-05T10:45:39.694+0100 [conn862] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:45:39.698+0100 [conn862] end connection 127.0.0.1:50361 (543 connections now open) 2015-10-05T10:45:44.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246c8bc91fc8b3b376f11 2015-10-05T10:45:44.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:46:02.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246dabc91fc8b3b376f2e 2015-10-05T10:46:03.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:46:06.914+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:46:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:46:21.294+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561246ebd5de43e0ed5d3b64') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444038033:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444038033:41", when: new Date(1444038381100), why: "doing balance round", ts: ObjectId('561246edbc91fc8b3b376f58') } } gle1: { lastOp: Timestamp 1444038381000|3, connectionId: 36339, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } gle2: { lastOp: Timestamp 1444038362000|8, connectionId: 34801, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2015-10-05T10:46:21.298+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1444038033:41' 2015-10-05T10:46:21.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246edbc91fc8b3b376f58 2015-10-05T10:46:21.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:46:25.446+0100 [mongosMain] connection accepted from 172.28.0.164:56349 #863 (544 connections now open) 2015-10-05T10:46:25.446+0100 [mongosMain] connection accepted from 172.28.0.164:56350 #864 (545 connections now open) 2015-10-05T10:46:25.447+0100 [mongosMain] connection accepted from 172.28.0.164:56352 #865 (546 connections now open) 2015-10-05T10:46:25.448+0100 [mongosMain] connection accepted from 172.28.0.164:56353 #866 (547 connections now open) 2015-10-05T10:46:25.448+0100 [conn863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.448+0100 [mongosMain] connection accepted from 172.28.0.164:56354 #867 (548 connections now open) 2015-10-05T10:46:25.449+0100 [mongosMain] connection accepted from 172.28.0.164:56355 #868 (549 connections now open) 2015-10-05T10:46:25.450+0100 [conn865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.450+0100 [conn864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.450+0100 [mongosMain] connection accepted from 172.28.0.164:56356 #869 (550 connections now open) 2015-10-05T10:46:25.450+0100 [conn866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.451+0100 [conn867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.451+0100 [mongosMain] connection accepted from 172.28.0.164:56357 #870 (551 connections now open) 2015-10-05T10:46:25.452+0100 [conn868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.453+0100 [conn869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.454+0100 [conn870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.458+0100 [mongosMain] connection accepted from 172.28.0.164:56358 #871 (552 connections now open) 2015-10-05T10:46:25.459+0100 [mongosMain] connection accepted from 172.28.0.164:56359 #872 (553 connections now open) 2015-10-05T10:46:25.461+0100 [conn871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:25.461+0100 [conn872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:28.624+0100 [mongosMain] connection accepted from 127.0.0.1:50491 #873 (554 connections now open) 2015-10-05T10:46:28.627+0100 [conn873] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:28.632+0100 [conn873] end connection 127.0.0.1:50491 (553 connections now open) 2015-10-05T10:46:33.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561246f9bc91fc8b3b376f7b 2015-10-05T10:46:34.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:46:35.351+0100 [mongosMain] connection accepted from 172.28.0.164:56369 #874 (554 connections now open) 2015-10-05T10:46:35.355+0100 [conn874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:37.170+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:46:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:46:39.421+0100 [mongosMain] connection accepted from 127.0.0.1:50493 #875 (555 connections now open) 2015-10-05T10:46:39.424+0100 [conn875] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:39.428+0100 [conn875] end connection 127.0.0.1:50493 (554 connections now open) 2015-10-05T10:46:41.952+0100 [mongosMain] connection accepted from 172.28.0.164:56378 #876 (555 connections now open) 2015-10-05T10:46:41.953+0100 [mongosMain] connection accepted from 172.28.0.164:56379 #877 (556 connections now open) 2015-10-05T10:46:41.955+0100 [conn876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:41.956+0100 [conn877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:46:46.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124706bc91fc8b3b376f9f 2015-10-05T10:46:46.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:47:05.447+0100 [mongosMain] connection accepted from 172.28.0.164:56393 #878 (557 connections now open) 2015-10-05T10:47:05.458+0100 [conn878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:07.437+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:47:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:47:07.458+0100 [mongosMain] connection accepted from 172.28.0.164:56394 #879 (558 connections now open) 2015-10-05T10:47:07.461+0100 [conn879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:08.457+0100 [mongosMain] connection accepted from 172.28.0.164:56395 #880 (559 connections now open) 2015-10-05T10:47:08.458+0100 [mongosMain] connection accepted from 172.28.0.164:56396 #881 (560 connections now open) 2015-10-05T10:47:08.459+0100 [mongosMain] connection accepted from 172.28.0.164:56397 #882 (561 connections now open) 2015-10-05T10:47:08.459+0100 [mongosMain] connection accepted from 172.28.0.164:56398 #883 (562 connections now open) 2015-10-05T10:47:08.460+0100 [conn880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:08.461+0100 [conn881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:08.461+0100 [conn882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:10.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612471ebc91fc8b3b376fe7 2015-10-05T10:47:10.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:47:22.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612472abc91fc8b3b376ff7 2015-10-05T10:47:22.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:47:27.958+0100 [mongosMain] connection accepted from 172.28.0.164:56414 #884 (563 connections now open) 2015-10-05T10:47:27.960+0100 [conn884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:28.780+0100 [mongosMain] connection accepted from 127.0.0.1:50531 #885 (564 connections now open) 2015-10-05T10:47:28.783+0100 [conn885] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:28.789+0100 [conn885] end connection 127.0.0.1:50531 (563 connections now open) 2015-10-05T10:47:35.368+0100 [mongosMain] connection accepted from 172.28.0.164:56422 #886 (564 connections now open) 2015-10-05T10:47:35.371+0100 [conn886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:37.707+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:47:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:47:39.898+0100 [mongosMain] connection accepted from 127.0.0.1:50532 #887 (565 connections now open) 2015-10-05T10:47:39.901+0100 [conn887] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:47:39.905+0100 [conn887] end connection 127.0.0.1:50532 (564 connections now open) 2015-10-05T10:47:40.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612473cbc91fc8b3b377011 2015-10-05T10:47:41.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:47:47.167+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:47:47.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:47:53.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124749bc91fc8b3b37702c 2015-10-05T10:47:53.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:47:59.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612474fbc91fc8b3b377037 2015-10-05T10:47:59.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:48:05.890+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:48:05.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:48:08.013+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:48:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:48:12.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612475bbc91fc8b3b377052 2015-10-05T10:48:12.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:48:24.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124768bc91fc8b3b377077 2015-10-05T10:48:24.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:48:29.139+0100 [mongosMain] connection accepted from 127.0.0.1:50696 #888 (565 connections now open) 2015-10-05T10:48:29.142+0100 [conn888] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:48:29.147+0100 [conn888] end connection 127.0.0.1:50696 (564 connections now open) 2015-10-05T10:48:35.384+0100 [mongosMain] connection accepted from 172.28.0.164:56467 #889 (565 connections now open) 2015-10-05T10:48:35.387+0100 [conn889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:48:38.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124774bc91fc8b3b3770a9 2015-10-05T10:48:38.812+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:48:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:48:38.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:48:39.751+0100 [mongosMain] connection accepted from 127.0.0.1:50712 #890 (566 connections now open) 2015-10-05T10:48:39.753+0100 [conn890] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:48:39.761+0100 [conn890] end connection 127.0.0.1:50712 (565 connections now open) 2015-10-05T10:48:57.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124788bc91fc8b3b3770cd 2015-10-05T10:48:57.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:03.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612478fbc91fc8b3b3770dd 2015-10-05T10:49:03.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:08.992+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:49:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:49:09.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124795bc91fc8b3b3770f6 2015-10-05T10:49:10.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:16.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612479cbc91fc8b3b3770fd 2015-10-05T10:49:16.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:22.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247a2bc91fc8b3b377115 2015-10-05T10:49:22.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:28.259+0100 [mongosMain] connection accepted from 127.0.0.1:50754 #891 (566 connections now open) 2015-10-05T10:49:28.261+0100 [conn891] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:49:28.267+0100 [conn891] end connection 127.0.0.1:50754 (565 connections now open) 2015-10-05T10:49:28.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247a8bc91fc8b3b377127 2015-10-05T10:49:28.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:35.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247aebc91fc8b3b377135 2015-10-05T10:49:35.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:35.400+0100 [mongosMain] connection accepted from 172.28.0.164:56519 #892 (566 connections now open) 2015-10-05T10:49:35.403+0100 [conn892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:49:39.115+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:49:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:49:39.638+0100 [mongosMain] connection accepted from 127.0.0.1:50756 #893 (567 connections now open) 2015-10-05T10:49:39.641+0100 [conn893] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:49:39.645+0100 [conn893] end connection 127.0.0.1:50756 (566 connections now open) 2015-10-05T10:49:41.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247b5bc91fc8b3b37713b 2015-10-05T10:49:41.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:47.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247bbbc91fc8b3b37713e 2015-10-05T10:49:47.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:49:54.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247c1bc91fc8b3b377145 2015-10-05T10:49:54.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:00.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247c8bc91fc8b3b377149 2015-10-05T10:50:00.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:06.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247cebc91fc8b3b377161 2015-10-05T10:50:07.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:09.282+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:50:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:50:13.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247d5bc91fc8b3b37716e 2015-10-05T10:50:13.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:19.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247dbbc91fc8b3b377176 2015-10-05T10:50:19.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:26.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247e1bc91fc8b3b377183 2015-10-05T10:50:26.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:28.555+0100 [mongosMain] connection accepted from 127.0.0.1:50794 #894 (567 connections now open) 2015-10-05T10:50:28.558+0100 [conn894] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:50:28.564+0100 [conn894] end connection 127.0.0.1:50794 (566 connections now open) 2015-10-05T10:50:32.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247e8bc91fc8b3b37718f 2015-10-05T10:50:32.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:35.416+0100 [mongosMain] connection accepted from 172.28.0.164:56571 #895 (567 connections now open) 2015-10-05T10:50:35.419+0100 [conn895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:50:38.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247eebc91fc8b3b377198 2015-10-05T10:50:38.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:39.559+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:50:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:50:40.143+0100 [mongosMain] connection accepted from 127.0.0.1:50925 #896 (568 connections now open) 2015-10-05T10:50:40.145+0100 [conn896] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:50:40.148+0100 [conn896] end connection 127.0.0.1:50925 (567 connections now open) 2015-10-05T10:50:45.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247f4bc91fc8b3b3771a2 2015-10-05T10:50:45.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:45.661+0100 [conn457] end connection 172.28.0.163:50058 (566 connections now open) 2015-10-05T10:50:45.661+0100 [conn456] end connection 172.28.0.163:50056 (565 connections now open) 2015-10-05T10:50:45.662+0100 [conn453] end connection 172.28.0.163:50053 (564 connections now open) 2015-10-05T10:50:45.663+0100 [conn445] end connection 172.28.0.163:50041 (563 connections now open) 2015-10-05T10:50:45.663+0100 [conn715] end connection 172.28.0.163:50089 (562 connections now open) 2015-10-05T10:50:45.663+0100 [conn464] end connection 172.28.0.163:50068 (561 connections now open) 2015-10-05T10:50:45.664+0100 [conn452] end connection 172.28.0.163:50052 (560 connections now open) 2015-10-05T10:50:45.664+0100 [conn424] end connection 172.28.0.163:49941 (559 connections now open) 2015-10-05T10:50:45.666+0100 [conn444] end connection 172.28.0.163:50039 (558 connections now open) 2015-10-05T10:50:45.667+0100 [conn425] end connection 172.28.0.163:49951 (557 connections now open) 2015-10-05T10:50:45.667+0100 [conn458] end connection 172.28.0.163:50059 (556 connections now open) 2015-10-05T10:50:45.668+0100 [conn428] end connection 172.28.0.163:50012 (555 connections now open) 2015-10-05T10:50:45.668+0100 [conn446] end connection 172.28.0.163:50042 (554 connections now open) 2015-10-05T10:50:45.668+0100 [conn463] end connection 172.28.0.163:50066 (553 connections now open) 2015-10-05T10:50:45.668+0100 [conn443] end connection 172.28.0.163:50037 (552 connections now open) 2015-10-05T10:50:45.668+0100 [conn429] end connection 172.28.0.163:50013 (552 connections now open) 2015-10-05T10:50:45.669+0100 [conn442] end connection 172.28.0.163:50035 (550 connections now open) 2015-10-05T10:50:45.669+0100 [conn465] end connection 172.28.0.163:50069 (549 connections now open) 2015-10-05T10:50:45.669+0100 [conn468] end connection 172.28.0.163:50075 (549 connections now open) 2015-10-05T10:50:45.670+0100 [conn459] end connection 172.28.0.163:50060 (547 connections now open) 2015-10-05T10:50:45.671+0100 [conn448] end connection 172.28.0.163:50046 (546 connections now open) 2015-10-05T10:50:45.671+0100 [conn469] end connection 172.28.0.163:50078 (545 connections now open) 2015-10-05T10:50:45.671+0100 [conn371] end connection 172.28.0.163:49813 (544 connections now open) 2015-10-05T10:50:45.672+0100 [conn722] end connection 172.28.0.163:50090 (543 connections now open) 2015-10-05T10:50:45.672+0100 [conn433] end connection 172.28.0.163:50017 (542 connections now open) 2015-10-05T10:50:45.672+0100 [conn370] end connection 172.28.0.163:49812 (541 connections now open) 2015-10-05T10:50:45.672+0100 [conn426] end connection 172.28.0.163:50010 (541 connections now open) 2015-10-05T10:50:45.672+0100 [conn461] end connection 172.28.0.163:50063 (540 connections now open) 2015-10-05T10:50:45.672+0100 [conn455] end connection 172.28.0.163:50055 (538 connections now open) 2015-10-05T10:50:45.672+0100 [conn711] end connection 172.28.0.163:50085 (537 connections now open) 2015-10-05T10:50:45.672+0100 [conn454] end connection 172.28.0.163:50054 (537 connections now open) 2015-10-05T10:50:45.673+0100 [conn432] end connection 172.28.0.163:50016 (535 connections now open) 2015-10-05T10:50:45.673+0100 [conn437] end connection 172.28.0.163:50026 (534 connections now open) 2015-10-05T10:50:45.673+0100 [conn439] end connection 172.28.0.163:50030 (533 connections now open) 2015-10-05T10:50:45.674+0100 [conn438] end connection 172.28.0.163:50028 (532 connections now open) 2015-10-05T10:50:45.674+0100 [conn440] end connection 172.28.0.163:50033 (532 connections now open) 2015-10-05T10:50:45.674+0100 [conn462] end connection 172.28.0.163:50064 (530 connections now open) 2015-10-05T10:50:45.675+0100 [conn467] end connection 172.28.0.163:50074 (529 connections now open) 2015-10-05T10:50:47.188+0100 [conn449] end connection 172.28.0.163:50048 (528 connections now open) 2015-10-05T10:50:47.188+0100 [conn436] end connection 172.28.0.163:50024 (527 connections now open) 2015-10-05T10:50:47.190+0100 [conn460] end connection 172.28.0.163:50061 (526 connections now open) 2015-10-05T10:50:47.191+0100 [conn447] end connection 172.28.0.163:50045 (525 connections now open) 2015-10-05T10:50:47.197+0100 [conn430] end connection 172.28.0.163:50014 (524 connections now open) 2015-10-05T10:50:47.197+0100 [conn431] end connection 172.28.0.163:50015 (523 connections now open) 2015-10-05T10:50:47.197+0100 [conn441] end connection 172.28.0.163:50034 (522 connections now open) 2015-10-05T10:50:47.198+0100 [conn450] end connection 172.28.0.163:50049 (521 connections now open) 2015-10-05T10:50:47.199+0100 [conn427] end connection 172.28.0.163:50011 (520 connections now open) 2015-10-05T10:50:47.200+0100 [conn451] end connection 172.28.0.163:50050 (519 connections now open) 2015-10-05T10:50:47.201+0100 [conn466] end connection 172.28.0.163:50073 (518 connections now open) 2015-10-05T10:50:47.202+0100 [conn435] end connection 172.28.0.163:50022 (517 connections now open) 2015-10-05T10:50:47.204+0100 [conn434] end connection 172.28.0.163:50018 (516 connections now open) 2015-10-05T10:50:51.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561247fbbc91fc8b3b3771b0 2015-10-05T10:50:51.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:50:57.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124801bc91fc8b3b3771c5 2015-10-05T10:50:57.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:03.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124807bc91fc8b3b3771e8 2015-10-05T10:51:03.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:09.848+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:51:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:51:10.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612480ebc91fc8b3b37720a 2015-10-05T10:51:10.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:16.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124814bc91fc8b3b37721d 2015-10-05T10:51:16.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:23.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612481abc91fc8b3b37722f 2015-10-05T10:51:23.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:28.295+0100 [mongosMain] connection accepted from 127.0.0.1:50968 #897 (517 connections now open) 2015-10-05T10:51:28.299+0100 [conn897] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:51:28.306+0100 [conn897] end connection 127.0.0.1:50968 (516 connections now open) 2015-10-05T10:51:29.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124821bc91fc8b3b37723b 2015-10-05T10:51:29.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:35.433+0100 [mongosMain] connection accepted from 172.28.0.164:56621 #898 (517 connections now open) 2015-10-05T10:51:35.436+0100 [conn898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:51:35.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124827bc91fc8b3b377247 2015-10-05T10:51:35.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:39.774+0100 [mongosMain] connection accepted from 127.0.0.1:50969 #899 (518 connections now open) 2015-10-05T10:51:39.777+0100 [conn899] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:51:39.781+0100 [conn899] end connection 127.0.0.1:50969 (517 connections now open) 2015-10-05T10:51:40.112+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:51:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:51:42.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612482dbc91fc8b3b377259 2015-10-05T10:51:42.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:48.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124834bc91fc8b3b377271 2015-10-05T10:51:48.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:51:54.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612483abc91fc8b3b377277 2015-10-05T10:51:55.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:01.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124841bc91fc8b3b37728b 2015-10-05T10:52:01.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:07.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124847bc91fc8b3b377291 2015-10-05T10:52:07.490+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:08.717+0100 [mongosMain] connection accepted from 172.28.0.163:51013 #900 (518 connections now open) 2015-10-05T10:52:08.717+0100 [mongosMain] connection accepted from 172.28.0.163:51014 #901 (519 connections now open) 2015-10-05T10:52:10.393+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:52:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:52:13.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612484dbc91fc8b3b3772a7 2015-10-05T10:52:13.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:20.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124853bc91fc8b3b3772bc 2015-10-05T10:52:20.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:26.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612485abc91fc8b3b3772cf 2015-10-05T10:52:26.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:28.293+0100 [mongosMain] connection accepted from 127.0.0.1:51045 #902 (520 connections now open) 2015-10-05T10:52:28.295+0100 [conn902] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:52:28.300+0100 [conn902] end connection 127.0.0.1:51045 (519 connections now open) 2015-10-05T10:52:28.858+0100 [conn375] end connection 172.28.0.163:49824 (518 connections now open) 2015-10-05T10:52:33.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124860bc91fc8b3b3772e5 2015-10-05T10:52:33.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:35.449+0100 [mongosMain] connection accepted from 172.28.0.164:56676 #903 (519 connections now open) 2015-10-05T10:52:35.452+0100 [conn903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:52:39.437+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124867bc91fc8b3b3772f6 2015-10-05T10:52:39.500+0100 [mongosMain] connection accepted from 127.0.0.1:51049 #904 (520 connections now open) 2015-10-05T10:52:39.502+0100 [conn904] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:52:39.506+0100 [conn904] end connection 127.0.0.1:51049 (519 connections now open) 2015-10-05T10:52:39.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:40.668+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:52:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:52:51.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124873bc91fc8b3b377309 2015-10-05T10:52:51.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:52:57.929+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:52:57.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:53:04.144+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612487fbc91fc8b3b377327 2015-10-05T10:53:04.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:10.393+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:53:10.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:53:10.941+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:53:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:53:16.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612488cbc91fc8b3b377358 2015-10-05T10:53:16.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:28.601+0100 [mongosMain] connection accepted from 127.0.0.1:51094 #905 (520 connections now open) 2015-10-05T10:53:28.604+0100 [conn905] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:28.609+0100 [conn905] end connection 127.0.0.1:51094 (519 connections now open) 2015-10-05T10:53:28.871+0100 [conn381] end connection 172.28.0.163:49832 (518 connections now open) 2015-10-05T10:53:28.872+0100 [mongosMain] connection accepted from 172.28.0.163:51095 #906 (519 connections now open) 2015-10-05T10:53:28.874+0100 [conn906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:28.876+0100 [mongosMain] connection accepted from 172.28.0.163:51096 #907 (520 connections now open) 2015-10-05T10:53:28.877+0100 [conn907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:28.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124898bc91fc8b3b377377 2015-10-05T10:53:29.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:35.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612489fbc91fc8b3b37737f 2015-10-05T10:53:35.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:35.464+0100 [mongosMain] connection accepted from 172.28.0.164:56718 #908 (521 connections now open) 2015-10-05T10:53:35.467+0100 [conn908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:39.190+0100 [mongosMain] connection accepted from 127.0.0.1:51100 #909 (522 connections now open) 2015-10-05T10:53:39.193+0100 [conn909] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:39.197+0100 [conn909] end connection 127.0.0.1:51100 (521 connections now open) 2015-10-05T10:53:41.213+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:53:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:53:47.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248abbc91fc8b3b377397 2015-10-05T10:53:47.873+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:54.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248b1bc91fc8b3b37739e 2015-10-05T10:53:54.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:53:56.479+0100 [mongosMain] connection accepted from 172.28.0.164:56743 #910 (522 connections now open) 2015-10-05T10:53:56.480+0100 [mongosMain] connection accepted from 172.28.0.164:56744 #911 (523 connections now open) 2015-10-05T10:53:56.482+0100 [conn910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:56.482+0100 [conn911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:56.524+0100 [mongosMain] connection accepted from 172.28.0.164:56745 #912 (524 connections now open) 2015-10-05T10:53:56.525+0100 [mongosMain] connection accepted from 172.28.0.164:56746 #913 (525 connections now open) 2015-10-05T10:53:56.527+0100 [conn912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:56.527+0100 [conn913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:57.477+0100 [mongosMain] connection accepted from 172.28.0.164:56748 #914 (526 connections now open) 2015-10-05T10:53:57.478+0100 [mongosMain] connection accepted from 172.28.0.164:56749 #915 (527 connections now open) 2015-10-05T10:53:57.480+0100 [conn914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:53:57.480+0100 [conn915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:11.490+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:54:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:54:12.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248c4bc91fc8b3b3773c7 2015-10-05T10:54:12.549+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:54:24.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248d0bc91fc8b3b3773ea 2015-10-05T10:54:24.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:54:28.405+0100 [mongosMain] connection accepted from 127.0.0.1:51143 #916 (528 connections now open) 2015-10-05T10:54:28.408+0100 [conn916] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:28.414+0100 [conn916] end connection 127.0.0.1:51143 (527 connections now open) 2015-10-05T10:54:28.887+0100 [conn374] end connection 172.28.0.163:49822 (526 connections now open) 2015-10-05T10:54:28.888+0100 [mongosMain] connection accepted from 172.28.0.163:51144 #917 (527 connections now open) 2015-10-05T10:54:28.890+0100 [conn917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:35.480+0100 [mongosMain] connection accepted from 172.28.0.164:56772 #918 (528 connections now open) 2015-10-05T10:54:35.481+0100 [mongosMain] connection accepted from 172.28.0.164:56773 #919 (529 connections now open) 2015-10-05T10:54:35.484+0100 [conn918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:35.484+0100 [conn919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:36.479+0100 [mongosMain] connection accepted from 172.28.0.164:56775 #920 (530 connections now open) 2015-10-05T10:54:36.480+0100 [mongosMain] connection accepted from 172.28.0.164:56776 #921 (531 connections now open) 2015-10-05T10:54:36.482+0100 [conn921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:36.482+0100 [conn920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:37.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248dcbc91fc8b3b377405 2015-10-05T10:54:37.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:54:39.357+0100 [mongosMain] connection accepted from 127.0.0.1:51149 #922 (532 connections now open) 2015-10-05T10:54:39.360+0100 [conn922] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:39.365+0100 [conn922] end connection 127.0.0.1:51149 (531 connections now open) 2015-10-05T10:54:40.989+0100 [mongosMain] connection accepted from 172.28.0.164:56783 #923 (532 connections now open) 2015-10-05T10:54:40.990+0100 [mongosMain] connection accepted from 172.28.0.164:56784 #924 (533 connections now open) 2015-10-05T10:54:40.992+0100 [conn923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:40.992+0100 [conn924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:41.647+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:54:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:54:43.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248e3bc91fc8b3b37740e 2015-10-05T10:54:43.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:54:45.233+0100 [conn901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:45.482+0100 [mongosMain] connection accepted from 172.28.0.164:56789 #925 (534 connections now open) 2015-10-05T10:54:45.482+0100 [mongosMain] connection accepted from 172.28.0.164:56790 #926 (535 connections now open) 2015-10-05T10:54:45.484+0100 [conn925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:45.485+0100 [conn926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:45.489+0100 [mongosMain] connection accepted from 172.28.0.164:56791 #927 (536 connections now open) 2015-10-05T10:54:45.490+0100 [mongosMain] connection accepted from 172.28.0.164:56792 #928 (537 connections now open) 2015-10-05T10:54:45.492+0100 [conn928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.478+0100 [mongosMain] connection accepted from 172.28.0.164:56796 #929 (538 connections now open) 2015-10-05T10:54:47.478+0100 [mongosMain] connection accepted from 172.28.0.164:56797 #930 (539 connections now open) 2015-10-05T10:54:47.479+0100 [mongosMain] connection accepted from 172.28.0.164:56798 #931 (540 connections now open) 2015-10-05T10:54:47.480+0100 [mongosMain] connection accepted from 172.28.0.164:56799 #932 (541 connections now open) 2015-10-05T10:54:47.480+0100 [mongosMain] connection accepted from 172.28.0.164:56800 #933 (542 connections now open) 2015-10-05T10:54:47.480+0100 [mongosMain] connection accepted from 172.28.0.164:56801 #934 (543 connections now open) 2015-10-05T10:54:47.481+0100 [conn929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.481+0100 [conn930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.482+0100 [conn931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.482+0100 [conn932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.483+0100 [conn933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.483+0100 [conn934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.493+0100 [mongosMain] connection accepted from 172.28.0.164:56802 #935 (544 connections now open) 2015-10-05T10:54:47.494+0100 [mongosMain] connection accepted from 172.28.0.164:56803 #936 (545 connections now open) 2015-10-05T10:54:47.494+0100 [mongosMain] connection accepted from 172.28.0.164:56804 #937 (546 connections now open) 2015-10-05T10:54:47.495+0100 [mongosMain] connection accepted from 172.28.0.164:56805 #938 (547 connections now open) 2015-10-05T10:54:47.496+0100 [conn935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.496+0100 [conn936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.497+0100 [conn937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.497+0100 [conn938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.500+0100 [mongosMain] connection accepted from 172.28.0.164:56806 #939 (548 connections now open) 2015-10-05T10:54:47.501+0100 [mongosMain] connection accepted from 172.28.0.164:56807 #940 (549 connections now open) 2015-10-05T10:54:47.502+0100 [mongosMain] connection accepted from 172.28.0.164:56808 #941 (550 connections now open) 2015-10-05T10:54:47.502+0100 [mongosMain] connection accepted from 172.28.0.164:56809 #942 (551 connections now open) 2015-10-05T10:54:47.503+0100 [mongosMain] connection accepted from 172.28.0.164:56810 #943 (552 connections now open) 2015-10-05T10:54:47.503+0100 [mongosMain] connection accepted from 172.28.0.164:56811 #944 (553 connections now open) 2015-10-05T10:54:47.503+0100 [conn939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.504+0100 [mongosMain] connection accepted from 172.28.0.164:56812 #945 (554 connections now open) 2015-10-05T10:54:47.504+0100 [mongosMain] connection accepted from 172.28.0.164:56813 #946 (555 connections now open) 2015-10-05T10:54:47.504+0100 [conn940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.504+0100 [conn941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.504+0100 [conn942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.505+0100 [conn943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.506+0100 [conn945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.506+0100 [conn946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.509+0100 [mongosMain] connection accepted from 172.28.0.164:56814 #947 (556 connections now open) 2015-10-05T10:54:47.509+0100 [mongosMain] connection accepted from 172.28.0.164:56815 #948 (557 connections now open) 2015-10-05T10:54:47.510+0100 [mongosMain] connection accepted from 172.28.0.164:56816 #949 (558 connections now open) 2015-10-05T10:54:47.510+0100 [mongosMain] connection accepted from 172.28.0.164:56817 #950 (559 connections now open) 2015-10-05T10:54:47.510+0100 [mongosMain] connection accepted from 172.28.0.164:56818 #951 (560 connections now open) 2015-10-05T10:54:47.511+0100 [mongosMain] connection accepted from 172.28.0.164:56819 #952 (561 connections now open) 2015-10-05T10:54:47.511+0100 [conn948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.511+0100 [conn949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.512+0100 [conn950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.513+0100 [conn951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.513+0100 [conn952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:47.516+0100 [mongosMain] connection accepted from 172.28.0.164:56820 #953 (562 connections now open) 2015-10-05T10:54:47.516+0100 [mongosMain] connection accepted from 172.28.0.164:56821 #954 (563 connections now open) 2015-10-05T10:54:49.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248e9bc91fc8b3b377424 2015-10-05T10:54:49.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:54:51.472+0100 [mongosMain] connection accepted from 172.28.0.164:56825 #955 (564 connections now open) 2015-10-05T10:54:51.475+0100 [conn955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:54.467+0100 [mongosMain] connection accepted from 172.28.0.164:56830 #956 (565 connections now open) 2015-10-05T10:54:54.468+0100 [mongosMain] connection accepted from 172.28.0.164:56831 #957 (566 connections now open) 2015-10-05T10:54:54.470+0100 [conn956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:54.470+0100 [conn957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:54.483+0100 [mongosMain] connection accepted from 172.28.0.164:56832 #958 (567 connections now open) 2015-10-05T10:54:54.483+0100 [mongosMain] connection accepted from 172.28.0.164:56833 #959 (568 connections now open) 2015-10-05T10:54:54.485+0100 [conn958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:54.485+0100 [conn959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:54:54.911+0100 [conn936] end connection 172.28.0.164:56803 (567 connections now open) 2015-10-05T10:54:54.916+0100 [conn61] end connection 172.28.0.164:55280 (566 connections now open) 2015-10-05T10:54:54.921+0100 [conn929] end connection 172.28.0.164:56796 (565 connections now open) 2015-10-05T10:54:54.922+0100 [conn933] end connection 172.28.0.164:56800 (564 connections now open) 2015-10-05T10:54:54.925+0100 [conn800] end connection 172.28.0.164:56130 (563 connections now open) 2015-10-05T10:54:54.925+0100 [conn932] end connection 172.28.0.164:56799 (562 connections now open) 2015-10-05T10:54:54.926+0100 [conn871] end connection 172.28.0.164:56358 (561 connections now open) 2015-10-05T10:54:54.926+0100 [conn913] end connection 172.28.0.164:56746 (560 connections now open) 2015-10-05T10:54:54.926+0100 [conn928] end connection 172.28.0.164:56792 (560 connections now open) 2015-10-05T10:54:54.926+0100 [conn943] end connection 172.28.0.164:56810 (559 connections now open) 2015-10-05T10:54:54.926+0100 [conn803] end connection 172.28.0.164:56134 (559 connections now open) 2015-10-05T10:54:54.926+0100 [conn946] end connection 172.28.0.164:56813 (556 connections now open) 2015-10-05T10:54:54.927+0100 [conn945] end connection 172.28.0.164:56812 (556 connections now open) 2015-10-05T10:54:54.927+0100 [conn367] end connection 172.28.0.164:55709 (554 connections now open) 2015-10-05T10:54:54.928+0100 [conn931] end connection 172.28.0.164:56798 (553 connections now open) 2015-10-05T10:54:54.928+0100 [conn942] end connection 172.28.0.164:56809 (553 connections now open) 2015-10-05T10:54:54.928+0100 [conn930] end connection 172.28.0.164:56797 (551 connections now open) 2015-10-05T10:54:54.928+0100 [conn937] end connection 172.28.0.164:56804 (551 connections now open) 2015-10-05T10:54:54.928+0100 [conn475] end connection 172.28.0.164:55796 (551 connections now open) 2015-10-05T10:54:54.928+0100 [conn477] end connection 172.28.0.164:55798 (548 connections now open) 2015-10-05T10:54:54.928+0100 [conn523] end connection 172.28.0.164:55846 (551 connections now open) 2015-10-05T10:54:54.928+0100 [conn479] end connection 172.28.0.164:55800 (548 connections now open) 2015-10-05T10:54:54.928+0100 [conn472] end connection 172.28.0.164:55793 (548 connections now open) 2015-10-05T10:54:54.928+0100 [conn939] end connection 172.28.0.164:56806 (545 connections now open) 2015-10-05T10:54:54.929+0100 [conn470] end connection 172.28.0.164:55791 (545 connections now open) 2015-10-05T10:54:54.929+0100 [conn480] end connection 172.28.0.164:55801 (543 connections now open) 2015-10-05T10:54:54.929+0100 [conn481] end connection 172.28.0.164:55802 (543 connections now open) 2015-10-05T10:54:54.929+0100 [conn478] end connection 172.28.0.164:55799 (542 connections now open) 2015-10-05T10:54:54.929+0100 [conn493] end connection 172.28.0.164:55814 (541 connections now open) 2015-10-05T10:54:54.929+0100 [conn488] end connection 172.28.0.164:55809 (540 connections now open) 2015-10-05T10:54:54.929+0100 [conn498] end connection 172.28.0.164:55821 (539 connections now open) 2015-10-05T10:54:54.929+0100 [conn511] end connection 172.28.0.164:55833 (538 connections now open) 2015-10-05T10:54:54.929+0100 [conn503] end connection 172.28.0.164:55825 (536 connections now open) 2015-10-05T10:54:54.929+0100 [conn935] end connection 172.28.0.164:56802 (536 connections now open) 2015-10-05T10:54:54.929+0100 [conn517] end connection 172.28.0.164:55841 (535 connections now open) 2015-10-05T10:54:54.930+0100 [conn490] end connection 172.28.0.164:55811 (533 connections now open) 2015-10-05T10:54:54.930+0100 [conn497] end connection 172.28.0.164:55819 (533 connections now open) 2015-10-05T10:54:54.930+0100 [conn505] end connection 172.28.0.164:55828 (533 connections now open) 2015-10-05T10:54:54.930+0100 [conn494] end connection 172.28.0.164:55815 (532 connections now open) 2015-10-05T10:54:54.930+0100 [conn504] end connection 172.28.0.164:55826 (530 connections now open) 2015-10-05T10:54:54.930+0100 [conn529] end connection 172.28.0.164:55853 (530 connections now open) 2015-10-05T10:54:54.930+0100 [conn496] end connection 172.28.0.164:55818 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn500] end connection 172.28.0.164:55822 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn516] end connection 172.28.0.164:55837 (526 connections now open) 2015-10-05T10:54:54.930+0100 [conn553] end connection 172.28.0.164:55878 (526 connections now open) 2015-10-05T10:54:54.930+0100 [conn501] end connection 172.28.0.164:55823 (523 connections now open) 2015-10-05T10:54:54.930+0100 [conn938] end connection 172.28.0.164:56805 (523 connections now open) 2015-10-05T10:54:54.928+0100 [conn733] end connection 172.28.0.164:56056 (551 connections now open) 2015-10-05T10:54:54.930+0100 [conn507] end connection 172.28.0.164:55827 (522 connections now open) 2015-10-05T10:54:54.931+0100 [conn528] end connection 172.28.0.164:55852 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn584] end connection 172.28.0.164:55909 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn512] end connection 172.28.0.164:55834 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn527] end connection 172.28.0.164:55851 (516 connections now open) 2015-10-05T10:54:54.931+0100 [conn520] end connection 172.28.0.164:55843 (516 connections now open) 2015-10-05T10:54:54.931+0100 [conn518] end connection 172.28.0.164:55842 (515 connections now open) 2015-10-05T10:54:54.931+0100 [conn940] end connection 172.28.0.164:56807 (513 connections now open) 2015-10-05T10:54:54.931+0100 [conn539] end connection 172.28.0.164:55863 (512 connections now open) 2015-10-05T10:54:54.931+0100 [conn602] end connection 172.28.0.164:55926 (511 connections now open) 2015-10-05T10:54:54.931+0100 [conn830] end connection 172.28.0.164:56162 (510 connections now open) 2015-10-05T10:54:54.931+0100 [conn533] end connection 172.28.0.164:55857 (509 connections now open) 2015-10-05T10:54:54.931+0100 [conn532] end connection 172.28.0.164:55856 (508 connections now open) 2015-10-05T10:54:54.931+0100 [conn531] end connection 172.28.0.164:55855 (507 connections now open) 2015-10-05T10:54:54.931+0100 [conn536] end connection 172.28.0.164:55860 (507 connections now open) 2015-10-05T10:54:54.932+0100 [conn538] end connection 172.28.0.164:55862 (504 connections now open) 2015-10-05T10:54:54.932+0100 [conn544] end connection 172.28.0.164:55866 (504 connections now open) 2015-10-05T10:54:54.932+0100 [conn614] end connection 172.28.0.164:55938 (504 connections now open) 2015-10-05T10:54:54.932+0100 [conn542] end connection 172.28.0.164:55868 (502 connections now open) 2015-10-05T10:54:54.932+0100 [conn551] end connection 172.28.0.164:55875 (501 connections now open) 2015-10-05T10:54:54.932+0100 [conn625] end connection 172.28.0.164:55947 (501 connections now open) 2015-10-05T10:54:54.932+0100 [conn620] end connection 172.28.0.164:55943 (499 connections now open) 2015-10-05T10:54:54.932+0100 [conn919] end connection 172.28.0.164:56773 (498 connections now open) 2015-10-05T10:54:54.932+0100 [conn543] end connection 172.28.0.164:55867 (498 connections now open) 2015-10-05T10:54:54.932+0100 [conn566] end connection 172.28.0.164:55890 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn561] end connection 172.28.0.164:55885 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn567] end connection 172.28.0.164:55891 (494 connections now open) 2015-10-05T10:54:54.932+0100 [conn563] end connection 172.28.0.164:55887 (493 connections now open) 2015-10-05T10:54:54.932+0100 [conn637] end connection 172.28.0.164:55962 (492 connections now open) 2015-10-05T10:54:54.932+0100 [conn568] end connection 172.28.0.164:55892 (491 connections now open) 2015-10-05T10:54:54.932+0100 [conn572] end connection 172.28.0.164:55896 (490 connections now open) 2015-10-05T10:54:54.933+0100 [conn806] end connection 172.28.0.164:56137 (489 connections now open) 2015-10-05T10:54:54.933+0100 [conn585] end connection 172.28.0.164:55906 (487 connections now open) 2015-10-05T10:54:54.933+0100 [conn600] end connection 172.28.0.164:55916 (487 connections now open) 2015-10-05T10:54:54.933+0100 [conn910] end connection 172.28.0.164:56743 (486 connections now open) 2015-10-05T10:54:54.933+0100 [conn579] end connection 172.28.0.164:55903 (485 connections now open) 2015-10-05T10:54:54.933+0100 [conn923] end connection 172.28.0.164:56783 (486 connections now open) 2015-10-05T10:54:54.933+0100 [conn837] end connection 172.28.0.164:56168 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn576] end connection 172.28.0.164:55898 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn597] end connection 172.28.0.164:55921 (482 connections now open) 2015-10-05T10:54:54.933+0100 [conn867] end connection 172.28.0.164:56354 (480 connections now open) 2015-10-05T10:54:54.933+0100 [conn789] end connection 172.28.0.164:56119 (480 connections now open) 2015-10-05T10:54:54.933+0100 [conn575] end connection 172.28.0.164:55900 (478 connections now open) 2015-10-05T10:54:54.933+0100 [conn869] end connection 172.28.0.164:56356 (477 connections now open) 2015-10-05T10:54:54.933+0100 [conn603] end connection 172.28.0.164:55927 (476 connections now open) 2015-10-05T10:54:54.933+0100 [conn587] end connection 172.28.0.164:55912 (475 connections now open) 2015-10-05T10:54:54.933+0100 [conn668] end connection 172.28.0.164:55994 (475 connections now open) 2015-10-05T10:54:54.933+0100 [conn826] end connection 172.28.0.164:56157 (473 connections now open) 2015-10-05T10:54:54.933+0100 [conn679] end connection 172.28.0.164:56004 (472 connections now open) 2015-10-05T10:54:54.934+0100 [conn674] end connection 172.28.0.164:56000 (471 connections now open) 2015-10-05T10:54:54.934+0100 [conn821] end connection 172.28.0.164:56153 (471 connections now open) 2015-10-05T10:54:54.934+0100 [conn593] end connection 172.28.0.164:55918 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn610] end connection 172.28.0.164:55933 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn809] end connection 172.28.0.164:56140 (467 connections now open) 2015-10-05T10:54:54.934+0100 [conn914] end connection 172.28.0.164:56748 (466 connections now open) 2015-10-05T10:54:54.934+0100 [conn615] end connection 172.28.0.164:55940 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn698] end connection 172.28.0.164:56024 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn605] end connection 172.28.0.164:55930 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn911] end connection 172.28.0.164:56744 (462 connections now open) 2015-10-05T10:54:54.934+0100 [conn622] end connection 172.28.0.164:55948 (461 connections now open) 2015-10-05T10:54:54.934+0100 [conn819] end connection 172.28.0.164:56151 (461 connections now open) 2015-10-05T10:54:54.934+0100 [conn828] end connection 172.28.0.164:56160 (459 connections now open) 2015-10-05T10:54:54.934+0100 [conn703] end connection 172.28.0.164:56027 (458 connections now open) 2015-10-05T10:54:54.934+0100 [conn627] end connection 172.28.0.164:55952 (458 connections now open) 2015-10-05T10:54:54.934+0100 [conn795] end connection 172.28.0.164:56125 (456 connections now open) 2015-10-05T10:54:54.934+0100 [conn599] end connection 172.28.0.164:55924 (456 connections now open) 2015-10-05T10:54:54.934+0100 [conn634] end connection 172.28.0.164:55957 (455 connections now open) 2015-10-05T10:54:54.935+0100 [conn801] end connection 172.28.0.164:56131 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn645] end connection 172.28.0.164:55970 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn878] end connection 172.28.0.164:56393 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn646] end connection 172.28.0.164:55971 (452 connections now open) 2015-10-05T10:54:54.935+0100 [conn652] end connection 172.28.0.164:55977 (451 connections now open) 2015-10-05T10:54:54.935+0100 [conn796] end connection 172.28.0.164:56126 (450 connections now open) 2015-10-05T10:54:54.935+0100 [conn872] end connection 172.28.0.164:56359 (450 connections now open) 2015-10-05T10:54:54.935+0100 [conn849] end connection 172.28.0.164:56181 (449 connections now open) 2015-10-05T10:54:54.935+0100 [conn848] end connection 172.28.0.164:56180 (448 connections now open) 2015-10-05T10:54:54.935+0100 [conn815] end connection 172.28.0.164:56147 (447 connections now open) 2015-10-05T10:54:54.935+0100 [conn664] end connection 172.28.0.164:55989 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn728] end connection 172.28.0.164:56050 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn611] end connection 172.28.0.164:55936 (445 connections now open) 2015-10-05T10:54:54.935+0100 [conn676] end connection 172.28.0.164:55999 (444 connections now open) 2015-10-05T10:54:54.935+0100 [conn681] end connection 172.28.0.164:56006 (442 connections now open) 2015-10-05T10:54:54.935+0100 [conn734] end connection 172.28.0.164:56055 (441 connections now open) 2015-10-05T10:54:54.935+0100 [conn693] end connection 172.28.0.164:56019 (441 connections now open) 2015-10-05T10:54:54.935+0100 [conn618] end connection 172.28.0.164:55944 (439 connections now open) 2015-10-05T10:54:54.935+0100 [conn785] end connection 172.28.0.164:56115 (439 connections now open) 2015-10-05T10:54:54.935+0100 [conn843] end connection 172.28.0.164:56175 (438 connections now open) 2015-10-05T10:54:54.936+0100 [conn688] end connection 172.28.0.164:56013 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn881] end connection 172.28.0.164:56396 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn846] end connection 172.28.0.164:56178 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn790] end connection 172.28.0.164:56120 (433 connections now open) 2015-10-05T10:54:54.936+0100 [conn751] end connection 172.28.0.164:56073 (432 connections now open) 2015-10-05T10:54:54.936+0100 [conn623] end connection 172.28.0.164:55949 (431 connections now open) 2015-10-05T10:54:54.936+0100 [conn705] end connection 172.28.0.164:56030 (430 connections now open) 2015-10-05T10:54:54.936+0100 [conn880] end connection 172.28.0.164:56395 (429 connections now open) 2015-10-05T10:54:54.936+0100 [conn808] end connection 172.28.0.164:56139 (429 connections now open) 2015-10-05T10:54:54.936+0100 [conn763] end connection 172.28.0.164:56085 (427 connections now open) 2015-10-05T10:54:54.936+0100 [conn868] end connection 172.28.0.164:56355 (427 connections now open) 2015-10-05T10:54:54.936+0100 [conn630] end connection 172.28.0.164:55956 (425 connections now open) 2015-10-05T10:54:54.936+0100 [conn712] end connection 172.28.0.164:56036 (424 connections now open) 2015-10-05T10:54:54.936+0100 [conn818] end connection 172.28.0.164:56150 (423 connections now open) 2015-10-05T10:54:54.936+0100 [conn635] end connection 172.28.0.164:55960 (422 connections now open) 2015-10-05T10:54:54.936+0100 [conn764] end connection 172.28.0.164:56086 (422 connections now open) 2015-10-05T10:54:54.936+0100 [conn718] end connection 172.28.0.164:56041 (420 connections now open) 2015-10-05T10:54:54.937+0100 [conn723] end connection 172.28.0.164:56045 (419 connections now open) 2015-10-05T10:54:54.937+0100 [conn724] end connection 172.28.0.164:56046 (418 connections now open) 2015-10-05T10:54:54.937+0100 [conn877] end connection 172.28.0.164:56379 (417 connections now open) 2015-10-05T10:54:54.937+0100 [conn729] end connection 172.28.0.164:56051 (416 connections now open) 2015-10-05T10:54:54.937+0100 [conn775] end connection 172.28.0.164:56098 (415 connections now open) 2015-10-05T10:54:54.937+0100 [conn770] end connection 172.28.0.164:56093 (415 connections now open) 2015-10-05T10:54:54.937+0100 [conn822] end connection 172.28.0.164:56154 (413 connections now open) 2015-10-05T10:54:54.937+0100 [conn781] end connection 172.28.0.164:56103 (412 connections now open) 2015-10-05T10:54:54.937+0100 [conn776] end connection 172.28.0.164:56099 (411 connections now open) 2015-10-05T10:54:54.937+0100 [conn735] end connection 172.28.0.164:56057 (410 connections now open) 2015-10-05T10:54:54.937+0100 [conn844] end connection 172.28.0.164:56176 (410 connections now open) 2015-10-05T10:54:54.937+0100 [conn817] end connection 172.28.0.164:56149 (408 connections now open) 2015-10-05T10:54:54.937+0100 [conn742] end connection 172.28.0.164:56064 (408 connections now open) 2015-10-05T10:54:54.937+0100 [conn748] end connection 172.28.0.164:56070 (407 connections now open) 2015-10-05T10:54:54.928+0100 [conn474] end connection 172.28.0.164:55795 (548 connections now open) 2015-10-05T10:54:54.937+0100 [conn845] end connection 172.28.0.164:56177 (404 connections now open) 2015-10-05T10:54:54.937+0100 [conn832] end connection 172.28.0.164:56164 (403 connections now open) 2015-10-05T10:54:54.937+0100 [conn952] end connection 172.28.0.164:56819 (403 connections now open) 2015-10-05T10:54:54.937+0100 [conn648] end connection 172.28.0.164:55973 (401 connections now open) 2015-10-05T10:54:54.938+0100 [conn766] end connection 172.28.0.164:56088 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn765] end connection 172.28.0.164:56087 (399 connections now open) 2015-10-05T10:54:54.938+0100 [conn772] end connection 172.28.0.164:56095 (398 connections now open) 2015-10-05T10:54:54.938+0100 [conn647] end connection 172.28.0.164:55972 (398 connections now open) 2015-10-05T10:54:54.938+0100 [conn777] end connection 172.28.0.164:56100 (395 connections now open) 2015-10-05T10:54:54.938+0100 [conn784] end connection 172.28.0.164:56106 (394 connections now open) 2015-10-05T10:54:54.938+0100 [conn783] end connection 172.28.0.164:56104 (394 connections now open) 2015-10-05T10:54:54.938+0100 [conn948] end connection 172.28.0.164:56815 (393 connections now open) 2015-10-05T10:54:54.938+0100 [conn654] end connection 172.28.0.164:55978 (390 connections now open) 2015-10-05T10:54:54.938+0100 [conn851] end connection 172.28.0.164:56183 (390 connections now open) 2015-10-05T10:54:54.938+0100 [conn954] end connection 172.28.0.164:56821 (388 connections now open) 2015-10-05T10:54:54.928+0100 [conn471] end connection 172.28.0.164:55792 (548 connections now open) 2015-10-05T10:54:54.938+0100 [conn659] end connection 172.28.0.164:55984 (385 connections now open) 2015-10-05T10:54:54.938+0100 [conn787] end connection 172.28.0.164:56117 (384 connections now open) 2015-10-05T10:54:54.929+0100 [conn484] end connection 172.28.0.164:55805 (543 connections now open) 2015-10-05T10:54:54.938+0100 [conn671] end connection 172.28.0.164:55996 (382 connections now open) 2015-10-05T10:54:54.938+0100 [conn672] end connection 172.28.0.164:55997 (382 connections now open) 2015-10-05T10:54:54.938+0100 [conn678] end connection 172.28.0.164:56003 (380 connections now open) 2015-10-05T10:54:54.938+0100 [conn804] end connection 172.28.0.164:56135 (380 connections now open) 2015-10-05T10:54:54.938+0100 [conn690] end connection 172.28.0.164:56015 (378 connections now open) 2015-10-05T10:54:54.938+0100 [conn695] end connection 172.28.0.164:56020 (377 connections now open) 2015-10-05T10:54:54.939+0100 [conn701] end connection 172.28.0.164:56026 (376 connections now open) 2015-10-05T10:54:54.939+0100 [conn702] end connection 172.28.0.164:56028 (375 connections now open) 2015-10-05T10:54:54.939+0100 [conn829] end connection 172.28.0.164:56161 (374 connections now open) 2015-10-05T10:54:54.939+0100 [conn707] end connection 172.28.0.164:56032 (374 connections now open) 2015-10-05T10:54:54.939+0100 [conn708] end connection 172.28.0.164:56033 (373 connections now open) 2015-10-05T10:54:54.939+0100 [conn793] end connection 172.28.0.164:56123 (371 connections now open) 2015-10-05T10:54:54.939+0100 [conn719] end connection 172.28.0.164:56042 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn725] end connection 172.28.0.164:56047 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn731] end connection 172.28.0.164:56053 (368 connections now open) 2015-10-05T10:54:54.939+0100 [conn738] end connection 172.28.0.164:56061 (367 connections now open) 2015-10-05T10:54:54.939+0100 [conn737] end connection 172.28.0.164:56059 (367 connections now open) 2015-10-05T10:54:54.939+0100 [conn744] end connection 172.28.0.164:56067 (366 connections now open) 2015-10-05T10:54:54.939+0100 [conn749] end connection 172.28.0.164:56071 (365 connections now open) 2015-10-05T10:54:54.939+0100 [conn755] end connection 172.28.0.164:56077 (363 connections now open) 2015-10-05T10:54:54.939+0100 [conn756] end connection 172.28.0.164:56078 (362 connections now open) 2015-10-05T10:54:54.939+0100 [conn761] end connection 172.28.0.164:56081 (362 connections now open) 2015-10-05T10:54:54.939+0100 [conn768] end connection 172.28.0.164:56089 (361 connections now open) 2015-10-05T10:54:54.939+0100 [conn859] end connection 172.28.0.164:56289 (360 connections now open) 2015-10-05T10:54:54.939+0100 [conn773] end connection 172.28.0.164:56097 (358 connections now open) 2015-10-05T10:54:54.939+0100 [conn866] end connection 172.28.0.164:56353 (357 connections now open) 2015-10-05T10:54:54.939+0100 [conn926] end connection 172.28.0.164:56790 (356 connections now open) 2015-10-05T10:54:54.929+0100 [conn485] end connection 172.28.0.164:55806 (541 connections now open) 2015-10-05T10:54:54.940+0100 [conn841] end connection 172.28.0.164:56173 (355 connections now open) 2015-10-05T10:54:54.929+0100 [conn473] end connection 172.28.0.164:55794 (548 connections now open) 2015-10-05T10:54:54.929+0100 [conn486] end connection 172.28.0.164:55807 (540 connections now open) 2015-10-05T10:54:54.928+0100 [conn944] end connection 172.28.0.164:56811 (551 connections now open) 2015-10-05T10:54:54.929+0100 [conn491] end connection 172.28.0.164:55812 (539 connections now open) 2015-10-05T10:54:54.929+0100 [conn492] end connection 172.28.0.164:55813 (539 connections now open) 2015-10-05T10:54:54.929+0100 [conn499] end connection 172.28.0.164:55820 (539 connections now open) 2015-10-05T10:54:54.929+0100 [conn489] end connection 172.28.0.164:55810 (535 connections now open) 2015-10-05T10:54:54.930+0100 [conn502] end connection 172.28.0.164:55824 (533 connections now open) 2015-10-05T10:54:54.930+0100 [conn509] end connection 172.28.0.164:55832 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn535] end connection 172.28.0.164:55859 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn541] end connection 172.28.0.164:55865 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn547] end connection 172.28.0.164:55869 (527 connections now open) 2015-10-05T10:54:54.930+0100 [conn515] end connection 172.28.0.164:55840 (526 connections now open) 2015-10-05T10:54:54.930+0100 [conn921] end connection 172.28.0.164:56776 (526 connections now open) 2015-10-05T10:54:54.930+0100 [conn915] end connection 172.28.0.164:56749 (526 connections now open) 2015-10-05T10:54:54.930+0100 [conn510] end connection 172.28.0.164:55831 (523 connections now open) 2015-10-05T10:54:54.928+0100 [conn732] end connection 172.28.0.164:56054 (551 connections now open) 2015-10-05T10:54:54.930+0100 [conn559] end connection 172.28.0.164:55883 (523 connections now open) 2015-10-05T10:54:54.930+0100 [conn565] end connection 172.28.0.164:55889 (523 connections now open) 2015-10-05T10:54:54.931+0100 [conn508] end connection 172.28.0.164:55830 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn521] end connection 172.28.0.164:55845 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn506] end connection 172.28.0.164:55829 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn571] end connection 172.28.0.164:55895 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn522] end connection 172.28.0.164:55847 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn577] end connection 172.28.0.164:55901 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn582] end connection 172.28.0.164:55907 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn513] end connection 172.28.0.164:55835 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn583] end connection 172.28.0.164:55908 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn514] end connection 172.28.0.164:55836 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn589] end connection 172.28.0.164:55911 (520 connections now open) 2015-10-05T10:54:54.931+0100 [conn590] end connection 172.28.0.164:55917 (516 connections now open) 2015-10-05T10:54:54.931+0100 [conn595] end connection 172.28.0.164:55919 (516 connections now open) 2015-10-05T10:54:54.931+0100 [conn519] end connection 172.28.0.164:55844 (516 connections now open) 2015-10-05T10:54:54.931+0100 [conn934] end connection 172.28.0.164:56801 (515 connections now open) 2015-10-05T10:54:54.931+0100 [conn534] end connection 172.28.0.164:55858 (513 connections now open) 2015-10-05T10:54:54.931+0100 [conn596] end connection 172.28.0.164:55922 (512 connections now open) 2015-10-05T10:54:54.931+0100 [conn601] end connection 172.28.0.164:55923 (511 connections now open) 2015-10-05T10:54:54.931+0100 [conn525] end connection 172.28.0.164:55849 (510 connections now open) 2015-10-05T10:54:54.931+0100 [conn524] end connection 172.28.0.164:55848 (508 connections now open) 2015-10-05T10:54:54.931+0100 [conn608] end connection 172.28.0.164:55932 (508 connections now open) 2015-10-05T10:54:54.931+0100 [conn613] end connection 172.28.0.164:55937 (508 connections now open) 2015-10-05T10:54:54.931+0100 [conn526] end connection 172.28.0.164:55850 (507 connections now open) 2015-10-05T10:54:54.931+0100 [conn607] end connection 172.28.0.164:55931 (507 connections now open) 2015-10-05T10:54:54.931+0100 [conn530] end connection 172.28.0.164:55854 (507 connections now open) 2015-10-05T10:54:54.931+0100 [conn540] end connection 172.28.0.164:55864 (506 connections now open) 2015-10-05T10:54:54.932+0100 [conn545] end connection 172.28.0.164:55871 (504 connections now open) 2015-10-05T10:54:54.932+0100 [conn537] end connection 172.28.0.164:55861 (504 connections now open) 2015-10-05T10:54:54.932+0100 [conn546] end connection 172.28.0.164:55870 (503 connections now open) 2015-10-05T10:54:54.932+0100 [conn557] end connection 172.28.0.164:55881 (502 connections now open) 2015-10-05T10:54:54.932+0100 [conn550] end connection 172.28.0.164:55874 (497 connections now open) 2015-10-05T10:54:54.932+0100 [conn619] end connection 172.28.0.164:55945 (497 connections now open) 2015-10-05T10:54:54.932+0100 [conn548] end connection 172.28.0.164:55872 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn631] end connection 172.28.0.164:55955 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn549] end connection 172.28.0.164:55873 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn626] end connection 172.28.0.164:55950 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn554] end connection 172.28.0.164:55879 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn552] end connection 172.28.0.164:55876 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn556] end connection 172.28.0.164:55880 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn560] end connection 172.28.0.164:55882 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn562] end connection 172.28.0.164:55886 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn564] end connection 172.28.0.164:55888 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn555] end connection 172.28.0.164:55877 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn924] end connection 172.28.0.164:56784 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn558] end connection 172.28.0.164:55884 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn632] end connection 172.28.0.164:55959 (496 connections now open) 2015-10-05T10:54:54.932+0100 [conn574] end connection 172.28.0.164:55899 (495 connections now open) 2015-10-05T10:54:54.932+0100 [conn863] end connection 172.28.0.164:56349 (492 connections now open) 2015-10-05T10:54:54.932+0100 [conn912] end connection 172.28.0.164:56745 (492 connections now open) 2015-10-05T10:54:54.932+0100 [conn638] end connection 172.28.0.164:55963 (491 connections now open) 2015-10-05T10:54:54.932+0100 [conn920] end connection 172.28.0.164:56775 (489 connections now open) 2015-10-05T10:54:54.933+0100 [conn573] end connection 172.28.0.164:55897 (488 connections now open) 2015-10-05T10:54:54.928+0100 [conn476] end connection 172.28.0.164:55797 (550 connections now open) 2015-10-05T10:54:54.933+0100 [conn581] end connection 172.28.0.164:55905 (489 connections now open) 2015-10-05T10:54:54.933+0100 [conn644] end connection 172.28.0.164:55969 (487 connections now open) 2015-10-05T10:54:54.933+0100 [conn643] end connection 172.28.0.164:55968 (486 connections now open) 2015-10-05T10:54:54.933+0100 [conn578] end connection 172.28.0.164:55902 (486 connections now open) 2015-10-05T10:54:54.933+0100 [conn925] end connection 172.28.0.164:56789 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn580] end connection 172.28.0.164:55904 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn650] end connection 172.28.0.164:55975 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn569] end connection 172.28.0.164:55893 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn586] end connection 172.28.0.164:55910 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn570] end connection 172.28.0.164:55894 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn592] end connection 172.28.0.164:55915 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn649] end connection 172.28.0.164:55974 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn591] end connection 172.28.0.164:55920 (483 connections now open) 2015-10-05T10:54:54.933+0100 [conn655] end connection 172.28.0.164:55979 (482 connections now open) 2015-10-05T10:54:54.933+0100 [conn788] end connection 172.28.0.164:56118 (481 connections now open) 2015-10-05T10:54:54.933+0100 [conn495] end connection 172.28.0.164:55817 (538 connections now open) 2015-10-05T10:54:54.933+0100 [conn661] end connection 172.28.0.164:55986 (477 connections now open) 2015-10-05T10:54:54.933+0100 [conn598] end connection 172.28.0.164:55925 (476 connections now open) 2015-10-05T10:54:54.933+0100 [conn667] end connection 172.28.0.164:55991 (476 connections now open) 2015-10-05T10:54:54.933+0100 [conn656] end connection 172.28.0.164:55981 (476 connections now open) 2015-10-05T10:54:54.933+0100 [conn662] end connection 172.28.0.164:55987 (475 connections now open) 2015-10-05T10:54:54.933+0100 [conn604] end connection 172.28.0.164:55928 (475 connections now open) 2015-10-05T10:54:54.933+0100 [conn673] end connection 172.28.0.164:55998 (472 connections now open) 2015-10-05T10:54:54.933+0100 [conn588] end connection 172.28.0.164:55913 (472 connections now open) 2015-10-05T10:54:54.934+0100 [conn594] end connection 172.28.0.164:55914 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn680] end connection 172.28.0.164:56005 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn685] end connection 172.28.0.164:56010 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn686] end connection 172.28.0.164:56011 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn609] end connection 172.28.0.164:55934 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn797] end connection 172.28.0.164:56127 (469 connections now open) 2015-10-05T10:54:54.934+0100 [conn691] end connection 172.28.0.164:56016 (468 connections now open) 2015-10-05T10:54:54.934+0100 [conn791] end connection 172.28.0.164:56121 (468 connections now open) 2015-10-05T10:54:54.934+0100 [conn616] end connection 172.28.0.164:55939 (466 connections now open) 2015-10-05T10:54:54.934+0100 [conn692] end connection 172.28.0.164:56017 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn697] end connection 172.28.0.164:56022 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn621] end connection 172.28.0.164:55946 (464 connections now open) 2015-10-05T10:54:54.934+0100 [conn814] end connection 172.28.0.164:56146 (462 connections now open) 2015-10-05T10:54:54.934+0100 [conn833] end connection 172.28.0.164:56165 (458 connections now open) 2015-10-05T10:54:54.934+0100 [conn628] end connection 172.28.0.164:55954 (456 connections now open) 2015-10-05T10:54:54.934+0100 [conn842] end connection 172.28.0.164:56174 (454 connections now open) 2015-10-05T10:54:54.934+0100 [conn709] end connection 172.28.0.164:56034 (454 connections now open) 2015-10-05T10:54:54.934+0100 [conn794] end connection 172.28.0.164:56124 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn704] end connection 172.28.0.164:56029 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn633] end connection 172.28.0.164:55958 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn879] end connection 172.28.0.164:56394 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn710] end connection 172.28.0.164:56035 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn864] end connection 172.28.0.164:56350 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn640] end connection 172.28.0.164:55964 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn639] end connection 172.28.0.164:55965 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn850] end connection 172.28.0.164:56182 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn716] end connection 172.28.0.164:56039 (453 connections now open) 2015-10-05T10:54:54.935+0100 [conn651] end connection 172.28.0.164:55976 (452 connections now open) 2015-10-05T10:54:54.935+0100 [conn721] end connection 172.28.0.164:56044 (452 connections now open) 2015-10-05T10:54:54.935+0100 [conn727] end connection 172.28.0.164:56049 (451 connections now open) 2015-10-05T10:54:54.935+0100 [conn658] end connection 172.28.0.164:55983 (450 connections now open) 2015-10-05T10:54:54.935+0100 [conn836] end connection 172.28.0.164:56169 (449 connections now open) 2015-10-05T10:54:54.935+0100 [conn657] end connection 172.28.0.164:55982 (448 connections now open) 2015-10-05T10:54:54.935+0100 [conn606] end connection 172.28.0.164:55929 (447 connections now open) 2015-10-05T10:54:54.935+0100 [conn811] end connection 172.28.0.164:56144 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn663] end connection 172.28.0.164:55988 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn612] end connection 172.28.0.164:55935 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn670] end connection 172.28.0.164:55995 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn798] end connection 172.28.0.164:56128 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn739] end connection 172.28.0.164:56060 (446 connections now open) 2015-10-05T10:54:54.935+0100 [conn669] end connection 172.28.0.164:55993 (445 connections now open) 2015-10-05T10:54:54.935+0100 [conn675] end connection 172.28.0.164:56001 (443 connections now open) 2015-10-05T10:54:54.935+0100 [conn840] end connection 172.28.0.164:56172 (441 connections now open) 2015-10-05T10:54:54.935+0100 [conn617] end connection 172.28.0.164:55942 (441 connections now open) 2015-10-05T10:54:54.935+0100 [conn682] end connection 172.28.0.164:56007 (441 connections now open) 2015-10-05T10:54:54.935+0100 [conn745] end connection 172.28.0.164:56066 (439 connections now open) 2015-10-05T10:54:54.936+0100 [conn740] end connection 172.28.0.164:56062 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn687] end connection 172.28.0.164:56012 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn746] end connection 172.28.0.164:56068 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn807] end connection 172.28.0.164:56138 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn694] end connection 172.28.0.164:56018 (435 connections now open) 2015-10-05T10:54:54.936+0100 [conn699] end connection 172.28.0.164:56023 (433 connections now open) 2015-10-05T10:54:54.936+0100 [conn706] end connection 172.28.0.164:56031 (431 connections now open) 2015-10-05T10:54:54.936+0100 [conn752] end connection 172.28.0.164:56074 (430 connections now open) 2015-10-05T10:54:54.936+0100 [conn700] end connection 172.28.0.164:56025 (431 connections now open) 2015-10-05T10:54:54.936+0100 [conn824] end connection 172.28.0.164:56156 (429 connections now open) 2015-10-05T10:54:54.936+0100 [conn757] end connection 172.28.0.164:56079 (429 connections now open) 2015-10-05T10:54:54.936+0100 [conn624] end connection 172.28.0.164:55951 (429 connections now open) 2015-10-05T10:54:54.936+0100 [conn629] end connection 172.28.0.164:55953 (427 connections now open) 2015-10-05T10:54:54.936+0100 [conn810] end connection 172.28.0.164:56141 (426 connections now open) 2015-10-05T10:54:54.936+0100 [conn758] end connection 172.28.0.164:56080 (423 connections now open) 2015-10-05T10:54:54.936+0100 [conn717] end connection 172.28.0.164:56040 (422 connections now open) 2015-10-05T10:54:54.936+0100 [conn839] end connection 172.28.0.164:56171 (420 connections now open) 2015-10-05T10:54:54.937+0100 [conn870] end connection 172.28.0.164:56357 (419 connections now open) 2015-10-05T10:54:54.937+0100 [conn769] end connection 172.28.0.164:56092 (419 connections now open) 2015-10-05T10:54:54.937+0100 [conn831] end connection 172.28.0.164:56163 (416 connections now open) 2015-10-05T10:54:54.937+0100 [conn825] end connection 172.28.0.164:56158 (416 connections now open) 2015-10-05T10:54:54.937+0100 [conn736] end connection 172.28.0.164:56058 (415 connections now open) 2015-10-05T10:54:54.937+0100 [conn813] end connection 172.28.0.164:56145 (415 connections now open) 2015-10-05T10:54:54.937+0100 [conn838] end connection 172.28.0.164:56170 (414 connections now open) 2015-10-05T10:54:54.937+0100 [conn636] end connection 172.28.0.164:55961 (414 connections now open) 2015-10-05T10:54:54.937+0100 [conn812] end connection 172.28.0.164:56143 (412 connections now open) 2015-10-05T10:54:54.937+0100 [conn730] end connection 172.28.0.164:56052 (412 connections now open) 2015-10-05T10:54:54.937+0100 [conn741] end connection 172.28.0.164:56063 (410 connections now open) 2015-10-05T10:54:54.937+0100 [conn641] end connection 172.28.0.164:55966 (410 connections now open) 2015-10-05T10:54:54.937+0100 [conn642] end connection 172.28.0.164:55967 (409 connections now open) 2015-10-05T10:54:54.937+0100 [conn782] end connection 172.28.0.164:56105 (409 connections now open) 2015-10-05T10:54:54.937+0100 [conn927] end connection 172.28.0.164:56791 (408 connections now open) 2015-10-05T10:54:54.937+0100 [conn820] end connection 172.28.0.164:56152 (408 connections now open) 2015-10-05T10:54:54.937+0100 [conn747] end connection 172.28.0.164:56069 (408 connections now open) 2015-10-05T10:54:54.937+0100 [conn951] end connection 172.28.0.164:56818 (404 connections now open) 2015-10-05T10:54:54.937+0100 [conn753] end connection 172.28.0.164:56075 (403 connections now open) 2015-10-05T10:54:54.937+0100 [conn759] end connection 172.28.0.164:56083 (401 connections now open) 2015-10-05T10:54:54.938+0100 [conn754] end connection 172.28.0.164:56076 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn827] end connection 172.28.0.164:56159 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn760] end connection 172.28.0.164:56082 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn858] end connection 172.28.0.164:56287 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn958] end connection 172.28.0.164:56832 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn957] end connection 172.28.0.164:56831 (400 connections now open) 2015-10-05T10:54:54.938+0100 [conn771] end connection 172.28.0.164:56094 (399 connections now open) 2015-10-05T10:54:54.938+0100 [conn802] end connection 172.28.0.164:56132 (398 connections now open) 2015-10-05T10:54:54.938+0100 [conn778] end connection 172.28.0.164:56101 (398 connections now open) 2015-10-05T10:54:54.938+0100 [conn876] end connection 172.28.0.164:56378 (397 connections now open) 2015-10-05T10:54:54.938+0100 [conn882] end connection 172.28.0.164:56397 (394 connections now open) 2015-10-05T10:54:54.938+0100 [conn653] end connection 172.28.0.164:55980 (392 connections now open) 2015-10-05T10:54:54.938+0100 [conn947] end connection 172.28.0.164:56814 (390 connections now open) 2015-10-05T10:54:54.938+0100 [conn953] end connection 172.28.0.164:56820 (388 connections now open) 2015-10-05T10:54:54.928+0100 [conn941] end connection 172.28.0.164:56808 (548 connections now open) 2015-10-05T10:54:54.938+0100 [conn959] end connection 172.28.0.164:56833 (387 connections now open) 2015-10-05T10:54:54.929+0100 [conn487] end connection 172.28.0.164:55808 (543 connections now open) 2015-10-05T10:54:54.929+0100 [conn482] end connection 172.28.0.164:55803 (543 connections now open) 2015-10-05T10:54:54.938+0100 [conn660] end connection 172.28.0.164:55985 (384 connections now open) 2015-10-05T10:54:54.938+0100 [conn666] end connection 172.28.0.164:55992 (383 connections now open) 2015-10-05T10:54:54.938+0100 [conn665] end connection 172.28.0.164:55990 (383 connections now open) 2015-10-05T10:54:54.929+0100 [conn483] end connection 172.28.0.164:55804 (541 connections now open) 2015-10-05T10:54:54.938+0100 [conn677] end connection 172.28.0.164:56002 (381 connections now open) 2015-10-05T10:54:54.938+0100 [conn683] end connection 172.28.0.164:56008 (380 connections now open) 2015-10-05T10:54:54.938+0100 [conn684] end connection 172.28.0.164:56009 (380 connections now open) 2015-10-05T10:54:54.938+0100 [conn689] end connection 172.28.0.164:56014 (378 connections now open) 2015-10-05T10:54:54.938+0100 [conn696] end connection 172.28.0.164:56021 (378 connections now open) 2015-10-05T10:54:54.939+0100 [conn816] end connection 172.28.0.164:56148 (377 connections now open) 2015-10-05T10:54:54.939+0100 [conn834] end connection 172.28.0.164:56166 (374 connections now open) 2015-10-05T10:54:54.939+0100 [conn713] end connection 172.28.0.164:56037 (373 connections now open) 2015-10-05T10:54:54.939+0100 [conn714] end connection 172.28.0.164:56038 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn884] end connection 172.28.0.164:56414 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn720] end connection 172.28.0.164:56043 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn726] end connection 172.28.0.164:56048 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn805] end connection 172.28.0.164:56136 (370 connections now open) 2015-10-05T10:54:54.939+0100 [conn883] end connection 172.28.0.164:56398 (368 connections now open) 2015-10-05T10:54:54.939+0100 [conn835] end connection 172.28.0.164:56167 (368 connections now open) 2015-10-05T10:54:54.939+0100 [conn799] end connection 172.28.0.164:56129 (367 connections now open) 2015-10-05T10:54:54.939+0100 [conn743] end connection 172.28.0.164:56065 (367 connections now open) 2015-10-05T10:54:54.939+0100 [conn847] end connection 172.28.0.164:56179 (365 connections now open) 2015-10-05T10:54:54.939+0100 [conn750] end connection 172.28.0.164:56072 (363 connections now open) 2015-10-05T10:54:54.939+0100 [conn792] end connection 172.28.0.164:56122 (362 connections now open) 2015-10-05T10:54:54.939+0100 [conn762] end connection 172.28.0.164:56084 (361 connections now open) 2015-10-05T10:54:54.939+0100 [conn779] end connection 172.28.0.164:56091 (361 connections now open) 2015-10-05T10:54:54.939+0100 [conn767] end connection 172.28.0.164:56090 (360 connections now open) 2015-10-05T10:54:54.939+0100 [conn774] end connection 172.28.0.164:56096 (358 connections now open) 2015-10-05T10:54:54.939+0100 [conn780] end connection 172.28.0.164:56102 (356 connections now open) 2015-10-05T10:54:54.939+0100 [conn865] end connection 172.28.0.164:56352 (356 connections now open) 2015-10-05T10:54:54.940+0100 [conn949] end connection 172.28.0.164:56816 (356 connections now open) 2015-10-05T10:54:54.940+0100 [conn956] end connection 172.28.0.164:56830 (355 connections now open) 2015-10-05T10:54:54.940+0100 [conn955] end connection 172.28.0.164:56825 (355 connections now open) 2015-10-05T10:54:54.940+0100 [conn823] end connection 172.28.0.164:56155 (374 connections now open) 2015-10-05T10:54:54.940+0100 [conn786] end connection 172.28.0.164:56116 (355 connections now open) 2015-10-05T10:54:54.940+0100 [conn950] end connection 172.28.0.164:56817 (356 connections now open) 2015-10-05T10:54:55.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248efbc91fc8b3b37743a 2015-10-05T10:54:56.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:02.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248f6bc91fc8b3b37744a 2015-10-05T10:55:02.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:08.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561248fcbc91fc8b3b377460 2015-10-05T10:55:08.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:11.914+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:55:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:55:14.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124902bc91fc8b3b377470 2015-10-05T10:55:15.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:21.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124909bc91fc8b3b377483 2015-10-05T10:55:21.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:27.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612490fbc91fc8b3b377495 2015-10-05T10:55:27.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:28.903+0100 [conn379] end connection 172.28.0.163:49830 (119 connections now open) 2015-10-05T10:55:28.904+0100 [mongosMain] connection accepted from 172.28.0.163:51192 #960 (120 connections now open) 2015-10-05T10:55:28.906+0100 [conn960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:55:29.053+0100 [mongosMain] connection accepted from 127.0.0.1:51194 #961 (121 connections now open) 2015-10-05T10:55:29.055+0100 [conn961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:55:29.060+0100 [conn961] end connection 127.0.0.1:51194 (120 connections now open) 2015-10-05T10:55:35.497+0100 [mongosMain] connection accepted from 172.28.0.164:56858 #962 (121 connections now open) 2015-10-05T10:55:35.500+0100 [conn962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:55:39.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612491bbc91fc8b3b3774b1 2015-10-05T10:55:39.909+0100 [mongosMain] connection accepted from 127.0.0.1:51196 #963 (122 connections now open) 2015-10-05T10:55:39.912+0100 [conn963] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:55:39.916+0100 [conn963] end connection 127.0.0.1:51196 (121 connections now open) 2015-10-05T10:55:39.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:55:42.077+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:55:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:55:52.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124927bc91fc8b3b3774da 2015-10-05T10:55:52.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:04.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124934bc91fc8b3b3774ff 2015-10-05T10:56:04.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:07.978+0100 [mongosMain] connection accepted from 172.28.0.164:56895 #964 (122 connections now open) 2015-10-05T10:56:07.979+0100 [mongosMain] connection accepted from 172.28.0.164:56896 #965 (123 connections now open) 2015-10-05T10:56:10.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612493abc91fc8b3b377516 2015-10-05T10:56:11.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:12.197+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:56:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:56:23.197+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124947bc91fc8b3b37752c 2015-10-05T10:56:23.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:28.869+0100 [mongosMain] connection accepted from 127.0.0.1:51239 #966 (124 connections now open) 2015-10-05T10:56:28.872+0100 [conn966] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:28.878+0100 [conn966] end connection 127.0.0.1:51239 (123 connections now open) 2015-10-05T10:56:28.920+0100 [conn376] end connection 172.28.0.163:49825 (122 connections now open) 2015-10-05T10:56:28.921+0100 [mongosMain] connection accepted from 172.28.0.163:51240 #967 (123 connections now open) 2015-10-05T10:56:28.923+0100 [conn967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:29.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612494dbc91fc8b3b377541 2015-10-05T10:56:29.489+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:35.513+0100 [mongosMain] connection accepted from 172.28.0.164:56919 #968 (124 connections now open) 2015-10-05T10:56:35.516+0100 [conn968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:39.836+0100 [mongosMain] connection accepted from 127.0.0.1:51245 #969 (125 connections now open) 2015-10-05T10:56:39.838+0100 [conn969] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:39.842+0100 [conn969] end connection 127.0.0.1:51245 (124 connections now open) 2015-10-05T10:56:41.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124959bc91fc8b3b377553 2015-10-05T10:56:41.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:42.472+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:56:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:56:47.978+0100 [conn964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:47.978+0100 [conn965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:48.072+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612495fbc91fc8b3b37756a 2015-10-05T10:56:48.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:56:51.989+0100 [mongosMain] connection accepted from 172.28.0.164:56938 #970 (125 connections now open) 2015-10-05T10:56:51.991+0100 [conn970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:55.982+0100 [mongosMain] connection accepted from 172.28.0.164:56944 #971 (126 connections now open) 2015-10-05T10:56:55.983+0100 [mongosMain] connection accepted from 172.28.0.164:56945 #972 (127 connections now open) 2015-10-05T10:56:55.986+0100 [conn972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:55.995+0100 [mongosMain] connection accepted from 172.28.0.164:56946 #973 (128 connections now open) 2015-10-05T10:56:55.995+0100 [mongosMain] connection accepted from 172.28.0.164:56947 #974 (129 connections now open) 2015-10-05T10:56:55.996+0100 [mongosMain] connection accepted from 172.28.0.164:56948 #975 (130 connections now open) 2015-10-05T10:56:55.996+0100 [mongosMain] connection accepted from 172.28.0.164:56949 #976 (131 connections now open) 2015-10-05T10:56:55.997+0100 [mongosMain] connection accepted from 172.28.0.164:56950 #977 (132 connections now open) 2015-10-05T10:56:55.998+0100 [mongosMain] connection accepted from 172.28.0.164:56951 #978 (133 connections now open) 2015-10-05T10:56:55.998+0100 [conn975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:55.999+0100 [mongosMain] connection accepted from 172.28.0.164:56952 #979 (134 connections now open) 2015-10-05T10:56:55.999+0100 [mongosMain] connection accepted from 172.28.0.164:56953 #980 (135 connections now open) 2015-10-05T10:56:55.999+0100 [conn977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.000+0100 [conn978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.000+0100 [conn980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.001+0100 [conn979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.002+0100 [mongosMain] connection accepted from 172.28.0.164:56954 #981 (136 connections now open) 2015-10-05T10:56:56.005+0100 [mongosMain] connection accepted from 172.28.0.164:56955 #982 (137 connections now open) 2015-10-05T10:56:56.006+0100 [mongosMain] connection accepted from 172.28.0.164:56956 #983 (138 connections now open) 2015-10-05T10:56:56.009+0100 [conn974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.009+0100 [conn973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.013+0100 [conn981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.013+0100 [conn983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.013+0100 [mongosMain] connection accepted from 172.28.0.164:56957 #984 (139 connections now open) 2015-10-05T10:56:56.015+0100 [conn984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.065+0100 [mongosMain] connection accepted from 172.28.0.164:56958 #985 (140 connections now open) 2015-10-05T10:56:56.066+0100 [mongosMain] connection accepted from 172.28.0.164:56959 #986 (141 connections now open) 2015-10-05T10:56:56.066+0100 [mongosMain] connection accepted from 172.28.0.164:56960 #987 (142 connections now open) 2015-10-05T10:56:56.066+0100 [mongosMain] connection accepted from 172.28.0.164:56961 #988 (143 connections now open) 2015-10-05T10:56:56.067+0100 [mongosMain] connection accepted from 172.28.0.164:56962 #989 (144 connections now open) 2015-10-05T10:56:56.067+0100 [conn985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.067+0100 [mongosMain] connection accepted from 172.28.0.164:56963 #990 (145 connections now open) 2015-10-05T10:56:56.068+0100 [mongosMain] connection accepted from 172.28.0.164:56964 #991 (146 connections now open) 2015-10-05T10:56:56.069+0100 [conn987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.069+0100 [conn988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.069+0100 [conn989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.069+0100 [conn986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.070+0100 [mongosMain] connection accepted from 172.28.0.164:56965 #992 (147 connections now open) 2015-10-05T10:56:56.071+0100 [conn991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.071+0100 [mongosMain] connection accepted from 172.28.0.164:56966 #993 (148 connections now open) 2015-10-05T10:56:56.071+0100 [mongosMain] connection accepted from 172.28.0.164:56968 #994 (149 connections now open) 2015-10-05T10:56:56.072+0100 [mongosMain] connection accepted from 172.28.0.164:56969 #995 (150 connections now open) 2015-10-05T10:56:56.072+0100 [conn992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.073+0100 [mongosMain] connection accepted from 172.28.0.164:56970 #996 (151 connections now open) 2015-10-05T10:56:56.073+0100 [conn994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.074+0100 [mongosMain] connection accepted from 172.28.0.164:56971 #997 (152 connections now open) 2015-10-05T10:56:56.075+0100 [conn996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.075+0100 [mongosMain] connection accepted from 172.28.0.164:56972 #998 (153 connections now open) 2015-10-05T10:56:56.076+0100 [conn997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.077+0100 [conn998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.077+0100 [mongosMain] connection accepted from 172.28.0.164:56973 #999 (154 connections now open) 2015-10-05T10:56:56.078+0100 [mongosMain] connection accepted from 172.28.0.164:56974 #1000 (155 connections now open) 2015-10-05T10:56:56.079+0100 [conn999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.080+0100 [mongosMain] connection accepted from 172.28.0.164:56975 #1001 (156 connections now open) 2015-10-05T10:56:56.081+0100 [mongosMain] connection accepted from 172.28.0.164:56976 #1002 (157 connections now open) 2015-10-05T10:56:56.083+0100 [mongosMain] connection accepted from 172.28.0.164:56977 #1003 (158 connections now open) 2015-10-05T10:56:56.085+0100 [mongosMain] connection accepted from 172.28.0.164:56978 #1004 (159 connections now open) 2015-10-05T10:56:56.086+0100 [mongosMain] connection accepted from 172.28.0.164:56979 #1005 (160 connections now open) 2015-10-05T10:56:56.088+0100 [mongosMain] connection accepted from 172.28.0.164:56980 #1006 (161 connections now open) 2015-10-05T10:56:56.090+0100 [mongosMain] connection accepted from 172.28.0.164:56981 #1007 (162 connections now open) 2015-10-05T10:56:56.091+0100 [mongosMain] connection accepted from 172.28.0.164:56982 #1008 (163 connections now open) 2015-10-05T10:56:56.092+0100 [conn1000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.092+0100 [mongosMain] connection accepted from 172.28.0.164:56983 #1009 (164 connections now open) 2015-10-05T10:56:56.092+0100 [mongosMain] connection accepted from 172.28.0.164:56984 #1010 (165 connections now open) 2015-10-05T10:56:56.092+0100 [conn1006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.093+0100 [conn1004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.093+0100 [conn1007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.093+0100 [mongosMain] connection accepted from 172.28.0.164:56985 #1011 (166 connections now open) 2015-10-05T10:56:56.093+0100 [conn1001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.093+0100 [mongosMain] connection accepted from 172.28.0.164:56986 #1012 (167 connections now open) 2015-10-05T10:56:56.093+0100 [conn1005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.093+0100 [conn1003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.094+0100 [mongosMain] connection accepted from 172.28.0.164:56987 #1013 (168 connections now open) 2015-10-05T10:56:56.094+0100 [mongosMain] connection accepted from 172.28.0.164:56988 #1014 (169 connections now open) 2015-10-05T10:56:56.094+0100 [conn1009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.094+0100 [conn1010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.095+0100 [mongosMain] connection accepted from 172.28.0.164:56989 #1015 (170 connections now open) 2015-10-05T10:56:56.095+0100 [conn1012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.095+0100 [conn1013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.095+0100 [conn1014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.095+0100 [mongosMain] connection accepted from 172.28.0.164:56990 #1016 (171 connections now open) 2015-10-05T10:56:56.097+0100 [mongosMain] connection accepted from 172.28.0.164:56991 #1017 (172 connections now open) 2015-10-05T10:56:56.103+0100 [conn1017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.103+0100 [mongosMain] connection accepted from 172.28.0.164:56992 #1018 (173 connections now open) 2015-10-05T10:56:56.104+0100 [conn1016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.105+0100 [mongosMain] connection accepted from 172.28.0.164:56993 #1019 (174 connections now open) 2015-10-05T10:56:56.105+0100 [mongosMain] connection accepted from 172.28.0.164:56994 #1020 (175 connections now open) 2015-10-05T10:56:56.106+0100 [mongosMain] connection accepted from 172.28.0.164:56995 #1021 (176 connections now open) 2015-10-05T10:56:56.106+0100 [conn1018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.107+0100 [mongosMain] connection accepted from 172.28.0.164:56996 #1022 (177 connections now open) 2015-10-05T10:56:56.107+0100 [mongosMain] connection accepted from 172.28.0.164:56997 #1023 (178 connections now open) 2015-10-05T10:56:56.107+0100 [mongosMain] connection accepted from 172.28.0.164:56998 #1024 (179 connections now open) 2015-10-05T10:56:56.107+0100 [conn1020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.107+0100 [mongosMain] connection accepted from 172.28.0.164:56999 #1025 (180 connections now open) 2015-10-05T10:56:56.108+0100 [conn1019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.108+0100 [mongosMain] connection accepted from 172.28.0.164:57000 #1026 (181 connections now open) 2015-10-05T10:56:56.108+0100 [conn1021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.109+0100 [conn1023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.109+0100 [mongosMain] connection accepted from 172.28.0.164:57001 #1027 (182 connections now open) 2015-10-05T10:56:56.109+0100 [conn1024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.110+0100 [mongosMain] connection accepted from 172.28.0.164:57002 #1028 (183 connections now open) 2015-10-05T10:56:56.110+0100 [mongosMain] connection accepted from 172.28.0.164:57003 #1029 (184 connections now open) 2015-10-05T10:56:56.110+0100 [conn1026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.110+0100 [mongosMain] connection accepted from 172.28.0.164:57004 #1030 (185 connections now open) 2015-10-05T10:56:56.110+0100 [mongosMain] connection accepted from 172.28.0.164:57005 #1031 (186 connections now open) 2015-10-05T10:56:56.111+0100 [mongosMain] connection accepted from 172.28.0.164:57007 #1032 (187 connections now open) 2015-10-05T10:56:56.111+0100 [mongosMain] connection accepted from 172.28.0.164:57006 #1033 (188 connections now open) 2015-10-05T10:56:56.112+0100 [mongosMain] connection accepted from 172.28.0.164:57008 #1034 (189 connections now open) 2015-10-05T10:56:56.112+0100 [conn1028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.112+0100 [conn1029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.112+0100 [mongosMain] connection accepted from 172.28.0.164:57009 #1035 (190 connections now open) 2015-10-05T10:56:56.112+0100 [conn1030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.112+0100 [conn1031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.113+0100 [conn1033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.113+0100 [conn1032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.113+0100 [conn1034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.113+0100 [conn1035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.114+0100 [mongosMain] connection accepted from 172.28.0.164:57010 #1036 (191 connections now open) 2015-10-05T10:56:56.117+0100 [mongosMain] connection accepted from 172.28.0.164:57011 #1037 (192 connections now open) 2015-10-05T10:56:56.117+0100 [mongosMain] connection accepted from 172.28.0.164:57012 #1038 (193 connections now open) 2015-10-05T10:56:56.118+0100 [mongosMain] connection accepted from 172.28.0.164:57013 #1039 (194 connections now open) 2015-10-05T10:56:56.118+0100 [mongosMain] connection accepted from 172.28.0.164:57015 #1040 (195 connections now open) 2015-10-05T10:56:56.118+0100 [conn982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.119+0100 [mongosMain] connection accepted from 172.28.0.164:57014 #1041 (196 connections now open) 2015-10-05T10:56:56.119+0100 [conn971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.119+0100 [mongosMain] connection accepted from 172.28.0.164:57016 #1042 (197 connections now open) 2015-10-05T10:56:56.119+0100 [mongosMain] connection accepted from 172.28.0.164:57017 #1043 (198 connections now open) 2015-10-05T10:56:56.120+0100 [conn976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.122+0100 [mongosMain] connection accepted from 172.28.0.164:57019 #1044 (199 connections now open) 2015-10-05T10:56:56.122+0100 [mongosMain] connection accepted from 172.28.0.164:57018 #1045 (200 connections now open) 2015-10-05T10:56:56.122+0100 [conn990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.125+0100 [conn993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.125+0100 [conn995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.135+0100 [mongosMain] connection accepted from 172.28.0.164:57021 #1046 (201 connections now open) 2015-10-05T10:56:56.136+0100 [conn1027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.150+0100 [conn1008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.166+0100 [conn1011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.167+0100 [conn1015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.168+0100 [conn1022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.168+0100 [conn1025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.169+0100 [conn1002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.169+0100 [conn1037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.170+0100 [conn1038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.170+0100 [conn1042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.173+0100 [conn1043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.173+0100 [conn1039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.173+0100 [conn1041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.173+0100 [conn1040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.173+0100 [conn1044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.174+0100 [conn1045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.174+0100 [conn1036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:56:56.176+0100 [conn1046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:00.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612496cbc91fc8b3b37757c 2015-10-05T10:57:00.560+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:57:12.574+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:57:12.578+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:57:12.580+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:57:12.757+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:57:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:57:12.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124978bc91fc8b3b377599 2015-10-05T10:57:12.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:57:25.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124985bc91fc8b3b3775ab 2015-10-05T10:57:25.411+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:57:28.660+0100 [mongosMain] connection accepted from 127.0.0.1:51285 #1047 (202 connections now open) 2015-10-05T10:57:28.663+0100 [conn1047] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:28.668+0100 [conn1047] end connection 127.0.0.1:51285 (201 connections now open) 2015-10-05T10:57:28.936+0100 [conn372] end connection 172.28.0.163:49819 (200 connections now open) 2015-10-05T10:57:28.938+0100 [mongosMain] connection accepted from 172.28.0.163:51286 #1048 (201 connections now open) 2015-10-05T10:57:28.940+0100 [conn1048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.715+0100 [mongosMain] connection accepted from 172.28.0.163:51289 #1049 (202 connections now open) 2015-10-05T10:57:29.717+0100 [mongosMain] connection accepted from 172.28.0.163:51290 #1050 (203 connections now open) 2015-10-05T10:57:29.718+0100 [conn1049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.719+0100 [mongosMain] connection accepted from 172.28.0.163:51291 #1051 (204 connections now open) 2015-10-05T10:57:29.721+0100 [conn1050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.725+0100 [mongosMain] connection accepted from 172.28.0.163:51292 #1052 (205 connections now open) 2015-10-05T10:57:29.728+0100 [conn1052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.739+0100 [mongosMain] connection accepted from 172.28.0.163:51293 #1053 (206 connections now open) 2015-10-05T10:57:29.739+0100 [conn1051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.740+0100 [conn1053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.749+0100 [mongosMain] connection accepted from 172.28.0.163:51294 #1054 (207 connections now open) 2015-10-05T10:57:29.750+0100 [mongosMain] connection accepted from 172.28.0.163:51295 #1055 (208 connections now open) 2015-10-05T10:57:29.751+0100 [mongosMain] connection accepted from 172.28.0.163:51296 #1056 (209 connections now open) 2015-10-05T10:57:29.751+0100 [mongosMain] connection accepted from 172.28.0.163:51297 #1057 (210 connections now open) 2015-10-05T10:57:29.752+0100 [mongosMain] connection accepted from 172.28.0.163:51298 #1058 (211 connections now open) 2015-10-05T10:57:29.752+0100 [mongosMain] connection accepted from 172.28.0.163:51299 #1059 (212 connections now open) 2015-10-05T10:57:29.753+0100 [conn1056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.753+0100 [conn1055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.753+0100 [mongosMain] connection accepted from 172.28.0.163:51300 #1060 (213 connections now open) 2015-10-05T10:57:29.754+0100 [conn1059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.756+0100 [conn1057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.756+0100 [mongosMain] connection accepted from 172.28.0.163:51301 #1061 (214 connections now open) 2015-10-05T10:57:29.757+0100 [conn1060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.763+0100 [conn1061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.764+0100 [mongosMain] connection accepted from 172.28.0.163:51302 #1062 (215 connections now open) 2015-10-05T10:57:29.764+0100 [conn1058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.765+0100 [conn1062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.765+0100 [mongosMain] connection accepted from 172.28.0.163:51303 #1063 (216 connections now open) 2015-10-05T10:57:29.768+0100 [mongosMain] connection accepted from 172.28.0.163:51304 #1064 (217 connections now open) 2015-10-05T10:57:29.768+0100 [mongosMain] connection accepted from 172.28.0.163:51305 #1065 (218 connections now open) 2015-10-05T10:57:29.779+0100 [mongosMain] connection accepted from 172.28.0.163:51306 #1066 (219 connections now open) 2015-10-05T10:57:29.779+0100 [mongosMain] connection accepted from 172.28.0.163:51307 #1067 (220 connections now open) 2015-10-05T10:57:29.780+0100 [mongosMain] connection accepted from 172.28.0.163:51308 #1068 (221 connections now open) 2015-10-05T10:57:29.780+0100 [mongosMain] connection accepted from 172.28.0.163:51309 #1069 (222 connections now open) 2015-10-05T10:57:29.780+0100 [mongosMain] connection accepted from 172.28.0.163:51310 #1070 (223 connections now open) 2015-10-05T10:57:29.780+0100 [mongosMain] connection accepted from 172.28.0.163:51311 #1071 (224 connections now open) 2015-10-05T10:57:29.780+0100 [mongosMain] connection accepted from 172.28.0.163:51312 #1072 (225 connections now open) 2015-10-05T10:57:29.781+0100 [mongosMain] connection accepted from 172.28.0.163:51313 #1073 (226 connections now open) 2015-10-05T10:57:29.781+0100 [mongosMain] connection accepted from 172.28.0.163:51314 #1074 (227 connections now open) 2015-10-05T10:57:29.781+0100 [mongosMain] connection accepted from 172.28.0.163:51315 #1075 (228 connections now open) 2015-10-05T10:57:29.781+0100 [mongosMain] connection accepted from 172.28.0.163:51316 #1076 (229 connections now open) 2015-10-05T10:57:29.781+0100 [mongosMain] connection accepted from 172.28.0.163:51317 #1077 (230 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51318 #1078 (231 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51319 #1079 (232 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51320 #1080 (233 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51321 #1081 (234 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51322 #1082 (235 connections now open) 2015-10-05T10:57:29.782+0100 [mongosMain] connection accepted from 172.28.0.163:51323 #1083 (236 connections now open) 2015-10-05T10:57:29.783+0100 [mongosMain] connection accepted from 172.28.0.163:51324 #1084 (237 connections now open) 2015-10-05T10:57:29.783+0100 [mongosMain] connection accepted from 172.28.0.163:51325 #1085 (238 connections now open) 2015-10-05T10:57:29.783+0100 [mongosMain] connection accepted from 172.28.0.163:51326 #1086 (239 connections now open) 2015-10-05T10:57:29.798+0100 [conn1063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.798+0100 [conn1064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.801+0100 [conn1065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.801+0100 [conn1066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.803+0100 [conn1067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.804+0100 [conn1068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.804+0100 [conn1069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.804+0100 [conn1070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.805+0100 [conn1071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.805+0100 [conn1072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.805+0100 [conn1073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.806+0100 [conn1074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.806+0100 [conn1075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.806+0100 [conn1076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.806+0100 [conn1077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.806+0100 [conn1078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.807+0100 [conn1079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.807+0100 [conn1080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.807+0100 [conn1081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.808+0100 [conn1082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.808+0100 [conn1083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.808+0100 [conn1084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.808+0100 [conn1085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.809+0100 [conn1086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.920+0100 [mongosMain] connection accepted from 172.28.0.163:51329 #1087 (240 connections now open) 2015-10-05T10:57:29.920+0100 [mongosMain] connection accepted from 172.28.0.163:51330 #1088 (241 connections now open) 2015-10-05T10:57:29.920+0100 [mongosMain] connection accepted from 172.28.0.163:51331 #1089 (242 connections now open) 2015-10-05T10:57:29.921+0100 [mongosMain] connection accepted from 172.28.0.163:51332 #1090 (243 connections now open) 2015-10-05T10:57:29.921+0100 [mongosMain] connection accepted from 172.28.0.163:51333 #1091 (244 connections now open) 2015-10-05T10:57:29.921+0100 [mongosMain] connection accepted from 172.28.0.163:51334 #1092 (245 connections now open) 2015-10-05T10:57:29.921+0100 [mongosMain] connection accepted from 172.28.0.163:51335 #1093 (246 connections now open) 2015-10-05T10:57:29.921+0100 [mongosMain] connection accepted from 172.28.0.163:51336 #1094 (247 connections now open) 2015-10-05T10:57:29.922+0100 [mongosMain] connection accepted from 172.28.0.163:51337 #1095 (248 connections now open) 2015-10-05T10:57:29.922+0100 [mongosMain] connection accepted from 172.28.0.163:51338 #1096 (249 connections now open) 2015-10-05T10:57:29.922+0100 [mongosMain] connection accepted from 172.28.0.163:51339 #1097 (250 connections now open) 2015-10-05T10:57:29.922+0100 [mongosMain] connection accepted from 172.28.0.163:51340 #1098 (251 connections now open) 2015-10-05T10:57:29.923+0100 [mongosMain] connection accepted from 172.28.0.163:51341 #1099 (252 connections now open) 2015-10-05T10:57:29.923+0100 [mongosMain] connection accepted from 172.28.0.163:51342 #1100 (253 connections now open) 2015-10-05T10:57:29.923+0100 [mongosMain] connection accepted from 172.28.0.163:51343 #1101 (254 connections now open) 2015-10-05T10:57:29.924+0100 [mongosMain] connection accepted from 172.28.0.163:51344 #1102 (255 connections now open) 2015-10-05T10:57:29.925+0100 [mongosMain] connection accepted from 172.28.0.163:51345 #1103 (256 connections now open) 2015-10-05T10:57:29.925+0100 [mongosMain] connection accepted from 172.28.0.163:51346 #1104 (257 connections now open) 2015-10-05T10:57:29.926+0100 [mongosMain] connection accepted from 172.28.0.163:51347 #1105 (258 connections now open) 2015-10-05T10:57:29.926+0100 [mongosMain] connection accepted from 172.28.0.163:51348 #1106 (259 connections now open) 2015-10-05T10:57:29.926+0100 [mongosMain] connection accepted from 172.28.0.163:51350 #1107 (260 connections now open) 2015-10-05T10:57:29.927+0100 [mongosMain] connection accepted from 172.28.0.163:51351 #1108 (261 connections now open) 2015-10-05T10:57:29.927+0100 [mongosMain] connection accepted from 172.28.0.163:51349 #1109 (262 connections now open) 2015-10-05T10:57:29.928+0100 [conn1101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.928+0100 [conn1097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.929+0100 [conn1091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.929+0100 [conn1095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.929+0100 [conn1103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.929+0100 [conn1102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.929+0100 [mongosMain] connection accepted from 172.28.0.163:51352 #1110 (263 connections now open) 2015-10-05T10:57:29.929+0100 [conn1096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.931+0100 [conn1090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.931+0100 [mongosMain] connection accepted from 172.28.0.163:51353 #1111 (264 connections now open) 2015-10-05T10:57:29.932+0100 [mongosMain] connection accepted from 172.28.0.163:51354 #1112 (265 connections now open) 2015-10-05T10:57:29.932+0100 [mongosMain] connection accepted from 172.28.0.163:51355 #1113 (266 connections now open) 2015-10-05T10:57:29.932+0100 [mongosMain] connection accepted from 172.28.0.163:51356 #1114 (267 connections now open) 2015-10-05T10:57:29.933+0100 [conn1089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.933+0100 [mongosMain] connection accepted from 172.28.0.163:51357 #1115 (268 connections now open) 2015-10-05T10:57:29.933+0100 [mongosMain] connection accepted from 172.28.0.163:51358 #1116 (269 connections now open) 2015-10-05T10:57:29.935+0100 [mongosMain] connection accepted from 172.28.0.163:51359 #1117 (270 connections now open) 2015-10-05T10:57:29.936+0100 [mongosMain] connection accepted from 172.28.0.163:51360 #1118 (271 connections now open) 2015-10-05T10:57:29.937+0100 [mongosMain] connection accepted from 172.28.0.163:51361 #1119 (272 connections now open) 2015-10-05T10:57:29.938+0100 [conn1100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.938+0100 [conn1094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.938+0100 [mongosMain] connection accepted from 172.28.0.163:51362 #1120 (273 connections now open) 2015-10-05T10:57:29.938+0100 [conn1088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.941+0100 [mongosMain] connection accepted from 172.28.0.163:51363 #1121 (274 connections now open) 2015-10-05T10:57:29.942+0100 [mongosMain] connection accepted from 172.28.0.163:51364 #1122 (275 connections now open) 2015-10-05T10:57:29.944+0100 [conn1106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.945+0100 [conn1092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.945+0100 [conn1104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.946+0100 [conn1098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.948+0100 [conn1087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.948+0100 [conn1099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.952+0100 [conn1109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.952+0100 [conn1107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.953+0100 [conn1113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.956+0100 [conn1116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.962+0100 [mongosMain] connection accepted from 172.28.0.163:51366 #1123 (276 connections now open) 2015-10-05T10:57:29.971+0100 [mongosMain] connection accepted from 172.28.0.163:51365 #1124 (277 connections now open) 2015-10-05T10:57:29.972+0100 [conn1120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.972+0100 [conn1108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.972+0100 [conn1111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.973+0100 [conn1114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.973+0100 [conn1117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.974+0100 [conn1123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.975+0100 [conn1124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.975+0100 [conn1105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.978+0100 [mongosMain] connection accepted from 172.28.0.163:51367 #1125 (278 connections now open) 2015-10-05T10:57:29.983+0100 [conn1125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.992+0100 [mongosMain] connection accepted from 172.28.0.163:51368 #1126 (279 connections now open) 2015-10-05T10:57:29.994+0100 [mongosMain] connection accepted from 172.28.0.163:51369 #1127 (280 connections now open) 2015-10-05T10:57:29.994+0100 [conn1126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.997+0100 [conn1127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:29.997+0100 [mongosMain] connection accepted from 172.28.0.163:51370 #1128 (281 connections now open) 2015-10-05T10:57:29.999+0100 [mongosMain] connection accepted from 172.28.0.163:51371 #1129 (282 connections now open) 2015-10-05T10:57:29.999+0100 [mongosMain] connection accepted from 172.28.0.163:51372 #1130 (283 connections now open) 2015-10-05T10:57:29.999+0100 [mongosMain] connection accepted from 172.28.0.163:51373 #1131 (284 connections now open) 2015-10-05T10:57:30.000+0100 [mongosMain] connection accepted from 172.28.0.163:51374 #1132 (285 connections now open) 2015-10-05T10:57:30.000+0100 [mongosMain] connection accepted from 172.28.0.163:51376 #1133 (286 connections now open) 2015-10-05T10:57:30.000+0100 [mongosMain] connection accepted from 172.28.0.163:51375 #1134 (287 connections now open) 2015-10-05T10:57:30.000+0100 [mongosMain] connection accepted from 172.28.0.163:51377 #1135 (288 connections now open) 2015-10-05T10:57:30.000+0100 [conn1129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.000+0100 [mongosMain] connection accepted from 172.28.0.163:51378 #1136 (289 connections now open) 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51381 #1137 (290 connections now open) 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51380 #1138 (291 connections now open) 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51379 #1139 (292 connections now open) 2015-10-05T10:57:30.001+0100 [conn1132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51383 #1140 (293 connections now open) 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51384 #1141 (294 connections now open) 2015-10-05T10:57:30.001+0100 [conn1131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.001+0100 [mongosMain] connection accepted from 172.28.0.163:51385 #1142 (295 connections now open) 2015-10-05T10:57:30.002+0100 [mongosMain] connection accepted from 172.28.0.163:51386 #1143 (296 connections now open) 2015-10-05T10:57:30.002+0100 [mongosMain] connection accepted from 172.28.0.163:51387 #1144 (297 connections now open) 2015-10-05T10:57:30.002+0100 [mongosMain] connection accepted from 172.28.0.163:51388 #1145 (298 connections now open) 2015-10-05T10:57:30.002+0100 [conn1130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.002+0100 [mongosMain] connection accepted from 172.28.0.163:51389 #1146 (299 connections now open) 2015-10-05T10:57:30.002+0100 [mongosMain] connection accepted from 172.28.0.163:51390 #1147 (300 connections now open) 2015-10-05T10:57:30.002+0100 [conn1137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.003+0100 [mongosMain] connection accepted from 172.28.0.163:51391 #1148 (301 connections now open) 2015-10-05T10:57:30.003+0100 [mongosMain] connection accepted from 172.28.0.163:51392 #1149 (302 connections now open) 2015-10-05T10:57:30.003+0100 [mongosMain] connection accepted from 172.28.0.163:51394 #1150 (303 connections now open) 2015-10-05T10:57:30.003+0100 [mongosMain] connection accepted from 172.28.0.163:51395 #1151 (304 connections now open) 2015-10-05T10:57:30.003+0100 [mongosMain] connection accepted from 172.28.0.163:51396 #1152 (305 connections now open) 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51397 #1153 (306 connections now open) 2015-10-05T10:57:30.004+0100 [conn1143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51398 #1154 (307 connections now open) 2015-10-05T10:57:30.004+0100 [conn1138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.004+0100 [conn1136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51399 #1155 (308 connections now open) 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51400 #1156 (309 connections now open) 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51401 #1157 (310 connections now open) 2015-10-05T10:57:30.004+0100 [mongosMain] connection accepted from 172.28.0.163:51402 #1158 (311 connections now open) 2015-10-05T10:57:30.005+0100 [conn1149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.005+0100 [mongosMain] connection accepted from 172.28.0.163:51403 #1159 (312 connections now open) 2015-10-05T10:57:30.005+0100 [mongosMain] connection accepted from 172.28.0.163:51405 #1160 (313 connections now open) 2015-10-05T10:57:30.005+0100 [conn1128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.005+0100 [mongosMain] connection accepted from 172.28.0.163:51406 #1161 (314 connections now open) 2015-10-05T10:57:30.005+0100 [conn1134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.005+0100 [mongosMain] connection accepted from 172.28.0.163:51407 #1162 (315 connections now open) 2015-10-05T10:57:30.005+0100 [conn1144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.006+0100 [mongosMain] connection accepted from 172.28.0.163:51408 #1163 (316 connections now open) 2015-10-05T10:57:30.006+0100 [mongosMain] connection accepted from 172.28.0.163:51409 #1164 (317 connections now open) 2015-10-05T10:57:30.006+0100 [mongosMain] connection accepted from 172.28.0.163:51404 #1165 (318 connections now open) 2015-10-05T10:57:30.006+0100 [mongosMain] connection accepted from 172.28.0.163:51410 #1166 (319 connections now open) 2015-10-05T10:57:30.006+0100 [mongosMain] connection accepted from 172.28.0.163:51411 #1167 (320 connections now open) 2015-10-05T10:57:30.006+0100 [conn1133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.007+0100 [mongosMain] connection accepted from 172.28.0.163:51412 #1168 (321 connections now open) 2015-10-05T10:57:30.007+0100 [mongosMain] connection accepted from 172.28.0.163:51413 #1169 (322 connections now open) 2015-10-05T10:57:30.007+0100 [mongosMain] connection accepted from 172.28.0.163:51414 #1170 (323 connections now open) 2015-10-05T10:57:30.007+0100 [mongosMain] connection accepted from 172.28.0.163:51415 #1171 (324 connections now open) 2015-10-05T10:57:30.007+0100 [conn1152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.008+0100 [mongosMain] connection accepted from 172.28.0.163:51416 #1172 (325 connections now open) 2015-10-05T10:57:30.008+0100 [mongosMain] connection accepted from 172.28.0.163:51417 #1173 (326 connections now open) 2015-10-05T10:57:30.008+0100 [mongosMain] connection accepted from 172.28.0.163:51418 #1174 (327 connections now open) 2015-10-05T10:57:30.009+0100 [mongosMain] connection accepted from 172.28.0.163:51419 #1175 (328 connections now open) 2015-10-05T10:57:30.009+0100 [mongosMain] connection accepted from 172.28.0.163:51420 #1176 (329 connections now open) 2015-10-05T10:57:30.009+0100 [mongosMain] connection accepted from 172.28.0.163:51421 #1177 (330 connections now open) 2015-10-05T10:57:30.009+0100 [mongosMain] connection accepted from 172.28.0.163:51422 #1178 (331 connections now open) 2015-10-05T10:57:30.009+0100 [mongosMain] connection accepted from 172.28.0.163:51423 #1179 (332 connections now open) 2015-10-05T10:57:30.010+0100 [conn1155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.010+0100 [conn1164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.011+0100 [conn1142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.013+0100 [mongosMain] connection accepted from 172.28.0.163:51425 #1180 (333 connections now open) 2015-10-05T10:57:30.013+0100 [mongosMain] connection accepted from 172.28.0.163:51427 #1181 (334 connections now open) 2015-10-05T10:57:30.013+0100 [mongosMain] connection accepted from 172.28.0.163:51426 #1182 (335 connections now open) 2015-10-05T10:57:30.013+0100 [mongosMain] connection accepted from 172.28.0.163:51428 #1183 (336 connections now open) 2015-10-05T10:57:30.013+0100 [mongosMain] connection accepted from 172.28.0.163:51429 #1184 (337 connections now open) 2015-10-05T10:57:30.014+0100 [mongosMain] connection accepted from 172.28.0.163:51430 #1185 (338 connections now open) 2015-10-05T10:57:30.014+0100 [mongosMain] connection accepted from 172.28.0.163:51431 #1186 (339 connections now open) 2015-10-05T10:57:30.014+0100 [mongosMain] connection accepted from 172.28.0.163:51432 #1187 (340 connections now open) 2015-10-05T10:57:30.015+0100 [mongosMain] connection accepted from 172.28.0.163:51433 #1188 (341 connections now open) 2015-10-05T10:57:30.015+0100 [mongosMain] connection accepted from 172.28.0.163:51434 #1189 (342 connections now open) 2015-10-05T10:57:30.015+0100 [mongosMain] connection accepted from 172.28.0.163:51435 #1190 (343 connections now open) 2015-10-05T10:57:30.015+0100 [conn1148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.015+0100 [conn1158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.016+0100 [mongosMain] connection accepted from 172.28.0.163:51436 #1191 (344 connections now open) 2015-10-05T10:57:30.016+0100 [conn1161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.016+0100 [conn1170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.016+0100 [conn1167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.016+0100 [conn1150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.017+0100 [mongosMain] connection accepted from 172.28.0.163:51438 #1192 (345 connections now open) 2015-10-05T10:57:30.017+0100 [mongosMain] connection accepted from 172.28.0.163:51439 #1193 (346 connections now open) 2015-10-05T10:57:30.017+0100 [mongosMain] connection accepted from 172.28.0.163:51440 #1194 (347 connections now open) 2015-10-05T10:57:30.017+0100 [mongosMain] connection accepted from 172.28.0.163:51441 #1195 (348 connections now open) 2015-10-05T10:57:30.018+0100 [conn1154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.019+0100 [conn1160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.019+0100 [conn1172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.019+0100 [conn1151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.019+0100 [conn1178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.019+0100 [conn1166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.020+0100 [conn1180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.020+0100 [conn1184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.020+0100 [mongosMain] connection accepted from 172.28.0.163:51442 #1196 (349 connections now open) 2015-10-05T10:57:30.021+0100 [conn1186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.021+0100 [conn1189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.021+0100 [conn1183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.021+0100 [conn1191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.021+0100 [conn1185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.022+0100 [conn1192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.022+0100 [conn1190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.023+0100 [conn1195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.024+0100 [conn1145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.024+0100 [conn1187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.024+0100 [mongosMain] connection accepted from 172.28.0.163:51443 #1197 (350 connections now open) 2015-10-05T10:57:30.026+0100 [conn1139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.026+0100 [conn1196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.026+0100 [conn1193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.027+0100 [conn1140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.028+0100 [conn1181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.029+0100 [conn1197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.030+0100 [mongosMain] connection accepted from 172.28.0.163:51444 #1198 (351 connections now open) 2015-10-05T10:57:30.030+0100 [mongosMain] connection accepted from 172.28.0.163:51445 #1199 (352 connections now open) 2015-10-05T10:57:30.031+0100 [mongosMain] connection accepted from 172.28.0.163:51446 #1200 (353 connections now open) 2015-10-05T10:57:30.032+0100 [mongosMain] connection accepted from 172.28.0.163:51447 #1201 (354 connections now open) 2015-10-05T10:57:30.032+0100 [mongosMain] connection accepted from 172.28.0.163:51448 #1202 (355 connections now open) 2015-10-05T10:57:30.033+0100 [conn1199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.033+0100 [conn1198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.034+0100 [conn1201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.034+0100 [conn1202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.035+0100 [mongosMain] connection accepted from 172.28.0.163:51450 #1203 (356 connections now open) 2015-10-05T10:57:30.036+0100 [mongosMain] connection accepted from 172.28.0.163:51449 #1204 (357 connections now open) 2015-10-05T10:57:30.037+0100 [conn1203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.037+0100 [conn1204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.038+0100 [mongosMain] connection accepted from 172.28.0.163:51451 #1205 (358 connections now open) 2015-10-05T10:57:30.039+0100 [conn1176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.040+0100 [conn1188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.041+0100 [conn1182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.041+0100 [mongosMain] connection accepted from 172.28.0.163:51453 #1206 (359 connections now open) 2015-10-05T10:57:30.041+0100 [conn1157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.042+0100 [mongosMain] connection accepted from 172.28.0.163:51454 #1207 (360 connections now open) 2015-10-05T10:57:30.042+0100 [conn1135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.042+0100 [mongosMain] connection accepted from 172.28.0.163:51455 #1208 (361 connections now open) 2015-10-05T10:57:30.042+0100 [conn1169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.042+0100 [conn1175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.042+0100 [conn1147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.042+0100 [mongosMain] connection accepted from 172.28.0.163:51456 #1209 (362 connections now open) 2015-10-05T10:57:30.042+0100 [conn1141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.043+0100 [mongosMain] connection accepted from 172.28.0.163:51457 #1210 (363 connections now open) 2015-10-05T10:57:30.043+0100 [conn1153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.043+0100 [mongosMain] connection accepted from 172.28.0.163:51458 #1211 (364 connections now open) 2015-10-05T10:57:30.043+0100 [mongosMain] connection accepted from 172.28.0.163:51459 #1212 (365 connections now open) 2015-10-05T10:57:30.044+0100 [mongosMain] connection accepted from 172.28.0.163:51461 #1213 (366 connections now open) 2015-10-05T10:57:30.044+0100 [mongosMain] connection accepted from 172.28.0.163:51460 #1214 (367 connections now open) 2015-10-05T10:57:30.044+0100 [mongosMain] connection accepted from 172.28.0.163:51462 #1215 (368 connections now open) 2015-10-05T10:57:30.045+0100 [mongosMain] connection accepted from 172.28.0.163:51463 #1216 (369 connections now open) 2015-10-05T10:57:30.045+0100 [conn1163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.045+0100 [conn1159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.045+0100 [mongosMain] connection accepted from 172.28.0.163:51464 #1217 (370 connections now open) 2015-10-05T10:57:30.045+0100 [conn1194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.046+0100 [conn1200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.046+0100 [conn1177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.046+0100 [conn1162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.046+0100 [mongosMain] connection accepted from 172.28.0.163:51465 #1218 (371 connections now open) 2015-10-05T10:57:30.047+0100 [conn1168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.047+0100 [mongosMain] connection accepted from 172.28.0.163:51466 #1219 (372 connections now open) 2015-10-05T10:57:30.047+0100 [conn1174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.047+0100 [conn1213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.047+0100 [conn1211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.048+0100 [conn1173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.048+0100 [conn1215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.051+0100 [conn1207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.051+0100 [conn1210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.052+0100 [conn1216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.053+0100 [mongosMain] connection accepted from 172.28.0.163:51467 #1220 (373 connections now open) 2015-10-05T10:57:30.054+0100 [mongosMain] connection accepted from 172.28.0.163:51468 #1221 (374 connections now open) 2015-10-05T10:57:30.055+0100 [mongosMain] connection accepted from 172.28.0.163:51469 #1222 (375 connections now open) 2015-10-05T10:57:30.055+0100 [mongosMain] connection accepted from 172.28.0.163:51470 #1223 (376 connections now open) 2015-10-05T10:57:30.063+0100 [mongosMain] connection accepted from 172.28.0.163:51472 #1224 (377 connections now open) 2015-10-05T10:57:30.064+0100 [mongosMain] connection accepted from 172.28.0.163:51474 #1225 (378 connections now open) 2015-10-05T10:57:30.064+0100 [conn1209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.064+0100 [mongosMain] connection accepted from 172.28.0.163:51473 #1226 (379 connections now open) 2015-10-05T10:57:30.067+0100 [mongosMain] connection accepted from 172.28.0.163:51475 #1227 (380 connections now open) 2015-10-05T10:57:30.071+0100 [mongosMain] connection accepted from 172.28.0.163:51476 #1228 (381 connections now open) 2015-10-05T10:57:30.072+0100 [mongosMain] connection accepted from 172.28.0.163:51477 #1229 (382 connections now open) 2015-10-05T10:57:30.072+0100 [mongosMain] connection accepted from 172.28.0.163:51478 #1230 (383 connections now open) 2015-10-05T10:57:30.081+0100 [mongosMain] connection accepted from 172.28.0.163:51479 #1231 (384 connections now open) 2015-10-05T10:57:30.081+0100 [mongosMain] connection accepted from 172.28.0.163:51480 #1232 (385 connections now open) 2015-10-05T10:57:30.082+0100 [mongosMain] connection accepted from 172.28.0.163:51481 #1233 (386 connections now open) 2015-10-05T10:57:30.082+0100 [mongosMain] connection accepted from 172.28.0.163:51482 #1234 (387 connections now open) 2015-10-05T10:57:30.082+0100 [mongosMain] connection accepted from 172.28.0.163:51483 #1235 (388 connections now open) 2015-10-05T10:57:30.083+0100 [mongosMain] connection accepted from 172.28.0.163:51484 #1236 (389 connections now open) 2015-10-05T10:57:30.083+0100 [mongosMain] connection accepted from 172.28.0.163:51485 #1237 (390 connections now open) 2015-10-05T10:57:30.084+0100 [mongosMain] connection accepted from 172.28.0.163:51486 #1238 (391 connections now open) 2015-10-05T10:57:30.084+0100 [mongosMain] connection accepted from 172.28.0.163:51487 #1239 (392 connections now open) 2015-10-05T10:57:30.086+0100 [mongosMain] connection accepted from 172.28.0.163:51488 #1240 (393 connections now open) 2015-10-05T10:57:30.087+0100 [mongosMain] connection accepted from 172.28.0.163:51489 #1241 (394 connections now open) 2015-10-05T10:57:30.087+0100 [mongosMain] connection accepted from 172.28.0.163:51490 #1242 (395 connections now open) 2015-10-05T10:57:30.087+0100 [mongosMain] connection accepted from 172.28.0.163:51491 #1243 (396 connections now open) 2015-10-05T10:57:30.088+0100 [mongosMain] connection accepted from 172.28.0.163:51492 #1244 (397 connections now open) 2015-10-05T10:57:30.088+0100 [mongosMain] connection accepted from 172.28.0.163:51493 #1245 (398 connections now open) 2015-10-05T10:57:30.090+0100 [mongosMain] connection accepted from 172.28.0.163:51494 #1246 (399 connections now open) 2015-10-05T10:57:30.090+0100 [mongosMain] connection accepted from 172.28.0.163:51495 #1247 (400 connections now open) 2015-10-05T10:57:30.094+0100 [conn1217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.094+0100 [conn1214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.094+0100 [conn1228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.094+0100 [conn1225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.094+0100 [conn1223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.095+0100 [conn1206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.098+0100 [mongosMain] connection accepted from 172.28.0.163:51496 #1248 (401 connections now open) 2015-10-05T10:57:30.101+0100 [conn1212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.101+0100 [conn1218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.101+0100 [mongosMain] connection accepted from 172.28.0.163:51497 #1249 (402 connections now open) 2015-10-05T10:57:30.107+0100 [mongosMain] connection accepted from 172.28.0.163:51498 #1250 (403 connections now open) 2015-10-05T10:57:30.112+0100 [conn1221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.112+0100 [conn1224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.112+0100 [conn1243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.113+0100 [conn1240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.113+0100 [conn1239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.116+0100 [mongosMain] connection accepted from 172.28.0.163:51499 #1251 (404 connections now open) 2015-10-05T10:57:30.119+0100 [mongosMain] connection accepted from 172.28.0.163:51500 #1252 (405 connections now open) 2015-10-05T10:57:30.119+0100 [conn1229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.119+0100 [conn1247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.120+0100 [mongosMain] connection accepted from 172.28.0.163:51501 #1253 (406 connections now open) 2015-10-05T10:57:30.120+0100 [conn1246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.120+0100 [mongosMain] connection accepted from 172.28.0.163:51502 #1254 (407 connections now open) 2015-10-05T10:57:30.120+0100 [conn1230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.122+0100 [conn1235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.121+0100 [conn1237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.122+0100 [conn1222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.122+0100 [conn1238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.122+0100 [conn1241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.127+0100 [conn1248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.127+0100 [conn1219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.127+0100 [conn1249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.128+0100 [conn1220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.128+0100 [conn1208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.131+0100 [conn1252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.132+0100 [conn1254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.132+0100 [conn1253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.132+0100 [conn1250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.134+0100 [conn1179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.139+0100 [conn1251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.141+0100 [conn1245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.142+0100 [mongosMain] connection accepted from 172.28.0.163:51503 #1255 (408 connections now open) 2015-10-05T10:57:30.143+0100 [mongosMain] connection accepted from 172.28.0.163:51504 #1256 (409 connections now open) 2015-10-05T10:57:30.144+0100 [mongosMain] connection accepted from 172.28.0.163:51505 #1257 (410 connections now open) 2015-10-05T10:57:30.146+0100 [conn1257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.149+0100 [conn1255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.149+0100 [conn1256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.151+0100 [mongosMain] connection accepted from 172.28.0.163:51506 #1258 (411 connections now open) 2015-10-05T10:57:30.152+0100 [mongosMain] connection accepted from 172.28.0.163:51507 #1259 (412 connections now open) 2015-10-05T10:57:30.153+0100 [conn1258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.155+0100 [mongosMain] connection accepted from 172.28.0.163:51508 #1260 (413 connections now open) 2015-10-05T10:57:30.158+0100 [mongosMain] connection accepted from 172.28.0.163:51509 #1261 (414 connections now open) 2015-10-05T10:57:30.160+0100 [conn1259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.164+0100 [mongosMain] connection accepted from 172.28.0.163:51510 #1262 (415 connections now open) 2015-10-05T10:57:30.167+0100 [mongosMain] connection accepted from 172.28.0.163:51511 #1263 (416 connections now open) 2015-10-05T10:57:30.168+0100 [mongosMain] connection accepted from 172.28.0.163:51512 #1264 (417 connections now open) 2015-10-05T10:57:30.168+0100 [mongosMain] connection accepted from 172.28.0.163:51513 #1265 (418 connections now open) 2015-10-05T10:57:30.169+0100 [mongosMain] connection accepted from 172.28.0.163:51514 #1266 (419 connections now open) 2015-10-05T10:57:30.169+0100 [mongosMain] connection accepted from 172.28.0.163:51515 #1267 (420 connections now open) 2015-10-05T10:57:30.170+0100 [mongosMain] connection accepted from 172.28.0.163:51516 #1268 (421 connections now open) 2015-10-05T10:57:30.174+0100 [mongosMain] connection accepted from 172.28.0.163:51517 #1269 (422 connections now open) 2015-10-05T10:57:30.175+0100 [mongosMain] connection accepted from 172.28.0.163:51518 #1270 (423 connections now open) 2015-10-05T10:57:30.177+0100 [mongosMain] connection accepted from 172.28.0.163:51519 #1271 (424 connections now open) 2015-10-05T10:57:30.179+0100 [mongosMain] connection accepted from 172.28.0.163:51520 #1272 (425 connections now open) 2015-10-05T10:57:30.181+0100 [conn1264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.182+0100 [conn1261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.182+0100 [conn1269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.183+0100 [conn1270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.183+0100 [conn1263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.184+0100 [conn1262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.185+0100 [conn1267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.192+0100 [mongosMain] connection accepted from 172.28.0.163:51521 #1273 (426 connections now open) 2015-10-05T10:57:30.193+0100 [conn1268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.194+0100 [mongosMain] connection accepted from 172.28.0.163:51522 #1274 (427 connections now open) 2015-10-05T10:57:30.195+0100 [mongosMain] connection accepted from 172.28.0.163:51523 #1275 (428 connections now open) 2015-10-05T10:57:30.195+0100 [mongosMain] connection accepted from 172.28.0.163:51524 #1276 (429 connections now open) 2015-10-05T10:57:30.195+0100 [conn1273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.195+0100 [mongosMain] connection accepted from 172.28.0.163:51525 #1277 (430 connections now open) 2015-10-05T10:57:30.196+0100 [conn1260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.196+0100 [conn1274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.196+0100 [mongosMain] connection accepted from 172.28.0.163:51527 #1278 (431 connections now open) 2015-10-05T10:57:30.196+0100 [mongosMain] connection accepted from 172.28.0.163:51526 #1279 (432 connections now open) 2015-10-05T10:57:30.198+0100 [conn1276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.198+0100 [conn1275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.199+0100 [conn1279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.200+0100 [conn1272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.204+0100 [mongosMain] connection accepted from 172.28.0.163:51528 #1280 (433 connections now open) 2015-10-05T10:57:30.204+0100 [mongosMain] connection accepted from 172.28.0.163:51529 #1281 (434 connections now open) 2015-10-05T10:57:30.205+0100 [mongosMain] connection accepted from 172.28.0.163:51530 #1282 (435 connections now open) 2015-10-05T10:57:30.206+0100 [conn1280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.206+0100 [conn1281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.207+0100 [conn1282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.208+0100 [conn1271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.208+0100 [mongosMain] connection accepted from 172.28.0.163:51531 #1283 (436 connections now open) 2015-10-05T10:57:30.208+0100 [conn1277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.208+0100 [mongosMain] connection accepted from 172.28.0.163:51532 #1284 (437 connections now open) 2015-10-05T10:57:30.209+0100 [mongosMain] connection accepted from 172.28.0.163:51533 #1285 (438 connections now open) 2015-10-05T10:57:30.210+0100 [mongosMain] connection accepted from 172.28.0.163:51534 #1286 (439 connections now open) 2015-10-05T10:57:30.210+0100 [mongosMain] connection accepted from 172.28.0.163:51535 #1287 (440 connections now open) 2015-10-05T10:57:30.210+0100 [mongosMain] connection accepted from 172.28.0.163:51536 #1288 (441 connections now open) 2015-10-05T10:57:30.210+0100 [conn1283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.211+0100 [mongosMain] connection accepted from 172.28.0.163:51537 #1289 (442 connections now open) 2015-10-05T10:57:30.211+0100 [mongosMain] connection accepted from 172.28.0.163:51538 #1290 (443 connections now open) 2015-10-05T10:57:30.211+0100 [conn1284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.212+0100 [mongosMain] connection accepted from 172.28.0.163:51540 #1291 (444 connections now open) 2015-10-05T10:57:30.212+0100 [conn1287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.212+0100 [mongosMain] connection accepted from 172.28.0.163:51539 #1292 (445 connections now open) 2015-10-05T10:57:30.212+0100 [conn1288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.213+0100 [conn1286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.213+0100 [conn1290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.214+0100 [mongosMain] connection accepted from 172.28.0.163:51541 #1293 (446 connections now open) 2015-10-05T10:57:30.214+0100 [mongosMain] connection accepted from 172.28.0.163:51542 #1294 (447 connections now open) 2015-10-05T10:57:30.214+0100 [conn1285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.216+0100 [conn1293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.216+0100 [conn1294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.216+0100 [mongosMain] connection accepted from 172.28.0.163:51544 #1295 (448 connections now open) 2015-10-05T10:57:30.216+0100 [conn1289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.216+0100 [mongosMain] connection accepted from 172.28.0.163:51543 #1296 (449 connections now open) 2015-10-05T10:57:30.218+0100 [mongosMain] connection accepted from 172.28.0.163:51545 #1297 (450 connections now open) 2015-10-05T10:57:30.218+0100 [mongosMain] connection accepted from 172.28.0.163:51546 #1298 (451 connections now open) 2015-10-05T10:57:30.218+0100 [mongosMain] connection accepted from 172.28.0.163:51547 #1299 (452 connections now open) 2015-10-05T10:57:30.219+0100 [conn1296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.220+0100 [mongosMain] connection accepted from 172.28.0.163:51548 #1300 (453 connections now open) 2015-10-05T10:57:30.221+0100 [mongosMain] connection accepted from 172.28.0.163:51549 #1301 (454 connections now open) 2015-10-05T10:57:30.222+0100 [conn1299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.223+0100 [conn1300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.224+0100 [conn1298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.226+0100 [mongosMain] connection accepted from 172.28.0.163:51550 #1302 (455 connections now open) 2015-10-05T10:57:30.226+0100 [mongosMain] connection accepted from 172.28.0.163:51551 #1303 (456 connections now open) 2015-10-05T10:57:30.226+0100 [conn1301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.226+0100 [mongosMain] connection accepted from 172.28.0.163:51552 #1304 (457 connections now open) 2015-10-05T10:57:30.227+0100 [conn1295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.228+0100 [conn1297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.228+0100 [conn1302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.229+0100 [mongosMain] connection accepted from 172.28.0.163:51553 #1305 (458 connections now open) 2015-10-05T10:57:30.230+0100 [conn1303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.230+0100 [mongosMain] connection accepted from 172.28.0.163:51554 #1306 (459 connections now open) 2015-10-05T10:57:30.230+0100 [conn1304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.231+0100 [conn1306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.233+0100 [conn1305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.233+0100 [mongosMain] connection accepted from 172.28.0.163:51555 #1307 (460 connections now open) 2015-10-05T10:57:30.234+0100 [mongosMain] connection accepted from 172.28.0.163:51556 #1308 (461 connections now open) 2015-10-05T10:57:30.234+0100 [mongosMain] connection accepted from 172.28.0.163:51557 #1309 (462 connections now open) 2015-10-05T10:57:30.235+0100 [mongosMain] connection accepted from 172.28.0.163:51558 #1310 (463 connections now open) 2015-10-05T10:57:30.236+0100 [conn1307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.237+0100 [conn1310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.237+0100 [mongosMain] connection accepted from 172.28.0.163:51559 #1311 (464 connections now open) 2015-10-05T10:57:30.237+0100 [conn1309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.240+0100 [mongosMain] connection accepted from 172.28.0.163:51560 #1312 (465 connections now open) 2015-10-05T10:57:30.240+0100 [mongosMain] connection accepted from 172.28.0.163:51561 #1313 (466 connections now open) 2015-10-05T10:57:30.240+0100 [mongosMain] connection accepted from 172.28.0.163:51562 #1314 (467 connections now open) 2015-10-05T10:57:30.242+0100 [conn1312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.242+0100 [mongosMain] connection accepted from 172.28.0.163:51563 #1315 (468 connections now open) 2015-10-05T10:57:30.243+0100 [mongosMain] connection accepted from 172.28.0.163:51564 #1316 (469 connections now open) 2015-10-05T10:57:30.243+0100 [mongosMain] connection accepted from 172.28.0.163:51565 #1317 (470 connections now open) 2015-10-05T10:57:30.244+0100 [mongosMain] connection accepted from 172.28.0.163:51566 #1318 (471 connections now open) 2015-10-05T10:57:30.246+0100 [conn1308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.246+0100 [conn1315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.247+0100 [conn1317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.248+0100 [conn1316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.248+0100 [mongosMain] connection accepted from 172.28.0.163:51567 #1319 (472 connections now open) 2015-10-05T10:57:30.249+0100 [mongosMain] connection accepted from 172.28.0.163:51568 #1320 (473 connections now open) 2015-10-05T10:57:30.250+0100 [mongosMain] connection accepted from 172.28.0.163:51569 #1321 (474 connections now open) 2015-10-05T10:57:30.250+0100 [mongosMain] connection accepted from 172.28.0.163:51570 #1322 (475 connections now open) 2015-10-05T10:57:30.251+0100 [conn1314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.252+0100 [conn1320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.252+0100 [mongosMain] connection accepted from 172.28.0.163:51571 #1323 (476 connections now open) 2015-10-05T10:57:30.252+0100 [mongosMain] connection accepted from 172.28.0.163:51572 #1324 (477 connections now open) 2015-10-05T10:57:30.253+0100 [conn1313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.253+0100 [conn1319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.254+0100 [conn1322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.254+0100 [conn1323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.255+0100 [conn1324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.256+0100 [conn1321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.256+0100 [mongosMain] connection accepted from 172.28.0.163:51573 #1325 (478 connections now open) 2015-10-05T10:57:30.257+0100 [mongosMain] connection accepted from 172.28.0.163:51574 #1326 (479 connections now open) 2015-10-05T10:57:30.258+0100 [mongosMain] connection accepted from 172.28.0.163:51575 #1327 (480 connections now open) 2015-10-05T10:57:30.260+0100 [mongosMain] connection accepted from 172.28.0.163:51576 #1328 (481 connections now open) 2015-10-05T10:57:30.262+0100 [conn1328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.262+0100 [conn1327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.265+0100 [conn1325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.266+0100 [conn1326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.267+0100 [mongosMain] connection accepted from 172.28.0.163:51577 #1329 (482 connections now open) 2015-10-05T10:57:30.267+0100 [mongosMain] connection accepted from 172.28.0.163:51578 #1330 (483 connections now open) 2015-10-05T10:57:30.269+0100 [conn1330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.269+0100 [mongosMain] connection accepted from 172.28.0.163:51579 #1331 (484 connections now open) 2015-10-05T10:57:30.269+0100 [conn1329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.273+0100 [mongosMain] connection accepted from 172.28.0.163:51580 #1332 (485 connections now open) 2015-10-05T10:57:30.273+0100 [conn1331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.275+0100 [conn1332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.276+0100 [mongosMain] connection accepted from 172.28.0.163:51581 #1333 (486 connections now open) 2015-10-05T10:57:30.277+0100 [mongosMain] connection accepted from 172.28.0.163:51582 #1334 (487 connections now open) 2015-10-05T10:57:30.277+0100 [mongosMain] connection accepted from 172.28.0.163:51583 #1335 (488 connections now open) 2015-10-05T10:57:30.278+0100 [mongosMain] connection accepted from 172.28.0.163:51584 #1336 (489 connections now open) 2015-10-05T10:57:30.279+0100 [mongosMain] connection accepted from 172.28.0.163:51586 #1337 (490 connections now open) 2015-10-05T10:57:30.279+0100 [mongosMain] connection accepted from 172.28.0.163:51587 #1338 (491 connections now open) 2015-10-05T10:57:30.280+0100 [mongosMain] connection accepted from 172.28.0.163:51589 #1339 (492 connections now open) 2015-10-05T10:57:30.282+0100 [mongosMain] connection accepted from 172.28.0.163:51590 #1340 (493 connections now open) 2015-10-05T10:57:30.283+0100 [mongosMain] connection accepted from 172.28.0.163:51591 #1341 (494 connections now open) 2015-10-05T10:57:30.284+0100 [mongosMain] connection accepted from 172.28.0.163:51592 #1342 (495 connections now open) 2015-10-05T10:57:30.284+0100 [mongosMain] connection accepted from 172.28.0.163:51593 #1343 (496 connections now open) 2015-10-05T10:57:30.284+0100 [conn1338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.284+0100 [conn1337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.286+0100 [mongosMain] connection accepted from 172.28.0.163:51594 #1344 (497 connections now open) 2015-10-05T10:57:30.286+0100 [conn1340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.287+0100 [conn1334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.287+0100 [conn1336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.289+0100 [mongosMain] connection accepted from 172.28.0.163:51596 #1345 (498 connections now open) 2015-10-05T10:57:30.289+0100 [conn1342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.289+0100 [conn1333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.290+0100 [mongosMain] connection accepted from 172.28.0.163:51597 #1346 (499 connections now open) 2015-10-05T10:57:30.291+0100 [conn1341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.292+0100 [conn1339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.292+0100 [conn1343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.293+0100 [mongosMain] connection accepted from 172.28.0.163:51600 #1347 (500 connections now open) 2015-10-05T10:57:30.293+0100 [conn1346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.295+0100 [mongosMain] connection accepted from 172.28.0.163:51604 #1348 (501 connections now open) 2015-10-05T10:57:30.295+0100 [mongosMain] connection accepted from 172.28.0.163:51605 #1349 (502 connections now open) 2015-10-05T10:57:30.297+0100 [conn1344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.297+0100 [mongosMain] connection accepted from 172.28.0.163:51607 #1350 (503 connections now open) 2015-10-05T10:57:30.298+0100 [mongosMain] connection accepted from 172.28.0.163:51611 #1351 (504 connections now open) 2015-10-05T10:57:30.298+0100 [mongosMain] connection accepted from 172.28.0.163:51612 #1352 (505 connections now open) 2015-10-05T10:57:30.299+0100 [mongosMain] connection accepted from 172.28.0.163:51613 #1353 (506 connections now open) 2015-10-05T10:57:30.299+0100 [mongosMain] connection accepted from 172.28.0.163:51614 #1354 (507 connections now open) 2015-10-05T10:57:30.299+0100 [mongosMain] connection accepted from 172.28.0.163:51616 #1355 (508 connections now open) 2015-10-05T10:57:30.300+0100 [mongosMain] connection accepted from 172.28.0.163:51618 #1356 (509 connections now open) 2015-10-05T10:57:30.301+0100 [mongosMain] connection accepted from 172.28.0.163:51619 #1357 (510 connections now open) 2015-10-05T10:57:30.301+0100 [mongosMain] connection accepted from 172.28.0.163:51620 #1358 (511 connections now open) 2015-10-05T10:57:30.302+0100 [mongosMain] connection accepted from 172.28.0.163:51621 #1359 (512 connections now open) 2015-10-05T10:57:30.303+0100 [mongosMain] connection accepted from 172.28.0.163:51623 #1360 (513 connections now open) 2015-10-05T10:57:30.303+0100 [mongosMain] connection accepted from 172.28.0.163:51624 #1361 (514 connections now open) 2015-10-05T10:57:30.305+0100 [mongosMain] connection accepted from 172.28.0.163:51627 #1362 (515 connections now open) 2015-10-05T10:57:30.306+0100 [mongosMain] connection accepted from 172.28.0.163:51629 #1363 (516 connections now open) 2015-10-05T10:57:30.306+0100 [mongosMain] connection accepted from 172.28.0.163:51630 #1364 (517 connections now open) 2015-10-05T10:57:30.307+0100 [mongosMain] connection accepted from 172.28.0.163:51632 #1365 (518 connections now open) 2015-10-05T10:57:30.309+0100 [conn1355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.309+0100 [mongosMain] connection accepted from 172.28.0.163:51634 #1366 (519 connections now open) 2015-10-05T10:57:30.310+0100 [conn1361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.311+0100 [mongosMain] connection accepted from 172.28.0.163:51638 #1367 (520 connections now open) 2015-10-05T10:57:30.313+0100 [conn1367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.315+0100 [mongosMain] connection accepted from 172.28.0.163:51641 #1368 (521 connections now open) 2015-10-05T10:57:30.316+0100 [conn1348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.316+0100 [mongosMain] connection accepted from 172.28.0.163:51644 #1369 (522 connections now open) 2015-10-05T10:57:30.316+0100 [mongosMain] connection accepted from 172.28.0.163:51645 #1370 (523 connections now open) 2015-10-05T10:57:30.317+0100 [conn1345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.320+0100 [mongosMain] connection accepted from 172.28.0.163:51649 #1371 (524 connections now open) 2015-10-05T10:57:30.322+0100 [conn1054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.325+0100 [conn1351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.326+0100 [conn1363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.326+0100 [conn1369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.327+0100 [conn1357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.328+0100 [conn1350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.329+0100 [conn1354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.329+0100 [conn1360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.330+0100 [conn1353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.333+0100 [conn1356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.345+0100 [conn1366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.345+0100 [conn1112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.346+0100 [mongosMain] connection accepted from 172.28.0.163:51671 #1372 (525 connections now open) 2015-10-05T10:57:30.362+0100 [conn1365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.392+0100 [conn1352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.392+0100 [conn1358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.393+0100 [conn1370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.398+0100 [conn1371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.412+0100 [conn1372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.430+0100 [conn1364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.431+0100 [conn1146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.554+0100 [conn1171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.596+0100 [conn1156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.609+0100 [conn1205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.618+0100 [conn1165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.754+0100 [conn1266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.766+0100 [conn1292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.771+0100 [conn1265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.776+0100 [conn1278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.831+0100 [conn1291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:30.956+0100 [conn1311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.061+0100 [conn1318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.169+0100 [conn1347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.196+0100 [conn1349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.214+0100 [conn1093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.217+0100 [conn1362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.217+0100 [conn1335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.290+0100 [conn900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.471+0100 [conn1359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:31.776+0100 [conn1368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:35.529+0100 [mongosMain] connection accepted from 172.28.0.164:57047 #1373 (526 connections now open) 2015-10-05T10:57:35.532+0100 [conn1373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:37.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124991bc91fc8b3b377644 2015-10-05T10:57:37.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:57:39.528+0100 [mongosMain] connection accepted from 127.0.0.1:51996 #1374 (527 connections now open) 2015-10-05T10:57:39.531+0100 [conn1374] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:57:39.535+0100 [conn1374] end connection 127.0.0.1:51996 (526 connections now open) 2015-10-05T10:57:43.031+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:57:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:57:50.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 5612499dbc91fc8b3b377674 2015-10-05T10:57:50.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:57:56.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249a4bc91fc8b3b37768b 2015-10-05T10:57:56.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:58:03.023+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:58:03.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:58:09.148+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444038033:41' (another update won) 2015-10-05T10:58:09.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' was not acquired. 2015-10-05T10:58:13.686+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:58:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:58:15.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249b7bc91fc8b3b377735 2015-10-05T10:58:15.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:58:28.443+0100 [mongosMain] connection accepted from 127.0.0.1:52042 #1375 (527 connections now open) 2015-10-05T10:58:28.445+0100 [conn1375] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:58:28.450+0100 [conn1375] end connection 127.0.0.1:52042 (526 connections now open) 2015-10-05T10:58:28.952+0100 [conn373] end connection 172.28.0.163:49820 (525 connections now open) 2015-10-05T10:58:28.953+0100 [mongosMain] connection accepted from 172.28.0.163:52043 #1376 (526 connections now open) 2015-10-05T10:58:28.955+0100 [conn1376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:58:35.545+0100 [mongosMain] connection accepted from 172.28.0.164:57326 #1377 (527 connections now open) 2015-10-05T10:58:35.548+0100 [conn1377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:58:39.213+0100 [mongosMain] connection accepted from 127.0.0.1:52046 #1378 (528 connections now open) 2015-10-05T10:58:39.216+0100 [conn1378] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:58:39.221+0100 [conn1378] end connection 127.0.0.1:52046 (527 connections now open) 2015-10-05T10:58:39.909+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561249ced5de43e0ed5d3bcc') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444038033:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444038033:41", when: new Date(1444039119777), why: "doing balance round", ts: ObjectId('561249cfbc91fc8b3b3777b4') } } gle1: { lastOp: Timestamp 1444039119000|3, connectionId: 36339, updatedExisting: true, n: 1, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } gle2: { lastOp: Timestamp 1444039095000|10, connectionId: 34801, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } 2015-10-05T10:58:39.913+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1444038033:41' 2015-10-05T10:58:40.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249cfbc91fc8b3b3777b4 2015-10-05T10:58:40.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:58:43.834+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:58:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:58:46.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249d6bc91fc8b3b3777e9 2015-10-05T10:58:46.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:58:52.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249dcbc91fc8b3b3777f7 2015-10-05T10:58:52.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:58:58.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249e2bc91fc8b3b377832 2015-10-05T10:58:58.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:05.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249e8bc91fc8b3b377850 2015-10-05T10:59:05.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:11.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249efbc91fc8b3b37786b 2015-10-05T10:59:11.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:14.085+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:59:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:59:17.641+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249f5bc91fc8b3b377881 2015-10-05T10:59:17.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:23.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 561249fbbc91fc8b3b3778c3 2015-10-05T10:59:24.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:29.001+0100 [conn368] end connection 172.28.0.163:49803 (526 connections now open) 2015-10-05T10:59:29.019+0100 [mongosMain] connection accepted from 172.28.0.163:52099 #1379 (527 connections now open) 2015-10-05T10:59:29.095+0100 [conn1379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:29.269+0100 [mongosMain] connection accepted from 127.0.0.1:52101 #1380 (528 connections now open) 2015-10-05T10:59:29.272+0100 [conn1380] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:29.276+0100 [conn1380] end connection 127.0.0.1:52101 (527 connections now open) 2015-10-05T10:59:30.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124a02bc91fc8b3b3779e3 2015-10-05T10:59:31.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:35.561+0100 [mongosMain] connection accepted from 172.28.0.164:57398 #1381 (528 connections now open) 2015-10-05T10:59:35.564+0100 [conn1381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:39.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124a09bc91fc8b3b377a68 2015-10-05T10:59:41.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:44.477+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:59:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444038033:41', sleeping for 30000ms 2015-10-05T10:59:46.255+0100 [mongosMain] connection accepted from 127.0.0.1:52184 #1382 (529 connections now open) 2015-10-05T10:59:46.258+0100 [conn1382] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:46.262+0100 [conn1382] end connection 127.0.0.1:52184 (528 connections now open) 2015-10-05T10:59:48.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' acquired, ts : 56124a14bc91fc8b3b377b59 2015-10-05T10:59:48.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444038033:41' unlocked. 2015-10-05T10:59:49.238+0100 [serviceShutdown] got SERVICE_CONTROL_STOP request from Windows Service Control Manager, will terminate after current cmd ends 2015-10-05T10:59:49.238+0100 [serviceShutdown] dbexit: exiting because Windows service was stopped 2015-10-05T10:59:49.239+0100 [mongosMain] dbexit: rc:48 2015-10-05T10:59:49.239+0100 Assertion failure s src\mongo\s\shardconnection.cpp 198 2015-10-05T10:59:50.580+0100 ***** SERVER RESTARTED ***** 2015-10-05T10:59:50.585+0100 Hotfix KB2731284 or later update is not installed, will zero-out data files 2015-10-05T10:59:50.586+0100 Trying to start Windows service 'MongoS' 2015-10-05T10:59:50.588+0100 Service running 2015-10-05T10:59:50.590+0100 [mongosMain] MongoS version 2.6.11 starting: pid=12004 port=27017 64-bit host=402929-MYWAPP1 (--help for usage) 2015-10-05T10:59:50.590+0100 [mongosMain] db version v2.6.11 2015-10-05T10:59:50.590+0100 [mongosMain] git version: d00c1735675c457f75a12d530bee85421f0c5548 2015-10-05T10:59:50.590+0100 [mongosMain] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 2015-10-05T10:59:50.590+0100 [mongosMain] allocator: system 2015-10-05T10:59:50.590+0100 [mongosMain] options: { security: { keyFile: "C:\mongo\mongo_keyfile" }, service: true, sharding: { configDB: "mywdb7:27019,mywdb8:27019,mywdb9:27019" }, systemLog: { destination: "file", logAppend: true, path: "c:\mongo\data\log\mongos.log" } } 2015-10-05T10:59:50.913+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:59:50.916+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:59:50.919+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:59:50.933+0100 [mongosMain] creating WriteBackListener for: mywdb7:27019 serverID: 000000000000000000000000 2015-10-05T10:59:50.937+0100 [mongosMain] creating WriteBackListener for: mywdb8:27019 serverID: 000000000000000000000000 2015-10-05T10:59:50.941+0100 [mongosMain] creating WriteBackListener for: mywdb9:27019 serverID: 000000000000000000000000 2015-10-05T10:59:50.972+0100 [mongosMain] scoped connection to mywdb7:27019,mywdb8:27019,mywdb9:27019 not being returned to the pool 2015-10-05T10:59:50.972+0100 [Balancer] about to contact config servers and shards 2015-10-05T10:59:50.972+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:59:50.972+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:59:50.974+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:59:50.974+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:59:50.976+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:59:50.976+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:59:50.984+0100 [Balancer] starting new replica set monitor for replica set replset1 with seeds mywdb7.tg-server.net:27017,mywdb8.tg-server.net:27017,mywdb9.tg-server.net:27017 2015-10-05T10:59:50.984+0100 [ReplicaSetMonitorWatcher] starting 2015-10-05T10:59:50.988+0100 [mongosMain] waiting for connections on port 27017 2015-10-05T10:59:51.003+0100 [Balancer] config servers and shards contacted successfully 2015-10-05T10:59:51.003+0100 [Balancer] balancer id: 402929-MYWAPP1:27017 started at Oct 05 10:59:51 2015-10-05T10:59:51.036+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T10:59:51.036+0100 [LockPinger] creating distributed lock ping thread for mywdb7:27019,mywdb8:27019,mywdb9:27019 and process 402929-MYWAPP1:27017:1444039191:41 (sleeping for 30000ms) 2015-10-05T10:59:51.037+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T10:59:51.039+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T10:59:51.340+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 10:59:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T10:59:51.480+0100 [mongosMain] connection accepted from 172.28.0.163:52214 #1 (1 connection now open) 2015-10-05T10:59:51.489+0100 [conn1] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:51.541+0100 [mongosMain] connection accepted from 172.28.0.163:52226 #2 (2 connections now open) 2015-10-05T10:59:51.544+0100 [conn2] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:51.557+0100 [mongosMain] connection accepted from 172.28.0.163:52228 #3 (3 connections now open) 2015-10-05T10:59:51.558+0100 [conn3] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:51.559+0100 [conn2] creating WriteBackListener for: mywdb7.tg-server.net:27017 serverID: 56124a1612deab02e297ea51 2015-10-05T10:59:51.559+0100 [mongosMain] connection accepted from 172.28.0.163:52229 #4 (4 connections now open) 2015-10-05T10:59:51.561+0100 [conn4] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:51.589+0100 [conn2] creating WriteBackListener for: mywdb8.tg-server.net:27017 serverID: 56124a1612deab02e297ea51 2015-10-05T10:59:51.589+0100 [conn2] creating WriteBackListener for: mywdb9.tg-server.net:27017 serverID: 56124a1612deab02e297ea51 2015-10-05T10:59:53.267+0100 [mongosMain] connection accepted from 172.28.0.164:57417 #5 (5 connections now open) 2015-10-05T10:59:53.269+0100 [conn5] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.278+0100 [mongosMain] connection accepted from 172.28.0.164:57421 #6 (6 connections now open) 2015-10-05T10:59:53.281+0100 [conn6] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.304+0100 [mongosMain] connection accepted from 172.28.0.164:57423 #7 (7 connections now open) 2015-10-05T10:59:53.305+0100 [mongosMain] connection accepted from 172.28.0.164:57422 #8 (8 connections now open) 2015-10-05T10:59:53.306+0100 [conn7] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.306+0100 [conn8] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.307+0100 [mongosMain] connection accepted from 172.28.0.164:57424 #9 (9 connections now open) 2015-10-05T10:59:53.307+0100 [mongosMain] connection accepted from 172.28.0.164:57425 #10 (10 connections now open) 2015-10-05T10:59:53.310+0100 [conn9] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.311+0100 [conn10] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:53.726+0100 [mongosMain] connection accepted from 172.28.0.163:52246 #11 (11 connections now open) 2015-10-05T10:59:53.727+0100 [conn11] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T10:59:57.315+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a1d12deab02e297ea68 2015-10-05T10:59:57.451+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T10:59:58.371+0100 [mongosMain] connection accepted from 172.28.0.163:52254 #12 (12 connections now open) 2015-10-05T10:59:58.377+0100 [conn12] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.618+0100 [mongosMain] connection accepted from 172.28.0.163:52268 #13 (13 connections now open) 2015-10-05T11:00:06.618+0100 [mongosMain] connection accepted from 172.28.0.163:52269 #14 (14 connections now open) 2015-10-05T11:00:06.619+0100 [conn13] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.621+0100 [conn14] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.633+0100 [mongosMain] connection accepted from 172.28.0.163:52271 #15 (15 connections now open) 2015-10-05T11:00:06.635+0100 [conn15] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.635+0100 [mongosMain] connection accepted from 172.28.0.163:52272 #16 (16 connections now open) 2015-10-05T11:00:06.637+0100 [conn16] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.641+0100 [mongosMain] connection accepted from 172.28.0.163:52274 #17 (17 connections now open) 2015-10-05T11:00:06.641+0100 [mongosMain] connection accepted from 172.28.0.163:52275 #18 (18 connections now open) 2015-10-05T11:00:06.642+0100 [mongosMain] connection accepted from 172.28.0.163:52276 #19 (19 connections now open) 2015-10-05T11:00:06.642+0100 [mongosMain] connection accepted from 172.28.0.163:52277 #20 (20 connections now open) 2015-10-05T11:00:06.642+0100 [mongosMain] connection accepted from 172.28.0.163:52278 #21 (21 connections now open) 2015-10-05T11:00:06.642+0100 [conn17] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.642+0100 [conn18] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.643+0100 [conn19] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.644+0100 [conn21] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.644+0100 [conn20] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:06.648+0100 [mongosMain] connection accepted from 172.28.0.163:52284 #22 (22 connections now open) 2015-10-05T11:00:06.650+0100 [conn22] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.337+0100 [mongosMain] connection accepted from 172.28.0.163:52291 #23 (23 connections now open) 2015-10-05T11:00:07.337+0100 [mongosMain] connection accepted from 172.28.0.163:52290 #24 (24 connections now open) 2015-10-05T11:00:07.337+0100 [mongosMain] connection accepted from 172.28.0.163:52292 #25 (25 connections now open) 2015-10-05T11:00:07.338+0100 [conn23] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.338+0100 [conn24] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.339+0100 [conn25] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.775+0100 [mongosMain] connection accepted from 172.28.0.163:52300 #26 (26 connections now open) 2015-10-05T11:00:07.776+0100 [conn26] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.780+0100 [mongosMain] connection accepted from 172.28.0.163:52301 #27 (27 connections now open) 2015-10-05T11:00:07.781+0100 [conn27] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.782+0100 [mongosMain] connection accepted from 172.28.0.163:52302 #28 (28 connections now open) 2015-10-05T11:00:07.782+0100 [mongosMain] connection accepted from 172.28.0.163:52303 #29 (29 connections now open) 2015-10-05T11:00:07.783+0100 [mongosMain] connection accepted from 172.28.0.163:52304 #30 (30 connections now open) 2015-10-05T11:00:07.783+0100 [conn28] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.783+0100 [mongosMain] connection accepted from 172.28.0.163:52305 #31 (31 connections now open) 2015-10-05T11:00:07.784+0100 [conn29] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.784+0100 [conn30] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.784+0100 [conn31] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.785+0100 [mongosMain] connection accepted from 172.28.0.163:52307 #32 (32 connections now open) 2015-10-05T11:00:07.786+0100 [conn32] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.788+0100 [mongosMain] connection accepted from 172.28.0.163:52309 #33 (33 connections now open) 2015-10-05T11:00:07.788+0100 [mongosMain] connection accepted from 172.28.0.163:52310 #34 (34 connections now open) 2015-10-05T11:00:07.789+0100 [mongosMain] connection accepted from 172.28.0.163:52311 #35 (35 connections now open) 2015-10-05T11:00:07.789+0100 [conn33] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.789+0100 [conn34] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:07.790+0100 [conn35] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.523+0100 [mongosMain] connection accepted from 172.28.0.163:52322 #36 (36 connections now open) 2015-10-05T11:00:08.525+0100 [conn36] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.532+0100 [mongosMain] connection accepted from 172.28.0.163:52323 #37 (37 connections now open) 2015-10-05T11:00:08.533+0100 [conn37] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.544+0100 [mongosMain] connection accepted from 172.28.0.163:52324 #38 (38 connections now open) 2015-10-05T11:00:08.544+0100 [mongosMain] connection accepted from 172.28.0.163:52325 #39 (39 connections now open) 2015-10-05T11:00:08.549+0100 [conn39] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.549+0100 [conn38] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.550+0100 [mongosMain] connection accepted from 172.28.0.163:52327 #40 (40 connections now open) 2015-10-05T11:00:08.550+0100 [mongosMain] connection accepted from 172.28.0.163:52328 #41 (41 connections now open) 2015-10-05T11:00:08.551+0100 [mongosMain] connection accepted from 172.28.0.163:52329 #42 (42 connections now open) 2015-10-05T11:00:08.552+0100 [conn40] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.552+0100 [conn41] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.553+0100 [conn42] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.569+0100 [mongosMain] connection accepted from 172.28.0.163:52333 #43 (43 connections now open) 2015-10-05T11:00:08.576+0100 [conn43] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.576+0100 [mongosMain] connection accepted from 172.28.0.163:52334 #44 (44 connections now open) 2015-10-05T11:00:08.576+0100 [mongosMain] connection accepted from 172.28.0.163:52335 #45 (45 connections now open) 2015-10-05T11:00:08.576+0100 [mongosMain] connection accepted from 172.28.0.163:52336 #46 (46 connections now open) 2015-10-05T11:00:08.577+0100 [conn45] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.577+0100 [conn44] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.578+0100 [conn46] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.597+0100 [mongosMain] connection accepted from 172.28.0.163:52341 #47 (47 connections now open) 2015-10-05T11:00:08.599+0100 [conn47] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.623+0100 [mongosMain] connection accepted from 172.28.0.163:52343 #48 (48 connections now open) 2015-10-05T11:00:08.624+0100 [mongosMain] connection accepted from 172.28.0.163:52344 #49 (49 connections now open) 2015-10-05T11:00:08.625+0100 [conn48] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.625+0100 [conn49] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.630+0100 [mongosMain] connection accepted from 172.28.0.163:52347 #50 (50 connections now open) 2015-10-05T11:00:08.631+0100 [mongosMain] connection accepted from 172.28.0.163:52348 #51 (51 connections now open) 2015-10-05T11:00:08.632+0100 [conn50] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.632+0100 [conn51] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.635+0100 [mongosMain] connection accepted from 172.28.0.163:52351 #52 (52 connections now open) 2015-10-05T11:00:08.636+0100 [mongosMain] connection accepted from 172.28.0.163:52352 #53 (53 connections now open) 2015-10-05T11:00:08.636+0100 [conn52] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.637+0100 [conn53] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.641+0100 [mongosMain] connection accepted from 172.28.0.163:52355 #54 (54 connections now open) 2015-10-05T11:00:08.642+0100 [mongosMain] connection accepted from 172.28.0.163:52356 #55 (55 connections now open) 2015-10-05T11:00:08.642+0100 [conn54] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.643+0100 [mongosMain] connection accepted from 172.28.0.163:52357 #56 (56 connections now open) 2015-10-05T11:00:08.643+0100 [conn55] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.644+0100 [conn56] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.645+0100 [mongosMain] connection accepted from 172.28.0.163:52360 #57 (57 connections now open) 2015-10-05T11:00:08.646+0100 [conn57] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.647+0100 [mongosMain] connection accepted from 172.28.0.163:52362 #58 (58 connections now open) 2015-10-05T11:00:08.648+0100 [conn58] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.652+0100 [mongosMain] connection accepted from 172.28.0.163:52365 #59 (59 connections now open) 2015-10-05T11:00:08.653+0100 [conn59] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.658+0100 [mongosMain] connection accepted from 172.28.0.163:52367 #60 (60 connections now open) 2015-10-05T11:00:08.659+0100 [conn60] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.663+0100 [mongosMain] connection accepted from 172.28.0.163:52369 #61 (61 connections now open) 2015-10-05T11:00:08.665+0100 [conn61] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.666+0100 [mongosMain] connection accepted from 172.28.0.163:52370 #62 (62 connections now open) 2015-10-05T11:00:08.667+0100 [mongosMain] connection accepted from 172.28.0.163:52372 #63 (63 connections now open) 2015-10-05T11:00:08.667+0100 [mongosMain] connection accepted from 172.28.0.163:52373 #64 (64 connections now open) 2015-10-05T11:00:08.668+0100 [conn62] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.668+0100 [mongosMain] connection accepted from 172.28.0.163:52374 #65 (65 connections now open) 2015-10-05T11:00:08.668+0100 [conn64] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.668+0100 [conn63] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.669+0100 [conn65] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.671+0100 [mongosMain] connection accepted from 172.28.0.163:52378 #66 (66 connections now open) 2015-10-05T11:00:08.671+0100 [mongosMain] connection accepted from 172.28.0.163:52379 #67 (67 connections now open) 2015-10-05T11:00:08.671+0100 [mongosMain] connection accepted from 172.28.0.163:52380 #68 (68 connections now open) 2015-10-05T11:00:08.671+0100 [mongosMain] connection accepted from 172.28.0.163:52382 #69 (69 connections now open) 2015-10-05T11:00:08.672+0100 [mongosMain] connection accepted from 172.28.0.163:52383 #70 (70 connections now open) 2015-10-05T11:00:08.672+0100 [conn66] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.672+0100 [conn67] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.672+0100 [conn68] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.673+0100 [conn69] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.673+0100 [conn70] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.677+0100 [mongosMain] connection accepted from 172.28.0.163:52390 #71 (71 connections now open) 2015-10-05T11:00:08.678+0100 [conn71] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.679+0100 [mongosMain] connection accepted from 172.28.0.163:52392 #72 (72 connections now open) 2015-10-05T11:00:08.680+0100 [conn72] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.685+0100 [mongosMain] connection accepted from 172.28.0.163:52395 #73 (73 connections now open) 2015-10-05T11:00:08.686+0100 [conn73] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.691+0100 [mongosMain] connection accepted from 172.28.0.163:52397 #74 (74 connections now open) 2015-10-05T11:00:08.692+0100 [conn74] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.694+0100 [mongosMain] connection accepted from 172.28.0.163:52399 #75 (75 connections now open) 2015-10-05T11:00:08.695+0100 [conn75] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.698+0100 [mongosMain] connection accepted from 172.28.0.163:52401 #76 (76 connections now open) 2015-10-05T11:00:08.699+0100 [conn76] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.707+0100 [mongosMain] connection accepted from 172.28.0.163:52403 #77 (77 connections now open) 2015-10-05T11:00:08.708+0100 [mongosMain] connection accepted from 172.28.0.163:52404 #78 (78 connections now open) 2015-10-05T11:00:08.709+0100 [conn77] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.710+0100 [conn78] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.710+0100 [mongosMain] connection accepted from 172.28.0.163:52405 #79 (79 connections now open) 2015-10-05T11:00:08.712+0100 [conn79] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.715+0100 [mongosMain] connection accepted from 172.28.0.163:52409 #80 (80 connections now open) 2015-10-05T11:00:08.716+0100 [conn80] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.727+0100 [mongosMain] connection accepted from 172.28.0.163:52411 #81 (81 connections now open) 2015-10-05T11:00:08.729+0100 [conn81] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.730+0100 [mongosMain] connection accepted from 172.28.0.163:52412 #82 (82 connections now open) 2015-10-05T11:00:08.731+0100 [conn82] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.748+0100 [mongosMain] connection accepted from 172.28.0.163:52415 #83 (83 connections now open) 2015-10-05T11:00:08.750+0100 [conn83] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.755+0100 [mongosMain] connection accepted from 172.28.0.163:52417 #84 (84 connections now open) 2015-10-05T11:00:08.757+0100 [conn84] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.765+0100 [mongosMain] connection accepted from 172.28.0.163:52419 #85 (85 connections now open) 2015-10-05T11:00:08.767+0100 [conn85] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.773+0100 [mongosMain] connection accepted from 172.28.0.163:52421 #86 (86 connections now open) 2015-10-05T11:00:08.775+0100 [conn86] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.788+0100 [mongosMain] connection accepted from 172.28.0.163:52423 #87 (87 connections now open) 2015-10-05T11:00:08.791+0100 [conn87] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.792+0100 [mongosMain] connection accepted from 172.28.0.163:52424 #88 (88 connections now open) 2015-10-05T11:00:08.794+0100 [conn88] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.797+0100 [mongosMain] connection accepted from 172.28.0.163:52427 #89 (89 connections now open) 2015-10-05T11:00:08.799+0100 [conn89] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.867+0100 [mongosMain] connection accepted from 172.28.0.163:52429 #90 (90 connections now open) 2015-10-05T11:00:08.869+0100 [conn90] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.877+0100 [mongosMain] connection accepted from 172.28.0.163:52431 #91 (91 connections now open) 2015-10-05T11:00:08.879+0100 [conn91] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.885+0100 [mongosMain] connection accepted from 172.28.0.163:52433 #92 (92 connections now open) 2015-10-05T11:00:08.887+0100 [conn92] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.895+0100 [mongosMain] connection accepted from 172.28.0.163:52435 #93 (93 connections now open) 2015-10-05T11:00:08.897+0100 [conn93] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.925+0100 [mongosMain] connection accepted from 172.28.0.163:52439 #94 (94 connections now open) 2015-10-05T11:00:08.927+0100 [conn94] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.932+0100 [mongosMain] connection accepted from 172.28.0.163:52441 #95 (95 connections now open) 2015-10-05T11:00:08.934+0100 [conn95] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.946+0100 [mongosMain] connection accepted from 172.28.0.163:52443 #96 (96 connections now open) 2015-10-05T11:00:08.948+0100 [conn96] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.950+0100 [mongosMain] connection accepted from 172.28.0.163:52444 #97 (97 connections now open) 2015-10-05T11:00:08.951+0100 [mongosMain] connection accepted from 172.28.0.163:52445 #98 (98 connections now open) 2015-10-05T11:00:08.952+0100 [conn97] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.952+0100 [conn98] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.959+0100 [mongosMain] connection accepted from 172.28.0.163:52449 #99 (99 connections now open) 2015-10-05T11:00:08.961+0100 [conn99] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.967+0100 [mongosMain] connection accepted from 172.28.0.163:52451 #100 (100 connections now open) 2015-10-05T11:00:08.969+0100 [conn100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.973+0100 [mongosMain] connection accepted from 172.28.0.163:52453 #101 (101 connections now open) 2015-10-05T11:00:08.974+0100 [mongosMain] connection accepted from 172.28.0.163:52454 #102 (102 connections now open) 2015-10-05T11:00:08.975+0100 [mongosMain] connection accepted from 172.28.0.163:52455 #103 (103 connections now open) 2015-10-05T11:00:08.975+0100 [conn101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.976+0100 [conn102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.976+0100 [conn103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.981+0100 [mongosMain] connection accepted from 172.28.0.163:52459 #104 (104 connections now open) 2015-10-05T11:00:08.983+0100 [conn104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.991+0100 [mongosMain] connection accepted from 172.28.0.163:52461 #105 (105 connections now open) 2015-10-05T11:00:08.994+0100 [conn105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.995+0100 [mongosMain] connection accepted from 172.28.0.163:52462 #106 (106 connections now open) 2015-10-05T11:00:08.995+0100 [mongosMain] connection accepted from 172.28.0.163:52463 #107 (107 connections now open) 2015-10-05T11:00:08.996+0100 [mongosMain] connection accepted from 172.28.0.163:52464 #108 (108 connections now open) 2015-10-05T11:00:08.996+0100 [conn106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.996+0100 [mongosMain] connection accepted from 172.28.0.163:52465 #109 (109 connections now open) 2015-10-05T11:00:08.997+0100 [conn107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.997+0100 [conn108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:08.997+0100 [conn109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.015+0100 [mongosMain] connection accepted from 172.28.0.163:52471 #110 (110 connections now open) 2015-10-05T11:00:09.017+0100 [conn110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.052+0100 [mongosMain] connection accepted from 172.28.0.163:52473 #111 (111 connections now open) 2015-10-05T11:00:09.054+0100 [conn111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.071+0100 [mongosMain] connection accepted from 172.28.0.163:52475 #112 (112 connections now open) 2015-10-05T11:00:09.072+0100 [mongosMain] connection accepted from 172.28.0.163:52476 #113 (113 connections now open) 2015-10-05T11:00:09.072+0100 [mongosMain] connection accepted from 172.28.0.163:52477 #114 (114 connections now open) 2015-10-05T11:00:09.073+0100 [conn112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.073+0100 [conn113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.074+0100 [conn114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.080+0100 [mongosMain] connection accepted from 172.28.0.163:52481 #115 (115 connections now open) 2015-10-05T11:00:09.081+0100 [conn115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.085+0100 [mongosMain] connection accepted from 172.28.0.163:52483 #116 (116 connections now open) 2015-10-05T11:00:09.086+0100 [conn116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.099+0100 [mongosMain] connection accepted from 172.28.0.163:52485 #117 (117 connections now open) 2015-10-05T11:00:09.100+0100 [mongosMain] connection accepted from 172.28.0.163:52486 #118 (118 connections now open) 2015-10-05T11:00:09.102+0100 [conn117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.102+0100 [conn118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.105+0100 [mongosMain] connection accepted from 172.28.0.163:52489 #119 (119 connections now open) 2015-10-05T11:00:09.107+0100 [conn119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.113+0100 [mongosMain] connection accepted from 172.28.0.163:52491 #120 (120 connections now open) 2015-10-05T11:00:09.114+0100 [conn120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.114+0100 [mongosMain] connection accepted from 172.28.0.163:52492 #121 (121 connections now open) 2015-10-05T11:00:09.116+0100 [conn121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.133+0100 [mongosMain] connection accepted from 172.28.0.163:52495 #122 (122 connections now open) 2015-10-05T11:00:09.134+0100 [mongosMain] connection accepted from 172.28.0.163:52496 #123 (123 connections now open) 2015-10-05T11:00:09.135+0100 [conn122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.136+0100 [conn123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.154+0100 [mongosMain] connection accepted from 172.28.0.163:52499 #124 (124 connections now open) 2015-10-05T11:00:09.155+0100 [mongosMain] connection accepted from 172.28.0.163:52500 #125 (125 connections now open) 2015-10-05T11:00:09.156+0100 [conn124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.157+0100 [conn125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.162+0100 [mongosMain] connection accepted from 172.28.0.163:52503 #126 (126 connections now open) 2015-10-05T11:00:09.164+0100 [conn126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.165+0100 [mongosMain] connection accepted from 172.28.0.163:52504 #127 (127 connections now open) 2015-10-05T11:00:09.167+0100 [conn127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.181+0100 [mongosMain] connection accepted from 172.28.0.163:52507 #128 (128 connections now open) 2015-10-05T11:00:09.183+0100 [conn128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.204+0100 [mongosMain] connection accepted from 172.28.0.163:52509 #129 (129 connections now open) 2015-10-05T11:00:09.206+0100 [conn129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.226+0100 [mongosMain] connection accepted from 172.28.0.163:52511 #130 (130 connections now open) 2015-10-05T11:00:09.228+0100 [conn130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.230+0100 [mongosMain] connection accepted from 172.28.0.163:52512 #131 (131 connections now open) 2015-10-05T11:00:09.230+0100 [mongosMain] connection accepted from 172.28.0.163:52514 #132 (132 connections now open) 2015-10-05T11:00:09.232+0100 [conn131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.232+0100 [conn132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.243+0100 [mongosMain] connection accepted from 172.28.0.163:52517 #133 (133 connections now open) 2015-10-05T11:00:09.245+0100 [conn133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.259+0100 [mongosMain] connection accepted from 172.28.0.163:52519 #134 (134 connections now open) 2015-10-05T11:00:09.261+0100 [conn134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.266+0100 [mongosMain] connection accepted from 172.28.0.163:52521 #135 (135 connections now open) 2015-10-05T11:00:09.268+0100 [conn135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.307+0100 [mongosMain] connection accepted from 172.28.0.163:52523 #136 (136 connections now open) 2015-10-05T11:00:09.307+0100 [mongosMain] connection accepted from 172.28.0.163:52524 #137 (137 connections now open) 2015-10-05T11:00:09.309+0100 [conn137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.309+0100 [conn136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.309+0100 [mongosMain] connection accepted from 172.28.0.163:52525 #138 (138 connections now open) 2015-10-05T11:00:09.310+0100 [conn138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.312+0100 [mongosMain] connection accepted from 172.28.0.163:52529 #139 (139 connections now open) 2015-10-05T11:00:09.314+0100 [conn139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.316+0100 [mongosMain] connection accepted from 172.28.0.163:52531 #140 (140 connections now open) 2015-10-05T11:00:09.318+0100 [conn140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.318+0100 [mongosMain] connection accepted from 172.28.0.163:52532 #141 (141 connections now open) 2015-10-05T11:00:09.319+0100 [conn141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.327+0100 [mongosMain] connection accepted from 172.28.0.163:52535 #142 (142 connections now open) 2015-10-05T11:00:09.328+0100 [conn142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.333+0100 [mongosMain] connection accepted from 172.28.0.163:52537 #143 (143 connections now open) 2015-10-05T11:00:09.335+0100 [conn143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.339+0100 [mongosMain] connection accepted from 172.28.0.163:52539 #144 (144 connections now open) 2015-10-05T11:00:09.341+0100 [conn144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.347+0100 [mongosMain] connection accepted from 172.28.0.163:52541 #145 (145 connections now open) 2015-10-05T11:00:09.348+0100 [conn145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.349+0100 [mongosMain] connection accepted from 172.28.0.163:52542 #146 (146 connections now open) 2015-10-05T11:00:09.350+0100 [conn146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.407+0100 [mongosMain] connection accepted from 172.28.0.163:52545 #147 (147 connections now open) 2015-10-05T11:00:09.408+0100 [mongosMain] connection accepted from 172.28.0.163:52546 #148 (148 connections now open) 2015-10-05T11:00:09.410+0100 [conn147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.410+0100 [mongosMain] connection accepted from 172.28.0.163:52547 #149 (149 connections now open) 2015-10-05T11:00:09.410+0100 [conn148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.412+0100 [conn149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.428+0100 [mongosMain] connection accepted from 172.28.0.163:52552 #150 (150 connections now open) 2015-10-05T11:00:09.428+0100 [mongosMain] connection accepted from 172.28.0.163:52553 #151 (151 connections now open) 2015-10-05T11:00:09.429+0100 [mongosMain] connection accepted from 172.28.0.163:52554 #152 (152 connections now open) 2015-10-05T11:00:09.429+0100 [mongosMain] connection accepted from 172.28.0.163:52555 #153 (153 connections now open) 2015-10-05T11:00:09.429+0100 [conn150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.430+0100 [conn151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.430+0100 [conn152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.431+0100 [conn153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.431+0100 [mongosMain] connection accepted from 172.28.0.163:52557 #154 (154 connections now open) 2015-10-05T11:00:09.431+0100 [mongosMain] connection accepted from 172.28.0.163:52558 #155 (155 connections now open) 2015-10-05T11:00:09.432+0100 [mongosMain] connection accepted from 172.28.0.163:52561 #156 (156 connections now open) 2015-10-05T11:00:09.433+0100 [conn154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.433+0100 [conn155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.433+0100 [conn156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.437+0100 [mongosMain] connection accepted from 172.28.0.163:52566 #157 (157 connections now open) 2015-10-05T11:00:09.438+0100 [conn157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.449+0100 [mongosMain] connection accepted from 172.28.0.163:52568 #158 (158 connections now open) 2015-10-05T11:00:09.450+0100 [conn158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.476+0100 [mongosMain] connection accepted from 172.28.0.163:52570 #159 (159 connections now open) 2015-10-05T11:00:09.478+0100 [conn159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.479+0100 [mongosMain] connection accepted from 172.28.0.163:52571 #160 (160 connections now open) 2015-10-05T11:00:09.480+0100 [conn160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.481+0100 [mongosMain] connection accepted from 172.28.0.163:52573 #161 (161 connections now open) 2015-10-05T11:00:09.482+0100 [conn161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.496+0100 [mongosMain] connection accepted from 172.28.0.163:52576 #162 (162 connections now open) 2015-10-05T11:00:09.497+0100 [mongosMain] connection accepted from 172.28.0.163:52577 #163 (163 connections now open) 2015-10-05T11:00:09.498+0100 [conn162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.499+0100 [conn163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.509+0100 [mongosMain] connection accepted from 172.28.0.163:52580 #164 (164 connections now open) 2015-10-05T11:00:09.511+0100 [conn164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.519+0100 [mongosMain] connection accepted from 172.28.0.163:52582 #165 (165 connections now open) 2015-10-05T11:00:09.520+0100 [mongosMain] connection accepted from 172.28.0.163:52583 #166 (166 connections now open) 2015-10-05T11:00:09.521+0100 [conn165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.521+0100 [conn166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.525+0100 [mongosMain] connection accepted from 172.28.0.163:52586 #167 (167 connections now open) 2015-10-05T11:00:09.527+0100 [conn167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.554+0100 [mongosMain] connection accepted from 172.28.0.163:52588 #168 (168 connections now open) 2015-10-05T11:00:09.556+0100 [conn168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.571+0100 [mongosMain] connection accepted from 172.28.0.163:52590 #169 (169 connections now open) 2015-10-05T11:00:09.573+0100 [conn169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.574+0100 [mongosMain] connection accepted from 172.28.0.163:52591 #170 (170 connections now open) 2015-10-05T11:00:09.575+0100 [conn170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.582+0100 [mongosMain] connection accepted from 172.28.0.163:52594 #171 (171 connections now open) 2015-10-05T11:00:09.582+0100 [mongosMain] connection accepted from 172.28.0.163:52595 #172 (172 connections now open) 2015-10-05T11:00:09.583+0100 [mongosMain] connection accepted from 172.28.0.163:52596 #173 (173 connections now open) 2015-10-05T11:00:09.583+0100 [conn171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.584+0100 [conn172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.584+0100 [conn173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.593+0100 [mongosMain] connection accepted from 172.28.0.163:52600 #174 (174 connections now open) 2015-10-05T11:00:09.595+0100 [conn174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.599+0100 [mongosMain] connection accepted from 172.28.0.163:52602 #175 (175 connections now open) 2015-10-05T11:00:09.601+0100 [conn175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.609+0100 [mongosMain] connection accepted from 172.28.0.163:52604 #176 (176 connections now open) 2015-10-05T11:00:09.610+0100 [conn176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.628+0100 [mongosMain] connection accepted from 172.28.0.163:52606 #177 (177 connections now open) 2015-10-05T11:00:09.630+0100 [conn177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.656+0100 [mongosMain] connection accepted from 172.28.0.163:52608 #178 (178 connections now open) 2015-10-05T11:00:09.658+0100 [conn178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.674+0100 [mongosMain] connection accepted from 172.28.0.163:52610 #179 (179 connections now open) 2015-10-05T11:00:09.676+0100 [conn179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.678+0100 [mongosMain] connection accepted from 172.28.0.163:52611 #180 (180 connections now open) 2015-10-05T11:00:09.679+0100 [mongosMain] connection accepted from 172.28.0.163:52613 #181 (181 connections now open) 2015-10-05T11:00:09.680+0100 [conn180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.681+0100 [conn181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.693+0100 [mongosMain] connection accepted from 172.28.0.163:52616 #182 (182 connections now open) 2015-10-05T11:00:09.693+0100 [mongosMain] connection accepted from 172.28.0.163:52617 #183 (183 connections now open) 2015-10-05T11:00:09.695+0100 [conn182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:09.696+0100 [conn183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:10.253+0100 [mongosMain] connection accepted from 172.28.0.164:57497 #184 (184 connections now open) 2015-10-05T11:00:10.254+0100 [mongosMain] connection accepted from 172.28.0.164:57498 #185 (185 connections now open) 2015-10-05T11:00:10.255+0100 [mongosMain] connection accepted from 172.28.0.164:57499 #186 (186 connections now open) 2015-10-05T11:00:10.255+0100 [mongosMain] connection accepted from 172.28.0.164:57500 #187 (187 connections now open) 2015-10-05T11:00:10.255+0100 [mongosMain] connection accepted from 172.28.0.164:57501 #188 (188 connections now open) 2015-10-05T11:00:10.259+0100 [conn185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:10.261+0100 [conn186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:10.261+0100 [conn188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:10.262+0100 [conn184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:10.264+0100 [conn187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:15.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a2f12deab02e297eabd 2015-10-05T11:00:15.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:00:21.502+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:00:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:00:22.087+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a3512deab02e297ead3 2015-10-05T11:00:22.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:00:28.487+0100 [mongosMain] connection accepted from 127.0.0.1:52734 #189 (189 connections now open) 2015-10-05T11:00:28.499+0100 [conn189] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:28.520+0100 [conn189] end connection 127.0.0.1:52734 (188 connections now open) 2015-10-05T11:00:29.110+0100 [mongosMain] connection accepted from 172.28.0.163:52735 #190 (189 connections now open) 2015-10-05T11:00:29.112+0100 [conn190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:29.114+0100 [mongosMain] connection accepted from 172.28.0.163:52736 #191 (190 connections now open) 2015-10-05T11:00:29.116+0100 [conn191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:29.117+0100 [mongosMain] connection accepted from 172.28.0.163:52737 #192 (191 connections now open) 2015-10-05T11:00:29.119+0100 [conn192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:35.577+0100 [mongosMain] connection accepted from 172.28.0.164:57584 #193 (192 connections now open) 2015-10-05T11:00:35.580+0100 [conn193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:35.582+0100 [mongosMain] connection accepted from 172.28.0.164:57585 #194 (193 connections now open) 2015-10-05T11:00:35.584+0100 [conn194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:40.135+0100 [mongosMain] connection accepted from 127.0.0.1:52745 #195 (194 connections now open) 2015-10-05T11:00:40.138+0100 [conn195] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:00:40.142+0100 [conn195] end connection 127.0.0.1:52745 (193 connections now open) 2015-10-05T11:00:46.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a4e12deab02e297eb0f 2015-10-05T11:00:46.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:00:51.756+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:00:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:01:05.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a6012deab02e297eb47 2015-10-05T11:01:05.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:18.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a6d12deab02e297eb79 2015-10-05T11:01:19.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:22.040+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:01:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:01:26.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a7512deab02e297eb8c 2015-10-05T11:01:26.103+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:28.223+0100 [mongosMain] connection accepted from 127.0.0.1:52815 #196 (194 connections now open) 2015-10-05T11:01:28.225+0100 [conn196] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:01:28.231+0100 [conn196] end connection 127.0.0.1:52815 (193 connections now open) 2015-10-05T11:01:29.125+0100 [mongosMain] connection accepted from 172.28.0.163:52816 #197 (194 connections now open) 2015-10-05T11:01:29.127+0100 [conn197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:01:32.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a7c12deab02e297eb91 2015-10-05T11:01:32.524+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:35.594+0100 [mongosMain] connection accepted from 172.28.0.164:57729 #198 (195 connections now open) 2015-10-05T11:01:35.597+0100 [conn198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:01:38.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a8212deab02e297ebab 2015-10-05T11:01:38.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:39.728+0100 [mongosMain] connection accepted from 127.0.0.1:52825 #199 (196 connections now open) 2015-10-05T11:01:39.731+0100 [conn199] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:01:39.735+0100 [conn199] end connection 127.0.0.1:52825 (195 connections now open) 2015-10-05T11:01:45.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a8812deab02e297ebc8 2015-10-05T11:01:45.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:51.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a8f12deab02e297ebdb 2015-10-05T11:01:51.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:01:52.315+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:01:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:01:57.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124a9512deab02e297ebf0 2015-10-05T11:01:57.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:02:10.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124aa112deab02e297ec0e 2015-10-05T11:02:10.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:02:22.570+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:02:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:02:28.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ab412deab02e297ec47 2015-10-05T11:02:28.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:02:29.047+0100 [mongosMain] connection accepted from 127.0.0.1:52871 #200 (196 connections now open) 2015-10-05T11:02:29.050+0100 [conn200] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:02:29.055+0100 [conn200] end connection 127.0.0.1:52871 (195 connections now open) 2015-10-05T11:02:29.143+0100 [mongosMain] connection accepted from 172.28.0.163:52872 #201 (196 connections now open) 2015-10-05T11:02:29.144+0100 [conn201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:02:35.611+0100 [mongosMain] connection accepted from 172.28.0.164:57782 #202 (197 connections now open) 2015-10-05T11:02:35.614+0100 [conn202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:02:39.773+0100 [mongosMain] connection accepted from 127.0.0.1:52877 #203 (198 connections now open) 2015-10-05T11:02:39.779+0100 [conn203] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:02:39.788+0100 [conn203] end connection 127.0.0.1:52877 (197 connections now open) 2015-10-05T11:02:40.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ac012deab02e297ec6b 2015-10-05T11:02:41.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:02:52.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:02:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:02:53.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124acd12deab02e297ec95 2015-10-05T11:02:53.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:05.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ad912deab02e297ecc8 2015-10-05T11:03:05.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:18.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ae512deab02e297ed0e 2015-10-05T11:03:18.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:23.023+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:03:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:03:24.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124aec12deab02e297ed3a 2015-10-05T11:03:24.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:28.193+0100 [mongosMain] connection accepted from 127.0.0.1:53006 #204 (198 connections now open) 2015-10-05T11:03:28.196+0100 [conn204] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:03:28.201+0100 [conn204] end connection 127.0.0.1:53006 (197 connections now open) 2015-10-05T11:03:29.159+0100 [mongosMain] connection accepted from 172.28.0.163:53007 #205 (198 connections now open) 2015-10-05T11:03:29.161+0100 [conn205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:03:30.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124af212deab02e297ed47 2015-10-05T11:03:30.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:35.625+0100 [mongosMain] connection accepted from 172.28.0.164:57952 #206 (199 connections now open) 2015-10-05T11:03:35.628+0100 [conn206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:03:37.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124af912deab02e297ed58 2015-10-05T11:03:37.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:39.231+0100 [mongosMain] connection accepted from 127.0.0.1:53019 #207 (200 connections now open) 2015-10-05T11:03:39.233+0100 [conn207] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:03:39.237+0100 [conn207] end connection 127.0.0.1:53019 (199 connections now open) 2015-10-05T11:03:43.807+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124aff12deab02e297ed75 2015-10-05T11:03:43.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:50.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b0512deab02e297ed88 2015-10-05T11:03:50.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:03:53.312+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:03:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:03:56.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b0c12deab02e297ed9c 2015-10-05T11:03:56.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:03.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b1212deab02e297edb7 2015-10-05T11:04:03.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:09.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b1912deab02e297edc9 2015-10-05T11:04:09.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:15.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b1f12deab02e297eddb 2015-10-05T11:04:16.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:22.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b2612deab02e297ee00 2015-10-05T11:04:22.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:24.135+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:04:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:04:28.394+0100 [mongosMain] connection accepted from 127.0.0.1:53063 #208 (200 connections now open) 2015-10-05T11:04:28.397+0100 [conn208] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:04:28.403+0100 [conn208] end connection 127.0.0.1:53063 (199 connections now open) 2015-10-05T11:04:28.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b2c12deab02e297ee17 2015-10-05T11:04:28.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:29.174+0100 [mongosMain] connection accepted from 172.28.0.163:53064 #209 (200 connections now open) 2015-10-05T11:04:29.176+0100 [conn209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:04:35.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b3212deab02e297ee28 2015-10-05T11:04:35.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:35.642+0100 [mongosMain] connection accepted from 172.28.0.164:58015 #210 (201 connections now open) 2015-10-05T11:04:35.645+0100 [conn210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:04:39.855+0100 [mongosMain] connection accepted from 127.0.0.1:53069 #211 (202 connections now open) 2015-10-05T11:04:39.860+0100 [conn211] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:04:39.863+0100 [conn211] end connection 127.0.0.1:53069 (201 connections now open) 2015-10-05T11:04:41.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b3912deab02e297ee3f 2015-10-05T11:04:41.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:47.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b3f12deab02e297ee77 2015-10-05T11:04:48.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:04:54.629+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:04:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:04:54.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b4612deab02e297ee9c 2015-10-05T11:04:54.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:07.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b5212deab02e297ef0c 2015-10-05T11:05:07.199+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:13.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b5912deab02e297ef45 2015-10-05T11:05:13.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:19.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b5f12deab02e297efdc 2015-10-05T11:05:19.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:25.728+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:05:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:05:26.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b6512deab02e297f012 2015-10-05T11:05:26.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:28.924+0100 [mongosMain] connection accepted from 127.0.0.1:53128 #212 (202 connections now open) 2015-10-05T11:05:28.928+0100 [conn212] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:05:28.932+0100 [conn212] end connection 127.0.0.1:53128 (201 connections now open) 2015-10-05T11:05:29.190+0100 [mongosMain] connection accepted from 172.28.0.163:53129 #213 (202 connections now open) 2015-10-05T11:05:29.192+0100 [conn213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:05:32.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b6c12deab02e297f062 2015-10-05T11:05:32.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:35.658+0100 [mongosMain] connection accepted from 172.28.0.164:58099 #214 (203 connections now open) 2015-10-05T11:05:35.665+0100 [conn214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:05:38.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b7212deab02e297f08a 2015-10-05T11:05:38.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:40.065+0100 [mongosMain] connection accepted from 127.0.0.1:53134 #215 (204 connections now open) 2015-10-05T11:05:40.068+0100 [conn215] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:05:40.072+0100 [conn215] end connection 127.0.0.1:53134 (203 connections now open) 2015-10-05T11:05:44.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b7812deab02e297f0d4 2015-10-05T11:05:45.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:51.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b7f12deab02e297f10a 2015-10-05T11:05:51.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:05:55.988+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:05:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:05:57.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b8512deab02e297f136 2015-10-05T11:05:57.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:03.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b8b12deab02e297f16c 2015-10-05T11:06:03.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:10.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b9112deab02e297f19a 2015-10-05T11:06:10.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:16.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b9812deab02e297f1cb 2015-10-05T11:06:16.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:22.524+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124b9e12deab02e297f20b 2015-10-05T11:06:22.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:26.139+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:06:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:06:28.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ba412deab02e297f246 2015-10-05T11:06:29.008+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:29.153+0100 [mongosMain] connection accepted from 127.0.0.1:53184 #216 (204 connections now open) 2015-10-05T11:06:29.156+0100 [conn216] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:29.161+0100 [conn216] end connection 127.0.0.1:53184 (203 connections now open) 2015-10-05T11:06:29.206+0100 [mongosMain] connection accepted from 172.28.0.163:53185 #217 (204 connections now open) 2015-10-05T11:06:29.207+0100 [conn217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:35.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bab12deab02e297f27b 2015-10-05T11:06:35.423+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:35.674+0100 [mongosMain] connection accepted from 172.28.0.164:58153 #218 (205 connections now open) 2015-10-05T11:06:35.678+0100 [conn218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:39.511+0100 [mongosMain] connection accepted from 127.0.0.1:53190 #219 (206 connections now open) 2015-10-05T11:06:39.514+0100 [conn219] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:39.518+0100 [conn219] end connection 127.0.0.1:53190 (205 connections now open) 2015-10-05T11:06:41.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bb112deab02e297f2bd 2015-10-05T11:06:41.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:47.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bb712deab02e297f356 2015-10-05T11:06:48.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:52.244+0100 [mongosMain] connection accepted from 172.28.0.163:53337 #220 (206 connections now open) 2015-10-05T11:06:52.247+0100 [conn220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:52.247+0100 [mongosMain] connection accepted from 172.28.0.163:53338 #221 (207 connections now open) 2015-10-05T11:06:52.249+0100 [mongosMain] connection accepted from 172.28.0.163:53339 #222 (208 connections now open) 2015-10-05T11:06:52.249+0100 [conn221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:52.250+0100 [conn222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:52.260+0100 [mongosMain] connection accepted from 172.28.0.163:53342 #223 (209 connections now open) 2015-10-05T11:06:52.262+0100 [conn223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:54.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bbe12deab02e297f43b 2015-10-05T11:06:54.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:06:56.307+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:06:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:06:57.157+0100 [mongosMain] connection accepted from 172.28.0.163:53369 #224 (210 connections now open) 2015-10-05T11:06:57.157+0100 [mongosMain] connection accepted from 172.28.0.163:53370 #225 (211 connections now open) 2015-10-05T11:06:57.159+0100 [conn224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.159+0100 [conn225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.172+0100 [mongosMain] connection accepted from 172.28.0.163:53371 #226 (212 connections now open) 2015-10-05T11:06:57.175+0100 [conn226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.176+0100 [mongosMain] connection accepted from 172.28.0.163:53372 #227 (213 connections now open) 2015-10-05T11:06:57.178+0100 [conn227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.213+0100 [mongosMain] connection accepted from 172.28.0.163:53376 #228 (214 connections now open) 2015-10-05T11:06:57.215+0100 [conn228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.215+0100 [mongosMain] connection accepted from 172.28.0.163:53377 #229 (215 connections now open) 2015-10-05T11:06:57.217+0100 [conn229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.226+0100 [mongosMain] connection accepted from 172.28.0.163:53380 #230 (216 connections now open) 2015-10-05T11:06:57.228+0100 [conn230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.234+0100 [mongosMain] connection accepted from 172.28.0.163:53382 #231 (217 connections now open) 2015-10-05T11:06:57.236+0100 [conn231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.254+0100 [mongosMain] connection accepted from 172.28.0.163:53385 #232 (218 connections now open) 2015-10-05T11:06:57.256+0100 [conn232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.260+0100 [mongosMain] connection accepted from 172.28.0.163:53389 #233 (219 connections now open) 2015-10-05T11:06:57.262+0100 [conn233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.265+0100 [mongosMain] connection accepted from 172.28.0.163:53392 #234 (220 connections now open) 2015-10-05T11:06:57.267+0100 [conn234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:06:57.267+0100 [mongosMain] connection accepted from 172.28.0.163:53393 #235 (221 connections now open) 2015-10-05T11:06:57.268+0100 [conn235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:00.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bc412deab02e297f550 2015-10-05T11:07:00.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:06.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bca12deab02e297f694 2015-10-05T11:07:06.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:14.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bd012deab02e297f7cb 2015-10-05T11:07:14.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:21.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bd812deab02e297f90c 2015-10-05T11:07:21.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:26.592+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:07:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:07:27.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bdf12deab02e297fa2b 2015-10-05T11:07:27.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:28.948+0100 [mongosMain] connection accepted from 127.0.0.1:53437 #236 (222 connections now open) 2015-10-05T11:07:28.948+0100 [conn236] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:28.948+0100 [conn236] end connection 127.0.0.1:53437 (221 connections now open) 2015-10-05T11:07:29.260+0100 [mongosMain] connection accepted from 172.28.0.163:53438 #237 (222 connections now open) 2015-10-05T11:07:29.260+0100 [conn237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53454 #238 (223 connections now open) 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53456 #239 (224 connections now open) 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53457 #240 (225 connections now open) 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53460 #241 (226 connections now open) 2015-10-05T11:07:29.744+0100 [conn239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [conn238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53459 #242 (227 connections now open) 2015-10-05T11:07:29.744+0100 [conn240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [mongosMain] connection accepted from 172.28.0.163:53463 #243 (228 connections now open) 2015-10-05T11:07:29.744+0100 [conn241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [conn242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.744+0100 [conn243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.775+0100 [mongosMain] connection accepted from 172.28.0.163:53470 #244 (229 connections now open) 2015-10-05T11:07:29.775+0100 [conn244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.775+0100 [mongosMain] connection accepted from 172.28.0.163:53472 #245 (230 connections now open) 2015-10-05T11:07:29.790+0100 [conn245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.790+0100 [mongosMain] connection accepted from 172.28.0.163:53474 #246 (231 connections now open) 2015-10-05T11:07:29.790+0100 [conn246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.806+0100 [mongosMain] connection accepted from 172.28.0.163:53478 #247 (232 connections now open) 2015-10-05T11:07:29.806+0100 [conn247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.822+0100 [mongosMain] connection accepted from 172.28.0.163:53480 #248 (233 connections now open) 2015-10-05T11:07:29.822+0100 [conn248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.822+0100 [mongosMain] connection accepted from 172.28.0.163:53484 #249 (234 connections now open) 2015-10-05T11:07:29.822+0100 [conn249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:29.931+0100 [mongosMain] connection accepted from 172.28.0.163:53490 #250 (235 connections now open) 2015-10-05T11:07:29.978+0100 [conn250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:33.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124be512deab02e297fb2e 2015-10-05T11:07:33.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:35.718+0100 [mongosMain] connection accepted from 172.28.0.164:58340 #251 (236 connections now open) 2015-10-05T11:07:35.718+0100 [conn251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:39.275+0100 [mongosMain] connection accepted from 127.0.0.1:53494 #252 (237 connections now open) 2015-10-05T11:07:39.275+0100 [conn252] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:39.275+0100 [conn252] end connection 127.0.0.1:53494 (236 connections now open) 2015-10-05T11:07:40.274+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bec12deab02e297fc63 2015-10-05T11:07:40.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:46.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bf212deab02e297fd6d 2015-10-05T11:07:46.685+0100 [mongosMain] connection accepted from 172.28.0.163:53517 #253 (237 connections now open) 2015-10-05T11:07:46.701+0100 [mongosMain] connection accepted from 172.28.0.163:53518 #254 (238 connections now open) 2015-10-05T11:07:46.701+0100 [conn253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.701+0100 [conn254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.701+0100 [mongosMain] connection accepted from 172.28.0.163:53519 #255 (239 connections now open) 2015-10-05T11:07:46.701+0100 [mongosMain] connection accepted from 172.28.0.163:53520 #256 (240 connections now open) 2015-10-05T11:07:46.701+0100 [conn255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.701+0100 [conn256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.701+0100 [mongosMain] connection accepted from 172.28.0.163:53523 #257 (241 connections now open) 2015-10-05T11:07:46.701+0100 [conn257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.716+0100 [mongosMain] connection accepted from 172.28.0.163:53527 #258 (242 connections now open) 2015-10-05T11:07:46.716+0100 [conn258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.779+0100 [mongosMain] connection accepted from 172.28.0.163:53529 #259 (243 connections now open) 2015-10-05T11:07:46.779+0100 [conn259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:46.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:47.122+0100 [mongosMain] connection accepted from 172.28.0.163:53537 #260 (244 connections now open) 2015-10-05T11:07:47.138+0100 [mongosMain] connection accepted from 172.28.0.163:53539 #261 (245 connections now open) 2015-10-05T11:07:47.184+0100 [mongosMain] connection accepted from 172.28.0.163:53541 #262 (246 connections now open) 2015-10-05T11:07:47.200+0100 [mongosMain] connection accepted from 172.28.0.163:53542 #263 (247 connections now open) 2015-10-05T11:07:47.216+0100 [conn262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:47.247+0100 [mongosMain] connection accepted from 172.28.0.163:53544 #264 (248 connections now open) 2015-10-05T11:07:47.247+0100 [conn260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:47.247+0100 [mongosMain] connection accepted from 172.28.0.163:53546 #265 (249 connections now open) 2015-10-05T11:07:47.309+0100 [conn261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:47.356+0100 [conn265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:47.356+0100 [conn264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:47.372+0100 [conn263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:53.066+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bf812deab02e297fe59 2015-10-05T11:07:53.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:07:56.311+0100 [mongosMain] connection accepted from 172.28.0.163:53582 #266 (250 connections now open) 2015-10-05T11:07:56.311+0100 [mongosMain] connection accepted from 172.28.0.163:53583 #267 (251 connections now open) 2015-10-05T11:07:56.311+0100 [conn266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.311+0100 [conn267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.326+0100 [mongosMain] connection accepted from 172.28.0.163:53584 #268 (252 connections now open) 2015-10-05T11:07:56.326+0100 [mongosMain] connection accepted from 172.28.0.163:53585 #269 (253 connections now open) 2015-10-05T11:07:56.326+0100 [conn268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.326+0100 [conn269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.326+0100 [mongosMain] connection accepted from 172.28.0.163:53586 #270 (254 connections now open) 2015-10-05T11:07:56.326+0100 [conn270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.342+0100 [mongosMain] connection accepted from 172.28.0.163:53587 #271 (255 connections now open) 2015-10-05T11:07:56.342+0100 [conn271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:56.342+0100 [mongosMain] connection accepted from 172.28.0.163:53588 #272 (256 connections now open) 2015-10-05T11:07:56.342+0100 [conn272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:07:57.761+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:07:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:07:59.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124bff12deab02e297ff19 2015-10-05T11:07:59.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:05.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c0512deab02e297ffcb 2015-10-05T11:08:05.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:12.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c0b12deab02e29800bf 2015-10-05T11:08:12.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:18.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c1212deab02e29801f9 2015-10-05T11:08:18.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:24.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c1812deab02e298031e 2015-10-05T11:08:25.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:28.197+0100 [mongosMain] connection accepted from 127.0.0.1:53653 #273 (257 connections now open) 2015-10-05T11:08:28.213+0100 [conn273] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:28.213+0100 [conn273] end connection 127.0.0.1:53653 (256 connections now open) 2015-10-05T11:08:28.587+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:08:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:08:29.289+0100 [mongosMain] connection accepted from 172.28.0.163:53654 #274 (257 connections now open) 2015-10-05T11:08:29.320+0100 [conn274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:31.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c1f12deab02e2980476 2015-10-05T11:08:31.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:38.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c2512deab02e2980558 2015-10-05T11:08:38.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:08:39.538+0100 [mongosMain] connection accepted from 127.0.0.1:53665 #275 (258 connections now open) 2015-10-05T11:08:39.554+0100 [conn275] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:39.554+0100 [conn275] end connection 127.0.0.1:53665 (257 connections now open) 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53689 #276 (258 connections now open) 2015-10-05T11:08:57.822+0100 [conn276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53690 #277 (259 connections now open) 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53691 #278 (260 connections now open) 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53692 #279 (261 connections now open) 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53693 #280 (262 connections now open) 2015-10-05T11:08:57.822+0100 [conn277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.822+0100 [conn278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53694 #281 (263 connections now open) 2015-10-05T11:08:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:53695 #282 (264 connections now open) 2015-10-05T11:08:57.822+0100 [conn279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.837+0100 [conn281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.837+0100 [conn282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:57.837+0100 [conn280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:08:59.241+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:08:59.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:08:59.382+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:08:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:09:05.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c4112deab02e2980836 2015-10-05T11:09:05.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:11.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c4712deab02e29808d9 2015-10-05T11:09:11.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:24.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c5312deab02e2980ab8 2015-10-05T11:09:24.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:29.022+0100 [mongosMain] connection accepted from 127.0.0.1:53775 #283 (265 connections now open) 2015-10-05T11:09:29.022+0100 [conn283] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:29.037+0100 [conn283] end connection 127.0.0.1:53775 (264 connections now open) 2015-10-05T11:09:29.334+0100 [mongosMain] connection accepted from 172.28.0.163:53776 #284 (265 connections now open) 2015-10-05T11:09:29.334+0100 [conn284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:29.630+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:09:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:09:30.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c5a12deab02e2980bb3 2015-10-05T11:09:30.832+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:35.746+0100 [mongosMain] connection accepted from 172.28.0.164:58558 #285 (266 connections now open) 2015-10-05T11:09:35.761+0100 [conn285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:35.761+0100 [mongosMain] connection accepted from 172.28.0.164:58559 #286 (267 connections now open) 2015-10-05T11:09:35.761+0100 [conn286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:37.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c6012deab02e2980c23 2015-10-05T11:09:37.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:43.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c6712deab02e2980cc7 2015-10-05T11:09:44.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:44.154+0100 [mongosMain] connection accepted from 127.0.0.1:53785 #287 (268 connections now open) 2015-10-05T11:09:44.154+0100 [conn287] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:44.154+0100 [conn287] end connection 127.0.0.1:53785 (267 connections now open) 2015-10-05T11:09:50.285+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c6e12deab02e2980d67 2015-10-05T11:09:50.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:09:59.302+0100 [mongosMain] connection accepted from 172.28.0.163:53855 #288 (268 connections now open) 2015-10-05T11:09:59.302+0100 [mongosMain] connection accepted from 172.28.0.163:53856 #289 (269 connections now open) 2015-10-05T11:09:59.317+0100 [mongosMain] connection accepted from 172.28.0.163:53857 #290 (270 connections now open) 2015-10-05T11:09:59.348+0100 [mongosMain] connection accepted from 172.28.0.163:53858 #291 (271 connections now open) 2015-10-05T11:09:59.348+0100 [mongosMain] connection accepted from 172.28.0.163:53859 #292 (272 connections now open) 2015-10-05T11:09:59.395+0100 [mongosMain] connection accepted from 172.28.0.163:53860 #293 (273 connections now open) 2015-10-05T11:09:59.395+0100 [mongosMain] connection accepted from 172.28.0.163:53861 #294 (274 connections now open) 2015-10-05T11:09:59.411+0100 [mongosMain] connection accepted from 172.28.0.163:53862 #295 (275 connections now open) 2015-10-05T11:09:59.458+0100 [mongosMain] connection accepted from 172.28.0.163:53863 #296 (276 connections now open) 2015-10-05T11:09:59.676+0100 [conn290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:59.692+0100 [conn291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:59.707+0100 [conn295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:09:59.910+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:09:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:10:00.082+0100 [conn294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:00.456+0100 [conn289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:00.456+0100 [conn288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:00.456+0100 [conn292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:00.472+0100 [conn296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:00.472+0100 [conn293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:02.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c7a12deab02e2980e8b 2015-10-05T11:10:03.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:10:09.333+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c8112deab02e2980f8b 2015-10-05T11:10:09.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:10:16.867+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:10:16.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:10:17.507+0100 [mongosMain] connection accepted from 172.21.40.52:54463 #297 (277 connections now open) 2015-10-05T11:10:17.710+0100 [mongosMain] connection accepted from 172.21.40.52:54464 #298 (278 connections now open) 2015-10-05T11:10:17.788+0100 [conn298] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:21.859+0100 [mongosMain] connection accepted from 172.21.40.52:54465 #299 (279 connections now open) 2015-10-05T11:10:22.171+0100 [conn299] authenticate db: admin { authenticate: 1, nonce: "xxx", user: "ma", key: "xxx" } 2015-10-05T11:10:23.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124c8e12deab02e298114c 2015-10-05T11:10:23.263+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:10:28.240+0100 [mongosMain] connection accepted from 127.0.0.1:53915 #300 (280 connections now open) 2015-10-05T11:10:28.240+0100 [conn300] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:28.240+0100 [conn300] end connection 127.0.0.1:53915 (279 connections now open) 2015-10-05T11:10:28.240+0100 [conn265] Socket recv() errno:10054 An existing connection was forcibly closed by the remote host. 172.31.0.216:27017 2015-10-05T11:10:28.240+0100 [conn265] SocketException: remote: 172.31.0.216:27017 error: 9001 socket exception [RECV_ERROR] server [172.31.0.216:27017] 2015-10-05T11:10:28.240+0100 [conn265] Detected bad connection created at 1444039209525991 microSec, clearing pool for mywdb7.tg-server.net:27017 of 178 connections 2015-10-05T11:10:29.347+0100 [mongosMain] connection accepted from 172.28.0.163:53942 #301 (280 connections now open) 2015-10-05T11:10:29.347+0100 [conn301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:30.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:10:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:10:35.775+0100 [mongosMain] connection accepted from 172.28.0.164:58617 #302 (281 connections now open) 2015-10-05T11:10:35.775+0100 [conn302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:39.878+0100 [mongosMain] connection accepted from 127.0.0.1:54032 #303 (282 connections now open) 2015-10-05T11:10:39.878+0100 [conn303] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:10:39.878+0100 [conn303] end connection 127.0.0.1:54032 (281 connections now open) 2015-10-05T11:10:47.568+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ca712deab02e2981393 2015-10-05T11:10:47.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:10:51.094+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4ms 2015-10-05T11:10:53.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cad12deab02e2981426 2015-10-05T11:10:54.011+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:10:58.598+0100 [conn14] Socket recv() errno:10054 An existing connection was forcibly closed by the remote host. 172.31.0.217:27017 2015-10-05T11:10:58.598+0100 [conn14] SocketException: remote: 172.31.0.217:27017 error: 9001 socket exception [RECV_ERROR] server [172.31.0.217:27017] 2015-10-05T11:10:58.598+0100 [conn14] DBClientCursor::init lazy say() failed 2015-10-05T11:10:58.598+0100 [conn14] DBClientCursor::init message from say() was empty 2015-10-05T11:10:58.598+0100 [conn14] slave no longer has secondary status: mywdb8.tg-server.net:27017 2015-10-05T11:10:58.598+0100 [conn14] warning: Weird shift of primary detected 2015-10-05T11:11:00.251+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T11:11:00.267+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T11:11:00.267+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T11:11:03.309+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:11:03.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:11:03.917+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:11:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:11:09.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cbd12deab02e298155c 2015-10-05T11:11:09.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:11:15.805+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:11:15.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:11:28.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ccf12deab02e29816fb 2015-10-05T11:11:28.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:11:28.909+0100 [mongosMain] connection accepted from 127.0.0.1:54245 #304 (282 connections now open) 2015-10-05T11:11:28.924+0100 [conn304] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:11:28.924+0100 [conn304] end connection 127.0.0.1:54245 (281 connections now open) 2015-10-05T11:11:29.361+0100 [mongosMain] connection accepted from 172.28.0.163:54246 #305 (282 connections now open) 2015-10-05T11:11:29.361+0100 [conn305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:11:34.213+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:11:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:11:35.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cd612deab02e298174e 2015-10-05T11:11:35.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:11:35.788+0100 [mongosMain] connection accepted from 172.28.0.164:58710 #306 (283 connections now open) 2015-10-05T11:11:35.788+0100 [conn306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:11:39.564+0100 [mongosMain] connection accepted from 127.0.0.1:54249 #307 (284 connections now open) 2015-10-05T11:11:39.579+0100 [conn307] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:11:39.579+0100 [conn307] end connection 127.0.0.1:54249 (283 connections now open) 2015-10-05T11:11:41.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cdd12deab02e2981786 2015-10-05T11:11:41.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:11:48.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ce312deab02e29817b3 2015-10-05T11:11:49.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:11:55.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ceb12deab02e29817ef 2015-10-05T11:11:55.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:01.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cf112deab02e2981831 2015-10-05T11:12:01.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:04.477+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:12:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:12:09.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cf812deab02e2981899 2015-10-05T11:12:09.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:15.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124cff12deab02e29818ef 2015-10-05T11:12:15.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:21.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d0512deab02e2981940 2015-10-05T11:12:21.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:27.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d0b12deab02e298197e 2015-10-05T11:12:28.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:28.220+0100 [mongosMain] connection accepted from 127.0.0.1:54294 #308 (284 connections now open) 2015-10-05T11:12:28.220+0100 [conn308] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:12:28.220+0100 [conn308] end connection 127.0.0.1:54294 (283 connections now open) 2015-10-05T11:12:29.375+0100 [mongosMain] connection accepted from 172.28.0.163:54295 #309 (284 connections now open) 2015-10-05T11:12:29.375+0100 [conn309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:12:34.881+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:12:34.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:12:34.944+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:12:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:12:35.802+0100 [mongosMain] connection accepted from 172.28.0.164:58820 #310 (285 connections now open) 2015-10-05T11:12:35.802+0100 [conn310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:12:39.998+0100 [mongosMain] connection accepted from 127.0.0.1:54304 #311 (286 connections now open) 2015-10-05T11:12:39.998+0100 [conn311] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:12:39.998+0100 [conn311] end connection 127.0.0.1:54304 (285 connections now open) 2015-10-05T11:12:41.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d1812deab02e2981a33 2015-10-05T11:12:41.106+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:12:53.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d2512deab02e2981ad7 2015-10-05T11:12:53.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:13:05.614+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:13:05.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:13:05.723+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:13:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:13:17.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d3d12deab02e2981ce8 2015-10-05T11:13:17.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:13:18.063+0100 [conn185] end connection 172.28.0.164:57498 (284 connections now open) 2015-10-05T11:13:18.063+0100 [conn10] end connection 172.28.0.164:57425 (283 connections now open) 2015-10-05T11:13:18.063+0100 [conn194] end connection 172.28.0.164:57585 (282 connections now open) 2015-10-05T11:13:18.063+0100 [conn302] end connection 172.28.0.164:58617 (282 connections now open) 2015-10-05T11:13:18.063+0100 [conn206] end connection 172.28.0.164:57952 (280 connections now open) 2015-10-05T11:13:18.063+0100 [conn198] end connection 172.28.0.164:57729 (280 connections now open) 2015-10-05T11:13:18.063+0100 [conn188] end connection 172.28.0.164:57501 (278 connections now open) 2015-10-05T11:13:18.063+0100 [conn6] end connection 172.28.0.164:57421 (278 connections now open) 2015-10-05T11:13:18.063+0100 [conn306] end connection 172.28.0.164:58710 (276 connections now open) 2015-10-05T11:13:18.063+0100 [conn184] end connection 172.28.0.164:57497 (276 connections now open) 2015-10-05T11:13:18.063+0100 [conn286] end connection 172.28.0.164:58559 (276 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54707 #312 (275 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54708 #313 (276 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54709 #314 (277 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54710 #315 (278 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54711 #316 (279 connections now open) 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54712 #317 (280 connections now open) 2015-10-05T11:13:19.560+0100 [conn312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.560+0100 [mongosMain] connection accepted from 172.28.0.163:54713 #318 (281 connections now open) 2015-10-05T11:13:19.576+0100 [conn314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.576+0100 [mongosMain] connection accepted from 172.28.0.163:54715 #319 (282 connections now open) 2015-10-05T11:13:19.576+0100 [mongosMain] connection accepted from 172.28.0.163:54714 #320 (283 connections now open) 2015-10-05T11:13:19.576+0100 [mongosMain] connection accepted from 172.28.0.163:54716 #321 (284 connections now open) 2015-10-05T11:13:19.607+0100 [mongosMain] connection accepted from 172.28.0.163:54719 #322 (285 connections now open) 2015-10-05T11:13:19.607+0100 [mongosMain] connection accepted from 172.28.0.163:54721 #323 (286 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54722 #324 (287 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54723 #325 (288 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54724 #326 (289 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54725 #327 (290 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54726 #328 (291 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54727 #329 (292 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54728 #330 (293 connections now open) 2015-10-05T11:13:19.623+0100 [conn315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54717 #331 (294 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54729 #332 (295 connections now open) 2015-10-05T11:13:19.623+0100 [conn317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.623+0100 [conn320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54730 #333 (296 connections now open) 2015-10-05T11:13:19.623+0100 [mongosMain] connection accepted from 172.28.0.163:54731 #334 (297 connections now open) 2015-10-05T11:13:19.638+0100 [conn316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.638+0100 [mongosMain] connection accepted from 172.28.0.163:54733 #335 (298 connections now open) 2015-10-05T11:13:19.638+0100 [mongosMain] connection accepted from 172.28.0.163:54734 #336 (299 connections now open) 2015-10-05T11:13:19.638+0100 [mongosMain] connection accepted from 172.28.0.163:54735 #337 (300 connections now open) 2015-10-05T11:13:19.638+0100 [mongosMain] connection accepted from 172.28.0.163:54736 #338 (301 connections now open) 2015-10-05T11:13:19.638+0100 [mongosMain] connection accepted from 172.28.0.163:54737 #339 (302 connections now open) 2015-10-05T11:13:19.638+0100 [conn313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54738 #340 (303 connections now open) 2015-10-05T11:13:19.654+0100 [conn319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54739 #341 (304 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54740 #342 (305 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54742 #343 (306 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54743 #344 (307 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54741 #345 (308 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54746 #346 (309 connections now open) 2015-10-05T11:13:19.654+0100 [conn331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54747 #347 (310 connections now open) 2015-10-05T11:13:19.654+0100 [conn332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54748 #348 (311 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54749 #349 (312 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54752 #350 (313 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54753 #351 (314 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54757 #352 (315 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54758 #353 (316 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54762 #354 (317 connections now open) 2015-10-05T11:13:19.654+0100 [conn345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54768 #355 (318 connections now open) 2015-10-05T11:13:19.654+0100 [conn349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54766 #356 (319 connections now open) 2015-10-05T11:13:19.654+0100 [conn351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54769 #357 (320 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54770 #358 (321 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54771 #359 (322 connections now open) 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54772 #360 (323 connections now open) 2015-10-05T11:13:19.654+0100 [conn352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54775 #361 (324 connections now open) 2015-10-05T11:13:19.654+0100 [conn358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [conn356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.654+0100 [mongosMain] connection accepted from 172.28.0.163:54776 #362 (325 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54774 #363 (326 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54777 #364 (327 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54778 #365 (328 connections now open) 2015-10-05T11:13:19.669+0100 [conn359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54779 #366 (329 connections now open) 2015-10-05T11:13:19.669+0100 [conn355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54780 #367 (330 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54782 #368 (331 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54783 #369 (332 connections now open) 2015-10-05T11:13:19.669+0100 [conn361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54785 #370 (333 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54786 #371 (334 connections now open) 2015-10-05T11:13:19.669+0100 [conn366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54788 #372 (335 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54787 #373 (336 connections now open) 2015-10-05T11:13:19.669+0100 [conn367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54789 #374 (337 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54790 #375 (338 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54792 #376 (339 connections now open) 2015-10-05T11:13:19.669+0100 [conn372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54795 #377 (340 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54797 #378 (341 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54798 #379 (342 connections now open) 2015-10-05T11:13:19.669+0100 [conn376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54800 #380 (343 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54799 #381 (344 connections now open) 2015-10-05T11:13:19.669+0100 [conn378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54802 #382 (345 connections now open) 2015-10-05T11:13:19.669+0100 [conn380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54804 #383 (346 connections now open) 2015-10-05T11:13:19.669+0100 [conn350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54805 #384 (347 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54806 #385 (348 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54809 #386 (349 connections now open) 2015-10-05T11:13:19.669+0100 [conn382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54810 #387 (350 connections now open) 2015-10-05T11:13:19.669+0100 [conn354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54812 #388 (351 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54813 #389 (352 connections now open) 2015-10-05T11:13:19.669+0100 [conn383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54815 #390 (353 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54816 #391 (354 connections now open) 2015-10-05T11:13:19.669+0100 [conn370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54817 #392 (355 connections now open) 2015-10-05T11:13:19.669+0100 [conn388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54819 #393 (356 connections now open) 2015-10-05T11:13:19.669+0100 [conn390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [conn391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54828 #394 (357 connections now open) 2015-10-05T11:13:19.669+0100 [conn389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54827 #395 (358 connections now open) 2015-10-05T11:13:19.669+0100 [conn384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54829 #396 (359 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54831 #397 (360 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54832 #398 (361 connections now open) 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54834 #399 (362 connections now open) 2015-10-05T11:13:19.669+0100 [conn395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.669+0100 [mongosMain] connection accepted from 172.28.0.163:54836 #400 (363 connections now open) 2015-10-05T11:13:19.669+0100 [conn396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54837 #401 (364 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54839 #402 (365 connections now open) 2015-10-05T11:13:19.685+0100 [conn398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54842 #403 (366 connections now open) 2015-10-05T11:13:19.685+0100 [conn402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54844 #404 (367 connections now open) 2015-10-05T11:13:19.685+0100 [conn400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54847 #405 (368 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54851 #406 (369 connections now open) 2015-10-05T11:13:19.685+0100 [conn405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54855 #407 (370 connections now open) 2015-10-05T11:13:19.685+0100 [conn406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54856 #408 (371 connections now open) 2015-10-05T11:13:19.685+0100 [conn407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54857 #409 (372 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54859 #410 (373 connections now open) 2015-10-05T11:13:19.685+0100 [conn408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54861 #411 (374 connections now open) 2015-10-05T11:13:19.685+0100 [conn409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54862 #412 (375 connections now open) 2015-10-05T11:13:19.685+0100 [conn410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54863 #413 (376 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54864 #414 (377 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54865 #415 (378 connections now open) 2015-10-05T11:13:19.685+0100 [conn411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [conn412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54868 #416 (379 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54869 #417 (380 connections now open) 2015-10-05T11:13:19.685+0100 [conn413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54870 #418 (381 connections now open) 2015-10-05T11:13:19.685+0100 [conn414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54871 #419 (382 connections now open) 2015-10-05T11:13:19.685+0100 [conn416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54872 #420 (383 connections now open) 2015-10-05T11:13:19.685+0100 [conn418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54874 #421 (384 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54877 #422 (385 connections now open) 2015-10-05T11:13:19.685+0100 [conn419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54878 #423 (386 connections now open) 2015-10-05T11:13:19.685+0100 [conn417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54879 #424 (387 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54881 #425 (388 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54880 #426 (389 connections now open) 2015-10-05T11:13:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:54882 #427 (390 connections now open) 2015-10-05T11:13:19.685+0100 [conn423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54883 #428 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54884 #429 (392 connections now open) 2015-10-05T11:13:19.701+0100 [conn424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn8] end connection 172.28.0.164:57422 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn7] end connection 172.28.0.164:57423 (390 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54885 #430 (391 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54886 #431 (392 connections now open) 2015-10-05T11:13:19.701+0100 [conn187] end connection 172.28.0.164:57500 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn310] end connection 172.28.0.164:58820 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn218] end connection 172.28.0.164:58153 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn193] end connection 172.28.0.164:57584 (389 connections now open) 2015-10-05T11:13:19.701+0100 [conn9] end connection 172.28.0.164:57424 (387 connections now open) 2015-10-05T11:13:19.701+0100 [conn186] end connection 172.28.0.164:57499 (391 connections now open) 2015-10-05T11:13:19.701+0100 [conn210] end connection 172.28.0.164:58015 (385 connections now open) 2015-10-05T11:13:19.701+0100 [conn251] end connection 172.28.0.164:58340 (384 connections now open) 2015-10-05T11:13:19.701+0100 [conn214] end connection 172.28.0.164:58099 (385 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54888 #432 (386 connections now open) 2015-10-05T11:13:19.701+0100 [conn285] end connection 172.28.0.164:58558 (383 connections now open) 2015-10-05T11:13:19.701+0100 [conn429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54891 #433 (384 connections now open) 2015-10-05T11:13:19.701+0100 [conn430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54893 #434 (385 connections now open) 2015-10-05T11:13:19.701+0100 [conn202] end connection 172.28.0.164:57782 (384 connections now open) 2015-10-05T11:13:19.701+0100 [conn5] end connection 172.28.0.164:57417 (382 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54895 #435 (385 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54897 #436 (385 connections now open) 2015-10-05T11:13:19.701+0100 [conn427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54898 #437 (386 connections now open) 2015-10-05T11:13:19.701+0100 [conn432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54899 #438 (387 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54900 #439 (388 connections now open) 2015-10-05T11:13:19.701+0100 [conn436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54902 #440 (389 connections now open) 2015-10-05T11:13:19.701+0100 [conn437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54903 #441 (390 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54904 #442 (391 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54906 #443 (392 connections now open) 2015-10-05T11:13:19.701+0100 [conn318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54909 #444 (393 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54910 #445 (394 connections now open) 2015-10-05T11:13:19.701+0100 [conn440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54911 #446 (395 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54912 #447 (396 connections now open) 2015-10-05T11:13:19.701+0100 [conn444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54914 #448 (397 connections now open) 2015-10-05T11:13:19.701+0100 [conn443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54915 #449 (398 connections now open) 2015-10-05T11:13:19.701+0100 [conn445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54917 #450 (399 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54918 #451 (400 connections now open) 2015-10-05T11:13:19.701+0100 [conn446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54919 #452 (401 connections now open) 2015-10-05T11:13:19.701+0100 [conn447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54920 #453 (402 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54922 #454 (403 connections now open) 2015-10-05T11:13:19.701+0100 [conn448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [conn450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54923 #455 (404 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54924 #456 (405 connections now open) 2015-10-05T11:13:19.701+0100 [conn452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54927 #457 (406 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54928 #458 (407 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54929 #459 (408 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54931 #460 (409 connections now open) 2015-10-05T11:13:19.701+0100 [conn455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54935 #461 (410 connections now open) 2015-10-05T11:13:19.701+0100 [conn453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54936 #462 (411 connections now open) 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54937 #463 (412 connections now open) 2015-10-05T11:13:19.701+0100 [conn457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.701+0100 [mongosMain] connection accepted from 172.28.0.163:54938 #464 (413 connections now open) 2015-10-05T11:13:19.701+0100 [conn458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54939 #465 (414 connections now open) 2015-10-05T11:13:19.716+0100 [conn460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54941 #466 (415 connections now open) 2015-10-05T11:13:19.716+0100 [conn461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54942 #467 (416 connections now open) 2015-10-05T11:13:19.716+0100 [conn462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54943 #468 (417 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54944 #469 (418 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54945 #470 (419 connections now open) 2015-10-05T11:13:19.716+0100 [conn454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54947 #471 (420 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54948 #472 (421 connections now open) 2015-10-05T11:13:19.716+0100 [conn468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54950 #473 (422 connections now open) 2015-10-05T11:13:19.716+0100 [conn467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54953 #474 (423 connections now open) 2015-10-05T11:13:19.716+0100 [conn465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54956 #475 (424 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54952 #476 (425 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54958 #477 (426 connections now open) 2015-10-05T11:13:19.716+0100 [conn336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54960 #478 (427 connections now open) 2015-10-05T11:13:19.716+0100 [conn327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [conn478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54971 #479 (428 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54975 #480 (429 connections now open) 2015-10-05T11:13:19.716+0100 [mongosMain] connection accepted from 172.28.0.163:54976 #481 (430 connections now open) 2015-10-05T11:13:19.732+0100 [conn479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.732+0100 [conn481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.732+0100 [conn480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.732+0100 [mongosMain] connection accepted from 172.28.0.163:54996 #482 (431 connections now open) 2015-10-05T11:13:19.732+0100 [conn482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.747+0100 [conn362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.747+0100 [conn369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.747+0100 [conn363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.747+0100 [conn373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.779+0100 [conn415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.779+0100 [conn464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.779+0100 [mongosMain] connection accepted from 172.28.0.163:55001 #483 (432 connections now open) 2015-10-05T11:13:19.841+0100 [mongosMain] connection accepted from 172.28.0.163:55006 #484 (433 connections now open) 2015-10-05T11:13:19.841+0100 [conn483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55008 #485 (434 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55007 #486 (435 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55009 #487 (436 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55010 #488 (437 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55011 #489 (438 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55012 #490 (439 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55013 #491 (440 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55014 #492 (441 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55015 #493 (442 connections now open) 2015-10-05T11:13:19.857+0100 [mongosMain] connection accepted from 172.28.0.163:55016 #494 (443 connections now open) 2015-10-05T11:13:19.872+0100 [mongosMain] connection accepted from 172.28.0.163:55017 #495 (444 connections now open) 2015-10-05T11:13:19.872+0100 [mongosMain] connection accepted from 172.28.0.163:55018 #496 (445 connections now open) 2015-10-05T11:13:19.872+0100 [mongosMain] connection accepted from 172.28.0.163:55019 #497 (446 connections now open) 2015-10-05T11:13:19.888+0100 [mongosMain] connection accepted from 172.28.0.163:55020 #498 (447 connections now open) 2015-10-05T11:13:19.935+0100 [conn492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.935+0100 [conn377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.935+0100 [conn498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.935+0100 [conn491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.966+0100 [conn494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.981+0100 [conn489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.981+0100 [conn495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:19.997+0100 [conn496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.028+0100 [conn488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.028+0100 [conn493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.028+0100 [conn357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.153+0100 [conn484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.153+0100 [conn497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.153+0100 [conn486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.153+0100 [conn485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.169+0100 [conn490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:20.169+0100 [conn487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:29.419+0100 [mongosMain] connection accepted from 172.28.0.163:55078 #499 (448 connections now open) 2015-10-05T11:13:29.419+0100 [conn499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:30.355+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d4a12deab02e2981fb2 2015-10-05T11:13:30.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:13:36.658+0100 [mongosMain] connection accepted from 127.0.0.1:55162 #500 (449 connections now open) 2015-10-05T11:13:36.658+0100 [conn500] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:36.658+0100 [conn500] end connection 127.0.0.1:55162 (448 connections now open) 2015-10-05T11:13:38.764+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:13:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:13:40.433+0100 [mongosMain] connection accepted from 127.0.0.1:55166 #501 (449 connections now open) 2015-10-05T11:13:40.433+0100 [conn501] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:13:40.433+0100 [conn501] end connection 127.0.0.1:55166 (448 connections now open) 2015-10-05T11:13:43.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d5712deab02e298224a 2015-10-05T11:13:43.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:13:49.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d5d12deab02e29823d1 2015-10-05T11:13:50.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:01.025+0100 [mongosMain] connection accepted from 172.28.0.163:55315 #502 (449 connections now open) 2015-10-05T11:14:01.025+0100 [mongosMain] connection accepted from 172.28.0.163:55317 #503 (450 connections now open) 2015-10-05T11:14:01.025+0100 [conn502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.025+0100 [conn503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.025+0100 [mongosMain] connection accepted from 172.28.0.163:55321 #504 (451 connections now open) 2015-10-05T11:14:01.025+0100 [conn504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.041+0100 [mongosMain] connection accepted from 172.28.0.163:55324 #505 (452 connections now open) 2015-10-05T11:14:01.041+0100 [conn505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.041+0100 [mongosMain] connection accepted from 172.28.0.163:55326 #506 (453 connections now open) 2015-10-05T11:14:01.041+0100 [conn506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.134+0100 [mongosMain] connection accepted from 172.28.0.163:55330 #507 (454 connections now open) 2015-10-05T11:14:01.134+0100 [conn507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.134+0100 [mongosMain] connection accepted from 172.28.0.163:55332 #508 (455 connections now open) 2015-10-05T11:14:01.134+0100 [conn508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.259+0100 [mongosMain] connection accepted from 172.28.0.163:55335 #509 (456 connections now open) 2015-10-05T11:14:01.259+0100 [conn509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.259+0100 [mongosMain] connection accepted from 172.28.0.163:55337 #510 (457 connections now open) 2015-10-05T11:14:01.259+0100 [conn510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.431+0100 [mongosMain] connection accepted from 172.28.0.163:55340 #511 (458 connections now open) 2015-10-05T11:14:01.431+0100 [conn511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.805+0100 [mongosMain] connection accepted from 172.28.0.163:55342 #512 (459 connections now open) 2015-10-05T11:14:01.805+0100 [mongosMain] connection accepted from 172.28.0.163:55343 #513 (460 connections now open) 2015-10-05T11:14:01.821+0100 [conn512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:01.836+0100 [conn513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d6a12deab02e298261f 2015-10-05T11:14:03.864+0100 [mongosMain] connection accepted from 172.28.0.163:55373 #514 (461 connections now open) 2015-10-05T11:14:03.864+0100 [conn514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.864+0100 [mongosMain] connection accepted from 172.28.0.163:55375 #515 (462 connections now open) 2015-10-05T11:14:03.864+0100 [conn515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.864+0100 [mongosMain] connection accepted from 172.28.0.163:55376 #516 (463 connections now open) 2015-10-05T11:14:03.864+0100 [conn516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55378 #517 (464 connections now open) 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55379 #518 (465 connections now open) 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55380 #519 (466 connections now open) 2015-10-05T11:14:03.880+0100 [conn517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [conn518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55381 #520 (467 connections now open) 2015-10-05T11:14:03.880+0100 [conn519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [conn520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55382 #521 (468 connections now open) 2015-10-05T11:14:03.880+0100 [mongosMain] connection accepted from 172.28.0.163:55383 #522 (469 connections now open) 2015-10-05T11:14:03.880+0100 [conn521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.880+0100 [conn522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.896+0100 [mongosMain] connection accepted from 172.28.0.163:55386 #523 (470 connections now open) 2015-10-05T11:14:03.896+0100 [conn523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.896+0100 [mongosMain] connection accepted from 172.28.0.163:55388 #524 (471 connections now open) 2015-10-05T11:14:03.911+0100 [conn524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.911+0100 [mongosMain] connection accepted from 172.28.0.163:55389 #525 (472 connections now open) 2015-10-05T11:14:03.911+0100 [conn525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.927+0100 [mongosMain] connection accepted from 172.28.0.163:55390 #526 (473 connections now open) 2015-10-05T11:14:03.927+0100 [mongosMain] connection accepted from 172.28.0.163:55391 #527 (474 connections now open) 2015-10-05T11:14:03.927+0100 [conn526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.927+0100 [conn527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:03.942+0100 [mongosMain] connection accepted from 172.28.0.163:55393 #528 (475 connections now open) 2015-10-05T11:14:03.942+0100 [conn528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:03.958+0100 [mongosMain] connection accepted from 172.28.0.163:55394 #529 (476 connections now open) 2015-10-05T11:14:03.958+0100 [conn529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:04.130+0100 [mongosMain] connection accepted from 172.28.0.163:55413 #530 (477 connections now open) 2015-10-05T11:14:04.145+0100 [mongosMain] connection accepted from 172.28.0.163:55414 #531 (478 connections now open) 2015-10-05T11:14:04.145+0100 [mongosMain] connection accepted from 172.28.0.163:55415 #532 (479 connections now open) 2015-10-05T11:14:04.176+0100 [mongosMain] connection accepted from 172.28.0.163:55418 #533 (480 connections now open) 2015-10-05T11:14:04.176+0100 [conn533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:04.176+0100 [conn530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:04.176+0100 [conn531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:04.176+0100 [conn532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:09.059+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:14:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:14:12.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d7112deab02e29827a9 2015-10-05T11:14:13.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:19.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d7b12deab02e29829cb 2015-10-05T11:14:19.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:25.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d8112deab02e2982b4a 2015-10-05T11:14:25.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:28.544+0100 [mongosMain] connection accepted from 127.0.0.1:55541 #534 (481 connections now open) 2015-10-05T11:14:28.559+0100 [conn534] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:28.559+0100 [conn534] end connection 127.0.0.1:55541 (480 connections now open) 2015-10-05T11:14:29.449+0100 [mongosMain] connection accepted from 172.28.0.163:55543 #535 (481 connections now open) 2015-10-05T11:14:29.449+0100 [conn535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:39.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d8d12deab02e2982daa 2015-10-05T11:14:39.854+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:14:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:14:39.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:14:40.041+0100 [mongosMain] connection accepted from 127.0.0.1:55823 #536 (482 connections now open) 2015-10-05T11:14:40.041+0100 [conn536] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:14:40.041+0100 [conn536] end connection 127.0.0.1:55823 (481 connections now open) 2015-10-05T11:14:53.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124d9d12deab02e298301c 2015-10-05T11:14:53.254+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:15:00.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124da312deab02e2983102 2015-10-05T11:15:00.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:15:10.492+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:15:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:15:13.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124db112deab02e298331f 2015-10-05T11:15:13.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:15:20.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124db712deab02e2983430 2015-10-05T11:15:20.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:15:26.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124dbe12deab02e2983525 2015-10-05T11:15:26.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:15:28.589+0100 [mongosMain] connection accepted from 127.0.0.1:56024 #537 (482 connections now open) 2015-10-05T11:15:28.589+0100 [conn537] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:15:28.589+0100 [conn537] end connection 127.0.0.1:56024 (481 connections now open) 2015-10-05T11:15:29.478+0100 [mongosMain] connection accepted from 172.28.0.163:56026 #538 (482 connections now open) 2015-10-05T11:15:29.478+0100 [conn538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:15:34.158+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:15:34.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:15:40.975+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:15:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:16:06.388+0100 [mongosMain] connection accepted from 127.0.0.1:56047 #539 (483 connections now open) 2015-10-05T11:16:06.388+0100 [conn539] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:06.388+0100 [conn539] end connection 127.0.0.1:56047 (482 connections now open) 2015-10-05T11:16:11.270+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:16:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:16:13.626+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ded12deab02e298380a 2015-10-05T11:16:14.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:20.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124df412deab02e29838d9 2015-10-05T11:16:20.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:26.964+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124dfa12deab02e2983983 2015-10-05T11:16:27.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:29.195+0100 [mongosMain] connection accepted from 127.0.0.1:56139 #540 (483 connections now open) 2015-10-05T11:16:29.195+0100 [conn540] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:29.195+0100 [conn540] end connection 127.0.0.1:56139 (482 connections now open) 2015-10-05T11:16:29.491+0100 [mongosMain] connection accepted from 172.28.0.163:56140 #541 (483 connections now open) 2015-10-05T11:16:29.491+0100 [conn541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:30.178+0100 [mongosMain] connection accepted from 172.28.0.164:49315 #542 (484 connections now open) 2015-10-05T11:16:30.178+0100 [mongosMain] connection accepted from 172.28.0.164:49316 #543 (485 connections now open) 2015-10-05T11:16:33.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e0112deab02e2983a0e 2015-10-05T11:16:33.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:33.485+0100 [conn542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.485+0100 [conn543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.501+0100 [mongosMain] connection accepted from 172.28.0.164:49331 #544 (486 connections now open) 2015-10-05T11:16:33.501+0100 [conn544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.501+0100 [mongosMain] connection accepted from 172.28.0.164:49333 #545 (487 connections now open) 2015-10-05T11:16:33.501+0100 [conn545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.501+0100 [mongosMain] connection accepted from 172.28.0.164:49336 #546 (488 connections now open) 2015-10-05T11:16:33.501+0100 [conn546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.703+0100 [mongosMain] connection accepted from 172.28.0.164:49339 #547 (489 connections now open) 2015-10-05T11:16:33.703+0100 [conn547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.735+0100 [mongosMain] connection accepted from 172.28.0.164:49367 #548 (490 connections now open) 2015-10-05T11:16:33.750+0100 [conn548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.766+0100 [mongosMain] connection accepted from 172.28.0.164:49377 #549 (491 connections now open) 2015-10-05T11:16:33.766+0100 [conn549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.766+0100 [mongosMain] connection accepted from 172.28.0.164:49379 #550 (492 connections now open) 2015-10-05T11:16:33.766+0100 [mongosMain] connection accepted from 172.28.0.164:49380 #551 (493 connections now open) 2015-10-05T11:16:33.766+0100 [conn550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.766+0100 [conn551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.781+0100 [mongosMain] connection accepted from 172.28.0.164:49383 #552 (494 connections now open) 2015-10-05T11:16:33.781+0100 [conn552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.781+0100 [mongosMain] connection accepted from 172.28.0.164:49389 #553 (495 connections now open) 2015-10-05T11:16:33.781+0100 [conn553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.844+0100 [mongosMain] connection accepted from 172.28.0.164:49392 #554 (496 connections now open) 2015-10-05T11:16:33.859+0100 [conn554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.891+0100 [mongosMain] connection accepted from 172.28.0.164:49394 #555 (497 connections now open) 2015-10-05T11:16:33.891+0100 [conn555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.922+0100 [mongosMain] connection accepted from 172.28.0.164:49396 #556 (498 connections now open) 2015-10-05T11:16:33.922+0100 [conn556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.922+0100 [mongosMain] connection accepted from 172.28.0.164:49397 #557 (499 connections now open) 2015-10-05T11:16:33.937+0100 [conn557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.937+0100 [mongosMain] connection accepted from 172.28.0.164:49398 #558 (500 connections now open) 2015-10-05T11:16:33.937+0100 [conn558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.937+0100 [mongosMain] connection accepted from 172.28.0.164:49399 #559 (501 connections now open) 2015-10-05T11:16:33.937+0100 [conn559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.937+0100 [mongosMain] connection accepted from 172.28.0.164:49400 #560 (502 connections now open) 2015-10-05T11:16:33.953+0100 [conn560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.953+0100 [mongosMain] connection accepted from 172.28.0.164:49401 #561 (503 connections now open) 2015-10-05T11:16:33.953+0100 [conn561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.953+0100 [mongosMain] connection accepted from 172.28.0.164:49402 #562 (504 connections now open) 2015-10-05T11:16:33.953+0100 [conn562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.953+0100 [mongosMain] connection accepted from 172.28.0.164:49403 #563 (505 connections now open) 2015-10-05T11:16:33.969+0100 [conn563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.969+0100 [mongosMain] connection accepted from 172.28.0.164:49404 #564 (506 connections now open) 2015-10-05T11:16:33.969+0100 [conn564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.969+0100 [mongosMain] connection accepted from 172.28.0.164:49405 #565 (507 connections now open) 2015-10-05T11:16:33.969+0100 [conn565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.969+0100 [mongosMain] connection accepted from 172.28.0.164:49406 #566 (508 connections now open) 2015-10-05T11:16:33.984+0100 [conn566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.984+0100 [mongosMain] connection accepted from 172.28.0.164:49407 #567 (509 connections now open) 2015-10-05T11:16:33.984+0100 [conn567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.984+0100 [mongosMain] connection accepted from 172.28.0.164:49408 #568 (510 connections now open) 2015-10-05T11:16:33.984+0100 [conn568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.984+0100 [mongosMain] connection accepted from 172.28.0.164:49409 #569 (511 connections now open) 2015-10-05T11:16:33.984+0100 [conn569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:33.984+0100 [mongosMain] connection accepted from 172.28.0.164:49410 #570 (512 connections now open) 2015-10-05T11:16:34.000+0100 [conn570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.000+0100 [mongosMain] connection accepted from 172.28.0.164:49411 #571 (513 connections now open) 2015-10-05T11:16:34.000+0100 [conn571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.000+0100 [mongosMain] connection accepted from 172.28.0.164:49412 #572 (514 connections now open) 2015-10-05T11:16:34.000+0100 [conn572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.000+0100 [mongosMain] connection accepted from 172.28.0.164:49413 #573 (515 connections now open) 2015-10-05T11:16:34.000+0100 [conn573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.015+0100 [mongosMain] connection accepted from 172.28.0.164:49414 #574 (516 connections now open) 2015-10-05T11:16:34.015+0100 [conn574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.015+0100 [mongosMain] connection accepted from 172.28.0.164:49415 #575 (517 connections now open) 2015-10-05T11:16:34.031+0100 [conn575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.031+0100 [mongosMain] connection accepted from 172.28.0.164:49416 #576 (518 connections now open) 2015-10-05T11:16:34.031+0100 [conn576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.031+0100 [mongosMain] connection accepted from 172.28.0.164:49417 #577 (519 connections now open) 2015-10-05T11:16:34.031+0100 [conn577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.031+0100 [mongosMain] connection accepted from 172.28.0.164:49418 #578 (520 connections now open) 2015-10-05T11:16:34.031+0100 [conn578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.031+0100 [mongosMain] connection accepted from 172.28.0.164:49419 #579 (521 connections now open) 2015-10-05T11:16:34.047+0100 [conn579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.047+0100 [mongosMain] connection accepted from 172.28.0.164:49420 #580 (522 connections now open) 2015-10-05T11:16:34.047+0100 [conn580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.047+0100 [mongosMain] connection accepted from 172.28.0.164:49421 #581 (523 connections now open) 2015-10-05T11:16:34.047+0100 [conn581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.047+0100 [mongosMain] connection accepted from 172.28.0.164:49422 #582 (524 connections now open) 2015-10-05T11:16:34.047+0100 [conn582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.047+0100 [mongosMain] connection accepted from 172.28.0.164:49423 #583 (525 connections now open) 2015-10-05T11:16:34.047+0100 [conn583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.047+0100 [mongosMain] connection accepted from 172.28.0.164:49424 #584 (526 connections now open) 2015-10-05T11:16:34.062+0100 [conn584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.062+0100 [mongosMain] connection accepted from 172.28.0.164:49425 #585 (527 connections now open) 2015-10-05T11:16:34.062+0100 [conn585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.062+0100 [mongosMain] connection accepted from 172.28.0.164:49426 #586 (528 connections now open) 2015-10-05T11:16:34.062+0100 [conn586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.062+0100 [mongosMain] connection accepted from 172.28.0.164:49427 #587 (529 connections now open) 2015-10-05T11:16:34.062+0100 [conn587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.078+0100 [mongosMain] connection accepted from 172.28.0.164:49428 #588 (530 connections now open) 2015-10-05T11:16:34.078+0100 [conn588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.078+0100 [mongosMain] connection accepted from 172.28.0.164:49429 #589 (531 connections now open) 2015-10-05T11:16:34.078+0100 [conn589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.078+0100 [mongosMain] connection accepted from 172.28.0.164:49430 #590 (532 connections now open) 2015-10-05T11:16:34.078+0100 [conn590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.078+0100 [mongosMain] connection accepted from 172.28.0.164:49431 #591 (533 connections now open) 2015-10-05T11:16:34.078+0100 [conn591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:34.093+0100 [mongosMain] connection accepted from 172.28.0.164:49432 #592 (534 connections now open) 2015-10-05T11:16:34.093+0100 [conn592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:36.667+0100 [mongosMain] connection accepted from 172.28.0.164:49436 #593 (535 connections now open) 2015-10-05T11:16:36.667+0100 [mongosMain] connection accepted from 172.28.0.164:49437 #594 (536 connections now open) 2015-10-05T11:16:39.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e0712deab02e2983a6c 2015-10-05T11:16:39.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:39.803+0100 [mongosMain] connection accepted from 127.0.0.1:56159 #595 (537 connections now open) 2015-10-05T11:16:39.803+0100 [conn595] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:16:39.803+0100 [conn595] end connection 127.0.0.1:56159 (536 connections now open) 2015-10-05T11:16:41.550+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:16:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:16:52.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e1412deab02e2983b04 2015-10-05T11:16:52.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:16:59.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e1a12deab02e2983b38 2015-10-05T11:16:59.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:17:11.690+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:17:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:17:12.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e2712deab02e2983bf4 2015-10-05T11:17:12.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:17:12.173+0100 [conn594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:17:24.669+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56124e3303838a453716309f') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444040244154), why: "doing balance round", ts: ObjectId('56124e3412deab02e2983c8e') } } gle1: { lastOp: Timestamp 1444040244000|3, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } gle2: { lastOp: Timestamp 1444040232000|4, connectionId: 39966, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2015-10-05T11:17:24.669+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:17:24.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:17:28.273+0100 [mongosMain] connection accepted from 127.0.0.1:56365 #596 (537 connections now open) 2015-10-05T11:17:28.273+0100 [conn596] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:17:28.273+0100 [conn596] end connection 127.0.0.1:56365 (536 connections now open) 2015-10-05T11:17:29.505+0100 [mongosMain] connection accepted from 172.28.0.163:56366 #597 (537 connections now open) 2015-10-05T11:17:29.505+0100 [conn597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:17:31.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e3b12deab02e2983d00 2015-10-05T11:17:31.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:17:38.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e4112deab02e2983d6d 2015-10-05T11:17:38.179+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:17:40.066+0100 [mongosMain] connection accepted from 127.0.0.1:56374 #598 (538 connections now open) 2015-10-05T11:17:40.066+0100 [conn598] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:17:40.066+0100 [conn598] end connection 127.0.0.1:56374 (537 connections now open) 2015-10-05T11:17:42.047+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:17:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:17:42.047+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:17:42.188+0100 [LockPinger] handled late remove of old distributed lock with ts 56124e3412deab02e2983c8e 2015-10-05T11:17:44.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e4812deab02e2983de5 2015-10-05T11:17:44.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:17:50.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e4e12deab02e2983e5e 2015-10-05T11:17:51.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:18:03.170+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:18:03.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:18:09.301+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:18:09.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:18:12.327+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:18:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:18:15.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e6712deab02e2983fd5 2015-10-05T11:18:15.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:18:21.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e6d12deab02e298402c 2015-10-05T11:18:21.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:18:28.957+0100 [mongosMain] connection accepted from 127.0.0.1:56510 #599 (538 connections now open) 2015-10-05T11:18:28.957+0100 [conn599] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:18:28.957+0100 [conn599] end connection 127.0.0.1:56510 (537 connections now open) 2015-10-05T11:18:29.519+0100 [mongosMain] connection accepted from 172.28.0.163:56511 #600 (538 connections now open) 2015-10-05T11:18:29.519+0100 [conn600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:18:39.627+0100 [mongosMain] connection accepted from 127.0.0.1:56513 #601 (539 connections now open) 2015-10-05T11:18:39.643+0100 [conn601] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:18:39.643+0100 [conn601] end connection 127.0.0.1:56513 (538 connections now open) 2015-10-05T11:18:40.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e8012deab02e29840a5 2015-10-05T11:18:41.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:18:43.059+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:18:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:18:47.490+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e8712deab02e29840df 2015-10-05T11:18:47.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:18:53.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e8d12deab02e2984110 2015-10-05T11:18:53.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:00.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124e9312deab02e2984132 2015-10-05T11:19:00.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:12.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ea012deab02e298417c 2015-10-05T11:19:12.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:13.324+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:19:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:19:18.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ea612deab02e29841a5 2015-10-05T11:19:19.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:25.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ead12deab02e29841c6 2015-10-05T11:19:25.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:28.143+0100 [mongosMain] connection accepted from 127.0.0.1:56560 #602 (539 connections now open) 2015-10-05T11:19:28.145+0100 [conn602] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:28.147+0100 [conn602] end connection 127.0.0.1:56560 (538 connections now open) 2015-10-05T11:19:29.497+0100 [mongosMain] connection accepted from 172.28.0.163:56561 #603 (539 connections now open) 2015-10-05T11:19:29.499+0100 [conn603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124eb312deab02e29841ec 2015-10-05T11:19:31.697+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:31.824+0100 [mongosMain] connection accepted from 172.28.0.164:50122 #604 (540 connections now open) 2015-10-05T11:19:31.825+0100 [mongosMain] connection accepted from 172.28.0.164:50125 #605 (541 connections now open) 2015-10-05T11:19:31.830+0100 [mongosMain] connection accepted from 172.28.0.164:50126 #606 (542 connections now open) 2015-10-05T11:19:31.831+0100 [mongosMain] connection accepted from 172.28.0.164:50127 #607 (543 connections now open) 2015-10-05T11:19:31.832+0100 [mongosMain] connection accepted from 172.28.0.164:50129 #608 (544 connections now open) 2015-10-05T11:19:31.834+0100 [conn605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.836+0100 [conn604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.838+0100 [mongosMain] connection accepted from 172.28.0.164:50136 #609 (545 connections now open) 2015-10-05T11:19:31.841+0100 [mongosMain] connection accepted from 172.28.0.164:50139 #610 (546 connections now open) 2015-10-05T11:19:31.845+0100 [mongosMain] connection accepted from 172.28.0.164:50140 #611 (547 connections now open) 2015-10-05T11:19:31.846+0100 [conn608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.846+0100 [conn609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.847+0100 [conn607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.847+0100 [mongosMain] connection accepted from 172.28.0.164:50141 #612 (548 connections now open) 2015-10-05T11:19:31.848+0100 [mongosMain] connection accepted from 172.28.0.164:50145 #613 (549 connections now open) 2015-10-05T11:19:31.848+0100 [mongosMain] connection accepted from 172.28.0.164:50146 #614 (550 connections now open) 2015-10-05T11:19:31.852+0100 [conn612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.853+0100 [conn611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.853+0100 [mongosMain] connection accepted from 172.28.0.164:50148 #615 (551 connections now open) 2015-10-05T11:19:31.854+0100 [mongosMain] connection accepted from 172.28.0.164:50149 #616 (552 connections now open) 2015-10-05T11:19:31.857+0100 [mongosMain] connection accepted from 172.28.0.164:50151 #617 (553 connections now open) 2015-10-05T11:19:31.857+0100 [mongosMain] connection accepted from 172.28.0.164:50152 #618 (554 connections now open) 2015-10-05T11:19:31.858+0100 [mongosMain] connection accepted from 172.28.0.164:50154 #619 (555 connections now open) 2015-10-05T11:19:31.859+0100 [mongosMain] connection accepted from 172.28.0.164:50155 #620 (556 connections now open) 2015-10-05T11:19:31.859+0100 [mongosMain] connection accepted from 172.28.0.164:50157 #621 (557 connections now open) 2015-10-05T11:19:31.860+0100 [mongosMain] connection accepted from 172.28.0.164:50159 #622 (558 connections now open) 2015-10-05T11:19:31.862+0100 [mongosMain] connection accepted from 172.28.0.164:50160 #623 (559 connections now open) 2015-10-05T11:19:31.870+0100 [mongosMain] connection accepted from 172.28.0.164:50161 #624 (560 connections now open) 2015-10-05T11:19:31.872+0100 [mongosMain] connection accepted from 172.28.0.164:50162 #625 (561 connections now open) 2015-10-05T11:19:31.873+0100 [mongosMain] connection accepted from 172.28.0.164:50164 #626 (562 connections now open) 2015-10-05T11:19:31.874+0100 [mongosMain] connection accepted from 172.28.0.164:50165 #627 (563 connections now open) 2015-10-05T11:19:31.884+0100 [mongosMain] connection accepted from 172.28.0.164:50168 #628 (564 connections now open) 2015-10-05T11:19:31.884+0100 [mongosMain] connection accepted from 172.28.0.164:50169 #629 (565 connections now open) 2015-10-05T11:19:31.890+0100 [conn613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.895+0100 [mongosMain] connection accepted from 172.28.0.164:50171 #630 (566 connections now open) 2015-10-05T11:19:31.896+0100 [mongosMain] connection accepted from 172.28.0.164:50172 #631 (567 connections now open) 2015-10-05T11:19:31.899+0100 [conn618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.902+0100 [conn620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.908+0100 [mongosMain] connection accepted from 172.28.0.164:50173 #632 (568 connections now open) 2015-10-05T11:19:31.909+0100 [conn621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.910+0100 [conn623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.910+0100 [mongosMain] connection accepted from 172.28.0.164:50174 #633 (569 connections now open) 2015-10-05T11:19:31.911+0100 [mongosMain] connection accepted from 172.28.0.164:50175 #634 (570 connections now open) 2015-10-05T11:19:31.913+0100 [conn622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.915+0100 [mongosMain] connection accepted from 172.28.0.164:50176 #635 (571 connections now open) 2015-10-05T11:19:31.917+0100 [conn619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.924+0100 [mongosMain] connection accepted from 172.28.0.164:50177 #636 (572 connections now open) 2015-10-05T11:19:31.925+0100 [mongosMain] connection accepted from 172.28.0.164:50179 #637 (573 connections now open) 2015-10-05T11:19:31.925+0100 [mongosMain] connection accepted from 172.28.0.164:50178 #638 (574 connections now open) 2015-10-05T11:19:31.926+0100 [mongosMain] connection accepted from 172.28.0.164:50180 #639 (575 connections now open) 2015-10-05T11:19:31.926+0100 [mongosMain] connection accepted from 172.28.0.164:50181 #640 (576 connections now open) 2015-10-05T11:19:31.931+0100 [mongosMain] connection accepted from 172.28.0.164:50183 #641 (577 connections now open) 2015-10-05T11:19:31.932+0100 [mongosMain] connection accepted from 172.28.0.164:50182 #642 (578 connections now open) 2015-10-05T11:19:31.933+0100 [mongosMain] connection accepted from 172.28.0.164:50184 #643 (579 connections now open) 2015-10-05T11:19:31.934+0100 [mongosMain] connection accepted from 172.28.0.164:50185 #644 (580 connections now open) 2015-10-05T11:19:31.934+0100 [mongosMain] connection accepted from 172.28.0.164:50186 #645 (581 connections now open) 2015-10-05T11:19:31.935+0100 [mongosMain] connection accepted from 172.28.0.164:50187 #646 (582 connections now open) 2015-10-05T11:19:31.935+0100 [mongosMain] connection accepted from 172.28.0.164:50188 #647 (583 connections now open) 2015-10-05T11:19:31.936+0100 [mongosMain] connection accepted from 172.28.0.164:50189 #648 (584 connections now open) 2015-10-05T11:19:31.936+0100 [mongosMain] connection accepted from 172.28.0.164:50190 #649 (585 connections now open) 2015-10-05T11:19:31.940+0100 [mongosMain] connection accepted from 172.28.0.164:50191 #650 (586 connections now open) 2015-10-05T11:19:31.948+0100 [mongosMain] connection accepted from 172.28.0.164:50192 #651 (587 connections now open) 2015-10-05T11:19:31.961+0100 [conn614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.968+0100 [conn624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.979+0100 [mongosMain] connection accepted from 172.28.0.164:50193 #652 (588 connections now open) 2015-10-05T11:19:31.986+0100 [conn617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.986+0100 [conn627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.987+0100 [conn625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.987+0100 [conn628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.987+0100 [mongosMain] connection accepted from 172.28.0.164:50194 #653 (589 connections now open) 2015-10-05T11:19:31.989+0100 [conn630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.989+0100 [conn629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.989+0100 [mongosMain] connection accepted from 172.28.0.164:50195 #654 (590 connections now open) 2015-10-05T11:19:31.990+0100 [conn626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:31.991+0100 [mongosMain] connection accepted from 172.28.0.164:50196 #655 (591 connections now open) 2015-10-05T11:19:31.995+0100 [mongosMain] connection accepted from 172.28.0.164:50197 #656 (592 connections now open) 2015-10-05T11:19:31.997+0100 [mongosMain] connection accepted from 172.28.0.164:50198 #657 (593 connections now open) 2015-10-05T11:19:31.998+0100 [mongosMain] connection accepted from 172.28.0.164:50199 #658 (594 connections now open) 2015-10-05T11:19:31.999+0100 [conn632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.000+0100 [conn634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.002+0100 [mongosMain] connection accepted from 172.28.0.164:50200 #659 (595 connections now open) 2015-10-05T11:19:32.003+0100 [mongosMain] connection accepted from 172.28.0.164:50201 #660 (596 connections now open) 2015-10-05T11:19:32.024+0100 [mongosMain] connection accepted from 172.28.0.164:50202 #661 (597 connections now open) 2015-10-05T11:19:32.037+0100 [conn633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.037+0100 [conn631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.050+0100 [conn635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.062+0100 [mongosMain] connection accepted from 172.28.0.164:50203 #662 (598 connections now open) 2015-10-05T11:19:32.062+0100 [mongosMain] connection accepted from 172.28.0.164:50204 #663 (599 connections now open) 2015-10-05T11:19:32.063+0100 [mongosMain] connection accepted from 172.28.0.164:50205 #664 (600 connections now open) 2015-10-05T11:19:32.063+0100 [mongosMain] connection accepted from 172.28.0.164:50206 #665 (601 connections now open) 2015-10-05T11:19:32.064+0100 [mongosMain] connection accepted from 172.28.0.164:50207 #666 (602 connections now open) 2015-10-05T11:19:32.064+0100 [mongosMain] connection accepted from 172.28.0.164:50208 #667 (603 connections now open) 2015-10-05T11:19:32.064+0100 [mongosMain] connection accepted from 172.28.0.164:50209 #668 (604 connections now open) 2015-10-05T11:19:32.093+0100 [conn644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.093+0100 [conn643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.109+0100 [conn642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.111+0100 [conn654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.111+0100 [conn655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.111+0100 [conn653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.111+0100 [conn651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.112+0100 [conn660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.112+0100 [conn656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.112+0100 [conn659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.112+0100 [conn661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.140+0100 [mongosMain] connection accepted from 172.28.0.164:50214 #669 (605 connections now open) 2015-10-05T11:19:32.142+0100 [mongosMain] connection accepted from 172.28.0.164:50215 #670 (606 connections now open) 2015-10-05T11:19:32.142+0100 [mongosMain] connection accepted from 172.28.0.164:50216 #671 (607 connections now open) 2015-10-05T11:19:32.143+0100 [mongosMain] connection accepted from 172.28.0.164:50217 #672 (608 connections now open) 2015-10-05T11:19:32.143+0100 [mongosMain] connection accepted from 172.28.0.164:50218 #673 (609 connections now open) 2015-10-05T11:19:32.144+0100 [mongosMain] connection accepted from 172.28.0.164:50219 #674 (610 connections now open) 2015-10-05T11:19:32.144+0100 [mongosMain] connection accepted from 172.28.0.164:50220 #675 (611 connections now open) 2015-10-05T11:19:32.144+0100 [mongosMain] connection accepted from 172.28.0.164:50221 #676 (612 connections now open) 2015-10-05T11:19:32.146+0100 [mongosMain] connection accepted from 172.28.0.164:50223 #677 (613 connections now open) 2015-10-05T11:19:32.146+0100 [mongosMain] connection accepted from 172.28.0.164:50222 #678 (614 connections now open) 2015-10-05T11:19:32.147+0100 [mongosMain] connection accepted from 172.28.0.164:50224 #679 (615 connections now open) 2015-10-05T11:19:32.148+0100 [mongosMain] connection accepted from 172.28.0.164:50225 #680 (616 connections now open) 2015-10-05T11:19:32.154+0100 [conn606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.155+0100 [conn658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.155+0100 [conn664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.155+0100 [conn665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.156+0100 [conn666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.158+0100 [mongosMain] connection accepted from 172.28.0.164:50226 #681 (617 connections now open) 2015-10-05T11:19:32.171+0100 [mongosMain] connection accepted from 172.28.0.164:50227 #682 (618 connections now open) 2015-10-05T11:19:32.177+0100 [mongosMain] connection accepted from 172.28.0.164:50228 #683 (619 connections now open) 2015-10-05T11:19:32.184+0100 [conn668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.188+0100 [conn667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.189+0100 [conn645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.203+0100 [mongosMain] connection accepted from 172.28.0.164:50230 #684 (620 connections now open) 2015-10-05T11:19:32.204+0100 [mongosMain] connection accepted from 172.28.0.164:50231 #685 (621 connections now open) 2015-10-05T11:19:32.206+0100 [mongosMain] connection accepted from 172.28.0.164:50232 #686 (622 connections now open) 2015-10-05T11:19:32.206+0100 [mongosMain] connection accepted from 172.28.0.164:50233 #687 (623 connections now open) 2015-10-05T11:19:32.224+0100 [mongosMain] connection accepted from 172.28.0.164:50234 #688 (624 connections now open) 2015-10-05T11:19:32.232+0100 [mongosMain] connection accepted from 172.28.0.164:50229 #689 (625 connections now open) 2015-10-05T11:19:32.249+0100 [mongosMain] connection accepted from 172.28.0.164:50235 #690 (626 connections now open) 2015-10-05T11:19:32.250+0100 [mongosMain] connection accepted from 172.28.0.164:50236 #691 (627 connections now open) 2015-10-05T11:19:32.251+0100 [mongosMain] connection accepted from 172.28.0.164:50237 #692 (628 connections now open) 2015-10-05T11:19:32.254+0100 [mongosMain] connection accepted from 172.28.0.164:50239 #693 (629 connections now open) 2015-10-05T11:19:32.266+0100 [mongosMain] connection accepted from 172.28.0.164:50240 #694 (630 connections now open) 2015-10-05T11:19:32.272+0100 [mongosMain] connection accepted from 172.28.0.164:50241 #695 (631 connections now open) 2015-10-05T11:19:32.274+0100 [conn610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.280+0100 [conn677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.281+0100 [conn679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.281+0100 [conn663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.281+0100 [conn676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.282+0100 [conn670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.282+0100 [conn671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.282+0100 [conn674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.282+0100 [conn673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.283+0100 [conn637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.283+0100 [conn672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.283+0100 [conn680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.300+0100 [conn652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.300+0100 [conn681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.300+0100 [conn662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.300+0100 [conn678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.302+0100 [mongosMain] connection accepted from 172.28.0.164:50242 #696 (632 connections now open) 2015-10-05T11:19:32.316+0100 [mongosMain] connection accepted from 172.28.0.164:50246 #697 (633 connections now open) 2015-10-05T11:19:32.321+0100 [conn683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.322+0100 [conn615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.323+0100 [conn682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.329+0100 [mongosMain] connection accepted from 172.28.0.164:50247 #698 (634 connections now open) 2015-10-05T11:19:32.330+0100 [mongosMain] connection accepted from 172.28.0.164:50248 #699 (635 connections now open) 2015-10-05T11:19:32.330+0100 [mongosMain] connection accepted from 172.28.0.164:50249 #700 (636 connections now open) 2015-10-05T11:19:32.331+0100 [mongosMain] connection accepted from 172.28.0.164:50250 #701 (637 connections now open) 2015-10-05T11:19:32.331+0100 [mongosMain] connection accepted from 172.28.0.164:50252 #702 (638 connections now open) 2015-10-05T11:19:32.331+0100 [mongosMain] connection accepted from 172.28.0.164:50251 #703 (639 connections now open) 2015-10-05T11:19:32.332+0100 [mongosMain] connection accepted from 172.28.0.164:50254 #704 (640 connections now open) 2015-10-05T11:19:32.332+0100 [mongosMain] connection accepted from 172.28.0.164:50255 #705 (641 connections now open) 2015-10-05T11:19:32.332+0100 [mongosMain] connection accepted from 172.28.0.164:50253 #706 (642 connections now open) 2015-10-05T11:19:32.332+0100 [mongosMain] connection accepted from 172.28.0.164:50256 #707 (643 connections now open) 2015-10-05T11:19:32.333+0100 [mongosMain] connection accepted from 172.28.0.164:50257 #708 (644 connections now open) 2015-10-05T11:19:32.333+0100 [mongosMain] connection accepted from 172.28.0.164:50258 #709 (645 connections now open) 2015-10-05T11:19:32.335+0100 [mongosMain] connection accepted from 172.28.0.164:50259 #710 (646 connections now open) 2015-10-05T11:19:32.342+0100 [mongosMain] connection accepted from 172.28.0.164:50260 #711 (647 connections now open) 2015-10-05T11:19:32.345+0100 [mongosMain] connection accepted from 172.28.0.164:50261 #712 (648 connections now open) 2015-10-05T11:19:32.346+0100 [mongosMain] connection accepted from 172.28.0.164:50262 #713 (649 connections now open) 2015-10-05T11:19:32.346+0100 [mongosMain] connection accepted from 172.28.0.164:50263 #714 (650 connections now open) 2015-10-05T11:19:32.348+0100 [conn684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.350+0100 [conn686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.350+0100 [conn687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.352+0100 [conn685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.355+0100 [mongosMain] connection accepted from 172.28.0.164:50264 #715 (651 connections now open) 2015-10-05T11:19:32.357+0100 [conn675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.420+0100 [mongosMain] connection accepted from 172.28.0.164:50265 #716 (652 connections now open) 2015-10-05T11:19:32.421+0100 [mongosMain] connection accepted from 172.28.0.164:50266 #717 (653 connections now open) 2015-10-05T11:19:32.442+0100 [conn669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.535+0100 [mongosMain] connection accepted from 172.28.0.164:50267 #718 (654 connections now open) 2015-10-05T11:19:32.538+0100 [mongosMain] connection accepted from 172.28.0.164:50277 #719 (655 connections now open) 2015-10-05T11:19:32.539+0100 [mongosMain] connection accepted from 172.28.0.164:50275 #720 (656 connections now open) 2015-10-05T11:19:32.541+0100 [conn689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.543+0100 [conn688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.543+0100 [conn695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.543+0100 [conn693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.544+0100 [conn690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.544+0100 [conn691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.546+0100 [conn694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.547+0100 [conn692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.555+0100 [mongosMain] connection accepted from 172.28.0.164:50276 #721 (657 connections now open) 2015-10-05T11:19:32.560+0100 [mongosMain] connection accepted from 172.28.0.164:50272 #722 (658 connections now open) 2015-10-05T11:19:32.585+0100 [mongosMain] connection accepted from 172.28.0.164:50270 #723 (659 connections now open) 2015-10-05T11:19:32.585+0100 [mongosMain] connection accepted from 172.28.0.164:50273 #724 (660 connections now open) 2015-10-05T11:19:32.591+0100 [conn696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.594+0100 [conn698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.594+0100 [conn699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.595+0100 [conn701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.595+0100 [conn702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.595+0100 [conn703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.595+0100 [conn704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.596+0100 [conn706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.596+0100 [conn709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.596+0100 [conn705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.596+0100 [conn710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.596+0100 [conn708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.599+0100 [conn616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.601+0100 [conn711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.601+0100 [conn714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.615+0100 [mongosMain] connection accepted from 172.28.0.164:50271 #725 (661 connections now open) 2015-10-05T11:19:32.691+0100 [conn715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.691+0100 [conn700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.695+0100 [conn697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.695+0100 [conn717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.696+0100 [mongosMain] connection accepted from 172.28.0.164:50279 #726 (662 connections now open) 2015-10-05T11:19:32.696+0100 [mongosMain] connection accepted from 172.28.0.164:50292 #727 (663 connections now open) 2015-10-05T11:19:32.697+0100 [mongosMain] connection accepted from 172.28.0.164:50280 #728 (664 connections now open) 2015-10-05T11:19:32.699+0100 [mongosMain] connection accepted from 172.28.0.164:50285 #729 (665 connections now open) 2015-10-05T11:19:32.699+0100 [mongosMain] connection accepted from 172.28.0.164:50281 #730 (666 connections now open) 2015-10-05T11:19:32.700+0100 [mongosMain] connection accepted from 172.28.0.164:50287 #731 (667 connections now open) 2015-10-05T11:19:32.704+0100 [conn719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.707+0100 [mongosMain] connection accepted from 172.28.0.164:50283 #732 (668 connections now open) 2015-10-05T11:19:32.708+0100 [mongosMain] connection accepted from 172.28.0.164:50286 #733 (669 connections now open) 2015-10-05T11:19:32.750+0100 [mongosMain] connection accepted from 172.28.0.164:50274 #734 (670 connections now open) 2015-10-05T11:19:32.751+0100 [conn720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.751+0100 [mongosMain] connection accepted from 172.28.0.164:50290 #735 (671 connections now open) 2015-10-05T11:19:32.754+0100 [conn707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.756+0100 [mongosMain] connection accepted from 172.28.0.164:50282 #736 (672 connections now open) 2015-10-05T11:19:32.757+0100 [mongosMain] connection accepted from 172.28.0.164:50289 #737 (673 connections now open) 2015-10-05T11:19:32.757+0100 [mongosMain] connection accepted from 172.28.0.164:50288 #738 (674 connections now open) 2015-10-05T11:19:32.761+0100 [mongosMain] connection accepted from 172.28.0.164:50291 #739 (675 connections now open) 2015-10-05T11:19:32.761+0100 [conn716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.762+0100 [mongosMain] connection accepted from 172.28.0.164:50284 #740 (676 connections now open) 2015-10-05T11:19:32.766+0100 [mongosMain] connection accepted from 172.28.0.164:50293 #741 (677 connections now open) 2015-10-05T11:19:32.769+0100 [mongosMain] connection accepted from 172.28.0.164:50294 #742 (678 connections now open) 2015-10-05T11:19:32.772+0100 [mongosMain] connection accepted from 172.28.0.164:50295 #743 (679 connections now open) 2015-10-05T11:19:32.774+0100 [mongosMain] connection accepted from 172.28.0.164:50278 #744 (680 connections now open) 2015-10-05T11:19:32.782+0100 [conn721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.796+0100 [conn722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.926+0100 [mongosMain] connection accepted from 172.28.0.164:50301 #745 (681 connections now open) 2015-10-05T11:19:32.935+0100 [conn718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.936+0100 [mongosMain] connection accepted from 172.28.0.164:50300 #746 (682 connections now open) 2015-10-05T11:19:32.938+0100 [mongosMain] connection accepted from 172.28.0.164:50302 #747 (683 connections now open) 2015-10-05T11:19:32.938+0100 [mongosMain] connection accepted from 172.28.0.164:50303 #748 (684 connections now open) 2015-10-05T11:19:32.940+0100 [mongosMain] connection accepted from 172.28.0.164:50304 #749 (685 connections now open) 2015-10-05T11:19:32.940+0100 [mongosMain] connection accepted from 172.28.0.164:50305 #750 (686 connections now open) 2015-10-05T11:19:32.943+0100 [mongosMain] connection accepted from 172.28.0.164:50307 #751 (687 connections now open) 2015-10-05T11:19:32.943+0100 [mongosMain] connection accepted from 172.28.0.164:50306 #752 (688 connections now open) 2015-10-05T11:19:32.943+0100 [conn712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:32.946+0100 [mongosMain] connection accepted from 172.28.0.164:50308 #753 (689 connections now open) 2015-10-05T11:19:33.034+0100 [conn713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.053+0100 [conn726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.112+0100 [conn727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.112+0100 [conn725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.112+0100 [conn657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.122+0100 [conn728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.126+0100 [conn724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.126+0100 [conn735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.127+0100 [conn737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.127+0100 [conn733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.127+0100 [conn731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.129+0100 [conn732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.142+0100 [conn739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.143+0100 [conn734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.144+0100 [conn738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.201+0100 [conn730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.201+0100 [conn740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.266+0100 [conn729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.273+0100 [conn747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.273+0100 [conn746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.275+0100 [conn748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.298+0100 [conn750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.364+0100 [conn751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.365+0100 [conn744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.365+0100 [conn741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.365+0100 [conn745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.367+0100 [conn752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.367+0100 [conn736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.369+0100 [conn753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.370+0100 [conn743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.457+0100 [conn749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.495+0100 [conn742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.504+0100 [conn723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:33.779+0100 [conn593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:37.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124eb912deab02e298427c 2015-10-05T11:19:38.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:40.106+0100 [mongosMain] connection accepted from 127.0.0.1:56566 #754 (690 connections now open) 2015-10-05T11:19:40.108+0100 [conn754] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:40.109+0100 [conn754] end connection 127.0.0.1:56566 (689 connections now open) 2015-10-05T11:19:43.580+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:19:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:19:45.685+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56124ebed67947988ef73bd1') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444040385433), why: "doing balance round", ts: ObjectId('56124ec112deab02e29842c1') } } gle1: { lastOp: Timestamp 1444040378000|1, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1444040385000|5, connectionId: 39966, updatedExisting: true, n: 1, syncMillis: 101, writtenTo: null, err: null, waited: 101, ok: 1.0 } 2015-10-05T11:19:45.687+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:19:45.687+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:19:48.927+0100 [mongosMain] connection accepted from 172.28.0.164:50352 #755 (690 connections now open) 2015-10-05T11:19:48.930+0100 [conn755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.930+0100 [mongosMain] connection accepted from 172.28.0.164:50353 #756 (691 connections now open) 2015-10-05T11:19:48.931+0100 [mongosMain] connection accepted from 172.28.0.164:50354 #757 (692 connections now open) 2015-10-05T11:19:48.931+0100 [mongosMain] connection accepted from 172.28.0.164:50355 #758 (693 connections now open) 2015-10-05T11:19:48.933+0100 [mongosMain] connection accepted from 172.28.0.164:50356 #759 (694 connections now open) 2015-10-05T11:19:48.934+0100 [mongosMain] connection accepted from 172.28.0.164:50357 #760 (695 connections now open) 2015-10-05T11:19:48.934+0100 [conn757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.935+0100 [mongosMain] connection accepted from 172.28.0.164:50358 #761 (696 connections now open) 2015-10-05T11:19:48.935+0100 [conn758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.935+0100 [mongosMain] connection accepted from 172.28.0.164:50359 #762 (697 connections now open) 2015-10-05T11:19:48.936+0100 [conn759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.937+0100 [conn760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.937+0100 [conn761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.938+0100 [mongosMain] connection accepted from 172.28.0.164:50360 #763 (698 connections now open) 2015-10-05T11:19:48.938+0100 [conn762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.938+0100 [mongosMain] connection accepted from 172.28.0.164:50361 #764 (699 connections now open) 2015-10-05T11:19:48.940+0100 [conn763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:48.940+0100 [conn764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:49.326+0100 [conn756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:19:51.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ec712deab02e298433c 2015-10-05T11:19:52.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:19:58.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ece12deab02e2984368 2015-10-05T11:19:58.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:04.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ed412deab02e2984396 2015-10-05T11:20:04.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:10.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124eda12deab02e29843cc 2015-10-05T11:20:10.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:13.737+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:20:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:20:13.737+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:20:13.806+0100 [LockPinger] handled late remove of old distributed lock with ts 56124ec112deab02e29842c1 2015-10-05T11:20:16.945+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ee012deab02e29843f4 2015-10-05T11:20:17.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:23.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ee712deab02e298441c 2015-10-05T11:20:23.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:28.862+0100 [mongosMain] connection accepted from 127.0.0.1:56612 #765 (700 connections now open) 2015-10-05T11:20:28.864+0100 [conn765] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:28.865+0100 [conn765] end connection 127.0.0.1:56612 (699 connections now open) 2015-10-05T11:20:29.514+0100 [mongosMain] connection accepted from 172.28.0.163:56613 #766 (700 connections now open) 2015-10-05T11:20:29.516+0100 [conn766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:29.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124eed12deab02e2984457 2015-10-05T11:20:29.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:37.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ef312deab02e2984477 2015-10-05T11:20:37.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:39.540+0100 [mongosMain] connection accepted from 127.0.0.1:56621 #767 (701 connections now open) 2015-10-05T11:20:39.542+0100 [conn767] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:39.543+0100 [conn767] end connection 127.0.0.1:56621 (700 connections now open) 2015-10-05T11:20:41.653+0100 [mongosMain] connection accepted from 172.28.0.164:50407 #768 (701 connections now open) 2015-10-05T11:20:41.654+0100 [mongosMain] connection accepted from 172.28.0.164:50408 #769 (702 connections now open) 2015-10-05T11:20:41.655+0100 [mongosMain] connection accepted from 172.28.0.164:50409 #770 (703 connections now open) 2015-10-05T11:20:41.655+0100 [mongosMain] connection accepted from 172.28.0.164:50410 #771 (704 connections now open) 2015-10-05T11:20:41.656+0100 [mongosMain] connection accepted from 172.28.0.164:50411 #772 (705 connections now open) 2015-10-05T11:20:41.656+0100 [mongosMain] connection accepted from 172.28.0.164:50412 #773 (706 connections now open) 2015-10-05T11:20:41.657+0100 [conn768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:41.657+0100 [conn769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:41.658+0100 [conn770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:41.658+0100 [conn771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:43.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124efb12deab02e29844ae 2015-10-05T11:20:43.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:44.085+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:20:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:20:46.645+0100 [mongosMain] connection accepted from 172.28.0.164:50419 #774 (707 connections now open) 2015-10-05T11:20:46.645+0100 [mongosMain] connection accepted from 172.28.0.164:50420 #775 (708 connections now open) 2015-10-05T11:20:46.649+0100 [conn775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.679+0100 [mongosMain] connection accepted from 172.28.0.164:50421 #776 (709 connections now open) 2015-10-05T11:20:46.679+0100 [mongosMain] connection accepted from 172.28.0.164:50422 #777 (710 connections now open) 2015-10-05T11:20:46.680+0100 [mongosMain] connection accepted from 172.28.0.164:50423 #778 (711 connections now open) 2015-10-05T11:20:46.680+0100 [mongosMain] connection accepted from 172.28.0.164:50424 #779 (712 connections now open) 2015-10-05T11:20:46.681+0100 [conn776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.681+0100 [mongosMain] connection accepted from 172.28.0.164:50425 #780 (713 connections now open) 2015-10-05T11:20:46.681+0100 [mongosMain] connection accepted from 172.28.0.164:50426 #781 (714 connections now open) 2015-10-05T11:20:46.682+0100 [conn778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.682+0100 [conn777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.682+0100 [mongosMain] connection accepted from 172.28.0.164:50427 #782 (715 connections now open) 2015-10-05T11:20:46.683+0100 [mongosMain] connection accepted from 172.28.0.164:50428 #783 (716 connections now open) 2015-10-05T11:20:46.683+0100 [conn780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.683+0100 [mongosMain] connection accepted from 172.28.0.164:50429 #784 (717 connections now open) 2015-10-05T11:20:46.684+0100 [conn779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.684+0100 [mongosMain] connection accepted from 172.28.0.164:50430 #785 (718 connections now open) 2015-10-05T11:20:46.684+0100 [conn781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.686+0100 [mongosMain] connection accepted from 172.28.0.164:50432 #786 (719 connections now open) 2015-10-05T11:20:46.686+0100 [conn782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.686+0100 [conn784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.686+0100 [mongosMain] connection accepted from 172.28.0.164:50433 #787 (720 connections now open) 2015-10-05T11:20:46.686+0100 [conn785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.687+0100 [conn783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.687+0100 [mongosMain] connection accepted from 172.28.0.164:50434 #788 (721 connections now open) 2015-10-05T11:20:46.688+0100 [mongosMain] connection accepted from 172.28.0.164:50435 #789 (722 connections now open) 2015-10-05T11:20:46.689+0100 [conn786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.690+0100 [conn787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.691+0100 [conn789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.692+0100 [mongosMain] connection accepted from 172.28.0.164:50436 #790 (723 connections now open) 2015-10-05T11:20:46.692+0100 [mongosMain] connection accepted from 172.28.0.164:50437 #791 (724 connections now open) 2015-10-05T11:20:46.693+0100 [mongosMain] connection accepted from 172.28.0.164:50438 #792 (725 connections now open) 2015-10-05T11:20:46.693+0100 [mongosMain] connection accepted from 172.28.0.164:50439 #793 (726 connections now open) 2015-10-05T11:20:46.694+0100 [mongosMain] connection accepted from 172.28.0.164:50440 #794 (727 connections now open) 2015-10-05T11:20:46.694+0100 [mongosMain] connection accepted from 172.28.0.164:50441 #795 (728 connections now open) 2015-10-05T11:20:46.694+0100 [mongosMain] connection accepted from 172.28.0.164:50442 #796 (729 connections now open) 2015-10-05T11:20:46.695+0100 [mongosMain] connection accepted from 172.28.0.164:50443 #797 (730 connections now open) 2015-10-05T11:20:46.703+0100 [mongosMain] connection accepted from 172.28.0.164:50444 #798 (731 connections now open) 2015-10-05T11:20:46.703+0100 [mongosMain] connection accepted from 172.28.0.164:50445 #799 (732 connections now open) 2015-10-05T11:20:46.704+0100 [conn792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.704+0100 [conn790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.704+0100 [conn791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.705+0100 [conn795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.705+0100 [conn796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.706+0100 [conn798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.706+0100 [mongosMain] connection accepted from 172.28.0.164:50446 #800 (733 connections now open) 2015-10-05T11:20:46.706+0100 [mongosMain] connection accepted from 172.28.0.164:50448 #801 (734 connections now open) 2015-10-05T11:20:46.707+0100 [conn793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.707+0100 [mongosMain] connection accepted from 172.28.0.164:50447 #802 (735 connections now open) 2015-10-05T11:20:46.707+0100 [mongosMain] connection accepted from 172.28.0.164:50449 #803 (736 connections now open) 2015-10-05T11:20:46.708+0100 [mongosMain] connection accepted from 172.28.0.164:50451 #804 (737 connections now open) 2015-10-05T11:20:46.708+0100 [conn794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.708+0100 [mongosMain] connection accepted from 172.28.0.164:50450 #805 (738 connections now open) 2015-10-05T11:20:46.708+0100 [mongosMain] connection accepted from 172.28.0.164:50452 #806 (739 connections now open) 2015-10-05T11:20:46.708+0100 [conn797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.708+0100 [mongosMain] connection accepted from 172.28.0.164:50453 #807 (740 connections now open) 2015-10-05T11:20:46.709+0100 [mongosMain] connection accepted from 172.28.0.164:50454 #808 (741 connections now open) 2015-10-05T11:20:46.709+0100 [mongosMain] connection accepted from 172.28.0.164:50456 #809 (742 connections now open) 2015-10-05T11:20:46.709+0100 [mongosMain] connection accepted from 172.28.0.164:50457 #810 (743 connections now open) 2015-10-05T11:20:46.709+0100 [mongosMain] connection accepted from 172.28.0.164:50458 #811 (744 connections now open) 2015-10-05T11:20:46.709+0100 [mongosMain] connection accepted from 172.28.0.164:50459 #812 (745 connections now open) 2015-10-05T11:20:46.710+0100 [mongosMain] connection accepted from 172.28.0.164:50455 #813 (746 connections now open) 2015-10-05T11:20:46.711+0100 [mongosMain] connection accepted from 172.28.0.164:50461 #814 (747 connections now open) 2015-10-05T11:20:46.711+0100 [conn800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.711+0100 [conn807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.712+0100 [conn802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.712+0100 [mongosMain] connection accepted from 172.28.0.164:50462 #815 (748 connections now open) 2015-10-05T11:20:46.712+0100 [mongosMain] connection accepted from 172.28.0.164:50460 #816 (749 connections now open) 2015-10-05T11:20:46.712+0100 [conn801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.713+0100 [mongosMain] connection accepted from 172.28.0.164:50463 #817 (750 connections now open) 2015-10-05T11:20:46.713+0100 [mongosMain] connection accepted from 172.28.0.164:50464 #818 (751 connections now open) 2015-10-05T11:20:46.717+0100 [mongosMain] connection accepted from 172.28.0.164:50467 #819 (752 connections now open) 2015-10-05T11:20:46.717+0100 [mongosMain] connection accepted from 172.28.0.164:50465 #820 (753 connections now open) 2015-10-05T11:20:46.718+0100 [mongosMain] connection accepted from 172.28.0.164:50466 #821 (754 connections now open) 2015-10-05T11:20:46.719+0100 [conn808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [conn811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [conn799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [conn810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [mongosMain] connection accepted from 172.28.0.164:50468 #822 (755 connections now open) 2015-10-05T11:20:46.719+0100 [conn803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [conn816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.719+0100 [conn806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.720+0100 [conn805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.721+0100 [conn804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.721+0100 [conn820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.721+0100 [conn809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.721+0100 [conn817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.722+0100 [conn822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.722+0100 [conn821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.723+0100 [mongosMain] connection accepted from 172.28.0.164:50469 #823 (756 connections now open) 2015-10-05T11:20:46.723+0100 [conn815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.723+0100 [conn819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.723+0100 [mongosMain] connection accepted from 172.28.0.164:50470 #824 (757 connections now open) 2015-10-05T11:20:46.724+0100 [mongosMain] connection accepted from 172.28.0.164:50471 #825 (758 connections now open) 2015-10-05T11:20:46.725+0100 [conn823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.726+0100 [mongosMain] connection accepted from 172.28.0.164:50472 #826 (759 connections now open) 2015-10-05T11:20:46.726+0100 [mongosMain] connection accepted from 172.28.0.164:50473 #827 (760 connections now open) 2015-10-05T11:20:46.726+0100 [mongosMain] connection accepted from 172.28.0.164:50474 #828 (761 connections now open) 2015-10-05T11:20:46.726+0100 [conn824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.727+0100 [mongosMain] connection accepted from 172.28.0.164:50475 #829 (762 connections now open) 2015-10-05T11:20:46.727+0100 [mongosMain] connection accepted from 172.28.0.164:50476 #830 (763 connections now open) 2015-10-05T11:20:46.727+0100 [mongosMain] connection accepted from 172.28.0.164:50477 #831 (764 connections now open) 2015-10-05T11:20:46.727+0100 [mongosMain] connection accepted from 172.28.0.164:50478 #832 (765 connections now open) 2015-10-05T11:20:46.727+0100 [mongosMain] connection accepted from 172.28.0.164:50479 #833 (766 connections now open) 2015-10-05T11:20:46.728+0100 [mongosMain] connection accepted from 172.28.0.164:50480 #834 (767 connections now open) 2015-10-05T11:20:46.728+0100 [mongosMain] connection accepted from 172.28.0.164:50482 #835 (768 connections now open) 2015-10-05T11:20:46.728+0100 [mongosMain] connection accepted from 172.28.0.164:50481 #836 (769 connections now open) 2015-10-05T11:20:46.728+0100 [mongosMain] connection accepted from 172.28.0.164:50483 #837 (770 connections now open) 2015-10-05T11:20:46.728+0100 [mongosMain] connection accepted from 172.28.0.164:50484 #838 (771 connections now open) 2015-10-05T11:20:46.729+0100 [mongosMain] connection accepted from 172.28.0.164:50485 #839 (772 connections now open) 2015-10-05T11:20:46.729+0100 [mongosMain] connection accepted from 172.28.0.164:50486 #840 (773 connections now open) 2015-10-05T11:20:46.729+0100 [mongosMain] connection accepted from 172.28.0.164:50487 #841 (774 connections now open) 2015-10-05T11:20:46.729+0100 [mongosMain] connection accepted from 172.28.0.164:50488 #842 (775 connections now open) 2015-10-05T11:20:46.733+0100 [conn825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.733+0100 [conn834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.733+0100 [conn833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.733+0100 [mongosMain] connection accepted from 172.28.0.164:50489 #843 (776 connections now open) 2015-10-05T11:20:46.734+0100 [mongosMain] connection accepted from 172.28.0.164:50490 #844 (777 connections now open) 2015-10-05T11:20:46.734+0100 [mongosMain] connection accepted from 172.28.0.164:50491 #845 (778 connections now open) 2015-10-05T11:20:46.734+0100 [conn828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.734+0100 [conn837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.734+0100 [mongosMain] connection accepted from 172.28.0.164:50493 #846 (779 connections now open) 2015-10-05T11:20:46.735+0100 [mongosMain] connection accepted from 172.28.0.164:50495 #847 (780 connections now open) 2015-10-05T11:20:46.735+0100 [mongosMain] connection accepted from 172.28.0.164:50494 #848 (781 connections now open) 2015-10-05T11:20:46.735+0100 [mongosMain] connection accepted from 172.28.0.164:50492 #849 (782 connections now open) 2015-10-05T11:20:46.735+0100 [conn829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.735+0100 [mongosMain] connection accepted from 172.28.0.164:50496 #850 (783 connections now open) 2015-10-05T11:20:46.737+0100 [conn838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.738+0100 [mongosMain] connection accepted from 172.28.0.164:50497 #851 (784 connections now open) 2015-10-05T11:20:46.741+0100 [mongosMain] connection accepted from 172.28.0.164:50498 #852 (785 connections now open) 2015-10-05T11:20:46.741+0100 [mongosMain] connection accepted from 172.28.0.164:50499 #853 (786 connections now open) 2015-10-05T11:20:46.741+0100 [mongosMain] connection accepted from 172.28.0.164:50500 #854 (787 connections now open) 2015-10-05T11:20:46.741+0100 [mongosMain] connection accepted from 172.28.0.164:50502 #855 (788 connections now open) 2015-10-05T11:20:46.741+0100 [conn830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.742+0100 [mongosMain] connection accepted from 172.28.0.164:50501 #856 (789 connections now open) 2015-10-05T11:20:46.742+0100 [mongosMain] connection accepted from 172.28.0.164:50503 #857 (790 connections now open) 2015-10-05T11:20:46.742+0100 [mongosMain] connection accepted from 172.28.0.164:50504 #858 (791 connections now open) 2015-10-05T11:20:46.746+0100 [conn832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.747+0100 [conn842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.747+0100 [conn835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.747+0100 [conn846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.747+0100 [conn847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.748+0100 [conn849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.748+0100 [conn826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.748+0100 [conn843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.748+0100 [conn844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.749+0100 [conn841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.749+0100 [mongosMain] connection accepted from 172.28.0.164:50505 #859 (792 connections now open) 2015-10-05T11:20:46.757+0100 [conn840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.759+0100 [conn854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.762+0100 [conn836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.772+0100 [mongosMain] connection accepted from 172.28.0.164:50507 #860 (793 connections now open) 2015-10-05T11:20:46.772+0100 [mongosMain] connection accepted from 172.28.0.164:50506 #861 (794 connections now open) 2015-10-05T11:20:46.773+0100 [mongosMain] connection accepted from 172.28.0.164:50508 #862 (795 connections now open) 2015-10-05T11:20:46.774+0100 [mongosMain] connection accepted from 172.28.0.164:50509 #863 (796 connections now open) 2015-10-05T11:20:46.774+0100 [mongosMain] connection accepted from 172.28.0.164:50510 #864 (797 connections now open) 2015-10-05T11:20:46.775+0100 [mongosMain] connection accepted from 172.28.0.164:50511 #865 (798 connections now open) 2015-10-05T11:20:46.775+0100 [mongosMain] connection accepted from 172.28.0.164:50512 #866 (799 connections now open) 2015-10-05T11:20:46.775+0100 [mongosMain] connection accepted from 172.28.0.164:50513 #867 (800 connections now open) 2015-10-05T11:20:46.775+0100 [mongosMain] connection accepted from 172.28.0.164:50514 #868 (801 connections now open) 2015-10-05T11:20:46.776+0100 [mongosMain] connection accepted from 172.28.0.164:50515 #869 (802 connections now open) 2015-10-05T11:20:46.776+0100 [mongosMain] connection accepted from 172.28.0.164:50516 #870 (803 connections now open) 2015-10-05T11:20:46.776+0100 [mongosMain] connection accepted from 172.28.0.164:50517 #871 (804 connections now open) 2015-10-05T11:20:46.776+0100 [mongosMain] connection accepted from 172.28.0.164:50518 #872 (805 connections now open) 2015-10-05T11:20:46.776+0100 [conn858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.776+0100 [mongosMain] connection accepted from 172.28.0.164:50521 #873 (806 connections now open) 2015-10-05T11:20:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:50520 #874 (807 connections now open) 2015-10-05T11:20:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:50519 #875 (808 connections now open) 2015-10-05T11:20:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:50522 #876 (809 connections now open) 2015-10-05T11:20:46.777+0100 [mongosMain] connection accepted from 172.28.0.164:50523 #877 (810 connections now open) 2015-10-05T11:20:46.778+0100 [mongosMain] connection accepted from 172.28.0.164:50524 #878 (811 connections now open) 2015-10-05T11:20:46.778+0100 [mongosMain] connection accepted from 172.28.0.164:50525 #879 (812 connections now open) 2015-10-05T11:20:46.779+0100 [mongosMain] connection accepted from 172.28.0.164:50526 #880 (813 connections now open) 2015-10-05T11:20:46.780+0100 [mongosMain] connection accepted from 172.28.0.164:50527 #881 (814 connections now open) 2015-10-05T11:20:46.781+0100 [mongosMain] connection accepted from 172.28.0.164:50528 #882 (815 connections now open) 2015-10-05T11:20:46.782+0100 [mongosMain] connection accepted from 172.28.0.164:50529 #883 (816 connections now open) 2015-10-05T11:20:46.787+0100 [conn859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.787+0100 [conn774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.787+0100 [conn857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.787+0100 [conn856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.787+0100 [conn831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.788+0100 [conn818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.796+0100 [conn845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.797+0100 [conn862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.802+0100 [conn863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.803+0100 [conn872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.804+0100 [conn875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.805+0100 [conn812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.805+0100 [conn772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.806+0100 [conn874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.806+0100 [conn873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.806+0100 [conn867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.818+0100 [conn860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.819+0100 [conn876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.820+0100 [conn879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.820+0100 [conn878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.821+0100 [conn880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:46.822+0100 [conn881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.241+0100 [conn883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.242+0100 [conn877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.250+0100 [conn882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.254+0100 [conn853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.254+0100 [conn773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.260+0100 [conn852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.261+0100 [conn861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.551+0100 [mongosMain] connection accepted from 172.28.0.164:50536 #884 (817 connections now open) 2015-10-05T11:20:47.556+0100 [mongosMain] connection accepted from 172.28.0.164:50535 #885 (818 connections now open) 2015-10-05T11:20:47.558+0100 [conn884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:47.560+0100 [conn885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:49.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f0112deab02e29845d2 2015-10-05T11:20:50.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:56.788+0100 [mongosMain] connection accepted from 172.28.0.164:50567 #886 (819 connections now open) 2015-10-05T11:20:56.789+0100 [mongosMain] connection accepted from 172.28.0.164:50568 #887 (820 connections now open) 2015-10-05T11:20:56.802+0100 [conn886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:56.803+0100 [conn887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:57.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f0812deab02e29846fd 2015-10-05T11:20:57.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:20:58.418+0100 [mongosMain] connection accepted from 172.28.0.164:50569 #888 (821 connections now open) 2015-10-05T11:20:58.421+0100 [conn888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:20:58.547+0100 [mongosMain] connection accepted from 172.28.0.164:50570 #889 (822 connections now open) 2015-10-05T11:20:58.551+0100 [conn889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:03.190+0100 [mongosMain] connection accepted from 172.28.0.164:50601 #890 (823 connections now open) 2015-10-05T11:21:03.237+0100 [mongosMain] connection accepted from 172.28.0.164:50604 #891 (824 connections now open) 2015-10-05T11:21:03.925+0100 [conn891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.025+0100 [conn890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.079+0100 [mongosMain] connection accepted from 172.28.0.164:50619 #892 (825 connections now open) 2015-10-05T11:21:04.422+0100 [conn892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.490+0100 [mongosMain] connection accepted from 172.28.0.164:50645 #893 (826 connections now open) 2015-10-05T11:21:04.493+0100 [conn893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.598+0100 [mongosMain] connection accepted from 172.28.0.164:50727 #894 (827 connections now open) 2015-10-05T11:21:04.660+0100 [conn894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.690+0100 [mongosMain] connection accepted from 172.28.0.164:50767 #895 (828 connections now open) 2015-10-05T11:21:04.793+0100 [conn895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.798+0100 [mongosMain] connection accepted from 172.28.0.164:50769 #896 (829 connections now open) 2015-10-05T11:21:04.853+0100 [conn896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:04.971+0100 [mongosMain] connection accepted from 172.28.0.164:50778 #897 (830 connections now open) 2015-10-05T11:21:04.989+0100 [conn897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:05.037+0100 [mongosMain] connection accepted from 172.28.0.164:50781 #898 (831 connections now open) 2015-10-05T11:21:05.345+0100 [conn898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:05.540+0100 [mongosMain] connection accepted from 172.28.0.164:50785 #899 (832 connections now open) 2015-10-05T11:21:05.568+0100 [conn899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:05.647+0100 [mongosMain] connection accepted from 172.28.0.164:50790 #900 (833 connections now open) 2015-10-05T11:21:05.720+0100 [conn900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.354+0100 [mongosMain] connection accepted from 172.28.0.164:50872 #901 (834 connections now open) 2015-10-05T11:21:06.375+0100 [conn901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.415+0100 [mongosMain] connection accepted from 172.28.0.164:50873 #902 (835 connections now open) 2015-10-05T11:21:06.419+0100 [conn902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.431+0100 [mongosMain] connection accepted from 172.28.0.164:50874 #903 (836 connections now open) 2015-10-05T11:21:06.440+0100 [conn903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.558+0100 [mongosMain] connection accepted from 172.28.0.164:50875 #904 (837 connections now open) 2015-10-05T11:21:06.562+0100 [conn904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.593+0100 [mongosMain] connection accepted from 172.28.0.164:50876 #905 (838 connections now open) 2015-10-05T11:21:06.595+0100 [conn905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:06.855+0100 [mongosMain] connection accepted from 172.28.0.164:50877 #906 (839 connections now open) 2015-10-05T11:21:07.075+0100 [conn906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.082+0100 [mongosMain] connection accepted from 172.28.0.164:50879 #907 (840 connections now open) 2015-10-05T11:21:07.091+0100 [conn907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.100+0100 [mongosMain] connection accepted from 172.28.0.164:50881 #908 (841 connections now open) 2015-10-05T11:21:07.105+0100 [conn908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.126+0100 [mongosMain] connection accepted from 172.28.0.164:50882 #909 (842 connections now open) 2015-10-05T11:21:07.131+0100 [conn909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.160+0100 [mongosMain] connection accepted from 172.28.0.164:50884 #910 (843 connections now open) 2015-10-05T11:21:07.167+0100 [conn910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.200+0100 [mongosMain] connection accepted from 172.28.0.164:50885 #911 (844 connections now open) 2015-10-05T11:21:07.217+0100 [conn911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.308+0100 [mongosMain] connection accepted from 172.28.0.164:50886 #912 (845 connections now open) 2015-10-05T11:21:07.338+0100 [conn912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.392+0100 [mongosMain] connection accepted from 172.28.0.164:50889 #913 (846 connections now open) 2015-10-05T11:21:07.412+0100 [conn913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.422+0100 [mongosMain] connection accepted from 172.28.0.164:50890 #914 (847 connections now open) 2015-10-05T11:21:07.425+0100 [conn914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.440+0100 [mongosMain] connection accepted from 172.28.0.164:50891 #915 (848 connections now open) 2015-10-05T11:21:07.444+0100 [conn915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.515+0100 [mongosMain] connection accepted from 172.28.0.164:50892 #916 (849 connections now open) 2015-10-05T11:21:07.524+0100 [conn916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.588+0100 [mongosMain] connection accepted from 172.28.0.164:50893 #917 (850 connections now open) 2015-10-05T11:21:07.591+0100 [conn917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.596+0100 [mongosMain] connection accepted from 172.28.0.164:50894 #918 (851 connections now open) 2015-10-05T11:21:07.605+0100 [mongosMain] connection accepted from 172.28.0.164:50895 #919 (852 connections now open) 2015-10-05T11:21:07.610+0100 [conn919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.651+0100 [mongosMain] connection accepted from 172.28.0.164:50899 #920 (853 connections now open) 2015-10-05T11:21:07.672+0100 [mongosMain] connection accepted from 172.28.0.164:50900 #921 (854 connections now open) 2015-10-05T11:21:07.675+0100 [conn920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.776+0100 [mongosMain] connection accepted from 172.28.0.164:50904 #922 (855 connections now open) 2015-10-05T11:21:07.779+0100 [conn922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:07.907+0100 [mongosMain] connection accepted from 172.28.0.164:50906 #923 (856 connections now open) 2015-10-05T11:21:07.910+0100 [conn923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:08.189+0100 [mongosMain] connection accepted from 172.28.0.164:50907 #924 (857 connections now open) 2015-10-05T11:21:08.192+0100 [conn924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:08.217+0100 [mongosMain] connection accepted from 172.28.0.164:50908 #925 (858 connections now open) 2015-10-05T11:21:08.219+0100 [conn925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:08.294+0100 [mongosMain] connection accepted from 172.28.0.164:50909 #926 (859 connections now open) 2015-10-05T11:21:08.296+0100 [conn926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:09.156+0100 [mongosMain] connection accepted from 172.28.0.164:50911 #927 (860 connections now open) 2015-10-05T11:21:09.159+0100 [conn927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:10.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f1512deab02e2984912 2015-10-05T11:21:10.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:21:11.154+0100 [mongosMain] connection accepted from 172.28.0.164:50913 #928 (861 connections now open) 2015-10-05T11:21:12.171+0100 [conn928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:14.150+0100 [mongosMain] connection accepted from 172.28.0.164:50914 #929 (862 connections now open) 2015-10-05T11:21:14.153+0100 [conn929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:14.711+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:21:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:21:15.170+0100 [mongosMain] connection accepted from 172.28.0.164:50915 #930 (863 connections now open) 2015-10-05T11:21:15.173+0100 [conn930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:16.164+0100 [mongosMain] connection accepted from 172.28.0.164:50916 #931 (864 connections now open) 2015-10-05T11:21:16.168+0100 [conn931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:17.162+0100 [mongosMain] connection accepted from 172.28.0.164:50917 #932 (865 connections now open) 2015-10-05T11:21:17.165+0100 [conn932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:19.156+0100 [mongosMain] connection accepted from 172.28.0.164:50919 #933 (866 connections now open) 2015-10-05T11:21:19.159+0100 [conn933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:20.174+0100 [mongosMain] connection accepted from 172.28.0.164:50921 #934 (867 connections now open) 2015-10-05T11:21:20.177+0100 [conn934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:21.174+0100 [mongosMain] connection accepted from 172.28.0.164:50923 #935 (868 connections now open) 2015-10-05T11:21:21.178+0100 [conn935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:22.176+0100 [mongosMain] connection accepted from 172.28.0.164:50926 #936 (869 connections now open) 2015-10-05T11:21:22.180+0100 [conn936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:23.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f2212deab02e2984984 2015-10-05T11:21:23.168+0100 [mongosMain] connection accepted from 172.28.0.164:50928 #937 (870 connections now open) 2015-10-05T11:21:23.171+0100 [conn937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:23.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:21:25.148+0100 [mongosMain] connection accepted from 172.28.0.164:50931 #938 (871 connections now open) 2015-10-05T11:21:25.152+0100 [conn938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:27.144+0100 [mongosMain] connection accepted from 172.28.0.164:50935 #939 (872 connections now open) 2015-10-05T11:21:27.150+0100 [conn939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:28.418+0100 [mongosMain] connection accepted from 127.0.0.1:56721 #940 (873 connections now open) 2015-10-05T11:21:28.421+0100 [conn940] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:28.422+0100 [conn940] end connection 127.0.0.1:56721 (872 connections now open) 2015-10-05T11:21:28.658+0100 [mongosMain] connection accepted from 172.28.0.164:50937 #941 (873 connections now open) 2015-10-05T11:21:28.662+0100 [conn941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:29.529+0100 [mongosMain] connection accepted from 172.28.0.163:56722 #942 (874 connections now open) 2015-10-05T11:21:29.531+0100 [conn942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:29.682+0100 [mongosMain] connection accepted from 172.28.0.164:50939 #943 (875 connections now open) 2015-10-05T11:21:29.685+0100 [conn943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:31.654+0100 [mongosMain] connection accepted from 172.28.0.164:50941 #944 (876 connections now open) 2015-10-05T11:21:31.659+0100 [conn944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:39.839+0100 [mongosMain] connection accepted from 127.0.0.1:56724 #945 (877 connections now open) 2015-10-05T11:21:39.842+0100 [conn945] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:21:39.842+0100 [conn945] end connection 127.0.0.1:56724 (876 connections now open) 2015-10-05T11:21:41.431+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:21:41.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:21:44.844+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:21:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:21:47.507+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:21:47.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:21:53.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f4112deab02e2984a6b 2015-10-05T11:21:53.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:22:12.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f5312deab02e2984aeb 2015-10-05T11:22:12.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:22:15.122+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:22:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:22:24.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f6012deab02e2984b40 2015-10-05T11:22:24.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:22:28.698+0100 [mongosMain] connection accepted from 127.0.0.1:56772 #946 (877 connections now open) 2015-10-05T11:22:28.701+0100 [conn946] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:22:28.702+0100 [conn946] end connection 127.0.0.1:56772 (876 connections now open) 2015-10-05T11:22:29.545+0100 [mongosMain] connection accepted from 172.28.0.163:56773 #947 (877 connections now open) 2015-10-05T11:22:29.547+0100 [conn947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:22:36.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f6c12deab02e2984b93 2015-10-05T11:22:36.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:22:39.490+0100 [mongosMain] connection accepted from 127.0.0.1:56779 #948 (878 connections now open) 2015-10-05T11:22:39.492+0100 [conn948] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:22:39.493+0100 [conn948] end connection 127.0.0.1:56779 (877 connections now open) 2015-10-05T11:22:45.289+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:22:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:22:49.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f7812deab02e2984c0e 2015-10-05T11:22:49.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:22:56.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f7f12deab02e2984c62 2015-10-05T11:22:56.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:02.813+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f8612deab02e2984cdc 2015-10-05T11:23:02.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:09.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f8c12deab02e2984d5e 2015-10-05T11:23:09.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:15.539+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:23:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:23:15.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f9312deab02e2984dce 2015-10-05T11:23:15.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:21.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124f9912deab02e2984e27 2015-10-05T11:23:22.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:27.206+0100 [mongosMain] connection accepted from 127.0.0.1:56844 #949 (878 connections now open) 2015-10-05T11:23:27.209+0100 [conn949] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:23:27.210+0100 [conn949] end connection 127.0.0.1:56844 (877 connections now open) 2015-10-05T11:23:29.562+0100 [mongosMain] connection accepted from 172.28.0.163:56845 #950 (878 connections now open) 2015-10-05T11:23:29.564+0100 [conn950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:23:29.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fa112deab02e2984e7d 2015-10-05T11:23:30.027+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:31.514+0100 [mongosMain] connection accepted from 127.0.0.1:56847 #951 (879 connections now open) 2015-10-05T11:23:31.517+0100 [conn951] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:23:31.518+0100 [conn951] end connection 127.0.0.1:56847 (878 connections now open) 2015-10-05T11:23:32.755+0100 [mongosMain] connection accepted from 127.0.0.1:56850 #952 (879 connections now open) 2015-10-05T11:23:32.758+0100 [conn952] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:23:32.759+0100 [conn952] end connection 127.0.0.1:56850 (878 connections now open) 2015-10-05T11:23:36.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fa812deab02e2984ed3 2015-10-05T11:23:36.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:40.354+0100 [mongosMain] connection accepted from 127.0.0.1:56854 #953 (879 connections now open) 2015-10-05T11:23:40.358+0100 [conn953] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:23:40.358+0100 [conn953] end connection 127.0.0.1:56854 (878 connections now open) 2015-10-05T11:23:42.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fae12deab02e2984f3d 2015-10-05T11:23:43.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:46.288+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:23:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:23:49.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fb512deab02e2984f9e 2015-10-05T11:23:49.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:23:56.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fbb12deab02e2984ffd 2015-10-05T11:23:56.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:02.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fc212deab02e298505a 2015-10-05T11:24:02.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:09.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fc812deab02e29850ed 2015-10-05T11:24:09.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:15.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fcf12deab02e298514e 2015-10-05T11:24:15.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:17.154+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:24:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:24:21.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fd512deab02e29851c4 2015-10-05T11:24:22.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:28.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fdc12deab02e298522f 2015-10-05T11:24:28.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:29.035+0100 [mongosMain] connection accepted from 127.0.0.1:56933 #954 (879 connections now open) 2015-10-05T11:24:29.038+0100 [conn954] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:24:29.039+0100 [conn954] end connection 127.0.0.1:56933 (878 connections now open) 2015-10-05T11:24:29.578+0100 [mongosMain] connection accepted from 172.28.0.163:56934 #955 (879 connections now open) 2015-10-05T11:24:29.579+0100 [conn955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:24:34.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fe212deab02e2985296 2015-10-05T11:24:34.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:39.494+0100 [mongosMain] connection accepted from 127.0.0.1:56950 #956 (880 connections now open) 2015-10-05T11:24:39.496+0100 [conn956] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:24:39.496+0100 [conn956] end connection 127.0.0.1:56950 (879 connections now open) 2015-10-05T11:24:40.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fe812deab02e29852df 2015-10-05T11:24:40.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:49.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124fee12deab02e2985337 2015-10-05T11:24:49.665+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:24:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:24:49.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:24:51.225+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4ms 2015-10-05T11:24:55.910+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ff712deab02e29853ed 2015-10-05T11:24:55.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:02.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56124ffd12deab02e2985433 2015-10-05T11:25:02.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:08.366+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612500412deab02e29854a1 2015-10-05T11:25:08.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:14.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612500a12deab02e29854d7 2015-10-05T11:25:15.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:20.007+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:25:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:25:21.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612501112deab02e298552c 2015-10-05T11:25:21.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:27.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612501712deab02e298557b 2015-10-05T11:25:27.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:28.609+0100 [mongosMain] connection accepted from 127.0.0.1:57031 #957 (880 connections now open) 2015-10-05T11:25:28.612+0100 [conn957] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:25:28.613+0100 [conn957] end connection 127.0.0.1:57031 (879 connections now open) 2015-10-05T11:25:29.594+0100 [mongosMain] connection accepted from 172.28.0.163:57034 #958 (880 connections now open) 2015-10-05T11:25:29.595+0100 [conn958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:25:29.640+0100 [conn133] end connection 172.28.0.163:52517 (879 connections now open) 2015-10-05T11:25:34.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612501d12deab02e29855cc 2015-10-05T11:25:34.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:25:39.418+0100 [mongosMain] connection accepted from 127.0.0.1:57041 #959 (880 connections now open) 2015-10-05T11:25:39.421+0100 [conn959] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:25:39.421+0100 [conn959] end connection 127.0.0.1:57041 (879 connections now open) 2015-10-05T11:25:41.090+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:25:41.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:25:47.160+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612502603838a45371630d5') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444040747099), why: "doing balance round", ts: ObjectId('5612502b12deab02e2985657') } } gle1: { lastOp: Timestamp 1444040734000|9, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } gle2: { lastOp: Timestamp 1444040747000|4, connectionId: 34850, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T11:25:47.163+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:25:47.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:25:51.872+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:25:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:25:51.872+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:25:52.008+0100 [LockPinger] handled late remove of old distributed lock with ts 5612502b12deab02e2985657 2015-10-05T11:25:53.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612503112deab02e29856b4 2015-10-05T11:25:53.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:26:11.787+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:26:11.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:26:18.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612504912deab02e29857dc 2015-10-05T11:26:18.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:26:22.163+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:26:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:26:28.942+0100 [mongosMain] connection accepted from 127.0.0.1:57106 #960 (880 connections now open) 2015-10-05T11:26:28.944+0100 [conn960] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:26:28.945+0100 [conn960] end connection 127.0.0.1:57106 (879 connections now open) 2015-10-05T11:26:29.612+0100 [mongosMain] connection accepted from 172.28.0.163:57107 #961 (880 connections now open) 2015-10-05T11:26:29.615+0100 [conn961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:26:29.656+0100 [conn81] end connection 172.28.0.163:52411 (879 connections now open) 2015-10-05T11:26:30.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612505612deab02e298586b 2015-10-05T11:26:30.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:26:34.228+0100 [conn547] end connection 172.28.0.164:49339 (878 connections now open) 2015-10-05T11:26:34.229+0100 [mongosMain] connection accepted from 172.28.0.164:51193 #962 (879 connections now open) 2015-10-05T11:26:34.232+0100 [conn962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:26:40.132+0100 [mongosMain] connection accepted from 127.0.0.1:57119 #963 (880 connections now open) 2015-10-05T11:26:40.135+0100 [conn963] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:26:40.136+0100 [conn963] end connection 127.0.0.1:57119 (879 connections now open) 2015-10-05T11:26:43.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612506212deab02e29858f1 2015-10-05T11:26:43.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:26:49.894+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612506912deab02e2985948 2015-10-05T11:26:49.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:26:53.375+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:26:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:26:56.719+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:26:56.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:27:03.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612507612deab02e29859cf 2015-10-05T11:27:03.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:27:09.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612507d12deab02e2985a43 2015-10-05T11:27:09.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:27:23.889+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:27:23.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:27:25.221+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:27:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:27:28.747+0100 [mongosMain] connection accepted from 127.0.0.1:57199 #964 (880 connections now open) 2015-10-05T11:27:28.750+0100 [conn964] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:27:28.750+0100 [conn964] end connection 127.0.0.1:57199 (879 connections now open) 2015-10-05T11:27:29.636+0100 [mongosMain] connection accepted from 172.28.0.163:57201 #965 (880 connections now open) 2015-10-05T11:27:29.639+0100 [conn965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:27:29.674+0100 [conn169] end connection 172.28.0.163:52590 (879 connections now open) 2015-10-05T11:27:30.098+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:27:30.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:27:34.244+0100 [conn549] end connection 172.28.0.164:49377 (878 connections now open) 2015-10-05T11:27:34.246+0100 [mongosMain] connection accepted from 172.28.0.164:51277 #966 (879 connections now open) 2015-10-05T11:27:34.248+0100 [conn966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:27:40.235+0100 [mongosMain] connection accepted from 127.0.0.1:57208 #967 (880 connections now open) 2015-10-05T11:27:40.237+0100 [conn967] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:27:40.238+0100 [conn967] end connection 127.0.0.1:57208 (879 connections now open) 2015-10-05T11:27:48.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250a412deab02e2985bd6 2015-10-05T11:27:48.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:27:55.682+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:27:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:28:00.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250b012deab02e2985c3d 2015-10-05T11:28:00.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:06.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250b612deab02e2985c93 2015-10-05T11:28:07.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:13.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250bd12deab02e2985cec 2015-10-05T11:28:14.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:20.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250c412deab02e2985d4a 2015-10-05T11:28:20.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:25.928+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:28:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:28:26.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250ca12deab02e2985d9a 2015-10-05T11:28:27.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:28.375+0100 [mongosMain] connection accepted from 127.0.0.1:57273 #968 (880 connections now open) 2015-10-05T11:28:28.389+0100 [conn968] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:28.390+0100 [conn968] end connection 127.0.0.1:57273 (879 connections now open) 2015-10-05T11:28:29.642+0100 [mongosMain] connection accepted from 172.28.0.163:57278 #969 (880 connections now open) 2015-10-05T11:28:29.644+0100 [conn969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:29.690+0100 [conn312] end connection 172.28.0.163:54707 (879 connections now open) 2015-10-05T11:28:34.103+0100 [conn527] end connection 172.28.0.163:55391 (878 connections now open) 2015-10-05T11:28:34.104+0100 [conn324] end connection 172.28.0.163:54722 (877 connections now open) 2015-10-05T11:28:34.105+0100 [mongosMain] connection accepted from 172.28.0.163:57279 #970 (878 connections now open) 2015-10-05T11:28:34.105+0100 [mongosMain] connection accepted from 172.28.0.163:57280 #971 (879 connections now open) 2015-10-05T11:28:34.106+0100 [conn970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.107+0100 [conn971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.109+0100 [conn292] end connection 172.28.0.163:53859 (878 connections now open) 2015-10-05T11:28:34.110+0100 [mongosMain] connection accepted from 172.28.0.163:57281 #972 (879 connections now open) 2015-10-05T11:28:34.111+0100 [conn272] end connection 172.28.0.163:53588 (878 connections now open) 2015-10-05T11:28:34.111+0100 [conn972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.111+0100 [mongosMain] connection accepted from 172.28.0.163:57282 #973 (879 connections now open) 2015-10-05T11:28:34.113+0100 [conn432] end connection 172.28.0.163:54888 (878 connections now open) 2015-10-05T11:28:34.113+0100 [conn973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.113+0100 [mongosMain] connection accepted from 172.28.0.163:57283 #974 (879 connections now open) 2015-10-05T11:28:34.115+0100 [conn433] end connection 172.28.0.163:54891 (878 connections now open) 2015-10-05T11:28:34.115+0100 [conn974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.116+0100 [mongosMain] connection accepted from 172.28.0.163:57284 #975 (879 connections now open) 2015-10-05T11:28:34.117+0100 [conn975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.217+0100 [conn479] end connection 172.28.0.163:54971 (878 connections now open) 2015-10-05T11:28:34.217+0100 [conn469] end connection 172.28.0.163:54944 (878 connections now open) 2015-10-05T11:28:34.218+0100 [mongosMain] connection accepted from 172.28.0.163:57285 #976 (878 connections now open) 2015-10-05T11:28:34.219+0100 [mongosMain] connection accepted from 172.28.0.163:57286 #977 (879 connections now open) 2015-10-05T11:28:34.220+0100 [conn976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.220+0100 [conn977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.242+0100 [conn326] end connection 172.28.0.163:54724 (878 connections now open) 2015-10-05T11:28:34.243+0100 [mongosMain] connection accepted from 172.28.0.163:57287 #978 (879 connections now open) 2015-10-05T11:28:34.244+0100 [conn978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.260+0100 [conn542] end connection 172.28.0.164:49315 (878 connections now open) 2015-10-05T11:28:34.261+0100 [conn42] end connection 172.28.0.163:52329 (877 connections now open) 2015-10-05T11:28:34.262+0100 [mongosMain] connection accepted from 172.28.0.164:51326 #979 (878 connections now open) 2015-10-05T11:28:34.262+0100 [mongosMain] connection accepted from 172.28.0.163:57288 #980 (879 connections now open) 2015-10-05T11:28:34.264+0100 [conn980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.265+0100 [conn979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.311+0100 [conn492] end connection 172.28.0.163:55014 (878 connections now open) 2015-10-05T11:28:34.312+0100 [mongosMain] connection accepted from 172.28.0.163:57289 #981 (879 connections now open) 2015-10-05T11:28:34.314+0100 [conn981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.336+0100 [conn37] end connection 172.28.0.163:52323 (878 connections now open) 2015-10-05T11:28:34.338+0100 [mongosMain] connection accepted from 172.28.0.163:57290 #982 (879 connections now open) 2015-10-05T11:28:34.340+0100 [conn982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.345+0100 [conn137] end connection 172.28.0.163:52524 (878 connections now open) 2015-10-05T11:28:34.347+0100 [mongosMain] connection accepted from 172.28.0.163:57291 #983 (879 connections now open) 2015-10-05T11:28:34.349+0100 [conn983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.361+0100 [conn181] end connection 172.28.0.163:52613 (878 connections now open) 2015-10-05T11:28:34.362+0100 [mongosMain] connection accepted from 172.28.0.163:57292 #984 (879 connections now open) 2015-10-05T11:28:34.364+0100 [conn984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.370+0100 [conn116] end connection 172.28.0.163:52483 (878 connections now open) 2015-10-05T11:28:34.370+0100 [conn388] end connection 172.28.0.163:54812 (877 connections now open) 2015-10-05T11:28:34.371+0100 [mongosMain] connection accepted from 172.28.0.163:57293 #985 (878 connections now open) 2015-10-05T11:28:34.371+0100 [mongosMain] connection accepted from 172.28.0.163:57294 #986 (879 connections now open) 2015-10-05T11:28:34.373+0100 [conn985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.373+0100 [conn986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.380+0100 [conn155] end connection 172.28.0.163:52558 (878 connections now open) 2015-10-05T11:28:34.381+0100 [mongosMain] connection accepted from 172.28.0.163:57295 #987 (879 connections now open) 2015-10-05T11:28:34.383+0100 [conn987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.390+0100 [conn262] end connection 172.28.0.163:53541 (878 connections now open) 2015-10-05T11:28:34.391+0100 [mongosMain] connection accepted from 172.28.0.163:57296 #988 (879 connections now open) 2015-10-05T11:28:34.393+0100 [conn988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.406+0100 [conn454] end connection 172.28.0.163:54922 (878 connections now open) 2015-10-05T11:28:34.407+0100 [mongosMain] connection accepted from 172.28.0.163:57297 #989 (879 connections now open) 2015-10-05T11:28:34.408+0100 [conn115] end connection 172.28.0.163:52481 (878 connections now open) 2015-10-05T11:28:34.409+0100 [conn375] end connection 172.28.0.163:54790 (877 connections now open) 2015-10-05T11:28:34.410+0100 [conn989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.410+0100 [mongosMain] connection accepted from 172.28.0.163:57298 #990 (878 connections now open) 2015-10-05T11:28:34.410+0100 [mongosMain] connection accepted from 172.28.0.163:57299 #991 (879 connections now open) 2015-10-05T11:28:34.412+0100 [conn990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.412+0100 [conn991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.421+0100 [conn415] end connection 172.28.0.163:54865 (878 connections now open) 2015-10-05T11:28:34.422+0100 [conn380] end connection 172.28.0.163:54800 (877 connections now open) 2015-10-05T11:28:34.423+0100 [mongosMain] connection accepted from 172.28.0.163:57300 #992 (878 connections now open) 2015-10-05T11:28:34.424+0100 [mongosMain] connection accepted from 172.28.0.163:57301 #993 (879 connections now open) 2015-10-05T11:28:34.425+0100 [conn161] end connection 172.28.0.163:52573 (878 connections now open) 2015-10-05T11:28:34.425+0100 [conn992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.426+0100 [conn993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.426+0100 [mongosMain] connection accepted from 172.28.0.163:57302 #994 (879 connections now open) 2015-10-05T11:28:34.428+0100 [conn994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.446+0100 [conn413] end connection 172.28.0.163:54863 (878 connections now open) 2015-10-05T11:28:34.447+0100 [mongosMain] connection accepted from 172.28.0.163:57303 #995 (879 connections now open) 2015-10-05T11:28:34.449+0100 [conn995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.461+0100 [conn450] end connection 172.28.0.163:54917 (878 connections now open) 2015-10-05T11:28:34.463+0100 [mongosMain] connection accepted from 172.28.0.163:57304 #996 (879 connections now open) 2015-10-05T11:28:34.465+0100 [conn996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.573+0100 [conn92] end connection 172.28.0.163:52433 (878 connections now open) 2015-10-05T11:28:34.575+0100 [mongosMain] connection accepted from 172.28.0.163:57305 #997 (879 connections now open) 2015-10-05T11:28:34.577+0100 [conn997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.604+0100 [conn87] end connection 172.28.0.163:52423 (878 connections now open) 2015-10-05T11:28:34.606+0100 [mongosMain] connection accepted from 172.28.0.163:57306 #998 (879 connections now open) 2015-10-05T11:28:34.607+0100 [conn998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:34.615+0100 [conn427] end connection 172.28.0.163:54882 (878 connections now open) 2015-10-05T11:28:34.616+0100 [mongosMain] connection accepted from 172.28.0.163:57307 #999 (879 connections now open) 2015-10-05T11:28:34.618+0100 [conn999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:39.212+0100 [mongosMain] connection accepted from 127.0.0.1:57313 #1000 (880 connections now open) 2015-10-05T11:28:39.215+0100 [conn1000] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:28:39.215+0100 [conn1000] end connection 127.0.0.1:57313 (879 connections now open) 2015-10-05T11:28:39.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250d712deab02e2985e58 2015-10-05T11:28:39.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:46.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250dd12deab02e2985edd 2015-10-05T11:28:46.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:52.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250e412deab02e2985f37 2015-10-05T11:28:52.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:28:56.078+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:28:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:29:12.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561250f812deab02e298603a 2015-10-05T11:29:12.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:29:24.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612510412deab02e29860ca 2015-10-05T11:29:24.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:29:26.345+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:29:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:29:28.363+0100 [mongosMain] connection accepted from 127.0.0.1:57433 #1001 (880 connections now open) 2015-10-05T11:29:28.366+0100 [conn1001] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:29:28.369+0100 [conn1001] end connection 127.0.0.1:57433 (879 connections now open) 2015-10-05T11:29:29.659+0100 [mongosMain] connection accepted from 172.28.0.163:57434 #1002 (880 connections now open) 2015-10-05T11:29:29.660+0100 [conn1002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:29:29.705+0100 [conn111] end connection 172.28.0.163:52473 (879 connections now open) 2015-10-05T11:29:34.277+0100 [conn544] end connection 172.28.0.164:49331 (878 connections now open) 2015-10-05T11:29:34.278+0100 [mongosMain] connection accepted from 172.28.0.164:51375 #1003 (879 connections now open) 2015-10-05T11:29:34.281+0100 [conn1003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:29:39.273+0100 [mongosMain] connection accepted from 127.0.0.1:57442 #1004 (880 connections now open) 2015-10-05T11:29:39.276+0100 [conn1004] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:29:39.277+0100 [conn1004] end connection 127.0.0.1:57442 (879 connections now open) 2015-10-05T11:29:40.026+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:29:40.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:29:46.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612511a12deab02e29861c0 2015-10-05T11:29:46.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:29:52.726+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:29:52.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:29:58.425+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:29:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:30:05.033+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:30:05.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:30:07.784+0100 [conn30] end connection 172.28.0.163:52304 (878 connections now open) 2015-10-05T11:30:07.785+0100 [mongosMain] connection accepted from 172.28.0.163:57489 #1005 (879 connections now open) 2015-10-05T11:30:07.786+0100 [conn1005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:09.569+0100 [conn151] end connection 172.28.0.163:52553 (878 connections now open) 2015-10-05T11:30:10.632+0100 [conn28] end connection 172.28.0.163:52302 (877 connections now open) 2015-10-05T11:30:10.633+0100 [mongosMain] connection accepted from 172.28.0.163:57493 #1006 (878 connections now open) 2015-10-05T11:30:10.634+0100 [conn1006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:10.666+0100 [conn63] end connection 172.28.0.163:52372 (877 connections now open) 2015-10-05T11:30:10.667+0100 [mongosMain] connection accepted from 172.28.0.163:57494 #1007 (878 connections now open) 2015-10-05T11:30:10.668+0100 [conn1007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:11.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612513312deab02e298630e 2015-10-05T11:30:11.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:30:12.909+0100 [conn70] end connection 172.28.0.163:52383 (877 connections now open) 2015-10-05T11:30:12.910+0100 [mongosMain] connection accepted from 172.28.0.163:57496 #1008 (878 connections now open) 2015-10-05T11:30:12.912+0100 [conn1008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.416+0100 [conn173] end connection 172.28.0.163:52596 (877 connections now open) 2015-10-05T11:30:13.417+0100 [mongosMain] connection accepted from 172.28.0.163:57498 #1009 (878 connections now open) 2015-10-05T11:30:13.418+0100 [conn1009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.425+0100 [conn91] end connection 172.28.0.163:52431 (877 connections now open) 2015-10-05T11:30:13.426+0100 [mongosMain] connection accepted from 172.28.0.163:57499 #1010 (878 connections now open) 2015-10-05T11:30:13.427+0100 [conn1010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.443+0100 [conn117] end connection 172.28.0.163:52485 (877 connections now open) 2015-10-05T11:30:13.444+0100 [mongosMain] connection accepted from 172.28.0.163:57500 #1011 (878 connections now open) 2015-10-05T11:30:13.445+0100 [conn1011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.453+0100 [conn19] end connection 172.28.0.163:52276 (877 connections now open) 2015-10-05T11:30:13.454+0100 [mongosMain] connection accepted from 172.28.0.163:57502 #1012 (878 connections now open) 2015-10-05T11:30:13.456+0100 [conn1012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.514+0100 [conn142] end connection 172.28.0.163:52535 (877 connections now open) 2015-10-05T11:30:13.516+0100 [mongosMain] connection accepted from 172.28.0.163:57503 #1013 (878 connections now open) 2015-10-05T11:30:13.517+0100 [conn1013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.552+0100 [conn124] end connection 172.28.0.163:52499 (877 connections now open) 2015-10-05T11:30:13.553+0100 [conn65] end connection 172.28.0.163:52374 (876 connections now open) 2015-10-05T11:30:13.553+0100 [mongosMain] connection accepted from 172.28.0.163:57504 #1014 (878 connections now open) 2015-10-05T11:30:13.554+0100 [mongosMain] connection accepted from 172.28.0.163:57505 #1015 (878 connections now open) 2015-10-05T11:30:13.555+0100 [conn1014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.556+0100 [conn1015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.608+0100 [conn165] end connection 172.28.0.163:52582 (877 connections now open) 2015-10-05T11:30:13.609+0100 [mongosMain] connection accepted from 172.28.0.163:57506 #1016 (878 connections now open) 2015-10-05T11:30:13.609+0100 [conn157] end connection 172.28.0.163:52566 (876 connections now open) 2015-10-05T11:30:13.610+0100 [mongosMain] connection accepted from 172.28.0.163:57507 #1017 (878 connections now open) 2015-10-05T11:30:13.611+0100 [conn56] end connection 172.28.0.163:52357 (877 connections now open) 2015-10-05T11:30:13.611+0100 [mongosMain] connection accepted from 172.28.0.163:57508 #1018 (878 connections now open) 2015-10-05T11:30:13.612+0100 [conn1016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.612+0100 [conn1017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.613+0100 [conn1018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.625+0100 [conn110] end connection 172.28.0.163:52471 (877 connections now open) 2015-10-05T11:30:13.626+0100 [conn22] end connection 172.28.0.163:52284 (876 connections now open) 2015-10-05T11:30:13.626+0100 [mongosMain] connection accepted from 172.28.0.163:57509 #1019 (877 connections now open) 2015-10-05T11:30:13.626+0100 [conn84] end connection 172.28.0.163:52417 (876 connections now open) 2015-10-05T11:30:13.626+0100 [mongosMain] connection accepted from 172.28.0.163:57510 #1020 (878 connections now open) 2015-10-05T11:30:13.627+0100 [mongosMain] connection accepted from 172.28.0.163:57511 #1021 (878 connections now open) 2015-10-05T11:30:13.628+0100 [conn1020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.628+0100 [conn1019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.628+0100 [conn1021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.631+0100 [conn33] end connection 172.28.0.163:52309 (877 connections now open) 2015-10-05T11:30:13.632+0100 [mongosMain] connection accepted from 172.28.0.163:57512 #1022 (878 connections now open) 2015-10-05T11:30:13.632+0100 [conn24] end connection 172.28.0.163:52290 (877 connections now open) 2015-10-05T11:30:13.632+0100 [conn62] end connection 172.28.0.163:52370 (876 connections now open) 2015-10-05T11:30:13.633+0100 [mongosMain] connection accepted from 172.28.0.163:57513 #1023 (877 connections now open) 2015-10-05T11:30:13.633+0100 [conn1022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.633+0100 [mongosMain] connection accepted from 172.28.0.163:57514 #1024 (878 connections now open) 2015-10-05T11:30:13.634+0100 [conn1023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.634+0100 [conn1024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.636+0100 [conn44] end connection 172.28.0.163:52334 (877 connections now open) 2015-10-05T11:30:13.636+0100 [conn131] end connection 172.28.0.163:52512 (876 connections now open) 2015-10-05T11:30:13.637+0100 [mongosMain] connection accepted from 172.28.0.163:57515 #1025 (877 connections now open) 2015-10-05T11:30:13.637+0100 [mongosMain] connection accepted from 172.28.0.163:57516 #1026 (878 connections now open) 2015-10-05T11:30:13.638+0100 [conn1025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.638+0100 [conn1026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.646+0100 [conn174] end connection 172.28.0.163:52600 (877 connections now open) 2015-10-05T11:30:13.647+0100 [mongosMain] connection accepted from 172.28.0.163:57517 #1027 (878 connections now open) 2015-10-05T11:30:13.648+0100 [conn1027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.650+0100 [conn123] end connection 172.28.0.163:52496 (877 connections now open) 2015-10-05T11:30:13.651+0100 [mongosMain] connection accepted from 172.28.0.163:57518 #1028 (878 connections now open) 2015-10-05T11:30:13.653+0100 [conn1028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.724+0100 [conn58] end connection 172.28.0.163:52362 (877 connections now open) 2015-10-05T11:30:13.726+0100 [mongosMain] connection accepted from 172.28.0.163:57519 #1029 (878 connections now open) 2015-10-05T11:30:13.728+0100 [conn1029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.742+0100 [conn153] end connection 172.28.0.163:52555 (877 connections now open) 2015-10-05T11:30:13.743+0100 [mongosMain] connection accepted from 172.28.0.163:57520 #1030 (878 connections now open) 2015-10-05T11:30:13.745+0100 [conn1030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.780+0100 [conn108] end connection 172.28.0.163:52464 (877 connections now open) 2015-10-05T11:30:13.781+0100 [mongosMain] connection accepted from 172.28.0.163:57521 #1031 (878 connections now open) 2015-10-05T11:30:13.783+0100 [conn1031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.798+0100 [conn159] end connection 172.28.0.163:52570 (877 connections now open) 2015-10-05T11:30:13.799+0100 [mongosMain] connection accepted from 172.28.0.163:57522 #1032 (878 connections now open) 2015-10-05T11:30:13.801+0100 [conn1032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.865+0100 [conn177] end connection 172.28.0.163:52606 (877 connections now open) 2015-10-05T11:30:13.866+0100 [mongosMain] connection accepted from 172.28.0.163:57523 #1033 (878 connections now open) 2015-10-05T11:30:13.868+0100 [conn1033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.919+0100 [conn163] end connection 172.28.0.163:52577 (877 connections now open) 2015-10-05T11:30:13.920+0100 [mongosMain] connection accepted from 172.28.0.163:57524 #1034 (878 connections now open) 2015-10-05T11:30:13.921+0100 [conn1034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.938+0100 [conn99] end connection 172.28.0.163:52449 (877 connections now open) 2015-10-05T11:30:13.940+0100 [mongosMain] connection accepted from 172.28.0.163:57525 #1035 (878 connections now open) 2015-10-05T11:30:13.941+0100 [conn1035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.949+0100 [conn16] end connection 172.28.0.163:52272 (877 connections now open) 2015-10-05T11:30:13.950+0100 [mongosMain] connection accepted from 172.28.0.163:57526 #1036 (878 connections now open) 2015-10-05T11:30:13.951+0100 [conn1036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.958+0100 [conn149] end connection 172.28.0.163:52547 (877 connections now open) 2015-10-05T11:30:13.959+0100 [mongosMain] connection accepted from 172.28.0.163:57527 #1037 (878 connections now open) 2015-10-05T11:30:13.960+0100 [conn1037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:13.966+0100 [conn83] end connection 172.28.0.163:52415 (877 connections now open) 2015-10-05T11:30:13.967+0100 [mongosMain] connection accepted from 172.28.0.163:57528 #1038 (878 connections now open) 2015-10-05T11:30:13.969+0100 [conn1038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:14.002+0100 [conn35] end connection 172.28.0.163:52311 (877 connections now open) 2015-10-05T11:30:14.003+0100 [mongosMain] connection accepted from 172.28.0.163:57529 #1039 (878 connections now open) 2015-10-05T11:30:14.005+0100 [conn1039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:15.980+0100 [conn47] end connection 172.28.0.163:52341 (877 connections now open) 2015-10-05T11:30:15.981+0100 [mongosMain] connection accepted from 172.28.0.163:57534 #1040 (878 connections now open) 2015-10-05T11:30:15.982+0100 [conn1040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:15.989+0100 [conn175] end connection 172.28.0.163:52602 (877 connections now open) 2015-10-05T11:30:15.990+0100 [mongosMain] connection accepted from 172.28.0.163:57535 #1041 (878 connections now open) 2015-10-05T11:30:15.990+0100 [conn27] end connection 172.28.0.163:52301 (877 connections now open) 2015-10-05T11:30:15.991+0100 [conn1041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:15.991+0100 [mongosMain] connection accepted from 172.28.0.163:57536 #1042 (878 connections now open) 2015-10-05T11:30:15.993+0100 [conn1042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:15.993+0100 [conn106] end connection 172.28.0.163:52462 (877 connections now open) 2015-10-05T11:30:15.994+0100 [mongosMain] connection accepted from 172.28.0.163:57537 #1043 (878 connections now open) 2015-10-05T11:30:15.995+0100 [conn1043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:28.571+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:30:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:30:28.625+0100 [mongosMain] connection accepted from 127.0.0.1:57560 #1044 (879 connections now open) 2015-10-05T11:30:28.628+0100 [conn1044] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:28.629+0100 [conn1044] end connection 127.0.0.1:57560 (878 connections now open) 2015-10-05T11:30:29.675+0100 [mongosMain] connection accepted from 172.28.0.163:57561 #1045 (879 connections now open) 2015-10-05T11:30:29.677+0100 [conn1045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:29.721+0100 [conn392] end connection 172.28.0.163:54817 (878 connections now open) 2015-10-05T11:30:34.293+0100 [conn548] end connection 172.28.0.164:49367 (877 connections now open) 2015-10-05T11:30:34.294+0100 [mongosMain] connection accepted from 172.28.0.164:51430 #1046 (878 connections now open) 2015-10-05T11:30:34.297+0100 [conn1046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:36.891+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:30:36.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:30:39.562+0100 [mongosMain] connection accepted from 127.0.0.1:57572 #1047 (879 connections now open) 2015-10-05T11:30:39.565+0100 [conn1047] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:39.565+0100 [conn1047] end connection 127.0.0.1:57572 (878 connections now open) 2015-10-05T11:30:39.987+0100 [conn614] end connection 172.28.0.164:50146 (877 connections now open) 2015-10-05T11:30:39.987+0100 [conn820] end connection 172.28.0.164:50465 (877 connections now open) 2015-10-05T11:30:39.987+0100 [conn817] end connection 172.28.0.164:50463 (877 connections now open) 2015-10-05T11:30:39.987+0100 [conn607] end connection 172.28.0.164:50127 (874 connections now open) 2015-10-05T11:30:39.987+0100 [conn849] end connection 172.28.0.164:50492 (874 connections now open) 2015-10-05T11:30:39.987+0100 [conn760] end connection 172.28.0.164:50357 (873 connections now open) 2015-10-05T11:30:39.987+0100 [conn757] end connection 172.28.0.164:50354 (873 connections now open) 2015-10-05T11:30:39.987+0100 [conn883] end connection 172.28.0.164:50529 (873 connections now open) 2015-10-05T11:30:39.988+0100 [conn873] end connection 172.28.0.164:50521 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn762] end connection 172.28.0.164:50359 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn870] end connection 172.28.0.164:50516 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn830] end connection 172.28.0.164:50476 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn609] end connection 172.28.0.164:50136 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn843] end connection 172.28.0.164:50489 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn837] end connection 172.28.0.164:50483 (864 connections now open) 2015-10-05T11:30:39.988+0100 [conn828] end connection 172.28.0.164:50474 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn698] end connection 172.28.0.164:50247 (863 connections now open) 2015-10-05T11:30:39.988+0100 [conn853] end connection 172.28.0.164:50499 (862 connections now open) 2015-10-05T11:30:39.988+0100 [conn731] end connection 172.28.0.164:50287 (864 connections now open) 2015-10-05T11:30:39.988+0100 [conn832] end connection 172.28.0.164:50478 (864 connections now open) 2015-10-05T11:30:39.988+0100 [conn750] end connection 172.28.0.164:50305 (864 connections now open) 2015-10-05T11:30:39.988+0100 [conn624] end connection 172.28.0.164:50161 (869 connections now open) 2015-10-05T11:30:39.988+0100 [conn815] end connection 172.28.0.164:50462 (856 connections now open) 2015-10-05T11:30:39.988+0100 [conn717] end connection 172.28.0.164:50266 (862 connections now open) 2015-10-05T11:30:39.988+0100 [conn838] end connection 172.28.0.164:50484 (868 connections now open) 2015-10-05T11:30:39.988+0100 [conn613] end connection 172.28.0.164:50145 (864 connections now open) 2015-10-05T11:30:39.988+0100 [conn858] end connection 172.28.0.164:50504 (862 connections now open) 2015-10-05T11:30:39.988+0100 [conn826] end connection 172.28.0.164:50472 (861 connections now open) 2015-10-05T11:30:39.988+0100 [conn727] end connection 172.28.0.164:50292 (861 connections now open) 2015-10-05T11:30:39.988+0100 [conn827] end connection 172.28.0.164:50473 (860 connections now open) 2015-10-05T11:30:39.988+0100 [conn855] end connection 172.28.0.164:50502 (862 connections now open) 2015-10-05T11:30:39.989+0100 [conn809] end connection 172.28.0.164:50456 (848 connections now open) 2015-10-05T11:30:39.989+0100 [conn814] end connection 172.28.0.164:50461 (855 connections now open) 2015-10-05T11:30:39.989+0100 [conn691] end connection 172.28.0.164:50236 (855 connections now open) 2015-10-05T11:30:39.989+0100 [conn774] end connection 172.28.0.164:50419 (854 connections now open) 2015-10-05T11:30:39.989+0100 [conn775] end connection 172.28.0.164:50420 (855 connections now open) 2015-10-05T11:30:39.989+0100 [conn718] end connection 172.28.0.164:50267 (848 connections now open) 2015-10-05T11:30:39.990+0100 [conn708] end connection 172.28.0.164:50257 (840 connections now open) 2015-10-05T11:30:39.990+0100 [conn808] end connection 172.28.0.164:50454 (839 connections now open) 2015-10-05T11:30:39.990+0100 [conn735] end connection 172.28.0.164:50290 (838 connections now open) 2015-10-05T11:30:39.990+0100 [conn724] end connection 172.28.0.164:50273 (837 connections now open) 2015-10-05T11:30:39.991+0100 [conn711] end connection 172.28.0.164:50260 (836 connections now open) 2015-10-05T11:30:39.991+0100 [conn806] end connection 172.28.0.164:50452 (836 connections now open) 2015-10-05T11:30:39.992+0100 [conn769] end connection 172.28.0.164:50408 (834 connections now open) 2015-10-05T11:30:39.992+0100 [conn638] end connection 172.28.0.164:50178 (834 connections now open) 2015-10-05T11:30:39.992+0100 [conn722] end connection 172.28.0.164:50272 (834 connections now open) 2015-10-05T11:30:39.992+0100 [conn865] end connection 172.28.0.164:50511 (831 connections now open) 2015-10-05T11:30:39.992+0100 [conn737] end connection 172.28.0.164:50289 (831 connections now open) 2015-10-05T11:30:39.992+0100 [conn732] end connection 172.28.0.164:50283 (829 connections now open) 2015-10-05T11:30:39.993+0100 [conn822] end connection 172.28.0.164:50468 (828 connections now open) 2015-10-05T11:30:39.993+0100 [conn846] end connection 172.28.0.164:50493 (828 connections now open) 2015-10-05T11:30:39.993+0100 [conn871] end connection 172.28.0.164:50517 (826 connections now open) 2015-10-05T11:30:39.994+0100 [conn594] end connection 172.28.0.164:49437 (825 connections now open) 2015-10-05T11:30:39.994+0100 [conn593] end connection 172.28.0.164:49436 (825 connections now open) 2015-10-05T11:30:39.994+0100 [conn860] end connection 172.28.0.164:50507 (825 connections now open) 2015-10-05T11:30:39.995+0100 [conn875] end connection 172.28.0.164:50519 (822 connections now open) 2015-10-05T11:30:39.995+0100 [conn689] end connection 172.28.0.164:50229 (822 connections now open) 2015-10-05T11:30:39.995+0100 [conn730] end connection 172.28.0.164:50281 (820 connections now open) 2015-10-05T11:30:39.997+0100 [conn709] end connection 172.28.0.164:50258 (819 connections now open) 2015-10-05T11:30:39.997+0100 [conn656] end connection 172.28.0.164:50197 (818 connections now open) 2015-10-05T11:30:39.997+0100 [conn818] end connection 172.28.0.164:50464 (818 connections now open) 2015-10-05T11:30:39.997+0100 [conn619] end connection 172.28.0.164:50154 (816 connections now open) 2015-10-05T11:30:39.998+0100 [conn856] end connection 172.28.0.164:50501 (816 connections now open) 2015-10-05T11:30:39.998+0100 [conn810] end connection 172.28.0.164:50457 (816 connections now open) 2015-10-05T11:30:39.998+0100 [conn606] end connection 172.28.0.164:50126 (816 connections now open) 2015-10-05T11:30:39.998+0100 [conn861] end connection 172.28.0.164:50506 (816 connections now open) 2015-10-05T11:30:39.998+0100 [conn681] end connection 172.28.0.164:50226 (811 connections now open) 2015-10-05T11:30:39.998+0100 [conn695] end connection 172.28.0.164:50241 (810 connections now open) 2015-10-05T11:30:39.998+0100 [conn705] end connection 172.28.0.164:50255 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn889] end connection 172.28.0.164:50570 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn694] end connection 172.28.0.164:50240 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn719] end connection 172.28.0.164:50277 (808 connections now open) 2015-10-05T11:30:39.998+0100 [conn879] end connection 172.28.0.164:50525 (806 connections now open) 2015-10-05T11:30:39.998+0100 [conn640] end connection 172.28.0.164:50181 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn649] end connection 172.28.0.164:50190 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn833] end connection 172.28.0.164:50479 (809 connections now open) 2015-10-05T11:30:39.998+0100 [conn877] end connection 172.28.0.164:50523 (808 connections now open) 2015-10-05T11:30:39.999+0100 [conn700] end connection 172.28.0.164:50249 (802 connections now open) 2015-10-05T11:30:39.999+0100 [conn792] end connection 172.28.0.164:50438 (802 connections now open) 2015-10-05T11:30:39.999+0100 [conn647] end connection 172.28.0.164:50188 (799 connections now open) 2015-10-05T11:30:39.999+0100 [conn876] end connection 172.28.0.164:50522 (802 connections now open) 2015-10-05T11:30:39.999+0100 [conn777] end connection 172.28.0.164:50422 (797 connections now open) 2015-10-05T11:30:39.999+0100 [conn749] end connection 172.28.0.164:50304 (795 connections now open) 2015-10-05T11:30:39.999+0100 [conn704] end connection 172.28.0.164:50254 (797 connections now open) 2015-10-05T11:30:39.999+0100 [conn702] end connection 172.28.0.164:50252 (801 connections now open) 2015-10-05T11:30:39.999+0100 [conn706] end connection 172.28.0.164:50253 (802 connections now open) 2015-10-05T11:30:39.999+0100 [conn803] end connection 172.28.0.164:50449 (791 connections now open) 2015-10-05T11:30:39.999+0100 [conn779] end connection 172.28.0.164:50424 (790 connections now open) 2015-10-05T11:30:40.004+0100 [conn658] end connection 172.28.0.164:50199 (789 connections now open) 2015-10-05T11:30:40.005+0100 [conn692] end connection 172.28.0.164:50237 (789 connections now open) 2015-10-05T11:30:40.005+0100 [conn616] end connection 172.28.0.164:50149 (789 connections now open) 2015-10-05T11:30:40.005+0100 [conn836] end connection 172.28.0.164:50481 (786 connections now open) 2015-10-05T11:30:40.005+0100 [conn801] end connection 172.28.0.164:50448 (785 connections now open) 2015-10-05T11:30:40.005+0100 [conn675] end connection 172.28.0.164:50220 (786 connections now open) 2015-10-05T11:30:40.005+0100 [conn627] end connection 172.28.0.164:50165 (784 connections now open) 2015-10-05T11:30:40.005+0100 [conn720] end connection 172.28.0.164:50275 (782 connections now open) 2015-10-05T11:30:40.005+0100 [conn690] end connection 172.28.0.164:50235 (782 connections now open) 2015-10-05T11:30:40.009+0100 [conn851] end connection 172.28.0.164:50497 (780 connections now open) 2015-10-05T11:30:40.009+0100 [conn847] end connection 172.28.0.164:50495 (780 connections now open) 2015-10-05T11:30:40.010+0100 [conn632] end connection 172.28.0.164:50173 (779 connections now open) 2015-10-05T11:30:40.010+0100 [conn715] end connection 172.28.0.164:50264 (778 connections now open) 2015-10-05T11:30:40.010+0100 [conn728] end connection 172.28.0.164:50280 (777 connections now open) 2015-10-05T11:30:40.010+0100 [conn811] end connection 172.28.0.164:50458 (776 connections now open) 2015-10-05T11:30:40.010+0100 [conn802] end connection 172.28.0.164:50447 (778 connections now open) 2015-10-05T11:30:40.010+0100 [conn739] end connection 172.28.0.164:50291 (777 connections now open) 2015-10-05T11:30:40.010+0100 [conn622] end connection 172.28.0.164:50159 (773 connections now open) 2015-10-05T11:30:40.010+0100 [conn710] end connection 172.28.0.164:50259 (772 connections now open) 2015-10-05T11:30:40.010+0100 [conn707] end connection 172.28.0.164:50256 (773 connections now open) 2015-10-05T11:30:40.010+0100 [conn805] end connection 172.28.0.164:50450 (773 connections now open) 2015-10-05T11:30:40.010+0100 [conn721] end connection 172.28.0.164:50276 (778 connections now open) 2015-10-05T11:30:40.010+0100 [conn604] end connection 172.28.0.164:50122 (768 connections now open) 2015-10-05T11:30:40.010+0100 [conn688] end connection 172.28.0.164:50234 (767 connections now open) 2015-10-05T11:30:40.010+0100 [conn701] end connection 172.28.0.164:50250 (767 connections now open) 2015-10-05T11:30:40.011+0100 [conn789] end connection 172.28.0.164:50435 (765 connections now open) 2015-10-05T11:30:40.011+0100 [conn669] end connection 172.28.0.164:50214 (764 connections now open) 2015-10-05T11:30:40.010+0100 [conn804] end connection 172.28.0.164:50451 (772 connections now open) 2015-10-05T11:30:40.010+0100 [conn682] end connection 172.28.0.164:50227 (773 connections now open) 2015-10-05T11:30:40.011+0100 [conn788] end connection 172.28.0.164:50434 (760 connections now open) 2015-10-05T11:30:40.011+0100 [conn857] end connection 172.28.0.164:50503 (760 connections now open) 2015-10-05T11:30:40.011+0100 [conn621] end connection 172.28.0.164:50157 (760 connections now open) 2015-10-05T11:30:40.010+0100 [conn637] end connection 172.28.0.164:50179 (766 connections now open) 2015-10-05T11:30:40.011+0100 [conn678] end connection 172.28.0.164:50222 (758 connections now open) 2015-10-05T11:30:40.011+0100 [conn685] end connection 172.28.0.164:50231 (759 connections now open) 2015-10-05T11:30:40.011+0100 [conn787] end connection 172.28.0.164:50433 (759 connections now open) 2015-10-05T11:30:40.011+0100 [conn848] end connection 172.28.0.164:50494 (754 connections now open) 2015-10-05T11:30:40.011+0100 [conn712] end connection 172.28.0.164:50261 (760 connections now open) 2015-10-05T11:30:40.011+0100 [conn776] end connection 172.28.0.164:50421 (753 connections now open) 2015-10-05T11:30:40.011+0100 [conn738] end connection 172.28.0.164:50288 (750 connections now open) 2015-10-05T11:30:40.011+0100 [conn725] end connection 172.28.0.164:50271 (756 connections now open) 2015-10-05T11:30:40.011+0100 [conn651] end connection 172.28.0.164:50192 (749 connections now open) 2015-10-05T11:30:40.011+0100 [conn869] end connection 172.28.0.164:50515 (748 connections now open) 2015-10-05T11:30:40.011+0100 [conn834] end connection 172.28.0.164:50480 (747 connections now open) 2015-10-05T11:30:40.011+0100 [conn641] end connection 172.28.0.164:50183 (754 connections now open) 2015-10-05T11:30:40.011+0100 [conn782] end connection 172.28.0.164:50427 (754 connections now open) 2015-10-05T11:30:40.011+0100 [conn665] end connection 172.28.0.164:50206 (750 connections now open) 2015-10-05T11:30:40.011+0100 [conn743] end connection 172.28.0.164:50295 (750 connections now open) 2015-10-05T11:30:40.011+0100 [conn618] end connection 172.28.0.164:50152 (748 connections now open) 2015-10-05T11:30:40.012+0100 [conn668] end connection 172.28.0.164:50209 (744 connections now open) 2015-10-05T11:30:40.012+0100 [conn634] end connection 172.28.0.164:50175 (743 connections now open) 2015-10-05T11:30:40.012+0100 [conn608] end connection 172.28.0.164:50129 (743 connections now open) 2015-10-05T11:30:40.012+0100 [conn864] end connection 172.28.0.164:50510 (738 connections now open) 2015-10-05T11:30:40.012+0100 [conn753] end connection 172.28.0.164:50308 (737 connections now open) 2015-10-05T11:30:40.012+0100 [conn773] end connection 172.28.0.164:50412 (742 connections now open) 2015-10-05T11:30:40.012+0100 [conn617] end connection 172.28.0.164:50151 (737 connections now open) 2015-10-05T11:30:40.012+0100 [conn872] end connection 172.28.0.164:50518 (737 connections now open) 2015-10-05T11:30:40.012+0100 [conn839] end connection 172.28.0.164:50485 (735 connections now open) 2015-10-05T11:30:40.012+0100 [conn880] end connection 172.28.0.164:50526 (732 connections now open) 2015-10-05T11:30:40.012+0100 [conn625] end connection 172.28.0.164:50162 (732 connections now open) 2015-10-05T11:30:40.012+0100 [conn854] end connection 172.28.0.164:50500 (730 connections now open) 2015-10-05T11:30:40.012+0100 [conn755] end connection 172.28.0.164:50352 (730 connections now open) 2015-10-05T11:30:40.012+0100 [conn655] end connection 172.28.0.164:50196 (729 connections now open) 2015-10-05T11:30:40.013+0100 [conn768] end connection 172.28.0.164:50407 (727 connections now open) 2015-10-05T11:30:40.012+0100 [conn723] end connection 172.28.0.164:50270 (730 connections now open) 2015-10-05T11:30:40.013+0100 [conn742] end connection 172.28.0.164:50294 (724 connections now open) 2015-10-05T11:30:40.013+0100 [conn785] end connection 172.28.0.164:50430 (724 connections now open) 2015-10-05T11:30:40.013+0100 [conn823] end connection 172.28.0.164:50469 (723 connections now open) 2015-10-05T11:30:40.013+0100 [conn726] end connection 172.28.0.164:50279 (722 connections now open) 2015-10-05T11:30:40.013+0100 [conn666] end connection 172.28.0.164:50207 (720 connections now open) 2015-10-05T11:30:40.013+0100 [conn799] end connection 172.28.0.164:50445 (720 connections now open) 2015-10-05T11:30:40.013+0100 [conn821] end connection 172.28.0.164:50466 (720 connections now open) 2015-10-05T11:30:40.013+0100 [conn679] end connection 172.28.0.164:50224 (719 connections now open) 2015-10-05T11:30:40.013+0100 [conn744] end connection 172.28.0.164:50278 (717 connections now open) 2015-10-05T11:30:40.013+0100 [conn761] end connection 172.28.0.164:50358 (724 connections now open) 2015-10-05T11:30:40.013+0100 [conn813] end connection 172.28.0.164:50455 (724 connections now open) 2015-10-05T11:30:40.013+0100 [conn663] end connection 172.28.0.164:50204 (724 connections now open) 2015-10-05T11:30:40.012+0100 [conn680] end connection 172.28.0.164:50225 (730 connections now open) 2015-10-05T11:30:40.013+0100 [conn662] end connection 172.28.0.164:50203 (723 connections now open) 2015-10-05T11:30:40.012+0100 [conn734] end connection 172.28.0.164:50274 (730 connections now open) 2015-10-05T11:30:40.013+0100 [conn790] end connection 172.28.0.164:50436 (724 connections now open) 2015-10-05T11:30:40.013+0100 [conn796] end connection 172.28.0.164:50442 (722 connections now open) 2015-10-05T11:30:40.014+0100 [conn862] end connection 172.28.0.164:50508 (708 connections now open) 2015-10-05T11:30:40.013+0100 [conn874] end connection 172.28.0.164:50520 (720 connections now open) 2015-10-05T11:30:40.014+0100 [conn829] end connection 172.28.0.164:50475 (706 connections now open) 2015-10-05T11:30:40.014+0100 [conn845] end connection 172.28.0.164:50491 (705 connections now open) 2015-10-05T11:30:40.014+0100 [conn831] end connection 172.28.0.164:50477 (704 connections now open) 2015-10-05T11:30:40.014+0100 [conn659] end connection 172.28.0.164:50200 (702 connections now open) 2015-10-05T11:30:40.014+0100 [conn771] end connection 172.28.0.164:50410 (702 connections now open) 2015-10-05T11:30:40.014+0100 [conn745] end connection 172.28.0.164:50301 (700 connections now open) 2015-10-05T11:30:40.015+0100 [conn676] end connection 172.28.0.164:50221 (700 connections now open) 2015-10-05T11:30:40.015+0100 [conn643] end connection 172.28.0.164:50184 (698 connections now open) 2015-10-05T11:30:40.015+0100 [conn863] end connection 172.28.0.164:50509 (698 connections now open) 2015-10-05T11:30:40.015+0100 [conn882] end connection 172.28.0.164:50528 (696 connections now open) 2015-10-05T11:30:40.015+0100 [conn841] end connection 172.28.0.164:50487 (695 connections now open) 2015-10-05T11:30:40.015+0100 [conn629] end connection 172.28.0.164:50169 (695 connections now open) 2015-10-05T11:30:40.015+0100 [conn696] end connection 172.28.0.164:50242 (694 connections now open) 2015-10-05T11:30:40.015+0100 [conn693] end connection 172.28.0.164:50239 (692 connections now open) 2015-10-05T11:30:40.013+0100 [conn786] end connection 172.28.0.164:50432 (717 connections now open) 2015-10-05T11:30:40.015+0100 [conn687] end connection 172.28.0.164:50233 (690 connections now open) 2015-10-05T11:30:40.016+0100 [conn772] end connection 172.28.0.164:50411 (689 connections now open) 2015-10-05T11:30:40.016+0100 [conn807] end connection 172.28.0.164:50453 (689 connections now open) 2015-10-05T11:30:40.016+0100 [conn639] end connection 172.28.0.164:50180 (688 connections now open) 2015-10-05T11:30:40.016+0100 [conn620] end connection 172.28.0.164:50155 (687 connections now open) 2015-10-05T11:30:40.016+0100 [conn630] end connection 172.28.0.164:50171 (686 connections now open) 2015-10-05T11:30:40.016+0100 [conn645] end connection 172.28.0.164:50186 (686 connections now open) 2015-10-05T11:30:40.016+0100 [conn670] end connection 172.28.0.164:50215 (684 connections now open) 2015-10-05T11:30:40.013+0100 [conn878] end connection 172.28.0.164:50524 (715 connections now open) 2015-10-05T11:30:40.013+0100 [conn835] end connection 172.28.0.164:50482 (715 connections now open) 2015-10-05T11:30:40.016+0100 [conn654] end connection 172.28.0.164:50195 (681 connections now open) 2015-10-05T11:30:40.016+0100 [conn677] end connection 172.28.0.164:50223 (680 connections now open) 2015-10-05T11:30:40.016+0100 [conn612] end connection 172.28.0.164:50141 (679 connections now open) 2015-10-05T11:30:40.016+0100 [conn816] end connection 172.28.0.164:50460 (678 connections now open) 2015-10-05T11:30:40.014+0100 [conn758] end connection 172.28.0.164:50355 (710 connections now open) 2015-10-05T11:30:40.014+0100 [conn713] end connection 172.28.0.164:50262 (706 connections now open) 2015-10-05T11:30:40.016+0100 [conn615] end connection 172.28.0.164:50148 (675 connections now open) 2015-10-05T11:30:40.014+0100 [conn842] end connection 172.28.0.164:50488 (704 connections now open) 2015-10-05T11:30:40.014+0100 [conn748] end connection 172.28.0.164:50303 (704 connections now open) 2015-10-05T11:30:40.017+0100 [conn859] end connection 172.28.0.164:50505 (671 connections now open) 2015-10-05T11:30:40.017+0100 [conn733] end connection 172.28.0.164:50286 (671 connections now open) 2015-10-05T11:30:40.015+0100 [conn747] end connection 172.28.0.164:50302 (695 connections now open) 2015-10-05T11:30:40.015+0100 [conn868] end connection 172.28.0.164:50514 (695 connections now open) 2015-10-05T11:30:40.015+0100 [conn673] end connection 172.28.0.164:50218 (690 connections now open) 2015-10-05T11:30:40.017+0100 [conn716] end connection 172.28.0.164:50265 (668 connections now open) 2015-10-05T11:30:40.017+0100 [conn699] end connection 172.28.0.164:50248 (666 connections now open) 2015-10-05T11:30:40.016+0100 [conn825] end connection 172.28.0.164:50471 (689 connections now open) 2015-10-05T11:30:40.016+0100 [conn759] end connection 172.28.0.164:50356 (689 connections now open) 2015-10-05T11:30:40.016+0100 [conn642] end connection 172.28.0.164:50182 (688 connections now open) 2015-10-05T11:30:40.016+0100 [conn780] end connection 172.28.0.164:50425 (687 connections now open) 2015-10-05T11:30:40.013+0100 [conn756] end connection 172.28.0.164:50353 (715 connections now open) 2015-10-05T11:30:40.013+0100 [conn793] end connection 172.28.0.164:50439 (715 connections now open) 2015-10-05T11:30:40.016+0100 [conn671] end connection 172.28.0.164:50216 (684 connections now open) 2015-10-05T11:30:40.016+0100 [conn741] end connection 172.28.0.164:50293 (683 connections now open) 2015-10-05T11:30:40.016+0100 [conn672] end connection 172.28.0.164:50217 (683 connections now open) 2015-10-05T11:30:40.018+0100 [conn657] end connection 172.28.0.164:50198 (656 connections now open) 2015-10-05T11:30:40.016+0100 [conn729] end connection 172.28.0.164:50285 (680 connections now open) 2015-10-05T11:30:40.018+0100 [conn740] end connection 172.28.0.164:50284 (655 connections now open) 2015-10-05T11:30:40.013+0100 [conn683] end connection 172.28.0.164:50228 (714 connections now open) 2015-10-05T11:30:40.017+0100 [conn824] end connection 172.28.0.164:50470 (673 connections now open) 2015-10-05T11:30:40.017+0100 [conn764] end connection 172.28.0.164:50361 (673 connections now open) 2015-10-05T11:30:40.018+0100 [conn784] end connection 172.28.0.164:50429 (651 connections now open) 2015-10-05T11:30:40.015+0100 [conn628] end connection 172.28.0.164:50168 (700 connections now open) 2015-10-05T11:30:40.017+0100 [conn866] end connection 172.28.0.164:50512 (671 connections now open) 2015-10-05T11:30:40.017+0100 [conn884] end connection 172.28.0.164:50536 (671 connections now open) 2015-10-05T11:30:40.015+0100 [conn819] end connection 172.28.0.164:50467 (695 connections now open) 2015-10-05T11:30:40.018+0100 [conn840] end connection 172.28.0.164:50486 (645 connections now open) 2015-10-05T11:30:40.018+0100 [conn611] end connection 172.28.0.164:50140 (644 connections now open) 2015-10-05T11:30:40.017+0100 [conn653] end connection 172.28.0.164:50194 (662 connections now open) 2015-10-05T11:30:40.017+0100 [conn887] end connection 172.28.0.164:50568 (661 connections now open) 2015-10-05T11:30:40.016+0100 [conn778] end connection 172.28.0.164:50423 (681 connections now open) 2015-10-05T11:30:40.018+0100 [conn626] end connection 172.28.0.164:50164 (656 connections now open) 2015-10-05T11:30:40.019+0100 [conn660] end connection 172.28.0.164:50201 (639 connections now open) 2015-10-05T11:30:40.019+0100 [conn633] end connection 172.28.0.164:50174 (638 connections now open) 2015-10-05T11:30:40.018+0100 [conn794] end connection 172.28.0.164:50440 (655 connections now open) 2015-10-05T11:30:40.019+0100 [conn674] end connection 172.28.0.164:50219 (636 connections now open) 2015-10-05T11:30:40.019+0100 [conn631] end connection 172.28.0.164:50172 (635 connections now open) 2015-10-05T11:30:40.018+0100 [conn605] end connection 172.28.0.164:50125 (651 connections now open) 2015-10-05T11:30:40.019+0100 [conn852] end connection 172.28.0.164:50498 (634 connections now open) 2015-10-05T11:30:40.019+0100 [conn650] end connection 172.28.0.164:50191 (633 connections now open) 2015-10-05T11:30:40.018+0100 [conn746] end connection 172.28.0.164:50300 (645 connections now open) 2015-10-05T11:30:40.019+0100 [conn888] end connection 172.28.0.164:50569 (630 connections now open) 2015-10-05T11:30:40.019+0100 [conn763] end connection 172.28.0.164:50360 (629 connections now open) 2015-10-05T11:30:40.019+0100 [conn684] end connection 172.28.0.164:50230 (628 connections now open) 2015-10-05T11:30:40.017+0100 [conn661] end connection 172.28.0.164:50202 (671 connections now open) 2015-10-05T11:30:40.018+0100 [conn783] end connection 172.28.0.164:50428 (644 connections now open) 2015-10-05T11:30:40.017+0100 [conn752] end connection 172.28.0.164:50306 (662 connections now open) 2015-10-05T11:30:40.018+0100 [conn714] end connection 172.28.0.164:50263 (643 connections now open) 2015-10-05T11:30:40.019+0100 [conn646] end connection 172.28.0.164:50187 (638 connections now open) 2015-10-05T11:30:40.020+0100 [conn797] end connection 172.28.0.164:50443 (623 connections now open) 2015-10-05T11:30:40.020+0100 [conn800] end connection 172.28.0.164:50446 (620 connections now open) 2015-10-05T11:30:40.020+0100 [conn812] end connection 172.28.0.164:50459 (620 connections now open) 2015-10-05T11:30:40.019+0100 [conn686] end connection 172.28.0.164:50232 (636 connections now open) 2015-10-05T11:30:40.020+0100 [conn648] end connection 172.28.0.164:50189 (618 connections now open) 2015-10-05T11:30:40.013+0100 [conn798] end connection 172.28.0.164:50444 (714 connections now open) 2015-10-05T11:30:40.019+0100 [conn636] end connection 172.28.0.164:50177 (634 connections now open) 2015-10-05T11:30:40.019+0100 [conn610] end connection 172.28.0.164:50139 (634 connections now open) 2015-10-05T11:30:40.017+0100 [conn844] end connection 172.28.0.164:50490 (671 connections now open) 2015-10-05T11:30:40.019+0100 [conn644] end connection 172.28.0.164:50185 (633 connections now open) 2015-10-05T11:30:40.019+0100 [conn781] end connection 172.28.0.164:50426 (632 connections now open) 2015-10-05T11:30:40.018+0100 [conn795] end connection 172.28.0.164:50441 (649 connections now open) 2015-10-05T11:30:40.019+0100 [conn867] end connection 172.28.0.164:50513 (630 connections now open) 2015-10-05T11:30:40.019+0100 [conn886] end connection 172.28.0.164:50567 (629 connections now open) 2015-10-05T11:30:40.020+0100 [conn635] end connection 172.28.0.164:50176 (608 connections now open) 2015-10-05T11:30:40.020+0100 [conn736] end connection 172.28.0.164:50282 (623 connections now open) 2015-10-05T11:30:40.020+0100 [conn791] end connection 172.28.0.164:50437 (623 connections now open) 2015-10-05T11:30:40.020+0100 [conn697] end connection 172.28.0.164:50246 (623 connections now open) 2015-10-05T11:30:40.019+0100 [conn885] end connection 172.28.0.164:50535 (638 connections now open) 2015-10-05T11:30:40.020+0100 [conn850] end connection 172.28.0.164:50496 (618 connections now open) 2015-10-05T11:30:40.020+0100 [conn652] end connection 172.28.0.164:50193 (618 connections now open) 2015-10-05T11:30:40.020+0100 [conn770] end connection 172.28.0.164:50409 (618 connections now open) 2015-10-05T11:30:40.020+0100 [conn881] end connection 172.28.0.164:50527 (617 connections now open) 2015-10-05T11:30:40.020+0100 [conn667] end connection 172.28.0.164:50208 (615 connections now open) 2015-10-05T11:30:40.020+0100 [conn664] end connection 172.28.0.164:50205 (615 connections now open) 2015-10-05T11:30:40.020+0100 [conn751] end connection 172.28.0.164:50307 (614 connections now open) 2015-10-05T11:30:40.020+0100 [conn623] end connection 172.28.0.164:50160 (614 connections now open) 2015-10-05T11:30:40.020+0100 [conn703] end connection 172.28.0.164:50251 (623 connections now open) 2015-10-05T11:30:46.291+0100 [conn129] end connection 172.28.0.163:52509 (593 connections now open) 2015-10-05T11:30:46.292+0100 [mongosMain] connection accepted from 172.28.0.163:57579 #1048 (594 connections now open) 2015-10-05T11:30:46.294+0100 [conn1048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:46.300+0100 [conn145] end connection 172.28.0.163:52541 (593 connections now open) 2015-10-05T11:30:46.301+0100 [mongosMain] connection accepted from 172.28.0.163:57580 #1049 (594 connections now open) 2015-10-05T11:30:46.303+0100 [conn1049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:46.306+0100 [conn80] end connection 172.28.0.163:52409 (593 connections now open) 2015-10-05T11:30:46.306+0100 [conn14] end connection 172.28.0.163:52269 (592 connections now open) 2015-10-05T11:30:46.307+0100 [mongosMain] connection accepted from 172.28.0.163:57581 #1050 (593 connections now open) 2015-10-05T11:30:46.307+0100 [mongosMain] connection accepted from 172.28.0.163:57582 #1051 (594 connections now open) 2015-10-05T11:30:46.309+0100 [conn1050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:46.309+0100 [conn1051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:46.494+0100 [conn46] end connection 172.28.0.163:52336 (593 connections now open) 2015-10-05T11:30:46.495+0100 [mongosMain] connection accepted from 172.28.0.163:57583 #1052 (594 connections now open) 2015-10-05T11:30:46.497+0100 [conn1052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:46.497+0100 [conn51] end connection 172.28.0.163:52348 (593 connections now open) 2015-10-05T11:30:46.498+0100 [mongosMain] connection accepted from 172.28.0.163:57584 #1053 (594 connections now open) 2015-10-05T11:30:46.499+0100 [conn1053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:30:49.353+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:30:49.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:30:55.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612515f12deab02e2986574 2015-10-05T11:30:55.799+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:30:58.733+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:30:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:31:02.012+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612516512deab02e29865e2 2015-10-05T11:31:02.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:08.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612516c12deab02e2986662 2015-10-05T11:31:08.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:16.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612517212deab02e29866bf 2015-10-05T11:31:16.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:20.284+0100 [conn21] end connection 172.28.0.163:52278 (593 connections now open) 2015-10-05T11:31:20.286+0100 [mongosMain] connection accepted from 172.28.0.163:57634 #1054 (594 connections now open) 2015-10-05T11:31:20.288+0100 [conn1054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.335+0100 [conn17] end connection 172.28.0.163:52274 (593 connections now open) 2015-10-05T11:31:20.337+0100 [mongosMain] connection accepted from 172.28.0.163:57635 #1055 (594 connections now open) 2015-10-05T11:31:20.339+0100 [conn1055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.407+0100 [conn101] end connection 172.28.0.163:52453 (593 connections now open) 2015-10-05T11:31:20.408+0100 [mongosMain] connection accepted from 172.28.0.163:57636 #1056 (594 connections now open) 2015-10-05T11:31:20.410+0100 [conn1056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.416+0100 [conn182] end connection 172.28.0.163:52616 (593 connections now open) 2015-10-05T11:31:20.417+0100 [mongosMain] connection accepted from 172.28.0.163:57637 #1057 (594 connections now open) 2015-10-05T11:31:20.418+0100 [conn1057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.428+0100 [conn135] end connection 172.28.0.163:52521 (593 connections now open) 2015-10-05T11:31:20.429+0100 [mongosMain] connection accepted from 172.28.0.163:57638 #1058 (594 connections now open) 2015-10-05T11:31:20.430+0100 [conn1058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.442+0100 [conn168] end connection 172.28.0.163:52588 (593 connections now open) 2015-10-05T11:31:20.442+0100 [mongosMain] connection accepted from 172.28.0.163:57639 #1059 (594 connections now open) 2015-10-05T11:31:20.444+0100 [conn1059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.453+0100 [conn160] end connection 172.28.0.163:52571 (593 connections now open) 2015-10-05T11:31:20.454+0100 [mongosMain] connection accepted from 172.28.0.163:57640 #1060 (594 connections now open) 2015-10-05T11:31:20.456+0100 [conn1060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.515+0100 [conn152] end connection 172.28.0.163:52554 (593 connections now open) 2015-10-05T11:31:20.516+0100 [mongosMain] connection accepted from 172.28.0.163:57641 #1061 (594 connections now open) 2015-10-05T11:31:20.518+0100 [conn1061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.518+0100 [conn34] end connection 172.28.0.163:52310 (593 connections now open) 2015-10-05T11:31:20.519+0100 [mongosMain] connection accepted from 172.28.0.163:57642 #1062 (594 connections now open) 2015-10-05T11:31:20.520+0100 [conn1062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.568+0100 [conn96] end connection 172.28.0.163:52443 (593 connections now open) 2015-10-05T11:31:20.569+0100 [mongosMain] connection accepted from 172.28.0.163:57643 #1063 (594 connections now open) 2015-10-05T11:31:20.571+0100 [conn1063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.574+0100 [conn172] end connection 172.28.0.163:52595 (593 connections now open) 2015-10-05T11:31:20.575+0100 [mongosMain] connection accepted from 172.28.0.163:57644 #1064 (594 connections now open) 2015-10-05T11:31:20.577+0100 [conn1064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.620+0100 [conn128] end connection 172.28.0.163:52507 (593 connections now open) 2015-10-05T11:31:20.621+0100 [mongosMain] connection accepted from 172.28.0.163:57645 #1065 (594 connections now open) 2015-10-05T11:31:20.623+0100 [conn1065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.627+0100 [conn89] end connection 172.28.0.163:52427 (593 connections now open) 2015-10-05T11:31:20.628+0100 [mongosMain] connection accepted from 172.28.0.163:57646 #1066 (594 connections now open) 2015-10-05T11:31:20.629+0100 [conn178] end connection 172.28.0.163:52608 (593 connections now open) 2015-10-05T11:31:20.630+0100 [conn1066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.630+0100 [mongosMain] connection accepted from 172.28.0.163:57647 #1067 (594 connections now open) 2015-10-05T11:31:20.632+0100 [conn1067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.636+0100 [conn15] end connection 172.28.0.163:52271 (593 connections now open) 2015-10-05T11:31:20.637+0100 [mongosMain] connection accepted from 172.28.0.163:57648 #1068 (594 connections now open) 2015-10-05T11:31:20.638+0100 [conn1068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.639+0100 [conn148] end connection 172.28.0.163:52546 (593 connections now open) 2015-10-05T11:31:20.640+0100 [mongosMain] connection accepted from 172.28.0.163:57649 #1069 (594 connections now open) 2015-10-05T11:31:20.641+0100 [conn1069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.679+0100 [conn32] end connection 172.28.0.163:52307 (593 connections now open) 2015-10-05T11:31:20.680+0100 [mongosMain] connection accepted from 172.28.0.163:57650 #1070 (594 connections now open) 2015-10-05T11:31:20.682+0100 [conn1070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.708+0100 [conn171] end connection 172.28.0.163:52594 (593 connections now open) 2015-10-05T11:31:20.709+0100 [mongosMain] connection accepted from 172.28.0.163:57651 #1071 (594 connections now open) 2015-10-05T11:31:20.711+0100 [conn1071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.714+0100 [conn93] end connection 172.28.0.163:52435 (593 connections now open) 2015-10-05T11:31:20.714+0100 [mongosMain] connection accepted from 172.28.0.163:57652 #1072 (594 connections now open) 2015-10-05T11:31:20.716+0100 [conn1072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.738+0100 [conn82] end connection 172.28.0.163:52412 (593 connections now open) 2015-10-05T11:31:20.740+0100 [mongosMain] connection accepted from 172.28.0.163:57653 #1073 (594 connections now open) 2015-10-05T11:31:20.741+0100 [conn1073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:20.757+0100 [conn130] end connection 172.28.0.163:52511 (593 connections now open) 2015-10-05T11:31:20.758+0100 [mongosMain] connection accepted from 172.28.0.163:57654 #1074 (594 connections now open) 2015-10-05T11:31:20.760+0100 [conn1074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:28.814+0100 [mongosMain] connection accepted from 127.0.0.1:57668 #1075 (595 connections now open) 2015-10-05T11:31:28.814+0100 [conn1075] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:28.814+0100 [conn1075] end connection 127.0.0.1:57668 (594 connections now open) 2015-10-05T11:31:28.924+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612518012deab02e29867b0 2015-10-05T11:31:29.033+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:31:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:31:29.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:29.719+0100 [mongosMain] connection accepted from 172.28.0.163:57669 #1076 (595 connections now open) 2015-10-05T11:31:29.719+0100 [conn1076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:29.766+0100 [conn512] end connection 172.28.0.163:55342 (594 connections now open) 2015-10-05T11:31:34.309+0100 [conn551] end connection 172.28.0.164:49380 (593 connections now open) 2015-10-05T11:31:34.310+0100 [mongosMain] connection accepted from 172.28.0.164:51488 #1077 (594 connections now open) 2015-10-05T11:31:34.312+0100 [conn1077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:35.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612518712deab02e298681c 2015-10-05T11:31:35.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:39.329+0100 [mongosMain] connection accepted from 127.0.0.1:57677 #1078 (595 connections now open) 2015-10-05T11:31:39.332+0100 [conn1078] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:39.332+0100 [conn1078] end connection 127.0.0.1:57677 (594 connections now open) 2015-10-05T11:31:41.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612518d12deab02e2986873 2015-10-05T11:31:41.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:49.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612519312deab02e29868cc 2015-10-05T11:31:49.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:31:56.541+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:31:56.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:31:57.753+0100 [conn138] end connection 172.28.0.163:52525 (593 connections now open) 2015-10-05T11:31:57.754+0100 [conn136] end connection 172.28.0.163:52523 (592 connections now open) 2015-10-05T11:31:57.754+0100 [mongosMain] connection accepted from 172.28.0.163:57704 #1079 (593 connections now open) 2015-10-05T11:31:57.755+0100 [mongosMain] connection accepted from 172.28.0.163:57705 #1080 (594 connections now open) 2015-10-05T11:31:57.756+0100 [conn1079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:57.757+0100 [conn1080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:57.767+0100 [conn45] end connection 172.28.0.163:52335 (593 connections now open) 2015-10-05T11:31:57.768+0100 [mongosMain] connection accepted from 172.28.0.163:57706 #1081 (594 connections now open) 2015-10-05T11:31:57.770+0100 [conn1081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:57.779+0100 [conn125] end connection 172.28.0.163:52500 (593 connections now open) 2015-10-05T11:31:57.780+0100 [mongosMain] connection accepted from 172.28.0.163:57707 #1082 (594 connections now open) 2015-10-05T11:31:57.782+0100 [conn1082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:58.394+0100 [conn60] end connection 172.28.0.163:52367 (593 connections now open) 2015-10-05T11:31:58.411+0100 [conn59] end connection 172.28.0.163:52365 (592 connections now open) 2015-10-05T11:31:58.589+0100 [mongosMain] connection accepted from 172.28.0.163:57713 #1083 (593 connections now open) 2015-10-05T11:31:58.590+0100 [mongosMain] connection accepted from 172.28.0.163:57714 #1084 (594 connections now open) 2015-10-05T11:31:58.595+0100 [conn1083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:58.607+0100 [conn53] end connection 172.28.0.163:52352 (593 connections now open) 2015-10-05T11:31:58.799+0100 [conn158] end connection 172.28.0.163:52568 (592 connections now open) 2015-10-05T11:31:59.274+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:31:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:31:59.442+0100 [conn1084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:59.460+0100 [mongosMain] connection accepted from 172.28.0.163:57717 #1085 (593 connections now open) 2015-10-05T11:31:59.539+0100 [conn1085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:31:59.568+0100 [mongosMain] connection accepted from 172.28.0.163:57718 #1086 (594 connections now open) 2015-10-05T11:31:59.581+0100 [conn1086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:32:02.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251a212deab02e2986981 2015-10-05T11:32:02.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:15.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251ae12deab02e2986a30 2015-10-05T11:32:15.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:21.844+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251b512deab02e2986a8c 2015-10-05T11:32:21.980+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:28.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251bc12deab02e2986af0 2015-10-05T11:32:28.682+0100 [mongosMain] connection accepted from 127.0.0.1:57754 #1087 (595 connections now open) 2015-10-05T11:32:28.690+0100 [conn1087] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:32:28.691+0100 [conn1087] end connection 127.0.0.1:57754 (594 connections now open) 2015-10-05T11:32:29.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:29.707+0100 [mongosMain] connection accepted from 172.28.0.163:57755 #1088 (595 connections now open) 2015-10-05T11:32:29.708+0100 [conn1088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:32:29.754+0100 [conn98] end connection 172.28.0.163:52445 (594 connections now open) 2015-10-05T11:32:30.273+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:32:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:32:34.325+0100 [conn550] end connection 172.28.0.164:49379 (593 connections now open) 2015-10-05T11:32:34.326+0100 [mongosMain] connection accepted from 172.28.0.164:51551 #1089 (594 connections now open) 2015-10-05T11:32:34.331+0100 [conn1089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:32:35.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251c312deab02e2986b4e 2015-10-05T11:32:35.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:39.736+0100 [mongosMain] connection accepted from 127.0.0.1:57762 #1090 (595 connections now open) 2015-10-05T11:32:39.739+0100 [conn1090] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:32:39.739+0100 [conn1090] end connection 127.0.0.1:57762 (594 connections now open) 2015-10-05T11:32:41.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251c912deab02e2986bdc 2015-10-05T11:32:41.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:48.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251cf12deab02e2986c80 2015-10-05T11:32:48.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:54.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251d612deab02e2986cfd 2015-10-05T11:32:54.718+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:32:56.034+0100 [conn901] end connection 172.28.0.164:50872 (593 connections now open) 2015-10-05T11:32:56.034+0100 [conn928] end connection 172.28.0.164:50913 (592 connections now open) 2015-10-05T11:32:56.034+0100 [conn897] end connection 172.28.0.164:50778 (592 connections now open) 2015-10-05T11:32:56.035+0100 [conn939] end connection 172.28.0.164:50935 (590 connections now open) 2015-10-05T11:32:56.035+0100 [conn900] end connection 172.28.0.164:50790 (590 connections now open) 2015-10-05T11:32:56.035+0100 [conn891] end connection 172.28.0.164:50604 (590 connections now open) 2015-10-05T11:32:56.036+0100 [conn894] end connection 172.28.0.164:50727 (587 connections now open) 2015-10-05T11:32:56.036+0100 [conn892] end connection 172.28.0.164:50619 (587 connections now open) 2015-10-05T11:32:56.036+0100 [conn895] end connection 172.28.0.164:50767 (586 connections now open) 2015-10-05T11:32:56.036+0100 [conn890] end connection 172.28.0.164:50601 (587 connections now open) 2015-10-05T11:32:56.036+0100 [conn931] end connection 172.28.0.164:50916 (583 connections now open) 2015-10-05T11:32:56.036+0100 [conn934] end connection 172.28.0.164:50921 (583 connections now open) 2015-10-05T11:32:56.036+0100 [conn936] end connection 172.28.0.164:50926 (583 connections now open) 2015-10-05T11:32:56.036+0100 [conn930] end connection 172.28.0.164:50915 (582 connections now open) 2015-10-05T11:32:56.037+0100 [conn909] end connection 172.28.0.164:50882 (579 connections now open) 2015-10-05T11:32:56.037+0100 [conn933] end connection 172.28.0.164:50919 (579 connections now open) 2015-10-05T11:32:56.037+0100 [conn935] end connection 172.28.0.164:50923 (579 connections now open) 2015-10-05T11:32:56.037+0100 [conn937] end connection 172.28.0.164:50928 (577 connections now open) 2015-10-05T11:32:56.037+0100 [conn938] end connection 172.28.0.164:50931 (577 connections now open) 2015-10-05T11:32:56.037+0100 [conn932] end connection 172.28.0.164:50917 (575 connections now open) 2015-10-05T11:32:56.038+0100 [conn916] end connection 172.28.0.164:50892 (573 connections now open) 2015-10-05T11:32:56.039+0100 [conn896] end connection 172.28.0.164:50769 (572 connections now open) 2015-10-05T11:32:56.039+0100 [conn913] end connection 172.28.0.164:50889 (571 connections now open) 2015-10-05T11:32:56.039+0100 [conn920] end connection 172.28.0.164:50899 (571 connections now open) 2015-10-05T11:32:56.039+0100 [conn929] end connection 172.28.0.164:50914 (571 connections now open) 2015-10-05T11:32:56.040+0100 [conn902] end connection 172.28.0.164:50873 (568 connections now open) 2015-10-05T11:32:56.042+0100 [conn925] end connection 172.28.0.164:50908 (567 connections now open) 2015-10-05T11:32:56.043+0100 [conn919] end connection 172.28.0.164:50895 (566 connections now open) 2015-10-05T11:32:56.043+0100 [conn912] end connection 172.28.0.164:50886 (566 connections now open) 2015-10-05T11:32:56.043+0100 [conn907] end connection 172.28.0.164:50879 (566 connections now open) 2015-10-05T11:32:56.043+0100 [conn904] end connection 172.28.0.164:50875 (565 connections now open) 2015-10-05T11:32:56.043+0100 [conn906] end connection 172.28.0.164:50877 (562 connections now open) 2015-10-05T11:32:56.043+0100 [conn899] end connection 172.28.0.164:50785 (561 connections now open) 2015-10-05T11:32:56.044+0100 [conn924] end connection 172.28.0.164:50907 (560 connections now open) 2015-10-05T11:32:56.044+0100 [conn917] end connection 172.28.0.164:50893 (560 connections now open) 2015-10-05T11:32:56.044+0100 [conn893] end connection 172.28.0.164:50645 (558 connections now open) 2015-10-05T11:32:56.044+0100 [conn914] end connection 172.28.0.164:50890 (557 connections now open) 2015-10-05T11:32:56.044+0100 [conn915] end connection 172.28.0.164:50891 (556 connections now open) 2015-10-05T11:32:56.044+0100 [conn923] end connection 172.28.0.164:50906 (556 connections now open) 2015-10-05T11:32:56.044+0100 [conn910] end connection 172.28.0.164:50884 (555 connections now open) 2015-10-05T11:32:56.044+0100 [conn911] end connection 172.28.0.164:50885 (555 connections now open) 2015-10-05T11:32:56.044+0100 [conn922] end connection 172.28.0.164:50904 (555 connections now open) 2015-10-05T11:32:56.044+0100 [conn903] end connection 172.28.0.164:50874 (551 connections now open) 2015-10-05T11:32:56.045+0100 [conn943] end connection 172.28.0.164:50939 (550 connections now open) 2015-10-05T11:32:56.045+0100 [conn927] end connection 172.28.0.164:50911 (549 connections now open) 2015-10-05T11:32:56.045+0100 [conn944] end connection 172.28.0.164:50941 (548 connections now open) 2015-10-05T11:32:56.045+0100 [conn908] end connection 172.28.0.164:50881 (548 connections now open) 2015-10-05T11:32:56.046+0100 [conn898] end connection 172.28.0.164:50781 (546 connections now open) 2015-10-05T11:32:56.046+0100 [conn941] end connection 172.28.0.164:50937 (546 connections now open) 2015-10-05T11:32:56.046+0100 [conn905] end connection 172.28.0.164:50876 (544 connections now open) 2015-10-05T11:32:56.047+0100 [conn926] end connection 172.28.0.164:50909 (543 connections now open) 2015-10-05T11:33:00.592+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:33:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:33:00.729+0100 [conn921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:00.757+0100 [conn918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:01.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251dc12deab02e2986d5b 2015-10-05T11:33:01.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:07.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251e312deab02e2986db9 2015-10-05T11:33:07.385+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:14.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251e912deab02e2986e1d 2015-10-05T11:33:14.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:20.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251f012deab02e2986e7a 2015-10-05T11:33:20.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:27.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561251f612deab02e2986ec8 2015-10-05T11:33:27.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:29.154+0100 [mongosMain] connection accepted from 127.0.0.1:57819 #1091 (544 connections now open) 2015-10-05T11:33:29.157+0100 [conn1091] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:29.158+0100 [conn1091] end connection 127.0.0.1:57819 (543 connections now open) 2015-10-05T11:33:29.738+0100 [mongosMain] connection accepted from 172.28.0.163:57820 #1092 (544 connections now open) 2015-10-05T11:33:29.740+0100 [conn1092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:29.769+0100 [conn255] end connection 172.28.0.163:53519 (543 connections now open) 2015-10-05T11:33:30.747+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:33:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:33:34.341+0100 [conn552] end connection 172.28.0.164:49383 (542 connections now open) 2015-10-05T11:33:34.343+0100 [mongosMain] connection accepted from 172.28.0.164:51601 #1093 (543 connections now open) 2015-10-05T11:33:34.346+0100 [conn1093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:40.066+0100 [mongosMain] connection accepted from 127.0.0.1:57824 #1094 (544 connections now open) 2015-10-05T11:33:40.069+0100 [conn1094] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:33:40.069+0100 [conn1094] end connection 127.0.0.1:57824 (543 connections now open) 2015-10-05T11:33:40.794+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:33:40.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:33:47.086+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612520a12deab02e2986f94 2015-10-05T11:33:47.222+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:33:59.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612521712deab02e2987029 2015-10-05T11:33:59.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:34:00.894+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:34:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:34:06.630+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:34:06.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:34:12.737+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:34:12.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:34:19.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612522a12deab02e2987142 2015-10-05T11:34:19.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:34:28.681+0100 [mongosMain] connection accepted from 127.0.0.1:57885 #1095 (544 connections now open) 2015-10-05T11:34:28.683+0100 [conn1095] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:34:28.684+0100 [conn1095] end connection 127.0.0.1:57885 (543 connections now open) 2015-10-05T11:34:29.753+0100 [conn2] end connection 172.28.0.163:52226 (542 connections now open) 2015-10-05T11:34:29.754+0100 [mongosMain] connection accepted from 172.28.0.163:57886 #1096 (543 connections now open) 2015-10-05T11:34:29.755+0100 [conn1096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:34:29.816+0100 [conn277] end connection 172.28.0.163:53690 (542 connections now open) 2015-10-05T11:34:31.053+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:34:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:34:31.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612523712deab02e29871e6 2015-10-05T11:34:31.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:34:34.357+0100 [conn555] end connection 172.28.0.164:49394 (541 connections now open) 2015-10-05T11:34:34.358+0100 [mongosMain] connection accepted from 172.28.0.164:51650 #1097 (542 connections now open) 2015-10-05T11:34:34.361+0100 [conn1097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:34:37.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612523d12deab02e2987258 2015-10-05T11:34:37.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:34:39.952+0100 [mongosMain] connection accepted from 127.0.0.1:57889 #1098 (543 connections now open) 2015-10-05T11:34:39.955+0100 [conn1098] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:34:39.955+0100 [conn1098] end connection 127.0.0.1:57889 (542 connections now open) 2015-10-05T11:34:49.955+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612524626fd57ee99392989') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444041289823), why: "doing balance round", ts: ObjectId('5612524912deab02e29872fc') } } gle1: { lastOp: Timestamp 1444041289000|4, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1444041277000|13, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } 2015-10-05T11:34:49.957+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:34:49.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:34:57.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612524f12deab02e2987349 2015-10-05T11:34:57.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:01.373+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:35:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:35:01.373+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:35:01.509+0100 [LockPinger] handled late remove of old distributed lock with ts 5612524912deab02e29872fc 2015-10-05T11:35:03.526+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612525712deab02e29873ab 2015-10-05T11:35:03.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:06.799+0100 [mongosMain] connection accepted from 172.28.0.164:51675 #1099 (543 connections now open) 2015-10-05T11:35:06.849+0100 [conn1099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:09.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612525d12deab02e2987429 2015-10-05T11:35:10.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:13.080+0100 [conn25] end connection 172.28.0.163:52292 (542 connections now open) 2015-10-05T11:35:13.081+0100 [mongosMain] connection accepted from 172.28.0.163:57937 #1100 (543 connections now open) 2015-10-05T11:35:13.081+0100 [conn470] end connection 172.28.0.163:54945 (541 connections now open) 2015-10-05T11:35:13.082+0100 [conn530] end connection 172.28.0.163:55413 (541 connections now open) 2015-10-05T11:35:13.082+0100 [conn371] end connection 172.28.0.163:54786 (540 connections now open) 2015-10-05T11:35:13.082+0100 [mongosMain] connection accepted from 172.28.0.163:57938 #1101 (542 connections now open) 2015-10-05T11:35:13.083+0100 [mongosMain] connection accepted from 172.28.0.163:57939 #1102 (542 connections now open) 2015-10-05T11:35:13.083+0100 [conn1100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.083+0100 [mongosMain] connection accepted from 172.28.0.163:57940 #1103 (543 connections now open) 2015-10-05T11:35:13.084+0100 [conn368] end connection 172.28.0.163:54782 (542 connections now open) 2015-10-05T11:35:13.084+0100 [conn340] end connection 172.28.0.163:54738 (541 connections now open) 2015-10-05T11:35:13.084+0100 [conn1102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.084+0100 [conn1101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.085+0100 [conn1103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.085+0100 [mongosMain] connection accepted from 172.28.0.163:57941 #1104 (542 connections now open) 2015-10-05T11:35:13.085+0100 [mongosMain] connection accepted from 172.28.0.163:57942 #1105 (543 connections now open) 2015-10-05T11:35:13.086+0100 [conn1104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.087+0100 [conn1105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.087+0100 [conn43] end connection 172.28.0.163:52333 (542 connections now open) 2015-10-05T11:35:13.088+0100 [mongosMain] connection accepted from 172.28.0.163:57946 #1106 (543 connections now open) 2015-10-05T11:35:13.089+0100 [conn103] end connection 172.28.0.163:52455 (542 connections now open) 2015-10-05T11:35:13.089+0100 [conn31] end connection 172.28.0.163:52305 (541 connections now open) 2015-10-05T11:35:13.089+0100 [conn1106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.090+0100 [mongosMain] connection accepted from 172.28.0.163:57947 #1107 (542 connections now open) 2015-10-05T11:35:13.090+0100 [mongosMain] connection accepted from 172.28.0.163:57948 #1108 (543 connections now open) 2015-10-05T11:35:13.091+0100 [conn1107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.091+0100 [conn1108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.121+0100 [conn170] end connection 172.28.0.163:52591 (542 connections now open) 2015-10-05T11:35:13.122+0100 [mongosMain] connection accepted from 172.28.0.163:57952 #1109 (543 connections now open) 2015-10-05T11:35:13.122+0100 [conn271] end connection 172.28.0.163:53587 (542 connections now open) 2015-10-05T11:35:13.123+0100 [conn467] end connection 172.28.0.163:54942 (541 connections now open) 2015-10-05T11:35:13.124+0100 [conn1109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.136+0100 [mongosMain] connection accepted from 172.28.0.163:57954 #1110 (542 connections now open) 2015-10-05T11:35:13.137+0100 [mongosMain] connection accepted from 172.28.0.163:57955 #1111 (543 connections now open) 2015-10-05T11:35:13.138+0100 [conn409] end connection 172.28.0.163:54857 (542 connections now open) 2015-10-05T11:35:13.143+0100 [conn1110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.149+0100 [conn1111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:13.163+0100 [mongosMain] connection accepted from 172.28.0.163:57957 #1112 (543 connections now open) 2015-10-05T11:35:13.248+0100 [conn1112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:28.275+0100 [mongosMain] connection accepted from 127.0.0.1:57965 #1113 (544 connections now open) 2015-10-05T11:35:28.278+0100 [conn1113] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:28.279+0100 [conn1113] end connection 127.0.0.1:57965 (543 connections now open) 2015-10-05T11:35:28.360+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612527012deab02e2987501 2015-10-05T11:35:28.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:29.771+0100 [conn197] end connection 172.28.0.163:52816 (542 connections now open) 2015-10-05T11:35:29.772+0100 [mongosMain] connection accepted from 172.28.0.163:57968 #1114 (543 connections now open) 2015-10-05T11:35:29.773+0100 [conn1114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:29.944+0100 [conn489] end connection 172.28.0.163:55011 (542 connections now open) 2015-10-05T11:35:32.247+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:35:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:35:34.374+0100 [conn556] end connection 172.28.0.164:49396 (541 connections now open) 2015-10-05T11:35:34.375+0100 [mongosMain] connection accepted from 172.28.0.164:51698 #1115 (542 connections now open) 2015-10-05T11:35:34.378+0100 [conn1115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:34.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612527612deab02e2987564 2015-10-05T11:35:34.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:39.158+0100 [mongosMain] connection accepted from 127.0.0.1:57972 #1116 (543 connections now open) 2015-10-05T11:35:39.160+0100 [conn1116] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:35:39.161+0100 [conn1116] end connection 127.0.0.1:57972 (542 connections now open) 2015-10-05T11:35:40.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612527c12deab02e29875b5 2015-10-05T11:35:41.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:35:53.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612528912deab02e2987672 2015-10-05T11:35:53.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:36:02.700+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:36:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:36:05.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612529512deab02e298770c 2015-10-05T11:36:05.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:36:19.169+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:36:19.169+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:36:25.276+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561252a303838a4537163117') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444041385177), why: "doing balance round", ts: ObjectId('561252a912deab02e298780c') } } gle1: { lastOp: Timestamp 1444041365000|10, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1444041385000|4, connectionId: 39966, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2015-10-05T11:36:25.278+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:36:25.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:36:29.035+0100 [mongosMain] connection accepted from 127.0.0.1:58025 #1117 (543 connections now open) 2015-10-05T11:36:29.038+0100 [conn1117] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:36:29.041+0100 [conn1117] end connection 127.0.0.1:58025 (542 connections now open) 2015-10-05T11:36:29.786+0100 [conn192] end connection 172.28.0.163:52737 (541 connections now open) 2015-10-05T11:36:29.787+0100 [mongosMain] connection accepted from 172.28.0.163:58027 #1118 (542 connections now open) 2015-10-05T11:36:29.789+0100 [conn1118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:36:29.958+0100 [conn112] end connection 172.28.0.163:52475 (541 connections now open) 2015-10-05T11:36:32.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561252af12deab02e2987854 2015-10-05T11:36:32.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:36:33.017+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:36:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:36:33.017+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:36:33.154+0100 [LockPinger] handled late remove of old distributed lock with ts 561252a912deab02e298780c 2015-10-05T11:36:34.389+0100 [conn557] end connection 172.28.0.164:49397 (540 connections now open) 2015-10-05T11:36:34.391+0100 [mongosMain] connection accepted from 172.28.0.164:51744 #1119 (541 connections now open) 2015-10-05T11:36:34.395+0100 [conn1119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:36:39.286+0100 [mongosMain] connection accepted from 127.0.0.1:58034 #1120 (542 connections now open) 2015-10-05T11:36:39.289+0100 [conn1120] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:36:39.289+0100 [conn1120] end connection 127.0.0.1:58034 (541 connections now open) 2015-10-05T11:36:52.591+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561252bdd5de43e0ed5d3cdb') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444041410899), why: "doing balance round", ts: ObjectId('561252c212deab02e298794d') } } gle1: { lastOp: Timestamp 1444041411000|4, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 301, writtenTo: null, err: null, waited: 301, ok: 1.0 } gle2: { lastOp: Timestamp 1444041392000|7, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T11:36:52.595+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:36:52.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:36:58.733+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:36:58.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:37:03.405+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:37:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:37:03.405+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:37:03.541+0100 [LockPinger] handled late remove of old distributed lock with ts 561252c212deab02e298794d 2015-10-05T11:37:05.201+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561252d012deab02e29879c0 2015-10-05T11:37:05.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:37:11.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561252d712deab02e29879d3 2015-10-05T11:37:11.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:37:18.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561252dd12deab02e29879e2 2015-10-05T11:37:18.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:37:23.743+0100 [conn225] end connection 172.28.0.163:53370 (540 connections now open) 2015-10-05T11:37:23.744+0100 [mongosMain] connection accepted from 172.28.0.163:58082 #1121 (541 connections now open) 2015-10-05T11:37:23.746+0100 [conn1121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:23.953+0100 [conn228] end connection 172.28.0.163:53376 (540 connections now open) 2015-10-05T11:37:23.954+0100 [mongosMain] connection accepted from 172.28.0.163:58083 #1122 (541 connections now open) 2015-10-05T11:37:23.956+0100 [conn1122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:24.027+0100 [conn224] end connection 172.28.0.163:53369 (540 connections now open) 2015-10-05T11:37:24.029+0100 [mongosMain] connection accepted from 172.28.0.163:58084 #1123 (541 connections now open) 2015-10-05T11:37:24.030+0100 [conn1123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:24.518+0100 [conn233] end connection 172.28.0.163:53389 (540 connections now open) 2015-10-05T11:37:24.519+0100 [mongosMain] connection accepted from 172.28.0.163:58085 #1124 (541 connections now open) 2015-10-05T11:37:24.520+0100 [conn1124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:25.247+0100 [conn223] end connection 172.28.0.163:53342 (540 connections now open) 2015-10-05T11:37:25.251+0100 [mongosMain] connection accepted from 172.28.0.163:58086 #1125 (541 connections now open) 2015-10-05T11:37:25.253+0100 [conn1125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:25.319+0100 [conn234] end connection 172.28.0.163:53392 (540 connections now open) 2015-10-05T11:37:25.320+0100 [mongosMain] connection accepted from 172.28.0.163:58087 #1126 (541 connections now open) 2015-10-05T11:37:25.321+0100 [conn1126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:25.524+0100 [conn222] end connection 172.28.0.163:53339 (540 connections now open) 2015-10-05T11:37:25.525+0100 [mongosMain] connection accepted from 172.28.0.163:58088 #1127 (541 connections now open) 2015-10-05T11:37:25.527+0100 [conn1127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:25.783+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:37:25.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:37:28.944+0100 [mongosMain] connection accepted from 127.0.0.1:58100 #1128 (542 connections now open) 2015-10-05T11:37:28.947+0100 [conn1128] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:28.948+0100 [conn1128] end connection 127.0.0.1:58100 (541 connections now open) 2015-10-05T11:37:29.803+0100 [conn217] end connection 172.28.0.163:53185 (540 connections now open) 2015-10-05T11:37:29.804+0100 [mongosMain] connection accepted from 172.28.0.163:58101 #1129 (541 connections now open) 2015-10-05T11:37:29.805+0100 [conn1129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:29.973+0100 [conn118] end connection 172.28.0.163:52486 (540 connections now open) 2015-10-05T11:37:33.715+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:37:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:37:34.432+0100 [conn561] end connection 172.28.0.164:49401 (539 connections now open) 2015-10-05T11:37:34.432+0100 [mongosMain] connection accepted from 172.28.0.164:51790 #1130 (540 connections now open) 2015-10-05T11:37:34.432+0100 [conn1130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:37.892+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:37:37.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:37:39.934+0100 [mongosMain] connection accepted from 127.0.0.1:58110 #1131 (541 connections now open) 2015-10-05T11:37:39.936+0100 [conn1131] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:39.937+0100 [conn1131] end connection 127.0.0.1:58110 (540 connections now open) 2015-10-05T11:37:46.471+0100 [conn240] end connection 172.28.0.163:53457 (539 connections now open) 2015-10-05T11:37:46.473+0100 [mongosMain] connection accepted from 172.28.0.163:58117 #1132 (540 connections now open) 2015-10-05T11:37:46.475+0100 [conn1132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:46.647+0100 [conn250] end connection 172.28.0.163:53490 (539 connections now open) 2015-10-05T11:37:46.648+0100 [mongosMain] connection accepted from 172.28.0.163:58118 #1133 (540 connections now open) 2015-10-05T11:37:46.650+0100 [conn1133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:46.727+0100 [conn257] end connection 172.28.0.163:53523 (539 connections now open) 2015-10-05T11:37:48.076+0100 [conn264] end connection 172.28.0.163:53544 (538 connections now open) 2015-10-05T11:37:48.077+0100 [mongosMain] connection accepted from 172.28.0.163:58122 #1134 (539 connections now open) 2015-10-05T11:37:48.079+0100 [conn1134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:48.377+0100 [conn263] end connection 172.28.0.163:53542 (538 connections now open) 2015-10-05T11:37:48.378+0100 [mongosMain] connection accepted from 172.28.0.163:58123 #1135 (539 connections now open) 2015-10-05T11:37:48.380+0100 [conn1135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:48.514+0100 [conn260] end connection 172.28.0.163:53537 (538 connections now open) 2015-10-05T11:37:48.515+0100 [mongosMain] connection accepted from 172.28.0.163:58124 #1136 (539 connections now open) 2015-10-05T11:37:48.517+0100 [conn1136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:48.519+0100 [conn243] end connection 172.28.0.163:53463 (538 connections now open) 2015-10-05T11:37:48.520+0100 [mongosMain] connection accepted from 172.28.0.163:58125 #1137 (539 connections now open) 2015-10-05T11:37:48.522+0100 [conn1137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:48.652+0100 [conn254] end connection 172.28.0.163:53518 (538 connections now open) 2015-10-05T11:37:48.653+0100 [mongosMain] connection accepted from 172.28.0.163:58126 #1138 (539 connections now open) 2015-10-05T11:37:48.655+0100 [conn1138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:37:50.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561252fd12deab02e2987ba2 2015-10-05T11:37:50.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:37:56.882+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:37:56.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:38:03.021+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:38:03.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:38:03.948+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:38:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:38:09.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612531112deab02e2987cc0 2015-10-05T11:38:09.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:38:09.678+0100 [conn269] end connection 172.28.0.163:53585 (538 connections now open) 2015-10-05T11:38:09.679+0100 [mongosMain] connection accepted from 172.28.0.163:58160 #1139 (539 connections now open) 2015-10-05T11:38:09.680+0100 [conn1139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:10.187+0100 [conn238] end connection 172.28.0.163:53454 (538 connections now open) 2015-10-05T11:38:10.188+0100 [mongosMain] connection accepted from 172.28.0.163:58162 #1140 (539 connections now open) 2015-10-05T11:38:10.190+0100 [conn1140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:10.386+0100 [conn259] end connection 172.28.0.163:53529 (538 connections now open) 2015-10-05T11:38:10.388+0100 [mongosMain] connection accepted from 172.28.0.163:58163 #1141 (539 connections now open) 2015-10-05T11:38:10.389+0100 [conn1141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:16.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612531712deab02e2987d28 2015-10-05T11:38:16.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:38:29.519+0100 [conn253] end connection 172.28.0.163:53517 (538 connections now open) 2015-10-05T11:38:29.520+0100 [mongosMain] connection accepted from 172.28.0.163:58177 #1142 (539 connections now open) 2015-10-05T11:38:29.522+0100 [conn1142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.524+0100 [conn239] end connection 172.28.0.163:53456 (538 connections now open) 2015-10-05T11:38:29.524+0100 [conn244] end connection 172.28.0.163:53470 (537 connections now open) 2015-10-05T11:38:29.525+0100 [mongosMain] connection accepted from 172.28.0.163:58178 #1143 (538 connections now open) 2015-10-05T11:38:29.525+0100 [mongosMain] connection accepted from 172.28.0.163:58179 #1144 (539 connections now open) 2015-10-05T11:38:29.526+0100 [conn1143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.527+0100 [conn1144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.539+0100 [conn247] end connection 172.28.0.163:53478 (538 connections now open) 2015-10-05T11:38:29.541+0100 [mongosMain] connection accepted from 172.28.0.163:58180 #1145 (539 connections now open) 2015-10-05T11:38:29.542+0100 [conn1145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.669+0100 [conn261] end connection 172.28.0.163:53539 (538 connections now open) 2015-10-05T11:38:29.670+0100 [mongosMain] connection accepted from 172.28.0.163:58181 #1146 (539 connections now open) 2015-10-05T11:38:29.672+0100 [conn1146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.857+0100 [conn209] end connection 172.28.0.163:53064 (538 connections now open) 2015-10-05T11:38:29.858+0100 [mongosMain] connection accepted from 172.28.0.163:58184 #1147 (539 connections now open) 2015-10-05T11:38:29.860+0100 [conn1147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:29.998+0100 [conn54] end connection 172.28.0.163:52355 (538 connections now open) 2015-10-05T11:38:30.920+0100 [mongosMain] connection accepted from 127.0.0.1:58185 #1148 (539 connections now open) 2015-10-05T11:38:30.922+0100 [conn1148] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:30.923+0100 [conn1148] end connection 127.0.0.1:58185 (538 connections now open) 2015-10-05T11:38:31.433+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:38:31.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:38:34.228+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:38:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:38:34.421+0100 [conn562] end connection 172.28.0.164:49402 (537 connections now open) 2015-10-05T11:38:34.429+0100 [mongosMain] connection accepted from 172.28.0.164:51844 #1149 (538 connections now open) 2015-10-05T11:38:34.434+0100 [conn1149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:39.583+0100 [mongosMain] connection accepted from 127.0.0.1:58191 #1150 (539 connections now open) 2015-10-05T11:38:39.586+0100 [conn1150] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:38:39.586+0100 [conn1150] end connection 127.0.0.1:58191 (538 connections now open) 2015-10-05T11:38:55.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612533f12deab02e2987f70 2015-10-05T11:38:55.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:38:59.669+0100 [conn279] end connection 172.28.0.163:53692 (537 connections now open) 2015-10-05T11:39:04.531+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:39:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:39:20.159+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612535812deab02e29880bf 2015-10-05T11:39:20.227+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:39:28.582+0100 [mongosMain] connection accepted from 127.0.0.1:58246 #1151 (538 connections now open) 2015-10-05T11:39:28.586+0100 [conn1151] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:39:28.587+0100 [conn1151] end connection 127.0.0.1:58246 (537 connections now open) 2015-10-05T11:39:29.867+0100 [conn309] end connection 172.28.0.163:54295 (536 connections now open) 2015-10-05T11:39:29.868+0100 [mongosMain] connection accepted from 172.28.0.163:58249 #1152 (537 connections now open) 2015-10-05T11:39:29.870+0100 [conn1152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:39:30.006+0100 [conn55] end connection 172.28.0.163:52356 (536 connections now open) 2015-10-05T11:39:33.776+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612536338482111da12e04c') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444041572241), why: "doing balance round", ts: ObjectId('5612536412deab02e298817f') } } gle1: { lastOp: Timestamp 1444041560000|8, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 1106, writtenTo: null, err: null, waited: 1106, ok: 1.0 } gle2: { lastOp: Timestamp 1444041572000|4, connectionId: 34850, updatedExisting: true, n: 1, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2015-10-05T11:39:33.780+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:39:33.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:39:34.437+0100 [conn563] end connection 172.28.0.164:49403 (535 connections now open) 2015-10-05T11:39:34.438+0100 [mongosMain] connection accepted from 172.28.0.164:51890 #1153 (536 connections now open) 2015-10-05T11:39:34.440+0100 [conn1153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:39:35.002+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:39:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:39:35.002+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:39:35.138+0100 [LockPinger] handled late remove of old distributed lock with ts 5612536412deab02e298817f 2015-10-05T11:39:39.751+0100 [mongosMain] connection accepted from 127.0.0.1:58255 #1154 (537 connections now open) 2015-10-05T11:39:39.754+0100 [conn1154] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:39:39.754+0100 [conn1154] end connection 127.0.0.1:58255 (536 connections now open) 2015-10-05T11:39:40.246+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:39:40.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:39:52.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612537812deab02e29882ad 2015-10-05T11:39:52.500+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:00.657+0100 [conn290] end connection 172.28.0.163:53857 (535 connections now open) 2015-10-05T11:40:04.599+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:40:04.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:40:05.600+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:40:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:40:10.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612538a12deab02e29883d9 2015-10-05T11:40:11.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:17.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612539112deab02e298843a 2015-10-05T11:40:17.317+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:23.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612539712deab02e2988498 2015-10-05T11:40:23.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:28.448+0100 [mongosMain] connection accepted from 127.0.0.1:58315 #1155 (536 connections now open) 2015-10-05T11:40:28.451+0100 [conn1155] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:40:28.452+0100 [conn1155] end connection 127.0.0.1:58315 (535 connections now open) 2015-10-05T11:40:29.349+0100 [conn301] end connection 172.28.0.163:53942 (534 connections now open) 2015-10-05T11:40:29.357+0100 [mongosMain] connection accepted from 172.28.0.163:58317 #1156 (535 connections now open) 2015-10-05T11:40:29.359+0100 [conn1156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:40:29.882+0100 [conn237] end connection 172.28.0.163:53438 (534 connections now open) 2015-10-05T11:40:29.883+0100 [mongosMain] connection accepted from 172.28.0.163:58318 #1157 (535 connections now open) 2015-10-05T11:40:29.884+0100 [conn1157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:40:30.039+0100 [conn336] end connection 172.28.0.163:54734 (534 connections now open) 2015-10-05T11:40:34.453+0100 [conn564] end connection 172.28.0.164:49404 (533 connections now open) 2015-10-05T11:40:34.454+0100 [mongosMain] connection accepted from 172.28.0.164:51939 #1158 (534 connections now open) 2015-10-05T11:40:34.457+0100 [conn1158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:40:35.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253a312deab02e2988526 2015-10-05T11:40:35.875+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:40:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:40:35.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:39.491+0100 [mongosMain] connection accepted from 127.0.0.1:58323 #1159 (535 connections now open) 2015-10-05T11:40:39.494+0100 [conn1159] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:40:39.494+0100 [conn1159] end connection 127.0.0.1:58323 (534 connections now open) 2015-10-05T11:40:48.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253af12deab02e29885e4 2015-10-05T11:40:48.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:40:54.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253b612deab02e2988648 2015-10-05T11:40:54.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:41:01.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253bc12deab02e29886b3 2015-10-05T11:41:01.712+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:41:06.068+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:41:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:41:07.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253c312deab02e298874d 2015-10-05T11:41:07.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:41:12.698+0100 [conn258] end connection 172.28.0.163:53527 (533 connections now open) 2015-10-05T11:41:12.699+0100 [mongosMain] connection accepted from 172.28.0.163:58380 #1160 (534 connections now open) 2015-10-05T11:41:12.701+0100 [conn1160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:12.798+0100 [conn294] end connection 172.28.0.163:53861 (533 connections now open) 2015-10-05T11:41:12.799+0100 [mongosMain] connection accepted from 172.28.0.163:58381 #1161 (534 connections now open) 2015-10-05T11:41:12.801+0100 [conn1161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:12.823+0100 [conn288] end connection 172.28.0.163:53855 (533 connections now open) 2015-10-05T11:41:12.824+0100 [mongosMain] connection accepted from 172.28.0.163:58382 #1162 (534 connections now open) 2015-10-05T11:41:12.827+0100 [conn1162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:12.909+0100 [conn278] end connection 172.28.0.163:53691 (533 connections now open) 2015-10-05T11:41:12.910+0100 [mongosMain] connection accepted from 172.28.0.163:58383 #1163 (534 connections now open) 2015-10-05T11:41:12.912+0100 [conn1163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:20.737+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253d012deab02e2988826 2015-10-05T11:41:20.873+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:41:28.527+0100 [mongosMain] connection accepted from 127.0.0.1:58396 #1164 (535 connections now open) 2015-10-05T11:41:28.530+0100 [conn1164] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:28.531+0100 [conn1164] end connection 127.0.0.1:58396 (534 connections now open) 2015-10-05T11:41:29.899+0100 [conn510] end connection 172.28.0.163:55337 (533 connections now open) 2015-10-05T11:41:29.900+0100 [mongosMain] connection accepted from 172.28.0.163:58397 #1165 (534 connections now open) 2015-10-05T11:41:29.901+0100 [conn1165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:30.054+0100 [conn465] end connection 172.28.0.163:54939 (533 connections now open) 2015-10-05T11:41:34.469+0100 [conn554] end connection 172.28.0.164:49392 (532 connections now open) 2015-10-05T11:41:34.471+0100 [mongosMain] connection accepted from 172.28.0.164:51989 #1166 (533 connections now open) 2015-10-05T11:41:34.473+0100 [conn1166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:35.569+0100 [conn1099] end connection 172.28.0.164:51675 (532 connections now open) 2015-10-05T11:41:35.569+0100 [conn921] end connection 172.28.0.164:50900 (531 connections now open) 2015-10-05T11:41:35.570+0100 [conn918] end connection 172.28.0.164:50894 (530 connections now open) 2015-10-05T11:41:36.945+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:41:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:41:39.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253e212deab02e2988980 2015-10-05T11:41:39.269+0100 [mongosMain] connection accepted from 127.0.0.1:58401 #1167 (531 connections now open) 2015-10-05T11:41:39.272+0100 [conn1167] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:41:39.272+0100 [conn1167] end connection 127.0.0.1:58401 (530 connections now open) 2015-10-05T11:41:39.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:41:52.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561253f012deab02e2988a29 2015-10-05T11:41:52.249+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:04.571+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:42:04.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:42:07.261+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:42:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:42:09.410+0100 [conn568] end connection 172.28.0.164:49408 (529 connections now open) 2015-10-05T11:42:09.410+0100 [conn583] end connection 172.28.0.164:49423 (528 connections now open) 2015-10-05T11:42:09.410+0100 [conn588] end connection 172.28.0.164:49428 (527 connections now open) 2015-10-05T11:42:09.411+0100 [conn570] end connection 172.28.0.164:49410 (527 connections now open) 2015-10-05T11:42:09.411+0100 [conn1097] end connection 172.28.0.164:51650 (527 connections now open) 2015-10-05T11:42:09.411+0100 [conn979] end connection 172.28.0.164:51326 (524 connections now open) 2015-10-05T11:42:09.411+0100 [conn545] end connection 172.28.0.164:49333 (524 connections now open) 2015-10-05T11:42:09.411+0100 [conn571] end connection 172.28.0.164:49411 (522 connections now open) 2015-10-05T11:42:09.411+0100 [conn569] end connection 172.28.0.164:49409 (521 connections now open) 2015-10-05T11:42:09.412+0100 [conn592] end connection 172.28.0.164:49432 (520 connections now open) 2015-10-05T11:42:09.412+0100 [conn591] end connection 172.28.0.164:49431 (520 connections now open) 2015-10-05T11:42:09.412+0100 [conn589] end connection 172.28.0.164:49429 (518 connections now open) 2015-10-05T11:42:09.412+0100 [conn567] end connection 172.28.0.164:49407 (518 connections now open) 2015-10-05T11:42:09.412+0100 [conn590] end connection 172.28.0.164:49430 (518 connections now open) 2015-10-05T11:42:09.412+0100 [conn559] end connection 172.28.0.164:49399 (518 connections now open) 2015-10-05T11:42:09.412+0100 [conn558] end connection 172.28.0.164:49398 (514 connections now open) 2015-10-05T11:42:09.412+0100 [conn560] end connection 172.28.0.164:49400 (514 connections now open) 2015-10-05T11:42:09.413+0100 [conn587] end connection 172.28.0.164:49427 (512 connections now open) 2015-10-05T11:42:09.413+0100 [conn546] end connection 172.28.0.164:49336 (511 connections now open) 2015-10-05T11:42:09.414+0100 [conn1077] end connection 172.28.0.164:51488 (510 connections now open) 2015-10-05T11:42:09.414+0100 [conn966] end connection 172.28.0.164:51277 (509 connections now open) 2015-10-05T11:42:09.414+0100 [conn1046] end connection 172.28.0.164:51430 (509 connections now open) 2015-10-05T11:42:09.414+0100 [conn1130] end connection 172.28.0.164:51790 (507 connections now open) 2015-10-05T11:42:09.414+0100 [conn1115] end connection 172.28.0.164:51698 (506 connections now open) 2015-10-05T11:42:09.414+0100 [conn574] end connection 172.28.0.164:49414 (505 connections now open) 2015-10-05T11:42:09.415+0100 [conn1119] end connection 172.28.0.164:51744 (505 connections now open) 2015-10-05T11:42:09.415+0100 [conn1003] end connection 172.28.0.164:51375 (505 connections now open) 2015-10-05T11:42:09.415+0100 [conn962] end connection 172.28.0.164:51193 (505 connections now open) 2015-10-05T11:42:09.415+0100 [conn1158] end connection 172.28.0.164:51939 (502 connections now open) 2015-10-05T11:42:09.415+0100 [conn1089] end connection 172.28.0.164:51551 (500 connections now open) 2015-10-05T11:42:09.415+0100 [conn1149] end connection 172.28.0.164:51844 (499 connections now open) 2015-10-05T11:42:09.415+0100 [conn572] end connection 172.28.0.164:49412 (498 connections now open) 2015-10-05T11:42:09.416+0100 [conn1153] end connection 172.28.0.164:51890 (497 connections now open) 2015-10-05T11:42:09.416+0100 [conn543] end connection 172.28.0.164:49316 (497 connections now open) 2015-10-05T11:42:09.416+0100 [conn1093] end connection 172.28.0.164:51601 (495 connections now open) 2015-10-05T11:42:09.416+0100 [conn586] end connection 172.28.0.164:49426 (494 connections now open) 2015-10-05T11:42:09.417+0100 [conn573] end connection 172.28.0.164:49413 (493 connections now open) 2015-10-05T11:42:09.417+0100 [conn566] end connection 172.28.0.164:49406 (492 connections now open) 2015-10-05T11:42:09.417+0100 [conn565] end connection 172.28.0.164:49405 (491 connections now open) 2015-10-05T11:42:09.417+0100 [conn553] end connection 172.28.0.164:49389 (491 connections now open) 2015-10-05T11:42:09.418+0100 [conn578] end connection 172.28.0.164:49418 (489 connections now open) 2015-10-05T11:42:09.418+0100 [conn580] end connection 172.28.0.164:49420 (489 connections now open) 2015-10-05T11:42:09.418+0100 [conn576] end connection 172.28.0.164:49416 (489 connections now open) 2015-10-05T11:42:09.418+0100 [conn575] end connection 172.28.0.164:49415 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn581] end connection 172.28.0.164:49421 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn577] end connection 172.28.0.164:49417 (485 connections now open) 2015-10-05T11:42:09.418+0100 [conn1166] end connection 172.28.0.164:51989 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn579] end connection 172.28.0.164:49419 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn582] end connection 172.28.0.164:49422 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn584] end connection 172.28.0.164:49424 (486 connections now open) 2015-10-05T11:42:09.418+0100 [conn585] end connection 172.28.0.164:49425 (486 connections now open) 2015-10-05T11:42:10.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612540212deab02e2988b41 2015-10-05T11:42:10.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:28.371+0100 [mongosMain] connection accepted from 127.0.0.1:58465 #1168 (480 connections now open) 2015-10-05T11:42:28.375+0100 [conn1168] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:42:28.376+0100 [conn1168] end connection 127.0.0.1:58465 (479 connections now open) 2015-10-05T11:42:29.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612541512deab02e2988c68 2015-10-05T11:42:29.411+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:29.947+0100 [conn504] end connection 172.28.0.163:55321 (478 connections now open) 2015-10-05T11:42:29.951+0100 [mongosMain] connection accepted from 172.28.0.163:58466 #1169 (479 connections now open) 2015-10-05T11:42:29.988+0100 [conn1169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:42:30.106+0100 [conn529] end connection 172.28.0.163:55394 (478 connections now open) 2015-10-05T11:42:37.464+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:42:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:42:40.158+0100 [mongosMain] connection accepted from 127.0.0.1:58471 #1170 (479 connections now open) 2015-10-05T11:42:40.161+0100 [conn1170] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:42:40.161+0100 [conn1170] end connection 127.0.0.1:58471 (478 connections now open) 2015-10-05T11:42:42.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612542112deab02e2988d17 2015-10-05T11:42:42.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:48.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612542812deab02e2988d8f 2015-10-05T11:42:49.085+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:52.021+0100 [conn280] end connection 172.28.0.163:53693 (477 connections now open) 2015-10-05T11:42:52.023+0100 [mongosMain] connection accepted from 172.28.0.163:58487 #1171 (478 connections now open) 2015-10-05T11:42:52.025+0100 [conn1171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:42:55.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612542f12deab02e2988dea 2015-10-05T11:42:55.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:42:58.308+0100 [conn232] end connection 172.28.0.163:53385 (477 connections now open) 2015-10-05T11:42:58.311+0100 [mongosMain] connection accepted from 172.28.0.163:58496 #1172 (478 connections now open) 2015-10-05T11:42:58.311+0100 [conn226] end connection 172.28.0.163:53371 (476 connections now open) 2015-10-05T11:42:58.312+0100 [mongosMain] connection accepted from 172.28.0.163:58497 #1173 (478 connections now open) 2015-10-05T11:42:58.313+0100 [conn1172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:42:58.313+0100 [conn1173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:03.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612543512deab02e2988e41 2015-10-05T11:43:03.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:43:07.724+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:43:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:43:10.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612543d12deab02e2988ed1 2015-10-05T11:43:10.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:43:16.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612544412deab02e2988f2d 2015-10-05T11:43:16.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:43:19.646+0100 [conn359] end connection 172.28.0.163:54771 (477 connections now open) 2015-10-05T11:43:19.647+0100 [mongosMain] connection accepted from 172.28.0.163:58524 #1174 (478 connections now open) 2015-10-05T11:43:19.649+0100 [conn1174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:19.683+0100 [conn480] end connection 172.28.0.163:54975 (477 connections now open) 2015-10-05T11:43:19.685+0100 [mongosMain] connection accepted from 172.28.0.163:58525 #1175 (478 connections now open) 2015-10-05T11:43:19.686+0100 [conn1175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:19.692+0100 [conn386] end connection 172.28.0.163:54809 (477 connections now open) 2015-10-05T11:43:19.693+0100 [mongosMain] connection accepted from 172.28.0.163:58526 #1176 (478 connections now open) 2015-10-05T11:43:19.694+0100 [conn1176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:20.353+0100 [conn381] end connection 172.28.0.163:54799 (477 connections now open) 2015-10-05T11:43:20.354+0100 [mongosMain] connection accepted from 172.28.0.163:58527 #1177 (478 connections now open) 2015-10-05T11:43:20.355+0100 [conn1177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.456+0100 [conn391] end connection 172.28.0.163:54816 (477 connections now open) 2015-10-05T11:43:22.457+0100 [mongosMain] connection accepted from 172.28.0.163:58530 #1178 (478 connections now open) 2015-10-05T11:43:22.458+0100 [conn1178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.520+0100 [conn462] end connection 172.28.0.163:54936 (477 connections now open) 2015-10-05T11:43:22.521+0100 [mongosMain] connection accepted from 172.28.0.163:58531 #1179 (478 connections now open) 2015-10-05T11:43:22.523+0100 [conn1179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.563+0100 [conn487] end connection 172.28.0.163:55009 (477 connections now open) 2015-10-05T11:43:22.565+0100 [mongosMain] connection accepted from 172.28.0.163:58532 #1180 (478 connections now open) 2015-10-05T11:43:22.566+0100 [conn1180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.578+0100 [conn367] end connection 172.28.0.163:54780 (477 connections now open) 2015-10-05T11:43:22.579+0100 [mongosMain] connection accepted from 172.28.0.163:58533 #1181 (478 connections now open) 2015-10-05T11:43:22.581+0100 [conn1181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.583+0100 [conn363] end connection 172.28.0.163:54774 (477 connections now open) 2015-10-05T11:43:22.584+0100 [mongosMain] connection accepted from 172.28.0.163:58534 #1182 (478 connections now open) 2015-10-05T11:43:22.585+0100 [conn1182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.598+0100 [conn438] end connection 172.28.0.163:54899 (477 connections now open) 2015-10-05T11:43:22.598+0100 [conn379] end connection 172.28.0.163:54798 (477 connections now open) 2015-10-05T11:43:22.600+0100 [mongosMain] connection accepted from 172.28.0.163:58536 #1183 (477 connections now open) 2015-10-05T11:43:22.600+0100 [conn484] end connection 172.28.0.163:55006 (476 connections now open) 2015-10-05T11:43:22.600+0100 [mongosMain] connection accepted from 172.28.0.163:58535 #1184 (477 connections now open) 2015-10-05T11:43:22.601+0100 [mongosMain] connection accepted from 172.28.0.163:58537 #1185 (478 connections now open) 2015-10-05T11:43:22.602+0100 [conn1183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.602+0100 [conn1184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.602+0100 [conn1185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.645+0100 [conn343] end connection 172.28.0.163:54742 (477 connections now open) 2015-10-05T11:43:22.646+0100 [mongosMain] connection accepted from 172.28.0.163:58538 #1186 (478 connections now open) 2015-10-05T11:43:22.648+0100 [conn1186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.678+0100 [conn466] end connection 172.28.0.163:54941 (477 connections now open) 2015-10-05T11:43:22.679+0100 [mongosMain] connection accepted from 172.28.0.163:58539 #1187 (478 connections now open) 2015-10-05T11:43:22.681+0100 [conn1187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.696+0100 [conn407] end connection 172.28.0.163:54855 (477 connections now open) 2015-10-05T11:43:22.696+0100 [conn443] end connection 172.28.0.163:54906 (476 connections now open) 2015-10-05T11:43:22.697+0100 [mongosMain] connection accepted from 172.28.0.163:58540 #1188 (477 connections now open) 2015-10-05T11:43:22.698+0100 [mongosMain] connection accepted from 172.28.0.163:58541 #1189 (478 connections now open) 2015-10-05T11:43:22.699+0100 [conn1188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.699+0100 [conn1189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.730+0100 [conn332] end connection 172.28.0.163:54729 (477 connections now open) 2015-10-05T11:43:22.731+0100 [mongosMain] connection accepted from 172.28.0.163:58542 #1190 (478 connections now open) 2015-10-05T11:43:22.733+0100 [conn1190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.747+0100 [conn434] end connection 172.28.0.163:54893 (477 connections now open) 2015-10-05T11:43:22.748+0100 [mongosMain] connection accepted from 172.28.0.163:58543 #1191 (478 connections now open) 2015-10-05T11:43:22.750+0100 [conn1191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.757+0100 [conn387] end connection 172.28.0.163:54810 (477 connections now open) 2015-10-05T11:43:22.758+0100 [mongosMain] connection accepted from 172.28.0.163:58544 #1192 (478 connections now open) 2015-10-05T11:43:22.760+0100 [conn1192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.763+0100 [conn412] end connection 172.28.0.163:54862 (477 connections now open) 2015-10-05T11:43:22.764+0100 [mongosMain] connection accepted from 172.28.0.163:58545 #1193 (478 connections now open) 2015-10-05T11:43:22.765+0100 [conn1193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.780+0100 [conn442] end connection 172.28.0.163:54904 (477 connections now open) 2015-10-05T11:43:22.782+0100 [mongosMain] connection accepted from 172.28.0.163:58546 #1194 (478 connections now open) 2015-10-05T11:43:22.783+0100 [conn1194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.783+0100 [conn382] end connection 172.28.0.163:54802 (477 connections now open) 2015-10-05T11:43:22.785+0100 [mongosMain] connection accepted from 172.28.0.163:58547 #1195 (478 connections now open) 2015-10-05T11:43:22.786+0100 [conn1195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.798+0100 [conn372] end connection 172.28.0.163:54788 (477 connections now open) 2015-10-05T11:43:22.799+0100 [mongosMain] connection accepted from 172.28.0.163:58548 #1196 (478 connections now open) 2015-10-05T11:43:22.801+0100 [conn1196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.853+0100 [conn473] end connection 172.28.0.163:54950 (477 connections now open) 2015-10-05T11:43:22.854+0100 [mongosMain] connection accepted from 172.28.0.163:58549 #1197 (478 connections now open) 2015-10-05T11:43:22.857+0100 [conn1197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.863+0100 [conn328] end connection 172.28.0.163:54726 (477 connections now open) 2015-10-05T11:43:22.865+0100 [mongosMain] connection accepted from 172.28.0.163:58550 #1198 (478 connections now open) 2015-10-05T11:43:22.867+0100 [conn1198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.940+0100 [conn488] end connection 172.28.0.163:55010 (477 connections now open) 2015-10-05T11:43:22.940+0100 [conn490] end connection 172.28.0.163:55012 (477 connections now open) 2015-10-05T11:43:22.941+0100 [mongosMain] connection accepted from 172.28.0.163:58551 #1199 (477 connections now open) 2015-10-05T11:43:22.941+0100 [mongosMain] connection accepted from 172.28.0.163:58552 #1200 (478 connections now open) 2015-10-05T11:43:22.943+0100 [conn1200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.943+0100 [conn1199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:22.982+0100 [conn464] end connection 172.28.0.163:54938 (477 connections now open) 2015-10-05T11:43:22.983+0100 [mongosMain] connection accepted from 172.28.0.163:58553 #1201 (478 connections now open) 2015-10-05T11:43:22.985+0100 [conn1201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.012+0100 [conn494] end connection 172.28.0.163:55016 (477 connections now open) 2015-10-05T11:43:23.012+0100 [conn441] end connection 172.28.0.163:54903 (476 connections now open) 2015-10-05T11:43:23.013+0100 [mongosMain] connection accepted from 172.28.0.163:58554 #1202 (477 connections now open) 2015-10-05T11:43:23.013+0100 [mongosMain] connection accepted from 172.28.0.163:58555 #1203 (478 connections now open) 2015-10-05T11:43:23.014+0100 [conn1202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.014+0100 [conn1203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.023+0100 [conn476] end connection 172.28.0.163:54952 (477 connections now open) 2015-10-05T11:43:23.024+0100 [mongosMain] connection accepted from 172.28.0.163:58556 #1204 (478 connections now open) 2015-10-05T11:43:23.025+0100 [conn1204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.032+0100 [conn335] end connection 172.28.0.163:54733 (477 connections now open) 2015-10-05T11:43:23.033+0100 [mongosMain] connection accepted from 172.28.0.163:58557 #1205 (478 connections now open) 2015-10-05T11:43:23.034+0100 [conn1205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.073+0100 [conn498] end connection 172.28.0.163:55020 (477 connections now open) 2015-10-05T11:43:23.074+0100 [mongosMain] connection accepted from 172.28.0.163:58558 #1206 (478 connections now open) 2015-10-05T11:43:23.076+0100 [conn1206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.122+0100 [conn444] end connection 172.28.0.163:54909 (477 connections now open) 2015-10-05T11:43:23.123+0100 [mongosMain] connection accepted from 172.28.0.163:58559 #1207 (478 connections now open) 2015-10-05T11:43:23.125+0100 [conn1207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.150+0100 [conn448] end connection 172.28.0.163:54914 (477 connections now open) 2015-10-05T11:43:23.152+0100 [mongosMain] connection accepted from 172.28.0.163:58560 #1208 (478 connections now open) 2015-10-05T11:43:23.154+0100 [conn1208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.159+0100 [conn353] end connection 172.28.0.163:54758 (477 connections now open) 2015-10-05T11:43:23.160+0100 [mongosMain] connection accepted from 172.28.0.163:58561 #1209 (478 connections now open) 2015-10-05T11:43:23.162+0100 [conn1209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.185+0100 [conn354] end connection 172.28.0.163:54762 (477 connections now open) 2015-10-05T11:43:23.186+0100 [mongosMain] connection accepted from 172.28.0.163:58562 #1210 (478 connections now open) 2015-10-05T11:43:23.187+0100 [conn1210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.213+0100 [conn357] end connection 172.28.0.163:54769 (477 connections now open) 2015-10-05T11:43:23.214+0100 [mongosMain] connection accepted from 172.28.0.163:58563 #1211 (478 connections now open) 2015-10-05T11:43:23.216+0100 [conn1211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.246+0100 [conn420] end connection 172.28.0.163:54872 (477 connections now open) 2015-10-05T11:43:23.247+0100 [mongosMain] connection accepted from 172.28.0.163:58564 #1212 (478 connections now open) 2015-10-05T11:43:23.249+0100 [conn1212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.282+0100 [conn463] end connection 172.28.0.163:54937 (477 connections now open) 2015-10-05T11:43:23.283+0100 [mongosMain] connection accepted from 172.28.0.163:58565 #1213 (478 connections now open) 2015-10-05T11:43:23.285+0100 [conn1213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.297+0100 [conn350] end connection 172.28.0.163:54752 (477 connections now open) 2015-10-05T11:43:23.298+0100 [mongosMain] connection accepted from 172.28.0.163:58566 #1214 (478 connections now open) 2015-10-05T11:43:23.298+0100 [conn348] end connection 172.28.0.163:54748 (476 connections now open) 2015-10-05T11:43:23.300+0100 [mongosMain] connection accepted from 172.28.0.163:58567 #1215 (478 connections now open) 2015-10-05T11:43:23.301+0100 [conn1214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.302+0100 [conn1215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.303+0100 [conn486] end connection 172.28.0.163:55007 (477 connections now open) 2015-10-05T11:43:23.305+0100 [mongosMain] connection accepted from 172.28.0.163:58568 #1216 (478 connections now open) 2015-10-05T11:43:23.306+0100 [conn1216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.312+0100 [conn329] end connection 172.28.0.163:54727 (477 connections now open) 2015-10-05T11:43:23.313+0100 [mongosMain] connection accepted from 172.28.0.163:58569 #1217 (478 connections now open) 2015-10-05T11:43:23.315+0100 [conn1217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.330+0100 [conn333] end connection 172.28.0.163:54730 (477 connections now open) 2015-10-05T11:43:23.331+0100 [mongosMain] connection accepted from 172.28.0.163:58570 #1218 (478 connections now open) 2015-10-05T11:43:23.333+0100 [conn1218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.442+0100 [conn346] end connection 172.28.0.163:54746 (477 connections now open) 2015-10-05T11:43:23.443+0100 [mongosMain] connection accepted from 172.28.0.163:58571 #1219 (478 connections now open) 2015-10-05T11:43:23.445+0100 [conn1219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:23.482+0100 [conn395] end connection 172.28.0.163:54827 (477 connections now open) 2015-10-05T11:43:23.483+0100 [mongosMain] connection accepted from 172.28.0.163:58572 #1220 (478 connections now open) 2015-10-05T11:43:23.485+0100 [conn1220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:24.402+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:43:24.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:43:24.987+0100 [conn337] end connection 172.28.0.163:54735 (477 connections now open) 2015-10-05T11:43:24.988+0100 [mongosMain] connection accepted from 172.28.0.163:58574 #1221 (478 connections now open) 2015-10-05T11:43:24.990+0100 [conn1221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.001+0100 [conn397] end connection 172.28.0.163:54831 (477 connections now open) 2015-10-05T11:43:25.002+0100 [mongosMain] connection accepted from 172.28.0.163:58575 #1222 (478 connections now open) 2015-10-05T11:43:25.004+0100 [conn1222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.028+0100 [conn364] end connection 172.28.0.163:54777 (477 connections now open) 2015-10-05T11:43:25.030+0100 [mongosMain] connection accepted from 172.28.0.163:58576 #1223 (478 connections now open) 2015-10-05T11:43:25.054+0100 [conn1223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.070+0100 [conn383] end connection 172.28.0.163:54804 (477 connections now open) 2015-10-05T11:43:25.071+0100 [mongosMain] connection accepted from 172.28.0.163:58577 #1224 (478 connections now open) 2015-10-05T11:43:25.074+0100 [conn1224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.217+0100 [conn478] end connection 172.28.0.163:54960 (477 connections now open) 2015-10-05T11:43:25.223+0100 [mongosMain] connection accepted from 172.28.0.163:58578 #1225 (478 connections now open) 2015-10-05T11:43:25.226+0100 [conn1225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.231+0100 [conn361] end connection 172.28.0.163:54775 (477 connections now open) 2015-10-05T11:43:25.232+0100 [mongosMain] connection accepted from 172.28.0.163:58579 #1226 (478 connections now open) 2015-10-05T11:43:25.232+0100 [conn431] end connection 172.28.0.163:54886 (477 connections now open) 2015-10-05T11:43:25.233+0100 [mongosMain] connection accepted from 172.28.0.163:58580 #1227 (478 connections now open) 2015-10-05T11:43:25.234+0100 [conn1226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.234+0100 [conn1227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.268+0100 [conn323] end connection 172.28.0.163:54721 (477 connections now open) 2015-10-05T11:43:25.269+0100 [mongosMain] connection accepted from 172.28.0.163:58581 #1228 (478 connections now open) 2015-10-05T11:43:25.270+0100 [conn1228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.336+0100 [conn417] end connection 172.28.0.163:54869 (477 connections now open) 2015-10-05T11:43:25.337+0100 [mongosMain] connection accepted from 172.28.0.163:58582 #1229 (478 connections now open) 2015-10-05T11:43:25.338+0100 [conn1229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:25.376+0100 [conn384] end connection 172.28.0.163:54805 (477 connections now open) 2015-10-05T11:43:25.377+0100 [mongosMain] connection accepted from 172.28.0.163:58583 #1230 (478 connections now open) 2015-10-05T11:43:25.379+0100 [conn1230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:29.164+0100 [mongosMain] connection accepted from 127.0.0.1:58589 #1231 (479 connections now open) 2015-10-05T11:43:29.167+0100 [conn1231] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:29.168+0100 [conn1231] end connection 127.0.0.1:58589 (478 connections now open) 2015-10-05T11:43:29.995+0100 [conn3] end connection 172.28.0.163:52228 (477 connections now open) 2015-10-05T11:43:30.012+0100 [mongosMain] connection accepted from 172.28.0.163:58590 #1232 (478 connections now open) 2015-10-05T11:43:30.014+0100 [conn1232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:30.120+0100 [conn376] end connection 172.28.0.163:54792 (477 connections now open) 2015-10-05T11:43:30.474+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:43:30.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:43:37.868+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:43:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:43:40.068+0100 [mongosMain] connection accepted from 127.0.0.1:58592 #1233 (478 connections now open) 2015-10-05T11:43:40.068+0100 [conn1233] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:40.068+0100 [conn1233] end connection 127.0.0.1:58592 (477 connections now open) 2015-10-05T11:43:42.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612545e12deab02e2989088 2015-10-05T11:43:42.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:43:56.183+0100 [conn423] end connection 172.28.0.163:54878 (476 connections now open) 2015-10-05T11:43:56.183+0100 [mongosMain] connection accepted from 172.28.0.163:58614 #1234 (477 connections now open) 2015-10-05T11:43:56.183+0100 [conn1234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.245+0100 [conn342] end connection 172.28.0.163:54740 (476 connections now open) 2015-10-05T11:43:56.245+0100 [mongosMain] connection accepted from 172.28.0.163:58616 #1235 (477 connections now open) 2015-10-05T11:43:56.245+0100 [conn389] end connection 172.28.0.163:54813 (476 connections now open) 2015-10-05T11:43:56.245+0100 [mongosMain] connection accepted from 172.28.0.163:58617 #1236 (477 connections now open) 2015-10-05T11:43:56.245+0100 [conn1235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.261+0100 [conn1236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.276+0100 [conn445] end connection 172.28.0.163:54910 (476 connections now open) 2015-10-05T11:43:56.276+0100 [mongosMain] connection accepted from 172.28.0.163:58618 #1237 (477 connections now open) 2015-10-05T11:43:56.276+0100 [conn1237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.386+0100 [conn390] end connection 172.28.0.163:54815 (476 connections now open) 2015-10-05T11:43:56.401+0100 [mongosMain] connection accepted from 172.28.0.163:58619 #1238 (477 connections now open) 2015-10-05T11:43:56.401+0100 [conn1238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.401+0100 [conn338] end connection 172.28.0.163:54736 (476 connections now open) 2015-10-05T11:43:56.401+0100 [mongosMain] connection accepted from 172.28.0.163:58620 #1239 (477 connections now open) 2015-10-05T11:43:56.401+0100 [conn1239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.417+0100 [conn416] end connection 172.28.0.163:54868 (476 connections now open) 2015-10-05T11:43:56.417+0100 [mongosMain] connection accepted from 172.28.0.163:58621 #1240 (477 connections now open) 2015-10-05T11:43:56.417+0100 [conn1240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.432+0100 [conn365] end connection 172.28.0.163:54778 (476 connections now open) 2015-10-05T11:43:56.432+0100 [mongosMain] connection accepted from 172.28.0.163:58622 #1241 (477 connections now open) 2015-10-05T11:43:56.432+0100 [conn1241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.448+0100 [conn425] end connection 172.28.0.163:54881 (476 connections now open) 2015-10-05T11:43:56.448+0100 [mongosMain] connection accepted from 172.28.0.163:58623 #1242 (477 connections now open) 2015-10-05T11:43:56.448+0100 [conn1242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.479+0100 [conn455] end connection 172.28.0.163:54923 (476 connections now open) 2015-10-05T11:43:56.479+0100 [mongosMain] connection accepted from 172.28.0.163:58624 #1243 (477 connections now open) 2015-10-05T11:43:56.479+0100 [conn1243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.495+0100 [conn440] end connection 172.28.0.163:54902 (476 connections now open) 2015-10-05T11:43:56.495+0100 [mongosMain] connection accepted from 172.28.0.163:58625 #1244 (477 connections now open) 2015-10-05T11:43:56.495+0100 [conn1244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:43:56.510+0100 [conn449] end connection 172.28.0.163:54915 (476 connections now open) 2015-10-05T11:43:56.510+0100 [mongosMain] connection accepted from 172.28.0.163:58626 #1245 (477 connections now open) 2015-10-05T11:43:56.510+0100 [conn1245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:02.359+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:44:02.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:44:03.893+0100 [conn521] end connection 172.28.0.163:55382 (476 connections now open) 2015-10-05T11:44:03.893+0100 [mongosMain] connection accepted from 172.28.0.163:58644 #1246 (477 connections now open) 2015-10-05T11:44:03.893+0100 [conn1246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:05.563+0100 [conn517] end connection 172.28.0.163:55378 (476 connections now open) 2015-10-05T11:44:05.563+0100 [mongosMain] connection accepted from 172.28.0.163:58648 #1247 (477 connections now open) 2015-10-05T11:44:05.578+0100 [conn1247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:08.339+0100 [conn506] end connection 172.28.0.163:55326 (476 connections now open) 2015-10-05T11:44:08.339+0100 [mongosMain] connection accepted from 172.28.0.163:58653 #1248 (477 connections now open) 2015-10-05T11:44:08.339+0100 [conn1248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:08.886+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:44:08.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:44:08.964+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:44:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:44:15.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612547e12deab02e2989228 2015-10-05T11:44:15.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:44:27.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612548b12deab02e29892da 2015-10-05T11:44:27.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:44:28.380+0100 [mongosMain] connection accepted from 127.0.0.1:58672 #1249 (478 connections now open) 2015-10-05T11:44:28.383+0100 [conn1249] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:28.384+0100 [conn1249] end connection 127.0.0.1:58672 (477 connections now open) 2015-10-05T11:44:29.670+0100 [conn515] end connection 172.28.0.163:55375 (476 connections now open) 2015-10-05T11:44:29.670+0100 [conn533] end connection 172.28.0.163:55418 (475 connections now open) 2015-10-05T11:44:29.671+0100 [mongosMain] connection accepted from 172.28.0.163:58673 #1250 (476 connections now open) 2015-10-05T11:44:29.671+0100 [mongosMain] connection accepted from 172.28.0.163:58674 #1251 (477 connections now open) 2015-10-05T11:44:29.672+0100 [conn1250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:29.672+0100 [conn1251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:29.742+0100 [conn513] end connection 172.28.0.163:55343 (476 connections now open) 2015-10-05T11:44:29.743+0100 [mongosMain] connection accepted from 172.28.0.163:58675 #1252 (477 connections now open) 2015-10-05T11:44:29.745+0100 [conn1252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:30.024+0100 [conn507] end connection 172.28.0.163:55330 (476 connections now open) 2015-10-05T11:44:30.025+0100 [mongosMain] connection accepted from 172.28.0.163:58676 #1253 (477 connections now open) 2015-10-05T11:44:30.027+0100 [conn1253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:30.133+0100 [conn531] end connection 172.28.0.163:55414 (476 connections now open) 2015-10-05T11:44:37.160+0100 [conn514] end connection 172.28.0.163:55373 (475 connections now open) 2015-10-05T11:44:37.160+0100 [mongosMain] connection accepted from 172.28.0.163:58683 #1254 (476 connections now open) 2015-10-05T11:44:37.160+0100 [conn1254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:39.077+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:44:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:44:40.117+0100 [mongosMain] connection accepted from 127.0.0.1:58685 #1255 (477 connections now open) 2015-10-05T11:44:40.121+0100 [conn1255] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:44:40.121+0100 [conn1255] end connection 127.0.0.1:58685 (476 connections now open) 2015-10-05T11:44:41.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612549812deab02e2989392 2015-10-05T11:44:41.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:44:47.683+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612549f12deab02e29893f6 2015-10-05T11:44:47.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:45:00.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561254ab12deab02e2989495 2015-10-05T11:45:00.322+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:45:06.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561254b212deab02e29894fb 2015-10-05T11:45:06.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:45:09.345+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:45:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:45:14.072+0100 [mongosMain] connection accepted from 172.28.0.164:52170 #1256 (477 connections now open) 2015-10-05T11:45:14.112+0100 [mongosMain] connection accepted from 172.28.0.164:52171 #1257 (478 connections now open) 2015-10-05T11:45:14.475+0100 [conn1257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.479+0100 [conn1256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.485+0100 [mongosMain] connection accepted from 172.28.0.164:52175 #1258 (479 connections now open) 2015-10-05T11:45:14.488+0100 [conn1258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.490+0100 [mongosMain] connection accepted from 172.28.0.164:52178 #1259 (480 connections now open) 2015-10-05T11:45:14.493+0100 [conn1259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.513+0100 [mongosMain] connection accepted from 172.28.0.164:52181 #1260 (481 connections now open) 2015-10-05T11:45:14.516+0100 [conn1260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.519+0100 [mongosMain] connection accepted from 172.28.0.164:52184 #1261 (482 connections now open) 2015-10-05T11:45:14.521+0100 [conn1261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.523+0100 [mongosMain] connection accepted from 172.28.0.164:52187 #1262 (483 connections now open) 2015-10-05T11:45:14.525+0100 [conn1262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.528+0100 [mongosMain] connection accepted from 172.28.0.164:52190 #1263 (484 connections now open) 2015-10-05T11:45:14.530+0100 [conn1263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.532+0100 [mongosMain] connection accepted from 172.28.0.164:52193 #1264 (485 connections now open) 2015-10-05T11:45:14.535+0100 [conn1264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.537+0100 [mongosMain] connection accepted from 172.28.0.164:52196 #1265 (486 connections now open) 2015-10-05T11:45:14.540+0100 [conn1265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.542+0100 [mongosMain] connection accepted from 172.28.0.164:52199 #1266 (487 connections now open) 2015-10-05T11:45:14.544+0100 [conn1266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.546+0100 [mongosMain] connection accepted from 172.28.0.164:52203 #1267 (488 connections now open) 2015-10-05T11:45:14.549+0100 [conn1267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.552+0100 [mongosMain] connection accepted from 172.28.0.164:52206 #1268 (489 connections now open) 2015-10-05T11:45:14.554+0100 [conn1268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.557+0100 [mongosMain] connection accepted from 172.28.0.164:52209 #1269 (490 connections now open) 2015-10-05T11:45:14.560+0100 [conn1269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.562+0100 [mongosMain] connection accepted from 172.28.0.164:52213 #1270 (491 connections now open) 2015-10-05T11:45:14.565+0100 [conn1270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.568+0100 [mongosMain] connection accepted from 172.28.0.164:52216 #1271 (492 connections now open) 2015-10-05T11:45:14.571+0100 [conn1271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.573+0100 [mongosMain] connection accepted from 172.28.0.164:52220 #1272 (493 connections now open) 2015-10-05T11:45:14.576+0100 [conn1272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.579+0100 [mongosMain] connection accepted from 172.28.0.164:52223 #1273 (494 connections now open) 2015-10-05T11:45:14.581+0100 [conn1273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.584+0100 [mongosMain] connection accepted from 172.28.0.164:52226 #1274 (495 connections now open) 2015-10-05T11:45:14.587+0100 [conn1274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.590+0100 [mongosMain] connection accepted from 172.28.0.164:52230 #1275 (496 connections now open) 2015-10-05T11:45:14.593+0100 [conn1275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.595+0100 [mongosMain] connection accepted from 172.28.0.164:52233 #1276 (497 connections now open) 2015-10-05T11:45:14.598+0100 [conn1276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.601+0100 [mongosMain] connection accepted from 172.28.0.164:52237 #1277 (498 connections now open) 2015-10-05T11:45:14.604+0100 [conn1277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.607+0100 [mongosMain] connection accepted from 172.28.0.164:52240 #1278 (499 connections now open) 2015-10-05T11:45:14.610+0100 [conn1278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.613+0100 [mongosMain] connection accepted from 172.28.0.164:52244 #1279 (500 connections now open) 2015-10-05T11:45:14.616+0100 [conn1279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.618+0100 [mongosMain] connection accepted from 172.28.0.164:52245 #1280 (501 connections now open) 2015-10-05T11:45:14.621+0100 [conn1280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.623+0100 [mongosMain] connection accepted from 172.28.0.164:52246 #1281 (502 connections now open) 2015-10-05T11:45:14.626+0100 [conn1281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.629+0100 [mongosMain] connection accepted from 172.28.0.164:52247 #1282 (503 connections now open) 2015-10-05T11:45:14.631+0100 [conn1282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.634+0100 [mongosMain] connection accepted from 172.28.0.164:52248 #1283 (504 connections now open) 2015-10-05T11:45:14.637+0100 [conn1283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.639+0100 [mongosMain] connection accepted from 172.28.0.164:52249 #1284 (505 connections now open) 2015-10-05T11:45:14.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561254b912deab02e298952d 2015-10-05T11:45:14.643+0100 [conn1284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.646+0100 [mongosMain] connection accepted from 172.28.0.164:52250 #1285 (506 connections now open) 2015-10-05T11:45:14.648+0100 [conn1285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.651+0100 [mongosMain] connection accepted from 172.28.0.164:52251 #1286 (507 connections now open) 2015-10-05T11:45:14.654+0100 [conn1286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.657+0100 [mongosMain] connection accepted from 172.28.0.164:52252 #1287 (508 connections now open) 2015-10-05T11:45:14.660+0100 [conn1287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.663+0100 [mongosMain] connection accepted from 172.28.0.164:52253 #1288 (509 connections now open) 2015-10-05T11:45:14.665+0100 [conn1288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.668+0100 [mongosMain] connection accepted from 172.28.0.164:52254 #1289 (510 connections now open) 2015-10-05T11:45:14.671+0100 [conn1289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.673+0100 [mongosMain] connection accepted from 172.28.0.164:52255 #1290 (511 connections now open) 2015-10-05T11:45:14.676+0100 [conn1290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.679+0100 [mongosMain] connection accepted from 172.28.0.164:52256 #1291 (512 connections now open) 2015-10-05T11:45:14.681+0100 [conn1291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.684+0100 [mongosMain] connection accepted from 172.28.0.164:52257 #1292 (513 connections now open) 2015-10-05T11:45:14.686+0100 [conn1292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.689+0100 [mongosMain] connection accepted from 172.28.0.164:52258 #1293 (514 connections now open) 2015-10-05T11:45:14.692+0100 [conn1293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.696+0100 [mongosMain] connection accepted from 172.28.0.164:52259 #1294 (515 connections now open) 2015-10-05T11:45:14.699+0100 [conn1294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.702+0100 [mongosMain] connection accepted from 172.28.0.164:52260 #1295 (516 connections now open) 2015-10-05T11:45:14.705+0100 [conn1295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.707+0100 [mongosMain] connection accepted from 172.28.0.164:52261 #1296 (517 connections now open) 2015-10-05T11:45:14.710+0100 [conn1296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.716+0100 [mongosMain] connection accepted from 172.28.0.164:52262 #1297 (518 connections now open) 2015-10-05T11:45:14.719+0100 [conn1297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.721+0100 [mongosMain] connection accepted from 172.28.0.164:52263 #1298 (519 connections now open) 2015-10-05T11:45:14.724+0100 [conn1298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.727+0100 [mongosMain] connection accepted from 172.28.0.164:52264 #1299 (520 connections now open) 2015-10-05T11:45:14.729+0100 [conn1299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.732+0100 [mongosMain] connection accepted from 172.28.0.164:52265 #1300 (521 connections now open) 2015-10-05T11:45:14.736+0100 [conn1300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.738+0100 [mongosMain] connection accepted from 172.28.0.164:52266 #1301 (522 connections now open) 2015-10-05T11:45:14.740+0100 [conn1301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.743+0100 [mongosMain] connection accepted from 172.28.0.164:52268 #1302 (523 connections now open) 2015-10-05T11:45:14.746+0100 [conn1302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.748+0100 [mongosMain] connection accepted from 172.28.0.164:52269 #1303 (524 connections now open) 2015-10-05T11:45:14.751+0100 [conn1303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.754+0100 [mongosMain] connection accepted from 172.28.0.164:52270 #1304 (525 connections now open) 2015-10-05T11:45:14.756+0100 [conn1304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.759+0100 [mongosMain] connection accepted from 172.28.0.164:52271 #1305 (526 connections now open) 2015-10-05T11:45:14.761+0100 [conn1305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.763+0100 [mongosMain] connection accepted from 172.28.0.164:52272 #1306 (527 connections now open) 2015-10-05T11:45:14.766+0100 [conn1306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:14.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:45:20.958+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561254c012deab02e298956b 2015-10-05T11:45:21.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:45:28.604+0100 [mongosMain] connection accepted from 127.0.0.1:58835 #1307 (528 connections now open) 2015-10-05T11:45:28.607+0100 [conn1307] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:28.608+0100 [conn1307] end connection 127.0.0.1:58835 (527 connections now open) 2015-10-05T11:45:30.048+0100 [conn11] end connection 172.28.0.163:52246 (526 connections now open) 2015-10-05T11:45:30.053+0100 [mongosMain] connection accepted from 172.28.0.163:58836 #1308 (527 connections now open) 2015-10-05T11:45:30.055+0100 [conn1308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:30.199+0100 [conn526] end connection 172.28.0.163:55390 (526 connections now open) 2015-10-05T11:45:34.784+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:45:34.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:45:39.626+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:45:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:45:40.091+0100 [mongosMain] connection accepted from 127.0.0.1:58843 #1309 (527 connections now open) 2015-10-05T11:45:40.093+0100 [conn1309] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:45:40.094+0100 [conn1309] end connection 127.0.0.1:58843 (526 connections now open) 2015-10-05T11:45:42.264+0100 [mongosMain] connection accepted from 172.28.0.164:52320 #1310 (527 connections now open) 2015-10-05T11:45:42.265+0100 [mongosMain] connection accepted from 172.28.0.164:52321 #1311 (528 connections now open) 2015-10-05T11:45:46.876+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:45:46.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:45:53.037+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:45:53.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:45:59.204+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:45:59.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:46:05.323+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:46:05.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:46:09.767+0100 [conn1311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:46:09.923+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:46:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:46:11.561+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:46:11.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:46:23.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561254ff12deab02e298972d 2015-10-05T11:46:23.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:46:29.055+0100 [mongosMain] connection accepted from 127.0.0.1:58891 #1312 (529 connections now open) 2015-10-05T11:46:29.057+0100 [conn1312] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:46:29.058+0100 [conn1312] end connection 127.0.0.1:58891 (528 connections now open) 2015-10-05T11:46:30.046+0100 [conn4] end connection 172.28.0.163:52229 (527 connections now open) 2015-10-05T11:46:30.048+0100 [mongosMain] connection accepted from 172.28.0.163:58892 #1313 (528 connections now open) 2015-10-05T11:46:30.050+0100 [conn1313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:46:30.237+0100 [conn52] end connection 172.28.0.163:52351 (527 connections now open) 2015-10-05T11:46:39.204+0100 [mongosMain] connection accepted from 127.0.0.1:58900 #1314 (528 connections now open) 2015-10-05T11:46:39.204+0100 [conn1314] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:46:39.204+0100 [conn1314] end connection 127.0.0.1:58900 (527 connections now open) 2015-10-05T11:46:40.062+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:46:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:46:48.060+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:46:48.060+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:46:54.202+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:46:54.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:47:00.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612552412deab02e2989835 2015-10-05T11:47:00.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:06.269+0100 [conn1310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:47:06.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612552a12deab02e298985a 2015-10-05T11:47:06.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:10.184+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:47:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:47:13.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612553012deab02e298986f 2015-10-05T11:47:13.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:19.554+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612553712deab02e2989898 2015-10-05T11:47:19.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:25.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612553d12deab02e29898c3 2015-10-05T11:47:26.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:28.738+0100 [mongosMain] connection accepted from 127.0.0.1:58962 #1315 (528 connections now open) 2015-10-05T11:47:28.741+0100 [conn1315] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:47:28.742+0100 [conn1315] end connection 127.0.0.1:58962 (527 connections now open) 2015-10-05T11:47:30.050+0100 [conn274] end connection 172.28.0.163:53654 (526 connections now open) 2015-10-05T11:47:30.051+0100 [mongosMain] connection accepted from 172.28.0.163:58963 #1316 (527 connections now open) 2015-10-05T11:47:30.053+0100 [conn1316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:47:30.237+0100 [conn18] end connection 172.28.0.163:52275 (526 connections now open) 2015-10-05T11:47:32.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612554412deab02e29898ee 2015-10-05T11:47:32.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:38.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612554a12deab02e2989925 2015-10-05T11:47:38.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:40.152+0100 [mongosMain] connection accepted from 127.0.0.1:58968 #1317 (527 connections now open) 2015-10-05T11:47:40.155+0100 [conn1317] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:47:40.156+0100 [conn1317] end connection 127.0.0.1:58968 (526 connections now open) 2015-10-05T11:47:40.431+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:47:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:47:45.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612555012deab02e2989951 2015-10-05T11:47:45.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:51.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612555712deab02e2989978 2015-10-05T11:47:51.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:47:57.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612555d12deab02e29899a3 2015-10-05T11:47:57.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:04.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612556312deab02e29899c3 2015-10-05T11:48:04.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:08.260+0100 [mongosMain] connection accepted from 172.28.0.164:52429 #1318 (527 connections now open) 2015-10-05T11:48:08.262+0100 [conn1318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:10.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612556a12deab02e29899ec 2015-10-05T11:48:10.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:10.751+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:48:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:48:17.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612557012deab02e2989a2d 2015-10-05T11:48:17.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:23.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612557712deab02e2989a62 2015-10-05T11:48:23.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:28.553+0100 [mongosMain] connection accepted from 127.0.0.1:59035 #1319 (528 connections now open) 2015-10-05T11:48:28.556+0100 [conn1319] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:28.557+0100 [conn1319] end connection 127.0.0.1:59035 (527 connections now open) 2015-10-05T11:48:30.099+0100 [conn201] end connection 172.28.0.163:52872 (526 connections now open) 2015-10-05T11:48:30.100+0100 [mongosMain] connection accepted from 172.28.0.163:59036 #1320 (527 connections now open) 2015-10-05T11:48:30.101+0100 [conn1320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:30.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612557d12deab02e2989a95 2015-10-05T11:48:30.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:30.287+0100 [conn102] end connection 172.28.0.163:52454 (526 connections now open) 2015-10-05T11:48:36.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612558412deab02e2989ac7 2015-10-05T11:48:36.642+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:39.429+0100 [mongosMain] connection accepted from 127.0.0.1:59061 #1321 (527 connections now open) 2015-10-05T11:48:39.433+0100 [conn1321] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:39.433+0100 [conn1321] end connection 127.0.0.1:59061 (526 connections now open) 2015-10-05T11:48:41.030+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:48:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:48:42.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612558a12deab02e2989afa 2015-10-05T11:48:43.045+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:44.796+0100 [mongosMain] connection accepted from 172.28.0.164:52462 #1322 (527 connections now open) 2015-10-05T11:48:44.797+0100 [mongosMain] connection accepted from 172.28.0.164:52463 #1323 (528 connections now open) 2015-10-05T11:48:44.798+0100 [mongosMain] connection accepted from 172.28.0.164:52464 #1324 (529 connections now open) 2015-10-05T11:48:44.798+0100 [mongosMain] connection accepted from 172.28.0.164:52465 #1325 (530 connections now open) 2015-10-05T11:48:44.799+0100 [conn1322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.799+0100 [mongosMain] connection accepted from 172.28.0.164:52466 #1326 (531 connections now open) 2015-10-05T11:48:44.801+0100 [conn1323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.801+0100 [mongosMain] connection accepted from 172.28.0.164:52467 #1327 (532 connections now open) 2015-10-05T11:48:44.801+0100 [mongosMain] connection accepted from 172.28.0.164:52468 #1328 (533 connections now open) 2015-10-05T11:48:44.801+0100 [mongosMain] connection accepted from 172.28.0.164:52469 #1329 (534 connections now open) 2015-10-05T11:48:44.802+0100 [conn1324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.802+0100 [conn1325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.802+0100 [mongosMain] connection accepted from 172.28.0.164:52470 #1330 (535 connections now open) 2015-10-05T11:48:44.803+0100 [mongosMain] connection accepted from 172.28.0.164:52471 #1331 (536 connections now open) 2015-10-05T11:48:44.803+0100 [mongosMain] connection accepted from 172.28.0.164:52472 #1332 (537 connections now open) 2015-10-05T11:48:44.803+0100 [conn1327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.804+0100 [conn1326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.804+0100 [mongosMain] connection accepted from 172.28.0.164:52473 #1333 (538 connections now open) 2015-10-05T11:48:44.804+0100 [mongosMain] connection accepted from 172.28.0.164:52474 #1334 (539 connections now open) 2015-10-05T11:48:44.804+0100 [mongosMain] connection accepted from 172.28.0.164:52476 #1335 (540 connections now open) 2015-10-05T11:48:44.804+0100 [conn1329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.804+0100 [mongosMain] connection accepted from 172.28.0.164:52475 #1336 (541 connections now open) 2015-10-05T11:48:44.805+0100 [conn1328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.805+0100 [mongosMain] connection accepted from 172.28.0.164:52477 #1337 (542 connections now open) 2015-10-05T11:48:44.805+0100 [mongosMain] connection accepted from 172.28.0.164:52478 #1338 (543 connections now open) 2015-10-05T11:48:44.805+0100 [mongosMain] connection accepted from 172.28.0.164:52479 #1339 (544 connections now open) 2015-10-05T11:48:44.805+0100 [conn1330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.805+0100 [conn1331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.806+0100 [mongosMain] connection accepted from 172.28.0.164:52480 #1340 (545 connections now open) 2015-10-05T11:48:44.806+0100 [conn1334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.806+0100 [mongosMain] connection accepted from 172.28.0.164:52481 #1341 (546 connections now open) 2015-10-05T11:48:44.806+0100 [conn1332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.806+0100 [mongosMain] connection accepted from 172.28.0.164:52482 #1342 (547 connections now open) 2015-10-05T11:48:44.807+0100 [mongosMain] connection accepted from 172.28.0.164:52483 #1343 (548 connections now open) 2015-10-05T11:48:44.807+0100 [mongosMain] connection accepted from 172.28.0.164:52485 #1344 (549 connections now open) 2015-10-05T11:48:44.807+0100 [conn1335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.807+0100 [mongosMain] connection accepted from 172.28.0.164:52484 #1345 (550 connections now open) 2015-10-05T11:48:44.807+0100 [conn1337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.807+0100 [conn1338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.807+0100 [mongosMain] connection accepted from 172.28.0.164:52486 #1346 (551 connections now open) 2015-10-05T11:48:44.808+0100 [conn1339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.808+0100 [mongosMain] connection accepted from 172.28.0.164:52487 #1347 (552 connections now open) 2015-10-05T11:48:44.809+0100 [mongosMain] connection accepted from 172.28.0.164:52489 #1348 (553 connections now open) 2015-10-05T11:48:44.809+0100 [mongosMain] connection accepted from 172.28.0.164:52488 #1349 (554 connections now open) 2015-10-05T11:48:44.809+0100 [conn1333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.810+0100 [mongosMain] connection accepted from 172.28.0.164:52490 #1350 (555 connections now open) 2015-10-05T11:48:44.810+0100 [conn1336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.810+0100 [mongosMain] connection accepted from 172.28.0.164:52492 #1351 (556 connections now open) 2015-10-05T11:48:44.811+0100 [mongosMain] connection accepted from 172.28.0.164:52491 #1352 (557 connections now open) 2015-10-05T11:48:44.811+0100 [conn1340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.811+0100 [mongosMain] connection accepted from 172.28.0.164:52494 #1353 (558 connections now open) 2015-10-05T11:48:44.811+0100 [mongosMain] connection accepted from 172.28.0.164:52493 #1354 (559 connections now open) 2015-10-05T11:48:44.812+0100 [mongosMain] connection accepted from 172.28.0.164:52496 #1355 (560 connections now open) 2015-10-05T11:48:44.812+0100 [mongosMain] connection accepted from 172.28.0.164:52495 #1356 (561 connections now open) 2015-10-05T11:48:44.812+0100 [conn1341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.813+0100 [conn1343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.813+0100 [conn1342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.813+0100 [conn1347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.813+0100 [conn1345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.813+0100 [conn1346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.814+0100 [mongosMain] connection accepted from 172.28.0.164:52497 #1357 (562 connections now open) 2015-10-05T11:48:44.814+0100 [mongosMain] connection accepted from 172.28.0.164:52498 #1358 (563 connections now open) 2015-10-05T11:48:44.814+0100 [conn1344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.814+0100 [mongosMain] connection accepted from 172.28.0.164:52499 #1359 (564 connections now open) 2015-10-05T11:48:44.814+0100 [conn1349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.814+0100 [conn1348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.815+0100 [mongosMain] connection accepted from 172.28.0.164:52500 #1360 (565 connections now open) 2015-10-05T11:48:44.815+0100 [conn1350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.815+0100 [conn1354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.815+0100 [mongosMain] connection accepted from 172.28.0.164:52501 #1361 (566 connections now open) 2015-10-05T11:48:44.815+0100 [conn1353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.815+0100 [conn1352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.816+0100 [mongosMain] connection accepted from 172.28.0.164:52502 #1362 (567 connections now open) 2015-10-05T11:48:44.816+0100 [conn1356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.816+0100 [mongosMain] connection accepted from 172.28.0.164:52503 #1363 (568 connections now open) 2015-10-05T11:48:44.816+0100 [conn1357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.816+0100 [conn1355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.816+0100 [conn1358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.816+0100 [mongosMain] connection accepted from 172.28.0.164:52505 #1364 (569 connections now open) 2015-10-05T11:48:44.817+0100 [mongosMain] connection accepted from 172.28.0.164:52504 #1365 (570 connections now open) 2015-10-05T11:48:44.817+0100 [conn1351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.817+0100 [mongosMain] connection accepted from 172.28.0.164:52506 #1366 (571 connections now open) 2015-10-05T11:48:44.817+0100 [conn1359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.817+0100 [mongosMain] connection accepted from 172.28.0.164:52507 #1367 (572 connections now open) 2015-10-05T11:48:44.818+0100 [mongosMain] connection accepted from 172.28.0.164:52509 #1368 (573 connections now open) 2015-10-05T11:48:44.818+0100 [mongosMain] connection accepted from 172.28.0.164:52508 #1369 (574 connections now open) 2015-10-05T11:48:44.818+0100 [mongosMain] connection accepted from 172.28.0.164:52510 #1370 (575 connections now open) 2015-10-05T11:48:44.818+0100 [conn1363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.818+0100 [conn1364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.818+0100 [mongosMain] connection accepted from 172.28.0.164:52511 #1371 (576 connections now open) 2015-10-05T11:48:44.818+0100 [conn1362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.819+0100 [conn1366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.820+0100 [conn1367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.821+0100 [conn1371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.821+0100 [conn1370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.821+0100 [mongosMain] connection accepted from 172.28.0.164:52512 #1372 (577 connections now open) 2015-10-05T11:48:44.821+0100 [conn1368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.821+0100 [conn1369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.822+0100 [conn1360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.822+0100 [mongosMain] connection accepted from 172.28.0.164:52513 #1373 (578 connections now open) 2015-10-05T11:48:44.823+0100 [mongosMain] connection accepted from 172.28.0.164:52514 #1374 (579 connections now open) 2015-10-05T11:48:44.823+0100 [conn1372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.824+0100 [mongosMain] connection accepted from 172.28.0.164:52515 #1375 (580 connections now open) 2015-10-05T11:48:44.826+0100 [conn1375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.826+0100 [mongosMain] connection accepted from 172.28.0.164:52517 #1376 (581 connections now open) 2015-10-05T11:48:44.827+0100 [mongosMain] connection accepted from 172.28.0.164:52516 #1377 (582 connections now open) 2015-10-05T11:48:44.827+0100 [mongosMain] connection accepted from 172.28.0.164:52518 #1378 (583 connections now open) 2015-10-05T11:48:44.828+0100 [mongosMain] connection accepted from 172.28.0.164:52519 #1379 (584 connections now open) 2015-10-05T11:48:44.828+0100 [mongosMain] connection accepted from 172.28.0.164:52520 #1380 (585 connections now open) 2015-10-05T11:48:44.828+0100 [mongosMain] connection accepted from 172.28.0.164:52521 #1381 (586 connections now open) 2015-10-05T11:48:44.828+0100 [mongosMain] connection accepted from 172.28.0.164:52522 #1382 (587 connections now open) 2015-10-05T11:48:44.828+0100 [conn1376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.829+0100 [mongosMain] connection accepted from 172.28.0.164:52523 #1383 (588 connections now open) 2015-10-05T11:48:44.829+0100 [mongosMain] connection accepted from 172.28.0.164:52524 #1384 (589 connections now open) 2015-10-05T11:48:44.829+0100 [mongosMain] connection accepted from 172.28.0.164:52525 #1385 (590 connections now open) 2015-10-05T11:48:44.830+0100 [mongosMain] connection accepted from 172.28.0.164:52526 #1386 (591 connections now open) 2015-10-05T11:48:44.830+0100 [mongosMain] connection accepted from 172.28.0.164:52528 #1387 (592 connections now open) 2015-10-05T11:48:44.830+0100 [mongosMain] connection accepted from 172.28.0.164:52527 #1388 (593 connections now open) 2015-10-05T11:48:44.831+0100 [conn1378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.831+0100 [mongosMain] connection accepted from 172.28.0.164:52529 #1389 (594 connections now open) 2015-10-05T11:48:44.831+0100 [mongosMain] connection accepted from 172.28.0.164:52533 #1390 (595 connections now open) 2015-10-05T11:48:44.832+0100 [mongosMain] connection accepted from 172.28.0.164:52530 #1391 (596 connections now open) 2015-10-05T11:48:44.832+0100 [conn1383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.832+0100 [mongosMain] connection accepted from 172.28.0.164:52532 #1392 (597 connections now open) 2015-10-05T11:48:44.832+0100 [mongosMain] connection accepted from 172.28.0.164:52531 #1393 (598 connections now open) 2015-10-05T11:48:44.833+0100 [mongosMain] connection accepted from 172.28.0.164:52534 #1394 (599 connections now open) 2015-10-05T11:48:44.834+0100 [conn1381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.833+0100 [conn1384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.835+0100 [mongosMain] connection accepted from 172.28.0.164:52535 #1395 (600 connections now open) 2015-10-05T11:48:44.835+0100 [mongosMain] connection accepted from 172.28.0.164:52536 #1396 (601 connections now open) 2015-10-05T11:48:44.835+0100 [conn1391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.835+0100 [conn1388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.835+0100 [mongosMain] connection accepted from 172.28.0.164:52537 #1397 (602 connections now open) 2015-10-05T11:48:44.835+0100 [mongosMain] connection accepted from 172.28.0.164:52538 #1398 (603 connections now open) 2015-10-05T11:48:44.836+0100 [mongosMain] connection accepted from 172.28.0.164:52539 #1399 (604 connections now open) 2015-10-05T11:48:44.836+0100 [mongosMain] connection accepted from 172.28.0.164:52540 #1400 (605 connections now open) 2015-10-05T11:48:44.836+0100 [conn1386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.833+0100 [conn1380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.835+0100 [conn1389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.835+0100 [conn1382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.836+0100 [mongosMain] connection accepted from 172.28.0.164:52541 #1401 (606 connections now open) 2015-10-05T11:48:44.837+0100 [conn1394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.837+0100 [conn1397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.837+0100 [mongosMain] connection accepted from 172.28.0.164:52542 #1402 (607 connections now open) 2015-10-05T11:48:44.837+0100 [mongosMain] connection accepted from 172.28.0.164:52543 #1403 (608 connections now open) 2015-10-05T11:48:44.838+0100 [mongosMain] connection accepted from 172.28.0.164:52544 #1404 (609 connections now open) 2015-10-05T11:48:44.838+0100 [mongosMain] connection accepted from 172.28.0.164:52545 #1405 (610 connections now open) 2015-10-05T11:48:44.838+0100 [conn1399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.838+0100 [mongosMain] connection accepted from 172.28.0.164:52546 #1406 (611 connections now open) 2015-10-05T11:48:44.838+0100 [conn1395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.838+0100 [mongosMain] connection accepted from 172.28.0.164:52547 #1407 (612 connections now open) 2015-10-05T11:48:44.838+0100 [mongosMain] connection accepted from 172.28.0.164:52548 #1408 (613 connections now open) 2015-10-05T11:48:44.839+0100 [conn1403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.840+0100 [mongosMain] connection accepted from 172.28.0.164:52550 #1409 (614 connections now open) 2015-10-05T11:48:44.840+0100 [mongosMain] connection accepted from 172.28.0.164:52549 #1410 (615 connections now open) 2015-10-05T11:48:44.840+0100 [conn1407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.840+0100 [conn1402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.840+0100 [conn1401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.840+0100 [mongosMain] connection accepted from 172.28.0.164:52551 #1411 (616 connections now open) 2015-10-05T11:48:44.841+0100 [mongosMain] connection accepted from 172.28.0.164:52552 #1412 (617 connections now open) 2015-10-05T11:48:44.841+0100 [mongosMain] connection accepted from 172.28.0.164:52553 #1413 (618 connections now open) 2015-10-05T11:48:44.841+0100 [conn1408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.842+0100 [mongosMain] connection accepted from 172.28.0.164:52555 #1414 (619 connections now open) 2015-10-05T11:48:44.842+0100 [mongosMain] connection accepted from 172.28.0.164:52554 #1415 (620 connections now open) 2015-10-05T11:48:44.842+0100 [mongosMain] connection accepted from 172.28.0.164:52556 #1416 (621 connections now open) 2015-10-05T11:48:44.843+0100 [conn1411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.843+0100 [mongosMain] connection accepted from 172.28.0.164:52558 #1417 (622 connections now open) 2015-10-05T11:48:44.843+0100 [conn1410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.843+0100 [mongosMain] connection accepted from 172.28.0.164:52560 #1418 (623 connections now open) 2015-10-05T11:48:44.843+0100 [mongosMain] connection accepted from 172.28.0.164:52557 #1419 (624 connections now open) 2015-10-05T11:48:44.844+0100 [mongosMain] connection accepted from 172.28.0.164:52561 #1420 (625 connections now open) 2015-10-05T11:48:44.844+0100 [conn1412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.844+0100 [mongosMain] connection accepted from 172.28.0.164:52562 #1421 (626 connections now open) 2015-10-05T11:48:44.844+0100 [conn1416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.844+0100 [mongosMain] connection accepted from 172.28.0.164:52563 #1422 (627 connections now open) 2015-10-05T11:48:44.844+0100 [conn1414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.845+0100 [conn1413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.845+0100 [mongosMain] connection accepted from 172.28.0.164:52564 #1423 (628 connections now open) 2015-10-05T11:48:44.845+0100 [conn1415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.845+0100 [mongosMain] connection accepted from 172.28.0.164:52559 #1424 (629 connections now open) 2015-10-05T11:48:44.845+0100 [mongosMain] connection accepted from 172.28.0.164:52566 #1425 (630 connections now open) 2015-10-05T11:48:44.845+0100 [mongosMain] connection accepted from 172.28.0.164:52565 #1426 (631 connections now open) 2015-10-05T11:48:44.845+0100 [mongosMain] connection accepted from 172.28.0.164:52567 #1427 (632 connections now open) 2015-10-05T11:48:44.846+0100 [mongosMain] connection accepted from 172.28.0.164:52569 #1428 (633 connections now open) 2015-10-05T11:48:44.846+0100 [mongosMain] connection accepted from 172.28.0.164:52568 #1429 (634 connections now open) 2015-10-05T11:48:44.846+0100 [mongosMain] connection accepted from 172.28.0.164:52571 #1430 (635 connections now open) 2015-10-05T11:48:44.847+0100 [mongosMain] connection accepted from 172.28.0.164:52570 #1431 (636 connections now open) 2015-10-05T11:48:44.847+0100 [mongosMain] connection accepted from 172.28.0.164:52572 #1432 (637 connections now open) 2015-10-05T11:48:44.847+0100 [mongosMain] connection accepted from 172.28.0.164:52573 #1433 (638 connections now open) 2015-10-05T11:48:44.847+0100 [mongosMain] connection accepted from 172.28.0.164:52574 #1434 (639 connections now open) 2015-10-05T11:48:44.847+0100 [mongosMain] connection accepted from 172.28.0.164:52575 #1435 (640 connections now open) 2015-10-05T11:48:44.848+0100 [mongosMain] connection accepted from 172.28.0.164:52576 #1436 (641 connections now open) 2015-10-05T11:48:44.848+0100 [mongosMain] connection accepted from 172.28.0.164:52577 #1437 (642 connections now open) 2015-10-05T11:48:44.848+0100 [mongosMain] connection accepted from 172.28.0.164:52578 #1438 (643 connections now open) 2015-10-05T11:48:44.849+0100 [conn1417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.849+0100 [conn1422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.849+0100 [mongosMain] connection accepted from 172.28.0.164:52579 #1439 (644 connections now open) 2015-10-05T11:48:44.849+0100 [mongosMain] connection accepted from 172.28.0.164:52580 #1440 (645 connections now open) 2015-10-05T11:48:44.849+0100 [conn1421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.849+0100 [mongosMain] connection accepted from 172.28.0.164:52581 #1441 (646 connections now open) 2015-10-05T11:48:44.849+0100 [conn1419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.850+0100 [mongosMain] connection accepted from 172.28.0.164:52583 #1442 (647 connections now open) 2015-10-05T11:48:44.850+0100 [mongosMain] connection accepted from 172.28.0.164:52582 #1443 (648 connections now open) 2015-10-05T11:48:44.850+0100 [mongosMain] connection accepted from 172.28.0.164:52585 #1444 (649 connections now open) 2015-10-05T11:48:44.850+0100 [mongosMain] connection accepted from 172.28.0.164:52584 #1445 (650 connections now open) 2015-10-05T11:48:44.850+0100 [mongosMain] connection accepted from 172.28.0.164:52586 #1446 (651 connections now open) 2015-10-05T11:48:44.851+0100 [mongosMain] connection accepted from 172.28.0.164:52589 #1447 (652 connections now open) 2015-10-05T11:48:44.851+0100 [conn1425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.851+0100 [conn1426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.851+0100 [mongosMain] connection accepted from 172.28.0.164:52587 #1448 (653 connections now open) 2015-10-05T11:48:44.851+0100 [mongosMain] connection accepted from 172.28.0.164:52588 #1449 (654 connections now open) 2015-10-05T11:48:44.851+0100 [mongosMain] connection accepted from 172.28.0.164:52591 #1450 (655 connections now open) 2015-10-05T11:48:44.851+0100 [mongosMain] connection accepted from 172.28.0.164:52592 #1451 (656 connections now open) 2015-10-05T11:48:44.852+0100 [mongosMain] connection accepted from 172.28.0.164:52590 #1452 (657 connections now open) 2015-10-05T11:48:44.852+0100 [conn1434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.852+0100 [mongosMain] connection accepted from 172.28.0.164:52593 #1453 (658 connections now open) 2015-10-05T11:48:44.852+0100 [mongosMain] connection accepted from 172.28.0.164:52594 #1454 (659 connections now open) 2015-10-05T11:48:44.853+0100 [conn1442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.853+0100 [conn1447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.853+0100 [mongosMain] connection accepted from 172.28.0.164:52595 #1455 (660 connections now open) 2015-10-05T11:48:44.853+0100 [mongosMain] connection accepted from 172.28.0.164:52597 #1456 (661 connections now open) 2015-10-05T11:48:44.853+0100 [conn1446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.853+0100 [conn1443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.853+0100 [mongosMain] connection accepted from 172.28.0.164:52596 #1457 (662 connections now open) 2015-10-05T11:48:44.854+0100 [conn1444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.854+0100 [mongosMain] connection accepted from 172.28.0.164:52598 #1458 (663 connections now open) 2015-10-05T11:48:44.854+0100 [mongosMain] connection accepted from 172.28.0.164:52600 #1459 (664 connections now open) 2015-10-05T11:48:44.854+0100 [conn1452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.854+0100 [conn1445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.854+0100 [mongosMain] connection accepted from 172.28.0.164:52601 #1460 (665 connections now open) 2015-10-05T11:48:44.854+0100 [conn1450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.854+0100 [conn1451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.855+0100 [mongosMain] connection accepted from 172.28.0.164:52603 #1461 (666 connections now open) 2015-10-05T11:48:44.855+0100 [mongosMain] connection accepted from 172.28.0.164:52602 #1462 (667 connections now open) 2015-10-05T11:48:44.855+0100 [mongosMain] connection accepted from 172.28.0.164:52604 #1463 (668 connections now open) 2015-10-05T11:48:44.855+0100 [mongosMain] connection accepted from 172.28.0.164:52599 #1464 (669 connections now open) 2015-10-05T11:48:44.856+0100 [mongosMain] connection accepted from 172.28.0.164:52605 #1465 (670 connections now open) 2015-10-05T11:48:44.856+0100 [mongosMain] connection accepted from 172.28.0.164:52606 #1466 (671 connections now open) 2015-10-05T11:48:44.856+0100 [mongosMain] connection accepted from 172.28.0.164:52607 #1467 (672 connections now open) 2015-10-05T11:48:44.857+0100 [mongosMain] connection accepted from 172.28.0.164:52608 #1468 (673 connections now open) 2015-10-05T11:48:44.857+0100 [mongosMain] connection accepted from 172.28.0.164:52609 #1469 (674 connections now open) 2015-10-05T11:48:44.857+0100 [mongosMain] connection accepted from 172.28.0.164:52610 #1470 (675 connections now open) 2015-10-05T11:48:44.858+0100 [mongosMain] connection accepted from 172.28.0.164:52611 #1471 (676 connections now open) 2015-10-05T11:48:44.858+0100 [mongosMain] connection accepted from 172.28.0.164:52613 #1472 (677 connections now open) 2015-10-05T11:48:44.858+0100 [mongosMain] connection accepted from 172.28.0.164:52612 #1473 (678 connections now open) 2015-10-05T11:48:44.858+0100 [conn1459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.858+0100 [conn1458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.858+0100 [conn1464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.858+0100 [mongosMain] connection accepted from 172.28.0.164:52615 #1474 (679 connections now open) 2015-10-05T11:48:44.859+0100 [mongosMain] connection accepted from 172.28.0.164:52614 #1475 (680 connections now open) 2015-10-05T11:48:44.859+0100 [conn1454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.859+0100 [mongosMain] connection accepted from 172.28.0.164:52617 #1476 (681 connections now open) 2015-10-05T11:48:44.859+0100 [mongosMain] connection accepted from 172.28.0.164:52618 #1477 (682 connections now open) 2015-10-05T11:48:44.859+0100 [mongosMain] connection accepted from 172.28.0.164:52616 #1478 (683 connections now open) 2015-10-05T11:48:44.860+0100 [mongosMain] connection accepted from 172.28.0.164:52619 #1479 (684 connections now open) 2015-10-05T11:48:44.860+0100 [mongosMain] connection accepted from 172.28.0.164:52620 #1480 (685 connections now open) 2015-10-05T11:48:44.860+0100 [mongosMain] connection accepted from 172.28.0.164:52621 #1481 (686 connections now open) 2015-10-05T11:48:44.860+0100 [mongosMain] connection accepted from 172.28.0.164:52622 #1482 (687 connections now open) 2015-10-05T11:48:44.860+0100 [mongosMain] connection accepted from 172.28.0.164:52623 #1483 (688 connections now open) 2015-10-05T11:48:44.861+0100 [mongosMain] connection accepted from 172.28.0.164:52624 #1484 (689 connections now open) 2015-10-05T11:48:44.863+0100 [conn1457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.863+0100 [conn1468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.863+0100 [conn1456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.863+0100 [mongosMain] connection accepted from 172.28.0.164:52625 #1485 (690 connections now open) 2015-10-05T11:48:44.864+0100 [mongosMain] connection accepted from 172.28.0.164:52627 #1486 (691 connections now open) 2015-10-05T11:48:44.864+0100 [conn1462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.864+0100 [mongosMain] connection accepted from 172.28.0.164:52626 #1487 (692 connections now open) 2015-10-05T11:48:44.864+0100 [mongosMain] connection accepted from 172.28.0.164:52628 #1488 (693 connections now open) 2015-10-05T11:48:44.864+0100 [conn1461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.864+0100 [mongosMain] connection accepted from 172.28.0.164:52629 #1489 (694 connections now open) 2015-10-05T11:48:44.865+0100 [mongosMain] connection accepted from 172.28.0.164:52630 #1490 (695 connections now open) 2015-10-05T11:48:44.865+0100 [mongosMain] connection accepted from 172.28.0.164:52631 #1491 (696 connections now open) 2015-10-05T11:48:44.865+0100 [conn1475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.865+0100 [conn1469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.865+0100 [mongosMain] connection accepted from 172.28.0.164:52632 #1492 (697 connections now open) 2015-10-05T11:48:44.865+0100 [mongosMain] connection accepted from 172.28.0.164:52633 #1493 (698 connections now open) 2015-10-05T11:48:44.865+0100 [conn1463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.866+0100 [conn1466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.866+0100 [conn1470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.866+0100 [mongosMain] connection accepted from 172.28.0.164:52634 #1494 (699 connections now open) 2015-10-05T11:48:44.866+0100 [mongosMain] connection accepted from 172.28.0.164:52636 #1495 (700 connections now open) 2015-10-05T11:48:44.866+0100 [conn1474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.866+0100 [conn1467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.867+0100 [mongosMain] connection accepted from 172.28.0.164:52635 #1496 (701 connections now open) 2015-10-05T11:48:44.867+0100 [mongosMain] connection accepted from 172.28.0.164:52638 #1497 (702 connections now open) 2015-10-05T11:48:44.867+0100 [conn1472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.867+0100 [conn1473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.867+0100 [mongosMain] connection accepted from 172.28.0.164:52637 #1498 (703 connections now open) 2015-10-05T11:48:44.868+0100 [mongosMain] connection accepted from 172.28.0.164:52640 #1499 (704 connections now open) 2015-10-05T11:48:44.868+0100 [conn1471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.868+0100 [conn1465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.868+0100 [conn1481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.868+0100 [mongosMain] connection accepted from 172.28.0.164:52641 #1500 (705 connections now open) 2015-10-05T11:48:44.868+0100 [mongosMain] connection accepted from 172.28.0.164:52642 #1501 (706 connections now open) 2015-10-05T11:48:44.869+0100 [mongosMain] connection accepted from 172.28.0.164:52643 #1502 (707 connections now open) 2015-10-05T11:48:44.869+0100 [conn1478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.869+0100 [conn1482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.870+0100 [conn1476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.870+0100 [mongosMain] connection accepted from 172.28.0.164:52644 #1503 (708 connections now open) 2015-10-05T11:48:44.870+0100 [mongosMain] connection accepted from 172.28.0.164:52645 #1504 (709 connections now open) 2015-10-05T11:48:44.871+0100 [conn1480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.871+0100 [conn1477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.871+0100 [conn1479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.871+0100 [conn1483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.872+0100 [conn1484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.873+0100 [conn1460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.874+0100 [mongosMain] connection accepted from 172.28.0.164:52651 #1505 (710 connections now open) 2015-10-05T11:48:44.877+0100 [mongosMain] connection accepted from 172.28.0.164:52653 #1506 (711 connections now open) 2015-10-05T11:48:44.880+0100 [conn1486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.880+0100 [conn1485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.880+0100 [conn1487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.882+0100 [conn1488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.895+0100 [mongosMain] connection accepted from 172.28.0.164:52659 #1507 (712 connections now open) 2015-10-05T11:48:44.956+0100 [conn1489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.956+0100 [conn1499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.957+0100 [conn1492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.957+0100 [conn1494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.957+0100 [conn1496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.982+0100 [conn1493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.982+0100 [conn1490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.985+0100 [conn1423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.986+0100 [conn1502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.986+0100 [conn1449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.986+0100 [conn1453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.987+0100 [conn1505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.988+0100 [conn1436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:44.988+0100 [conn1507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.029+0100 [conn1431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.079+0100 [conn1504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.112+0100 [conn1361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.119+0100 [conn1374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.130+0100 [conn1377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.137+0100 [conn1379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.145+0100 [conn1373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.146+0100 [conn1393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.146+0100 [conn1387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.147+0100 [conn1396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.147+0100 [conn1385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.149+0100 [conn1392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.149+0100 [conn1398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.149+0100 [conn1400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.153+0100 [conn1405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.290+0100 [conn1365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.291+0100 [conn1406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.293+0100 [conn1418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.293+0100 [conn1404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.294+0100 [conn1424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.294+0100 [conn1409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.317+0100 [conn1420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.318+0100 [conn1455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.333+0100 [conn1390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:45.670+0100 [conn1500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:48:49.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612559112deab02e2989b38 2015-10-05T11:48:49.391+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:48:55.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612559712deab02e2989b69 2015-10-05T11:48:55.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:01.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612559d12deab02e2989b81 2015-10-05T11:49:01.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:07.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255a312deab02e2989ba7 2015-10-05T11:49:08.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:11.294+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:49:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:49:14.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255aa12deab02e2989bc7 2015-10-05T11:49:14.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:20.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255b012deab02e2989bf9 2015-10-05T11:49:20.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:27.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255b612deab02e2989c13 2015-10-05T11:49:27.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:28.299+0100 [mongosMain] connection accepted from 127.0.0.1:59115 #1508 (713 connections now open) 2015-10-05T11:49:28.302+0100 [conn1508] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:49:28.303+0100 [conn1508] end connection 127.0.0.1:59115 (712 connections now open) 2015-10-05T11:49:30.147+0100 [conn205] end connection 172.28.0.163:53007 (711 connections now open) 2015-10-05T11:49:30.147+0100 [mongosMain] connection accepted from 172.28.0.163:59118 #1509 (712 connections now open) 2015-10-05T11:49:30.147+0100 [conn1509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:49:30.334+0100 [conn451] end connection 172.28.0.163:54918 (711 connections now open) 2015-10-05T11:49:33.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255bd12deab02e2989c42 2015-10-05T11:49:33.637+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:39.518+0100 [mongosMain] connection accepted from 127.0.0.1:59124 #1510 (712 connections now open) 2015-10-05T11:49:39.521+0100 [conn1510] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:49:39.521+0100 [conn1510] end connection 127.0.0.1:59124 (711 connections now open) 2015-10-05T11:49:39.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255c312deab02e2989c7e 2015-10-05T11:49:40.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:41.458+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:49:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:49:52.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255d012deab02e2989cd0 2015-10-05T11:49:52.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:49:58.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255d612deab02e2989cfb 2015-10-05T11:49:58.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:04.891+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255dc12deab02e2989d31 2015-10-05T11:50:04.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:11.638+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:50:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:50:17.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255e812deab02e2989d9c 2015-10-05T11:50:17.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:23.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255ef12deab02e2989df3 2015-10-05T11:50:23.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:28.613+0100 [mongosMain] connection accepted from 127.0.0.1:59184 #1511 (712 connections now open) 2015-10-05T11:50:28.617+0100 [conn1511] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:28.618+0100 [conn1511] end connection 127.0.0.1:59184 (711 connections now open) 2015-10-05T11:50:29.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561255f512deab02e2989e58 2015-10-05T11:50:30.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:30.194+0100 [conn191] end connection 172.28.0.163:52736 (710 connections now open) 2015-10-05T11:50:30.194+0100 [mongosMain] connection accepted from 172.28.0.163:59197 #1512 (711 connections now open) 2015-10-05T11:50:30.225+0100 [conn1512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:30.349+0100 [conn50] end connection 172.28.0.163:52347 (710 connections now open) 2015-10-05T11:50:39.504+0100 [mongosMain] connection accepted from 127.0.0.1:59249 #1513 (711 connections now open) 2015-10-05T11:50:39.507+0100 [conn1513] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:39.507+0100 [conn1513] end connection 127.0.0.1:59249 (710 connections now open) 2015-10-05T11:50:40.684+0100 [conn402] end connection 172.28.0.163:54839 (709 connections now open) 2015-10-05T11:50:40.685+0100 [conn358] end connection 172.28.0.163:54770 (708 connections now open) 2015-10-05T11:50:40.687+0100 [conn394] end connection 172.28.0.163:54828 (707 connections now open) 2015-10-05T11:50:40.800+0100 [mongosMain] connection accepted from 172.28.0.163:59366 #1514 (708 connections now open) 2015-10-05T11:50:40.800+0100 [mongosMain] connection accepted from 172.28.0.163:59367 #1515 (709 connections now open) 2015-10-05T11:50:40.801+0100 [mongosMain] connection accepted from 172.28.0.163:59368 #1516 (710 connections now open) 2015-10-05T11:50:40.821+0100 [conn1516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:40.838+0100 [conn1515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:40.851+0100 [conn1514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:40.879+0100 [conn461] end connection 172.28.0.163:54935 (709 connections now open) 2015-10-05T11:50:40.881+0100 [conn356] end connection 172.28.0.163:54766 (708 connections now open) 2015-10-05T11:50:40.883+0100 [conn314] end connection 172.28.0.163:54709 (707 connections now open) 2015-10-05T11:50:40.894+0100 [conn452] end connection 172.28.0.163:54919 (706 connections now open) 2015-10-05T11:50:40.906+0100 [conn404] end connection 172.28.0.163:54844 (705 connections now open) 2015-10-05T11:50:40.922+0100 [conn370] end connection 172.28.0.163:54785 (704 connections now open) 2015-10-05T11:50:41.101+0100 [mongosMain] connection accepted from 172.28.0.163:59381 #1517 (705 connections now open) 2015-10-05T11:50:41.103+0100 [conn1517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:41.199+0100 [mongosMain] connection accepted from 172.28.0.163:59383 #1518 (706 connections now open) 2015-10-05T11:50:41.225+0100 [mongosMain] connection accepted from 172.28.0.163:59390 #1519 (707 connections now open) 2015-10-05T11:50:41.233+0100 [mongosMain] connection accepted from 172.28.0.163:59393 #1520 (708 connections now open) 2015-10-05T11:50:41.240+0100 [mongosMain] connection accepted from 172.28.0.163:59394 #1521 (709 connections now open) 2015-10-05T11:50:41.242+0100 [mongosMain] connection accepted from 172.28.0.163:59402 #1522 (710 connections now open) 2015-10-05T11:50:41.364+0100 [conn1519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:41.367+0100 [conn1518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:41.377+0100 [conn1522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:41.377+0100 [conn1520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:41.399+0100 [conn1521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:50:42.206+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:50:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:50:43.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612560212deab02e2989f2d 2015-10-05T11:50:44.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:51.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612560a12deab02e2989f99 2015-10-05T11:50:51.620+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:50:57.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612561112deab02e2989fad 2015-10-05T11:50:57.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:04.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612561712deab02e2989fcf 2015-10-05T11:51:04.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:10.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612561e12deab02e2989ff1 2015-10-05T11:51:10.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:12.354+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:51:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:51:16.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612562412deab02e2989ffa 2015-10-05T11:51:16.993+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:23.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612562a12deab02e298a009 2015-10-05T11:51:23.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:29.159+0100 [mongosMain] connection accepted from 127.0.0.1:59667 #1523 (711 connections now open) 2015-10-05T11:51:29.164+0100 [conn1523] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:51:29.165+0100 [conn1523] end connection 127.0.0.1:59667 (710 connections now open) 2015-10-05T11:51:29.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612563112deab02e298a020 2015-10-05T11:51:29.502+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:30.272+0100 [conn535] end connection 172.28.0.163:55543 (709 connections now open) 2015-10-05T11:51:30.272+0100 [mongosMain] connection accepted from 172.28.0.163:59669 #1524 (710 connections now open) 2015-10-05T11:51:30.272+0100 [conn1524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:51:35.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612563712deab02e298a03e 2015-10-05T11:51:35.901+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:39.871+0100 [mongosMain] connection accepted from 127.0.0.1:59671 #1525 (711 connections now open) 2015-10-05T11:51:39.874+0100 [conn1525] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:51:39.875+0100 [conn1525] end connection 127.0.0.1:59671 (710 connections now open) 2015-10-05T11:51:42.183+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612563d12deab02e298a048 2015-10-05T11:51:42.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:42.593+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:51:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:51:48.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612564412deab02e298a062 2015-10-05T11:51:48.742+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:51:51.530+0100 [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5ms 2015-10-05T11:51:54.926+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612564a12deab02e298a070 2015-10-05T11:51:55.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:01.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612565112deab02e298a085 2015-10-05T11:52:01.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:07.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612565712deab02e298a098 2015-10-05T11:52:07.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:12.943+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:52:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:52:13.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612565d12deab02e298a0ac 2015-10-05T11:52:13.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:20.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612566312deab02e298a0b8 2015-10-05T11:52:20.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:26.629+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612566a12deab02e298a0c3 2015-10-05T11:52:26.765+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:28.268+0100 [mongosMain] connection accepted from 127.0.0.1:59712 #1526 (711 connections now open) 2015-10-05T11:52:28.272+0100 [conn1526] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:52:28.273+0100 [conn1526] end connection 127.0.0.1:59712 (710 connections now open) 2015-10-05T11:52:30.234+0100 [conn190] end connection 172.28.0.163:52735 (709 connections now open) 2015-10-05T11:52:30.235+0100 [mongosMain] connection accepted from 172.28.0.163:59713 #1527 (710 connections now open) 2015-10-05T11:52:30.237+0100 [conn1527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:52:33.050+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612567012deab02e298a0d8 2015-10-05T11:52:33.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:39.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612567712deab02e298a0e4 2015-10-05T11:52:39.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:40.004+0100 [mongosMain] connection accepted from 127.0.0.1:59716 #1528 (711 connections now open) 2015-10-05T11:52:40.007+0100 [conn1528] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:52:40.008+0100 [conn1528] end connection 127.0.0.1:59716 (710 connections now open) 2015-10-05T11:52:43.129+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:52:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:52:45.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612567d12deab02e298a0f4 2015-10-05T11:52:45.931+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:52.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612568312deab02e298a10c 2015-10-05T11:52:52.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:52:58.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612568a12deab02e298a120 2015-10-05T11:52:58.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:04.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612569012deab02e298a134 2015-10-05T11:53:04.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:11.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612569612deab02e298a13c 2015-10-05T11:53:11.109+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:13.515+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:53:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:53:17.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612569d12deab02e298a157 2015-10-05T11:53:17.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:23.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256a312deab02e298a15f 2015-10-05T11:53:23.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:29.138+0100 [mongosMain] connection accepted from 127.0.0.1:59762 #1529 (711 connections now open) 2015-10-05T11:53:29.141+0100 [conn1529] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:53:29.142+0100 [conn1529] end connection 127.0.0.1:59762 (710 connections now open) 2015-10-05T11:53:30.030+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256a912deab02e298a170 2015-10-05T11:53:30.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:30.253+0100 [conn503] end connection 172.28.0.163:55317 (709 connections now open) 2015-10-05T11:53:30.255+0100 [mongosMain] connection accepted from 172.28.0.163:59763 #1530 (710 connections now open) 2015-10-05T11:53:30.257+0100 [conn1530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:53:36.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256b012deab02e298a184 2015-10-05T11:53:36.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:39.738+0100 [mongosMain] connection accepted from 127.0.0.1:59764 #1531 (711 connections now open) 2015-10-05T11:53:39.741+0100 [conn1531] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:53:39.741+0100 [conn1531] end connection 127.0.0.1:59764 (710 connections now open) 2015-10-05T11:53:42.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256b612deab02e298a18f 2015-10-05T11:53:42.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:43.679+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:53:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:53:48.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256bc12deab02e298a193 2015-10-05T11:53:48.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:53:54.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256c212deab02e298a199 2015-10-05T11:53:55.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:01.243+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256c912deab02e298a1a4 2015-10-05T11:54:01.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:07.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256cf12deab02e298a1b0 2015-10-05T11:54:07.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:13.813+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:54:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:54:13.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256d512deab02e298a1bf 2015-10-05T11:54:13.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:20.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256dc12deab02e298a1cc 2015-10-05T11:54:21.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:28.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256e312deab02e298a1da 2015-10-05T11:54:28.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:28.704+0100 [mongosMain] connection accepted from 127.0.0.1:59872 #1532 (711 connections now open) 2015-10-05T11:54:28.707+0100 [conn1532] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:54:28.708+0100 [conn1532] end connection 127.0.0.1:59872 (710 connections now open) 2015-10-05T11:54:30.264+0100 [conn499] end connection 172.28.0.163:55078 (709 connections now open) 2015-10-05T11:54:30.265+0100 [mongosMain] connection accepted from 172.28.0.163:59873 #1533 (710 connections now open) 2015-10-05T11:54:30.267+0100 [conn1533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:54:34.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256ea12deab02e298a1e9 2015-10-05T11:54:34.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:40.034+0100 [mongosMain] connection accepted from 127.0.0.1:59910 #1534 (711 connections now open) 2015-10-05T11:54:40.037+0100 [conn1534] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:54:40.037+0100 [conn1534] end connection 127.0.0.1:59910 (710 connections now open) 2015-10-05T11:54:41.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256f012deab02e298a1f9 2015-10-05T11:54:41.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:43.972+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:54:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:54:47.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256f712deab02e298a20c 2015-10-05T11:54:47.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:54:53.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561256fd12deab02e298a21c 2015-10-05T11:54:53.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:05.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612570912deab02e298a23e 2015-10-05T11:55:06.023+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:12.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612571012deab02e298a24f 2015-10-05T11:55:12.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:14.156+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:55:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:55:14.922+0100 [conn1256] end connection 172.28.0.164:52170 (709 connections now open) 2015-10-05T11:55:14.923+0100 [mongosMain] connection accepted from 172.28.0.164:53284 #1535 (710 connections now open) 2015-10-05T11:55:14.927+0100 [conn1535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:55:18.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612571612deab02e298a25f 2015-10-05T11:55:18.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:24.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612571c12deab02e298a276 2015-10-05T11:55:25.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:28.364+0100 [mongosMain] connection accepted from 127.0.0.1:60336 #1536 (711 connections now open) 2015-10-05T11:55:28.367+0100 [conn1536] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:55:28.368+0100 [conn1536] end connection 127.0.0.1:60336 (710 connections now open) 2015-10-05T11:55:30.303+0100 [conn305] end connection 172.28.0.163:54246 (709 connections now open) 2015-10-05T11:55:30.304+0100 [mongosMain] connection accepted from 172.28.0.163:60337 #1537 (710 connections now open) 2015-10-05T11:55:30.306+0100 [conn1537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:55:31.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612572312deab02e298a291 2015-10-05T11:55:31.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:37.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612572912deab02e298a29e 2015-10-05T11:55:37.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:39.278+0100 [mongosMain] connection accepted from 127.0.0.1:60578 #1538 (711 connections now open) 2015-10-05T11:55:39.281+0100 [conn1538] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:55:39.281+0100 [conn1538] end connection 127.0.0.1:60578 (710 connections now open) 2015-10-05T11:55:44.267+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612572f12deab02e298a2b6 2015-10-05T11:55:44.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:44.437+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:55:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:55:50.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612573612deab02e298a2c7 2015-10-05T11:55:50.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:55:56.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612573c12deab02e298a2dc 2015-10-05T11:55:56.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:03.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612574212deab02e298a2ef 2015-10-05T11:56:03.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:09.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612574912deab02e298a309 2015-10-05T11:56:09.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:14.596+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:56:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:56:14.934+0100 [conn1258] end connection 172.28.0.164:52175 (709 connections now open) 2015-10-05T11:56:14.936+0100 [mongosMain] connection accepted from 172.28.0.164:53326 #1539 (710 connections now open) 2015-10-05T11:56:14.938+0100 [conn1539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:56:15.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612574f12deab02e298a318 2015-10-05T11:56:15.894+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:22.177+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612575512deab02e298a32a 2015-10-05T11:56:22.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:28.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612575c12deab02e298a343 2015-10-05T11:56:28.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:29.021+0100 [mongosMain] connection accepted from 127.0.0.1:62002 #1540 (711 connections now open) 2015-10-05T11:56:29.023+0100 [conn1540] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:56:29.025+0100 [conn1540] end connection 127.0.0.1:62002 (710 connections now open) 2015-10-05T11:56:30.316+0100 [conn213] end connection 172.28.0.163:53129 (709 connections now open) 2015-10-05T11:56:30.317+0100 [mongosMain] connection accepted from 172.28.0.163:62003 #1541 (710 connections now open) 2015-10-05T11:56:30.319+0100 [conn1541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:56:34.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612576212deab02e298a348 2015-10-05T11:56:34.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:39.557+0100 [mongosMain] connection accepted from 127.0.0.1:62048 #1542 (711 connections now open) 2015-10-05T11:56:39.560+0100 [conn1542] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:56:39.560+0100 [conn1542] end connection 127.0.0.1:62048 (710 connections now open) 2015-10-05T11:56:44.757+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:56:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:56:47.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612576e12deab02e298a360 2015-10-05T11:56:47.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:53.334+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612577512deab02e298a36c 2015-10-05T11:56:53.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:56:59.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612577b12deab02e298a37c 2015-10-05T11:56:59.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:05.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612578112deab02e298a389 2015-10-05T11:57:05.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:12.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612578712deab02e298a39c 2015-10-05T11:57:12.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:14.950+0100 [conn1259] end connection 172.28.0.164:52178 (709 connections now open) 2015-10-05T11:57:14.952+0100 [mongosMain] connection accepted from 172.28.0.164:53375 #1543 (710 connections now open) 2015-10-05T11:57:14.955+0100 [conn1543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:57:15.023+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:57:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:57:18.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612578e12deab02e298a3a8 2015-10-05T11:57:18.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:24.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612579412deab02e298a3bc 2015-10-05T11:57:24.961+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:28.464+0100 [mongosMain] connection accepted from 127.0.0.1:63169 #1544 (711 connections now open) 2015-10-05T11:57:28.467+0100 [conn1544] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:57:28.468+0100 [conn1544] end connection 127.0.0.1:63169 (710 connections now open) 2015-10-05T11:57:30.333+0100 [conn597] end connection 172.28.0.163:56366 (709 connections now open) 2015-10-05T11:57:30.334+0100 [mongosMain] connection accepted from 172.28.0.163:63200 #1545 (710 connections now open) 2015-10-05T11:57:30.336+0100 [conn1545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:57:31.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612579a12deab02e298a3cc 2015-10-05T11:57:31.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:37.486+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612579e03838a45371631a3') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444042657337), why: "doing balance round", ts: ObjectId('561257a112deab02e298a3d9') } } gle1: { lastOp: Timestamp 1444042657000|3, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1444042651000|5, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2015-10-05T11:57:37.491+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T11:57:37.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:57:39.982+0100 [mongosMain] connection accepted from 127.0.0.1:63383 #1546 (711 connections now open) 2015-10-05T11:57:39.985+0100 [conn1546] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:57:39.985+0100 [conn1546] end connection 127.0.0.1:63383 (710 connections now open) 2015-10-05T11:57:43.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257a712deab02e298a3e0 2015-10-05T11:57:43.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:57:45.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:57:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:57:45.174+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T11:57:45.243+0100 [LockPinger] handled late remove of old distributed lock with ts 561257a112deab02e298a3d9 2015-10-05T11:57:56.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257b312deab02e298a3fe 2015-10-05T11:57:56.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:08.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257c012deab02e298a421 2015-10-05T11:58:08.798+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:14.977+0100 [conn1260] end connection 172.28.0.164:52181 (709 connections now open) 2015-10-05T11:58:14.977+0100 [mongosMain] connection accepted from 172.28.0.164:53417 #1547 (710 connections now open) 2015-10-05T11:58:14.980+0100 [conn1547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:58:15.410+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:58:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:58:20.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257cc12deab02e298a448 2015-10-05T11:58:21.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:27.162+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T11:58:27.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T11:58:28.897+0100 [mongosMain] connection accepted from 127.0.0.1:63499 #1548 (711 connections now open) 2015-10-05T11:58:28.899+0100 [conn1548] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:58:28.900+0100 [conn1548] end connection 127.0.0.1:63499 (710 connections now open) 2015-10-05T11:58:30.034+0100 [conn1318] end connection 172.28.0.164:52429 (709 connections now open) 2015-10-05T11:58:30.359+0100 [conn505] end connection 172.28.0.163:55324 (708 connections now open) 2015-10-05T11:58:30.360+0100 [mongosMain] connection accepted from 172.28.0.163:63500 #1549 (709 connections now open) 2015-10-05T11:58:30.362+0100 [conn1549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:58:33.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257d912deab02e298a45d 2015-10-05T11:58:33.413+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:39.229+0100 [mongosMain] connection accepted from 127.0.0.1:63504 #1550 (710 connections now open) 2015-10-05T11:58:39.232+0100 [conn1550] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:58:39.232+0100 [conn1550] end connection 127.0.0.1:63504 (709 connections now open) 2015-10-05T11:58:39.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257df12deab02e298a474 2015-10-05T11:58:39.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:45.538+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:58:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:58:52.129+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257eb12deab02e298a48a 2015-10-05T11:58:52.265+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:58:58.415+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257f212deab02e298a49f 2015-10-05T11:58:58.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:10.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561257fe12deab02e298a4c6 2015-10-05T11:59:10.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:14.993+0100 [conn1261] end connection 172.28.0.164:52184 (708 connections now open) 2015-10-05T11:59:14.994+0100 [mongosMain] connection accepted from 172.28.0.164:53458 #1551 (709 connections now open) 2015-10-05T11:59:14.996+0100 [conn1551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:59:15.677+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:59:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:59:17.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612580412deab02e298a4d6 2015-10-05T11:59:17.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:28.680+0100 [mongosMain] connection accepted from 127.0.0.1:63735 #1552 (710 connections now open) 2015-10-05T11:59:28.683+0100 [conn1552] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:59:28.684+0100 [conn1552] end connection 127.0.0.1:63735 (709 connections now open) 2015-10-05T11:59:30.047+0100 [conn1322] end connection 172.28.0.164:52462 (708 connections now open) 2015-10-05T11:59:30.374+0100 [conn538] end connection 172.28.0.163:56026 (707 connections now open) 2015-10-05T11:59:30.375+0100 [mongosMain] connection accepted from 172.28.0.163:63736 #1553 (708 connections now open) 2015-10-05T11:59:30.377+0100 [conn1553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T11:59:35.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612581712deab02e298a517 2015-10-05T11:59:35.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:39.816+0100 [mongosMain] connection accepted from 127.0.0.1:63737 #1554 (709 connections now open) 2015-10-05T11:59:39.819+0100 [conn1554] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T11:59:39.820+0100 [conn1554] end connection 127.0.0.1:63737 (708 connections now open) 2015-10-05T11:59:41.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612581d12deab02e298a524 2015-10-05T11:59:41.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:45.951+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 11:59:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T11:59:48.110+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612582312deab02e298a534 2015-10-05T11:59:48.245+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T11:59:54.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612582a12deab02e298a53a 2015-10-05T11:59:54.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:00.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612583012deab02e298a541 2015-10-05T12:00:01.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:07.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612583712deab02e298a55f 2015-10-05T12:00:07.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:13.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612583d12deab02e298a56f 2015-10-05T12:00:13.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:15.012+0100 [conn1262] end connection 172.28.0.164:52187 (707 connections now open) 2015-10-05T12:00:15.013+0100 [mongosMain] connection accepted from 172.28.0.164:53500 #1555 (708 connections now open) 2015-10-05T12:00:15.016+0100 [conn1555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:00:16.247+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:00:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:00:19.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612584312deab02e298a57e 2015-10-05T12:00:20.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:26.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612584a12deab02e298a589 2015-10-05T12:00:26.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:29.155+0100 [mongosMain] connection accepted from 127.0.0.1:64355 #1556 (709 connections now open) 2015-10-05T12:00:29.158+0100 [conn1556] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:00:29.159+0100 [conn1556] end connection 127.0.0.1:64355 (708 connections now open) 2015-10-05T12:00:30.067+0100 [conn1323] end connection 172.28.0.164:52463 (707 connections now open) 2015-10-05T12:00:30.396+0100 [conn509] end connection 172.28.0.163:55335 (706 connections now open) 2015-10-05T12:00:30.398+0100 [mongosMain] connection accepted from 172.28.0.163:64356 #1557 (707 connections now open) 2015-10-05T12:00:30.400+0100 [conn1557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:00:32.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612585012deab02e298a5a3 2015-10-05T12:00:32.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:38.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612585612deab02e298a5ad 2015-10-05T12:00:39.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:00:39.785+0100 [mongosMain] connection accepted from 127.0.0.1:64630 #1558 (708 connections now open) 2015-10-05T12:00:39.788+0100 [conn1558] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:00:39.788+0100 [conn1558] end connection 127.0.0.1:64630 (707 connections now open) 2015-10-05T12:00:46.409+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:00:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:00:51.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612586312deab02e298a5c7 2015-10-05T12:00:51.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:03.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612586f12deab02e298a5e3 2015-10-05T12:01:03.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:09.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612587512deab02e298a5f2 2015-10-05T12:01:10.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:15.028+0100 [conn1263] end connection 172.28.0.164:52190 (706 connections now open) 2015-10-05T12:01:15.029+0100 [mongosMain] connection accepted from 172.28.0.164:53542 #1559 (707 connections now open) 2015-10-05T12:01:15.032+0100 [conn1559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:01:16.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612587c12deab02e298a606 2015-10-05T12:01:16.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:16.672+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:01:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:01:22.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612588212deab02e298a619 2015-10-05T12:01:22.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:28.338+0100 [mongosMain] connection accepted from 127.0.0.1:64815 #1560 (708 connections now open) 2015-10-05T12:01:28.341+0100 [conn1560] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:01:28.342+0100 [conn1560] end connection 127.0.0.1:64815 (707 connections now open) 2015-10-05T12:01:30.083+0100 [conn1325] end connection 172.28.0.164:52465 (706 connections now open) 2015-10-05T12:01:30.411+0100 [conn511] end connection 172.28.0.163:55340 (705 connections now open) 2015-10-05T12:01:30.412+0100 [mongosMain] connection accepted from 172.28.0.163:64816 #1561 (706 connections now open) 2015-10-05T12:01:30.414+0100 [conn1561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:01:35.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612588e12deab02e298a639 2015-10-05T12:01:35.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:01:39.392+0100 [mongosMain] connection accepted from 127.0.0.1:64819 #1562 (707 connections now open) 2015-10-05T12:01:39.394+0100 [conn1562] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:01:39.395+0100 [conn1562] end connection 127.0.0.1:64819 (706 connections now open) 2015-10-05T12:01:46.962+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:01:46 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:01:53.522+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258a112deab02e298a66a 2015-10-05T12:01:53.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:02:05.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258ad12deab02e298a68f 2015-10-05T12:02:06.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:02:15.044+0100 [conn1264] end connection 172.28.0.164:52193 (705 connections now open) 2015-10-05T12:02:15.045+0100 [mongosMain] connection accepted from 172.28.0.164:53583 #1563 (706 connections now open) 2015-10-05T12:02:15.048+0100 [conn1563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:02:17.240+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:02:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:02:18.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258ba12deab02e298a6a3 2015-10-05T12:02:18.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:02:28.893+0100 [mongosMain] connection accepted from 127.0.0.1:65421 #1564 (707 connections now open) 2015-10-05T12:02:28.895+0100 [conn1564] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:02:28.896+0100 [conn1564] end connection 127.0.0.1:65421 (706 connections now open) 2015-10-05T12:02:30.099+0100 [conn1324] end connection 172.28.0.164:52464 (705 connections now open) 2015-10-05T12:02:30.427+0100 [conn541] end connection 172.28.0.163:56140 (704 connections now open) 2015-10-05T12:02:30.428+0100 [mongosMain] connection accepted from 172.28.0.163:65425 #1565 (705 connections now open) 2015-10-05T12:02:30.430+0100 [conn1565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:02:30.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258c612deab02e298a6c5 2015-10-05T12:02:31.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:02:39.614+0100 [mongosMain] connection accepted from 127.0.0.1:65432 #1566 (706 connections now open) 2015-10-05T12:02:39.620+0100 [conn1566] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:02:39.620+0100 [conn1566] end connection 127.0.0.1:65432 (705 connections now open) 2015-10-05T12:02:47.504+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:02:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:02:49.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258d912deab02e298a6f4 2015-10-05T12:02:49.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:02:55.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258df12deab02e298a708 2015-10-05T12:02:55.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:02.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258e512deab02e298a731 2015-10-05T12:03:02.159+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:08.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258ec12deab02e298a753 2015-10-05T12:03:08.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:14.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258f212deab02e298a769 2015-10-05T12:03:15.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:15.060+0100 [conn1265] end connection 172.28.0.164:52196 (704 connections now open) 2015-10-05T12:03:15.061+0100 [mongosMain] connection accepted from 172.28.0.164:53626 #1567 (705 connections now open) 2015-10-05T12:03:15.064+0100 [conn1567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:03:17.665+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:03:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:03:21.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258f912deab02e298a779 2015-10-05T12:03:21.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:27.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561258ff12deab02e298a78b 2015-10-05T12:03:27.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:29.153+0100 [mongosMain] connection accepted from 127.0.0.1:65515 #1568 (706 connections now open) 2015-10-05T12:03:29.156+0100 [conn1568] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:03:29.157+0100 [conn1568] end connection 127.0.0.1:65515 (705 connections now open) 2015-10-05T12:03:30.114+0100 [conn1328] end connection 172.28.0.164:52468 (704 connections now open) 2015-10-05T12:03:30.442+0100 [conn284] end connection 172.28.0.163:53776 (703 connections now open) 2015-10-05T12:03:30.443+0100 [mongosMain] connection accepted from 172.28.0.163:65517 #1569 (704 connections now open) 2015-10-05T12:03:30.445+0100 [conn1569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:03:33.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612590512deab02e298a797 2015-10-05T12:03:33.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:39.640+0100 [mongosMain] connection accepted from 127.0.0.1:65521 #1570 (705 connections now open) 2015-10-05T12:03:39.643+0100 [conn1570] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:03:39.644+0100 [conn1570] end connection 127.0.0.1:65521 (704 connections now open) 2015-10-05T12:03:40.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612590b12deab02e298a7a3 2015-10-05T12:03:40.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:46.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612591212deab02e298a7b0 2015-10-05T12:03:46.505+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:47.941+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:03:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:03:52.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612591812deab02e298a7c0 2015-10-05T12:03:52.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:03:59.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612591e12deab02e298a7e2 2015-10-05T12:03:59.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:05.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612592512deab02e298a7f9 2015-10-05T12:04:05.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:11.860+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612592b12deab02e298a804 2015-10-05T12:04:11.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:15.076+0100 [conn1266] end connection 172.28.0.164:52199 (703 connections now open) 2015-10-05T12:04:15.077+0100 [mongosMain] connection accepted from 172.28.0.164:53668 #1571 (704 connections now open) 2015-10-05T12:04:15.080+0100 [conn1571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:04:18.219+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:04:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:04:18.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612593212deab02e298a81c 2015-10-05T12:04:18.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:28.848+0100 [mongosMain] connection accepted from 127.0.0.1:49652 #1572 (705 connections now open) 2015-10-05T12:04:28.850+0100 [conn1572] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:04:28.852+0100 [conn1572] end connection 127.0.0.1:49652 (704 connections now open) 2015-10-05T12:04:30.119+0100 [conn1337] end connection 172.28.0.164:52477 (703 connections now open) 2015-10-05T12:04:30.448+0100 [conn942] end connection 172.28.0.163:56722 (702 connections now open) 2015-10-05T12:04:30.449+0100 [mongosMain] connection accepted from 172.28.0.163:49653 #1573 (703 connections now open) 2015-10-05T12:04:30.451+0100 [conn1573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:04:30.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612593e12deab02e298a83f 2015-10-05T12:04:30.866+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:39.914+0100 [mongosMain] connection accepted from 127.0.0.1:49656 #1574 (704 connections now open) 2015-10-05T12:04:39.916+0100 [conn1574] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:04:39.917+0100 [conn1574] end connection 127.0.0.1:49656 (703 connections now open) 2015-10-05T12:04:43.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612594a12deab02e298a873 2015-10-05T12:04:43.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:04:48.351+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:04:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:04:55.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612595712deab02e298a8a2 2015-10-05T12:04:55.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:01.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612595d12deab02e298a8bf 2015-10-05T12:05:01.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:08.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612596312deab02e298a8d4 2015-10-05T12:05:08.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:11.182+0100 [conn1396] end connection 172.28.0.164:52536 (702 connections now open) 2015-10-05T12:05:11.182+0100 [conn1400] end connection 172.28.0.164:52540 (702 connections now open) 2015-10-05T12:05:11.183+0100 [conn1393] end connection 172.28.0.164:52531 (700 connections now open) 2015-10-05T12:05:11.183+0100 [mongosMain] connection accepted from 172.28.0.164:53717 #1575 (701 connections now open) 2015-10-05T12:05:11.183+0100 [conn1504] end connection 172.28.0.164:52645 (699 connections now open) 2015-10-05T12:05:11.183+0100 [conn1502] end connection 172.28.0.164:52643 (699 connections now open) 2015-10-05T12:05:11.183+0100 [mongosMain] connection accepted from 172.28.0.164:53718 #1576 (700 connections now open) 2015-10-05T12:05:11.184+0100 [mongosMain] connection accepted from 172.28.0.164:53720 #1577 (701 connections now open) 2015-10-05T12:05:11.184+0100 [mongosMain] connection accepted from 172.28.0.164:53721 #1578 (702 connections now open) 2015-10-05T12:05:11.184+0100 [mongosMain] connection accepted from 172.28.0.164:53719 #1579 (703 connections now open) 2015-10-05T12:05:11.185+0100 [conn1575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:11.185+0100 [conn1576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:11.186+0100 [conn1577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:11.186+0100 [conn1578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:11.186+0100 [conn1579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:15.080+0100 [conn1267] end connection 172.28.0.164:52203 (702 connections now open) 2015-10-05T12:05:15.082+0100 [mongosMain] connection accepted from 172.28.0.164:53726 #1580 (703 connections now open) 2015-10-05T12:05:15.084+0100 [conn1580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:18.622+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:05:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:05:28.239+0100 [mongosMain] connection accepted from 127.0.0.1:49718 #1581 (704 connections now open) 2015-10-05T12:05:28.241+0100 [conn1581] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:28.242+0100 [conn1581] end connection 127.0.0.1:49718 (703 connections now open) 2015-10-05T12:05:30.136+0100 [conn1335] end connection 172.28.0.164:52476 (702 connections now open) 2015-10-05T12:05:30.463+0100 [conn600] end connection 172.28.0.163:56511 (701 connections now open) 2015-10-05T12:05:30.465+0100 [mongosMain] connection accepted from 172.28.0.163:49719 #1582 (702 connections now open) 2015-10-05T12:05:30.467+0100 [conn1582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:32.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612597c12deab02e298a9a1 2015-10-05T12:05:32.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:38.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612598212deab02e298a9dd 2015-10-05T12:05:39.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:39.826+0100 [conn1500] end connection 172.28.0.164:52641 (701 connections now open) 2015-10-05T12:05:39.827+0100 [mongosMain] connection accepted from 172.28.0.164:53759 #1583 (702 connections now open) 2015-10-05T12:05:39.839+0100 [conn1583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:39.867+0100 [conn1455] end connection 172.28.0.164:52595 (701 connections now open) 2015-10-05T12:05:39.868+0100 [mongosMain] connection accepted from 172.28.0.164:53769 #1584 (702 connections now open) 2015-10-05T12:05:39.870+0100 [conn1584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:39.889+0100 [mongosMain] connection accepted from 127.0.0.1:49722 #1585 (703 connections now open) 2015-10-05T12:05:39.891+0100 [conn1394] end connection 172.28.0.164:52534 (702 connections now open) 2015-10-05T12:05:39.891+0100 [conn1408] end connection 172.28.0.164:52548 (701 connections now open) 2015-10-05T12:05:39.891+0100 [conn1385] end connection 172.28.0.164:52525 (701 connections now open) 2015-10-05T12:05:39.892+0100 [conn1585] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:39.892+0100 [mongosMain] connection accepted from 172.28.0.164:53773 #1586 (701 connections now open) 2015-10-05T12:05:39.892+0100 [mongosMain] connection accepted from 172.28.0.164:53774 #1587 (702 connections now open) 2015-10-05T12:05:39.893+0100 [conn1585] end connection 127.0.0.1:49722 (700 connections now open) 2015-10-05T12:05:39.893+0100 [mongosMain] connection accepted from 172.28.0.164:53775 #1588 (702 connections now open) 2015-10-05T12:05:39.895+0100 [conn1587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:39.897+0100 [conn1586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:39.897+0100 [conn1588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:45.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612598912deab02e298aa23 2015-10-05T12:05:45.352+0100 [conn1416] end connection 172.28.0.164:52556 (701 connections now open) 2015-10-05T12:05:45.353+0100 [mongosMain] connection accepted from 172.28.0.164:53782 #1589 (702 connections now open) 2015-10-05T12:05:45.358+0100 [conn1589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:45.364+0100 [conn1392] end connection 172.28.0.164:52532 (701 connections now open) 2015-10-05T12:05:45.365+0100 [mongosMain] connection accepted from 172.28.0.164:53783 #1590 (702 connections now open) 2015-10-05T12:05:45.375+0100 [conn1590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:45.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:48.821+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:05:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:05:50.039+0100 [conn1390] end connection 172.28.0.164:52533 (701 connections now open) 2015-10-05T12:05:50.041+0100 [mongosMain] connection accepted from 172.28.0.164:53790 #1591 (702 connections now open) 2015-10-05T12:05:50.044+0100 [conn1591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.044+0100 [conn1397] end connection 172.28.0.164:52537 (701 connections now open) 2015-10-05T12:05:50.046+0100 [mongosMain] connection accepted from 172.28.0.164:53791 #1592 (702 connections now open) 2015-10-05T12:05:50.049+0100 [conn1592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.051+0100 [conn1420] end connection 172.28.0.164:52561 (701 connections now open) 2015-10-05T12:05:50.051+0100 [conn1398] end connection 172.28.0.164:52538 (700 connections now open) 2015-10-05T12:05:50.052+0100 [mongosMain] connection accepted from 172.28.0.164:53792 #1593 (701 connections now open) 2015-10-05T12:05:50.053+0100 [mongosMain] connection accepted from 172.28.0.164:53793 #1594 (702 connections now open) 2015-10-05T12:05:50.055+0100 [conn1593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.055+0100 [conn1395] end connection 172.28.0.164:52535 (701 connections now open) 2015-10-05T12:05:50.056+0100 [conn1594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.056+0100 [conn1434] end connection 172.28.0.164:52574 (700 connections now open) 2015-10-05T12:05:50.057+0100 [mongosMain] connection accepted from 172.28.0.164:53794 #1595 (701 connections now open) 2015-10-05T12:05:50.057+0100 [mongosMain] connection accepted from 172.28.0.164:53795 #1596 (702 connections now open) 2015-10-05T12:05:50.058+0100 [conn1424] end connection 172.28.0.164:52559 (701 connections now open) 2015-10-05T12:05:50.059+0100 [mongosMain] connection accepted from 172.28.0.164:53796 #1597 (702 connections now open) 2015-10-05T12:05:50.060+0100 [conn1595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.060+0100 [conn1596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.061+0100 [conn1597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.062+0100 [conn1404] end connection 172.28.0.164:52544 (701 connections now open) 2015-10-05T12:05:50.063+0100 [conn1409] end connection 172.28.0.164:52550 (700 connections now open) 2015-10-05T12:05:50.063+0100 [mongosMain] connection accepted from 172.28.0.164:53797 #1598 (701 connections now open) 2015-10-05T12:05:50.064+0100 [mongosMain] connection accepted from 172.28.0.164:53798 #1599 (702 connections now open) 2015-10-05T12:05:50.066+0100 [conn1598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:50.066+0100 [conn1599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:05:51.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612598f12deab02e298aa5b 2015-10-05T12:05:51.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:05:57.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612599512deab02e298aa99 2015-10-05T12:05:58.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:06:04.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612599c12deab02e298aad7 2015-10-05T12:06:04.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:06:15.096+0100 [conn1268] end connection 172.28.0.164:52206 (701 connections now open) 2015-10-05T12:06:15.097+0100 [mongosMain] connection accepted from 172.28.0.164:53815 #1600 (702 connections now open) 2015-10-05T12:06:15.100+0100 [conn1600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:06:16.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259a812deab02e298ab58 2015-10-05T12:06:16.655+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:06:18.963+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:06:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:06:28.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259b412deab02e298abd3 2015-10-05T12:06:29.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:06:29.140+0100 [mongosMain] connection accepted from 127.0.0.1:50151 #1601 (703 connections now open) 2015-10-05T12:06:29.142+0100 [conn1601] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:06:29.143+0100 [conn1601] end connection 127.0.0.1:50151 (702 connections now open) 2015-10-05T12:06:30.154+0100 [conn1338] end connection 172.28.0.164:52478 (701 connections now open) 2015-10-05T12:06:30.479+0100 [conn961] end connection 172.28.0.163:57107 (700 connections now open) 2015-10-05T12:06:30.480+0100 [mongosMain] connection accepted from 172.28.0.163:50152 #1602 (701 connections now open) 2015-10-05T12:06:30.482+0100 [conn1602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:06:39.867+0100 [mongosMain] connection accepted from 127.0.0.1:50154 #1603 (702 connections now open) 2015-10-05T12:06:39.867+0100 [conn1603] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:06:39.867+0100 [conn1603] end connection 127.0.0.1:50154 (701 connections now open) 2015-10-05T12:06:41.537+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259c112deab02e298ac3d 2015-10-05T12:06:41.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:06:49.231+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:06:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:06:53.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259cd12deab02e298acb5 2015-10-05T12:06:53.973+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:00.228+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259d312deab02e298acf6 2015-10-05T12:07:00.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:06.565+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259da12deab02e298ad3e 2015-10-05T12:07:06.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:12.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259e012deab02e298ad84 2015-10-05T12:07:12.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:15.112+0100 [conn1269] end connection 172.28.0.164:52209 (700 connections now open) 2015-10-05T12:07:15.114+0100 [mongosMain] connection accepted from 172.28.0.164:53866 #1604 (701 connections now open) 2015-10-05T12:07:15.117+0100 [conn1604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:07:19.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259e612deab02e298adc3 2015-10-05T12:07:19.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:19.408+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:07:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:07:25.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259ed12deab02e298adfc 2015-10-05T12:07:25.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:28.593+0100 [mongosMain] connection accepted from 127.0.0.1:50200 #1605 (702 connections now open) 2015-10-05T12:07:28.600+0100 [conn1605] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:07:28.601+0100 [conn1605] end connection 127.0.0.1:50200 (701 connections now open) 2015-10-05T12:07:30.167+0100 [conn1339] end connection 172.28.0.164:52479 (700 connections now open) 2015-10-05T12:07:30.534+0100 [conn950] end connection 172.28.0.163:56845 (699 connections now open) 2015-10-05T12:07:30.534+0100 [mongosMain] connection accepted from 172.28.0.163:50201 #1606 (700 connections now open) 2015-10-05T12:07:30.534+0100 [conn1606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:07:37.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561259f912deab02e298ae61 2015-10-05T12:07:37.573+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:39.619+0100 [mongosMain] connection accepted from 127.0.0.1:50203 #1607 (701 connections now open) 2015-10-05T12:07:39.622+0100 [conn1607] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:07:39.622+0100 [conn1607] end connection 127.0.0.1:50203 (700 connections now open) 2015-10-05T12:07:49.511+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:07:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:07:49.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a0512deab02e298aec7 2015-10-05T12:07:49.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:07:56.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a0b12deab02e298aef0 2015-10-05T12:07:56.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:02.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a1212deab02e298af14 2015-10-05T12:08:02.421+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:08.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a1812deab02e298af3c 2015-10-05T12:08:08.809+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:14.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a1e12deab02e298af74 2015-10-05T12:08:15.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:15.128+0100 [conn1270] end connection 172.28.0.164:52213 (699 connections now open) 2015-10-05T12:08:15.129+0100 [mongosMain] connection accepted from 172.28.0.164:53925 #1608 (700 connections now open) 2015-10-05T12:08:15.131+0100 [conn1608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:08:19.780+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:08:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:08:21.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a2512deab02e298afc8 2015-10-05T12:08:21.454+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:27.613+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a2b12deab02e298b009 2015-10-05T12:08:27.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:28.265+0100 [mongosMain] connection accepted from 127.0.0.1:50245 #1609 (701 connections now open) 2015-10-05T12:08:28.267+0100 [conn1609] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:08:28.268+0100 [conn1609] end connection 127.0.0.1:50245 (700 connections now open) 2015-10-05T12:08:30.183+0100 [conn1326] end connection 172.28.0.164:52466 (699 connections now open) 2015-10-05T12:08:30.511+0100 [conn969] end connection 172.28.0.163:57278 (698 connections now open) 2015-10-05T12:08:30.512+0100 [mongosMain] connection accepted from 172.28.0.163:50246 #1610 (699 connections now open) 2015-10-05T12:08:30.514+0100 [conn1610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:08:33.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a3112deab02e298b04c 2015-10-05T12:08:33.917+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:39.595+0100 [mongosMain] connection accepted from 127.0.0.1:50248 #1611 (700 connections now open) 2015-10-05T12:08:39.595+0100 [conn1611] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:08:39.595+0100 [conn1611] end connection 127.0.0.1:50248 (699 connections now open) 2015-10-05T12:08:40.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a3712deab02e298b093 2015-10-05T12:08:40.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:46.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a3e12deab02e298b0e1 2015-10-05T12:08:46.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:50.070+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:08:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:08:52.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a4412deab02e298b118 2015-10-05T12:08:53.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:08:59.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a4b12deab02e298b159 2015-10-05T12:08:59.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:05.747+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a5112deab02e298b187 2015-10-05T12:09:05.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:12.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a5712deab02e298b1b3 2015-10-05T12:09:12.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:15.143+0100 [conn1271] end connection 172.28.0.164:52216 (698 connections now open) 2015-10-05T12:09:15.143+0100 [mongosMain] connection accepted from 172.28.0.164:53979 #1612 (699 connections now open) 2015-10-05T12:09:15.143+0100 [conn1612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:09:18.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a5e12deab02e298b1ef 2015-10-05T12:09:18.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:20.244+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:09:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:09:24.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a6412deab02e298b233 2015-10-05T12:09:24.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:29.048+0100 [mongosMain] connection accepted from 127.0.0.1:50318 #1613 (700 connections now open) 2015-10-05T12:09:29.051+0100 [conn1613] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:09:29.052+0100 [conn1613] end connection 127.0.0.1:50318 (699 connections now open) 2015-10-05T12:09:30.179+0100 [conn1346] end connection 172.28.0.164:52486 (698 connections now open) 2015-10-05T12:09:30.543+0100 [conn958] end connection 172.28.0.163:57034 (697 connections now open) 2015-10-05T12:09:30.543+0100 [mongosMain] connection accepted from 172.28.0.163:50319 #1614 (698 connections now open) 2015-10-05T12:09:30.543+0100 [conn1614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:09:31.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a6a12deab02e298b26b 2015-10-05T12:09:31.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:37.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a7112deab02e298b2ae 2015-10-05T12:09:37.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:39.295+0100 [mongosMain] connection accepted from 127.0.0.1:50323 #1615 (699 connections now open) 2015-10-05T12:09:39.298+0100 [conn1615] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:09:39.298+0100 [conn1615] end connection 127.0.0.1:50323 (698 connections now open) 2015-10-05T12:09:49.648+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a7d12deab02e298b31a 2015-10-05T12:09:49.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:09:50.472+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:09:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:09:55.869+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:09:55.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:10:02.024+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a8912deab02e298b37e 2015-10-05T12:10:02.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:08.210+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:10:08.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:10:14.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a9612deab02e298b40d 2015-10-05T12:10:14.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:15.154+0100 [conn1272] end connection 172.28.0.164:52220 (697 connections now open) 2015-10-05T12:10:15.170+0100 [mongosMain] connection accepted from 172.28.0.164:54030 #1616 (698 connections now open) 2015-10-05T12:10:15.170+0100 [conn1616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:10:20.739+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:10:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:10:20.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125a9c12deab02e298b441 2015-10-05T12:10:21.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:27.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125aa312deab02e298b491 2015-10-05T12:10:27.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:28.842+0100 [mongosMain] connection accepted from 127.0.0.1:50383 #1617 (699 connections now open) 2015-10-05T12:10:28.845+0100 [conn1617] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:10:28.846+0100 [conn1617] end connection 127.0.0.1:50383 (698 connections now open) 2015-10-05T12:10:30.196+0100 [conn1347] end connection 172.28.0.164:52487 (697 connections now open) 2015-10-05T12:10:30.523+0100 [conn766] end connection 172.28.0.163:56613 (696 connections now open) 2015-10-05T12:10:30.524+0100 [mongosMain] connection accepted from 172.28.0.163:50384 #1618 (697 connections now open) 2015-10-05T12:10:30.526+0100 [conn1618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:10:33.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125aa912deab02e298b4da 2015-10-05T12:10:33.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:39.295+0100 [mongosMain] connection accepted from 127.0.0.1:50390 #1619 (698 connections now open) 2015-10-05T12:10:39.310+0100 [conn1619] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:10:39.310+0100 [conn1619] end connection 127.0.0.1:50390 (697 connections now open) 2015-10-05T12:10:40.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125aaf12deab02e298b510 2015-10-05T12:10:40.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:43.895+0100 [mongosMain] connection accepted from 172.28.0.163:50395 #1620 (698 connections now open) 2015-10-05T12:10:46.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ab612deab02e298b545 2015-10-05T12:10:46.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:47.901+0100 [mongosMain] connection accepted from 172.28.0.163:50400 #1621 (699 connections now open) 2015-10-05T12:10:50.917+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:10:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:10:52.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125abc12deab02e298b580 2015-10-05T12:10:53.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:10:59.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ac312deab02e298b5c1 2015-10-05T12:10:59.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:05.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ac912deab02e298b603 2015-10-05T12:11:05.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:11.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125acf12deab02e298b640 2015-10-05T12:11:12.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:15.187+0100 [conn1273] end connection 172.28.0.164:52223 (698 connections now open) 2015-10-05T12:11:15.187+0100 [mongosMain] connection accepted from 172.28.0.164:54079 #1622 (699 connections now open) 2015-10-05T12:11:15.202+0100 [conn1622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:11:18.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ad612deab02e298b68e 2015-10-05T12:11:18.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:21.131+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:11:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:11:24.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125adc12deab02e298b6ed 2015-10-05T12:11:24.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:28.472+0100 [mongosMain] connection accepted from 127.0.0.1:50461 #1623 (700 connections now open) 2015-10-05T12:11:28.475+0100 [conn1623] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:11:28.476+0100 [conn1623] end connection 127.0.0.1:50461 (699 connections now open) 2015-10-05T12:11:30.225+0100 [conn1341] end connection 172.28.0.164:52481 (698 connections now open) 2015-10-05T12:11:30.537+0100 [conn947] end connection 172.28.0.163:56773 (697 connections now open) 2015-10-05T12:11:30.539+0100 [mongosMain] connection accepted from 172.28.0.163:50462 #1624 (698 connections now open) 2015-10-05T12:11:30.540+0100 [conn1624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:11:31.020+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ae212deab02e298b738 2015-10-05T12:11:31.088+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:32.494+0100 [conn418] end connection 172.28.0.163:54870 (697 connections now open) 2015-10-05T12:11:37.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ae912deab02e298b76a 2015-10-05T12:11:37.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:39.464+0100 [mongosMain] connection accepted from 127.0.0.1:50469 #1625 (698 connections now open) 2015-10-05T12:11:39.466+0100 [conn1625] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:11:39.466+0100 [conn1625] end connection 127.0.0.1:50469 (697 connections now open) 2015-10-05T12:11:43.686+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125aef12deab02e298b7a6 2015-10-05T12:11:43.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:45.938+0100 [conn1620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:11:49.495+0100 [conn435] end connection 172.28.0.163:54895 (696 connections now open) 2015-10-05T12:11:49.495+0100 [conn999] end connection 172.28.0.163:57307 (695 connections now open) 2015-10-05T12:11:49.496+0100 [conn1225] end connection 172.28.0.163:58578 (694 connections now open) 2015-10-05T12:11:49.496+0100 [conn1207] end connection 172.28.0.163:58559 (693 connections now open) 2015-10-05T12:11:49.496+0100 [conn419] end connection 172.28.0.163:54871 (692 connections now open) 2015-10-05T12:11:49.496+0100 [conn39] end connection 172.28.0.163:52325 (691 connections now open) 2015-10-05T12:11:49.497+0100 [conn483] end connection 172.28.0.163:55001 (690 connections now open) 2015-10-05T12:11:49.497+0100 [conn1244] end connection 172.28.0.163:58625 (689 connections now open) 2015-10-05T12:11:49.497+0100 [conn410] end connection 172.28.0.163:54859 (689 connections now open) 2015-10-05T12:11:49.497+0100 [conn406] end connection 172.28.0.163:54851 (689 connections now open) 2015-10-05T12:11:49.497+0100 [conn1242] end connection 172.28.0.163:58623 (687 connections now open) 2015-10-05T12:11:49.497+0100 [conn439] end connection 172.28.0.163:54900 (685 connections now open) 2015-10-05T12:11:49.498+0100 [conn421] end connection 172.28.0.163:54874 (685 connections now open) 2015-10-05T12:11:49.498+0100 [conn1175] end connection 172.28.0.163:58525 (684 connections now open) 2015-10-05T12:11:49.498+0100 [conn436] end connection 172.28.0.163:54897 (682 connections now open) 2015-10-05T12:11:49.498+0100 [conn482] end connection 172.28.0.163:54996 (681 connections now open) 2015-10-05T12:11:49.498+0100 [conn1144] end connection 172.28.0.163:58179 (681 connections now open) 2015-10-05T12:11:49.499+0100 [conn1202] end connection 172.28.0.163:58554 (679 connections now open) 2015-10-05T12:11:49.499+0100 [conn1227] end connection 172.28.0.163:58580 (678 connections now open) 2015-10-05T12:11:49.499+0100 [conn414] end connection 172.28.0.163:54864 (678 connections now open) 2015-10-05T12:11:49.499+0100 [conn1216] end connection 172.28.0.163:58568 (676 connections now open) 2015-10-05T12:11:49.499+0100 [conn976] end connection 172.28.0.163:57285 (676 connections now open) 2015-10-05T12:11:49.499+0100 [conn974] end connection 172.28.0.163:57283 (676 connections now open) 2015-10-05T12:11:49.499+0100 [conn1203] end connection 172.28.0.163:58555 (676 connections now open) 2015-10-05T12:11:49.499+0100 [conn477] end connection 172.28.0.163:54958 (674 connections now open) 2015-10-05T12:11:49.499+0100 [conn472] end connection 172.28.0.163:54948 (673 connections now open) 2015-10-05T12:11:49.499+0100 [conn970] end connection 172.28.0.163:57279 (670 connections now open) 2015-10-05T12:11:49.499+0100 [conn428] end connection 172.28.0.163:54883 (670 connections now open) 2015-10-05T12:11:49.499+0100 [conn456] end connection 172.28.0.163:54924 (668 connections now open) 2015-10-05T12:11:49.500+0100 [conn493] end connection 172.28.0.163:55015 (667 connections now open) 2015-10-05T12:11:49.500+0100 [conn524] end connection 172.28.0.163:55388 (667 connections now open) 2015-10-05T12:11:49.500+0100 [conn405] end connection 172.28.0.163:54847 (667 connections now open) 2015-10-05T12:11:49.500+0100 [conn411] end connection 172.28.0.163:54861 (666 connections now open) 2015-10-05T12:11:49.500+0100 [conn485] end connection 172.28.0.163:55008 (663 connections now open) 2015-10-05T12:11:49.500+0100 [conn1137] end connection 172.28.0.163:58125 (662 connections now open) 2015-10-05T12:11:49.501+0100 [conn468] end connection 172.28.0.163:54943 (662 connections now open) 2015-10-05T12:11:49.501+0100 [conn1180] end connection 172.28.0.163:58532 (660 connections now open) 2015-10-05T12:11:49.501+0100 [conn1082] end connection 172.28.0.163:57707 (659 connections now open) 2015-10-05T12:11:49.501+0100 [conn1243] end connection 172.28.0.163:58624 (659 connections now open) 2015-10-05T12:11:49.501+0100 [conn1519] end connection 172.28.0.163:59390 (657 connections now open) 2015-10-05T12:11:49.501+0100 [conn1172] end connection 172.28.0.163:58496 (657 connections now open) 2015-10-05T12:11:49.502+0100 [conn1102] end connection 172.28.0.163:57939 (655 connections now open) 2015-10-05T12:11:49.502+0100 [conn496] end connection 172.28.0.163:55018 (655 connections now open) 2015-10-05T12:11:49.502+0100 [conn532] end connection 172.28.0.163:55415 (653 connections now open) 2015-10-05T12:11:49.502+0100 [conn1051] end connection 172.28.0.163:57582 (653 connections now open) 2015-10-05T12:11:49.502+0100 [conn1061] end connection 172.28.0.163:57641 (651 connections now open) 2015-10-05T12:11:49.502+0100 [conn1080] end connection 172.28.0.163:57705 (650 connections now open) 2015-10-05T12:11:49.502+0100 [conn1194] end connection 172.28.0.163:58546 (649 connections now open) 2015-10-05T12:11:49.503+0100 [conn1035] end connection 172.28.0.163:57525 (649 connections now open) 2015-10-05T12:11:49.503+0100 [conn179] end connection 172.28.0.163:52610 (647 connections now open) 2015-10-05T12:11:49.503+0100 [conn1065] end connection 172.28.0.163:57645 (647 connections now open) 2015-10-05T12:11:49.503+0100 [conn1086] end connection 172.28.0.163:57718 (646 connections now open) 2015-10-05T12:11:49.503+0100 [conn1174] end connection 172.28.0.163:58524 (645 connections now open) 2015-10-05T12:11:49.503+0100 [conn366] end connection 172.28.0.163:54779 (644 connections now open) 2015-10-05T12:11:49.503+0100 [conn1105] end connection 172.28.0.163:57942 (644 connections now open) 2015-10-05T12:11:49.503+0100 [conn1196] end connection 172.28.0.163:58548 (643 connections now open) 2015-10-05T12:11:49.503+0100 [conn1215] end connection 172.28.0.163:58567 (642 connections now open) 2015-10-05T12:11:49.503+0100 [conn220] end connection 172.28.0.163:53337 (641 connections now open) 2015-10-05T12:11:49.503+0100 [conn1182] end connection 172.28.0.163:58534 (640 connections now open) 2015-10-05T12:11:49.503+0100 [conn1515] end connection 172.28.0.163:59367 (640 connections now open) 2015-10-05T12:11:49.503+0100 [conn1226] end connection 172.28.0.163:58579 (638 connections now open) 2015-10-05T12:11:49.503+0100 [conn369] end connection 172.28.0.163:54783 (637 connections now open) 2015-10-05T12:11:49.503+0100 [conn1103] end connection 172.28.0.163:57940 (636 connections now open) 2015-10-05T12:11:49.503+0100 [conn1181] end connection 172.28.0.163:58533 (635 connections now open) 2015-10-05T12:11:49.503+0100 [conn991] end connection 172.28.0.163:57299 (638 connections now open) 2015-10-05T12:11:49.503+0100 [conn1241] end connection 172.28.0.163:58622 (633 connections now open) 2015-10-05T12:11:49.503+0100 [conn1223] end connection 172.28.0.163:58576 (630 connections now open) 2015-10-05T12:11:49.503+0100 [conn1218] end connection 172.28.0.163:58570 (630 connections now open) 2015-10-05T12:11:49.504+0100 [conn1161] end connection 172.28.0.163:58381 (630 connections now open) 2015-10-05T12:11:49.504+0100 [conn1210] end connection 172.28.0.163:58562 (630 connections now open) 2015-10-05T12:11:49.504+0100 [conn1050] end connection 172.28.0.163:57581 (627 connections now open) 2015-10-05T12:11:49.504+0100 [conn246] end connection 172.28.0.163:53474 (628 connections now open) 2015-10-05T12:11:49.504+0100 [conn349] end connection 172.28.0.163:54749 (626 connections now open) 2015-10-05T12:11:49.504+0100 [conn1214] end connection 172.28.0.163:58566 (625 connections now open) 2015-10-05T12:11:49.504+0100 [conn344] end connection 172.28.0.163:54743 (623 connections now open) 2015-10-05T12:11:49.504+0100 [conn355] end connection 172.28.0.163:54768 (623 connections now open) 2015-10-05T12:11:49.504+0100 [conn1198] end connection 172.28.0.163:58550 (623 connections now open) 2015-10-05T12:11:49.504+0100 [conn351] end connection 172.28.0.163:54753 (624 connections now open) 2015-10-05T12:11:49.504+0100 [conn1186] end connection 172.28.0.163:58538 (620 connections now open) 2015-10-05T12:11:49.504+0100 [conn331] end connection 172.28.0.163:54717 (620 connections now open) 2015-10-05T12:11:49.504+0100 [conn339] end connection 172.28.0.163:54737 (618 connections now open) 2015-10-05T12:11:49.504+0100 [conn347] end connection 172.28.0.163:54747 (622 connections now open) 2015-10-05T12:11:49.504+0100 [conn1239] end connection 172.28.0.163:58620 (622 connections now open) 2015-10-05T12:11:49.504+0100 [conn330] end connection 172.28.0.163:54728 (621 connections now open) 2015-10-05T12:11:49.504+0100 [conn352] end connection 172.28.0.163:54757 (621 connections now open) 2015-10-05T12:11:49.504+0100 [conn345] end connection 172.28.0.163:54741 (613 connections now open) 2015-10-05T12:11:49.504+0100 [conn1228] end connection 172.28.0.163:58581 (623 connections now open) 2015-10-05T12:11:49.504+0100 [conn1028] end connection 172.28.0.163:57518 (623 connections now open) 2015-10-05T12:11:49.504+0100 [conn320] end connection 172.28.0.163:54714 (609 connections now open) 2015-10-05T12:11:49.504+0100 [conn978] end connection 172.28.0.163:57287 (617 connections now open) 2015-10-05T12:11:49.504+0100 [conn318] end connection 172.28.0.163:54713 (615 connections now open) 2015-10-05T12:11:49.505+0100 [conn296] end connection 172.28.0.163:53863 (607 connections now open) 2015-10-05T12:11:49.504+0100 [conn322] end connection 172.28.0.163:54719 (614 connections now open) 2015-10-05T12:11:49.504+0100 [conn295] end connection 172.28.0.163:53862 (620 connections now open) 2015-10-05T12:11:49.504+0100 [conn1190] end connection 172.28.0.163:58542 (611 connections now open) 2015-10-05T12:11:49.504+0100 [conn319] end connection 172.28.0.163:54715 (610 connections now open) 2015-10-05T12:11:49.504+0100 [conn317] end connection 172.28.0.163:54712 (610 connections now open) 2015-10-05T12:11:49.505+0100 [conn1040] end connection 172.28.0.163:57534 (600 connections now open) 2015-10-05T12:11:49.504+0100 [conn293] end connection 172.28.0.163:53860 (609 connections now open) 2015-10-05T12:11:49.504+0100 [conn325] end connection 172.28.0.163:54723 (614 connections now open) 2015-10-05T12:11:49.505+0100 [conn1010] end connection 172.28.0.163:57499 (597 connections now open) 2015-10-05T12:11:49.505+0100 [conn1055] end connection 172.28.0.163:57635 (604 connections now open) 2015-10-05T12:11:49.505+0100 [conn1171] end connection 172.28.0.163:58487 (596 connections now open) 2015-10-05T12:11:49.505+0100 [conn282] end connection 172.28.0.163:53695 (602 connections now open) 2015-10-05T12:11:49.505+0100 [conn1109] end connection 172.28.0.163:57952 (601 connections now open) 2015-10-05T12:11:49.504+0100 [conn1209] end connection 172.28.0.163:58561 (623 connections now open) 2015-10-05T12:11:49.505+0100 [conn127] end connection 172.28.0.163:52504 (592 connections now open) 2015-10-05T12:11:49.505+0100 [conn270] end connection 172.28.0.163:53586 (598 connections now open) 2015-10-05T12:11:49.505+0100 [conn276] end connection 172.28.0.163:53689 (598 connections now open) 2015-10-05T12:11:49.505+0100 [conn291] end connection 172.28.0.163:53858 (607 connections now open) 2015-10-05T12:11:49.505+0100 [conn1036] end connection 172.28.0.163:57526 (597 connections now open) 2015-10-05T12:11:49.505+0100 [conn100] end connection 172.28.0.163:52451 (588 connections now open) 2015-10-05T12:11:49.505+0100 [conn281] end connection 172.28.0.163:53694 (594 connections now open) 2015-10-05T12:11:49.506+0100 [conn146] end connection 172.28.0.163:52542 (584 connections now open) 2015-10-05T12:11:49.505+0100 [conn973] end connection 172.28.0.163:57282 (593 connections now open) 2015-10-05T12:11:49.506+0100 [conn268] end connection 172.28.0.163:53584 (582 connections now open) 2015-10-05T12:11:49.506+0100 [conn997] end connection 172.28.0.163:57305 (582 connections now open) 2015-10-05T12:11:49.505+0100 [conn1163] end connection 172.28.0.163:58383 (590 connections now open) 2015-10-05T12:11:49.505+0100 [conn987] end connection 172.28.0.163:57295 (589 connections now open) 2015-10-05T12:11:49.505+0100 [conn1079] end connection 172.28.0.163:57704 (588 connections now open) 2015-10-05T12:11:49.505+0100 [conn20] end connection 172.28.0.163:52277 (588 connections now open) 2015-10-05T12:11:49.505+0100 [conn1142] end connection 172.28.0.163:58177 (603 connections now open) 2015-10-05T12:11:49.506+0100 [conn1041] end connection 172.28.0.163:57535 (586 connections now open) 2015-10-05T12:11:49.506+0100 [conn229] end connection 172.28.0.163:53377 (584 connections now open) 2015-10-05T12:11:49.506+0100 [conn1110] end connection 172.28.0.163:57954 (584 connections now open) 2015-10-05T12:11:49.505+0100 [conn68] end connection 172.28.0.163:52380 (598 connections now open) 2015-10-05T12:11:49.505+0100 [conn76] end connection 172.28.0.163:52401 (592 connections now open) 2015-10-05T12:11:49.506+0100 [conn266] end connection 172.28.0.163:53582 (581 connections now open) 2015-10-05T12:11:49.506+0100 [conn1138] end connection 172.28.0.163:58126 (570 connections now open) 2015-10-05T12:11:49.506+0100 [conn1133] end connection 172.28.0.163:58118 (580 connections now open) 2015-10-05T12:11:49.506+0100 [conn1059] end connection 172.28.0.163:57639 (579 connections now open) 2015-10-05T12:11:49.506+0100 [conn1134] end connection 172.28.0.163:58122 (578 connections now open) 2015-10-05T12:11:49.506+0100 [conn235] end connection 172.28.0.163:53393 (566 connections now open) 2015-10-05T12:11:49.506+0100 [conn1146] end connection 172.28.0.163:58181 (576 connections now open) 2015-10-05T12:11:49.506+0100 [conn267] end connection 172.28.0.163:53583 (576 connections now open) 2015-10-05T12:11:49.506+0100 [conn265] end connection 172.28.0.163:53546 (575 connections now open) 2015-10-05T12:11:49.506+0100 [conn1141] end connection 172.28.0.163:58163 (574 connections now open) 2015-10-05T12:11:49.506+0100 [conn1032] end connection 172.28.0.163:57522 (573 connections now open) 2015-10-05T12:11:49.506+0100 [conn988] end connection 172.28.0.163:57296 (573 connections now open) 2015-10-05T12:11:49.507+0100 [conn994] end connection 172.28.0.163:57302 (559 connections now open) 2015-10-05T12:11:49.506+0100 [conn1136] end connection 172.28.0.163:58124 (571 connections now open) 2015-10-05T12:11:49.506+0100 [conn1135] end connection 172.28.0.163:58123 (571 connections now open) 2015-10-05T12:11:49.506+0100 [conn1139] end connection 172.28.0.163:58160 (580 connections now open) 2015-10-05T12:11:49.506+0100 [conn249] end connection 172.28.0.163:53484 (570 connections now open) 2015-10-05T12:11:49.506+0100 [conn1160] end connection 172.28.0.163:58380 (568 connections now open) 2015-10-05T12:11:49.506+0100 [conn1071] end connection 172.28.0.163:57651 (568 connections now open) 2015-10-05T12:11:49.506+0100 [conn1145] end connection 172.28.0.163:58180 (566 connections now open) 2015-10-05T12:11:49.506+0100 [conn248] end connection 172.28.0.163:53480 (576 connections now open) 2015-10-05T12:11:49.507+0100 [conn143] end connection 172.28.0.163:52537 (565 connections now open) 2015-10-05T12:11:49.507+0100 [conn114] end connection 172.28.0.163:52477 (564 connections now open) 2015-10-05T12:11:49.507+0100 [conn139] end connection 172.28.0.163:52529 (563 connections now open) 2015-10-05T12:11:49.507+0100 [conn75] end connection 172.28.0.163:52399 (563 connections now open) 2015-10-05T12:11:49.507+0100 [conn1011] end connection 172.28.0.163:57500 (561 connections now open) 2015-10-05T12:11:49.507+0100 [conn113] end connection 172.28.0.163:52476 (561 connections now open) 2015-10-05T12:11:49.507+0100 [conn1033] end connection 172.28.0.163:57523 (560 connections now open) 2015-10-05T12:11:49.507+0100 [conn38] end connection 172.28.0.163:52324 (560 connections now open) 2015-10-05T12:11:49.507+0100 [conn1106] end connection 172.28.0.163:57946 (556 connections now open) 2015-10-05T12:11:49.507+0100 [conn1007] end connection 172.28.0.163:57494 (556 connections now open) 2015-10-05T12:11:49.507+0100 [conn1048] end connection 172.28.0.163:57579 (556 connections now open) 2015-10-05T12:11:49.507+0100 [conn41] end connection 172.28.0.163:52328 (556 connections now open) 2015-10-05T12:11:49.508+0100 [conn1034] end connection 172.28.0.163:57524 (538 connections now open) 2015-10-05T12:11:49.507+0100 [conn1013] end connection 172.28.0.163:57503 (554 connections now open) 2015-10-05T12:11:49.507+0100 [conn1015] end connection 172.28.0.163:57505 (551 connections now open) 2015-10-05T12:11:49.507+0100 [conn1085] end connection 172.28.0.163:57717 (551 connections now open) 2015-10-05T12:11:49.507+0100 [conn1021] end connection 172.28.0.163:57511 (551 connections now open) 2015-10-05T12:11:49.507+0100 [conn245] end connection 172.28.0.163:53472 (551 connections now open) 2015-10-05T12:11:49.507+0100 [conn120] end connection 172.28.0.163:52491 (550 connections now open) 2015-10-05T12:11:49.508+0100 [conn71] end connection 172.28.0.163:52390 (531 connections now open) 2015-10-05T12:11:49.507+0100 [conn64] end connection 172.28.0.163:52373 (550 connections now open) 2015-10-05T12:11:49.507+0100 [conn61] end connection 172.28.0.163:52369 (549 connections now open) 2015-10-05T12:11:49.507+0100 [conn984] end connection 172.28.0.163:57292 (548 connections now open) 2015-10-05T12:11:49.507+0100 [conn78] end connection 172.28.0.163:52404 (547 connections now open) 2015-10-05T12:11:49.507+0100 [conn104] end connection 172.28.0.163:52459 (545 connections now open) 2015-10-05T12:11:49.508+0100 [conn1125] end connection 172.28.0.163:58086 (525 connections now open) 2015-10-05T12:11:49.508+0100 [conn13] end connection 172.28.0.163:52268 (545 connections now open) 2015-10-05T12:11:49.508+0100 [conn1189] end connection 172.28.0.163:58541 (543 connections now open) 2015-10-05T12:11:49.508+0100 [conn176] end connection 172.28.0.163:52604 (541 connections now open) 2015-10-05T12:11:49.508+0100 [conn1043] end connection 172.28.0.163:57537 (540 connections now open) 2015-10-05T12:11:49.509+0100 [conn985] end connection 172.28.0.163:57293 (520 connections now open) 2015-10-05T12:11:49.507+0100 [conn150] end connection 172.28.0.163:52552 (555 connections now open) 2015-10-05T12:11:49.508+0100 [conn167] end connection 172.28.0.163:52586 (537 connections now open) 2015-10-05T12:11:49.508+0100 [conn88] end connection 172.28.0.163:52424 (536 connections now open) 2015-10-05T12:11:49.508+0100 [conn1069] end connection 172.28.0.163:57649 (536 connections now open) 2015-10-05T12:11:49.508+0100 [conn1038] end connection 172.28.0.163:57528 (534 connections now open) 2015-10-05T12:11:49.508+0100 [conn1072] end connection 172.28.0.163:57652 (533 connections now open) 2015-10-05T12:11:49.508+0100 [conn1108] end connection 172.28.0.163:57948 (535 connections now open) 2015-10-05T12:11:49.509+0100 [conn147] end connection 172.28.0.163:52545 (513 connections now open) 2015-10-05T12:11:49.508+0100 [conn72] end connection 172.28.0.163:52392 (528 connections now open) 2015-10-05T12:11:49.508+0100 [conn1030] end connection 172.28.0.163:57520 (527 connections now open) 2015-10-05T12:11:49.508+0100 [conn94] end connection 172.28.0.163:52439 (526 connections now open) 2015-10-05T12:11:49.508+0100 [conn1009] end connection 172.28.0.163:57498 (525 connections now open) 2015-10-05T12:11:49.508+0100 [conn156] end connection 172.28.0.163:52561 (525 connections now open) 2015-10-05T12:11:49.509+0100 [conn980] end connection 172.28.0.163:57288 (505 connections now open) 2015-10-05T12:11:49.508+0100 [conn77] end connection 172.28.0.163:52403 (524 connections now open) 2015-10-05T12:11:49.509+0100 [conn1084] end connection 172.28.0.163:57714 (524 connections now open) 2015-10-05T12:11:49.509+0100 [conn1073] end connection 172.28.0.163:57653 (503 connections now open) 2015-10-05T12:11:49.509+0100 [conn1083] end connection 172.28.0.163:57713 (519 connections now open) 2015-10-05T12:11:49.509+0100 [conn1066] end connection 172.28.0.163:57646 (501 connections now open) 2015-10-05T12:11:49.509+0100 [conn1018] end connection 172.28.0.163:57508 (500 connections now open) 2015-10-05T12:11:49.510+0100 [conn1124] end connection 172.28.0.163:58085 (499 connections now open) 2015-10-05T12:11:49.509+0100 [conn1140] end connection 172.28.0.163:58162 (515 connections now open) 2015-10-05T12:11:49.509+0100 [conn73] end connection 172.28.0.163:52395 (515 connections now open) 2015-10-05T12:11:49.509+0100 [conn1127] end connection 172.28.0.163:58088 (515 connections now open) 2015-10-05T12:11:49.509+0100 [conn1057] end connection 172.28.0.163:57637 (514 connections now open) 2015-10-05T12:11:49.510+0100 [conn40] end connection 172.28.0.163:52327 (494 connections now open) 2015-10-05T12:11:49.508+0100 [conn141] end connection 172.28.0.163:52532 (532 connections now open) 2015-10-05T12:11:49.509+0100 [conn1005] end connection 172.28.0.163:57489 (511 connections now open) 2015-10-05T12:11:49.509+0100 [conn74] end connection 172.28.0.163:52397 (509 connections now open) 2015-10-05T12:11:49.509+0100 [conn1022] end connection 172.28.0.163:57512 (509 connections now open) 2015-10-05T12:11:49.509+0100 [conn134] end connection 172.28.0.163:52519 (508 connections now open) 2015-10-05T12:11:49.509+0100 [conn97] end connection 172.28.0.163:52444 (506 connections now open) 2015-10-05T12:11:49.510+0100 [conn1132] end connection 172.28.0.163:58117 (487 connections now open) 2015-10-05T12:11:49.508+0100 [conn180] end connection 172.28.0.163:52611 (545 connections now open) 2015-10-05T12:11:49.510+0100 [conn1026] end connection 172.28.0.163:57516 (485 connections now open) 2015-10-05T12:11:49.509+0100 [conn183] end connection 172.28.0.163:52617 (502 connections now open) 2015-10-05T12:11:49.510+0100 [conn79] end connection 172.28.0.163:52405 (482 connections now open) 2015-10-05T12:11:49.509+0100 [conn1024] end connection 172.28.0.163:57514 (518 connections now open) 2015-10-05T12:11:49.509+0100 [conn121] end connection 172.28.0.163:52492 (516 connections now open) 2015-10-05T12:11:49.509+0100 [conn1143] end connection 172.28.0.163:58178 (516 connections now open) 2015-10-05T12:11:49.510+0100 [conn1068] end connection 172.28.0.163:57648 (479 connections now open) 2015-10-05T12:11:49.510+0100 [conn1027] end connection 172.28.0.163:57517 (497 connections now open) 2015-10-05T12:11:49.510+0100 [conn1058] end connection 172.28.0.163:57638 (495 connections now open) 2015-10-05T12:11:49.511+0100 [conn1121] end connection 172.28.0.163:58082 (476 connections now open) 2015-10-05T12:11:49.509+0100 [conn66] end connection 172.28.0.163:52378 (513 connections now open) 2015-10-05T12:11:49.510+0100 [conn122] end connection 172.28.0.163:52495 (493 connections now open) 2015-10-05T12:11:49.510+0100 [conn23] end connection 172.28.0.163:52291 (492 connections now open) 2015-10-05T12:11:49.510+0100 [conn241] end connection 172.28.0.163:53460 (491 connections now open) 2015-10-05T12:11:49.510+0100 [conn1025] end connection 172.28.0.163:57515 (491 connections now open) 2015-10-05T12:11:49.510+0100 [conn1060] end connection 172.28.0.163:57640 (489 connections now open) 2015-10-05T12:11:49.510+0100 [conn1014] end connection 172.28.0.163:57504 (488 connections now open) 2015-10-05T12:11:49.510+0100 [conn1029] end connection 172.28.0.163:57519 (487 connections now open) 2015-10-05T12:11:49.509+0100 [conn29] end connection 172.28.0.163:52303 (505 connections now open) 2015-10-05T12:11:49.510+0100 [conn166] end connection 172.28.0.163:52583 (486 connections now open) 2015-10-05T12:11:49.508+0100 [conn49] end connection 172.28.0.163:52344 (539 connections now open) 2015-10-05T12:11:49.510+0100 [conn36] end connection 172.28.0.163:52322 (484 connections now open) 2015-10-05T12:11:49.510+0100 [conn1056] end connection 172.28.0.163:57636 (483 connections now open) 2015-10-05T12:11:49.509+0100 [conn1126] end connection 172.28.0.163:58087 (501 connections now open) 2015-10-05T12:11:49.510+0100 [conn85] end connection 172.28.0.163:52419 (481 connections now open) 2015-10-05T12:11:49.510+0100 [conn1039] end connection 172.28.0.163:57529 (481 connections now open) 2015-10-05T12:11:49.510+0100 [conn1037] end connection 172.28.0.163:57527 (480 connections now open) 2015-10-05T12:11:49.510+0100 [conn1031] end connection 172.28.0.163:57521 (498 connections now open) 2015-10-05T12:11:49.510+0100 [conn107] end connection 172.28.0.163:52463 (478 connections now open) 2015-10-05T12:11:49.511+0100 [conn105] end connection 172.28.0.163:52461 (477 connections now open) 2015-10-05T12:11:49.511+0100 [conn1081] end connection 172.28.0.163:57706 (474 connections now open) 2015-10-05T12:11:49.511+0100 [conn26] end connection 172.28.0.163:52300 (472 connections now open) 2015-10-05T12:11:49.511+0100 [conn1023] end connection 172.28.0.163:57513 (471 connections now open) 2015-10-05T12:11:49.511+0100 [conn1049] end connection 172.28.0.163:57580 (470 connections now open) 2015-10-05T12:11:49.511+0100 [conn242] end connection 172.28.0.163:53459 (470 connections now open) 2015-10-05T12:11:49.512+0100 [conn227] end connection 172.28.0.163:53372 (450 connections now open) 2015-10-05T12:11:49.511+0100 [conn90] end connection 172.28.0.163:52429 (467 connections now open) 2015-10-05T12:11:49.511+0100 [conn1074] end connection 172.28.0.163:57654 (466 connections now open) 2015-10-05T12:11:49.511+0100 [conn1123] end connection 172.28.0.163:58084 (462 connections now open) 2015-10-05T12:11:49.511+0100 [conn1062] end connection 172.28.0.163:57642 (462 connections now open) 2015-10-05T12:11:49.511+0100 [conn1054] end connection 172.28.0.163:57634 (461 connections now open) 2015-10-05T12:11:49.511+0100 [conn230] end connection 172.28.0.163:53380 (458 connections now open) 2015-10-05T12:11:49.511+0100 [conn119] end connection 172.28.0.163:52489 (458 connections now open) 2015-10-05T12:11:49.511+0100 [conn140] end connection 172.28.0.163:52531 (456 connections now open) 2015-10-05T12:11:49.512+0100 [conn1208] end connection 172.28.0.163:58560 (450 connections now open) 2015-10-05T12:11:49.512+0100 [conn998] end connection 172.28.0.163:57306 (450 connections now open) 2015-10-05T12:11:49.511+0100 [conn126] end connection 172.28.0.163:52503 (469 connections now open) 2015-10-05T12:11:49.512+0100 [conn162] end connection 172.28.0.163:52576 (448 connections now open) 2015-10-05T12:11:49.512+0100 [conn525] end connection 172.28.0.163:55389 (447 connections now open) 2015-10-05T12:11:49.512+0100 [conn437] end connection 172.28.0.163:54898 (446 connections now open) 2015-10-05T12:11:49.512+0100 [conn982] end connection 172.28.0.163:57290 (445 connections now open) 2015-10-05T12:11:49.512+0100 [conn231] end connection 172.28.0.163:53382 (434 connections now open) 2015-10-05T12:11:49.512+0100 [conn1052] end connection 172.28.0.163:57583 (441 connections now open) 2015-10-05T12:11:49.512+0100 [conn1008] end connection 172.28.0.163:57496 (440 connections now open) 2015-10-05T12:11:49.513+0100 [conn1204] end connection 172.28.0.163:58556 (430 connections now open) 2015-10-05T12:11:49.512+0100 [conn67] end connection 172.28.0.163:52379 (438 connections now open) 2015-10-05T12:11:49.512+0100 [conn1067] end connection 172.28.0.163:57647 (435 connections now open) 2015-10-05T12:11:49.512+0100 [conn1173] end connection 172.28.0.163:58497 (443 connections now open) 2015-10-05T12:11:49.512+0100 [conn1122] end connection 172.28.0.163:58083 (433 connections now open) 2015-10-05T12:11:49.512+0100 [conn69] end connection 172.28.0.163:52382 (439 connections now open) 2015-10-05T12:11:49.513+0100 [conn983] end connection 172.28.0.163:57291 (428 connections now open) 2015-10-05T12:11:49.513+0100 [conn1251] end connection 172.28.0.163:58674 (426 connections now open) 2015-10-05T12:11:49.513+0100 [conn446] end connection 172.28.0.163:54911 (423 connections now open) 2015-10-05T12:11:49.513+0100 [conn95] end connection 172.28.0.163:52441 (423 connections now open) 2015-10-05T12:11:49.513+0100 [conn1020] end connection 172.28.0.163:57510 (421 connections now open) 2015-10-05T12:11:49.513+0100 [conn1063] end connection 172.28.0.163:57643 (421 connections now open) 2015-10-05T12:11:49.513+0100 [conn57] end connection 172.28.0.163:52360 (419 connections now open) 2015-10-05T12:11:49.513+0100 [conn164] end connection 172.28.0.163:52580 (418 connections now open) 2015-10-05T12:11:49.513+0100 [conn221] end connection 172.28.0.163:53338 (415 connections now open) 2015-10-05T12:11:49.513+0100 [conn1017] end connection 172.28.0.163:57507 (415 connections now open) 2015-10-05T12:11:49.513+0100 [conn1006] end connection 172.28.0.163:57493 (414 connections now open) 2015-10-05T12:11:49.513+0100 [conn86] end connection 172.28.0.163:52421 (412 connections now open) 2015-10-05T12:11:49.514+0100 [conn990] end connection 172.28.0.163:57298 (412 connections now open) 2015-10-05T12:11:49.514+0100 [conn1042] end connection 172.28.0.163:57536 (410 connections now open) 2015-10-05T12:11:49.514+0100 [conn144] end connection 172.28.0.163:52539 (409 connections now open) 2015-10-05T12:11:49.514+0100 [conn458] end connection 172.28.0.163:54928 (409 connections now open) 2015-10-05T12:11:49.514+0100 [conn1199] end connection 172.28.0.163:58551 (408 connections now open) 2015-10-05T12:11:49.514+0100 [conn1019] end connection 172.28.0.163:57509 (407 connections now open) 2015-10-05T12:11:49.514+0100 [conn48] end connection 172.28.0.163:52343 (405 connections now open) 2015-10-05T12:11:49.514+0100 [conn1070] end connection 172.28.0.163:57650 (404 connections now open) 2015-10-05T12:11:49.514+0100 [conn523] end connection 172.28.0.163:55386 (404 connections now open) 2015-10-05T12:11:49.514+0100 [conn1234] end connection 172.28.0.163:58614 (403 connections now open) 2015-10-05T12:11:49.515+0100 [conn1521] end connection 172.28.0.163:59394 (401 connections now open) 2015-10-05T12:11:49.515+0100 [conn453] end connection 172.28.0.163:54920 (400 connections now open) 2015-10-05T12:11:49.516+0100 [conn1229] end connection 172.28.0.163:58582 (399 connections now open) 2015-10-05T12:11:49.516+0100 [conn996] end connection 172.28.0.163:57304 (399 connections now open) 2015-10-05T12:11:49.517+0100 [conn459] end connection 172.28.0.163:54929 (397 connections now open) 2015-10-05T12:11:49.517+0100 [conn1197] end connection 172.28.0.163:58549 (397 connections now open) 2015-10-05T12:11:49.517+0100 [conn1162] end connection 172.28.0.163:58382 (395 connections now open) 2015-10-05T12:11:49.518+0100 [conn132] end connection 172.28.0.163:52514 (394 connections now open) 2015-10-05T12:11:49.518+0100 [conn12] end connection 172.28.0.163:52254 (393 connections now open) 2015-10-05T12:11:49.518+0100 [conn109] end connection 172.28.0.163:52465 (392 connections now open) 2015-10-05T12:11:49.519+0100 [conn1240] end connection 172.28.0.163:58621 (391 connections now open) 2015-10-05T12:11:49.519+0100 [conn408] end connection 172.28.0.163:54856 (390 connections now open) 2015-10-05T12:11:49.519+0100 [conn1212] end connection 172.28.0.163:58564 (390 connections now open) 2015-10-05T12:11:49.519+0100 [conn1185] end connection 172.28.0.163:58537 (390 connections now open) 2015-10-05T12:11:49.520+0100 [conn992] end connection 172.28.0.163:57300 (387 connections now open) 2015-10-05T12:11:49.520+0100 [conn528] end connection 172.28.0.163:55393 (386 connections now open) 2015-10-05T12:11:49.520+0100 [conn1111] end connection 172.28.0.163:57955 (385 connections now open) 2015-10-05T12:11:49.520+0100 [conn475] end connection 172.28.0.163:54956 (385 connections now open) 2015-10-05T12:11:49.521+0100 [conn1112] end connection 172.28.0.163:57957 (383 connections now open) 2015-10-05T12:11:49.522+0100 [conn981] end connection 172.28.0.163:57289 (382 connections now open) 2015-10-05T12:11:49.522+0100 [conn491] end connection 172.28.0.163:55013 (382 connections now open) 2015-10-05T12:11:49.522+0100 [conn426] end connection 172.28.0.163:54880 (380 connections now open) 2015-10-05T12:11:49.522+0100 [conn481] end connection 172.28.0.163:54976 (379 connections now open) 2015-10-05T12:11:49.522+0100 [conn1188] end connection 172.28.0.163:58540 (378 connections now open) 2015-10-05T12:11:49.523+0100 [conn1053] end connection 172.28.0.163:57584 (377 connections now open) 2015-10-05T12:11:49.523+0100 [conn1191] end connection 172.28.0.163:58543 (376 connections now open) 2015-10-05T12:11:49.523+0100 [conn1179] end connection 172.28.0.163:58531 (375 connections now open) 2015-10-05T12:11:49.524+0100 [conn1206] end connection 172.28.0.163:58558 (374 connections now open) 2015-10-05T12:11:49.524+0100 [conn1100] end connection 172.28.0.163:57937 (373 connections now open) 2015-10-05T12:11:49.524+0100 [conn1517] end connection 172.28.0.163:59381 (372 connections now open) 2015-10-05T12:11:49.524+0100 [conn457] end connection 172.28.0.163:54927 (372 connections now open) 2015-10-05T12:11:49.524+0100 [conn975] end connection 172.28.0.163:57284 (371 connections now open) 2015-10-05T12:11:49.524+0100 [conn1193] end connection 172.28.0.163:58545 (369 connections now open) 2015-10-05T12:11:49.525+0100 [conn1184] end connection 172.28.0.163:58535 (368 connections now open) 2015-10-05T12:11:49.525+0100 [conn1012] end connection 172.28.0.163:57502 (367 connections now open) 2015-10-05T12:11:49.525+0100 [conn1213] end connection 172.28.0.163:58565 (366 connections now open) 2015-10-05T12:11:49.525+0100 [conn972] end connection 172.28.0.163:57281 (366 connections now open) 2015-10-05T12:11:49.525+0100 [conn460] end connection 172.28.0.163:54931 (365 connections now open) 2015-10-05T12:11:49.525+0100 [conn154] end connection 172.28.0.163:52557 (364 connections now open) 2015-10-05T12:11:49.525+0100 [conn1016] end connection 172.28.0.163:57506 (364 connections now open) 2015-10-05T12:11:49.525+0100 [conn1064] end connection 172.28.0.163:57644 (361 connections now open) 2015-10-05T12:11:49.525+0100 [conn424] end connection 172.28.0.163:54879 (360 connections now open) 2015-10-05T12:11:49.526+0100 [conn1104] end connection 172.28.0.163:57941 (359 connections now open) 2015-10-05T12:11:49.526+0100 [conn1201] end connection 172.28.0.163:58553 (359 connections now open) 2015-10-05T12:11:49.526+0100 [conn256] end connection 172.28.0.163:53520 (359 connections now open) 2015-10-05T12:11:49.526+0100 [conn1101] end connection 172.28.0.163:57938 (356 connections now open) 2015-10-05T12:11:49.526+0100 [conn289] end connection 172.28.0.163:53856 (355 connections now open) 2015-10-05T12:11:49.526+0100 [conn1252] end connection 172.28.0.163:58675 (354 connections now open) 2015-10-05T12:11:49.526+0100 [conn1245] end connection 172.28.0.163:58626 (353 connections now open) 2015-10-05T12:11:49.527+0100 [conn422] end connection 172.28.0.163:54877 (353 connections now open) 2015-10-05T12:11:49.527+0100 [conn471] end connection 172.28.0.163:54947 (351 connections now open) 2015-10-05T12:11:49.527+0100 [conn995] end connection 172.28.0.163:57303 (351 connections now open) 2015-10-05T12:11:49.527+0100 [conn429] end connection 172.28.0.163:54884 (351 connections now open) 2015-10-05T12:11:49.527+0100 [conn989] end connection 172.28.0.163:57297 (351 connections now open) 2015-10-05T12:11:49.527+0100 [conn1187] end connection 172.28.0.163:58539 (351 connections now open) 2015-10-05T12:11:49.527+0100 [conn516] end connection 172.28.0.163:55376 (346 connections now open) 2015-10-05T12:11:49.527+0100 [conn447] end connection 172.28.0.163:54912 (346 connections now open) 2015-10-05T12:11:49.527+0100 [conn1522] end connection 172.28.0.163:59402 (345 connections now open) 2015-10-05T12:11:49.527+0100 [conn1237] end connection 172.28.0.163:58618 (343 connections now open) 2015-10-05T12:11:49.528+0100 [conn522] end connection 172.28.0.163:55383 (343 connections now open) 2015-10-05T12:11:49.528+0100 [conn403] end connection 172.28.0.163:54842 (342 connections now open) 2015-10-05T12:11:49.528+0100 [conn400] end connection 172.28.0.163:54836 (341 connections now open) 2015-10-05T12:11:49.528+0100 [conn399] end connection 172.28.0.163:54834 (339 connections now open) 2015-10-05T12:11:49.528+0100 [conn1516] end connection 172.28.0.163:59368 (339 connections now open) 2015-10-05T12:11:49.528+0100 [conn401] end connection 172.28.0.163:54837 (339 connections now open) 2015-10-05T12:11:49.528+0100 [conn1222] end connection 172.28.0.163:58575 (339 connections now open) 2015-10-05T12:11:49.528+0100 [conn1514] end connection 172.28.0.163:59366 (338 connections now open) 2015-10-05T12:11:49.528+0100 [conn396] end connection 172.28.0.163:54829 (338 connections now open) 2015-10-05T12:11:49.528+0100 [conn398] end connection 172.28.0.163:54832 (336 connections now open) 2015-10-05T12:11:49.528+0100 [conn393] end connection 172.28.0.163:54819 (334 connections now open) 2015-10-05T12:11:49.528+0100 [conn519] end connection 172.28.0.163:55380 (334 connections now open) 2015-10-05T12:11:49.528+0100 [conn1220] end connection 172.28.0.163:58572 (332 connections now open) 2015-10-05T12:11:49.528+0100 [conn1178] end connection 172.28.0.163:58530 (331 connections now open) 2015-10-05T12:11:49.528+0100 [conn1236] end connection 172.28.0.163:58617 (329 connections now open) 2015-10-05T12:11:49.528+0100 [conn1192] end connection 172.28.0.163:58544 (329 connections now open) 2015-10-05T12:11:49.528+0100 [conn986] end connection 172.28.0.163:57294 (328 connections now open) 2015-10-05T12:11:49.528+0100 [conn1247] end connection 172.28.0.163:58648 (327 connections now open) 2015-10-05T12:11:49.528+0100 [conn1250] end connection 172.28.0.163:58673 (327 connections now open) 2015-10-05T12:11:49.528+0100 [conn385] end connection 172.28.0.163:54806 (325 connections now open) 2015-10-05T12:11:49.528+0100 [conn1238] end connection 172.28.0.163:58619 (324 connections now open) 2015-10-05T12:11:49.528+0100 [conn1107] end connection 172.28.0.163:57947 (325 connections now open) 2015-10-05T12:11:49.529+0100 [conn977] end connection 172.28.0.163:57286 (321 connections now open) 2015-10-05T12:11:49.529+0100 [conn1230] end connection 172.28.0.163:58583 (321 connections now open) 2015-10-05T12:11:49.529+0100 [conn1224] end connection 172.28.0.163:58577 (319 connections now open) 2015-10-05T12:11:49.529+0100 [conn1176] end connection 172.28.0.163:58526 (318 connections now open) 2015-10-05T12:11:49.529+0100 [conn993] end connection 172.28.0.163:57301 (318 connections now open) 2015-10-05T12:11:49.529+0100 [conn1195] end connection 172.28.0.163:58547 (317 connections now open) 2015-10-05T12:11:49.529+0100 [conn374] end connection 172.28.0.163:54789 (316 connections now open) 2015-10-05T12:11:49.529+0100 [conn1177] end connection 172.28.0.163:58527 (315 connections now open) 2015-10-05T12:11:49.529+0100 [conn378] end connection 172.28.0.163:54797 (315 connections now open) 2015-10-05T12:11:49.529+0100 [conn373] end connection 172.28.0.163:54787 (311 connections now open) 2015-10-05T12:11:49.529+0100 [conn377] end connection 172.28.0.163:54795 (311 connections now open) 2015-10-05T12:11:49.529+0100 [conn1211] end connection 172.28.0.163:58563 (311 connections now open) 2015-10-05T12:11:49.529+0100 [conn362] end connection 172.28.0.163:54776 (310 connections now open) 2015-10-05T12:11:49.529+0100 [conn1520] end connection 172.28.0.163:59393 (309 connections now open) 2015-10-05T12:11:49.529+0100 [conn1217] end connection 172.28.0.163:58569 (307 connections now open) 2015-10-05T12:11:49.529+0100 [conn360] end connection 172.28.0.163:54772 (306 connections now open) 2015-10-05T12:11:49.529+0100 [conn1246] end connection 172.28.0.163:58644 (305 connections now open) 2015-10-05T12:11:49.529+0100 [conn341] end connection 172.28.0.163:54739 (303 connections now open) 2015-10-05T12:11:49.530+0100 [conn1219] end connection 172.28.0.163:58571 (302 connections now open) 2015-10-05T12:11:49.530+0100 [conn520] end connection 172.28.0.163:55381 (302 connections now open) 2015-10-05T12:11:49.530+0100 [conn1235] end connection 172.28.0.163:58616 (302 connections now open) 2015-10-05T12:11:49.530+0100 [conn971] end connection 172.28.0.163:57280 (299 connections now open) 2015-10-05T12:11:49.530+0100 [conn1221] end connection 172.28.0.163:58574 (299 connections now open) 2015-10-05T12:11:49.530+0100 [conn327] end connection 172.28.0.163:54725 (299 connections now open) 2015-10-05T12:11:49.530+0100 [conn316] end connection 172.28.0.163:54711 (297 connections now open) 2015-10-05T12:11:49.530+0100 [conn1518] end connection 172.28.0.163:59383 (295 connections now open) 2015-10-05T12:11:49.530+0100 [conn313] end connection 172.28.0.163:54708 (295 connections now open) 2015-10-05T12:11:49.530+0100 [conn321] end connection 172.28.0.163:54716 (295 connections now open) 2015-10-05T12:11:49.530+0100 [conn1254] end connection 172.28.0.163:58683 (294 connections now open) 2015-10-05T12:11:49.530+0100 [conn334] end connection 172.28.0.163:54731 (293 connections now open) 2015-10-05T12:11:49.530+0100 [conn315] end connection 172.28.0.163:54710 (292 connections now open) 2015-10-05T12:11:49.530+0100 [conn518] end connection 172.28.0.163:55379 (291 connections now open) 2015-10-05T12:11:49.530+0100 [conn1205] end connection 172.28.0.163:58557 (290 connections now open) 2015-10-05T12:11:49.530+0100 [conn474] end connection 172.28.0.163:54953 (287 connections now open) 2015-10-05T12:11:49.530+0100 [conn430] end connection 172.28.0.163:54885 (287 connections now open) 2015-10-05T12:11:49.530+0100 [conn495] end connection 172.28.0.163:55017 (286 connections now open) 2015-10-05T12:11:49.530+0100 [conn1200] end connection 172.28.0.163:58552 (286 connections now open) 2015-10-05T12:11:49.530+0100 [conn497] end connection 172.28.0.163:55019 (285 connections now open) 2015-10-05T12:11:49.532+0100 [conn1183] end connection 172.28.0.163:58536 (282 connections now open) 2015-10-05T12:11:50.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125af612deab02e298b7e8 2015-10-05T12:11:50.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:11:51.672+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:11:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:11:57.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125afc12deab02e298b83c 2015-10-05T12:11:57.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:02.898+0100 [conn1621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:12:03.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b0312deab02e298b87f 2015-10-05T12:12:03.826+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:15.186+0100 [conn1274] end connection 172.28.0.164:52226 (281 connections now open) 2015-10-05T12:12:15.188+0100 [mongosMain] connection accepted from 172.28.0.164:54139 #1626 (282 connections now open) 2015-10-05T12:12:15.190+0100 [conn1626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:12:16.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b0f12deab02e298b8d5 2015-10-05T12:12:16.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:21.937+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:12:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:12:28.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b1c12deab02e298b942 2015-10-05T12:12:28.809+0100 [mongosMain] connection accepted from 127.0.0.1:50510 #1627 (283 connections now open) 2015-10-05T12:12:28.811+0100 [conn1627] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:12:28.812+0100 [conn1627] end connection 127.0.0.1:50510 (282 connections now open) 2015-10-05T12:12:28.867+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:30.241+0100 [conn1345] end connection 172.28.0.164:52484 (281 connections now open) 2015-10-05T12:12:30.553+0100 [conn502] end connection 172.28.0.163:55315 (280 connections now open) 2015-10-05T12:12:30.554+0100 [mongosMain] connection accepted from 172.28.0.163:50511 #1628 (281 connections now open) 2015-10-05T12:12:30.556+0100 [conn1628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:12:39.544+0100 [mongosMain] connection accepted from 127.0.0.1:50513 #1629 (282 connections now open) 2015-10-05T12:12:39.547+0100 [conn1629] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:12:39.548+0100 [conn1629] end connection 127.0.0.1:50513 (281 connections now open) 2015-10-05T12:12:41.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b2812deab02e298b9af 2015-10-05T12:12:41.148+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:47.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b2f12deab02e298b9fa 2015-10-05T12:12:47.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:12:52.258+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:12:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:12:53.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b3512deab02e298ba25 2015-10-05T12:12:54.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:00.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b3c12deab02e298ba59 2015-10-05T12:13:00.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:06.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b4212deab02e298ba7c 2015-10-05T12:13:06.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:12.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b4812deab02e298babb 2015-10-05T12:13:13.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:15.226+0100 [conn1275] end connection 172.28.0.164:52230 (280 connections now open) 2015-10-05T12:13:15.227+0100 [mongosMain] connection accepted from 172.28.0.164:54185 #1630 (281 connections now open) 2015-10-05T12:13:15.230+0100 [conn1630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:13:19.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b4f12deab02e298bafc 2015-10-05T12:13:19.559+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:22.556+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:13:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:13:25.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b5512deab02e298bb3e 2015-10-05T12:13:25.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:28.248+0100 [mongosMain] connection accepted from 127.0.0.1:50556 #1631 (282 connections now open) 2015-10-05T12:13:28.251+0100 [conn1631] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:13:28.252+0100 [conn1631] end connection 127.0.0.1:50556 (281 connections now open) 2015-10-05T12:13:30.281+0100 [conn1343] end connection 172.28.0.164:52483 (280 connections now open) 2015-10-05T12:13:30.594+0100 [conn1076] end connection 172.28.0.163:57669 (279 connections now open) 2015-10-05T12:13:30.595+0100 [mongosMain] connection accepted from 172.28.0.163:50557 #1632 (280 connections now open) 2015-10-05T12:13:30.597+0100 [conn1632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:13:38.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b6212deab02e298bba9 2015-10-05T12:13:38.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:39.883+0100 [mongosMain] connection accepted from 127.0.0.1:50559 #1633 (281 connections now open) 2015-10-05T12:13:39.886+0100 [conn1633] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:13:39.886+0100 [conn1633] end connection 127.0.0.1:50559 (280 connections now open) 2015-10-05T12:13:50.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b6e12deab02e298bc07 2015-10-05T12:13:50.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:13:52.694+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:13:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:13:56.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b7412deab02e298bc33 2015-10-05T12:13:56.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:03.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b7a12deab02e298bc62 2015-10-05T12:14:03.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:09.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b8112deab02e298bc92 2015-10-05T12:14:09.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:15.242+0100 [conn1276] end connection 172.28.0.164:52233 (279 connections now open) 2015-10-05T12:14:15.244+0100 [mongosMain] connection accepted from 172.28.0.164:54242 #1634 (280 connections now open) 2015-10-05T12:14:15.246+0100 [conn1634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:14:15.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b8712deab02e298bcce 2015-10-05T12:14:15.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:22.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b8d12deab02e298bd06 2015-10-05T12:14:22.234+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:22.986+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:14:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:14:28.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b9412deab02e298bd3b 2015-10-05T12:14:28.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:28.554+0100 [mongosMain] connection accepted from 127.0.0.1:50602 #1635 (281 connections now open) 2015-10-05T12:14:28.557+0100 [conn1635] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:14:28.558+0100 [conn1635] end connection 127.0.0.1:50602 (280 connections now open) 2015-10-05T12:14:30.297+0100 [conn1349] end connection 172.28.0.164:52488 (279 connections now open) 2015-10-05T12:14:30.611+0100 [conn965] end connection 172.28.0.163:57201 (278 connections now open) 2015-10-05T12:14:30.613+0100 [mongosMain] connection accepted from 172.28.0.163:50603 #1636 (279 connections now open) 2015-10-05T12:14:30.615+0100 [conn1636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:14:34.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125b9a12deab02e298bd71 2015-10-05T12:14:34.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:39.655+0100 [mongosMain] connection accepted from 127.0.0.1:50604 #1637 (280 connections now open) 2015-10-05T12:14:39.657+0100 [conn1637] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:14:39.658+0100 [conn1637] end connection 127.0.0.1:50604 (279 connections now open) 2015-10-05T12:14:41.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ba012deab02e298bdb5 2015-10-05T12:14:41.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:47.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ba712deab02e298bdf3 2015-10-05T12:14:47.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:14:53.263+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:14:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:14:53.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bad12deab02e298be21 2015-10-05T12:14:53.758+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:00.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bb312deab02e298be4a 2015-10-05T12:15:00.179+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:06.476+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bba12deab02e298be82 2015-10-05T12:15:06.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:08.924+0100 [mongosMain] connection accepted from 172.28.0.163:50637 #1638 (280 connections now open) 2015-10-05T12:15:08.925+0100 [mongosMain] connection accepted from 172.28.0.163:50638 #1639 (281 connections now open) 2015-10-05T12:15:08.926+0100 [mongosMain] connection accepted from 172.28.0.163:50639 #1640 (282 connections now open) 2015-10-05T12:15:08.927+0100 [conn1638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.927+0100 [mongosMain] connection accepted from 172.28.0.163:50640 #1641 (283 connections now open) 2015-10-05T12:15:08.928+0100 [conn1639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.928+0100 [conn1640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.928+0100 [mongosMain] connection accepted from 172.28.0.163:50641 #1642 (284 connections now open) 2015-10-05T12:15:08.929+0100 [mongosMain] connection accepted from 172.28.0.163:50642 #1643 (285 connections now open) 2015-10-05T12:15:08.929+0100 [conn1641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.930+0100 [mongosMain] connection accepted from 172.28.0.163:50643 #1644 (286 connections now open) 2015-10-05T12:15:08.930+0100 [mongosMain] connection accepted from 172.28.0.163:50644 #1645 (287 connections now open) 2015-10-05T12:15:08.931+0100 [conn1643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.931+0100 [conn1644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.931+0100 [mongosMain] connection accepted from 172.28.0.163:50645 #1646 (288 connections now open) 2015-10-05T12:15:08.932+0100 [mongosMain] connection accepted from 172.28.0.163:50646 #1647 (289 connections now open) 2015-10-05T12:15:08.932+0100 [conn1645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.933+0100 [mongosMain] connection accepted from 172.28.0.163:50647 #1648 (290 connections now open) 2015-10-05T12:15:08.933+0100 [conn1646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.934+0100 [mongosMain] connection accepted from 172.28.0.163:50648 #1649 (291 connections now open) 2015-10-05T12:15:08.934+0100 [mongosMain] connection accepted from 172.28.0.163:50649 #1650 (292 connections now open) 2015-10-05T12:15:08.934+0100 [conn1648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.935+0100 [conn1649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.936+0100 [conn1650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.937+0100 [mongosMain] connection accepted from 172.28.0.163:50650 #1651 (293 connections now open) 2015-10-05T12:15:08.938+0100 [mongosMain] connection accepted from 172.28.0.163:50651 #1652 (294 connections now open) 2015-10-05T12:15:08.939+0100 [mongosMain] connection accepted from 172.28.0.163:50653 #1653 (295 connections now open) 2015-10-05T12:15:08.939+0100 [mongosMain] connection accepted from 172.28.0.163:50652 #1654 (296 connections now open) 2015-10-05T12:15:08.940+0100 [conn1653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.941+0100 [mongosMain] connection accepted from 172.28.0.163:50655 #1655 (297 connections now open) 2015-10-05T12:15:08.941+0100 [mongosMain] connection accepted from 172.28.0.163:50654 #1656 (298 connections now open) 2015-10-05T12:15:08.943+0100 [conn1651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.944+0100 [conn1652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.944+0100 [mongosMain] connection accepted from 172.28.0.163:50656 #1657 (299 connections now open) 2015-10-05T12:15:08.946+0100 [mongosMain] connection accepted from 172.28.0.163:50657 #1658 (300 connections now open) 2015-10-05T12:15:08.946+0100 [mongosMain] connection accepted from 172.28.0.163:50658 #1659 (301 connections now open) 2015-10-05T12:15:08.946+0100 [conn1656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.947+0100 [mongosMain] connection accepted from 172.28.0.163:50659 #1660 (302 connections now open) 2015-10-05T12:15:08.948+0100 [mongosMain] connection accepted from 172.28.0.163:50660 #1661 (303 connections now open) 2015-10-05T12:15:08.948+0100 [mongosMain] connection accepted from 172.28.0.163:50661 #1662 (304 connections now open) 2015-10-05T12:15:08.948+0100 [conn1655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.948+0100 [mongosMain] connection accepted from 172.28.0.163:50663 #1663 (305 connections now open) 2015-10-05T12:15:08.949+0100 [conn1658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.949+0100 [mongosMain] connection accepted from 172.28.0.163:50662 #1664 (306 connections now open) 2015-10-05T12:15:08.949+0100 [conn1660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.949+0100 [conn1657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.949+0100 [mongosMain] connection accepted from 172.28.0.163:50664 #1665 (307 connections now open) 2015-10-05T12:15:08.950+0100 [mongosMain] connection accepted from 172.28.0.163:50665 #1666 (308 connections now open) 2015-10-05T12:15:08.950+0100 [conn1661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.951+0100 [conn1663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.951+0100 [conn1659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.951+0100 [mongosMain] connection accepted from 172.28.0.163:50666 #1667 (309 connections now open) 2015-10-05T12:15:08.951+0100 [conn1665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.951+0100 [conn1664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.951+0100 [mongosMain] connection accepted from 172.28.0.163:50667 #1668 (310 connections now open) 2015-10-05T12:15:08.952+0100 [mongosMain] connection accepted from 172.28.0.163:50668 #1669 (311 connections now open) 2015-10-05T12:15:08.953+0100 [mongosMain] connection accepted from 172.28.0.163:50669 #1670 (312 connections now open) 2015-10-05T12:15:08.953+0100 [conn1667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.954+0100 [conn1662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.955+0100 [mongosMain] connection accepted from 172.28.0.163:50670 #1671 (313 connections now open) 2015-10-05T12:15:08.955+0100 [conn1668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.956+0100 [mongosMain] connection accepted from 172.28.0.163:50671 #1672 (314 connections now open) 2015-10-05T12:15:08.957+0100 [conn1669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.957+0100 [conn1671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.958+0100 [conn1670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.962+0100 [mongosMain] connection accepted from 172.28.0.163:50672 #1673 (315 connections now open) 2015-10-05T12:15:08.962+0100 [mongosMain] connection accepted from 172.28.0.163:50673 #1674 (316 connections now open) 2015-10-05T12:15:08.965+0100 [mongosMain] connection accepted from 172.28.0.163:50674 #1675 (317 connections now open) 2015-10-05T12:15:08.966+0100 [conn1674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.966+0100 [mongosMain] connection accepted from 172.28.0.163:50675 #1676 (318 connections now open) 2015-10-05T12:15:08.967+0100 [conn1672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.967+0100 [conn1676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.968+0100 [mongosMain] connection accepted from 172.28.0.163:50676 #1677 (319 connections now open) 2015-10-05T12:15:08.969+0100 [conn1677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.970+0100 [conn1675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.977+0100 [mongosMain] connection accepted from 172.28.0.163:50678 #1678 (320 connections now open) 2015-10-05T12:15:08.978+0100 [mongosMain] connection accepted from 172.28.0.163:50679 #1679 (321 connections now open) 2015-10-05T12:15:08.978+0100 [mongosMain] connection accepted from 172.28.0.163:50680 #1680 (322 connections now open) 2015-10-05T12:15:08.978+0100 [conn1678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.979+0100 [mongosMain] connection accepted from 172.28.0.163:50681 #1681 (323 connections now open) 2015-10-05T12:15:08.979+0100 [mongosMain] connection accepted from 172.28.0.163:50682 #1682 (324 connections now open) 2015-10-05T12:15:08.980+0100 [mongosMain] connection accepted from 172.28.0.163:50683 #1683 (325 connections now open) 2015-10-05T12:15:08.980+0100 [mongosMain] connection accepted from 172.28.0.163:50684 #1684 (326 connections now open) 2015-10-05T12:15:08.981+0100 [conn1684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.982+0100 [mongosMain] connection accepted from 172.28.0.163:50685 #1685 (327 connections now open) 2015-10-05T12:15:08.982+0100 [mongosMain] connection accepted from 172.28.0.163:50686 #1686 (328 connections now open) 2015-10-05T12:15:08.982+0100 [mongosMain] connection accepted from 172.28.0.163:50687 #1687 (329 connections now open) 2015-10-05T12:15:08.983+0100 [mongosMain] connection accepted from 172.28.0.163:50688 #1688 (330 connections now open) 2015-10-05T12:15:08.983+0100 [mongosMain] connection accepted from 172.28.0.163:50689 #1689 (331 connections now open) 2015-10-05T12:15:08.983+0100 [conn1682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.984+0100 [conn1683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.985+0100 [conn1689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.985+0100 [conn1686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.986+0100 [conn1688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.990+0100 [mongosMain] connection accepted from 172.28.0.163:50690 #1690 (332 connections now open) 2015-10-05T12:15:08.991+0100 [mongosMain] connection accepted from 172.28.0.163:50691 #1691 (333 connections now open) 2015-10-05T12:15:08.992+0100 [mongosMain] connection accepted from 172.28.0.163:50692 #1692 (334 connections now open) 2015-10-05T12:15:08.995+0100 [conn1690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:08.997+0100 [mongosMain] connection accepted from 172.28.0.163:50693 #1693 (335 connections now open) 2015-10-05T12:15:08.999+0100 [conn1681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.000+0100 [conn1687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.003+0100 [conn1673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.003+0100 [conn1685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.003+0100 [conn1691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.003+0100 [conn1679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.012+0100 [mongosMain] connection accepted from 172.28.0.163:50694 #1694 (336 connections now open) 2015-10-05T12:15:09.015+0100 [mongosMain] connection accepted from 172.28.0.163:50695 #1695 (337 connections now open) 2015-10-05T12:15:09.020+0100 [conn1693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.020+0100 [conn1695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.021+0100 [conn1692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.021+0100 [mongosMain] connection accepted from 172.28.0.163:50696 #1696 (338 connections now open) 2015-10-05T12:15:09.022+0100 [mongosMain] connection accepted from 172.28.0.163:50697 #1697 (339 connections now open) 2015-10-05T12:15:09.023+0100 [mongosMain] connection accepted from 172.28.0.163:50698 #1698 (340 connections now open) 2015-10-05T12:15:09.025+0100 [mongosMain] connection accepted from 172.28.0.163:50699 #1699 (341 connections now open) 2015-10-05T12:15:09.026+0100 [mongosMain] connection accepted from 172.28.0.163:50700 #1700 (342 connections now open) 2015-10-05T12:15:09.027+0100 [mongosMain] connection accepted from 172.28.0.163:50701 #1701 (343 connections now open) 2015-10-05T12:15:09.028+0100 [conn1699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.030+0100 [conn1697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.030+0100 [conn1696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.032+0100 [conn1698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.033+0100 [conn1701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.034+0100 [conn1700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.043+0100 [mongosMain] connection accepted from 172.28.0.163:50703 #1702 (344 connections now open) 2015-10-05T12:15:09.044+0100 [mongosMain] connection accepted from 172.28.0.163:50704 #1703 (345 connections now open) 2015-10-05T12:15:09.049+0100 [mongosMain] connection accepted from 172.28.0.163:50705 #1704 (346 connections now open) 2015-10-05T12:15:09.055+0100 [mongosMain] connection accepted from 172.28.0.163:50706 #1705 (347 connections now open) 2015-10-05T12:15:09.055+0100 [mongosMain] connection accepted from 172.28.0.163:50707 #1706 (348 connections now open) 2015-10-05T12:15:09.057+0100 [conn1704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.058+0100 [mongosMain] connection accepted from 172.28.0.163:50708 #1707 (349 connections now open) 2015-10-05T12:15:09.058+0100 [conn1706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.068+0100 [mongosMain] connection accepted from 172.28.0.163:50709 #1708 (350 connections now open) 2015-10-05T12:15:09.090+0100 [mongosMain] connection accepted from 172.28.0.163:50714 #1709 (351 connections now open) 2015-10-05T12:15:09.098+0100 [mongosMain] connection accepted from 172.28.0.163:50715 #1710 (352 connections now open) 2015-10-05T12:15:09.098+0100 [mongosMain] connection accepted from 172.28.0.163:50716 #1711 (353 connections now open) 2015-10-05T12:15:09.098+0100 [mongosMain] connection accepted from 172.28.0.163:50712 #1712 (354 connections now open) 2015-10-05T12:15:09.099+0100 [mongosMain] connection accepted from 172.28.0.163:50721 #1713 (355 connections now open) 2015-10-05T12:15:09.099+0100 [mongosMain] connection accepted from 172.28.0.163:50722 #1714 (356 connections now open) 2015-10-05T12:15:09.106+0100 [mongosMain] connection accepted from 172.28.0.163:50720 #1715 (357 connections now open) 2015-10-05T12:15:09.111+0100 [conn1710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.111+0100 [conn1713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.112+0100 [conn1709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.116+0100 [mongosMain] connection accepted from 172.28.0.163:50711 #1716 (358 connections now open) 2015-10-05T12:15:09.120+0100 [mongosMain] connection accepted from 172.28.0.163:50717 #1717 (359 connections now open) 2015-10-05T12:15:09.121+0100 [mongosMain] connection accepted from 172.28.0.163:50713 #1718 (360 connections now open) 2015-10-05T12:15:09.122+0100 [mongosMain] connection accepted from 172.28.0.163:50718 #1719 (361 connections now open) 2015-10-05T12:15:09.127+0100 [mongosMain] connection accepted from 172.28.0.163:50719 #1720 (362 connections now open) 2015-10-05T12:15:09.129+0100 [conn1718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.129+0100 [conn1714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.131+0100 [conn1717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.150+0100 [mongosMain] connection accepted from 172.28.0.163:50723 #1721 (363 connections now open) 2015-10-05T12:15:09.151+0100 [conn1716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.151+0100 [conn1719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.154+0100 [mongosMain] connection accepted from 172.28.0.163:50724 #1722 (364 connections now open) 2015-10-05T12:15:09.155+0100 [mongosMain] connection accepted from 172.28.0.163:50726 #1723 (365 connections now open) 2015-10-05T12:15:09.155+0100 [mongosMain] connection accepted from 172.28.0.163:50727 #1724 (366 connections now open) 2015-10-05T12:15:09.155+0100 [mongosMain] connection accepted from 172.28.0.163:50725 #1725 (367 connections now open) 2015-10-05T12:15:09.155+0100 [mongosMain] connection accepted from 172.28.0.163:50728 #1726 (368 connections now open) 2015-10-05T12:15:09.160+0100 [conn1726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.161+0100 [conn1723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.161+0100 [conn1722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.170+0100 [conn1721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.170+0100 [mongosMain] connection accepted from 172.28.0.163:50729 #1727 (369 connections now open) 2015-10-05T12:15:09.171+0100 [conn1725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.171+0100 [mongosMain] connection accepted from 172.28.0.163:50730 #1728 (370 connections now open) 2015-10-05T12:15:09.193+0100 [conn1727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.193+0100 [conn1728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.195+0100 [mongosMain] connection accepted from 172.28.0.163:50731 #1729 (371 connections now open) 2015-10-05T12:15:09.195+0100 [mongosMain] connection accepted from 172.28.0.163:50732 #1730 (372 connections now open) 2015-10-05T12:15:09.203+0100 [conn1730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.204+0100 [mongosMain] connection accepted from 172.28.0.163:50733 #1731 (373 connections now open) 2015-10-05T12:15:09.217+0100 [mongosMain] connection accepted from 172.28.0.163:50734 #1732 (374 connections now open) 2015-10-05T12:15:09.217+0100 [mongosMain] connection accepted from 172.28.0.163:50735 #1733 (375 connections now open) 2015-10-05T12:15:09.219+0100 [mongosMain] connection accepted from 172.28.0.163:50736 #1734 (376 connections now open) 2015-10-05T12:15:09.220+0100 [conn1732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.222+0100 [conn1733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.223+0100 [mongosMain] connection accepted from 172.28.0.163:50737 #1735 (377 connections now open) 2015-10-05T12:15:09.225+0100 [conn1735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.226+0100 [mongosMain] connection accepted from 172.28.0.163:50738 #1736 (378 connections now open) 2015-10-05T12:15:09.227+0100 [mongosMain] connection accepted from 172.28.0.163:50739 #1737 (379 connections now open) 2015-10-05T12:15:09.228+0100 [conn1734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.228+0100 [conn1736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.231+0100 [conn1737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.232+0100 [mongosMain] connection accepted from 172.28.0.163:50740 #1738 (380 connections now open) 2015-10-05T12:15:09.233+0100 [mongosMain] connection accepted from 172.28.0.163:50741 #1739 (381 connections now open) 2015-10-05T12:15:09.234+0100 [mongosMain] connection accepted from 172.28.0.163:50742 #1740 (382 connections now open) 2015-10-05T12:15:09.235+0100 [mongosMain] connection accepted from 172.28.0.163:50743 #1741 (383 connections now open) 2015-10-05T12:15:09.235+0100 [mongosMain] connection accepted from 172.28.0.163:50744 #1742 (384 connections now open) 2015-10-05T12:15:09.238+0100 [mongosMain] connection accepted from 172.28.0.163:50745 #1743 (385 connections now open) 2015-10-05T12:15:09.239+0100 [mongosMain] connection accepted from 172.28.0.163:50746 #1744 (386 connections now open) 2015-10-05T12:15:09.240+0100 [mongosMain] connection accepted from 172.28.0.163:50747 #1745 (387 connections now open) 2015-10-05T12:15:09.240+0100 [mongosMain] connection accepted from 172.28.0.163:50748 #1746 (388 connections now open) 2015-10-05T12:15:09.241+0100 [mongosMain] connection accepted from 172.28.0.163:50749 #1747 (389 connections now open) 2015-10-05T12:15:09.241+0100 [mongosMain] connection accepted from 172.28.0.163:50750 #1748 (390 connections now open) 2015-10-05T12:15:09.241+0100 [mongosMain] connection accepted from 172.28.0.163:50751 #1749 (391 connections now open) 2015-10-05T12:15:09.242+0100 [conn1742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.242+0100 [mongosMain] connection accepted from 172.28.0.163:50752 #1750 (392 connections now open) 2015-10-05T12:15:09.242+0100 [mongosMain] connection accepted from 172.28.0.163:50753 #1751 (393 connections now open) 2015-10-05T12:15:09.244+0100 [mongosMain] connection accepted from 172.28.0.163:50754 #1752 (394 connections now open) 2015-10-05T12:15:09.244+0100 [mongosMain] connection accepted from 172.28.0.163:50755 #1753 (395 connections now open) 2015-10-05T12:15:09.245+0100 [mongosMain] connection accepted from 172.28.0.163:50756 #1754 (396 connections now open) 2015-10-05T12:15:09.246+0100 [mongosMain] connection accepted from 172.28.0.163:50757 #1755 (397 connections now open) 2015-10-05T12:15:09.246+0100 [mongosMain] connection accepted from 172.28.0.163:50758 #1756 (398 connections now open) 2015-10-05T12:15:09.247+0100 [mongosMain] connection accepted from 172.28.0.163:50759 #1757 (399 connections now open) 2015-10-05T12:15:09.247+0100 [mongosMain] connection accepted from 172.28.0.163:50760 #1758 (400 connections now open) 2015-10-05T12:15:09.247+0100 [conn1751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.247+0100 [mongosMain] connection accepted from 172.28.0.163:50761 #1759 (401 connections now open) 2015-10-05T12:15:09.248+0100 [conn1738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.248+0100 [mongosMain] connection accepted from 172.28.0.163:50762 #1760 (402 connections now open) 2015-10-05T12:15:09.249+0100 [mongosMain] connection accepted from 172.28.0.163:50763 #1761 (403 connections now open) 2015-10-05T12:15:09.249+0100 [mongosMain] connection accepted from 172.28.0.163:50764 #1762 (404 connections now open) 2015-10-05T12:15:09.250+0100 [conn1757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.250+0100 [mongosMain] connection accepted from 172.28.0.163:50765 #1763 (405 connections now open) 2015-10-05T12:15:09.250+0100 [mongosMain] connection accepted from 172.28.0.163:50766 #1764 (406 connections now open) 2015-10-05T12:15:09.251+0100 [mongosMain] connection accepted from 172.28.0.163:50767 #1765 (407 connections now open) 2015-10-05T12:15:09.251+0100 [mongosMain] connection accepted from 172.28.0.163:50768 #1766 (408 connections now open) 2015-10-05T12:15:09.251+0100 [conn1754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.251+0100 [mongosMain] connection accepted from 172.28.0.163:50769 #1767 (409 connections now open) 2015-10-05T12:15:09.251+0100 [mongosMain] connection accepted from 172.28.0.163:50770 #1768 (410 connections now open) 2015-10-05T12:15:09.251+0100 [mongosMain] connection accepted from 172.28.0.163:50771 #1769 (411 connections now open) 2015-10-05T12:15:09.252+0100 [mongosMain] connection accepted from 172.28.0.163:50772 #1770 (412 connections now open) 2015-10-05T12:15:09.252+0100 [conn1760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.252+0100 [mongosMain] connection accepted from 172.28.0.163:50773 #1771 (413 connections now open) 2015-10-05T12:15:09.252+0100 [mongosMain] connection accepted from 172.28.0.163:50774 #1772 (414 connections now open) 2015-10-05T12:15:09.253+0100 [mongosMain] connection accepted from 172.28.0.163:50775 #1773 (415 connections now open) 2015-10-05T12:15:09.253+0100 [mongosMain] connection accepted from 172.28.0.163:50776 #1774 (416 connections now open) 2015-10-05T12:15:09.253+0100 [mongosMain] connection accepted from 172.28.0.163:50777 #1775 (417 connections now open) 2015-10-05T12:15:09.253+0100 [mongosMain] connection accepted from 172.28.0.163:50778 #1776 (418 connections now open) 2015-10-05T12:15:09.254+0100 [mongosMain] connection accepted from 172.28.0.163:50779 #1777 (419 connections now open) 2015-10-05T12:15:09.254+0100 [mongosMain] connection accepted from 172.28.0.163:50780 #1778 (420 connections now open) 2015-10-05T12:15:09.255+0100 [conn1763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.255+0100 [mongosMain] connection accepted from 172.28.0.163:50781 #1779 (421 connections now open) 2015-10-05T12:15:09.255+0100 [mongosMain] connection accepted from 172.28.0.163:50782 #1780 (422 connections now open) 2015-10-05T12:15:09.256+0100 [mongosMain] connection accepted from 172.28.0.163:50783 #1781 (423 connections now open) 2015-10-05T12:15:09.258+0100 [mongosMain] connection accepted from 172.28.0.163:50784 #1782 (424 connections now open) 2015-10-05T12:15:09.260+0100 [conn1775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.261+0100 [conn1781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.262+0100 [mongosMain] connection accepted from 172.28.0.163:50786 #1783 (425 connections now open) 2015-10-05T12:15:09.262+0100 [mongosMain] connection accepted from 172.28.0.163:50787 #1784 (426 connections now open) 2015-10-05T12:15:09.262+0100 [mongosMain] connection accepted from 172.28.0.163:50788 #1785 (427 connections now open) 2015-10-05T12:15:09.262+0100 [mongosMain] connection accepted from 172.28.0.163:50789 #1786 (428 connections now open) 2015-10-05T12:15:09.263+0100 [conn1744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.265+0100 [mongosMain] connection accepted from 172.28.0.163:50790 #1787 (429 connections now open) 2015-10-05T12:15:09.270+0100 [conn1739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.270+0100 [conn1769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.271+0100 [mongosMain] connection accepted from 172.28.0.163:50791 #1788 (430 connections now open) 2015-10-05T12:15:09.281+0100 [mongosMain] connection accepted from 172.28.0.163:50792 #1789 (431 connections now open) 2015-10-05T12:15:09.281+0100 [conn1779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.282+0100 [mongosMain] connection accepted from 172.28.0.163:50793 #1790 (432 connections now open) 2015-10-05T12:15:09.283+0100 [conn1761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.284+0100 [conn1749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.284+0100 [conn1773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.286+0100 [mongosMain] connection accepted from 172.28.0.163:50794 #1791 (433 connections now open) 2015-10-05T12:15:09.286+0100 [conn1755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.287+0100 [mongosMain] connection accepted from 172.28.0.163:50795 #1792 (434 connections now open) 2015-10-05T12:15:09.288+0100 [conn1790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.289+0100 [mongosMain] connection accepted from 172.28.0.163:50796 #1793 (435 connections now open) 2015-10-05T12:15:09.289+0100 [mongosMain] connection accepted from 172.28.0.163:50797 #1794 (436 connections now open) 2015-10-05T12:15:09.289+0100 [conn1784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.290+0100 [mongosMain] connection accepted from 172.28.0.163:50798 #1795 (437 connections now open) 2015-10-05T12:15:09.290+0100 [mongosMain] connection accepted from 172.28.0.163:50799 #1796 (438 connections now open) 2015-10-05T12:15:09.290+0100 [mongosMain] connection accepted from 172.28.0.163:50801 #1797 (439 connections now open) 2015-10-05T12:15:09.290+0100 [mongosMain] connection accepted from 172.28.0.163:50800 #1798 (440 connections now open) 2015-10-05T12:15:09.290+0100 [mongosMain] connection accepted from 172.28.0.163:50802 #1799 (441 connections now open) 2015-10-05T12:15:09.291+0100 [conn1791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.292+0100 [mongosMain] connection accepted from 172.28.0.163:50803 #1800 (442 connections now open) 2015-10-05T12:15:09.293+0100 [mongosMain] connection accepted from 172.28.0.163:50804 #1801 (443 connections now open) 2015-10-05T12:15:09.293+0100 [mongosMain] connection accepted from 172.28.0.163:50805 #1802 (444 connections now open) 2015-10-05T12:15:09.294+0100 [mongosMain] connection accepted from 172.28.0.163:50806 #1803 (445 connections now open) 2015-10-05T12:15:09.294+0100 [conn1767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.295+0100 [conn1793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.296+0100 [mongosMain] connection accepted from 172.28.0.163:50807 #1804 (446 connections now open) 2015-10-05T12:15:09.297+0100 [conn1796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.298+0100 [conn1741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.299+0100 [mongosMain] connection accepted from 172.28.0.163:50809 #1805 (447 connections now open) 2015-10-05T12:15:09.299+0100 [conn1804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.300+0100 [conn1747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.301+0100 [mongosMain] connection accepted from 172.28.0.163:50810 #1806 (448 connections now open) 2015-10-05T12:15:09.302+0100 [conn1743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.303+0100 [conn1805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.305+0100 [conn1783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.305+0100 [mongosMain] connection accepted from 172.28.0.163:50808 #1807 (449 connections now open) 2015-10-05T12:15:09.305+0100 [conn1771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.305+0100 [conn1750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.306+0100 [conn1756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.306+0100 [conn1802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.307+0100 [mongosMain] connection accepted from 172.28.0.163:50811 #1808 (450 connections now open) 2015-10-05T12:15:09.308+0100 [conn1762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.308+0100 [conn1766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.309+0100 [conn1792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.310+0100 [mongosMain] connection accepted from 172.28.0.163:50812 #1809 (451 connections now open) 2015-10-05T12:15:09.310+0100 [conn1765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.311+0100 [conn1808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.313+0100 [conn1746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.315+0100 [conn1752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.317+0100 [conn1774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.318+0100 [mongosMain] connection accepted from 172.28.0.163:50813 #1810 (452 connections now open) 2015-10-05T12:15:09.318+0100 [conn1768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.318+0100 [mongosMain] connection accepted from 172.28.0.163:50814 #1811 (453 connections now open) 2015-10-05T12:15:09.318+0100 [mongosMain] connection accepted from 172.28.0.163:50815 #1812 (454 connections now open) 2015-10-05T12:15:09.318+0100 [mongosMain] connection accepted from 172.28.0.163:50816 #1813 (455 connections now open) 2015-10-05T12:15:09.320+0100 [mongosMain] connection accepted from 172.28.0.163:50817 #1814 (456 connections now open) 2015-10-05T12:15:09.320+0100 [conn1780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.324+0100 [mongosMain] connection accepted from 172.28.0.163:50818 #1815 (457 connections now open) 2015-10-05T12:15:09.324+0100 [mongosMain] connection accepted from 172.28.0.163:50820 #1816 (458 connections now open) 2015-10-05T12:15:09.325+0100 [mongosMain] connection accepted from 172.28.0.163:50821 #1817 (459 connections now open) 2015-10-05T12:15:09.325+0100 [mongosMain] connection accepted from 172.28.0.163:50822 #1818 (460 connections now open) 2015-10-05T12:15:09.325+0100 [mongosMain] connection accepted from 172.28.0.163:50819 #1819 (461 connections now open) 2015-10-05T12:15:09.325+0100 [mongosMain] connection accepted from 172.28.0.163:50823 #1820 (462 connections now open) 2015-10-05T12:15:09.327+0100 [mongosMain] connection accepted from 172.28.0.163:50824 #1821 (463 connections now open) 2015-10-05T12:15:09.327+0100 [mongosMain] connection accepted from 172.28.0.163:50825 #1822 (464 connections now open) 2015-10-05T12:15:09.328+0100 [conn1786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.328+0100 [mongosMain] connection accepted from 172.28.0.163:50826 #1823 (465 connections now open) 2015-10-05T12:15:09.329+0100 [mongosMain] connection accepted from 172.28.0.163:50827 #1824 (466 connections now open) 2015-10-05T12:15:09.329+0100 [mongosMain] connection accepted from 172.28.0.163:50828 #1825 (467 connections now open) 2015-10-05T12:15:09.329+0100 [conn1801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.330+0100 [conn1789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.330+0100 [conn1795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.331+0100 [mongosMain] connection accepted from 172.28.0.163:50829 #1826 (468 connections now open) 2015-10-05T12:15:09.331+0100 [conn1787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.334+0100 [conn1764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.337+0100 [conn1807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.338+0100 [conn1770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.340+0100 [mongosMain] connection accepted from 172.28.0.163:50830 #1827 (469 connections now open) 2015-10-05T12:15:09.341+0100 [conn1817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.344+0100 [conn1823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.348+0100 [conn1822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.353+0100 [conn1821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.376+0100 [mongosMain] connection accepted from 172.28.0.163:50832 #1828 (470 connections now open) 2015-10-05T12:15:09.379+0100 [mongosMain] connection accepted from 172.28.0.163:50834 #1829 (471 connections now open) 2015-10-05T12:15:09.379+0100 [mongosMain] connection accepted from 172.28.0.163:50835 #1830 (472 connections now open) 2015-10-05T12:15:09.399+0100 [conn1776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.513+0100 [mongosMain] connection accepted from 172.28.0.163:50841 #1831 (473 connections now open) 2015-10-05T12:15:09.518+0100 [mongosMain] connection accepted from 172.28.0.163:50843 #1832 (474 connections now open) 2015-10-05T12:15:09.520+0100 [mongosMain] connection accepted from 172.28.0.163:50840 #1833 (475 connections now open) 2015-10-05T12:15:09.522+0100 [mongosMain] connection accepted from 172.28.0.163:50845 #1834 (476 connections now open) 2015-10-05T12:15:09.525+0100 [conn1814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.526+0100 [conn1788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.526+0100 [conn1782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.526+0100 [conn1794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.526+0100 [conn1824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.526+0100 [conn1818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.527+0100 [conn1800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.527+0100 [conn1813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.528+0100 [conn1812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.528+0100 [conn1806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.529+0100 [conn1816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.529+0100 [conn1809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.529+0100 [conn1830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.530+0100 [conn1811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.530+0100 [conn1828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.535+0100 [conn1829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.541+0100 [conn1820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.544+0100 [conn1810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.574+0100 [mongosMain] connection accepted from 172.28.0.163:50858 #1835 (477 connections now open) 2015-10-05T12:15:09.588+0100 [mongosMain] connection accepted from 172.28.0.163:50854 #1836 (478 connections now open) 2015-10-05T12:15:09.590+0100 [mongosMain] connection accepted from 172.28.0.163:50857 #1837 (479 connections now open) 2015-10-05T12:15:09.590+0100 [mongosMain] connection accepted from 172.28.0.163:50859 #1838 (480 connections now open) 2015-10-05T12:15:09.598+0100 [mongosMain] connection accepted from 172.28.0.163:50861 #1839 (481 connections now open) 2015-10-05T12:15:09.601+0100 [mongosMain] connection accepted from 172.28.0.163:50867 #1840 (482 connections now open) 2015-10-05T12:15:09.640+0100 [mongosMain] connection accepted from 172.28.0.163:50869 #1841 (483 connections now open) 2015-10-05T12:15:09.644+0100 [conn1815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.644+0100 [conn1833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.645+0100 [mongosMain] connection accepted from 172.28.0.163:50875 #1842 (484 connections now open) 2015-10-05T12:15:09.645+0100 [conn1825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.646+0100 [conn1832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.647+0100 [conn1838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.650+0100 [conn1837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.653+0100 [conn1831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.655+0100 [conn1840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.656+0100 [conn1835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.656+0100 [conn1836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.746+0100 [mongosMain] connection accepted from 172.28.0.163:50873 #1843 (485 connections now open) 2015-10-05T12:15:09.746+0100 [conn1839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.747+0100 [mongosMain] connection accepted from 172.28.0.163:50877 #1844 (486 connections now open) 2015-10-05T12:15:09.748+0100 [mongosMain] connection accepted from 172.28.0.163:50870 #1845 (487 connections now open) 2015-10-05T12:15:09.748+0100 [mongosMain] connection accepted from 172.28.0.163:50878 #1846 (488 connections now open) 2015-10-05T12:15:09.748+0100 [mongosMain] connection accepted from 172.28.0.163:50860 #1847 (489 connections now open) 2015-10-05T12:15:09.750+0100 [mongosMain] connection accepted from 172.28.0.163:50871 #1848 (490 connections now open) 2015-10-05T12:15:09.753+0100 [mongosMain] connection accepted from 172.28.0.163:50880 #1849 (491 connections now open) 2015-10-05T12:15:09.763+0100 [mongosMain] connection accepted from 172.28.0.163:50881 #1850 (492 connections now open) 2015-10-05T12:15:09.763+0100 [conn1841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.763+0100 [conn1842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.781+0100 [mongosMain] connection accepted from 172.28.0.163:50883 #1851 (493 connections now open) 2015-10-05T12:15:09.782+0100 [mongosMain] connection accepted from 172.28.0.163:50885 #1852 (494 connections now open) 2015-10-05T12:15:09.782+0100 [mongosMain] connection accepted from 172.28.0.163:50886 #1853 (495 connections now open) 2015-10-05T12:15:09.784+0100 [mongosMain] connection accepted from 172.28.0.163:50888 #1854 (496 connections now open) 2015-10-05T12:15:09.784+0100 [mongosMain] connection accepted from 172.28.0.163:50876 #1855 (497 connections now open) 2015-10-05T12:15:09.787+0100 [mongosMain] connection accepted from 172.28.0.163:50892 #1856 (498 connections now open) 2015-10-05T12:15:09.790+0100 [mongosMain] connection accepted from 172.28.0.163:50894 #1857 (499 connections now open) 2015-10-05T12:15:09.841+0100 [mongosMain] connection accepted from 172.28.0.163:50896 #1858 (500 connections now open) 2015-10-05T12:15:09.860+0100 [conn1845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.872+0100 [conn1826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.876+0100 [mongosMain] connection accepted from 172.28.0.163:50898 #1859 (501 connections now open) 2015-10-05T12:15:09.877+0100 [conn1834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.887+0100 [conn1843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.887+0100 [conn1847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:09.902+0100 [mongosMain] connection accepted from 172.28.0.163:50902 #1860 (502 connections now open) 2015-10-05T12:15:09.905+0100 [mongosMain] connection accepted from 172.28.0.163:50904 #1861 (503 connections now open) 2015-10-05T12:15:09.906+0100 [mongosMain] connection accepted from 172.28.0.163:50905 #1862 (504 connections now open) 2015-10-05T12:15:09.971+0100 [mongosMain] connection accepted from 172.28.0.163:50906 #1863 (505 connections now open) 2015-10-05T12:15:09.974+0100 [mongosMain] connection accepted from 172.28.0.163:50907 #1864 (506 connections now open) 2015-10-05T12:15:09.984+0100 [mongosMain] connection accepted from 172.28.0.163:50908 #1865 (507 connections now open) 2015-10-05T12:15:09.999+0100 [mongosMain] connection accepted from 172.28.0.163:50909 #1866 (508 connections now open) 2015-10-05T12:15:10.008+0100 [conn1846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.009+0100 [mongosMain] connection accepted from 172.28.0.163:50910 #1867 (509 connections now open) 2015-10-05T12:15:10.013+0100 [mongosMain] connection accepted from 172.28.0.163:50911 #1868 (510 connections now open) 2015-10-05T12:15:10.014+0100 [conn1849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.014+0100 [mongosMain] connection accepted from 172.28.0.163:50913 #1869 (511 connections now open) 2015-10-05T12:15:10.023+0100 [conn1850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.028+0100 [conn1855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.028+0100 [conn1854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.036+0100 [conn1857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.037+0100 [mongosMain] connection accepted from 172.28.0.163:50916 #1870 (512 connections now open) 2015-10-05T12:15:10.038+0100 [conn1858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.039+0100 [conn1861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.039+0100 [conn1859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.039+0100 [conn1860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.040+0100 [conn1852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.040+0100 [conn1856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.041+0100 [conn1862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.041+0100 [conn1851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.041+0100 [mongosMain] connection accepted from 172.28.0.163:50918 #1871 (513 connections now open) 2015-10-05T12:15:10.043+0100 [conn1864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.044+0100 [conn1866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.045+0100 [conn1867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.046+0100 [conn1863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.050+0100 [conn1869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.059+0100 [mongosMain] connection accepted from 172.28.0.163:50923 #1872 (514 connections now open) 2015-10-05T12:15:10.059+0100 [mongosMain] connection accepted from 172.28.0.163:50924 #1873 (515 connections now open) 2015-10-05T12:15:10.062+0100 [mongosMain] connection accepted from 172.28.0.163:50926 #1874 (516 connections now open) 2015-10-05T12:15:10.062+0100 [mongosMain] connection accepted from 172.28.0.163:50927 #1875 (517 connections now open) 2015-10-05T12:15:10.063+0100 [mongosMain] connection accepted from 172.28.0.163:50919 #1876 (518 connections now open) 2015-10-05T12:15:10.063+0100 [mongosMain] connection accepted from 172.28.0.163:50928 #1877 (519 connections now open) 2015-10-05T12:15:10.066+0100 [mongosMain] connection accepted from 172.28.0.163:50929 #1878 (520 connections now open) 2015-10-05T12:15:10.068+0100 [mongosMain] connection accepted from 172.28.0.163:50933 #1879 (521 connections now open) 2015-10-05T12:15:10.070+0100 [conn1654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.071+0100 [conn1642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.072+0100 [conn1647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.074+0100 [mongosMain] connection accepted from 172.28.0.163:50934 #1880 (522 connections now open) 2015-10-05T12:15:10.074+0100 [mongosMain] connection accepted from 172.28.0.163:50935 #1881 (523 connections now open) 2015-10-05T12:15:10.078+0100 [conn1666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.087+0100 [conn1870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.297+0100 [conn1844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.298+0100 [conn1853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.301+0100 [conn1875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.302+0100 [conn1873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.313+0100 [conn1881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.340+0100 [conn1876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.362+0100 [conn1680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.365+0100 [conn1871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.413+0100 [conn1879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.437+0100 [conn1707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.437+0100 [conn1868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.437+0100 [conn1705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.438+0100 [conn1703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.440+0100 [conn1702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.444+0100 [conn1708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.457+0100 [conn1872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.480+0100 [conn1715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.561+0100 [conn1848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.562+0100 [conn1729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.562+0100 [conn1720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.580+0100 [conn1712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.584+0100 [conn1724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.836+0100 [conn1731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.845+0100 [conn1745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.863+0100 [conn1748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.875+0100 [conn1778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.945+0100 [conn1785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.952+0100 [conn1772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:10.956+0100 [conn1758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.094+0100 [conn1799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.114+0100 [conn1803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.119+0100 [conn1797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.143+0100 [conn1753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.144+0100 [conn1759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.144+0100 [conn1777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.157+0100 [conn1740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.211+0100 [conn1819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.271+0100 [conn1827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.290+0100 [conn1798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:11.895+0100 [conn1711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:12.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bc012deab02e298bede 2015-10-05T12:15:13.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:15.259+0100 [conn1277] end connection 172.28.0.164:52237 (522 connections now open) 2015-10-05T12:15:15.260+0100 [mongosMain] connection accepted from 172.28.0.164:54302 #1882 (523 connections now open) 2015-10-05T12:15:15.264+0100 [conn1882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:19.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bc712deab02e298bf1b 2015-10-05T12:15:19.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:23.423+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:15:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:15:25.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bcd12deab02e298bf5e 2015-10-05T12:15:25.749+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:28.215+0100 [mongosMain] connection accepted from 127.0.0.1:51026 #1883 (524 connections now open) 2015-10-05T12:15:28.218+0100 [conn1883] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:28.219+0100 [conn1883] end connection 127.0.0.1:51026 (523 connections now open) 2015-10-05T12:15:30.313+0100 [conn1352] end connection 172.28.0.164:52491 (522 connections now open) 2015-10-05T12:15:30.627+0100 [conn603] end connection 172.28.0.163:56561 (521 connections now open) 2015-10-05T12:15:30.629+0100 [mongosMain] connection accepted from 172.28.0.163:51027 #1884 (522 connections now open) 2015-10-05T12:15:30.631+0100 [conn1884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:32.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bd312deab02e298bf93 2015-10-05T12:15:32.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:38.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bda12deab02e298bfbb 2015-10-05T12:15:38.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:39.209+0100 [mongosMain] connection accepted from 127.0.0.1:51029 #1885 (523 connections now open) 2015-10-05T12:15:39.215+0100 [conn1885] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:15:39.215+0100 [conn1885] end connection 127.0.0.1:51029 (522 connections now open) 2015-10-05T12:15:44.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125be012deab02e298bfdc 2015-10-05T12:15:44.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:50.988+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125be612deab02e298bfff 2015-10-05T12:15:51.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:15:53.821+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:15:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:15:57.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bed12deab02e298c02d 2015-10-05T12:15:57.551+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:03.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bf312deab02e298c053 2015-10-05T12:16:03.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:10.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125bf912deab02e298c076 2015-10-05T12:16:10.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:15.274+0100 [conn1278] end connection 172.28.0.164:52240 (521 connections now open) 2015-10-05T12:16:15.279+0100 [mongosMain] connection accepted from 172.28.0.164:54358 #1886 (522 connections now open) 2015-10-05T12:16:15.282+0100 [conn1886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:16:16.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c0012deab02e298c0b8 2015-10-05T12:16:16.601+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:22.883+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c0612deab02e298c0e3 2015-10-05T12:16:23.019+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:24.077+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:16:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:16:28.483+0100 [mongosMain] connection accepted from 127.0.0.1:51070 #1887 (523 connections now open) 2015-10-05T12:16:28.486+0100 [conn1887] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:16:28.487+0100 [conn1887] end connection 127.0.0.1:51070 (522 connections now open) 2015-10-05T12:16:29.199+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c0d12deab02e298c113 2015-10-05T12:16:29.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:30.329+0100 [conn1356] end connection 172.28.0.164:52495 (521 connections now open) 2015-10-05T12:16:30.642+0100 [conn1096] end connection 172.28.0.163:57886 (520 connections now open) 2015-10-05T12:16:30.645+0100 [mongosMain] connection accepted from 172.28.0.163:51072 #1888 (521 connections now open) 2015-10-05T12:16:30.648+0100 [conn1888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:16:35.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c1312deab02e298c142 2015-10-05T12:16:35.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:39.974+0100 [mongosMain] connection accepted from 127.0.0.1:51073 #1889 (522 connections now open) 2015-10-05T12:16:39.977+0100 [conn1889] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:16:39.977+0100 [conn1889] end connection 127.0.0.1:51073 (521 connections now open) 2015-10-05T12:16:41.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c1912deab02e298c169 2015-10-05T12:16:42.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:48.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c2012deab02e298c1e6 2015-10-05T12:16:48.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:16:54.358+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:16:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:16:54.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c2612deab02e298c28d 2015-10-05T12:16:54.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:00.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c2c12deab02e298c339 2015-10-05T12:17:01.083+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:07.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c3312deab02e298c395 2015-10-05T12:17:07.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:13.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c3912deab02e298c411 2015-10-05T12:17:13.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:15.291+0100 [conn1279] end connection 172.28.0.164:52244 (520 connections now open) 2015-10-05T12:17:15.292+0100 [mongosMain] connection accepted from 172.28.0.164:54410 #1890 (521 connections now open) 2015-10-05T12:17:15.294+0100 [conn1890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:19.967+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c3f12deab02e298c45c 2015-10-05T12:17:20.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:25.765+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:17:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:17:28.921+0100 [mongosMain] connection accepted from 127.0.0.1:51379 #1891 (522 connections now open) 2015-10-05T12:17:28.924+0100 [conn1891] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:28.925+0100 [conn1891] end connection 127.0.0.1:51379 (521 connections now open) 2015-10-05T12:17:30.628+0100 [conn508] end connection 172.28.0.163:55332 (520 connections now open) 2015-10-05T12:17:30.629+0100 [mongosMain] connection accepted from 172.28.0.163:51380 #1892 (521 connections now open) 2015-10-05T12:17:30.630+0100 [conn1892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:31.119+0100 [conn1358] end connection 172.28.0.164:52498 (520 connections now open) 2015-10-05T12:17:32.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c4c12deab02e298c5e3 2015-10-05T12:17:32.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:39.652+0100 [mongosMain] connection accepted from 127.0.0.1:51382 #1893 (521 connections now open) 2015-10-05T12:17:39.654+0100 [conn1893] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:39.654+0100 [conn1893] end connection 127.0.0.1:51382 (520 connections now open) 2015-10-05T12:17:44.774+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c5812deab02e298c768 2015-10-05T12:17:44.841+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:17:56.021+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:17:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:17:56.219+0100 [conn1431] end connection 172.28.0.164:52570 (519 connections now open) 2015-10-05T12:17:56.227+0100 [conn1586] end connection 172.28.0.164:53773 (518 connections now open) 2015-10-05T12:17:56.232+0100 [mongosMain] connection accepted from 172.28.0.164:54472 #1894 (519 connections now open) 2015-10-05T12:17:56.233+0100 [mongosMain] connection accepted from 172.28.0.164:54473 #1895 (520 connections now open) 2015-10-05T12:17:56.236+0100 [conn1895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:56.237+0100 [conn1894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:56.857+0100 [conn1579] end connection 172.28.0.164:53719 (519 connections now open) 2015-10-05T12:17:57.582+0100 [mongosMain] connection accepted from 172.28.0.164:54474 #1896 (520 connections now open) 2015-10-05T12:17:57.591+0100 [conn1896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:17:57.733+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:17:57.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:18:04.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c6c12deab02e298c911 2015-10-05T12:18:05.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:18:08.086+0100 [conn1588] end connection 172.28.0.164:53775 (519 connections now open) 2015-10-05T12:18:08.087+0100 [mongosMain] connection accepted from 172.28.0.164:54489 #1897 (520 connections now open) 2015-10-05T12:18:08.089+0100 [conn1575] end connection 172.28.0.164:53717 (519 connections now open) 2015-10-05T12:18:08.089+0100 [conn1897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:08.090+0100 [mongosMain] connection accepted from 172.28.0.164:54490 #1898 (520 connections now open) 2015-10-05T12:18:08.093+0100 [conn1898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:08.228+0100 [conn1418] end connection 172.28.0.164:52560 (519 connections now open) 2015-10-05T12:18:08.229+0100 [mongosMain] connection accepted from 172.28.0.164:54491 #1899 (520 connections now open) 2015-10-05T12:18:08.232+0100 [conn1899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:08.329+0100 [conn1406] end connection 172.28.0.164:52546 (519 connections now open) 2015-10-05T12:18:08.339+0100 [conn1444] end connection 172.28.0.164:52585 (518 connections now open) 2015-10-05T12:18:08.397+0100 [mongosMain] connection accepted from 172.28.0.164:54493 #1900 (519 connections now open) 2015-10-05T12:18:08.398+0100 [mongosMain] connection accepted from 172.28.0.164:54492 #1901 (520 connections now open) 2015-10-05T12:18:08.400+0100 [conn1900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:08.400+0100 [conn1901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:09.106+0100 [conn1387] end connection 172.28.0.164:52528 (519 connections now open) 2015-10-05T12:18:09.107+0100 [conn1407] end connection 172.28.0.164:52547 (519 connections now open) 2015-10-05T12:18:11.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c7312deab02e298c99f 2015-10-05T12:18:11.488+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:18:15.277+0100 [conn1280] end connection 172.28.0.164:52245 (517 connections now open) 2015-10-05T12:18:15.278+0100 [mongosMain] connection accepted from 172.28.0.164:54497 #1902 (518 connections now open) 2015-10-05T12:18:15.281+0100 [conn1902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:18.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c7912deab02e298ca16 2015-10-05T12:18:18.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:18:26.554+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:18:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:18:28.505+0100 [mongosMain] connection accepted from 127.0.0.1:51435 #1903 (519 connections now open) 2015-10-05T12:18:28.508+0100 [conn1903] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:28.509+0100 [conn1903] end connection 127.0.0.1:51435 (518 connections now open) 2015-10-05T12:18:30.644+0100 [conn1092] end connection 172.28.0.163:57820 (517 connections now open) 2015-10-05T12:18:30.645+0100 [mongosMain] connection accepted from 172.28.0.163:51436 #1904 (518 connections now open) 2015-10-05T12:18:30.646+0100 [conn1904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:31.127+0100 [conn1362] end connection 172.28.0.164:52502 (517 connections now open) 2015-10-05T12:18:31.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c8712deab02e298cabc 2015-10-05T12:18:31.839+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:18:39.431+0100 [mongosMain] connection accepted from 127.0.0.1:51448 #1905 (518 connections now open) 2015-10-05T12:18:39.434+0100 [conn1905] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:18:39.434+0100 [conn1905] end connection 127.0.0.1:51448 (517 connections now open) 2015-10-05T12:18:50.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125c9912deab02e298cbc1 2015-10-05T12:18:50.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:18:57.030+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:18:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:19:03.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ca612deab02e298cc36 2015-10-05T12:19:03.863+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:10.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cad12deab02e298cca7 2015-10-05T12:19:10.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:15.293+0100 [conn1281] end connection 172.28.0.164:52246 (516 connections now open) 2015-10-05T12:19:15.294+0100 [mongosMain] connection accepted from 172.28.0.164:54592 #1906 (517 connections now open) 2015-10-05T12:19:15.298+0100 [conn1906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:17.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cb412deab02e298ccf7 2015-10-05T12:19:17.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:23.824+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cbb12deab02e298cd5a 2015-10-05T12:19:23.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:27.168+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:19:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:19:28.522+0100 [mongosMain] connection accepted from 127.0.0.1:51508 #1907 (518 connections now open) 2015-10-05T12:19:28.524+0100 [conn1907] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:28.525+0100 [conn1907] end connection 127.0.0.1:51508 (517 connections now open) 2015-10-05T12:19:30.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cc112deab02e298cdb0 2015-10-05T12:19:30.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:30.660+0100 [conn1118] end connection 172.28.0.163:58027 (516 connections now open) 2015-10-05T12:19:30.661+0100 [mongosMain] connection accepted from 172.28.0.163:51511 #1908 (517 connections now open) 2015-10-05T12:19:30.662+0100 [conn1908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:31.145+0100 [conn1364] end connection 172.28.0.164:52505 (516 connections now open) 2015-10-05T12:19:36.570+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cc812deab02e298ce02 2015-10-05T12:19:36.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:39.213+0100 [mongosMain] connection accepted from 127.0.0.1:51514 #1909 (517 connections now open) 2015-10-05T12:19:39.216+0100 [conn1909] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:39.216+0100 [conn1909] end connection 127.0.0.1:51514 (516 connections now open) 2015-10-05T12:19:43.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cce12deab02e298ce45 2015-10-05T12:19:43.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:44.617+0100 [conn1365] end connection 172.28.0.164:52504 (515 connections now open) 2015-10-05T12:19:44.620+0100 [conn1405] end connection 172.28.0.164:52545 (514 connections now open) 2015-10-05T12:19:44.648+0100 [mongosMain] connection accepted from 172.28.0.164:54636 #1910 (515 connections now open) 2015-10-05T12:19:44.648+0100 [mongosMain] connection accepted from 172.28.0.164:54637 #1911 (516 connections now open) 2015-10-05T12:19:44.652+0100 [conn1910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:44.653+0100 [conn1911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:19:50.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cd512deab02e298ce72 2015-10-05T12:19:50.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:19:57.458+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:19:57.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:19:57.662+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:19:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:20:03.831+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ce312deab02e298cf00 2015-10-05T12:20:04.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:10.323+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cea12deab02e298cf67 2015-10-05T12:20:10.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:15.311+0100 [conn1282] end connection 172.28.0.164:52247 (515 connections now open) 2015-10-05T12:20:15.312+0100 [mongosMain] connection accepted from 172.28.0.164:54666 #1912 (516 connections now open) 2015-10-05T12:20:15.314+0100 [conn1912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:16.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cf012deab02e298cfc1 2015-10-05T12:20:16.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:23.494+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cf612deab02e298d01c 2015-10-05T12:20:23.630+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:29.138+0100 [mongosMain] connection accepted from 127.0.0.1:51566 #1913 (517 connections now open) 2015-10-05T12:20:29.140+0100 [conn1913] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:29.141+0100 [conn1913] end connection 127.0.0.1:51566 (516 connections now open) 2015-10-05T12:20:29.292+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:20:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:20:29.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125cfd12deab02e298d074 2015-10-05T12:20:30.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:30.677+0100 [conn955] end connection 172.28.0.163:56934 (515 connections now open) 2015-10-05T12:20:30.679+0100 [mongosMain] connection accepted from 172.28.0.163:51569 #1914 (516 connections now open) 2015-10-05T12:20:30.681+0100 [conn1914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:31.159+0100 [conn1366] end connection 172.28.0.164:52506 (515 connections now open) 2015-10-05T12:20:36.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d0412deab02e298d0c8 2015-10-05T12:20:36.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:39.408+0100 [mongosMain] connection accepted from 127.0.0.1:51573 #1915 (516 connections now open) 2015-10-05T12:20:39.410+0100 [conn1915] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:39.410+0100 [conn1915] end connection 127.0.0.1:51573 (515 connections now open) 2015-10-05T12:20:40.785+0100 [conn1414] end connection 172.28.0.164:52555 (514 connections now open) 2015-10-05T12:20:40.787+0100 [mongosMain] connection accepted from 172.28.0.164:54701 #1916 (515 connections now open) 2015-10-05T12:20:40.790+0100 [conn1916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:40.794+0100 [conn1379] end connection 172.28.0.164:52519 (514 connections now open) 2015-10-05T12:20:40.796+0100 [mongosMain] connection accepted from 172.28.0.164:54702 #1917 (515 connections now open) 2015-10-05T12:20:40.800+0100 [conn1917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:40.802+0100 [conn1340] end connection 172.28.0.164:52480 (514 connections now open) 2015-10-05T12:20:40.802+0100 [conn1329] end connection 172.28.0.164:52469 (513 connections now open) 2015-10-05T12:20:40.803+0100 [mongosMain] connection accepted from 172.28.0.164:54703 #1918 (514 connections now open) 2015-10-05T12:20:40.803+0100 [mongosMain] connection accepted from 172.28.0.164:54704 #1919 (515 connections now open) 2015-10-05T12:20:40.805+0100 [conn1918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:40.805+0100 [conn1919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:40.809+0100 [conn1359] end connection 172.28.0.164:52499 (514 connections now open) 2015-10-05T12:20:41.000+0100 [mongosMain] connection accepted from 172.28.0.164:54705 #1920 (515 connections now open) 2015-10-05T12:20:41.003+0100 [conn1920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:20:42.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d0a12deab02e298d12a 2015-10-05T12:20:42.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:48.824+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d1012deab02e298d181 2015-10-05T12:20:48.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:55.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d1612deab02e298d1cb 2015-10-05T12:20:55.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:20:59.912+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:20:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:21:07.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d2312deab02e298d276 2015-10-05T12:21:07.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:14.177+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:21:14.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:21:15.325+0100 [conn1283] end connection 172.28.0.164:52248 (514 connections now open) 2015-10-05T12:21:15.327+0100 [mongosMain] connection accepted from 172.28.0.164:54733 #1921 (515 connections now open) 2015-10-05T12:21:15.330+0100 [conn1921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:21:20.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d3012deab02e298d33e 2015-10-05T12:21:20.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:26.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d3612deab02e298d38f 2015-10-05T12:21:27.034+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:28.638+0100 [mongosMain] connection accepted from 127.0.0.1:51639 #1922 (516 connections now open) 2015-10-05T12:21:28.640+0100 [conn1922] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:21:28.641+0100 [conn1922] end connection 127.0.0.1:51639 (515 connections now open) 2015-10-05T12:21:30.327+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:21:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:21:30.692+0100 [conn1114] end connection 172.28.0.163:57968 (514 connections now open) 2015-10-05T12:21:30.693+0100 [mongosMain] connection accepted from 172.28.0.163:51640 #1923 (515 connections now open) 2015-10-05T12:21:30.694+0100 [conn1923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:21:31.175+0100 [conn1367] end connection 172.28.0.164:52507 (514 connections now open) 2015-10-05T12:21:33.196+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d3d12deab02e298d3ea 2015-10-05T12:21:33.263+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:39.544+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d4312deab02e298d423 2015-10-05T12:21:39.680+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:39.699+0100 [mongosMain] connection accepted from 127.0.0.1:51644 #1924 (515 connections now open) 2015-10-05T12:21:39.702+0100 [conn1924] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:21:39.702+0100 [conn1924] end connection 127.0.0.1:51644 (514 connections now open) 2015-10-05T12:21:46.030+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d4912deab02e298d459 2015-10-05T12:21:46.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:21:52.378+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d5012deab02e298d4a7 2015-10-05T12:21:52.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:22:00.634+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:22:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:22:12.204+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:22:12.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:22:15.371+0100 [conn1284] end connection 172.28.0.164:52249 (513 connections now open) 2015-10-05T12:22:15.373+0100 [mongosMain] connection accepted from 172.28.0.164:54793 #1925 (514 connections now open) 2015-10-05T12:22:15.375+0100 [conn1925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:22:24.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d7012deab02e298d69a 2015-10-05T12:22:24.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:22:29.141+0100 [mongosMain] connection accepted from 127.0.0.1:51698 #1926 (515 connections now open) 2015-10-05T12:22:29.144+0100 [conn1926] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:22:29.145+0100 [conn1926] end connection 127.0.0.1:51698 (514 connections now open) 2015-10-05T12:22:30.740+0100 [conn1147] end connection 172.28.0.163:58184 (513 connections now open) 2015-10-05T12:22:30.741+0100 [mongosMain] connection accepted from 172.28.0.163:51700 #1927 (514 connections now open) 2015-10-05T12:22:30.743+0100 [conn1927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:22:30.885+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:22:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:22:31.223+0100 [conn1370] end connection 172.28.0.164:52510 (513 connections now open) 2015-10-05T12:22:37.026+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d7c12deab02e298d78d 2015-10-05T12:22:37.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:22:39.762+0100 [mongosMain] connection accepted from 127.0.0.1:51702 #1928 (514 connections now open) 2015-10-05T12:22:39.765+0100 [conn1928] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:22:39.765+0100 [conn1928] end connection 127.0.0.1:51702 (513 connections now open) 2015-10-05T12:22:49.321+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:22:49.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:23:01.157+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:23:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:23:01.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d9512deab02e298d976 2015-10-05T12:23:01.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:07.881+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125d9b12deab02e298d9f9 2015-10-05T12:23:07.948+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:14.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125da112deab02e298da67 2015-10-05T12:23:14.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:15.388+0100 [conn1285] end connection 172.28.0.164:52250 (512 connections now open) 2015-10-05T12:23:15.389+0100 [mongosMain] connection accepted from 172.28.0.164:54854 #1929 (513 connections now open) 2015-10-05T12:23:15.392+0100 [conn1929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:23:21.349+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56125da503838a4537163267') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444044201015), why: "doing balance round", ts: ObjectId('56125da912deab02e298dad6') } } gle1: { lastOp: Timestamp 1444044201000|3, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } gle2: { lastOp: Timestamp 1444044194000|8, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2015-10-05T12:23:21.353+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1444039191:41' 2015-10-05T12:23:21.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125da912deab02e298dad6 2015-10-05T12:23:22.067+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:28.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125db012deab02e298db4b 2015-10-05T12:23:28.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:28.698+0100 [mongosMain] connection accepted from 127.0.0.1:51754 #1930 (514 connections now open) 2015-10-05T12:23:28.698+0100 [conn1930] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:23:28.698+0100 [conn1930] end connection 127.0.0.1:51754 (513 connections now open) 2015-10-05T12:23:30.789+0100 [conn1129] end connection 172.28.0.163:58101 (512 connections now open) 2015-10-05T12:23:30.789+0100 [mongosMain] connection accepted from 172.28.0.163:51763 #1931 (513 connections now open) 2015-10-05T12:23:30.789+0100 [conn1931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:23:31.257+0100 [conn1369] end connection 172.28.0.164:52508 (512 connections now open) 2015-10-05T12:23:31.331+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:23:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:23:34.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125db612deab02e298dbcd 2015-10-05T12:23:34.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:40.051+0100 [mongosMain] connection accepted from 127.0.0.1:51766 #1932 (513 connections now open) 2015-10-05T12:23:40.054+0100 [conn1932] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:23:40.054+0100 [conn1932] end connection 127.0.0.1:51766 (512 connections now open) 2015-10-05T12:23:40.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125dbc12deab02e298dc5c 2015-10-05T12:23:40.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:23:47.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125dc212deab02e298dce8 2015-10-05T12:23:47.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:24:00.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125dd012deab02e298dde4 2015-10-05T12:24:00.833+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:24:01.586+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:24:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:24:15.404+0100 [conn1286] end connection 172.28.0.164:52251 (511 connections now open) 2015-10-05T12:24:15.406+0100 [mongosMain] connection accepted from 172.28.0.164:54910 #1933 (512 connections now open) 2015-10-05T12:24:15.409+0100 [conn1933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:24:26.872+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125de812deab02e298e015 2015-10-05T12:24:26.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:24:28.416+0100 [mongosMain] connection accepted from 127.0.0.1:51817 #1934 (513 connections now open) 2015-10-05T12:24:28.419+0100 [conn1934] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:24:28.420+0100 [conn1934] end connection 127.0.0.1:51817 (512 connections now open) 2015-10-05T12:24:30.771+0100 [conn1157] end connection 172.28.0.163:58318 (511 connections now open) 2015-10-05T12:24:30.772+0100 [mongosMain] connection accepted from 172.28.0.163:51818 #1935 (512 connections now open) 2015-10-05T12:24:30.773+0100 [conn1935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:24:31.254+0100 [conn1368] end connection 172.28.0.164:52509 (511 connections now open) 2015-10-05T12:24:33.407+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:24:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:24:33.408+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:24:33.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:24:39.480+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:24:39.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:24:40.204+0100 [mongosMain] connection accepted from 127.0.0.1:51822 #1936 (512 connections now open) 2015-10-05T12:24:40.206+0100 [conn1936] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:24:40.207+0100 [conn1936] end connection 127.0.0.1:51822 (511 connections now open) 2015-10-05T12:24:45.620+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:24:45.620+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:25:00.463+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:25:00.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:25:03.621+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:25:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:25:06.627+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e1212deab02e298e36f 2015-10-05T12:25:06.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:15.421+0100 [conn1287] end connection 172.28.0.164:52252 (510 connections now open) 2015-10-05T12:25:15.422+0100 [mongosMain] connection accepted from 172.28.0.164:54972 #1937 (511 connections now open) 2015-10-05T12:25:15.424+0100 [conn1937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:25:18.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e1e12deab02e298e448 2015-10-05T12:25:19.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:23.751+0100 [conn1640] end connection 172.28.0.163:50639 (510 connections now open) 2015-10-05T12:25:25.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e2512deab02e298e49b 2015-10-05T12:25:25.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:28.284+0100 [mongosMain] connection accepted from 127.0.0.1:51873 #1938 (511 connections now open) 2015-10-05T12:25:28.286+0100 [conn1938] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:25:28.288+0100 [conn1938] end connection 127.0.0.1:51873 (510 connections now open) 2015-10-05T12:25:30.788+0100 [conn1088] end connection 172.28.0.163:57755 (509 connections now open) 2015-10-05T12:25:30.789+0100 [mongosMain] connection accepted from 172.28.0.163:51874 #1939 (510 connections now open) 2015-10-05T12:25:30.790+0100 [conn1939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:25:31.271+0100 [conn1360] end connection 172.28.0.164:52500 (509 connections now open) 2015-10-05T12:25:33.903+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:25:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:25:38.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e3212deab02e298e56e 2015-10-05T12:25:38.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:39.624+0100 [mongosMain] connection accepted from 127.0.0.1:51879 #1940 (510 connections now open) 2015-10-05T12:25:39.626+0100 [conn1940] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:25:39.627+0100 [conn1940] end connection 127.0.0.1:51879 (509 connections now open) 2015-10-05T12:25:45.094+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e3812deab02e298e5ef 2015-10-05T12:25:45.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:51.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e3f12deab02e298e68c 2015-10-05T12:25:51.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:25:58.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e4512deab02e298e723 2015-10-05T12:25:58.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:04.199+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:26:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:26:05.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e4c12deab02e298e7aa 2015-10-05T12:26:05.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:11.473+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e5312deab02e298e805 2015-10-05T12:26:11.608+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:15.425+0100 [conn1288] end connection 172.28.0.164:52253 (508 connections now open) 2015-10-05T12:26:15.426+0100 [mongosMain] connection accepted from 172.28.0.164:55031 #1941 (509 connections now open) 2015-10-05T12:26:15.429+0100 [conn1941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:26:17.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e5912deab02e298e845 2015-10-05T12:26:18.041+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:23.757+0100 [conn1643] end connection 172.28.0.163:50642 (508 connections now open) 2015-10-05T12:26:24.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e6012deab02e298e8bf 2015-10-05T12:26:24.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:28.970+0100 [mongosMain] connection accepted from 127.0.0.1:51929 #1942 (509 connections now open) 2015-10-05T12:26:28.972+0100 [conn1942] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:26:28.973+0100 [conn1942] end connection 127.0.0.1:51929 (508 connections now open) 2015-10-05T12:26:30.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e6612deab02e298e933 2015-10-05T12:26:30.671+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:30.794+0100 [conn1509] end connection 172.28.0.163:59118 (507 connections now open) 2015-10-05T12:26:30.797+0100 [mongosMain] connection accepted from 172.28.0.163:51931 #1943 (508 connections now open) 2015-10-05T12:26:30.799+0100 [conn1943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:26:31.276+0100 [conn1376] end connection 172.28.0.164:52517 (507 connections now open) 2015-10-05T12:26:34.337+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:26:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:26:36.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e6c12deab02e298e9bf 2015-10-05T12:26:37.069+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:26:40.150+0100 [mongosMain] connection accepted from 127.0.0.1:51936 #1944 (508 connections now open) 2015-10-05T12:26:40.152+0100 [conn1944] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:26:40.152+0100 [conn1944] end connection 127.0.0.1:51936 (507 connections now open) 2015-10-05T12:26:43.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e7312deab02e298ea30 2015-10-05T12:26:43.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:03.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e8512deab02e298eb93 2015-10-05T12:27:03.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:04.500+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:27:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:27:09.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125e8d12deab02e298ec48 2015-10-05T12:27:10.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:15.441+0100 [conn1289] end connection 172.28.0.164:52254 (506 connections now open) 2015-10-05T12:27:15.442+0100 [mongosMain] connection accepted from 172.28.0.164:55085 #1945 (507 connections now open) 2015-10-05T12:27:15.445+0100 [conn1945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:23.773+0100 [conn1639] end connection 172.28.0.163:50638 (506 connections now open) 2015-10-05T12:27:28.360+0100 [mongosMain] connection accepted from 127.0.0.1:51987 #1946 (507 connections now open) 2015-10-05T12:27:28.363+0100 [conn1946] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:28.364+0100 [conn1946] end connection 127.0.0.1:51987 (506 connections now open) 2015-10-05T12:27:28.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ea012deab02e298edc4 2015-10-05T12:27:28.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:30.808+0100 [conn1320] end connection 172.28.0.163:59036 (505 connections now open) 2015-10-05T12:27:30.810+0100 [mongosMain] connection accepted from 172.28.0.163:51988 #1947 (506 connections now open) 2015-10-05T12:27:30.812+0100 [conn1947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:31.292+0100 [conn1378] end connection 172.28.0.164:52518 (505 connections now open) 2015-10-05T12:27:34.777+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:27:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:27:35.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ea612deab02e298ee28 2015-10-05T12:27:35.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:39.642+0100 [mongosMain] connection accepted from 127.0.0.1:51991 #1948 (506 connections now open) 2015-10-05T12:27:39.645+0100 [conn1948] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:39.645+0100 [conn1948] end connection 127.0.0.1:51991 (505 connections now open) 2015-10-05T12:27:42.491+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ead12deab02e298eeb3 2015-10-05T12:27:43.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:51.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125eb512deab02e298ef5d 2015-10-05T12:27:51.233+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:27:57.965+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:27:57.965+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:27:59.219+0100 [conn1753] end connection 172.28.0.163:50755 (504 connections now open) 2015-10-05T12:27:59.221+0100 [mongosMain] connection accepted from 172.28.0.163:52012 #1949 (505 connections now open) 2015-10-05T12:27:59.222+0100 [conn1949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:59.261+0100 [conn1832] end connection 172.28.0.163:50843 (504 connections now open) 2015-10-05T12:27:59.261+0100 [conn1708] end connection 172.28.0.163:50709 (503 connections now open) 2015-10-05T12:27:59.262+0100 [conn1709] end connection 172.28.0.163:50714 (502 connections now open) 2015-10-05T12:27:59.263+0100 [mongosMain] connection accepted from 172.28.0.163:52014 #1950 (503 connections now open) 2015-10-05T12:27:59.263+0100 [mongosMain] connection accepted from 172.28.0.163:52013 #1951 (504 connections now open) 2015-10-05T12:27:59.263+0100 [mongosMain] connection accepted from 172.28.0.163:52015 #1952 (505 connections now open) 2015-10-05T12:27:59.265+0100 [conn1951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:59.265+0100 [conn1952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:59.267+0100 [conn1950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:27:59.285+0100 [conn1809] end connection 172.28.0.163:50812 (504 connections now open) 2015-10-05T12:27:59.286+0100 [mongosMain] connection accepted from 172.28.0.163:52016 #1953 (505 connections now open) 2015-10-05T12:27:59.288+0100 [conn1953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:28:04.238+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56125ebfd5de43e0ed5d3e3f') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444044483973), why: "doing balance round", ts: ObjectId('56125ec312deab02e298f02b') } } gle1: { lastOp: Timestamp 1444044484000|1, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1444044471000|2, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } 2015-10-05T12:28:04.241+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:28:04.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:28:05.159+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:28:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:28:05.159+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:28:05.228+0100 [LockPinger] handled late remove of old distributed lock with ts 56125ec312deab02e298f02b 2015-10-05T12:28:10.516+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125eca12deab02e298f0a5 2015-10-05T12:28:10.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:28:15.464+0100 [conn1290] end connection 172.28.0.164:52255 (504 connections now open) 2015-10-05T12:28:15.467+0100 [mongosMain] connection accepted from 172.28.0.164:55145 #1954 (505 connections now open) 2015-10-05T12:28:15.471+0100 [conn1954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:28:16.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ed012deab02e298f0f6 2015-10-05T12:28:16.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:28:23.789+0100 [conn1650] end connection 172.28.0.163:50649 (504 connections now open) 2015-10-05T12:28:30.824+0100 [conn1308] end connection 172.28.0.163:58836 (503 connections now open) 2015-10-05T12:28:30.826+0100 [mongosMain] connection accepted from 172.28.0.163:52045 #1955 (504 connections now open) 2015-10-05T12:28:30.828+0100 [conn1955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:28:31.308+0100 [conn1383] end connection 172.28.0.164:52523 (503 connections now open) 2015-10-05T12:28:33.930+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125edc12deab02e298f1a3 2015-10-05T12:28:34.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:28:36.079+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:28:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:28:36.669+0100 [mongosMain] connection accepted from 127.0.0.1:52046 #1956 (504 connections now open) 2015-10-05T12:28:36.672+0100 [conn1956] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:28:36.673+0100 [conn1956] end connection 127.0.0.1:52046 (503 connections now open) 2015-10-05T12:28:39.494+0100 [mongosMain] connection accepted from 127.0.0.1:52050 #1957 (504 connections now open) 2015-10-05T12:28:39.496+0100 [conn1957] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:28:39.496+0100 [conn1957] end connection 127.0.0.1:52050 (503 connections now open) 2015-10-05T12:28:41.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ee812deab02e298f229 2015-10-05T12:28:41.164+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:28:48.738+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:28:48.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:28:55.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ef612deab02e298f324 2015-10-05T12:28:55.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:06.339+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:29:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:29:07.773+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:29:07.773+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:29:13.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f0912deab02e298f49a 2015-10-05T12:29:14.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:15.474+0100 [conn1291] end connection 172.28.0.164:52256 (502 connections now open) 2015-10-05T12:29:15.475+0100 [mongosMain] connection accepted from 172.28.0.164:55200 #1958 (503 connections now open) 2015-10-05T12:29:15.478+0100 [conn1958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:29:20.810+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:29:20.810+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:29:23.804+0100 [conn1653] end connection 172.28.0.163:50653 (502 connections now open) 2015-10-05T12:29:26.953+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:29:26.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:29:28.660+0100 [mongosMain] connection accepted from 127.0.0.1:52107 #1959 (503 connections now open) 2015-10-05T12:29:28.662+0100 [conn1959] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:29:28.663+0100 [conn1959] end connection 127.0.0.1:52107 (502 connections now open) 2015-10-05T12:29:30.841+0100 [conn1002] end connection 172.28.0.163:57434 (501 connections now open) 2015-10-05T12:29:30.842+0100 [mongosMain] connection accepted from 172.28.0.163:52110 #1960 (502 connections now open) 2015-10-05T12:29:30.844+0100 [conn1960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:29:31.338+0100 [conn1384] end connection 172.28.0.164:52524 (501 connections now open) 2015-10-05T12:29:34.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f1c12deab02e298f5c1 2015-10-05T12:29:34.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:36.742+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:29:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:29:40.100+0100 [mongosMain] connection accepted from 127.0.0.1:52120 #1961 (502 connections now open) 2015-10-05T12:29:40.103+0100 [conn1961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:29:40.103+0100 [conn1961] end connection 127.0.0.1:52120 (501 connections now open) 2015-10-05T12:29:40.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f2412deab02e298f637 2015-10-05T12:29:40.838+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:46.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f2a12deab02e298f6a2 2015-10-05T12:29:47.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:53.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f3112deab02e298f6eb 2015-10-05T12:29:53.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:29:59.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f3712deab02e298f732 2015-10-05T12:29:59.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:30:06.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f3d12deab02e298f7a2 2015-10-05T12:30:06.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:30:07.174+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:30:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:30:12.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f4412deab02e298f804 2015-10-05T12:30:12.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:30:15.492+0100 [conn1292] end connection 172.28.0.164:52257 (500 connections now open) 2015-10-05T12:30:15.494+0100 [mongosMain] connection accepted from 172.28.0.164:55271 #1962 (501 connections now open) 2015-10-05T12:30:15.497+0100 [conn1962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:30:18.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f4a12deab02e298f85a 2015-10-05T12:30:18.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:30:23.825+0100 [conn1656] end connection 172.28.0.163:50654 (500 connections now open) 2015-10-05T12:30:25.477+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:30:25.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:30:25.506+0100 [conn1555] end connection 172.28.0.164:53500 (499 connections now open) 2015-10-05T12:30:25.508+0100 [mongosMain] connection accepted from 172.28.0.164:55284 #1963 (500 connections now open) 2015-10-05T12:30:25.511+0100 [conn1963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:30:28.539+0100 [mongosMain] connection accepted from 127.0.0.1:52191 #1964 (501 connections now open) 2015-10-05T12:30:28.542+0100 [conn1964] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:30:28.543+0100 [conn1964] end connection 127.0.0.1:52191 (500 connections now open) 2015-10-05T12:30:30.860+0100 [conn1165] end connection 172.28.0.163:58397 (499 connections now open) 2015-10-05T12:30:30.861+0100 [mongosMain] connection accepted from 172.28.0.163:52192 #1965 (500 connections now open) 2015-10-05T12:30:30.864+0100 [conn1965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:30:31.343+0100 [conn1389] end connection 172.28.0.164:52529 (499 connections now open) 2015-10-05T12:30:37.382+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:30:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:30:37.589+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:30:37.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:30:39.277+0100 [mongosMain] connection accepted from 127.0.0.1:52197 #1966 (500 connections now open) 2015-10-05T12:30:39.280+0100 [conn1966] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:30:39.280+0100 [conn1966] end connection 127.0.0.1:52197 (499 connections now open) 2015-10-05T12:30:43.829+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:30:43.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:30:49.989+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:30:49.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:30:59.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f6f12deab02e298fa57 2015-10-05T12:30:59.284+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:05.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f7912deab02e298faf2 2015-10-05T12:31:06.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:07.507+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:31:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:31:12.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f8012deab02e298fb6f 2015-10-05T12:31:12.251+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:15.508+0100 [conn1295] end connection 172.28.0.164:52260 (498 connections now open) 2015-10-05T12:31:15.509+0100 [mongosMain] connection accepted from 172.28.0.164:55334 #1967 (499 connections now open) 2015-10-05T12:31:15.511+0100 [conn1967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:18.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f8612deab02e298fbd0 2015-10-05T12:31:18.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:23.840+0100 [conn1658] end connection 172.28.0.163:50657 (498 connections now open) 2015-10-05T12:31:24.778+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f8c12deab02e298fc4d 2015-10-05T12:31:24.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:28.690+0100 [mongosMain] connection accepted from 127.0.0.1:52281 #1968 (499 connections now open) 2015-10-05T12:31:28.693+0100 [conn1968] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:28.695+0100 [conn1968] end connection 127.0.0.1:52281 (498 connections now open) 2015-10-05T12:31:30.878+0100 [conn1232] end connection 172.28.0.163:58590 (497 connections now open) 2015-10-05T12:31:30.879+0100 [mongosMain] connection accepted from 172.28.0.163:52283 #1969 (498 connections now open) 2015-10-05T12:31:30.880+0100 [conn1969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:31.359+0100 [conn1380] end connection 172.28.0.164:52520 (497 connections now open) 2015-10-05T12:31:37.089+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56125f9438482111da12e1c9') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444044696897), why: "doing balance round", ts: ObjectId('56125f9812deab02e298fd13') } } gle1: { lastOp: Timestamp 1444044697000|1, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1444044684000|6, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2015-10-05T12:31:37.092+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:31:37.092+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:31:37.774+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:31:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:31:37.774+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:31:37.911+0100 [LockPinger] handled late remove of old distributed lock with ts 56125f9812deab02e298fd13 2015-10-05T12:31:39.207+0100 [mongosMain] connection accepted from 127.0.0.1:52286 #1970 (498 connections now open) 2015-10-05T12:31:39.210+0100 [conn1970] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:39.210+0100 [conn1970] end connection 127.0.0.1:52286 (497 connections now open) 2015-10-05T12:31:43.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125f9f12deab02e298fd69 2015-10-05T12:31:43.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:31:59.061+0100 [conn1826] end connection 172.28.0.163:50829 (496 connections now open) 2015-10-05T12:31:59.062+0100 [conn1839] end connection 172.28.0.163:50861 (495 connections now open) 2015-10-05T12:31:59.063+0100 [mongosMain] connection accepted from 172.28.0.163:52318 #1971 (496 connections now open) 2015-10-05T12:31:59.063+0100 [mongosMain] connection accepted from 172.28.0.163:52319 #1972 (497 connections now open) 2015-10-05T12:31:59.065+0100 [conn1971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.065+0100 [conn1972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.067+0100 [conn1850] end connection 172.28.0.163:50881 (496 connections now open) 2015-10-05T12:31:59.068+0100 [mongosMain] connection accepted from 172.28.0.163:52320 #1973 (497 connections now open) 2015-10-05T12:31:59.070+0100 [conn1973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.098+0100 [conn1783] end connection 172.28.0.163:50786 (496 connections now open) 2015-10-05T12:31:59.099+0100 [conn1741] end connection 172.28.0.163:50743 (495 connections now open) 2015-10-05T12:31:59.099+0100 [mongosMain] connection accepted from 172.28.0.163:52321 #1974 (496 connections now open) 2015-10-05T12:31:59.100+0100 [mongosMain] connection accepted from 172.28.0.163:52322 #1975 (497 connections now open) 2015-10-05T12:31:59.101+0100 [conn1974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.102+0100 [conn1975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.114+0100 [conn1873] end connection 172.28.0.163:50924 (496 connections now open) 2015-10-05T12:31:59.115+0100 [mongosMain] connection accepted from 172.28.0.163:52323 #1976 (497 connections now open) 2015-10-05T12:31:59.117+0100 [conn1976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.123+0100 [conn1704] end connection 172.28.0.163:50705 (496 connections now open) 2015-10-05T12:31:59.123+0100 [conn1773] end connection 172.28.0.163:50775 (496 connections now open) 2015-10-05T12:31:59.124+0100 [mongosMain] connection accepted from 172.28.0.163:52324 #1977 (496 connections now open) 2015-10-05T12:31:59.124+0100 [mongosMain] connection accepted from 172.28.0.163:52325 #1978 (497 connections now open) 2015-10-05T12:31:59.126+0100 [conn1977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.126+0100 [conn1759] end connection 172.28.0.163:50761 (496 connections now open) 2015-10-05T12:31:59.126+0100 [conn1978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.127+0100 [mongosMain] connection accepted from 172.28.0.163:52326 #1979 (497 connections now open) 2015-10-05T12:31:59.128+0100 [conn1979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.177+0100 [conn1825] end connection 172.28.0.163:50828 (496 connections now open) 2015-10-05T12:31:59.178+0100 [mongosMain] connection accepted from 172.28.0.163:52327 #1980 (497 connections now open) 2015-10-05T12:31:59.181+0100 [conn1980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.188+0100 [conn1700] end connection 172.28.0.163:50700 (496 connections now open) 2015-10-05T12:31:59.189+0100 [mongosMain] connection accepted from 172.28.0.163:52328 #1981 (497 connections now open) 2015-10-05T12:31:59.190+0100 [conn1761] end connection 172.28.0.163:50763 (496 connections now open) 2015-10-05T12:31:59.191+0100 [mongosMain] connection accepted from 172.28.0.163:52329 #1982 (497 connections now open) 2015-10-05T12:31:59.191+0100 [conn1981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.192+0100 [conn1982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.319+0100 [conn1717] end connection 172.28.0.163:50717 (496 connections now open) 2015-10-05T12:31:59.321+0100 [mongosMain] connection accepted from 172.28.0.163:52330 #1983 (497 connections now open) 2015-10-05T12:31:59.322+0100 [conn1983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:31:59.325+0100 [conn1827] end connection 172.28.0.163:50830 (496 connections now open) 2015-10-05T12:31:59.326+0100 [mongosMain] connection accepted from 172.28.0.163:52332 #1984 (497 connections now open) 2015-10-05T12:31:59.327+0100 [conn1984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:02.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fb112deab02e298fe6d 2015-10-05T12:32:02.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:08.053+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:32:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:32:08.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fb812deab02e298fef4 2015-10-05T12:32:08.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:14.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fbe12deab02e298ff67 2015-10-05T12:32:14.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:15.532+0100 [conn1294] end connection 172.28.0.164:52259 (496 connections now open) 2015-10-05T12:32:15.534+0100 [mongosMain] connection accepted from 172.28.0.164:55391 #1985 (497 connections now open) 2015-10-05T12:32:15.537+0100 [conn1985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:21.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fc412deab02e298ffd6 2015-10-05T12:32:21.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:23.857+0100 [conn1663] end connection 172.28.0.163:50663 (496 connections now open) 2015-10-05T12:32:27.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fcb12deab02e2990055 2015-10-05T12:32:27.688+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:28.625+0100 [mongosMain] connection accepted from 127.0.0.1:52373 #1986 (497 connections now open) 2015-10-05T12:32:28.628+0100 [conn1986] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:28.629+0100 [conn1986] end connection 127.0.0.1:52373 (496 connections now open) 2015-10-05T12:32:30.893+0100 [conn1248] end connection 172.28.0.163:58653 (495 connections now open) 2015-10-05T12:32:30.894+0100 [mongosMain] connection accepted from 172.28.0.163:52379 #1987 (496 connections now open) 2015-10-05T12:32:30.895+0100 [conn1987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:31.374+0100 [conn1399] end connection 172.28.0.164:52539 (495 connections now open) 2015-10-05T12:32:33.981+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fd112deab02e29900c0 2015-10-05T12:32:35.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:38.180+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:32:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:32:39.281+0100 [mongosMain] connection accepted from 127.0.0.1:52390 #1988 (496 connections now open) 2015-10-05T12:32:39.284+0100 [conn1988] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:39.284+0100 [conn1988] end connection 127.0.0.1:52390 (495 connections now open) 2015-10-05T12:32:42.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fd912deab02e2990151 2015-10-05T12:32:42.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:55.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125fe612deab02e2990231 2015-10-05T12:32:55.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:32:59.154+0100 [conn1728] end connection 172.28.0.163:50730 (494 connections now open) 2015-10-05T12:32:59.156+0100 [mongosMain] connection accepted from 172.28.0.163:52423 #1989 (495 connections now open) 2015-10-05T12:32:59.158+0100 [conn1989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.196+0100 [conn1866] end connection 172.28.0.163:50909 (494 connections now open) 2015-10-05T12:32:59.197+0100 [mongosMain] connection accepted from 172.28.0.163:52424 #1990 (495 connections now open) 2015-10-05T12:32:59.200+0100 [conn1990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.216+0100 [conn1767] end connection 172.28.0.163:50769 (494 connections now open) 2015-10-05T12:32:59.217+0100 [mongosMain] connection accepted from 172.28.0.163:52425 #1991 (495 connections now open) 2015-10-05T12:32:59.219+0100 [conn1991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.271+0100 [conn1723] end connection 172.28.0.163:50726 (494 connections now open) 2015-10-05T12:32:59.272+0100 [conn1645] end connection 172.28.0.163:50644 (493 connections now open) 2015-10-05T12:32:59.273+0100 [mongosMain] connection accepted from 172.28.0.163:52426 #1992 (494 connections now open) 2015-10-05T12:32:59.273+0100 [mongosMain] connection accepted from 172.28.0.163:52427 #1993 (495 connections now open) 2015-10-05T12:32:59.274+0100 [conn1992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.274+0100 [conn1993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.301+0100 [conn1807] end connection 172.28.0.163:50808 (494 connections now open) 2015-10-05T12:32:59.302+0100 [mongosMain] connection accepted from 172.28.0.163:52428 #1994 (495 connections now open) 2015-10-05T12:32:59.304+0100 [conn1994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.306+0100 [conn1737] end connection 172.28.0.163:50739 (494 connections now open) 2015-10-05T12:32:59.307+0100 [mongosMain] connection accepted from 172.28.0.163:52429 #1995 (495 connections now open) 2015-10-05T12:32:59.308+0100 [conn1995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.344+0100 [conn1716] end connection 172.28.0.163:50711 (494 connections now open) 2015-10-05T12:32:59.345+0100 [mongosMain] connection accepted from 172.28.0.163:52431 #1996 (495 connections now open) 2015-10-05T12:32:59.347+0100 [conn1996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.387+0100 [conn1811] end connection 172.28.0.163:50814 (494 connections now open) 2015-10-05T12:32:59.388+0100 [mongosMain] connection accepted from 172.28.0.163:52433 #1997 (495 connections now open) 2015-10-05T12:32:59.389+0100 [conn1997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.685+0100 [conn1895] end connection 172.28.0.164:54473 (494 connections now open) 2015-10-05T12:32:59.685+0100 [conn1386] end connection 172.28.0.164:52526 (493 connections now open) 2015-10-05T12:32:59.686+0100 [conn1920] end connection 172.28.0.164:54705 (492 connections now open) 2015-10-05T12:32:59.687+0100 [conn1381] end connection 172.28.0.164:52521 (491 connections now open) 2015-10-05T12:32:59.690+0100 [mongosMain] connection accepted from 172.28.0.164:55456 #1998 (492 connections now open) 2015-10-05T12:32:59.690+0100 [mongosMain] connection accepted from 172.28.0.164:55459 #1999 (493 connections now open) 2015-10-05T12:32:59.691+0100 [mongosMain] connection accepted from 172.28.0.164:55457 #2000 (494 connections now open) 2015-10-05T12:32:59.691+0100 [mongosMain] connection accepted from 172.28.0.164:55458 #2001 (495 connections now open) 2015-10-05T12:32:59.694+0100 [conn2000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.695+0100 [conn2001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.700+0100 [conn1999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:32:59.704+0100 [conn1998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:08.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56125ff312deab02e2990300 2015-10-05T12:33:08.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:33:08.325+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:33:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:33:14.440+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:33:14.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:33:15.541+0100 [conn1293] end connection 172.28.0.164:52258 (494 connections now open) 2015-10-05T12:33:15.548+0100 [mongosMain] connection accepted from 172.28.0.164:55482 #2002 (495 connections now open) 2015-10-05T12:33:15.551+0100 [conn2002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:20.722+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612600012deab02e29903cd 2015-10-05T12:33:20.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:33:23.873+0100 [conn1662] end connection 172.28.0.163:50661 (494 connections now open) 2015-10-05T12:33:27.189+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612600612deab02e299042f 2015-10-05T12:33:27.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:33:28.568+0100 [mongosMain] connection accepted from 127.0.0.1:52485 #2003 (495 connections now open) 2015-10-05T12:33:28.571+0100 [conn2003] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:28.573+0100 [conn2003] end connection 127.0.0.1:52485 (494 connections now open) 2015-10-05T12:33:30.909+0100 [conn1156] end connection 172.28.0.163:58317 (493 connections now open) 2015-10-05T12:33:30.910+0100 [mongosMain] connection accepted from 172.28.0.163:52486 #2004 (494 connections now open) 2015-10-05T12:33:30.912+0100 [conn2004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:31.390+0100 [conn1401] end connection 172.28.0.164:52541 (493 connections now open) 2015-10-05T12:33:33.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612600d12deab02e2990498 2015-10-05T12:33:34.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:33:39.272+0100 [conn1382] end connection 172.28.0.164:52522 (492 connections now open) 2015-10-05T12:33:39.272+0100 [conn1388] end connection 172.28.0.164:52527 (491 connections now open) 2015-10-05T12:33:39.274+0100 [conn1373] end connection 172.28.0.164:52513 (490 connections now open) 2015-10-05T12:33:39.285+0100 [mongosMain] connection accepted from 172.28.0.164:55520 #2005 (491 connections now open) 2015-10-05T12:33:39.285+0100 [mongosMain] connection accepted from 172.28.0.164:55519 #2006 (492 connections now open) 2015-10-05T12:33:39.286+0100 [mongosMain] connection accepted from 172.28.0.164:55521 #2007 (493 connections now open) 2015-10-05T12:33:39.288+0100 [conn2005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:39.288+0100 [conn2007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:39.288+0100 [conn2006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:39.736+0100 [mongosMain] connection accepted from 127.0.0.1:52487 #2008 (494 connections now open) 2015-10-05T12:33:39.739+0100 [conn2008] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:39.739+0100 [conn2008] end connection 127.0.0.1:52487 (493 connections now open) 2015-10-05T12:33:40.741+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:33:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:33:40.743+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:33:40.743+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:33:46.303+0100 [conn1355] end connection 172.28.0.164:52496 (492 connections now open) 2015-10-05T12:33:46.304+0100 [mongosMain] connection accepted from 172.28.0.164:55537 #2009 (493 connections now open) 2015-10-05T12:33:46.307+0100 [conn2009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.319+0100 [conn1377] end connection 172.28.0.164:52516 (492 connections now open) 2015-10-05T12:33:46.321+0100 [mongosMain] connection accepted from 172.28.0.164:55538 #2010 (493 connections now open) 2015-10-05T12:33:46.321+0100 [conn1348] end connection 172.28.0.164:52489 (492 connections now open) 2015-10-05T12:33:46.322+0100 [mongosMain] connection accepted from 172.28.0.164:55539 #2011 (493 connections now open) 2015-10-05T12:33:46.322+0100 [conn1375] end connection 172.28.0.164:52515 (492 connections now open) 2015-10-05T12:33:46.324+0100 [mongosMain] connection accepted from 172.28.0.164:55540 #2012 (493 connections now open) 2015-10-05T12:33:46.324+0100 [conn2010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.326+0100 [conn2011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.327+0100 [conn2012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.449+0100 [conn1372] end connection 172.28.0.164:52512 (492 connections now open) 2015-10-05T12:33:46.451+0100 [mongosMain] connection accepted from 172.28.0.164:55541 #2013 (493 connections now open) 2015-10-05T12:33:46.453+0100 [conn2013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.454+0100 [conn1374] end connection 172.28.0.164:52514 (492 connections now open) 2015-10-05T12:33:46.456+0100 [mongosMain] connection accepted from 172.28.0.164:55542 #2014 (493 connections now open) 2015-10-05T12:33:46.459+0100 [conn2014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.478+0100 [conn1363] end connection 172.28.0.164:52503 (492 connections now open) 2015-10-05T12:33:46.479+0100 [conn1361] end connection 172.28.0.164:52501 (491 connections now open) 2015-10-05T12:33:46.479+0100 [conn1371] end connection 172.28.0.164:52511 (491 connections now open) 2015-10-05T12:33:46.479+0100 [mongosMain] connection accepted from 172.28.0.164:55543 #2015 (491 connections now open) 2015-10-05T12:33:46.480+0100 [mongosMain] connection accepted from 172.28.0.164:55545 #2016 (492 connections now open) 2015-10-05T12:33:46.480+0100 [mongosMain] connection accepted from 172.28.0.164:55544 #2017 (493 connections now open) 2015-10-05T12:33:46.483+0100 [conn2015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.483+0100 [conn2017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.484+0100 [conn2016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.498+0100 [conn1342] end connection 172.28.0.164:52482 (492 connections now open) 2015-10-05T12:33:46.499+0100 [mongosMain] connection accepted from 172.28.0.164:55546 #2018 (493 connections now open) 2015-10-05T12:33:46.500+0100 [conn1353] end connection 172.28.0.164:52494 (492 connections now open) 2015-10-05T12:33:46.501+0100 [mongosMain] connection accepted from 172.28.0.164:55547 #2019 (493 connections now open) 2015-10-05T12:33:46.502+0100 [conn2018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:46.504+0100 [conn2019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:33:52.905+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:33:52.905+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:34:00.576+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612602321e099ca5fa0cf1b') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444044838912), why: "doing balance round", ts: ObjectId('5612602612deab02e29905e5') } } gle1: { lastOp: Timestamp 1444044813000|9, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } gle2: { lastOp: Timestamp 1444044840000|4, connectionId: 39966, updatedExisting: true, n: 1, syncMillis: 35, writtenTo: null, err: null, waited: 35, ok: 1.0 } 2015-10-05T12:34:00.579+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:34:00.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:34:06.736+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612602e12deab02e2990676 2015-10-05T12:34:06.805+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:34:13.219+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:34:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:34:13.219+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:34:13.356+0100 [LockPinger] handled late remove of old distributed lock with ts 5612602612deab02e29905e5 2015-10-05T12:34:13.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612603512deab02e29906af 2015-10-05T12:34:13.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:34:15.557+0100 [conn1296] end connection 172.28.0.164:52261 (492 connections now open) 2015-10-05T12:34:15.558+0100 [mongosMain] connection accepted from 172.28.0.164:55571 #2020 (493 connections now open) 2015-10-05T12:34:15.561+0100 [conn2020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:19.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612603b12deab02e2990708 2015-10-05T12:34:19.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:34:23.889+0100 [conn1657] end connection 172.28.0.163:50656 (492 connections now open) 2015-10-05T12:34:26.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612604112deab02e2990743 2015-10-05T12:34:26.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:34:29.055+0100 [mongosMain] connection accepted from 127.0.0.1:52549 #2021 (493 connections now open) 2015-10-05T12:34:29.060+0100 [conn2021] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:29.061+0100 [conn2021] end connection 127.0.0.1:52549 (492 connections now open) 2015-10-05T12:34:30.928+0100 [conn1152] end connection 172.28.0.163:58249 (491 connections now open) 2015-10-05T12:34:30.929+0100 [mongosMain] connection accepted from 172.28.0.163:52552 #2022 (492 connections now open) 2015-10-05T12:34:30.931+0100 [conn2022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:31.411+0100 [conn1402] end connection 172.28.0.164:52542 (491 connections now open) 2015-10-05T12:34:34.417+0100 [conn1705] end connection 172.28.0.163:50706 (490 connections now open) 2015-10-05T12:34:34.418+0100 [mongosMain] connection accepted from 172.28.0.163:52575 #2023 (491 connections now open) 2015-10-05T12:34:34.420+0100 [conn2023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.420+0100 [conn1829] end connection 172.28.0.163:50834 (490 connections now open) 2015-10-05T12:34:34.421+0100 [mongosMain] connection accepted from 172.28.0.163:52576 #2024 (491 connections now open) 2015-10-05T12:34:34.423+0100 [conn2024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.451+0100 [conn1720] end connection 172.28.0.163:50719 (490 connections now open) 2015-10-05T12:34:34.452+0100 [mongosMain] connection accepted from 172.28.0.163:52579 #2025 (491 connections now open) 2015-10-05T12:34:34.454+0100 [conn2025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.475+0100 [conn1651] end connection 172.28.0.163:50650 (490 connections now open) 2015-10-05T12:34:34.476+0100 [mongosMain] connection accepted from 172.28.0.163:52580 #2026 (491 connections now open) 2015-10-05T12:34:34.478+0100 [conn2026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.506+0100 [conn1744] end connection 172.28.0.163:50746 (490 connections now open) 2015-10-05T12:34:34.507+0100 [mongosMain] connection accepted from 172.28.0.163:52582 #2027 (491 connections now open) 2015-10-05T12:34:34.509+0100 [conn2027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.518+0100 [conn1713] end connection 172.28.0.163:50721 (490 connections now open) 2015-10-05T12:34:34.519+0100 [mongosMain] connection accepted from 172.28.0.163:52583 #2028 (491 connections now open) 2015-10-05T12:34:34.522+0100 [conn2028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.545+0100 [conn1698] end connection 172.28.0.163:50698 (490 connections now open) 2015-10-05T12:34:34.547+0100 [mongosMain] connection accepted from 172.28.0.163:52587 #2029 (491 connections now open) 2015-10-05T12:34:34.549+0100 [conn2029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.602+0100 [conn1856] end connection 172.28.0.163:50892 (490 connections now open) 2015-10-05T12:34:34.603+0100 [mongosMain] connection accepted from 172.28.0.163:52588 #2030 (491 connections now open) 2015-10-05T12:34:34.604+0100 [conn1754] end connection 172.28.0.163:50756 (490 connections now open) 2015-10-05T12:34:34.604+0100 [conn1757] end connection 172.28.0.163:50759 (489 connections now open) 2015-10-05T12:34:34.605+0100 [mongosMain] connection accepted from 172.28.0.163:52590 #2031 (490 connections now open) 2015-10-05T12:34:34.605+0100 [conn2030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.605+0100 [mongosMain] connection accepted from 172.28.0.163:52591 #2032 (491 connections now open) 2015-10-05T12:34:34.606+0100 [conn2031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:34.607+0100 [conn2032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:47.843+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:34:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:34:49.983+0100 [mongosMain] connection accepted from 127.0.0.1:52605 #2033 (492 connections now open) 2015-10-05T12:34:49.986+0100 [conn2033] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:34:49.987+0100 [conn2033] end connection 127.0.0.1:52605 (491 connections now open) 2015-10-05T12:34:52.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612605c12deab02e2990849 2015-10-05T12:34:52.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:35:06.229+0100 [conn1357] end connection 172.28.0.164:52497 (490 connections now open) 2015-10-05T12:35:06.895+0100 [conn1350] end connection 172.28.0.164:52490 (489 connections now open) 2015-10-05T12:35:14.599+0100 [conn1330] end connection 172.28.0.164:52470 (488 connections now open) 2015-10-05T12:35:14.601+0100 [conn1332] end connection 172.28.0.164:52472 (487 connections now open) 2015-10-05T12:35:14.602+0100 [conn1336] end connection 172.28.0.164:52475 (486 connections now open) 2015-10-05T12:35:14.603+0100 [conn1333] end connection 172.28.0.164:52473 (485 connections now open) 2015-10-05T12:35:14.604+0100 [conn1327] end connection 172.28.0.164:52467 (484 connections now open) 2015-10-05T12:35:14.621+0100 [conn1334] end connection 172.28.0.164:52474 (483 connections now open) 2015-10-05T12:35:14.658+0100 [mongosMain] connection accepted from 172.28.0.164:55645 #2034 (484 connections now open) 2015-10-05T12:35:14.658+0100 [mongosMain] connection accepted from 172.28.0.164:55646 #2035 (485 connections now open) 2015-10-05T12:35:14.660+0100 [conn2035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:14.660+0100 [conn2034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:15.174+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:35:15.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:35:15.577+0100 [conn1297] end connection 172.28.0.164:52262 (484 connections now open) 2015-10-05T12:35:15.578+0100 [mongosMain] connection accepted from 172.28.0.164:55649 #2036 (485 connections now open) 2015-10-05T12:35:15.581+0100 [conn2036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:15.984+0100 [mongosMain] connection accepted from 172.28.0.164:55650 #2037 (486 connections now open) 2015-10-05T12:35:15.985+0100 [mongosMain] connection accepted from 172.28.0.164:55651 #2038 (487 connections now open) 2015-10-05T12:35:15.985+0100 [mongosMain] connection accepted from 172.28.0.164:55652 #2039 (488 connections now open) 2015-10-05T12:35:15.987+0100 [conn2037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:15.988+0100 [mongosMain] connection accepted from 172.28.0.164:55653 #2040 (489 connections now open) 2015-10-05T12:35:15.988+0100 [conn2038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:15.989+0100 [mongosMain] connection accepted from 172.28.0.164:55654 #2041 (490 connections now open) 2015-10-05T12:35:15.996+0100 [conn2039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:15.997+0100 [mongosMain] connection accepted from 172.28.0.164:55655 #2042 (491 connections now open) 2015-10-05T12:35:16.005+0100 [conn2042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:16.014+0100 [conn2040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:16.743+0100 [conn2041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:17.624+0100 [conn1448] end connection 172.28.0.164:52587 (490 connections now open) 2015-10-05T12:35:17.626+0100 [mongosMain] connection accepted from 172.28.0.164:55659 #2043 (491 connections now open) 2015-10-05T12:35:17.626+0100 [conn1576] end connection 172.28.0.164:53718 (490 connections now open) 2015-10-05T12:35:17.631+0100 [conn2043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:18.630+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:35:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:35:20.035+0100 [conn1331] end connection 172.28.0.164:52471 (489 connections now open) 2015-10-05T12:35:20.036+0100 [mongosMain] connection accepted from 172.28.0.164:55670 #2044 (490 connections now open) 2015-10-05T12:35:20.039+0100 [conn2044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:20.056+0100 [conn1484] end connection 172.28.0.164:52624 (489 connections now open) 2015-10-05T12:35:20.057+0100 [mongosMain] connection accepted from 172.28.0.164:55671 #2045 (490 connections now open) 2015-10-05T12:35:20.060+0100 [conn2045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:20.706+0100 [conn1391] end connection 172.28.0.164:52530 (489 connections now open) 2015-10-05T12:35:20.901+0100 [mongosMain] connection accepted from 172.28.0.164:55672 #2046 (490 connections now open) 2015-10-05T12:35:20.906+0100 [conn2046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:21.836+0100 [conn1577] end connection 172.28.0.164:53720 (489 connections now open) 2015-10-05T12:35:21.836+0100 [conn1578] end connection 172.28.0.164:53721 (489 connections now open) 2015-10-05T12:35:23.909+0100 [conn1670] end connection 172.28.0.163:50669 (487 connections now open) 2015-10-05T12:35:25.750+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:35:25.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:35:26.002+0100 [conn1776] end connection 172.28.0.163:50778 (486 connections now open) 2015-10-05T12:35:26.004+0100 [mongosMain] connection accepted from 172.28.0.163:52677 #2047 (487 connections now open) 2015-10-05T12:35:26.006+0100 [conn2047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.145+0100 [conn1812] end connection 172.28.0.163:50815 (486 connections now open) 2015-10-05T12:35:26.145+0100 [conn1804] end connection 172.28.0.163:50807 (485 connections now open) 2015-10-05T12:35:26.147+0100 [mongosMain] connection accepted from 172.28.0.163:52681 #2048 (486 connections now open) 2015-10-05T12:35:26.147+0100 [mongosMain] connection accepted from 172.28.0.163:52682 #2049 (487 connections now open) 2015-10-05T12:35:26.149+0100 [conn2048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.149+0100 [conn2049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.240+0100 [conn1680] end connection 172.28.0.163:50680 (486 connections now open) 2015-10-05T12:35:26.241+0100 [mongosMain] connection accepted from 172.28.0.163:52690 #2050 (487 connections now open) 2015-10-05T12:35:26.243+0100 [conn2050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.320+0100 [conn1727] end connection 172.28.0.163:50729 (486 connections now open) 2015-10-05T12:35:26.322+0100 [conn1874] end connection 172.28.0.163:50926 (485 connections now open) 2015-10-05T12:35:26.322+0100 [mongosMain] connection accepted from 172.28.0.163:52693 #2051 (487 connections now open) 2015-10-05T12:35:26.323+0100 [mongosMain] connection accepted from 172.28.0.163:52694 #2052 (487 connections now open) 2015-10-05T12:35:26.324+0100 [conn2051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.325+0100 [conn2052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.655+0100 [conn1715] end connection 172.28.0.163:50720 (486 connections now open) 2015-10-05T12:35:26.656+0100 [mongosMain] connection accepted from 172.28.0.163:52702 #2053 (487 connections now open) 2015-10-05T12:35:26.658+0100 [conn2053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.679+0100 [conn1815] end connection 172.28.0.163:50818 (486 connections now open) 2015-10-05T12:35:26.680+0100 [mongosMain] connection accepted from 172.28.0.163:52703 #2054 (487 connections now open) 2015-10-05T12:35:26.682+0100 [conn2054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.687+0100 [conn1718] end connection 172.28.0.163:50713 (486 connections now open) 2015-10-05T12:35:26.688+0100 [mongosMain] connection accepted from 172.28.0.163:52705 #2055 (487 connections now open) 2015-10-05T12:35:26.690+0100 [conn2055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.695+0100 [conn1755] end connection 172.28.0.163:50757 (486 connections now open) 2015-10-05T12:35:26.696+0100 [mongosMain] connection accepted from 172.28.0.163:52706 #2056 (487 connections now open) 2015-10-05T12:35:26.698+0100 [conn2056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.736+0100 [conn1766] end connection 172.28.0.163:50768 (486 connections now open) 2015-10-05T12:35:26.737+0100 [mongosMain] connection accepted from 172.28.0.163:52708 #2057 (487 connections now open) 2015-10-05T12:35:26.739+0100 [conn2057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.750+0100 [conn1668] end connection 172.28.0.163:50667 (486 connections now open) 2015-10-05T12:35:26.751+0100 [mongosMain] connection accepted from 172.28.0.163:52709 #2058 (487 connections now open) 2015-10-05T12:35:26.753+0100 [conn2058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.824+0100 [conn1751] end connection 172.28.0.163:50753 (486 connections now open) 2015-10-05T12:35:26.825+0100 [mongosMain] connection accepted from 172.28.0.163:52711 #2059 (487 connections now open) 2015-10-05T12:35:26.827+0100 [conn2059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.876+0100 [conn1641] end connection 172.28.0.163:50640 (486 connections now open) 2015-10-05T12:35:26.877+0100 [mongosMain] connection accepted from 172.28.0.163:52715 #2060 (487 connections now open) 2015-10-05T12:35:26.879+0100 [conn2060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.910+0100 [conn1862] end connection 172.28.0.163:50905 (486 connections now open) 2015-10-05T12:35:26.911+0100 [mongosMain] connection accepted from 172.28.0.163:52716 #2061 (487 connections now open) 2015-10-05T12:35:26.914+0100 [conn2061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.938+0100 [conn1806] end connection 172.28.0.163:50810 (486 connections now open) 2015-10-05T12:35:26.939+0100 [mongosMain] connection accepted from 172.28.0.163:52718 #2062 (487 connections now open) 2015-10-05T12:35:26.941+0100 [conn2062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:26.994+0100 [conn1877] end connection 172.28.0.163:50928 (486 connections now open) 2015-10-05T12:35:26.995+0100 [mongosMain] connection accepted from 172.28.0.163:52719 #2063 (487 connections now open) 2015-10-05T12:35:26.997+0100 [conn2063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.042+0100 [conn1731] end connection 172.28.0.163:50733 (486 connections now open) 2015-10-05T12:35:27.043+0100 [mongosMain] connection accepted from 172.28.0.163:52721 #2064 (487 connections now open) 2015-10-05T12:35:27.045+0100 [conn2064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.064+0100 [conn1702] end connection 172.28.0.163:50703 (486 connections now open) 2015-10-05T12:35:27.065+0100 [mongosMain] connection accepted from 172.28.0.163:52722 #2065 (487 connections now open) 2015-10-05T12:35:27.067+0100 [conn2065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.088+0100 [conn1854] end connection 172.28.0.163:50888 (486 connections now open) 2015-10-05T12:35:27.090+0100 [mongosMain] connection accepted from 172.28.0.163:52723 #2066 (487 connections now open) 2015-10-05T12:35:27.092+0100 [conn2066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.109+0100 [conn1795] end connection 172.28.0.163:50798 (486 connections now open) 2015-10-05T12:35:27.110+0100 [mongosMain] connection accepted from 172.28.0.163:52725 #2067 (487 connections now open) 2015-10-05T12:35:27.113+0100 [conn2067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.175+0100 [conn1822] end connection 172.28.0.163:50825 (486 connections now open) 2015-10-05T12:35:27.177+0100 [mongosMain] connection accepted from 172.28.0.163:52726 #2068 (487 connections now open) 2015-10-05T12:35:27.179+0100 [conn2068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.188+0100 [conn1821] end connection 172.28.0.163:50824 (486 connections now open) 2015-10-05T12:35:27.190+0100 [mongosMain] connection accepted from 172.28.0.163:52727 #2069 (487 connections now open) 2015-10-05T12:35:27.192+0100 [conn2069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.224+0100 [conn1732] end connection 172.28.0.163:50734 (486 connections now open) 2015-10-05T12:35:27.225+0100 [mongosMain] connection accepted from 172.28.0.163:52728 #2070 (487 connections now open) 2015-10-05T12:35:27.227+0100 [conn2070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.241+0100 [conn1739] end connection 172.28.0.163:50741 (486 connections now open) 2015-10-05T12:35:27.242+0100 [mongosMain] connection accepted from 172.28.0.163:52730 #2071 (487 connections now open) 2015-10-05T12:35:27.244+0100 [conn2071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.274+0100 [conn1789] end connection 172.28.0.163:50792 (486 connections now open) 2015-10-05T12:35:27.275+0100 [mongosMain] connection accepted from 172.28.0.163:52731 #2072 (487 connections now open) 2015-10-05T12:35:27.276+0100 [conn2072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.307+0100 [conn1879] end connection 172.28.0.163:50933 (486 connections now open) 2015-10-05T12:35:27.308+0100 [mongosMain] connection accepted from 172.28.0.163:52734 #2073 (487 connections now open) 2015-10-05T12:35:27.310+0100 [conn2073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:27.346+0100 [conn1842] end connection 172.28.0.163:50875 (486 connections now open) 2015-10-05T12:35:27.347+0100 [mongosMain] connection accepted from 172.28.0.163:52739 #2074 (487 connections now open) 2015-10-05T12:35:27.348+0100 [conn2074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:29.119+0100 [mongosMain] connection accepted from 127.0.0.1:52742 #2075 (488 connections now open) 2015-10-05T12:35:29.122+0100 [conn2075] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:29.123+0100 [conn2075] end connection 127.0.0.1:52742 (487 connections now open) 2015-10-05T12:35:30.945+0100 [conn1313] end connection 172.28.0.163:58892 (486 connections now open) 2015-10-05T12:35:30.946+0100 [mongosMain] connection accepted from 172.28.0.163:52745 #2076 (487 connections now open) 2015-10-05T12:35:30.947+0100 [conn2076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:31.426+0100 [conn1310] end connection 172.28.0.164:52320 (486 connections now open) 2015-10-05T12:35:33.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612608312deab02e2990a07 2015-10-05T12:35:35.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:35:39.341+0100 [conn1843] end connection 172.28.0.163:50873 (485 connections now open) 2015-10-05T12:35:39.342+0100 [conn1664] end connection 172.28.0.163:50662 (484 connections now open) 2015-10-05T12:35:39.344+0100 [mongosMain] connection accepted from 172.28.0.163:52747 #2077 (485 connections now open) 2015-10-05T12:35:39.345+0100 [mongosMain] connection accepted from 172.28.0.163:52748 #2078 (486 connections now open) 2015-10-05T12:35:39.346+0100 [conn2077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.347+0100 [conn2078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.372+0100 [conn1838] end connection 172.28.0.163:50859 (485 connections now open) 2015-10-05T12:35:39.374+0100 [mongosMain] connection accepted from 172.28.0.163:52749 #2079 (486 connections now open) 2015-10-05T12:35:39.376+0100 [conn2079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.446+0100 [conn1758] end connection 172.28.0.163:50760 (485 connections now open) 2015-10-05T12:35:39.447+0100 [mongosMain] connection accepted from 172.28.0.163:52750 #2080 (486 connections now open) 2015-10-05T12:35:39.449+0100 [conn2080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.475+0100 [conn1752] end connection 172.28.0.163:50754 (485 connections now open) 2015-10-05T12:35:39.476+0100 [mongosMain] connection accepted from 172.28.0.163:52751 #2081 (486 connections now open) 2015-10-05T12:35:39.477+0100 [conn2081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.635+0100 [conn1676] end connection 172.28.0.163:50675 (485 connections now open) 2015-10-05T12:35:39.637+0100 [mongosMain] connection accepted from 172.28.0.163:52752 #2082 (486 connections now open) 2015-10-05T12:35:39.638+0100 [conn2082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.686+0100 [conn1722] end connection 172.28.0.163:50724 (485 connections now open) 2015-10-05T12:35:39.688+0100 [mongosMain] connection accepted from 172.28.0.163:52753 #2083 (486 connections now open) 2015-10-05T12:35:39.690+0100 [conn2083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.695+0100 [conn1808] end connection 172.28.0.163:50811 (485 connections now open) 2015-10-05T12:35:39.695+0100 [conn1790] end connection 172.28.0.163:50793 (485 connections now open) 2015-10-05T12:35:39.696+0100 [mongosMain] connection accepted from 172.28.0.163:52754 #2084 (485 connections now open) 2015-10-05T12:35:39.696+0100 [mongosMain] connection accepted from 172.28.0.163:52755 #2085 (486 connections now open) 2015-10-05T12:35:39.697+0100 [conn1724] end connection 172.28.0.163:50727 (485 connections now open) 2015-10-05T12:35:39.697+0100 [conn2084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.697+0100 [conn2085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.698+0100 [mongosMain] connection accepted from 172.28.0.163:52756 #2086 (486 connections now open) 2015-10-05T12:35:39.699+0100 [conn2086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.790+0100 [conn1712] end connection 172.28.0.163:50712 (485 connections now open) 2015-10-05T12:35:39.792+0100 [mongosMain] connection accepted from 172.28.0.163:52757 #2087 (486 connections now open) 2015-10-05T12:35:39.794+0100 [conn2087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.803+0100 [mongosMain] connection accepted from 127.0.0.1:52758 #2088 (487 connections now open) 2015-10-05T12:35:39.805+0100 [conn2088] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.806+0100 [conn2088] end connection 127.0.0.1:52758 (486 connections now open) 2015-10-05T12:35:39.812+0100 [conn1768] end connection 172.28.0.163:50770 (485 connections now open) 2015-10-05T12:35:39.814+0100 [mongosMain] connection accepted from 172.28.0.163:52759 #2089 (486 connections now open) 2015-10-05T12:35:39.816+0100 [conn1691] end connection 172.28.0.163:50691 (485 connections now open) 2015-10-05T12:35:39.816+0100 [conn2089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.817+0100 [mongosMain] connection accepted from 172.28.0.163:52760 #2090 (486 connections now open) 2015-10-05T12:35:39.819+0100 [conn2090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.852+0100 [conn1771] end connection 172.28.0.163:50773 (485 connections now open) 2015-10-05T12:35:39.853+0100 [mongosMain] connection accepted from 172.28.0.163:52761 #2091 (486 connections now open) 2015-10-05T12:35:39.855+0100 [conn2091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.890+0100 [conn1816] end connection 172.28.0.163:50820 (485 connections now open) 2015-10-05T12:35:39.891+0100 [mongosMain] connection accepted from 172.28.0.163:52762 #2092 (486 connections now open) 2015-10-05T12:35:39.893+0100 [conn2092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:39.958+0100 [conn1834] end connection 172.28.0.163:50845 (485 connections now open) 2015-10-05T12:35:39.959+0100 [mongosMain] connection accepted from 172.28.0.163:52763 #2093 (486 connections now open) 2015-10-05T12:35:39.961+0100 [conn2093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.038+0100 [conn1847] end connection 172.28.0.163:50860 (485 connections now open) 2015-10-05T12:35:40.039+0100 [mongosMain] connection accepted from 172.28.0.163:52764 #2094 (486 connections now open) 2015-10-05T12:35:40.041+0100 [conn2094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.075+0100 [conn1746] end connection 172.28.0.163:50748 (485 connections now open) 2015-10-05T12:35:40.076+0100 [mongosMain] connection accepted from 172.28.0.163:52765 #2095 (486 connections now open) 2015-10-05T12:35:40.077+0100 [conn1747] end connection 172.28.0.163:50749 (485 connections now open) 2015-10-05T12:35:40.078+0100 [conn2095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.078+0100 [conn1855] end connection 172.28.0.163:50876 (484 connections now open) 2015-10-05T12:35:40.078+0100 [mongosMain] connection accepted from 172.28.0.163:52766 #2096 (485 connections now open) 2015-10-05T12:35:40.079+0100 [mongosMain] connection accepted from 172.28.0.163:52767 #2097 (486 connections now open) 2015-10-05T12:35:40.080+0100 [conn2096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.081+0100 [conn2097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.127+0100 [conn1735] end connection 172.28.0.163:50737 (485 connections now open) 2015-10-05T12:35:40.128+0100 [mongosMain] connection accepted from 172.28.0.163:52768 #2098 (486 connections now open) 2015-10-05T12:35:40.128+0100 [conn1665] end connection 172.28.0.163:50664 (485 connections now open) 2015-10-05T12:35:40.128+0100 [mongosMain] connection accepted from 172.28.0.163:52769 #2099 (486 connections now open) 2015-10-05T12:35:40.130+0100 [conn2098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.130+0100 [conn2099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.151+0100 [conn1845] end connection 172.28.0.163:50870 (485 connections now open) 2015-10-05T12:35:40.153+0100 [mongosMain] connection accepted from 172.28.0.163:52770 #2100 (486 connections now open) 2015-10-05T12:35:40.155+0100 [conn2100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.285+0100 [conn1675] end connection 172.28.0.163:50674 (485 connections now open) 2015-10-05T12:35:40.287+0100 [mongosMain] connection accepted from 172.28.0.163:52771 #2101 (486 connections now open) 2015-10-05T12:35:40.289+0100 [conn2101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.325+0100 [conn1819] end connection 172.28.0.163:50819 (485 connections now open) 2015-10-05T12:35:40.326+0100 [mongosMain] connection accepted from 172.28.0.163:52772 #2102 (486 connections now open) 2015-10-05T12:35:40.328+0100 [conn2102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.455+0100 [conn1669] end connection 172.28.0.163:50668 (485 connections now open) 2015-10-05T12:35:40.456+0100 [mongosMain] connection accepted from 172.28.0.163:52773 #2103 (486 connections now open) 2015-10-05T12:35:40.457+0100 [conn2103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.526+0100 [conn1648] end connection 172.28.0.163:50647 (485 connections now open) 2015-10-05T12:35:40.527+0100 [mongosMain] connection accepted from 172.28.0.163:52774 #2104 (486 connections now open) 2015-10-05T12:35:40.529+0100 [conn2104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.576+0100 [conn1794] end connection 172.28.0.163:50797 (485 connections now open) 2015-10-05T12:35:40.577+0100 [mongosMain] connection accepted from 172.28.0.163:52775 #2105 (486 connections now open) 2015-10-05T12:35:40.579+0100 [conn2105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.674+0100 [conn1792] end connection 172.28.0.163:50795 (485 connections now open) 2015-10-05T12:35:40.676+0100 [mongosMain] connection accepted from 172.28.0.163:52776 #2106 (486 connections now open) 2015-10-05T12:35:40.678+0100 [conn2106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.727+0100 [conn1780] end connection 172.28.0.163:50782 (485 connections now open) 2015-10-05T12:35:40.728+0100 [mongosMain] connection accepted from 172.28.0.163:52777 #2107 (486 connections now open) 2015-10-05T12:35:40.730+0100 [conn2107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.813+0100 [conn1787] end connection 172.28.0.163:50790 (485 connections now open) 2015-10-05T12:35:40.815+0100 [mongosMain] connection accepted from 172.28.0.163:52778 #2108 (486 connections now open) 2015-10-05T12:35:40.816+0100 [conn2108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.827+0100 [conn1786] end connection 172.28.0.163:50789 (485 connections now open) 2015-10-05T12:35:40.828+0100 [mongosMain] connection accepted from 172.28.0.163:52779 #2109 (486 connections now open) 2015-10-05T12:35:40.830+0100 [conn2109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:40.919+0100 [conn1756] end connection 172.28.0.163:50758 (485 connections now open) 2015-10-05T12:35:40.920+0100 [mongosMain] connection accepted from 172.28.0.163:52780 #2110 (486 connections now open) 2015-10-05T12:35:40.922+0100 [conn2110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.042+0100 [conn1695] end connection 172.28.0.163:50695 (485 connections now open) 2015-10-05T12:35:41.043+0100 [mongosMain] connection accepted from 172.28.0.163:52781 #2111 (486 connections now open) 2015-10-05T12:35:41.045+0100 [conn2111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.168+0100 [conn1805] end connection 172.28.0.163:50809 (485 connections now open) 2015-10-05T12:35:41.169+0100 [mongosMain] connection accepted from 172.28.0.163:52783 #2112 (486 connections now open) 2015-10-05T12:35:41.171+0100 [conn2112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.176+0100 [conn1762] end connection 172.28.0.163:50764 (485 connections now open) 2015-10-05T12:35:41.177+0100 [mongosMain] connection accepted from 172.28.0.163:52784 #2113 (486 connections now open) 2015-10-05T12:35:41.178+0100 [conn2113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.235+0100 [conn1644] end connection 172.28.0.163:50643 (485 connections now open) 2015-10-05T12:35:41.235+0100 [conn1800] end connection 172.28.0.163:50803 (484 connections now open) 2015-10-05T12:35:41.237+0100 [mongosMain] connection accepted from 172.28.0.163:52785 #2114 (485 connections now open) 2015-10-05T12:35:41.237+0100 [mongosMain] connection accepted from 172.28.0.163:52786 #2115 (486 connections now open) 2015-10-05T12:35:41.239+0100 [conn2114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.239+0100 [conn2115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.277+0100 [conn1848] end connection 172.28.0.163:50871 (485 connections now open) 2015-10-05T12:35:41.278+0100 [mongosMain] connection accepted from 172.28.0.163:52787 #2116 (486 connections now open) 2015-10-05T12:35:41.280+0100 [conn2116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.301+0100 [conn1666] end connection 172.28.0.163:50665 (485 connections now open) 2015-10-05T12:35:41.302+0100 [mongosMain] connection accepted from 172.28.0.163:52788 #2117 (486 connections now open) 2015-10-05T12:35:41.304+0100 [conn2117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.354+0100 [conn1833] end connection 172.28.0.163:50840 (485 connections now open) 2015-10-05T12:35:41.355+0100 [mongosMain] connection accepted from 172.28.0.163:52789 #2118 (486 connections now open) 2015-10-05T12:35:41.357+0100 [conn2118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.420+0100 [conn1785] end connection 172.28.0.163:50788 (485 connections now open) 2015-10-05T12:35:41.421+0100 [mongosMain] connection accepted from 172.28.0.163:52790 #2119 (486 connections now open) 2015-10-05T12:35:41.424+0100 [conn2119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.497+0100 [conn1649] end connection 172.28.0.163:50648 (485 connections now open) 2015-10-05T12:35:41.498+0100 [mongosMain] connection accepted from 172.28.0.163:52791 #2120 (486 connections now open) 2015-10-05T12:35:41.500+0100 [conn2120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.506+0100 [conn1876] end connection 172.28.0.163:50919 (485 connections now open) 2015-10-05T12:35:41.508+0100 [mongosMain] connection accepted from 172.28.0.163:52792 #2121 (486 connections now open) 2015-10-05T12:35:41.509+0100 [conn2121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.513+0100 [conn1782] end connection 172.28.0.163:50784 (485 connections now open) 2015-10-05T12:35:41.514+0100 [mongosMain] connection accepted from 172.28.0.163:52793 #2122 (486 connections now open) 2015-10-05T12:35:41.516+0100 [conn2122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.557+0100 [conn1828] end connection 172.28.0.163:50832 (485 connections now open) 2015-10-05T12:35:41.557+0100 [conn1803] end connection 172.28.0.163:50806 (484 connections now open) 2015-10-05T12:35:41.558+0100 [conn1865] end connection 172.28.0.163:50908 (483 connections now open) 2015-10-05T12:35:41.558+0100 [mongosMain] connection accepted from 172.28.0.163:52794 #2123 (484 connections now open) 2015-10-05T12:35:41.558+0100 [mongosMain] connection accepted from 172.28.0.163:52795 #2124 (485 connections now open) 2015-10-05T12:35:41.559+0100 [mongosMain] connection accepted from 172.28.0.163:52796 #2125 (486 connections now open) 2015-10-05T12:35:41.559+0100 [conn2123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.560+0100 [conn2124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.560+0100 [conn2125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:41.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612608d12deab02e2990a58 2015-10-05T12:35:41.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:35:41.791+0100 [conn1583] end connection 172.28.0.164:53759 (485 connections now open) 2015-10-05T12:35:41.854+0100 [conn1587] end connection 172.28.0.164:53774 (484 connections now open) 2015-10-05T12:35:41.855+0100 [conn1584] end connection 172.28.0.164:53769 (483 connections now open) 2015-10-05T12:35:47.367+0100 [conn1589] end connection 172.28.0.164:53782 (482 connections now open) 2015-10-05T12:35:47.368+0100 [mongosMain] connection accepted from 172.28.0.164:55745 #2126 (483 connections now open) 2015-10-05T12:35:47.371+0100 [conn2126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:47.448+0100 [conn1590] end connection 172.28.0.164:53783 (482 connections now open) 2015-10-05T12:35:48.390+0100 [mongosMain] connection accepted from 172.28.0.164:55747 #2127 (483 connections now open) 2015-10-05T12:35:48.393+0100 [conn2127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:50.180+0100 [conn1592] end connection 172.28.0.164:53791 (482 connections now open) 2015-10-05T12:35:50.320+0100 [conn1595] end connection 172.28.0.164:53794 (481 connections now open) 2015-10-05T12:35:50.321+0100 [conn1597] end connection 172.28.0.164:53796 (480 connections now open) 2015-10-05T12:35:50.465+0100 [conn1598] end connection 172.28.0.164:53797 (479 connections now open) 2015-10-05T12:35:50.585+0100 [conn1489] end connection 172.28.0.164:52629 (478 connections now open) 2015-10-05T12:35:50.704+0100 [conn1594] end connection 172.28.0.164:53793 (477 connections now open) 2015-10-05T12:35:50.725+0100 [conn1599] end connection 172.28.0.164:53798 (476 connections now open) 2015-10-05T12:35:50.736+0100 [conn1593] end connection 172.28.0.164:53792 (475 connections now open) 2015-10-05T12:35:50.755+0100 [mongosMain] connection accepted from 172.28.0.164:55749 #2128 (476 connections now open) 2015-10-05T12:35:50.756+0100 [mongosMain] connection accepted from 172.28.0.164:55750 #2129 (477 connections now open) 2015-10-05T12:35:50.760+0100 [conn2128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:50.777+0100 [conn2129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:50.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612609412deab02e2990af9 2015-10-05T12:35:50.838+0100 [conn1421] end connection 172.28.0.164:52562 (476 connections now open) 2015-10-05T12:35:50.866+0100 [mongosMain] connection accepted from 172.28.0.164:55752 #2130 (477 connections now open) 2015-10-05T12:35:50.913+0100 [conn2130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:51.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:35:51.152+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:35:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:35:51.787+0100 [conn1507] end connection 172.28.0.164:52659 (476 connections now open) 2015-10-05T12:35:51.884+0100 [conn1430] end connection 172.28.0.164:52571 (475 connections now open) 2015-10-05T12:35:51.888+0100 [conn1495] end connection 172.28.0.164:52636 (474 connections now open) 2015-10-05T12:35:51.913+0100 [mongosMain] connection accepted from 172.28.0.164:55755 #2131 (475 connections now open) 2015-10-05T12:35:51.913+0100 [mongosMain] connection accepted from 172.28.0.164:55757 #2132 (476 connections now open) 2015-10-05T12:35:51.913+0100 [mongosMain] connection accepted from 172.28.0.164:55756 #2133 (477 connections now open) 2015-10-05T12:35:51.915+0100 [conn2131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:51.915+0100 [conn2132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:51.915+0100 [conn2133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:35:52.012+0100 [conn1596] end connection 172.28.0.164:53795 (476 connections now open) 2015-10-05T12:35:58.129+0100 [conn1591] end connection 172.28.0.164:53790 (475 connections now open) 2015-10-05T12:36:01.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612609d12deab02e2990b2b 2015-10-05T12:36:02.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:36:10.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260a812deab02e2990b6d 2015-10-05T12:36:11.222+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:36:15.594+0100 [conn1301] end connection 172.28.0.164:52266 (474 connections now open) 2015-10-05T12:36:15.594+0100 [mongosMain] connection accepted from 172.28.0.164:55806 #2134 (475 connections now open) 2015-10-05T12:36:15.597+0100 [conn2134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.640+0100 [conn1435] end connection 172.28.0.164:52575 (474 connections now open) 2015-10-05T12:36:16.806+0100 [mongosMain] connection accepted from 172.28.0.164:55809 #2135 (475 connections now open) 2015-10-05T12:36:16.837+0100 [conn1439] end connection 172.28.0.164:52579 (474 connections now open) 2015-10-05T12:36:16.837+0100 [conn1490] end connection 172.28.0.164:52630 (473 connections now open) 2015-10-05T12:36:16.838+0100 [conn1505] end connection 172.28.0.164:52651 (472 connections now open) 2015-10-05T12:36:16.841+0100 [conn1432] end connection 172.28.0.164:52572 (471 connections now open) 2015-10-05T12:36:16.847+0100 [conn1428] end connection 172.28.0.164:52569 (470 connections now open) 2015-10-05T12:36:16.876+0100 [mongosMain] connection accepted from 172.28.0.164:55813 #2136 (471 connections now open) 2015-10-05T12:36:16.877+0100 [mongosMain] connection accepted from 172.28.0.164:55814 #2137 (472 connections now open) 2015-10-05T12:36:16.879+0100 [mongosMain] connection accepted from 172.28.0.164:55815 #2138 (473 connections now open) 2015-10-05T12:36:16.880+0100 [mongosMain] connection accepted from 172.28.0.164:55816 #2139 (474 connections now open) 2015-10-05T12:36:16.881+0100 [mongosMain] connection accepted from 172.28.0.164:55817 #2140 (475 connections now open) 2015-10-05T12:36:16.884+0100 [conn2137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.886+0100 [conn2140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.889+0100 [conn2136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.901+0100 [conn2139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.968+0100 [conn2135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:16.974+0100 [conn2138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:18.306+0100 [conn1429] end connection 172.28.0.164:52568 (474 connections now open) 2015-10-05T12:36:18.315+0100 [conn1436] end connection 172.28.0.164:52576 (473 connections now open) 2015-10-05T12:36:18.316+0100 [conn1506] end connection 172.28.0.164:52653 (472 connections now open) 2015-10-05T12:36:18.652+0100 [mongosMain] connection accepted from 172.28.0.164:55819 #2141 (473 connections now open) 2015-10-05T12:36:18.655+0100 [mongosMain] connection accepted from 172.28.0.164:55820 #2142 (474 connections now open) 2015-10-05T12:36:18.656+0100 [mongosMain] connection accepted from 172.28.0.164:55821 #2143 (475 connections now open) 2015-10-05T12:36:18.657+0100 [conn2141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:18.657+0100 [conn2142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:18.995+0100 [conn2143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:19.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260b112deab02e2990bc3 2015-10-05T12:36:20.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:36:22.607+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:36:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:36:23.956+0100 [conn1659] end connection 172.28.0.163:50658 (474 connections now open) 2015-10-05T12:36:26.928+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260ba12deab02e2990c27 2015-10-05T12:36:27.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:36:29.669+0100 [conn1441] end connection 172.28.0.164:52581 (473 connections now open) 2015-10-05T12:36:29.669+0100 [conn1437] end connection 172.28.0.164:52577 (472 connections now open) 2015-10-05T12:36:29.669+0100 [conn1453] end connection 172.28.0.164:52593 (471 connections now open) 2015-10-05T12:36:29.669+0100 [conn1470] end connection 172.28.0.164:52610 (470 connections now open) 2015-10-05T12:36:29.670+0100 [conn1438] end connection 172.28.0.164:52578 (469 connections now open) 2015-10-05T12:36:29.671+0100 [conn1440] end connection 172.28.0.164:52580 (468 connections now open) 2015-10-05T12:36:29.672+0100 [conn1486] end connection 172.28.0.164:52627 (467 connections now open) 2015-10-05T12:36:29.672+0100 [conn1433] end connection 172.28.0.164:52573 (466 connections now open) 2015-10-05T12:36:29.673+0100 [conn1427] end connection 172.28.0.164:52567 (465 connections now open) 2015-10-05T12:36:29.673+0100 [conn1449] end connection 172.28.0.164:52588 (464 connections now open) 2015-10-05T12:36:29.673+0100 [conn1423] end connection 172.28.0.164:52564 (464 connections now open) 2015-10-05T12:36:29.674+0100 [conn1493] end connection 172.28.0.164:52633 (462 connections now open) 2015-10-05T12:36:29.674+0100 [conn1497] end connection 172.28.0.164:52638 (461 connections now open) 2015-10-05T12:36:29.674+0100 [conn1496] end connection 172.28.0.164:52635 (460 connections now open) 2015-10-05T12:36:29.675+0100 [conn1491] end connection 172.28.0.164:52631 (460 connections now open) 2015-10-05T12:36:29.675+0100 [conn1501] end connection 172.28.0.164:52642 (458 connections now open) 2015-10-05T12:36:29.676+0100 [conn1499] end connection 172.28.0.164:52640 (457 connections now open) 2015-10-05T12:36:29.720+0100 [conn1498] end connection 172.28.0.164:52637 (456 connections now open) 2015-10-05T12:36:29.724+0100 [conn1503] end connection 172.28.0.164:52644 (455 connections now open) 2015-10-05T12:36:29.724+0100 [conn1494] end connection 172.28.0.164:52634 (455 connections now open) 2015-10-05T12:36:29.728+0100 [conn1492] end connection 172.28.0.164:52632 (453 connections now open) 2015-10-05T12:36:29.728+0100 [conn1460] end connection 172.28.0.164:52601 (453 connections now open) 2015-10-05T12:36:29.728+0100 [conn1488] end connection 172.28.0.164:52628 (451 connections now open) 2015-10-05T12:36:29.729+0100 [conn1487] end connection 172.28.0.164:52626 (450 connections now open) 2015-10-05T12:36:29.730+0100 [conn1485] end connection 172.28.0.164:52625 (449 connections now open) 2015-10-05T12:36:29.730+0100 [conn1456] end connection 172.28.0.164:52597 (448 connections now open) 2015-10-05T12:36:29.731+0100 [conn1478] end connection 172.28.0.164:52616 (447 connections now open) 2015-10-05T12:36:29.731+0100 [conn1483] end connection 172.28.0.164:52623 (446 connections now open) 2015-10-05T12:36:29.733+0100 [conn1480] end connection 172.28.0.164:52620 (445 connections now open) 2015-10-05T12:36:29.733+0100 [conn1477] end connection 172.28.0.164:52618 (445 connections now open) 2015-10-05T12:36:29.733+0100 [conn1479] end connection 172.28.0.164:52619 (445 connections now open) 2015-10-05T12:36:29.733+0100 [conn1482] end connection 172.28.0.164:52622 (443 connections now open) 2015-10-05T12:36:29.733+0100 [conn1476] end connection 172.28.0.164:52617 (441 connections now open) 2015-10-05T12:36:29.735+0100 [mongosMain] connection accepted from 172.28.0.164:55831 #2144 (442 connections now open) 2015-10-05T12:36:29.736+0100 [conn1344] end connection 172.28.0.164:52485 (441 connections now open) 2015-10-05T12:36:29.736+0100 [mongosMain] connection accepted from 172.28.0.164:55832 #2145 (443 connections now open) 2015-10-05T12:36:29.736+0100 [mongosMain] connection accepted from 172.28.0.164:55833 #2146 (443 connections now open) 2015-10-05T12:36:29.737+0100 [conn1473] end connection 172.28.0.164:52612 (442 connections now open) 2015-10-05T12:36:29.737+0100 [mongosMain] connection accepted from 172.28.0.164:55835 #2147 (443 connections now open) 2015-10-05T12:36:29.738+0100 [conn2144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.738+0100 [conn2145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.738+0100 [conn2146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.738+0100 [mongosMain] connection accepted from 172.28.0.164:55836 #2148 (444 connections now open) 2015-10-05T12:36:29.739+0100 [mongosMain] connection accepted from 172.28.0.164:55837 #2149 (445 connections now open) 2015-10-05T12:36:29.739+0100 [conn2147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.740+0100 [mongosMain] connection accepted from 172.28.0.164:55838 #2150 (446 connections now open) 2015-10-05T12:36:29.740+0100 [conn2149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.740+0100 [mongosMain] connection accepted from 172.28.0.164:55839 #2151 (447 connections now open) 2015-10-05T12:36:29.740+0100 [conn2148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.740+0100 [mongosMain] connection accepted from 172.28.0.164:55840 #2152 (448 connections now open) 2015-10-05T12:36:29.741+0100 [mongosMain] connection accepted from 172.28.0.164:55841 #2153 (449 connections now open) 2015-10-05T12:36:29.741+0100 [mongosMain] connection accepted from 172.28.0.164:55842 #2154 (450 connections now open) 2015-10-05T12:36:29.742+0100 [mongosMain] connection accepted from 172.28.0.164:55843 #2155 (451 connections now open) 2015-10-05T12:36:29.743+0100 [mongosMain] connection accepted from 172.28.0.164:55844 #2156 (452 connections now open) 2015-10-05T12:36:29.743+0100 [mongosMain] connection accepted from 172.28.0.164:55845 #2157 (453 connections now open) 2015-10-05T12:36:29.743+0100 [mongosMain] connection accepted from 172.28.0.164:55846 #2158 (454 connections now open) 2015-10-05T12:36:29.744+0100 [conn2150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.744+0100 [mongosMain] connection accepted from 172.28.0.164:55847 #2159 (455 connections now open) 2015-10-05T12:36:29.744+0100 [conn2154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.744+0100 [conn2153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.745+0100 [conn2156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.745+0100 [mongosMain] connection accepted from 172.28.0.164:55848 #2160 (456 connections now open) 2015-10-05T12:36:29.775+0100 [conn2155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.779+0100 [conn2158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.824+0100 [conn1481] end connection 172.28.0.164:52621 (455 connections now open) 2015-10-05T12:36:29.824+0100 [conn1403] end connection 172.28.0.164:52543 (454 connections now open) 2015-10-05T12:36:29.826+0100 [conn1354] end connection 172.28.0.164:52493 (453 connections now open) 2015-10-05T12:36:29.886+0100 [mongosMain] connection accepted from 172.28.0.164:55849 #2161 (454 connections now open) 2015-10-05T12:36:29.888+0100 [mongosMain] connection accepted from 172.28.0.164:55851 #2162 (455 connections now open) 2015-10-05T12:36:29.888+0100 [mongosMain] connection accepted from 172.28.0.164:55850 #2163 (456 connections now open) 2015-10-05T12:36:29.889+0100 [conn2161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.890+0100 [mongosMain] connection accepted from 172.28.0.164:55852 #2164 (457 connections now open) 2015-10-05T12:36:29.890+0100 [mongosMain] connection accepted from 172.28.0.164:55853 #2165 (458 connections now open) 2015-10-05T12:36:29.890+0100 [conn2162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.891+0100 [mongosMain] connection accepted from 172.28.0.164:55854 #2166 (459 connections now open) 2015-10-05T12:36:29.891+0100 [conn2163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.891+0100 [mongosMain] connection accepted from 172.28.0.164:55855 #2167 (460 connections now open) 2015-10-05T12:36:29.894+0100 [conn2164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.897+0100 [mongosMain] connection accepted from 172.28.0.164:55856 #2168 (461 connections now open) 2015-10-05T12:36:29.897+0100 [conn2167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.898+0100 [mongosMain] connection accepted from 172.28.0.164:55857 #2169 (462 connections now open) 2015-10-05T12:36:29.899+0100 [mongosMain] connection accepted from 172.28.0.164:55858 #2170 (463 connections now open) 2015-10-05T12:36:29.899+0100 [mongosMain] connection accepted from 172.28.0.164:55859 #2171 (464 connections now open) 2015-10-05T12:36:29.900+0100 [mongosMain] connection accepted from 172.28.0.164:55860 #2172 (465 connections now open) 2015-10-05T12:36:29.900+0100 [mongosMain] connection accepted from 172.28.0.164:55861 #2173 (466 connections now open) 2015-10-05T12:36:29.901+0100 [mongosMain] connection accepted from 172.28.0.164:55862 #2174 (467 connections now open) 2015-10-05T12:36:29.901+0100 [conn2165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.902+0100 [mongosMain] connection accepted from 172.28.0.164:55863 #2175 (468 connections now open) 2015-10-05T12:36:29.903+0100 [conn2174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.903+0100 [mongosMain] connection accepted from 172.28.0.164:55864 #2176 (469 connections now open) 2015-10-05T12:36:29.904+0100 [conn2171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.904+0100 [conn2169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.904+0100 [mongosMain] connection accepted from 172.28.0.164:55865 #2177 (470 connections now open) 2015-10-05T12:36:29.904+0100 [conn2173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.905+0100 [conn2172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.909+0100 [mongosMain] connection accepted from 172.28.0.164:55866 #2178 (471 connections now open) 2015-10-05T12:36:29.910+0100 [conn2151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.911+0100 [conn2178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.911+0100 [conn2152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.912+0100 [conn2157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.912+0100 [conn2159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.913+0100 [conn2160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.916+0100 [conn2168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.940+0100 [mongosMain] connection accepted from 172.28.0.164:55868 #2179 (472 connections now open) 2015-10-05T12:36:29.940+0100 [mongosMain] connection accepted from 172.28.0.164:55869 #2180 (473 connections now open) 2015-10-05T12:36:29.941+0100 [mongosMain] connection accepted from 172.28.0.164:55870 #2181 (474 connections now open) 2015-10-05T12:36:29.943+0100 [conn2180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.943+0100 [conn2179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:29.943+0100 [conn2181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.013+0100 [conn1465] end connection 172.28.0.164:52605 (473 connections now open) 2015-10-05T12:36:30.021+0100 [conn2166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.023+0100 [conn2176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.023+0100 [conn2177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.024+0100 [conn2175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.028+0100 [conn2170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.077+0100 [mongosMain] connection accepted from 172.28.0.164:55872 #2182 (474 connections now open) 2015-10-05T12:36:30.079+0100 [conn2182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.167+0100 [conn1471] end connection 172.28.0.164:52611 (473 connections now open) 2015-10-05T12:36:30.265+0100 [mongosMain] connection accepted from 172.28.0.164:55873 #2183 (474 connections now open) 2015-10-05T12:36:30.267+0100 [conn2183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.323+0100 [conn1472] end connection 172.28.0.164:52613 (473 connections now open) 2015-10-05T12:36:30.379+0100 [mongosMain] connection accepted from 172.28.0.164:55876 #2184 (474 connections now open) 2015-10-05T12:36:30.382+0100 [conn2184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.454+0100 [conn1458] end connection 172.28.0.164:52598 (473 connections now open) 2015-10-05T12:36:30.478+0100 [conn1351] end connection 172.28.0.164:52492 (472 connections now open) 2015-10-05T12:36:30.517+0100 [mongosMain] connection accepted from 172.28.0.164:55878 #2185 (473 connections now open) 2015-10-05T12:36:30.520+0100 [conn2185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.522+0100 [mongosMain] connection accepted from 172.28.0.164:55879 #2186 (474 connections now open) 2015-10-05T12:36:30.524+0100 [conn2186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:30.960+0100 [conn1253] end connection 172.28.0.163:58676 (473 connections now open) 2015-10-05T12:36:30.961+0100 [mongosMain] connection accepted from 172.28.0.163:52856 #2187 (474 connections now open) 2015-10-05T12:36:30.962+0100 [conn2187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:32.239+0100 [conn1467] end connection 172.28.0.164:52607 (473 connections now open) 2015-10-05T12:36:32.245+0100 [conn1474] end connection 172.28.0.164:52615 (472 connections now open) 2015-10-05T12:36:32.251+0100 [conn1463] end connection 172.28.0.164:52604 (471 connections now open) 2015-10-05T12:36:33.374+0100 [mongosMain] connection accepted from 127.0.0.1:52864 #2188 (472 connections now open) 2015-10-05T12:36:33.376+0100 [conn2188] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:33.378+0100 [conn2188] end connection 127.0.0.1:52864 (471 connections now open) 2015-10-05T12:36:34.082+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:36:34.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:36:35.997+0100 [mongosMain] connection accepted from 172.28.0.164:55897 #2189 (472 connections now open) 2015-10-05T12:36:35.998+0100 [mongosMain] connection accepted from 172.28.0.164:55898 #2190 (473 connections now open) 2015-10-05T12:36:35.998+0100 [mongosMain] connection accepted from 172.28.0.164:55899 #2191 (474 connections now open) 2015-10-05T12:36:35.999+0100 [conn2189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:36.001+0100 [conn2191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:37.018+0100 [conn2190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:39.342+0100 [conn1411] end connection 172.28.0.164:52551 (473 connections now open) 2015-10-05T12:36:39.762+0100 [mongosMain] connection accepted from 127.0.0.1:52866 #2192 (474 connections now open) 2015-10-05T12:36:39.765+0100 [conn2192] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:39.766+0100 [conn2192] end connection 127.0.0.1:52866 (473 connections now open) 2015-10-05T12:36:43.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260c812deab02e2990d18 2015-10-05T12:36:43.672+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:36:54.416+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:36:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:36:57.624+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:36:57.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:36:59.426+0100 [conn1801] end connection 172.28.0.163:50804 (472 connections now open) 2015-10-05T12:36:59.427+0100 [mongosMain] connection accepted from 172.28.0.163:52918 #2193 (473 connections now open) 2015-10-05T12:36:59.428+0100 [conn2193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:59.556+0100 [conn1824] end connection 172.28.0.163:50827 (472 connections now open) 2015-10-05T12:36:59.557+0100 [mongosMain] connection accepted from 172.28.0.163:52926 #2194 (473 connections now open) 2015-10-05T12:36:59.559+0100 [conn2194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:59.559+0100 [conn1878] end connection 172.28.0.163:50929 (472 connections now open) 2015-10-05T12:36:59.560+0100 [mongosMain] connection accepted from 172.28.0.163:52928 #2195 (473 connections now open) 2015-10-05T12:36:59.562+0100 [conn2195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:59.751+0100 [conn1725] end connection 172.28.0.163:50725 (472 connections now open) 2015-10-05T12:36:59.753+0100 [mongosMain] connection accepted from 172.28.0.163:52930 #2196 (473 connections now open) 2015-10-05T12:36:59.755+0100 [conn2196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:59.801+0100 [conn1881] end connection 172.28.0.163:50935 (472 connections now open) 2015-10-05T12:36:59.802+0100 [mongosMain] connection accepted from 172.28.0.163:52932 #2197 (473 connections now open) 2015-10-05T12:36:59.804+0100 [conn2197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:36:59.934+0100 [conn1765] end connection 172.28.0.163:50767 (472 connections now open) 2015-10-05T12:36:59.935+0100 [mongosMain] connection accepted from 172.28.0.163:52934 #2198 (473 connections now open) 2015-10-05T12:36:59.937+0100 [conn2198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.002+0100 [conn1837] end connection 172.28.0.163:50857 (472 connections now open) 2015-10-05T12:37:00.003+0100 [mongosMain] connection accepted from 172.28.0.163:52936 #2199 (473 connections now open) 2015-10-05T12:37:00.004+0100 [conn2199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.046+0100 [conn1764] end connection 172.28.0.163:50766 (472 connections now open) 2015-10-05T12:37:00.047+0100 [mongosMain] connection accepted from 172.28.0.163:52941 #2200 (473 connections now open) 2015-10-05T12:37:00.049+0100 [conn2200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.659+0100 [conn1867] end connection 172.28.0.163:50910 (472 connections now open) 2015-10-05T12:37:00.660+0100 [mongosMain] connection accepted from 172.28.0.163:52943 #2201 (473 connections now open) 2015-10-05T12:37:00.662+0100 [conn2201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.710+0100 [conn1793] end connection 172.28.0.163:50796 (472 connections now open) 2015-10-05T12:37:00.711+0100 [mongosMain] connection accepted from 172.28.0.163:52944 #2202 (473 connections now open) 2015-10-05T12:37:00.712+0100 [conn2202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.791+0100 [conn1835] end connection 172.28.0.163:50858 (472 connections now open) 2015-10-05T12:37:00.792+0100 [mongosMain] connection accepted from 172.28.0.163:52945 #2203 (473 connections now open) 2015-10-05T12:37:00.794+0100 [conn2203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.898+0100 [conn1852] end connection 172.28.0.163:50885 (472 connections now open) 2015-10-05T12:37:00.900+0100 [mongosMain] connection accepted from 172.28.0.163:52947 #2204 (473 connections now open) 2015-10-05T12:37:00.902+0100 [conn2204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.911+0100 [conn1743] end connection 172.28.0.163:50745 (472 connections now open) 2015-10-05T12:37:00.913+0100 [mongosMain] connection accepted from 172.28.0.163:52948 #2205 (473 connections now open) 2015-10-05T12:37:00.915+0100 [conn2205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.949+0100 [conn1779] end connection 172.28.0.163:50781 (472 connections now open) 2015-10-05T12:37:00.951+0100 [mongosMain] connection accepted from 172.28.0.163:52949 #2206 (473 connections now open) 2015-10-05T12:37:00.953+0100 [conn2206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.985+0100 [conn1684] end connection 172.28.0.163:50684 (472 connections now open) 2015-10-05T12:37:00.985+0100 [conn1810] end connection 172.28.0.163:50813 (471 connections now open) 2015-10-05T12:37:00.986+0100 [mongosMain] connection accepted from 172.28.0.163:52954 #2207 (472 connections now open) 2015-10-05T12:37:00.987+0100 [mongosMain] connection accepted from 172.28.0.163:52955 #2208 (473 connections now open) 2015-10-05T12:37:00.988+0100 [conn2207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:00.988+0100 [conn2208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:01.003+0100 [conn1853] end connection 172.28.0.163:50886 (472 connections now open) 2015-10-05T12:37:01.004+0100 [mongosMain] connection accepted from 172.28.0.163:52958 #2209 (473 connections now open) 2015-10-05T12:37:01.005+0100 [conn2209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:01.259+0100 [conn1831] end connection 172.28.0.163:50841 (472 connections now open) 2015-10-05T12:37:01.260+0100 [conn1802] end connection 172.28.0.163:50805 (471 connections now open) 2015-10-05T12:37:01.400+0100 [mongosMain] connection accepted from 172.28.0.163:52965 #2210 (472 connections now open) 2015-10-05T12:37:01.400+0100 [mongosMain] connection accepted from 172.28.0.163:52964 #2211 (473 connections now open) 2015-10-05T12:37:01.402+0100 [conn2211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:01.984+0100 [conn2210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:04.814+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260df12deab02e2990e23 2015-10-05T12:37:04.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:37:13.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260e612deab02e2990ec0 2015-10-05T12:37:13.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:37:15.610+0100 [conn1298] end connection 172.28.0.164:52263 (472 connections now open) 2015-10-05T12:37:15.611+0100 [mongosMain] connection accepted from 172.28.0.164:56030 #2212 (473 connections now open) 2015-10-05T12:37:15.613+0100 [conn2212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:23.972+0100 [conn1674] end connection 172.28.0.163:50673 (472 connections now open) 2015-10-05T12:37:25.513+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:37:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:37:27.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561260f512deab02e2990ff7 2015-10-05T12:37:27.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:37:28.558+0100 [mongosMain] connection accepted from 127.0.0.1:53066 #2213 (473 connections now open) 2015-10-05T12:37:28.561+0100 [conn2213] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:28.562+0100 [conn2213] end connection 127.0.0.1:53066 (472 connections now open) 2015-10-05T12:37:30.977+0100 [conn1530] end connection 172.28.0.163:59763 (471 connections now open) 2015-10-05T12:37:30.978+0100 [mongosMain] connection accepted from 172.28.0.163:53067 #2214 (472 connections now open) 2015-10-05T12:37:30.979+0100 [conn2214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:39.353+0100 [conn1410] end connection 172.28.0.164:52549 (471 connections now open) 2015-10-05T12:37:39.985+0100 [mongosMain] connection accepted from 127.0.0.1:53069 #2215 (472 connections now open) 2015-10-05T12:37:39.988+0100 [conn2215] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:37:39.988+0100 [conn2215] end connection 127.0.0.1:53069 (471 connections now open) 2015-10-05T12:37:41.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612610412deab02e299112b 2015-10-05T12:37:41.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:37:48.162+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:37:48.162+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:37:54.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612611212deab02e299123c 2015-10-05T12:37:54.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:37:56.258+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:37:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:38:06.875+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612611e12deab02e299133a 2015-10-05T12:38:07.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:13.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612612512deab02e29913bd 2015-10-05T12:38:13.591+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:15.626+0100 [conn1302] end connection 172.28.0.164:52268 (470 connections now open) 2015-10-05T12:38:15.627+0100 [mongosMain] connection accepted from 172.28.0.164:56101 #2216 (471 connections now open) 2015-10-05T12:38:15.630+0100 [conn2216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:38:19.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612612b12deab02e299143b 2015-10-05T12:38:20.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:24.000+0100 [conn1672] end connection 172.28.0.163:50671 (470 connections now open) 2015-10-05T12:38:26.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612613212deab02e299148d 2015-10-05T12:38:26.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:26.388+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:38:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:38:28.667+0100 [mongosMain] connection accepted from 127.0.0.1:53148 #2217 (471 connections now open) 2015-10-05T12:38:28.669+0100 [conn2217] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:38:28.671+0100 [conn2217] end connection 127.0.0.1:53148 (470 connections now open) 2015-10-05T12:38:30.993+0100 [conn1512] end connection 172.28.0.163:59197 (469 connections now open) 2015-10-05T12:38:30.994+0100 [mongosMain] connection accepted from 172.28.0.163:53153 #2218 (470 connections now open) 2015-10-05T12:38:30.995+0100 [conn2218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:38:34.063+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612613812deab02e29914f1 2015-10-05T12:38:34.131+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:39.205+0100 [mongosMain] connection accepted from 127.0.0.1:53165 #2219 (471 connections now open) 2015-10-05T12:38:39.216+0100 [conn2219] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:38:39.216+0100 [conn2219] end connection 127.0.0.1:53165 (470 connections now open) 2015-10-05T12:38:39.370+0100 [conn1413] end connection 172.28.0.164:52553 (469 connections now open) 2015-10-05T12:38:46.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612614612deab02e29915e9 2015-10-05T12:38:47.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:38:56.887+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:38:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:39:07.329+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126155d67947988ef822a8') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045147244), why: "doing balance round", ts: ObjectId('5612615b12deab02e2991723') } } gle1: { lastOp: Timestamp 1444045147000|5, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1444045127000|3, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2015-10-05T12:39:07.334+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:39:07.334+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:39:13.573+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612615cd67947988ef82324') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045153343), why: "doing balance round", ts: ObjectId('5612616112deab02e2991787') } } gle1: { lastOp: Timestamp 1444045153000|5, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } gle2: { lastOp: Timestamp 1444045127000|3, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } 2015-10-05T12:39:13.577+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:39:13.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:39:15.646+0100 [conn1300] end connection 172.28.0.164:52265 (468 connections now open) 2015-10-05T12:39:15.647+0100 [mongosMain] connection accepted from 172.28.0.164:56186 #2220 (469 connections now open) 2015-10-05T12:39:15.651+0100 [conn2220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:39:19.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612616712deab02e29917f3 2015-10-05T12:39:19.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:39:24.010+0100 [conn1677] end connection 172.28.0.163:50676 (468 connections now open) 2015-10-05T12:39:26.244+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612616d12deab02e2991857 2015-10-05T12:39:26.380+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:39:27.166+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:39:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:39:27.166+0100 [LockPinger] trying to delete 2 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:39:27.302+0100 [LockPinger] handled late remove of old distributed lock with ts 5612615b12deab02e2991723 2015-10-05T12:39:27.438+0100 [LockPinger] handled late remove of old distributed lock with ts 5612616112deab02e2991787 2015-10-05T12:39:28.803+0100 [mongosMain] connection accepted from 127.0.0.1:53241 #2221 (469 connections now open) 2015-10-05T12:39:28.806+0100 [conn2221] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:39:28.807+0100 [conn2221] end connection 127.0.0.1:53241 (468 connections now open) 2015-10-05T12:39:31.015+0100 [conn1537] end connection 172.28.0.163:60337 (467 connections now open) 2015-10-05T12:39:31.016+0100 [mongosMain] connection accepted from 172.28.0.163:53244 #2222 (468 connections now open) 2015-10-05T12:39:31.018+0100 [conn2222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:39:32.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612617412deab02e29918c1 2015-10-05T12:39:32.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:39:39.390+0100 [conn1412] end connection 172.28.0.164:52552 (467 connections now open) 2015-10-05T12:39:39.884+0100 [mongosMain] connection accepted from 127.0.0.1:53252 #2223 (468 connections now open) 2015-10-05T12:39:39.886+0100 [conn2223] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:39:39.887+0100 [conn2223] end connection 127.0.0.1:53252 (467 connections now open) 2015-10-05T12:39:51.155+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:39:51.155+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:39:58.425+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126189d67947988ef825b8') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045197163), why: "doing balance round", ts: ObjectId('5612618d12deab02e2991a15') } } gle1: { lastOp: Timestamp 1444045197000|6, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 875, writtenTo: null, err: null, waited: 875, ok: 1.0 } gle2: { lastOp: Timestamp 1444045172000|8, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 0, writtenTo: null, err: null, waited: 0, ok: 1.0 } 2015-10-05T12:39:58.430+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:39:58.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:39:58.733+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:39:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:39:58.733+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:39:58.870+0100 [LockPinger] handled late remove of old distributed lock with ts 5612618d12deab02e2991a15 2015-10-05T12:40:04.771+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:40:04.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:40:15.662+0100 [conn1304] end connection 172.28.0.164:52270 (466 connections now open) 2015-10-05T12:40:15.664+0100 [mongosMain] connection accepted from 172.28.0.164:56270 #2224 (467 connections now open) 2015-10-05T12:40:15.668+0100 [conn2224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:40:18.639+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:40:18.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:40:24.026+0100 [conn1678] end connection 172.28.0.163:50678 (466 connections now open) 2015-10-05T12:40:24.769+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:40:24.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:40:28.684+0100 [mongosMain] connection accepted from 127.0.0.1:53335 #2225 (467 connections now open) 2015-10-05T12:40:28.686+0100 [conn2225] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:40:28.687+0100 [conn2225] end connection 127.0.0.1:53335 (466 connections now open) 2015-10-05T12:40:29.739+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:40:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:40:31.031+0100 [conn1541] end connection 172.28.0.163:62003 (465 connections now open) 2015-10-05T12:40:31.032+0100 [mongosMain] connection accepted from 172.28.0.163:53337 #2226 (466 connections now open) 2015-10-05T12:40:31.034+0100 [conn2226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:40:31.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561261ae12deab02e2991c26 2015-10-05T12:40:31.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:40:39.406+0100 [conn1415] end connection 172.28.0.164:52554 (465 connections now open) 2015-10-05T12:40:39.870+0100 [mongosMain] connection accepted from 127.0.0.1:53339 #2227 (466 connections now open) 2015-10-05T12:40:39.873+0100 [conn2227] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:40:39.874+0100 [conn2227] end connection 127.0.0.1:53339 (465 connections now open) 2015-10-05T12:40:43.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561261bb12deab02e2991cd3 2015-10-05T12:40:43.560+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:40:49.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561261c112deab02e2991d33 2015-10-05T12:40:49.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:40:56.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561261c712deab02e2991d9d 2015-10-05T12:40:56.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:40:59.987+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:40:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:41:15.678+0100 [conn1299] end connection 172.28.0.164:52264 (464 connections now open) 2015-10-05T12:41:15.679+0100 [mongosMain] connection accepted from 172.28.0.164:56344 #2228 (465 connections now open) 2015-10-05T12:41:15.682+0100 [conn2228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:41:21.187+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:41:21.187+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:24.042+0100 [conn1682] end connection 172.28.0.163:50682 (464 connections now open) 2015-10-05T12:41:27.325+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561261e103838a45371632d0') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045287194), why: "doing balance round", ts: ObjectId('561261e712deab02e2991fb8') } } gle1: { lastOp: Timestamp 1444045287000|7, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } gle2: { lastOp: Timestamp 1444045256000|4, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } 2015-10-05T12:41:27.329+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:41:27.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:28.588+0100 [mongosMain] connection accepted from 127.0.0.1:53429 #2229 (465 connections now open) 2015-10-05T12:41:28.590+0100 [conn2229] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:41:28.591+0100 [conn2229] end connection 127.0.0.1:53429 (464 connections now open) 2015-10-05T12:41:30.276+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:41:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:41:30.276+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:41:30.413+0100 [LockPinger] handled late remove of old distributed lock with ts 561261e712deab02e2991fb8 2015-10-05T12:41:31.046+0100 [conn1045] end connection 172.28.0.163:57561 (463 connections now open) 2015-10-05T12:41:31.047+0100 [mongosMain] connection accepted from 172.28.0.163:53445 #2230 (464 connections now open) 2015-10-05T12:41:31.049+0100 [conn2230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:41:33.482+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561261e721e099ca5fa0cf3d') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045293339), why: "doing balance round", ts: ObjectId('561261ed12deab02e299200c') } } gle1: { lastOp: Timestamp 1444045293000|6, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } gle2: { lastOp: Timestamp 1444045256000|4, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } 2015-10-05T12:41:33.486+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:41:33.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:39.452+0100 [conn1422] end connection 172.28.0.164:52563 (463 connections now open) 2015-10-05T12:41:39.608+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:41:39.608+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:39.608+0100 [mongosMain] connection accepted from 127.0.0.1:53453 #2231 (464 connections now open) 2015-10-05T12:41:39.608+0100 [conn2231] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:41:39.608+0100 [conn2231] end connection 127.0.0.1:53453 (463 connections now open) 2015-10-05T12:41:45.621+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:41:45.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:51.692+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:41:51.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:41:59.130+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:41:59.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:00.667+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:42:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:42:00.667+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:42:00.803+0100 [LockPinger] handled late remove of old distributed lock with ts 561261ed12deab02e299200c 2015-10-05T12:42:05.933+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:05.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:12.064+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:12.064+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:15.660+0100 [conn1305] end connection 172.28.0.164:52271 (462 connections now open) 2015-10-05T12:42:15.661+0100 [mongosMain] connection accepted from 172.28.0.164:56435 #2232 (463 connections now open) 2015-10-05T12:42:15.665+0100 [conn2232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:42:18.202+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:18.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:24.023+0100 [conn1689] end connection 172.28.0.163:50689 (462 connections now open) 2015-10-05T12:42:24.339+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:24.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:28.895+0100 [mongosMain] connection accepted from 127.0.0.1:53527 #2233 (463 connections now open) 2015-10-05T12:42:28.898+0100 [conn2233] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:42:28.899+0100 [conn2233] end connection 127.0.0.1:53527 (462 connections now open) 2015-10-05T12:42:30.414+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:30.414+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:30.963+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:42:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:42:31.028+0100 [conn1524] end connection 172.28.0.163:59669 (461 connections now open) 2015-10-05T12:42:31.030+0100 [mongosMain] connection accepted from 172.28.0.163:53529 #2234 (462 connections now open) 2015-10-05T12:42:31.032+0100 [conn2234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:42:37.477+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612622603838a45371632d6') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045356422), why: "doing balance round", ts: ObjectId('5612622c12deab02e29922e9') } } gle1: { lastOp: Timestamp 1444045356000|6, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 394, writtenTo: null, err: null, waited: 394, ok: 1.0 } gle2: { lastOp: Timestamp 1444045256000|4, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } 2015-10-05T12:42:37.481+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:42:37.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:39.305+0100 [mongosMain] connection accepted from 127.0.0.1:53533 #2235 (463 connections now open) 2015-10-05T12:42:39.307+0100 [conn2235] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:42:39.308+0100 [conn2235] end connection 127.0.0.1:53533 (462 connections now open) 2015-10-05T12:42:39.419+0100 [conn1419] end connection 172.28.0.164:52557 (461 connections now open) 2015-10-05T12:42:50.235+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:42:50.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:42:57.466+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612623ad5de43e0ed5d3e90') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045376250), why: "doing balance round", ts: ObjectId('5612624012deab02e29923f9') } } gle1: { lastOp: Timestamp 1444045377000|3, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 25, writtenTo: null, err: null, waited: 25, ok: 1.0 } gle2: { lastOp: Timestamp 1444045256000|4, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2015-10-05T12:42:57.470+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:42:57.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:01.220+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:43:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:43:01.220+0100 [LockPinger] trying to delete 2 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:43:01.356+0100 [LockPinger] handled late remove of old distributed lock with ts 5612622c12deab02e29922e9 2015-10-05T12:43:01.492+0100 [LockPinger] handled late remove of old distributed lock with ts 5612624012deab02e29923f9 2015-10-05T12:43:03.825+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612624038482111da12e216') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045383477), why: "doing balance round", ts: ObjectId('5612624712deab02e2992456') } } gle1: { lastOp: Timestamp 1444045383000|7, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1444045256000|4, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2015-10-05T12:43:03.829+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:43:03.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:10.546+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:43:10.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:15.676+0100 [conn1303] end connection 172.28.0.164:52269 (460 connections now open) 2015-10-05T12:43:15.677+0100 [mongosMain] connection accepted from 172.28.0.164:56511 #2236 (461 connections now open) 2015-10-05T12:43:15.680+0100 [conn2236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:16.701+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:43:16.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:18.060+0100 [conn1660] end connection 172.28.0.163:50659 (460 connections now open) 2015-10-05T12:43:18.061+0100 [mongosMain] connection accepted from 172.28.0.163:53619 #2237 (461 connections now open) 2015-10-05T12:43:18.063+0100 [conn2237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:18.143+0100 [conn1642] end connection 172.28.0.163:50641 (460 connections now open) 2015-10-05T12:43:18.144+0100 [mongosMain] connection accepted from 172.28.0.163:53621 #2238 (461 connections now open) 2015-10-05T12:43:18.146+0100 [conn2238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:18.524+0100 [conn1721] end connection 172.28.0.163:50723 (460 connections now open) 2015-10-05T12:43:18.525+0100 [mongosMain] connection accepted from 172.28.0.163:53622 #2239 (461 connections now open) 2015-10-05T12:43:18.526+0100 [conn2239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.517+0100 [conn1777] end connection 172.28.0.163:50779 (460 connections now open) 2015-10-05T12:43:20.518+0100 [mongosMain] connection accepted from 172.28.0.163:53623 #2240 (461 connections now open) 2015-10-05T12:43:20.520+0100 [conn2240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.522+0100 [conn1750] end connection 172.28.0.163:50752 (460 connections now open) 2015-10-05T12:43:20.523+0100 [mongosMain] connection accepted from 172.28.0.163:53624 #2241 (461 connections now open) 2015-10-05T12:43:20.525+0100 [conn2241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.571+0100 [conn1791] end connection 172.28.0.163:50794 (460 connections now open) 2015-10-05T12:43:20.572+0100 [mongosMain] connection accepted from 172.28.0.163:53625 #2242 (461 connections now open) 2015-10-05T12:43:20.574+0100 [conn2242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.631+0100 [conn1748] end connection 172.28.0.163:50750 (460 connections now open) 2015-10-05T12:43:20.633+0100 [mongosMain] connection accepted from 172.28.0.163:53626 #2243 (461 connections now open) 2015-10-05T12:43:20.634+0100 [conn2243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.693+0100 [conn1734] end connection 172.28.0.163:50736 (460 connections now open) 2015-10-05T12:43:20.694+0100 [conn1742] end connection 172.28.0.163:50744 (459 connections now open) 2015-10-05T12:43:20.695+0100 [mongosMain] connection accepted from 172.28.0.163:53627 #2244 (460 connections now open) 2015-10-05T12:43:20.695+0100 [mongosMain] connection accepted from 172.28.0.163:53628 #2245 (461 connections now open) 2015-10-05T12:43:20.696+0100 [conn2244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.697+0100 [conn2245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.697+0100 [conn1738] end connection 172.28.0.163:50740 (460 connections now open) 2015-10-05T12:43:20.698+0100 [mongosMain] connection accepted from 172.28.0.163:53629 #2246 (461 connections now open) 2015-10-05T12:43:20.699+0100 [conn2246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.713+0100 [conn1788] end connection 172.28.0.163:50791 (460 connections now open) 2015-10-05T12:43:20.714+0100 [mongosMain] connection accepted from 172.28.0.163:53630 #2247 (461 connections now open) 2015-10-05T12:43:20.717+0100 [conn2247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.734+0100 [conn1781] end connection 172.28.0.163:50783 (460 connections now open) 2015-10-05T12:43:20.735+0100 [mongosMain] connection accepted from 172.28.0.163:53631 #2248 (461 connections now open) 2015-10-05T12:43:20.737+0100 [conn2248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.784+0100 [conn1726] end connection 172.28.0.163:50728 (460 connections now open) 2015-10-05T12:43:20.785+0100 [mongosMain] connection accepted from 172.28.0.163:53632 #2249 (461 connections now open) 2015-10-05T12:43:20.787+0100 [conn2249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.797+0100 [conn1772] end connection 172.28.0.163:50774 (460 connections now open) 2015-10-05T12:43:20.798+0100 [mongosMain] connection accepted from 172.28.0.163:53633 #2250 (461 connections now open) 2015-10-05T12:43:20.800+0100 [conn2250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.948+0100 [conn1661] end connection 172.28.0.163:50660 (460 connections now open) 2015-10-05T12:43:20.949+0100 [conn1774] end connection 172.28.0.163:50776 (459 connections now open) 2015-10-05T12:43:20.950+0100 [mongosMain] connection accepted from 172.28.0.163:53635 #2251 (460 connections now open) 2015-10-05T12:43:20.950+0100 [mongosMain] connection accepted from 172.28.0.163:53636 #2252 (461 connections now open) 2015-10-05T12:43:20.951+0100 [conn2251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.951+0100 [conn2252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.993+0100 [conn1736] end connection 172.28.0.163:50738 (460 connections now open) 2015-10-05T12:43:20.994+0100 [mongosMain] connection accepted from 172.28.0.163:53637 #2253 (461 connections now open) 2015-10-05T12:43:20.997+0100 [conn2253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:20.997+0100 [conn1733] end connection 172.28.0.163:50735 (460 connections now open) 2015-10-05T12:43:20.998+0100 [mongosMain] connection accepted from 172.28.0.163:53638 #2254 (461 connections now open) 2015-10-05T12:43:20.999+0100 [conn2254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:21.077+0100 [conn1714] end connection 172.28.0.163:50722 (460 connections now open) 2015-10-05T12:43:21.079+0100 [mongosMain] connection accepted from 172.28.0.163:53639 #2255 (461 connections now open) 2015-10-05T12:43:21.080+0100 [conn2255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:22.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612625a12deab02e2992557 2015-10-05T12:43:23.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:43:24.040+0100 [conn1686] end connection 172.28.0.163:50686 (460 connections now open) 2015-10-05T12:43:29.056+0100 [mongosMain] connection accepted from 127.0.0.1:53644 #2256 (461 connections now open) 2015-10-05T12:43:29.059+0100 [conn2256] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:29.060+0100 [conn2256] end connection 127.0.0.1:53644 (460 connections now open) 2015-10-05T12:43:31.045+0100 [conn1169] end connection 172.28.0.163:58466 (459 connections now open) 2015-10-05T12:43:31.047+0100 [mongosMain] connection accepted from 172.28.0.163:53650 #2257 (460 connections now open) 2015-10-05T12:43:31.049+0100 [conn2257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:31.814+0100 [conn1710] end connection 172.28.0.163:50715 (459 connections now open) 2015-10-05T12:43:31.815+0100 [mongosMain] connection accepted from 172.28.0.163:53651 #2258 (460 connections now open) 2015-10-05T12:43:31.817+0100 [conn2258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:31.860+0100 [conn1798] end connection 172.28.0.163:50800 (459 connections now open) 2015-10-05T12:43:31.861+0100 [mongosMain] connection accepted from 172.28.0.163:53652 #2259 (460 connections now open) 2015-10-05T12:43:31.863+0100 [conn2259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:31.888+0100 [conn1706] end connection 172.28.0.163:50707 (459 connections now open) 2015-10-05T12:43:31.889+0100 [mongosMain] connection accepted from 172.28.0.163:53653 #2260 (460 connections now open) 2015-10-05T12:43:31.891+0100 [conn2260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:31.895+0100 [conn1775] end connection 172.28.0.163:50777 (459 connections now open) 2015-10-05T12:43:31.896+0100 [mongosMain] connection accepted from 172.28.0.163:53654 #2261 (460 connections now open) 2015-10-05T12:43:31.898+0100 [conn2261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:32.222+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:43:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:43:32.222+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:43:32.359+0100 [LockPinger] handled late remove of old distributed lock with ts 5612624712deab02e2992456 2015-10-05T12:43:39.296+0100 [mongosMain] connection accepted from 127.0.0.1:53663 #2262 (461 connections now open) 2015-10-05T12:43:39.298+0100 [conn2262] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:39.298+0100 [conn2262] end connection 127.0.0.1:53663 (460 connections now open) 2015-10-05T12:43:39.436+0100 [conn1425] end connection 172.28.0.164:52566 (459 connections now open) 2015-10-05T12:43:42.452+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:43:42.452+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:48.631+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:43:48.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:54.786+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126274d67947988ef8318f') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045434644), why: "doing balance round", ts: ObjectId('5612627a12deab02e29926a6') } } gle1: { lastOp: Timestamp 1444045434000|4, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 25, writtenTo: null, err: null, waited: 25, ok: 1.0 } gle2: { lastOp: Timestamp 1444045403000|2, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } 2015-10-05T12:43:54.789+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:43:54.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:43:56.504+0100 [conn1841] end connection 172.28.0.163:50869 (458 connections now open) 2015-10-05T12:43:56.506+0100 [mongosMain] connection accepted from 172.28.0.163:53692 #2263 (459 connections now open) 2015-10-05T12:43:56.508+0100 [conn2263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:56.598+0100 [conn1729] end connection 172.28.0.163:50731 (458 connections now open) 2015-10-05T12:43:56.600+0100 [mongosMain] connection accepted from 172.28.0.163:53694 #2264 (459 connections now open) 2015-10-05T12:43:56.601+0100 [conn2264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:43:56.696+0100 [conn1745] end connection 172.28.0.163:50747 (458 connections now open) 2015-10-05T12:43:56.697+0100 [mongosMain] connection accepted from 172.28.0.163:53695 #2265 (459 connections now open) 2015-10-05T12:43:56.699+0100 [conn2265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:00.930+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:00.930+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:02.665+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:44:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:44:02.665+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:44:02.733+0100 [LockPinger] handled late remove of old distributed lock with ts 5612627a12deab02e29926a6 2015-10-05T12:44:07.780+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:07.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:14.179+0100 [conn1846] end connection 172.28.0.163:50878 (458 connections now open) 2015-10-05T12:44:14.180+0100 [mongosMain] connection accepted from 172.28.0.163:53739 #2266 (459 connections now open) 2015-10-05T12:44:14.182+0100 [conn2266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:14.672+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:14.672+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:15.692+0100 [conn1306] end connection 172.28.0.164:52272 (458 connections now open) 2015-10-05T12:44:15.693+0100 [mongosMain] connection accepted from 172.28.0.164:56578 #2267 (459 connections now open) 2015-10-05T12:44:15.696+0100 [conn2267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:24.056+0100 [conn1681] end connection 172.28.0.163:50681 (458 connections now open) 2015-10-05T12:44:26.809+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:26.809+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:28.210+0100 [mongosMain] connection accepted from 127.0.0.1:53757 #2268 (459 connections now open) 2015-10-05T12:44:28.214+0100 [conn2268] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:28.215+0100 [conn2268] end connection 127.0.0.1:53757 (458 connections now open) 2015-10-05T12:44:31.060+0100 [conn1527] end connection 172.28.0.163:59713 (457 connections now open) 2015-10-05T12:44:31.061+0100 [mongosMain] connection accepted from 172.28.0.163:53762 #2269 (458 connections now open) 2015-10-05T12:44:31.063+0100 [conn2269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:32.914+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:44:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:44:32.915+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:32.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:34.353+0100 [conn1857] end connection 172.28.0.163:50894 (457 connections now open) 2015-10-05T12:44:34.354+0100 [mongosMain] connection accepted from 172.28.0.163:53765 #2270 (458 connections now open) 2015-10-05T12:44:34.356+0100 [conn2270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:39.128+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:39.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:39.447+0100 [mongosMain] connection accepted from 127.0.0.1:53767 #2271 (459 connections now open) 2015-10-05T12:44:39.450+0100 [conn2271] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:39.451+0100 [conn2271] end connection 127.0.0.1:53767 (458 connections now open) 2015-10-05T12:44:39.452+0100 [conn1426] end connection 172.28.0.164:52565 (457 connections now open) 2015-10-05T12:44:46.275+0100 [conn1859] end connection 172.28.0.163:50898 (456 connections now open) 2015-10-05T12:44:46.277+0100 [mongosMain] connection accepted from 172.28.0.163:53777 #2272 (457 connections now open) 2015-10-05T12:44:46.279+0100 [conn2272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:48.981+0100 [conn1871] end connection 172.28.0.163:50918 (456 connections now open) 2015-10-05T12:44:48.983+0100 [mongosMain] connection accepted from 172.28.0.163:53790 #2273 (457 connections now open) 2015-10-05T12:44:48.984+0100 [conn2273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:51.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262b312deab02e299299a 2015-10-05T12:44:51.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:44:55.610+0100 [conn1880] end connection 172.28.0.163:50934 (456 connections now open) 2015-10-05T12:44:55.611+0100 [mongosMain] connection accepted from 172.28.0.163:53798 #2274 (457 connections now open) 2015-10-05T12:44:55.613+0100 [conn2274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:57.839+0100 [conn1778] end connection 172.28.0.163:50780 (456 connections now open) 2015-10-05T12:44:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:53804 #2275 (457 connections now open) 2015-10-05T12:44:57.841+0100 [conn2275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:57.979+0100 [conn1692] end connection 172.28.0.163:50692 (456 connections now open) 2015-10-05T12:44:57.980+0100 [mongosMain] connection accepted from 172.28.0.163:53805 #2276 (457 connections now open) 2015-10-05T12:44:57.982+0100 [conn2276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.006+0100 [conn1836] end connection 172.28.0.163:50854 (456 connections now open) 2015-10-05T12:44:58.007+0100 [mongosMain] connection accepted from 172.28.0.163:53806 #2277 (457 connections now open) 2015-10-05T12:44:58.009+0100 [conn2277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.032+0100 [conn1813] end connection 172.28.0.163:50816 (456 connections now open) 2015-10-05T12:44:58.033+0100 [mongosMain] connection accepted from 172.28.0.163:53807 #2278 (457 connections now open) 2015-10-05T12:44:58.035+0100 [conn2278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.235+0100 [conn1830] end connection 172.28.0.163:50835 (456 connections now open) 2015-10-05T12:44:58.237+0100 [mongosMain] connection accepted from 172.28.0.163:53808 #2279 (457 connections now open) 2015-10-05T12:44:58.239+0100 [conn2279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.348+0100 [conn1849] end connection 172.28.0.163:50880 (456 connections now open) 2015-10-05T12:44:58.349+0100 [mongosMain] connection accepted from 172.28.0.163:53809 #2280 (457 connections now open) 2015-10-05T12:44:58.351+0100 [conn2280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.461+0100 [conn1770] end connection 172.28.0.163:50772 (456 connections now open) 2015-10-05T12:44:58.462+0100 [mongosMain] connection accepted from 172.28.0.163:53811 #2281 (457 connections now open) 2015-10-05T12:44:58.463+0100 [conn2281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.507+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:44:58.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:44:58.550+0100 [conn1840] end connection 172.28.0.163:50867 (456 connections now open) 2015-10-05T12:44:58.552+0100 [mongosMain] connection accepted from 172.28.0.163:53812 #2282 (457 connections now open) 2015-10-05T12:44:58.554+0100 [conn2282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.597+0100 [conn1860] end connection 172.28.0.163:50902 (456 connections now open) 2015-10-05T12:44:58.598+0100 [mongosMain] connection accepted from 172.28.0.163:53813 #2283 (457 connections now open) 2015-10-05T12:44:58.600+0100 [conn2283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.631+0100 [conn1870] end connection 172.28.0.163:50916 (456 connections now open) 2015-10-05T12:44:58.633+0100 [mongosMain] connection accepted from 172.28.0.163:53814 #2284 (457 connections now open) 2015-10-05T12:44:58.635+0100 [conn2284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.673+0100 [conn1863] end connection 172.28.0.163:50906 (456 connections now open) 2015-10-05T12:44:58.674+0100 [mongosMain] connection accepted from 172.28.0.163:53815 #2285 (457 connections now open) 2015-10-05T12:44:58.676+0100 [conn2285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.778+0100 [conn1740] end connection 172.28.0.163:50742 (456 connections now open) 2015-10-05T12:44:58.779+0100 [mongosMain] connection accepted from 172.28.0.163:53817 #2286 (457 connections now open) 2015-10-05T12:44:58.779+0100 [conn1667] end connection 172.28.0.163:50666 (456 connections now open) 2015-10-05T12:44:58.780+0100 [mongosMain] connection accepted from 172.28.0.163:53818 #2287 (457 connections now open) 2015-10-05T12:44:58.780+0100 [conn2286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:58.782+0100 [conn2287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.020+0100 [conn1799] end connection 172.28.0.163:50802 (456 connections now open) 2015-10-05T12:44:59.022+0100 [mongosMain] connection accepted from 172.28.0.163:53820 #2288 (457 connections now open) 2015-10-05T12:44:59.023+0100 [conn2288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.159+0100 [conn1796] end connection 172.28.0.163:50799 (456 connections now open) 2015-10-05T12:44:59.159+0100 [mongosMain] connection accepted from 172.28.0.163:53822 #2289 (457 connections now open) 2015-10-05T12:44:59.162+0100 [conn2289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.402+0100 [conn1707] end connection 172.28.0.163:50708 (456 connections now open) 2015-10-05T12:44:59.404+0100 [mongosMain] connection accepted from 172.28.0.163:53823 #2290 (457 connections now open) 2015-10-05T12:44:59.405+0100 [conn2290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.410+0100 [conn1817] end connection 172.28.0.163:50821 (456 connections now open) 2015-10-05T12:44:59.411+0100 [mongosMain] connection accepted from 172.28.0.163:53824 #2291 (457 connections now open) 2015-10-05T12:44:59.413+0100 [conn2291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.434+0100 [conn1868] end connection 172.28.0.163:50911 (456 connections now open) 2015-10-05T12:44:59.436+0100 [mongosMain] connection accepted from 172.28.0.163:53825 #2292 (457 connections now open) 2015-10-05T12:44:59.438+0100 [conn2292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.679+0100 [conn1694] end connection 172.28.0.163:50694 (456 connections now open) 2015-10-05T12:44:59.680+0100 [mongosMain] connection accepted from 172.28.0.163:53827 #2293 (457 connections now open) 2015-10-05T12:44:59.682+0100 [conn2293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.760+0100 [conn1820] end connection 172.28.0.163:50823 (456 connections now open) 2015-10-05T12:44:59.761+0100 [mongosMain] connection accepted from 172.28.0.163:53828 #2294 (457 connections now open) 2015-10-05T12:44:59.763+0100 [conn2294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.766+0100 [conn1652] end connection 172.28.0.163:50651 (456 connections now open) 2015-10-05T12:44:59.767+0100 [mongosMain] connection accepted from 172.28.0.163:53829 #2295 (457 connections now open) 2015-10-05T12:44:59.768+0100 [conn2295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.895+0100 [conn1760] end connection 172.28.0.163:50762 (456 connections now open) 2015-10-05T12:44:59.897+0100 [mongosMain] connection accepted from 172.28.0.163:53831 #2296 (457 connections now open) 2015-10-05T12:44:59.898+0100 [conn2296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:44:59.981+0100 [conn1719] end connection 172.28.0.163:50718 (456 connections now open) 2015-10-05T12:44:59.983+0100 [mongosMain] connection accepted from 172.28.0.163:53834 #2297 (457 connections now open) 2015-10-05T12:44:59.984+0100 [conn2297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.004+0100 [conn1784] end connection 172.28.0.163:50787 (456 connections now open) 2015-10-05T12:45:00.005+0100 [mongosMain] connection accepted from 172.28.0.163:53836 #2298 (457 connections now open) 2015-10-05T12:45:00.007+0100 [conn2298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.186+0100 [conn1701] end connection 172.28.0.163:50701 (456 connections now open) 2015-10-05T12:45:00.188+0100 [mongosMain] connection accepted from 172.28.0.163:53841 #2299 (457 connections now open) 2015-10-05T12:45:00.190+0100 [conn2299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.225+0100 [conn1671] end connection 172.28.0.163:50670 (456 connections now open) 2015-10-05T12:45:00.225+0100 [mongosMain] connection accepted from 172.28.0.163:53843 #2300 (457 connections now open) 2015-10-05T12:45:00.227+0100 [conn2300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.369+0100 [conn1620] end connection 172.28.0.163:50395 (456 connections now open) 2015-10-05T12:45:00.370+0100 [mongosMain] connection accepted from 172.28.0.163:53848 #2301 (457 connections now open) 2015-10-05T12:45:00.372+0100 [conn2301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.763+0100 [conn1654] end connection 172.28.0.163:50652 (456 connections now open) 2015-10-05T12:45:00.765+0100 [mongosMain] connection accepted from 172.28.0.163:53860 #2302 (457 connections now open) 2015-10-05T12:45:00.767+0100 [conn2302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.827+0100 [conn1647] end connection 172.28.0.163:50646 (456 connections now open) 2015-10-05T12:45:00.828+0100 [mongosMain] connection accepted from 172.28.0.163:53863 #2303 (457 connections now open) 2015-10-05T12:45:00.830+0100 [conn2303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.834+0100 [conn1655] end connection 172.28.0.163:50655 (456 connections now open) 2015-10-05T12:45:00.835+0100 [mongosMain] connection accepted from 172.28.0.163:53865 #2304 (457 connections now open) 2015-10-05T12:45:00.836+0100 [conn2304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:00.841+0100 [conn1872] end connection 172.28.0.163:50923 (456 connections now open) 2015-10-05T12:45:00.842+0100 [mongosMain] connection accepted from 172.28.0.163:53867 #2305 (457 connections now open) 2015-10-05T12:45:00.844+0100 [conn2305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:03.196+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:45:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:45:04.766+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:45:04.766+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:45:10.871+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561262c338482111da12e229') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045510774), why: "doing balance round", ts: ObjectId('561262c612deab02e2992a9a') } } gle1: { lastOp: Timestamp 1444045510000|4, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444045491000|12, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2015-10-05T12:45:10.874+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:45:10.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:45:15.708+0100 [conn1535] end connection 172.28.0.164:53284 (456 connections now open) 2015-10-05T12:45:15.710+0100 [mongosMain] connection accepted from 172.28.0.164:56694 #2306 (457 connections now open) 2015-10-05T12:45:15.713+0100 [conn2306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:17.014+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561262c938482111da12e22a') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045516880), why: "doing balance round", ts: ObjectId('561262cc12deab02e2992aea') } } gle1: { lastOp: Timestamp 1444045510000|4, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1444045516000|5, connectionId: 39966, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T12:45:17.016+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:45:17.016+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:45:23.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262d312deab02e2992b27 2015-10-05T12:45:23.444+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:24.084+0100 [conn1690] end connection 172.28.0.163:50690 (456 connections now open) 2015-10-05T12:45:28.582+0100 [mongosMain] connection accepted from 127.0.0.1:53922 #2307 (457 connections now open) 2015-10-05T12:45:28.585+0100 [conn2307] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:28.586+0100 [conn2307] end connection 127.0.0.1:53922 (456 connections now open) 2015-10-05T12:45:29.587+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262d912deab02e2992b66 2015-10-05T12:45:29.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:31.077+0100 [conn1533] end connection 172.28.0.163:59873 (455 connections now open) 2015-10-05T12:45:31.078+0100 [mongosMain] connection accepted from 172.28.0.163:53926 #2308 (456 connections now open) 2015-10-05T12:45:31.080+0100 [conn2308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:33.482+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:45:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:45:33.482+0100 [LockPinger] trying to delete 2 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:45:33.618+0100 [LockPinger] handled late remove of old distributed lock with ts 561262c612deab02e2992a9a 2015-10-05T12:45:33.755+0100 [LockPinger] handled late remove of old distributed lock with ts 561262cc12deab02e2992aea 2015-10-05T12:45:35.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262df12deab02e2992ba9 2015-10-05T12:45:35.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:39.468+0100 [conn1447] end connection 172.28.0.164:52589 (455 connections now open) 2015-10-05T12:45:39.841+0100 [mongosMain] connection accepted from 127.0.0.1:53930 #2309 (456 connections now open) 2015-10-05T12:45:39.843+0100 [conn2309] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:45:39.843+0100 [conn2309] end connection 127.0.0.1:53930 (455 connections now open) 2015-10-05T12:45:42.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262e512deab02e2992bda 2015-10-05T12:45:42.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:48.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262ec12deab02e2992c1c 2015-10-05T12:45:48.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:54.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561262f212deab02e2992c5f 2015-10-05T12:45:55.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:45:59.987+0100 [conn1569] end connection 172.28.0.163:65517 (454 connections now open) 2015-10-05T12:46:01.488+0100 [conn1] end connection 172.28.0.163:52214 (453 connections now open) 2015-10-05T12:46:01.488+0100 [conn1602] end connection 172.28.0.163:50152 (452 connections now open) 2015-10-05T12:46:01.488+0100 [conn1632] end connection 172.28.0.163:50557 (452 connections now open) 2015-10-05T12:46:01.488+0100 [conn1624] end connection 172.28.0.163:50462 (452 connections now open) 2015-10-05T12:46:01.489+0100 [conn1969] end connection 172.28.0.163:52283 (449 connections now open) 2015-10-05T12:46:01.489+0100 [conn2269] end connection 172.28.0.163:53762 (448 connections now open) 2015-10-05T12:46:01.489+0100 [conn2230] end connection 172.28.0.163:53445 (448 connections now open) 2015-10-05T12:46:01.490+0100 [conn2226] end connection 172.28.0.163:53337 (446 connections now open) 2015-10-05T12:46:01.490+0100 [conn1606] end connection 172.28.0.163:50201 (445 connections now open) 2015-10-05T12:46:01.491+0100 [conn1923] end connection 172.28.0.163:51640 (444 connections now open) 2015-10-05T12:46:01.491+0100 [conn1943] end connection 172.28.0.163:51931 (443 connections now open) 2015-10-05T12:46:01.492+0100 [conn1935] end connection 172.28.0.163:51818 (442 connections now open) 2015-10-05T12:46:01.493+0100 [conn1947] end connection 172.28.0.163:51988 (441 connections now open) 2015-10-05T12:46:01.493+0100 [conn1561] end connection 172.28.0.163:64816 (440 connections now open) 2015-10-05T12:46:01.493+0100 [conn1614] end connection 172.28.0.163:50319 (439 connections now open) 2015-10-05T12:46:01.494+0100 [conn2022] end connection 172.28.0.163:52552 (438 connections now open) 2015-10-05T12:46:01.494+0100 [conn1884] end connection 172.28.0.163:51027 (438 connections now open) 2015-10-05T12:46:01.494+0100 [conn1927] end connection 172.28.0.163:51700 (436 connections now open) 2015-10-05T12:46:01.495+0100 [conn2218] end connection 172.28.0.163:53153 (435 connections now open) 2015-10-05T12:46:01.495+0100 [conn2187] end connection 172.28.0.163:52856 (434 connections now open) 2015-10-05T12:46:01.495+0100 [conn2222] end connection 172.28.0.163:53244 (434 connections now open) 2015-10-05T12:46:01.495+0100 [conn1553] end connection 172.28.0.163:63736 (432 connections now open) 2015-10-05T12:46:01.496+0100 [conn2257] end connection 172.28.0.163:53650 (431 connections now open) 2015-10-05T12:46:01.496+0100 [conn1628] end connection 172.28.0.163:50511 (430 connections now open) 2015-10-05T12:46:01.496+0100 [conn1987] end connection 172.28.0.163:52379 (429 connections now open) 2015-10-05T12:46:01.497+0100 [conn1636] end connection 172.28.0.163:50603 (428 connections now open) 2015-10-05T12:46:01.499+0100 [conn2308] end connection 172.28.0.163:53926 (427 connections now open) 2015-10-05T12:46:01.499+0100 [conn1549] end connection 172.28.0.163:63500 (426 connections now open) 2015-10-05T12:46:01.499+0100 [conn1618] end connection 172.28.0.163:50384 (425 connections now open) 2015-10-05T12:46:01.500+0100 [conn1316] end connection 172.28.0.163:58963 (424 connections now open) 2015-10-05T12:46:01.500+0100 [conn2076] end connection 172.28.0.163:52745 (423 connections now open) 2015-10-05T12:46:01.500+0100 [conn2214] end connection 172.28.0.163:53067 (422 connections now open) 2015-10-05T12:46:01.500+0100 [conn1914] end connection 172.28.0.163:51569 (421 connections now open) 2015-10-05T12:46:01.501+0100 [conn1565] end connection 172.28.0.163:65425 (420 connections now open) 2015-10-05T12:46:01.502+0100 [conn1904] end connection 172.28.0.163:51436 (419 connections now open) 2015-10-05T12:46:01.502+0100 [conn1965] end connection 172.28.0.163:52192 (418 connections now open) 2015-10-05T12:46:01.503+0100 [conn1582] end connection 172.28.0.163:49719 (417 connections now open) 2015-10-05T12:46:01.503+0100 [conn1573] end connection 172.28.0.163:49653 (416 connections now open) 2015-10-05T12:46:01.503+0100 [conn1557] end connection 172.28.0.163:64356 (415 connections now open) 2015-10-05T12:46:01.503+0100 [conn1960] end connection 172.28.0.163:52110 (414 connections now open) 2015-10-05T12:46:01.503+0100 [conn1610] end connection 172.28.0.163:50246 (413 connections now open) 2015-10-05T12:46:01.504+0100 [conn2234] end connection 172.28.0.163:53529 (412 connections now open) 2015-10-05T12:46:01.504+0100 [conn1908] end connection 172.28.0.163:51511 (412 connections now open) 2015-10-05T12:46:01.504+0100 [conn1931] end connection 172.28.0.163:51763 (410 connections now open) 2015-10-05T12:46:01.504+0100 [conn1939] end connection 172.28.0.163:51874 (409 connections now open) 2015-10-05T12:46:01.504+0100 [conn1888] end connection 172.28.0.163:51072 (408 connections now open) 2015-10-05T12:46:01.505+0100 [conn1892] end connection 172.28.0.163:51380 (407 connections now open) 2015-10-05T12:46:01.505+0100 [conn1545] end connection 172.28.0.163:63200 (406 connections now open) 2015-10-05T12:46:01.505+0100 [conn2004] end connection 172.28.0.163:52486 (405 connections now open) 2015-10-05T12:46:01.505+0100 [conn1955] end connection 172.28.0.163:52045 (404 connections now open) 2015-10-05T12:46:03.897+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:46:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:46:07.804+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:46:07.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:46:14.135+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612630512deab02e2992d57 2015-10-05T12:46:14.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:46:15.724+0100 [conn1539] end connection 172.28.0.164:53326 (403 connections now open) 2015-10-05T12:46:15.727+0100 [mongosMain] connection accepted from 172.28.0.164:56770 #2310 (404 connections now open) 2015-10-05T12:46:15.730+0100 [conn2310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:46:24.088+0100 [conn1687] end connection 172.28.0.163:50687 (403 connections now open) 2015-10-05T12:46:28.664+0100 [mongosMain] connection accepted from 127.0.0.1:54026 #2311 (404 connections now open) 2015-10-05T12:46:28.668+0100 [conn2311] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:46:28.669+0100 [conn2311] end connection 127.0.0.1:54026 (403 connections now open) 2015-10-05T12:46:32.770+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:46:32.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:46:34.273+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:46:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:46:38.853+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:46:38.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:46:39.484+0100 [conn1442] end connection 172.28.0.164:52583 (402 connections now open) 2015-10-05T12:46:39.726+0100 [mongosMain] connection accepted from 127.0.0.1:54028 #2312 (403 connections now open) 2015-10-05T12:46:39.729+0100 [conn2312] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:46:39.729+0100 [conn2312] end connection 127.0.0.1:54028 (402 connections now open) 2015-10-05T12:46:45.381+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:46:45.381+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:46:59.547+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:46:59.547+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:47:06.055+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:47:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:47:09.976+0100 [mongosMain] connection accepted from 172.28.0.163:54102 #2313 (403 connections now open) 2015-10-05T12:47:11.456+0100 [mongosMain] connection accepted from 172.28.0.163:54105 #2314 (404 connections now open) 2015-10-05T12:47:12.062+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:47:12.062+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:47:15.741+0100 [conn1543] end connection 172.28.0.164:53375 (403 connections now open) 2015-10-05T12:47:15.742+0100 [mongosMain] connection accepted from 172.28.0.164:56844 #2315 (404 connections now open) 2015-10-05T12:47:15.745+0100 [conn2315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:18.208+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:47:18.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:47:24.104+0100 [conn1685] end connection 172.28.0.163:50685 (403 connections now open) 2015-10-05T12:47:29.255+0100 [mongosMain] connection accepted from 127.0.0.1:54132 #2316 (404 connections now open) 2015-10-05T12:47:29.258+0100 [conn2316] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:29.259+0100 [conn2316] end connection 127.0.0.1:54132 (403 connections now open) 2015-10-05T12:47:30.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612635212deab02e2993148 2015-10-05T12:47:30.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:47:31.472+0100 [conn2314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:31.473+0100 [conn2313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:32.473+0100 [mongosMain] connection accepted from 172.28.0.163:54134 #2317 (404 connections now open) 2015-10-05T12:47:32.475+0100 [conn2317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:33.870+0100 [mongosMain] connection accepted from 172.28.0.163:54142 #2318 (405 connections now open) 2015-10-05T12:47:33.880+0100 [conn2318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:33.969+0100 [mongosMain] connection accepted from 172.28.0.163:54221 #2319 (406 connections now open) 2015-10-05T12:47:34.052+0100 [conn2319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.112+0100 [mongosMain] connection accepted from 172.28.0.163:54227 #2320 (407 connections now open) 2015-10-05T12:47:34.126+0100 [conn2320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.151+0100 [mongosMain] connection accepted from 172.28.0.163:54229 #2321 (408 connections now open) 2015-10-05T12:47:34.153+0100 [conn2321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.156+0100 [mongosMain] connection accepted from 172.28.0.163:54231 #2322 (409 connections now open) 2015-10-05T12:47:34.166+0100 [conn2322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.172+0100 [mongosMain] connection accepted from 172.28.0.163:54234 #2323 (410 connections now open) 2015-10-05T12:47:34.173+0100 [conn2323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.234+0100 [mongosMain] connection accepted from 172.28.0.163:54235 #2324 (411 connections now open) 2015-10-05T12:47:34.246+0100 [conn2324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.277+0100 [mongosMain] connection accepted from 172.28.0.163:54238 #2325 (412 connections now open) 2015-10-05T12:47:34.280+0100 [conn2325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.286+0100 [mongosMain] connection accepted from 172.28.0.163:54239 #2326 (413 connections now open) 2015-10-05T12:47:34.292+0100 [conn2326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.302+0100 [mongosMain] connection accepted from 172.28.0.163:54242 #2327 (414 connections now open) 2015-10-05T12:47:34.386+0100 [conn2327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.402+0100 [mongosMain] connection accepted from 172.28.0.163:54251 #2328 (415 connections now open) 2015-10-05T12:47:34.419+0100 [conn2328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.421+0100 [mongosMain] connection accepted from 172.28.0.163:54252 #2329 (416 connections now open) 2015-10-05T12:47:34.422+0100 [conn2329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.423+0100 [mongosMain] connection accepted from 172.28.0.163:54253 #2330 (417 connections now open) 2015-10-05T12:47:34.425+0100 [conn2330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.427+0100 [mongosMain] connection accepted from 172.28.0.163:54254 #2331 (418 connections now open) 2015-10-05T12:47:34.429+0100 [conn2331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.434+0100 [mongosMain] connection accepted from 172.28.0.163:54255 #2332 (419 connections now open) 2015-10-05T12:47:34.436+0100 [conn2332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.437+0100 [mongosMain] connection accepted from 172.28.0.163:54256 #2333 (420 connections now open) 2015-10-05T12:47:34.438+0100 [conn2333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.439+0100 [mongosMain] connection accepted from 172.28.0.163:54257 #2334 (421 connections now open) 2015-10-05T12:47:34.442+0100 [conn2334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.444+0100 [mongosMain] connection accepted from 172.28.0.163:54258 #2335 (422 connections now open) 2015-10-05T12:47:34.445+0100 [conn2335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.447+0100 [mongosMain] connection accepted from 172.28.0.163:54259 #2336 (423 connections now open) 2015-10-05T12:47:34.455+0100 [conn2336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.458+0100 [mongosMain] connection accepted from 172.28.0.163:54261 #2337 (424 connections now open) 2015-10-05T12:47:34.462+0100 [conn2337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.466+0100 [mongosMain] connection accepted from 172.28.0.163:54262 #2338 (425 connections now open) 2015-10-05T12:47:34.478+0100 [conn2338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.485+0100 [mongosMain] connection accepted from 172.28.0.163:54263 #2339 (426 connections now open) 2015-10-05T12:47:34.489+0100 [conn2339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.496+0100 [mongosMain] connection accepted from 172.28.0.163:54264 #2340 (427 connections now open) 2015-10-05T12:47:34.502+0100 [conn2340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.513+0100 [mongosMain] connection accepted from 172.28.0.163:54265 #2341 (428 connections now open) 2015-10-05T12:47:34.522+0100 [conn2341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.530+0100 [mongosMain] connection accepted from 172.28.0.163:54266 #2342 (429 connections now open) 2015-10-05T12:47:34.542+0100 [conn2342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.553+0100 [mongosMain] connection accepted from 172.28.0.163:54267 #2343 (430 connections now open) 2015-10-05T12:47:34.555+0100 [conn2343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.558+0100 [mongosMain] connection accepted from 172.28.0.163:54269 #2344 (431 connections now open) 2015-10-05T12:47:34.560+0100 [conn2344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.576+0100 [mongosMain] connection accepted from 172.28.0.163:54270 #2345 (432 connections now open) 2015-10-05T12:47:34.578+0100 [conn2345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.588+0100 [mongosMain] connection accepted from 172.28.0.163:54273 #2346 (433 connections now open) 2015-10-05T12:47:34.602+0100 [conn2346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.616+0100 [mongosMain] connection accepted from 172.28.0.163:54274 #2347 (434 connections now open) 2015-10-05T12:47:34.619+0100 [conn2347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.662+0100 [mongosMain] connection accepted from 172.28.0.163:54275 #2348 (435 connections now open) 2015-10-05T12:47:34.669+0100 [conn2348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.680+0100 [mongosMain] connection accepted from 172.28.0.163:54276 #2349 (436 connections now open) 2015-10-05T12:47:34.714+0100 [conn2349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.797+0100 [mongosMain] connection accepted from 172.28.0.163:54277 #2350 (437 connections now open) 2015-10-05T12:47:34.806+0100 [conn2350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.842+0100 [mongosMain] connection accepted from 172.28.0.163:54278 #2351 (438 connections now open) 2015-10-05T12:47:34.851+0100 [conn2351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.854+0100 [mongosMain] connection accepted from 172.28.0.163:54279 #2352 (439 connections now open) 2015-10-05T12:47:34.857+0100 [conn2352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.860+0100 [mongosMain] connection accepted from 172.28.0.163:54280 #2353 (440 connections now open) 2015-10-05T12:47:34.864+0100 [conn2353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.870+0100 [mongosMain] connection accepted from 172.28.0.163:54281 #2354 (441 connections now open) 2015-10-05T12:47:34.872+0100 [conn2354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.874+0100 [mongosMain] connection accepted from 172.28.0.163:54282 #2355 (442 connections now open) 2015-10-05T12:47:34.875+0100 [conn2355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.878+0100 [mongosMain] connection accepted from 172.28.0.163:54283 #2356 (443 connections now open) 2015-10-05T12:47:34.879+0100 [conn2356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.880+0100 [mongosMain] connection accepted from 172.28.0.163:54284 #2357 (444 connections now open) 2015-10-05T12:47:34.881+0100 [conn2357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.886+0100 [mongosMain] connection accepted from 172.28.0.163:54285 #2358 (445 connections now open) 2015-10-05T12:47:34.887+0100 [conn2358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.888+0100 [mongosMain] connection accepted from 172.28.0.163:54286 #2359 (446 connections now open) 2015-10-05T12:47:34.889+0100 [conn2359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.890+0100 [mongosMain] connection accepted from 172.28.0.163:54287 #2360 (447 connections now open) 2015-10-05T12:47:34.892+0100 [conn2360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.893+0100 [mongosMain] connection accepted from 172.28.0.163:54288 #2361 (448 connections now open) 2015-10-05T12:47:34.894+0100 [conn2361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.896+0100 [mongosMain] connection accepted from 172.28.0.163:54289 #2362 (449 connections now open) 2015-10-05T12:47:34.898+0100 [conn2362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.900+0100 [mongosMain] connection accepted from 172.28.0.163:54290 #2363 (450 connections now open) 2015-10-05T12:47:34.901+0100 [conn2363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.903+0100 [mongosMain] connection accepted from 172.28.0.163:54291 #2364 (451 connections now open) 2015-10-05T12:47:34.904+0100 [conn2364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:34.905+0100 [mongosMain] connection accepted from 172.28.0.163:54292 #2365 (452 connections now open) 2015-10-05T12:47:34.906+0100 [conn2365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:36.327+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:47:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:47:39.500+0100 [conn1446] end connection 172.28.0.164:52586 (451 connections now open) 2015-10-05T12:47:39.947+0100 [mongosMain] connection accepted from 127.0.0.1:54293 #2366 (452 connections now open) 2015-10-05T12:47:39.952+0100 [conn2366] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:47:39.953+0100 [conn2366] end connection 127.0.0.1:54293 (451 connections now open) 2015-10-05T12:47:43.398+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:47:43.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:47:50.723+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:47:50.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:47:57.663+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:47:57.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:48:03.801+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126370d67947988ef83eef') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045683676), why: "doing balance round", ts: ObjectId('5612637312deab02e299332d') } } gle1: { lastOp: Timestamp 1444045650000|6, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } gle2: { lastOp: Timestamp 1444045683000|6, connectionId: 39966, updatedExisting: true, n: 1, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } 2015-10-05T12:48:03.804+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:48:03.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:48:05.693+0100 [conn1894] end connection 172.28.0.164:54472 (450 connections now open) 2015-10-05T12:48:05.693+0100 [mongosMain] connection accepted from 172.28.0.164:56909 #2367 (451 connections now open) 2015-10-05T12:48:05.696+0100 [conn2367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:06.491+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:48:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:48:06.491+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:48:06.558+0100 [LockPinger] handled late remove of old distributed lock with ts 5612637312deab02e299332d 2015-10-05T12:48:08.164+0100 [conn1897] end connection 172.28.0.164:54489 (450 connections now open) 2015-10-05T12:48:09.971+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126377d67947988ef83f5f') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045689814), why: "doing balance round", ts: ObjectId('5612637912deab02e299338e') } } gle1: { lastOp: Timestamp 1444045650000|6, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } gle2: { lastOp: Timestamp 1444045689000|5, connectionId: 34850, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2015-10-05T12:48:09.974+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:48:09.974+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:48:15.757+0100 [conn1547] end connection 172.28.0.164:53417 (449 connections now open) 2015-10-05T12:48:15.759+0100 [mongosMain] connection accepted from 172.28.0.164:56913 #2368 (450 connections now open) 2015-10-05T12:48:15.762+0100 [conn2368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:16.507+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612637f12deab02e29933ec 2015-10-05T12:48:16.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:48:24.120+0100 [conn1679] end connection 172.28.0.163:50679 (449 connections now open) 2015-10-05T12:48:25.793+0100 [conn1899] end connection 172.28.0.164:54491 (448 connections now open) 2015-10-05T12:48:25.795+0100 [mongosMain] connection accepted from 172.28.0.164:56926 #2369 (449 connections now open) 2015-10-05T12:48:25.799+0100 [conn2369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:26.323+0100 [conn1901] end connection 172.28.0.164:54492 (448 connections now open) 2015-10-05T12:48:26.324+0100 [mongosMain] connection accepted from 172.28.0.164:56929 #2370 (449 connections now open) 2015-10-05T12:48:26.327+0100 [conn2370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:26.455+0100 [conn1898] end connection 172.28.0.164:54490 (448 connections now open) 2015-10-05T12:48:26.458+0100 [mongosMain] connection accepted from 172.28.0.164:56930 #2371 (449 connections now open) 2015-10-05T12:48:26.461+0100 [conn2371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:26.647+0100 [conn1896] end connection 172.28.0.164:54474 (448 connections now open) 2015-10-05T12:48:26.649+0100 [mongosMain] connection accepted from 172.28.0.164:56931 #2372 (449 connections now open) 2015-10-05T12:48:26.653+0100 [conn2372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:28.930+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612638c12deab02e29934c3 2015-10-05T12:48:28.955+0100 [mongosMain] connection accepted from 127.0.0.1:54346 #2373 (450 connections now open) 2015-10-05T12:48:28.958+0100 [conn2373] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:28.960+0100 [conn2373] end connection 127.0.0.1:54346 (449 connections now open) 2015-10-05T12:48:29.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:48:35.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612639312deab02e2993534 2015-10-05T12:48:35.514+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:48:36.845+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:48:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:48:36.845+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:48:36.982+0100 [LockPinger] handled late remove of old distributed lock with ts 5612637912deab02e299338e 2015-10-05T12:48:39.517+0100 [conn1443] end connection 172.28.0.164:52582 (448 connections now open) 2015-10-05T12:48:39.571+0100 [mongosMain] connection accepted from 127.0.0.1:54351 #2374 (449 connections now open) 2015-10-05T12:48:39.574+0100 [conn2374] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:48:39.575+0100 [conn2374] end connection 127.0.0.1:54351 (448 connections now open) 2015-10-05T12:48:40.104+0100 [conn1630] end connection 172.28.0.164:54185 (447 connections now open) 2015-10-05T12:48:40.104+0100 [conn2306] end connection 172.28.0.164:56694 (447 connections now open) 2015-10-05T12:48:40.105+0100 [conn2216] end connection 172.28.0.164:56101 (445 connections now open) 2015-10-05T12:48:40.105+0100 [conn1958] end connection 172.28.0.164:55200 (444 connections now open) 2015-10-05T12:48:40.105+0100 [conn1941] end connection 172.28.0.164:55031 (443 connections now open) 2015-10-05T12:48:40.105+0100 [conn2310] end connection 172.28.0.164:56770 (442 connections now open) 2015-10-05T12:48:40.105+0100 [conn1626] end connection 172.28.0.164:54139 (442 connections now open) 2015-10-05T12:48:40.105+0100 [conn1902] end connection 172.28.0.164:54497 (440 connections now open) 2015-10-05T12:48:40.105+0100 [conn2002] end connection 172.28.0.164:55482 (440 connections now open) 2015-10-05T12:48:40.106+0100 [conn2236] end connection 172.28.0.164:56511 (438 connections now open) 2015-10-05T12:48:40.106+0100 [conn1616] end connection 172.28.0.164:54030 (438 connections now open) 2015-10-05T12:48:40.106+0100 [conn1886] end connection 172.28.0.164:54358 (438 connections now open) 2015-10-05T12:48:41.732+0100 [conn1567] end connection 172.28.0.164:53626 (435 connections now open) 2015-10-05T12:48:41.733+0100 [conn2212] end connection 172.28.0.164:56030 (434 connections now open) 2015-10-05T12:48:41.733+0100 [conn1945] end connection 172.28.0.164:55085 (433 connections now open) 2015-10-05T12:48:41.733+0100 [conn1604] end connection 172.28.0.164:53866 (433 connections now open) 2015-10-05T12:48:41.733+0100 [conn2220] end connection 172.28.0.164:56186 (431 connections now open) 2015-10-05T12:48:41.733+0100 [conn1912] end connection 172.28.0.164:54666 (431 connections now open) 2015-10-05T12:48:41.734+0100 [conn1608] end connection 172.28.0.164:53925 (431 connections now open) 2015-10-05T12:48:41.734+0100 [conn1580] end connection 172.28.0.164:53726 (428 connections now open) 2015-10-05T12:48:41.734+0100 [conn1929] end connection 172.28.0.164:54854 (428 connections now open) 2015-10-05T12:48:41.734+0100 [conn1985] end connection 172.28.0.164:55391 (428 connections now open) 2015-10-05T12:48:41.734+0100 [conn1559] end connection 172.28.0.164:53542 (428 connections now open) 2015-10-05T12:48:41.734+0100 [conn1954] end connection 172.28.0.164:55145 (425 connections now open) 2015-10-05T12:48:41.734+0100 [conn1551] end connection 172.28.0.164:53458 (423 connections now open) 2015-10-05T12:48:41.734+0100 [conn2368] end connection 172.28.0.164:56913 (423 connections now open) 2015-10-05T12:48:41.735+0100 [conn2020] end connection 172.28.0.164:55571 (421 connections now open) 2015-10-05T12:48:41.735+0100 [conn1933] end connection 172.28.0.164:54910 (420 connections now open) 2015-10-05T12:48:41.735+0100 [conn1890] end connection 172.28.0.164:54410 (419 connections now open) 2015-10-05T12:48:41.736+0100 [conn2228] end connection 172.28.0.164:56344 (418 connections now open) 2015-10-05T12:48:41.736+0100 [conn2267] end connection 172.28.0.164:56578 (417 connections now open) 2015-10-05T12:48:41.736+0100 [conn2315] end connection 172.28.0.164:56844 (417 connections now open) 2015-10-05T12:48:41.736+0100 [conn1634] end connection 172.28.0.164:54242 (416 connections now open) 2015-10-05T12:48:41.736+0100 [conn1571] end connection 172.28.0.164:53668 (414 connections now open) 2015-10-05T12:48:41.737+0100 [conn2224] end connection 172.28.0.164:56270 (413 connections now open) 2015-10-05T12:48:41.737+0100 [conn2232] end connection 172.28.0.164:56435 (413 connections now open) 2015-10-05T12:48:41.737+0100 [conn1882] end connection 172.28.0.164:54302 (412 connections now open) 2015-10-05T12:48:41.737+0100 [conn1600] end connection 172.28.0.164:53815 (410 connections now open) 2015-10-05T12:48:41.737+0100 [conn1967] end connection 172.28.0.164:55334 (410 connections now open) 2015-10-05T12:48:41.737+0100 [conn1622] end connection 172.28.0.164:54079 (409 connections now open) 2015-10-05T12:48:41.737+0100 [conn1921] end connection 172.28.0.164:54733 (407 connections now open) 2015-10-05T12:48:41.738+0100 [conn1937] end connection 172.28.0.164:54972 (407 connections now open) 2015-10-05T12:48:41.737+0100 [conn2134] end connection 172.28.0.164:55806 (407 connections now open) 2015-10-05T12:48:41.738+0100 [conn1563] end connection 172.28.0.164:53583 (407 connections now open) 2015-10-05T12:48:41.737+0100 [conn1612] end connection 172.28.0.164:53979 (407 connections now open) 2015-10-05T12:48:41.738+0100 [conn1963] end connection 172.28.0.164:55284 (403 connections now open) 2015-10-05T12:48:41.738+0100 [conn1925] end connection 172.28.0.164:54793 (401 connections now open) 2015-10-05T12:48:41.738+0100 [conn2036] end connection 172.28.0.164:55649 (401 connections now open) 2015-10-05T12:48:41.738+0100 [conn1906] end connection 172.28.0.164:54592 (401 connections now open) 2015-10-05T12:48:41.738+0100 [conn1257] end connection 172.28.0.164:52171 (398 connections now open) 2015-10-05T12:48:41.738+0100 [conn1962] end connection 172.28.0.164:55271 (398 connections now open) 2015-10-05T12:48:41.898+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612639912deab02e29935ae 2015-10-05T12:48:42.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:48:54.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263a612deab02e299368e 2015-10-05T12:48:54.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:07.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263b212deab02e2993740 2015-10-05T12:49:07.145+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:07.555+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:49:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:49:19.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263bf12deab02e299380f 2015-10-05T12:49:19.714+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:24.137+0100 [conn1693] end connection 172.28.0.163:50693 (396 connections now open) 2015-10-05T12:49:25.868+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263c512deab02e299387b 2015-10-05T12:49:25.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:28.660+0100 [mongosMain] connection accepted from 127.0.0.1:54453 #2375 (397 connections now open) 2015-10-05T12:49:28.664+0100 [conn2375] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:28.666+0100 [conn2375] end connection 127.0.0.1:54453 (396 connections now open) 2015-10-05T12:49:32.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263cb12deab02e29938cc 2015-10-05T12:49:32.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:37.750+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:49:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:49:39.532+0100 [conn1452] end connection 172.28.0.164:52590 (395 connections now open) 2015-10-05T12:49:39.861+0100 [mongosMain] connection accepted from 127.0.0.1:54465 #2376 (396 connections now open) 2015-10-05T12:49:39.865+0100 [conn2376] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:39.865+0100 [conn2376] end connection 127.0.0.1:54465 (395 connections now open) 2015-10-05T12:49:44.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263d812deab02e2993963 2015-10-05T12:49:44.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:44.690+0100 [conn1911] end connection 172.28.0.164:54637 (394 connections now open) 2015-10-05T12:49:44.691+0100 [mongosMain] connection accepted from 172.28.0.164:57075 #2377 (395 connections now open) 2015-10-05T12:49:44.694+0100 [conn2377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:50.409+0100 [mongosMain] connection accepted from 172.28.0.164:57098 #2378 (396 connections now open) 2015-10-05T12:49:50.409+0100 [mongosMain] connection accepted from 172.28.0.164:57099 #2379 (397 connections now open) 2015-10-05T12:49:50.822+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263de12deab02e29939d6 2015-10-05T12:49:50.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:49:54.416+0100 [conn2378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.420+0100 [conn2379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.426+0100 [mongosMain] connection accepted from 172.28.0.164:57108 #2380 (398 connections now open) 2015-10-05T12:49:54.430+0100 [conn2380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.434+0100 [mongosMain] connection accepted from 172.28.0.164:57112 #2381 (399 connections now open) 2015-10-05T12:49:54.437+0100 [conn2381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.456+0100 [mongosMain] connection accepted from 172.28.0.164:57116 #2382 (400 connections now open) 2015-10-05T12:49:54.460+0100 [conn2382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.463+0100 [mongosMain] connection accepted from 172.28.0.164:57119 #2383 (401 connections now open) 2015-10-05T12:49:54.465+0100 [conn2383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.467+0100 [mongosMain] connection accepted from 172.28.0.164:57122 #2384 (402 connections now open) 2015-10-05T12:49:54.469+0100 [conn2384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.471+0100 [mongosMain] connection accepted from 172.28.0.164:57125 #2385 (403 connections now open) 2015-10-05T12:49:54.473+0100 [conn2385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.476+0100 [mongosMain] connection accepted from 172.28.0.164:57128 #2386 (404 connections now open) 2015-10-05T12:49:54.478+0100 [conn2386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.480+0100 [mongosMain] connection accepted from 172.28.0.164:57131 #2387 (405 connections now open) 2015-10-05T12:49:54.484+0100 [conn2387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.486+0100 [mongosMain] connection accepted from 172.28.0.164:57134 #2388 (406 connections now open) 2015-10-05T12:49:54.488+0100 [conn2388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.491+0100 [mongosMain] connection accepted from 172.28.0.164:57138 #2389 (407 connections now open) 2015-10-05T12:49:54.495+0100 [conn2389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.497+0100 [mongosMain] connection accepted from 172.28.0.164:57141 #2390 (408 connections now open) 2015-10-05T12:49:54.499+0100 [conn2390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.501+0100 [mongosMain] connection accepted from 172.28.0.164:57145 #2391 (409 connections now open) 2015-10-05T12:49:54.504+0100 [conn2391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.506+0100 [mongosMain] connection accepted from 172.28.0.164:57149 #2392 (410 connections now open) 2015-10-05T12:49:54.508+0100 [conn2392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.509+0100 [mongosMain] connection accepted from 172.28.0.164:57152 #2393 (411 connections now open) 2015-10-05T12:49:54.512+0100 [conn2393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.515+0100 [mongosMain] connection accepted from 172.28.0.164:57156 #2394 (412 connections now open) 2015-10-05T12:49:54.518+0100 [conn2394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.522+0100 [mongosMain] connection accepted from 172.28.0.164:57161 #2395 (413 connections now open) 2015-10-05T12:49:54.524+0100 [conn2395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.526+0100 [mongosMain] connection accepted from 172.28.0.164:57164 #2396 (414 connections now open) 2015-10-05T12:49:54.529+0100 [conn2396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.531+0100 [mongosMain] connection accepted from 172.28.0.164:57168 #2397 (415 connections now open) 2015-10-05T12:49:54.533+0100 [conn2397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.536+0100 [mongosMain] connection accepted from 172.28.0.164:57172 #2398 (416 connections now open) 2015-10-05T12:49:54.538+0100 [conn2398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.540+0100 [mongosMain] connection accepted from 172.28.0.164:57175 #2399 (417 connections now open) 2015-10-05T12:49:54.542+0100 [conn2399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.545+0100 [mongosMain] connection accepted from 172.28.0.164:57177 #2400 (418 connections now open) 2015-10-05T12:49:54.546+0100 [conn2400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.549+0100 [mongosMain] connection accepted from 172.28.0.164:57178 #2401 (419 connections now open) 2015-10-05T12:49:54.552+0100 [conn2401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.554+0100 [mongosMain] connection accepted from 172.28.0.164:57179 #2402 (420 connections now open) 2015-10-05T12:49:54.556+0100 [conn2402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.558+0100 [mongosMain] connection accepted from 172.28.0.164:57180 #2403 (421 connections now open) 2015-10-05T12:49:54.561+0100 [conn2403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.564+0100 [mongosMain] connection accepted from 172.28.0.164:57181 #2404 (422 connections now open) 2015-10-05T12:49:54.566+0100 [conn2404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.569+0100 [mongosMain] connection accepted from 172.28.0.164:57182 #2405 (423 connections now open) 2015-10-05T12:49:54.572+0100 [conn2405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.574+0100 [mongosMain] connection accepted from 172.28.0.164:57183 #2406 (424 connections now open) 2015-10-05T12:49:54.577+0100 [conn2406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.580+0100 [mongosMain] connection accepted from 172.28.0.164:57184 #2407 (425 connections now open) 2015-10-05T12:49:54.583+0100 [conn2407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.585+0100 [mongosMain] connection accepted from 172.28.0.164:57185 #2408 (426 connections now open) 2015-10-05T12:49:54.588+0100 [conn2408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.591+0100 [mongosMain] connection accepted from 172.28.0.164:57186 #2409 (427 connections now open) 2015-10-05T12:49:54.594+0100 [conn2409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.596+0100 [mongosMain] connection accepted from 172.28.0.164:57187 #2410 (428 connections now open) 2015-10-05T12:49:54.599+0100 [conn2410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.601+0100 [mongosMain] connection accepted from 172.28.0.164:57188 #2411 (429 connections now open) 2015-10-05T12:49:54.605+0100 [conn2411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.608+0100 [mongosMain] connection accepted from 172.28.0.164:57189 #2412 (430 connections now open) 2015-10-05T12:49:54.611+0100 [conn2412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.613+0100 [mongosMain] connection accepted from 172.28.0.164:57190 #2413 (431 connections now open) 2015-10-05T12:49:54.617+0100 [conn2413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.619+0100 [mongosMain] connection accepted from 172.28.0.164:57191 #2414 (432 connections now open) 2015-10-05T12:49:54.623+0100 [conn2414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.626+0100 [mongosMain] connection accepted from 172.28.0.164:57192 #2415 (433 connections now open) 2015-10-05T12:49:54.629+0100 [conn2415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.632+0100 [mongosMain] connection accepted from 172.28.0.164:57193 #2416 (434 connections now open) 2015-10-05T12:49:54.635+0100 [conn2416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.637+0100 [mongosMain] connection accepted from 172.28.0.164:57194 #2417 (435 connections now open) 2015-10-05T12:49:54.640+0100 [conn2417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.643+0100 [mongosMain] connection accepted from 172.28.0.164:57195 #2418 (436 connections now open) 2015-10-05T12:49:54.646+0100 [conn2418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.648+0100 [mongosMain] connection accepted from 172.28.0.164:57196 #2419 (437 connections now open) 2015-10-05T12:49:54.651+0100 [conn2419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.653+0100 [mongosMain] connection accepted from 172.28.0.164:57197 #2420 (438 connections now open) 2015-10-05T12:49:54.656+0100 [conn2420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.659+0100 [mongosMain] connection accepted from 172.28.0.164:57198 #2421 (439 connections now open) 2015-10-05T12:49:54.661+0100 [conn2421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.664+0100 [mongosMain] connection accepted from 172.28.0.164:57199 #2422 (440 connections now open) 2015-10-05T12:49:54.666+0100 [conn2422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.669+0100 [mongosMain] connection accepted from 172.28.0.164:57200 #2423 (441 connections now open) 2015-10-05T12:49:54.671+0100 [conn2423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.673+0100 [mongosMain] connection accepted from 172.28.0.164:57201 #2424 (442 connections now open) 2015-10-05T12:49:54.676+0100 [conn2424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.679+0100 [mongosMain] connection accepted from 172.28.0.164:57202 #2425 (443 connections now open) 2015-10-05T12:49:54.682+0100 [conn2425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.685+0100 [mongosMain] connection accepted from 172.28.0.164:57203 #2426 (444 connections now open) 2015-10-05T12:49:54.687+0100 [conn2426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.689+0100 [mongosMain] connection accepted from 172.28.0.164:57204 #2427 (445 connections now open) 2015-10-05T12:49:54.692+0100 [conn2427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:54.696+0100 [mongosMain] connection accepted from 172.28.0.164:57205 #2428 (446 connections now open) 2015-10-05T12:49:54.700+0100 [conn2428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:57.006+0100 [conn1910] end connection 172.28.0.164:54636 (445 connections now open) 2015-10-05T12:49:57.008+0100 [mongosMain] connection accepted from 172.28.0.164:57211 #2429 (446 connections now open) 2015-10-05T12:49:57.012+0100 [conn2429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:49:57.352+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:49:57.352+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:50:03.879+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561263e526fd57ee99392b8d') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045803523), why: "doing balance round", ts: ObjectId('561263eb12deab02e2993a69') } } gle1: { lastOp: Timestamp 1444045790000|17, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } gle2: { lastOp: Timestamp 1444045803000|4, connectionId: 34850, updatedExisting: true, n: 1, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2015-10-05T12:50:03.885+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1444039191:41' 2015-10-05T12:50:04.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263eb12deab02e2993a69 2015-10-05T12:50:04.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:07.888+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:50:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:50:10.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263f212deab02e2993ae8 2015-10-05T12:50:10.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:17.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263f912deab02e2993b3f 2015-10-05T12:50:17.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:23.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561263ff12deab02e2993b95 2015-10-05T12:50:23.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:24.152+0100 [conn1683] end connection 172.28.0.163:50683 (445 connections now open) 2015-10-05T12:50:28.405+0100 [mongosMain] connection accepted from 127.0.0.1:54532 #2430 (446 connections now open) 2015-10-05T12:50:28.408+0100 [conn2430] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:50:28.409+0100 [conn2430] end connection 127.0.0.1:54532 (445 connections now open) 2015-10-05T12:50:30.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612640612deab02e2993bff 2015-10-05T12:50:30.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:37.733+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:50:37.733+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:50:38.255+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:50:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:50:39.300+0100 [mongosMain] connection accepted from 127.0.0.1:54536 #2431 (446 connections now open) 2015-10-05T12:50:39.303+0100 [conn2431] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:50:39.304+0100 [conn2431] end connection 127.0.0.1:54536 (445 connections now open) 2015-10-05T12:50:39.548+0100 [conn1445] end connection 172.28.0.164:52584 (444 connections now open) 2015-10-05T12:50:40.883+0100 [conn1918] end connection 172.28.0.164:54703 (443 connections now open) 2015-10-05T12:50:40.885+0100 [mongosMain] connection accepted from 172.28.0.164:57275 #2432 (444 connections now open) 2015-10-05T12:50:40.888+0100 [conn2432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:50:42.721+0100 [conn1916] end connection 172.28.0.164:54701 (443 connections now open) 2015-10-05T12:50:42.723+0100 [mongosMain] connection accepted from 172.28.0.164:57277 #2433 (444 connections now open) 2015-10-05T12:50:42.726+0100 [conn2433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:50:50.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612641912deab02e2993d1f 2015-10-05T12:50:50.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:50:56.920+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:50:56.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:50:59.700+0100 [conn1919] end connection 172.28.0.164:54704 (443 connections now open) 2015-10-05T12:50:59.702+0100 [mongosMain] connection accepted from 172.28.0.164:57299 #2434 (444 connections now open) 2015-10-05T12:50:59.706+0100 [conn2434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:00.572+0100 [conn2191] end connection 172.28.0.164:55899 (443 connections now open) 2015-10-05T12:51:00.572+0100 [conn2181] end connection 172.28.0.164:55870 (443 connections now open) 2015-10-05T12:51:00.572+0100 [conn2006] end connection 172.28.0.164:55519 (443 connections now open) 2015-10-05T12:51:00.573+0100 [mongosMain] connection accepted from 172.28.0.164:57303 #2435 (442 connections now open) 2015-10-05T12:51:00.573+0100 [mongosMain] connection accepted from 172.28.0.164:57302 #2436 (443 connections now open) 2015-10-05T12:51:00.573+0100 [mongosMain] connection accepted from 172.28.0.164:57304 #2437 (444 connections now open) 2015-10-05T12:51:00.575+0100 [conn2436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:00.576+0100 [conn2435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:00.576+0100 [conn2437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:00.619+0100 [conn2149] end connection 172.28.0.164:55837 (443 connections now open) 2015-10-05T12:51:00.754+0100 [mongosMain] connection accepted from 172.28.0.164:57305 #2438 (444 connections now open) 2015-10-05T12:51:00.759+0100 [conn2438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:03.348+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:51:03.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:51:08.417+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:51:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:51:15.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612643312deab02e2993ebe 2015-10-05T12:51:15.775+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:22.002+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612643912deab02e2993f12 2015-10-05T12:51:22.138+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:24.169+0100 [conn1673] end connection 172.28.0.163:50672 (443 connections now open) 2015-10-05T12:51:28.382+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612644012deab02e2993f52 2015-10-05T12:51:28.484+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:28.601+0100 [mongosMain] connection accepted from 127.0.0.1:54624 #2439 (444 connections now open) 2015-10-05T12:51:28.604+0100 [conn2439] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:28.606+0100 [conn2439] end connection 127.0.0.1:54624 (443 connections now open) 2015-10-05T12:51:34.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612644612deab02e2993f9e 2015-10-05T12:51:34.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:38.554+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:51:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:51:39.565+0100 [conn1451] end connection 172.28.0.164:52592 (442 connections now open) 2015-10-05T12:51:39.891+0100 [mongosMain] connection accepted from 127.0.0.1:54647 #2440 (443 connections now open) 2015-10-05T12:51:39.893+0100 [conn2440] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:51:39.894+0100 [conn2440] end connection 127.0.0.1:54647 (442 connections now open) 2015-10-05T12:51:40.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612644c12deab02e2993fdf 2015-10-05T12:51:41.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:47.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612645312deab02e299402a 2015-10-05T12:51:47.340+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:51:53.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612645912deab02e2994067 2015-10-05T12:51:53.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:52:08.818+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:52:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:52:11.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612646b12deab02e299413d 2015-10-05T12:52:11.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:52:24.185+0100 [conn1699] end connection 172.28.0.163:50699 (441 connections now open) 2015-10-05T12:52:28.569+0100 [mongosMain] connection accepted from 127.0.0.1:54713 #2441 (442 connections now open) 2015-10-05T12:52:28.572+0100 [conn2441] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:52:28.573+0100 [conn2441] end connection 127.0.0.1:54713 (441 connections now open) 2015-10-05T12:52:30.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612647e12deab02e29941ef 2015-10-05T12:52:30.456+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:52:39.103+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:52:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:52:39.581+0100 [conn1450] end connection 172.28.0.164:52591 (440 connections now open) 2015-10-05T12:52:39.862+0100 [mongosMain] connection accepted from 127.0.0.1:54720 #2442 (441 connections now open) 2015-10-05T12:52:39.864+0100 [conn2442] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:52:39.865+0100 [conn2442] end connection 127.0.0.1:54720 (440 connections now open) 2015-10-05T12:52:49.416+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612648f38482111da12e25a') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444045968905), why: "doing balance round", ts: ObjectId('5612649012deab02e2994264') } } gle1: { lastOp: Timestamp 1444045950000|9, connectionId: 36388, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } gle2: { lastOp: Timestamp 1444045969000|2, connectionId: 34850, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } 2015-10-05T12:52:49.419+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T12:52:49.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:52:55.667+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:52:55.667+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:52:57.761+0100 [conn2009] end connection 172.28.0.164:55537 (439 connections now open) 2015-10-05T12:52:58.203+0100 [mongosMain] connection accepted from 172.28.0.164:57464 #2443 (440 connections now open) 2015-10-05T12:52:58.206+0100 [conn2443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:52:58.740+0100 [conn2014] end connection 172.28.0.164:55542 (439 connections now open) 2015-10-05T12:52:58.766+0100 [mongosMain] connection accepted from 172.28.0.164:57465 #2444 (440 connections now open) 2015-10-05T12:52:58.788+0100 [conn2444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:53:01.806+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:53:01.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:53:07.909+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:53:07.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:53:09.240+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:53:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:53:09.240+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T12:53:09.308+0100 [LockPinger] handled late remove of old distributed lock with ts 5612649012deab02e2994264 2015-10-05T12:53:14.088+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:53:14.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:53:20.235+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:53:20.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:53:24.200+0100 [conn1697] end connection 172.28.0.163:50697 (439 connections now open) 2015-10-05T12:53:28.643+0100 [mongosMain] connection accepted from 127.0.0.1:54797 #2445 (440 connections now open) 2015-10-05T12:53:28.647+0100 [conn2445] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:53:28.648+0100 [conn2445] end connection 127.0.0.1:54797 (439 connections now open) 2015-10-05T12:53:32.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264bc12deab02e29943cd 2015-10-05T12:53:32.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:53:39.566+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:53:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:53:39.612+0100 [conn1417] end connection 172.28.0.164:52558 (438 connections now open) 2015-10-05T12:53:39.887+0100 [mongosMain] connection accepted from 127.0.0.1:54804 #2446 (439 connections now open) 2015-10-05T12:53:39.889+0100 [conn2446] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:53:39.889+0100 [conn2446] end connection 127.0.0.1:54804 (438 connections now open) 2015-10-05T12:53:50.940+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264ce12deab02e2994444 2015-10-05T12:53:51.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:04.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264db12deab02e2994499 2015-10-05T12:54:04.746+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:09.832+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:54:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:54:17.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264e812deab02e29944fe 2015-10-05T12:54:17.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:24.216+0100 [conn1869] end connection 172.28.0.163:50913 (437 connections now open) 2015-10-05T12:54:28.243+0100 [mongosMain] connection accepted from 127.0.0.1:54893 #2447 (438 connections now open) 2015-10-05T12:54:28.245+0100 [conn2447] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:54:28.247+0100 [conn2447] end connection 127.0.0.1:54893 (437 connections now open) 2015-10-05T12:54:29.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264f512deab02e2994558 2015-10-05T12:54:29.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:35.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561264fb12deab02e2994584 2015-10-05T12:54:35.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:39.481+0100 [mongosMain] connection accepted from 127.0.0.1:54897 #2448 (438 connections now open) 2015-10-05T12:54:39.483+0100 [conn2448] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:54:39.484+0100 [conn2448] end connection 127.0.0.1:54897 (437 connections now open) 2015-10-05T12:54:39.629+0100 [conn1454] end connection 172.28.0.164:52594 (436 connections now open) 2015-10-05T12:54:40.000+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:54:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:54:41.983+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612650112deab02e29945bd 2015-10-05T12:54:42.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:48.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612650812deab02e29945f1 2015-10-05T12:54:48.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:54:55.306+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:54:55.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:55:01.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612651512deab02e299463f 2015-10-05T12:55:01.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:55:07.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612651b12deab02e2994684 2015-10-05T12:55:07.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:55:10.260+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:55:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:55:20.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612652712deab02e29946d8 2015-10-05T12:55:20.397+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:55:24.233+0100 [conn1749] end connection 172.28.0.163:50751 (435 connections now open) 2015-10-05T12:55:28.495+0100 [mongosMain] connection accepted from 127.0.0.1:54954 #2449 (436 connections now open) 2015-10-05T12:55:28.498+0100 [conn2449] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:55:28.499+0100 [conn2449] end connection 127.0.0.1:54954 (435 connections now open) 2015-10-05T12:55:32.556+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:55:32.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:55:38.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612653a12deab02e299475f 2015-10-05T12:55:38.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:55:39.598+0100 [mongosMain] connection accepted from 127.0.0.1:54967 #2450 (436 connections now open) 2015-10-05T12:55:39.601+0100 [conn2450] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:55:39.602+0100 [conn2450] end connection 127.0.0.1:54967 (435 connections now open) 2015-10-05T12:55:39.645+0100 [conn1459] end connection 172.28.0.164:52600 (434 connections now open) 2015-10-05T12:55:40.541+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:55:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:55:51.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612654612deab02e29947a4 2015-10-05T12:55:51.694+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:56:10.594+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:56:10.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:56:10.765+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:56:10 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:56:22.744+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:56:22.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:56:24.248+0100 [conn1858] end connection 172.28.0.163:50896 (433 connections now open) 2015-10-05T12:56:28.402+0100 [mongosMain] connection accepted from 127.0.0.1:55039 #2451 (434 connections now open) 2015-10-05T12:56:28.404+0100 [conn2451] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:56:28.405+0100 [conn2451] end connection 127.0.0.1:55039 (433 connections now open) 2015-10-05T12:56:28.886+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:56:28.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:56:35.074+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612657212deab02e29948fc 2015-10-05T12:56:35.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:56:39.514+0100 [mongosMain] connection accepted from 127.0.0.1:55048 #2452 (434 connections now open) 2015-10-05T12:56:39.517+0100 [conn2452] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:56:39.517+0100 [conn2452] end connection 127.0.0.1:55048 (433 connections now open) 2015-10-05T12:56:39.661+0100 [conn1464] end connection 172.28.0.164:52599 (432 connections now open) 2015-10-05T12:56:41.043+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:56:40 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:56:47.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612657f12deab02e299497a 2015-10-05T12:56:47.634+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:56:59.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612658b12deab02e29949f2 2015-10-05T12:56:59.897+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:05.977+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T12:57:05.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T12:57:11.335+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:57:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:57:12.200+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612659712deab02e2994a9a 2015-10-05T12:57:12.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:24.265+0100 [conn1711] end connection 172.28.0.163:50716 (431 connections now open) 2015-10-05T12:57:24.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265a412deab02e2994b04 2015-10-05T12:57:24.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:28.204+0100 [mongosMain] connection accepted from 127.0.0.1:55121 #2453 (432 connections now open) 2015-10-05T12:57:28.207+0100 [conn2453] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:28.208+0100 [conn2453] end connection 127.0.0.1:55121 (431 connections now open) 2015-10-05T12:57:35.061+0100 [conn2313] end connection 172.28.0.163:54102 (430 connections now open) 2015-10-05T12:57:35.063+0100 [mongosMain] connection accepted from 172.28.0.163:55124 #2454 (431 connections now open) 2015-10-05T12:57:35.065+0100 [conn2454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:36.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265b012deab02e2994b88 2015-10-05T12:57:36.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:39.497+0100 [mongosMain] connection accepted from 127.0.0.1:55129 #2455 (432 connections now open) 2015-10-05T12:57:39.499+0100 [conn2455] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:39.500+0100 [conn2455] end connection 127.0.0.1:55129 (431 connections now open) 2015-10-05T12:57:39.678+0100 [conn1457] end connection 172.28.0.164:52596 (430 connections now open) 2015-10-05T12:57:41.565+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:57:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:57:43.135+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265b612deab02e2994bc9 2015-10-05T12:57:43.203+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:49.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265bd12deab02e2994c0b 2015-10-05T12:57:49.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:55.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265c312deab02e2994c54 2015-10-05T12:57:55.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:57:58.998+0100 [conn2168] end connection 172.28.0.164:55856 (429 connections now open) 2015-10-05T12:57:59.000+0100 [mongosMain] connection accepted from 172.28.0.164:57761 #2456 (430 connections now open) 2015-10-05T12:57:59.002+0100 [conn2456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:59.050+0100 [conn2190] end connection 172.28.0.164:55898 (429 connections now open) 2015-10-05T12:57:59.052+0100 [mongosMain] connection accepted from 172.28.0.164:57762 #2457 (430 connections now open) 2015-10-05T12:57:59.054+0100 [conn2457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:59.073+0100 [conn2169] end connection 172.28.0.164:55857 (429 connections now open) 2015-10-05T12:57:59.074+0100 [mongosMain] connection accepted from 172.28.0.164:57763 #2458 (430 connections now open) 2015-10-05T12:57:59.077+0100 [conn2458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:59.087+0100 [conn2136] end connection 172.28.0.164:55813 (429 connections now open) 2015-10-05T12:57:59.103+0100 [conn1917] end connection 172.28.0.164:54702 (428 connections now open) 2015-10-05T12:57:59.260+0100 [mongosMain] connection accepted from 172.28.0.164:57765 #2459 (429 connections now open) 2015-10-05T12:57:59.262+0100 [mongosMain] connection accepted from 172.28.0.164:57764 #2460 (430 connections now open) 2015-10-05T12:57:59.271+0100 [conn2460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:57:59.272+0100 [conn2459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:58:02.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265c912deab02e2994c9a 2015-10-05T12:58:02.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:08.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265d012deab02e2994cf4 2015-10-05T12:58:08.525+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:11.700+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:58:11 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:58:14.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265d612deab02e2994d44 2015-10-05T12:58:14.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:21.091+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265dc12deab02e2994d9f 2015-10-05T12:58:21.159+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:24.282+0100 [conn1769] end connection 172.28.0.163:50771 (429 connections now open) 2015-10-05T12:58:27.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265e312deab02e2994ddd 2015-10-05T12:58:27.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:29.138+0100 [mongosMain] connection accepted from 127.0.0.1:55187 #2461 (430 connections now open) 2015-10-05T12:58:29.141+0100 [conn2461] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:58:29.142+0100 [conn2461] end connection 127.0.0.1:55187 (429 connections now open) 2015-10-05T12:58:33.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265e912deab02e2994e31 2015-10-05T12:58:34.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:35.076+0100 [conn2317] end connection 172.28.0.163:54134 (428 connections now open) 2015-10-05T12:58:35.077+0100 [mongosMain] connection accepted from 172.28.0.163:55189 #2462 (429 connections now open) 2015-10-05T12:58:35.079+0100 [conn2462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:58:39.285+0100 [mongosMain] connection accepted from 127.0.0.1:55190 #2463 (430 connections now open) 2015-10-05T12:58:39.289+0100 [conn2463] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:58:39.289+0100 [conn2463] end connection 127.0.0.1:55190 (429 connections now open) 2015-10-05T12:58:39.694+0100 [conn1468] end connection 172.28.0.164:52608 (428 connections now open) 2015-10-05T12:58:41.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265f012deab02e2994e9b 2015-10-05T12:58:41.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:42.673+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:58:41 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:58:47.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265f712deab02e2994f1b 2015-10-05T12:58:48.102+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:58:54.402+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561265fe12deab02e2994f83 2015-10-05T12:58:54.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:00.857+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612660412deab02e2994fe0 2015-10-05T12:59:00.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:07.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612660b12deab02e299504f 2015-10-05T12:59:07.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:12.912+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:59:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:59:13.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612661112deab02e29950c6 2015-10-05T12:59:13.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:24.298+0100 [conn1851] end connection 172.28.0.163:50883 (427 connections now open) 2015-10-05T12:59:26.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612661d12deab02e2995197 2015-10-05T12:59:26.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:29.125+0100 [mongosMain] connection accepted from 127.0.0.1:55262 #2464 (428 connections now open) 2015-10-05T12:59:29.128+0100 [conn2464] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:29.129+0100 [conn2464] end connection 127.0.0.1:55262 (427 connections now open) 2015-10-05T12:59:35.093+0100 [conn2318] end connection 172.28.0.163:54142 (426 connections now open) 2015-10-05T12:59:35.094+0100 [mongosMain] connection accepted from 172.28.0.163:55266 #2465 (427 connections now open) 2015-10-05T12:59:35.096+0100 [conn2465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:38.408+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612662a12deab02e2995263 2015-10-05T12:59:38.543+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:39.710+0100 [conn1462] end connection 172.28.0.164:52602 (426 connections now open) 2015-10-05T12:59:39.923+0100 [mongosMain] connection accepted from 127.0.0.1:55267 #2466 (427 connections now open) 2015-10-05T12:59:39.925+0100 [conn2466] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:39.926+0100 [conn2466] end connection 127.0.0.1:55267 (426 connections now open) 2015-10-05T12:59:43.224+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 12:59:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T12:59:51.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612663612deab02e299530a 2015-10-05T12:59:51.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T12:59:54.859+0100 [conn2378] end connection 172.28.0.164:57098 (425 connections now open) 2015-10-05T12:59:54.860+0100 [mongosMain] connection accepted from 172.28.0.164:57885 #2467 (426 connections now open) 2015-10-05T12:59:54.863+0100 [conn2467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.017+0100 [conn2148] end connection 172.28.0.164:55836 (425 connections now open) 2015-10-05T12:59:56.018+0100 [mongosMain] connection accepted from 172.28.0.164:57886 #2468 (426 connections now open) 2015-10-05T12:59:56.021+0100 [conn2468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.025+0100 [conn1900] end connection 172.28.0.164:54493 (425 connections now open) 2015-10-05T12:59:56.026+0100 [mongosMain] connection accepted from 172.28.0.164:57887 #2469 (426 connections now open) 2015-10-05T12:59:56.028+0100 [conn2167] end connection 172.28.0.164:55855 (425 connections now open) 2015-10-05T12:59:56.029+0100 [mongosMain] connection accepted from 172.28.0.164:57888 #2470 (426 connections now open) 2015-10-05T12:59:56.029+0100 [conn2469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.031+0100 [conn2470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.040+0100 [conn2150] end connection 172.28.0.164:55838 (425 connections now open) 2015-10-05T12:59:56.041+0100 [mongosMain] connection accepted from 172.28.0.164:57889 #2471 (426 connections now open) 2015-10-05T12:59:56.043+0100 [conn2471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.046+0100 [conn2044] end connection 172.28.0.164:55670 (425 connections now open) 2015-10-05T12:59:56.047+0100 [mongosMain] connection accepted from 172.28.0.164:57890 #2472 (426 connections now open) 2015-10-05T12:59:56.050+0100 [conn2472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.070+0100 [conn2127] end connection 172.28.0.164:55747 (425 connections now open) 2015-10-05T12:59:56.071+0100 [mongosMain] connection accepted from 172.28.0.164:57891 #2473 (426 connections now open) 2015-10-05T12:59:56.074+0100 [conn2011] end connection 172.28.0.164:55539 (425 connections now open) 2015-10-05T12:59:56.074+0100 [conn2473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.076+0100 [mongosMain] connection accepted from 172.28.0.164:57892 #2474 (426 connections now open) 2015-10-05T12:59:56.078+0100 [conn2015] end connection 172.28.0.164:55543 (425 connections now open) 2015-10-05T12:59:56.079+0100 [conn2474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.079+0100 [mongosMain] connection accepted from 172.28.0.164:57893 #2475 (426 connections now open) 2015-10-05T12:59:56.081+0100 [conn2475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.087+0100 [conn2013] end connection 172.28.0.164:55541 (425 connections now open) 2015-10-05T12:59:56.089+0100 [mongosMain] connection accepted from 172.28.0.164:57894 #2476 (426 connections now open) 2015-10-05T12:59:56.097+0100 [conn2038] end connection 172.28.0.164:55651 (425 connections now open) 2015-10-05T12:59:56.098+0100 [conn2476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.098+0100 [mongosMain] connection accepted from 172.28.0.164:57895 #2477 (426 connections now open) 2015-10-05T12:59:56.101+0100 [conn2477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.126+0100 [conn2146] end connection 172.28.0.164:55833 (425 connections now open) 2015-10-05T12:59:56.130+0100 [conn1999] end connection 172.28.0.164:55459 (424 connections now open) 2015-10-05T12:59:56.134+0100 [mongosMain] connection accepted from 172.28.0.164:57896 #2478 (425 connections now open) 2015-10-05T12:59:56.134+0100 [mongosMain] connection accepted from 172.28.0.164:57897 #2479 (426 connections now open) 2015-10-05T12:59:56.137+0100 [conn2478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.138+0100 [conn2479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:56.139+0100 [conn2147] end connection 172.28.0.164:55835 (425 connections now open) 2015-10-05T12:59:56.210+0100 [mongosMain] connection accepted from 172.28.0.164:57898 #2480 (426 connections now open) 2015-10-05T12:59:56.213+0100 [conn2480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.264+0100 [conn2152] end connection 172.28.0.164:55840 (425 connections now open) 2015-10-05T12:59:58.266+0100 [mongosMain] connection accepted from 172.28.0.164:57899 #2481 (426 connections now open) 2015-10-05T12:59:58.268+0100 [conn2012] end connection 172.28.0.164:55540 (425 connections now open) 2015-10-05T12:59:58.269+0100 [conn2135] end connection 172.28.0.164:55809 (424 connections now open) 2015-10-05T12:59:58.270+0100 [conn2481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.270+0100 [mongosMain] connection accepted from 172.28.0.164:57900 #2482 (425 connections now open) 2015-10-05T12:59:58.270+0100 [conn1466] end connection 172.28.0.164:52606 (424 connections now open) 2015-10-05T12:59:58.271+0100 [mongosMain] connection accepted from 172.28.0.164:57901 #2483 (425 connections now open) 2015-10-05T12:59:58.271+0100 [conn1461] end connection 172.28.0.164:52603 (424 connections now open) 2015-10-05T12:59:58.272+0100 [mongosMain] connection accepted from 172.28.0.164:57902 #2484 (425 connections now open) 2015-10-05T12:59:58.273+0100 [conn1469] end connection 172.28.0.164:52609 (424 connections now open) 2015-10-05T12:59:58.273+0100 [mongosMain] connection accepted from 172.28.0.164:57903 #2485 (426 connections now open) 2015-10-05T12:59:58.273+0100 [conn2482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.274+0100 [conn2483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.274+0100 [mongosMain] connection accepted from 172.28.0.164:57904 #2486 (426 connections now open) 2015-10-05T12:59:58.275+0100 [conn2484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.276+0100 [conn2485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.278+0100 [conn2486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.280+0100 [conn1475] end connection 172.28.0.164:52614 (425 connections now open) 2015-10-05T12:59:58.281+0100 [mongosMain] connection accepted from 172.28.0.164:57905 #2487 (426 connections now open) 2015-10-05T12:59:58.282+0100 [mongosMain] connection accepted from 172.28.0.164:57906 #2488 (427 connections now open) 2015-10-05T12:59:58.282+0100 [mongosMain] connection accepted from 172.28.0.164:57907 #2489 (428 connections now open) 2015-10-05T12:59:58.284+0100 [conn2488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.284+0100 [conn2487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.285+0100 [conn2489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.286+0100 [mongosMain] connection accepted from 172.28.0.164:57908 #2490 (429 connections now open) 2015-10-05T12:59:58.290+0100 [conn2490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.310+0100 [mongosMain] connection accepted from 172.28.0.164:57909 #2491 (430 connections now open) 2015-10-05T12:59:58.313+0100 [conn2491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.314+0100 [mongosMain] connection accepted from 172.28.0.164:57910 #2492 (431 connections now open) 2015-10-05T12:59:58.317+0100 [conn2492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.320+0100 [mongosMain] connection accepted from 172.28.0.164:57911 #2493 (432 connections now open) 2015-10-05T12:59:58.323+0100 [conn2493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T12:59:58.475+0100 [mongosMain] connection accepted from 172.28.0.164:57912 #2494 (433 connections now open) 2015-10-05T12:59:58.485+0100 [conn2494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:00:03.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612664312deab02e29953cf 2015-10-05T13:00:03.645+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:13.502+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:00:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:00:16.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612664f12deab02e2995690 2015-10-05T13:00:16.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:22.843+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612665612deab02e2995811 2015-10-05T13:00:22.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:24.315+0100 [conn1844] end connection 172.28.0.163:50877 (432 connections now open) 2015-10-05T13:00:28.416+0100 [mongosMain] connection accepted from 127.0.0.1:55338 #2495 (433 connections now open) 2015-10-05T13:00:28.419+0100 [conn2495] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:00:28.420+0100 [conn2495] end connection 127.0.0.1:55338 (432 connections now open) 2015-10-05T13:00:29.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612665c12deab02e29959f6 2015-10-05T13:00:29.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:35.110+0100 [conn2319] end connection 172.28.0.163:54221 (431 connections now open) 2015-10-05T13:00:35.111+0100 [mongosMain] connection accepted from 172.28.0.163:55341 #2496 (432 connections now open) 2015-10-05T13:00:35.113+0100 [conn2496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:00:35.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612666312deab02e2995ba3 2015-10-05T13:00:36.022+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:40.037+0100 [mongosMain] connection accepted from 127.0.0.1:55342 #2497 (433 connections now open) 2015-10-05T13:00:40.040+0100 [conn2497] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:00:40.040+0100 [conn2497] end connection 127.0.0.1:55342 (432 connections now open) 2015-10-05T13:00:42.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612666a12deab02e2995cf0 2015-10-05T13:00:42.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:43.976+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:00:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:00:48.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612667012deab02e2995e93 2015-10-05T13:00:48.862+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:00:54.875+0100 [conn2380] end connection 172.28.0.164:57108 (431 connections now open) 2015-10-05T13:00:54.879+0100 [mongosMain] connection accepted from 172.28.0.164:58044 #2498 (432 connections now open) 2015-10-05T13:00:54.881+0100 [conn2498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:00:55.137+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612667612deab02e2996037 2015-10-05T13:00:55.307+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:01.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612667d12deab02e2996152 2015-10-05T13:01:01.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:07.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612668312deab02e29962c4 2015-10-05T13:01:08.052+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:15.456+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:01:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:01:15.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612668a12deab02e299649d 2015-10-05T13:01:15.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:19.848+0100 [conn1981] end connection 172.28.0.163:52328 (431 connections now open) 2015-10-05T13:01:19.849+0100 [conn2060] end connection 172.28.0.163:52715 (430 connections now open) 2015-10-05T13:01:19.849+0100 [conn1953] end connection 172.28.0.163:52016 (430 connections now open) 2015-10-05T13:01:19.850+0100 [conn2023] end connection 172.28.0.163:52575 (428 connections now open) 2015-10-05T13:01:19.850+0100 [conn2296] end connection 172.28.0.163:53831 (427 connections now open) 2015-10-05T13:01:19.850+0100 [conn2202] end connection 172.28.0.163:52944 (426 connections now open) 2015-10-05T13:01:19.850+0100 [conn2211] end connection 172.28.0.163:52964 (425 connections now open) 2015-10-05T13:01:19.850+0100 [conn1823] end connection 172.28.0.163:50826 (425 connections now open) 2015-10-05T13:01:19.850+0100 [conn2245] end connection 172.28.0.163:53628 (424 connections now open) 2015-10-05T13:01:19.851+0100 [conn2291] end connection 172.28.0.163:53824 (422 connections now open) 2015-10-05T13:01:19.851+0100 [conn2239] end connection 172.28.0.163:53622 (421 connections now open) 2015-10-05T13:01:19.851+0100 [conn2205] end connection 172.28.0.163:52948 (420 connections now open) 2015-10-05T13:01:19.851+0100 [conn2302] end connection 172.28.0.163:53860 (420 connections now open) 2015-10-05T13:01:19.851+0100 [conn2283] end connection 172.28.0.163:53813 (419 connections now open) 2015-10-05T13:01:19.851+0100 [conn2289] end connection 172.28.0.163:53822 (417 connections now open) 2015-10-05T13:01:19.851+0100 [conn2266] end connection 172.28.0.163:53739 (416 connections now open) 2015-10-05T13:01:19.852+0100 [conn2110] end connection 172.28.0.163:52780 (415 connections now open) 2015-10-05T13:01:19.852+0100 [conn2029] end connection 172.28.0.163:52587 (414 connections now open) 2015-10-05T13:01:19.852+0100 [conn2264] end connection 172.28.0.163:53694 (413 connections now open) 2015-10-05T13:01:19.852+0100 [conn2080] end connection 172.28.0.163:52750 (412 connections now open) 2015-10-05T13:01:19.852+0100 [conn2196] end connection 172.28.0.163:52930 (411 connections now open) 2015-10-05T13:01:19.853+0100 [conn2025] end connection 172.28.0.163:52579 (410 connections now open) 2015-10-05T13:01:19.853+0100 [conn2286] end connection 172.28.0.163:53817 (410 connections now open) 2015-10-05T13:01:19.853+0100 [conn2285] end connection 172.28.0.163:53815 (408 connections now open) 2015-10-05T13:01:19.853+0100 [conn2258] end connection 172.28.0.163:53651 (408 connections now open) 2015-10-05T13:01:19.853+0100 [conn2074] end connection 172.28.0.163:52739 (408 connections now open) 2015-10-05T13:01:19.854+0100 [conn2207] end connection 172.28.0.163:52954 (405 connections now open) 2015-10-05T13:01:19.854+0100 [conn2101] end connection 172.28.0.163:52771 (405 connections now open) 2015-10-05T13:01:19.854+0100 [conn2111] end connection 172.28.0.163:52781 (404 connections now open) 2015-10-05T13:01:19.854+0100 [conn2252] end connection 172.28.0.163:53636 (402 connections now open) 2015-10-05T13:01:19.854+0100 [conn2254] end connection 172.28.0.163:53638 (401 connections now open) 2015-10-05T13:01:19.854+0100 [conn2275] end connection 172.28.0.163:53804 (401 connections now open) 2015-10-05T13:01:19.854+0100 [conn2071] end connection 172.28.0.163:52730 (399 connections now open) 2015-10-05T13:01:19.854+0100 [conn2083] end connection 172.28.0.163:52753 (399 connections now open) 2015-10-05T13:01:19.855+0100 [conn2270] end connection 172.28.0.163:53765 (397 connections now open) 2015-10-05T13:01:19.855+0100 [conn2198] end connection 172.28.0.163:52934 (396 connections now open) 2015-10-05T13:01:19.855+0100 [conn2199] end connection 172.28.0.163:52936 (396 connections now open) 2015-10-05T13:01:19.855+0100 [conn2293] end connection 172.28.0.163:53827 (394 connections now open) 2015-10-05T13:01:19.856+0100 [conn1974] end connection 172.28.0.163:52321 (393 connections now open) 2015-10-05T13:01:19.856+0100 [conn1971] end connection 172.28.0.163:52318 (392 connections now open) 2015-10-05T13:01:19.856+0100 [conn2109] end connection 172.28.0.163:52779 (391 connections now open) 2015-10-05T13:01:19.856+0100 [conn2278] end connection 172.28.0.163:53807 (390 connections now open) 2015-10-05T13:01:21.356+0100 [conn2095] end connection 172.28.0.163:52765 (389 connections now open) 2015-10-05T13:01:21.356+0100 [conn1621] end connection 172.28.0.163:50400 (388 connections now open) 2015-10-05T13:01:21.356+0100 [conn2096] end connection 172.28.0.163:52766 (387 connections now open) 2015-10-05T13:01:21.357+0100 [conn2087] end connection 172.28.0.163:52757 (386 connections now open) 2015-10-05T13:01:21.357+0100 [conn2265] end connection 172.28.0.163:53695 (385 connections now open) 2015-10-05T13:01:21.357+0100 [conn2200] end connection 172.28.0.163:52941 (385 connections now open) 2015-10-05T13:01:21.358+0100 [conn2092] end connection 172.28.0.163:52762 (383 connections now open) 2015-10-05T13:01:21.358+0100 [conn2103] end connection 172.28.0.163:52773 (382 connections now open) 2015-10-05T13:01:21.358+0100 [conn2276] end connection 172.28.0.163:53805 (381 connections now open) 2015-10-05T13:01:21.358+0100 [conn2287] end connection 172.28.0.163:53818 (380 connections now open) 2015-10-05T13:01:21.358+0100 [conn2069] end connection 172.28.0.163:52727 (379 connections now open) 2015-10-05T13:01:21.358+0100 [conn1980] end connection 172.28.0.163:52327 (378 connections now open) 2015-10-05T13:01:21.358+0100 [conn2066] end connection 172.28.0.163:52723 (377 connections now open) 2015-10-05T13:01:21.359+0100 [conn2117] end connection 172.28.0.163:52788 (376 connections now open) 2015-10-05T13:01:21.359+0100 [conn2240] end connection 172.28.0.163:53623 (376 connections now open) 2015-10-05T13:01:21.359+0100 [conn2237] end connection 172.28.0.163:53619 (376 connections now open) 2015-10-05T13:01:21.359+0100 [conn2305] end connection 172.28.0.163:53867 (373 connections now open) 2015-10-05T13:01:21.359+0100 [conn2113] end connection 172.28.0.163:52784 (372 connections now open) 2015-10-05T13:01:21.359+0100 [conn2085] end connection 172.28.0.163:52755 (372 connections now open) 2015-10-05T13:01:21.359+0100 [conn2259] end connection 172.28.0.163:53652 (371 connections now open) 2015-10-05T13:01:21.360+0100 [conn2058] end connection 172.28.0.163:52709 (369 connections now open) 2015-10-05T13:01:21.360+0100 [conn2059] end connection 172.28.0.163:52711 (368 connections now open) 2015-10-05T13:01:21.360+0100 [conn2062] end connection 172.28.0.163:52718 (368 connections now open) 2015-10-05T13:01:21.360+0100 [conn2063] end connection 172.28.0.163:52719 (366 connections now open) 2015-10-05T13:01:21.360+0100 [conn2068] end connection 172.28.0.163:52726 (366 connections now open) 2015-10-05T13:01:21.360+0100 [conn2094] end connection 172.28.0.163:52764 (365 connections now open) 2015-10-05T13:01:21.360+0100 [conn2030] end connection 172.28.0.163:52588 (363 connections now open) 2015-10-05T13:01:21.360+0100 [conn2115] end connection 172.28.0.163:52786 (363 connections now open) 2015-10-05T13:01:21.361+0100 [conn2209] end connection 172.28.0.163:52958 (361 connections now open) 2015-10-05T13:01:21.361+0100 [conn2057] end connection 172.28.0.163:52708 (360 connections now open) 2015-10-05T13:01:21.361+0100 [conn2206] end connection 172.28.0.163:52949 (359 connections now open) 2015-10-05T13:01:21.361+0100 [conn2274] end connection 172.28.0.163:53798 (359 connections now open) 2015-10-05T13:01:21.361+0100 [conn1977] end connection 172.28.0.163:52324 (357 connections now open) 2015-10-05T13:01:21.362+0100 [conn2295] end connection 172.28.0.163:53829 (356 connections now open) 2015-10-05T13:01:21.362+0100 [conn2300] end connection 172.28.0.163:53843 (355 connections now open) 2015-10-05T13:01:21.362+0100 [conn2061] end connection 172.28.0.163:52716 (355 connections now open) 2015-10-05T13:01:21.362+0100 [conn2073] end connection 172.28.0.163:52734 (354 connections now open) 2015-10-05T13:01:21.362+0100 [conn2208] end connection 172.28.0.163:52955 (353 connections now open) 2015-10-05T13:01:21.362+0100 [conn1952] end connection 172.28.0.163:52015 (351 connections now open) 2015-10-05T13:01:21.362+0100 [conn1949] end connection 172.28.0.163:52012 (350 connections now open) 2015-10-05T13:01:21.362+0100 [conn2070] end connection 172.28.0.163:52728 (350 connections now open) 2015-10-05T13:01:21.362+0100 [conn2294] end connection 172.28.0.163:53828 (348 connections now open) 2015-10-05T13:01:21.362+0100 [conn1989] end connection 172.28.0.163:52423 (348 connections now open) 2015-10-05T13:01:21.363+0100 [conn1951] end connection 172.28.0.163:52013 (347 connections now open) 2015-10-05T13:01:21.363+0100 [conn2193] end connection 172.28.0.163:52918 (346 connections now open) 2015-10-05T13:01:21.363+0100 [conn2277] end connection 172.28.0.163:53806 (344 connections now open) 2015-10-05T13:01:21.363+0100 [conn2104] end connection 172.28.0.163:52774 (343 connections now open) 2015-10-05T13:01:21.363+0100 [conn1990] end connection 172.28.0.163:52424 (342 connections now open) 2015-10-05T13:01:21.363+0100 [conn2098] end connection 172.28.0.163:52768 (341 connections now open) 2015-10-05T13:01:21.363+0100 [conn1995] end connection 172.28.0.163:52429 (340 connections now open) 2015-10-05T13:01:21.364+0100 [conn2248] end connection 172.28.0.163:53631 (340 connections now open) 2015-10-05T13:01:21.364+0100 [conn2031] end connection 172.28.0.163:52590 (338 connections now open) 2015-10-05T13:01:21.364+0100 [conn1972] end connection 172.28.0.163:52319 (337 connections now open) 2015-10-05T13:01:21.364+0100 [conn1997] end connection 172.28.0.163:52433 (336 connections now open) 2015-10-05T13:01:21.364+0100 [conn2195] end connection 172.28.0.163:52928 (335 connections now open) 2015-10-05T13:01:21.364+0100 [conn2055] end connection 172.28.0.163:52705 (334 connections now open) 2015-10-05T13:01:21.364+0100 [conn2123] end connection 172.28.0.163:52794 (333 connections now open) 2015-10-05T13:01:21.365+0100 [conn2238] end connection 172.28.0.163:53621 (332 connections now open) 2015-10-05T13:01:21.365+0100 [conn2090] end connection 172.28.0.163:52760 (331 connections now open) 2015-10-05T13:01:21.365+0100 [conn1975] end connection 172.28.0.163:52322 (330 connections now open) 2015-10-05T13:01:21.365+0100 [conn2244] end connection 172.28.0.163:53627 (329 connections now open) 2015-10-05T13:01:21.366+0100 [conn2304] end connection 172.28.0.163:53865 (328 connections now open) 2015-10-05T13:01:21.366+0100 [conn2048] end connection 172.28.0.163:52681 (327 connections now open) 2015-10-05T13:01:21.366+0100 [conn2056] end connection 172.28.0.163:52706 (327 connections now open) 2015-10-05T13:01:21.366+0100 [conn2114] end connection 172.28.0.163:52785 (326 connections now open) 2015-10-05T13:01:21.366+0100 [conn1978] end connection 172.28.0.163:52325 (325 connections now open) 2015-10-05T13:01:21.366+0100 [conn2122] end connection 172.28.0.163:52793 (325 connections now open) 2015-10-05T13:01:21.366+0100 [conn2201] end connection 172.28.0.163:52943 (322 connections now open) 2015-10-05T13:01:21.366+0100 [conn1996] end connection 172.28.0.163:52431 (322 connections now open) 2015-10-05T13:01:21.366+0100 [conn1994] end connection 172.28.0.163:52428 (320 connections now open) 2015-10-05T13:01:21.366+0100 [conn2299] end connection 172.28.0.163:53841 (319 connections now open) 2015-10-05T13:01:21.367+0100 [conn2292] end connection 172.28.0.163:53825 (318 connections now open) 2015-10-05T13:01:21.367+0100 [conn2079] end connection 172.28.0.163:52749 (318 connections now open) 2015-10-05T13:01:21.367+0100 [conn2093] end connection 172.28.0.163:52763 (316 connections now open) 2015-10-05T13:01:21.367+0100 [conn2077] end connection 172.28.0.163:52747 (315 connections now open) 2015-10-05T13:01:21.367+0100 [conn2081] end connection 172.28.0.163:52751 (314 connections now open) 2015-10-05T13:01:21.368+0100 [conn2251] end connection 172.28.0.163:53635 (313 connections now open) 2015-10-05T13:01:21.368+0100 [conn2064] end connection 172.28.0.163:52721 (313 connections now open) 2015-10-05T13:01:21.368+0100 [conn2051] end connection 172.28.0.163:52693 (312 connections now open) 2015-10-05T13:01:21.368+0100 [conn1984] end connection 172.28.0.163:52332 (310 connections now open) 2015-10-05T13:01:21.368+0100 [conn1950] end connection 172.28.0.163:52014 (310 connections now open) 2015-10-05T13:01:21.368+0100 [conn2089] end connection 172.28.0.163:52759 (308 connections now open) 2015-10-05T13:01:21.368+0100 [conn1814] end connection 172.28.0.163:50817 (307 connections now open) 2015-10-05T13:01:21.368+0100 [conn1696] end connection 172.28.0.163:50696 (307 connections now open) 2015-10-05T13:01:21.368+0100 [conn1763] end connection 172.28.0.163:50765 (306 connections now open) 2015-10-05T13:01:21.369+0100 [conn2078] end connection 172.28.0.163:52748 (304 connections now open) 2015-10-05T13:01:21.369+0100 [conn2250] end connection 172.28.0.163:53633 (304 connections now open) 2015-10-05T13:01:21.369+0100 [conn1991] end connection 172.28.0.163:52425 (303 connections now open) 2015-10-05T13:01:21.369+0100 [conn2282] end connection 172.28.0.163:53812 (301 connections now open) 2015-10-05T13:01:21.369+0100 [conn2297] end connection 172.28.0.163:53834 (300 connections now open) 2015-10-05T13:01:21.369+0100 [conn1638] end connection 172.28.0.163:50637 (300 connections now open) 2015-10-05T13:01:21.369+0100 [conn1688] end connection 172.28.0.163:50688 (298 connections now open) 2015-10-05T13:01:21.369+0100 [conn2100] end connection 172.28.0.163:52770 (297 connections now open) 2015-10-05T13:01:21.369+0100 [conn2106] end connection 172.28.0.163:52776 (297 connections now open) 2015-10-05T13:01:21.369+0100 [conn2290] end connection 172.28.0.163:53823 (296 connections now open) 2015-10-05T13:01:21.369+0100 [conn1703] end connection 172.28.0.163:50704 (295 connections now open) 2015-10-05T13:01:21.370+0100 [conn1730] end connection 172.28.0.163:50732 (293 connections now open) 2015-10-05T13:01:21.370+0100 [conn1976] end connection 172.28.0.163:52323 (292 connections now open) 2015-10-05T13:01:21.370+0100 [conn2119] end connection 172.28.0.163:52790 (292 connections now open) 2015-10-05T13:01:21.370+0100 [conn1864] end connection 172.28.0.163:50907 (290 connections now open) 2015-10-05T13:01:21.370+0100 [conn2246] end connection 172.28.0.163:53629 (290 connections now open) 2015-10-05T13:01:21.370+0100 [conn1818] end connection 172.28.0.163:50822 (288 connections now open) 2015-10-05T13:01:21.370+0100 [conn1797] end connection 172.28.0.163:50801 (288 connections now open) 2015-10-05T13:01:21.370+0100 [conn2301] end connection 172.28.0.163:53848 (287 connections now open) 2015-10-05T13:01:21.370+0100 [conn1646] end connection 172.28.0.163:50645 (286 connections now open) 2015-10-05T13:01:21.371+0100 [conn2116] end connection 172.28.0.163:52787 (284 connections now open) 2015-10-05T13:01:21.371+0100 [conn2242] end connection 172.28.0.163:53625 (284 connections now open) 2015-10-05T13:01:21.371+0100 [conn2194] end connection 172.28.0.163:52926 (282 connections now open) 2015-10-05T13:01:21.371+0100 [conn2026] end connection 172.28.0.163:52580 (281 connections now open) 2015-10-05T13:01:21.371+0100 [conn1983] end connection 172.28.0.163:52330 (280 connections now open) 2015-10-05T13:01:21.371+0100 [conn2241] end connection 172.28.0.163:53624 (280 connections now open) 2015-10-05T13:01:21.371+0100 [conn2284] end connection 172.28.0.163:53814 (279 connections now open) 2015-10-05T13:01:21.371+0100 [conn2272] end connection 172.28.0.163:53777 (278 connections now open) 2015-10-05T13:01:21.371+0100 [conn2298] end connection 172.28.0.163:53836 (276 connections now open) 2015-10-05T13:01:21.372+0100 [conn2279] end connection 172.28.0.163:53808 (275 connections now open) 2015-10-05T13:01:21.372+0100 [conn1973] end connection 172.28.0.163:52320 (274 connections now open) 2015-10-05T13:01:21.373+0100 [conn2261] end connection 172.28.0.163:53654 (273 connections now open) 2015-10-05T13:01:21.373+0100 [conn2204] end connection 172.28.0.163:52947 (272 connections now open) 2015-10-05T13:01:21.373+0100 [conn2120] end connection 172.28.0.163:52791 (271 connections now open) 2015-10-05T13:01:21.373+0100 [conn2260] end connection 172.28.0.163:53653 (271 connections now open) 2015-10-05T13:01:21.373+0100 [conn2263] end connection 172.28.0.163:53692 (269 connections now open) 2015-10-05T13:01:21.373+0100 [conn2255] end connection 172.28.0.163:53639 (268 connections now open) 2015-10-05T13:01:21.374+0100 [conn2099] end connection 172.28.0.163:52769 (267 connections now open) 2015-10-05T13:01:21.374+0100 [conn2203] end connection 172.28.0.163:52945 (266 connections now open) 2015-10-05T13:01:21.374+0100 [conn2247] end connection 172.28.0.163:53630 (266 connections now open) 2015-10-05T13:01:21.374+0100 [conn1993] end connection 172.28.0.163:52427 (264 connections now open) 2015-10-05T13:01:21.374+0100 [conn2097] end connection 172.28.0.163:52767 (263 connections now open) 2015-10-05T13:01:21.375+0100 [conn2112] end connection 172.28.0.163:52783 (263 connections now open) 2015-10-05T13:01:21.375+0100 [conn2210] end connection 172.28.0.163:52965 (261 connections now open) 2015-10-05T13:01:21.375+0100 [conn2067] end connection 172.28.0.163:52725 (261 connections now open) 2015-10-05T13:01:21.375+0100 [conn2108] end connection 172.28.0.163:52778 (259 connections now open) 2015-10-05T13:01:21.375+0100 [conn2281] end connection 172.28.0.163:53811 (259 connections now open) 2015-10-05T13:01:21.375+0100 [conn2273] end connection 172.28.0.163:53790 (257 connections now open) 2015-10-05T13:01:21.375+0100 [conn2124] end connection 172.28.0.163:52795 (257 connections now open) 2015-10-05T13:01:21.376+0100 [conn1982] end connection 172.28.0.163:52329 (255 connections now open) 2015-10-05T13:01:21.376+0100 [conn2249] end connection 172.28.0.163:53632 (254 connections now open) 2015-10-05T13:01:21.376+0100 [conn2243] end connection 172.28.0.163:53626 (254 connections now open) 2015-10-05T13:01:21.376+0100 [conn2105] end connection 172.28.0.163:52775 (252 connections now open) 2015-10-05T13:01:21.377+0100 [conn2118] end connection 172.28.0.163:52789 (251 connections now open) 2015-10-05T13:01:21.377+0100 [conn1992] end connection 172.28.0.163:52426 (250 connections now open) 2015-10-05T13:01:21.377+0100 [conn2032] end connection 172.28.0.163:52591 (250 connections now open) 2015-10-05T13:01:21.377+0100 [conn2125] end connection 172.28.0.163:52796 (249 connections now open) 2015-10-05T13:01:21.377+0100 [conn2024] end connection 172.28.0.163:52576 (248 connections now open) 2015-10-05T13:01:21.378+0100 [conn2121] end connection 172.28.0.163:52792 (246 connections now open) 2015-10-05T13:01:21.378+0100 [conn2050] end connection 172.28.0.163:52690 (245 connections now open) 2015-10-05T13:01:21.378+0100 [conn2253] end connection 172.28.0.163:53637 (244 connections now open) 2015-10-05T13:01:21.378+0100 [conn2280] end connection 172.28.0.163:53809 (244 connections now open) 2015-10-05T13:01:21.378+0100 [conn2084] end connection 172.28.0.163:52754 (242 connections now open) 2015-10-05T13:01:21.378+0100 [conn1861] end connection 172.28.0.163:50904 (242 connections now open) 2015-10-05T13:01:21.379+0100 [conn1875] end connection 172.28.0.163:50927 (240 connections now open) 2015-10-05T13:01:21.379+0100 [conn2027] end connection 172.28.0.163:52582 (240 connections now open) 2015-10-05T13:01:21.379+0100 [conn2288] end connection 172.28.0.163:53820 (238 connections now open) 2015-10-05T13:01:21.379+0100 [conn2049] end connection 172.28.0.163:52682 (237 connections now open) 2015-10-05T13:01:21.379+0100 [conn2107] end connection 172.28.0.163:52777 (237 connections now open) 2015-10-05T13:01:21.379+0100 [conn1979] end connection 172.28.0.163:52326 (235 connections now open) 2015-10-05T13:01:21.379+0100 [conn2028] end connection 172.28.0.163:52583 (235 connections now open) 2015-10-05T13:01:21.380+0100 [conn2047] end connection 172.28.0.163:52677 (233 connections now open) 2015-10-05T13:01:21.380+0100 [conn2072] end connection 172.28.0.163:52731 (233 connections now open) 2015-10-05T13:01:21.380+0100 [conn2053] end connection 172.28.0.163:52702 (231 connections now open) 2015-10-05T13:01:21.380+0100 [conn2102] end connection 172.28.0.163:52772 (230 connections now open) 2015-10-05T13:01:21.381+0100 [conn2082] end connection 172.28.0.163:52752 (229 connections now open) 2015-10-05T13:01:21.381+0100 [conn2303] end connection 172.28.0.163:53863 (228 connections now open) 2015-10-05T13:01:21.381+0100 [conn2052] end connection 172.28.0.163:52694 (228 connections now open) 2015-10-05T13:01:21.381+0100 [conn2086] end connection 172.28.0.163:52756 (227 connections now open) 2015-10-05T13:01:21.381+0100 [conn2197] end connection 172.28.0.163:52932 (228 connections now open) 2015-10-05T13:01:21.381+0100 [conn2091] end connection 172.28.0.163:52761 (227 connections now open) 2015-10-05T13:01:21.381+0100 [conn2054] end connection 172.28.0.163:52703 (223 connections now open) 2015-10-05T13:01:21.381+0100 [conn2065] end connection 172.28.0.163:52722 (223 connections now open) 2015-10-05T13:01:22.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612669112deab02e29965d5 2015-10-05T13:01:22.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:29.133+0100 [mongosMain] connection accepted from 127.0.0.1:55394 #2499 (223 connections now open) 2015-10-05T13:01:29.135+0100 [conn2499] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:29.137+0100 [conn2499] end connection 127.0.0.1:55394 (222 connections now open) 2015-10-05T13:01:35.126+0100 [conn2320] end connection 172.28.0.163:54227 (221 connections now open) 2015-10-05T13:01:35.127+0100 [mongosMain] connection accepted from 172.28.0.163:55396 #2500 (222 connections now open) 2015-10-05T13:01:35.129+0100 [conn2500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:37.654+0100 [mongosMain] connection accepted from 172.28.0.164:58110 #2501 (223 connections now open) 2015-10-05T13:01:37.669+0100 [mongosMain] connection accepted from 172.28.0.164:58112 #2502 (224 connections now open) 2015-10-05T13:01:37.674+0100 [conn2502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:37.678+0100 [conn2501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:39.422+0100 [mongosMain] connection accepted from 127.0.0.1:55397 #2503 (225 connections now open) 2015-10-05T13:01:39.425+0100 [conn2503] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:39.425+0100 [conn2503] end connection 127.0.0.1:55397 (224 connections now open) 2015-10-05T13:01:40.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266a412deab02e2996972 2015-10-05T13:01:40.416+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:45.608+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:01:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:01:52.583+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266b012deab02e2996bce 2015-10-05T13:01:52.651+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:01:54.891+0100 [conn2381] end connection 172.28.0.164:57112 (223 connections now open) 2015-10-05T13:01:54.892+0100 [mongosMain] connection accepted from 172.28.0.164:58145 #2504 (224 connections now open) 2015-10-05T13:01:54.895+0100 [conn2504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:01:58.729+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:01:58.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:02:04.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266bc12deab02e2996dbb 2015-10-05T13:02:05.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:11.271+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:02:11.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:02:15.746+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:02:15 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:02:17.517+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266c912deab02e2997019 2015-10-05T13:02:17.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:28.771+0100 [mongosMain] connection accepted from 127.0.0.1:55448 #2505 (225 connections now open) 2015-10-05T13:02:28.774+0100 [conn2505] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:02:28.776+0100 [conn2505] end connection 127.0.0.1:55448 (224 connections now open) 2015-10-05T13:02:29.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266d512deab02e2997251 2015-10-05T13:02:30.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:35.143+0100 [conn2321] end connection 172.28.0.163:54229 (223 connections now open) 2015-10-05T13:02:35.144+0100 [mongosMain] connection accepted from 172.28.0.163:55450 #2506 (224 connections now open) 2015-10-05T13:02:35.146+0100 [conn2506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:02:36.350+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266dc12deab02e2997373 2015-10-05T13:02:36.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:39.562+0100 [mongosMain] connection accepted from 127.0.0.1:55452 #2507 (225 connections now open) 2015-10-05T13:02:39.565+0100 [conn2507] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:02:39.566+0100 [conn2507] end connection 127.0.0.1:55452 (224 connections now open) 2015-10-05T13:02:42.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266e212deab02e2997487 2015-10-05T13:02:42.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:46.732+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:02:45 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:02:49.353+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266e812deab02e2997569 2015-10-05T13:02:49.420+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:02:54.907+0100 [conn2382] end connection 172.28.0.164:57116 (223 connections now open) 2015-10-05T13:02:54.908+0100 [mongosMain] connection accepted from 172.28.0.164:58210 #2508 (224 connections now open) 2015-10-05T13:02:54.911+0100 [conn2508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:02:56.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266ef12deab02e299765e 2015-10-05T13:02:59.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:05.321+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266f912deab02e299777a 2015-10-05T13:03:05.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:11.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561266ff12deab02e2997844 2015-10-05T13:03:11.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:17.008+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:03:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:03:17.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612670512deab02e29978cb 2015-10-05T13:03:18.068+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:24.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612670c12deab02e2997969 2015-10-05T13:03:24.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:28.179+0100 [mongosMain] connection accepted from 127.0.0.1:55519 #2509 (225 connections now open) 2015-10-05T13:03:28.182+0100 [conn2509] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:03:28.183+0100 [conn2509] end connection 127.0.0.1:55519 (224 connections now open) 2015-10-05T13:03:30.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612671212deab02e29979f4 2015-10-05T13:03:30.710+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:35.158+0100 [conn2322] end connection 172.28.0.163:54231 (223 connections now open) 2015-10-05T13:03:35.160+0100 [mongosMain] connection accepted from 172.28.0.163:55521 #2510 (224 connections now open) 2015-10-05T13:03:35.161+0100 [conn2510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:03:39.629+0100 [mongosMain] connection accepted from 127.0.0.1:55522 #2511 (225 connections now open) 2015-10-05T13:03:39.631+0100 [conn2511] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:03:39.631+0100 [conn2511] end connection 127.0.0.1:55522 (224 connections now open) 2015-10-05T13:03:39.774+0100 [conn2000] end connection 172.28.0.164:55457 (223 connections now open) 2015-10-05T13:03:40.399+0100 [conn2005] end connection 172.28.0.164:55520 (222 connections now open) 2015-10-05T13:03:40.400+0100 [mongosMain] connection accepted from 172.28.0.164:58247 #2512 (223 connections now open) 2015-10-05T13:03:40.403+0100 [conn2512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:03:42.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612671e12deab02e2997b13 2015-10-05T13:03:42.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:03:47.152+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:03:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:03:54.923+0100 [conn2383] end connection 172.28.0.164:57119 (222 connections now open) 2015-10-05T13:03:54.924+0100 [mongosMain] connection accepted from 172.28.0.164:58266 #2513 (223 connections now open) 2015-10-05T13:03:54.927+0100 [conn2513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:03:55.108+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612672a12deab02e2997b2f 2015-10-05T13:03:55.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:01.329+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:04:01.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:04:07.603+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612673712deab02e2997b37 2015-10-05T13:04:07.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:17.411+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:04:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:04:20.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612674312deab02e2997b39 2015-10-05T13:04:20.212+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:26.361+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612674a12deab02e2997b3a 2015-10-05T13:04:26.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:28.176+0100 [mongosMain] connection accepted from 127.0.0.1:55576 #2514 (224 connections now open) 2015-10-05T13:04:28.179+0100 [conn2514] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:04:28.180+0100 [conn2514] end connection 127.0.0.1:55576 (223 connections now open) 2015-10-05T13:04:32.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612675012deab02e2997b3b 2015-10-05T13:04:32.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:35.175+0100 [conn2323] end connection 172.28.0.163:54234 (222 connections now open) 2015-10-05T13:04:35.176+0100 [mongosMain] connection accepted from 172.28.0.163:55579 #2515 (223 connections now open) 2015-10-05T13:04:35.178+0100 [conn2515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:04:38.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612675612deab02e2997b3c 2015-10-05T13:04:39.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:39.790+0100 [conn2001] end connection 172.28.0.164:55458 (222 connections now open) 2015-10-05T13:04:40.159+0100 [mongosMain] connection accepted from 127.0.0.1:55581 #2516 (223 connections now open) 2015-10-05T13:04:40.161+0100 [conn2516] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:04:40.162+0100 [conn2516] end connection 127.0.0.1:55581 (222 connections now open) 2015-10-05T13:04:45.365+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612675d12deab02e2997b3d 2015-10-05T13:04:45.501+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:47.685+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:04:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:04:47.937+0100 [conn2479] end connection 172.28.0.164:57897 (221 connections now open) 2015-10-05T13:04:47.937+0100 [conn2484] end connection 172.28.0.164:57902 (221 connections now open) 2015-10-05T13:04:47.937+0100 [conn2019] end connection 172.28.0.164:55547 (219 connections now open) 2015-10-05T13:04:47.937+0100 [conn2501] end connection 172.28.0.164:58110 (218 connections now open) 2015-10-05T13:04:47.937+0100 [conn2010] end connection 172.28.0.164:55538 (217 connections now open) 2015-10-05T13:04:47.938+0100 [conn2367] end connection 172.28.0.164:56909 (216 connections now open) 2015-10-05T13:04:47.938+0100 [conn2186] end connection 172.28.0.164:55879 (215 connections now open) 2015-10-05T13:04:47.938+0100 [conn2161] end connection 172.28.0.164:55849 (215 connections now open) 2015-10-05T13:04:47.938+0100 [conn2189] end connection 172.28.0.164:55897 (214 connections now open) 2015-10-05T13:04:47.938+0100 [conn2178] end connection 172.28.0.164:55866 (214 connections now open) 2015-10-05T13:04:47.938+0100 [conn2184] end connection 172.28.0.164:55876 (211 connections now open) 2015-10-05T13:04:47.938+0100 [conn2157] end connection 172.28.0.164:55845 (214 connections now open) 2015-10-05T13:04:47.939+0100 [conn2151] end connection 172.28.0.164:55839 (211 connections now open) 2015-10-05T13:04:47.939+0100 [conn2438] end connection 172.28.0.164:57305 (208 connections now open) 2015-10-05T13:04:47.939+0100 [conn2137] end connection 172.28.0.164:55814 (207 connections now open) 2015-10-05T13:04:47.939+0100 [conn2144] end connection 172.28.0.164:55831 (206 connections now open) 2015-10-05T13:04:47.939+0100 [conn2128] end connection 172.28.0.164:55749 (206 connections now open) 2015-10-05T13:04:47.939+0100 [conn1311] end connection 172.28.0.164:52321 (206 connections now open) 2015-10-05T13:04:47.939+0100 [conn2487] end connection 172.28.0.164:57905 (203 connections now open) 2015-10-05T13:04:47.940+0100 [conn2131] end connection 172.28.0.164:55755 (202 connections now open) 2015-10-05T13:04:47.940+0100 [conn2176] end connection 172.28.0.164:55864 (201 connections now open) 2015-10-05T13:04:47.940+0100 [conn2485] end connection 172.28.0.164:57903 (201 connections now open) 2015-10-05T13:04:47.940+0100 [conn2502] end connection 172.28.0.164:58112 (199 connections now open) 2015-10-05T13:04:47.941+0100 [conn2156] end connection 172.28.0.164:55844 (198 connections now open) 2015-10-05T13:04:47.941+0100 [conn2179] end connection 172.28.0.164:55868 (197 connections now open) 2015-10-05T13:04:47.941+0100 [conn2437] end connection 172.28.0.164:57304 (196 connections now open) 2015-10-05T13:04:47.941+0100 [conn1998] end connection 172.28.0.164:55456 (195 connections now open) 2015-10-05T13:04:47.941+0100 [conn2040] end connection 172.28.0.164:55653 (194 connections now open) 2015-10-05T13:04:47.941+0100 [conn2158] end connection 172.28.0.164:55846 (194 connections now open) 2015-10-05T13:04:47.942+0100 [conn2432] end connection 172.28.0.164:57275 (192 connections now open) 2015-10-05T13:04:49.572+0100 [conn2174] end connection 172.28.0.164:55862 (191 connections now open) 2015-10-05T13:04:49.573+0100 [conn2164] end connection 172.28.0.164:55852 (190 connections now open) 2015-10-05T13:04:49.574+0100 [conn2145] end connection 172.28.0.164:55832 (189 connections now open) 2015-10-05T13:04:49.574+0100 [conn2472] end connection 172.28.0.164:57890 (189 connections now open) 2015-10-05T13:04:49.575+0100 [conn2132] end connection 172.28.0.164:55757 (187 connections now open) 2015-10-05T13:04:49.575+0100 [conn2468] end connection 172.28.0.164:57886 (187 connections now open) 2015-10-05T13:04:49.575+0100 [conn2143] end connection 172.28.0.164:55821 (185 connections now open) 2015-10-05T13:04:49.575+0100 [conn2443] end connection 172.28.0.164:57464 (184 connections now open) 2015-10-05T13:04:49.576+0100 [conn2469] end connection 172.28.0.164:57887 (183 connections now open) 2015-10-05T13:04:49.576+0100 [conn2488] end connection 172.28.0.164:57906 (183 connections now open) 2015-10-05T13:04:49.576+0100 [conn2476] end connection 172.28.0.164:57894 (182 connections now open) 2015-10-05T13:04:49.576+0100 [conn2018] end connection 172.28.0.164:55546 (180 connections now open) 2015-10-05T13:04:49.576+0100 [conn2470] end connection 172.28.0.164:57888 (179 connections now open) 2015-10-05T13:04:49.576+0100 [conn2154] end connection 172.28.0.164:55842 (178 connections now open) 2015-10-05T13:04:49.576+0100 [conn2434] end connection 172.28.0.164:57299 (179 connections now open) 2015-10-05T13:04:49.576+0100 [conn2471] end connection 172.28.0.164:57889 (177 connections now open) 2015-10-05T13:04:49.577+0100 [conn2017] end connection 172.28.0.164:55544 (176 connections now open) 2015-10-05T13:04:49.577+0100 [conn2165] end connection 172.28.0.164:55853 (174 connections now open) 2015-10-05T13:04:49.577+0100 [conn2436] end connection 172.28.0.164:57302 (173 connections now open) 2015-10-05T13:04:49.577+0100 [conn2512] end connection 172.28.0.164:58247 (173 connections now open) 2015-10-05T13:04:49.579+0100 [conn2372] end connection 172.28.0.164:56931 (171 connections now open) 2015-10-05T13:04:49.579+0100 [conn2433] end connection 172.28.0.164:57277 (171 connections now open) 2015-10-05T13:04:49.579+0100 [conn2133] end connection 172.28.0.164:55756 (171 connections now open) 2015-10-05T13:04:49.579+0100 [conn2046] end connection 172.28.0.164:55672 (168 connections now open) 2015-10-05T13:04:49.579+0100 [conn2458] end connection 172.28.0.164:57763 (168 connections now open) 2015-10-05T13:04:49.579+0100 [conn2035] end connection 172.28.0.164:55646 (166 connections now open) 2015-10-05T13:04:49.580+0100 [conn2170] end connection 172.28.0.164:55858 (165 connections now open) 2015-10-05T13:04:49.580+0100 [conn2172] end connection 172.28.0.164:55860 (165 connections now open) 2015-10-05T13:04:49.580+0100 [conn2034] end connection 172.28.0.164:55645 (163 connections now open) 2015-10-05T13:04:49.580+0100 [conn2171] end connection 172.28.0.164:55859 (163 connections now open) 2015-10-05T13:04:49.580+0100 [conn2182] end connection 172.28.0.164:55872 (162 connections now open) 2015-10-05T13:04:49.580+0100 [conn2460] end connection 172.28.0.164:57764 (162 connections now open) 2015-10-05T13:04:49.580+0100 [conn2043] end connection 172.28.0.164:55659 (162 connections now open) 2015-10-05T13:04:49.581+0100 [conn2175] end connection 172.28.0.164:55863 (158 connections now open) 2015-10-05T13:04:49.581+0100 [conn2494] end connection 172.28.0.164:57912 (157 connections now open) 2015-10-05T13:04:49.581+0100 [conn2007] end connection 172.28.0.164:55521 (156 connections now open) 2015-10-05T13:04:49.582+0100 [conn2459] end connection 172.28.0.164:57765 (155 connections now open) 2015-10-05T13:04:49.582+0100 [conn2180] end connection 172.28.0.164:55869 (155 connections now open) 2015-10-05T13:04:49.582+0100 [conn2185] end connection 172.28.0.164:55878 (153 connections now open) 2015-10-05T13:04:49.582+0100 [conn2155] end connection 172.28.0.164:55843 (152 connections now open) 2015-10-05T13:04:49.582+0100 [conn2037] end connection 172.28.0.164:55650 (151 connections now open) 2015-10-05T13:04:49.582+0100 [conn2493] end connection 172.28.0.164:57911 (151 connections now open) 2015-10-05T13:04:49.583+0100 [conn2490] end connection 172.28.0.164:57908 (149 connections now open) 2015-10-05T13:04:49.583+0100 [conn2142] end connection 172.28.0.164:55820 (149 connections now open) 2015-10-05T13:04:49.583+0100 [conn2486] end connection 172.28.0.164:57904 (147 connections now open) 2015-10-05T13:04:49.583+0100 [conn2477] end connection 172.28.0.164:57895 (147 connections now open) 2015-10-05T13:04:49.583+0100 [conn2163] end connection 172.28.0.164:55850 (147 connections now open) 2015-10-05T13:04:49.585+0100 [conn2481] end connection 172.28.0.164:57899 (144 connections now open) 2015-10-05T13:04:49.585+0100 [conn2457] end connection 172.28.0.164:57762 (144 connections now open) 2015-10-05T13:04:49.585+0100 [conn2474] end connection 172.28.0.164:57892 (144 connections now open) 2015-10-05T13:04:49.586+0100 [conn2162] end connection 172.28.0.164:55851 (142 connections now open) 2015-10-05T13:04:49.586+0100 [conn2369] end connection 172.28.0.164:56926 (141 connections now open) 2015-10-05T13:04:49.586+0100 [conn2159] end connection 172.28.0.164:55847 (139 connections now open) 2015-10-05T13:04:49.586+0100 [conn2478] end connection 172.28.0.164:57896 (138 connections now open) 2015-10-05T13:04:49.586+0100 [conn2139] end connection 172.28.0.164:55816 (137 connections now open) 2015-10-05T13:04:49.587+0100 [conn2429] end connection 172.28.0.164:57211 (136 connections now open) 2015-10-05T13:04:49.587+0100 [conn2480] end connection 172.28.0.164:57898 (136 connections now open) 2015-10-05T13:04:49.587+0100 [conn2160] end connection 172.28.0.164:55848 (135 connections now open) 2015-10-05T13:04:49.588+0100 [conn2489] end connection 172.28.0.164:57907 (133 connections now open) 2015-10-05T13:04:49.588+0100 [conn2370] end connection 172.28.0.164:56929 (133 connections now open) 2015-10-05T13:04:49.588+0100 [conn2183] end connection 172.28.0.164:55873 (132 connections now open) 2015-10-05T13:04:49.588+0100 [conn2435] end connection 172.28.0.164:57303 (130 connections now open) 2015-10-05T13:04:49.588+0100 [conn2177] end connection 172.28.0.164:55865 (130 connections now open) 2015-10-05T13:04:49.588+0100 [conn2126] end connection 172.28.0.164:55745 (128 connections now open) 2015-10-05T13:04:49.588+0100 [conn2039] end connection 172.28.0.164:55652 (127 connections now open) 2015-10-05T13:04:49.589+0100 [conn2045] end connection 172.28.0.164:55671 (126 connections now open) 2015-10-05T13:04:49.589+0100 [conn2492] end connection 172.28.0.164:57910 (125 connections now open) 2015-10-05T13:04:49.589+0100 [conn2491] end connection 172.28.0.164:57909 (124 connections now open) 2015-10-05T13:04:49.589+0100 [conn2456] end connection 172.28.0.164:57761 (124 connections now open) 2015-10-05T13:04:49.590+0100 [conn2173] end connection 172.28.0.164:55861 (122 connections now open) 2015-10-05T13:04:49.590+0100 [conn2482] end connection 172.28.0.164:57900 (122 connections now open) 2015-10-05T13:04:49.590+0100 [conn2138] end connection 172.28.0.164:55815 (120 connections now open) 2015-10-05T13:04:49.590+0100 [conn2473] end connection 172.28.0.164:57891 (119 connections now open) 2015-10-05T13:04:49.591+0100 [conn2475] end connection 172.28.0.164:57893 (118 connections now open) 2015-10-05T13:04:49.591+0100 [conn2129] end connection 172.28.0.164:55750 (118 connections now open) 2015-10-05T13:04:49.591+0100 [conn2041] end connection 172.28.0.164:55654 (116 connections now open) 2015-10-05T13:04:49.591+0100 [conn2483] end connection 172.28.0.164:57901 (115 connections now open) 2015-10-05T13:04:49.592+0100 [conn2042] end connection 172.28.0.164:55655 (114 connections now open) 2015-10-05T13:04:49.592+0100 [conn2377] end connection 172.28.0.164:57075 (114 connections now open) 2015-10-05T13:04:49.592+0100 [conn2444] end connection 172.28.0.164:57465 (113 connections now open) 2015-10-05T13:04:49.592+0100 [conn2016] end connection 172.28.0.164:55545 (113 connections now open) 2015-10-05T13:04:49.592+0100 [conn2153] end connection 172.28.0.164:55841 (110 connections now open) 2015-10-05T13:04:49.593+0100 [conn2130] end connection 172.28.0.164:55752 (110 connections now open) 2015-10-05T13:04:49.594+0100 [conn2166] end connection 172.28.0.164:55854 (108 connections now open) 2015-10-05T13:04:49.595+0100 [conn2141] end connection 172.28.0.164:55819 (107 connections now open) 2015-10-05T13:04:49.595+0100 [conn2371] end connection 172.28.0.164:56930 (107 connections now open) 2015-10-05T13:04:49.595+0100 [conn2140] end connection 172.28.0.164:55817 (107 connections now open) 2015-10-05T13:04:51.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612676312deab02e2997b3e 2015-10-05T13:04:51.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:04:54.939+0100 [conn2384] end connection 172.28.0.164:57122 (104 connections now open) 2015-10-05T13:04:54.941+0100 [mongosMain] connection accepted from 172.28.0.164:58313 #2517 (105 connections now open) 2015-10-05T13:04:54.943+0100 [conn2517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:04:58.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612676912deab02e2997b3f 2015-10-05T13:04:58.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:04.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612677012deab02e2997b40 2015-10-05T13:05:04.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:10.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612677612deab02e2997b41 2015-10-05T13:05:11.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:17.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612677d12deab02e2997b42 2015-10-05T13:05:17.239+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:17.820+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:05:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:05:23.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612678312deab02e2997b44 2015-10-05T13:05:23.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:28.968+0100 [mongosMain] connection accepted from 127.0.0.1:55629 #2518 (106 connections now open) 2015-10-05T13:05:28.970+0100 [conn2518] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:05:28.971+0100 [conn2518] end connection 127.0.0.1:55629 (105 connections now open) 2015-10-05T13:05:29.807+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612678912deab02e2997b45 2015-10-05T13:05:29.909+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:35.190+0100 [conn2324] end connection 172.28.0.163:54235 (104 connections now open) 2015-10-05T13:05:35.191+0100 [mongosMain] connection accepted from 172.28.0.163:55632 #2519 (105 connections now open) 2015-10-05T13:05:35.193+0100 [conn2519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:05:36.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612678f12deab02e2997b46 2015-10-05T13:05:36.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:39.790+0100 [mongosMain] connection accepted from 127.0.0.1:55634 #2520 (106 connections now open) 2015-10-05T13:05:39.793+0100 [conn2520] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:05:39.794+0100 [conn2520] end connection 127.0.0.1:55634 (105 connections now open) 2015-10-05T13:05:42.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612679612deab02e2997b48 2015-10-05T13:05:42.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:48.105+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:05:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:05:48.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612679c12deab02e2997b49 2015-10-05T13:05:48.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:05:54.984+0100 [conn2385] end connection 172.28.0.164:57125 (104 connections now open) 2015-10-05T13:05:54.984+0100 [mongosMain] connection accepted from 172.28.0.164:58364 #2521 (105 connections now open) 2015-10-05T13:05:54.984+0100 [conn2521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:05:55.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267a212deab02e2997b4a 2015-10-05T13:05:55.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:01.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267a912deab02e2997b4b 2015-10-05T13:06:01.902+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:08.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267af12deab02e2997b4d 2015-10-05T13:06:08.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:14.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267b612deab02e2997b4e 2015-10-05T13:06:14.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:18.363+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:06:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:06:19.949+0100 [mongosMain] connection accepted from 172.28.0.164:58384 #2522 (106 connections now open) 2015-10-05T13:06:19.949+0100 [mongosMain] connection accepted from 172.28.0.164:58385 #2523 (107 connections now open) 2015-10-05T13:06:20.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267bc12deab02e2997b4f 2015-10-05T13:06:20.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:26.903+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267c212deab02e2997b50 2015-10-05T13:06:26.970+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:28.243+0100 [mongosMain] connection accepted from 127.0.0.1:55679 #2524 (108 connections now open) 2015-10-05T13:06:28.245+0100 [conn2524] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:06:28.246+0100 [conn2524] end connection 127.0.0.1:55679 (107 connections now open) 2015-10-05T13:06:33.292+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267c812deab02e2997b51 2015-10-05T13:06:33.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:35.207+0100 [conn2325] end connection 172.28.0.163:54238 (106 connections now open) 2015-10-05T13:06:35.209+0100 [mongosMain] connection accepted from 172.28.0.163:55681 #2525 (107 connections now open) 2015-10-05T13:06:35.211+0100 [conn2525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:06:39.242+0100 [mongosMain] connection accepted from 127.0.0.1:55682 #2526 (108 connections now open) 2015-10-05T13:06:39.245+0100 [conn2526] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:06:39.245+0100 [conn2526] end connection 127.0.0.1:55682 (107 connections now open) 2015-10-05T13:06:39.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267cf12deab02e2997b52 2015-10-05T13:06:39.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:46.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267d512deab02e2997b53 2015-10-05T13:06:46.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:48.490+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:06:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:06:52.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267dc12deab02e2997b54 2015-10-05T13:06:52.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:06:52.975+0100 [conn2523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:06:54.987+0100 [conn2387] end connection 172.28.0.164:57131 (106 connections now open) 2015-10-05T13:06:54.988+0100 [mongosMain] connection accepted from 172.28.0.164:58424 #2527 (107 connections now open) 2015-10-05T13:06:54.991+0100 [conn2527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:06:56.953+0100 [conn2522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:03.959+0100 [mongosMain] connection accepted from 172.28.0.164:58427 #2528 (108 connections now open) 2015-10-05T13:07:03.966+0100 [conn2528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:04.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267e812deab02e2997b55 2015-10-05T13:07:04.932+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:11.080+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:07:11.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:07:13.460+0100 [mongosMain] connection accepted from 172.28.0.164:58428 #2529 (109 connections now open) 2015-10-05T13:07:13.463+0100 [conn2529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.548+0100 [mongosMain] connection accepted from 172.28.0.164:58510 #2530 (110 connections now open) 2015-10-05T13:07:13.549+0100 [mongosMain] connection accepted from 172.28.0.164:58511 #2531 (111 connections now open) 2015-10-05T13:07:13.551+0100 [mongosMain] connection accepted from 172.28.0.164:58512 #2532 (112 connections now open) 2015-10-05T13:07:13.552+0100 [conn2530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.552+0100 [conn2531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.554+0100 [mongosMain] connection accepted from 172.28.0.164:58513 #2533 (113 connections now open) 2015-10-05T13:07:13.564+0100 [conn2533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.574+0100 [mongosMain] connection accepted from 172.28.0.164:58514 #2534 (114 connections now open) 2015-10-05T13:07:13.575+0100 [mongosMain] connection accepted from 172.28.0.164:58515 #2535 (115 connections now open) 2015-10-05T13:07:13.576+0100 [conn2534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.576+0100 [mongosMain] connection accepted from 172.28.0.164:58516 #2536 (116 connections now open) 2015-10-05T13:07:13.577+0100 [mongosMain] connection accepted from 172.28.0.164:58517 #2537 (117 connections now open) 2015-10-05T13:07:13.598+0100 [mongosMain] connection accepted from 172.28.0.164:58518 #2538 (118 connections now open) 2015-10-05T13:07:13.599+0100 [mongosMain] connection accepted from 172.28.0.164:58519 #2539 (119 connections now open) 2015-10-05T13:07:13.600+0100 [mongosMain] connection accepted from 172.28.0.164:58520 #2540 (120 connections now open) 2015-10-05T13:07:13.601+0100 [conn2538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.601+0100 [mongosMain] connection accepted from 172.28.0.164:58521 #2541 (121 connections now open) 2015-10-05T13:07:13.601+0100 [conn2539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.602+0100 [mongosMain] connection accepted from 172.28.0.164:58522 #2542 (122 connections now open) 2015-10-05T13:07:13.603+0100 [conn2541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.603+0100 [mongosMain] connection accepted from 172.28.0.164:58523 #2543 (123 connections now open) 2015-10-05T13:07:13.604+0100 [mongosMain] connection accepted from 172.28.0.164:58524 #2544 (124 connections now open) 2015-10-05T13:07:13.606+0100 [mongosMain] connection accepted from 172.28.0.164:58525 #2545 (125 connections now open) 2015-10-05T13:07:13.608+0100 [mongosMain] connection accepted from 172.28.0.164:58528 #2546 (126 connections now open) 2015-10-05T13:07:13.610+0100 [mongosMain] connection accepted from 172.28.0.164:58529 #2547 (127 connections now open) 2015-10-05T13:07:13.612+0100 [conn2546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.613+0100 [conn2547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.618+0100 [mongosMain] connection accepted from 172.28.0.164:58530 #2548 (128 connections now open) 2015-10-05T13:07:13.618+0100 [mongosMain] connection accepted from 172.28.0.164:58531 #2549 (129 connections now open) 2015-10-05T13:07:13.620+0100 [mongosMain] connection accepted from 172.28.0.164:58532 #2550 (130 connections now open) 2015-10-05T13:07:13.620+0100 [conn2549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.621+0100 [mongosMain] connection accepted from 172.28.0.164:58533 #2551 (131 connections now open) 2015-10-05T13:07:13.622+0100 [mongosMain] connection accepted from 172.28.0.164:58535 #2552 (132 connections now open) 2015-10-05T13:07:13.622+0100 [conn2532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.622+0100 [conn2550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.622+0100 [mongosMain] connection accepted from 172.28.0.164:58534 #2553 (133 connections now open) 2015-10-05T13:07:13.622+0100 [mongosMain] connection accepted from 172.28.0.164:58536 #2554 (134 connections now open) 2015-10-05T13:07:13.624+0100 [mongosMain] connection accepted from 172.28.0.164:58537 #2555 (135 connections now open) 2015-10-05T13:07:13.625+0100 [mongosMain] connection accepted from 172.28.0.164:58538 #2556 (136 connections now open) 2015-10-05T13:07:13.625+0100 [mongosMain] connection accepted from 172.28.0.164:58539 #2557 (137 connections now open) 2015-10-05T13:07:13.626+0100 [conn2551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.627+0100 [mongosMain] connection accepted from 172.28.0.164:58540 #2558 (138 connections now open) 2015-10-05T13:07:13.627+0100 [conn2555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.627+0100 [conn2557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.627+0100 [conn2556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.628+0100 [mongosMain] connection accepted from 172.28.0.164:58541 #2559 (139 connections now open) 2015-10-05T13:07:13.629+0100 [mongosMain] connection accepted from 172.28.0.164:58542 #2560 (140 connections now open) 2015-10-05T13:07:13.629+0100 [mongosMain] connection accepted from 172.28.0.164:58543 #2561 (141 connections now open) 2015-10-05T13:07:13.631+0100 [mongosMain] connection accepted from 172.28.0.164:58544 #2562 (142 connections now open) 2015-10-05T13:07:13.631+0100 [mongosMain] connection accepted from 172.28.0.164:58545 #2563 (143 connections now open) 2015-10-05T13:07:13.632+0100 [mongosMain] connection accepted from 172.28.0.164:58546 #2564 (144 connections now open) 2015-10-05T13:07:13.632+0100 [conn2561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.633+0100 [mongosMain] connection accepted from 172.28.0.164:58547 #2565 (145 connections now open) 2015-10-05T13:07:13.634+0100 [conn2564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.640+0100 [conn2563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.644+0100 [mongosMain] connection accepted from 172.28.0.164:58548 #2566 (146 connections now open) 2015-10-05T13:07:13.645+0100 [mongosMain] connection accepted from 172.28.0.164:58549 #2567 (147 connections now open) 2015-10-05T13:07:13.645+0100 [conn2537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.646+0100 [conn2536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.646+0100 [mongosMain] connection accepted from 172.28.0.164:58550 #2568 (148 connections now open) 2015-10-05T13:07:13.646+0100 [conn2566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.653+0100 [conn2568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.655+0100 [conn2542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.656+0100 [conn2544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.657+0100 [conn2543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.674+0100 [mongosMain] connection accepted from 172.28.0.164:58557 #2569 (149 connections now open) 2015-10-05T13:07:13.676+0100 [mongosMain] connection accepted from 172.28.0.164:58558 #2570 (150 connections now open) 2015-10-05T13:07:13.677+0100 [conn2569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.678+0100 [mongosMain] connection accepted from 172.28.0.164:58559 #2571 (151 connections now open) 2015-10-05T13:07:13.679+0100 [mongosMain] connection accepted from 172.28.0.164:58560 #2572 (152 connections now open) 2015-10-05T13:07:13.679+0100 [mongosMain] connection accepted from 172.28.0.164:58561 #2573 (153 connections now open) 2015-10-05T13:07:13.681+0100 [conn2571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.682+0100 [conn2548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.684+0100 [mongosMain] connection accepted from 172.28.0.164:58563 #2574 (154 connections now open) 2015-10-05T13:07:13.684+0100 [mongosMain] connection accepted from 172.28.0.164:58562 #2575 (155 connections now open) 2015-10-05T13:07:13.684+0100 [conn2554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.685+0100 [mongosMain] connection accepted from 172.28.0.164:58564 #2576 (156 connections now open) 2015-10-05T13:07:13.685+0100 [conn2552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.686+0100 [mongosMain] connection accepted from 172.28.0.164:58565 #2577 (157 connections now open) 2015-10-05T13:07:13.686+0100 [mongosMain] connection accepted from 172.28.0.164:58567 #2578 (158 connections now open) 2015-10-05T13:07:13.686+0100 [mongosMain] connection accepted from 172.28.0.164:58566 #2579 (159 connections now open) 2015-10-05T13:07:13.686+0100 [conn2558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.687+0100 [conn2574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.687+0100 [conn2562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.687+0100 [conn2559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.688+0100 [mongosMain] connection accepted from 172.28.0.164:58568 #2580 (160 connections now open) 2015-10-05T13:07:13.688+0100 [conn2575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.689+0100 [conn2576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.689+0100 [conn2565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.689+0100 [conn2578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.692+0100 [conn2579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.694+0100 [conn2560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.694+0100 [mongosMain] connection accepted from 172.28.0.164:58569 #2581 (161 connections now open) 2015-10-05T13:07:13.698+0100 [conn2535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.698+0100 [conn2581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.698+0100 [mongosMain] connection accepted from 172.28.0.164:58570 #2582 (162 connections now open) 2015-10-05T13:07:13.700+0100 [conn2540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.702+0100 [mongosMain] connection accepted from 172.28.0.164:58571 #2583 (163 connections now open) 2015-10-05T13:07:13.702+0100 [conn2567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.702+0100 [conn2582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.703+0100 [mongosMain] connection accepted from 172.28.0.164:58572 #2584 (164 connections now open) 2015-10-05T13:07:13.706+0100 [conn2584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.776+0100 [conn2545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.825+0100 [mongosMain] connection accepted from 172.28.0.164:58582 #2585 (165 connections now open) 2015-10-05T13:07:13.827+0100 [conn2585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.829+0100 [mongosMain] connection accepted from 172.28.0.164:58583 #2586 (166 connections now open) 2015-10-05T13:07:13.835+0100 [mongosMain] connection accepted from 172.28.0.164:58584 #2587 (167 connections now open) 2015-10-05T13:07:13.835+0100 [conn2553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.843+0100 [mongosMain] connection accepted from 172.28.0.164:58585 #2588 (168 connections now open) 2015-10-05T13:07:13.844+0100 [conn2577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.845+0100 [conn2580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.846+0100 [mongosMain] connection accepted from 172.28.0.164:58586 #2589 (169 connections now open) 2015-10-05T13:07:13.847+0100 [conn2587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.848+0100 [conn2588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.854+0100 [conn2589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.865+0100 [conn2583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.872+0100 [mongosMain] connection accepted from 172.28.0.164:58587 #2590 (170 connections now open) 2015-10-05T13:07:13.872+0100 [mongosMain] connection accepted from 172.28.0.164:58588 #2591 (171 connections now open) 2015-10-05T13:07:13.875+0100 [mongosMain] connection accepted from 172.28.0.164:58589 #2592 (172 connections now open) 2015-10-05T13:07:13.875+0100 [mongosMain] connection accepted from 172.28.0.164:58590 #2593 (173 connections now open) 2015-10-05T13:07:13.876+0100 [conn2591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.876+0100 [mongosMain] connection accepted from 172.28.0.164:58591 #2594 (174 connections now open) 2015-10-05T13:07:13.877+0100 [mongosMain] connection accepted from 172.28.0.164:58592 #2595 (175 connections now open) 2015-10-05T13:07:13.877+0100 [conn2592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.877+0100 [mongosMain] connection accepted from 172.28.0.164:58593 #2596 (176 connections now open) 2015-10-05T13:07:13.878+0100 [mongosMain] connection accepted from 172.28.0.164:58594 #2597 (177 connections now open) 2015-10-05T13:07:13.880+0100 [conn2596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.880+0100 [conn2595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.880+0100 [conn2597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.881+0100 [mongosMain] connection accepted from 172.28.0.164:58595 #2598 (178 connections now open) 2015-10-05T13:07:13.883+0100 [mongosMain] connection accepted from 172.28.0.164:58596 #2599 (179 connections now open) 2015-10-05T13:07:13.885+0100 [conn2599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.899+0100 [mongosMain] connection accepted from 172.28.0.164:58597 #2600 (180 connections now open) 2015-10-05T13:07:13.901+0100 [mongosMain] connection accepted from 172.28.0.164:58598 #2601 (181 connections now open) 2015-10-05T13:07:13.903+0100 [mongosMain] connection accepted from 172.28.0.164:58599 #2602 (182 connections now open) 2015-10-05T13:07:13.912+0100 [mongosMain] connection accepted from 172.28.0.164:58600 #2603 (183 connections now open) 2015-10-05T13:07:13.913+0100 [mongosMain] connection accepted from 172.28.0.164:58601 #2604 (184 connections now open) 2015-10-05T13:07:13.914+0100 [conn2603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.915+0100 [conn2604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.916+0100 [mongosMain] connection accepted from 172.28.0.164:58602 #2605 (185 connections now open) 2015-10-05T13:07:13.921+0100 [mongosMain] connection accepted from 172.28.0.164:58603 #2606 (186 connections now open) 2015-10-05T13:07:13.924+0100 [conn2606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.928+0100 [mongosMain] connection accepted from 172.28.0.164:58605 #2607 (187 connections now open) 2015-10-05T13:07:13.931+0100 [conn2607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.948+0100 [mongosMain] connection accepted from 172.28.0.164:58607 #2608 (188 connections now open) 2015-10-05T13:07:13.949+0100 [mongosMain] connection accepted from 172.28.0.164:58608 #2609 (189 connections now open) 2015-10-05T13:07:13.951+0100 [conn2608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.957+0100 [conn2609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.971+0100 [conn2570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.971+0100 [conn2573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.972+0100 [conn2572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.972+0100 [conn2586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.999+0100 [conn2594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:13.999+0100 [conn2590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.001+0100 [conn2593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.092+0100 [conn2600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.092+0100 [conn2605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.093+0100 [conn2601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.093+0100 [conn2602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:14.163+0100 [conn2598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:17.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267f512deab02e2997c05 2015-10-05T13:07:17.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:18.768+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:07:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:07:23.449+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561267fb12deab02e2997c06 2015-10-05T13:07:23.551+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:28.796+0100 [mongosMain] connection accepted from 127.0.0.1:55724 #2610 (190 connections now open) 2015-10-05T13:07:28.799+0100 [conn2610] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:28.800+0100 [conn2610] end connection 127.0.0.1:55724 (189 connections now open) 2015-10-05T13:07:29.701+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612680112deab02e2997c07 2015-10-05T13:07:29.769+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:35.222+0100 [conn2326] end connection 172.28.0.163:54239 (188 connections now open) 2015-10-05T13:07:35.223+0100 [mongosMain] connection accepted from 172.28.0.163:55729 #2611 (189 connections now open) 2015-10-05T13:07:35.225+0100 [conn2611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:36.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612680712deab02e2997c08 2015-10-05T13:07:36.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:39.379+0100 [mongosMain] connection accepted from 127.0.0.1:55730 #2612 (190 connections now open) 2015-10-05T13:07:39.381+0100 [conn2612] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:39.381+0100 [conn2612] end connection 127.0.0.1:55730 (189 connections now open) 2015-10-05T13:07:42.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612680e12deab02e2997c09 2015-10-05T13:07:42.409+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:48.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612681412deab02e2997c0a 2015-10-05T13:07:48.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:49.035+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:07:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:07:55.003+0100 [conn2388] end connection 172.28.0.164:57134 (188 connections now open) 2015-10-05T13:07:55.004+0100 [mongosMain] connection accepted from 172.28.0.164:58655 #2613 (189 connections now open) 2015-10-05T13:07:55.007+0100 [conn2613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:07:55.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612681a12deab02e2997c0b 2015-10-05T13:07:55.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:07:59.450+0100 [mongosMain] connection accepted from 172.28.0.164:58656 #2614 (190 connections now open) 2015-10-05T13:07:59.453+0100 [conn2614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:01.368+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612682112deab02e2997c0c 2015-10-05T13:08:01.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:02.985+0100 [mongosMain] connection accepted from 172.28.0.164:58657 #2615 (191 connections now open) 2015-10-05T13:08:02.985+0100 [mongosMain] connection accepted from 172.28.0.164:58658 #2616 (192 connections now open) 2015-10-05T13:08:02.987+0100 [conn2615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:02.989+0100 [conn2616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:07.723+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612682712deab02e2997c1b 2015-10-05T13:08:07.739+0100 [conn2342] end connection 172.28.0.163:54266 (191 connections now open) 2015-10-05T13:08:07.740+0100 [conn2353] end connection 172.28.0.163:54280 (190 connections now open) 2015-10-05T13:08:07.740+0100 [conn2346] end connection 172.28.0.163:54273 (190 connections now open) 2015-10-05T13:08:07.740+0100 [conn2347] end connection 172.28.0.163:54274 (190 connections now open) 2015-10-05T13:08:07.740+0100 [conn2364] end connection 172.28.0.163:54291 (188 connections now open) 2015-10-05T13:08:07.740+0100 [conn2336] end connection 172.28.0.163:54259 (187 connections now open) 2015-10-05T13:08:07.740+0100 [conn2333] end connection 172.28.0.163:54256 (185 connections now open) 2015-10-05T13:08:07.740+0100 [conn2360] end connection 172.28.0.163:54287 (185 connections now open) 2015-10-05T13:08:07.740+0100 [conn2334] end connection 172.28.0.163:54257 (183 connections now open) 2015-10-05T13:08:07.741+0100 [conn2344] end connection 172.28.0.163:54269 (183 connections now open) 2015-10-05T13:08:07.741+0100 [conn2611] end connection 172.28.0.163:55729 (182 connections now open) 2015-10-05T13:08:07.741+0100 [conn2335] end connection 172.28.0.163:54258 (181 connections now open) 2015-10-05T13:08:07.741+0100 [conn2348] end connection 172.28.0.163:54275 (181 connections now open) 2015-10-05T13:08:07.741+0100 [conn2358] end connection 172.28.0.163:54285 (178 connections now open) 2015-10-05T13:08:07.741+0100 [conn2355] end connection 172.28.0.163:54282 (178 connections now open) 2015-10-05T13:08:07.741+0100 [conn2362] end connection 172.28.0.163:54289 (177 connections now open) 2015-10-05T13:08:07.741+0100 [conn2365] end connection 172.28.0.163:54292 (176 connections now open) 2015-10-05T13:08:07.741+0100 [conn2357] end connection 172.28.0.163:54284 (174 connections now open) 2015-10-05T13:08:07.741+0100 [conn2363] end connection 172.28.0.163:54290 (173 connections now open) 2015-10-05T13:08:07.742+0100 [conn2327] end connection 172.28.0.163:54242 (172 connections now open) 2015-10-05T13:08:07.742+0100 [conn2500] end connection 172.28.0.163:55396 (171 connections now open) 2015-10-05T13:08:07.743+0100 [conn2314] end connection 172.28.0.163:54105 (170 connections now open) 2015-10-05T13:08:07.743+0100 [conn2339] end connection 172.28.0.163:54263 (169 connections now open) 2015-10-05T13:08:07.743+0100 [conn2338] end connection 172.28.0.163:54262 (168 connections now open) 2015-10-05T13:08:07.744+0100 [conn2462] end connection 172.28.0.163:55189 (167 connections now open) 2015-10-05T13:08:07.744+0100 [conn2337] end connection 172.28.0.163:54261 (166 connections now open) 2015-10-05T13:08:07.744+0100 [conn2343] end connection 172.28.0.163:54267 (166 connections now open) 2015-10-05T13:08:07.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:09.244+0100 [conn2330] end connection 172.28.0.163:54253 (164 connections now open) 2015-10-05T13:08:09.244+0100 [conn2345] end connection 172.28.0.163:54270 (163 connections now open) 2015-10-05T13:08:09.244+0100 [conn2519] end connection 172.28.0.163:55632 (162 connections now open) 2015-10-05T13:08:09.245+0100 [conn2361] end connection 172.28.0.163:54288 (161 connections now open) 2015-10-05T13:08:09.245+0100 [conn2496] end connection 172.28.0.163:55341 (160 connections now open) 2015-10-05T13:08:09.245+0100 [conn2356] end connection 172.28.0.163:54283 (159 connections now open) 2015-10-05T13:08:09.245+0100 [conn2359] end connection 172.28.0.163:54286 (158 connections now open) 2015-10-05T13:08:09.246+0100 [conn2341] end connection 172.28.0.163:54265 (157 connections now open) 2015-10-05T13:08:09.246+0100 [conn2351] end connection 172.28.0.163:54278 (156 connections now open) 2015-10-05T13:08:09.246+0100 [conn2350] end connection 172.28.0.163:54277 (155 connections now open) 2015-10-05T13:08:09.246+0100 [conn2454] end connection 172.28.0.163:55124 (154 connections now open) 2015-10-05T13:08:09.246+0100 [conn2329] end connection 172.28.0.163:54252 (153 connections now open) 2015-10-05T13:08:09.247+0100 [conn2354] end connection 172.28.0.163:54281 (152 connections now open) 2015-10-05T13:08:09.247+0100 [conn2525] end connection 172.28.0.163:55681 (151 connections now open) 2015-10-05T13:08:09.247+0100 [conn2349] end connection 172.28.0.163:54276 (150 connections now open) 2015-10-05T13:08:09.247+0100 [conn2331] end connection 172.28.0.163:54254 (149 connections now open) 2015-10-05T13:08:09.248+0100 [conn2332] end connection 172.28.0.163:54255 (148 connections now open) 2015-10-05T13:08:09.248+0100 [conn2465] end connection 172.28.0.163:55266 (147 connections now open) 2015-10-05T13:08:09.248+0100 [conn2510] end connection 172.28.0.163:55521 (146 connections now open) 2015-10-05T13:08:09.248+0100 [conn2515] end connection 172.28.0.163:55579 (145 connections now open) 2015-10-05T13:08:09.249+0100 [conn2340] end connection 172.28.0.163:54264 (144 connections now open) 2015-10-05T13:08:09.249+0100 [conn2506] end connection 172.28.0.163:55450 (143 connections now open) 2015-10-05T13:08:09.249+0100 [conn2352] end connection 172.28.0.163:54279 (142 connections now open) 2015-10-05T13:08:09.249+0100 [conn2328] end connection 172.28.0.163:54251 (141 connections now open) 2015-10-05T13:08:14.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612682d12deab02e2997c1c 2015-10-05T13:08:14.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:19.301+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:08:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:08:20.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612683412deab02e2997c1d 2015-10-05T13:08:20.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:26.852+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:08:26.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:08:29.005+0100 [mongosMain] connection accepted from 127.0.0.1:55774 #2617 (142 connections now open) 2015-10-05T13:08:29.007+0100 [conn2617] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.008+0100 [conn2617] end connection 127.0.0.1:55774 (141 connections now open) 2015-10-05T13:08:29.665+0100 [mongosMain] connection accepted from 172.28.0.164:58673 #2618 (142 connections now open) 2015-10-05T13:08:29.666+0100 [mongosMain] connection accepted from 172.28.0.164:58674 #2619 (143 connections now open) 2015-10-05T13:08:29.666+0100 [mongosMain] connection accepted from 172.28.0.164:58675 #2620 (144 connections now open) 2015-10-05T13:08:29.667+0100 [mongosMain] connection accepted from 172.28.0.164:58676 #2621 (145 connections now open) 2015-10-05T13:08:29.667+0100 [mongosMain] connection accepted from 172.28.0.164:58677 #2622 (146 connections now open) 2015-10-05T13:08:29.667+0100 [mongosMain] connection accepted from 172.28.0.164:58678 #2623 (147 connections now open) 2015-10-05T13:08:29.668+0100 [conn2618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.668+0100 [conn2619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.669+0100 [conn2620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.669+0100 [conn2621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.670+0100 [conn2623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.670+0100 [conn2622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.691+0100 [mongosMain] connection accepted from 172.28.0.164:58679 #2624 (148 connections now open) 2015-10-05T13:08:29.691+0100 [mongosMain] connection accepted from 172.28.0.164:58680 #2625 (149 connections now open) 2015-10-05T13:08:29.698+0100 [conn2624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.698+0100 [conn2625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.700+0100 [mongosMain] connection accepted from 172.28.0.164:58681 #2626 (150 connections now open) 2015-10-05T13:08:29.700+0100 [mongosMain] connection accepted from 172.28.0.164:58682 #2627 (151 connections now open) 2015-10-05T13:08:29.702+0100 [conn2627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.702+0100 [conn2626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.703+0100 [mongosMain] connection accepted from 172.28.0.164:58684 #2628 (152 connections now open) 2015-10-05T13:08:29.703+0100 [mongosMain] connection accepted from 172.28.0.164:58683 #2629 (153 connections now open) 2015-10-05T13:08:29.705+0100 [conn2628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.706+0100 [conn2629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.706+0100 [mongosMain] connection accepted from 172.28.0.164:58685 #2630 (154 connections now open) 2015-10-05T13:08:29.706+0100 [mongosMain] connection accepted from 172.28.0.164:58686 #2631 (155 connections now open) 2015-10-05T13:08:29.706+0100 [mongosMain] connection accepted from 172.28.0.164:58687 #2632 (156 connections now open) 2015-10-05T13:08:29.707+0100 [mongosMain] connection accepted from 172.28.0.164:58688 #2633 (157 connections now open) 2015-10-05T13:08:29.707+0100 [conn2630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.708+0100 [conn2631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.708+0100 [conn2632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.709+0100 [conn2633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.709+0100 [mongosMain] connection accepted from 172.28.0.164:58689 #2634 (158 connections now open) 2015-10-05T13:08:29.709+0100 [mongosMain] connection accepted from 172.28.0.164:58690 #2635 (159 connections now open) 2015-10-05T13:08:29.710+0100 [mongosMain] connection accepted from 172.28.0.164:58691 #2636 (160 connections now open) 2015-10-05T13:08:29.710+0100 [mongosMain] connection accepted from 172.28.0.164:58692 #2637 (161 connections now open) 2015-10-05T13:08:29.710+0100 [mongosMain] connection accepted from 172.28.0.164:58693 #2638 (162 connections now open) 2015-10-05T13:08:29.710+0100 [mongosMain] connection accepted from 172.28.0.164:58694 #2639 (163 connections now open) 2015-10-05T13:08:29.710+0100 [conn2634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.711+0100 [mongosMain] connection accepted from 172.28.0.164:58695 #2640 (164 connections now open) 2015-10-05T13:08:29.711+0100 [mongosMain] connection accepted from 172.28.0.164:58696 #2641 (165 connections now open) 2015-10-05T13:08:29.711+0100 [conn2635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.711+0100 [mongosMain] connection accepted from 172.28.0.164:58697 #2642 (166 connections now open) 2015-10-05T13:08:29.712+0100 [conn2638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.712+0100 [conn2639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.712+0100 [conn2637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.712+0100 [mongosMain] connection accepted from 172.28.0.164:58698 #2643 (167 connections now open) 2015-10-05T13:08:29.712+0100 [conn2640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.713+0100 [conn2641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.713+0100 [conn2642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.714+0100 [mongosMain] connection accepted from 172.28.0.164:58699 #2644 (168 connections now open) 2015-10-05T13:08:29.714+0100 [mongosMain] connection accepted from 172.28.0.164:58700 #2645 (169 connections now open) 2015-10-05T13:08:29.715+0100 [conn2644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.716+0100 [mongosMain] connection accepted from 172.28.0.164:58701 #2646 (170 connections now open) 2015-10-05T13:08:29.716+0100 [conn2645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.716+0100 [mongosMain] connection accepted from 172.28.0.164:58702 #2647 (171 connections now open) 2015-10-05T13:08:29.716+0100 [mongosMain] connection accepted from 172.28.0.164:58703 #2648 (172 connections now open) 2015-10-05T13:08:29.717+0100 [mongosMain] connection accepted from 172.28.0.164:58704 #2649 (173 connections now open) 2015-10-05T13:08:29.717+0100 [mongosMain] connection accepted from 172.28.0.164:58705 #2650 (174 connections now open) 2015-10-05T13:08:29.717+0100 [mongosMain] connection accepted from 172.28.0.164:58706 #2651 (175 connections now open) 2015-10-05T13:08:29.718+0100 [conn2646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.719+0100 [conn2647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.719+0100 [mongosMain] connection accepted from 172.28.0.164:58707 #2652 (176 connections now open) 2015-10-05T13:08:29.719+0100 [mongosMain] connection accepted from 172.28.0.164:58708 #2653 (177 connections now open) 2015-10-05T13:08:29.719+0100 [conn2649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.720+0100 [conn2651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.720+0100 [mongosMain] connection accepted from 172.28.0.164:58709 #2654 (178 connections now open) 2015-10-05T13:08:29.720+0100 [mongosMain] connection accepted from 172.28.0.164:58710 #2655 (179 connections now open) 2015-10-05T13:08:29.721+0100 [mongosMain] connection accepted from 172.28.0.164:58711 #2656 (180 connections now open) 2015-10-05T13:08:29.721+0100 [conn2653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.721+0100 [mongosMain] connection accepted from 172.28.0.164:58712 #2657 (181 connections now open) 2015-10-05T13:08:29.721+0100 [mongosMain] connection accepted from 172.28.0.164:58713 #2658 (182 connections now open) 2015-10-05T13:08:29.721+0100 [mongosMain] connection accepted from 172.28.0.164:58714 #2659 (183 connections now open) 2015-10-05T13:08:29.722+0100 [conn2654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.722+0100 [mongosMain] connection accepted from 172.28.0.164:58715 #2660 (184 connections now open) 2015-10-05T13:08:29.722+0100 [conn2655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.723+0100 [conn2656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.723+0100 [mongosMain] connection accepted from 172.28.0.164:58717 #2661 (185 connections now open) 2015-10-05T13:08:29.723+0100 [conn2658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.724+0100 [conn2659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.724+0100 [conn2660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.725+0100 [conn2661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.726+0100 [mongosMain] connection accepted from 172.28.0.164:58719 #2662 (186 connections now open) 2015-10-05T13:08:29.727+0100 [mongosMain] connection accepted from 172.28.0.164:58718 #2663 (187 connections now open) 2015-10-05T13:08:29.727+0100 [mongosMain] connection accepted from 172.28.0.164:58720 #2664 (188 connections now open) 2015-10-05T13:08:29.727+0100 [mongosMain] connection accepted from 172.28.0.164:58721 #2665 (189 connections now open) 2015-10-05T13:08:29.728+0100 [conn2662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.729+0100 [conn2663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.729+0100 [mongosMain] connection accepted from 172.28.0.164:58722 #2666 (190 connections now open) 2015-10-05T13:08:29.729+0100 [conn2664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.729+0100 [conn2665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.729+0100 [mongosMain] connection accepted from 172.28.0.164:58723 #2667 (191 connections now open) 2015-10-05T13:08:29.729+0100 [mongosMain] connection accepted from 172.28.0.164:58724 #2668 (192 connections now open) 2015-10-05T13:08:29.730+0100 [mongosMain] connection accepted from 172.28.0.164:58725 #2669 (193 connections now open) 2015-10-05T13:08:29.731+0100 [conn2667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.731+0100 [conn2668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.735+0100 [conn2669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.737+0100 [mongosMain] connection accepted from 172.28.0.164:58726 #2670 (194 connections now open) 2015-10-05T13:08:29.747+0100 [mongosMain] connection accepted from 172.28.0.164:58728 #2671 (195 connections now open) 2015-10-05T13:08:29.752+0100 [mongosMain] connection accepted from 172.28.0.164:58727 #2672 (196 connections now open) 2015-10-05T13:08:29.754+0100 [conn2671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.754+0100 [conn2670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.754+0100 [conn2672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.756+0100 [mongosMain] connection accepted from 172.28.0.164:58729 #2673 (197 connections now open) 2015-10-05T13:08:29.757+0100 [mongosMain] connection accepted from 172.28.0.164:58731 #2674 (198 connections now open) 2015-10-05T13:08:29.757+0100 [mongosMain] connection accepted from 172.28.0.164:58730 #2675 (199 connections now open) 2015-10-05T13:08:29.758+0100 [mongosMain] connection accepted from 172.28.0.164:58732 #2676 (200 connections now open) 2015-10-05T13:08:29.758+0100 [mongosMain] connection accepted from 172.28.0.164:58733 #2677 (201 connections now open) 2015-10-05T13:08:29.759+0100 [mongosMain] connection accepted from 172.28.0.164:58734 #2678 (202 connections now open) 2015-10-05T13:08:29.762+0100 [conn2676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.762+0100 [conn2675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.762+0100 [conn2677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.763+0100 [conn2678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.764+0100 [mongosMain] connection accepted from 172.28.0.164:58735 #2679 (203 connections now open) 2015-10-05T13:08:29.765+0100 [mongosMain] connection accepted from 172.28.0.164:58736 #2680 (204 connections now open) 2015-10-05T13:08:29.777+0100 [conn2680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.780+0100 [mongosMain] connection accepted from 172.28.0.164:58737 #2681 (205 connections now open) 2015-10-05T13:08:29.780+0100 [mongosMain] connection accepted from 172.28.0.164:58738 #2682 (206 connections now open) 2015-10-05T13:08:29.783+0100 [mongosMain] connection accepted from 172.28.0.164:58739 #2683 (207 connections now open) 2015-10-05T13:08:29.783+0100 [conn2682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.785+0100 [mongosMain] connection accepted from 172.28.0.164:58740 #2684 (208 connections now open) 2015-10-05T13:08:29.785+0100 [conn2683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.785+0100 [mongosMain] connection accepted from 172.28.0.164:58741 #2685 (209 connections now open) 2015-10-05T13:08:29.786+0100 [mongosMain] connection accepted from 172.28.0.164:58742 #2686 (210 connections now open) 2015-10-05T13:08:29.786+0100 [mongosMain] connection accepted from 172.28.0.164:58743 #2687 (211 connections now open) 2015-10-05T13:08:29.786+0100 [mongosMain] connection accepted from 172.28.0.164:58745 #2688 (212 connections now open) 2015-10-05T13:08:29.786+0100 [mongosMain] connection accepted from 172.28.0.164:58744 #2689 (213 connections now open) 2015-10-05T13:08:29.787+0100 [mongosMain] connection accepted from 172.28.0.164:58746 #2690 (214 connections now open) 2015-10-05T13:08:29.787+0100 [mongosMain] connection accepted from 172.28.0.164:58747 #2691 (215 connections now open) 2015-10-05T13:08:29.787+0100 [mongosMain] connection accepted from 172.28.0.164:58748 #2692 (216 connections now open) 2015-10-05T13:08:29.788+0100 [mongosMain] connection accepted from 172.28.0.164:58749 #2693 (217 connections now open) 2015-10-05T13:08:29.789+0100 [mongosMain] connection accepted from 172.28.0.164:58750 #2694 (218 connections now open) 2015-10-05T13:08:29.789+0100 [mongosMain] connection accepted from 172.28.0.164:58751 #2695 (219 connections now open) 2015-10-05T13:08:29.790+0100 [conn2685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.790+0100 [conn2687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.790+0100 [conn2689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.790+0100 [conn2688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.790+0100 [conn2691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.791+0100 [conn2686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.791+0100 [mongosMain] connection accepted from 172.28.0.164:58752 #2696 (220 connections now open) 2015-10-05T13:08:29.792+0100 [mongosMain] connection accepted from 172.28.0.164:58753 #2697 (221 connections now open) 2015-10-05T13:08:29.792+0100 [conn2695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.792+0100 [conn2694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.792+0100 [mongosMain] connection accepted from 172.28.0.164:58754 #2698 (222 connections now open) 2015-10-05T13:08:29.794+0100 [conn2696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.795+0100 [conn2697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.796+0100 [conn2698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.805+0100 [conn2636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.805+0100 [conn2643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.806+0100 [mongosMain] connection accepted from 172.28.0.164:58755 #2699 (223 connections now open) 2015-10-05T13:08:29.808+0100 [conn2650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.812+0100 [conn2699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.821+0100 [conn2657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.834+0100 [conn2648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.871+0100 [conn2674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.871+0100 [conn2673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.874+0100 [conn2679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.891+0100 [conn2681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.894+0100 [conn2692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.894+0100 [conn2684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.894+0100 [conn2693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.963+0100 [conn2652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:29.991+0100 [conn2666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:30.091+0100 [conn2690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:33.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612684012deab02e2997d49 2015-10-05T13:08:33.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:39.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612684712deab02e2997f44 2015-10-05T13:08:39.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:40.172+0100 [mongosMain] connection accepted from 127.0.0.1:55778 #2700 (224 connections now open) 2015-10-05T13:08:40.175+0100 [conn2700] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:40.175+0100 [conn2700] end connection 127.0.0.1:55778 (223 connections now open) 2015-10-05T13:08:45.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612684d12deab02e2997f45 2015-10-05T13:08:45.914+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:49.572+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:08:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:08:52.202+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612685312deab02e2997f46 2015-10-05T13:08:52.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:08:55.019+0100 [conn2389] end connection 172.28.0.164:57138 (222 connections now open) 2015-10-05T13:08:55.021+0100 [mongosMain] connection accepted from 172.28.0.164:58813 #2701 (223 connections now open) 2015-10-05T13:08:55.023+0100 [conn2701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:08:58.590+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612685a12deab02e2997f47 2015-10-05T13:08:58.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:05.013+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612686012deab02e2997f48 2015-10-05T13:09:05.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:11.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612686712deab02e2997f49 2015-10-05T13:09:11.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:17.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612686d12deab02e2997f4a 2015-10-05T13:09:17.789+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:19.839+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:09:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:09:24.042+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612687312deab02e2997f4b 2015-10-05T13:09:24.178+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:28.526+0100 [mongosMain] connection accepted from 127.0.0.1:55823 #2702 (224 connections now open) 2015-10-05T13:09:28.529+0100 [conn2702] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:09:28.530+0100 [conn2702] end connection 127.0.0.1:55823 (223 connections now open) 2015-10-05T13:09:30.293+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:09:30.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:09:36.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612688012deab02e2997f4d 2015-10-05T13:09:36.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:39.181+0100 [mongosMain] connection accepted from 127.0.0.1:55824 #2703 (224 connections now open) 2015-10-05T13:09:39.184+0100 [conn2703] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:09:39.184+0100 [conn2703] end connection 127.0.0.1:55824 (223 connections now open) 2015-10-05T13:09:48.811+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612688c12deab02e2997f4e 2015-10-05T13:09:48.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:09:50.109+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:09:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:09:55.036+0100 [conn2390] end connection 172.28.0.164:57141 (222 connections now open) 2015-10-05T13:09:55.037+0100 [mongosMain] connection accepted from 172.28.0.164:58857 #2704 (223 connections now open) 2015-10-05T13:09:55.039+0100 [conn2704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:10:01.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612689812deab02e2997f50 2015-10-05T13:10:01.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:13.600+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:10:13.600+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:10:20.328+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:10:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:10:25.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268b112deab02e2997f52 2015-10-05T13:10:25.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:28.306+0100 [mongosMain] connection accepted from 127.0.0.1:55863 #2705 (224 connections now open) 2015-10-05T13:10:28.309+0100 [conn2705] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:10:28.310+0100 [conn2705] end connection 127.0.0.1:55863 (223 connections now open) 2015-10-05T13:10:32.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268b712deab02e2997f53 2015-10-05T13:10:32.253+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:36.412+0100 [conn299] end connection 172.21.40.52:54465 (222 connections now open) 2015-10-05T13:10:38.401+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268be12deab02e2997f54 2015-10-05T13:10:38.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:39.477+0100 [mongosMain] connection accepted from 127.0.0.1:55865 #2706 (223 connections now open) 2015-10-05T13:10:39.480+0100 [conn2706] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:10:39.481+0100 [conn2706] end connection 127.0.0.1:55865 (222 connections now open) 2015-10-05T13:10:44.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268c412deab02e2997f56 2015-10-05T13:10:44.889+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:50.591+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:10:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:10:51.173+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268ca12deab02e2997f57 2015-10-05T13:10:51.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:10:55.052+0100 [conn2391] end connection 172.28.0.164:57145 (221 connections now open) 2015-10-05T13:10:55.053+0100 [mongosMain] connection accepted from 172.28.0.164:58908 #2707 (222 connections now open) 2015-10-05T13:10:55.056+0100 [conn2707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:10:57.588+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268d112deab02e2997f58 2015-10-05T13:10:57.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:04.010+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268d712deab02e2997f59 2015-10-05T13:11:04.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:10.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268de12deab02e2997f5a 2015-10-05T13:11:10.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:12.962+0100 [mongosMain] connection accepted from 172.28.0.163:55929 #2708 (223 connections now open) 2015-10-05T13:11:13.021+0100 [mongosMain] connection accepted from 172.28.0.163:55933 #2709 (224 connections now open) 2015-10-05T13:11:13.480+0100 [conn2708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.481+0100 [conn2709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.494+0100 [mongosMain] connection accepted from 172.28.0.163:55947 #2710 (225 connections now open) 2015-10-05T13:11:13.495+0100 [conn2710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.497+0100 [mongosMain] connection accepted from 172.28.0.163:55949 #2711 (226 connections now open) 2015-10-05T13:11:13.499+0100 [conn2711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.500+0100 [mongosMain] connection accepted from 172.28.0.163:55954 #2712 (227 connections now open) 2015-10-05T13:11:13.502+0100 [conn2712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.503+0100 [mongosMain] connection accepted from 172.28.0.163:55956 #2713 (228 connections now open) 2015-10-05T13:11:13.505+0100 [conn2713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.506+0100 [mongosMain] connection accepted from 172.28.0.163:55962 #2714 (229 connections now open) 2015-10-05T13:11:13.507+0100 [conn2714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.509+0100 [mongosMain] connection accepted from 172.28.0.163:55963 #2715 (230 connections now open) 2015-10-05T13:11:13.510+0100 [conn2715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.512+0100 [mongosMain] connection accepted from 172.28.0.163:55965 #2716 (231 connections now open) 2015-10-05T13:11:13.513+0100 [conn2716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.514+0100 [mongosMain] connection accepted from 172.28.0.163:55967 #2717 (232 connections now open) 2015-10-05T13:11:13.515+0100 [conn2717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.517+0100 [mongosMain] connection accepted from 172.28.0.163:55968 #2718 (233 connections now open) 2015-10-05T13:11:13.518+0100 [conn2718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.520+0100 [mongosMain] connection accepted from 172.28.0.163:55971 #2719 (234 connections now open) 2015-10-05T13:11:13.521+0100 [conn2719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.522+0100 [mongosMain] connection accepted from 172.28.0.163:55972 #2720 (235 connections now open) 2015-10-05T13:11:13.523+0100 [conn2720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.525+0100 [mongosMain] connection accepted from 172.28.0.163:55974 #2721 (236 connections now open) 2015-10-05T13:11:13.526+0100 [conn2721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.528+0100 [mongosMain] connection accepted from 172.28.0.163:55975 #2722 (237 connections now open) 2015-10-05T13:11:13.529+0100 [conn2722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.530+0100 [mongosMain] connection accepted from 172.28.0.163:55977 #2723 (238 connections now open) 2015-10-05T13:11:13.532+0100 [conn2723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.533+0100 [mongosMain] connection accepted from 172.28.0.163:55979 #2724 (239 connections now open) 2015-10-05T13:11:13.535+0100 [conn2724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.536+0100 [mongosMain] connection accepted from 172.28.0.163:55980 #2725 (240 connections now open) 2015-10-05T13:11:13.537+0100 [conn2725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.538+0100 [mongosMain] connection accepted from 172.28.0.163:55982 #2726 (241 connections now open) 2015-10-05T13:11:13.539+0100 [conn2726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.540+0100 [mongosMain] connection accepted from 172.28.0.163:55983 #2727 (242 connections now open) 2015-10-05T13:11:13.541+0100 [conn2727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.543+0100 [mongosMain] connection accepted from 172.28.0.163:55985 #2728 (243 connections now open) 2015-10-05T13:11:13.544+0100 [conn2728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.545+0100 [mongosMain] connection accepted from 172.28.0.163:55986 #2729 (244 connections now open) 2015-10-05T13:11:13.547+0100 [conn2729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.548+0100 [mongosMain] connection accepted from 172.28.0.163:55988 #2730 (245 connections now open) 2015-10-05T13:11:13.550+0100 [conn2730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.551+0100 [mongosMain] connection accepted from 172.28.0.163:55989 #2731 (246 connections now open) 2015-10-05T13:11:13.553+0100 [conn2731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.554+0100 [mongosMain] connection accepted from 172.28.0.163:55992 #2732 (247 connections now open) 2015-10-05T13:11:13.555+0100 [conn2732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.557+0100 [mongosMain] connection accepted from 172.28.0.163:55994 #2733 (248 connections now open) 2015-10-05T13:11:13.558+0100 [conn2733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.560+0100 [mongosMain] connection accepted from 172.28.0.163:55995 #2734 (249 connections now open) 2015-10-05T13:11:13.561+0100 [conn2734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.563+0100 [mongosMain] connection accepted from 172.28.0.163:55997 #2735 (250 connections now open) 2015-10-05T13:11:13.564+0100 [conn2735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.566+0100 [mongosMain] connection accepted from 172.28.0.163:55998 #2736 (251 connections now open) 2015-10-05T13:11:13.567+0100 [conn2736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.568+0100 [mongosMain] connection accepted from 172.28.0.163:56000 #2737 (252 connections now open) 2015-10-05T13:11:13.570+0100 [conn2737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.571+0100 [mongosMain] connection accepted from 172.28.0.163:56001 #2738 (253 connections now open) 2015-10-05T13:11:13.573+0100 [conn2738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.575+0100 [mongosMain] connection accepted from 172.28.0.163:56003 #2739 (254 connections now open) 2015-10-05T13:11:13.576+0100 [conn2739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.578+0100 [mongosMain] connection accepted from 172.28.0.163:56005 #2740 (255 connections now open) 2015-10-05T13:11:13.579+0100 [conn2740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.580+0100 [mongosMain] connection accepted from 172.28.0.163:56006 #2741 (256 connections now open) 2015-10-05T13:11:13.582+0100 [conn2741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.583+0100 [mongosMain] connection accepted from 172.28.0.163:56008 #2742 (257 connections now open) 2015-10-05T13:11:13.585+0100 [conn2742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.586+0100 [mongosMain] connection accepted from 172.28.0.163:56010 #2743 (258 connections now open) 2015-10-05T13:11:13.588+0100 [conn2743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.589+0100 [mongosMain] connection accepted from 172.28.0.163:56011 #2744 (259 connections now open) 2015-10-05T13:11:13.591+0100 [conn2744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.592+0100 [mongosMain] connection accepted from 172.28.0.163:56013 #2745 (260 connections now open) 2015-10-05T13:11:13.594+0100 [conn2745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.596+0100 [mongosMain] connection accepted from 172.28.0.163:56014 #2746 (261 connections now open) 2015-10-05T13:11:13.597+0100 [conn2746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.599+0100 [mongosMain] connection accepted from 172.28.0.163:56016 #2747 (262 connections now open) 2015-10-05T13:11:13.600+0100 [conn2747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.602+0100 [mongosMain] connection accepted from 172.28.0.163:56018 #2748 (263 connections now open) 2015-10-05T13:11:13.603+0100 [conn2748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.605+0100 [mongosMain] connection accepted from 172.28.0.163:56019 #2749 (264 connections now open) 2015-10-05T13:11:13.606+0100 [conn2749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.608+0100 [mongosMain] connection accepted from 172.28.0.163:56021 #2750 (265 connections now open) 2015-10-05T13:11:13.610+0100 [conn2750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.611+0100 [mongosMain] connection accepted from 172.28.0.163:56023 #2751 (266 connections now open) 2015-10-05T13:11:13.613+0100 [conn2751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.614+0100 [mongosMain] connection accepted from 172.28.0.163:56024 #2752 (267 connections now open) 2015-10-05T13:11:13.616+0100 [conn2752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.618+0100 [mongosMain] connection accepted from 172.28.0.163:56026 #2753 (268 connections now open) 2015-10-05T13:11:13.619+0100 [conn2753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.621+0100 [mongosMain] connection accepted from 172.28.0.163:56028 #2754 (269 connections now open) 2015-10-05T13:11:13.623+0100 [conn2754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.624+0100 [mongosMain] connection accepted from 172.28.0.163:56029 #2755 (270 connections now open) 2015-10-05T13:11:13.625+0100 [conn2755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.627+0100 [mongosMain] connection accepted from 172.28.0.163:56031 #2756 (271 connections now open) 2015-10-05T13:11:13.628+0100 [conn2756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.630+0100 [mongosMain] connection accepted from 172.28.0.163:56033 #2757 (272 connections now open) 2015-10-05T13:11:13.631+0100 [conn2757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:13.633+0100 [mongosMain] connection accepted from 172.28.0.163:56034 #2758 (273 connections now open) 2015-10-05T13:11:13.634+0100 [conn2758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:16.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268e412deab02e2997f5b 2015-10-05T13:11:16.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:20.884+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:11:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:11:23.143+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268ea12deab02e2997f5c 2015-10-05T13:11:23.278+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:28.758+0100 [mongosMain] connection accepted from 127.0.0.1:56063 #2759 (274 connections now open) 2015-10-05T13:11:28.760+0100 [conn2759] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:28.762+0100 [conn2759] end connection 127.0.0.1:56063 (273 connections now open) 2015-10-05T13:11:29.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268f112deab02e2997f5d 2015-10-05T13:11:29.700+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:35.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268f712deab02e2997f5e 2015-10-05T13:11:35.916+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:39.500+0100 [mongosMain] connection accepted from 127.0.0.1:56064 #2760 (274 connections now open) 2015-10-05T13:11:39.503+0100 [conn2760] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:39.503+0100 [conn2760] end connection 127.0.0.1:56064 (273 connections now open) 2015-10-05T13:11:41.964+0100 [mongosMain] connection accepted from 172.28.0.164:58948 #2761 (274 connections now open) 2015-10-05T13:11:41.968+0100 [conn2761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.004+0100 [mongosMain] connection accepted from 172.28.0.164:58950 #2762 (275 connections now open) 2015-10-05T13:11:42.004+0100 [mongosMain] connection accepted from 172.28.0.164:58951 #2763 (276 connections now open) 2015-10-05T13:11:42.006+0100 [conn2762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.007+0100 [conn2763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.007+0100 [mongosMain] connection accepted from 172.28.0.164:58952 #2764 (277 connections now open) 2015-10-05T13:11:42.008+0100 [mongosMain] connection accepted from 172.28.0.164:58953 #2765 (278 connections now open) 2015-10-05T13:11:42.010+0100 [conn2764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.011+0100 [conn2765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.011+0100 [mongosMain] connection accepted from 172.28.0.164:58954 #2766 (279 connections now open) 2015-10-05T13:11:42.012+0100 [mongosMain] connection accepted from 172.28.0.164:58955 #2767 (280 connections now open) 2015-10-05T13:11:42.014+0100 [conn2767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.015+0100 [mongosMain] connection accepted from 172.28.0.164:58956 #2768 (281 connections now open) 2015-10-05T13:11:42.015+0100 [mongosMain] connection accepted from 172.28.0.164:58957 #2769 (282 connections now open) 2015-10-05T13:11:42.017+0100 [conn2768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.018+0100 [mongosMain] connection accepted from 172.28.0.164:58958 #2770 (283 connections now open) 2015-10-05T13:11:42.018+0100 [mongosMain] connection accepted from 172.28.0.164:58959 #2771 (284 connections now open) 2015-10-05T13:11:42.020+0100 [conn2770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.020+0100 [conn2771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.063+0100 [mongosMain] connection accepted from 172.28.0.164:58960 #2772 (285 connections now open) 2015-10-05T13:11:42.066+0100 [conn2772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.066+0100 [mongosMain] connection accepted from 172.28.0.164:58961 #2773 (286 connections now open) 2015-10-05T13:11:42.067+0100 [mongosMain] connection accepted from 172.28.0.164:58962 #2774 (287 connections now open) 2015-10-05T13:11:42.069+0100 [conn2773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.070+0100 [conn2774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.079+0100 [mongosMain] connection accepted from 172.28.0.164:58963 #2775 (288 connections now open) 2015-10-05T13:11:42.080+0100 [mongosMain] connection accepted from 172.28.0.164:58964 #2776 (289 connections now open) 2015-10-05T13:11:42.081+0100 [mongosMain] connection accepted from 172.28.0.164:58965 #2777 (290 connections now open) 2015-10-05T13:11:42.082+0100 [mongosMain] connection accepted from 172.28.0.164:58966 #2778 (291 connections now open) 2015-10-05T13:11:42.083+0100 [conn2776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.083+0100 [conn2775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.085+0100 [mongosMain] connection accepted from 172.28.0.164:58967 #2779 (292 connections now open) 2015-10-05T13:11:42.085+0100 [mongosMain] connection accepted from 172.28.0.164:58968 #2780 (293 connections now open) 2015-10-05T13:11:42.086+0100 [mongosMain] connection accepted from 172.28.0.164:58969 #2781 (294 connections now open) 2015-10-05T13:11:42.086+0100 [mongosMain] connection accepted from 172.28.0.164:58970 #2782 (295 connections now open) 2015-10-05T13:11:42.087+0100 [conn2780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.088+0100 [mongosMain] connection accepted from 172.28.0.164:58971 #2783 (296 connections now open) 2015-10-05T13:11:42.088+0100 [conn2781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.088+0100 [mongosMain] connection accepted from 172.28.0.164:58972 #2784 (297 connections now open) 2015-10-05T13:11:42.089+0100 [conn2782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.089+0100 [mongosMain] connection accepted from 172.28.0.164:58973 #2785 (298 connections now open) 2015-10-05T13:11:42.090+0100 [mongosMain] connection accepted from 172.28.0.164:58974 #2786 (299 connections now open) 2015-10-05T13:11:42.090+0100 [conn2783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.091+0100 [conn2784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.091+0100 [conn2785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.092+0100 [conn2786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.092+0100 [mongosMain] connection accepted from 172.28.0.164:58975 #2787 (300 connections now open) 2015-10-05T13:11:42.093+0100 [mongosMain] connection accepted from 172.28.0.164:58976 #2788 (301 connections now open) 2015-10-05T13:11:42.095+0100 [conn2787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.095+0100 [conn2788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.098+0100 [mongosMain] connection accepted from 172.28.0.164:58978 #2789 (302 connections now open) 2015-10-05T13:11:42.099+0100 [mongosMain] connection accepted from 172.28.0.164:58979 #2790 (303 connections now open) 2015-10-05T13:11:42.099+0100 [mongosMain] connection accepted from 172.28.0.164:58980 #2791 (304 connections now open) 2015-10-05T13:11:42.099+0100 [mongosMain] connection accepted from 172.28.0.164:58981 #2792 (305 connections now open) 2015-10-05T13:11:42.100+0100 [mongosMain] connection accepted from 172.28.0.164:58982 #2793 (306 connections now open) 2015-10-05T13:11:42.101+0100 [conn2789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.101+0100 [mongosMain] connection accepted from 172.28.0.164:58983 #2794 (307 connections now open) 2015-10-05T13:11:42.101+0100 [conn2791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.101+0100 [mongosMain] connection accepted from 172.28.0.164:58984 #2795 (308 connections now open) 2015-10-05T13:11:42.102+0100 [mongosMain] connection accepted from 172.28.0.164:58985 #2796 (309 connections now open) 2015-10-05T13:11:42.103+0100 [conn2792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.103+0100 [conn2793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.103+0100 [conn2790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.104+0100 [conn2794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.104+0100 [conn2796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.106+0100 [mongosMain] connection accepted from 172.28.0.164:58986 #2797 (310 connections now open) 2015-10-05T13:11:42.107+0100 [mongosMain] connection accepted from 172.28.0.164:58987 #2798 (311 connections now open) 2015-10-05T13:11:42.108+0100 [mongosMain] connection accepted from 172.28.0.164:58988 #2799 (312 connections now open) 2015-10-05T13:11:42.108+0100 [mongosMain] connection accepted from 172.28.0.164:58989 #2800 (313 connections now open) 2015-10-05T13:11:42.108+0100 [mongosMain] connection accepted from 172.28.0.164:58990 #2801 (314 connections now open) 2015-10-05T13:11:42.109+0100 [conn2797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.109+0100 [mongosMain] connection accepted from 172.28.0.164:58991 #2802 (315 connections now open) 2015-10-05T13:11:42.110+0100 [conn2798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.110+0100 [conn2799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.110+0100 [mongosMain] connection accepted from 172.28.0.164:58992 #2803 (316 connections now open) 2015-10-05T13:11:42.111+0100 [mongosMain] connection accepted from 172.28.0.164:58993 #2804 (317 connections now open) 2015-10-05T13:11:42.111+0100 [mongosMain] connection accepted from 172.28.0.164:58994 #2805 (318 connections now open) 2015-10-05T13:11:42.111+0100 [mongosMain] connection accepted from 172.28.0.164:58995 #2806 (319 connections now open) 2015-10-05T13:11:42.112+0100 [mongosMain] connection accepted from 172.28.0.164:58996 #2807 (320 connections now open) 2015-10-05T13:11:42.112+0100 [conn2800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.112+0100 [conn2801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.112+0100 [mongosMain] connection accepted from 172.28.0.164:58997 #2808 (321 connections now open) 2015-10-05T13:11:42.113+0100 [conn2803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.114+0100 [conn2804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.114+0100 [mongosMain] connection accepted from 172.28.0.164:58998 #2809 (322 connections now open) 2015-10-05T13:11:42.114+0100 [conn2807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.114+0100 [conn2805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.119+0100 [mongosMain] connection accepted from 172.28.0.164:58999 #2810 (323 connections now open) 2015-10-05T13:11:42.119+0100 [conn2808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.119+0100 [conn2809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.121+0100 [conn2810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.123+0100 [mongosMain] connection accepted from 172.28.0.164:59000 #2811 (324 connections now open) 2015-10-05T13:11:42.124+0100 [mongosMain] connection accepted from 172.28.0.164:59001 #2812 (325 connections now open) 2015-10-05T13:11:42.124+0100 [mongosMain] connection accepted from 172.28.0.164:59003 #2813 (326 connections now open) 2015-10-05T13:11:42.124+0100 [mongosMain] connection accepted from 172.28.0.164:59004 #2814 (327 connections now open) 2015-10-05T13:11:42.125+0100 [mongosMain] connection accepted from 172.28.0.164:59002 #2815 (328 connections now open) 2015-10-05T13:11:42.125+0100 [mongosMain] connection accepted from 172.28.0.164:59005 #2816 (329 connections now open) 2015-10-05T13:11:42.125+0100 [mongosMain] connection accepted from 172.28.0.164:59006 #2817 (330 connections now open) 2015-10-05T13:11:42.125+0100 [mongosMain] connection accepted from 172.28.0.164:59007 #2818 (331 connections now open) 2015-10-05T13:11:42.126+0100 [mongosMain] connection accepted from 172.28.0.164:59009 #2819 (332 connections now open) 2015-10-05T13:11:42.126+0100 [mongosMain] connection accepted from 172.28.0.164:59010 #2820 (333 connections now open) 2015-10-05T13:11:42.126+0100 [mongosMain] connection accepted from 172.28.0.164:59011 #2821 (334 connections now open) 2015-10-05T13:11:42.126+0100 [mongosMain] connection accepted from 172.28.0.164:59012 #2822 (335 connections now open) 2015-10-05T13:11:42.127+0100 [conn2811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.127+0100 [conn2812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.128+0100 [conn2816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.128+0100 [conn2815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.130+0100 [mongosMain] connection accepted from 172.28.0.164:59013 #2823 (336 connections now open) 2015-10-05T13:11:42.131+0100 [mongosMain] connection accepted from 172.28.0.164:59014 #2824 (337 connections now open) 2015-10-05T13:11:42.132+0100 [mongosMain] connection accepted from 172.28.0.164:59015 #2825 (338 connections now open) 2015-10-05T13:11:42.132+0100 [mongosMain] connection accepted from 172.28.0.164:59017 #2826 (339 connections now open) 2015-10-05T13:11:42.133+0100 [mongosMain] connection accepted from 172.28.0.164:59018 #2827 (340 connections now open) 2015-10-05T13:11:42.133+0100 [mongosMain] connection accepted from 172.28.0.164:59016 #2828 (341 connections now open) 2015-10-05T13:11:42.135+0100 [mongosMain] connection accepted from 172.28.0.164:59019 #2829 (342 connections now open) 2015-10-05T13:11:42.135+0100 [mongosMain] connection accepted from 172.28.0.164:59020 #2830 (343 connections now open) 2015-10-05T13:11:42.136+0100 [conn2827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.137+0100 [mongosMain] connection accepted from 172.28.0.164:59021 #2831 (344 connections now open) 2015-10-05T13:11:42.137+0100 [mongosMain] connection accepted from 172.28.0.164:59022 #2832 (345 connections now open) 2015-10-05T13:11:42.138+0100 [conn2829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.138+0100 [mongosMain] connection accepted from 172.28.0.164:59023 #2833 (346 connections now open) 2015-10-05T13:11:42.138+0100 [mongosMain] connection accepted from 172.28.0.164:59024 #2834 (347 connections now open) 2015-10-05T13:11:42.139+0100 [mongosMain] connection accepted from 172.28.0.164:59025 #2835 (348 connections now open) 2015-10-05T13:11:42.139+0100 [mongosMain] connection accepted from 172.28.0.164:59026 #2836 (349 connections now open) 2015-10-05T13:11:42.140+0100 [mongosMain] connection accepted from 172.28.0.164:59030 #2837 (350 connections now open) 2015-10-05T13:11:42.140+0100 [mongosMain] connection accepted from 172.28.0.164:59027 #2838 (351 connections now open) 2015-10-05T13:11:42.140+0100 [mongosMain] connection accepted from 172.28.0.164:59028 #2839 (352 connections now open) 2015-10-05T13:11:42.140+0100 [mongosMain] connection accepted from 172.28.0.164:59029 #2840 (353 connections now open) 2015-10-05T13:11:42.140+0100 [conn2833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.141+0100 [conn2834] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.141+0100 [conn2835] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.142+0100 [conn2837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.143+0100 [mongosMain] connection accepted from 172.28.0.164:59031 #2841 (354 connections now open) 2015-10-05T13:11:42.143+0100 [conn2839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.143+0100 [mongosMain] connection accepted from 172.28.0.164:59032 #2842 (355 connections now open) 2015-10-05T13:11:42.143+0100 [mongosMain] connection accepted from 172.28.0.164:59033 #2843 (356 connections now open) 2015-10-05T13:11:42.144+0100 [mongosMain] connection accepted from 172.28.0.164:59034 #2844 (357 connections now open) 2015-10-05T13:11:42.144+0100 [mongosMain] connection accepted from 172.28.0.164:59035 #2845 (358 connections now open) 2015-10-05T13:11:42.145+0100 [mongosMain] connection accepted from 172.28.0.164:59036 #2846 (359 connections now open) 2015-10-05T13:11:42.145+0100 [mongosMain] connection accepted from 172.28.0.164:59037 #2847 (360 connections now open) 2015-10-05T13:11:42.146+0100 [mongosMain] connection accepted from 172.28.0.164:59038 #2848 (361 connections now open) 2015-10-05T13:11:42.146+0100 [mongosMain] connection accepted from 172.28.0.164:59039 #2849 (362 connections now open) 2015-10-05T13:11:42.146+0100 [mongosMain] connection accepted from 172.28.0.164:59040 #2850 (363 connections now open) 2015-10-05T13:11:42.146+0100 [conn2842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.148+0100 [mongosMain] connection accepted from 172.28.0.164:59042 #2851 (364 connections now open) 2015-10-05T13:11:42.151+0100 [mongosMain] connection accepted from 172.28.0.164:59043 #2852 (365 connections now open) 2015-10-05T13:11:42.151+0100 [mongosMain] connection accepted from 172.28.0.164:59044 #2853 (366 connections now open) 2015-10-05T13:11:42.151+0100 [mongosMain] connection accepted from 172.28.0.164:59045 #2854 (367 connections now open) 2015-10-05T13:11:42.151+0100 [conn2843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.152+0100 [mongosMain] connection accepted from 172.28.0.164:59046 #2855 (368 connections now open) 2015-10-05T13:11:42.152+0100 [mongosMain] connection accepted from 172.28.0.164:59041 #2856 (369 connections now open) 2015-10-05T13:11:42.155+0100 [conn2845] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.155+0100 [conn2844] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.156+0100 [conn2849] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.158+0100 [conn2847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.159+0100 [mongosMain] connection accepted from 172.28.0.164:59047 #2857 (370 connections now open) 2015-10-05T13:11:42.160+0100 [conn2851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.160+0100 [conn2848] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.160+0100 [conn2853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.160+0100 [conn2854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.161+0100 [conn2850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.161+0100 [conn2852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.161+0100 [mongosMain] connection accepted from 172.28.0.164:59048 #2858 (371 connections now open) 2015-10-05T13:11:42.161+0100 [conn2856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.162+0100 [mongosMain] connection accepted from 172.28.0.164:59049 #2859 (372 connections now open) 2015-10-05T13:11:42.164+0100 [conn2858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.164+0100 [conn2859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.167+0100 [mongosMain] connection accepted from 172.28.0.164:59050 #2860 (373 connections now open) 2015-10-05T13:11:42.168+0100 [mongosMain] connection accepted from 172.28.0.164:59051 #2861 (374 connections now open) 2015-10-05T13:11:42.169+0100 [mongosMain] connection accepted from 172.28.0.164:59052 #2862 (375 connections now open) 2015-10-05T13:11:42.169+0100 [mongosMain] connection accepted from 172.28.0.164:59053 #2863 (376 connections now open) 2015-10-05T13:11:42.170+0100 [mongosMain] connection accepted from 172.28.0.164:59054 #2864 (377 connections now open) 2015-10-05T13:11:42.170+0100 [mongosMain] connection accepted from 172.28.0.164:59055 #2865 (378 connections now open) 2015-10-05T13:11:42.170+0100 [mongosMain] connection accepted from 172.28.0.164:59057 #2866 (379 connections now open) 2015-10-05T13:11:42.171+0100 [mongosMain] connection accepted from 172.28.0.164:59058 #2867 (380 connections now open) 2015-10-05T13:11:42.171+0100 [mongosMain] connection accepted from 172.28.0.164:59056 #2868 (381 connections now open) 2015-10-05T13:11:42.172+0100 [conn2863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.173+0100 [mongosMain] connection accepted from 172.28.0.164:59059 #2869 (382 connections now open) 2015-10-05T13:11:42.174+0100 [mongosMain] connection accepted from 172.28.0.164:59060 #2870 (383 connections now open) 2015-10-05T13:11:42.174+0100 [conn2868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.174+0100 [conn2864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.174+0100 [mongosMain] connection accepted from 172.28.0.164:59061 #2871 (384 connections now open) 2015-10-05T13:11:42.175+0100 [mongosMain] connection accepted from 172.28.0.164:59062 #2872 (385 connections now open) 2015-10-05T13:11:42.175+0100 [mongosMain] connection accepted from 172.28.0.164:59063 #2873 (386 connections now open) 2015-10-05T13:11:42.175+0100 [conn2869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.175+0100 [mongosMain] connection accepted from 172.28.0.164:59064 #2874 (387 connections now open) 2015-10-05T13:11:42.177+0100 [conn2871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.179+0100 [mongosMain] connection accepted from 172.28.0.164:59065 #2875 (388 connections now open) 2015-10-05T13:11:42.180+0100 [mongosMain] connection accepted from 172.28.0.164:59067 #2876 (389 connections now open) 2015-10-05T13:11:42.180+0100 [mongosMain] connection accepted from 172.28.0.164:59066 #2877 (390 connections now open) 2015-10-05T13:11:42.181+0100 [mongosMain] connection accepted from 172.28.0.164:59068 #2878 (391 connections now open) 2015-10-05T13:11:42.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561268fd12deab02e2997f5f 2015-10-05T13:11:42.181+0100 [mongosMain] connection accepted from 172.28.0.164:59069 #2879 (392 connections now open) 2015-10-05T13:11:42.182+0100 [mongosMain] connection accepted from 172.28.0.164:59070 #2880 (393 connections now open) 2015-10-05T13:11:42.182+0100 [mongosMain] connection accepted from 172.28.0.164:59072 #2881 (394 connections now open) 2015-10-05T13:11:42.183+0100 [mongosMain] connection accepted from 172.28.0.164:59071 #2882 (395 connections now open) 2015-10-05T13:11:42.183+0100 [conn2875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.183+0100 [conn2876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.183+0100 [mongosMain] connection accepted from 172.28.0.164:59073 #2883 (396 connections now open) 2015-10-05T13:11:42.184+0100 [conn2877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.184+0100 [conn2879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.184+0100 [mongosMain] connection accepted from 172.28.0.164:59074 #2884 (397 connections now open) 2015-10-05T13:11:42.188+0100 [mongosMain] connection accepted from 172.28.0.164:59075 #2885 (398 connections now open) 2015-10-05T13:11:42.188+0100 [conn2878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.188+0100 [mongosMain] connection accepted from 172.28.0.164:59076 #2886 (399 connections now open) 2015-10-05T13:11:42.192+0100 [mongosMain] connection accepted from 172.28.0.164:59078 #2887 (400 connections now open) 2015-10-05T13:11:42.193+0100 [mongosMain] connection accepted from 172.28.0.164:59077 #2888 (401 connections now open) 2015-10-05T13:11:42.194+0100 [conn2882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.194+0100 [mongosMain] connection accepted from 172.28.0.164:59079 #2889 (402 connections now open) 2015-10-05T13:11:42.203+0100 [conn2884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.204+0100 [conn2885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.204+0100 [mongosMain] connection accepted from 172.28.0.164:59084 #2890 (403 connections now open) 2015-10-05T13:11:42.204+0100 [mongosMain] connection accepted from 172.28.0.164:59080 #2891 (404 connections now open) 2015-10-05T13:11:42.288+0100 [conn2880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.289+0100 [conn2887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.290+0100 [mongosMain] connection accepted from 172.28.0.164:59085 #2892 (405 connections now open) 2015-10-05T13:11:42.290+0100 [conn2881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.290+0100 [mongosMain] connection accepted from 172.28.0.164:59081 #2893 (406 connections now open) 2015-10-05T13:11:42.291+0100 [conn2883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.291+0100 [mongosMain] connection accepted from 172.28.0.164:59083 #2894 (407 connections now open) 2015-10-05T13:11:42.292+0100 [conn2889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.292+0100 [conn2886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.292+0100 [conn2891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.293+0100 [mongosMain] connection accepted from 172.28.0.164:59082 #2895 (408 connections now open) 2015-10-05T13:11:42.293+0100 [mongosMain] connection accepted from 172.28.0.164:59087 #2896 (409 connections now open) 2015-10-05T13:11:42.293+0100 [conn2890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.294+0100 [conn2892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.294+0100 [conn2893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.294+0100 [mongosMain] connection accepted from 172.28.0.164:59088 #2897 (410 connections now open) 2015-10-05T13:11:42.294+0100 [conn2895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.295+0100 [mongosMain] connection accepted from 172.28.0.164:59089 #2898 (411 connections now open) 2015-10-05T13:11:42.295+0100 [conn2896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.295+0100 [mongosMain] connection accepted from 172.28.0.164:59090 #2899 (412 connections now open) 2015-10-05T13:11:42.296+0100 [mongosMain] connection accepted from 172.28.0.164:59086 #2900 (413 connections now open) 2015-10-05T13:11:42.297+0100 [conn2897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.297+0100 [conn2898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.297+0100 [mongosMain] connection accepted from 172.28.0.164:59091 #2901 (414 connections now open) 2015-10-05T13:11:42.298+0100 [mongosMain] connection accepted from 172.28.0.164:59092 #2902 (415 connections now open) 2015-10-05T13:11:42.298+0100 [mongosMain] connection accepted from 172.28.0.164:59093 #2903 (416 connections now open) 2015-10-05T13:11:42.298+0100 [mongosMain] connection accepted from 172.28.0.164:59094 #2904 (417 connections now open) 2015-10-05T13:11:42.299+0100 [mongosMain] connection accepted from 172.28.0.164:59095 #2905 (418 connections now open) 2015-10-05T13:11:42.299+0100 [mongosMain] connection accepted from 172.28.0.164:59096 #2906 (419 connections now open) 2015-10-05T13:11:42.299+0100 [mongosMain] connection accepted from 172.28.0.164:59097 #2907 (420 connections now open) 2015-10-05T13:11:42.299+0100 [conn2899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.300+0100 [mongosMain] connection accepted from 172.28.0.164:59098 #2908 (421 connections now open) 2015-10-05T13:11:42.300+0100 [conn2903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.300+0100 [conn2901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.300+0100 [conn2905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.300+0100 [mongosMain] connection accepted from 172.28.0.164:59099 #2909 (422 connections now open) 2015-10-05T13:11:42.301+0100 [conn2907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.304+0100 [conn2908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.304+0100 [conn2909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.305+0100 [conn2888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.305+0100 [mongosMain] connection accepted from 172.28.0.164:59100 #2910 (423 connections now open) 2015-10-05T13:11:42.306+0100 [conn2910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.307+0100 [mongosMain] connection accepted from 172.28.0.164:59101 #2911 (424 connections now open) 2015-10-05T13:11:42.307+0100 [mongosMain] connection accepted from 172.28.0.164:59102 #2912 (425 connections now open) 2015-10-05T13:11:42.308+0100 [mongosMain] connection accepted from 172.28.0.164:59103 #2913 (426 connections now open) 2015-10-05T13:11:42.308+0100 [conn2900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.309+0100 [mongosMain] connection accepted from 172.28.0.164:59104 #2914 (427 connections now open) 2015-10-05T13:11:42.309+0100 [mongosMain] connection accepted from 172.28.0.164:59105 #2915 (428 connections now open) 2015-10-05T13:11:42.309+0100 [mongosMain] connection accepted from 172.28.0.164:59106 #2916 (429 connections now open) 2015-10-05T13:11:42.310+0100 [mongosMain] connection accepted from 172.28.0.164:59108 #2917 (430 connections now open) 2015-10-05T13:11:42.310+0100 [mongosMain] connection accepted from 172.28.0.164:59110 #2918 (431 connections now open) 2015-10-05T13:11:42.310+0100 [mongosMain] connection accepted from 172.28.0.164:59111 #2919 (432 connections now open) 2015-10-05T13:11:42.310+0100 [conn2911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.311+0100 [mongosMain] connection accepted from 172.28.0.164:59109 #2920 (433 connections now open) 2015-10-05T13:11:42.311+0100 [mongosMain] connection accepted from 172.28.0.164:59112 #2921 (434 connections now open) 2015-10-05T13:11:42.311+0100 [mongosMain] connection accepted from 172.28.0.164:59113 #2922 (435 connections now open) 2015-10-05T13:11:42.311+0100 [mongosMain] connection accepted from 172.28.0.164:59114 #2923 (436 connections now open) 2015-10-05T13:11:42.311+0100 [conn2912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.312+0100 [mongosMain] connection accepted from 172.28.0.164:59116 #2924 (437 connections now open) 2015-10-05T13:11:42.312+0100 [mongosMain] connection accepted from 172.28.0.164:59115 #2925 (438 connections now open) 2015-10-05T13:11:42.312+0100 [conn2916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.312+0100 [mongosMain] connection accepted from 172.28.0.164:59117 #2926 (439 connections now open) 2015-10-05T13:11:42.312+0100 [mongosMain] connection accepted from 172.28.0.164:59118 #2927 (440 connections now open) 2015-10-05T13:11:42.313+0100 [mongosMain] connection accepted from 172.28.0.164:59119 #2928 (441 connections now open) 2015-10-05T13:11:42.313+0100 [conn2914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.313+0100 [conn2919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.313+0100 [mongosMain] connection accepted from 172.28.0.164:59120 #2929 (442 connections now open) 2015-10-05T13:11:42.313+0100 [mongosMain] connection accepted from 172.28.0.164:59121 #2930 (443 connections now open) 2015-10-05T13:11:42.313+0100 [conn2915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.313+0100 [conn2921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.314+0100 [conn2923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.314+0100 [conn2925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.314+0100 [conn2928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.314+0100 [mongosMain] connection accepted from 172.28.0.164:59122 #2931 (444 connections now open) 2015-10-05T13:11:42.315+0100 [conn2930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.315+0100 [conn2924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.315+0100 [conn2926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.316+0100 [mongosMain] connection accepted from 172.28.0.164:59123 #2932 (445 connections now open) 2015-10-05T13:11:42.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:42.317+0100 [conn2920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.317+0100 [conn2929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.317+0100 [conn2931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.318+0100 [mongosMain] connection accepted from 172.28.0.164:59124 #2933 (446 connections now open) 2015-10-05T13:11:42.318+0100 [mongosMain] connection accepted from 172.28.0.164:59125 #2934 (447 connections now open) 2015-10-05T13:11:42.318+0100 [conn2913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.319+0100 [mongosMain] connection accepted from 172.28.0.164:59127 #2935 (448 connections now open) 2015-10-05T13:11:42.319+0100 [conn2933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.319+0100 [mongosMain] connection accepted from 172.28.0.164:59126 #2936 (449 connections now open) 2015-10-05T13:11:42.321+0100 [conn2934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.321+0100 [conn2935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.321+0100 [conn2936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.325+0100 [mongosMain] connection accepted from 172.28.0.164:59128 #2937 (450 connections now open) 2015-10-05T13:11:42.325+0100 [mongosMain] connection accepted from 172.28.0.164:59129 #2938 (451 connections now open) 2015-10-05T13:11:42.325+0100 [mongosMain] connection accepted from 172.28.0.164:59130 #2939 (452 connections now open) 2015-10-05T13:11:42.326+0100 [mongosMain] connection accepted from 172.28.0.164:59131 #2940 (453 connections now open) 2015-10-05T13:11:42.326+0100 [mongosMain] connection accepted from 172.28.0.164:59132 #2941 (454 connections now open) 2015-10-05T13:11:42.327+0100 [mongosMain] connection accepted from 172.28.0.164:59133 #2942 (455 connections now open) 2015-10-05T13:11:42.327+0100 [mongosMain] connection accepted from 172.28.0.164:59134 #2943 (456 connections now open) 2015-10-05T13:11:42.327+0100 [mongosMain] connection accepted from 172.28.0.164:59135 #2944 (457 connections now open) 2015-10-05T13:11:42.329+0100 [conn2937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.329+0100 [conn2942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.329+0100 [conn2944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.329+0100 [conn2941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.329+0100 [conn2939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.332+0100 [mongosMain] connection accepted from 172.28.0.164:59136 #2945 (458 connections now open) 2015-10-05T13:11:42.332+0100 [conn2943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.332+0100 [mongosMain] connection accepted from 172.28.0.164:59137 #2946 (459 connections now open) 2015-10-05T13:11:42.333+0100 [mongosMain] connection accepted from 172.28.0.164:59138 #2947 (460 connections now open) 2015-10-05T13:11:42.334+0100 [mongosMain] connection accepted from 172.28.0.164:59139 #2948 (461 connections now open) 2015-10-05T13:11:42.334+0100 [mongosMain] connection accepted from 172.28.0.164:59140 #2949 (462 connections now open) 2015-10-05T13:11:42.334+0100 [mongosMain] connection accepted from 172.28.0.164:59141 #2950 (463 connections now open) 2015-10-05T13:11:42.334+0100 [conn2940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.334+0100 [conn2945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.335+0100 [conn2946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.336+0100 [conn2947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.337+0100 [conn2949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.337+0100 [conn2950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.337+0100 [conn2948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.342+0100 [conn2766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.344+0100 [conn2769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.345+0100 [conn2778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.346+0100 [conn2779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.346+0100 [conn2777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.353+0100 [conn2795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.364+0100 [conn2806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.365+0100 [conn2819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.365+0100 [conn2817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.380+0100 [conn2821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.380+0100 [conn2818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.380+0100 [conn2825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.380+0100 [conn2824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.386+0100 [conn2813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.403+0100 [conn2802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.404+0100 [conn2840] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.405+0100 [conn2826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.405+0100 [conn2846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.406+0100 [conn2822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.406+0100 [conn2831] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.407+0100 [conn2832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.408+0100 [conn2828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.442+0100 [conn2855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.442+0100 [conn2861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.442+0100 [conn2866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.443+0100 [conn2857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.446+0100 [conn2862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.448+0100 [conn2814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.469+0100 [conn2836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.513+0100 [conn2860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.513+0100 [conn2870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.516+0100 [conn2904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.516+0100 [conn2841] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.539+0100 [conn2830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.584+0100 [conn2874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.586+0100 [conn2820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.705+0100 [conn2894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.706+0100 [conn2922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.707+0100 [conn2902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.712+0100 [conn2906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.760+0100 [conn2917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.760+0100 [conn2872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.779+0100 [conn2873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.795+0100 [conn2865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.805+0100 [conn2918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.805+0100 [conn2867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.806+0100 [conn2932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.807+0100 [conn2938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.807+0100 [conn2823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.829+0100 [conn2927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:42.886+0100 [conn2838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:11:51.155+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:11:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:11:54.470+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612690a12deab02e29980f2 2015-10-05T13:11:54.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:11:55.068+0100 [conn2392] end connection 172.28.0.164:57149 (462 connections now open) 2015-10-05T13:11:55.069+0100 [mongosMain] connection accepted from 172.28.0.164:59179 #2951 (463 connections now open) 2015-10-05T13:11:55.072+0100 [conn2951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:12:00.571+0100 [mongosMain] connection accepted from 172.28.0.163:56102 #2952 (464 connections now open) 2015-10-05T13:12:00.571+0100 [mongosMain] connection accepted from 172.28.0.163:56103 #2953 (465 connections now open) 2015-10-05T13:12:06.837+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612691612deab02e29980f4 2015-10-05T13:12:06.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:13.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612691c12deab02e29980f5 2015-10-05T13:12:13.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:19.486+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612692312deab02e29980f7 2015-10-05T13:12:19.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:21.430+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:12:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:12:25.907+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612692912deab02e29980f8 2015-10-05T13:12:26.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:28.936+0100 [mongosMain] connection accepted from 127.0.0.1:56129 #2954 (466 connections now open) 2015-10-05T13:12:28.939+0100 [conn2954] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:12:28.940+0100 [conn2954] end connection 127.0.0.1:56129 (465 connections now open) 2015-10-05T13:12:30.466+0100 [mongosMain] connection accepted from 172.28.0.164:59197 #2955 (466 connections now open) 2015-10-05T13:12:30.467+0100 [mongosMain] connection accepted from 172.28.0.164:59198 #2956 (467 connections now open) 2015-10-05T13:12:32.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612693012deab02e29980fa 2015-10-05T13:12:32.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:38.579+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612693612deab02e29980fb 2015-10-05T13:12:38.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:39.060+0100 [conn2953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:12:40.069+0100 [mongosMain] connection accepted from 127.0.0.1:56131 #2957 (468 connections now open) 2015-10-05T13:12:40.071+0100 [conn2957] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:12:40.072+0100 [conn2957] end connection 127.0.0.1:56131 (467 connections now open) 2015-10-05T13:12:44.796+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612693c12deab02e29980fc 2015-10-05T13:12:44.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:51.149+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612694212deab02e29980fe 2015-10-05T13:12:51.287+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:12:51.696+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:12:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:12:55.084+0100 [conn2393] end connection 172.28.0.164:57152 (466 connections now open) 2015-10-05T13:12:55.085+0100 [mongosMain] connection accepted from 172.28.0.164:59228 #2958 (467 connections now open) 2015-10-05T13:12:55.087+0100 [conn2958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:12:57.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612694912deab02e29980ff 2015-10-05T13:12:57.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:01.536+0100 [conn2952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:03.995+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612694f12deab02e2998100 2015-10-05T13:13:04.146+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:10.446+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612695612deab02e2998102 2015-10-05T13:13:10.584+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:15.548+0100 [mongosMain] connection accepted from 172.28.0.163:56174 #2959 (468 connections now open) 2015-10-05T13:13:15.551+0100 [conn2959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:16.219+0100 [conn2522] end connection 172.28.0.164:58384 (467 connections now open) 2015-10-05T13:13:16.219+0100 [conn2680] end connection 172.28.0.164:58736 (466 connections now open) 2015-10-05T13:13:16.219+0100 [conn2523] end connection 172.28.0.164:58385 (466 connections now open) 2015-10-05T13:13:16.219+0100 [conn2679] end connection 172.28.0.164:58735 (464 connections now open) 2015-10-05T13:13:16.219+0100 [conn2699] end connection 172.28.0.164:58755 (463 connections now open) 2015-10-05T13:13:16.220+0100 [conn2528] end connection 172.28.0.164:58427 (462 connections now open) 2015-10-05T13:13:16.220+0100 [conn2761] end connection 172.28.0.164:58948 (461 connections now open) 2015-10-05T13:13:16.220+0100 [conn2678] end connection 172.28.0.164:58734 (460 connections now open) 2015-10-05T13:13:16.220+0100 [conn2676] end connection 172.28.0.164:58732 (460 connections now open) 2015-10-05T13:13:16.220+0100 [conn2640] end connection 172.28.0.164:58695 (458 connections now open) 2015-10-05T13:13:16.220+0100 [conn2846] end connection 172.28.0.164:59036 (458 connections now open) 2015-10-05T13:13:16.220+0100 [conn2639] end connection 172.28.0.164:58694 (456 connections now open) 2015-10-05T13:13:16.221+0100 [conn2529] end connection 172.28.0.164:58428 (455 connections now open) 2015-10-05T13:13:16.221+0100 [conn2674] end connection 172.28.0.164:58731 (454 connections now open) 2015-10-05T13:13:16.221+0100 [conn2688] end connection 172.28.0.164:58745 (453 connections now open) 2015-10-05T13:13:16.221+0100 [conn2675] end connection 172.28.0.164:58730 (452 connections now open) 2015-10-05T13:13:16.221+0100 [conn2687] end connection 172.28.0.164:58743 (451 connections now open) 2015-10-05T13:13:16.221+0100 [conn2691] end connection 172.28.0.164:58747 (450 connections now open) 2015-10-05T13:13:16.221+0100 [conn2686] end connection 172.28.0.164:58742 (450 connections now open) 2015-10-05T13:13:16.221+0100 [conn2690] end connection 172.28.0.164:58746 (448 connections now open) 2015-10-05T13:13:16.222+0100 [conn2685] end connection 172.28.0.164:58741 (448 connections now open) 2015-10-05T13:13:16.222+0100 [conn2683] end connection 172.28.0.164:58739 (446 connections now open) 2015-10-05T13:13:16.222+0100 [conn2692] end connection 172.28.0.164:58748 (446 connections now open) 2015-10-05T13:13:16.222+0100 [conn2684] end connection 172.28.0.164:58740 (444 connections now open) 2015-10-05T13:13:16.222+0100 [conn2531] end connection 172.28.0.164:58511 (443 connections now open) 2015-10-05T13:13:16.222+0100 [conn2530] end connection 172.28.0.164:58510 (442 connections now open) 2015-10-05T13:13:16.223+0100 [conn2535] end connection 172.28.0.164:58515 (442 connections now open) 2015-10-05T13:13:16.223+0100 [conn2698] end connection 172.28.0.164:58754 (440 connections now open) 2015-10-05T13:13:16.223+0100 [conn2534] end connection 172.28.0.164:58514 (440 connections now open) 2015-10-05T13:13:16.223+0100 [conn2539] end connection 172.28.0.164:58519 (438 connections now open) 2015-10-05T13:13:16.223+0100 [conn2537] end connection 172.28.0.164:58517 (437 connections now open) 2015-10-05T13:13:16.223+0100 [conn2533] end connection 172.28.0.164:58513 (437 connections now open) 2015-10-05T13:13:16.223+0100 [conn2538] end connection 172.28.0.164:58518 (435 connections now open) 2015-10-05T13:13:16.222+0100 [conn2532] end connection 172.28.0.164:58512 (442 connections now open) 2015-10-05T13:13:16.224+0100 [conn2540] end connection 172.28.0.164:58520 (433 connections now open) 2015-10-05T13:13:16.224+0100 [conn2541] end connection 172.28.0.164:58521 (432 connections now open) 2015-10-05T13:13:16.224+0100 [conn2545] end connection 172.28.0.164:58525 (431 connections now open) 2015-10-05T13:13:16.224+0100 [conn2547] end connection 172.28.0.164:58529 (431 connections now open) 2015-10-05T13:13:16.224+0100 [conn2682] end connection 172.28.0.164:58738 (431 connections now open) 2015-10-05T13:13:16.225+0100 [conn2543] end connection 172.28.0.164:58523 (431 connections now open) 2015-10-05T13:13:16.225+0100 [conn2544] end connection 172.28.0.164:58524 (429 connections now open) 2015-10-05T13:13:16.225+0100 [conn2554] end connection 172.28.0.164:58536 (428 connections now open) 2015-10-05T13:13:16.226+0100 [conn2681] end connection 172.28.0.164:58737 (427 connections now open) 2015-10-05T13:13:16.226+0100 [conn2549] end connection 172.28.0.164:58531 (426 connections now open) 2015-10-05T13:13:16.226+0100 [conn2550] end connection 172.28.0.164:58532 (426 connections now open) 2015-10-05T13:13:16.226+0100 [conn2557] end connection 172.28.0.164:58539 (424 connections now open) 2015-10-05T13:13:16.226+0100 [conn2558] end connection 172.28.0.164:58540 (424 connections now open) 2015-10-05T13:13:16.226+0100 [conn2552] end connection 172.28.0.164:58535 (422 connections now open) 2015-10-05T13:13:16.226+0100 [conn2559] end connection 172.28.0.164:58541 (421 connections now open) 2015-10-05T13:13:16.227+0100 [conn2561] end connection 172.28.0.164:58543 (421 connections now open) 2015-10-05T13:13:16.227+0100 [conn2563] end connection 172.28.0.164:58545 (419 connections now open) 2015-10-05T13:13:16.227+0100 [conn2566] end connection 172.28.0.164:58548 (418 connections now open) 2015-10-05T13:13:16.227+0100 [conn2571] end connection 172.28.0.164:58559 (417 connections now open) 2015-10-05T13:13:16.227+0100 [conn2564] end connection 172.28.0.164:58546 (417 connections now open) 2015-10-05T13:13:16.228+0100 [conn2568] end connection 172.28.0.164:58550 (415 connections now open) 2015-10-05T13:13:16.228+0100 [conn2567] end connection 172.28.0.164:58549 (414 connections now open) 2015-10-05T13:13:16.228+0100 [conn2569] end connection 172.28.0.164:58557 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2581] end connection 172.28.0.164:58569 (413 connections now open) 2015-10-05T13:13:16.223+0100 [conn2536] end connection 172.28.0.164:58516 (440 connections now open) 2015-10-05T13:13:16.228+0100 [conn2582] end connection 172.28.0.164:58570 (411 connections now open) 2015-10-05T13:13:16.229+0100 [conn2585] end connection 172.28.0.164:58582 (409 connections now open) 2015-10-05T13:13:16.229+0100 [conn2584] end connection 172.28.0.164:58572 (409 connections now open) 2015-10-05T13:13:16.229+0100 [conn2583] end connection 172.28.0.164:58571 (407 connections now open) 2015-10-05T13:13:16.229+0100 [conn2578] end connection 172.28.0.164:58567 (406 connections now open) 2015-10-05T13:13:16.229+0100 [conn2694] end connection 172.28.0.164:58750 (406 connections now open) 2015-10-05T13:13:16.229+0100 [conn2576] end connection 172.28.0.164:58564 (404 connections now open) 2015-10-05T13:13:16.230+0100 [conn2587] end connection 172.28.0.164:58584 (403 connections now open) 2015-10-05T13:13:16.230+0100 [conn2697] end connection 172.28.0.164:58753 (403 connections now open) 2015-10-05T13:13:16.230+0100 [conn2595] end connection 172.28.0.164:58592 (401 connections now open) 2015-10-05T13:13:16.230+0100 [conn2597] end connection 172.28.0.164:58594 (401 connections now open) 2015-10-05T13:13:16.230+0100 [conn2696] end connection 172.28.0.164:58752 (399 connections now open) 2015-10-05T13:13:16.231+0100 [conn2591] end connection 172.28.0.164:58588 (398 connections now open) 2015-10-05T13:13:16.231+0100 [conn2604] end connection 172.28.0.164:58601 (397 connections now open) 2015-10-05T13:13:16.231+0100 [conn2596] end connection 172.28.0.164:58593 (397 connections now open) 2015-10-05T13:13:16.231+0100 [conn2599] end connection 172.28.0.164:58596 (395 connections now open) 2015-10-05T13:13:16.231+0100 [conn2594] end connection 172.28.0.164:58591 (394 connections now open) 2015-10-05T13:13:16.231+0100 [conn2598] end connection 172.28.0.164:58595 (394 connections now open) 2015-10-05T13:13:16.231+0100 [conn2590] end connection 172.28.0.164:58587 (392 connections now open) 2015-10-05T13:13:16.231+0100 [conn2693] end connection 172.28.0.164:58749 (392 connections now open) 2015-10-05T13:13:16.232+0100 [conn2602] end connection 172.28.0.164:58599 (391 connections now open) 2015-10-05T13:13:16.232+0100 [conn2600] end connection 172.28.0.164:58597 (391 connections now open) 2015-10-05T13:13:16.232+0100 [conn2606] end connection 172.28.0.164:58603 (389 connections now open) 2015-10-05T13:13:16.232+0100 [conn2608] end connection 172.28.0.164:58607 (388 connections now open) 2015-10-05T13:13:16.232+0100 [conn2605] end connection 172.28.0.164:58602 (387 connections now open) 2015-10-05T13:13:16.232+0100 [conn2601] end connection 172.28.0.164:58598 (386 connections now open) 2015-10-05T13:13:16.232+0100 [conn2603] end connection 172.28.0.164:58600 (386 connections now open) 2015-10-05T13:13:16.233+0100 [conn2607] end connection 172.28.0.164:58605 (386 connections now open) 2015-10-05T13:13:16.233+0100 [conn2609] end connection 172.28.0.164:58608 (384 connections now open) 2015-10-05T13:13:16.233+0100 [conn2615] end connection 172.28.0.164:58657 (384 connections now open) 2015-10-05T13:13:16.233+0100 [conn2614] end connection 172.28.0.164:58656 (382 connections now open) 2015-10-05T13:13:16.233+0100 [conn2616] end connection 172.28.0.164:58658 (382 connections now open) 2015-10-05T13:13:16.233+0100 [conn2623] end connection 172.28.0.164:58678 (380 connections now open) 2015-10-05T13:13:16.233+0100 [conn2618] end connection 172.28.0.164:58673 (380 connections now open) 2015-10-05T13:13:16.233+0100 [conn2622] end connection 172.28.0.164:58677 (378 connections now open) 2015-10-05T13:13:16.233+0100 [conn2619] end connection 172.28.0.164:58674 (378 connections now open) 2015-10-05T13:13:16.234+0100 [conn2620] end connection 172.28.0.164:58675 (376 connections now open) 2015-10-05T13:13:16.234+0100 [conn2621] end connection 172.28.0.164:58676 (375 connections now open) 2015-10-05T13:13:16.234+0100 [conn2625] end connection 172.28.0.164:58680 (375 connections now open) 2015-10-05T13:13:16.234+0100 [conn2624] end connection 172.28.0.164:58679 (373 connections now open) 2015-10-05T13:13:16.234+0100 [conn2626] end connection 172.28.0.164:58681 (372 connections now open) 2015-10-05T13:13:16.234+0100 [conn2627] end connection 172.28.0.164:58682 (372 connections now open) 2015-10-05T13:13:16.234+0100 [conn2628] end connection 172.28.0.164:58684 (370 connections now open) 2015-10-05T13:13:16.234+0100 [conn2635] end connection 172.28.0.164:58690 (370 connections now open) 2015-10-05T13:13:16.234+0100 [conn2630] end connection 172.28.0.164:58685 (369 connections now open) 2015-10-05T13:13:16.234+0100 [conn2633] end connection 172.28.0.164:58688 (369 connections now open) 2015-10-05T13:13:16.235+0100 [conn2631] end connection 172.28.0.164:58686 (369 connections now open) 2015-10-05T13:13:16.235+0100 [conn2629] end connection 172.28.0.164:58683 (368 connections now open) 2015-10-05T13:13:16.235+0100 [conn2634] end connection 172.28.0.164:58689 (366 connections now open) 2015-10-05T13:13:16.235+0100 [conn2632] end connection 172.28.0.164:58687 (366 connections now open) 2015-10-05T13:13:16.235+0100 [conn2638] end connection 172.28.0.164:58693 (364 connections now open) 2015-10-05T13:13:16.235+0100 [conn2642] end connection 172.28.0.164:58697 (364 connections now open) 2015-10-05T13:13:16.235+0100 [conn2643] end connection 172.28.0.164:58698 (362 connections now open) 2015-10-05T13:13:16.235+0100 [conn2644] end connection 172.28.0.164:58699 (362 connections now open) 2015-10-05T13:13:16.235+0100 [conn2652] end connection 172.28.0.164:58707 (360 connections now open) 2015-10-05T13:13:16.235+0100 [conn2641] end connection 172.28.0.164:58696 (360 connections now open) 2015-10-05T13:13:16.236+0100 [conn2646] end connection 172.28.0.164:58701 (358 connections now open) 2015-10-05T13:13:16.236+0100 [conn2647] end connection 172.28.0.164:58702 (358 connections now open) 2015-10-05T13:13:16.236+0100 [conn2648] end connection 172.28.0.164:58703 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2649] end connection 172.28.0.164:58704 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2653] end connection 172.28.0.164:58708 (356 connections now open) 2015-10-05T13:13:16.236+0100 [conn2665] end connection 172.28.0.164:58721 (355 connections now open) 2015-10-05T13:13:16.236+0100 [conn2666] end connection 172.28.0.164:58722 (354 connections now open) 2015-10-05T13:13:16.236+0100 [conn2662] end connection 172.28.0.164:58719 (353 connections now open) 2015-10-05T13:13:16.236+0100 [conn2671] end connection 172.28.0.164:58728 (353 connections now open) 2015-10-05T13:13:16.236+0100 [conn2669] end connection 172.28.0.164:58725 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2775] end connection 172.28.0.164:58963 (351 connections now open) 2015-10-05T13:13:16.236+0100 [conn2767] end connection 172.28.0.164:58955 (350 connections now open) 2015-10-05T13:13:16.236+0100 [conn2673] end connection 172.28.0.164:58729 (349 connections now open) 2015-10-05T13:13:16.236+0100 [conn2776] end connection 172.28.0.164:58964 (348 connections now open) 2015-10-05T13:13:16.236+0100 [conn2779] end connection 172.28.0.164:58967 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2780] end connection 172.28.0.164:58968 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2784] end connection 172.28.0.164:58972 (346 connections now open) 2015-10-05T13:13:16.236+0100 [conn2789] end connection 172.28.0.164:58978 (346 connections now open) 2015-10-05T13:13:16.237+0100 [conn2793] end connection 172.28.0.164:58982 (345 connections now open) 2015-10-05T13:13:16.237+0100 [conn2794] end connection 172.28.0.164:58983 (344 connections now open) 2015-10-05T13:13:16.237+0100 [conn2797] end connection 172.28.0.164:58986 (343 connections now open) 2015-10-05T13:13:16.237+0100 [conn2800] end connection 172.28.0.164:58989 (342 connections now open) 2015-10-05T13:13:16.237+0100 [conn2812] end connection 172.28.0.164:59001 (340 connections now open) 2015-10-05T13:13:16.237+0100 [conn2808] end connection 172.28.0.164:58997 (339 connections now open) 2015-10-05T13:13:16.237+0100 [conn2802] end connection 172.28.0.164:58991 (338 connections now open) 2015-10-05T13:13:16.237+0100 [conn2810] end connection 172.28.0.164:58999 (337 connections now open) 2015-10-05T13:13:16.237+0100 [conn2819] end connection 172.28.0.164:59009 (336 connections now open) 2015-10-05T13:13:16.237+0100 [conn2826] end connection 172.28.0.164:59017 (335 connections now open) 2015-10-05T13:13:16.237+0100 [conn2818] end connection 172.28.0.164:59007 (334 connections now open) 2015-10-05T13:13:16.237+0100 [conn2821] end connection 172.28.0.164:59011 (334 connections now open) 2015-10-05T13:13:16.237+0100 [conn2828] end connection 172.28.0.164:59016 (333 connections now open) 2015-10-05T13:13:16.237+0100 [conn2830] end connection 172.28.0.164:59020 (331 connections now open) 2015-10-05T13:13:16.237+0100 [conn2831] end connection 172.28.0.164:59021 (331 connections now open) 2015-10-05T13:13:16.237+0100 [conn2827] end connection 172.28.0.164:59018 (330 connections now open) 2015-10-05T13:13:16.237+0100 [conn2836] end connection 172.28.0.164:59026 (328 connections now open) 2015-10-05T13:13:16.237+0100 [conn2839] end connection 172.28.0.164:59028 (328 connections now open) 2015-10-05T13:13:16.237+0100 [conn2841] end connection 172.28.0.164:59031 (327 connections now open) 2015-10-05T13:13:16.237+0100 [conn2844] end connection 172.28.0.164:59034 (325 connections now open) 2015-10-05T13:13:16.237+0100 [conn2851] end connection 172.28.0.164:59042 (325 connections now open) 2015-10-05T13:13:16.238+0100 [conn2845] end connection 172.28.0.164:59035 (324 connections now open) 2015-10-05T13:13:16.238+0100 [conn2849] end connection 172.28.0.164:59039 (323 connections now open) 2015-10-05T13:13:16.238+0100 [conn2855] end connection 172.28.0.164:59046 (322 connections now open) 2015-10-05T13:13:16.238+0100 [conn2852] end connection 172.28.0.164:59043 (320 connections now open) 2015-10-05T13:13:16.238+0100 [conn2861] end connection 172.28.0.164:59051 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2860] end connection 172.28.0.164:59050 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2868] end connection 172.28.0.164:59056 (317 connections now open) 2015-10-05T13:13:16.238+0100 [conn2867] end connection 172.28.0.164:59058 (316 connections now open) 2015-10-05T13:13:16.238+0100 [conn2871] end connection 172.28.0.164:59061 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2877] end connection 172.28.0.164:59066 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2878] end connection 172.28.0.164:59068 (314 connections now open) 2015-10-05T13:13:16.238+0100 [conn2884] end connection 172.28.0.164:59074 (313 connections now open) 2015-10-05T13:13:16.238+0100 [conn2887] end connection 172.28.0.164:59078 (313 connections now open) 2015-10-05T13:13:16.238+0100 [conn2886] end connection 172.28.0.164:59076 (311 connections now open) 2015-10-05T13:13:16.238+0100 [conn2894] end connection 172.28.0.164:59083 (310 connections now open) 2015-10-05T13:13:16.238+0100 [conn2900] end connection 172.28.0.164:59086 (309 connections now open) 2015-10-05T13:13:16.238+0100 [conn2896] end connection 172.28.0.164:59087 (308 connections now open) 2015-10-05T13:13:16.239+0100 [conn2897] end connection 172.28.0.164:59088 (307 connections now open) 2015-10-05T13:13:16.239+0100 [conn2908] end connection 172.28.0.164:59098 (306 connections now open) 2015-10-05T13:13:16.239+0100 [conn2905] end connection 172.28.0.164:59095 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2910] end connection 172.28.0.164:59100 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2916] end connection 172.28.0.164:59106 (304 connections now open) 2015-10-05T13:13:16.239+0100 [conn2926] end connection 172.28.0.164:59117 (302 connections now open) 2015-10-05T13:13:16.239+0100 [conn2924] end connection 172.28.0.164:59116 (301 connections now open) 2015-10-05T13:13:16.239+0100 [conn2918] end connection 172.28.0.164:59110 (300 connections now open) 2015-10-05T13:13:16.239+0100 [conn2919] end connection 172.28.0.164:59111 (300 connections now open) 2015-10-05T13:13:16.239+0100 [conn2928] end connection 172.28.0.164:59119 (298 connections now open) 2015-10-05T13:13:16.239+0100 [conn2922] end connection 172.28.0.164:59113 (297 connections now open) 2015-10-05T13:13:16.239+0100 [conn2927] end connection 172.28.0.164:59118 (297 connections now open) 2015-10-05T13:13:16.239+0100 [conn2933] end connection 172.28.0.164:59124 (296 connections now open) 2015-10-05T13:13:16.239+0100 [conn2939] end connection 172.28.0.164:59130 (295 connections now open) 2015-10-05T13:13:16.239+0100 [conn2937] end connection 172.28.0.164:59128 (294 connections now open) 2015-10-05T13:13:16.239+0100 [conn2940] end connection 172.28.0.164:59131 (292 connections now open) 2015-10-05T13:13:16.239+0100 [conn2942] end connection 172.28.0.164:59133 (291 connections now open) 2015-10-05T13:13:16.239+0100 [conn2941] end connection 172.28.0.164:59132 (290 connections now open) 2015-10-05T13:13:16.239+0100 [conn2948] end connection 172.28.0.164:59139 (289 connections now open) 2015-10-05T13:13:16.225+0100 [conn2763] end connection 172.28.0.164:58951 (431 connections now open) 2015-10-05T13:13:16.225+0100 [conn2546] end connection 172.28.0.164:58528 (431 connections now open) 2015-10-05T13:13:16.240+0100 [conn2787] end connection 172.28.0.164:58975 (346 connections now open) 2015-10-05T13:13:16.225+0100 [conn2677] end connection 172.28.0.164:58733 (429 connections now open) 2015-10-05T13:13:16.225+0100 [conn2542] end connection 172.28.0.164:58522 (429 connections now open) 2015-10-05T13:13:16.240+0100 [conn2882] end connection 172.28.0.164:59071 (314 connections now open) 2015-10-05T13:13:16.225+0100 [conn2551] end connection 172.28.0.164:58533 (429 connections now open) 2015-10-05T13:13:16.225+0100 [conn2553] end connection 172.28.0.164:58534 (429 connections now open) 2015-10-05T13:13:16.226+0100 [conn2556] end connection 172.28.0.164:58538 (426 connections now open) 2015-10-05T13:13:16.226+0100 [conn2560] end connection 172.28.0.164:58542 (426 connections now open) 2015-10-05T13:13:16.226+0100 [conn2555] end connection 172.28.0.164:58537 (421 connections now open) 2015-10-05T13:13:16.227+0100 [conn2565] end connection 172.28.0.164:58547 (419 connections now open) 2015-10-05T13:13:16.228+0100 [conn2570] end connection 172.28.0.164:58558 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2562] end connection 172.28.0.164:58544 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2573] end connection 172.28.0.164:58561 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2579] end connection 172.28.0.164:58566 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2572] end connection 172.28.0.164:58560 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2575] end connection 172.28.0.164:58562 (413 connections now open) 2015-10-05T13:13:16.228+0100 [conn2577] end connection 172.28.0.164:58565 (413 connections now open) 2015-10-05T13:13:16.229+0100 [conn2574] end connection 172.28.0.164:58563 (409 connections now open) 2015-10-05T13:13:16.229+0100 [conn2695] end connection 172.28.0.164:58751 (406 connections now open) 2015-10-05T13:13:16.229+0100 [conn2580] end connection 172.28.0.164:58568 (406 connections now open) 2015-10-05T13:13:16.230+0100 [conn2589] end connection 172.28.0.164:58586 (403 connections now open) 2015-10-05T13:13:16.230+0100 [conn2593] end connection 172.28.0.164:58590 (403 connections now open) 2015-10-05T13:13:16.230+0100 [conn2592] end connection 172.28.0.164:58589 (403 connections now open) 2015-10-05T13:13:16.230+0100 [conn2586] end connection 172.28.0.164:58583 (401 connections now open) 2015-10-05T13:13:16.231+0100 [conn2588] end connection 172.28.0.164:58585 (392 connections now open) 2015-10-05T13:13:16.234+0100 [conn2637] end connection 172.28.0.164:58692 (369 connections now open) 2015-10-05T13:13:16.235+0100 [conn2636] end connection 172.28.0.164:58691 (364 connections now open) 2015-10-05T13:13:16.236+0100 [conn2645] end connection 172.28.0.164:58700 (358 connections now open) 2015-10-05T13:13:16.236+0100 [conn2655] end connection 172.28.0.164:58710 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2650] end connection 172.28.0.164:58705 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2762] end connection 172.28.0.164:58950 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2654] end connection 172.28.0.164:58709 (357 connections now open) 2015-10-05T13:13:16.236+0100 [conn2651] end connection 172.28.0.164:58706 (356 connections now open) 2015-10-05T13:13:16.236+0100 [conn2657] end connection 172.28.0.164:58712 (356 connections now open) 2015-10-05T13:13:16.236+0100 [conn2658] end connection 172.28.0.164:58713 (356 connections now open) 2015-10-05T13:13:16.236+0100 [conn2659] end connection 172.28.0.164:58714 (355 connections now open) 2015-10-05T13:13:16.236+0100 [conn2661] end connection 172.28.0.164:58717 (355 connections now open) 2015-10-05T13:13:16.236+0100 [conn2656] end connection 172.28.0.164:58711 (354 connections now open) 2015-10-05T13:13:16.236+0100 [conn2664] end connection 172.28.0.164:58720 (354 connections now open) 2015-10-05T13:13:16.236+0100 [conn2660] end connection 172.28.0.164:58715 (353 connections now open) 2015-10-05T13:13:16.236+0100 [conn2668] end connection 172.28.0.164:58724 (353 connections now open) 2015-10-05T13:13:16.236+0100 [conn2670] end connection 172.28.0.164:58726 (353 connections now open) 2015-10-05T13:13:16.236+0100 [conn2672] end connection 172.28.0.164:58727 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2667] end connection 172.28.0.164:58723 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2689] end connection 172.28.0.164:58744 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2774] end connection 172.28.0.164:58962 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2765] end connection 172.28.0.164:58953 (352 connections now open) 2015-10-05T13:13:16.236+0100 [conn2770] end connection 172.28.0.164:58958 (351 connections now open) 2015-10-05T13:13:16.236+0100 [conn2769] end connection 172.28.0.164:58957 (351 connections now open) 2015-10-05T13:13:16.236+0100 [conn2764] end connection 172.28.0.164:58952 (350 connections now open) 2015-10-05T13:13:16.236+0100 [conn2768] end connection 172.28.0.164:58956 (350 connections now open) 2015-10-05T13:13:16.236+0100 [conn2771] end connection 172.28.0.164:58959 (349 connections now open) 2015-10-05T13:13:16.236+0100 [conn2777] end connection 172.28.0.164:58965 (349 connections now open) 2015-10-05T13:13:16.236+0100 [conn2772] end connection 172.28.0.164:58960 (349 connections now open) 2015-10-05T13:13:16.236+0100 [conn2785] end connection 172.28.0.164:58973 (348 connections now open) 2015-10-05T13:13:16.236+0100 [conn2773] end connection 172.28.0.164:58961 (348 connections now open) 2015-10-05T13:13:16.236+0100 [conn2781] end connection 172.28.0.164:58969 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2786] end connection 172.28.0.164:58974 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2783] end connection 172.28.0.164:58971 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2782] end connection 172.28.0.164:58970 (347 connections now open) 2015-10-05T13:13:16.236+0100 [conn2796] end connection 172.28.0.164:58985 (346 connections now open) 2015-10-05T13:13:16.237+0100 [conn2790] end connection 172.28.0.164:58979 (345 connections now open) 2015-10-05T13:13:16.237+0100 [conn2792] end connection 172.28.0.164:58981 (345 connections now open) 2015-10-05T13:13:16.237+0100 [conn2791] end connection 172.28.0.164:58980 (344 connections now open) 2015-10-05T13:13:16.237+0100 [conn2798] end connection 172.28.0.164:58987 (344 connections now open) 2015-10-05T13:13:16.237+0100 [conn2795] end connection 172.28.0.164:58984 (344 connections now open) 2015-10-05T13:13:16.237+0100 [conn2804] end connection 172.28.0.164:58993 (343 connections now open) 2015-10-05T13:13:16.237+0100 [conn2805] end connection 172.28.0.164:58994 (342 connections now open) 2015-10-05T13:13:16.237+0100 [conn2815] end connection 172.28.0.164:59002 (340 connections now open) 2015-10-05T13:13:16.237+0100 [conn2801] end connection 172.28.0.164:58990 (339 connections now open) 2015-10-05T13:13:16.237+0100 [conn2799] end connection 172.28.0.164:58988 (339 connections now open) 2015-10-05T13:13:16.237+0100 [conn2809] end connection 172.28.0.164:58998 (339 connections now open) 2015-10-05T13:13:16.237+0100 [conn2803] end connection 172.28.0.164:58992 (338 connections now open) 2015-10-05T13:13:16.237+0100 [conn2806] end connection 172.28.0.164:58995 (338 connections now open) 2015-10-05T13:13:16.237+0100 [conn2807] end connection 172.28.0.164:58996 (338 connections now open) 2015-10-05T13:13:16.237+0100 [conn2811] end connection 172.28.0.164:59000 (337 connections now open) 2015-10-05T13:13:16.225+0100 [conn2548] end connection 172.28.0.164:58530 (431 connections now open) 2015-10-05T13:13:16.237+0100 [conn2813] end connection 172.28.0.164:59003 (337 connections now open) 2015-10-05T13:13:16.237+0100 [conn2814] end connection 172.28.0.164:59004 (336 connections now open) 2015-10-05T13:13:16.237+0100 [conn2820] end connection 172.28.0.164:59010 (336 connections now open) 2015-10-05T13:13:16.237+0100 [conn2817] end connection 172.28.0.164:59006 (335 connections now open) 2015-10-05T13:13:16.237+0100 [conn2824] end connection 172.28.0.164:59014 (334 connections now open) 2015-10-05T13:13:16.237+0100 [conn2823] end connection 172.28.0.164:59013 (334 connections now open) 2015-10-05T13:13:16.237+0100 [conn2822] end connection 172.28.0.164:59012 (333 connections now open) 2015-10-05T13:13:16.237+0100 [conn2825] end connection 172.28.0.164:59015 (333 connections now open) 2015-10-05T13:13:16.237+0100 [conn2829] end connection 172.28.0.164:59019 (332 connections now open) 2015-10-05T13:13:16.237+0100 [conn2833] end connection 172.28.0.164:59023 (331 connections now open) 2015-10-05T13:13:16.237+0100 [conn2834] end connection 172.28.0.164:59024 (330 connections now open) 2015-10-05T13:13:16.237+0100 [conn2838] end connection 172.28.0.164:59027 (330 connections now open) 2015-10-05T13:13:16.237+0100 [conn2832] end connection 172.28.0.164:59022 (328 connections now open) 2015-10-05T13:13:16.237+0100 [conn2840] end connection 172.28.0.164:59029 (327 connections now open) 2015-10-05T13:13:16.237+0100 [conn2843] end connection 172.28.0.164:59033 (326 connections now open) 2015-10-05T13:13:16.237+0100 [conn2837] end connection 172.28.0.164:59030 (326 connections now open) 2015-10-05T13:13:16.237+0100 [conn2842] end connection 172.28.0.164:59032 (325 connections now open) 2015-10-05T13:13:16.237+0100 [conn2856] end connection 172.28.0.164:59041 (325 connections now open) 2015-10-05T13:13:16.237+0100 [conn2847] end connection 172.28.0.164:59037 (324 connections now open) 2015-10-05T13:13:16.238+0100 [conn2848] end connection 172.28.0.164:59038 (324 connections now open) 2015-10-05T13:13:16.238+0100 [conn2850] end connection 172.28.0.164:59040 (323 connections now open) 2015-10-05T13:13:16.238+0100 [conn2859] end connection 172.28.0.164:59049 (322 connections now open) 2015-10-05T13:13:16.238+0100 [conn2854] end connection 172.28.0.164:59045 (321 connections now open) 2015-10-05T13:13:16.238+0100 [conn2853] end connection 172.28.0.164:59044 (320 connections now open) 2015-10-05T13:13:16.238+0100 [conn2857] end connection 172.28.0.164:59047 (320 connections now open) 2015-10-05T13:13:16.238+0100 [conn2858] end connection 172.28.0.164:59048 (320 connections now open) 2015-10-05T13:13:16.238+0100 [conn2863] end connection 172.28.0.164:59053 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2862] end connection 172.28.0.164:59052 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2865] end connection 172.28.0.164:59055 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2864] end connection 172.28.0.164:59054 (319 connections now open) 2015-10-05T13:13:16.238+0100 [conn2866] end connection 172.28.0.164:59057 (317 connections now open) 2015-10-05T13:13:16.238+0100 [conn2869] end connection 172.28.0.164:59059 (316 connections now open) 2015-10-05T13:13:16.238+0100 [conn2875] end connection 172.28.0.164:59065 (316 connections now open) 2015-10-05T13:13:16.238+0100 [conn2870] end connection 172.28.0.164:59060 (316 connections now open) 2015-10-05T13:13:16.238+0100 [conn2872] end connection 172.28.0.164:59062 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2873] end connection 172.28.0.164:59063 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2874] end connection 172.28.0.164:59064 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2879] end connection 172.28.0.164:59069 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2880] end connection 172.28.0.164:59070 (315 connections now open) 2015-10-05T13:13:16.238+0100 [conn2876] end connection 172.28.0.164:59067 (314 connections now open) 2015-10-05T13:13:16.238+0100 [conn2888] end connection 172.28.0.164:59077 (313 connections now open) 2015-10-05T13:13:16.238+0100 [conn2881] end connection 172.28.0.164:59072 (312 connections now open) 2015-10-05T13:13:16.238+0100 [conn2885] end connection 172.28.0.164:59075 (312 connections now open) 2015-10-05T13:13:16.238+0100 [conn2892] end connection 172.28.0.164:59085 (310 connections now open) 2015-10-05T13:13:16.238+0100 [conn2889] end connection 172.28.0.164:59079 (310 connections now open) 2015-10-05T13:13:16.238+0100 [conn2903] end connection 172.28.0.164:59093 (310 connections now open) 2015-10-05T13:13:16.238+0100 [conn2895] end connection 172.28.0.164:59082 (310 connections now open) 2015-10-05T13:13:16.238+0100 [conn2891] end connection 172.28.0.164:59080 (309 connections now open) 2015-10-05T13:13:16.238+0100 [conn2890] end connection 172.28.0.164:59084 (309 connections now open) 2015-10-05T13:13:16.238+0100 [conn2893] end connection 172.28.0.164:59081 (309 connections now open) 2015-10-05T13:13:16.238+0100 [conn2899] end connection 172.28.0.164:59090 (308 connections now open) 2015-10-05T13:13:16.238+0100 [conn2898] end connection 172.28.0.164:59089 (308 connections now open) 2015-10-05T13:13:16.239+0100 [conn2907] end connection 172.28.0.164:59097 (307 connections now open) 2015-10-05T13:13:16.239+0100 [conn2901] end connection 172.28.0.164:59091 (306 connections now open) 2015-10-05T13:13:16.239+0100 [conn2902] end connection 172.28.0.164:59092 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2904] end connection 172.28.0.164:59094 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2915] end connection 172.28.0.164:59105 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2909] end connection 172.28.0.164:59099 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2906] end connection 172.28.0.164:59096 (305 connections now open) 2015-10-05T13:13:16.239+0100 [conn2663] end connection 172.28.0.164:58718 (356 connections now open) 2015-10-05T13:13:16.239+0100 [conn2923] end connection 172.28.0.164:59114 (304 connections now open) 2015-10-05T13:13:16.239+0100 [conn2911] end connection 172.28.0.164:59101 (304 connections now open) 2015-10-05T13:13:16.239+0100 [conn2912] end connection 172.28.0.164:59102 (302 connections now open) 2015-10-05T13:13:16.239+0100 [conn2914] end connection 172.28.0.164:59104 (302 connections now open) 2015-10-05T13:13:16.239+0100 [conn2913] end connection 172.28.0.164:59103 (301 connections now open) 2015-10-05T13:13:16.239+0100 [conn2920] end connection 172.28.0.164:59109 (300 connections now open) 2015-10-05T13:13:16.239+0100 [conn2917] end connection 172.28.0.164:59108 (300 connections now open) 2015-10-05T13:13:16.239+0100 [conn2921] end connection 172.28.0.164:59112 (299 connections now open) 2015-10-05T13:13:16.239+0100 [conn2925] end connection 172.28.0.164:59115 (299 connections now open) 2015-10-05T13:13:16.239+0100 [conn2929] end connection 172.28.0.164:59120 (297 connections now open) 2015-10-05T13:13:16.239+0100 [conn2932] end connection 172.28.0.164:59123 (297 connections now open) 2015-10-05T13:13:16.239+0100 [conn2930] end connection 172.28.0.164:59121 (297 connections now open) 2015-10-05T13:13:16.239+0100 [conn2931] end connection 172.28.0.164:59122 (296 connections now open) 2015-10-05T13:13:16.239+0100 [conn2938] end connection 172.28.0.164:59129 (296 connections now open) 2015-10-05T13:13:16.239+0100 [conn2935] end connection 172.28.0.164:59127 (295 connections now open) 2015-10-05T13:13:16.239+0100 [conn2936] end connection 172.28.0.164:59126 (294 connections now open) 2015-10-05T13:13:16.239+0100 [conn2934] end connection 172.28.0.164:59125 (294 connections now open) 2015-10-05T13:13:16.239+0100 [conn2946] end connection 172.28.0.164:59137 (292 connections now open) 2015-10-05T13:13:16.239+0100 [conn2947] end connection 172.28.0.164:59138 (291 connections now open) 2015-10-05T13:13:16.239+0100 [conn2945] end connection 172.28.0.164:59136 (290 connections now open) 2015-10-05T13:13:16.239+0100 [conn2943] end connection 172.28.0.164:59134 (290 connections now open) 2015-10-05T13:13:16.239+0100 [conn2944] end connection 172.28.0.164:59135 (290 connections now open) 2015-10-05T13:13:16.239+0100 [conn2950] end connection 172.28.0.164:59141 (290 connections now open) 2015-10-05T13:13:16.239+0100 [conn2949] end connection 172.28.0.164:59140 (289 connections now open) 2015-10-05T13:13:16.240+0100 [conn2766] end connection 172.28.0.164:58954 (351 connections now open) 2015-10-05T13:13:16.240+0100 [conn2778] end connection 172.28.0.164:58966 (347 connections now open) 2015-10-05T13:13:16.240+0100 [conn2788] end connection 172.28.0.164:58976 (345 connections now open) 2015-10-05T13:13:16.240+0100 [conn2816] end connection 172.28.0.164:59005 (335 connections now open) 2015-10-05T13:13:16.240+0100 [conn2835] end connection 172.28.0.164:59025 (328 connections now open) 2015-10-05T13:13:16.240+0100 [conn2883] end connection 172.28.0.164:59073 (314 connections now open) 2015-10-05T13:13:16.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612695c12deab02e2998103 2015-10-05T13:13:17.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:21.898+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:13:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:13:23.165+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612696312deab02e2998104 2015-10-05T13:13:23.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:28.931+0100 [mongosMain] connection accepted from 127.0.0.1:56178 #2960 (110 connections now open) 2015-10-05T13:13:28.933+0100 [conn2960] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:28.934+0100 [conn2960] end connection 127.0.0.1:56178 (109 connections now open) 2015-10-05T13:13:29.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612696912deab02e2998105 2015-10-05T13:13:29.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:39.906+0100 [mongosMain] connection accepted from 127.0.0.1:56179 #2961 (110 connections now open) 2015-10-05T13:13:39.909+0100 [conn2961] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:39.909+0100 [conn2961] end connection 127.0.0.1:56179 (109 connections now open) 2015-10-05T13:13:41.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612697512deab02e2998106 2015-10-05T13:13:41.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:52.158+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:13:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:13:54.174+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612698112deab02e2998107 2015-10-05T13:13:54.310+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:13:54.541+0100 [mongosMain] connection accepted from 172.28.0.163:56199 #2962 (110 connections now open) 2015-10-05T13:13:54.543+0100 [conn2962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.546+0100 [mongosMain] connection accepted from 172.28.0.163:56201 #2963 (111 connections now open) 2015-10-05T13:13:54.547+0100 [mongosMain] connection accepted from 172.28.0.163:56202 #2964 (112 connections now open) 2015-10-05T13:13:54.549+0100 [conn2963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.550+0100 [conn2964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.552+0100 [mongosMain] connection accepted from 172.28.0.163:56203 #2965 (113 connections now open) 2015-10-05T13:13:54.553+0100 [mongosMain] connection accepted from 172.28.0.163:56204 #2966 (114 connections now open) 2015-10-05T13:13:54.555+0100 [conn2965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.557+0100 [conn2966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.559+0100 [mongosMain] connection accepted from 172.28.0.163:56205 #2967 (115 connections now open) 2015-10-05T13:13:54.560+0100 [mongosMain] connection accepted from 172.28.0.163:56206 #2968 (116 connections now open) 2015-10-05T13:13:54.561+0100 [conn2967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.564+0100 [mongosMain] connection accepted from 172.28.0.163:56207 #2969 (117 connections now open) 2015-10-05T13:13:54.564+0100 [mongosMain] connection accepted from 172.28.0.163:56208 #2970 (118 connections now open) 2015-10-05T13:13:54.565+0100 [conn2968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.565+0100 [mongosMain] connection accepted from 172.28.0.163:56209 #2971 (119 connections now open) 2015-10-05T13:13:54.565+0100 [conn2969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.566+0100 [mongosMain] connection accepted from 172.28.0.163:56210 #2972 (120 connections now open) 2015-10-05T13:13:54.566+0100 [conn2970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.566+0100 [mongosMain] connection accepted from 172.28.0.163:56211 #2973 (121 connections now open) 2015-10-05T13:13:54.566+0100 [conn2971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.567+0100 [mongosMain] connection accepted from 172.28.0.163:56212 #2974 (122 connections now open) 2015-10-05T13:13:54.567+0100 [mongosMain] connection accepted from 172.28.0.163:56213 #2975 (123 connections now open) 2015-10-05T13:13:54.567+0100 [conn2972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.568+0100 [conn2973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.568+0100 [conn2974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.569+0100 [mongosMain] connection accepted from 172.28.0.163:56214 #2976 (124 connections now open) 2015-10-05T13:13:54.570+0100 [mongosMain] connection accepted from 172.28.0.163:56215 #2977 (125 connections now open) 2015-10-05T13:13:54.570+0100 [conn2975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.571+0100 [conn2976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.572+0100 [conn2977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.572+0100 [mongosMain] connection accepted from 172.28.0.163:56216 #2978 (126 connections now open) 2015-10-05T13:13:54.573+0100 [mongosMain] connection accepted from 172.28.0.163:56217 #2979 (127 connections now open) 2015-10-05T13:13:54.575+0100 [conn2978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.575+0100 [mongosMain] connection accepted from 172.28.0.163:56218 #2980 (128 connections now open) 2015-10-05T13:13:54.575+0100 [mongosMain] connection accepted from 172.28.0.163:56219 #2981 (129 connections now open) 2015-10-05T13:13:54.575+0100 [mongosMain] connection accepted from 172.28.0.163:56220 #2982 (130 connections now open) 2015-10-05T13:13:54.576+0100 [mongosMain] connection accepted from 172.28.0.163:56221 #2983 (131 connections now open) 2015-10-05T13:13:54.577+0100 [mongosMain] connection accepted from 172.28.0.163:56222 #2984 (132 connections now open) 2015-10-05T13:13:54.577+0100 [mongosMain] connection accepted from 172.28.0.163:56223 #2985 (133 connections now open) 2015-10-05T13:13:54.578+0100 [mongosMain] connection accepted from 172.28.0.163:56224 #2986 (134 connections now open) 2015-10-05T13:13:54.578+0100 [mongosMain] connection accepted from 172.28.0.163:56226 #2987 (135 connections now open) 2015-10-05T13:13:54.579+0100 [conn2984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.579+0100 [mongosMain] connection accepted from 172.28.0.163:56225 #2988 (136 connections now open) 2015-10-05T13:13:54.579+0100 [conn2983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.579+0100 [conn2986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.580+0100 [mongosMain] connection accepted from 172.28.0.163:56227 #2989 (137 connections now open) 2015-10-05T13:13:54.580+0100 [conn2980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.582+0100 [conn2985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.582+0100 [mongosMain] connection accepted from 172.28.0.163:56228 #2990 (138 connections now open) 2015-10-05T13:13:54.583+0100 [conn2989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.587+0100 [conn2990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.588+0100 [mongosMain] connection accepted from 172.28.0.163:56229 #2991 (139 connections now open) 2015-10-05T13:13:54.590+0100 [conn2991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.591+0100 [conn2988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.593+0100 [mongosMain] connection accepted from 172.28.0.163:56230 #2992 (140 connections now open) 2015-10-05T13:13:54.593+0100 [conn2981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.594+0100 [mongosMain] connection accepted from 172.28.0.163:56231 #2993 (141 connections now open) 2015-10-05T13:13:54.595+0100 [mongosMain] connection accepted from 172.28.0.163:56232 #2994 (142 connections now open) 2015-10-05T13:13:54.597+0100 [mongosMain] connection accepted from 172.28.0.163:56233 #2995 (143 connections now open) 2015-10-05T13:13:54.598+0100 [mongosMain] connection accepted from 172.28.0.163:56234 #2996 (144 connections now open) 2015-10-05T13:13:54.600+0100 [mongosMain] connection accepted from 172.28.0.163:56235 #2997 (145 connections now open) 2015-10-05T13:13:54.600+0100 [mongosMain] connection accepted from 172.28.0.163:56236 #2998 (146 connections now open) 2015-10-05T13:13:54.602+0100 [conn2998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.602+0100 [mongosMain] connection accepted from 172.28.0.163:56237 #2999 (147 connections now open) 2015-10-05T13:13:54.603+0100 [mongosMain] connection accepted from 172.28.0.163:56238 #3000 (148 connections now open) 2015-10-05T13:13:54.604+0100 [mongosMain] connection accepted from 172.28.0.163:56239 #3001 (149 connections now open) 2015-10-05T13:13:54.604+0100 [mongosMain] connection accepted from 172.28.0.163:56240 #3002 (150 connections now open) 2015-10-05T13:13:54.605+0100 [mongosMain] connection accepted from 172.28.0.163:56241 #3003 (151 connections now open) 2015-10-05T13:13:54.605+0100 [mongosMain] connection accepted from 172.28.0.163:56242 #3004 (152 connections now open) 2015-10-05T13:13:54.606+0100 [conn2999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.606+0100 [mongosMain] connection accepted from 172.28.0.163:56243 #3005 (153 connections now open) 2015-10-05T13:13:54.606+0100 [conn3001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.607+0100 [mongosMain] connection accepted from 172.28.0.163:56244 #3006 (154 connections now open) 2015-10-05T13:13:54.607+0100 [mongosMain] connection accepted from 172.28.0.163:56245 #3007 (155 connections now open) 2015-10-05T13:13:54.608+0100 [mongosMain] connection accepted from 172.28.0.163:56246 #3008 (156 connections now open) 2015-10-05T13:13:54.608+0100 [conn3004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.608+0100 [mongosMain] connection accepted from 172.28.0.163:56247 #3009 (157 connections now open) 2015-10-05T13:13:54.608+0100 [mongosMain] connection accepted from 172.28.0.163:56248 #3010 (158 connections now open) 2015-10-05T13:13:54.609+0100 [mongosMain] connection accepted from 172.28.0.163:56249 #3011 (159 connections now open) 2015-10-05T13:13:54.609+0100 [mongosMain] connection accepted from 172.28.0.163:56250 #3012 (160 connections now open) 2015-10-05T13:13:54.610+0100 [mongosMain] connection accepted from 172.28.0.163:56251 #3013 (161 connections now open) 2015-10-05T13:13:54.610+0100 [conn3010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.612+0100 [mongosMain] connection accepted from 172.28.0.163:56252 #3014 (162 connections now open) 2015-10-05T13:13:54.612+0100 [conn3007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.613+0100 [conn3011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.613+0100 [conn3014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.614+0100 [mongosMain] connection accepted from 172.28.0.163:56253 #3015 (163 connections now open) 2015-10-05T13:13:54.619+0100 [conn2994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.622+0100 [conn3000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.622+0100 [conn3012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.623+0100 [conn3006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.627+0100 [conn3003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.629+0100 [conn2997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.631+0100 [conn3015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.632+0100 [mongosMain] connection accepted from 172.28.0.163:56254 #3016 (164 connections now open) 2015-10-05T13:13:54.632+0100 [mongosMain] connection accepted from 172.28.0.163:56255 #3017 (165 connections now open) 2015-10-05T13:13:54.632+0100 [mongosMain] connection accepted from 172.28.0.163:56256 #3018 (166 connections now open) 2015-10-05T13:13:54.632+0100 [mongosMain] connection accepted from 172.28.0.163:56257 #3019 (167 connections now open) 2015-10-05T13:13:54.632+0100 [mongosMain] connection accepted from 172.28.0.163:56258 #3020 (168 connections now open) 2015-10-05T13:13:54.635+0100 [mongosMain] connection accepted from 172.28.0.163:56259 #3021 (169 connections now open) 2015-10-05T13:13:54.636+0100 [conn3020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.639+0100 [conn3019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.640+0100 [conn3016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.640+0100 [conn3021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.644+0100 [conn3018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.736+0100 [mongosMain] connection accepted from 172.28.0.163:56260 #3022 (170 connections now open) 2015-10-05T13:13:54.756+0100 [mongosMain] connection accepted from 172.28.0.163:56261 #3023 (171 connections now open) 2015-10-05T13:13:54.756+0100 [mongosMain] connection accepted from 172.28.0.163:56262 #3024 (172 connections now open) 2015-10-05T13:13:54.759+0100 [mongosMain] connection accepted from 172.28.0.163:56263 #3025 (173 connections now open) 2015-10-05T13:13:54.762+0100 [mongosMain] connection accepted from 172.28.0.163:56264 #3026 (174 connections now open) 2015-10-05T13:13:54.762+0100 [mongosMain] connection accepted from 172.28.0.163:56265 #3027 (175 connections now open) 2015-10-05T13:13:54.763+0100 [mongosMain] connection accepted from 172.28.0.163:56266 #3028 (176 connections now open) 2015-10-05T13:13:54.763+0100 [mongosMain] connection accepted from 172.28.0.163:56267 #3029 (177 connections now open) 2015-10-05T13:13:54.763+0100 [mongosMain] connection accepted from 172.28.0.163:56268 #3030 (178 connections now open) 2015-10-05T13:13:54.766+0100 [conn3022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.767+0100 [conn3027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.772+0100 [conn3024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.774+0100 [conn3025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.776+0100 [conn3030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.778+0100 [conn3026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.803+0100 [conn3028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.812+0100 [conn3023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.815+0100 [mongosMain] connection accepted from 172.28.0.163:56269 #3031 (179 connections now open) 2015-10-05T13:13:54.817+0100 [conn3031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.820+0100 [mongosMain] connection accepted from 172.28.0.163:56270 #3032 (180 connections now open) 2015-10-05T13:13:54.822+0100 [conn3032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.834+0100 [mongosMain] connection accepted from 172.28.0.163:56271 #3033 (181 connections now open) 2015-10-05T13:13:54.872+0100 [mongosMain] connection accepted from 172.28.0.163:56272 #3034 (182 connections now open) 2015-10-05T13:13:54.874+0100 [conn3034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.877+0100 [mongosMain] connection accepted from 172.28.0.163:56273 #3035 (183 connections now open) 2015-10-05T13:13:54.878+0100 [mongosMain] connection accepted from 172.28.0.163:56274 #3036 (184 connections now open) 2015-10-05T13:13:54.880+0100 [mongosMain] connection accepted from 172.28.0.163:56275 #3037 (185 connections now open) 2015-10-05T13:13:54.892+0100 [conn3037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.893+0100 [conn3036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.893+0100 [conn3035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.893+0100 [mongosMain] connection accepted from 172.28.0.163:56276 #3038 (186 connections now open) 2015-10-05T13:13:54.895+0100 [conn3038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.900+0100 [conn3033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.900+0100 [mongosMain] connection accepted from 172.28.0.163:56277 #3039 (187 connections now open) 2015-10-05T13:13:54.912+0100 [mongosMain] connection accepted from 172.28.0.163:56279 #3040 (188 connections now open) 2015-10-05T13:13:54.912+0100 [mongosMain] connection accepted from 172.28.0.163:56278 #3041 (189 connections now open) 2015-10-05T13:13:54.912+0100 [mongosMain] connection accepted from 172.28.0.163:56280 #3042 (190 connections now open) 2015-10-05T13:13:54.913+0100 [mongosMain] connection accepted from 172.28.0.163:56281 #3043 (191 connections now open) 2015-10-05T13:13:54.913+0100 [mongosMain] connection accepted from 172.28.0.163:56282 #3044 (192 connections now open) 2015-10-05T13:13:54.913+0100 [mongosMain] connection accepted from 172.28.0.163:56283 #3045 (193 connections now open) 2015-10-05T13:13:54.914+0100 [mongosMain] connection accepted from 172.28.0.163:56284 #3046 (194 connections now open) 2015-10-05T13:13:54.914+0100 [mongosMain] connection accepted from 172.28.0.163:56285 #3047 (195 connections now open) 2015-10-05T13:13:54.914+0100 [mongosMain] connection accepted from 172.28.0.163:56286 #3048 (196 connections now open) 2015-10-05T13:13:54.915+0100 [mongosMain] connection accepted from 172.28.0.163:56287 #3049 (197 connections now open) 2015-10-05T13:13:54.915+0100 [mongosMain] connection accepted from 172.28.0.163:56288 #3050 (198 connections now open) 2015-10-05T13:13:54.915+0100 [mongosMain] connection accepted from 172.28.0.163:56289 #3051 (199 connections now open) 2015-10-05T13:13:54.915+0100 [mongosMain] connection accepted from 172.28.0.163:56290 #3052 (200 connections now open) 2015-10-05T13:13:54.916+0100 [conn3044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.916+0100 [conn3043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.916+0100 [mongosMain] connection accepted from 172.28.0.163:56291 #3053 (201 connections now open) 2015-10-05T13:13:54.916+0100 [mongosMain] connection accepted from 172.28.0.163:56292 #3054 (202 connections now open) 2015-10-05T13:13:54.920+0100 [conn3040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.921+0100 [conn3052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.921+0100 [mongosMain] connection accepted from 172.28.0.163:56293 #3055 (203 connections now open) 2015-10-05T13:13:54.923+0100 [conn3046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.925+0100 [mongosMain] connection accepted from 172.28.0.163:56294 #3056 (204 connections now open) 2015-10-05T13:13:54.929+0100 [conn3049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.933+0100 [mongosMain] connection accepted from 172.28.0.163:56295 #3057 (205 connections now open) 2015-10-05T13:13:54.936+0100 [conn3051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.936+0100 [conn3057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.937+0100 [conn3056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.937+0100 [conn3045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.945+0100 [conn3055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.951+0100 [mongosMain] connection accepted from 172.28.0.163:56296 #3058 (206 connections now open) 2015-10-05T13:13:54.957+0100 [conn3042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.958+0100 [conn3048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.958+0100 [mongosMain] connection accepted from 172.28.0.163:56297 #3059 (207 connections now open) 2015-10-05T13:13:54.959+0100 [mongosMain] connection accepted from 172.28.0.163:56298 #3060 (208 connections now open) 2015-10-05T13:13:54.960+0100 [conn3050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.961+0100 [conn3053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.961+0100 [conn3047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.963+0100 [conn3059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.963+0100 [conn3054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.964+0100 [mongosMain] connection accepted from 172.28.0.163:56299 #3061 (209 connections now open) 2015-10-05T13:13:54.965+0100 [mongosMain] connection accepted from 172.28.0.163:56300 #3062 (210 connections now open) 2015-10-05T13:13:54.965+0100 [mongosMain] connection accepted from 172.28.0.163:56301 #3063 (211 connections now open) 2015-10-05T13:13:54.965+0100 [mongosMain] connection accepted from 172.28.0.163:56302 #3064 (212 connections now open) 2015-10-05T13:13:54.966+0100 [mongosMain] connection accepted from 172.28.0.163:56303 #3065 (213 connections now open) 2015-10-05T13:13:54.966+0100 [mongosMain] connection accepted from 172.28.0.163:56304 #3066 (214 connections now open) 2015-10-05T13:13:54.966+0100 [mongosMain] connection accepted from 172.28.0.163:56305 #3067 (215 connections now open) 2015-10-05T13:13:54.966+0100 [mongosMain] connection accepted from 172.28.0.163:56306 #3068 (216 connections now open) 2015-10-05T13:13:54.967+0100 [mongosMain] connection accepted from 172.28.0.163:56307 #3069 (217 connections now open) 2015-10-05T13:13:54.967+0100 [mongosMain] connection accepted from 172.28.0.163:56308 #3070 (218 connections now open) 2015-10-05T13:13:54.969+0100 [conn3062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.969+0100 [conn3061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.971+0100 [conn3068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.971+0100 [conn3066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.972+0100 [conn3069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.973+0100 [conn3060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.975+0100 [conn3063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.975+0100 [conn3070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.975+0100 [conn3058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.975+0100 [conn3065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.976+0100 [mongosMain] connection accepted from 172.28.0.163:56310 #3071 (219 connections now open) 2015-10-05T13:13:54.977+0100 [mongosMain] connection accepted from 172.28.0.163:56311 #3072 (220 connections now open) 2015-10-05T13:13:54.977+0100 [conn3064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.978+0100 [mongosMain] connection accepted from 172.28.0.163:56312 #3073 (221 connections now open) 2015-10-05T13:13:54.978+0100 [mongosMain] connection accepted from 172.28.0.163:56313 #3074 (222 connections now open) 2015-10-05T13:13:54.979+0100 [mongosMain] connection accepted from 172.28.0.163:56314 #3075 (223 connections now open) 2015-10-05T13:13:54.981+0100 [conn3072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.981+0100 [conn3073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.982+0100 [mongosMain] connection accepted from 172.28.0.163:56315 #3076 (224 connections now open) 2015-10-05T13:13:54.983+0100 [mongosMain] connection accepted from 172.28.0.163:56316 #3077 (225 connections now open) 2015-10-05T13:13:54.985+0100 [conn3076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.987+0100 [conn3075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.990+0100 [conn3071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.991+0100 [mongosMain] connection accepted from 172.28.0.163:56317 #3078 (226 connections now open) 2015-10-05T13:13:54.991+0100 [mongosMain] connection accepted from 172.28.0.163:56318 #3079 (227 connections now open) 2015-10-05T13:13:54.991+0100 [mongosMain] connection accepted from 172.28.0.163:56319 #3080 (228 connections now open) 2015-10-05T13:13:54.992+0100 [mongosMain] connection accepted from 172.28.0.163:56320 #3081 (229 connections now open) 2015-10-05T13:13:54.993+0100 [mongosMain] connection accepted from 172.28.0.163:56321 #3082 (230 connections now open) 2015-10-05T13:13:54.994+0100 [conn3080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.994+0100 [conn3078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.994+0100 [conn3081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.994+0100 [mongosMain] connection accepted from 172.28.0.163:56322 #3083 (231 connections now open) 2015-10-05T13:13:54.997+0100 [mongosMain] connection accepted from 172.28.0.163:56323 #3084 (232 connections now open) 2015-10-05T13:13:54.998+0100 [conn3077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.999+0100 [conn3083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:54.999+0100 [conn3084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.000+0100 [mongosMain] connection accepted from 172.28.0.163:56324 #3085 (233 connections now open) 2015-10-05T13:13:55.001+0100 [mongosMain] connection accepted from 172.28.0.163:56325 #3086 (234 connections now open) 2015-10-05T13:13:55.001+0100 [conn3082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.002+0100 [conn3085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.002+0100 [mongosMain] connection accepted from 172.28.0.163:56326 #3087 (235 connections now open) 2015-10-05T13:13:55.003+0100 [conn3086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.004+0100 [mongosMain] connection accepted from 172.28.0.163:56327 #3088 (236 connections now open) 2015-10-05T13:13:55.004+0100 [conn3087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.004+0100 [mongosMain] connection accepted from 172.28.0.163:56328 #3089 (237 connections now open) 2015-10-05T13:13:55.005+0100 [conn3088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.006+0100 [mongosMain] connection accepted from 172.28.0.163:56329 #3090 (238 connections now open) 2015-10-05T13:13:55.006+0100 [mongosMain] connection accepted from 172.28.0.163:56330 #3091 (239 connections now open) 2015-10-05T13:13:55.006+0100 [mongosMain] connection accepted from 172.28.0.163:56331 #3092 (240 connections now open) 2015-10-05T13:13:55.007+0100 [conn3089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.007+0100 [conn3090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.007+0100 [conn3091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.008+0100 [conn3092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.009+0100 [mongosMain] connection accepted from 172.28.0.163:56332 #3093 (241 connections now open) 2015-10-05T13:13:55.009+0100 [mongosMain] connection accepted from 172.28.0.163:56333 #3094 (242 connections now open) 2015-10-05T13:13:55.010+0100 [mongosMain] connection accepted from 172.28.0.163:56334 #3095 (243 connections now open) 2015-10-05T13:13:55.010+0100 [conn3093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.011+0100 [conn3094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.011+0100 [conn3095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.015+0100 [mongosMain] connection accepted from 172.28.0.163:56335 #3096 (244 connections now open) 2015-10-05T13:13:55.015+0100 [mongosMain] connection accepted from 172.28.0.163:56336 #3097 (245 connections now open) 2015-10-05T13:13:55.016+0100 [conn3096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.016+0100 [mongosMain] connection accepted from 172.28.0.163:56337 #3098 (246 connections now open) 2015-10-05T13:13:55.017+0100 [mongosMain] connection accepted from 172.28.0.163:56338 #3099 (247 connections now open) 2015-10-05T13:13:55.017+0100 [conn3097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.018+0100 [conn3099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:55.100+0100 [conn2394] end connection 172.28.0.164:57156 (246 connections now open) 2015-10-05T13:13:55.101+0100 [mongosMain] connection accepted from 172.28.0.164:59280 #3100 (247 connections now open) 2015-10-05T13:13:55.104+0100 [conn3100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:58.039+0100 [mongosMain] connection accepted from 172.28.0.163:56344 #3101 (248 connections now open) 2015-10-05T13:13:58.041+0100 [conn3101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:59.038+0100 [mongosMain] connection accepted from 172.28.0.163:56346 #3102 (249 connections now open) 2015-10-05T13:13:59.039+0100 [mongosMain] connection accepted from 172.28.0.163:56347 #3103 (250 connections now open) 2015-10-05T13:13:59.040+0100 [conn3102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:59.042+0100 [conn3103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:13:59.052+0100 [mongosMain] connection accepted from 172.28.0.163:56348 #3104 (251 connections now open) 2015-10-05T13:13:59.054+0100 [conn3104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:00.459+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612698812deab02e2998119 2015-10-05T13:14:00.527+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:14:01.042+0100 [conn2979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.047+0100 [conn2992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.047+0100 [conn2993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.048+0100 [conn2996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.048+0100 [conn2995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.050+0100 [conn2987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.058+0100 [conn3002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.059+0100 [conn3008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.059+0100 [conn3005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.061+0100 [conn3009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.062+0100 [conn3013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:01.350+0100 [conn3017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:12.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612699412deab02e299811d 2015-10-05T13:14:12.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:14:22.299+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:14:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:14:25.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269a012deab02e299811e 2015-10-05T13:14:25.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:14:28.440+0100 [mongosMain] connection accepted from 127.0.0.1:56386 #3105 (252 connections now open) 2015-10-05T13:14:28.443+0100 [conn3105] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:28.444+0100 [conn3105] end connection 127.0.0.1:56386 (251 connections now open) 2015-10-05T13:14:40.077+0100 [mongosMain] connection accepted from 127.0.0.1:56387 #3106 (252 connections now open) 2015-10-05T13:14:40.079+0100 [conn3106] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:40.080+0100 [conn3106] end connection 127.0.0.1:56387 (251 connections now open) 2015-10-05T13:14:41.541+0100 [conn3029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:43.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269b312deab02e299811f 2015-10-05T13:14:43.614+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:14:49.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269b912deab02e2998120 2015-10-05T13:14:49.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:14:50.041+0100 [mongosMain] connection accepted from 172.28.0.163:56400 #3107 (252 connections now open) 2015-10-05T13:14:50.046+0100 [mongosMain] connection accepted from 172.28.0.163:56401 #3108 (253 connections now open) 2015-10-05T13:14:52.457+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:14:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:14:55.116+0100 [conn2396] end connection 172.28.0.164:57164 (252 connections now open) 2015-10-05T13:14:55.117+0100 [mongosMain] connection accepted from 172.28.0.164:59331 #3109 (253 connections now open) 2015-10-05T13:14:55.120+0100 [conn3109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:14:56.050+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269bf12deab02e2998121 2015-10-05T13:14:56.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:02.268+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269c612deab02e2998122 2015-10-05T13:15:02.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:08.621+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269cc12deab02e2998124 2015-10-05T13:15:08.756+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:15.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269d212deab02e2998125 2015-10-05T13:15:15.181+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:21.364+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269d912deab02e2998126 2015-10-05T13:15:21.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:22.595+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:15:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:15:27.659+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269df12deab02e2998127 2015-10-05T13:15:27.726+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:28.406+0100 [mongosMain] connection accepted from 127.0.0.1:56438 #3110 (254 connections now open) 2015-10-05T13:15:28.409+0100 [conn3110] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:15:28.410+0100 [conn3110] end connection 127.0.0.1:56438 (253 connections now open) 2015-10-05T13:15:33.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269e512deab02e2998128 2015-10-05T13:15:33.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:36.301+0100 [conn3060] end connection 172.28.0.163:56298 (252 connections now open) 2015-10-05T13:15:36.302+0100 [conn2952] end connection 172.28.0.163:56102 (251 connections now open) 2015-10-05T13:15:36.302+0100 [conn2953] end connection 172.28.0.163:56103 (250 connections now open) 2015-10-05T13:15:36.302+0100 [conn3062] end connection 172.28.0.163:56300 (249 connections now open) 2015-10-05T13:15:36.302+0100 [conn3063] end connection 172.28.0.163:56301 (249 connections now open) 2015-10-05T13:15:36.302+0100 [conn2959] end connection 172.28.0.163:56174 (249 connections now open) 2015-10-05T13:15:36.303+0100 [conn2963] end connection 172.28.0.163:56201 (246 connections now open) 2015-10-05T13:15:36.303+0100 [conn2962] end connection 172.28.0.163:56199 (246 connections now open) 2015-10-05T13:15:36.303+0100 [conn2964] end connection 172.28.0.163:56202 (246 connections now open) 2015-10-05T13:15:36.303+0100 [conn2966] end connection 172.28.0.163:56204 (244 connections now open) 2015-10-05T13:15:36.303+0100 [conn2965] end connection 172.28.0.163:56203 (246 connections now open) 2015-10-05T13:15:36.303+0100 [conn2968] end connection 172.28.0.163:56206 (243 connections now open) 2015-10-05T13:15:36.303+0100 [conn2970] end connection 172.28.0.163:56208 (242 connections now open) 2015-10-05T13:15:36.303+0100 [conn2969] end connection 172.28.0.163:56207 (242 connections now open) 2015-10-05T13:15:36.303+0100 [conn2967] end connection 172.28.0.163:56205 (244 connections now open) 2015-10-05T13:15:36.303+0100 [conn2971] end connection 172.28.0.163:56209 (241 connections now open) 2015-10-05T13:15:36.303+0100 [conn2972] end connection 172.28.0.163:56210 (240 connections now open) 2015-10-05T13:15:36.303+0100 [conn2979] end connection 172.28.0.163:56217 (237 connections now open) 2015-10-05T13:15:36.303+0100 [conn2975] end connection 172.28.0.163:56213 (240 connections now open) 2015-10-05T13:15:36.304+0100 [conn2982] end connection 172.28.0.163:56220 (235 connections now open) 2015-10-05T13:15:36.303+0100 [conn2974] end connection 172.28.0.163:56212 (240 connections now open) 2015-10-05T13:15:36.303+0100 [conn2977] end connection 172.28.0.163:56215 (238 connections now open) 2015-10-05T13:15:36.303+0100 [conn2976] end connection 172.28.0.163:56214 (238 connections now open) 2015-10-05T13:15:36.303+0100 [conn2978] end connection 172.28.0.163:56216 (237 connections now open) 2015-10-05T13:15:36.304+0100 [conn2990] end connection 172.28.0.163:56228 (230 connections now open) 2015-10-05T13:15:36.304+0100 [conn2992] end connection 172.28.0.163:56230 (229 connections now open) 2015-10-05T13:15:36.304+0100 [conn2984] end connection 172.28.0.163:56222 (234 connections now open) 2015-10-05T13:15:36.304+0100 [conn2981] end connection 172.28.0.163:56219 (234 connections now open) 2015-10-05T13:15:36.304+0100 [conn2983] end connection 172.28.0.163:56221 (232 connections now open) 2015-10-05T13:15:36.304+0100 [conn2985] end connection 172.28.0.163:56223 (232 connections now open) 2015-10-05T13:15:36.304+0100 [conn3001] end connection 172.28.0.163:56239 (224 connections now open) 2015-10-05T13:15:36.304+0100 [conn2986] end connection 172.28.0.163:56224 (232 connections now open) 2015-10-05T13:15:36.304+0100 [conn3003] end connection 172.28.0.163:56241 (222 connections now open) 2015-10-05T13:15:36.304+0100 [conn3004] end connection 172.28.0.163:56242 (220 connections now open) 2015-10-05T13:15:36.304+0100 [conn3007] end connection 172.28.0.163:56245 (220 connections now open) 2015-10-05T13:15:36.304+0100 [conn3008] end connection 172.28.0.163:56246 (219 connections now open) 2015-10-05T13:15:36.304+0100 [conn2993] end connection 172.28.0.163:56231 (228 connections now open) 2015-10-05T13:15:36.304+0100 [conn2980] end connection 172.28.0.163:56218 (235 connections now open) 2015-10-05T13:15:36.304+0100 [conn2995] end connection 172.28.0.163:56233 (226 connections now open) 2015-10-05T13:15:36.304+0100 [conn3014] end connection 172.28.0.163:56252 (215 connections now open) 2015-10-05T13:15:36.304+0100 [conn3015] end connection 172.28.0.163:56253 (214 connections now open) 2015-10-05T13:15:36.304+0100 [conn2998] end connection 172.28.0.163:56236 (225 connections now open) 2015-10-05T13:15:36.304+0100 [conn2997] end connection 172.28.0.163:56235 (225 connections now open) 2015-10-05T13:15:36.304+0100 [conn2999] end connection 172.28.0.163:56237 (225 connections now open) 2015-10-05T13:15:36.304+0100 [conn3000] end connection 172.28.0.163:56238 (224 connections now open) 2015-10-05T13:15:36.305+0100 [conn3018] end connection 172.28.0.163:56256 (209 connections now open) 2015-10-05T13:15:36.305+0100 [conn3020] end connection 172.28.0.163:56258 (208 connections now open) 2015-10-05T13:15:36.305+0100 [conn3023] end connection 172.28.0.163:56261 (206 connections now open) 2015-10-05T13:15:36.305+0100 [conn3022] end connection 172.28.0.163:56260 (205 connections now open) 2015-10-05T13:15:36.305+0100 [conn3028] end connection 172.28.0.163:56266 (205 connections now open) 2015-10-05T13:15:36.304+0100 [conn2991] end connection 172.28.0.163:56229 (230 connections now open) 2015-10-05T13:15:36.304+0100 [conn3006] end connection 172.28.0.163:56244 (219 connections now open) 2015-10-05T13:15:36.304+0100 [conn3009] end connection 172.28.0.163:56247 (219 connections now open) 2015-10-05T13:15:36.305+0100 [conn3036] end connection 172.28.0.163:56274 (200 connections now open) 2015-10-05T13:15:36.305+0100 [conn3032] end connection 172.28.0.163:56270 (200 connections now open) 2015-10-05T13:15:36.305+0100 [conn3033] end connection 172.28.0.163:56271 (199 connections now open) 2015-10-05T13:15:36.305+0100 [conn3037] end connection 172.28.0.163:56275 (197 connections now open) 2015-10-05T13:15:36.304+0100 [conn3013] end connection 172.28.0.163:56251 (215 connections now open) 2015-10-05T13:15:36.304+0100 [conn2994] end connection 172.28.0.163:56232 (227 connections now open) 2015-10-05T13:15:36.305+0100 [conn3039] end connection 172.28.0.163:56277 (195 connections now open) 2015-10-05T13:15:36.304+0100 [conn3019] end connection 172.28.0.163:56257 (214 connections now open) 2015-10-05T13:15:36.305+0100 [conn3021] end connection 172.28.0.163:56259 (211 connections now open) 2015-10-05T13:15:36.306+0100 [conn3048] end connection 172.28.0.163:56286 (192 connections now open) 2015-10-05T13:15:36.305+0100 [conn3017] end connection 172.28.0.163:56255 (210 connections now open) 2015-10-05T13:15:36.304+0100 [conn2988] end connection 172.28.0.163:56225 (232 connections now open) 2015-10-05T13:15:36.306+0100 [conn3050] end connection 172.28.0.163:56288 (189 connections now open) 2015-10-05T13:15:36.306+0100 [conn3054] end connection 172.28.0.163:56292 (187 connections now open) 2015-10-05T13:15:36.305+0100 [conn3030] end connection 172.28.0.163:56268 (206 connections now open) 2015-10-05T13:15:36.305+0100 [conn3024] end connection 172.28.0.163:56262 (205 connections now open) 2015-10-05T13:15:36.306+0100 [conn3061] end connection 172.28.0.163:56299 (184 connections now open) 2015-10-05T13:15:36.304+0100 [conn2989] end connection 172.28.0.163:56227 (231 connections now open) 2015-10-05T13:15:36.306+0100 [conn3056] end connection 172.28.0.163:56294 (184 connections now open) 2015-10-05T13:15:36.305+0100 [conn3029] end connection 172.28.0.163:56267 (204 connections now open) 2015-10-05T13:15:36.306+0100 [conn3066] end connection 172.28.0.163:56304 (181 connections now open) 2015-10-05T13:15:36.306+0100 [conn3076] end connection 172.28.0.163:56315 (180 connections now open) 2015-10-05T13:15:36.305+0100 [conn3031] end connection 172.28.0.163:56269 (201 connections now open) 2015-10-05T13:15:36.306+0100 [conn3068] end connection 172.28.0.163:56306 (177 connections now open) 2015-10-05T13:15:36.305+0100 [conn3025] end connection 172.28.0.163:56263 (200 connections now open) 2015-10-05T13:15:36.304+0100 [conn3010] end connection 172.28.0.163:56248 (217 connections now open) 2015-10-05T13:15:36.306+0100 [conn3079] end connection 172.28.0.163:56318 (175 connections now open) 2015-10-05T13:15:36.306+0100 [conn3075] end connection 172.28.0.163:56314 (173 connections now open) 2015-10-05T13:15:36.304+0100 [conn3012] end connection 172.28.0.163:56250 (215 connections now open) 2015-10-05T13:15:36.305+0100 [conn3038] end connection 172.28.0.163:56276 (197 connections now open) 2015-10-05T13:15:36.305+0100 [conn3041] end connection 172.28.0.163:56278 (197 connections now open) 2015-10-05T13:15:36.307+0100 [conn3084] end connection 172.28.0.163:56323 (169 connections now open) 2015-10-05T13:15:36.305+0100 [conn3043] end connection 172.28.0.163:56281 (196 connections now open) 2015-10-05T13:15:36.307+0100 [conn3082] end connection 172.28.0.163:56321 (167 connections now open) 2015-10-05T13:15:36.307+0100 [conn3086] end connection 172.28.0.163:56325 (166 connections now open) 2015-10-05T13:15:36.307+0100 [conn3087] end connection 172.28.0.163:56326 (165 connections now open) 2015-10-05T13:15:36.305+0100 [conn3044] end connection 172.28.0.163:56282 (193 connections now open) 2015-10-05T13:15:36.305+0100 [conn3047] end connection 172.28.0.163:56285 (192 connections now open) 2015-10-05T13:15:36.306+0100 [conn3046] end connection 172.28.0.163:56284 (192 connections now open) 2015-10-05T13:15:36.305+0100 [conn3016] end connection 172.28.0.163:56254 (211 connections now open) 2015-10-05T13:15:36.307+0100 [conn3093] end connection 172.28.0.163:56332 (161 connections now open) 2015-10-05T13:15:36.306+0100 [conn3049] end connection 172.28.0.163:56287 (189 connections now open) 2015-10-05T13:15:36.304+0100 [conn3002] end connection 172.28.0.163:56240 (223 connections now open) 2015-10-05T13:15:36.306+0100 [conn3059] end connection 172.28.0.163:56297 (188 connections now open) 2015-10-05T13:15:36.307+0100 [conn3096] end connection 172.28.0.163:56335 (157 connections now open) 2015-10-05T13:15:36.304+0100 [conn2987] end connection 172.28.0.163:56226 (231 connections now open) 2015-10-05T13:15:36.306+0100 [conn3051] end connection 172.28.0.163:56289 (186 connections now open) 2015-10-05T13:15:36.306+0100 [conn3072] end connection 172.28.0.163:56311 (185 connections now open) 2015-10-05T13:15:36.306+0100 [conn3053] end connection 172.28.0.163:56291 (185 connections now open) 2015-10-05T13:15:36.306+0100 [conn3073] end connection 172.28.0.163:56312 (184 connections now open) 2015-10-05T13:15:36.304+0100 [conn3005] end connection 172.28.0.163:56243 (220 connections now open) 2015-10-05T13:15:36.307+0100 [conn3104] end connection 172.28.0.163:56348 (149 connections now open) 2015-10-05T13:15:36.306+0100 [conn3057] end connection 172.28.0.163:56295 (183 connections now open) 2015-10-05T13:15:36.305+0100 [conn3026] end connection 172.28.0.163:56264 (205 connections now open) 2015-10-05T13:15:36.306+0100 [conn3058] end connection 172.28.0.163:56296 (183 connections now open) 2015-10-05T13:15:36.306+0100 [conn3064] end connection 172.28.0.163:56302 (183 connections now open) 2015-10-05T13:15:36.305+0100 [conn3027] end connection 172.28.0.163:56265 (203 connections now open) 2015-10-05T13:15:36.305+0100 [conn3034] end connection 172.28.0.163:56272 (201 connections now open) 2015-10-05T13:15:36.306+0100 [conn3067] end connection 172.28.0.163:56305 (178 connections now open) 2015-10-05T13:15:36.303+0100 [conn2973] end connection 172.28.0.163:56211 (240 connections now open) 2015-10-05T13:15:36.306+0100 [conn3065] end connection 172.28.0.163:56303 (177 connections now open) 2015-10-05T13:15:36.306+0100 [conn3069] end connection 172.28.0.163:56307 (176 connections now open) 2015-10-05T13:15:36.306+0100 [conn3071] end connection 172.28.0.163:56310 (176 connections now open) 2015-10-05T13:15:36.306+0100 [conn3080] end connection 172.28.0.163:56319 (175 connections now open) 2015-10-05T13:15:36.305+0100 [conn3035] end connection 172.28.0.163:56273 (198 connections now open) 2015-10-05T13:15:36.306+0100 [conn3078] end connection 172.28.0.163:56317 (174 connections now open) 2015-10-05T13:15:36.304+0100 [conn3011] end connection 172.28.0.163:56249 (216 connections now open) 2015-10-05T13:15:36.306+0100 [conn3083] end connection 172.28.0.163:56322 (172 connections now open) 2015-10-05T13:15:36.306+0100 [conn3074] end connection 172.28.0.163:56313 (172 connections now open) 2015-10-05T13:15:36.306+0100 [conn3077] end connection 172.28.0.163:56316 (171 connections now open) 2015-10-05T13:15:36.305+0100 [conn3045] end connection 172.28.0.163:56283 (196 connections now open) 2015-10-05T13:15:36.307+0100 [conn3081] end connection 172.28.0.163:56320 (168 connections now open) 2015-10-05T13:15:36.305+0100 [conn3040] end connection 172.28.0.163:56279 (195 connections now open) 2015-10-05T13:15:36.304+0100 [conn2996] end connection 172.28.0.163:56234 (226 connections now open) 2015-10-05T13:15:36.307+0100 [conn3085] end connection 172.28.0.163:56324 (166 connections now open) 2015-10-05T13:15:36.305+0100 [conn3042] end connection 172.28.0.163:56280 (193 connections now open) 2015-10-05T13:15:36.307+0100 [conn3088] end connection 172.28.0.163:56327 (165 connections now open) 2015-10-05T13:15:36.307+0100 [conn3089] end connection 172.28.0.163:56328 (164 connections now open) 2015-10-05T13:15:36.307+0100 [conn3090] end connection 172.28.0.163:56329 (164 connections now open) 2015-10-05T13:15:36.307+0100 [conn3091] end connection 172.28.0.163:56330 (162 connections now open) 2015-10-05T13:15:36.307+0100 [conn3092] end connection 172.28.0.163:56331 (162 connections now open) 2015-10-05T13:15:36.306+0100 [conn3055] end connection 172.28.0.163:56293 (190 connections now open) 2015-10-05T13:15:36.307+0100 [conn3094] end connection 172.28.0.163:56333 (160 connections now open) 2015-10-05T13:15:36.307+0100 [conn3095] end connection 172.28.0.163:56334 (159 connections now open) 2015-10-05T13:15:36.306+0100 [conn3070] end connection 172.28.0.163:56308 (187 connections now open) 2015-10-05T13:15:36.307+0100 [conn3097] end connection 172.28.0.163:56336 (157 connections now open) 2015-10-05T13:15:36.307+0100 [conn3098] end connection 172.28.0.163:56337 (155 connections now open) 2015-10-05T13:15:36.307+0100 [conn3099] end connection 172.28.0.163:56338 (155 connections now open) 2015-10-05T13:15:36.307+0100 [conn3101] end connection 172.28.0.163:56344 (154 connections now open) 2015-10-05T13:15:36.307+0100 [conn3102] end connection 172.28.0.163:56346 (152 connections now open) 2015-10-05T13:15:36.307+0100 [conn3103] end connection 172.28.0.163:56347 (152 connections now open) 2015-10-05T13:15:36.306+0100 [conn3052] end connection 172.28.0.163:56290 (184 connections now open) 2015-10-05T13:15:39.401+0100 [mongosMain] connection accepted from 127.0.0.1:56443 #3111 (109 connections now open) 2015-10-05T13:15:39.404+0100 [conn3111] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:15:39.404+0100 [conn3111] end connection 127.0.0.1:56443 (108 connections now open) 2015-10-05T13:15:46.247+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269f112deab02e299812a 2015-10-05T13:15:46.383+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:15:52.873+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:15:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:15:55.132+0100 [conn2386] end connection 172.28.0.164:57128 (107 connections now open) 2015-10-05T13:15:55.133+0100 [mongosMain] connection accepted from 172.28.0.164:59385 #3112 (108 connections now open) 2015-10-05T13:15:55.136+0100 [conn3112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:15:58.472+0100 [conn2955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:15:58.472+0100 [conn2956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:15:58.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561269fe12deab02e299812c 2015-10-05T13:15:58.781+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:11.075+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a0a12deab02e299812e 2015-10-05T13:16:11.211+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:17.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a1112deab02e299812f 2015-10-05T13:16:17.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:23.028+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:16:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:16:23.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a1712deab02e2998130 2015-10-05T13:16:23.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:28.573+0100 [mongosMain] connection accepted from 127.0.0.1:56482 #3113 (109 connections now open) 2015-10-05T13:16:28.576+0100 [conn3113] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:16:28.577+0100 [conn3113] end connection 127.0.0.1:56482 (108 connections now open) 2015-10-05T13:16:29.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a1d12deab02e2998132 2015-10-05T13:16:30.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:36.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a2412deab02e2998133 2015-10-05T13:16:36.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:39.835+0100 [mongosMain] connection accepted from 127.0.0.1:56484 #3114 (109 connections now open) 2015-10-05T13:16:39.837+0100 [conn3114] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:16:39.838+0100 [conn3114] end connection 127.0.0.1:56484 (108 connections now open) 2015-10-05T13:16:42.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a2a12deab02e2998134 2015-10-05T13:16:42.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:48.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a3012deab02e2998135 2015-10-05T13:16:48.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:16:53.260+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:16:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:16:55.148+0100 [conn2397] end connection 172.28.0.164:57168 (107 connections now open) 2015-10-05T13:16:55.153+0100 [mongosMain] connection accepted from 172.28.0.164:59434 #3115 (108 connections now open) 2015-10-05T13:16:55.156+0100 [conn3115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:16:55.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a3612deab02e2998136 2015-10-05T13:16:55.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:01.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a3d12deab02e2998137 2015-10-05T13:17:01.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:08.077+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a4312deab02e2998138 2015-10-05T13:17:08.210+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:14.497+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a4a12deab02e2998139 2015-10-05T13:17:14.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:20.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a5012deab02e299813c 2015-10-05T13:17:21.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:23.516+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:17:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:17:27.376+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a5712deab02e299813d 2015-10-05T13:17:27.478+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:29.018+0100 [mongosMain] connection accepted from 127.0.0.1:56528 #3116 (109 connections now open) 2015-10-05T13:17:29.021+0100 [conn3116] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:17:29.022+0100 [conn3116] end connection 127.0.0.1:56528 (108 connections now open) 2015-10-05T13:17:33.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a5d12deab02e299813e 2015-10-05T13:17:33.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:34.645+0100 [mongosMain] connection accepted from 172.28.0.164:59463 #3117 (109 connections now open) 2015-10-05T13:17:34.647+0100 [conn3117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:17:39.724+0100 [mongosMain] connection accepted from 127.0.0.1:56530 #3118 (110 connections now open) 2015-10-05T13:17:39.727+0100 [conn3118] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:17:39.727+0100 [conn3118] end connection 127.0.0.1:56530 (109 connections now open) 2015-10-05T13:17:39.879+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a6312deab02e299813f 2015-10-05T13:17:39.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:46.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a6912deab02e2998140 2015-10-05T13:17:46.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:52.495+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a7012deab02e2998141 2015-10-05T13:17:52.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:17:53.793+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:17:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:17:55.164+0100 [conn2398] end connection 172.28.0.164:57172 (108 connections now open) 2015-10-05T13:17:55.166+0100 [mongosMain] connection accepted from 172.28.0.164:59490 #3119 (109 connections now open) 2015-10-05T13:17:55.169+0100 [conn3119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:17:58.848+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a7612deab02e2998142 2015-10-05T13:17:58.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:05.285+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a7d12deab02e2998143 2015-10-05T13:18:05.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:11.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a8312deab02e2998144 2015-10-05T13:18:11.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:17.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a8912deab02e2998145 2015-10-05T13:18:18.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:23.929+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:18:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:18:24.204+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a9012deab02e2998146 2015-10-05T13:18:24.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:29.066+0100 [mongosMain] connection accepted from 127.0.0.1:56584 #3120 (110 connections now open) 2015-10-05T13:18:29.069+0100 [conn3120] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:18:29.070+0100 [conn3120] end connection 127.0.0.1:56584 (109 connections now open) 2015-10-05T13:18:30.562+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a9612deab02e2998148 2015-10-05T13:18:30.698+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:37.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126a9c12deab02e2998149 2015-10-05T13:18:37.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:40.073+0100 [mongosMain] connection accepted from 127.0.0.1:56586 #3121 (110 connections now open) 2015-10-05T13:18:40.076+0100 [conn3121] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:18:40.076+0100 [conn3121] end connection 127.0.0.1:56586 (109 connections now open) 2015-10-05T13:18:43.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126aa312deab02e299814a 2015-10-05T13:18:43.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:48.052+0100 [mongosMain] connection accepted from 172.28.0.163:56595 #3122 (110 connections now open) 2015-10-05T13:18:48.053+0100 [mongosMain] connection accepted from 172.28.0.163:56596 #3123 (111 connections now open) 2015-10-05T13:18:49.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126aa912deab02e299814b 2015-10-05T13:18:49.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:18:54.204+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:18:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:18:55.012+0100 [mongosMain] connection accepted from 172.28.0.164:59557 #3124 (112 connections now open) 2015-10-05T13:18:55.013+0100 [mongosMain] connection accepted from 172.28.0.164:59558 #3125 (113 connections now open) 2015-10-05T13:18:55.180+0100 [conn2399] end connection 172.28.0.164:57175 (112 connections now open) 2015-10-05T13:18:55.182+0100 [mongosMain] connection accepted from 172.28.0.164:59562 #3126 (113 connections now open) 2015-10-05T13:18:55.184+0100 [conn3126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:18:56.051+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126aaf12deab02e299814c 2015-10-05T13:18:56.186+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:19:13.051+0100 [conn3107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:19:14.480+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ac212deab02e299814e 2015-10-05T13:19:14.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:19:24.347+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:19:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:19:26.704+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:19:26.704+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:19:29.129+0100 [mongosMain] connection accepted from 127.0.0.1:56634 #3127 (114 connections now open) 2015-10-05T13:19:29.132+0100 [conn3127] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:19:29.133+0100 [conn3127] end connection 127.0.0.1:56634 (113 connections now open) 2015-10-05T13:19:32.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ad412deab02e2998151 2015-10-05T13:19:32.920+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:19:39.380+0100 [mongosMain] connection accepted from 127.0.0.1:56639 #3128 (114 connections now open) 2015-10-05T13:19:39.382+0100 [conn3128] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:19:39.383+0100 [conn3128] end connection 127.0.0.1:56639 (113 connections now open) 2015-10-05T13:19:42.986+0100 [conn3107] end connection 172.28.0.163:56400 (112 connections now open) 2015-10-05T13:19:42.986+0100 [conn3108] end connection 172.28.0.163:56401 (112 connections now open) 2015-10-05T13:19:51.223+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ae612deab02e2998153 2015-10-05T13:19:51.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:19:53.615+0100 [conn2955] end connection 172.28.0.164:59197 (110 connections now open) 2015-10-05T13:19:53.615+0100 [conn2956] end connection 172.28.0.164:59198 (109 connections now open) 2015-10-05T13:19:53.617+0100 [conn3117] end connection 172.28.0.164:59463 (108 connections now open) 2015-10-05T13:19:54.601+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:19:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:19:55.196+0100 [conn2400] end connection 172.28.0.164:57177 (107 connections now open) 2015-10-05T13:19:55.198+0100 [mongosMain] connection accepted from 172.28.0.164:59612 #3129 (108 connections now open) 2015-10-05T13:19:55.201+0100 [conn3129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:20:03.513+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:20:03.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:20:15.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126aff12deab02e2998157 2015-10-05T13:20:15.942+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:20:24.857+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:20:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:20:28.134+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b0b12deab02e2998158 2015-10-05T13:20:28.236+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:20:28.981+0100 [mongosMain] connection accepted from 127.0.0.1:56727 #3130 (109 connections now open) 2015-10-05T13:20:28.984+0100 [conn3130] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:20:28.985+0100 [conn3130] end connection 127.0.0.1:56727 (108 connections now open) 2015-10-05T13:20:39.990+0100 [mongosMain] connection accepted from 127.0.0.1:56731 #3131 (109 connections now open) 2015-10-05T13:20:39.992+0100 [conn3131] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:20:39.993+0100 [conn3131] end connection 127.0.0.1:56731 (108 connections now open) 2015-10-05T13:20:40.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b1812deab02e2998159 2015-10-05T13:20:40.532+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:20:46.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b1e12deab02e299815a 2015-10-05T13:20:46.953+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:20:55.121+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:20:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:20:55.213+0100 [conn2401] end connection 172.28.0.164:57178 (107 connections now open) 2015-10-05T13:20:55.213+0100 [mongosMain] connection accepted from 172.28.0.164:59654 #3132 (108 connections now open) 2015-10-05T13:20:55.216+0100 [conn3132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:20:59.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b2a12deab02e299815b 2015-10-05T13:20:59.356+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:21:04.011+0100 [conn3125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:21:13.800+0100 [conn2708] end connection 172.28.0.163:55929 (107 connections now open) 2015-10-05T13:21:13.801+0100 [mongosMain] connection accepted from 172.28.0.163:56767 #3133 (108 connections now open) 2015-10-05T13:21:13.803+0100 [conn3133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:21:17.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b3d12deab02e299815d 2015-10-05T13:21:17.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:21:23.745+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:21:23.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:21:25.386+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:21:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:21:28.583+0100 [mongosMain] connection accepted from 127.0.0.1:56779 #3134 (109 connections now open) 2015-10-05T13:21:28.586+0100 [conn3134] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:21:28.587+0100 [conn3134] end connection 127.0.0.1:56779 (108 connections now open) 2015-10-05T13:21:30.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b4912deab02e299815f 2015-10-05T13:21:30.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:21:39.502+0100 [mongosMain] connection accepted from 127.0.0.1:56781 #3135 (109 connections now open) 2015-10-05T13:21:39.505+0100 [conn3135] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:21:39.505+0100 [conn3135] end connection 127.0.0.1:56781 (108 connections now open) 2015-10-05T13:21:42.442+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b5612deab02e2998160 2015-10-05T13:21:42.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:21:54.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b6212deab02e2998162 2015-10-05T13:21:54.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:21:55.229+0100 [conn2402] end connection 172.28.0.164:57179 (107 connections now open) 2015-10-05T13:21:55.230+0100 [mongosMain] connection accepted from 172.28.0.164:59715 #3136 (108 connections now open) 2015-10-05T13:21:55.233+0100 [conn3136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:21:55.547+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:21:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:22:02.371+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:22:02.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:22:13.811+0100 [conn2710] end connection 172.28.0.163:55947 (107 connections now open) 2015-10-05T13:22:13.812+0100 [mongosMain] connection accepted from 172.28.0.163:56809 #3137 (108 connections now open) 2015-10-05T13:22:13.814+0100 [conn3137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:15.495+0100 [mongosMain] connection accepted from 172.28.0.164:59717 #3138 (109 connections now open) 2015-10-05T13:22:15.495+0100 [mongosMain] connection accepted from 172.28.0.164:59718 #3139 (110 connections now open) 2015-10-05T13:22:28.090+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:22:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:22:37.580+0100 [conn3122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:38.560+0100 [conn3123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:41.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b9112deab02e2998168 2015-10-05T13:22:42.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:22:48.404+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b9812deab02e299816a 2015-10-05T13:22:48.540+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:22:49.252+0100 [mongosMain] connection accepted from 127.0.0.1:56839 #3140 (111 connections now open) 2015-10-05T13:22:49.255+0100 [conn3140] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:49.256+0100 [conn3140] end connection 127.0.0.1:56839 (110 connections now open) 2015-10-05T13:22:53.514+0100 [conn3138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:54.859+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126b9e12deab02e299816c 2015-10-05T13:22:54.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:22:55.245+0100 [conn2403] end connection 172.28.0.164:57180 (109 connections now open) 2015-10-05T13:22:55.246+0100 [mongosMain] connection accepted from 172.28.0.164:59756 #3141 (110 connections now open) 2015-10-05T13:22:55.248+0100 [conn3141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:55.579+0100 [mongosMain] connection accepted from 127.0.0.1:56840 #3142 (111 connections now open) 2015-10-05T13:22:55.581+0100 [conn3142] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:22:55.582+0100 [conn3142] end connection 127.0.0.1:56840 (110 connections now open) 2015-10-05T13:22:58.341+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:22:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:23:01.281+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ba512deab02e299816f 2015-10-05T13:23:01.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:07.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bab12deab02e2998170 2015-10-05T13:23:07.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:13.827+0100 [conn2711] end connection 172.28.0.163:55949 (109 connections now open) 2015-10-05T13:23:13.828+0100 [mongosMain] connection accepted from 172.28.0.163:56878 #3143 (110 connections now open) 2015-10-05T13:23:13.830+0100 [conn3143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:13.954+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bb112deab02e2998171 2015-10-05T13:23:14.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:18.005+0100 [conn3124] end connection 172.28.0.164:59557 (109 connections now open) 2015-10-05T13:23:18.005+0100 [conn3125] end connection 172.28.0.164:59558 (109 connections now open) 2015-10-05T13:23:20.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bb812deab02e2998172 2015-10-05T13:23:20.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:26.821+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bbe12deab02e2998173 2015-10-05T13:23:26.957+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:27.440+0100 [mongosMain] connection accepted from 127.0.0.1:56885 #3144 (109 connections now open) 2015-10-05T13:23:27.442+0100 [conn3144] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:27.443+0100 [conn3144] end connection 127.0.0.1:56885 (108 connections now open) 2015-10-05T13:23:28.590+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:23:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:23:28.639+0100 [mongosMain] connection accepted from 127.0.0.1:56886 #3145 (109 connections now open) 2015-10-05T13:23:28.641+0100 [conn3145] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:28.642+0100 [conn3145] end connection 127.0.0.1:56886 (108 connections now open) 2015-10-05T13:23:29.748+0100 [mongosMain] connection accepted from 127.0.0.1:56887 #3146 (109 connections now open) 2015-10-05T13:23:29.751+0100 [conn3146] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:29.752+0100 [conn3146] end connection 127.0.0.1:56887 (108 connections now open) 2015-10-05T13:23:30.509+0100 [conn3138] end connection 172.28.0.164:59717 (107 connections now open) 2015-10-05T13:23:30.509+0100 [conn3139] end connection 172.28.0.164:59718 (106 connections now open) 2015-10-05T13:23:33.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bc412deab02e2998174 2015-10-05T13:23:33.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:39.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bcb12deab02e2998175 2015-10-05T13:23:39.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:40.129+0100 [mongosMain] connection accepted from 127.0.0.1:56889 #3147 (107 connections now open) 2015-10-05T13:23:40.132+0100 [conn3147] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:40.133+0100 [conn3147] end connection 127.0.0.1:56889 (106 connections now open) 2015-10-05T13:23:45.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bd112deab02e2998176 2015-10-05T13:23:46.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:52.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bd812deab02e2998177 2015-10-05T13:23:52.221+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:55.261+0100 [conn2404] end connection 172.28.0.164:57181 (105 connections now open) 2015-10-05T13:23:55.262+0100 [mongosMain] connection accepted from 172.28.0.164:59822 #3148 (106 connections now open) 2015-10-05T13:23:55.265+0100 [conn3148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:23:58.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bde12deab02e2998179 2015-10-05T13:23:58.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:23:58.845+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:23:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:24:04.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126be412deab02e299817a 2015-10-05T13:24:04.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:24:11.139+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bea12deab02e299817b 2015-10-05T13:24:11.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:24:13.842+0100 [conn2712] end connection 172.28.0.163:55954 (105 connections now open) 2015-10-05T13:24:13.843+0100 [mongosMain] connection accepted from 172.28.0.163:56930 #3149 (106 connections now open) 2015-10-05T13:24:13.845+0100 [conn3149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:17.557+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bf112deab02e299817c 2015-10-05T13:24:17.693+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:24:23.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126bf712deab02e299817d 2015-10-05T13:24:23.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:24:27.011+0100 [mongosMain] connection accepted from 172.28.0.164:59849 #3150 (107 connections now open) 2015-10-05T13:24:27.011+0100 [mongosMain] connection accepted from 172.28.0.164:59850 #3151 (108 connections now open) 2015-10-05T13:24:28.349+0100 [mongosMain] connection accepted from 127.0.0.1:56941 #3152 (109 connections now open) 2015-10-05T13:24:28.352+0100 [conn3152] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:28.353+0100 [conn3152] end connection 127.0.0.1:56941 (108 connections now open) 2015-10-05T13:24:29.010+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:24:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:24:39.444+0100 [mongosMain] connection accepted from 127.0.0.1:56944 #3153 (109 connections now open) 2015-10-05T13:24:39.447+0100 [conn3153] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:39.448+0100 [conn3153] end connection 127.0.0.1:56944 (108 connections now open) 2015-10-05T13:24:48.339+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c0f12deab02e299817f 2015-10-05T13:24:48.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:24:55.277+0100 [conn2405] end connection 172.28.0.164:57182 (107 connections now open) 2015-10-05T13:24:55.278+0100 [mongosMain] connection accepted from 172.28.0.164:59886 #3154 (108 connections now open) 2015-10-05T13:24:55.280+0100 [conn3154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.568+0100 [mongosMain] connection accepted from 172.28.0.163:56965 #3155 (109 connections now open) 2015-10-05T13:24:57.569+0100 [mongosMain] connection accepted from 172.28.0.163:56966 #3156 (110 connections now open) 2015-10-05T13:24:57.570+0100 [conn3155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.571+0100 [mongosMain] connection accepted from 172.28.0.163:56967 #3157 (111 connections now open) 2015-10-05T13:24:57.572+0100 [mongosMain] connection accepted from 172.28.0.163:56968 #3158 (112 connections now open) 2015-10-05T13:24:57.573+0100 [mongosMain] connection accepted from 172.28.0.163:56969 #3159 (113 connections now open) 2015-10-05T13:24:57.575+0100 [mongosMain] connection accepted from 172.28.0.163:56970 #3160 (114 connections now open) 2015-10-05T13:24:57.576+0100 [mongosMain] connection accepted from 172.28.0.163:56971 #3161 (115 connections now open) 2015-10-05T13:24:57.577+0100 [mongosMain] connection accepted from 172.28.0.163:56972 #3162 (116 connections now open) 2015-10-05T13:24:57.578+0100 [mongosMain] connection accepted from 172.28.0.163:56973 #3163 (117 connections now open) 2015-10-05T13:24:57.580+0100 [mongosMain] connection accepted from 172.28.0.163:56974 #3164 (118 connections now open) 2015-10-05T13:24:57.581+0100 [mongosMain] connection accepted from 172.28.0.163:56975 #3165 (119 connections now open) 2015-10-05T13:24:57.582+0100 [mongosMain] connection accepted from 172.28.0.163:56976 #3166 (120 connections now open) 2015-10-05T13:24:57.583+0100 [mongosMain] connection accepted from 172.28.0.163:56977 #3167 (121 connections now open) 2015-10-05T13:24:57.584+0100 [mongosMain] connection accepted from 172.28.0.163:56978 #3168 (122 connections now open) 2015-10-05T13:24:57.585+0100 [mongosMain] connection accepted from 172.28.0.163:56979 #3169 (123 connections now open) 2015-10-05T13:24:57.586+0100 [mongosMain] connection accepted from 172.28.0.163:56980 #3170 (124 connections now open) 2015-10-05T13:24:57.590+0100 [mongosMain] connection accepted from 172.28.0.163:56981 #3171 (125 connections now open) 2015-10-05T13:24:57.593+0100 [conn3156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.593+0100 [conn3161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.593+0100 [conn3160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.593+0100 [conn3162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.594+0100 [conn3158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.594+0100 [conn3159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.594+0100 [conn3157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.594+0100 [conn3164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.594+0100 [conn3163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.604+0100 [conn3166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.604+0100 [conn3168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.605+0100 [conn3169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.605+0100 [conn3170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.612+0100 [conn3171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.657+0100 [conn3167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.716+0100 [mongosMain] connection accepted from 172.28.0.163:56983 #3172 (126 connections now open) 2015-10-05T13:24:57.719+0100 [conn3172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.723+0100 [mongosMain] connection accepted from 172.28.0.163:56984 #3173 (127 connections now open) 2015-10-05T13:24:57.724+0100 [mongosMain] connection accepted from 172.28.0.163:56985 #3174 (128 connections now open) 2015-10-05T13:24:57.725+0100 [conn3173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.726+0100 [conn3174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.728+0100 [mongosMain] connection accepted from 172.28.0.163:56986 #3175 (129 connections now open) 2015-10-05T13:24:57.735+0100 [mongosMain] connection accepted from 172.28.0.163:56987 #3176 (130 connections now open) 2015-10-05T13:24:57.737+0100 [mongosMain] connection accepted from 172.28.0.163:56988 #3177 (131 connections now open) 2015-10-05T13:24:57.739+0100 [mongosMain] connection accepted from 172.28.0.163:56990 #3178 (132 connections now open) 2015-10-05T13:24:57.742+0100 [mongosMain] connection accepted from 172.28.0.163:56992 #3179 (133 connections now open) 2015-10-05T13:24:57.742+0100 [conn3178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.743+0100 [conn3177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.745+0100 [mongosMain] connection accepted from 172.28.0.163:56993 #3180 (134 connections now open) 2015-10-05T13:24:57.746+0100 [conn3180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.753+0100 [mongosMain] connection accepted from 172.28.0.163:56994 #3181 (135 connections now open) 2015-10-05T13:24:57.754+0100 [mongosMain] connection accepted from 172.28.0.163:56995 #3182 (136 connections now open) 2015-10-05T13:24:57.754+0100 [mongosMain] connection accepted from 172.28.0.163:56996 #3183 (137 connections now open) 2015-10-05T13:24:57.754+0100 [conn3181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.755+0100 [mongosMain] connection accepted from 172.28.0.163:56997 #3184 (138 connections now open) 2015-10-05T13:24:57.755+0100 [conn3182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.755+0100 [conn3183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.755+0100 [mongosMain] connection accepted from 172.28.0.163:56998 #3185 (139 connections now open) 2015-10-05T13:24:57.756+0100 [conn3184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.756+0100 [mongosMain] connection accepted from 172.28.0.163:56999 #3186 (140 connections now open) 2015-10-05T13:24:57.757+0100 [conn3185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.757+0100 [mongosMain] connection accepted from 172.28.0.163:57000 #3187 (141 connections now open) 2015-10-05T13:24:57.757+0100 [mongosMain] connection accepted from 172.28.0.163:57001 #3188 (142 connections now open) 2015-10-05T13:24:57.757+0100 [conn3186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.758+0100 [mongosMain] connection accepted from 172.28.0.163:57002 #3189 (143 connections now open) 2015-10-05T13:24:57.758+0100 [conn3187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.759+0100 [mongosMain] connection accepted from 172.28.0.163:57003 #3190 (144 connections now open) 2015-10-05T13:24:57.759+0100 [conn3189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.759+0100 [mongosMain] connection accepted from 172.28.0.163:57004 #3191 (145 connections now open) 2015-10-05T13:24:57.761+0100 [conn3190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.761+0100 [conn3191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.761+0100 [mongosMain] connection accepted from 172.28.0.163:57005 #3192 (146 connections now open) 2015-10-05T13:24:57.761+0100 [mongosMain] connection accepted from 172.28.0.163:57006 #3193 (147 connections now open) 2015-10-05T13:24:57.762+0100 [conn3192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.763+0100 [conn3193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.763+0100 [mongosMain] connection accepted from 172.28.0.163:57007 #3194 (148 connections now open) 2015-10-05T13:24:57.764+0100 [conn3188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.765+0100 [mongosMain] connection accepted from 172.28.0.163:57008 #3195 (149 connections now open) 2015-10-05T13:24:57.765+0100 [conn3194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.765+0100 [mongosMain] connection accepted from 172.28.0.163:57009 #3196 (150 connections now open) 2015-10-05T13:24:57.766+0100 [mongosMain] connection accepted from 172.28.0.163:57010 #3197 (151 connections now open) 2015-10-05T13:24:57.767+0100 [mongosMain] connection accepted from 172.28.0.163:57011 #3198 (152 connections now open) 2015-10-05T13:24:57.767+0100 [mongosMain] connection accepted from 172.28.0.163:57012 #3199 (153 connections now open) 2015-10-05T13:24:57.767+0100 [conn3195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.767+0100 [mongosMain] connection accepted from 172.28.0.163:57013 #3200 (154 connections now open) 2015-10-05T13:24:57.768+0100 [mongosMain] connection accepted from 172.28.0.163:57014 #3201 (155 connections now open) 2015-10-05T13:24:57.768+0100 [conn3197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.769+0100 [mongosMain] connection accepted from 172.28.0.163:57015 #3202 (156 connections now open) 2015-10-05T13:24:57.769+0100 [conn3196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.770+0100 [mongosMain] connection accepted from 172.28.0.163:57016 #3203 (157 connections now open) 2015-10-05T13:24:57.771+0100 [mongosMain] connection accepted from 172.28.0.163:57017 #3204 (158 connections now open) 2015-10-05T13:24:57.772+0100 [conn3202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.772+0100 [conn3201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.773+0100 [conn3198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.773+0100 [conn3199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.773+0100 [mongosMain] connection accepted from 172.28.0.163:57018 #3205 (159 connections now open) 2015-10-05T13:24:57.774+0100 [conn3204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.774+0100 [mongosMain] connection accepted from 172.28.0.163:57019 #3206 (160 connections now open) 2015-10-05T13:24:57.775+0100 [mongosMain] connection accepted from 172.28.0.163:57020 #3207 (161 connections now open) 2015-10-05T13:24:57.775+0100 [mongosMain] connection accepted from 172.28.0.163:57021 #3208 (162 connections now open) 2015-10-05T13:24:57.775+0100 [conn3205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.775+0100 [mongosMain] connection accepted from 172.28.0.163:57022 #3209 (163 connections now open) 2015-10-05T13:24:57.776+0100 [mongosMain] connection accepted from 172.28.0.163:57023 #3210 (164 connections now open) 2015-10-05T13:24:57.776+0100 [mongosMain] connection accepted from 172.28.0.163:57024 #3211 (165 connections now open) 2015-10-05T13:24:57.777+0100 [mongosMain] connection accepted from 172.28.0.163:57025 #3212 (166 connections now open) 2015-10-05T13:24:57.778+0100 [conn3206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.778+0100 [mongosMain] connection accepted from 172.28.0.163:57026 #3213 (167 connections now open) 2015-10-05T13:24:57.778+0100 [mongosMain] connection accepted from 172.28.0.163:57027 #3214 (168 connections now open) 2015-10-05T13:24:57.778+0100 [mongosMain] connection accepted from 172.28.0.163:57028 #3215 (169 connections now open) 2015-10-05T13:24:57.779+0100 [mongosMain] connection accepted from 172.28.0.163:57029 #3216 (170 connections now open) 2015-10-05T13:24:57.779+0100 [mongosMain] connection accepted from 172.28.0.163:57030 #3217 (171 connections now open) 2015-10-05T13:24:57.779+0100 [conn3208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.780+0100 [mongosMain] connection accepted from 172.28.0.163:57031 #3218 (172 connections now open) 2015-10-05T13:24:57.780+0100 [mongosMain] connection accepted from 172.28.0.163:57032 #3219 (173 connections now open) 2015-10-05T13:24:57.780+0100 [mongosMain] connection accepted from 172.28.0.163:57033 #3220 (174 connections now open) 2015-10-05T13:24:57.781+0100 [mongosMain] connection accepted from 172.28.0.163:57034 #3221 (175 connections now open) 2015-10-05T13:24:57.781+0100 [mongosMain] connection accepted from 172.28.0.163:57035 #3222 (176 connections now open) 2015-10-05T13:24:57.781+0100 [mongosMain] connection accepted from 172.28.0.163:57036 #3223 (177 connections now open) 2015-10-05T13:24:57.782+0100 [conn3218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.782+0100 [conn3222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.783+0100 [mongosMain] connection accepted from 172.28.0.163:57037 #3224 (178 connections now open) 2015-10-05T13:24:57.783+0100 [conn3220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.784+0100 [mongosMain] connection accepted from 172.28.0.163:57038 #3225 (179 connections now open) 2015-10-05T13:24:57.785+0100 [conn3210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.786+0100 [conn3214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.786+0100 [conn3212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.788+0100 [conn3216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.788+0100 [conn3211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.791+0100 [conn3217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.792+0100 [mongosMain] connection accepted from 172.28.0.163:57039 #3226 (180 connections now open) 2015-10-05T13:24:57.791+0100 [conn3223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.794+0100 [mongosMain] connection accepted from 172.28.0.163:57040 #3227 (181 connections now open) 2015-10-05T13:24:57.794+0100 [mongosMain] connection accepted from 172.28.0.163:57041 #3228 (182 connections now open) 2015-10-05T13:24:57.794+0100 [conn3224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.795+0100 [mongosMain] connection accepted from 172.28.0.163:57042 #3229 (183 connections now open) 2015-10-05T13:24:57.795+0100 [mongosMain] connection accepted from 172.28.0.163:57043 #3230 (184 connections now open) 2015-10-05T13:24:57.797+0100 [mongosMain] connection accepted from 172.28.0.163:57044 #3231 (185 connections now open) 2015-10-05T13:24:57.797+0100 [mongosMain] connection accepted from 172.28.0.163:57045 #3232 (186 connections now open) 2015-10-05T13:24:57.799+0100 [mongosMain] connection accepted from 172.28.0.163:57046 #3233 (187 connections now open) 2015-10-05T13:24:57.799+0100 [mongosMain] connection accepted from 172.28.0.163:57047 #3234 (188 connections now open) 2015-10-05T13:24:57.799+0100 [mongosMain] connection accepted from 172.28.0.163:57048 #3235 (189 connections now open) 2015-10-05T13:24:57.801+0100 [mongosMain] connection accepted from 172.28.0.163:57049 #3236 (190 connections now open) 2015-10-05T13:24:57.801+0100 [mongosMain] connection accepted from 172.28.0.163:57050 #3237 (191 connections now open) 2015-10-05T13:24:57.801+0100 [mongosMain] connection accepted from 172.28.0.163:57051 #3238 (192 connections now open) 2015-10-05T13:24:57.802+0100 [mongosMain] connection accepted from 172.28.0.163:57052 #3239 (193 connections now open) 2015-10-05T13:24:57.802+0100 [conn3226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.802+0100 [mongosMain] connection accepted from 172.28.0.163:57053 #3240 (194 connections now open) 2015-10-05T13:24:57.803+0100 [mongosMain] connection accepted from 172.28.0.163:57054 #3241 (195 connections now open) 2015-10-05T13:24:57.803+0100 [conn3232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.803+0100 [mongosMain] connection accepted from 172.28.0.163:57055 #3242 (196 connections now open) 2015-10-05T13:24:57.804+0100 [mongosMain] connection accepted from 172.28.0.163:57056 #3243 (197 connections now open) 2015-10-05T13:24:57.805+0100 [conn3228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.805+0100 [mongosMain] connection accepted from 172.28.0.163:57057 #3244 (198 connections now open) 2015-10-05T13:24:57.805+0100 [mongosMain] connection accepted from 172.28.0.163:57058 #3245 (199 connections now open) 2015-10-05T13:24:57.805+0100 [mongosMain] connection accepted from 172.28.0.163:57059 #3246 (200 connections now open) 2015-10-05T13:24:57.805+0100 [mongosMain] connection accepted from 172.28.0.163:57060 #3247 (201 connections now open) 2015-10-05T13:24:57.806+0100 [mongosMain] connection accepted from 172.28.0.163:57061 #3248 (202 connections now open) 2015-10-05T13:24:57.806+0100 [mongosMain] connection accepted from 172.28.0.163:57062 #3249 (203 connections now open) 2015-10-05T13:24:57.807+0100 [mongosMain] connection accepted from 172.28.0.163:57063 #3250 (204 connections now open) 2015-10-05T13:24:57.807+0100 [mongosMain] connection accepted from 172.28.0.163:57064 #3251 (205 connections now open) 2015-10-05T13:24:57.807+0100 [mongosMain] connection accepted from 172.28.0.163:57065 #3252 (206 connections now open) 2015-10-05T13:24:57.808+0100 [mongosMain] connection accepted from 172.28.0.163:57066 #3253 (207 connections now open) 2015-10-05T13:24:57.808+0100 [mongosMain] connection accepted from 172.28.0.163:57068 #3254 (208 connections now open) 2015-10-05T13:24:57.809+0100 [mongosMain] connection accepted from 172.28.0.163:57067 #3255 (209 connections now open) 2015-10-05T13:24:57.809+0100 [mongosMain] connection accepted from 172.28.0.163:57069 #3256 (210 connections now open) 2015-10-05T13:24:57.809+0100 [mongosMain] connection accepted from 172.28.0.163:57070 #3257 (211 connections now open) 2015-10-05T13:24:57.810+0100 [mongosMain] connection accepted from 172.28.0.163:57071 #3258 (212 connections now open) 2015-10-05T13:24:57.810+0100 [mongosMain] connection accepted from 172.28.0.163:57072 #3259 (213 connections now open) 2015-10-05T13:24:57.810+0100 [mongosMain] connection accepted from 172.28.0.163:57073 #3260 (214 connections now open) 2015-10-05T13:24:57.810+0100 [mongosMain] connection accepted from 172.28.0.163:57074 #3261 (215 connections now open) 2015-10-05T13:24:57.810+0100 [mongosMain] connection accepted from 172.28.0.163:57075 #3262 (216 connections now open) 2015-10-05T13:24:57.811+0100 [mongosMain] connection accepted from 172.28.0.163:57076 #3263 (217 connections now open) 2015-10-05T13:24:57.811+0100 [mongosMain] connection accepted from 172.28.0.163:57077 #3264 (218 connections now open) 2015-10-05T13:24:57.811+0100 [mongosMain] connection accepted from 172.28.0.163:57078 #3265 (219 connections now open) 2015-10-05T13:24:57.812+0100 [mongosMain] connection accepted from 172.28.0.163:57079 #3266 (220 connections now open) 2015-10-05T13:24:57.812+0100 [conn3238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.813+0100 [conn3244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.815+0100 [conn3234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.816+0100 [conn3252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.817+0100 [mongosMain] connection accepted from 172.28.0.163:57080 #3267 (221 connections now open) 2015-10-05T13:24:57.817+0100 [mongosMain] connection accepted from 172.28.0.163:57081 #3268 (222 connections now open) 2015-10-05T13:24:57.818+0100 [mongosMain] connection accepted from 172.28.0.163:57082 #3269 (223 connections now open) 2015-10-05T13:24:57.818+0100 [mongosMain] connection accepted from 172.28.0.163:57083 #3270 (224 connections now open) 2015-10-05T13:24:57.819+0100 [conn3258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.819+0100 [conn3268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.820+0100 [conn3264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.820+0100 [mongosMain] connection accepted from 172.28.0.163:57084 #3271 (225 connections now open) 2015-10-05T13:24:57.820+0100 [conn3270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.821+0100 [mongosMain] connection accepted from 172.28.0.163:57085 #3272 (226 connections now open) 2015-10-05T13:24:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:57086 #3273 (227 connections now open) 2015-10-05T13:24:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:57087 #3274 (228 connections now open) 2015-10-05T13:24:57.822+0100 [mongosMain] connection accepted from 172.28.0.163:57088 #3275 (229 connections now open) 2015-10-05T13:24:57.823+0100 [mongosMain] connection accepted from 172.28.0.163:57089 #3276 (230 connections now open) 2015-10-05T13:24:57.823+0100 [mongosMain] connection accepted from 172.28.0.163:57090 #3277 (231 connections now open) 2015-10-05T13:24:57.824+0100 [mongosMain] connection accepted from 172.28.0.163:57091 #3278 (232 connections now open) 2015-10-05T13:24:57.824+0100 [mongosMain] connection accepted from 172.28.0.163:57092 #3279 (233 connections now open) 2015-10-05T13:24:57.825+0100 [mongosMain] connection accepted from 172.28.0.163:57093 #3280 (234 connections now open) 2015-10-05T13:24:57.825+0100 [mongosMain] connection accepted from 172.28.0.163:57094 #3281 (235 connections now open) 2015-10-05T13:24:57.826+0100 [mongosMain] connection accepted from 172.28.0.163:57095 #3282 (236 connections now open) 2015-10-05T13:24:57.826+0100 [mongosMain] connection accepted from 172.28.0.163:57096 #3283 (237 connections now open) 2015-10-05T13:24:57.828+0100 [mongosMain] connection accepted from 172.28.0.163:57097 #3284 (238 connections now open) 2015-10-05T13:24:57.828+0100 [mongosMain] connection accepted from 172.28.0.163:57098 #3285 (239 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57099 #3286 (240 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57100 #3287 (241 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57101 #3288 (242 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57102 #3289 (243 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57103 #3290 (244 connections now open) 2015-10-05T13:24:57.829+0100 [mongosMain] connection accepted from 172.28.0.163:57104 #3291 (245 connections now open) 2015-10-05T13:24:57.830+0100 [mongosMain] connection accepted from 172.28.0.163:57105 #3292 (246 connections now open) 2015-10-05T13:24:57.830+0100 [mongosMain] connection accepted from 172.28.0.163:57106 #3293 (247 connections now open) 2015-10-05T13:24:57.830+0100 [mongosMain] connection accepted from 172.28.0.163:57107 #3294 (248 connections now open) 2015-10-05T13:24:57.830+0100 [mongosMain] connection accepted from 172.28.0.163:57108 #3295 (249 connections now open) 2015-10-05T13:24:57.831+0100 [mongosMain] connection accepted from 172.28.0.163:57109 #3296 (250 connections now open) 2015-10-05T13:24:57.833+0100 [mongosMain] connection accepted from 172.28.0.163:57110 #3297 (251 connections now open) 2015-10-05T13:24:57.834+0100 [conn3230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.834+0100 [conn3242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.834+0100 [conn3236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.835+0100 [mongosMain] connection accepted from 172.28.0.163:57111 #3298 (252 connections now open) 2015-10-05T13:24:57.835+0100 [mongosMain] connection accepted from 172.28.0.163:57112 #3299 (253 connections now open) 2015-10-05T13:24:57.835+0100 [conn3248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.835+0100 [mongosMain] connection accepted from 172.28.0.163:57113 #3300 (254 connections now open) 2015-10-05T13:24:57.836+0100 [conn3260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.836+0100 [mongosMain] connection accepted from 172.28.0.163:57115 #3301 (255 connections now open) 2015-10-05T13:24:57.836+0100 [conn3254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.836+0100 [mongosMain] connection accepted from 172.28.0.163:57117 #3302 (256 connections now open) 2015-10-05T13:24:57.836+0100 [mongosMain] connection accepted from 172.28.0.163:57118 #3303 (257 connections now open) 2015-10-05T13:24:57.836+0100 [mongosMain] connection accepted from 172.28.0.163:57114 #3304 (258 connections now open) 2015-10-05T13:24:57.836+0100 [mongosMain] connection accepted from 172.28.0.163:57116 #3305 (259 connections now open) 2015-10-05T13:24:57.837+0100 [mongosMain] connection accepted from 172.28.0.163:57119 #3306 (260 connections now open) 2015-10-05T13:24:57.837+0100 [conn3282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.837+0100 [mongosMain] connection accepted from 172.28.0.163:57120 #3307 (261 connections now open) 2015-10-05T13:24:57.837+0100 [mongosMain] connection accepted from 172.28.0.163:57122 #3308 (262 connections now open) 2015-10-05T13:24:57.837+0100 [mongosMain] connection accepted from 172.28.0.163:57121 #3309 (263 connections now open) 2015-10-05T13:24:57.837+0100 [conn3272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.837+0100 [mongosMain] connection accepted from 172.28.0.163:57123 #3310 (264 connections now open) 2015-10-05T13:24:57.838+0100 [mongosMain] connection accepted from 172.28.0.163:57124 #3311 (265 connections now open) 2015-10-05T13:24:57.838+0100 [mongosMain] connection accepted from 172.28.0.163:57125 #3312 (266 connections now open) 2015-10-05T13:24:57.838+0100 [mongosMain] connection accepted from 172.28.0.163:57126 #3313 (267 connections now open) 2015-10-05T13:24:57.838+0100 [mongosMain] connection accepted from 172.28.0.163:57127 #3314 (268 connections now open) 2015-10-05T13:24:57.838+0100 [mongosMain] connection accepted from 172.28.0.163:57128 #3315 (269 connections now open) 2015-10-05T13:24:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:57129 #3316 (270 connections now open) 2015-10-05T13:24:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:57130 #3317 (271 connections now open) 2015-10-05T13:24:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:57131 #3318 (272 connections now open) 2015-10-05T13:24:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:57132 #3319 (273 connections now open) 2015-10-05T13:24:57.839+0100 [mongosMain] connection accepted from 172.28.0.163:57133 #3320 (274 connections now open) 2015-10-05T13:24:57.840+0100 [mongosMain] connection accepted from 172.28.0.163:57134 #3321 (275 connections now open) 2015-10-05T13:24:57.840+0100 [mongosMain] connection accepted from 172.28.0.163:57135 #3322 (276 connections now open) 2015-10-05T13:24:57.840+0100 [mongosMain] connection accepted from 172.28.0.163:57136 #3323 (277 connections now open) 2015-10-05T13:24:57.840+0100 [mongosMain] connection accepted from 172.28.0.163:57137 #3324 (278 connections now open) 2015-10-05T13:24:57.840+0100 [mongosMain] connection accepted from 172.28.0.163:57138 #3325 (279 connections now open) 2015-10-05T13:24:57.841+0100 [mongosMain] connection accepted from 172.28.0.163:57139 #3326 (280 connections now open) 2015-10-05T13:24:57.841+0100 [mongosMain] connection accepted from 172.28.0.163:57140 #3327 (281 connections now open) 2015-10-05T13:24:57.841+0100 [mongosMain] connection accepted from 172.28.0.163:57141 #3328 (282 connections now open) 2015-10-05T13:24:57.841+0100 [mongosMain] connection accepted from 172.28.0.163:57142 #3329 (283 connections now open) 2015-10-05T13:24:57.841+0100 [mongosMain] connection accepted from 172.28.0.163:57143 #3330 (284 connections now open) 2015-10-05T13:24:57.842+0100 [mongosMain] connection accepted from 172.28.0.163:57144 #3331 (285 connections now open) 2015-10-05T13:24:57.842+0100 [mongosMain] connection accepted from 172.28.0.163:57145 #3332 (286 connections now open) 2015-10-05T13:24:57.842+0100 [mongosMain] connection accepted from 172.28.0.163:57146 #3333 (287 connections now open) 2015-10-05T13:24:57.842+0100 [conn3266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.842+0100 [mongosMain] connection accepted from 172.28.0.163:57147 #3334 (288 connections now open) 2015-10-05T13:24:57.842+0100 [mongosMain] connection accepted from 172.28.0.163:57148 #3335 (289 connections now open) 2015-10-05T13:24:57.843+0100 [mongosMain] connection accepted from 172.28.0.163:57149 #3336 (290 connections now open) 2015-10-05T13:24:57.843+0100 [mongosMain] connection accepted from 172.28.0.163:57151 #3337 (291 connections now open) 2015-10-05T13:24:57.843+0100 [mongosMain] connection accepted from 172.28.0.163:57150 #3338 (292 connections now open) 2015-10-05T13:24:57.844+0100 [mongosMain] connection accepted from 172.28.0.163:57152 #3339 (293 connections now open) 2015-10-05T13:24:57.844+0100 [mongosMain] connection accepted from 172.28.0.163:57153 #3340 (294 connections now open) 2015-10-05T13:24:57.844+0100 [mongosMain] connection accepted from 172.28.0.163:57154 #3341 (295 connections now open) 2015-10-05T13:24:57.844+0100 [mongosMain] connection accepted from 172.28.0.163:57155 #3342 (296 connections now open) 2015-10-05T13:24:57.845+0100 [mongosMain] connection accepted from 172.28.0.163:57156 #3343 (297 connections now open) 2015-10-05T13:24:57.845+0100 [mongosMain] connection accepted from 172.28.0.163:57157 #3344 (298 connections now open) 2015-10-05T13:24:57.845+0100 [conn3278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.846+0100 [mongosMain] connection accepted from 172.28.0.163:57158 #3345 (299 connections now open) 2015-10-05T13:24:57.846+0100 [mongosMain] connection accepted from 172.28.0.163:57159 #3346 (300 connections now open) 2015-10-05T13:24:57.846+0100 [mongosMain] connection accepted from 172.28.0.163:57160 #3347 (301 connections now open) 2015-10-05T13:24:57.847+0100 [mongosMain] connection accepted from 172.28.0.163:57161 #3348 (302 connections now open) 2015-10-05T13:24:57.847+0100 [mongosMain] connection accepted from 172.28.0.163:57162 #3349 (303 connections now open) 2015-10-05T13:24:57.847+0100 [mongosMain] connection accepted from 172.28.0.163:57163 #3350 (304 connections now open) 2015-10-05T13:24:57.847+0100 [mongosMain] connection accepted from 172.28.0.163:57164 #3351 (305 connections now open) 2015-10-05T13:24:57.847+0100 [mongosMain] connection accepted from 172.28.0.163:57165 #3352 (306 connections now open) 2015-10-05T13:24:57.848+0100 [mongosMain] connection accepted from 172.28.0.163:57166 #3353 (307 connections now open) 2015-10-05T13:24:57.848+0100 [mongosMain] connection accepted from 172.28.0.163:57167 #3354 (308 connections now open) 2015-10-05T13:24:57.849+0100 [mongosMain] connection accepted from 172.28.0.163:57170 #3355 (309 connections now open) 2015-10-05T13:24:57.849+0100 [mongosMain] connection accepted from 172.28.0.163:57169 #3356 (310 connections now open) 2015-10-05T13:24:57.849+0100 [mongosMain] connection accepted from 172.28.0.163:57168 #3357 (311 connections now open) 2015-10-05T13:24:57.849+0100 [mongosMain] connection accepted from 172.28.0.163:57171 #3358 (312 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57172 #3359 (313 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57173 #3360 (314 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57174 #3361 (315 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57175 #3362 (316 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57176 #3363 (317 connections now open) 2015-10-05T13:24:57.850+0100 [mongosMain] connection accepted from 172.28.0.163:57177 #3364 (318 connections now open) 2015-10-05T13:24:57.851+0100 [mongosMain] connection accepted from 172.28.0.163:57178 #3365 (319 connections now open) 2015-10-05T13:24:57.851+0100 [mongosMain] connection accepted from 172.28.0.163:57179 #3366 (320 connections now open) 2015-10-05T13:24:57.851+0100 [mongosMain] connection accepted from 172.28.0.163:57180 #3367 (321 connections now open) 2015-10-05T13:24:57.851+0100 [mongosMain] connection accepted from 172.28.0.163:57181 #3368 (322 connections now open) 2015-10-05T13:24:57.851+0100 [mongosMain] connection accepted from 172.28.0.163:57182 #3369 (323 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57183 #3370 (324 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57184 #3371 (325 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57185 #3372 (326 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57186 #3373 (327 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57187 #3374 (328 connections now open) 2015-10-05T13:24:57.852+0100 [mongosMain] connection accepted from 172.28.0.163:57188 #3375 (329 connections now open) 2015-10-05T13:24:57.853+0100 [mongosMain] connection accepted from 172.28.0.163:57189 #3376 (330 connections now open) 2015-10-05T13:24:57.853+0100 [mongosMain] connection accepted from 172.28.0.163:57190 #3377 (331 connections now open) 2015-10-05T13:24:57.853+0100 [mongosMain] connection accepted from 172.28.0.163:57191 #3378 (332 connections now open) 2015-10-05T13:24:57.853+0100 [conn3348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.854+0100 [mongosMain] connection accepted from 172.28.0.163:57192 #3379 (333 connections now open) 2015-10-05T13:24:57.854+0100 [conn3354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.854+0100 [mongosMain] connection accepted from 172.28.0.163:57193 #3380 (334 connections now open) 2015-10-05T13:24:57.854+0100 [conn3360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.854+0100 [conn3366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.854+0100 [mongosMain] connection accepted from 172.28.0.163:57194 #3381 (335 connections now open) 2015-10-05T13:24:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:57195 #3382 (336 connections now open) 2015-10-05T13:24:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:57196 #3383 (337 connections now open) 2015-10-05T13:24:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:57197 #3384 (338 connections now open) 2015-10-05T13:24:57.855+0100 [mongosMain] connection accepted from 172.28.0.163:57198 #3385 (339 connections now open) 2015-10-05T13:24:57.856+0100 [mongosMain] connection accepted from 172.28.0.163:57200 #3386 (340 connections now open) 2015-10-05T13:24:57.857+0100 [mongosMain] connection accepted from 172.28.0.163:57201 #3387 (341 connections now open) 2015-10-05T13:24:57.857+0100 [mongosMain] connection accepted from 172.28.0.163:57202 #3388 (342 connections now open) 2015-10-05T13:24:57.857+0100 [mongosMain] connection accepted from 172.28.0.163:57203 #3389 (343 connections now open) 2015-10-05T13:24:57.857+0100 [mongosMain] connection accepted from 172.28.0.163:57204 #3390 (344 connections now open) 2015-10-05T13:24:57.857+0100 [mongosMain] connection accepted from 172.28.0.163:57199 #3391 (345 connections now open) 2015-10-05T13:24:57.858+0100 [mongosMain] connection accepted from 172.28.0.163:57205 #3392 (346 connections now open) 2015-10-05T13:24:57.858+0100 [mongosMain] connection accepted from 172.28.0.163:57206 #3393 (347 connections now open) 2015-10-05T13:24:57.858+0100 [mongosMain] connection accepted from 172.28.0.163:57207 #3394 (348 connections now open) 2015-10-05T13:24:57.859+0100 [mongosMain] connection accepted from 172.28.0.163:57208 #3395 (349 connections now open) 2015-10-05T13:24:57.859+0100 [mongosMain] connection accepted from 172.28.0.163:57209 #3396 (350 connections now open) 2015-10-05T13:24:57.859+0100 [mongosMain] connection accepted from 172.28.0.163:57210 #3397 (351 connections now open) 2015-10-05T13:24:57.860+0100 [mongosMain] connection accepted from 172.28.0.163:57211 #3398 (352 connections now open) 2015-10-05T13:24:57.860+0100 [mongosMain] connection accepted from 172.28.0.163:57212 #3399 (353 connections now open) 2015-10-05T13:24:57.860+0100 [mongosMain] connection accepted from 172.28.0.163:57213 #3400 (354 connections now open) 2015-10-05T13:24:57.861+0100 [mongosMain] connection accepted from 172.28.0.163:57214 #3401 (355 connections now open) 2015-10-05T13:24:57.861+0100 [mongosMain] connection accepted from 172.28.0.163:57215 #3402 (356 connections now open) 2015-10-05T13:24:57.862+0100 [mongosMain] connection accepted from 172.28.0.163:57216 #3403 (357 connections now open) 2015-10-05T13:24:57.862+0100 [mongosMain] connection accepted from 172.28.0.163:57217 #3404 (358 connections now open) 2015-10-05T13:24:57.862+0100 [mongosMain] connection accepted from 172.28.0.163:57218 #3405 (359 connections now open) 2015-10-05T13:24:57.862+0100 [mongosMain] connection accepted from 172.28.0.163:57219 #3406 (360 connections now open) 2015-10-05T13:24:57.863+0100 [mongosMain] connection accepted from 172.28.0.163:57220 #3407 (361 connections now open) 2015-10-05T13:24:57.863+0100 [mongosMain] connection accepted from 172.28.0.163:57221 #3408 (362 connections now open) 2015-10-05T13:24:57.864+0100 [mongosMain] connection accepted from 172.28.0.163:57223 #3409 (363 connections now open) 2015-10-05T13:24:57.864+0100 [mongosMain] connection accepted from 172.28.0.163:57222 #3410 (364 connections now open) 2015-10-05T13:24:57.864+0100 [mongosMain] connection accepted from 172.28.0.163:57224 #3411 (365 connections now open) 2015-10-05T13:24:57.864+0100 [conn3372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.864+0100 [mongosMain] connection accepted from 172.28.0.163:57225 #3412 (366 connections now open) 2015-10-05T13:24:57.865+0100 [conn3378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.865+0100 [mongosMain] connection accepted from 172.28.0.163:57227 #3413 (367 connections now open) 2015-10-05T13:24:57.865+0100 [mongosMain] connection accepted from 172.28.0.163:57226 #3414 (368 connections now open) 2015-10-05T13:24:57.865+0100 [mongosMain] connection accepted from 172.28.0.163:57228 #3415 (369 connections now open) 2015-10-05T13:24:57.866+0100 [mongosMain] connection accepted from 172.28.0.163:57229 #3416 (370 connections now open) 2015-10-05T13:24:57.866+0100 [mongosMain] connection accepted from 172.28.0.163:57230 #3417 (371 connections now open) 2015-10-05T13:24:57.867+0100 [mongosMain] connection accepted from 172.28.0.163:57231 #3418 (372 connections now open) 2015-10-05T13:24:57.867+0100 [mongosMain] connection accepted from 172.28.0.163:57233 #3419 (373 connections now open) 2015-10-05T13:24:57.867+0100 [mongosMain] connection accepted from 172.28.0.163:57232 #3420 (374 connections now open) 2015-10-05T13:24:57.867+0100 [mongosMain] connection accepted from 172.28.0.163:57234 #3421 (375 connections now open) 2015-10-05T13:24:57.868+0100 [mongosMain] connection accepted from 172.28.0.163:57235 #3422 (376 connections now open) 2015-10-05T13:24:57.869+0100 [mongosMain] connection accepted from 172.28.0.163:57236 #3423 (377 connections now open) 2015-10-05T13:24:57.869+0100 [mongosMain] connection accepted from 172.28.0.163:57237 #3424 (378 connections now open) 2015-10-05T13:24:57.869+0100 [mongosMain] connection accepted from 172.28.0.163:57238 #3425 (379 connections now open) 2015-10-05T13:24:57.869+0100 [mongosMain] connection accepted from 172.28.0.163:57239 #3426 (380 connections now open) 2015-10-05T13:24:57.870+0100 [mongosMain] connection accepted from 172.28.0.163:57241 #3427 (381 connections now open) 2015-10-05T13:24:57.870+0100 [mongosMain] connection accepted from 172.28.0.163:57242 #3428 (382 connections now open) 2015-10-05T13:24:57.870+0100 [mongosMain] connection accepted from 172.28.0.163:57244 #3429 (383 connections now open) 2015-10-05T13:24:57.872+0100 [mongosMain] connection accepted from 172.28.0.163:57247 #3430 (384 connections now open) 2015-10-05T13:24:57.873+0100 [mongosMain] connection accepted from 172.28.0.163:57249 #3431 (385 connections now open) 2015-10-05T13:24:57.876+0100 [mongosMain] connection accepted from 172.28.0.163:57251 #3432 (386 connections now open) 2015-10-05T13:24:57.876+0100 [mongosMain] connection accepted from 172.28.0.163:57252 #3433 (387 connections now open) 2015-10-05T13:24:57.887+0100 [mongosMain] connection accepted from 172.28.0.163:57254 #3434 (388 connections now open) 2015-10-05T13:24:57.896+0100 [mongosMain] connection accepted from 172.28.0.163:57255 #3435 (389 connections now open) 2015-10-05T13:24:57.897+0100 [mongosMain] connection accepted from 172.28.0.163:57256 #3436 (390 connections now open) 2015-10-05T13:24:57.898+0100 [mongosMain] connection accepted from 172.28.0.163:57258 #3437 (391 connections now open) 2015-10-05T13:24:57.909+0100 [mongosMain] connection accepted from 172.28.0.163:57260 #3438 (392 connections now open) 2015-10-05T13:24:57.910+0100 [conn3207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.910+0100 [conn3213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.911+0100 [conn3255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.912+0100 [conn3261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.912+0100 [conn3279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.912+0100 [conn3267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.912+0100 [conn3285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.913+0100 [conn3273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.914+0100 [conn3239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.915+0100 [conn3209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.915+0100 [conn3245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.917+0100 [conn3390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.917+0100 [conn3402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.918+0100 [conn3251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.918+0100 [conn3396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.919+0100 [conn3408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.921+0100 [conn3350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.921+0100 [conn3362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.921+0100 [conn3380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.922+0100 [conn3398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.923+0100 [conn3392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.923+0100 [conn3356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.923+0100 [conn3368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.924+0100 [conn3420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.924+0100 [conn3344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.926+0100 [conn3257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.926+0100 [conn3269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.926+0100 [conn3293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.927+0100 [conn3371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.928+0100 [conn3401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.928+0100 [conn3389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.931+0100 [conn3352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.931+0100 [conn3364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.937+0100 [conn3400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.937+0100 [conn3383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.937+0100 [conn3382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.938+0100 [conn3388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.939+0100 [conn3370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.940+0100 [conn3413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.943+0100 [conn3432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.945+0100 [conn3353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.946+0100 [conn3430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.946+0100 [conn3431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.947+0100 [conn3418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.948+0100 [conn3359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.950+0100 [conn3299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.951+0100 [conn3306] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3310] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.952+0100 [conn3322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.953+0100 [conn3358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.954+0100 [conn3330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.960+0100 [conn3342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.963+0100 [conn3312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.963+0100 [conn3315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.963+0100 [conn3309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.963+0100 [conn3332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3314] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.964+0100 [conn3412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.965+0100 [conn3437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.982+0100 [conn3425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.983+0100 [conn3393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.984+0100 [conn3417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.984+0100 [conn3399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.984+0100 [conn3429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.984+0100 [conn3435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.984+0100 [conn3423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.986+0100 [conn3363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.991+0100 [conn3229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.991+0100 [conn3241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.995+0100 [conn3247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.995+0100 [conn3277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:57.997+0100 [conn3259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.003+0100 [mongosMain] connection accepted from 172.28.0.163:57263 #3439 (393 connections now open) 2015-10-05T13:24:58.004+0100 [mongosMain] connection accepted from 172.28.0.163:57264 #3440 (394 connections now open) 2015-10-05T13:24:58.005+0100 [mongosMain] connection accepted from 172.28.0.163:57265 #3441 (395 connections now open) 2015-10-05T13:24:58.011+0100 [mongosMain] connection accepted from 172.28.0.163:57269 #3442 (396 connections now open) 2015-10-05T13:24:58.013+0100 [mongosMain] connection accepted from 172.28.0.163:57270 #3443 (397 connections now open) 2015-10-05T13:24:58.013+0100 [mongosMain] connection accepted from 172.28.0.163:57272 #3444 (398 connections now open) 2015-10-05T13:24:58.015+0100 [mongosMain] connection accepted from 172.28.0.163:57274 #3445 (399 connections now open) 2015-10-05T13:24:58.015+0100 [mongosMain] connection accepted from 172.28.0.163:57273 #3446 (400 connections now open) 2015-10-05T13:24:58.015+0100 [mongosMain] connection accepted from 172.28.0.163:57275 #3447 (401 connections now open) 2015-10-05T13:24:58.016+0100 [mongosMain] connection accepted from 172.28.0.163:57278 #3448 (402 connections now open) 2015-10-05T13:24:58.017+0100 [mongosMain] connection accepted from 172.28.0.163:57279 #3449 (403 connections now open) 2015-10-05T13:24:58.020+0100 [mongosMain] connection accepted from 172.28.0.163:57281 #3450 (404 connections now open) 2015-10-05T13:24:58.023+0100 [mongosMain] connection accepted from 172.28.0.163:57282 #3451 (405 connections now open) 2015-10-05T13:24:58.023+0100 [mongosMain] connection accepted from 172.28.0.163:57284 #3452 (406 connections now open) 2015-10-05T13:24:58.024+0100 [mongosMain] connection accepted from 172.28.0.163:57285 #3453 (407 connections now open) 2015-10-05T13:24:58.024+0100 [mongosMain] connection accepted from 172.28.0.163:57286 #3454 (408 connections now open) 2015-10-05T13:24:58.026+0100 [mongosMain] connection accepted from 172.28.0.163:57287 #3455 (409 connections now open) 2015-10-05T13:24:58.029+0100 [conn3319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.030+0100 [conn3253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.031+0100 [conn3283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.031+0100 [conn3337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.031+0100 [conn3367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.031+0100 [conn3349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.032+0100 [conn3373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.032+0100 [conn3361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.033+0100 [conn3385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.034+0100 [conn3343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.034+0100 [conn3391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.041+0100 [conn3379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.042+0100 [conn3355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.068+0100 [conn3449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.069+0100 [conn3307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.072+0100 [mongosMain] connection accepted from 172.28.0.163:57291 #3456 (410 connections now open) 2015-10-05T13:24:58.073+0100 [mongosMain] connection accepted from 172.28.0.163:57292 #3457 (411 connections now open) 2015-10-05T13:24:58.076+0100 [mongosMain] connection accepted from 172.28.0.163:57293 #3458 (412 connections now open) 2015-10-05T13:24:58.076+0100 [mongosMain] connection accepted from 172.28.0.163:57294 #3459 (413 connections now open) 2015-10-05T13:24:58.079+0100 [mongosMain] connection accepted from 172.28.0.163:57297 #3460 (414 connections now open) 2015-10-05T13:24:58.081+0100 [mongosMain] connection accepted from 172.28.0.163:57299 #3461 (415 connections now open) 2015-10-05T13:24:58.084+0100 [conn3440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.085+0100 [conn3448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.085+0100 [conn3439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.085+0100 [conn3447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.085+0100 [conn3446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.085+0100 [conn3421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.086+0100 [conn3445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.097+0100 [mongosMain] connection accepted from 172.28.0.163:57300 #3462 (416 connections now open) 2015-10-05T13:24:58.103+0100 [mongosMain] connection accepted from 172.28.0.163:57305 #3463 (417 connections now open) 2015-10-05T13:24:58.104+0100 [mongosMain] connection accepted from 172.28.0.163:57309 #3464 (418 connections now open) 2015-10-05T13:24:58.105+0100 [mongosMain] connection accepted from 172.28.0.163:57312 #3465 (419 connections now open) 2015-10-05T13:24:58.105+0100 [mongosMain] connection accepted from 172.28.0.163:57306 #3466 (420 connections now open) 2015-10-05T13:24:58.106+0100 [mongosMain] connection accepted from 172.28.0.163:57315 #3467 (421 connections now open) 2015-10-05T13:24:58.118+0100 [mongosMain] connection accepted from 172.28.0.163:57319 #3468 (422 connections now open) 2015-10-05T13:24:58.118+0100 [mongosMain] connection accepted from 172.28.0.163:57320 #3469 (423 connections now open) 2015-10-05T13:24:58.119+0100 [mongosMain] connection accepted from 172.28.0.163:57322 #3470 (424 connections now open) 2015-10-05T13:24:58.119+0100 [mongosMain] connection accepted from 172.28.0.163:57323 #3471 (425 connections now open) 2015-10-05T13:24:58.126+0100 [mongosMain] connection accepted from 172.28.0.163:57326 #3472 (426 connections now open) 2015-10-05T13:24:58.126+0100 [mongosMain] connection accepted from 172.28.0.163:57327 #3473 (427 connections now open) 2015-10-05T13:24:58.135+0100 [mongosMain] connection accepted from 172.28.0.163:57329 #3474 (428 connections now open) 2015-10-05T13:24:58.136+0100 [mongosMain] connection accepted from 172.28.0.163:57331 #3475 (429 connections now open) 2015-10-05T13:24:58.141+0100 [mongosMain] connection accepted from 172.28.0.163:57332 #3476 (430 connections now open) 2015-10-05T13:24:58.142+0100 [mongosMain] connection accepted from 172.28.0.163:57334 #3477 (431 connections now open) 2015-10-05T13:24:58.150+0100 [conn3271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.152+0100 [mongosMain] connection accepted from 172.28.0.163:57338 #3478 (432 connections now open) 2015-10-05T13:24:58.159+0100 [conn3313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.167+0100 [conn3442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.172+0100 [conn3451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.172+0100 [conn3453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.172+0100 [conn3441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.172+0100 [conn3427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.173+0100 [conn3443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.174+0100 [conn3454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.186+0100 [conn3452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.189+0100 [conn3455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.207+0100 [conn3444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.213+0100 [conn3450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.238+0100 [mongosMain] connection accepted from 172.28.0.163:57346 #3479 (433 connections now open) 2015-10-05T13:24:58.240+0100 [mongosMain] connection accepted from 172.28.0.163:57348 #3480 (434 connections now open) 2015-10-05T13:24:58.240+0100 [mongosMain] connection accepted from 172.28.0.163:57349 #3481 (435 connections now open) 2015-10-05T13:24:58.242+0100 [mongosMain] connection accepted from 172.28.0.163:57353 #3482 (436 connections now open) 2015-10-05T13:24:58.242+0100 [mongosMain] connection accepted from 172.28.0.163:57351 #3483 (437 connections now open) 2015-10-05T13:24:58.243+0100 [mongosMain] connection accepted from 172.28.0.163:57355 #3484 (438 connections now open) 2015-10-05T13:24:58.243+0100 [mongosMain] connection accepted from 172.28.0.163:57359 #3485 (439 connections now open) 2015-10-05T13:24:58.244+0100 [mongosMain] connection accepted from 172.28.0.163:57362 #3486 (440 connections now open) 2015-10-05T13:24:58.254+0100 [conn3460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.254+0100 [conn3458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.255+0100 [conn3468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.256+0100 [conn3477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.257+0100 [conn3476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.257+0100 [conn3471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.259+0100 [conn3478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.260+0100 [conn3475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.262+0100 [conn3457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.301+0100 [conn3459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.307+0100 [conn3479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.308+0100 [conn3480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.308+0100 [conn3484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.308+0100 [conn3481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.309+0100 [conn3483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.309+0100 [conn3485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.315+0100 [mongosMain] connection accepted from 172.28.0.163:57366 #3487 (441 connections now open) 2015-10-05T13:24:58.315+0100 [mongosMain] connection accepted from 172.28.0.163:57365 #3488 (442 connections now open) 2015-10-05T13:24:58.315+0100 [mongosMain] connection accepted from 172.28.0.163:57369 #3489 (443 connections now open) 2015-10-05T13:24:58.316+0100 [mongosMain] connection accepted from 172.28.0.163:57368 #3490 (444 connections now open) 2015-10-05T13:24:58.316+0100 [mongosMain] connection accepted from 172.28.0.163:57370 #3491 (445 connections now open) 2015-10-05T13:24:58.316+0100 [conn3482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.317+0100 [mongosMain] connection accepted from 172.28.0.163:57371 #3492 (446 connections now open) 2015-10-05T13:24:58.335+0100 [mongosMain] connection accepted from 172.28.0.163:57378 #3493 (447 connections now open) 2015-10-05T13:24:58.337+0100 [mongosMain] connection accepted from 172.28.0.163:57379 #3494 (448 connections now open) 2015-10-05T13:24:58.339+0100 [mongosMain] connection accepted from 172.28.0.163:57380 #3495 (449 connections now open) 2015-10-05T13:24:58.342+0100 [mongosMain] connection accepted from 172.28.0.163:57382 #3496 (450 connections now open) 2015-10-05T13:24:58.344+0100 [mongosMain] connection accepted from 172.28.0.163:57384 #3497 (451 connections now open) 2015-10-05T13:24:58.344+0100 [mongosMain] connection accepted from 172.28.0.163:57387 #3498 (452 connections now open) 2015-10-05T13:24:58.345+0100 [mongosMain] connection accepted from 172.28.0.163:57391 #3499 (453 connections now open) 2015-10-05T13:24:58.345+0100 [mongosMain] connection accepted from 172.28.0.163:57392 #3500 (454 connections now open) 2015-10-05T13:24:58.362+0100 [mongosMain] connection accepted from 172.28.0.163:57408 #3501 (455 connections now open) 2015-10-05T13:24:58.405+0100 [conn3488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.405+0100 [conn3200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.405+0100 [conn3491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.405+0100 [conn3490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.406+0100 [conn3276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.408+0100 [conn3176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.413+0100 [conn3492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.416+0100 [conn3165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.430+0100 [conn3179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.430+0100 [conn3486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.430+0100 [conn3489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.431+0100 [conn3497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.439+0100 [conn3498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.439+0100 [conn3495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.461+0100 [conn3297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.494+0100 [conn3494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.504+0100 [conn3496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.505+0100 [conn3175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.505+0100 [conn3487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.505+0100 [conn3500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.505+0100 [conn3499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.544+0100 [conn3501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:58.603+0100 [conn3493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:24:59.162+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:24:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:25:06.754+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c2212deab02e2998419 2015-10-05T13:25:06.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:25:13.859+0100 [conn2713] end connection 172.28.0.163:55956 (454 connections now open) 2015-10-05T13:25:13.860+0100 [mongosMain] connection accepted from 172.28.0.163:57618 #3502 (455 connections now open) 2015-10-05T13:25:13.862+0100 [conn3502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:25:25.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c3412deab02e2998512 2015-10-05T13:25:25.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:25:28.454+0100 [mongosMain] connection accepted from 127.0.0.1:57624 #3503 (456 connections now open) 2015-10-05T13:25:28.457+0100 [conn3503] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:25:28.458+0100 [conn3503] end connection 127.0.0.1:57624 (455 connections now open) 2015-10-05T13:25:29.424+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:25:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:25:39.551+0100 [mongosMain] connection accepted from 127.0.0.1:57627 #3504 (456 connections now open) 2015-10-05T13:25:39.554+0100 [conn3504] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:25:39.555+0100 [conn3504] end connection 127.0.0.1:57627 (455 connections now open) 2015-10-05T13:25:43.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c4712deab02e2998594 2015-10-05T13:25:43.741+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:25:55.293+0100 [conn2406] end connection 172.28.0.164:57183 (454 connections now open) 2015-10-05T13:25:55.295+0100 [mongosMain] connection accepted from 172.28.0.164:59935 #3505 (455 connections now open) 2015-10-05T13:25:55.297+0100 [conn3505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:25:55.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c5312deab02e2998652 2015-10-05T13:25:55.963+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:25:59.584+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:25:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:26:02.111+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:26:02.111+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:26:08.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c6012deab02e29986d4 2015-10-05T13:26:08.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:13.875+0100 [conn2714] end connection 172.28.0.163:55962 (454 connections now open) 2015-10-05T13:26:13.876+0100 [mongosMain] connection accepted from 172.28.0.163:57660 #3506 (455 connections now open) 2015-10-05T13:26:13.878+0100 [conn3506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:20.689+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c6c12deab02e299870f 2015-10-05T13:26:20.757+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:26.908+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c7212deab02e2998711 2015-10-05T13:26:26.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:28.515+0100 [mongosMain] connection accepted from 127.0.0.1:57668 #3507 (456 connections now open) 2015-10-05T13:26:28.517+0100 [conn3507] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:28.518+0100 [conn3507] end connection 127.0.0.1:57668 (455 connections now open) 2015-10-05T13:26:29.723+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:26:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:26:33.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c7812deab02e2998713 2015-10-05T13:26:33.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:39.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c7f12deab02e2998716 2015-10-05T13:26:39.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:40.158+0100 [mongosMain] connection accepted from 127.0.0.1:57669 #3508 (456 connections now open) 2015-10-05T13:26:40.161+0100 [conn3508] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:40.161+0100 [conn3508] end connection 127.0.0.1:57669 (455 connections now open) 2015-10-05T13:26:48.510+0100 [conn3151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:50.505+0100 [conn3150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:51.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c8b12deab02e2998734 2015-10-05T13:26:52.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:26:55.309+0100 [conn2407] end connection 172.28.0.164:57184 (454 connections now open) 2015-10-05T13:26:55.310+0100 [mongosMain] connection accepted from 172.28.0.164:59989 #3509 (455 connections now open) 2015-10-05T13:26:55.313+0100 [conn3509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:26:59.885+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:26:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:27:04.226+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126c9812deab02e299873a 2015-10-05T13:27:04.362+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:27:13.890+0100 [conn2715] end connection 172.28.0.163:55963 (454 connections now open) 2015-10-05T13:27:13.891+0100 [mongosMain] connection accepted from 172.28.0.163:57704 #3510 (455 connections now open) 2015-10-05T13:27:13.893+0100 [conn3510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:27:22.649+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126caa12deab02e2998742 2015-10-05T13:27:22.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:27:28.191+0100 [mongosMain] connection accepted from 127.0.0.1:57710 #3511 (456 connections now open) 2015-10-05T13:27:28.194+0100 [conn3511] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:27:28.195+0100 [conn3511] end connection 127.0.0.1:57710 (455 connections now open) 2015-10-05T13:27:30.026+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:27:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:27:34.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126cb612deab02e2998744 2015-10-05T13:27:35.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:27:39.537+0100 [mongosMain] connection accepted from 127.0.0.1:57712 #3512 (456 connections now open) 2015-10-05T13:27:39.539+0100 [conn3512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:27:39.540+0100 [conn3512] end connection 127.0.0.1:57712 (455 connections now open) 2015-10-05T13:27:53.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126cc912deab02e2998745 2015-10-05T13:27:53.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:27:55.325+0100 [conn2408] end connection 172.28.0.164:57185 (454 connections now open) 2015-10-05T13:27:55.326+0100 [mongosMain] connection accepted from 172.28.0.164:60042 #3513 (455 connections now open) 2015-10-05T13:27:55.329+0100 [conn3513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:28:00.184+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:28:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:28:05.513+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126cd512deab02e299874a 2015-10-05T13:28:05.581+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:28:11.696+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:28:11.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:28:13.908+0100 [conn2716] end connection 172.28.0.163:55965 (454 connections now open) 2015-10-05T13:28:13.909+0100 [mongosMain] connection accepted from 172.28.0.163:57746 #3514 (455 connections now open) 2015-10-05T13:28:13.911+0100 [conn3514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:28:23.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ce712deab02e2998751 2015-10-05T13:28:24.125+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:28:28.336+0100 [mongosMain] connection accepted from 127.0.0.1:57753 #3515 (456 connections now open) 2015-10-05T13:28:28.339+0100 [conn3515] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:28:28.340+0100 [conn3515] end connection 127.0.0.1:57753 (455 connections now open) 2015-10-05T13:28:30.275+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126cee12deab02e2998756 2015-10-05T13:28:30.343+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:28:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:28:30.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:28:39.902+0100 [mongosMain] connection accepted from 127.0.0.1:57754 #3516 (456 connections now open) 2015-10-05T13:28:39.905+0100 [conn3516] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:28:39.905+0100 [conn3516] end connection 127.0.0.1:57754 (455 connections now open) 2015-10-05T13:28:48.627+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d0012deab02e299875b 2015-10-05T13:28:48.763+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:28:55.341+0100 [conn2409] end connection 172.28.0.164:57186 (454 connections now open) 2015-10-05T13:28:55.342+0100 [mongosMain] connection accepted from 172.28.0.164:60091 #3517 (455 connections now open) 2015-10-05T13:28:55.345+0100 [conn3517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:00.622+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:29:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:29:01.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d0c12deab02e299875f 2015-10-05T13:29:01.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:13.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d1912deab02e2998764 2015-10-05T13:29:13.640+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:13.923+0100 [conn2717] end connection 172.28.0.163:55967 (454 connections now open) 2015-10-05T13:29:13.925+0100 [mongosMain] connection accepted from 172.28.0.163:57789 #3518 (455 connections now open) 2015-10-05T13:29:13.926+0100 [conn3518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:19.788+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d1f12deab02e29987b5 2015-10-05T13:29:19.856+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:26.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d2512deab02e29987b6 2015-10-05T13:29:26.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:28.349+0100 [mongosMain] connection accepted from 127.0.0.1:57795 #3519 (456 connections now open) 2015-10-05T13:29:28.352+0100 [conn3519] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:28.353+0100 [conn3519] end connection 127.0.0.1:57795 (455 connections now open) 2015-10-05T13:29:30.888+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:29:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:29:32.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d2c12deab02e29987b8 2015-10-05T13:29:32.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:38.830+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d3212deab02e29987bb 2015-10-05T13:29:38.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:39.375+0100 [mongosMain] connection accepted from 127.0.0.1:57796 #3520 (456 connections now open) 2015-10-05T13:29:39.378+0100 [conn3520] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:39.378+0100 [conn3520] end connection 127.0.0.1:57796 (455 connections now open) 2015-10-05T13:29:45.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d3812deab02e29987bd 2015-10-05T13:29:45.183+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:51.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d3f12deab02e29987be 2015-10-05T13:29:51.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:29:55.016+0100 [mongosMain] connection accepted from 172.28.0.164:60138 #3521 (456 connections now open) 2015-10-05T13:29:55.020+0100 [conn3521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:55.360+0100 [conn2412] end connection 172.28.0.164:57189 (455 connections now open) 2015-10-05T13:29:55.553+0100 [mongosMain] connection accepted from 172.28.0.164:60353 #3522 (456 connections now open) 2015-10-05T13:29:55.555+0100 [conn3522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:56.122+0100 [mongosMain] connection accepted from 172.28.0.164:60532 #3523 (457 connections now open) 2015-10-05T13:29:56.433+0100 [conn3523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:29:59.049+0100 [mongosMain] connection accepted from 172.28.0.164:60554 #3524 (458 connections now open) 2015-10-05T13:29:59.052+0100 [conn3524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:30:01.137+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:30:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:30:03.943+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:30:03.943+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:30:10.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d5112deab02e29987cb 2015-10-05T13:30:10.219+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:30:13.940+0100 [conn2718] end connection 172.28.0.163:55968 (457 connections now open) 2015-10-05T13:30:13.941+0100 [mongosMain] connection accepted from 172.28.0.163:57834 #3525 (458 connections now open) 2015-10-05T13:30:13.943+0100 [conn3525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:30:22.344+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:30:22.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:30:28.412+0100 [mongosMain] connection accepted from 127.0.0.1:57840 #3526 (459 connections now open) 2015-10-05T13:30:28.415+0100 [conn3526] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:30:28.416+0100 [conn3526] end connection 127.0.0.1:57840 (458 connections now open) 2015-10-05T13:30:31.282+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:30:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:30:34.455+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:30:34.455+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:30:39.756+0100 [mongosMain] connection accepted from 127.0.0.1:57842 #3527 (459 connections now open) 2015-10-05T13:30:39.759+0100 [conn3527] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:30:39.759+0100 [conn3527] end connection 127.0.0.1:57842 (458 connections now open) 2015-10-05T13:30:40.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d7012deab02e29987da 2015-10-05T13:30:40.670+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:30:52.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d7c12deab02e29987df 2015-10-05T13:30:53.081+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:30:55.561+0100 [conn2424] end connection 172.28.0.164:57201 (457 connections now open) 2015-10-05T13:30:55.562+0100 [mongosMain] connection accepted from 172.28.0.164:60599 #3528 (458 connections now open) 2015-10-05T13:30:55.565+0100 [conn3528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:31:01.553+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:31:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:31:11.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d8f12deab02e29987e1 2015-10-05T13:31:11.558+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:31:13.956+0100 [conn2719] end connection 172.28.0.163:55971 (457 connections now open) 2015-10-05T13:31:13.957+0100 [mongosMain] connection accepted from 172.28.0.163:57876 #3529 (458 connections now open) 2015-10-05T13:31:13.959+0100 [conn3529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:31:23.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126d9b12deab02e29987e5 2015-10-05T13:31:23.989+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:31:29.104+0100 [mongosMain] connection accepted from 127.0.0.1:57884 #3530 (459 connections now open) 2015-10-05T13:31:29.106+0100 [conn3530] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:31:29.107+0100 [conn3530] end connection 127.0.0.1:57884 (458 connections now open) 2015-10-05T13:31:31.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:31:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:31:36.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126da812deab02e29987e6 2015-10-05T13:31:36.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:31:39.518+0100 [mongosMain] connection accepted from 127.0.0.1:57885 #3531 (459 connections now open) 2015-10-05T13:31:39.521+0100 [conn3531] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:31:39.521+0100 [conn3531] end connection 127.0.0.1:57885 (458 connections now open) 2015-10-05T13:31:48.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126db412deab02e2998838 2015-10-05T13:31:48.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:31:54.604+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:31:54.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:31:55.577+0100 [conn2413] end connection 172.28.0.164:57190 (457 connections now open) 2015-10-05T13:31:55.578+0100 [mongosMain] connection accepted from 172.28.0.164:60642 #3532 (458 connections now open) 2015-10-05T13:31:55.581+0100 [conn3532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:02.158+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:32:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:32:06.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126dc612deab02e299883f 2015-10-05T13:32:06.836+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:32:13.972+0100 [conn2720] end connection 172.28.0.163:55972 (457 connections now open) 2015-10-05T13:32:13.973+0100 [mongosMain] connection accepted from 172.28.0.163:57952 #3533 (458 connections now open) 2015-10-05T13:32:13.975+0100 [conn3533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:15.532+0100 [mongosMain] connection accepted from 172.28.0.164:60669 #3534 (459 connections now open) 2015-10-05T13:32:15.532+0100 [mongosMain] connection accepted from 172.28.0.164:60670 #3535 (460 connections now open) 2015-10-05T13:32:20.529+0100 [mongosMain] connection accepted from 172.28.0.164:60675 #3536 (461 connections now open) 2015-10-05T13:32:20.529+0100 [mongosMain] connection accepted from 172.28.0.164:60676 #3537 (462 connections now open) 2015-10-05T13:32:25.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126dd812deab02e2998844 2015-10-05T13:32:25.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:32:28.815+0100 [mongosMain] connection accepted from 127.0.0.1:57959 #3538 (463 connections now open) 2015-10-05T13:32:28.817+0100 [conn3538] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:28.818+0100 [conn3538] end connection 127.0.0.1:57959 (462 connections now open) 2015-10-05T13:32:32.413+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:32:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:32:35.587+0100 [mongosMain] connection accepted from 172.28.0.163:57961 #3539 (463 connections now open) 2015-10-05T13:32:35.588+0100 [mongosMain] connection accepted from 172.28.0.163:57962 #3540 (464 connections now open) 2015-10-05T13:32:39.646+0100 [mongosMain] connection accepted from 127.0.0.1:57965 #3541 (465 connections now open) 2015-10-05T13:32:39.649+0100 [conn3541] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:39.649+0100 [conn3541] end connection 127.0.0.1:57965 (464 connections now open) 2015-10-05T13:32:43.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126deb12deab02e299884a 2015-10-05T13:32:43.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:32:45.635+0100 [mongosMain] connection accepted from 172.28.0.163:57972 #3542 (465 connections now open) 2015-10-05T13:32:45.636+0100 [mongosMain] connection accepted from 172.28.0.163:57973 #3543 (466 connections now open) 2015-10-05T13:32:48.043+0100 [conn3537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:48.048+0100 [conn3536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:54.611+0100 [conn3539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:54.611+0100 [conn3540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:55.593+0100 [conn2420] end connection 172.28.0.164:57197 (465 connections now open) 2015-10-05T13:32:55.594+0100 [mongosMain] connection accepted from 172.28.0.164:60730 #3544 (466 connections now open) 2015-10-05T13:32:55.598+0100 [conn3544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:55.780+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:32:55.780+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:32:56.532+0100 [mongosMain] connection accepted from 172.28.0.164:60731 #3545 (467 connections now open) 2015-10-05T13:32:56.538+0100 [conn3545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.542+0100 [mongosMain] connection accepted from 172.28.0.164:60734 #3546 (468 connections now open) 2015-10-05T13:32:56.546+0100 [conn3546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.548+0100 [mongosMain] connection accepted from 172.28.0.164:60736 #3547 (469 connections now open) 2015-10-05T13:32:56.550+0100 [conn3547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.552+0100 [mongosMain] connection accepted from 172.28.0.164:60739 #3548 (470 connections now open) 2015-10-05T13:32:56.553+0100 [conn3548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.555+0100 [mongosMain] connection accepted from 172.28.0.164:60742 #3549 (471 connections now open) 2015-10-05T13:32:56.557+0100 [conn3549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.558+0100 [mongosMain] connection accepted from 172.28.0.164:60744 #3550 (472 connections now open) 2015-10-05T13:32:56.561+0100 [conn3550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.563+0100 [mongosMain] connection accepted from 172.28.0.164:60748 #3551 (473 connections now open) 2015-10-05T13:32:56.565+0100 [conn3551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.566+0100 [mongosMain] connection accepted from 172.28.0.164:60751 #3552 (474 connections now open) 2015-10-05T13:32:56.568+0100 [conn3552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.570+0100 [mongosMain] connection accepted from 172.28.0.164:60753 #3553 (475 connections now open) 2015-10-05T13:32:56.572+0100 [conn3553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.574+0100 [mongosMain] connection accepted from 172.28.0.164:60756 #3554 (476 connections now open) 2015-10-05T13:32:56.576+0100 [conn3554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.577+0100 [mongosMain] connection accepted from 172.28.0.164:60759 #3555 (477 connections now open) 2015-10-05T13:32:56.579+0100 [conn3555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.580+0100 [mongosMain] connection accepted from 172.28.0.164:60762 #3556 (478 connections now open) 2015-10-05T13:32:56.582+0100 [conn3556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.583+0100 [mongosMain] connection accepted from 172.28.0.164:60764 #3557 (479 connections now open) 2015-10-05T13:32:56.585+0100 [conn3557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.586+0100 [mongosMain] connection accepted from 172.28.0.164:60767 #3558 (480 connections now open) 2015-10-05T13:32:56.588+0100 [conn3558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.590+0100 [mongosMain] connection accepted from 172.28.0.164:60770 #3559 (481 connections now open) 2015-10-05T13:32:56.592+0100 [conn3559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.593+0100 [mongosMain] connection accepted from 172.28.0.164:60772 #3560 (482 connections now open) 2015-10-05T13:32:56.595+0100 [conn3560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.597+0100 [mongosMain] connection accepted from 172.28.0.164:60775 #3561 (483 connections now open) 2015-10-05T13:32:56.599+0100 [conn3561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.600+0100 [mongosMain] connection accepted from 172.28.0.164:60778 #3562 (484 connections now open) 2015-10-05T13:32:56.602+0100 [conn3562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.603+0100 [mongosMain] connection accepted from 172.28.0.164:60780 #3563 (485 connections now open) 2015-10-05T13:32:56.605+0100 [conn3563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.606+0100 [mongosMain] connection accepted from 172.28.0.164:60783 #3564 (486 connections now open) 2015-10-05T13:32:56.608+0100 [conn3564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.609+0100 [mongosMain] connection accepted from 172.28.0.164:60785 #3565 (487 connections now open) 2015-10-05T13:32:56.611+0100 [conn3565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.613+0100 [mongosMain] connection accepted from 172.28.0.164:60788 #3566 (488 connections now open) 2015-10-05T13:32:56.615+0100 [conn3566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.616+0100 [mongosMain] connection accepted from 172.28.0.164:60790 #3567 (489 connections now open) 2015-10-05T13:32:56.618+0100 [conn3567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.620+0100 [mongosMain] connection accepted from 172.28.0.164:60793 #3568 (490 connections now open) 2015-10-05T13:32:56.621+0100 [conn3568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.623+0100 [mongosMain] connection accepted from 172.28.0.164:60795 #3569 (491 connections now open) 2015-10-05T13:32:56.625+0100 [conn3569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.626+0100 [mongosMain] connection accepted from 172.28.0.164:60798 #3570 (492 connections now open) 2015-10-05T13:32:56.628+0100 [conn3570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.629+0100 [mongosMain] connection accepted from 172.28.0.164:60800 #3571 (493 connections now open) 2015-10-05T13:32:56.631+0100 [conn3571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.632+0100 [mongosMain] connection accepted from 172.28.0.164:60803 #3572 (494 connections now open) 2015-10-05T13:32:56.634+0100 [conn3572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.636+0100 [mongosMain] connection accepted from 172.28.0.164:60806 #3573 (495 connections now open) 2015-10-05T13:32:56.637+0100 [conn3573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.639+0100 [mongosMain] connection accepted from 172.28.0.164:60808 #3574 (496 connections now open) 2015-10-05T13:32:56.641+0100 [conn3574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.643+0100 [mongosMain] connection accepted from 172.28.0.164:60811 #3575 (497 connections now open) 2015-10-05T13:32:56.644+0100 [conn3575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.646+0100 [mongosMain] connection accepted from 172.28.0.164:60812 #3576 (498 connections now open) 2015-10-05T13:32:56.648+0100 [conn3576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.649+0100 [mongosMain] connection accepted from 172.28.0.164:60813 #3577 (499 connections now open) 2015-10-05T13:32:56.651+0100 [conn3577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.653+0100 [mongosMain] connection accepted from 172.28.0.164:60814 #3578 (500 connections now open) 2015-10-05T13:32:56.655+0100 [conn3578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.657+0100 [mongosMain] connection accepted from 172.28.0.164:60815 #3579 (501 connections now open) 2015-10-05T13:32:56.659+0100 [conn3579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.661+0100 [mongosMain] connection accepted from 172.28.0.164:60816 #3580 (502 connections now open) 2015-10-05T13:32:56.662+0100 [conn3580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.664+0100 [mongosMain] connection accepted from 172.28.0.164:60817 #3581 (503 connections now open) 2015-10-05T13:32:56.666+0100 [conn3581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.668+0100 [mongosMain] connection accepted from 172.28.0.164:60818 #3582 (504 connections now open) 2015-10-05T13:32:56.670+0100 [conn3582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.672+0100 [mongosMain] connection accepted from 172.28.0.164:60819 #3583 (505 connections now open) 2015-10-05T13:32:56.674+0100 [conn3583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.676+0100 [mongosMain] connection accepted from 172.28.0.164:60820 #3584 (506 connections now open) 2015-10-05T13:32:56.678+0100 [conn3584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.680+0100 [mongosMain] connection accepted from 172.28.0.164:60821 #3585 (507 connections now open) 2015-10-05T13:32:56.682+0100 [conn3585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.684+0100 [mongosMain] connection accepted from 172.28.0.164:60822 #3586 (508 connections now open) 2015-10-05T13:32:56.686+0100 [conn3586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.689+0100 [mongosMain] connection accepted from 172.28.0.164:60823 #3587 (509 connections now open) 2015-10-05T13:32:56.691+0100 [conn3587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.693+0100 [mongosMain] connection accepted from 172.28.0.164:60824 #3588 (510 connections now open) 2015-10-05T13:32:56.695+0100 [conn3588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.697+0100 [mongosMain] connection accepted from 172.28.0.164:60825 #3589 (511 connections now open) 2015-10-05T13:32:56.699+0100 [conn3589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.701+0100 [mongosMain] connection accepted from 172.28.0.164:60826 #3590 (512 connections now open) 2015-10-05T13:32:56.703+0100 [conn3590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.705+0100 [mongosMain] connection accepted from 172.28.0.164:60827 #3591 (513 connections now open) 2015-10-05T13:32:56.708+0100 [conn3591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.710+0100 [mongosMain] connection accepted from 172.28.0.164:60828 #3592 (514 connections now open) 2015-10-05T13:32:56.712+0100 [conn3592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:56.714+0100 [mongosMain] connection accepted from 172.28.0.164:60829 #3593 (515 connections now open) 2015-10-05T13:32:56.716+0100 [conn3593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:32:58.518+0100 [conn3536] end connection 172.28.0.164:60675 (514 connections now open) 2015-10-05T13:33:00.149+0100 [conn3549] end connection 172.28.0.164:60742 (513 connections now open) 2015-10-05T13:33:00.149+0100 [conn3537] end connection 172.28.0.164:60676 (512 connections now open) 2015-10-05T13:33:00.150+0100 [conn3573] end connection 172.28.0.164:60806 (511 connections now open) 2015-10-05T13:33:00.150+0100 [conn3580] end connection 172.28.0.164:60816 (510 connections now open) 2015-10-05T13:33:00.150+0100 [conn3577] end connection 172.28.0.164:60813 (510 connections now open) 2015-10-05T13:33:00.150+0100 [conn3552] end connection 172.28.0.164:60751 (509 connections now open) 2015-10-05T13:33:00.151+0100 [conn3550] end connection 172.28.0.164:60744 (507 connections now open) 2015-10-05T13:33:00.151+0100 [conn3570] end connection 172.28.0.164:60798 (507 connections now open) 2015-10-05T13:33:00.151+0100 [conn3564] end connection 172.28.0.164:60783 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3574] end connection 172.28.0.164:60808 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3593] end connection 172.28.0.164:60829 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3568] end connection 172.28.0.164:60793 (503 connections now open) 2015-10-05T13:33:00.151+0100 [conn3591] end connection 172.28.0.164:60827 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3561] end connection 172.28.0.164:60775 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3581] end connection 172.28.0.164:60817 (505 connections now open) 2015-10-05T13:33:00.151+0100 [conn3556] end connection 172.28.0.164:60762 (504 connections now open) 2015-10-05T13:33:00.151+0100 [conn3587] end connection 172.28.0.164:60823 (503 connections now open) 2015-10-05T13:33:00.152+0100 [conn3575] end connection 172.28.0.164:60811 (497 connections now open) 2015-10-05T13:33:00.151+0100 [conn3548] end connection 172.28.0.164:60739 (498 connections now open) 2015-10-05T13:33:00.152+0100 [conn3578] end connection 172.28.0.164:60814 (495 connections now open) 2015-10-05T13:33:00.152+0100 [conn3592] end connection 172.28.0.164:60828 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3586] end connection 172.28.0.164:60822 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3560] end connection 172.28.0.164:60772 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3558] end connection 172.28.0.164:60767 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3571] end connection 172.28.0.164:60800 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3545] end connection 172.28.0.164:60731 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3562] end connection 172.28.0.164:60778 (493 connections now open) 2015-10-05T13:33:00.152+0100 [conn3585] end connection 172.28.0.164:60821 (489 connections now open) 2015-10-05T13:33:00.152+0100 [conn3582] end connection 172.28.0.164:60818 (489 connections now open) 2015-10-05T13:33:00.152+0100 [conn3547] end connection 172.28.0.164:60736 (488 connections now open) 2015-10-05T13:33:00.152+0100 [conn3567] end connection 172.28.0.164:60790 (488 connections now open) 2015-10-05T13:33:00.153+0100 [conn3569] end connection 172.28.0.164:60795 (483 connections now open) 2015-10-05T13:33:00.153+0100 [conn3576] end connection 172.28.0.164:60812 (483 connections now open) 2015-10-05T13:33:00.153+0100 [conn3583] end connection 172.28.0.164:60819 (483 connections now open) 2015-10-05T13:33:00.153+0100 [conn3588] end connection 172.28.0.164:60824 (481 connections now open) 2015-10-05T13:33:00.153+0100 [conn3555] end connection 172.28.0.164:60759 (484 connections now open) 2015-10-05T13:33:00.153+0100 [conn3565] end connection 172.28.0.164:60785 (482 connections now open) 2015-10-05T13:33:00.153+0100 [conn3584] end connection 172.28.0.164:60820 (482 connections now open) 2015-10-05T13:33:00.153+0100 [conn3553] end connection 172.28.0.164:60753 (481 connections now open) 2015-10-05T13:33:00.153+0100 [conn3579] end connection 172.28.0.164:60815 (478 connections now open) 2015-10-05T13:33:00.153+0100 [conn3590] end connection 172.28.0.164:60826 (475 connections now open) 2015-10-05T13:33:00.154+0100 [conn3589] end connection 172.28.0.164:60825 (472 connections now open) 2015-10-05T13:33:00.154+0100 [conn3563] end connection 172.28.0.164:60780 (472 connections now open) 2015-10-05T13:33:00.154+0100 [conn3546] end connection 172.28.0.164:60734 (472 connections now open) 2015-10-05T13:33:00.154+0100 [conn3554] end connection 172.28.0.164:60756 (469 connections now open) 2015-10-05T13:33:00.154+0100 [conn3551] end connection 172.28.0.164:60748 (468 connections now open) 2015-10-05T13:33:00.155+0100 [conn3572] end connection 172.28.0.164:60803 (467 connections now open) 2015-10-05T13:33:00.155+0100 [conn3559] end connection 172.28.0.164:60770 (466 connections now open) 2015-10-05T13:33:00.155+0100 [conn3557] end connection 172.28.0.164:60764 (465 connections now open) 2015-10-05T13:33:00.155+0100 [conn3566] end connection 172.28.0.164:60788 (464 connections now open) 2015-10-05T13:33:01.927+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:33:01.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:33:02.712+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:33:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:33:08.222+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e0312deab02e2998856 2015-10-05T13:33:08.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:13.988+0100 [conn2721] end connection 172.28.0.163:55974 (463 connections now open) 2015-10-05T13:33:13.989+0100 [mongosMain] connection accepted from 172.28.0.163:58004 #3594 (464 connections now open) 2015-10-05T13:33:13.991+0100 [conn3594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.592+0100 [mongosMain] connection accepted from 172.28.0.163:58008 #3595 (465 connections now open) 2015-10-05T13:33:14.614+0100 [mongosMain] connection accepted from 172.28.0.163:58009 #3596 (466 connections now open) 2015-10-05T13:33:14.615+0100 [mongosMain] connection accepted from 172.28.0.163:58010 #3597 (467 connections now open) 2015-10-05T13:33:14.615+0100 [mongosMain] connection accepted from 172.28.0.163:58011 #3598 (468 connections now open) 2015-10-05T13:33:14.616+0100 [conn3596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.616+0100 [mongosMain] connection accepted from 172.28.0.163:58012 #3599 (469 connections now open) 2015-10-05T13:33:14.616+0100 [conn3597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.617+0100 [mongosMain] connection accepted from 172.28.0.163:58013 #3600 (470 connections now open) 2015-10-05T13:33:14.617+0100 [conn3598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.617+0100 [mongosMain] connection accepted from 172.28.0.163:58014 #3601 (471 connections now open) 2015-10-05T13:33:14.618+0100 [mongosMain] connection accepted from 172.28.0.163:58015 #3602 (472 connections now open) 2015-10-05T13:33:14.619+0100 [mongosMain] connection accepted from 172.28.0.163:58016 #3603 (473 connections now open) 2015-10-05T13:33:14.619+0100 [conn3601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.620+0100 [conn3602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.620+0100 [mongosMain] connection accepted from 172.28.0.163:58017 #3604 (474 connections now open) 2015-10-05T13:33:14.622+0100 [conn3604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.633+0100 [mongosMain] connection accepted from 172.28.0.163:58018 #3605 (475 connections now open) 2015-10-05T13:33:14.635+0100 [conn3605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.636+0100 [mongosMain] connection accepted from 172.28.0.163:58019 #3606 (476 connections now open) 2015-10-05T13:33:14.637+0100 [conn3603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.638+0100 [mongosMain] connection accepted from 172.28.0.163:58020 #3607 (477 connections now open) 2015-10-05T13:33:14.639+0100 [conn3606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.639+0100 [mongosMain] connection accepted from 172.28.0.163:58021 #3608 (478 connections now open) 2015-10-05T13:33:14.641+0100 [conn3608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.641+0100 [mongosMain] connection accepted from 172.28.0.163:58022 #3609 (479 connections now open) 2015-10-05T13:33:14.644+0100 [mongosMain] connection accepted from 172.28.0.163:58023 #3610 (480 connections now open) 2015-10-05T13:33:14.646+0100 [conn3610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.646+0100 [mongosMain] connection accepted from 172.28.0.163:58024 #3611 (481 connections now open) 2015-10-05T13:33:14.648+0100 [conn3609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.648+0100 [conn3611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.648+0100 [mongosMain] connection accepted from 172.28.0.163:58025 #3612 (482 connections now open) 2015-10-05T13:33:14.649+0100 [mongosMain] connection accepted from 172.28.0.163:58026 #3613 (483 connections now open) 2015-10-05T13:33:14.650+0100 [conn3612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.650+0100 [conn3613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.652+0100 [mongosMain] connection accepted from 172.28.0.163:58027 #3614 (484 connections now open) 2015-10-05T13:33:14.655+0100 [mongosMain] connection accepted from 172.28.0.163:58028 #3615 (485 connections now open) 2015-10-05T13:33:14.657+0100 [mongosMain] connection accepted from 172.28.0.163:58029 #3616 (486 connections now open) 2015-10-05T13:33:14.660+0100 [mongosMain] connection accepted from 172.28.0.163:58030 #3617 (487 connections now open) 2015-10-05T13:33:14.662+0100 [mongosMain] connection accepted from 172.28.0.163:58031 #3618 (488 connections now open) 2015-10-05T13:33:14.664+0100 [mongosMain] connection accepted from 172.28.0.163:58032 #3619 (489 connections now open) 2015-10-05T13:33:14.667+0100 [mongosMain] connection accepted from 172.28.0.163:58033 #3620 (490 connections now open) 2015-10-05T13:33:14.669+0100 [mongosMain] connection accepted from 172.28.0.163:58034 #3621 (491 connections now open) 2015-10-05T13:33:14.671+0100 [mongosMain] connection accepted from 172.28.0.163:58035 #3622 (492 connections now open) 2015-10-05T13:33:14.674+0100 [mongosMain] connection accepted from 172.28.0.163:58036 #3623 (493 connections now open) 2015-10-05T13:33:14.676+0100 [mongosMain] connection accepted from 172.28.0.163:58037 #3624 (494 connections now open) 2015-10-05T13:33:14.679+0100 [mongosMain] connection accepted from 172.28.0.163:58038 #3625 (495 connections now open) 2015-10-05T13:33:14.681+0100 [mongosMain] connection accepted from 172.28.0.163:58039 #3626 (496 connections now open) 2015-10-05T13:33:14.683+0100 [mongosMain] connection accepted from 172.28.0.163:58040 #3627 (497 connections now open) 2015-10-05T13:33:14.686+0100 [mongosMain] connection accepted from 172.28.0.163:58041 #3628 (498 connections now open) 2015-10-05T13:33:14.689+0100 [mongosMain] connection accepted from 172.28.0.163:58042 #3629 (499 connections now open) 2015-10-05T13:33:14.691+0100 [mongosMain] connection accepted from 172.28.0.163:58043 #3630 (500 connections now open) 2015-10-05T13:33:14.694+0100 [mongosMain] connection accepted from 172.28.0.163:58044 #3631 (501 connections now open) 2015-10-05T13:33:14.697+0100 [mongosMain] connection accepted from 172.28.0.163:58045 #3632 (502 connections now open) 2015-10-05T13:33:14.701+0100 [mongosMain] connection accepted from 172.28.0.163:58046 #3633 (503 connections now open) 2015-10-05T13:33:14.704+0100 [mongosMain] connection accepted from 172.28.0.163:58047 #3634 (504 connections now open) 2015-10-05T13:33:14.707+0100 [mongosMain] connection accepted from 172.28.0.163:58048 #3635 (505 connections now open) 2015-10-05T13:33:14.709+0100 [mongosMain] connection accepted from 172.28.0.163:58049 #3636 (506 connections now open) 2015-10-05T13:33:14.711+0100 [mongosMain] connection accepted from 172.28.0.163:58050 #3637 (507 connections now open) 2015-10-05T13:33:14.714+0100 [mongosMain] connection accepted from 172.28.0.163:58051 #3638 (508 connections now open) 2015-10-05T13:33:14.716+0100 [mongosMain] connection accepted from 172.28.0.163:58052 #3639 (509 connections now open) 2015-10-05T13:33:14.719+0100 [mongosMain] connection accepted from 172.28.0.163:58053 #3640 (510 connections now open) 2015-10-05T13:33:14.721+0100 [mongosMain] connection accepted from 172.28.0.163:58054 #3641 (511 connections now open) 2015-10-05T13:33:14.724+0100 [mongosMain] connection accepted from 172.28.0.163:58055 #3642 (512 connections now open) 2015-10-05T13:33:14.726+0100 [mongosMain] connection accepted from 172.28.0.163:58056 #3643 (513 connections now open) 2015-10-05T13:33:14.730+0100 [mongosMain] connection accepted from 172.28.0.163:58057 #3644 (514 connections now open) 2015-10-05T13:33:14.733+0100 [mongosMain] connection accepted from 172.28.0.163:58058 #3645 (515 connections now open) 2015-10-05T13:33:14.736+0100 [mongosMain] connection accepted from 172.28.0.163:58059 #3646 (516 connections now open) 2015-10-05T13:33:14.738+0100 [mongosMain] connection accepted from 172.28.0.163:58060 #3647 (517 connections now open) 2015-10-05T13:33:14.740+0100 [mongosMain] connection accepted from 172.28.0.163:58061 #3648 (518 connections now open) 2015-10-05T13:33:14.742+0100 [mongosMain] connection accepted from 172.28.0.163:58062 #3649 (519 connections now open) 2015-10-05T13:33:14.745+0100 [mongosMain] connection accepted from 172.28.0.163:58063 #3650 (520 connections now open) 2015-10-05T13:33:14.748+0100 [mongosMain] connection accepted from 172.28.0.163:58064 #3651 (521 connections now open) 2015-10-05T13:33:14.750+0100 [mongosMain] connection accepted from 172.28.0.163:58065 #3652 (522 connections now open) 2015-10-05T13:33:14.752+0100 [mongosMain] connection accepted from 172.28.0.163:58066 #3653 (523 connections now open) 2015-10-05T13:33:14.755+0100 [mongosMain] connection accepted from 172.28.0.163:58067 #3654 (524 connections now open) 2015-10-05T13:33:14.757+0100 [mongosMain] connection accepted from 172.28.0.163:58068 #3655 (525 connections now open) 2015-10-05T13:33:14.760+0100 [mongosMain] connection accepted from 172.28.0.163:58069 #3656 (526 connections now open) 2015-10-05T13:33:14.762+0100 [mongosMain] connection accepted from 172.28.0.163:58070 #3657 (527 connections now open) 2015-10-05T13:33:14.769+0100 [mongosMain] connection accepted from 172.28.0.163:58071 #3658 (528 connections now open) 2015-10-05T13:33:14.775+0100 [mongosMain] connection accepted from 172.28.0.163:58072 #3659 (529 connections now open) 2015-10-05T13:33:14.778+0100 [mongosMain] connection accepted from 172.28.0.163:58073 #3660 (530 connections now open) 2015-10-05T13:33:14.782+0100 [mongosMain] connection accepted from 172.28.0.163:58074 #3661 (531 connections now open) 2015-10-05T13:33:14.785+0100 [mongosMain] connection accepted from 172.28.0.163:58075 #3662 (532 connections now open) 2015-10-05T13:33:14.788+0100 [mongosMain] connection accepted from 172.28.0.163:58076 #3663 (533 connections now open) 2015-10-05T13:33:14.790+0100 [mongosMain] connection accepted from 172.28.0.163:58077 #3664 (534 connections now open) 2015-10-05T13:33:14.796+0100 [mongosMain] connection accepted from 172.28.0.163:58079 #3665 (535 connections now open) 2015-10-05T13:33:14.798+0100 [mongosMain] connection accepted from 172.28.0.163:58080 #3666 (536 connections now open) 2015-10-05T13:33:14.800+0100 [mongosMain] connection accepted from 172.28.0.163:58081 #3667 (537 connections now open) 2015-10-05T13:33:14.807+0100 [mongosMain] connection accepted from 172.28.0.163:58082 #3668 (538 connections now open) 2015-10-05T13:33:14.808+0100 [mongosMain] connection accepted from 172.28.0.163:58083 #3669 (539 connections now open) 2015-10-05T13:33:14.808+0100 [conn3607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.809+0100 [conn3614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.809+0100 [conn3617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.810+0100 [conn3619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.811+0100 [conn3655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.812+0100 [conn3634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.813+0100 [conn3658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.813+0100 [conn3621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.813+0100 [conn3659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.813+0100 [conn3661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.813+0100 [mongosMain] connection accepted from 172.28.0.163:58084 #3670 (540 connections now open) 2015-10-05T13:33:14.814+0100 [conn3631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.814+0100 [conn3665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.815+0100 [conn3664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.816+0100 [conn3668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.818+0100 [conn3669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:14.819+0100 [conn3670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:16.625+0100 [conn3539] end connection 172.28.0.163:57961 (539 connections now open) 2015-10-05T13:33:16.625+0100 [conn3662] end connection 172.28.0.163:58075 (538 connections now open) 2015-10-05T13:33:16.625+0100 [conn3663] end connection 172.28.0.163:58076 (538 connections now open) 2015-10-05T13:33:16.626+0100 [conn3540] end connection 172.28.0.163:57962 (536 connections now open) 2015-10-05T13:33:18.128+0100 [conn3595] end connection 172.28.0.163:58008 (535 connections now open) 2015-10-05T13:33:18.129+0100 [conn3660] end connection 172.28.0.163:58073 (534 connections now open) 2015-10-05T13:33:18.130+0100 [conn3667] end connection 172.28.0.163:58081 (534 connections now open) 2015-10-05T13:33:18.130+0100 [conn3668] end connection 172.28.0.163:58082 (532 connections now open) 2015-10-05T13:33:18.130+0100 [conn3666] end connection 172.28.0.163:58080 (532 connections now open) 2015-10-05T13:33:18.130+0100 [conn3670] end connection 172.28.0.163:58084 (531 connections now open) 2015-10-05T13:33:18.130+0100 [conn3661] end connection 172.28.0.163:58074 (529 connections now open) 2015-10-05T13:33:18.130+0100 [conn3669] end connection 172.28.0.163:58083 (529 connections now open) 2015-10-05T13:33:18.130+0100 [conn3665] end connection 172.28.0.163:58079 (528 connections now open) 2015-10-05T13:33:18.131+0100 [conn3664] end connection 172.28.0.163:58077 (526 connections now open) 2015-10-05T13:33:18.131+0100 [conn3642] end connection 172.28.0.163:58055 (525 connections now open) 2015-10-05T13:33:18.132+0100 [conn3641] end connection 172.28.0.163:58054 (524 connections now open) 2015-10-05T13:33:18.132+0100 [conn3640] end connection 172.28.0.163:58053 (524 connections now open) 2015-10-05T13:33:18.132+0100 [conn3639] end connection 172.28.0.163:58052 (522 connections now open) 2015-10-05T13:33:18.132+0100 [conn3638] end connection 172.28.0.163:58051 (522 connections now open) 2015-10-05T13:33:18.132+0100 [conn3637] end connection 172.28.0.163:58050 (520 connections now open) 2015-10-05T13:33:18.132+0100 [conn3636] end connection 172.28.0.163:58049 (520 connections now open) 2015-10-05T13:33:18.132+0100 [conn3635] end connection 172.28.0.163:58048 (518 connections now open) 2015-10-05T13:33:18.132+0100 [conn3634] end connection 172.28.0.163:58047 (518 connections now open) 2015-10-05T13:33:18.132+0100 [conn3633] end connection 172.28.0.163:58046 (516 connections now open) 2015-10-05T13:33:18.132+0100 [conn3632] end connection 172.28.0.163:58045 (515 connections now open) 2015-10-05T13:33:18.133+0100 [conn3631] end connection 172.28.0.163:58044 (515 connections now open) 2015-10-05T13:33:18.133+0100 [conn3630] end connection 172.28.0.163:58043 (514 connections now open) 2015-10-05T13:33:18.133+0100 [conn3629] end connection 172.28.0.163:58042 (513 connections now open) 2015-10-05T13:33:18.133+0100 [conn3628] end connection 172.28.0.163:58041 (512 connections now open) 2015-10-05T13:33:18.133+0100 [conn3627] end connection 172.28.0.163:58040 (510 connections now open) 2015-10-05T13:33:18.133+0100 [conn3626] end connection 172.28.0.163:58039 (510 connections now open) 2015-10-05T13:33:18.133+0100 [conn3625] end connection 172.28.0.163:58038 (509 connections now open) 2015-10-05T13:33:18.133+0100 [conn3624] end connection 172.28.0.163:58037 (507 connections now open) 2015-10-05T13:33:18.134+0100 [conn3623] end connection 172.28.0.163:58036 (506 connections now open) 2015-10-05T13:33:18.134+0100 [conn3622] end connection 172.28.0.163:58035 (505 connections now open) 2015-10-05T13:33:18.134+0100 [conn3621] end connection 172.28.0.163:58034 (505 connections now open) 2015-10-05T13:33:18.134+0100 [conn3620] end connection 172.28.0.163:58033 (504 connections now open) 2015-10-05T13:33:18.134+0100 [conn3619] end connection 172.28.0.163:58032 (502 connections now open) 2015-10-05T13:33:18.134+0100 [conn3618] end connection 172.28.0.163:58031 (501 connections now open) 2015-10-05T13:33:18.134+0100 [conn3617] end connection 172.28.0.163:58030 (501 connections now open) 2015-10-05T13:33:18.134+0100 [conn3616] end connection 172.28.0.163:58029 (499 connections now open) 2015-10-05T13:33:18.135+0100 [conn3615] end connection 172.28.0.163:58028 (499 connections now open) 2015-10-05T13:33:18.135+0100 [conn3614] end connection 172.28.0.163:58027 (497 connections now open) 2015-10-05T13:33:18.135+0100 [conn3613] end connection 172.28.0.163:58026 (497 connections now open) 2015-10-05T13:33:18.135+0100 [conn3612] end connection 172.28.0.163:58025 (495 connections now open) 2015-10-05T13:33:18.135+0100 [conn3611] end connection 172.28.0.163:58024 (495 connections now open) 2015-10-05T13:33:18.135+0100 [conn3610] end connection 172.28.0.163:58023 (493 connections now open) 2015-10-05T13:33:18.135+0100 [conn3609] end connection 172.28.0.163:58022 (492 connections now open) 2015-10-05T13:33:18.135+0100 [conn3608] end connection 172.28.0.163:58021 (492 connections now open) 2015-10-05T13:33:18.135+0100 [conn3607] end connection 172.28.0.163:58020 (490 connections now open) 2015-10-05T13:33:18.135+0100 [conn3606] end connection 172.28.0.163:58019 (489 connections now open) 2015-10-05T13:33:18.136+0100 [conn3605] end connection 172.28.0.163:58018 (488 connections now open) 2015-10-05T13:33:18.136+0100 [conn3604] end connection 172.28.0.163:58017 (488 connections now open) 2015-10-05T13:33:18.136+0100 [conn3603] end connection 172.28.0.163:58016 (487 connections now open) 2015-10-05T13:33:18.136+0100 [conn3602] end connection 172.28.0.163:58015 (485 connections now open) 2015-10-05T13:33:18.136+0100 [conn3601] end connection 172.28.0.163:58014 (485 connections now open) 2015-10-05T13:33:18.136+0100 [conn3600] end connection 172.28.0.163:58013 (483 connections now open) 2015-10-05T13:33:18.136+0100 [conn3599] end connection 172.28.0.163:58012 (482 connections now open) 2015-10-05T13:33:18.136+0100 [conn3598] end connection 172.28.0.163:58011 (481 connections now open) 2015-10-05T13:33:18.136+0100 [conn3597] end connection 172.28.0.163:58010 (480 connections now open) 2015-10-05T13:33:18.136+0100 [conn3596] end connection 172.28.0.163:58009 (480 connections now open) 2015-10-05T13:33:18.137+0100 [conn3659] end connection 172.28.0.163:58072 (478 connections now open) 2015-10-05T13:33:18.137+0100 [conn3658] end connection 172.28.0.163:58071 (478 connections now open) 2015-10-05T13:33:18.137+0100 [conn3657] end connection 172.28.0.163:58070 (476 connections now open) 2015-10-05T13:33:18.137+0100 [conn3656] end connection 172.28.0.163:58069 (476 connections now open) 2015-10-05T13:33:18.137+0100 [conn3655] end connection 172.28.0.163:58068 (474 connections now open) 2015-10-05T13:33:18.137+0100 [conn3654] end connection 172.28.0.163:58067 (473 connections now open) 2015-10-05T13:33:18.138+0100 [conn3653] end connection 172.28.0.163:58066 (472 connections now open) 2015-10-05T13:33:18.138+0100 [conn3652] end connection 172.28.0.163:58065 (471 connections now open) 2015-10-05T13:33:18.138+0100 [conn3651] end connection 172.28.0.163:58064 (470 connections now open) 2015-10-05T13:33:18.138+0100 [conn3650] end connection 172.28.0.163:58063 (470 connections now open) 2015-10-05T13:33:18.138+0100 [conn3649] end connection 172.28.0.163:58062 (469 connections now open) 2015-10-05T13:33:18.138+0100 [conn3648] end connection 172.28.0.163:58061 (468 connections now open) 2015-10-05T13:33:18.138+0100 [conn3647] end connection 172.28.0.163:58060 (467 connections now open) 2015-10-05T13:33:18.138+0100 [conn3646] end connection 172.28.0.163:58059 (465 connections now open) 2015-10-05T13:33:18.138+0100 [conn3645] end connection 172.28.0.163:58058 (465 connections now open) 2015-10-05T13:33:18.139+0100 [conn3644] end connection 172.28.0.163:58057 (463 connections now open) 2015-10-05T13:33:18.139+0100 [conn3643] end connection 172.28.0.163:58056 (462 connections now open) 2015-10-05T13:33:20.365+0100 [conn3151] end connection 172.28.0.164:59850 (461 connections now open) 2015-10-05T13:33:20.365+0100 [conn3150] end connection 172.28.0.164:59849 (461 connections now open) 2015-10-05T13:33:20.367+0100 [conn3521] end connection 172.28.0.164:60138 (459 connections now open) 2015-10-05T13:33:20.370+0100 [conn3524] end connection 172.28.0.164:60554 (458 connections now open) 2015-10-05T13:33:20.381+0100 [conn3523] end connection 172.28.0.164:60532 (457 connections now open) 2015-10-05T13:33:20.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e1012deab02e299887a 2015-10-05T13:33:20.927+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:29.047+0100 [mongosMain] connection accepted from 127.0.0.1:58146 #3671 (458 connections now open) 2015-10-05T13:33:29.049+0100 [conn3671] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:29.051+0100 [conn3671] end connection 127.0.0.1:58146 (457 connections now open) 2015-10-05T13:33:32.845+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:33:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:33:32.914+0100 [conn3123] end connection 172.28.0.163:56596 (456 connections now open) 2015-10-05T13:33:32.914+0100 [conn3122] end connection 172.28.0.163:56595 (456 connections now open) 2015-10-05T13:33:32.917+0100 [conn3155] end connection 172.28.0.163:56965 (454 connections now open) 2015-10-05T13:33:32.917+0100 [conn3156] end connection 172.28.0.163:56966 (454 connections now open) 2015-10-05T13:33:32.917+0100 [conn3157] end connection 172.28.0.163:56967 (452 connections now open) 2015-10-05T13:33:32.917+0100 [conn3158] end connection 172.28.0.163:56968 (452 connections now open) 2015-10-05T13:33:32.917+0100 [conn3159] end connection 172.28.0.163:56969 (452 connections now open) 2015-10-05T13:33:32.917+0100 [conn3160] end connection 172.28.0.163:56970 (451 connections now open) 2015-10-05T13:33:32.917+0100 [conn3164] end connection 172.28.0.163:56974 (449 connections now open) 2015-10-05T13:33:32.917+0100 [conn3166] end connection 172.28.0.163:56976 (449 connections now open) 2015-10-05T13:33:32.917+0100 [conn3161] end connection 172.28.0.163:56971 (451 connections now open) 2015-10-05T13:33:32.917+0100 [conn3168] end connection 172.28.0.163:56978 (446 connections now open) 2015-10-05T13:33:32.917+0100 [conn3169] end connection 172.28.0.163:56979 (446 connections now open) 2015-10-05T13:33:32.917+0100 [conn3172] end connection 172.28.0.163:56983 (445 connections now open) 2015-10-05T13:33:32.917+0100 [conn3173] end connection 172.28.0.163:56984 (444 connections now open) 2015-10-05T13:33:32.917+0100 [conn3175] end connection 172.28.0.163:56986 (442 connections now open) 2015-10-05T13:33:32.917+0100 [conn3179] end connection 172.28.0.163:56992 (441 connections now open) 2015-10-05T13:33:32.917+0100 [conn3170] end connection 172.28.0.163:56980 (446 connections now open) 2015-10-05T13:33:32.917+0100 [conn3171] end connection 172.28.0.163:56981 (446 connections now open) 2015-10-05T13:33:32.917+0100 [conn3162] end connection 172.28.0.163:56972 (451 connections now open) 2015-10-05T13:33:32.917+0100 [conn3167] end connection 172.28.0.163:56977 (447 connections now open) 2015-10-05T13:33:32.918+0100 [conn3184] end connection 172.28.0.163:56997 (436 connections now open) 2015-10-05T13:33:32.918+0100 [conn3185] end connection 172.28.0.163:56998 (436 connections now open) 2015-10-05T13:33:32.918+0100 [conn3187] end connection 172.28.0.163:57000 (434 connections now open) 2015-10-05T13:33:32.918+0100 [conn3188] end connection 172.28.0.163:57001 (433 connections now open) 2015-10-05T13:33:32.917+0100 [conn3177] end connection 172.28.0.163:56988 (441 connections now open) 2015-10-05T13:33:32.917+0100 [conn3178] end connection 172.28.0.163:56990 (441 connections now open) 2015-10-05T13:33:32.918+0100 [conn3180] end connection 172.28.0.163:56993 (439 connections now open) 2015-10-05T13:33:32.918+0100 [conn3182] end connection 172.28.0.163:56995 (438 connections now open) 2015-10-05T13:33:32.918+0100 [conn3198] end connection 172.28.0.163:57011 (428 connections now open) 2015-10-05T13:33:32.918+0100 [conn3183] end connection 172.28.0.163:56996 (437 connections now open) 2015-10-05T13:33:32.918+0100 [conn3163] end connection 172.28.0.163:56973 (436 connections now open) 2015-10-05T13:33:32.918+0100 [conn3201] end connection 172.28.0.163:57014 (425 connections now open) 2015-10-05T13:33:32.918+0100 [conn3186] end connection 172.28.0.163:56999 (436 connections now open) 2015-10-05T13:33:32.918+0100 [conn3205] end connection 172.28.0.163:57018 (423 connections now open) 2015-10-05T13:33:32.917+0100 [conn3165] end connection 172.28.0.163:56975 (448 connections now open) 2015-10-05T13:33:32.918+0100 [conn3208] end connection 172.28.0.163:57021 (421 connections now open) 2015-10-05T13:33:32.919+0100 [conn3211] end connection 172.28.0.163:57024 (420 connections now open) 2015-10-05T13:33:32.919+0100 [conn3212] end connection 172.28.0.163:57025 (419 connections now open) 2015-10-05T13:33:32.919+0100 [conn3214] end connection 172.28.0.163:57027 (418 connections now open) 2015-10-05T13:33:32.918+0100 [conn3190] end connection 172.28.0.163:57003 (432 connections now open) 2015-10-05T13:33:32.919+0100 [conn3216] end connection 172.28.0.163:57029 (416 connections now open) 2015-10-05T13:33:32.919+0100 [conn3221] end connection 172.28.0.163:57034 (415 connections now open) 2015-10-05T13:33:32.918+0100 [conn3192] end connection 172.28.0.163:57005 (431 connections now open) 2015-10-05T13:33:32.918+0100 [conn3193] end connection 172.28.0.163:57006 (430 connections now open) 2015-10-05T13:33:32.919+0100 [conn3219] end connection 172.28.0.163:57032 (412 connections now open) 2015-10-05T13:33:32.919+0100 [conn3223] end connection 172.28.0.163:57036 (411 connections now open) 2015-10-05T13:33:32.918+0100 [conn3195] end connection 172.28.0.163:57008 (428 connections now open) 2015-10-05T13:33:32.919+0100 [conn3224] end connection 172.28.0.163:57037 (409 connections now open) 2015-10-05T13:33:32.919+0100 [conn3239] end connection 172.28.0.163:57052 (409 connections now open) 2015-10-05T13:33:32.919+0100 [conn3228] end connection 172.28.0.163:57041 (409 connections now open) 2015-10-05T13:33:32.918+0100 [conn3199] end connection 172.28.0.163:57012 (428 connections now open) 2015-10-05T13:33:32.918+0100 [conn3200] end connection 172.28.0.163:57013 (427 connections now open) 2015-10-05T13:33:32.919+0100 [conn3257] end connection 172.28.0.163:57070 (404 connections now open) 2015-10-05T13:33:32.919+0100 [conn3229] end connection 172.28.0.163:57042 (403 connections now open) 2015-10-05T13:33:32.919+0100 [conn3227] end connection 172.28.0.163:57040 (403 connections now open) 2015-10-05T13:33:32.918+0100 [conn3197] end connection 172.28.0.163:57010 (426 connections now open) 2015-10-05T13:33:32.920+0100 [conn3285] end connection 172.28.0.163:57098 (400 connections now open) 2015-10-05T13:33:32.918+0100 [conn3204] end connection 172.28.0.163:57017 (424 connections now open) 2015-10-05T13:33:32.920+0100 [conn3235] end connection 172.28.0.163:57048 (398 connections now open) 2015-10-05T13:33:32.920+0100 [conn3232] end connection 172.28.0.163:57045 (397 connections now open) 2015-10-05T13:33:32.918+0100 [conn3202] end connection 172.28.0.163:57015 (422 connections now open) 2015-10-05T13:33:32.918+0100 [conn3206] end connection 172.28.0.163:57019 (422 connections now open) 2015-10-05T13:33:32.918+0100 [conn3207] end connection 172.28.0.163:57020 (421 connections now open) 2015-10-05T13:33:32.920+0100 [conn3247] end connection 172.28.0.163:57060 (393 connections now open) 2015-10-05T13:33:32.920+0100 [conn3243] end connection 172.28.0.163:57056 (392 connections now open) 2015-10-05T13:33:32.920+0100 [conn3242] end connection 172.28.0.163:57055 (392 connections now open) 2015-10-05T13:33:32.919+0100 [conn3209] end connection 172.28.0.163:57022 (420 connections now open) 2015-10-05T13:33:32.920+0100 [conn3244] end connection 172.28.0.163:57057 (389 connections now open) 2015-10-05T13:33:32.920+0100 [conn3265] end connection 172.28.0.163:57078 (389 connections now open) 2015-10-05T13:33:32.920+0100 [conn3249] end connection 172.28.0.163:57062 (387 connections now open) 2015-10-05T13:33:32.920+0100 [conn3250] end connection 172.28.0.163:57063 (386 connections now open) 2015-10-05T13:33:32.920+0100 [conn3254] end connection 172.28.0.163:57068 (385 connections now open) 2015-10-05T13:33:32.919+0100 [conn3213] end connection 172.28.0.163:57026 (418 connections now open) 2015-10-05T13:33:32.920+0100 [conn3259] end connection 172.28.0.163:57072 (384 connections now open) 2015-10-05T13:33:32.919+0100 [conn3218] end connection 172.28.0.163:57031 (415 connections now open) 2015-10-05T13:33:32.918+0100 [conn3191] end connection 172.28.0.163:57004 (432 connections now open) 2015-10-05T13:33:32.919+0100 [conn3217] end connection 172.28.0.163:57030 (415 connections now open) 2015-10-05T13:33:32.921+0100 [conn3263] end connection 172.28.0.163:57076 (380 connections now open) 2015-10-05T13:33:32.921+0100 [conn3266] end connection 172.28.0.163:57079 (377 connections now open) 2015-10-05T13:33:32.919+0100 [conn3220] end connection 172.28.0.163:57033 (415 connections now open) 2015-10-05T13:33:32.919+0100 [conn3222] end connection 172.28.0.163:57035 (412 connections now open) 2015-10-05T13:33:32.918+0100 [conn3194] end connection 172.28.0.163:57007 (429 connections now open) 2015-10-05T13:33:32.921+0100 [conn3271] end connection 172.28.0.163:57084 (374 connections now open) 2015-10-05T13:33:32.921+0100 [conn3274] end connection 172.28.0.163:57087 (373 connections now open) 2015-10-05T13:33:32.921+0100 [conn3276] end connection 172.28.0.163:57089 (372 connections now open) 2015-10-05T13:33:32.919+0100 [conn3225] end connection 172.28.0.163:57038 (409 connections now open) 2015-10-05T13:33:32.921+0100 [conn3297] end connection 172.28.0.163:57110 (370 connections now open) 2015-10-05T13:33:32.921+0100 [conn3277] end connection 172.28.0.163:57090 (369 connections now open) 2015-10-05T13:33:32.919+0100 [conn3238] end connection 172.28.0.163:57051 (403 connections now open) 2015-10-05T13:33:32.921+0100 [conn3280] end connection 172.28.0.163:57093 (367 connections now open) 2015-10-05T13:33:32.918+0100 [conn3196] end connection 172.28.0.163:57009 (427 connections now open) 2015-10-05T13:33:32.921+0100 [conn3281] end connection 172.28.0.163:57094 (366 connections now open) 2015-10-05T13:33:32.921+0100 [conn3282] end connection 172.28.0.163:57095 (366 connections now open) 2015-10-05T13:33:32.919+0100 [conn3230] end connection 172.28.0.163:57043 (402 connections now open) 2015-10-05T13:33:32.920+0100 [conn3233] end connection 172.28.0.163:57046 (400 connections now open) 2015-10-05T13:33:32.917+0100 [conn3176] end connection 172.28.0.163:56987 (441 connections now open) 2015-10-05T13:33:32.922+0100 [conn3438] end connection 172.28.0.163:57260 (360 connections now open) 2015-10-05T13:33:32.922+0100 [conn3284] end connection 172.28.0.163:57097 (359 connections now open) 2015-10-05T13:33:32.922+0100 [conn3307] end connection 172.28.0.163:57120 (358 connections now open) 2015-10-05T13:33:32.920+0100 [conn3231] end connection 172.28.0.163:57044 (398 connections now open) 2015-10-05T13:33:32.922+0100 [conn3287] end connection 172.28.0.163:57100 (356 connections now open) 2015-10-05T13:33:32.922+0100 [conn3294] end connection 172.28.0.163:57107 (355 connections now open) 2015-10-05T13:33:32.922+0100 [conn3298] end connection 172.28.0.163:57111 (354 connections now open) 2015-10-05T13:33:32.922+0100 [conn3305] end connection 172.28.0.163:57116 (353 connections now open) 2015-10-05T13:33:32.922+0100 [conn3300] end connection 172.28.0.163:57113 (352 connections now open) 2015-10-05T13:33:32.922+0100 [conn3312] end connection 172.28.0.163:57125 (352 connections now open) 2015-10-05T13:33:32.918+0100 [conn3203] end connection 172.28.0.163:57016 (423 connections now open) 2015-10-05T13:33:32.922+0100 [conn3306] end connection 172.28.0.163:57119 (349 connections now open) 2015-10-05T13:33:32.922+0100 [conn3333] end connection 172.28.0.163:57146 (348 connections now open) 2015-10-05T13:33:32.920+0100 [conn3245] end connection 172.28.0.163:57058 (394 connections now open) 2015-10-05T13:33:32.918+0100 [conn3189] end connection 172.28.0.163:57002 (433 connections now open) 2015-10-05T13:33:32.920+0100 [conn3246] end connection 172.28.0.163:57059 (390 connections now open) 2015-10-05T13:33:32.920+0100 [conn3248] end connection 172.28.0.163:57061 (389 connections now open) 2015-10-05T13:33:32.917+0100 [conn3174] end connection 172.28.0.163:56985 (441 connections now open) 2015-10-05T13:33:32.923+0100 [conn3313] end connection 172.28.0.163:57126 (341 connections now open) 2015-10-05T13:33:32.919+0100 [conn3210] end connection 172.28.0.163:57023 (418 connections now open) 2015-10-05T13:33:32.920+0100 [conn3251] end connection 172.28.0.163:57064 (386 connections now open) 2015-10-05T13:33:32.923+0100 [conn3319] end connection 172.28.0.163:57132 (339 connections now open) 2015-10-05T13:33:32.923+0100 [conn3324] end connection 172.28.0.163:57137 (339 connections now open) 2015-10-05T13:33:32.919+0100 [conn3215] end connection 172.28.0.163:57028 (418 connections now open) 2015-10-05T13:33:32.920+0100 [conn3253] end connection 172.28.0.163:57066 (385 connections now open) 2015-10-05T13:33:32.923+0100 [conn3395] end connection 172.28.0.163:57208 (336 connections now open) 2015-10-05T13:33:32.920+0100 [conn3293] end connection 172.28.0.163:57106 (384 connections now open) 2015-10-05T13:33:32.923+0100 [conn3330] end connection 172.28.0.163:57143 (332 connections now open) 2015-10-05T13:33:32.923+0100 [conn3328] end connection 172.28.0.163:57141 (332 connections now open) 2015-10-05T13:33:32.924+0100 [conn3397] end connection 172.28.0.163:57210 (331 connections now open) 2015-10-05T13:33:32.920+0100 [conn3256] end connection 172.28.0.163:57069 (383 connections now open) 2015-10-05T13:33:32.924+0100 [conn3337] end connection 172.28.0.163:57151 (329 connections now open) 2015-10-05T13:33:32.924+0100 [conn3338] end connection 172.28.0.163:57150 (328 connections now open) 2015-10-05T13:33:32.924+0100 [conn3340] end connection 172.28.0.163:57153 (327 connections now open) 2015-10-05T13:33:32.924+0100 [conn3341] end connection 172.28.0.163:57154 (326 connections now open) 2015-10-05T13:33:32.921+0100 [conn3262] end connection 172.28.0.163:57075 (380 connections now open) 2015-10-05T13:33:32.924+0100 [conn3345] end connection 172.28.0.163:57158 (324 connections now open) 2015-10-05T13:33:32.924+0100 [conn3346] end connection 172.28.0.163:57159 (323 connections now open) 2015-10-05T13:33:32.924+0100 [conn3348] end connection 172.28.0.163:57161 (322 connections now open) 2015-10-05T13:33:32.921+0100 [conn3264] end connection 172.28.0.163:57077 (377 connections now open) 2015-10-05T13:33:32.921+0100 [conn3269] end connection 172.28.0.163:57082 (377 connections now open) 2015-10-05T13:33:32.924+0100 [conn3353] end connection 172.28.0.163:57166 (319 connections now open) 2015-10-05T13:33:32.924+0100 [conn3357] end connection 172.28.0.163:57168 (318 connections now open) 2015-10-05T13:33:32.924+0100 [conn3355] end connection 172.28.0.163:57170 (317 connections now open) 2015-10-05T13:33:32.924+0100 [conn3354] end connection 172.28.0.163:57167 (317 connections now open) 2015-10-05T13:33:32.924+0100 [conn3360] end connection 172.28.0.163:57173 (316 connections now open) 2015-10-05T13:33:32.921+0100 [conn3267] end connection 172.28.0.163:57080 (376 connections now open) 2015-10-05T13:33:32.924+0100 [conn3364] end connection 172.28.0.163:57177 (313 connections now open) 2015-10-05T13:33:32.921+0100 [conn3270] end connection 172.28.0.163:57083 (373 connections now open) 2015-10-05T13:33:32.925+0100 [conn3368] end connection 172.28.0.163:57181 (312 connections now open) 2015-10-05T13:33:32.925+0100 [conn3363] end connection 172.28.0.163:57176 (310 connections now open) 2015-10-05T13:33:32.921+0100 [conn3273] end connection 172.28.0.163:57086 (372 connections now open) 2015-10-05T13:33:32.921+0100 [conn3272] end connection 172.28.0.163:57085 (372 connections now open) 2015-10-05T13:33:32.925+0100 [conn3375] end connection 172.28.0.163:57188 (307 connections now open) 2015-10-05T13:33:32.921+0100 [conn3275] end connection 172.28.0.163:57088 (371 connections now open) 2015-10-05T13:33:32.921+0100 [conn3295] end connection 172.28.0.163:57108 (371 connections now open) 2015-10-05T13:33:32.919+0100 [conn3255] end connection 172.28.0.163:57067 (407 connections now open) 2015-10-05T13:33:32.921+0100 [conn3278] end connection 172.28.0.163:57091 (369 connections now open) 2015-10-05T13:33:32.925+0100 [conn3376] end connection 172.28.0.163:57189 (302 connections now open) 2015-10-05T13:33:32.921+0100 [conn3279] end connection 172.28.0.163:57092 (368 connections now open) 2015-10-05T13:33:32.919+0100 [conn3226] end connection 172.28.0.163:57039 (403 connections now open) 2015-10-05T13:33:32.922+0100 [conn3283] end connection 172.28.0.163:57096 (360 connections now open) 2015-10-05T13:33:32.925+0100 [conn3381] end connection 172.28.0.163:57194 (299 connections now open) 2015-10-05T13:33:32.922+0100 [conn3286] end connection 172.28.0.163:57099 (358 connections now open) 2015-10-05T13:33:32.922+0100 [conn3288] end connection 172.28.0.163:57101 (357 connections now open) 2015-10-05T13:33:32.922+0100 [conn3290] end connection 172.28.0.163:57103 (357 connections now open) 2015-10-05T13:33:32.922+0100 [conn3289] end connection 172.28.0.163:57102 (356 connections now open) 2015-10-05T13:33:32.920+0100 [conn3236] end connection 172.28.0.163:57049 (397 connections now open) 2015-10-05T13:33:32.922+0100 [conn3292] end connection 172.28.0.163:57105 (356 connections now open) 2015-10-05T13:33:32.925+0100 [conn3389] end connection 172.28.0.163:57203 (291 connections now open) 2015-10-05T13:33:32.926+0100 [conn3393] end connection 172.28.0.163:57206 (290 connections now open) 2015-10-05T13:33:32.920+0100 [conn3237] end connection 172.28.0.163:57050 (397 connections now open) 2015-10-05T13:33:32.926+0100 [conn3398] end connection 172.28.0.163:57211 (288 connections now open) 2015-10-05T13:33:32.922+0100 [conn3301] end connection 172.28.0.163:57115 (352 connections now open) 2015-10-05T13:33:32.922+0100 [conn3304] end connection 172.28.0.163:57114 (351 connections now open) 2015-10-05T13:33:32.922+0100 [conn3303] end connection 172.28.0.163:57118 (349 connections now open) 2015-10-05T13:33:32.922+0100 [conn3302] end connection 172.28.0.163:57117 (349 connections now open) 2015-10-05T13:33:32.926+0100 [conn3406] end connection 172.28.0.163:57219 (284 connections now open) 2015-10-05T13:33:32.926+0100 [conn3401] end connection 172.28.0.163:57214 (283 connections now open) 2015-10-05T13:33:32.922+0100 [conn3310] end connection 172.28.0.163:57123 (349 connections now open) 2015-10-05T13:33:32.926+0100 [conn3405] end connection 172.28.0.163:57218 (280 connections now open) 2015-10-05T13:33:32.922+0100 [conn3311] end connection 172.28.0.163:57124 (348 connections now open) 2015-10-05T13:33:32.920+0100 [conn3240] end connection 172.28.0.163:57053 (394 connections now open) 2015-10-05T13:33:32.926+0100 [conn3411] end connection 172.28.0.163:57224 (278 connections now open) 2015-10-05T13:33:32.923+0100 [conn3335] end connection 172.28.0.163:57148 (345 connections now open) 2015-10-05T13:33:32.926+0100 [conn3414] end connection 172.28.0.163:57226 (275 connections now open) 2015-10-05T13:33:32.923+0100 [conn3316] end connection 172.28.0.163:57129 (341 connections now open) 2015-10-05T13:33:32.920+0100 [conn3252] end connection 172.28.0.163:57065 (389 connections now open) 2015-10-05T13:33:32.923+0100 [conn3334] end connection 172.28.0.163:57147 (341 connections now open) 2015-10-05T13:33:32.923+0100 [conn3318] end connection 172.28.0.163:57131 (340 connections now open) 2015-10-05T13:33:32.926+0100 [conn3426] end connection 172.28.0.163:57239 (271 connections now open) 2015-10-05T13:33:32.923+0100 [conn3315] end connection 172.28.0.163:57128 (339 connections now open) 2015-10-05T13:33:32.923+0100 [conn3322] end connection 172.28.0.163:57135 (339 connections now open) 2015-10-05T13:33:32.923+0100 [conn3329] end connection 172.28.0.163:57142 (336 connections now open) 2015-10-05T13:33:32.927+0100 [conn3428] end connection 172.28.0.163:57242 (266 connections now open) 2015-10-05T13:33:32.923+0100 [conn3323] end connection 172.28.0.163:57136 (336 connections now open) 2015-10-05T13:33:32.923+0100 [conn3321] end connection 172.28.0.163:57134 (336 connections now open) 2015-10-05T13:33:32.923+0100 [conn3326] end connection 172.28.0.163:57139 (335 connections now open) 2015-10-05T13:33:32.923+0100 [conn3327] end connection 172.28.0.163:57140 (334 connections now open) 2015-10-05T13:33:32.923+0100 [conn3332] end connection 172.28.0.163:57145 (331 connections now open) 2015-10-05T13:33:32.927+0100 [conn3433] end connection 172.28.0.163:57252 (260 connections now open) 2015-10-05T13:33:32.924+0100 [conn3336] end connection 172.28.0.163:57149 (331 connections now open) 2015-10-05T13:33:32.927+0100 [conn3435] end connection 172.28.0.163:57255 (258 connections now open) 2015-10-05T13:33:32.927+0100 [conn3434] end connection 172.28.0.163:57254 (257 connections now open) 2015-10-05T13:33:32.927+0100 [conn3437] end connection 172.28.0.163:57258 (257 connections now open) 2015-10-05T13:33:32.924+0100 [conn3358] end connection 172.28.0.163:57171 (327 connections now open) 2015-10-05T13:33:32.924+0100 [conn3342] end connection 172.28.0.163:57155 (327 connections now open) 2015-10-05T13:33:32.924+0100 [conn3344] end connection 172.28.0.163:57157 (324 connections now open) 2015-10-05T13:33:32.921+0100 [conn3260] end connection 172.28.0.163:57073 (380 connections now open) 2015-10-05T13:33:32.928+0100 [conn3449] end connection 172.28.0.163:57279 (251 connections now open) 2015-10-05T13:33:32.924+0100 [conn3432] end connection 172.28.0.163:57251 (323 connections now open) 2015-10-05T13:33:32.924+0100 [conn3350] end connection 172.28.0.163:57163 (322 connections now open) 2015-10-05T13:33:32.921+0100 [conn3261] end connection 172.28.0.163:57074 (380 connections now open) 2015-10-05T13:33:32.924+0100 [conn3352] end connection 172.28.0.163:57165 (321 connections now open) 2015-10-05T13:33:32.924+0100 [conn3349] end connection 172.28.0.163:57162 (319 connections now open) 2015-10-05T13:33:32.924+0100 [conn3351] end connection 172.28.0.163:57164 (319 connections now open) 2015-10-05T13:33:32.924+0100 [conn3356] end connection 172.28.0.163:57169 (315 connections now open) 2015-10-05T13:33:32.928+0100 [conn3446] end connection 172.28.0.163:57273 (244 connections now open) 2015-10-05T13:33:32.924+0100 [conn3359] end connection 172.28.0.163:57172 (315 connections now open) 2015-10-05T13:33:32.924+0100 [conn3362] end connection 172.28.0.163:57175 (313 connections now open) 2015-10-05T13:33:32.928+0100 [conn3445] end connection 172.28.0.163:57274 (241 connections now open) 2015-10-05T13:33:32.928+0100 [conn3447] end connection 172.28.0.163:57275 (241 connections now open) 2015-10-05T13:33:32.921+0100 [conn3268] end connection 172.28.0.163:57081 (374 connections now open) 2015-10-05T13:33:32.925+0100 [conn3367] end connection 172.28.0.163:57180 (312 connections now open) 2015-10-05T13:33:32.925+0100 [conn3366] end connection 172.28.0.163:57179 (310 connections now open) 2015-10-05T13:33:32.925+0100 [conn3372] end connection 172.28.0.163:57185 (309 connections now open) 2015-10-05T13:33:32.929+0100 [conn3453] end connection 172.28.0.163:57285 (234 connections now open) 2015-10-05T13:33:32.925+0100 [conn3370] end connection 172.28.0.163:57183 (308 connections now open) 2015-10-05T13:33:32.929+0100 [conn3451] end connection 172.28.0.163:57282 (232 connections now open) 2015-10-05T13:33:32.918+0100 [conn3181] end connection 172.28.0.163:56994 (437 connections now open) 2015-10-05T13:33:32.925+0100 [conn3371] end connection 172.28.0.163:57184 (306 connections now open) 2015-10-05T13:33:32.925+0100 [conn3373] end connection 172.28.0.163:57186 (305 connections now open) 2015-10-05T13:33:32.925+0100 [conn3391] end connection 172.28.0.163:57199 (305 connections now open) 2015-10-05T13:33:32.925+0100 [conn3377] end connection 172.28.0.163:57190 (304 connections now open) 2015-10-05T13:33:32.925+0100 [conn3374] end connection 172.28.0.163:57187 (304 connections now open) 2015-10-05T13:33:32.925+0100 [conn3420] end connection 172.28.0.163:57232 (303 connections now open) 2015-10-05T13:33:32.921+0100 [conn3309] end connection 172.28.0.163:57121 (368 connections now open) 2015-10-05T13:33:32.925+0100 [conn3378] end connection 172.28.0.163:57191 (301 connections now open) 2015-10-05T13:33:32.929+0100 [conn3462] end connection 172.28.0.163:57300 (222 connections now open) 2015-10-05T13:33:32.925+0100 [conn3379] end connection 172.28.0.163:57192 (300 connections now open) 2015-10-05T13:33:32.925+0100 [conn3380] end connection 172.28.0.163:57193 (300 connections now open) 2015-10-05T13:33:32.920+0100 [conn3234] end connection 172.28.0.163:57047 (398 connections now open) 2015-10-05T13:33:32.925+0100 [conn3383] end connection 172.28.0.163:57196 (298 connections now open) 2015-10-05T13:33:32.925+0100 [conn3382] end connection 172.28.0.163:57195 (297 connections now open) 2015-10-05T13:33:32.930+0100 [conn3465] end connection 172.28.0.163:57312 (217 connections now open) 2015-10-05T13:33:32.925+0100 [conn3385] end connection 172.28.0.163:57198 (295 connections now open) 2015-10-05T13:33:32.925+0100 [conn3386] end connection 172.28.0.163:57200 (294 connections now open) 2015-10-05T13:33:32.925+0100 [conn3387] end connection 172.28.0.163:57201 (294 connections now open) 2015-10-05T13:33:32.925+0100 [conn3388] end connection 172.28.0.163:57202 (293 connections now open) 2015-10-05T13:33:32.925+0100 [conn3390] end connection 172.28.0.163:57204 (293 connections now open) 2015-10-05T13:33:32.925+0100 [conn3392] end connection 172.28.0.163:57205 (290 connections now open) 2015-10-05T13:33:32.922+0100 [conn3296] end connection 172.28.0.163:57109 (355 connections now open) 2015-10-05T13:33:32.926+0100 [conn3394] end connection 172.28.0.163:57207 (290 connections now open) 2015-10-05T13:33:32.930+0100 [conn3469] end connection 172.28.0.163:57320 (207 connections now open) 2015-10-05T13:33:32.926+0100 [conn3427] end connection 172.28.0.163:57241 (290 connections now open) 2015-10-05T13:33:32.926+0100 [conn3396] end connection 172.28.0.163:57209 (288 connections now open) 2015-10-05T13:33:32.922+0100 [conn3299] end connection 172.28.0.163:57112 (352 connections now open) 2015-10-05T13:33:32.930+0100 [conn3475] end connection 172.28.0.163:57331 (203 connections now open) 2015-10-05T13:33:32.926+0100 [conn3399] end connection 172.28.0.163:57212 (287 connections now open) 2015-10-05T13:33:32.930+0100 [conn3478] end connection 172.28.0.163:57338 (201 connections now open) 2015-10-05T13:33:32.931+0100 [conn3471] end connection 172.28.0.163:57323 (200 connections now open) 2015-10-05T13:33:32.931+0100 [conn3470] end connection 172.28.0.163:57322 (199 connections now open) 2015-10-05T13:33:32.922+0100 [conn3308] end connection 172.28.0.163:57122 (349 connections now open) 2015-10-05T13:33:32.926+0100 [conn3402] end connection 172.28.0.163:57215 (282 connections now open) 2015-10-05T13:33:32.920+0100 [conn3241] end connection 172.28.0.163:57054 (395 connections now open) 2015-10-05T13:33:32.926+0100 [conn3403] end connection 172.28.0.163:57216 (282 connections now open) 2015-10-05T13:33:32.926+0100 [conn3404] end connection 172.28.0.163:57217 (282 connections now open) 2015-10-05T13:33:32.926+0100 [conn3407] end connection 172.28.0.163:57220 (281 connections now open) 2015-10-05T13:33:32.926+0100 [conn3408] end connection 172.28.0.163:57221 (278 connections now open) 2015-10-05T13:33:32.926+0100 [conn3409] end connection 172.28.0.163:57223 (278 connections now open) 2015-10-05T13:33:32.926+0100 [conn3410] end connection 172.28.0.163:57222 (278 connections now open) 2015-10-05T13:33:32.922+0100 [conn3314] end connection 172.28.0.163:57127 (347 connections now open) 2015-10-05T13:33:32.926+0100 [conn3412] end connection 172.28.0.163:57225 (276 connections now open) 2015-10-05T13:33:32.926+0100 [conn3413] end connection 172.28.0.163:57227 (274 connections now open) 2015-10-05T13:33:32.931+0100 [conn3480] end connection 172.28.0.163:57348 (186 connections now open) 2015-10-05T13:33:32.923+0100 [conn3317] end connection 172.28.0.163:57130 (345 connections now open) 2015-10-05T13:33:32.926+0100 [conn3415] end connection 172.28.0.163:57228 (274 connections now open) 2015-10-05T13:33:32.926+0100 [conn3416] end connection 172.28.0.163:57229 (274 connections now open) 2015-10-05T13:33:32.926+0100 [conn3418] end connection 172.28.0.163:57231 (273 connections now open) 2015-10-05T13:33:32.926+0100 [conn3422] end connection 172.28.0.163:57235 (273 connections now open) 2015-10-05T13:33:32.926+0100 [conn3419] end connection 172.28.0.163:57233 (272 connections now open) 2015-10-05T13:33:32.926+0100 [conn3423] end connection 172.28.0.163:57236 (271 connections now open) 2015-10-05T13:33:32.923+0100 [conn3320] end connection 172.28.0.163:57133 (340 connections now open) 2015-10-05T13:33:32.927+0100 [conn3424] end connection 172.28.0.163:57237 (270 connections now open) 2015-10-05T13:33:32.927+0100 [conn3425] end connection 172.28.0.163:57238 (269 connections now open) 2015-10-05T13:33:32.932+0100 [conn3485] end connection 172.28.0.163:57359 (175 connections now open) 2015-10-05T13:33:32.927+0100 [conn3429] end connection 172.28.0.163:57244 (269 connections now open) 2015-10-05T13:33:32.927+0100 [conn3430] end connection 172.28.0.163:57247 (269 connections now open) 2015-10-05T13:33:32.923+0100 [conn3325] end connection 172.28.0.163:57138 (336 connections now open) 2015-10-05T13:33:32.927+0100 [conn3431] end connection 172.28.0.163:57249 (261 connections now open) 2015-10-05T13:33:32.923+0100 [conn3331] end connection 172.28.0.163:57144 (331 connections now open) 2015-10-05T13:33:32.932+0100 [conn3488] end connection 172.28.0.163:57365 (171 connections now open) 2015-10-05T13:33:32.932+0100 [conn3490] end connection 172.28.0.163:57368 (168 connections now open) 2015-10-05T13:33:32.921+0100 [conn3258] end connection 172.28.0.163:57071 (383 connections now open) 2015-10-05T13:33:32.933+0100 [conn3491] end connection 172.28.0.163:57370 (166 connections now open) 2015-10-05T13:33:32.928+0100 [conn3443] end connection 172.28.0.163:57270 (253 connections now open) 2015-10-05T13:33:32.928+0100 [conn3439] end connection 172.28.0.163:57263 (253 connections now open) 2015-10-05T13:33:32.924+0100 [conn3347] end connection 172.28.0.163:57160 (324 connections now open) 2015-10-05T13:33:32.928+0100 [conn3441] end connection 172.28.0.163:57265 (251 connections now open) 2015-10-05T13:33:32.928+0100 [conn3448] end connection 172.28.0.163:57278 (250 connections now open) 2015-10-05T13:33:32.928+0100 [conn3440] end connection 172.28.0.163:57264 (249 connections now open) 2015-10-05T13:33:32.928+0100 [conn3450] end connection 172.28.0.163:57281 (248 connections now open) 2015-10-05T13:33:32.928+0100 [conn3444] end connection 172.28.0.163:57272 (246 connections now open) 2015-10-05T13:33:32.928+0100 [conn3442] end connection 172.28.0.163:57269 (241 connections now open) 2015-10-05T13:33:32.924+0100 [conn3361] end connection 172.28.0.163:57174 (313 connections now open) 2015-10-05T13:33:32.929+0100 [conn3452] end connection 172.28.0.163:57284 (234 connections now open) 2015-10-05T13:33:32.933+0100 [conn3493] end connection 172.28.0.163:57378 (154 connections now open) 2015-10-05T13:33:32.925+0100 [conn3365] end connection 172.28.0.163:57178 (309 connections now open) 2015-10-05T13:33:32.929+0100 [conn3454] end connection 172.28.0.163:57286 (232 connections now open) 2015-10-05T13:33:32.933+0100 [conn3487] end connection 172.28.0.163:57366 (151 connections now open) 2015-10-05T13:33:32.929+0100 [conn3455] end connection 172.28.0.163:57287 (229 connections now open) 2015-10-05T13:33:32.929+0100 [conn3458] end connection 172.28.0.163:57293 (227 connections now open) 2015-10-05T13:33:32.933+0100 [conn3497] end connection 172.28.0.163:57384 (149 connections now open) 2015-10-05T13:33:32.934+0100 [conn3500] end connection 172.28.0.163:57392 (147 connections now open) 2015-10-05T13:33:32.934+0100 [conn3499] end connection 172.28.0.163:57391 (146 connections now open) 2015-10-05T13:33:32.929+0100 [conn3459] end connection 172.28.0.163:57294 (225 connections now open) 2015-10-05T13:33:32.929+0100 [conn3463] end connection 172.28.0.163:57305 (224 connections now open) 2015-10-05T13:33:32.929+0100 [conn3461] end connection 172.28.0.163:57299 (223 connections now open) 2015-10-05T13:33:32.925+0100 [conn3384] end connection 172.28.0.163:57197 (296 connections now open) 2015-10-05T13:33:32.930+0100 [conn3460] end connection 172.28.0.163:57297 (215 connections now open) 2015-10-05T13:33:32.930+0100 [conn3472] end connection 172.28.0.163:57326 (214 connections now open) 2015-10-05T13:33:32.930+0100 [conn3466] end connection 172.28.0.163:57306 (213 connections now open) 2015-10-05T13:33:32.930+0100 [conn3473] end connection 172.28.0.163:57327 (211 connections now open) 2015-10-05T13:33:32.930+0100 [conn3468] end connection 172.28.0.163:57319 (209 connections now open) 2015-10-05T13:33:32.930+0100 [conn3464] end connection 172.28.0.163:57309 (207 connections now open) 2015-10-05T13:33:32.922+0100 [conn3291] end connection 172.28.0.163:57104 (353 connections now open) 2015-10-05T13:33:32.930+0100 [conn3467] end connection 172.28.0.163:57315 (204 connections now open) 2015-10-05T13:33:32.926+0100 [conn3417] end connection 172.28.0.163:57230 (287 connections now open) 2015-10-05T13:33:32.926+0100 [conn3421] end connection 172.28.0.163:57234 (285 connections now open) 2015-10-05T13:33:32.926+0100 [conn3400] end connection 172.28.0.163:57213 (284 connections now open) 2015-10-05T13:33:32.931+0100 [conn3474] end connection 172.28.0.163:57329 (197 connections now open) 2015-10-05T13:33:32.931+0100 [conn3476] end connection 172.28.0.163:57332 (196 connections now open) 2015-10-05T13:33:32.931+0100 [conn3477] end connection 172.28.0.163:57334 (194 connections now open) 2015-10-05T13:33:32.931+0100 [conn3479] end connection 172.28.0.163:57346 (190 connections now open) 2015-10-05T13:33:32.931+0100 [conn3483] end connection 172.28.0.163:57351 (189 connections now open) 2015-10-05T13:33:32.931+0100 [conn3481] end connection 172.28.0.163:57349 (183 connections now open) 2015-10-05T13:33:32.932+0100 [conn3482] end connection 172.28.0.163:57353 (181 connections now open) 2015-10-05T13:33:32.932+0100 [conn3484] end connection 172.28.0.163:57355 (175 connections now open) 2015-10-05T13:33:32.932+0100 [conn3486] end connection 172.28.0.163:57362 (173 connections now open) 2015-10-05T13:33:32.932+0100 [conn3489] end connection 172.28.0.163:57369 (172 connections now open) 2015-10-05T13:33:32.924+0100 [conn3339] end connection 172.28.0.163:57152 (330 connections now open) 2015-10-05T13:33:32.927+0100 [conn3436] end connection 172.28.0.163:57256 (257 connections now open) 2015-10-05T13:33:32.924+0100 [conn3343] end connection 172.28.0.163:57156 (328 connections now open) 2015-10-05T13:33:32.933+0100 [conn3492] end connection 172.28.0.163:57371 (162 connections now open) 2015-10-05T13:33:32.933+0100 [conn3495] end connection 172.28.0.163:57380 (158 connections now open) 2015-10-05T13:33:32.933+0100 [conn3496] end connection 172.28.0.163:57382 (157 connections now open) 2015-10-05T13:33:32.933+0100 [conn3501] end connection 172.28.0.163:57408 (157 connections now open) 2015-10-05T13:33:32.933+0100 [conn3494] end connection 172.28.0.163:57379 (153 connections now open) 2015-10-05T13:33:32.925+0100 [conn3369] end connection 172.28.0.163:57182 (308 connections now open) 2015-10-05T13:33:32.929+0100 [conn3456] end connection 172.28.0.163:57291 (227 connections now open) 2015-10-05T13:33:32.929+0100 [conn3457] end connection 172.28.0.163:57292 (227 connections now open) 2015-10-05T13:33:32.934+0100 [conn3498] end connection 172.28.0.163:57387 (144 connections now open) 2015-10-05T13:33:33.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e1c12deab02e299887c 2015-10-05T13:33:33.358+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:39.275+0100 [mongosMain] connection accepted from 127.0.0.1:58147 #3672 (109 connections now open) 2015-10-05T13:33:39.277+0100 [conn3672] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:39.278+0100 [conn3672] end connection 127.0.0.1:58147 (108 connections now open) 2015-10-05T13:33:39.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e2312deab02e299887d 2015-10-05T13:33:39.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:45.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e2912deab02e299887e 2015-10-05T13:33:45.998+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:52.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e3012deab02e299887f 2015-10-05T13:33:52.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:33:55.610+0100 [conn2425] end connection 172.28.0.164:57202 (107 connections now open) 2015-10-05T13:33:55.611+0100 [mongosMain] connection accepted from 172.28.0.164:60880 #3673 (108 connections now open) 2015-10-05T13:33:55.613+0100 [conn3673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:33:58.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e3612deab02e2998880 2015-10-05T13:33:59.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:01.039+0100 [conn3534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:01.039+0100 [conn3535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:03.132+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:34:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:34:05.286+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e3d12deab02e2998881 2015-10-05T13:34:05.570+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:11.885+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e4312deab02e2998882 2015-10-05T13:34:12.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:14.004+0100 [conn2722] end connection 172.28.0.163:55975 (107 connections now open) 2015-10-05T13:34:14.005+0100 [mongosMain] connection accepted from 172.28.0.163:58182 #3674 (108 connections now open) 2015-10-05T13:34:14.007+0100 [conn3674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:18.172+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e4a12deab02e2998883 2015-10-05T13:34:18.240+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:24.523+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e5012deab02e2998885 2015-10-05T13:34:24.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:28.191+0100 [mongosMain] connection accepted from 127.0.0.1:58188 #3675 (109 connections now open) 2015-10-05T13:34:28.194+0100 [conn3675] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:28.195+0100 [conn3675] end connection 127.0.0.1:58188 (108 connections now open) 2015-10-05T13:34:30.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e5612deab02e2998886 2015-10-05T13:34:31.080+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:33.403+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:34:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:34:34.165+0100 [conn3543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:34.165+0100 [conn3542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:35.092+0100 [mongosMain] connection accepted from 172.28.0.163:58190 #3676 (109 connections now open) 2015-10-05T13:34:35.117+0100 [conn3676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.091+0100 [mongosMain] connection accepted from 172.28.0.163:58191 #3677 (110 connections now open) 2015-10-05T13:34:36.264+0100 [mongosMain] connection accepted from 172.28.0.163:58193 #3678 (111 connections now open) 2015-10-05T13:34:36.265+0100 [mongosMain] connection accepted from 172.28.0.163:58194 #3679 (112 connections now open) 2015-10-05T13:34:36.266+0100 [mongosMain] connection accepted from 172.28.0.163:58195 #3680 (113 connections now open) 2015-10-05T13:34:36.266+0100 [conn3678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.266+0100 [mongosMain] connection accepted from 172.28.0.163:58196 #3681 (114 connections now open) 2015-10-05T13:34:36.267+0100 [conn3679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.267+0100 [mongosMain] connection accepted from 172.28.0.163:58197 #3682 (115 connections now open) 2015-10-05T13:34:36.267+0100 [conn3680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.268+0100 [mongosMain] connection accepted from 172.28.0.163:58198 #3683 (116 connections now open) 2015-10-05T13:34:36.269+0100 [mongosMain] connection accepted from 172.28.0.163:58199 #3684 (117 connections now open) 2015-10-05T13:34:36.269+0100 [mongosMain] connection accepted from 172.28.0.163:58200 #3685 (118 connections now open) 2015-10-05T13:34:36.269+0100 [conn3683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.269+0100 [mongosMain] connection accepted from 172.28.0.163:58201 #3686 (119 connections now open) 2015-10-05T13:34:36.270+0100 [conn3684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.270+0100 [conn3685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.271+0100 [conn3686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.271+0100 [mongosMain] connection accepted from 172.28.0.163:58202 #3687 (120 connections now open) 2015-10-05T13:34:36.271+0100 [mongosMain] connection accepted from 172.28.0.163:58203 #3688 (121 connections now open) 2015-10-05T13:34:36.272+0100 [mongosMain] connection accepted from 172.28.0.163:58204 #3689 (122 connections now open) 2015-10-05T13:34:36.273+0100 [mongosMain] connection accepted from 172.28.0.163:58205 #3690 (123 connections now open) 2015-10-05T13:34:36.273+0100 [conn3687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.273+0100 [mongosMain] connection accepted from 172.28.0.163:58206 #3691 (124 connections now open) 2015-10-05T13:34:36.273+0100 [conn3688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.273+0100 [conn3689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.274+0100 [mongosMain] connection accepted from 172.28.0.163:58207 #3692 (125 connections now open) 2015-10-05T13:34:36.275+0100 [conn3691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.275+0100 [conn3690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.276+0100 [conn3692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.276+0100 [mongosMain] connection accepted from 172.28.0.163:58208 #3693 (126 connections now open) 2015-10-05T13:34:36.277+0100 [mongosMain] connection accepted from 172.28.0.163:58209 #3694 (127 connections now open) 2015-10-05T13:34:36.277+0100 [mongosMain] connection accepted from 172.28.0.163:58210 #3695 (128 connections now open) 2015-10-05T13:34:36.278+0100 [conn3693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.279+0100 [conn3695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.279+0100 [conn3694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.279+0100 [mongosMain] connection accepted from 172.28.0.163:58211 #3696 (129 connections now open) 2015-10-05T13:34:36.280+0100 [mongosMain] connection accepted from 172.28.0.163:58212 #3697 (130 connections now open) 2015-10-05T13:34:36.280+0100 [mongosMain] connection accepted from 172.28.0.163:58213 #3698 (131 connections now open) 2015-10-05T13:34:36.280+0100 [mongosMain] connection accepted from 172.28.0.163:58214 #3699 (132 connections now open) 2015-10-05T13:34:36.282+0100 [conn3697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.282+0100 [conn3699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.283+0100 [conn3698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.284+0100 [mongosMain] connection accepted from 172.28.0.163:58215 #3700 (133 connections now open) 2015-10-05T13:34:36.294+0100 [mongosMain] connection accepted from 172.28.0.163:58216 #3701 (134 connections now open) 2015-10-05T13:34:36.294+0100 [mongosMain] connection accepted from 172.28.0.163:58217 #3702 (135 connections now open) 2015-10-05T13:34:36.294+0100 [mongosMain] connection accepted from 172.28.0.163:58218 #3703 (136 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58219 #3704 (137 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58220 #3705 (138 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58221 #3706 (139 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58222 #3707 (140 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58223 #3708 (141 connections now open) 2015-10-05T13:34:36.295+0100 [mongosMain] connection accepted from 172.28.0.163:58224 #3709 (142 connections now open) 2015-10-05T13:34:36.296+0100 [mongosMain] connection accepted from 172.28.0.163:58225 #3710 (143 connections now open) 2015-10-05T13:34:36.296+0100 [mongosMain] connection accepted from 172.28.0.163:58226 #3711 (144 connections now open) 2015-10-05T13:34:36.296+0100 [mongosMain] connection accepted from 172.28.0.163:58227 #3712 (145 connections now open) 2015-10-05T13:34:36.296+0100 [mongosMain] connection accepted from 172.28.0.163:58228 #3713 (146 connections now open) 2015-10-05T13:34:36.296+0100 [mongosMain] connection accepted from 172.28.0.163:58229 #3714 (147 connections now open) 2015-10-05T13:34:36.297+0100 [mongosMain] connection accepted from 172.28.0.163:58230 #3715 (148 connections now open) 2015-10-05T13:34:36.297+0100 [mongosMain] connection accepted from 172.28.0.163:58231 #3716 (149 connections now open) 2015-10-05T13:34:36.297+0100 [mongosMain] connection accepted from 172.28.0.163:58232 #3717 (150 connections now open) 2015-10-05T13:34:36.297+0100 [conn3701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.297+0100 [mongosMain] connection accepted from 172.28.0.163:58233 #3718 (151 connections now open) 2015-10-05T13:34:36.297+0100 [conn3705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.297+0100 [conn3709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.297+0100 [conn3711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.297+0100 [mongosMain] connection accepted from 172.28.0.163:58234 #3719 (152 connections now open) 2015-10-05T13:34:36.298+0100 [mongosMain] connection accepted from 172.28.0.163:58235 #3720 (153 connections now open) 2015-10-05T13:34:36.298+0100 [conn3700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.298+0100 [mongosMain] connection accepted from 172.28.0.163:58236 #3721 (154 connections now open) 2015-10-05T13:34:36.298+0100 [mongosMain] connection accepted from 172.28.0.163:58237 #3722 (155 connections now open) 2015-10-05T13:34:36.298+0100 [mongosMain] connection accepted from 172.28.0.163:58239 #3723 (156 connections now open) 2015-10-05T13:34:36.299+0100 [mongosMain] connection accepted from 172.28.0.163:58238 #3724 (157 connections now open) 2015-10-05T13:34:36.299+0100 [mongosMain] connection accepted from 172.28.0.163:58240 #3725 (158 connections now open) 2015-10-05T13:34:36.300+0100 [mongosMain] connection accepted from 172.28.0.163:58241 #3726 (159 connections now open) 2015-10-05T13:34:36.301+0100 [conn3713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.301+0100 [mongosMain] connection accepted from 172.28.0.163:58242 #3727 (160 connections now open) 2015-10-05T13:34:36.301+0100 [conn3719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.302+0100 [conn3717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.303+0100 [conn3706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.303+0100 [conn3712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.303+0100 [conn3718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.303+0100 [conn3724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.303+0100 [conn3704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.304+0100 [conn3723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.304+0100 [conn3716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.304+0100 [conn3725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.304+0100 [conn3722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.309+0100 [conn3721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.311+0100 [conn3727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.312+0100 [conn3714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.312+0100 [conn3708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.312+0100 [conn3720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.312+0100 [conn3726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.313+0100 [mongosMain] connection accepted from 172.28.0.163:58243 #3728 (161 connections now open) 2015-10-05T13:34:36.315+0100 [mongosMain] connection accepted from 172.28.0.163:58244 #3729 (162 connections now open) 2015-10-05T13:34:36.317+0100 [mongosMain] connection accepted from 172.28.0.163:58245 #3730 (163 connections now open) 2015-10-05T13:34:36.317+0100 [mongosMain] connection accepted from 172.28.0.163:58246 #3731 (164 connections now open) 2015-10-05T13:34:36.318+0100 [mongosMain] connection accepted from 172.28.0.163:58247 #3732 (165 connections now open) 2015-10-05T13:34:36.318+0100 [mongosMain] connection accepted from 172.28.0.163:58248 #3733 (166 connections now open) 2015-10-05T13:34:36.318+0100 [mongosMain] connection accepted from 172.28.0.163:58249 #3734 (167 connections now open) 2015-10-05T13:34:36.319+0100 [mongosMain] connection accepted from 172.28.0.163:58251 #3735 (168 connections now open) 2015-10-05T13:34:36.319+0100 [mongosMain] connection accepted from 172.28.0.163:58252 #3736 (169 connections now open) 2015-10-05T13:34:36.319+0100 [mongosMain] connection accepted from 172.28.0.163:58253 #3737 (170 connections now open) 2015-10-05T13:34:36.319+0100 [mongosMain] connection accepted from 172.28.0.163:58254 #3738 (171 connections now open) 2015-10-05T13:34:36.319+0100 [mongosMain] connection accepted from 172.28.0.163:58250 #3739 (172 connections now open) 2015-10-05T13:34:36.320+0100 [mongosMain] connection accepted from 172.28.0.163:58255 #3740 (173 connections now open) 2015-10-05T13:34:36.320+0100 [mongosMain] connection accepted from 172.28.0.163:58256 #3741 (174 connections now open) 2015-10-05T13:34:36.320+0100 [mongosMain] connection accepted from 172.28.0.163:58257 #3742 (175 connections now open) 2015-10-05T13:34:36.320+0100 [mongosMain] connection accepted from 172.28.0.163:58258 #3743 (176 connections now open) 2015-10-05T13:34:36.320+0100 [mongosMain] connection accepted from 172.28.0.163:58259 #3744 (177 connections now open) 2015-10-05T13:34:36.321+0100 [mongosMain] connection accepted from 172.28.0.163:58260 #3745 (178 connections now open) 2015-10-05T13:34:36.321+0100 [mongosMain] connection accepted from 172.28.0.163:58261 #3746 (179 connections now open) 2015-10-05T13:34:36.321+0100 [mongosMain] connection accepted from 172.28.0.163:58262 #3747 (180 connections now open) 2015-10-05T13:34:36.321+0100 [mongosMain] connection accepted from 172.28.0.163:58263 #3748 (181 connections now open) 2015-10-05T13:34:36.321+0100 [mongosMain] connection accepted from 172.28.0.163:58264 #3749 (182 connections now open) 2015-10-05T13:34:36.322+0100 [mongosMain] connection accepted from 172.28.0.163:58265 #3750 (183 connections now open) 2015-10-05T13:34:36.322+0100 [conn3729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.322+0100 [mongosMain] connection accepted from 172.28.0.163:58266 #3751 (184 connections now open) 2015-10-05T13:34:36.322+0100 [mongosMain] connection accepted from 172.28.0.163:58267 #3752 (185 connections now open) 2015-10-05T13:34:36.322+0100 [mongosMain] connection accepted from 172.28.0.163:58268 #3753 (186 connections now open) 2015-10-05T13:34:36.322+0100 [mongosMain] connection accepted from 172.28.0.163:58269 #3754 (187 connections now open) 2015-10-05T13:34:36.323+0100 [mongosMain] connection accepted from 172.28.0.163:58270 #3755 (188 connections now open) 2015-10-05T13:34:36.323+0100 [mongosMain] connection accepted from 172.28.0.163:58271 #3756 (189 connections now open) 2015-10-05T13:34:36.323+0100 [mongosMain] connection accepted from 172.28.0.163:58272 #3757 (190 connections now open) 2015-10-05T13:34:36.323+0100 [mongosMain] connection accepted from 172.28.0.163:58273 #3758 (191 connections now open) 2015-10-05T13:34:36.323+0100 [conn3735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.323+0100 [conn3734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.323+0100 [mongosMain] connection accepted from 172.28.0.163:58274 #3759 (192 connections now open) 2015-10-05T13:34:36.324+0100 [mongosMain] connection accepted from 172.28.0.163:58275 #3760 (193 connections now open) 2015-10-05T13:34:36.324+0100 [mongosMain] connection accepted from 172.28.0.163:58276 #3761 (194 connections now open) 2015-10-05T13:34:36.324+0100 [mongosMain] connection accepted from 172.28.0.163:58277 #3762 (195 connections now open) 2015-10-05T13:34:36.324+0100 [mongosMain] connection accepted from 172.28.0.163:58278 #3763 (196 connections now open) 2015-10-05T13:34:36.324+0100 [mongosMain] connection accepted from 172.28.0.163:58279 #3764 (197 connections now open) 2015-10-05T13:34:36.325+0100 [mongosMain] connection accepted from 172.28.0.163:58280 #3765 (198 connections now open) 2015-10-05T13:34:36.326+0100 [conn3751] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.326+0100 [conn3747] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.326+0100 [conn3746] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.326+0100 [conn3752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.327+0100 [conn3745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.327+0100 [conn3758] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.327+0100 [conn3757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.327+0100 [mongosMain] connection accepted from 172.28.0.163:58281 #3766 (199 connections now open) 2015-10-05T13:34:36.328+0100 [conn3733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.328+0100 [conn3764] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.332+0100 [mongosMain] connection accepted from 172.28.0.163:58282 #3767 (200 connections now open) 2015-10-05T13:34:36.340+0100 [conn3753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.342+0100 [conn3730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.342+0100 [conn3736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.342+0100 [conn3742] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.342+0100 [conn3748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.343+0100 [conn3754] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.343+0100 [conn3760] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.343+0100 [conn3732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.347+0100 [conn3759] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.347+0100 [mongosMain] connection accepted from 172.28.0.163:58283 #3768 (201 connections now open) 2015-10-05T13:34:36.347+0100 [mongosMain] connection accepted from 172.28.0.163:58284 #3769 (202 connections now open) 2015-10-05T13:34:36.347+0100 [mongosMain] connection accepted from 172.28.0.163:58286 #3770 (203 connections now open) 2015-10-05T13:34:36.347+0100 [mongosMain] connection accepted from 172.28.0.163:58285 #3771 (204 connections now open) 2015-10-05T13:34:36.348+0100 [mongosMain] connection accepted from 172.28.0.163:58287 #3772 (205 connections now open) 2015-10-05T13:34:36.348+0100 [mongosMain] connection accepted from 172.28.0.163:58288 #3773 (206 connections now open) 2015-10-05T13:34:36.348+0100 [mongosMain] connection accepted from 172.28.0.163:58289 #3774 (207 connections now open) 2015-10-05T13:34:36.348+0100 [mongosMain] connection accepted from 172.28.0.163:58290 #3775 (208 connections now open) 2015-10-05T13:34:36.349+0100 [mongosMain] connection accepted from 172.28.0.163:58291 #3776 (209 connections now open) 2015-10-05T13:34:36.351+0100 [mongosMain] connection accepted from 172.28.0.163:58292 #3777 (210 connections now open) 2015-10-05T13:34:36.352+0100 [conn3738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.352+0100 [mongosMain] connection accepted from 172.28.0.163:58293 #3778 (211 connections now open) 2015-10-05T13:34:36.352+0100 [conn3731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.352+0100 [conn3763] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.353+0100 [conn3749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.353+0100 [conn3743] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.354+0100 [conn3737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.355+0100 [conn3744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.355+0100 [conn3756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.355+0100 [conn3762] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.355+0100 [conn3755] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.358+0100 [conn3770] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.358+0100 [conn3775] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.359+0100 [conn3776] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.359+0100 [conn3769] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.359+0100 [conn3761] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.359+0100 [conn3765] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.360+0100 [conn3771] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.360+0100 [conn3777] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.361+0100 [conn3750] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.361+0100 [conn3772] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.361+0100 [conn3768] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.363+0100 [conn3739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.363+0100 [mongosMain] connection accepted from 172.28.0.163:58294 #3779 (212 connections now open) 2015-10-05T13:34:36.364+0100 [mongosMain] connection accepted from 172.28.0.163:58295 #3780 (213 connections now open) 2015-10-05T13:34:36.366+0100 [mongosMain] connection accepted from 172.28.0.163:58296 #3781 (214 connections now open) 2015-10-05T13:34:36.366+0100 [mongosMain] connection accepted from 172.28.0.163:58297 #3782 (215 connections now open) 2015-10-05T13:34:36.366+0100 [mongosMain] connection accepted from 172.28.0.163:58298 #3783 (216 connections now open) 2015-10-05T13:34:36.367+0100 [conn3682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.367+0100 [conn3681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.367+0100 [conn3728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.368+0100 [conn3702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.369+0100 [conn3741] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.369+0100 [conn3740] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.370+0100 [conn3703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.371+0100 [conn3767] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.371+0100 [conn3677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.376+0100 [conn3766] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.377+0100 [conn3715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.381+0100 [conn3780] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.382+0100 [conn3710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.390+0100 [mongosMain] connection accepted from 172.28.0.163:58299 #3784 (217 connections now open) 2015-10-05T13:34:36.390+0100 [mongosMain] connection accepted from 172.28.0.163:58300 #3785 (218 connections now open) 2015-10-05T13:34:36.391+0100 [mongosMain] connection accepted from 172.28.0.163:58301 #3786 (219 connections now open) 2015-10-05T13:34:36.398+0100 [mongosMain] connection accepted from 172.28.0.163:58303 #3787 (220 connections now open) 2015-10-05T13:34:36.402+0100 [mongosMain] connection accepted from 172.28.0.163:58304 #3788 (221 connections now open) 2015-10-05T13:34:36.403+0100 [mongosMain] connection accepted from 172.28.0.163:58305 #3789 (222 connections now open) 2015-10-05T13:34:36.426+0100 [conn3696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.426+0100 [conn3781] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.427+0100 [conn3784] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.427+0100 [conn3789] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.428+0100 [conn3786] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.429+0100 [conn3707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.430+0100 [conn3788] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.431+0100 [conn3773] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.431+0100 [conn3787] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.432+0100 [conn3779] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.432+0100 [conn3785] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.435+0100 [conn3774] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.452+0100 [conn3778] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.489+0100 [mongosMain] connection accepted from 172.28.0.163:58306 #3790 (223 connections now open) 2015-10-05T13:34:36.489+0100 [mongosMain] connection accepted from 172.28.0.163:58308 #3791 (224 connections now open) 2015-10-05T13:34:36.490+0100 [mongosMain] connection accepted from 172.28.0.163:58307 #3792 (225 connections now open) 2015-10-05T13:34:36.490+0100 [mongosMain] connection accepted from 172.28.0.163:58310 #3793 (226 connections now open) 2015-10-05T13:34:36.491+0100 [mongosMain] connection accepted from 172.28.0.163:58311 #3794 (227 connections now open) 2015-10-05T13:34:36.491+0100 [mongosMain] connection accepted from 172.28.0.163:58309 #3795 (228 connections now open) 2015-10-05T13:34:36.492+0100 [mongosMain] connection accepted from 172.28.0.163:58312 #3796 (229 connections now open) 2015-10-05T13:34:36.492+0100 [mongosMain] connection accepted from 172.28.0.163:58313 #3797 (230 connections now open) 2015-10-05T13:34:36.492+0100 [mongosMain] connection accepted from 172.28.0.163:58314 #3798 (231 connections now open) 2015-10-05T13:34:36.492+0100 [mongosMain] connection accepted from 172.28.0.163:58315 #3799 (232 connections now open) 2015-10-05T13:34:36.500+0100 [mongosMain] connection accepted from 172.28.0.163:58316 #3800 (233 connections now open) 2015-10-05T13:34:36.501+0100 [mongosMain] connection accepted from 172.28.0.163:58317 #3801 (234 connections now open) 2015-10-05T13:34:36.506+0100 [mongosMain] connection accepted from 172.28.0.163:58318 #3802 (235 connections now open) 2015-10-05T13:34:36.527+0100 [conn3796] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.527+0100 [conn3791] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.527+0100 [conn3802] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.529+0100 [conn3797] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.529+0100 [conn3782] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.531+0100 [conn3801] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.532+0100 [conn3790] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.533+0100 [conn3794] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.534+0100 [conn3799] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.535+0100 [conn3783] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.536+0100 [conn3792] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.549+0100 [conn3798] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.552+0100 [conn3800] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.554+0100 [mongosMain] connection accepted from 172.28.0.163:58319 #3803 (236 connections now open) 2015-10-05T13:34:36.555+0100 [mongosMain] connection accepted from 172.28.0.163:58320 #3804 (237 connections now open) 2015-10-05T13:34:36.558+0100 [mongosMain] connection accepted from 172.28.0.163:58321 #3805 (238 connections now open) 2015-10-05T13:34:36.559+0100 [mongosMain] connection accepted from 172.28.0.163:58322 #3806 (239 connections now open) 2015-10-05T13:34:36.563+0100 [mongosMain] connection accepted from 172.28.0.163:58323 #3807 (240 connections now open) 2015-10-05T13:34:36.564+0100 [mongosMain] connection accepted from 172.28.0.163:58325 #3808 (241 connections now open) 2015-10-05T13:34:36.565+0100 [mongosMain] connection accepted from 172.28.0.163:58324 #3809 (242 connections now open) 2015-10-05T13:34:36.565+0100 [mongosMain] connection accepted from 172.28.0.163:58326 #3810 (243 connections now open) 2015-10-05T13:34:36.566+0100 [mongosMain] connection accepted from 172.28.0.163:58327 #3811 (244 connections now open) 2015-10-05T13:34:36.567+0100 [mongosMain] connection accepted from 172.28.0.163:58328 #3812 (245 connections now open) 2015-10-05T13:34:36.567+0100 [mongosMain] connection accepted from 172.28.0.163:58329 #3813 (246 connections now open) 2015-10-05T13:34:36.568+0100 [mongosMain] connection accepted from 172.28.0.163:58330 #3814 (247 connections now open) 2015-10-05T13:34:36.568+0100 [mongosMain] connection accepted from 172.28.0.163:58331 #3815 (248 connections now open) 2015-10-05T13:34:36.569+0100 [mongosMain] connection accepted from 172.28.0.163:58332 #3816 (249 connections now open) 2015-10-05T13:34:36.570+0100 [mongosMain] connection accepted from 172.28.0.163:58333 #3817 (250 connections now open) 2015-10-05T13:34:36.570+0100 [mongosMain] connection accepted from 172.28.0.163:58334 #3818 (251 connections now open) 2015-10-05T13:34:36.572+0100 [mongosMain] connection accepted from 172.28.0.163:58335 #3819 (252 connections now open) 2015-10-05T13:34:36.575+0100 [conn3795] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.575+0100 [conn3806] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.576+0100 [conn3803] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.577+0100 [mongosMain] connection accepted from 172.28.0.163:58336 #3820 (253 connections now open) 2015-10-05T13:34:36.580+0100 [conn3804] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.581+0100 [conn3809] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.582+0100 [conn3805] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.587+0100 [conn3811] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.587+0100 [conn3816] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.589+0100 [conn3812] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.590+0100 [conn3817] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.592+0100 [conn3808] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.592+0100 [conn3814] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.592+0100 [conn3818] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.604+0100 [conn3793] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.615+0100 [mongosMain] connection accepted from 172.28.0.163:58337 #3821 (254 connections now open) 2015-10-05T13:34:36.615+0100 [mongosMain] connection accepted from 172.28.0.163:58338 #3822 (255 connections now open) 2015-10-05T13:34:36.617+0100 [conn3807] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.617+0100 [conn3810] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.625+0100 [conn3819] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.627+0100 [conn3822] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.627+0100 [conn3821] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.846+0100 [conn3815] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.847+0100 [conn3813] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.853+0100 [mongosMain] connection accepted from 172.28.0.163:58395 #3823 (256 connections now open) 2015-10-05T13:34:36.855+0100 [conn3820] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.860+0100 [mongosMain] connection accepted from 172.28.0.163:58381 #3824 (257 connections now open) 2015-10-05T13:34:36.867+0100 [mongosMain] connection accepted from 172.28.0.163:58377 #3825 (258 connections now open) 2015-10-05T13:34:36.875+0100 [mongosMain] connection accepted from 172.28.0.163:58385 #3826 (259 connections now open) 2015-10-05T13:34:36.877+0100 [conn3823] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.877+0100 [mongosMain] connection accepted from 172.28.0.163:58391 #3827 (260 connections now open) 2015-10-05T13:34:36.877+0100 [mongosMain] connection accepted from 172.28.0.163:58392 #3828 (261 connections now open) 2015-10-05T13:34:36.882+0100 [conn3824] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.884+0100 [mongosMain] connection accepted from 172.28.0.163:58379 #3829 (262 connections now open) 2015-10-05T13:34:36.888+0100 [mongosMain] connection accepted from 172.28.0.163:58369 #3830 (263 connections now open) 2015-10-05T13:34:36.888+0100 [conn3825] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.895+0100 [conn3828] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.967+0100 [conn3826] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.968+0100 [conn3830] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:36.988+0100 [conn3829] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:37.065+0100 [conn3827] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:37.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e5d12deab02e29988e4 2015-10-05T13:34:37.499+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:39.831+0100 [mongosMain] connection accepted from 127.0.0.1:58568 #3831 (264 connections now open) 2015-10-05T13:34:39.834+0100 [conn3831] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:39.834+0100 [conn3831] end connection 127.0.0.1:58568 (263 connections now open) 2015-10-05T13:34:43.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e6312deab02e29989bd 2015-10-05T13:34:43.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:50.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e6912deab02e29989be 2015-10-05T13:34:50.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:34:55.625+0100 [conn2422] end connection 172.28.0.164:57199 (262 connections now open) 2015-10-05T13:34:55.626+0100 [mongosMain] connection accepted from 172.28.0.164:60929 #3832 (263 connections now open) 2015-10-05T13:34:55.629+0100 [conn3832] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:34:56.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e7012deab02e29989bf 2015-10-05T13:34:56.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:02.992+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e7612deab02e29989c0 2015-10-05T13:35:03.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:03.675+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:35:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:35:09.279+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e7d12deab02e29989c1 2015-10-05T13:35:09.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:14.020+0100 [conn2723] end connection 172.28.0.163:55977 (262 connections now open) 2015-10-05T13:35:14.021+0100 [mongosMain] connection accepted from 172.28.0.163:58606 #3833 (263 connections now open) 2015-10-05T13:35:14.023+0100 [conn3833] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:35:15.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e8312deab02e29989c2 2015-10-05T13:35:15.768+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:22.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e8912deab02e29989c3 2015-10-05T13:35:22.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:28.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e9012deab02e29989c4 2015-10-05T13:35:28.618+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:28.950+0100 [mongosMain] connection accepted from 127.0.0.1:58612 #3834 (264 connections now open) 2015-10-05T13:35:28.953+0100 [conn3834] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:35:28.954+0100 [conn3834] end connection 127.0.0.1:58612 (263 connections now open) 2015-10-05T13:35:33.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:35:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:35:34.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e9612deab02e29989c5 2015-10-05T13:35:35.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:35.301+0100 [conn3542] end connection 172.28.0.163:57972 (262 connections now open) 2015-10-05T13:35:35.301+0100 [conn3543] end connection 172.28.0.163:57973 (261 connections now open) 2015-10-05T13:35:35.302+0100 [conn3676] end connection 172.28.0.163:58190 (260 connections now open) 2015-10-05T13:35:35.302+0100 [conn3677] end connection 172.28.0.163:58191 (259 connections now open) 2015-10-05T13:35:35.303+0100 [conn3678] end connection 172.28.0.163:58193 (259 connections now open) 2015-10-05T13:35:35.303+0100 [conn3680] end connection 172.28.0.163:58195 (259 connections now open) 2015-10-05T13:35:35.303+0100 [conn3681] end connection 172.28.0.163:58196 (257 connections now open) 2015-10-05T13:35:35.303+0100 [conn3688] end connection 172.28.0.163:58203 (255 connections now open) 2015-10-05T13:35:35.303+0100 [conn3685] end connection 172.28.0.163:58200 (255 connections now open) 2015-10-05T13:35:35.303+0100 [conn3687] end connection 172.28.0.163:58202 (254 connections now open) 2015-10-05T13:35:35.303+0100 [conn3694] end connection 172.28.0.163:58209 (254 connections now open) 2015-10-05T13:35:35.303+0100 [conn3690] end connection 172.28.0.163:58205 (253 connections now open) 2015-10-05T13:35:35.303+0100 [conn3700] end connection 172.28.0.163:58215 (252 connections now open) 2015-10-05T13:35:35.303+0100 [conn3692] end connection 172.28.0.163:58207 (251 connections now open) 2015-10-05T13:35:35.303+0100 [conn3695] end connection 172.28.0.163:58210 (250 connections now open) 2015-10-05T13:35:35.303+0100 [conn3696] end connection 172.28.0.163:58211 (249 connections now open) 2015-10-05T13:35:35.303+0100 [conn3699] end connection 172.28.0.163:58214 (248 connections now open) 2015-10-05T13:35:35.303+0100 [conn3701] end connection 172.28.0.163:58216 (247 connections now open) 2015-10-05T13:35:35.303+0100 [conn3712] end connection 172.28.0.163:58227 (246 connections now open) 2015-10-05T13:35:35.303+0100 [conn3703] end connection 172.28.0.163:58218 (246 connections now open) 2015-10-05T13:35:35.304+0100 [conn3718] end connection 172.28.0.163:58233 (244 connections now open) 2015-10-05T13:35:35.303+0100 [conn3679] end connection 172.28.0.163:58194 (259 connections now open) 2015-10-05T13:35:35.304+0100 [conn3728] end connection 172.28.0.163:58243 (242 connections now open) 2015-10-05T13:35:35.304+0100 [conn3715] end connection 172.28.0.163:58230 (241 connections now open) 2015-10-05T13:35:35.304+0100 [conn3717] end connection 172.28.0.163:58232 (239 connections now open) 2015-10-05T13:35:35.304+0100 [conn3772] end connection 172.28.0.163:58287 (238 connections now open) 2015-10-05T13:35:35.304+0100 [conn3709] end connection 172.28.0.163:58224 (237 connections now open) 2015-10-05T13:35:35.304+0100 [conn3711] end connection 172.28.0.163:58226 (237 connections now open) 2015-10-05T13:35:35.304+0100 [conn3734] end connection 172.28.0.163:58249 (235 connections now open) 2015-10-05T13:35:35.304+0100 [conn3730] end connection 172.28.0.163:58245 (235 connections now open) 2015-10-05T13:35:35.304+0100 [conn3713] end connection 172.28.0.163:58228 (233 connections now open) 2015-10-05T13:35:35.304+0100 [conn3714] end connection 172.28.0.163:58229 (231 connections now open) 2015-10-05T13:35:35.304+0100 [conn3716] end connection 172.28.0.163:58231 (231 connections now open) 2015-10-05T13:35:35.304+0100 [conn3721] end connection 172.28.0.163:58236 (230 connections now open) 2015-10-05T13:35:35.304+0100 [conn3742] end connection 172.28.0.163:58257 (228 connections now open) 2015-10-05T13:35:35.304+0100 [conn3796] end connection 172.28.0.163:58312 (228 connections now open) 2015-10-05T13:35:35.304+0100 [conn3748] end connection 172.28.0.163:58263 (227 connections now open) 2015-10-05T13:35:35.305+0100 [conn3725] end connection 172.28.0.163:58240 (227 connections now open) 2015-10-05T13:35:35.305+0100 [conn3760] end connection 172.28.0.163:58275 (225 connections now open) 2015-10-05T13:35:35.305+0100 [conn3726] end connection 172.28.0.163:58241 (225 connections now open) 2015-10-05T13:35:35.305+0100 [conn3729] end connection 172.28.0.163:58244 (223 connections now open) 2015-10-05T13:35:35.305+0100 [conn3778] end connection 172.28.0.163:58293 (222 connections now open) 2015-10-05T13:35:35.305+0100 [conn3754] end connection 172.28.0.163:58269 (221 connections now open) 2015-10-05T13:35:35.305+0100 [conn3820] end connection 172.28.0.163:58336 (221 connections now open) 2015-10-05T13:35:35.305+0100 [conn3767] end connection 172.28.0.163:58282 (219 connections now open) 2015-10-05T13:35:35.305+0100 [conn3732] end connection 172.28.0.163:58247 (218 connections now open) 2015-10-05T13:35:35.305+0100 [conn3741] end connection 172.28.0.163:58256 (217 connections now open) 2015-10-05T13:35:35.305+0100 [conn3790] end connection 172.28.0.163:58306 (216 connections now open) 2015-10-05T13:35:35.305+0100 [conn3751] end connection 172.28.0.163:58266 (216 connections now open) 2015-10-05T13:35:35.305+0100 [conn3759] end connection 172.28.0.163:58274 (214 connections now open) 2015-10-05T13:35:35.305+0100 [conn3746] end connection 172.28.0.163:58261 (213 connections now open) 2015-10-05T13:35:35.305+0100 [conn3753] end connection 172.28.0.163:58268 (212 connections now open) 2015-10-05T13:35:35.305+0100 [conn3747] end connection 172.28.0.163:58262 (211 connections now open) 2015-10-05T13:35:35.305+0100 [conn3755] end connection 172.28.0.163:58270 (210 connections now open) 2015-10-05T13:35:35.306+0100 [conn3761] end connection 172.28.0.163:58276 (209 connections now open) 2015-10-05T13:35:35.303+0100 [conn3686] end connection 172.28.0.163:58201 (255 connections now open) 2015-10-05T13:35:35.303+0100 [conn3682] end connection 172.28.0.163:58197 (258 connections now open) 2015-10-05T13:35:35.306+0100 [conn3745] end connection 172.28.0.163:58260 (206 connections now open) 2015-10-05T13:35:35.306+0100 [conn3802] end connection 172.28.0.163:58318 (205 connections now open) 2015-10-05T13:35:35.306+0100 [conn3765] end connection 172.28.0.163:58280 (204 connections now open) 2015-10-05T13:35:35.306+0100 [conn3752] end connection 172.28.0.163:58267 (203 connections now open) 2015-10-05T13:35:35.306+0100 [conn3825] end connection 172.28.0.163:58377 (203 connections now open) 2015-10-05T13:35:35.306+0100 [conn3823] end connection 172.28.0.163:58395 (201 connections now open) 2015-10-05T13:35:35.306+0100 [conn3762] end connection 172.28.0.163:58277 (200 connections now open) 2015-10-05T13:35:35.306+0100 [conn3764] end connection 172.28.0.163:58279 (199 connections now open) 2015-10-05T13:35:35.306+0100 [conn3795] end connection 172.28.0.163:58309 (198 connections now open) 2015-10-05T13:35:35.306+0100 [conn3814] end connection 172.28.0.163:58330 (197 connections now open) 2015-10-05T13:35:35.306+0100 [conn3777] end connection 172.28.0.163:58292 (196 connections now open) 2015-10-05T13:35:35.306+0100 [conn3794] end connection 172.28.0.163:58311 (194 connections now open) 2015-10-05T13:35:35.306+0100 [conn3768] end connection 172.28.0.163:58283 (194 connections now open) 2015-10-05T13:35:35.307+0100 [conn3779] end connection 172.28.0.163:58294 (193 connections now open) 2015-10-05T13:35:35.307+0100 [conn3780] end connection 172.28.0.163:58295 (192 connections now open) 2015-10-05T13:35:35.307+0100 [conn3771] end connection 172.28.0.163:58285 (191 connections now open) 2015-10-05T13:35:35.307+0100 [conn3785] end connection 172.28.0.163:58300 (190 connections now open) 2015-10-05T13:35:35.307+0100 [conn3786] end connection 172.28.0.163:58301 (190 connections now open) 2015-10-05T13:35:35.307+0100 [conn3787] end connection 172.28.0.163:58303 (188 connections now open) 2015-10-05T13:35:35.307+0100 [conn3800] end connection 172.28.0.163:58316 (187 connections now open) 2015-10-05T13:35:35.307+0100 [conn3807] end connection 172.28.0.163:58323 (186 connections now open) 2015-10-05T13:35:35.307+0100 [conn3797] end connection 172.28.0.163:58313 (185 connections now open) 2015-10-05T13:35:35.307+0100 [conn3801] end connection 172.28.0.163:58317 (184 connections now open) 2015-10-05T13:35:35.303+0100 [conn3689] end connection 172.28.0.163:58204 (254 connections now open) 2015-10-05T13:35:35.307+0100 [conn3803] end connection 172.28.0.163:58319 (183 connections now open) 2015-10-05T13:35:35.307+0100 [conn3805] end connection 172.28.0.163:58321 (182 connections now open) 2015-10-05T13:35:35.307+0100 [conn3822] end connection 172.28.0.163:58338 (181 connections now open) 2015-10-05T13:35:35.307+0100 [conn3804] end connection 172.28.0.163:58320 (180 connections now open) 2015-10-05T13:35:35.307+0100 [conn3811] end connection 172.28.0.163:58327 (179 connections now open) 2015-10-05T13:35:35.307+0100 [conn3817] end connection 172.28.0.163:58333 (179 connections now open) 2015-10-05T13:35:35.308+0100 [conn3816] end connection 172.28.0.163:58332 (177 connections now open) 2015-10-05T13:35:35.308+0100 [conn3813] end connection 172.28.0.163:58329 (176 connections now open) 2015-10-05T13:35:35.308+0100 [conn3828] end connection 172.28.0.163:58392 (174 connections now open) 2015-10-05T13:35:35.308+0100 [conn3818] end connection 172.28.0.163:58334 (174 connections now open) 2015-10-05T13:35:35.308+0100 [conn3830] end connection 172.28.0.163:58369 (173 connections now open) 2015-10-05T13:35:35.303+0100 [conn3691] end connection 172.28.0.163:58206 (252 connections now open) 2015-10-05T13:35:35.308+0100 [conn3821] end connection 172.28.0.163:58337 (173 connections now open) 2015-10-05T13:35:35.308+0100 [conn3827] end connection 172.28.0.163:58391 (173 connections now open) 2015-10-05T13:35:35.303+0100 [conn3693] end connection 172.28.0.163:58208 (251 connections now open) 2015-10-05T13:35:35.303+0100 [conn3698] end connection 172.28.0.163:58213 (249 connections now open) 2015-10-05T13:35:35.303+0100 [conn3706] end connection 172.28.0.163:58221 (248 connections now open) 2015-10-05T13:35:35.303+0100 [conn3697] end connection 172.28.0.163:58212 (248 connections now open) 2015-10-05T13:35:35.309+0100 [conn3774] end connection 172.28.0.163:58289 (164 connections now open) 2015-10-05T13:35:35.303+0100 [conn3702] end connection 172.28.0.163:58217 (246 connections now open) 2015-10-05T13:35:35.303+0100 [conn3705] end connection 172.28.0.163:58220 (245 connections now open) 2015-10-05T13:35:35.304+0100 [conn3724] end connection 172.28.0.163:58238 (242 connections now open) 2015-10-05T13:35:35.304+0100 [conn3707] end connection 172.28.0.163:58222 (238 connections now open) 2015-10-05T13:35:35.304+0100 [conn3708] end connection 172.28.0.163:58223 (238 connections now open) 2015-10-05T13:35:35.304+0100 [conn3710] end connection 172.28.0.163:58225 (235 connections now open) 2015-10-05T13:35:35.304+0100 [conn3736] end connection 172.28.0.163:58252 (231 connections now open) 2015-10-05T13:35:35.304+0100 [conn3719] end connection 172.28.0.163:58234 (230 connections now open) 2015-10-05T13:35:35.304+0100 [conn3766] end connection 172.28.0.163:58281 (228 connections now open) 2015-10-05T13:35:35.304+0100 [conn3722] end connection 172.28.0.163:58237 (228 connections now open) 2015-10-05T13:35:35.303+0100 [conn3684] end connection 172.28.0.163:58199 (255 connections now open) 2015-10-05T13:35:35.304+0100 [conn3723] end connection 172.28.0.163:58239 (227 connections now open) 2015-10-05T13:35:35.305+0100 [conn3727] end connection 172.28.0.163:58242 (224 connections now open) 2015-10-05T13:35:35.305+0100 [conn3733] end connection 172.28.0.163:58248 (222 connections now open) 2015-10-05T13:35:35.305+0100 [conn3737] end connection 172.28.0.163:58253 (222 connections now open) 2015-10-05T13:35:35.305+0100 [conn3731] end connection 172.28.0.163:58246 (221 connections now open) 2015-10-05T13:35:35.305+0100 [conn3781] end connection 172.28.0.163:58296 (218 connections now open) 2015-10-05T13:35:35.305+0100 [conn3740] end connection 172.28.0.163:58255 (216 connections now open) 2015-10-05T13:35:35.305+0100 [conn3784] end connection 172.28.0.163:58299 (215 connections now open) 2015-10-05T13:35:35.305+0100 [conn3738] end connection 172.28.0.163:58254 (213 connections now open) 2015-10-05T13:35:35.305+0100 [conn3739] end connection 172.28.0.163:58250 (213 connections now open) 2015-10-05T13:35:35.305+0100 [conn3735] end connection 172.28.0.163:58251 (212 connections now open) 2015-10-05T13:35:35.305+0100 [conn3782] end connection 172.28.0.163:58297 (210 connections now open) 2015-10-05T13:35:35.306+0100 [conn3744] end connection 172.28.0.163:58259 (209 connections now open) 2015-10-05T13:35:35.306+0100 [conn3720] end connection 172.28.0.163:58235 (207 connections now open) 2015-10-05T13:35:35.306+0100 [conn3756] end connection 172.28.0.163:58271 (207 connections now open) 2015-10-05T13:35:35.306+0100 [conn3743] end connection 172.28.0.163:58258 (207 connections now open) 2015-10-05T13:35:35.306+0100 [conn3750] end connection 172.28.0.163:58265 (207 connections now open) 2015-10-05T13:35:35.306+0100 [conn3749] end connection 172.28.0.163:58264 (206 connections now open) 2015-10-05T13:35:35.306+0100 [conn3808] end connection 172.28.0.163:58325 (205 connections now open) 2015-10-05T13:35:35.306+0100 [conn3763] end connection 172.28.0.163:58278 (204 connections now open) 2015-10-05T13:35:35.306+0100 [conn3783] end connection 172.28.0.163:58298 (203 connections now open) 2015-10-05T13:35:35.306+0100 [conn3757] end connection 172.28.0.163:58272 (203 connections now open) 2015-10-05T13:35:35.306+0100 [conn3826] end connection 172.28.0.163:58385 (200 connections now open) 2015-10-05T13:35:35.306+0100 [conn3758] end connection 172.28.0.163:58273 (200 connections now open) 2015-10-05T13:35:35.306+0100 [conn3799] end connection 172.28.0.163:58315 (199 connections now open) 2015-10-05T13:35:35.306+0100 [conn3788] end connection 172.28.0.163:58304 (194 connections now open) 2015-10-05T13:35:35.306+0100 [conn3769] end connection 172.28.0.163:58284 (194 connections now open) 2015-10-05T13:35:35.307+0100 [conn3773] end connection 172.28.0.163:58288 (193 connections now open) 2015-10-05T13:35:35.307+0100 [conn3792] end connection 172.28.0.163:58307 (193 connections now open) 2015-10-05T13:35:35.307+0100 [conn3775] end connection 172.28.0.163:58290 (193 connections now open) 2015-10-05T13:35:35.307+0100 [conn3789] end connection 172.28.0.163:58305 (193 connections now open) 2015-10-05T13:35:35.307+0100 [conn3770] end connection 172.28.0.163:58286 (192 connections now open) 2015-10-05T13:35:35.307+0100 [conn3776] end connection 172.28.0.163:58291 (190 connections now open) 2015-10-05T13:35:35.307+0100 [conn3809] end connection 172.28.0.163:58324 (189 connections now open) 2015-10-05T13:35:35.307+0100 [conn3791] end connection 172.28.0.163:58308 (187 connections now open) 2015-10-05T13:35:35.307+0100 [conn3815] end connection 172.28.0.163:58331 (187 connections now open) 2015-10-05T13:35:35.307+0100 [conn3798] end connection 172.28.0.163:58314 (186 connections now open) 2015-10-05T13:35:35.307+0100 [conn3793] end connection 172.28.0.163:58310 (184 connections now open) 2015-10-05T13:35:35.307+0100 [conn3806] end connection 172.28.0.163:58322 (182 connections now open) 2015-10-05T13:35:35.307+0100 [conn3810] end connection 172.28.0.163:58326 (179 connections now open) 2015-10-05T13:35:35.308+0100 [conn3812] end connection 172.28.0.163:58328 (176 connections now open) 2015-10-05T13:35:35.308+0100 [conn3824] end connection 172.28.0.163:58381 (174 connections now open) 2015-10-05T13:35:35.308+0100 [conn3829] end connection 172.28.0.163:58379 (173 connections now open) 2015-10-05T13:35:35.308+0100 [conn3819] end connection 172.28.0.163:58335 (173 connections now open) 2015-10-05T13:35:35.303+0100 [conn3683] end connection 172.28.0.163:58198 (255 connections now open) 2015-10-05T13:35:35.303+0100 [conn3704] end connection 172.28.0.163:58219 (247 connections now open) 2015-10-05T13:35:39.194+0100 [mongosMain] connection accepted from 127.0.0.1:58614 #3835 (107 connections now open) 2015-10-05T13:35:39.196+0100 [conn3835] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:35:39.197+0100 [conn3835] end connection 127.0.0.1:58614 (106 connections now open) 2015-10-05T13:35:41.191+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126e9d12deab02e29989c6 2015-10-05T13:35:41.293+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:48.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ea312deab02e29989c7 2015-10-05T13:35:48.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:54.320+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126eaa12deab02e29989c8 2015-10-05T13:35:54.388+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:35:55.642+0100 [conn2421] end connection 172.28.0.164:57198 (105 connections now open) 2015-10-05T13:35:55.643+0100 [mongosMain] connection accepted from 172.28.0.164:60972 #3836 (106 connections now open) 2015-10-05T13:35:55.646+0100 [conn3836] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:36:00.539+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126eb012deab02e29989c9 2015-10-05T13:36:00.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:36:02.120+0100 [mongosMain] connection accepted from 172.28.0.163:58649 #3837 (107 connections now open) 2015-10-05T13:36:02.121+0100 [mongosMain] connection accepted from 172.28.0.163:58650 #3838 (108 connections now open) 2015-10-05T13:36:04.232+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:36:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:36:06.894+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126eb612deab02e29989ca 2015-10-05T13:36:07.030+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:36:14.075+0100 [conn2724] end connection 172.28.0.163:55979 (107 connections now open) 2015-10-05T13:36:14.075+0100 [mongosMain] connection accepted from 172.28.0.163:58664 #3839 (108 connections now open) 2015-10-05T13:36:14.075+0100 [conn3839] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:36:19.297+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ec312deab02e29989cc 2015-10-05T13:36:19.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:36:28.389+0100 [mongosMain] connection accepted from 127.0.0.1:58672 #3840 (109 connections now open) 2015-10-05T13:36:28.391+0100 [conn3840] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:36:28.393+0100 [conn3840] end connection 127.0.0.1:58672 (108 connections now open) 2015-10-05T13:36:31.593+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ecf12deab02e29989cd 2015-10-05T13:36:31.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:36:34.499+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:36:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:36:39.579+0100 [mongosMain] connection accepted from 127.0.0.1:58673 #3841 (109 connections now open) 2015-10-05T13:36:39.581+0100 [conn3841] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:36:39.582+0100 [conn3841] end connection 127.0.0.1:58673 (108 connections now open) 2015-10-05T13:36:43.962+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126edb12deab02e29989ce 2015-10-05T13:36:44.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:36:55.657+0100 [conn2428] end connection 172.28.0.164:57205 (107 connections now open) 2015-10-05T13:36:55.658+0100 [mongosMain] connection accepted from 172.28.0.164:61017 #3842 (108 connections now open) 2015-10-05T13:36:55.661+0100 [conn3842] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:36:56.393+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ee812deab02e29989cf 2015-10-05T13:36:56.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:04.761+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:37:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:37:08.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ef412deab02e29989d0 2015-10-05T13:37:08.929+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:14.053+0100 [conn2725] end connection 172.28.0.163:55980 (107 connections now open) 2015-10-05T13:37:14.055+0100 [mongosMain] connection accepted from 172.28.0.163:58709 #3843 (108 connections now open) 2015-10-05T13:37:14.057+0100 [conn3843] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:37:27.299+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f0612deab02e29989d1 2015-10-05T13:37:28.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:28.583+0100 [mongosMain] connection accepted from 127.0.0.1:58716 #3844 (109 connections now open) 2015-10-05T13:37:28.594+0100 [conn3844] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:37:28.596+0100 [conn3844] end connection 127.0.0.1:58716 (108 connections now open) 2015-10-05T13:37:31.126+0100 [conn3838] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:37:34.439+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f0e12deab02e29989d2 2015-10-05T13:37:34.575+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:35.021+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:37:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:37:39.400+0100 [mongosMain] connection accepted from 127.0.0.1:58718 #3845 (109 connections now open) 2015-10-05T13:37:39.403+0100 [conn3845] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:37:39.403+0100 [conn3845] end connection 127.0.0.1:58718 (108 connections now open) 2015-10-05T13:37:40.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f1412deab02e29989d3 2015-10-05T13:37:40.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:47.282+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f1b12deab02e29989d4 2015-10-05T13:37:47.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:37:55.673+0100 [conn2395] end connection 172.28.0.164:57161 (107 connections now open) 2015-10-05T13:37:55.674+0100 [mongosMain] connection accepted from 172.28.0.164:61065 #3846 (108 connections now open) 2015-10-05T13:37:55.677+0100 [conn3846] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:37:59.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f2712deab02e29989d6 2015-10-05T13:37:59.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:05.179+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:38:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:38:05.795+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:38:05.795+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:38:11.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f3312deab02e29989d9 2015-10-05T13:38:12.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:14.069+0100 [conn2726] end connection 172.28.0.163:55982 (107 connections now open) 2015-10-05T13:38:14.071+0100 [mongosMain] connection accepted from 172.28.0.163:58755 #3847 (108 connections now open) 2015-10-05T13:38:14.073+0100 [conn3847] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:38:24.374+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f4012deab02e29989da 2015-10-05T13:38:24.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:28.531+0100 [mongosMain] connection accepted from 127.0.0.1:58761 #3848 (109 connections now open) 2015-10-05T13:38:28.534+0100 [conn3848] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:38:28.536+0100 [conn3848] end connection 127.0.0.1:58761 (108 connections now open) 2015-10-05T13:38:35.332+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:38:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:38:36.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f4c12deab02e29989dc 2015-10-05T13:38:36.735+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:40.053+0100 [mongosMain] connection accepted from 127.0.0.1:58762 #3849 (109 connections now open) 2015-10-05T13:38:40.055+0100 [conn3849] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:38:40.056+0100 [conn3849] end connection 127.0.0.1:58762 (108 connections now open) 2015-10-05T13:38:42.884+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f5212deab02e29989dd 2015-10-05T13:38:42.951+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:49.237+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f5812deab02e29989de 2015-10-05T13:38:49.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:38:55.689+0100 [conn2410] end connection 172.28.0.164:57187 (107 connections now open) 2015-10-05T13:38:55.690+0100 [mongosMain] connection accepted from 172.28.0.164:61109 #3850 (108 connections now open) 2015-10-05T13:38:55.692+0100 [conn3850] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:01.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f6512deab02e29989e0 2015-10-05T13:39:01.870+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:39:05.623+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:39:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:39:09.545+0100 [mongosMain] connection accepted from 172.28.0.164:61112 #3851 (109 connections now open) 2015-10-05T13:39:09.547+0100 [conn3851] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.567+0100 [mongosMain] connection accepted from 172.28.0.164:61113 #3852 (110 connections now open) 2015-10-05T13:39:09.567+0100 [mongosMain] connection accepted from 172.28.0.164:61114 #3853 (111 connections now open) 2015-10-05T13:39:09.569+0100 [mongosMain] connection accepted from 172.28.0.164:61115 #3854 (112 connections now open) 2015-10-05T13:39:09.569+0100 [conn3852] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.569+0100 [conn3853] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.574+0100 [conn3854] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.575+0100 [mongosMain] connection accepted from 172.28.0.164:61116 #3855 (113 connections now open) 2015-10-05T13:39:09.575+0100 [mongosMain] connection accepted from 172.28.0.164:61117 #3856 (114 connections now open) 2015-10-05T13:39:09.576+0100 [mongosMain] connection accepted from 172.28.0.164:61118 #3857 (115 connections now open) 2015-10-05T13:39:09.576+0100 [mongosMain] connection accepted from 172.28.0.164:61119 #3858 (116 connections now open) 2015-10-05T13:39:09.576+0100 [mongosMain] connection accepted from 172.28.0.164:61120 #3859 (117 connections now open) 2015-10-05T13:39:09.577+0100 [mongosMain] connection accepted from 172.28.0.164:61121 #3860 (118 connections now open) 2015-10-05T13:39:09.577+0100 [conn3856] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.577+0100 [mongosMain] connection accepted from 172.28.0.164:61122 #3861 (119 connections now open) 2015-10-05T13:39:09.578+0100 [mongosMain] connection accepted from 172.28.0.164:61123 #3862 (120 connections now open) 2015-10-05T13:39:09.578+0100 [conn3858] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.578+0100 [mongosMain] connection accepted from 172.28.0.164:61124 #3863 (121 connections now open) 2015-10-05T13:39:09.579+0100 [conn3859] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.579+0100 [mongosMain] connection accepted from 172.28.0.164:61125 #3864 (122 connections now open) 2015-10-05T13:39:09.579+0100 [conn3860] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.579+0100 [mongosMain] connection accepted from 172.28.0.164:61126 #3865 (123 connections now open) 2015-10-05T13:39:09.579+0100 [conn3861] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.580+0100 [mongosMain] connection accepted from 172.28.0.164:61127 #3866 (124 connections now open) 2015-10-05T13:39:09.580+0100 [conn3862] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.581+0100 [conn3864] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.581+0100 [conn3865] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.583+0100 [conn3866] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.585+0100 [mongosMain] connection accepted from 172.28.0.164:61128 #3867 (125 connections now open) 2015-10-05T13:39:09.588+0100 [conn3867] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.589+0100 [mongosMain] connection accepted from 172.28.0.164:61129 #3868 (126 connections now open) 2015-10-05T13:39:09.590+0100 [mongosMain] connection accepted from 172.28.0.164:61130 #3869 (127 connections now open) 2015-10-05T13:39:09.590+0100 [mongosMain] connection accepted from 172.28.0.164:61131 #3870 (128 connections now open) 2015-10-05T13:39:09.591+0100 [mongosMain] connection accepted from 172.28.0.164:61132 #3871 (129 connections now open) 2015-10-05T13:39:09.591+0100 [conn3868] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.591+0100 [mongosMain] connection accepted from 172.28.0.164:61133 #3872 (130 connections now open) 2015-10-05T13:39:09.591+0100 [mongosMain] connection accepted from 172.28.0.164:61134 #3873 (131 connections now open) 2015-10-05T13:39:09.592+0100 [conn3869] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.592+0100 [mongosMain] connection accepted from 172.28.0.164:61135 #3874 (132 connections now open) 2015-10-05T13:39:09.593+0100 [mongosMain] connection accepted from 172.28.0.164:61136 #3875 (133 connections now open) 2015-10-05T13:39:09.593+0100 [conn3871] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.593+0100 [mongosMain] connection accepted from 172.28.0.164:61137 #3876 (134 connections now open) 2015-10-05T13:39:09.593+0100 [mongosMain] connection accepted from 172.28.0.164:61138 #3877 (135 connections now open) 2015-10-05T13:39:09.593+0100 [mongosMain] connection accepted from 172.28.0.164:61139 #3878 (136 connections now open) 2015-10-05T13:39:09.594+0100 [mongosMain] connection accepted from 172.28.0.164:61140 #3879 (137 connections now open) 2015-10-05T13:39:09.594+0100 [mongosMain] connection accepted from 172.28.0.164:61141 #3880 (138 connections now open) 2015-10-05T13:39:09.595+0100 [mongosMain] connection accepted from 172.28.0.164:61142 #3881 (139 connections now open) 2015-10-05T13:39:09.595+0100 [mongosMain] connection accepted from 172.28.0.164:61143 #3882 (140 connections now open) 2015-10-05T13:39:09.595+0100 [conn3874] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.595+0100 [mongosMain] connection accepted from 172.28.0.164:61144 #3883 (141 connections now open) 2015-10-05T13:39:09.595+0100 [conn3875] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.596+0100 [mongosMain] connection accepted from 172.28.0.164:61145 #3884 (142 connections now open) 2015-10-05T13:39:09.596+0100 [mongosMain] connection accepted from 172.28.0.164:61146 #3885 (143 connections now open) 2015-10-05T13:39:09.596+0100 [mongosMain] connection accepted from 172.28.0.164:61147 #3886 (144 connections now open) 2015-10-05T13:39:09.597+0100 [mongosMain] connection accepted from 172.28.0.164:61148 #3887 (145 connections now open) 2015-10-05T13:39:09.597+0100 [mongosMain] connection accepted from 172.28.0.164:61149 #3888 (146 connections now open) 2015-10-05T13:39:09.597+0100 [conn3877] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.597+0100 [mongosMain] connection accepted from 172.28.0.164:61150 #3889 (147 connections now open) 2015-10-05T13:39:09.598+0100 [mongosMain] connection accepted from 172.28.0.164:61151 #3890 (148 connections now open) 2015-10-05T13:39:09.598+0100 [conn3878] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.598+0100 [conn3876] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.598+0100 [conn3879] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.598+0100 [mongosMain] connection accepted from 172.28.0.164:61152 #3891 (149 connections now open) 2015-10-05T13:39:09.599+0100 [conn3880] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.599+0100 [mongosMain] connection accepted from 172.28.0.164:61153 #3892 (150 connections now open) 2015-10-05T13:39:09.599+0100 [conn3881] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.599+0100 [mongosMain] connection accepted from 172.28.0.164:61154 #3893 (151 connections now open) 2015-10-05T13:39:09.599+0100 [conn3882] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.599+0100 [mongosMain] connection accepted from 172.28.0.164:61155 #3894 (152 connections now open) 2015-10-05T13:39:09.600+0100 [conn3883] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.600+0100 [mongosMain] connection accepted from 172.28.0.164:61156 #3895 (153 connections now open) 2015-10-05T13:39:09.600+0100 [mongosMain] connection accepted from 172.28.0.164:61157 #3896 (154 connections now open) 2015-10-05T13:39:09.600+0100 [mongosMain] connection accepted from 172.28.0.164:61158 #3897 (155 connections now open) 2015-10-05T13:39:09.601+0100 [mongosMain] connection accepted from 172.28.0.164:61159 #3898 (156 connections now open) 2015-10-05T13:39:09.601+0100 [mongosMain] connection accepted from 172.28.0.164:61160 #3899 (157 connections now open) 2015-10-05T13:39:09.601+0100 [mongosMain] connection accepted from 172.28.0.164:61161 #3900 (158 connections now open) 2015-10-05T13:39:09.602+0100 [mongosMain] connection accepted from 172.28.0.164:61162 #3901 (159 connections now open) 2015-10-05T13:39:09.602+0100 [mongosMain] connection accepted from 172.28.0.164:61163 #3902 (160 connections now open) 2015-10-05T13:39:09.603+0100 [mongosMain] connection accepted from 172.28.0.164:61164 #3903 (161 connections now open) 2015-10-05T13:39:09.603+0100 [mongosMain] connection accepted from 172.28.0.164:61165 #3904 (162 connections now open) 2015-10-05T13:39:09.603+0100 [mongosMain] connection accepted from 172.28.0.164:61166 #3905 (163 connections now open) 2015-10-05T13:39:09.604+0100 [mongosMain] connection accepted from 172.28.0.164:61167 #3906 (164 connections now open) 2015-10-05T13:39:09.604+0100 [mongosMain] connection accepted from 172.28.0.164:61168 #3907 (165 connections now open) 2015-10-05T13:39:09.604+0100 [mongosMain] connection accepted from 172.28.0.164:61169 #3908 (166 connections now open) 2015-10-05T13:39:09.605+0100 [mongosMain] connection accepted from 172.28.0.164:61170 #3909 (167 connections now open) 2015-10-05T13:39:09.605+0100 [mongosMain] connection accepted from 172.28.0.164:61171 #3910 (168 connections now open) 2015-10-05T13:39:09.605+0100 [mongosMain] connection accepted from 172.28.0.164:61172 #3911 (169 connections now open) 2015-10-05T13:39:09.605+0100 [mongosMain] connection accepted from 172.28.0.164:61173 #3912 (170 connections now open) 2015-10-05T13:39:09.606+0100 [conn3887] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.607+0100 [conn3885] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.607+0100 [conn3893] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3889] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3894] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3891] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3898] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3884] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3905] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3899] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3892] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3910] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3904] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3888] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3911] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.608+0100 [conn3890] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3900] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3901] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3895] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3907] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3903] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3902] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3908] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3896] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3897] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3906] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.609+0100 [conn3886] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.610+0100 [conn3912] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.610+0100 [conn3909] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.610+0100 [mongosMain] connection accepted from 172.28.0.164:61174 #3913 (171 connections now open) 2015-10-05T13:39:09.611+0100 [mongosMain] connection accepted from 172.28.0.164:61175 #3914 (172 connections now open) 2015-10-05T13:39:09.611+0100 [mongosMain] connection accepted from 172.28.0.164:61176 #3915 (173 connections now open) 2015-10-05T13:39:09.612+0100 [mongosMain] connection accepted from 172.28.0.164:61177 #3916 (174 connections now open) 2015-10-05T13:39:09.612+0100 [conn3913] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.612+0100 [mongosMain] connection accepted from 172.28.0.164:61178 #3917 (175 connections now open) 2015-10-05T13:39:09.613+0100 [mongosMain] connection accepted from 172.28.0.164:61179 #3918 (176 connections now open) 2015-10-05T13:39:09.613+0100 [mongosMain] connection accepted from 172.28.0.164:61180 #3919 (177 connections now open) 2015-10-05T13:39:09.613+0100 [conn3915] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.614+0100 [mongosMain] connection accepted from 172.28.0.164:61181 #3920 (178 connections now open) 2015-10-05T13:39:09.614+0100 [conn3916] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.614+0100 [conn3917] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.614+0100 [conn3918] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.616+0100 [mongosMain] connection accepted from 172.28.0.164:61182 #3921 (179 connections now open) 2015-10-05T13:39:09.618+0100 [mongosMain] connection accepted from 172.28.0.164:61183 #3922 (180 connections now open) 2015-10-05T13:39:09.618+0100 [mongosMain] connection accepted from 172.28.0.164:61184 #3923 (181 connections now open) 2015-10-05T13:39:09.618+0100 [mongosMain] connection accepted from 172.28.0.164:61185 #3924 (182 connections now open) 2015-10-05T13:39:09.619+0100 [mongosMain] connection accepted from 172.28.0.164:61186 #3925 (183 connections now open) 2015-10-05T13:39:09.619+0100 [mongosMain] connection accepted from 172.28.0.164:61187 #3926 (184 connections now open) 2015-10-05T13:39:09.619+0100 [mongosMain] connection accepted from 172.28.0.164:61188 #3927 (185 connections now open) 2015-10-05T13:39:09.619+0100 [mongosMain] connection accepted from 172.28.0.164:61189 #3928 (186 connections now open) 2015-10-05T13:39:09.619+0100 [mongosMain] connection accepted from 172.28.0.164:61190 #3929 (187 connections now open) 2015-10-05T13:39:09.620+0100 [mongosMain] connection accepted from 172.28.0.164:61191 #3930 (188 connections now open) 2015-10-05T13:39:09.620+0100 [mongosMain] connection accepted from 172.28.0.164:61192 #3931 (189 connections now open) 2015-10-05T13:39:09.620+0100 [mongosMain] connection accepted from 172.28.0.164:61193 #3932 (190 connections now open) 2015-10-05T13:39:09.621+0100 [mongosMain] connection accepted from 172.28.0.164:61194 #3933 (191 connections now open) 2015-10-05T13:39:09.621+0100 [mongosMain] connection accepted from 172.28.0.164:61195 #3934 (192 connections now open) 2015-10-05T13:39:09.621+0100 [mongosMain] connection accepted from 172.28.0.164:61196 #3935 (193 connections now open) 2015-10-05T13:39:09.621+0100 [mongosMain] connection accepted from 172.28.0.164:61197 #3936 (194 connections now open) 2015-10-05T13:39:09.622+0100 [mongosMain] connection accepted from 172.28.0.164:61198 #3937 (195 connections now open) 2015-10-05T13:39:09.622+0100 [mongosMain] connection accepted from 172.28.0.164:61199 #3938 (196 connections now open) 2015-10-05T13:39:09.622+0100 [mongosMain] connection accepted from 172.28.0.164:61200 #3939 (197 connections now open) 2015-10-05T13:39:09.623+0100 [mongosMain] connection accepted from 172.28.0.164:61201 #3940 (198 connections now open) 2015-10-05T13:39:09.624+0100 [mongosMain] connection accepted from 172.28.0.164:61202 #3941 (199 connections now open) 2015-10-05T13:39:09.625+0100 [mongosMain] connection accepted from 172.28.0.164:61203 #3942 (200 connections now open) 2015-10-05T13:39:09.626+0100 [mongosMain] connection accepted from 172.28.0.164:61204 #3943 (201 connections now open) 2015-10-05T13:39:09.626+0100 [mongosMain] connection accepted from 172.28.0.164:61205 #3944 (202 connections now open) 2015-10-05T13:39:09.627+0100 [mongosMain] connection accepted from 172.28.0.164:61206 #3945 (203 connections now open) 2015-10-05T13:39:09.628+0100 [mongosMain] connection accepted from 172.28.0.164:61207 #3946 (204 connections now open) 2015-10-05T13:39:09.629+0100 [mongosMain] connection accepted from 172.28.0.164:61208 #3947 (205 connections now open) 2015-10-05T13:39:09.629+0100 [mongosMain] connection accepted from 172.28.0.164:61209 #3948 (206 connections now open) 2015-10-05T13:39:09.630+0100 [mongosMain] connection accepted from 172.28.0.164:61210 #3949 (207 connections now open) 2015-10-05T13:39:09.630+0100 [mongosMain] connection accepted from 172.28.0.164:61211 #3950 (208 connections now open) 2015-10-05T13:39:09.631+0100 [mongosMain] connection accepted from 172.28.0.164:61212 #3951 (209 connections now open) 2015-10-05T13:39:09.631+0100 [mongosMain] connection accepted from 172.28.0.164:61213 #3952 (210 connections now open) 2015-10-05T13:39:09.631+0100 [mongosMain] connection accepted from 172.28.0.164:61214 #3953 (211 connections now open) 2015-10-05T13:39:09.631+0100 [mongosMain] connection accepted from 172.28.0.164:61215 #3954 (212 connections now open) 2015-10-05T13:39:09.632+0100 [mongosMain] connection accepted from 172.28.0.164:61216 #3955 (213 connections now open) 2015-10-05T13:39:09.632+0100 [mongosMain] connection accepted from 172.28.0.164:61217 #3956 (214 connections now open) 2015-10-05T13:39:09.635+0100 [mongosMain] connection accepted from 172.28.0.164:61218 #3957 (215 connections now open) 2015-10-05T13:39:09.636+0100 [mongosMain] connection accepted from 172.28.0.164:61219 #3958 (216 connections now open) 2015-10-05T13:39:09.636+0100 [mongosMain] connection accepted from 172.28.0.164:61220 #3959 (217 connections now open) 2015-10-05T13:39:09.643+0100 [mongosMain] connection accepted from 172.28.0.164:61221 #3960 (218 connections now open) 2015-10-05T13:39:09.646+0100 [mongosMain] connection accepted from 172.28.0.164:61222 #3961 (219 connections now open) 2015-10-05T13:39:09.647+0100 [mongosMain] connection accepted from 172.28.0.164:61223 #3962 (220 connections now open) 2015-10-05T13:39:09.647+0100 [mongosMain] connection accepted from 172.28.0.164:61224 #3963 (221 connections now open) 2015-10-05T13:39:09.649+0100 [mongosMain] connection accepted from 172.28.0.164:61225 #3964 (222 connections now open) 2015-10-05T13:39:09.649+0100 [mongosMain] connection accepted from 172.28.0.164:61226 #3965 (223 connections now open) 2015-10-05T13:39:09.650+0100 [mongosMain] connection accepted from 172.28.0.164:61227 #3966 (224 connections now open) 2015-10-05T13:39:09.651+0100 [mongosMain] connection accepted from 172.28.0.164:61228 #3967 (225 connections now open) 2015-10-05T13:39:09.653+0100 [mongosMain] connection accepted from 172.28.0.164:61230 #3968 (226 connections now open) 2015-10-05T13:39:09.654+0100 [mongosMain] connection accepted from 172.28.0.164:61229 #3969 (227 connections now open) 2015-10-05T13:39:09.654+0100 [mongosMain] connection accepted from 172.28.0.164:61231 #3970 (228 connections now open) 2015-10-05T13:39:09.655+0100 [mongosMain] connection accepted from 172.28.0.164:61232 #3971 (229 connections now open) 2015-10-05T13:39:09.655+0100 [mongosMain] connection accepted from 172.28.0.164:61233 #3972 (230 connections now open) 2015-10-05T13:39:09.656+0100 [mongosMain] connection accepted from 172.28.0.164:61234 #3973 (231 connections now open) 2015-10-05T13:39:09.656+0100 [mongosMain] connection accepted from 172.28.0.164:61235 #3974 (232 connections now open) 2015-10-05T13:39:09.656+0100 [mongosMain] connection accepted from 172.28.0.164:61236 #3975 (233 connections now open) 2015-10-05T13:39:09.657+0100 [mongosMain] connection accepted from 172.28.0.164:61237 #3976 (234 connections now open) 2015-10-05T13:39:09.657+0100 [mongosMain] connection accepted from 172.28.0.164:61238 #3977 (235 connections now open) 2015-10-05T13:39:09.658+0100 [mongosMain] connection accepted from 172.28.0.164:61239 #3978 (236 connections now open) 2015-10-05T13:39:09.658+0100 [mongosMain] connection accepted from 172.28.0.164:61240 #3979 (237 connections now open) 2015-10-05T13:39:09.658+0100 [mongosMain] connection accepted from 172.28.0.164:61242 #3980 (238 connections now open) 2015-10-05T13:39:09.658+0100 [mongosMain] connection accepted from 172.28.0.164:61241 #3981 (239 connections now open) 2015-10-05T13:39:09.659+0100 [mongosMain] connection accepted from 172.28.0.164:61243 #3982 (240 connections now open) 2015-10-05T13:39:09.659+0100 [mongosMain] connection accepted from 172.28.0.164:61244 #3983 (241 connections now open) 2015-10-05T13:39:09.659+0100 [mongosMain] connection accepted from 172.28.0.164:61245 #3984 (242 connections now open) 2015-10-05T13:39:09.660+0100 [mongosMain] connection accepted from 172.28.0.164:61246 #3985 (243 connections now open) 2015-10-05T13:39:09.660+0100 [mongosMain] connection accepted from 172.28.0.164:61247 #3986 (244 connections now open) 2015-10-05T13:39:09.660+0100 [mongosMain] connection accepted from 172.28.0.164:61248 #3987 (245 connections now open) 2015-10-05T13:39:09.661+0100 [mongosMain] connection accepted from 172.28.0.164:61249 #3988 (246 connections now open) 2015-10-05T13:39:09.661+0100 [mongosMain] connection accepted from 172.28.0.164:61250 #3989 (247 connections now open) 2015-10-05T13:39:09.661+0100 [mongosMain] connection accepted from 172.28.0.164:61251 #3990 (248 connections now open) 2015-10-05T13:39:09.662+0100 [mongosMain] connection accepted from 172.28.0.164:61252 #3991 (249 connections now open) 2015-10-05T13:39:09.662+0100 [mongosMain] connection accepted from 172.28.0.164:61253 #3992 (250 connections now open) 2015-10-05T13:39:09.662+0100 [mongosMain] connection accepted from 172.28.0.164:61254 #3993 (251 connections now open) 2015-10-05T13:39:09.663+0100 [mongosMain] connection accepted from 172.28.0.164:61255 #3994 (252 connections now open) 2015-10-05T13:39:09.663+0100 [mongosMain] connection accepted from 172.28.0.164:61256 #3995 (253 connections now open) 2015-10-05T13:39:09.664+0100 [mongosMain] connection accepted from 172.28.0.164:61258 #3996 (254 connections now open) 2015-10-05T13:39:09.664+0100 [mongosMain] connection accepted from 172.28.0.164:61257 #3997 (255 connections now open) 2015-10-05T13:39:09.666+0100 [conn3914] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.669+0100 [mongosMain] connection accepted from 172.28.0.164:61259 #3998 (256 connections now open) 2015-10-05T13:39:09.669+0100 [mongosMain] connection accepted from 172.28.0.164:61260 #3999 (257 connections now open) 2015-10-05T13:39:09.670+0100 [mongosMain] connection accepted from 172.28.0.164:61261 #4000 (258 connections now open) 2015-10-05T13:39:09.670+0100 [mongosMain] connection accepted from 172.28.0.164:61262 #4001 (259 connections now open) 2015-10-05T13:39:09.670+0100 [mongosMain] connection accepted from 172.28.0.164:61263 #4002 (260 connections now open) 2015-10-05T13:39:09.672+0100 [mongosMain] connection accepted from 172.28.0.164:61264 #4003 (261 connections now open) 2015-10-05T13:39:09.673+0100 [mongosMain] connection accepted from 172.28.0.164:61265 #4004 (262 connections now open) 2015-10-05T13:39:09.674+0100 [mongosMain] connection accepted from 172.28.0.164:61266 #4005 (263 connections now open) 2015-10-05T13:39:09.674+0100 [mongosMain] connection accepted from 172.28.0.164:61267 #4006 (264 connections now open) 2015-10-05T13:39:09.675+0100 [mongosMain] connection accepted from 172.28.0.164:61268 #4007 (265 connections now open) 2015-10-05T13:39:09.677+0100 [mongosMain] connection accepted from 172.28.0.164:61269 #4008 (266 connections now open) 2015-10-05T13:39:09.677+0100 [mongosMain] connection accepted from 172.28.0.164:61270 #4009 (267 connections now open) 2015-10-05T13:39:09.678+0100 [mongosMain] connection accepted from 172.28.0.164:61271 #4010 (268 connections now open) 2015-10-05T13:39:09.678+0100 [mongosMain] connection accepted from 172.28.0.164:61272 #4011 (269 connections now open) 2015-10-05T13:39:09.679+0100 [mongosMain] connection accepted from 172.28.0.164:61273 #4012 (270 connections now open) 2015-10-05T13:39:09.679+0100 [mongosMain] connection accepted from 172.28.0.164:61274 #4013 (271 connections now open) 2015-10-05T13:39:09.679+0100 [mongosMain] connection accepted from 172.28.0.164:61275 #4014 (272 connections now open) 2015-10-05T13:39:09.680+0100 [mongosMain] connection accepted from 172.28.0.164:61276 #4015 (273 connections now open) 2015-10-05T13:39:09.680+0100 [mongosMain] connection accepted from 172.28.0.164:61277 #4016 (274 connections now open) 2015-10-05T13:39:09.680+0100 [mongosMain] connection accepted from 172.28.0.164:61278 #4017 (275 connections now open) 2015-10-05T13:39:09.681+0100 [mongosMain] connection accepted from 172.28.0.164:61279 #4018 (276 connections now open) 2015-10-05T13:39:09.681+0100 [mongosMain] connection accepted from 172.28.0.164:61280 #4019 (277 connections now open) 2015-10-05T13:39:09.682+0100 [mongosMain] connection accepted from 172.28.0.164:61282 #4020 (278 connections now open) 2015-10-05T13:39:09.682+0100 [mongosMain] connection accepted from 172.28.0.164:61281 #4021 (279 connections now open) 2015-10-05T13:39:09.683+0100 [mongosMain] connection accepted from 172.28.0.164:61283 #4022 (280 connections now open) 2015-10-05T13:39:09.683+0100 [mongosMain] connection accepted from 172.28.0.164:61284 #4023 (281 connections now open) 2015-10-05T13:39:09.684+0100 [mongosMain] connection accepted from 172.28.0.164:61286 #4024 (282 connections now open) 2015-10-05T13:39:09.684+0100 [conn3919] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.684+0100 [conn3920] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.685+0100 [mongosMain] connection accepted from 172.28.0.164:61287 #4025 (283 connections now open) 2015-10-05T13:39:09.685+0100 [mongosMain] connection accepted from 172.28.0.164:61288 #4026 (284 connections now open) 2015-10-05T13:39:09.686+0100 [mongosMain] connection accepted from 172.28.0.164:61289 #4027 (285 connections now open) 2015-10-05T13:39:09.686+0100 [conn3925] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3923] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3924] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3922] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3930] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [mongosMain] connection accepted from 172.28.0.164:61290 #4028 (286 connections now open) 2015-10-05T13:39:09.686+0100 [conn3926] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3929] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.686+0100 [conn3931] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3934] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3932] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3933] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3938] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3936] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3942] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3935] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3939] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3940] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3947] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3943] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3948] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [mongosMain] connection accepted from 172.28.0.164:61291 #4029 (287 connections now open) 2015-10-05T13:39:09.687+0100 [conn3937] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.687+0100 [conn3953] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.688+0100 [conn3952] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.688+0100 [conn3954] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.688+0100 [mongosMain] connection accepted from 172.28.0.164:61292 #4030 (288 connections now open) 2015-10-05T13:39:09.688+0100 [conn3950] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.688+0100 [mongosMain] connection accepted from 172.28.0.164:61293 #4031 (289 connections now open) 2015-10-05T13:39:09.688+0100 [mongosMain] connection accepted from 172.28.0.164:61294 #4032 (290 connections now open) 2015-10-05T13:39:09.689+0100 [mongosMain] connection accepted from 172.28.0.164:61295 #4033 (291 connections now open) 2015-10-05T13:39:09.689+0100 [conn3951] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.689+0100 [conn3949] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.689+0100 [mongosMain] connection accepted from 172.28.0.164:61296 #4034 (292 connections now open) 2015-10-05T13:39:09.690+0100 [conn3977] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3944] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3978] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3928] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3979] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3981] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3983] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3984] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3988] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.690+0100 [conn3985] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3987] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3992] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3990] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3989] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3991] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [mongosMain] connection accepted from 172.28.0.164:61297 #4035 (293 connections now open) 2015-10-05T13:39:09.691+0100 [conn3945] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [mongosMain] connection accepted from 172.28.0.164:61298 #4036 (294 connections now open) 2015-10-05T13:39:09.691+0100 [conn3993] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [conn3986] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.691+0100 [mongosMain] connection accepted from 172.28.0.164:61299 #4037 (295 connections now open) 2015-10-05T13:39:09.692+0100 [mongosMain] connection accepted from 172.28.0.164:61300 #4038 (296 connections now open) 2015-10-05T13:39:09.692+0100 [conn3995] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.692+0100 [mongosMain] connection accepted from 172.28.0.164:61301 #4039 (297 connections now open) 2015-10-05T13:39:09.692+0100 [mongosMain] connection accepted from 172.28.0.164:61302 #4040 (298 connections now open) 2015-10-05T13:39:09.692+0100 [conn3994] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.692+0100 [conn3946] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.692+0100 [mongosMain] connection accepted from 172.28.0.164:61303 #4041 (299 connections now open) 2015-10-05T13:39:09.693+0100 [conn3996] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3956] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [mongosMain] connection accepted from 172.28.0.164:61304 #4042 (300 connections now open) 2015-10-05T13:39:09.693+0100 [conn3958] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [mongosMain] connection accepted from 172.28.0.164:61305 #4043 (301 connections now open) 2015-10-05T13:39:09.693+0100 [conn3964] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3963] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3982] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3969] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3960] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [conn3966] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.693+0100 [mongosMain] connection accepted from 172.28.0.164:61306 #4044 (302 connections now open) 2015-10-05T13:39:09.694+0100 [conn3965] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [mongosMain] connection accepted from 172.28.0.164:61307 #4045 (303 connections now open) 2015-10-05T13:39:09.694+0100 [conn3967] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3957] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3973] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [mongosMain] connection accepted from 172.28.0.164:61308 #4046 (304 connections now open) 2015-10-05T13:39:09.694+0100 [conn3970] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3968] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3974] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [mongosMain] connection accepted from 172.28.0.164:61309 #4047 (305 connections now open) 2015-10-05T13:39:09.694+0100 [conn3975] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3972] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3959] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [conn3976] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.694+0100 [mongosMain] connection accepted from 172.28.0.164:61310 #4048 (306 connections now open) 2015-10-05T13:39:09.695+0100 [conn3980] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.695+0100 [mongosMain] connection accepted from 172.28.0.164:61311 #4049 (307 connections now open) 2015-10-05T13:39:09.695+0100 [mongosMain] connection accepted from 172.28.0.164:61312 #4050 (308 connections now open) 2015-10-05T13:39:09.696+0100 [conn3962] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.696+0100 [conn3971] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.696+0100 [conn3941] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.697+0100 [conn3927] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.697+0100 [conn3961] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.697+0100 [mongosMain] connection accepted from 172.28.0.164:61313 #4051 (309 connections now open) 2015-10-05T13:39:09.697+0100 [mongosMain] connection accepted from 172.28.0.164:61315 #4052 (310 connections now open) 2015-10-05T13:39:09.698+0100 [mongosMain] connection accepted from 172.28.0.164:61314 #4053 (311 connections now open) 2015-10-05T13:39:09.698+0100 [mongosMain] connection accepted from 172.28.0.164:61316 #4054 (312 connections now open) 2015-10-05T13:39:09.698+0100 [mongosMain] connection accepted from 172.28.0.164:61317 #4055 (313 connections now open) 2015-10-05T13:39:09.699+0100 [mongosMain] connection accepted from 172.28.0.164:61318 #4056 (314 connections now open) 2015-10-05T13:39:09.699+0100 [mongosMain] connection accepted from 172.28.0.164:61319 #4057 (315 connections now open) 2015-10-05T13:39:09.699+0100 [mongosMain] connection accepted from 172.28.0.164:61320 #4058 (316 connections now open) 2015-10-05T13:39:09.699+0100 [mongosMain] connection accepted from 172.28.0.164:61321 #4059 (317 connections now open) 2015-10-05T13:39:09.700+0100 [mongosMain] connection accepted from 172.28.0.164:61322 #4060 (318 connections now open) 2015-10-05T13:39:09.700+0100 [mongosMain] connection accepted from 172.28.0.164:61323 #4061 (319 connections now open) 2015-10-05T13:39:09.701+0100 [mongosMain] connection accepted from 172.28.0.164:61324 #4062 (320 connections now open) 2015-10-05T13:39:09.701+0100 [mongosMain] connection accepted from 172.28.0.164:61325 #4063 (321 connections now open) 2015-10-05T13:39:09.702+0100 [mongosMain] connection accepted from 172.28.0.164:61326 #4064 (322 connections now open) 2015-10-05T13:39:09.702+0100 [mongosMain] connection accepted from 172.28.0.164:61328 #4065 (323 connections now open) 2015-10-05T13:39:09.702+0100 [conn3921] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.702+0100 [mongosMain] connection accepted from 172.28.0.164:61327 #4066 (324 connections now open) 2015-10-05T13:39:09.703+0100 [mongosMain] connection accepted from 172.28.0.164:61329 #4067 (325 connections now open) 2015-10-05T13:39:09.703+0100 [mongosMain] connection accepted from 172.28.0.164:61330 #4068 (326 connections now open) 2015-10-05T13:39:09.703+0100 [mongosMain] connection accepted from 172.28.0.164:61331 #4069 (327 connections now open) 2015-10-05T13:39:09.704+0100 [mongosMain] connection accepted from 172.28.0.164:61333 #4070 (328 connections now open) 2015-10-05T13:39:09.704+0100 [mongosMain] connection accepted from 172.28.0.164:61332 #4071 (329 connections now open) 2015-10-05T13:39:09.704+0100 [mongosMain] connection accepted from 172.28.0.164:61334 #4072 (330 connections now open) 2015-10-05T13:39:09.704+0100 [mongosMain] connection accepted from 172.28.0.164:61335 #4073 (331 connections now open) 2015-10-05T13:39:09.705+0100 [mongosMain] connection accepted from 172.28.0.164:61336 #4074 (332 connections now open) 2015-10-05T13:39:09.705+0100 [mongosMain] connection accepted from 172.28.0.164:61337 #4075 (333 connections now open) 2015-10-05T13:39:09.705+0100 [mongosMain] connection accepted from 172.28.0.164:61338 #4076 (334 connections now open) 2015-10-05T13:39:09.706+0100 [mongosMain] connection accepted from 172.28.0.164:61339 #4077 (335 connections now open) 2015-10-05T13:39:09.706+0100 [mongosMain] connection accepted from 172.28.0.164:61343 #4078 (336 connections now open) 2015-10-05T13:39:09.706+0100 [mongosMain] connection accepted from 172.28.0.164:61341 #4079 (337 connections now open) 2015-10-05T13:39:09.706+0100 [mongosMain] connection accepted from 172.28.0.164:61342 #4080 (338 connections now open) 2015-10-05T13:39:09.706+0100 [mongosMain] connection accepted from 172.28.0.164:61344 #4081 (339 connections now open) 2015-10-05T13:39:09.707+0100 [mongosMain] connection accepted from 172.28.0.164:61345 #4082 (340 connections now open) 2015-10-05T13:39:09.707+0100 [mongosMain] connection accepted from 172.28.0.164:61346 #4083 (341 connections now open) 2015-10-05T13:39:09.707+0100 [mongosMain] connection accepted from 172.28.0.164:61340 #4084 (342 connections now open) 2015-10-05T13:39:09.707+0100 [mongosMain] connection accepted from 172.28.0.164:61347 #4085 (343 connections now open) 2015-10-05T13:39:09.708+0100 [mongosMain] connection accepted from 172.28.0.164:61348 #4086 (344 connections now open) 2015-10-05T13:39:09.708+0100 [mongosMain] connection accepted from 172.28.0.164:61349 #4087 (345 connections now open) 2015-10-05T13:39:09.708+0100 [mongosMain] connection accepted from 172.28.0.164:61350 #4088 (346 connections now open) 2015-10-05T13:39:09.708+0100 [mongosMain] connection accepted from 172.28.0.164:61351 #4089 (347 connections now open) 2015-10-05T13:39:09.709+0100 [mongosMain] connection accepted from 172.28.0.164:61352 #4090 (348 connections now open) 2015-10-05T13:39:09.709+0100 [mongosMain] connection accepted from 172.28.0.164:61355 #4091 (349 connections now open) 2015-10-05T13:39:09.709+0100 [mongosMain] connection accepted from 172.28.0.164:61354 #4092 (350 connections now open) 2015-10-05T13:39:09.710+0100 [mongosMain] connection accepted from 172.28.0.164:61353 #4093 (351 connections now open) 2015-10-05T13:39:09.710+0100 [mongosMain] connection accepted from 172.28.0.164:61356 #4094 (352 connections now open) 2015-10-05T13:39:09.710+0100 [mongosMain] connection accepted from 172.28.0.164:61357 #4095 (353 connections now open) 2015-10-05T13:39:09.710+0100 [mongosMain] connection accepted from 172.28.0.164:61358 #4096 (354 connections now open) 2015-10-05T13:39:09.711+0100 [mongosMain] connection accepted from 172.28.0.164:61359 #4097 (355 connections now open) 2015-10-05T13:39:09.711+0100 [mongosMain] connection accepted from 172.28.0.164:61361 #4098 (356 connections now open) 2015-10-05T13:39:09.711+0100 [mongosMain] connection accepted from 172.28.0.164:61362 #4099 (357 connections now open) 2015-10-05T13:39:09.712+0100 [mongosMain] connection accepted from 172.28.0.164:61363 #4100 (358 connections now open) 2015-10-05T13:39:09.712+0100 [conn4002] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [mongosMain] connection accepted from 172.28.0.164:61364 #4101 (359 connections now open) 2015-10-05T13:39:09.712+0100 [conn3998] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [conn3999] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [conn4005] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [conn4001] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [conn4003] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [mongosMain] connection accepted from 172.28.0.164:61365 #4102 (360 connections now open) 2015-10-05T13:39:09.712+0100 [conn4000] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.712+0100 [mongosMain] connection accepted from 172.28.0.164:61366 #4103 (361 connections now open) 2015-10-05T13:39:09.713+0100 [conn4004] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.713+0100 [mongosMain] connection accepted from 172.28.0.164:61368 #4104 (362 connections now open) 2015-10-05T13:39:09.713+0100 [mongosMain] connection accepted from 172.28.0.164:61369 #4105 (363 connections now open) 2015-10-05T13:39:09.713+0100 [mongosMain] connection accepted from 172.28.0.164:61370 #4106 (364 connections now open) 2015-10-05T13:39:09.714+0100 [mongosMain] connection accepted from 172.28.0.164:61371 #4107 (365 connections now open) 2015-10-05T13:39:09.714+0100 [conn3955] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.714+0100 [mongosMain] connection accepted from 172.28.0.164:61372 #4108 (366 connections now open) 2015-10-05T13:39:09.714+0100 [mongosMain] connection accepted from 172.28.0.164:61373 #4109 (367 connections now open) 2015-10-05T13:39:09.715+0100 [mongosMain] connection accepted from 172.28.0.164:61367 #4110 (368 connections now open) 2015-10-05T13:39:09.715+0100 [mongosMain] connection accepted from 172.28.0.164:61360 #4111 (369 connections now open) 2015-10-05T13:39:09.715+0100 [mongosMain] connection accepted from 172.28.0.164:61374 #4112 (370 connections now open) 2015-10-05T13:39:09.716+0100 [mongosMain] connection accepted from 172.28.0.164:61376 #4113 (371 connections now open) 2015-10-05T13:39:09.716+0100 [mongosMain] connection accepted from 172.28.0.164:61375 #4114 (372 connections now open) 2015-10-05T13:39:09.716+0100 [mongosMain] connection accepted from 172.28.0.164:61377 #4115 (373 connections now open) 2015-10-05T13:39:09.716+0100 [mongosMain] connection accepted from 172.28.0.164:61378 #4116 (374 connections now open) 2015-10-05T13:39:09.717+0100 [mongosMain] connection accepted from 172.28.0.164:61379 #4117 (375 connections now open) 2015-10-05T13:39:09.717+0100 [mongosMain] connection accepted from 172.28.0.164:61380 #4118 (376 connections now open) 2015-10-05T13:39:09.720+0100 [conn4006] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.721+0100 [conn4007] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.721+0100 [conn4010] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.721+0100 [conn4009] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.721+0100 [conn4011] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.722+0100 [conn4013] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.722+0100 [conn4012] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.724+0100 [conn4015] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.725+0100 [mongosMain] connection accepted from 172.28.0.164:61381 #4119 (377 connections now open) 2015-10-05T13:39:09.726+0100 [mongosMain] connection accepted from 172.28.0.164:61382 #4120 (378 connections now open) 2015-10-05T13:39:09.726+0100 [conn4018] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.727+0100 [conn4017] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.727+0100 [mongosMain] connection accepted from 172.28.0.164:61383 #4121 (379 connections now open) 2015-10-05T13:39:09.727+0100 [conn4016] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.802+0100 [conn4020] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.802+0100 [conn4019] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.802+0100 [conn4008] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.803+0100 [mongosMain] connection accepted from 172.28.0.164:61384 #4122 (380 connections now open) 2015-10-05T13:39:09.805+0100 [conn4021] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.806+0100 [conn4023] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.808+0100 [conn4024] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.810+0100 [conn4014] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.819+0100 [conn4026] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.819+0100 [mongosMain] connection accepted from 172.28.0.164:61385 #4123 (381 connections now open) 2015-10-05T13:39:09.820+0100 [conn4025] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.820+0100 [mongosMain] connection accepted from 172.28.0.164:61386 #4124 (382 connections now open) 2015-10-05T13:39:09.820+0100 [mongosMain] connection accepted from 172.28.0.164:61387 #4125 (383 connections now open) 2015-10-05T13:39:09.820+0100 [mongosMain] connection accepted from 172.28.0.164:61388 #4126 (384 connections now open) 2015-10-05T13:39:09.821+0100 [mongosMain] connection accepted from 172.28.0.164:61389 #4127 (385 connections now open) 2015-10-05T13:39:09.821+0100 [mongosMain] connection accepted from 172.28.0.164:61390 #4128 (386 connections now open) 2015-10-05T13:39:09.821+0100 [conn4031] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.825+0100 [mongosMain] connection accepted from 172.28.0.164:61391 #4129 (387 connections now open) 2015-10-05T13:39:09.826+0100 [mongosMain] connection accepted from 172.28.0.164:61392 #4130 (388 connections now open) 2015-10-05T13:39:09.826+0100 [mongosMain] connection accepted from 172.28.0.164:61393 #4131 (389 connections now open) 2015-10-05T13:39:09.829+0100 [mongosMain] connection accepted from 172.28.0.164:61394 #4132 (390 connections now open) 2015-10-05T13:39:09.831+0100 [mongosMain] connection accepted from 172.28.0.164:61395 #4133 (391 connections now open) 2015-10-05T13:39:09.831+0100 [mongosMain] connection accepted from 172.28.0.164:61396 #4134 (392 connections now open) 2015-10-05T13:39:09.833+0100 [mongosMain] connection accepted from 172.28.0.164:61397 #4135 (393 connections now open) 2015-10-05T13:39:09.834+0100 [mongosMain] connection accepted from 172.28.0.164:61398 #4136 (394 connections now open) 2015-10-05T13:39:09.834+0100 [conn4030] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.834+0100 [conn4032] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.834+0100 [mongosMain] connection accepted from 172.28.0.164:61399 #4137 (395 connections now open) 2015-10-05T13:39:09.834+0100 [conn4033] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.835+0100 [conn4027] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.835+0100 [mongosMain] connection accepted from 172.28.0.164:61400 #4138 (396 connections now open) 2015-10-05T13:39:09.835+0100 [mongosMain] connection accepted from 172.28.0.164:61401 #4139 (397 connections now open) 2015-10-05T13:39:09.837+0100 [conn4028] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.837+0100 [conn4029] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.837+0100 [conn4034] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.840+0100 [conn4043] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.841+0100 [conn4040] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.841+0100 [conn4039] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.842+0100 [conn4035] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.842+0100 [conn4041] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.842+0100 [conn4038] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.842+0100 [conn4036] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.842+0100 [conn4037] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.843+0100 [conn4042] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.852+0100 [mongosMain] connection accepted from 172.28.0.164:61402 #4140 (398 connections now open) 2015-10-05T13:39:09.852+0100 [conn4047] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.852+0100 [conn4045] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.852+0100 [conn4048] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.853+0100 [conn4044] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.853+0100 [conn4046] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.855+0100 [conn4051] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.855+0100 [conn4050] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.855+0100 [conn4052] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.855+0100 [conn4053] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.866+0100 [conn4057] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.866+0100 [conn4049] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.867+0100 [conn4058] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.877+0100 [conn4022] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.915+0100 [mongosMain] connection accepted from 172.28.0.164:61403 #4141 (399 connections now open) 2015-10-05T13:39:09.918+0100 [mongosMain] connection accepted from 172.28.0.164:61404 #4142 (400 connections now open) 2015-10-05T13:39:09.918+0100 [mongosMain] connection accepted from 172.28.0.164:61405 #4143 (401 connections now open) 2015-10-05T13:39:09.918+0100 [mongosMain] connection accepted from 172.28.0.164:61406 #4144 (402 connections now open) 2015-10-05T13:39:09.919+0100 [mongosMain] connection accepted from 172.28.0.164:61407 #4145 (403 connections now open) 2015-10-05T13:39:09.919+0100 [mongosMain] connection accepted from 172.28.0.164:61408 #4146 (404 connections now open) 2015-10-05T13:39:09.919+0100 [mongosMain] connection accepted from 172.28.0.164:61409 #4147 (405 connections now open) 2015-10-05T13:39:09.920+0100 [mongosMain] connection accepted from 172.28.0.164:61410 #4148 (406 connections now open) 2015-10-05T13:39:09.920+0100 [mongosMain] connection accepted from 172.28.0.164:61411 #4149 (407 connections now open) 2015-10-05T13:39:09.920+0100 [mongosMain] connection accepted from 172.28.0.164:61413 #4150 (408 connections now open) 2015-10-05T13:39:09.921+0100 [mongosMain] connection accepted from 172.28.0.164:61412 #4151 (409 connections now open) 2015-10-05T13:39:09.921+0100 [mongosMain] connection accepted from 172.28.0.164:61415 #4152 (410 connections now open) 2015-10-05T13:39:09.921+0100 [conn4059] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.921+0100 [mongosMain] connection accepted from 172.28.0.164:61416 #4153 (411 connections now open) 2015-10-05T13:39:09.921+0100 [conn4056] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.921+0100 [conn4055] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [mongosMain] connection accepted from 172.28.0.164:61418 #4154 (412 connections now open) 2015-10-05T13:39:09.922+0100 [conn4054] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4060] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [mongosMain] connection accepted from 172.28.0.164:61417 #4155 (413 connections now open) 2015-10-05T13:39:09.922+0100 [conn4061] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4063] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4062] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4067] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4064] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.922+0100 [conn4068] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4071] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4066] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4069] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4073] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4065] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.923+0100 [conn4070] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.924+0100 [conn4072] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4105] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4108] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4099] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4107] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4102] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4112] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4104] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4101] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4075] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.926+0100 [conn4074] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.929+0100 [conn4092] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.929+0100 [conn4077] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.929+0100 [conn4111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.929+0100 [conn4097] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.929+0100 [conn4079] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4084] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4114] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4083] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4080] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4078] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4085] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4076] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4086] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4087] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4082] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4110] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4081] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4089] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.930+0100 [conn4088] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.931+0100 [conn4090] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.931+0100 [conn4091] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.931+0100 [conn4093] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.956+0100 [conn4098] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.956+0100 [mongosMain] connection accepted from 172.28.0.164:61425 #4156 (414 connections now open) 2015-10-05T13:39:09.957+0100 [conn4094] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.957+0100 [mongosMain] connection accepted from 172.28.0.164:61426 #4157 (415 connections now open) 2015-10-05T13:39:09.957+0100 [conn4096] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.958+0100 [mongosMain] connection accepted from 172.28.0.164:61419 #4158 (416 connections now open) 2015-10-05T13:39:09.958+0100 [conn4115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.958+0100 [mongosMain] connection accepted from 172.28.0.164:61427 #4159 (417 connections now open) 2015-10-05T13:39:09.959+0100 [mongosMain] connection accepted from 172.28.0.164:61422 #4160 (418 connections now open) 2015-10-05T13:39:09.960+0100 [mongosMain] connection accepted from 172.28.0.164:61420 #4161 (419 connections now open) 2015-10-05T13:39:09.961+0100 [conn4117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.962+0100 [conn4116] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.962+0100 [mongosMain] connection accepted from 172.28.0.164:61429 #4162 (420 connections now open) 2015-10-05T13:39:09.962+0100 [mongosMain] connection accepted from 172.28.0.164:61430 #4163 (421 connections now open) 2015-10-05T13:39:09.962+0100 [mongosMain] connection accepted from 172.28.0.164:61432 #4164 (422 connections now open) 2015-10-05T13:39:09.963+0100 [mongosMain] connection accepted from 172.28.0.164:61431 #4165 (423 connections now open) 2015-10-05T13:39:09.964+0100 [mongosMain] connection accepted from 172.28.0.164:61433 #4166 (424 connections now open) 2015-10-05T13:39:09.964+0100 [mongosMain] connection accepted from 172.28.0.164:61434 #4167 (425 connections now open) 2015-10-05T13:39:09.965+0100 [mongosMain] connection accepted from 172.28.0.164:61435 #4168 (426 connections now open) 2015-10-05T13:39:09.966+0100 [conn4106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.966+0100 [mongosMain] connection accepted from 172.28.0.164:61436 #4169 (427 connections now open) 2015-10-05T13:39:09.968+0100 [mongosMain] connection accepted from 172.28.0.164:61437 #4170 (428 connections now open) 2015-10-05T13:39:09.970+0100 [mongosMain] connection accepted from 172.28.0.164:61428 #4171 (429 connections now open) 2015-10-05T13:39:09.975+0100 [mongosMain] connection accepted from 172.28.0.164:61438 #4172 (430 connections now open) 2015-10-05T13:39:09.976+0100 [mongosMain] connection accepted from 172.28.0.164:61439 #4173 (431 connections now open) 2015-10-05T13:39:09.976+0100 [mongosMain] connection accepted from 172.28.0.164:61440 #4174 (432 connections now open) 2015-10-05T13:39:09.977+0100 [mongosMain] connection accepted from 172.28.0.164:61441 #4175 (433 connections now open) 2015-10-05T13:39:09.978+0100 [mongosMain] connection accepted from 172.28.0.164:61442 #4176 (434 connections now open) 2015-10-05T13:39:09.978+0100 [mongosMain] connection accepted from 172.28.0.164:61443 #4177 (435 connections now open) 2015-10-05T13:39:09.979+0100 [mongosMain] connection accepted from 172.28.0.164:61444 #4178 (436 connections now open) 2015-10-05T13:39:09.984+0100 [mongosMain] connection accepted from 172.28.0.164:61446 #4179 (437 connections now open) 2015-10-05T13:39:09.985+0100 [mongosMain] connection accepted from 172.28.0.164:61445 #4180 (438 connections now open) 2015-10-05T13:39:09.985+0100 [mongosMain] connection accepted from 172.28.0.164:61447 #4181 (439 connections now open) 2015-10-05T13:39:09.988+0100 [conn4118] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:09.997+0100 [mongosMain] connection accepted from 172.28.0.164:61449 #4182 (440 connections now open) 2015-10-05T13:39:09.998+0100 [mongosMain] connection accepted from 172.28.0.164:61450 #4183 (441 connections now open) 2015-10-05T13:39:09.999+0100 [mongosMain] connection accepted from 172.28.0.164:61452 #4184 (442 connections now open) 2015-10-05T13:39:09.999+0100 [mongosMain] connection accepted from 172.28.0.164:61451 #4185 (443 connections now open) 2015-10-05T13:39:10.000+0100 [mongosMain] connection accepted from 172.28.0.164:61453 #4186 (444 connections now open) 2015-10-05T13:39:10.000+0100 [conn4095] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.000+0100 [mongosMain] connection accepted from 172.28.0.164:61455 #4187 (445 connections now open) 2015-10-05T13:39:10.001+0100 [mongosMain] connection accepted from 172.28.0.164:61454 #4188 (446 connections now open) 2015-10-05T13:39:10.001+0100 [mongosMain] connection accepted from 172.28.0.164:61456 #4189 (447 connections now open) 2015-10-05T13:39:10.002+0100 [conn4103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.006+0100 [conn4122] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.006+0100 [conn4119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.014+0100 [conn4120] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.017+0100 [conn4121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.043+0100 [mongosMain] connection accepted from 172.28.0.164:61423 #4190 (448 connections now open) 2015-10-05T13:39:10.043+0100 [mongosMain] connection accepted from 172.28.0.164:61421 #4191 (449 connections now open) 2015-10-05T13:39:10.046+0100 [mongosMain] connection accepted from 172.28.0.164:61424 #4192 (450 connections now open) 2015-10-05T13:39:10.069+0100 [conn4135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4126] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.069+0100 [conn4139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.070+0100 [conn4133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.071+0100 [conn4136] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.072+0100 [conn4124] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.072+0100 [conn4128] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.080+0100 [conn4132] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.085+0100 [conn4123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.151+0100 [conn4131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.151+0100 [mongosMain] connection accepted from 172.28.0.164:61466 #4193 (451 connections now open) 2015-10-05T13:39:10.151+0100 [mongosMain] connection accepted from 172.28.0.164:61475 #4194 (452 connections now open) 2015-10-05T13:39:10.151+0100 [mongosMain] connection accepted from 172.28.0.164:61464 #4195 (453 connections now open) 2015-10-05T13:39:10.152+0100 [mongosMain] connection accepted from 172.28.0.164:61463 #4196 (454 connections now open) 2015-10-05T13:39:10.152+0100 [mongosMain] connection accepted from 172.28.0.164:61471 #4197 (455 connections now open) 2015-10-05T13:39:10.152+0100 [conn4140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.152+0100 [mongosMain] connection accepted from 172.28.0.164:61469 #4198 (456 connections now open) 2015-10-05T13:39:10.152+0100 [mongosMain] connection accepted from 172.28.0.164:61470 #4199 (457 connections now open) 2015-10-05T13:39:10.153+0100 [mongosMain] connection accepted from 172.28.0.164:61467 #4200 (458 connections now open) 2015-10-05T13:39:10.153+0100 [mongosMain] connection accepted from 172.28.0.164:61473 #4201 (459 connections now open) 2015-10-05T13:39:10.154+0100 [mongosMain] connection accepted from 172.28.0.164:61462 #4202 (460 connections now open) 2015-10-05T13:39:10.154+0100 [mongosMain] connection accepted from 172.28.0.164:61457 #4203 (461 connections now open) 2015-10-05T13:39:10.155+0100 [mongosMain] connection accepted from 172.28.0.164:61465 #4204 (462 connections now open) 2015-10-05T13:39:10.172+0100 [mongosMain] connection accepted from 172.28.0.164:61474 #4205 (463 connections now open) 2015-10-05T13:39:10.172+0100 [mongosMain] connection accepted from 172.28.0.164:61458 #4206 (464 connections now open) 2015-10-05T13:39:10.173+0100 [mongosMain] connection accepted from 172.28.0.164:61476 #4207 (465 connections now open) 2015-10-05T13:39:10.189+0100 [mongosMain] connection accepted from 172.28.0.164:61459 #4208 (466 connections now open) 2015-10-05T13:39:10.191+0100 [mongosMain] connection accepted from 172.28.0.164:61478 #4209 (467 connections now open) 2015-10-05T13:39:10.195+0100 [mongosMain] connection accepted from 172.28.0.164:61460 #4210 (468 connections now open) 2015-10-05T13:39:10.202+0100 [mongosMain] connection accepted from 172.28.0.164:61468 #4211 (469 connections now open) 2015-10-05T13:39:10.202+0100 [mongosMain] connection accepted from 172.28.0.164:61472 #4212 (470 connections now open) 2015-10-05T13:39:10.205+0100 [mongosMain] connection accepted from 172.28.0.164:61477 #4213 (471 connections now open) 2015-10-05T13:39:10.230+0100 [mongosMain] connection accepted from 172.28.0.164:61479 #4214 (472 connections now open) 2015-10-05T13:39:10.231+0100 [conn4145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.238+0100 [conn4134] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.238+0100 [conn4130] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.238+0100 [conn4127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.239+0100 [conn4144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.239+0100 [mongosMain] connection accepted from 172.28.0.164:61461 #4215 (473 connections now open) 2015-10-05T13:39:10.241+0100 [conn4146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.241+0100 [conn4153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.241+0100 [mongosMain] connection accepted from 172.28.0.164:61481 #4216 (474 connections now open) 2015-10-05T13:39:10.241+0100 [conn4152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.242+0100 [mongosMain] connection accepted from 172.28.0.164:61482 #4217 (475 connections now open) 2015-10-05T13:39:10.242+0100 [conn4154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.242+0100 [conn4143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.244+0100 [conn4148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.245+0100 [conn4141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.273+0100 [mongosMain] connection accepted from 172.28.0.164:61492 #4218 (476 connections now open) 2015-10-05T13:39:10.274+0100 [mongosMain] connection accepted from 172.28.0.164:61493 #4219 (477 connections now open) 2015-10-05T13:39:10.274+0100 [mongosMain] connection accepted from 172.28.0.164:61494 #4220 (478 connections now open) 2015-10-05T13:39:10.275+0100 [mongosMain] connection accepted from 172.28.0.164:61495 #4221 (479 connections now open) 2015-10-05T13:39:10.275+0100 [mongosMain] connection accepted from 172.28.0.164:61496 #4222 (480 connections now open) 2015-10-05T13:39:10.276+0100 [mongosMain] connection accepted from 172.28.0.164:61497 #4223 (481 connections now open) 2015-10-05T13:39:10.276+0100 [mongosMain] connection accepted from 172.28.0.164:61498 #4224 (482 connections now open) 2015-10-05T13:39:10.277+0100 [mongosMain] connection accepted from 172.28.0.164:61499 #4225 (483 connections now open) 2015-10-05T13:39:10.277+0100 [mongosMain] connection accepted from 172.28.0.164:61500 #4226 (484 connections now open) 2015-10-05T13:39:10.277+0100 [mongosMain] connection accepted from 172.28.0.164:61501 #4227 (485 connections now open) 2015-10-05T13:39:10.278+0100 [mongosMain] connection accepted from 172.28.0.164:61502 #4228 (486 connections now open) 2015-10-05T13:39:10.278+0100 [mongosMain] connection accepted from 172.28.0.164:61504 #4229 (487 connections now open) 2015-10-05T13:39:10.279+0100 [mongosMain] connection accepted from 172.28.0.164:61503 #4230 (488 connections now open) 2015-10-05T13:39:10.279+0100 [mongosMain] connection accepted from 172.28.0.164:61505 #4231 (489 connections now open) 2015-10-05T13:39:10.279+0100 [mongosMain] connection accepted from 172.28.0.164:61506 #4232 (490 connections now open) 2015-10-05T13:39:10.280+0100 [mongosMain] connection accepted from 172.28.0.164:61507 #4233 (491 connections now open) 2015-10-05T13:39:10.280+0100 [mongosMain] connection accepted from 172.28.0.164:61508 #4234 (492 connections now open) 2015-10-05T13:39:10.280+0100 [mongosMain] connection accepted from 172.28.0.164:61509 #4235 (493 connections now open) 2015-10-05T13:39:10.280+0100 [mongosMain] connection accepted from 172.28.0.164:61510 #4236 (494 connections now open) 2015-10-05T13:39:10.281+0100 [mongosMain] connection accepted from 172.28.0.164:61511 #4237 (495 connections now open) 2015-10-05T13:39:10.281+0100 [mongosMain] connection accepted from 172.28.0.164:61512 #4238 (496 connections now open) 2015-10-05T13:39:10.281+0100 [mongosMain] connection accepted from 172.28.0.164:61513 #4239 (497 connections now open) 2015-10-05T13:39:10.282+0100 [mongosMain] connection accepted from 172.28.0.164:61515 #4240 (498 connections now open) 2015-10-05T13:39:10.282+0100 [mongosMain] connection accepted from 172.28.0.164:61514 #4241 (499 connections now open) 2015-10-05T13:39:10.283+0100 [mongosMain] connection accepted from 172.28.0.164:61516 #4242 (500 connections now open) 2015-10-05T13:39:10.283+0100 [mongosMain] connection accepted from 172.28.0.164:61517 #4243 (501 connections now open) 2015-10-05T13:39:10.283+0100 [mongosMain] connection accepted from 172.28.0.164:61518 #4244 (502 connections now open) 2015-10-05T13:39:10.283+0100 [mongosMain] connection accepted from 172.28.0.164:61519 #4245 (503 connections now open) 2015-10-05T13:39:10.284+0100 [mongosMain] connection accepted from 172.28.0.164:61520 #4246 (504 connections now open) 2015-10-05T13:39:10.284+0100 [mongosMain] connection accepted from 172.28.0.164:61521 #4247 (505 connections now open) 2015-10-05T13:39:10.285+0100 [mongosMain] connection accepted from 172.28.0.164:61522 #4248 (506 connections now open) 2015-10-05T13:39:10.285+0100 [mongosMain] connection accepted from 172.28.0.164:61523 #4249 (507 connections now open) 2015-10-05T13:39:10.287+0100 [mongosMain] connection accepted from 172.28.0.164:61524 #4250 (508 connections now open) 2015-10-05T13:39:10.288+0100 [conn4155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.288+0100 [mongosMain] connection accepted from 172.28.0.164:61525 #4251 (509 connections now open) 2015-10-05T13:39:10.289+0100 [conn4150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.292+0100 [conn4151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.292+0100 [conn4165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.292+0100 [conn4157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.292+0100 [conn4160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.293+0100 [conn4162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.293+0100 [conn4166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.293+0100 [conn4147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.293+0100 [conn4159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.293+0100 [conn4158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.300+0100 [conn4164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.360+0100 [mongosMain] connection accepted from 172.28.0.164:61533 #4252 (510 connections now open) 2015-10-05T13:39:10.361+0100 [conn4169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.362+0100 [conn4156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.364+0100 [mongosMain] connection accepted from 172.28.0.164:61528 #4253 (511 connections now open) 2015-10-05T13:39:10.386+0100 [mongosMain] connection accepted from 172.28.0.164:61530 #4254 (512 connections now open) 2015-10-05T13:39:10.388+0100 [mongosMain] connection accepted from 172.28.0.164:61532 #4255 (513 connections now open) 2015-10-05T13:39:10.388+0100 [mongosMain] connection accepted from 172.28.0.164:61534 #4256 (514 connections now open) 2015-10-05T13:39:10.389+0100 [conn4142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.390+0100 [mongosMain] connection accepted from 172.28.0.164:61531 #4257 (515 connections now open) 2015-10-05T13:39:10.390+0100 [mongosMain] connection accepted from 172.28.0.164:61536 #4258 (516 connections now open) 2015-10-05T13:39:10.393+0100 [mongosMain] connection accepted from 172.28.0.164:61535 #4259 (517 connections now open) 2015-10-05T13:39:10.396+0100 [mongosMain] connection accepted from 172.28.0.164:61527 #4260 (518 connections now open) 2015-10-05T13:39:10.403+0100 [mongosMain] connection accepted from 172.28.0.164:61539 #4261 (519 connections now open) 2015-10-05T13:39:10.405+0100 [conn4163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.405+0100 [conn4171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.405+0100 [conn4161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.411+0100 [mongosMain] connection accepted from 172.28.0.164:61526 #4262 (520 connections now open) 2015-10-05T13:39:10.411+0100 [mongosMain] connection accepted from 172.28.0.164:61540 #4263 (521 connections now open) 2015-10-05T13:39:10.412+0100 [conn4170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.413+0100 [mongosMain] connection accepted from 172.28.0.164:61541 #4264 (522 connections now open) 2015-10-05T13:39:10.417+0100 [mongosMain] connection accepted from 172.28.0.164:61542 #4265 (523 connections now open) 2015-10-05T13:39:10.419+0100 [mongosMain] connection accepted from 172.28.0.164:61543 #4266 (524 connections now open) 2015-10-05T13:39:10.422+0100 [mongosMain] connection accepted from 172.28.0.164:61529 #4267 (525 connections now open) 2015-10-05T13:39:10.423+0100 [mongosMain] connection accepted from 172.28.0.164:61544 #4268 (526 connections now open) 2015-10-05T13:39:10.433+0100 [conn4149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.433+0100 [mongosMain] connection accepted from 172.28.0.164:61545 #4269 (527 connections now open) 2015-10-05T13:39:10.433+0100 [conn4167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.434+0100 [conn4172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.435+0100 [conn4182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.435+0100 [conn4188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.436+0100 [conn4189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.587+0100 [conn4176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.587+0100 [mongosMain] connection accepted from 172.28.0.164:61559 #4270 (528 connections now open) 2015-10-05T13:39:10.587+0100 [conn3870] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.587+0100 [mongosMain] connection accepted from 172.28.0.164:61551 #4271 (529 connections now open) 2015-10-05T13:39:10.588+0100 [mongosMain] connection accepted from 172.28.0.164:61556 #4272 (530 connections now open) 2015-10-05T13:39:10.588+0100 [conn4174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.588+0100 [conn4181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.588+0100 [mongosMain] connection accepted from 172.28.0.164:61557 #4273 (531 connections now open) 2015-10-05T13:39:10.589+0100 [conn4192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.589+0100 [mongosMain] connection accepted from 172.28.0.164:61577 #4274 (532 connections now open) 2015-10-05T13:39:10.590+0100 [mongosMain] connection accepted from 172.28.0.164:61554 #4275 (533 connections now open) 2015-10-05T13:39:10.590+0100 [mongosMain] connection accepted from 172.28.0.164:61561 #4276 (534 connections now open) 2015-10-05T13:39:10.591+0100 [mongosMain] connection accepted from 172.28.0.164:61578 #4277 (535 connections now open) 2015-10-05T13:39:10.592+0100 [mongosMain] connection accepted from 172.28.0.164:61562 #4278 (536 connections now open) 2015-10-05T13:39:10.593+0100 [mongosMain] connection accepted from 172.28.0.164:61566 #4279 (537 connections now open) 2015-10-05T13:39:10.593+0100 [mongosMain] connection accepted from 172.28.0.164:61571 #4280 (538 connections now open) 2015-10-05T13:39:10.597+0100 [mongosMain] connection accepted from 172.28.0.164:61547 #4281 (539 connections now open) 2015-10-05T13:39:10.597+0100 [mongosMain] connection accepted from 172.28.0.164:61576 #4282 (540 connections now open) 2015-10-05T13:39:10.598+0100 [mongosMain] connection accepted from 172.28.0.164:61568 #4283 (541 connections now open) 2015-10-05T13:39:10.598+0100 [mongosMain] connection accepted from 172.28.0.164:61572 #4284 (542 connections now open) 2015-10-05T13:39:10.602+0100 [mongosMain] connection accepted from 172.28.0.164:61575 #4285 (543 connections now open) 2015-10-05T13:39:10.602+0100 [mongosMain] connection accepted from 172.28.0.164:61555 #4286 (544 connections now open) 2015-10-05T13:39:10.602+0100 [conn4180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.603+0100 [mongosMain] connection accepted from 172.28.0.164:61565 #4287 (545 connections now open) 2015-10-05T13:39:10.603+0100 [mongosMain] connection accepted from 172.28.0.164:61558 #4288 (546 connections now open) 2015-10-05T13:39:10.603+0100 [mongosMain] connection accepted from 172.28.0.164:61574 #4289 (547 connections now open) 2015-10-05T13:39:10.605+0100 [mongosMain] connection accepted from 172.28.0.164:61549 #4290 (548 connections now open) 2015-10-05T13:39:10.606+0100 [mongosMain] connection accepted from 172.28.0.164:61563 #4291 (549 connections now open) 2015-10-05T13:39:10.610+0100 [conn4168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.611+0100 [mongosMain] connection accepted from 172.28.0.164:61569 #4292 (550 connections now open) 2015-10-05T13:39:10.612+0100 [mongosMain] connection accepted from 172.28.0.164:61573 #4293 (551 connections now open) 2015-10-05T13:39:10.613+0100 [mongosMain] connection accepted from 172.28.0.164:61550 #4294 (552 connections now open) 2015-10-05T13:39:10.615+0100 [mongosMain] connection accepted from 172.28.0.164:61567 #4295 (553 connections now open) 2015-10-05T13:39:10.616+0100 [conn4190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.618+0100 [conn4178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.620+0100 [conn3855] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.620+0100 [conn3857] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.621+0100 [conn3872] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.625+0100 [conn4185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.635+0100 [mongosMain] connection accepted from 172.28.0.164:61579 #4296 (554 connections now open) 2015-10-05T13:39:10.636+0100 [mongosMain] connection accepted from 172.28.0.164:61548 #4297 (555 connections now open) 2015-10-05T13:39:10.641+0100 [mongosMain] connection accepted from 172.28.0.164:61564 #4298 (556 connections now open) 2015-10-05T13:39:10.641+0100 [mongosMain] connection accepted from 172.28.0.164:61570 #4299 (557 connections now open) 2015-10-05T13:39:10.643+0100 [mongosMain] connection accepted from 172.28.0.164:61552 #4300 (558 connections now open) 2015-10-05T13:39:10.691+0100 [mongosMain] connection accepted from 172.28.0.164:61560 #4301 (559 connections now open) 2015-10-05T13:39:10.691+0100 [conn4173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.691+0100 [mongosMain] connection accepted from 172.28.0.164:61546 #4302 (560 connections now open) 2015-10-05T13:39:10.692+0100 [mongosMain] connection accepted from 172.28.0.164:61553 #4303 (561 connections now open) 2015-10-05T13:39:10.697+0100 [conn4195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.697+0100 [conn4201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.697+0100 [conn4196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.720+0100 [conn4193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.780+0100 [conn4191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.784+0100 [conn4205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.784+0100 [conn4207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.785+0100 [conn4202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.785+0100 [conn4208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.786+0100 [conn4204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.786+0100 [conn4210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.786+0100 [conn4212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.786+0100 [conn4206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.786+0100 [conn4199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.788+0100 [conn4209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.852+0100 [conn4194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.879+0100 [conn4197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.885+0100 [conn4213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.885+0100 [conn3997] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.888+0100 [conn4215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.890+0100 [conn4211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.890+0100 [conn4217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.890+0100 [conn4216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.896+0100 [conn4223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.898+0100 [conn4220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.898+0100 [conn4218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.898+0100 [conn4230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.907+0100 [conn4200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4244] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.910+0100 [conn4235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.912+0100 [conn4238] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.912+0100 [conn4247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.912+0100 [conn4251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.915+0100 [conn4232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.915+0100 [conn4243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.915+0100 [conn4241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.915+0100 [conn4239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4242] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.916+0100 [conn4236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.919+0100 [conn4245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.920+0100 [conn4256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.920+0100 [conn4254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.920+0100 [conn4240] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.920+0100 [conn4257] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.922+0100 [conn4253] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.922+0100 [conn4252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.946+0100 [conn4260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.957+0100 [conn4228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn3863] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn4267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn4259] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn3873] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn4255] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.958+0100 [conn4262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.959+0100 [conn4266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.959+0100 [conn4264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:10.959+0100 [conn4261] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.052+0100 [conn4249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.052+0100 [conn4265] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4263] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.163+0100 [conn4280] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.164+0100 [conn4290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.165+0100 [conn4286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.165+0100 [conn4284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.165+0100 [conn4287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.165+0100 [conn4291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.170+0100 [conn4295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.170+0100 [conn4292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.170+0100 [conn4294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.170+0100 [conn4293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.173+0100 [conn4302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.384+0100 [conn4270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.509+0100 [conn4269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.513+0100 [conn4296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.514+0100 [conn4203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.516+0100 [conn4214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.519+0100 [conn4222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:11.523+0100 [conn4301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:14.085+0100 [conn2727] end connection 172.28.0.163:55983 (560 connections now open) 2015-10-05T13:39:14.086+0100 [mongosMain] connection accepted from 172.28.0.163:58799 #4304 (561 connections now open) 2015-10-05T13:39:14.088+0100 [conn4304] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:14.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f7212deab02e2998c99 2015-10-05T13:39:14.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:39:29.064+0100 [mongosMain] connection accepted from 127.0.0.1:58808 #4305 (562 connections now open) 2015-10-05T13:39:29.067+0100 [conn4305] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:29.068+0100 [conn4305] end connection 127.0.0.1:58808 (561 connections now open) 2015-10-05T13:39:32.877+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f8412deab02e2998d78 2015-10-05T13:39:33.014+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:39:35.758+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:39:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:39:39.790+0100 [mongosMain] connection accepted from 127.0.0.1:58810 #4306 (562 connections now open) 2015-10-05T13:39:39.793+0100 [conn4306] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:39:39.793+0100 [conn4306] end connection 127.0.0.1:58810 (561 connections now open) 2015-10-05T13:39:51.295+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126f9712deab02e2998d79 2015-10-05T13:39:51.431+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:39:55.705+0100 [conn2411] end connection 172.28.0.164:57188 (560 connections now open) 2015-10-05T13:39:55.706+0100 [mongosMain] connection accepted from 172.28.0.164:61660 #4307 (561 connections now open) 2015-10-05T13:39:55.709+0100 [conn4307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:40:05.905+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:40:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:40:09.530+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56126fa7d67947988ef8964c') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444039191:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444039191:41", when: new Date(1444048809456), why: "doing balance round", ts: ObjectId('56126fa912deab02e2998d7b') } } gle1: { lastOp: Timestamp 1444048809000|3, connectionId: 36388, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1444048791000|10, connectionId: 34850, updatedExisting: false, n: 0, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T13:40:09.533+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444039191:41' not propagated. 2015-10-05T13:40:09.533+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:40:14.100+0100 [conn2728] end connection 172.28.0.163:55985 (560 connections now open) 2015-10-05T13:40:14.101+0100 [mongosMain] connection accepted from 172.28.0.163:58846 #4308 (561 connections now open) 2015-10-05T13:40:14.103+0100 [conn4308] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:40:15.676+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444039191:41' (another update won) 2015-10-05T13:40:15.676+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' was not acquired. 2015-10-05T13:40:21.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fb512deab02e2998d7d 2015-10-05T13:40:22.096+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:40:29.067+0100 [mongosMain] connection accepted from 127.0.0.1:58853 #4309 (562 connections now open) 2015-10-05T13:40:29.069+0100 [conn4309] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:40:29.071+0100 [conn4309] end connection 127.0.0.1:58853 (561 connections now open) 2015-10-05T13:40:36.262+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:40:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:40:36.262+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444039191:41 2015-10-05T13:40:36.433+0100 [LockPinger] handled late remove of old distributed lock with ts 56126fa912deab02e2998d7b 2015-10-05T13:40:39.430+0100 [mongosMain] connection accepted from 127.0.0.1:58855 #4310 (562 connections now open) 2015-10-05T13:40:39.432+0100 [conn4310] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:40:39.433+0100 [conn4310] end connection 127.0.0.1:58855 (561 connections now open) 2015-10-05T13:40:40.369+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fc812deab02e2998d7e 2015-10-05T13:40:40.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:40:46.611+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fce12deab02e2998d7f 2015-10-05T13:40:46.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:40:52.825+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fd412deab02e2998d80 2015-10-05T13:40:52.893+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:40:55.721+0100 [conn2419] end connection 172.28.0.164:57196 (560 connections now open) 2015-10-05T13:40:55.722+0100 [mongosMain] connection accepted from 172.28.0.164:61701 #4311 (561 connections now open) 2015-10-05T13:40:55.725+0100 [conn4311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:40:59.049+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fda12deab02e2998d81 2015-10-05T13:40:59.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:05.264+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fe112deab02e2998d82 2015-10-05T13:41:05.332+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:06.563+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:41:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:41:11.617+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126fe712deab02e2998d83 2015-10-05T13:41:11.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:14.116+0100 [conn2729] end connection 172.28.0.163:55986 (560 connections now open) 2015-10-05T13:41:14.118+0100 [mongosMain] connection accepted from 172.28.0.163:58889 #4312 (561 connections now open) 2015-10-05T13:41:14.119+0100 [conn4312] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:41:24.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 56126ff312deab02e2998d84 2015-10-05T13:41:24.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:28.425+0100 [mongosMain] connection accepted from 127.0.0.1:58896 #4313 (562 connections now open) 2015-10-05T13:41:28.428+0100 [conn4313] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:41:28.429+0100 [conn4313] end connection 127.0.0.1:58896 (561 connections now open) 2015-10-05T13:41:36.487+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612700012deab02e2998d85 2015-10-05T13:41:36.622+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:36.724+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:41:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:41:40.045+0100 [mongosMain] connection accepted from 127.0.0.1:58897 #4314 (562 connections now open) 2015-10-05T13:41:40.047+0100 [conn4314] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:41:40.048+0100 [conn4314] end connection 127.0.0.1:58897 (561 connections now open) 2015-10-05T13:41:48.820+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612700c12deab02e2998d86 2015-10-05T13:41:48.956+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:41:55.750+0100 [conn2417] end connection 172.28.0.164:57194 (560 connections now open) 2015-10-05T13:41:55.751+0100 [mongosMain] connection accepted from 172.28.0.164:61744 #4315 (561 connections now open) 2015-10-05T13:41:55.754+0100 [conn4315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:01.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612701812deab02e2998d87 2015-10-05T13:42:01.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:07.031+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:42:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:42:13.691+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612702512deab02e2998d88 2015-10-05T13:42:13.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:14.146+0100 [conn2730] end connection 172.28.0.163:55988 (560 connections now open) 2015-10-05T13:42:14.147+0100 [mongosMain] connection accepted from 172.28.0.163:58930 #4316 (561 connections now open) 2015-10-05T13:42:14.150+0100 [conn4316] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:20.035+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612702b12deab02e2998d89 2015-10-05T13:42:20.128+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:26.625+0100 [mongosMain] connection accepted from 172.28.0.163:58939 #4317 (562 connections now open) 2015-10-05T13:42:26.627+0100 [conn4317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.627+0100 [mongosMain] connection accepted from 172.28.0.163:58940 #4318 (563 connections now open) 2015-10-05T13:42:26.629+0100 [mongosMain] connection accepted from 172.28.0.163:58941 #4319 (564 connections now open) 2015-10-05T13:42:26.630+0100 [conn4318] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.631+0100 [mongosMain] connection accepted from 172.28.0.163:58942 #4320 (565 connections now open) 2015-10-05T13:42:26.633+0100 [conn4319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.634+0100 [mongosMain] connection accepted from 172.28.0.163:58943 #4321 (566 connections now open) 2015-10-05T13:42:26.634+0100 [conn4320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.634+0100 [mongosMain] connection accepted from 172.28.0.163:58944 #4322 (567 connections now open) 2015-10-05T13:42:26.648+0100 [mongosMain] connection accepted from 172.28.0.163:58945 #4323 (568 connections now open) 2015-10-05T13:42:26.648+0100 [mongosMain] connection accepted from 172.28.0.163:58946 #4324 (569 connections now open) 2015-10-05T13:42:26.649+0100 [mongosMain] connection accepted from 172.28.0.163:58947 #4325 (570 connections now open) 2015-10-05T13:42:26.649+0100 [mongosMain] connection accepted from 172.28.0.163:58948 #4326 (571 connections now open) 2015-10-05T13:42:26.649+0100 [mongosMain] connection accepted from 172.28.0.163:58949 #4327 (572 connections now open) 2015-10-05T13:42:26.649+0100 [mongosMain] connection accepted from 172.28.0.163:58950 #4328 (573 connections now open) 2015-10-05T13:42:26.650+0100 [mongosMain] connection accepted from 172.28.0.163:58951 #4329 (574 connections now open) 2015-10-05T13:42:26.650+0100 [mongosMain] connection accepted from 172.28.0.163:58952 #4330 (575 connections now open) 2015-10-05T13:42:26.650+0100 [conn4324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.650+0100 [conn4323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.651+0100 [conn4325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.651+0100 [mongosMain] connection accepted from 172.28.0.163:58953 #4331 (576 connections now open) 2015-10-05T13:42:26.651+0100 [mongosMain] connection accepted from 172.28.0.163:58954 #4332 (577 connections now open) 2015-10-05T13:42:26.651+0100 [mongosMain] connection accepted from 172.28.0.163:58955 #4333 (578 connections now open) 2015-10-05T13:42:26.652+0100 [conn4321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.652+0100 [conn4327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.653+0100 [conn4331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.653+0100 [conn4326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.654+0100 [conn4328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.655+0100 [conn4333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.656+0100 [conn4330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.657+0100 [conn4329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.657+0100 [conn4322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.660+0100 [mongosMain] connection accepted from 172.28.0.163:58956 #4334 (579 connections now open) 2015-10-05T13:42:26.663+0100 [mongosMain] connection accepted from 172.28.0.163:58957 #4335 (580 connections now open) 2015-10-05T13:42:26.665+0100 [conn4334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.666+0100 [mongosMain] connection accepted from 172.28.0.163:58958 #4336 (581 connections now open) 2015-10-05T13:42:26.669+0100 [conn4336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.670+0100 [mongosMain] connection accepted from 172.28.0.163:58959 #4337 (582 connections now open) 2015-10-05T13:42:26.672+0100 [mongosMain] connection accepted from 172.28.0.163:58960 #4338 (583 connections now open) 2015-10-05T13:42:26.673+0100 [mongosMain] connection accepted from 172.28.0.163:58961 #4339 (584 connections now open) 2015-10-05T13:42:26.674+0100 [mongosMain] connection accepted from 172.28.0.163:58962 #4340 (585 connections now open) 2015-10-05T13:42:26.674+0100 [conn4338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.676+0100 [mongosMain] connection accepted from 172.28.0.163:58963 #4341 (586 connections now open) 2015-10-05T13:42:26.679+0100 [mongosMain] connection accepted from 172.28.0.163:58964 #4342 (587 connections now open) 2015-10-05T13:42:26.680+0100 [mongosMain] connection accepted from 172.28.0.163:58965 #4343 (588 connections now open) 2015-10-05T13:42:26.680+0100 [mongosMain] connection accepted from 172.28.0.163:58966 #4344 (589 connections now open) 2015-10-05T13:42:26.681+0100 [mongosMain] connection accepted from 172.28.0.163:58967 #4345 (590 connections now open) 2015-10-05T13:42:26.682+0100 [mongosMain] connection accepted from 172.28.0.163:58968 #4346 (591 connections now open) 2015-10-05T13:42:26.682+0100 [mongosMain] connection accepted from 172.28.0.163:58969 #4347 (592 connections now open) 2015-10-05T13:42:26.685+0100 [conn4339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [mongosMain] connection accepted from 172.28.0.163:58970 #4348 (593 connections now open) 2015-10-05T13:42:26.686+0100 [conn4337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [conn4335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [conn4340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [conn4345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [conn4347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.687+0100 [conn4344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.686+0100 [conn4342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.687+0100 [conn4343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.687+0100 [conn4346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.687+0100 [conn4341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.687+0100 [conn4348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.688+0100 [mongosMain] connection accepted from 172.28.0.163:58971 #4349 (594 connections now open) 2015-10-05T13:42:26.688+0100 [mongosMain] connection accepted from 172.28.0.163:58972 #4350 (595 connections now open) 2015-10-05T13:42:26.688+0100 [mongosMain] connection accepted from 172.28.0.163:58973 #4351 (596 connections now open) 2015-10-05T13:42:26.689+0100 [mongosMain] connection accepted from 172.28.0.163:58974 #4352 (597 connections now open) 2015-10-05T13:42:26.689+0100 [mongosMain] connection accepted from 172.28.0.163:58975 #4353 (598 connections now open) 2015-10-05T13:42:26.689+0100 [mongosMain] connection accepted from 172.28.0.163:58976 #4354 (599 connections now open) 2015-10-05T13:42:26.689+0100 [mongosMain] connection accepted from 172.28.0.163:58977 #4355 (600 connections now open) 2015-10-05T13:42:26.690+0100 [conn4349] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.690+0100 [mongosMain] connection accepted from 172.28.0.163:58978 #4356 (601 connections now open) 2015-10-05T13:42:26.690+0100 [mongosMain] connection accepted from 172.28.0.163:58979 #4357 (602 connections now open) 2015-10-05T13:42:26.690+0100 [mongosMain] connection accepted from 172.28.0.163:58980 #4358 (603 connections now open) 2015-10-05T13:42:26.690+0100 [mongosMain] connection accepted from 172.28.0.163:58981 #4359 (604 connections now open) 2015-10-05T13:42:26.691+0100 [mongosMain] connection accepted from 172.28.0.163:58983 #4360 (605 connections now open) 2015-10-05T13:42:26.691+0100 [conn4350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.691+0100 [mongosMain] connection accepted from 172.28.0.163:58982 #4361 (606 connections now open) 2015-10-05T13:42:26.691+0100 [mongosMain] connection accepted from 172.28.0.163:58984 #4362 (607 connections now open) 2015-10-05T13:42:26.692+0100 [conn4351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.692+0100 [mongosMain] connection accepted from 172.28.0.163:58985 #4363 (608 connections now open) 2015-10-05T13:42:26.692+0100 [conn4359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.693+0100 [conn4356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.693+0100 [mongosMain] connection accepted from 172.28.0.163:58986 #4364 (609 connections now open) 2015-10-05T13:42:26.693+0100 [mongosMain] connection accepted from 172.28.0.163:58987 #4365 (610 connections now open) 2015-10-05T13:42:26.693+0100 [mongosMain] connection accepted from 172.28.0.163:58988 #4366 (611 connections now open) 2015-10-05T13:42:26.694+0100 [mongosMain] connection accepted from 172.28.0.163:58989 #4367 (612 connections now open) 2015-10-05T13:42:26.694+0100 [mongosMain] connection accepted from 172.28.0.163:58990 #4368 (613 connections now open) 2015-10-05T13:42:26.695+0100 [conn4361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.695+0100 [conn4355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.695+0100 [mongosMain] connection accepted from 172.28.0.163:58991 #4369 (614 connections now open) 2015-10-05T13:42:26.696+0100 [mongosMain] connection accepted from 172.28.0.163:58992 #4370 (615 connections now open) 2015-10-05T13:42:26.696+0100 [mongosMain] connection accepted from 172.28.0.163:58993 #4371 (616 connections now open) 2015-10-05T13:42:26.696+0100 [conn4357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.697+0100 [conn4367] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.697+0100 [mongosMain] connection accepted from 172.28.0.163:58994 #4372 (617 connections now open) 2015-10-05T13:42:26.698+0100 [mongosMain] connection accepted from 172.28.0.163:58995 #4373 (618 connections now open) 2015-10-05T13:42:26.699+0100 [conn4365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.699+0100 [mongosMain] connection accepted from 172.28.0.163:58996 #4374 (619 connections now open) 2015-10-05T13:42:26.700+0100 [mongosMain] connection accepted from 172.28.0.163:58997 #4375 (620 connections now open) 2015-10-05T13:42:26.701+0100 [conn4352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.702+0100 [mongosMain] connection accepted from 172.28.0.163:58998 #4376 (621 connections now open) 2015-10-05T13:42:26.703+0100 [conn4354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.704+0100 [conn4362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.705+0100 [conn4368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.705+0100 [mongosMain] connection accepted from 172.28.0.163:58999 #4377 (622 connections now open) 2015-10-05T13:42:26.705+0100 [conn4358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.707+0100 [conn4373] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.708+0100 [conn4377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.708+0100 [conn4374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.708+0100 [conn4364] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.709+0100 [conn4363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.709+0100 [mongosMain] connection accepted from 172.28.0.163:59000 #4378 (623 connections now open) 2015-10-05T13:42:26.710+0100 [mongosMain] connection accepted from 172.28.0.163:59001 #4379 (624 connections now open) 2015-10-05T13:42:26.713+0100 [mongosMain] connection accepted from 172.28.0.163:59002 #4380 (625 connections now open) 2015-10-05T13:42:26.713+0100 [conn4360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.714+0100 [mongosMain] connection accepted from 172.28.0.163:59003 #4381 (626 connections now open) 2015-10-05T13:42:26.715+0100 [mongosMain] connection accepted from 172.28.0.163:59004 #4382 (627 connections now open) 2015-10-05T13:42:26.720+0100 [mongosMain] connection accepted from 172.28.0.163:59006 #4383 (628 connections now open) 2015-10-05T13:42:26.722+0100 [mongosMain] connection accepted from 172.28.0.163:59005 #4384 (629 connections now open) 2015-10-05T13:42:26.729+0100 [mongosMain] connection accepted from 172.28.0.163:59007 #4385 (630 connections now open) 2015-10-05T13:42:26.729+0100 [conn4369] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.729+0100 [conn4375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.730+0100 [mongosMain] connection accepted from 172.28.0.163:59008 #4386 (631 connections now open) 2015-10-05T13:42:26.730+0100 [conn4379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.730+0100 [conn4381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.731+0100 [conn4376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.731+0100 [conn4382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.731+0100 [conn4370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.731+0100 [mongosMain] connection accepted from 172.28.0.163:59009 #4387 (632 connections now open) 2015-10-05T13:42:26.732+0100 [conn4366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.736+0100 [conn4385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.752+0100 [conn4332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.753+0100 [mongosMain] connection accepted from 172.28.0.163:59010 #4388 (633 connections now open) 2015-10-05T13:42:26.753+0100 [conn4371] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.753+0100 [conn4378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.754+0100 [conn4372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.757+0100 [mongosMain] connection accepted from 172.28.0.163:59011 #4389 (634 connections now open) 2015-10-05T13:42:26.757+0100 [mongosMain] connection accepted from 172.28.0.163:59012 #4390 (635 connections now open) 2015-10-05T13:42:26.758+0100 [mongosMain] connection accepted from 172.28.0.163:59013 #4391 (636 connections now open) 2015-10-05T13:42:26.758+0100 [mongosMain] connection accepted from 172.28.0.163:59014 #4392 (637 connections now open) 2015-10-05T13:42:26.758+0100 [mongosMain] connection accepted from 172.28.0.163:59015 #4393 (638 connections now open) 2015-10-05T13:42:26.758+0100 [mongosMain] connection accepted from 172.28.0.163:59016 #4394 (639 connections now open) 2015-10-05T13:42:26.758+0100 [mongosMain] connection accepted from 172.28.0.163:59017 #4395 (640 connections now open) 2015-10-05T13:42:26.759+0100 [mongosMain] connection accepted from 172.28.0.163:59018 #4396 (641 connections now open) 2015-10-05T13:42:26.759+0100 [mongosMain] connection accepted from 172.28.0.163:59019 #4397 (642 connections now open) 2015-10-05T13:42:26.759+0100 [mongosMain] connection accepted from 172.28.0.163:59020 #4398 (643 connections now open) 2015-10-05T13:42:26.759+0100 [mongosMain] connection accepted from 172.28.0.163:59021 #4399 (644 connections now open) 2015-10-05T13:42:26.759+0100 [mongosMain] connection accepted from 172.28.0.163:59022 #4400 (645 connections now open) 2015-10-05T13:42:26.760+0100 [mongosMain] connection accepted from 172.28.0.163:59023 #4401 (646 connections now open) 2015-10-05T13:42:26.760+0100 [mongosMain] connection accepted from 172.28.0.163:59024 #4402 (647 connections now open) 2015-10-05T13:42:26.760+0100 [mongosMain] connection accepted from 172.28.0.163:59025 #4403 (648 connections now open) 2015-10-05T13:42:26.760+0100 [mongosMain] connection accepted from 172.28.0.163:59026 #4404 (649 connections now open) 2015-10-05T13:42:26.760+0100 [mongosMain] connection accepted from 172.28.0.163:59027 #4405 (650 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59028 #4406 (651 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59029 #4407 (652 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59030 #4408 (653 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59031 #4409 (654 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59032 #4410 (655 connections now open) 2015-10-05T13:42:26.761+0100 [mongosMain] connection accepted from 172.28.0.163:59033 #4411 (656 connections now open) 2015-10-05T13:42:26.762+0100 [mongosMain] connection accepted from 172.28.0.163:59034 #4412 (657 connections now open) 2015-10-05T13:42:26.762+0100 [mongosMain] connection accepted from 172.28.0.163:59035 #4413 (658 connections now open) 2015-10-05T13:42:26.762+0100 [mongosMain] connection accepted from 172.28.0.163:59036 #4414 (659 connections now open) 2015-10-05T13:42:26.762+0100 [mongosMain] connection accepted from 172.28.0.163:59037 #4415 (660 connections now open) 2015-10-05T13:42:26.762+0100 [mongosMain] connection accepted from 172.28.0.163:59038 #4416 (661 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59039 #4417 (662 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59040 #4418 (663 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59041 #4419 (664 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59042 #4420 (665 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59043 #4421 (666 connections now open) 2015-10-05T13:42:26.763+0100 [mongosMain] connection accepted from 172.28.0.163:59044 #4422 (667 connections now open) 2015-10-05T13:42:26.764+0100 [mongosMain] connection accepted from 172.28.0.163:59045 #4423 (668 connections now open) 2015-10-05T13:42:26.764+0100 [mongosMain] connection accepted from 172.28.0.163:59046 #4424 (669 connections now open) 2015-10-05T13:42:26.764+0100 [mongosMain] connection accepted from 172.28.0.163:59047 #4425 (670 connections now open) 2015-10-05T13:42:26.764+0100 [mongosMain] connection accepted from 172.28.0.163:59048 #4426 (671 connections now open) 2015-10-05T13:42:26.764+0100 [mongosMain] connection accepted from 172.28.0.163:59049 #4427 (672 connections now open) 2015-10-05T13:42:26.765+0100 [mongosMain] connection accepted from 172.28.0.163:59050 #4428 (673 connections now open) 2015-10-05T13:42:26.765+0100 [mongosMain] connection accepted from 172.28.0.163:59051 #4429 (674 connections now open) 2015-10-05T13:42:26.765+0100 [mongosMain] connection accepted from 172.28.0.163:59052 #4430 (675 connections now open) 2015-10-05T13:42:26.765+0100 [mongosMain] connection accepted from 172.28.0.163:59053 #4431 (676 connections now open) 2015-10-05T13:42:26.765+0100 [mongosMain] connection accepted from 172.28.0.163:59054 #4432 (677 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59055 #4433 (678 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59056 #4434 (679 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59057 #4435 (680 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59058 #4436 (681 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59059 #4437 (682 connections now open) 2015-10-05T13:42:26.766+0100 [mongosMain] connection accepted from 172.28.0.163:59060 #4438 (683 connections now open) 2015-10-05T13:42:26.767+0100 [mongosMain] connection accepted from 172.28.0.163:59061 #4439 (684 connections now open) 2015-10-05T13:42:26.767+0100 [mongosMain] connection accepted from 172.28.0.163:59062 #4440 (685 connections now open) 2015-10-05T13:42:26.767+0100 [mongosMain] connection accepted from 172.28.0.163:59063 #4441 (686 connections now open) 2015-10-05T13:42:26.767+0100 [mongosMain] connection accepted from 172.28.0.163:59064 #4442 (687 connections now open) 2015-10-05T13:42:26.767+0100 [mongosMain] connection accepted from 172.28.0.163:59065 #4443 (688 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59066 #4444 (689 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59067 #4445 (690 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59068 #4446 (691 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59069 #4447 (692 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59070 #4448 (693 connections now open) 2015-10-05T13:42:26.768+0100 [mongosMain] connection accepted from 172.28.0.163:59071 #4449 (694 connections now open) 2015-10-05T13:42:26.769+0100 [mongosMain] connection accepted from 172.28.0.163:59072 #4450 (695 connections now open) 2015-10-05T13:42:26.769+0100 [mongosMain] connection accepted from 172.28.0.163:59073 #4451 (696 connections now open) 2015-10-05T13:42:26.769+0100 [mongosMain] connection accepted from 172.28.0.163:59074 #4452 (697 connections now open) 2015-10-05T13:42:26.769+0100 [mongosMain] connection accepted from 172.28.0.163:59075 #4453 (698 connections now open) 2015-10-05T13:42:26.769+0100 [mongosMain] connection accepted from 172.28.0.163:59076 #4454 (699 connections now open) 2015-10-05T13:42:26.770+0100 [mongosMain] connection accepted from 172.28.0.163:59077 #4455 (700 connections now open) 2015-10-05T13:42:26.770+0100 [mongosMain] connection accepted from 172.28.0.163:59078 #4456 (701 connections now open) 2015-10-05T13:42:26.770+0100 [mongosMain] connection accepted from 172.28.0.163:59079 #4457 (702 connections now open) 2015-10-05T13:42:26.770+0100 [mongosMain] connection accepted from 172.28.0.163:59080 #4458 (703 connections now open) 2015-10-05T13:42:26.770+0100 [mongosMain] connection accepted from 172.28.0.163:59081 #4459 (704 connections now open) 2015-10-05T13:42:26.771+0100 [mongosMain] connection accepted from 172.28.0.163:59082 #4460 (705 connections now open) 2015-10-05T13:42:26.771+0100 [mongosMain] connection accepted from 172.28.0.163:59083 #4461 (706 connections now open) 2015-10-05T13:42:26.771+0100 [mongosMain] connection accepted from 172.28.0.163:59084 #4462 (707 connections now open) 2015-10-05T13:42:26.771+0100 [mongosMain] connection accepted from 172.28.0.163:59085 #4463 (708 connections now open) 2015-10-05T13:42:26.771+0100 [mongosMain] connection accepted from 172.28.0.163:59086 #4464 (709 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59087 #4465 (710 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59088 #4466 (711 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59089 #4467 (712 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59090 #4468 (713 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59091 #4469 (714 connections now open) 2015-10-05T13:42:26.772+0100 [mongosMain] connection accepted from 172.28.0.163:59092 #4470 (715 connections now open) 2015-10-05T13:42:26.773+0100 [mongosMain] connection accepted from 172.28.0.163:59093 #4471 (716 connections now open) 2015-10-05T13:42:26.773+0100 [mongosMain] connection accepted from 172.28.0.163:59094 #4472 (717 connections now open) 2015-10-05T13:42:26.773+0100 [mongosMain] connection accepted from 172.28.0.163:59095 #4473 (718 connections now open) 2015-10-05T13:42:26.773+0100 [mongosMain] connection accepted from 172.28.0.163:59096 #4474 (719 connections now open) 2015-10-05T13:42:26.773+0100 [mongosMain] connection accepted from 172.28.0.163:59097 #4475 (720 connections now open) 2015-10-05T13:42:26.774+0100 [mongosMain] connection accepted from 172.28.0.163:59098 #4476 (721 connections now open) 2015-10-05T13:42:26.774+0100 [mongosMain] connection accepted from 172.28.0.163:59099 #4477 (722 connections now open) 2015-10-05T13:42:26.774+0100 [mongosMain] connection accepted from 172.28.0.163:59100 #4478 (723 connections now open) 2015-10-05T13:42:26.774+0100 [mongosMain] connection accepted from 172.28.0.163:59101 #4479 (724 connections now open) 2015-10-05T13:42:26.774+0100 [mongosMain] connection accepted from 172.28.0.163:59102 #4480 (725 connections now open) 2015-10-05T13:42:26.775+0100 [mongosMain] connection accepted from 172.28.0.163:59103 #4481 (726 connections now open) 2015-10-05T13:42:26.775+0100 [mongosMain] connection accepted from 172.28.0.163:59104 #4482 (727 connections now open) 2015-10-05T13:42:26.775+0100 [conn4353] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.775+0100 [mongosMain] connection accepted from 172.28.0.163:59105 #4483 (728 connections now open) 2015-10-05T13:42:26.775+0100 [mongosMain] connection accepted from 172.28.0.163:59106 #4484 (729 connections now open) 2015-10-05T13:42:26.775+0100 [mongosMain] connection accepted from 172.28.0.163:59107 #4485 (730 connections now open) 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59108 #4486 (731 connections now open) 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59109 #4487 (732 connections now open) 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59110 #4488 (733 connections now open) 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59111 #4489 (734 connections now open) 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59112 #4490 (735 connections now open) 2015-10-05T13:42:26.776+0100 [conn4383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.776+0100 [mongosMain] connection accepted from 172.28.0.163:59113 #4491 (736 connections now open) 2015-10-05T13:42:26.777+0100 [mongosMain] connection accepted from 172.28.0.163:59114 #4492 (737 connections now open) 2015-10-05T13:42:26.777+0100 [mongosMain] connection accepted from 172.28.0.163:59115 #4493 (738 connections now open) 2015-10-05T13:42:26.777+0100 [mongosMain] connection accepted from 172.28.0.163:59116 #4494 (739 connections now open) 2015-10-05T13:42:26.777+0100 [mongosMain] connection accepted from 172.28.0.163:59117 #4495 (740 connections now open) 2015-10-05T13:42:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:59118 #4496 (741 connections now open) 2015-10-05T13:42:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:59119 #4497 (742 connections now open) 2015-10-05T13:42:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:59121 #4498 (743 connections now open) 2015-10-05T13:42:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:59120 #4499 (744 connections now open) 2015-10-05T13:42:26.778+0100 [mongosMain] connection accepted from 172.28.0.163:59123 #4500 (745 connections now open) 2015-10-05T13:42:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:59124 #4501 (746 connections now open) 2015-10-05T13:42:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:59125 #4502 (747 connections now open) 2015-10-05T13:42:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:59127 #4503 (748 connections now open) 2015-10-05T13:42:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:59126 #4504 (749 connections now open) 2015-10-05T13:42:26.779+0100 [mongosMain] connection accepted from 172.28.0.163:59128 #4505 (750 connections now open) 2015-10-05T13:42:26.780+0100 [mongosMain] connection accepted from 172.28.0.163:59129 #4506 (751 connections now open) 2015-10-05T13:42:26.780+0100 [mongosMain] connection accepted from 172.28.0.163:59130 #4507 (752 connections now open) 2015-10-05T13:42:26.780+0100 [mongosMain] connection accepted from 172.28.0.163:59122 #4508 (753 connections now open) 2015-10-05T13:42:26.780+0100 [mongosMain] connection accepted from 172.28.0.163:59131 #4509 (754 connections now open) 2015-10-05T13:42:26.780+0100 [mongosMain] connection accepted from 172.28.0.163:59132 #4510 (755 connections now open) 2015-10-05T13:42:26.781+0100 [mongosMain] connection accepted from 172.28.0.163:59133 #4511 (756 connections now open) 2015-10-05T13:42:26.781+0100 [mongosMain] connection accepted from 172.28.0.163:59134 #4512 (757 connections now open) 2015-10-05T13:42:26.802+0100 [conn3837] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.807+0100 [conn4380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.808+0100 [conn4384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.808+0100 [conn4389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.808+0100 [conn4386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.808+0100 [conn4395] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.809+0100 [conn4388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.809+0100 [conn4401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.809+0100 [conn4391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.810+0100 [conn4421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.811+0100 [conn4419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.812+0100 [conn4427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.812+0100 [conn4433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.812+0100 [conn4425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.814+0100 [conn4439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.814+0100 [conn4443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.814+0100 [conn4415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.814+0100 [conn4431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.814+0100 [conn4406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.815+0100 [conn4437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.815+0100 [conn4393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.815+0100 [conn4407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.815+0100 [conn4418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.815+0100 [conn4399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.816+0100 [conn4405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.818+0100 [conn4412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.819+0100 [conn4424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.820+0100 [conn4411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.820+0100 [conn4445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.820+0100 [conn4442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.820+0100 [conn4451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.820+0100 [conn4457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.825+0100 [conn4417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.830+0100 [conn4400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.833+0100 [conn4454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.843+0100 [conn4430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.843+0100 [conn4429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.843+0100 [conn4392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.843+0100 [conn4410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4479] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.863+0100 [conn4461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4485] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4491] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.864+0100 [conn4509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.865+0100 [conn4467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.865+0100 [conn4436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.865+0100 [conn4497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.866+0100 [conn4404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.868+0100 [conn4469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.868+0100 [conn4475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.868+0100 [conn4402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4481] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4505] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.869+0100 [conn4438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.870+0100 [conn4426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.870+0100 [conn4408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.870+0100 [conn4444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.870+0100 [conn4465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.871+0100 [conn4471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.877+0100 [conn4456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.877+0100 [conn4477] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.877+0100 [conn4480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.877+0100 [conn4499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.878+0100 [conn4495] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.879+0100 [conn4510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.879+0100 [conn4483] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.879+0100 [conn4396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.879+0100 [conn4490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.879+0100 [conn4487] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.880+0100 [conn4453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.881+0100 [conn4428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.885+0100 [conn4434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.885+0100 [conn4449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.886+0100 [conn4502] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.887+0100 [conn4508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.888+0100 [conn4440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.888+0100 [conn4452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.889+0100 [conn4464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.890+0100 [conn4492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.890+0100 [conn4476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.890+0100 [conn4494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.890+0100 [conn4488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.891+0100 [conn4500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.891+0100 [conn4493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.891+0100 [conn4506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.891+0100 [conn4512] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.892+0100 [conn4482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:26.940+0100 [conn4511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.235+0100 [mongosMain] connection accepted from 172.28.0.163:59149 #4513 (758 connections now open) 2015-10-05T13:42:27.236+0100 [mongosMain] connection accepted from 172.28.0.163:59194 #4514 (759 connections now open) 2015-10-05T13:42:27.236+0100 [mongosMain] connection accepted from 172.28.0.163:59202 #4515 (760 connections now open) 2015-10-05T13:42:27.236+0100 [mongosMain] connection accepted from 172.28.0.163:59162 #4516 (761 connections now open) 2015-10-05T13:42:27.237+0100 [mongosMain] connection accepted from 172.28.0.163:59181 #4517 (762 connections now open) 2015-10-05T13:42:27.237+0100 [mongosMain] connection accepted from 172.28.0.163:59158 #4518 (763 connections now open) 2015-10-05T13:42:27.237+0100 [mongosMain] connection accepted from 172.28.0.163:59169 #4519 (764 connections now open) 2015-10-05T13:42:27.237+0100 [mongosMain] connection accepted from 172.28.0.163:59147 #4520 (765 connections now open) 2015-10-05T13:42:27.237+0100 [mongosMain] connection accepted from 172.28.0.163:59196 #4521 (766 connections now open) 2015-10-05T13:42:27.238+0100 [mongosMain] connection accepted from 172.28.0.163:59204 #4522 (767 connections now open) 2015-10-05T13:42:27.238+0100 [mongosMain] connection accepted from 172.28.0.163:59146 #4523 (768 connections now open) 2015-10-05T13:42:27.238+0100 [mongosMain] connection accepted from 172.28.0.163:59197 #4524 (769 connections now open) 2015-10-05T13:42:27.238+0100 [mongosMain] connection accepted from 172.28.0.163:59205 #4525 (770 connections now open) 2015-10-05T13:42:27.239+0100 [conn4513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.244+0100 [conn4525] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.246+0100 [mongosMain] connection accepted from 172.28.0.163:59136 #4526 (771 connections now open) 2015-10-05T13:42:27.246+0100 [conn4514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.247+0100 [mongosMain] connection accepted from 172.28.0.163:59191 #4527 (772 connections now open) 2015-10-05T13:42:27.247+0100 [mongosMain] connection accepted from 172.28.0.163:59215 #4528 (773 connections now open) 2015-10-05T13:42:27.247+0100 [mongosMain] connection accepted from 172.28.0.163:59256 #4529 (774 connections now open) 2015-10-05T13:42:27.247+0100 [mongosMain] connection accepted from 172.28.0.163:59294 #4530 (775 connections now open) 2015-10-05T13:42:27.248+0100 [mongosMain] connection accepted from 172.28.0.163:59305 #4531 (776 connections now open) 2015-10-05T13:42:27.248+0100 [conn4522] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.248+0100 [conn4519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.248+0100 [mongosMain] connection accepted from 172.28.0.163:59137 #4532 (777 connections now open) 2015-10-05T13:42:27.249+0100 [conn4516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.249+0100 [conn4520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.249+0100 [mongosMain] connection accepted from 172.28.0.163:59190 #4533 (778 connections now open) 2015-10-05T13:42:27.252+0100 [conn4526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.254+0100 [conn4532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.254+0100 [mongosMain] connection accepted from 172.28.0.163:59214 #4534 (779 connections now open) 2015-10-05T13:42:27.256+0100 [mongosMain] connection accepted from 172.28.0.163:59257 #4535 (780 connections now open) 2015-10-05T13:42:27.257+0100 [mongosMain] connection accepted from 172.28.0.163:59295 #4536 (781 connections now open) 2015-10-05T13:42:27.257+0100 [mongosMain] connection accepted from 172.28.0.163:59304 #4537 (782 connections now open) 2015-10-05T13:42:27.257+0100 [mongosMain] connection accepted from 172.28.0.163:59138 #4538 (783 connections now open) 2015-10-05T13:42:27.257+0100 [conn4517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.257+0100 [conn4523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.257+0100 [mongosMain] connection accepted from 172.28.0.163:59189 #4539 (784 connections now open) 2015-10-05T13:42:27.258+0100 [mongosMain] connection accepted from 172.28.0.163:59213 #4540 (785 connections now open) 2015-10-05T13:42:27.258+0100 [mongosMain] connection accepted from 172.28.0.163:59258 #4541 (786 connections now open) 2015-10-05T13:42:27.257+0100 [conn4529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.258+0100 [mongosMain] connection accepted from 172.28.0.163:59292 #4542 (787 connections now open) 2015-10-05T13:42:27.260+0100 [mongosMain] connection accepted from 172.28.0.163:59307 #4543 (788 connections now open) 2015-10-05T13:42:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:59150 #4544 (789 connections now open) 2015-10-05T13:42:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:59193 #4545 (790 connections now open) 2015-10-05T13:42:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:59201 #4546 (791 connections now open) 2015-10-05T13:42:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:59254 #4547 (792 connections now open) 2015-10-05T13:42:27.261+0100 [mongosMain] connection accepted from 172.28.0.163:59280 #4548 (793 connections now open) 2015-10-05T13:42:27.262+0100 [mongosMain] connection accepted from 172.28.0.163:59303 #4549 (794 connections now open) 2015-10-05T13:42:27.262+0100 [mongosMain] connection accepted from 172.28.0.163:59161 #4550 (795 connections now open) 2015-10-05T13:42:27.262+0100 [mongosMain] connection accepted from 172.28.0.163:59182 #4551 (796 connections now open) 2015-10-05T13:42:27.262+0100 [mongosMain] connection accepted from 172.28.0.163:59222 #4552 (797 connections now open) 2015-10-05T13:42:27.262+0100 [mongosMain] connection accepted from 172.28.0.163:59233 #4553 (798 connections now open) 2015-10-05T13:42:27.263+0100 [mongosMain] connection accepted from 172.28.0.163:59271 #4554 (799 connections now open) 2015-10-05T13:42:27.263+0100 [mongosMain] connection accepted from 172.28.0.163:59312 #4555 (800 connections now open) 2015-10-05T13:42:27.263+0100 [mongosMain] connection accepted from 172.28.0.163:59336 #4556 (801 connections now open) 2015-10-05T13:42:27.263+0100 [mongosMain] connection accepted from 172.28.0.163:59145 #4557 (802 connections now open) 2015-10-05T13:42:27.264+0100 [mongosMain] connection accepted from 172.28.0.163:59198 #4558 (803 connections now open) 2015-10-05T13:42:27.264+0100 [mongosMain] connection accepted from 172.28.0.163:59206 #4559 (804 connections now open) 2015-10-05T13:42:27.282+0100 [conn4538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.282+0100 [conn4521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.282+0100 [conn4544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.282+0100 [conn4527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.282+0100 [conn4515] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.282+0100 [conn4533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.283+0100 [conn4541] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.284+0100 [conn4547] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.284+0100 [conn4535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.284+0100 [conn4531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.287+0100 [mongosMain] connection accepted from 172.28.0.163:59249 #4560 (805 connections now open) 2015-10-05T13:42:27.287+0100 [mongosMain] connection accepted from 172.28.0.163:59287 #4561 (806 connections now open) 2015-10-05T13:42:27.288+0100 [mongosMain] connection accepted from 172.28.0.163:59296 #4562 (807 connections now open) 2015-10-05T13:42:27.288+0100 [conn4556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.288+0100 [mongosMain] connection accepted from 172.28.0.163:59141 #4563 (808 connections now open) 2015-10-05T13:42:27.288+0100 [conn4537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.288+0100 [mongosMain] connection accepted from 172.28.0.163:59186 #4564 (809 connections now open) 2015-10-05T13:42:27.288+0100 [conn4518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.289+0100 [conn4550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.289+0100 [conn4555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.291+0100 [mongosMain] connection accepted from 172.28.0.163:59210 #4565 (810 connections now open) 2015-10-05T13:42:27.292+0100 [mongosMain] connection accepted from 172.28.0.163:59261 #4566 (811 connections now open) 2015-10-05T13:42:27.292+0100 [mongosMain] connection accepted from 172.28.0.163:59291 #4567 (812 connections now open) 2015-10-05T13:42:27.292+0100 [mongosMain] connection accepted from 172.28.0.163:59308 #4568 (813 connections now open) 2015-10-05T13:42:27.292+0100 [mongosMain] connection accepted from 172.28.0.163:59154 #4569 (814 connections now open) 2015-10-05T13:42:27.292+0100 [mongosMain] connection accepted from 172.28.0.163:59173 #4570 (815 connections now open) 2015-10-05T13:42:27.292+0100 [conn4543] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.293+0100 [mongosMain] connection accepted from 172.28.0.163:59229 #4571 (816 connections now open) 2015-10-05T13:42:27.293+0100 [mongosMain] connection accepted from 172.28.0.163:59242 #4572 (817 connections now open) 2015-10-05T13:42:27.294+0100 [mongosMain] connection accepted from 172.28.0.163:59276 #4573 (818 connections now open) 2015-10-05T13:42:27.294+0100 [mongosMain] connection accepted from 172.28.0.163:59323 #4574 (819 connections now open) 2015-10-05T13:42:27.294+0100 [mongosMain] connection accepted from 172.28.0.163:59331 #4575 (820 connections now open) 2015-10-05T13:42:27.294+0100 [conn4549] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59142 #4576 (821 connections now open) 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59185 #4577 (822 connections now open) 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59209 #4578 (823 connections now open) 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59262 #4579 (824 connections now open) 2015-10-05T13:42:27.295+0100 [conn4574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59288 #4580 (825 connections now open) 2015-10-05T13:42:27.295+0100 [conn4559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.295+0100 [mongosMain] connection accepted from 172.28.0.163:59311 #4581 (826 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59351 #4582 (827 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59360 #4583 (828 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59153 #4584 (829 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59174 #4585 (830 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59230 #4586 (831 connections now open) 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59241 #4587 (832 connections now open) 2015-10-05T13:42:27.296+0100 [conn4580] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.296+0100 [mongosMain] connection accepted from 172.28.0.163:59279 #4588 (833 connections now open) 2015-10-05T13:42:27.297+0100 [mongosMain] connection accepted from 172.28.0.163:59320 #4589 (834 connections now open) 2015-10-05T13:42:27.298+0100 [mongosMain] connection accepted from 172.28.0.163:59328 #4590 (835 connections now open) 2015-10-05T13:42:27.298+0100 [mongosMain] connection accepted from 172.28.0.163:59165 #4591 (836 connections now open) 2015-10-05T13:42:27.298+0100 [mongosMain] connection accepted from 172.28.0.163:59178 #4592 (837 connections now open) 2015-10-05T13:42:27.299+0100 [conn4536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.300+0100 [conn4579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.300+0100 [conn4548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.301+0100 [conn4571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.302+0100 [conn4578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.302+0100 [conn4585] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.303+0100 [conn4589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.303+0100 [conn4534] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.303+0100 [conn4576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4564] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.304+0100 [conn4570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.306+0100 [conn4583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.308+0100 [conn4528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.308+0100 [mongosMain] connection accepted from 172.28.0.163:59218 #4593 (838 connections now open) 2015-10-05T13:42:27.310+0100 [conn4561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.310+0100 [conn4524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.311+0100 [conn4530] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.311+0100 [conn4562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.317+0100 [conn4553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.317+0100 [mongosMain] connection accepted from 172.28.0.163:59237 #4594 (839 connections now open) 2015-10-05T13:42:27.318+0100 [conn4592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.318+0100 [conn4567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.318+0100 [conn4560] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.319+0100 [mongosMain] connection accepted from 172.28.0.163:59267 #4595 (840 connections now open) 2015-10-05T13:42:27.319+0100 [conn4591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.320+0100 [conn4573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.320+0100 [mongosMain] connection accepted from 172.28.0.163:59316 #4596 (841 connections now open) 2015-10-05T13:42:27.320+0100 [conn4568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.321+0100 [conn4542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.321+0100 [conn4572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.323+0100 [conn4595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.324+0100 [mongosMain] connection accepted from 172.28.0.163:59340 #4597 (842 connections now open) 2015-10-05T13:42:27.325+0100 [mongosMain] connection accepted from 172.28.0.163:59226 #4598 (843 connections now open) 2015-10-05T13:42:27.326+0100 [conn4596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.326+0100 [conn4597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.326+0100 [mongosMain] connection accepted from 172.28.0.163:59157 #4599 (844 connections now open) 2015-10-05T13:42:27.327+0100 [mongosMain] connection accepted from 172.28.0.163:59170 #4600 (845 connections now open) 2015-10-05T13:42:27.327+0100 [mongosMain] connection accepted from 172.28.0.163:59245 #4601 (846 connections now open) 2015-10-05T13:42:27.327+0100 [mongosMain] connection accepted from 172.28.0.163:59275 #4602 (847 connections now open) 2015-10-05T13:42:27.328+0100 [conn4598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.328+0100 [mongosMain] connection accepted from 172.28.0.163:59324 #4603 (848 connections now open) 2015-10-05T13:42:27.329+0100 [mongosMain] connection accepted from 172.28.0.163:59332 #4604 (849 connections now open) 2015-10-05T13:42:27.329+0100 [conn4601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.329+0100 [conn4602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.331+0100 [conn4603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.332+0100 [mongosMain] connection accepted from 172.28.0.163:59156 #4605 (850 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59171 #4606 (851 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59227 #4607 (852 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59244 #4608 (853 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59274 #4609 (854 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59325 #4610 (855 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59333 #4611 (856 connections now open) 2015-10-05T13:42:27.333+0100 [mongosMain] connection accepted from 172.28.0.163:59159 #4612 (857 connections now open) 2015-10-05T13:42:27.334+0100 [mongosMain] connection accepted from 172.28.0.163:59168 #4613 (858 connections now open) 2015-10-05T13:42:27.334+0100 [mongosMain] connection accepted from 172.28.0.163:59224 #4614 (859 connections now open) 2015-10-05T13:42:27.334+0100 [mongosMain] connection accepted from 172.28.0.163:59247 #4615 (860 connections now open) 2015-10-05T13:42:27.334+0100 [mongosMain] connection accepted from 172.28.0.163:59273 #4616 (861 connections now open) 2015-10-05T13:42:27.335+0100 [mongosMain] connection accepted from 172.28.0.163:59326 #4617 (862 connections now open) 2015-10-05T13:42:27.336+0100 [mongosMain] connection accepted from 172.28.0.163:59334 #4618 (863 connections now open) 2015-10-05T13:42:27.336+0100 [mongosMain] connection accepted from 172.28.0.163:59163 #4619 (864 connections now open) 2015-10-05T13:42:27.339+0100 [conn4609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.340+0100 [conn4615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.340+0100 [mongosMain] connection accepted from 172.28.0.163:59180 #4620 (865 connections now open) 2015-10-05T13:42:27.341+0100 [mongosMain] connection accepted from 172.28.0.163:59220 #4621 (866 connections now open) 2015-10-05T13:42:27.341+0100 [mongosMain] connection accepted from 172.28.0.163:59235 #4622 (867 connections now open) 2015-10-05T13:42:27.342+0100 [mongosMain] connection accepted from 172.28.0.163:59269 #4623 (868 connections now open) 2015-10-05T13:42:27.343+0100 [mongosMain] connection accepted from 172.28.0.163:59314 #4624 (869 connections now open) 2015-10-05T13:42:27.344+0100 [conn4608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.344+0100 [conn4604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.345+0100 [mongosMain] connection accepted from 172.28.0.163:59338 #4625 (870 connections now open) 2015-10-05T13:42:27.345+0100 [mongosMain] connection accepted from 172.28.0.163:59148 #4626 (871 connections now open) 2015-10-05T13:42:27.346+0100 [mongosMain] connection accepted from 172.28.0.163:59195 #4627 (872 connections now open) 2015-10-05T13:42:27.346+0100 [mongosMain] connection accepted from 172.28.0.163:59203 #4628 (873 connections now open) 2015-10-05T13:42:27.347+0100 [conn4620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.347+0100 [conn4621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.347+0100 [mongosMain] connection accepted from 172.28.0.163:59252 #4629 (874 connections now open) 2015-10-05T13:42:27.347+0100 [mongosMain] connection accepted from 172.28.0.163:59282 #4630 (875 connections now open) 2015-10-05T13:42:27.347+0100 [mongosMain] connection accepted from 172.28.0.163:59301 #4631 (876 connections now open) 2015-10-05T13:42:27.347+0100 [mongosMain] connection accepted from 172.28.0.163:59357 #4632 (877 connections now open) 2015-10-05T13:42:27.348+0100 [conn4626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.350+0100 [conn4610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.350+0100 [conn4628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.350+0100 [mongosMain] connection accepted from 172.28.0.163:59160 #4633 (878 connections now open) 2015-10-05T13:42:27.350+0100 [conn4627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.350+0100 [mongosMain] connection accepted from 172.28.0.163:59183 #4634 (879 connections now open) 2015-10-05T13:42:27.350+0100 [mongosMain] connection accepted from 172.28.0.163:59223 #4635 (880 connections now open) 2015-10-05T13:42:27.350+0100 [mongosMain] connection accepted from 172.28.0.163:59232 #4636 (881 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59313 #4637 (882 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59270 #4638 (883 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59337 #4639 (884 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59151 #4640 (885 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59192 #4641 (886 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59200 #4642 (887 connections now open) 2015-10-05T13:42:27.351+0100 [mongosMain] connection accepted from 172.28.0.163:59255 #4643 (888 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59281 #4644 (889 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59302 #4645 (890 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59358 #4646 (891 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59139 #4647 (892 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59188 #4648 (893 connections now open) 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59212 #4649 (894 connections now open) 2015-10-05T13:42:27.352+0100 [conn4639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.352+0100 [mongosMain] connection accepted from 172.28.0.163:59259 #4650 (895 connections now open) 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59293 #4651 (896 connections now open) 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59306 #4652 (897 connections now open) 2015-10-05T13:42:27.353+0100 [conn4622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59346 #4653 (898 connections now open) 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59164 #4654 (899 connections now open) 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59179 #4655 (900 connections now open) 2015-10-05T13:42:27.353+0100 [conn4633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59219 #4656 (901 connections now open) 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59236 #4657 (902 connections now open) 2015-10-05T13:42:27.353+0100 [conn4613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.353+0100 [mongosMain] connection accepted from 172.28.0.163:59266 #4658 (903 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59317 #4659 (904 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59152 #4660 (905 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59175 #4661 (906 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59231 #4662 (907 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59240 #4663 (908 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59278 #4664 (909 connections now open) 2015-10-05T13:42:27.354+0100 [mongosMain] connection accepted from 172.28.0.163:59321 #4665 (910 connections now open) 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59329 #4666 (911 connections now open) 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59143 #4667 (912 connections now open) 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59184 #4668 (913 connections now open) 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59208 #4669 (914 connections now open) 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59263 #4670 (915 connections now open) 2015-10-05T13:42:27.353+0100 [conn4607] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59289 #4671 (916 connections now open) 2015-10-05T13:42:27.355+0100 [conn4619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.355+0100 [mongosMain] connection accepted from 172.28.0.163:59310 #4672 (917 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59350 #4673 (918 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59361 #4674 (919 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59345 #4675 (920 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59344 #4676 (921 connections now open) 2015-10-05T13:42:27.356+0100 [conn4645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59228 #4677 (922 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59243 #4678 (923 connections now open) 2015-10-05T13:42:27.356+0100 [mongosMain] connection accepted from 172.28.0.163:59322 #4679 (924 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59135 #4680 (925 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59155 #4681 (926 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59172 #4682 (927 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59277 #4683 (928 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59330 #4684 (929 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59140 #4685 (930 connections now open) 2015-10-05T13:42:27.357+0100 [mongosMain] connection accepted from 172.28.0.163:59187 #4686 (931 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59211 #4687 (932 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59260 #4688 (933 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59290 #4689 (934 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59309 #4690 (935 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59349 #4691 (936 connections now open) 2015-10-05T13:42:27.358+0100 [mongosMain] connection accepted from 172.28.0.163:59362 #4692 (937 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59144 #4693 (938 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59199 #4694 (939 connections now open) 2015-10-05T13:42:27.359+0100 [conn4634] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59207 #4695 (940 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59248 #4696 (941 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59286 #4697 (942 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59297 #4698 (943 connections now open) 2015-10-05T13:42:27.359+0100 [mongosMain] connection accepted from 172.28.0.163:59353 #4699 (944 connections now open) 2015-10-05T13:42:27.360+0100 [mongosMain] connection accepted from 172.28.0.163:59166 #4700 (945 connections now open) 2015-10-05T13:42:27.360+0100 [mongosMain] connection accepted from 172.28.0.163:59177 #4701 (946 connections now open) 2015-10-05T13:42:27.360+0100 [mongosMain] connection accepted from 172.28.0.163:59217 #4702 (947 connections now open) 2015-10-05T13:42:27.360+0100 [mongosMain] connection accepted from 172.28.0.163:59238 #4703 (948 connections now open) 2015-10-05T13:42:27.360+0100 [conn4643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.360+0100 [mongosMain] connection accepted from 172.28.0.163:59264 #4704 (949 connections now open) 2015-10-05T13:42:27.360+0100 [conn4655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.361+0100 [conn4649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.361+0100 [conn4661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.361+0100 [conn4673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.362+0100 [mongosMain] connection accepted from 172.28.0.163:59319 #4705 (950 connections now open) 2015-10-05T13:42:27.362+0100 [conn4631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.362+0100 [conn4640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.362+0100 [mongosMain] connection accepted from 172.28.0.163:59167 #4706 (951 connections now open) 2015-10-05T13:42:27.362+0100 [conn4646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.364+0100 [mongosMain] connection accepted from 172.28.0.163:59176 #4707 (952 connections now open) 2015-10-05T13:42:27.364+0100 [conn4679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.364+0100 [mongosMain] connection accepted from 172.28.0.163:59216 #4708 (953 connections now open) 2015-10-05T13:42:27.365+0100 [mongosMain] connection accepted from 172.28.0.163:59239 #4709 (954 connections now open) 2015-10-05T13:42:27.365+0100 [mongosMain] connection accepted from 172.28.0.163:59265 #4710 (955 connections now open) 2015-10-05T13:42:27.365+0100 [mongosMain] connection accepted from 172.28.0.163:59318 #4711 (956 connections now open) 2015-10-05T13:42:27.365+0100 [conn4539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.365+0100 [mongosMain] connection accepted from 172.28.0.163:59342 #4712 (957 connections now open) 2015-10-05T13:42:27.366+0100 [mongosMain] connection accepted from 172.28.0.163:59251 #4713 (958 connections now open) 2015-10-05T13:42:27.368+0100 [conn4632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4685] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [mongosMain] connection accepted from 172.28.0.163:59285 #4714 (959 connections now open) 2015-10-05T13:42:27.368+0100 [conn4656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4680] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.368+0100 [conn4686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.369+0100 [conn4674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.369+0100 [conn4692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.369+0100 [conn4698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.369+0100 [conn4704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.369+0100 [conn4703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.370+0100 [conn4657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.371+0100 [mongosMain] connection accepted from 172.28.0.163:59298 #4715 (960 connections now open) 2015-10-05T13:42:27.372+0100 [conn4625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.372+0100 [conn4669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.372+0100 [mongosMain] connection accepted from 172.28.0.163:59354 #4716 (961 connections now open) 2015-10-05T13:42:27.372+0100 [mongosMain] connection accepted from 172.28.0.163:59250 #4717 (962 connections now open) 2015-10-05T13:42:27.372+0100 [mongosMain] connection accepted from 172.28.0.163:59284 #4718 (963 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59299 #4719 (964 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59355 #4720 (965 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59253 #4721 (966 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59283 #4722 (967 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59300 #4723 (968 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59356 #4724 (969 connections now open) 2015-10-05T13:42:27.373+0100 [mongosMain] connection accepted from 172.28.0.163:59234 #4725 (970 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59221 #4726 (971 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59268 #4727 (972 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59315 #4728 (973 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59339 #4729 (974 connections now open) 2015-10-05T13:42:27.374+0100 [conn4675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59225 #4730 (975 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59246 #4731 (976 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59272 #4732 (977 connections now open) 2015-10-05T13:42:27.374+0100 [mongosMain] connection accepted from 172.28.0.163:59327 #4733 (978 connections now open) 2015-10-05T13:42:27.375+0100 [mongosMain] connection accepted from 172.28.0.163:59335 #4734 (979 connections now open) 2015-10-05T13:42:27.375+0100 [mongosMain] connection accepted from 172.28.0.163:59352 #4735 (980 connections now open) 2015-10-05T13:42:27.375+0100 [mongosMain] connection accepted from 172.28.0.163:59348 #4736 (981 connections now open) 2015-10-05T13:42:27.375+0100 [conn4687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.375+0100 [mongosMain] connection accepted from 172.28.0.163:59363 #4737 (982 connections now open) 2015-10-05T13:42:27.375+0100 [conn4667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.375+0100 [conn4637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.376+0100 [conn4693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.377+0100 [conn4594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.378+0100 [conn4699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.378+0100 [conn4705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4612] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.379+0100 [conn4624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.382+0100 [conn4652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.383+0100 [conn4733] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.384+0100 [conn4721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.385+0100 [conn4664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.386+0100 [conn4717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.387+0100 [conn4636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.387+0100 [conn4711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.388+0100 [conn4642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.388+0100 [conn4648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.389+0100 [conn4723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.400+0100 [conn4681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.400+0100 [conn4663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.402+0100 [conn4716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.408+0100 [conn4660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.408+0100 [conn4690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.408+0100 [conn4678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.408+0100 [conn4702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.408+0100 [conn4714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.409+0100 [conn4672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.409+0100 [conn4696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.409+0100 [conn4720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.410+0100 [conn4726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.411+0100 [conn4682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.411+0100 [conn4708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.411+0100 [conn4730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.411+0100 [conn4676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.411+0100 [conn4736] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.413+0100 [conn4734] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.413+0100 [conn4684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.413+0100 [conn4688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.413+0100 [conn4722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.413+0100 [conn4728] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.414+0100 [conn4724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.414+0100 [conn4658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.415+0100 [conn4666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.416+0100 [conn4706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.416+0100 [conn4700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.417+0100 [conn4732] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.417+0100 [conn4718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.422+0100 [conn4654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.423+0100 [conn4729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.423+0100 [conn4735] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.426+0100 [conn4551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.426+0100 [conn4545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.426+0100 [conn4557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.426+0100 [conn4563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.426+0100 [conn4710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.427+0100 [conn4581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.427+0100 [conn4587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.428+0100 [conn4593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.429+0100 [conn4694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4629] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.430+0100 [conn4605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.432+0100 [conn4641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.432+0100 [conn4653] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.433+0100 [conn4635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.434+0100 [conn4719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.434+0100 [conn4617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.435+0100 [conn4623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.435+0100 [conn4731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.435+0100 [conn4737] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.440+0100 [conn4712] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.440+0100 [conn4677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.444+0100 [conn4671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.459+0100 [conn4614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.460+0100 [conn4707] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.461+0100 [conn4725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.461+0100 [conn4713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.462+0100 [conn4659] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.844+0100 [mongosMain] connection accepted from 172.28.0.163:59347 #4738 (983 connections now open) 2015-10-05T13:42:27.844+0100 [mongosMain] connection accepted from 172.28.0.163:59359 #4739 (984 connections now open) 2015-10-05T13:42:27.851+0100 [conn4739] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:27.858+0100 [conn4738] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:28.362+0100 [mongosMain] connection accepted from 127.0.0.1:59436 #4740 (985 connections now open) 2015-10-05T13:42:28.365+0100 [conn4740] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:28.366+0100 [conn4740] end connection 127.0.0.1:59436 (984 connections now open) 2015-10-05T13:42:32.432+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612703812deab02e2999297 2015-10-05T13:42:32.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:37.309+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:42:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:42:38.784+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612703e12deab02e2999979 2015-10-05T13:42:38.852+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:40.025+0100 [mongosMain] connection accepted from 127.0.0.1:59720 #4741 (985 connections now open) 2015-10-05T13:42:40.028+0100 [conn4741] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:42:40.034+0100 [conn4741] end connection 127.0.0.1:59720 (984 connections now open) 2015-10-05T13:42:40.420+0100 [mongosMain] connection accepted from 172.28.0.163:59726 #4742 (985 connections now open) 2015-10-05T13:42:40.432+0100 [mongosMain] connection accepted from 172.28.0.163:59728 #4743 (986 connections now open) 2015-10-05T13:42:51.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612704b12deab02e29999d7 2015-10-05T13:42:51.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:42:55.766+0100 [conn2426] end connection 172.28.0.164:57203 (985 connections now open) 2015-10-05T13:42:55.768+0100 [mongosMain] connection accepted from 172.28.0.164:61789 #4744 (986 connections now open) 2015-10-05T13:42:55.771+0100 [conn4744] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:43:07.560+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:43:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:43:14.162+0100 [conn2731] end connection 172.28.0.163:55989 (985 connections now open) 2015-10-05T13:43:14.163+0100 [mongosMain] connection accepted from 172.28.0.163:59767 #4745 (986 connections now open) 2015-10-05T13:43:14.165+0100 [conn4745] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:43:16.612+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612706312deab02e29999d8 2015-10-05T13:43:16.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:28.617+0100 [mongosMain] connection accepted from 127.0.0.1:59777 #4746 (987 connections now open) 2015-10-05T13:43:28.620+0100 [conn4746] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:43:28.621+0100 [conn4746] end connection 127.0.0.1:59777 (986 connections now open) 2015-10-05T13:43:29.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612707012deab02e29999db 2015-10-05T13:43:29.184+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:35.467+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612707712deab02e29999dc 2015-10-05T13:43:35.604+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:37.959+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:43:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:43:40.099+0100 [mongosMain] connection accepted from 127.0.0.1:59778 #4747 (987 connections now open) 2015-10-05T13:43:40.101+0100 [conn4747] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:43:40.102+0100 [conn4747] end connection 127.0.0.1:59778 (986 connections now open) 2015-10-05T13:43:41.786+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612707d12deab02e29999dd 2015-10-05T13:43:41.854+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:48.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612708312deab02e29999de 2015-10-05T13:43:48.276+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:54.461+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612708a12deab02e29999df 2015-10-05T13:43:54.529+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:43:55.783+0100 [conn2416] end connection 172.28.0.164:57193 (985 connections now open) 2015-10-05T13:43:55.784+0100 [mongosMain] connection accepted from 172.28.0.164:61830 #4748 (986 connections now open) 2015-10-05T13:43:55.788+0100 [conn4748] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:44:00.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612709012deab02e29999e1 2015-10-05T13:44:00.950+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:07.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612709612deab02e29999e3 2015-10-05T13:44:07.168+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:08.091+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:44:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:44:13.319+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612709d12deab02e29999e5 2015-10-05T13:44:13.387+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:14.178+0100 [conn2732] end connection 172.28.0.163:55992 (985 connections now open) 2015-10-05T13:44:14.179+0100 [mongosMain] connection accepted from 172.28.0.163:59814 #4749 (986 connections now open) 2015-10-05T13:44:14.181+0100 [conn4749] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:44:19.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270a312deab02e29999e6 2015-10-05T13:44:19.809+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:26.093+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270a912deab02e29999e8 2015-10-05T13:44:26.229+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:28.622+0100 [mongosMain] connection accepted from 127.0.0.1:59821 #4750 (987 connections now open) 2015-10-05T13:44:28.625+0100 [conn4750] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:44:28.626+0100 [conn4750] end connection 127.0.0.1:59821 (986 connections now open) 2015-10-05T13:44:32.377+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270b012deab02e29999ea 2015-10-05T13:44:32.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:38.253+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:44:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:44:38.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270b612deab02e29999eb 2015-10-05T13:44:38.699+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:39.818+0100 [mongosMain] connection accepted from 127.0.0.1:59822 #4751 (987 connections now open) 2015-10-05T13:44:39.820+0100 [conn4751] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:44:39.821+0100 [conn4751] end connection 127.0.0.1:59822 (986 connections now open) 2015-10-05T13:44:44.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270bc12deab02e29999ec 2015-10-05T13:44:44.919+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:51.205+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270c212deab02e29999ed 2015-10-05T13:44:51.341+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:44:55.799+0100 [conn2467] end connection 172.28.0.164:57885 (985 connections now open) 2015-10-05T13:44:55.800+0100 [mongosMain] connection accepted from 172.28.0.164:61881 #4752 (986 connections now open) 2015-10-05T13:44:55.803+0100 [conn4752] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:44:57.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270c912deab02e29999ee 2015-10-05T13:44:57.627+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:03.918+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270cf12deab02e29999ef 2015-10-05T13:45:04.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:08.525+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:45:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:45:14.195+0100 [conn2733] end connection 172.28.0.163:55994 (985 connections now open) 2015-10-05T13:45:14.196+0100 [mongosMain] connection accepted from 172.28.0.163:59860 #4753 (986 connections now open) 2015-10-05T13:45:14.198+0100 [conn4753] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:45:16.349+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270dc12deab02e29999f0 2015-10-05T13:45:16.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:28.666+0100 [mongosMain] connection accepted from 127.0.0.1:59866 #4754 (987 connections now open) 2015-10-05T13:45:28.669+0100 [conn4754] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:45:28.670+0100 [conn4754] end connection 127.0.0.1:59866 (986 connections now open) 2015-10-05T13:45:34.785+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270ee12deab02e29999f1 2015-10-05T13:45:34.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:38.786+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:45:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:45:40.109+0100 [mongosMain] connection accepted from 127.0.0.1:59869 #4755 (987 connections now open) 2015-10-05T13:45:40.112+0100 [conn4755] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:45:40.112+0100 [conn4755] end connection 127.0.0.1:59869 (986 connections now open) 2015-10-05T13:45:47.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 561270fa12deab02e29999f2 2015-10-05T13:45:47.185+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:53.469+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612710112deab02e29999f3 2015-10-05T13:45:53.605+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:45:55.815+0100 [conn2414] end connection 172.28.0.164:57191 (985 connections now open) 2015-10-05T13:45:55.816+0100 [mongosMain] connection accepted from 172.28.0.164:61935 #4756 (986 connections now open) 2015-10-05T13:45:55.819+0100 [conn4756] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:45:59.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612710712deab02e29999f4 2015-10-05T13:45:59.890+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:06.208+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612710d12deab02e29999f5 2015-10-05T13:46:06.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:09.042+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:46:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:46:12.664+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612711412deab02e29999f6 2015-10-05T13:46:12.800+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:14.210+0100 [conn2734] end connection 172.28.0.163:55995 (985 connections now open) 2015-10-05T13:46:14.211+0100 [mongosMain] connection accepted from 172.28.0.163:59901 #4757 (986 connections now open) 2015-10-05T13:46:14.213+0100 [conn4757] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:18.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612711a12deab02e29999f7 2015-10-05T13:46:19.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:25.304+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612712112deab02e29999f8 2015-10-05T13:46:25.440+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:28.342+0100 [mongosMain] connection accepted from 127.0.0.1:59908 #4758 (987 connections now open) 2015-10-05T13:46:28.345+0100 [conn4758] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:28.346+0100 [conn4758] end connection 127.0.0.1:59908 (986 connections now open) 2015-10-05T13:46:31.623+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612712712deab02e29999f9 2015-10-05T13:46:31.724+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:37.880+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612712d12deab02e29999fa 2015-10-05T13:46:37.947+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:39.180+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:46:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444039191:41', sleeping for 30000ms 2015-10-05T13:46:39.763+0100 [mongosMain] connection accepted from 127.0.0.1:59909 #4759 (987 connections now open) 2015-10-05T13:46:39.765+0100 [conn4759] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:39.766+0100 [conn4759] end connection 127.0.0.1:59909 (986 connections now open) 2015-10-05T13:46:42.572+0100 [mongosMain] connection accepted from 172.28.0.164:61979 #4760 (987 connections now open) 2015-10-05T13:46:42.573+0100 [mongosMain] connection accepted from 172.28.0.164:61980 #4761 (988 connections now open) 2015-10-05T13:46:44.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' acquired, ts : 5612713312deab02e29999fb 2015-10-05T13:46:44.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444039191:41' unlocked. 2015-10-05T13:46:47.826+0100 [serviceShutdown] got SERVICE_CONTROL_STOP request from Windows Service Control Manager, will terminate after current cmd ends 2015-10-05T13:46:47.826+0100 [serviceShutdown] dbexit: exiting because Windows service was stopped 2015-10-05T13:46:49.160+0100 ***** SERVER RESTARTED ***** 2015-10-05T13:46:49.166+0100 Hotfix KB2731284 or later update is not installed, will zero-out data files 2015-10-05T13:46:49.167+0100 Trying to start Windows service 'MongoS' 2015-10-05T13:46:49.170+0100 Service running 2015-10-05T13:46:49.173+0100 [mongosMain] MongoS version 2.6.11 starting: pid=15524 port=27017 64-bit host=402929-MYWAPP1 (--help for usage) 2015-10-05T13:46:49.173+0100 [mongosMain] db version v2.6.11 2015-10-05T13:46:49.173+0100 [mongosMain] git version: d00c1735675c457f75a12d530bee85421f0c5548 2015-10-05T13:46:49.173+0100 [mongosMain] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49 2015-10-05T13:46:49.173+0100 [mongosMain] allocator: system 2015-10-05T13:46:49.173+0100 [mongosMain] options: { security: { keyFile: "C:\mongo\mongo_keyfile" }, service: true, sharding: { configDB: "mywdb7:27019,mywdb8:27019,mywdb9:27019" }, systemLog: { destination: "file", logAppend: true, path: "c:\mongo\data\log\mongos.log" } } 2015-10-05T13:46:49.204+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T13:46:49.207+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T13:46:49.209+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T13:46:49.222+0100 [mongosMain] creating WriteBackListener for: mywdb7:27019 serverID: 000000000000000000000000 2015-10-05T13:46:49.226+0100 [mongosMain] creating WriteBackListener for: mywdb8:27019 serverID: 000000000000000000000000 2015-10-05T13:46:49.230+0100 [mongosMain] creating WriteBackListener for: mywdb9:27019 serverID: 000000000000000000000000 2015-10-05T13:46:49.250+0100 [mongosMain] scoped connection to mywdb7:27019,mywdb8:27019,mywdb9:27019 not being returned to the pool 2015-10-05T13:46:49.251+0100 [Balancer] about to contact config servers and shards 2015-10-05T13:46:49.251+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T13:46:49.251+0100 [mongosMain] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T13:46:49.253+0100 [mongosMain] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T13:46:49.253+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T13:46:49.255+0100 [mongosMain] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T13:46:49.255+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T13:46:49.263+0100 [Balancer] starting new replica set monitor for replica set replset1 with seeds mywdb7.tg-server.net:27017,mywdb8.tg-server.net:27017,mywdb9.tg-server.net:27017 2015-10-05T13:46:49.263+0100 [mongosMain] waiting for connections on port 27017 2015-10-05T13:46:49.263+0100 [ReplicaSetMonitorWatcher] starting 2015-10-05T13:46:49.282+0100 [Balancer] config servers and shards contacted successfully 2015-10-05T13:46:49.282+0100 [Balancer] balancer id: 402929-MYWAPP1:27017 started at Oct 05 13:46:49 2015-10-05T13:46:49.310+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T13:46:49.310+0100 [LockPinger] creating distributed lock ping thread for mywdb7:27019,mywdb8:27019,mywdb9:27019 and process 402929-MYWAPP1:27017:1444049209:41 (sleeping for 30000ms) 2015-10-05T13:46:49.312+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T13:46:49.315+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T13:46:49.461+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:46:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:46:49.462+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271390c340f2cfc30c2ac 2015-10-05T13:46:49.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:46:49.532+0100 [mongosMain] connection accepted from 172.28.0.163:59918 #1 (1 connection now open) 2015-10-05T13:46:49.536+0100 [conn1] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:50.760+0100 [mongosMain] connection accepted from 172.28.0.163:59945 #2 (2 connections now open) 2015-10-05T13:46:50.762+0100 [conn2] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:50.769+0100 [conn2] creating WriteBackListener for: mywdb7.tg-server.net:27017 serverID: 561271390c340f2cfc30c2aa 2015-10-05T13:46:50.769+0100 [conn2] creating WriteBackListener for: mywdb8.tg-server.net:27017 serverID: 561271390c340f2cfc30c2aa 2015-10-05T13:46:50.769+0100 [conn2] creating WriteBackListener for: mywdb9.tg-server.net:27017 serverID: 561271390c340f2cfc30c2aa 2015-10-05T13:46:50.949+0100 [mongosMain] connection accepted from 172.28.0.164:61990 #3 (3 connections now open) 2015-10-05T13:46:50.951+0100 [conn3] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:51.322+0100 [mongosMain] connection accepted from 172.28.0.164:61993 #4 (4 connections now open) 2015-10-05T13:46:51.325+0100 [conn4] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:51.502+0100 [mongosMain] connection accepted from 172.21.40.52:56989 #5 (5 connections now open) 2015-10-05T13:46:52.756+0100 [mongosMain] connection accepted from 172.28.0.163:59953 #6 (6 connections now open) 2015-10-05T13:46:52.760+0100 [conn6] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:52.761+0100 [mongosMain] connection accepted from 172.28.0.163:59954 #7 (7 connections now open) 2015-10-05T13:46:52.763+0100 [conn7] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:55.816+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612713f0c340f2cfc30c2ad 2015-10-05T13:46:55.832+0100 [mongosMain] connection accepted from 172.28.0.164:61999 #8 (8 connections now open) 2015-10-05T13:46:55.835+0100 [conn8] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:55.838+0100 [mongosMain] connection accepted from 172.28.0.164:62000 #9 (9 connections now open) 2015-10-05T13:46:55.840+0100 [conn9] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:55.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:46:58.768+0100 [mongosMain] connection accepted from 172.28.0.164:62003 #10 (10 connections now open) 2015-10-05T13:46:58.768+0100 [mongosMain] connection accepted from 172.28.0.164:62004 #11 (11 connections now open) 2015-10-05T13:46:58.770+0100 [conn10] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:46:58.770+0100 [conn11] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:02.237+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271450c340f2cfc30c2ae 2015-10-05T13:47:02.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:08.365+0100 [mongosMain] connection accepted from 172.28.0.163:59979 #12 (12 connections now open) 2015-10-05T13:47:08.367+0100 [mongosMain] connection accepted from 172.28.0.163:59980 #13 (13 connections now open) 2015-10-05T13:47:08.367+0100 [conn12] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:08.368+0100 [conn13] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:08.586+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612714c0c340f2cfc30c2af 2015-10-05T13:47:08.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:14.228+0100 [mongosMain] connection accepted from 172.28.0.163:59988 #14 (14 connections now open) 2015-10-05T13:47:14.230+0100 [conn14] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:14.232+0100 [mongosMain] connection accepted from 172.28.0.163:59989 #15 (15 connections now open) 2015-10-05T13:47:14.233+0100 [conn15] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:14.801+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271520c340f2cfc30c2b0 2015-10-05T13:47:14.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:19.719+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:47:19 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:47:21.154+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271580c340f2cfc30c2b1 2015-10-05T13:47:21.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:27.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612715f0c340f2cfc30c2b2 2015-10-05T13:47:27.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:28.935+0100 [mongosMain] connection accepted from 127.0.0.1:59995 #16 (16 connections now open) 2015-10-05T13:47:28.939+0100 [conn16] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:28.945+0100 [conn16] end connection 127.0.0.1:59995 (15 connections now open) 2015-10-05T13:47:33.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271650c340f2cfc30c2b3 2015-10-05T13:47:33.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:40.073+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612716b0c340f2cfc30c2b4 2015-10-05T13:47:40.138+0100 [mongosMain] connection accepted from 127.0.0.1:59998 #17 (16 connections now open) 2015-10-05T13:47:40.140+0100 [conn17] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:40.140+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:40.145+0100 [conn17] end connection 127.0.0.1:59998 (15 connections now open) 2015-10-05T13:47:46.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271720c340f2cfc30c2b5 2015-10-05T13:47:46.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:47:48.759+0100 [conn12] end connection 172.28.0.163:59979 (14 connections now open) 2015-10-05T13:47:48.759+0100 [conn15] end connection 172.28.0.163:59989 (13 connections now open) 2015-10-05T13:47:48.759+0100 [conn1] end connection 172.28.0.163:59918 (12 connections now open) 2015-10-05T13:47:48.760+0100 [conn7] end connection 172.28.0.163:59954 (11 connections now open) 2015-10-05T13:47:48.761+0100 [conn13] end connection 172.28.0.163:59980 (10 connections now open) 2015-10-05T13:47:48.761+0100 [conn2] end connection 172.28.0.163:59945 (9 connections now open) 2015-10-05T13:47:48.762+0100 [conn14] end connection 172.28.0.163:59988 (8 connections now open) 2015-10-05T13:47:48.763+0100 [conn6] end connection 172.28.0.163:59953 (7 connections now open) 2015-10-05T13:47:54.514+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:47:49 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:47:55.848+0100 [mongosMain] connection accepted from 172.28.0.164:62049 #18 (8 connections now open) 2015-10-05T13:47:55.852+0100 [conn18] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:47:57.762+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612717b0c340f2cfc30c2b6 2015-10-05T13:47:58.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:48:06.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271850c340f2cfc30c2b7 2015-10-05T13:48:07.151+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:48:08.011+0100 [mongosMain] connection accepted from 172.28.0.164:62054 #19 (9 connections now open) 2015-10-05T13:48:08.013+0100 [conn19] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:48:13.906+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612718d0c340f2cfc30c2b8 2015-10-05T13:48:14.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:48:24.842+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:48:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:48:29.787+0100 [mongosMain] connection accepted from 127.0.0.1:60038 #20 (10 connections now open) 2015-10-05T13:48:29.790+0100 [conn20] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:48:29.795+0100 [conn20] end connection 127.0.0.1:60038 (9 connections now open) 2015-10-05T13:48:34.190+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271a10c340f2cfc30c2b9 2015-10-05T13:48:34.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:48:39.665+0100 [mongosMain] connection accepted from 127.0.0.1:60039 #21 (10 connections now open) 2015-10-05T13:48:39.667+0100 [conn21] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:48:39.672+0100 [conn21] end connection 127.0.0.1:60039 (9 connections now open) 2015-10-05T13:48:46.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271ae0c340f2cfc30c2bb 2015-10-05T13:48:46.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:48:52.678+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T13:48:52.678+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T13:48:54.998+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:48:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:48:55.864+0100 [mongosMain] connection accepted from 172.28.0.164:62098 #22 (10 connections now open) 2015-10-05T13:48:55.867+0100 [conn22] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:06.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271c00c340f2cfc30c2bd 2015-10-05T13:49:06.996+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:13.519+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271c90c340f2cfc30c2bf 2015-10-05T13:49:13.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:20.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271cf0c340f2cfc30c2c0 2015-10-05T13:49:20.206+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:25.291+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:49:25 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:49:26.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271d60c340f2cfc30c2c1 2015-10-05T13:49:26.589+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:28.624+0100 [mongosMain] connection accepted from 127.0.0.1:60094 #23 (11 connections now open) 2015-10-05T13:49:28.627+0100 [conn23] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:28.631+0100 [conn23] end connection 127.0.0.1:60094 (10 connections now open) 2015-10-05T13:49:30.864+0100 [mongosMain] connection accepted from 172.28.0.163:60112 #24 (11 connections now open) 2015-10-05T13:49:30.920+0100 [mongosMain] connection accepted from 172.28.0.163:60113 #25 (12 connections now open) 2015-10-05T13:49:31.418+0100 [conn25] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.418+0100 [conn24] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.431+0100 [mongosMain] connection accepted from 172.28.0.163:60116 #26 (13 connections now open) 2015-10-05T13:49:31.432+0100 [conn26] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.434+0100 [mongosMain] connection accepted from 172.28.0.163:60118 #27 (14 connections now open) 2015-10-05T13:49:31.435+0100 [conn27] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.436+0100 [mongosMain] connection accepted from 172.28.0.163:60120 #28 (15 connections now open) 2015-10-05T13:49:31.438+0100 [conn28] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.439+0100 [mongosMain] connection accepted from 172.28.0.163:60121 #29 (16 connections now open) 2015-10-05T13:49:31.441+0100 [conn29] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.442+0100 [mongosMain] connection accepted from 172.28.0.163:60123 #30 (17 connections now open) 2015-10-05T13:49:31.443+0100 [conn30] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.444+0100 [mongosMain] connection accepted from 172.28.0.163:60125 #31 (18 connections now open) 2015-10-05T13:49:31.446+0100 [conn31] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.447+0100 [mongosMain] connection accepted from 172.28.0.163:60126 #32 (19 connections now open) 2015-10-05T13:49:31.448+0100 [conn32] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.449+0100 [mongosMain] connection accepted from 172.28.0.163:60128 #33 (20 connections now open) 2015-10-05T13:49:31.451+0100 [conn33] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.452+0100 [mongosMain] connection accepted from 172.28.0.163:60130 #34 (21 connections now open) 2015-10-05T13:49:31.453+0100 [conn34] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.454+0100 [mongosMain] connection accepted from 172.28.0.163:60131 #35 (22 connections now open) 2015-10-05T13:49:31.455+0100 [conn35] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.457+0100 [mongosMain] connection accepted from 172.28.0.163:60133 #36 (23 connections now open) 2015-10-05T13:49:31.458+0100 [conn36] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.459+0100 [mongosMain] connection accepted from 172.28.0.163:60134 #37 (24 connections now open) 2015-10-05T13:49:31.460+0100 [conn37] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.461+0100 [mongosMain] connection accepted from 172.28.0.163:60136 #38 (25 connections now open) 2015-10-05T13:49:31.462+0100 [conn38] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.464+0100 [mongosMain] connection accepted from 172.28.0.163:60138 #39 (26 connections now open) 2015-10-05T13:49:31.465+0100 [conn39] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.466+0100 [mongosMain] connection accepted from 172.28.0.163:60139 #40 (27 connections now open) 2015-10-05T13:49:31.467+0100 [conn40] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.468+0100 [mongosMain] connection accepted from 172.28.0.163:60141 #41 (28 connections now open) 2015-10-05T13:49:31.469+0100 [conn41] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.471+0100 [mongosMain] connection accepted from 172.28.0.163:60142 #42 (29 connections now open) 2015-10-05T13:49:31.472+0100 [conn42] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.473+0100 [mongosMain] connection accepted from 172.28.0.163:60144 #43 (30 connections now open) 2015-10-05T13:49:31.474+0100 [conn43] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.475+0100 [mongosMain] connection accepted from 172.28.0.163:60146 #44 (31 connections now open) 2015-10-05T13:49:31.476+0100 [conn44] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.478+0100 [mongosMain] connection accepted from 172.28.0.163:60147 #45 (32 connections now open) 2015-10-05T13:49:31.479+0100 [conn45] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.480+0100 [mongosMain] connection accepted from 172.28.0.163:60149 #46 (33 connections now open) 2015-10-05T13:49:31.481+0100 [conn46] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.482+0100 [mongosMain] connection accepted from 172.28.0.163:60150 #47 (34 connections now open) 2015-10-05T13:49:31.484+0100 [conn47] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.485+0100 [mongosMain] connection accepted from 172.28.0.163:60152 #48 (35 connections now open) 2015-10-05T13:49:31.486+0100 [conn48] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.488+0100 [mongosMain] connection accepted from 172.28.0.163:60154 #49 (36 connections now open) 2015-10-05T13:49:31.489+0100 [conn49] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.490+0100 [mongosMain] connection accepted from 172.28.0.163:60155 #50 (37 connections now open) 2015-10-05T13:49:31.491+0100 [conn50] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.492+0100 [mongosMain] connection accepted from 172.28.0.163:60157 #51 (38 connections now open) 2015-10-05T13:49:31.494+0100 [conn51] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.495+0100 [mongosMain] connection accepted from 172.28.0.163:60159 #52 (39 connections now open) 2015-10-05T13:49:31.496+0100 [conn52] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.497+0100 [mongosMain] connection accepted from 172.28.0.163:60160 #53 (40 connections now open) 2015-10-05T13:49:31.499+0100 [conn53] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.500+0100 [mongosMain] connection accepted from 172.28.0.163:60162 #54 (41 connections now open) 2015-10-05T13:49:31.501+0100 [conn54] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.503+0100 [mongosMain] connection accepted from 172.28.0.163:60163 #55 (42 connections now open) 2015-10-05T13:49:31.504+0100 [conn55] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.505+0100 [mongosMain] connection accepted from 172.28.0.163:60165 #56 (43 connections now open) 2015-10-05T13:49:31.506+0100 [conn56] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.508+0100 [mongosMain] connection accepted from 172.28.0.163:60167 #57 (44 connections now open) 2015-10-05T13:49:31.509+0100 [conn57] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.510+0100 [mongosMain] connection accepted from 172.28.0.163:60168 #58 (45 connections now open) 2015-10-05T13:49:31.511+0100 [conn58] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.512+0100 [mongosMain] connection accepted from 172.28.0.163:60170 #59 (46 connections now open) 2015-10-05T13:49:31.514+0100 [conn59] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.515+0100 [mongosMain] connection accepted from 172.28.0.163:60171 #60 (47 connections now open) 2015-10-05T13:49:31.517+0100 [conn60] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.518+0100 [mongosMain] connection accepted from 172.28.0.163:60173 #61 (48 connections now open) 2015-10-05T13:49:31.519+0100 [conn61] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.520+0100 [mongosMain] connection accepted from 172.28.0.163:60175 #62 (49 connections now open) 2015-10-05T13:49:31.522+0100 [conn62] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.523+0100 [mongosMain] connection accepted from 172.28.0.163:60176 #63 (50 connections now open) 2015-10-05T13:49:31.524+0100 [conn63] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.526+0100 [mongosMain] connection accepted from 172.28.0.163:60178 #64 (51 connections now open) 2015-10-05T13:49:31.527+0100 [conn64] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.528+0100 [mongosMain] connection accepted from 172.28.0.163:60180 #65 (52 connections now open) 2015-10-05T13:49:31.530+0100 [conn65] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.531+0100 [mongosMain] connection accepted from 172.28.0.163:60181 #66 (53 connections now open) 2015-10-05T13:49:31.533+0100 [conn66] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.534+0100 [mongosMain] connection accepted from 172.28.0.163:60183 #67 (54 connections now open) 2015-10-05T13:49:31.536+0100 [conn67] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.537+0100 [mongosMain] connection accepted from 172.28.0.163:60185 #68 (55 connections now open) 2015-10-05T13:49:31.538+0100 [conn68] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.540+0100 [mongosMain] connection accepted from 172.28.0.163:60186 #69 (56 connections now open) 2015-10-05T13:49:31.542+0100 [conn69] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.543+0100 [mongosMain] connection accepted from 172.28.0.163:60188 #70 (57 connections now open) 2015-10-05T13:49:31.544+0100 [conn70] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.546+0100 [mongosMain] connection accepted from 172.28.0.163:60189 #71 (58 connections now open) 2015-10-05T13:49:31.547+0100 [conn71] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.549+0100 [mongosMain] connection accepted from 172.28.0.163:60191 #72 (59 connections now open) 2015-10-05T13:49:31.550+0100 [conn72] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.552+0100 [mongosMain] connection accepted from 172.28.0.163:60193 #73 (60 connections now open) 2015-10-05T13:49:31.553+0100 [conn73] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:31.554+0100 [mongosMain] connection accepted from 172.28.0.163:60194 #74 (61 connections now open) 2015-10-05T13:49:31.556+0100 [conn74] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:32.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271dc0c340f2cfc30c2c2 2015-10-05T13:49:32.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:39.099+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271e20c340f2cfc30c2c3 2015-10-05T13:49:39.235+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:40.143+0100 [mongosMain] connection accepted from 127.0.0.1:60217 #75 (62 connections now open) 2015-10-05T13:49:40.146+0100 [conn75] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:40.150+0100 [conn75] end connection 127.0.0.1:60217 (61 connections now open) 2015-10-05T13:49:45.502+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271e90c340f2cfc30c2c4 2015-10-05T13:49:45.638+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:50.143+0100 [mongosMain] connection accepted from 172.28.0.163:60229 #76 (62 connections now open) 2015-10-05T13:49:50.144+0100 [mongosMain] connection accepted from 172.28.0.163:60230 #77 (63 connections now open) 2015-10-05T13:49:51.925+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271ef0c340f2cfc30c2c5 2015-10-05T13:49:52.061+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:49:55.880+0100 [mongosMain] connection accepted from 172.28.0.164:62150 #78 (64 connections now open) 2015-10-05T13:49:55.884+0100 [conn78] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:49:56.075+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:49:55 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:49:58.328+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271f60c340f2cfc30c2c6 2015-10-05T13:49:58.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:04.628+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561271fc0c340f2cfc30c2c7 2015-10-05T13:50:04.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:10.846+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272020c340f2cfc30c2c8 2015-10-05T13:50:10.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:17.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272080c340f2cfc30c2c9 2015-10-05T13:50:17.331+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:23.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612720f0c340f2cfc30c2ca 2015-10-05T13:50:23.548+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:26.349+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:50:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:50:28.722+0100 [mongosMain] connection accepted from 127.0.0.1:60259 #79 (65 connections now open) 2015-10-05T13:50:28.725+0100 [conn79] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:50:28.730+0100 [conn79] end connection 127.0.0.1:60259 (64 connections now open) 2015-10-05T13:50:35.840+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612721b0c340f2cfc30c2cb 2015-10-05T13:50:35.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:39.707+0100 [mongosMain] connection accepted from 127.0.0.1:60262 #80 (65 connections now open) 2015-10-05T13:50:39.710+0100 [conn80] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:50:39.715+0100 [conn80] end connection 127.0.0.1:60262 (64 connections now open) 2015-10-05T13:50:48.147+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272270c340f2cfc30c2cc 2015-10-05T13:50:48.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:50:54.296+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T13:50:54.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T13:50:55.896+0100 [mongosMain] connection accepted from 172.28.0.164:62196 #81 (65 connections now open) 2015-10-05T13:50:55.899+0100 [conn81] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:50:56.618+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:50:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:51:00.580+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272340c340f2cfc30c2ce 2015-10-05T13:51:00.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:51:13.007+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272400c340f2cfc30c2cf 2015-10-05T13:51:13.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:51:25.435+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612724d0c340f2cfc30c2d1 2015-10-05T13:51:25.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:51:26.902+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:51:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:51:29.024+0100 [mongosMain] connection accepted from 127.0.0.1:60304 #82 (66 connections now open) 2015-10-05T13:51:29.027+0100 [conn82] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:51:29.032+0100 [conn82] end connection 127.0.0.1:60304 (65 connections now open) 2015-10-05T13:51:37.864+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272590c340f2cfc30c2d2 2015-10-05T13:51:38.000+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:51:39.489+0100 [mongosMain] connection accepted from 127.0.0.1:60306 #83 (66 connections now open) 2015-10-05T13:51:39.492+0100 [conn83] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:51:39.497+0100 [conn83] end connection 127.0.0.1:60306 (65 connections now open) 2015-10-05T13:51:50.294+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272660c340f2cfc30c2d3 2015-10-05T13:51:50.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:51:55.913+0100 [mongosMain] connection accepted from 172.28.0.164:62242 #84 (66 connections now open) 2015-10-05T13:51:55.916+0100 [conn84] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:51:57.054+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:51:56 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:52:02.725+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272720c340f2cfc30c2d4 2015-10-05T13:52:02.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:11.592+0100 [mongosMain] connection accepted from 172.28.0.164:62245 #85 (67 connections now open) 2015-10-05T13:52:11.727+0100 [conn85] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:15.153+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612727e0c340f2cfc30c2d6 2015-10-05T13:52:15.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:17.099+0100 [mongosMain] connection accepted from 172.28.0.164:62247 #86 (68 connections now open) 2015-10-05T13:52:17.103+0100 [conn86] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:27.301+0100 [Balancer] SyncClusterConnection connecting to [mywdb7:27019] 2015-10-05T13:52:27.305+0100 [Balancer] SyncClusterConnection connecting to [mywdb8:27019] 2015-10-05T13:52:27.307+0100 [Balancer] SyncClusterConnection connecting to [mywdb9:27019] 2015-10-05T13:52:27.308+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:52:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:52:27.582+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612728b0c340f2cfc30c2d7 2015-10-05T13:52:27.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:28.669+0100 [mongosMain] connection accepted from 127.0.0.1:60354 #87 (69 connections now open) 2015-10-05T13:52:28.672+0100 [conn87] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:28.677+0100 [conn87] end connection 127.0.0.1:60354 (68 connections now open) 2015-10-05T13:52:33.832+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T13:52:33.832+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T13:52:35.650+0100 [conn76] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:39.978+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272970c340f2cfc30c2db 2015-10-05T13:52:40.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:40.050+0100 [mongosMain] connection accepted from 127.0.0.1:60356 #88 (69 connections now open) 2015-10-05T13:52:40.053+0100 [conn88] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:40.058+0100 [conn88] end connection 127.0.0.1:60356 (68 connections now open) 2015-10-05T13:52:46.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612729e0c340f2cfc30c2de 2015-10-05T13:52:46.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:52.615+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272a40c340f2cfc30c2df 2015-10-05T13:52:52.682+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:52:55.929+0100 [mongosMain] connection accepted from 172.28.0.164:62290 #89 (69 connections now open) 2015-10-05T13:52:55.932+0100 [conn89] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:52:57.567+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:52:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:52:58.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272aa0c340f2cfc30c2e1 2015-10-05T13:52:59.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:05.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272b10c340f2cfc30c2e2 2015-10-05T13:53:05.525+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:11.776+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272b70c340f2cfc30c2e3 2015-10-05T13:53:11.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:18.059+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272bd0c340f2cfc30c2e4 2015-10-05T13:53:18.127+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:24.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272c40c340f2cfc30c2e6 2015-10-05T13:53:24.345+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:27.830+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:53:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:53:29.224+0100 [mongosMain] connection accepted from 127.0.0.1:60402 #90 (70 connections now open) 2015-10-05T13:53:29.228+0100 [conn90] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:53:29.235+0100 [conn90] end connection 127.0.0.1:60402 (69 connections now open) 2015-10-05T13:53:30.631+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272ca0c340f2cfc30c2e7 2015-10-05T13:53:30.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:36.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272d00c340f2cfc30c2ea 2015-10-05T13:53:37.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:40.131+0100 [mongosMain] connection accepted from 127.0.0.1:60405 #91 (70 connections now open) 2015-10-05T13:53:40.134+0100 [conn91] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:53:40.139+0100 [conn91] end connection 127.0.0.1:60405 (69 connections now open) 2015-10-05T13:53:43.336+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272d70c340f2cfc30c2eb 2015-10-05T13:53:43.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:49.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272dd0c340f2cfc30c2ed 2015-10-05T13:53:49.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:55.945+0100 [mongosMain] connection accepted from 172.28.0.164:62333 #92 (70 connections now open) 2015-10-05T13:53:55.947+0100 [conn92] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:53:55.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272e30c340f2cfc30c2ef 2015-10-05T13:53:56.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:53:58.095+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:53:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:54:02.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272ea0c340f2cfc30c2f0 2015-10-05T13:54:02.535+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:20.840+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561272fc0c340f2cfc30c2f3 2015-10-05T13:54:20.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:28.417+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:54:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:54:28.667+0100 [mongosMain] connection accepted from 127.0.0.1:60448 #93 (71 connections now open) 2015-10-05T13:54:28.683+0100 [conn93] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:54:28.683+0100 [conn93] end connection 127.0.0.1:60448 (70 connections now open) 2015-10-05T13:54:33.258+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273080c340f2cfc30c2f4 2015-10-05T13:54:33.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:39.679+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612730f0c340f2cfc30c2f5 2015-10-05T13:54:39.732+0100 [mongosMain] connection accepted from 127.0.0.1:60449 #94 (71 connections now open) 2015-10-05T13:54:39.735+0100 [conn94] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:54:39.740+0100 [conn94] end connection 127.0.0.1:60449 (70 connections now open) 2015-10-05T13:54:39.815+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:45.999+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273150c340f2cfc30c2f6 2015-10-05T13:54:46.101+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:52.269+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612731c0c340f2cfc30c2f7 2015-10-05T13:54:52.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:54:55.961+0100 [mongosMain] connection accepted from 172.28.0.164:62385 #95 (71 connections now open) 2015-10-05T13:54:55.964+0100 [conn95] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:54:58.657+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273220c340f2cfc30c2f8 2015-10-05T13:54:58.692+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:54:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:54:58.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:05.078+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273280c340f2cfc30c2f9 2015-10-05T13:55:05.214+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:11.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612732f0c340f2cfc30c2fa 2015-10-05T13:55:11.566+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:17.851+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273350c340f2cfc30c2fb 2015-10-05T13:55:17.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:24.271+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612733b0c340f2cfc30c2fc 2015-10-05T13:55:24.407+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:28.643+0100 [mongosMain] connection accepted from 127.0.0.1:60489 #96 (72 connections now open) 2015-10-05T13:55:28.646+0100 [conn96] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:55:28.652+0100 [conn96] end connection 127.0.0.1:60489 (71 connections now open) 2015-10-05T13:55:28.949+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:55:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:55:30.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273420c340f2cfc30c2fd 2015-10-05T13:55:30.705+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:40.148+0100 [mongosMain] connection accepted from 127.0.0.1:60492 #97 (72 connections now open) 2015-10-05T13:55:40.151+0100 [conn97] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:55:40.155+0100 [conn97] end connection 127.0.0.1:60492 (71 connections now open) 2015-10-05T13:55:42.980+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612734e0c340f2cfc30c2fe 2015-10-05T13:55:43.116+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:49.260+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273550c340f2cfc30c2ff 2015-10-05T13:55:49.327+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:55:55.977+0100 [mongosMain] connection accepted from 172.28.0.164:62429 #98 (72 connections now open) 2015-10-05T13:55:55.980+0100 [conn98] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:55:59.085+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:55:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:56:01.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273610c340f2cfc30c300 2015-10-05T13:56:01.752+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:03.159+0100 [mongosMain] connection accepted from 172.28.0.163:60516 #99 (73 connections now open) 2015-10-05T13:56:03.161+0100 [conn99] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:03.484+0100 [conn77] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:03.857+0100 [mongosMain] connection accepted from 172.28.0.163:60930 #100 (74 connections now open) 2015-10-05T13:56:03.859+0100 [conn100] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:14.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612736d0c340f2cfc30c31b 2015-10-05T13:56:14.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:20.460+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273740c340f2cfc30c31c 2015-10-05T13:56:20.596+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:26.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612737a0c340f2cfc30c31d 2015-10-05T13:56:27.001+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:28.495+0100 [mongosMain] connection accepted from 127.0.0.1:60948 #101 (75 connections now open) 2015-10-05T13:56:28.498+0100 [conn101] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:28.503+0100 [conn101] end connection 127.0.0.1:60948 (74 connections now open) 2015-10-05T13:56:29.359+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:56:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:56:33.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273810c340f2cfc30c31e 2015-10-05T13:56:33.395+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:35.458+0100 [conn77] end connection 172.28.0.163:60230 (73 connections now open) 2015-10-05T13:56:35.458+0100 [conn76] end connection 172.28.0.163:60229 (73 connections now open) 2015-10-05T13:56:35.461+0100 [conn99] end connection 172.28.0.163:60516 (71 connections now open) 2015-10-05T13:56:35.471+0100 [conn100] end connection 172.28.0.163:60930 (70 connections now open) 2015-10-05T13:56:39.545+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273870c340f2cfc30c31f 2015-10-05T13:56:39.613+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:40.058+0100 [mongosMain] connection accepted from 127.0.0.1:60949 #102 (71 connections now open) 2015-10-05T13:56:40.061+0100 [conn102] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:40.066+0100 [conn102] end connection 127.0.0.1:60949 (70 connections now open) 2015-10-05T13:56:45.934+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612738d0c340f2cfc30c320 2015-10-05T13:56:46.070+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:55.993+0100 [mongosMain] connection accepted from 172.28.0.164:62475 #103 (71 connections now open) 2015-10-05T13:56:55.996+0100 [conn103] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:56:58.230+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612739a0c340f2cfc30c321 2015-10-05T13:56:58.298+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:56:59.596+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:56:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:57:04.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273a00c340f2cfc30c322 2015-10-05T13:57:04.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:10.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273a60c340f2cfc30c323 2015-10-05T13:57:10.972+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:17.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273ac0c340f2cfc30c324 2015-10-05T13:57:17.394+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:23.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273b30c340f2cfc30c325 2015-10-05T13:57:23.783+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:28.626+0100 [mongosMain] connection accepted from 127.0.0.1:60989 #104 (72 connections now open) 2015-10-05T13:57:28.629+0100 [conn104] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:57:28.635+0100 [conn104] end connection 127.0.0.1:60989 (71 connections now open) 2015-10-05T13:57:29.728+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:57:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:57:29.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273b90c340f2cfc30c326 2015-10-05T13:57:30.003+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:36.291+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273c00c340f2cfc30c327 2015-10-05T13:57:36.428+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:40.004+0100 [mongosMain] connection accepted from 127.0.0.1:60990 #105 (72 connections now open) 2015-10-05T13:57:40.007+0100 [conn105] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:57:40.011+0100 [conn105] end connection 127.0.0.1:60990 (71 connections now open) 2015-10-05T13:57:42.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273c60c340f2cfc30c329 2015-10-05T13:57:42.646+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:48.933+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273cc0c340f2cfc30c32a 2015-10-05T13:57:49.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:55.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273d30c340f2cfc30c32b 2015-10-05T13:57:55.599+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:57:56.009+0100 [mongosMain] connection accepted from 172.28.0.164:62525 #106 (72 connections now open) 2015-10-05T13:57:56.012+0100 [conn106] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:58:00.042+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:57:59 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:58:01.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273d90c340f2cfc30c32c 2015-10-05T13:58:01.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:07.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273df0c340f2cfc30c32e 2015-10-05T13:58:08.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:14.348+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273e60c340f2cfc30c330 2015-10-05T13:58:14.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:20.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273ec0c340f2cfc30c331 2015-10-05T13:58:20.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:27.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273f20c340f2cfc30c332 2015-10-05T13:58:27.095+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:28.242+0100 [mongosMain] connection accepted from 127.0.0.1:61027 #107 (73 connections now open) 2015-10-05T13:58:28.245+0100 [conn107] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:58:28.250+0100 [conn107] end connection 127.0.0.1:61027 (72 connections now open) 2015-10-05T13:58:30.171+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:58:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:58:33.385+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273f90c340f2cfc30c333 2015-10-05T13:58:33.521+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:39.321+0100 [mongosMain] connection accepted from 127.0.0.1:61028 #108 (73 connections now open) 2015-10-05T13:58:39.324+0100 [conn108] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:58:39.328+0100 [conn108] end connection 127.0.0.1:61028 (72 connections now open) 2015-10-05T13:58:39.673+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561273ff0c340f2cfc30c334 2015-10-05T13:58:39.740+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:46.030+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274050c340f2cfc30c335 2015-10-05T13:58:46.166+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:52.318+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612740c0c340f2cfc30c336 2015-10-05T13:58:52.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:58:56.025+0100 [mongosMain] connection accepted from 172.28.0.164:62571 #109 (73 connections now open) 2015-10-05T13:58:56.029+0100 [conn109] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:58:58.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274120c340f2cfc30c337 2015-10-05T13:58:58.606+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:00.314+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:59:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:59:04.861+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274180c340f2cfc30c338 2015-10-05T13:59:04.997+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:11.150+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612741f0c340f2cfc30c339 2015-10-05T13:59:11.217+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:17.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274250c340f2cfc30c33a 2015-10-05T13:59:17.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:23.892+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612742b0c340f2cfc30c33b 2015-10-05T13:59:24.028+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:28.965+0100 [mongosMain] connection accepted from 127.0.0.1:61066 #110 (74 connections now open) 2015-10-05T13:59:28.971+0100 [conn110] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:59:28.977+0100 [conn110] end connection 127.0.0.1:61066 (73 connections now open) 2015-10-05T13:59:30.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274320c340f2cfc30c33c 2015-10-05T13:59:30.450+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:30.587+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 13:59:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T13:59:31.710+0100 [conn24] end connection 172.28.0.163:60112 (72 connections now open) 2015-10-05T13:59:31.712+0100 [mongosMain] connection accepted from 172.28.0.163:61069 #111 (73 connections now open) 2015-10-05T13:59:31.714+0100 [conn111] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T13:59:36.738+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274380c340f2cfc30c33d 2015-10-05T13:59:36.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:39.677+0100 [mongosMain] connection accepted from 127.0.0.1:61071 #112 (74 connections now open) 2015-10-05T13:59:39.680+0100 [conn112] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T13:59:39.684+0100 [conn112] end connection 127.0.0.1:61071 (73 connections now open) 2015-10-05T13:59:43.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612743e0c340f2cfc30c33f 2015-10-05T13:59:43.296+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:49.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274450c340f2cfc30c340 2015-10-05T13:59:49.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:55.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612744b0c340f2cfc30c341 2015-10-05T13:59:55.744+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T13:59:56.042+0100 [mongosMain] connection accepted from 172.28.0.164:62616 #113 (74 connections now open) 2015-10-05T13:59:56.045+0100 [conn113] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:00:00.867+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:00:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:00:02.032+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274510c340f2cfc30c342 2015-10-05T14:00:02.167+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:08.433+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274580c340f2cfc30c343 2015-10-05T14:00:08.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:14.729+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612745e0c340f2cfc30c344 2015-10-05T14:00:14.797+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:20.991+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274640c340f2cfc30c345 2015-10-05T14:00:21.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:27.209+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612746b0c340f2cfc30c346 2015-10-05T14:00:27.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:28.212+0100 [mongosMain] connection accepted from 127.0.0.1:61111 #114 (75 connections now open) 2015-10-05T14:00:28.215+0100 [conn114] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:00:28.221+0100 [conn114] end connection 127.0.0.1:61111 (74 connections now open) 2015-10-05T14:00:31.166+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:00:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:00:31.759+0100 [conn26] end connection 172.28.0.163:60116 (73 connections now open) 2015-10-05T14:00:31.759+0100 [mongosMain] connection accepted from 172.28.0.163:61114 #115 (74 connections now open) 2015-10-05T14:00:31.759+0100 [conn115] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:00:33.553+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274710c340f2cfc30c347 2015-10-05T14:00:33.647+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:39.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274770c340f2cfc30c349 2015-10-05T14:00:39.817+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:40.031+0100 [mongosMain] connection accepted from 127.0.0.1:61116 #116 (75 connections now open) 2015-10-05T14:00:40.034+0100 [conn116] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:00:40.039+0100 [conn116] end connection 127.0.0.1:61116 (74 connections now open) 2015-10-05T14:00:45.976+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612747d0c340f2cfc30c34a 2015-10-05T14:00:46.044+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:52.329+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274840c340f2cfc30c34b 2015-10-05T14:00:52.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:00:56.058+0100 [mongosMain] connection accepted from 172.28.0.164:62659 #117 (75 connections now open) 2015-10-05T14:00:56.061+0100 [conn117] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:00:58.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612748a0c340f2cfc30c34c 2015-10-05T14:00:58.887+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:01.312+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:01:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:01:05.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274900c340f2cfc30c34d 2015-10-05T14:01:05.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:11.257+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274970c340f2cfc30c34f 2015-10-05T14:01:11.325+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:17.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612749d0c340f2cfc30c350 2015-10-05T14:01:17.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:23.691+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274a30c340f2cfc30c351 2015-10-05T14:01:23.759+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:28.903+0100 [mongosMain] connection accepted from 127.0.0.1:61154 #118 (76 connections now open) 2015-10-05T14:01:28.905+0100 [conn118] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:01:28.911+0100 [conn118] end connection 127.0.0.1:61154 (75 connections now open) 2015-10-05T14:01:30.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274a90c340f2cfc30c352 2015-10-05T14:01:30.183+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:31.585+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:01:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:01:31.738+0100 [conn27] end connection 172.28.0.163:60118 (74 connections now open) 2015-10-05T14:01:31.739+0100 [mongosMain] connection accepted from 172.28.0.163:61165 #119 (75 connections now open) 2015-10-05T14:01:31.741+0100 [conn119] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:01:36.335+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274b00c340f2cfc30c353 2015-10-05T14:01:36.403+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:39.719+0100 [mongosMain] connection accepted from 127.0.0.1:61167 #120 (76 connections now open) 2015-10-05T14:01:39.722+0100 [conn120] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:01:39.726+0100 [conn120] end connection 127.0.0.1:61167 (75 connections now open) 2015-10-05T14:01:42.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274b60c340f2cfc30c355 2015-10-05T14:01:42.624+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:48.921+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274bc0c340f2cfc30c357 2015-10-05T14:01:49.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:55.311+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274c30c340f2cfc30c359 2015-10-05T14:01:55.447+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:01:56.074+0100 [mongosMain] connection accepted from 172.28.0.164:62701 #121 (76 connections now open) 2015-10-05T14:01:56.078+0100 [conn121] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:02:01.597+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274c90c340f2cfc30c35a 2015-10-05T14:02:01.665+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:01.734+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:02:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:02:07.827+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274cf0c340f2cfc30c35b 2015-10-05T14:02:07.895+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:14.180+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274d50c340f2cfc30c35c 2015-10-05T14:02:14.316+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:20.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274dc0c340f2cfc30c35d 2015-10-05T14:02:20.751+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:27.039+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274e20c340f2cfc30c35e 2015-10-05T14:02:27.175+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:28.469+0100 [mongosMain] connection accepted from 127.0.0.1:61206 #122 (77 connections now open) 2015-10-05T14:02:28.471+0100 [conn122] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:02:28.477+0100 [conn122] end connection 127.0.0.1:61206 (76 connections now open) 2015-10-05T14:02:31.754+0100 [conn28] end connection 172.28.0.163:60120 (75 connections now open) 2015-10-05T14:02:31.755+0100 [mongosMain] connection accepted from 172.28.0.163:61207 #123 (76 connections now open) 2015-10-05T14:02:31.757+0100 [conn123] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:02:31.992+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:02:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:02:33.429+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274e90c340f2cfc30c35f 2015-10-05T14:02:33.563+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:39.250+0100 [mongosMain] connection accepted from 127.0.0.1:61211 #124 (77 connections now open) 2015-10-05T14:02:39.253+0100 [conn124] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:02:39.257+0100 [conn124] end connection 127.0.0.1:61211 (76 connections now open) 2015-10-05T14:02:39.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561274ef0c340f2cfc30c360 2015-10-05T14:02:39.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:02:52.182+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:02:52.182+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:02:56.106+0100 [mongosMain] connection accepted from 172.28.0.164:62746 #125 (77 connections now open) 2015-10-05T14:02:56.109+0100 [conn125] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:02:58.298+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56127500d5de43e0ed5d40dd') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444050178189), why: "doing balance round", ts: ObjectId('561275020c340f2cfc30c363') } } gle1: { lastOp: Timestamp 1444050159000|8, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } gle2: { lastOp: Timestamp 1444050178000|3, connectionId: 40376, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T14:02:58.301+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:02:58.301+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:03:02.157+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:03:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:03:02.157+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:03:02.226+0100 [LockPinger] handled late remove of old distributed lock with ts 561275020c340f2cfc30c363 2015-10-05T14:03:04.585+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275080c340f2cfc30c364 2015-10-05T14:03:04.721+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:10.975+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612750e0c340f2cfc30c365 2015-10-05T14:03:11.043+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:17.430+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275150c340f2cfc30c366 2015-10-05T14:03:17.635+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:23.900+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612751b0c340f2cfc30c367 2015-10-05T14:03:24.036+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:29.181+0100 [mongosMain] connection accepted from 127.0.0.1:61249 #126 (78 connections now open) 2015-10-05T14:03:29.184+0100 [conn126] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:03:29.189+0100 [conn126] end connection 127.0.0.1:61249 (77 connections now open) 2015-10-05T14:03:30.322+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275220c340f2cfc30c368 2015-10-05T14:03:30.457+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:31.770+0100 [conn29] end connection 172.28.0.163:60121 (76 connections now open) 2015-10-05T14:03:31.771+0100 [mongosMain] connection accepted from 172.28.0.163:61250 #127 (77 connections now open) 2015-10-05T14:03:31.773+0100 [conn127] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:03:32.368+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:03:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:03:36.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275280c340f2cfc30c369 2015-10-05T14:03:36.677+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:39.461+0100 [mongosMain] connection accepted from 127.0.0.1:61252 #128 (78 connections now open) 2015-10-05T14:03:39.464+0100 [conn128] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:03:39.468+0100 [conn128] end connection 127.0.0.1:61252 (77 connections now open) 2015-10-05T14:03:42.935+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612752e0c340f2cfc30c36c 2015-10-05T14:03:43.071+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:49.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275350c340f2cfc30c36e 2015-10-05T14:03:49.493+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:55.652+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612753b0c340f2cfc30c36f 2015-10-05T14:03:55.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:03:56.122+0100 [mongosMain] connection accepted from 172.28.0.164:62791 #129 (78 connections now open) 2015-10-05T14:03:56.124+0100 [conn129] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:04:02.017+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275410c340f2cfc30c370 2015-10-05T14:04:02.152+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:02.528+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:04:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:04:08.303+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275480c340f2cfc30c371 2015-10-05T14:04:08.371+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:14.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612754e0c340f2cfc30c372 2015-10-05T14:04:14.790+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:20.937+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275540c340f2cfc30c373 2015-10-05T14:04:21.005+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:27.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612755b0c340f2cfc30c374 2015-10-05T14:04:27.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:28.632+0100 [mongosMain] connection accepted from 127.0.0.1:61291 #130 (79 connections now open) 2015-10-05T14:04:28.634+0100 [conn130] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:04:28.639+0100 [conn130] end connection 127.0.0.1:61291 (78 connections now open) 2015-10-05T14:04:31.787+0100 [conn30] end connection 172.28.0.163:60123 (77 connections now open) 2015-10-05T14:04:31.788+0100 [mongosMain] connection accepted from 172.28.0.163:61292 #131 (78 connections now open) 2015-10-05T14:04:31.790+0100 [conn131] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:04:32.784+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:04:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:04:33.706+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275610c340f2cfc30c375 2015-10-05T14:04:33.842+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:39.461+0100 [mongosMain] connection accepted from 127.0.0.1:61294 #132 (79 connections now open) 2015-10-05T14:04:39.464+0100 [conn132] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:04:39.468+0100 [conn132] end connection 127.0.0.1:61294 (78 connections now open) 2015-10-05T14:04:39.990+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275670c340f2cfc30c376 2015-10-05T14:04:40.058+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:46.207+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612756e0c340f2cfc30c377 2015-10-05T14:04:46.308+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:52.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275740c340f2cfc30c378 2015-10-05T14:04:52.731+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:04:56.138+0100 [mongosMain] connection accepted from 172.28.0.164:62840 #133 (79 connections now open) 2015-10-05T14:04:56.141+0100 [conn133] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:04:58.984+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612757a0c340f2cfc30c379 2015-10-05T14:04:59.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:02.947+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:05:02 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:05:05.270+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275810c340f2cfc30c37a 2015-10-05T14:05:05.338+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:11.504+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275870c340f2cfc30c37b 2015-10-05T14:05:11.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:17.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612758d0c340f2cfc30c37d 2015-10-05T14:05:17.994+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:24.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275940c340f2cfc30c37e 2015-10-05T14:05:24.426+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:28.504+0100 [mongosMain] connection accepted from 127.0.0.1:61338 #134 (80 connections now open) 2015-10-05T14:05:28.507+0100 [conn134] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:05:28.512+0100 [conn134] end connection 127.0.0.1:61338 (79 connections now open) 2015-10-05T14:05:30.713+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612759a0c340f2cfc30c380 2015-10-05T14:05:30.849+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:31.802+0100 [conn31] end connection 172.28.0.163:60125 (78 connections now open) 2015-10-05T14:05:31.803+0100 [mongosMain] connection accepted from 172.28.0.163:61340 #135 (79 connections now open) 2015-10-05T14:05:31.805+0100 [conn135] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:05:33.204+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:05:32 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:05:37.136+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275a00c340f2cfc30c381 2015-10-05T14:05:37.272+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:39.552+0100 [mongosMain] connection accepted from 127.0.0.1:61342 #136 (80 connections now open) 2015-10-05T14:05:39.555+0100 [conn136] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:05:39.559+0100 [conn136] end connection 127.0.0.1:61342 (79 connections now open) 2015-10-05T14:05:43.555+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275a70c340f2cfc30c382 2015-10-05T14:05:43.690+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:49.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275ad0c340f2cfc30c383 2015-10-05T14:05:50.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:05:56.154+0100 [mongosMain] connection accepted from 172.28.0.164:62885 #137 (80 connections now open) 2015-10-05T14:05:56.158+0100 [conn137] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:05:56.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275b40c340f2cfc30c384 2015-10-05T14:05:56.542+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:01.404+0100 [mongosMain] connection accepted from 172.28.0.163:61377 #138 (81 connections now open) 2015-10-05T14:06:01.524+0100 [conn138] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.621+0100 [mongosMain] connection accepted from 172.28.0.163:61378 #139 (82 connections now open) 2015-10-05T14:06:01.621+0100 [mongosMain] connection accepted from 172.28.0.163:61379 #140 (83 connections now open) 2015-10-05T14:06:01.622+0100 [conn139] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.622+0100 [conn140] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.622+0100 [mongosMain] connection accepted from 172.28.0.163:61380 #141 (84 connections now open) 2015-10-05T14:06:01.622+0100 [mongosMain] connection accepted from 172.28.0.163:61381 #142 (85 connections now open) 2015-10-05T14:06:01.623+0100 [conn141] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.623+0100 [conn142] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.623+0100 [mongosMain] connection accepted from 172.28.0.163:61382 #143 (86 connections now open) 2015-10-05T14:06:01.624+0100 [mongosMain] connection accepted from 172.28.0.163:61383 #144 (87 connections now open) 2015-10-05T14:06:01.624+0100 [mongosMain] connection accepted from 172.28.0.163:61384 #145 (88 connections now open) 2015-10-05T14:06:01.626+0100 [mongosMain] connection accepted from 172.28.0.163:61385 #146 (89 connections now open) 2015-10-05T14:06:01.628+0100 [conn145] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.629+0100 [conn143] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.629+0100 [conn144] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.633+0100 [mongosMain] connection accepted from 172.28.0.163:61386 #147 (90 connections now open) 2015-10-05T14:06:01.636+0100 [mongosMain] connection accepted from 172.28.0.163:61387 #148 (91 connections now open) 2015-10-05T14:06:01.638+0100 [conn147] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.652+0100 [conn148] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.652+0100 [conn146] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.653+0100 [mongosMain] connection accepted from 172.28.0.163:61388 #149 (92 connections now open) 2015-10-05T14:06:01.654+0100 [mongosMain] connection accepted from 172.28.0.163:61389 #150 (93 connections now open) 2015-10-05T14:06:01.654+0100 [conn149] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.654+0100 [mongosMain] connection accepted from 172.28.0.163:61390 #151 (94 connections now open) 2015-10-05T14:06:01.655+0100 [mongosMain] connection accepted from 172.28.0.163:61391 #152 (95 connections now open) 2015-10-05T14:06:01.655+0100 [mongosMain] connection accepted from 172.28.0.163:61393 #153 (96 connections now open) 2015-10-05T14:06:01.656+0100 [conn151] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.656+0100 [mongosMain] connection accepted from 172.28.0.163:61394 #154 (97 connections now open) 2015-10-05T14:06:01.656+0100 [mongosMain] connection accepted from 172.28.0.163:61395 #155 (98 connections now open) 2015-10-05T14:06:01.657+0100 [mongosMain] connection accepted from 172.28.0.163:61396 #156 (99 connections now open) 2015-10-05T14:06:01.658+0100 [conn155] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.658+0100 [mongosMain] connection accepted from 172.28.0.163:61397 #157 (100 connections now open) 2015-10-05T14:06:01.659+0100 [mongosMain] connection accepted from 172.28.0.163:61398 #158 (101 connections now open) 2015-10-05T14:06:01.660+0100 [conn158] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.660+0100 [conn150] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.661+0100 [mongosMain] connection accepted from 172.28.0.163:61399 #159 (102 connections now open) 2015-10-05T14:06:01.663+0100 [conn152] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.666+0100 [conn153] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.667+0100 [conn159] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.672+0100 [conn154] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.675+0100 [conn156] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.675+0100 [conn157] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.677+0100 [mongosMain] connection accepted from 172.28.0.163:61400 #160 (103 connections now open) 2015-10-05T14:06:01.679+0100 [mongosMain] connection accepted from 172.28.0.163:61401 #161 (104 connections now open) 2015-10-05T14:06:01.680+0100 [conn160] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.680+0100 [mongosMain] connection accepted from 172.28.0.163:61402 #162 (105 connections now open) 2015-10-05T14:06:01.680+0100 [conn161] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.681+0100 [mongosMain] connection accepted from 172.28.0.163:61404 #163 (106 connections now open) 2015-10-05T14:06:01.687+0100 [conn163] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.704+0100 [conn162] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.721+0100 [mongosMain] connection accepted from 172.28.0.163:61411 #164 (107 connections now open) 2015-10-05T14:06:01.729+0100 [conn164] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.730+0100 [mongosMain] connection accepted from 172.28.0.163:61413 #165 (108 connections now open) 2015-10-05T14:06:01.743+0100 [conn165] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.869+0100 [mongosMain] connection accepted from 172.28.0.163:61414 #166 (109 connections now open) 2015-10-05T14:06:01.870+0100 [conn166] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.877+0100 [mongosMain] connection accepted from 172.28.0.163:61417 #167 (110 connections now open) 2015-10-05T14:06:01.878+0100 [mongosMain] connection accepted from 172.28.0.163:61418 #168 (111 connections now open) 2015-10-05T14:06:01.878+0100 [mongosMain] connection accepted from 172.28.0.163:61419 #169 (112 connections now open) 2015-10-05T14:06:01.878+0100 [mongosMain] connection accepted from 172.28.0.163:61420 #170 (113 connections now open) 2015-10-05T14:06:01.878+0100 [conn167] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.879+0100 [conn168] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.879+0100 [conn169] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:01.879+0100 [conn170] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:02.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275ba0c340f2cfc30c385 2015-10-05T14:06:02.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:03.515+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:06:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:06:09.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275c00c340f2cfc30c386 2015-10-05T14:06:09.384+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:11.648+0100 [mongosMain] connection accepted from 172.28.0.163:61502 #171 (114 connections now open) 2015-10-05T14:06:11.648+0100 [conn171] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.650+0100 [mongosMain] connection accepted from 172.28.0.163:61503 #172 (115 connections now open) 2015-10-05T14:06:11.651+0100 [conn172] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.653+0100 [mongosMain] connection accepted from 172.28.0.163:61504 #173 (116 connections now open) 2015-10-05T14:06:11.654+0100 [conn173] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.655+0100 [mongosMain] connection accepted from 172.28.0.163:61505 #174 (117 connections now open) 2015-10-05T14:06:11.655+0100 [conn174] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.656+0100 [mongosMain] connection accepted from 172.28.0.163:61506 #175 (118 connections now open) 2015-10-05T14:06:11.657+0100 [conn175] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.658+0100 [mongosMain] connection accepted from 172.28.0.163:61507 #176 (119 connections now open) 2015-10-05T14:06:11.659+0100 [conn176] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.660+0100 [mongosMain] connection accepted from 172.28.0.163:61508 #177 (120 connections now open) 2015-10-05T14:06:11.660+0100 [conn177] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.661+0100 [mongosMain] connection accepted from 172.28.0.163:61509 #178 (121 connections now open) 2015-10-05T14:06:11.662+0100 [conn178] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.663+0100 [mongosMain] connection accepted from 172.28.0.163:61510 #179 (122 connections now open) 2015-10-05T14:06:11.664+0100 [conn179] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.665+0100 [mongosMain] connection accepted from 172.28.0.163:61512 #180 (123 connections now open) 2015-10-05T14:06:11.666+0100 [conn180] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.667+0100 [mongosMain] connection accepted from 172.28.0.163:61513 #181 (124 connections now open) 2015-10-05T14:06:11.667+0100 [conn181] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.669+0100 [mongosMain] connection accepted from 172.28.0.163:61514 #182 (125 connections now open) 2015-10-05T14:06:11.669+0100 [conn182] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.670+0100 [mongosMain] connection accepted from 172.28.0.163:61516 #183 (126 connections now open) 2015-10-05T14:06:11.671+0100 [conn183] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.672+0100 [mongosMain] connection accepted from 172.28.0.163:61517 #184 (127 connections now open) 2015-10-05T14:06:11.673+0100 [conn184] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.674+0100 [mongosMain] connection accepted from 172.28.0.163:61519 #185 (128 connections now open) 2015-10-05T14:06:11.675+0100 [conn185] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.676+0100 [mongosMain] connection accepted from 172.28.0.163:61521 #186 (129 connections now open) 2015-10-05T14:06:11.677+0100 [conn186] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.678+0100 [mongosMain] connection accepted from 172.28.0.163:61522 #187 (130 connections now open) 2015-10-05T14:06:11.678+0100 [conn187] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.680+0100 [mongosMain] connection accepted from 172.28.0.163:61523 #188 (131 connections now open) 2015-10-05T14:06:11.680+0100 [conn188] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.682+0100 [mongosMain] connection accepted from 172.28.0.163:61525 #189 (132 connections now open) 2015-10-05T14:06:11.682+0100 [conn189] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.683+0100 [mongosMain] connection accepted from 172.28.0.163:61527 #190 (133 connections now open) 2015-10-05T14:06:11.684+0100 [conn190] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.685+0100 [mongosMain] connection accepted from 172.28.0.163:61528 #191 (134 connections now open) 2015-10-05T14:06:11.686+0100 [conn191] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.686+0100 [mongosMain] connection accepted from 172.28.0.163:61530 #192 (135 connections now open) 2015-10-05T14:06:11.687+0100 [conn192] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.868+0100 [mongosMain] connection accepted from 172.28.0.163:61549 #193 (136 connections now open) 2015-10-05T14:06:11.869+0100 [conn193] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.870+0100 [mongosMain] connection accepted from 172.28.0.163:61551 #194 (137 connections now open) 2015-10-05T14:06:11.871+0100 [conn194] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.873+0100 [mongosMain] connection accepted from 172.28.0.163:61553 #195 (138 connections now open) 2015-10-05T14:06:11.873+0100 [conn195] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.875+0100 [mongosMain] connection accepted from 172.28.0.163:61554 #196 (139 connections now open) 2015-10-05T14:06:11.876+0100 [conn196] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.877+0100 [mongosMain] connection accepted from 172.28.0.163:61556 #197 (140 connections now open) 2015-10-05T14:06:11.878+0100 [conn197] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.879+0100 [mongosMain] connection accepted from 172.28.0.163:61557 #198 (141 connections now open) 2015-10-05T14:06:11.880+0100 [conn198] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.881+0100 [mongosMain] connection accepted from 172.28.0.163:61559 #199 (142 connections now open) 2015-10-05T14:06:11.882+0100 [conn199] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.884+0100 [mongosMain] connection accepted from 172.28.0.163:61560 #200 (143 connections now open) 2015-10-05T14:06:11.885+0100 [conn200] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.886+0100 [mongosMain] connection accepted from 172.28.0.163:61562 #201 (144 connections now open) 2015-10-05T14:06:11.887+0100 [conn201] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.888+0100 [mongosMain] connection accepted from 172.28.0.163:61564 #202 (145 connections now open) 2015-10-05T14:06:11.889+0100 [conn202] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.890+0100 [mongosMain] connection accepted from 172.28.0.163:61565 #203 (146 connections now open) 2015-10-05T14:06:11.891+0100 [conn203] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.892+0100 [mongosMain] connection accepted from 172.28.0.163:61567 #204 (147 connections now open) 2015-10-05T14:06:11.894+0100 [conn204] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.895+0100 [mongosMain] connection accepted from 172.28.0.163:61568 #205 (148 connections now open) 2015-10-05T14:06:11.896+0100 [conn205] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.897+0100 [mongosMain] connection accepted from 172.28.0.163:61570 #206 (149 connections now open) 2015-10-05T14:06:11.898+0100 [conn206] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.899+0100 [mongosMain] connection accepted from 172.28.0.163:61572 #207 (150 connections now open) 2015-10-05T14:06:11.900+0100 [conn207] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.901+0100 [mongosMain] connection accepted from 172.28.0.163:61573 #208 (151 connections now open) 2015-10-05T14:06:11.902+0100 [conn208] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.903+0100 [mongosMain] connection accepted from 172.28.0.163:61575 #209 (152 connections now open) 2015-10-05T14:06:11.904+0100 [conn209] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.905+0100 [mongosMain] connection accepted from 172.28.0.163:61576 #210 (153 connections now open) 2015-10-05T14:06:11.906+0100 [conn210] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.907+0100 [mongosMain] connection accepted from 172.28.0.163:61578 #211 (154 connections now open) 2015-10-05T14:06:11.908+0100 [conn211] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.909+0100 [mongosMain] connection accepted from 172.28.0.163:61579 #212 (155 connections now open) 2015-10-05T14:06:11.910+0100 [conn212] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.911+0100 [mongosMain] connection accepted from 172.28.0.163:61581 #213 (156 connections now open) 2015-10-05T14:06:11.912+0100 [conn213] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.913+0100 [mongosMain] connection accepted from 172.28.0.163:61583 #214 (157 connections now open) 2015-10-05T14:06:11.914+0100 [conn214] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.916+0100 [mongosMain] connection accepted from 172.28.0.163:61584 #215 (158 connections now open) 2015-10-05T14:06:11.917+0100 [conn215] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.918+0100 [mongosMain] connection accepted from 172.28.0.163:61586 #216 (159 connections now open) 2015-10-05T14:06:11.919+0100 [conn216] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.920+0100 [mongosMain] connection accepted from 172.28.0.163:61587 #217 (160 connections now open) 2015-10-05T14:06:11.921+0100 [conn217] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.922+0100 [mongosMain] connection accepted from 172.28.0.163:61589 #218 (161 connections now open) 2015-10-05T14:06:11.923+0100 [conn218] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.924+0100 [mongosMain] connection accepted from 172.28.0.163:61590 #219 (162 connections now open) 2015-10-05T14:06:11.925+0100 [conn219] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.926+0100 [mongosMain] connection accepted from 172.28.0.163:61592 #220 (163 connections now open) 2015-10-05T14:06:11.926+0100 [conn220] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.927+0100 [mongosMain] connection accepted from 172.28.0.163:61593 #221 (164 connections now open) 2015-10-05T14:06:11.928+0100 [conn221] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.929+0100 [mongosMain] connection accepted from 172.28.0.163:61595 #222 (165 connections now open) 2015-10-05T14:06:11.930+0100 [conn222] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.931+0100 [mongosMain] connection accepted from 172.28.0.163:61596 #223 (166 connections now open) 2015-10-05T14:06:11.932+0100 [conn223] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.933+0100 [mongosMain] connection accepted from 172.28.0.163:61598 #224 (167 connections now open) 2015-10-05T14:06:11.934+0100 [conn224] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.934+0100 [mongosMain] connection accepted from 172.28.0.163:61600 #225 (168 connections now open) 2015-10-05T14:06:11.935+0100 [conn225] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.936+0100 [mongosMain] connection accepted from 172.28.0.163:61601 #226 (169 connections now open) 2015-10-05T14:06:11.937+0100 [conn226] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.938+0100 [mongosMain] connection accepted from 172.28.0.163:61603 #227 (170 connections now open) 2015-10-05T14:06:11.939+0100 [conn227] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.940+0100 [mongosMain] connection accepted from 172.28.0.163:61604 #228 (171 connections now open) 2015-10-05T14:06:11.941+0100 [conn228] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.941+0100 [mongosMain] connection accepted from 172.28.0.163:61605 #229 (172 connections now open) 2015-10-05T14:06:11.943+0100 [conn229] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.944+0100 [mongosMain] connection accepted from 172.28.0.163:61607 #230 (173 connections now open) 2015-10-05T14:06:11.945+0100 [conn230] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.946+0100 [mongosMain] connection accepted from 172.28.0.163:61609 #231 (174 connections now open) 2015-10-05T14:06:11.947+0100 [conn231] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.948+0100 [mongosMain] connection accepted from 172.28.0.163:61610 #232 (175 connections now open) 2015-10-05T14:06:11.948+0100 [conn232] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.949+0100 [mongosMain] connection accepted from 172.28.0.163:61612 #233 (176 connections now open) 2015-10-05T14:06:11.950+0100 [conn233] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.951+0100 [mongosMain] connection accepted from 172.28.0.163:61613 #234 (177 connections now open) 2015-10-05T14:06:11.952+0100 [conn234] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.953+0100 [mongosMain] connection accepted from 172.28.0.163:61615 #235 (178 connections now open) 2015-10-05T14:06:11.954+0100 [conn235] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.955+0100 [mongosMain] connection accepted from 172.28.0.163:61616 #236 (179 connections now open) 2015-10-05T14:06:11.956+0100 [conn236] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:11.958+0100 [mongosMain] connection accepted from 172.28.0.163:61618 #237 (180 connections now open) 2015-10-05T14:06:11.959+0100 [conn237] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:15.668+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275c70c340f2cfc30c387 2015-10-05T14:06:15.804+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:28.098+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275d30c340f2cfc30c388 2015-10-05T14:06:28.210+0100 [mongosMain] connection accepted from 127.0.0.1:61646 #238 (181 connections now open) 2015-10-05T14:06:28.213+0100 [conn238] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:28.218+0100 [conn238] end connection 127.0.0.1:61646 (180 connections now open) 2015-10-05T14:06:28.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:31.819+0100 [conn32] end connection 172.28.0.163:60126 (179 connections now open) 2015-10-05T14:06:31.820+0100 [mongosMain] connection accepted from 172.28.0.163:61653 #239 (180 connections now open) 2015-10-05T14:06:31.821+0100 [conn239] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:33.795+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:06:33 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:06:39.717+0100 [mongosMain] connection accepted from 127.0.0.1:61667 #240 (181 connections now open) 2015-10-05T14:06:39.733+0100 [conn240] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:39.749+0100 [conn240] end connection 127.0.0.1:61667 (180 connections now open) 2015-10-05T14:06:40.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275e00c340f2cfc30c389 2015-10-05T14:06:40.794+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:06:56.170+0100 [mongosMain] connection accepted from 172.28.0.164:62936 #241 (181 connections now open) 2015-10-05T14:06:56.174+0100 [conn241] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:06:59.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275f20c340f2cfc30c475 2015-10-05T14:06:59.250+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:04.096+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:07:03 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:07:11.865+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561275ff0c340f2cfc30c6a4 2015-10-05T14:07:12.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:18.436+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276060c340f2cfc30c7d0 2015-10-05T14:07:18.602+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:24.944+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612760c0c340f2cfc30c8c7 2015-10-05T14:07:25.079+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:28.355+0100 [mongosMain] connection accepted from 127.0.0.1:61794 #242 (182 connections now open) 2015-10-05T14:07:28.358+0100 [conn242] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:28.363+0100 [conn242] end connection 127.0.0.1:61794 (181 connections now open) 2015-10-05T14:07:31.373+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276130c340f2cfc30ca11 2015-10-05T14:07:31.509+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:31.841+0100 [conn33] end connection 172.28.0.163:60128 (180 connections now open) 2015-10-05T14:07:31.845+0100 [mongosMain] connection accepted from 172.28.0.163:61796 #243 (181 connections now open) 2015-10-05T14:07:31.880+0100 [conn243] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:34.382+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:07:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:07:39.367+0100 [mongosMain] connection accepted from 127.0.0.1:61799 #244 (182 connections now open) 2015-10-05T14:07:39.369+0100 [conn244] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:39.374+0100 [conn244] end connection 127.0.0.1:61799 (181 connections now open) 2015-10-05T14:07:50.661+0100 [mongosMain] connection accepted from 172.28.0.163:61834 #245 (182 connections now open) 2015-10-05T14:07:50.662+0100 [conn245] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:50.666+0100 [mongosMain] connection accepted from 172.28.0.163:61835 #246 (183 connections now open) 2015-10-05T14:07:50.667+0100 [conn246] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:50.674+0100 [mongosMain] connection accepted from 172.28.0.163:61836 #247 (184 connections now open) 2015-10-05T14:07:50.675+0100 [conn247] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:50.681+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276260c340f2cfc30cea2 2015-10-05T14:07:50.696+0100 [mongosMain] connection accepted from 172.28.0.163:61837 #248 (185 connections now open) 2015-10-05T14:07:50.696+0100 [conn248] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:50.702+0100 [mongosMain] connection accepted from 172.28.0.163:61838 #249 (186 connections now open) 2015-10-05T14:07:50.703+0100 [conn249] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:50.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:07:56.186+0100 [mongosMain] connection accepted from 172.28.0.164:62986 #250 (187 connections now open) 2015-10-05T14:07:56.189+0100 [conn250] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:56.206+0100 [mongosMain] connection accepted from 172.28.0.163:61853 #251 (188 connections now open) 2015-10-05T14:07:56.207+0100 [conn251] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:07:56.896+0100 [mongosMain] connection accepted from 172.28.0.163:61867 #252 (189 connections now open) 2015-10-05T14:07:56.897+0100 [conn252] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:08:03.654+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:08:03.654+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:08:04.577+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:08:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:08:15.876+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:08:15.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:08:22.025+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:08:22.025+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:08:28.453+0100 [mongosMain] connection accepted from 127.0.0.1:61910 #253 (190 connections now open) 2015-10-05T14:08:28.456+0100 [conn253] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:08:28.460+0100 [conn253] end connection 127.0.0.1:61910 (189 connections now open) 2015-10-05T14:08:31.976+0100 [conn34] end connection 172.28.0.163:60130 (188 connections now open) 2015-10-05T14:08:32.059+0100 [mongosMain] connection accepted from 172.28.0.163:61911 #254 (189 connections now open) 2015-10-05T14:08:32.076+0100 [conn254] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:08:34.344+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276520c340f2cfc30dcc9 2015-10-05T14:08:34.482+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:08:34.854+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:08:34 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:08:39.251+0100 [mongosMain] connection accepted from 127.0.0.1:61916 #255 (190 connections now open) 2015-10-05T14:08:39.254+0100 [conn255] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:08:39.260+0100 [conn255] end connection 127.0.0.1:61916 (189 connections now open) 2015-10-05T14:08:55.434+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:08:55.434+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:08:56.202+0100 [mongosMain] connection accepted from 172.28.0.164:63037 #256 (190 connections now open) 2015-10-05T14:08:56.205+0100 [conn256] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:09:01.557+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612766b26fd57ee99392dcd') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444050541441), why: "doing balance round", ts: ObjectId('5612766d0c340f2cfc30e041') } } gle1: { lastOp: Timestamp 1444050514000|12, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1444050541000|6, connectionId: 35263, updatedExisting: true, n: 1, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } 2015-10-05T14:09:01.560+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:09:01.560+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:05.111+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:09:04 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:09:05.111+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:09:05.248+0100 [LockPinger] handled late remove of old distributed lock with ts 5612766d0c340f2cfc30e041 2015-10-05T14:09:07.708+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:09:07.708+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:14.124+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276790c340f2cfc30e141 2015-10-05T14:09:14.225+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:09:21.663+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:09:21.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:28.765+0100 [mongosMain] connection accepted from 127.0.0.1:61986 #257 (191 connections now open) 2015-10-05T14:09:28.768+0100 [conn257] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:09:28.773+0100 [conn257] end connection 127.0.0.1:61986 (190 connections now open) 2015-10-05T14:09:29.115+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:09:29.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:32.085+0100 [conn35] end connection 172.28.0.163:60131 (189 connections now open) 2015-10-05T14:09:32.086+0100 [mongosMain] connection accepted from 172.28.0.163:61994 #258 (190 connections now open) 2015-10-05T14:09:32.087+0100 [conn258] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:09:35.326+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:09:35.326+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:35.534+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:09:35 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:09:39.453+0100 [mongosMain] connection accepted from 127.0.0.1:62011 #259 (191 connections now open) 2015-10-05T14:09:39.458+0100 [conn259] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:09:39.465+0100 [conn259] end connection 127.0.0.1:62011 (190 connections now open) 2015-10-05T14:09:41.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276950c340f2cfc30e2ac 2015-10-05T14:09:41.745+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:09:49.987+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:09:49.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:09:56.218+0100 [mongosMain] connection accepted from 172.28.0.164:63093 #260 (191 connections now open) 2015-10-05T14:09:56.221+0100 [conn260] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:09:56.266+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276a30c340f2cfc30e2ae 2015-10-05T14:09:56.847+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:03.515+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276aa0c340f2cfc30e2af 2015-10-05T14:10:03.793+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:06.205+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:10:05 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:10:09.985+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276b10c340f2cfc30e2b0 2015-10-05T14:10:10.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:18.054+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276b80c340f2cfc30e2b2 2015-10-05T14:10:18.386+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:24.661+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276c00c340f2cfc30e2b3 2015-10-05T14:10:25.254+0100 [conn86] end connection 172.28.0.164:62247 (190 connections now open) 2015-10-05T14:10:25.255+0100 [conn85] end connection 172.28.0.164:62245 (189 connections now open) 2015-10-05T14:10:25.343+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:28.859+0100 [mongosMain] connection accepted from 127.0.0.1:62092 #261 (190 connections now open) 2015-10-05T14:10:28.878+0100 [conn261] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:10:28.883+0100 [conn261] end connection 127.0.0.1:62092 (189 connections now open) 2015-10-05T14:10:32.102+0100 [conn36] end connection 172.28.0.163:60133 (188 connections now open) 2015-10-05T14:10:32.103+0100 [mongosMain] connection accepted from 172.28.0.163:62105 #262 (189 connections now open) 2015-10-05T14:10:32.105+0100 [conn262] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:10:32.853+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276c70c340f2cfc30e2b4 2015-10-05T14:10:32.987+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:36.488+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:10:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:10:40.004+0100 [mongosMain] connection accepted from 127.0.0.1:62110 #263 (190 connections now open) 2015-10-05T14:10:40.007+0100 [conn263] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:10:40.012+0100 [conn263] end connection 127.0.0.1:62110 (189 connections now open) 2015-10-05T14:10:45.288+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276d50c340f2cfc30e2b5 2015-10-05T14:10:45.424+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:54.112+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276db0c340f2cfc30e2b6 2015-10-05T14:10:54.314+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:10:56.234+0100 [mongosMain] connection accepted from 172.28.0.164:63153 #264 (190 connections now open) 2015-10-05T14:10:56.238+0100 [conn264] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:00.510+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276e40c340f2cfc30e2d7 2015-10-05T14:11:00.782+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:06.748+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:11:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:11:07.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276ea0c340f2cfc30e3bf 2015-10-05T14:11:07.198+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:10.947+0100 [conn177] end connection 172.28.0.163:61508 (189 connections now open) 2015-10-05T14:11:11.910+0100 [conn192] end connection 172.28.0.163:61530 (188 connections now open) 2015-10-05T14:11:15.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276f10c340f2cfc30e4a4 2015-10-05T14:11:16.949+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:22.985+0100 [conn144] end connection 172.28.0.163:61383 (187 connections now open) 2015-10-05T14:11:23.130+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561276fa0c340f2cfc30e5d7 2015-10-05T14:11:23.248+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:23.841+0100 [conn138] end connection 172.28.0.163:61377 (186 connections now open) 2015-10-05T14:11:28.869+0100 [mongosMain] connection accepted from 127.0.0.1:62216 #265 (187 connections now open) 2015-10-05T14:11:28.891+0100 [conn265] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:28.896+0100 [conn265] end connection 127.0.0.1:62216 (186 connections now open) 2015-10-05T14:11:29.406+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277010c340f2cfc30e6af 2015-10-05T14:11:29.508+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:30.669+0100 [conn185] end connection 172.28.0.163:61519 (185 connections now open) 2015-10-05T14:11:30.713+0100 [mongosMain] connection accepted from 172.28.0.163:62223 #266 (186 connections now open) 2015-10-05T14:11:30.713+0100 [conn266] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:30.714+0100 [mongosMain] connection accepted from 172.28.0.163:62224 #267 (187 connections now open) 2015-10-05T14:11:30.714+0100 [conn267] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:30.715+0100 [mongosMain] connection accepted from 172.28.0.163:62225 #268 (188 connections now open) 2015-10-05T14:11:30.715+0100 [conn268] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:30.730+0100 [mongosMain] connection accepted from 172.28.0.163:62226 #269 (189 connections now open) 2015-10-05T14:11:30.730+0100 [mongosMain] connection accepted from 172.28.0.163:62227 #270 (190 connections now open) 2015-10-05T14:11:30.730+0100 [conn269] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:30.731+0100 [conn270] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:30.738+0100 [mongosMain] connection accepted from 172.28.0.163:62228 #271 (191 connections now open) 2015-10-05T14:11:30.739+0100 [conn271] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.339+0100 [mongosMain] connection accepted from 172.28.0.163:62250 #272 (192 connections now open) 2015-10-05T14:11:31.343+0100 [conn272] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.568+0100 [mongosMain] connection accepted from 172.28.0.163:62252 #273 (193 connections now open) 2015-10-05T14:11:31.568+0100 [conn273] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.570+0100 [mongosMain] connection accepted from 172.28.0.163:62253 #274 (194 connections now open) 2015-10-05T14:11:31.570+0100 [mongosMain] connection accepted from 172.28.0.163:62254 #275 (195 connections now open) 2015-10-05T14:11:31.570+0100 [conn274] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.571+0100 [conn275] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.572+0100 [mongosMain] connection accepted from 172.28.0.163:62255 #276 (196 connections now open) 2015-10-05T14:11:31.572+0100 [conn276] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.600+0100 [mongosMain] connection accepted from 172.28.0.163:62256 #277 (197 connections now open) 2015-10-05T14:11:31.600+0100 [conn277] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:31.610+0100 [mongosMain] connection accepted from 172.28.0.163:62257 #278 (198 connections now open) 2015-10-05T14:11:31.611+0100 [conn278] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:32.118+0100 [conn37] end connection 172.28.0.163:60134 (197 connections now open) 2015-10-05T14:11:32.119+0100 [mongosMain] connection accepted from 172.28.0.163:62259 #279 (198 connections now open) 2015-10-05T14:11:32.120+0100 [conn279] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:35.703+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277070c340f2cfc30e7c2 2015-10-05T14:11:35.803+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:36.897+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:11:36 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:11:39.251+0100 [mongosMain] connection accepted from 127.0.0.1:62266 #280 (199 connections now open) 2015-10-05T14:11:39.254+0100 [conn280] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:39.259+0100 [conn280] end connection 127.0.0.1:62266 (198 connections now open) 2015-10-05T14:11:47.842+0100 [mongosMain] connection accepted from 172.28.0.163:62284 #281 (199 connections now open) 2015-10-05T14:11:47.843+0100 [conn281] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.847+0100 [mongosMain] connection accepted from 172.28.0.163:62285 #282 (200 connections now open) 2015-10-05T14:11:47.848+0100 [conn282] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.855+0100 [mongosMain] connection accepted from 172.28.0.163:62286 #283 (201 connections now open) 2015-10-05T14:11:47.856+0100 [conn283] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.856+0100 [mongosMain] connection accepted from 172.28.0.163:62287 #284 (202 connections now open) 2015-10-05T14:11:47.857+0100 [conn284] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.936+0100 [mongosMain] connection accepted from 172.28.0.163:62289 #285 (203 connections now open) 2015-10-05T14:11:47.937+0100 [conn285] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.960+0100 [mongosMain] connection accepted from 172.28.0.163:62290 #286 (204 connections now open) 2015-10-05T14:11:47.961+0100 [conn286] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:47.974+0100 [mongosMain] connection accepted from 172.28.0.163:62291 #287 (205 connections now open) 2015-10-05T14:11:47.975+0100 [conn287] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:48.120+0100 [mongosMain] connection accepted from 172.28.0.163:62292 #288 (206 connections now open) 2015-10-05T14:11:48.122+0100 [conn288] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:48.208+0100 [mongosMain] connection accepted from 172.28.0.163:62293 #289 (207 connections now open) 2015-10-05T14:11:48.209+0100 [conn289] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.250+0100 [mongosMain] connection accepted from 172.28.0.164:63208 #290 (208 connections now open) 2015-10-05T14:11:56.253+0100 [conn290] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.289+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612771a0c340f2cfc30ea60 2015-10-05T14:11:56.429+0100 [mongosMain] connection accepted from 172.28.0.163:62320 #291 (209 connections now open) 2015-10-05T14:11:56.429+0100 [conn291] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.431+0100 [mongosMain] connection accepted from 172.28.0.163:62321 #292 (210 connections now open) 2015-10-05T14:11:56.431+0100 [mongosMain] connection accepted from 172.28.0.163:62322 #293 (211 connections now open) 2015-10-05T14:11:56.432+0100 [conn292] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.432+0100 [conn293] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.478+0100 [mongosMain] connection accepted from 172.28.0.163:62323 #294 (212 connections now open) 2015-10-05T14:11:56.479+0100 [conn294] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.568+0100 [mongosMain] connection accepted from 172.28.0.163:62324 #295 (213 connections now open) 2015-10-05T14:11:56.570+0100 [conn295] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:56.608+0100 [mongosMain] connection accepted from 172.28.0.163:62325 #296 (214 connections now open) 2015-10-05T14:11:56.609+0100 [conn296] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:57.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:11:57.207+0100 [mongosMain] connection accepted from 172.28.0.163:62327 #297 (215 connections now open) 2015-10-05T14:11:57.209+0100 [conn297] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:11:59.207+0100 [mongosMain] connection accepted from 172.28.0.163:62330 #298 (216 connections now open) 2015-10-05T14:11:59.208+0100 [conn298] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:00.717+0100 [mongosMain] connection accepted from 172.28.0.163:62338 #299 (217 connections now open) 2015-10-05T14:12:00.718+0100 [conn299] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:07.239+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:12:06 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:12:08.663+0100 [conn276] end connection 172.28.0.163:62255 (216 connections now open) 2015-10-05T14:12:08.857+0100 [conn281] end connection 172.28.0.163:62284 (215 connections now open) 2015-10-05T14:12:08.967+0100 [conn174] end connection 172.28.0.163:61505 (214 connections now open) 2015-10-05T14:12:10.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277290c340f2cfc30ec76 2015-10-05T14:12:10.132+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:12:16.845+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612772ed5de43e0ed5d4117') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444050736653), why: "doing balance round", ts: ObjectId('561277300c340f2cfc30edad') } } gle1: { lastOp: Timestamp 1444050730000|2, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1444050736000|3, connectionId: 40376, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } 2015-10-05T14:12:16.856+0100 [Balancer] lock update won, completing lock propagation for 'balancer/402929-MYWAPP1:27017:1444049209:41' 2015-10-05T14:12:16.982+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277300c340f2cfc30edad 2015-10-05T14:12:17.118+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:12:23.822+0100 [mongosMain] connection accepted from 172.28.0.163:62412 #300 (215 connections now open) 2015-10-05T14:12:23.823+0100 [conn300] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:23.931+0100 [mongosMain] connection accepted from 172.28.0.163:62413 #301 (216 connections now open) 2015-10-05T14:12:23.932+0100 [conn301] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:23.951+0100 [mongosMain] connection accepted from 172.28.0.163:62414 #302 (217 connections now open) 2015-10-05T14:12:23.952+0100 [conn302] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:24.207+0100 [mongosMain] connection accepted from 172.28.0.163:62415 #303 (218 connections now open) 2015-10-05T14:12:24.208+0100 [conn303] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:28.725+0100 [mongosMain] connection accepted from 127.0.0.1:62423 #304 (219 connections now open) 2015-10-05T14:12:28.727+0100 [conn304] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:28.731+0100 [conn304] end connection 127.0.0.1:62423 (218 connections now open) 2015-10-05T14:12:29.528+0100 [conn248] end connection 172.28.0.163:61837 (217 connections now open) 2015-10-05T14:12:29.576+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612773d0c340f2cfc30ef9e 2015-10-05T14:12:29.715+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:12:32.136+0100 [conn38] end connection 172.28.0.163:60136 (216 connections now open) 2015-10-05T14:12:32.154+0100 [mongosMain] connection accepted from 172.28.0.163:62427 #305 (217 connections now open) 2015-10-05T14:12:32.157+0100 [conn305] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:36.912+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277430c340f2cfc30f050 2015-10-05T14:12:37.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:12:37.739+0100 [conn173] end connection 172.28.0.163:61504 (216 connections now open) 2015-10-05T14:12:37.741+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:12:37 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:12:40.058+0100 [mongosMain] connection accepted from 127.0.0.1:62429 #306 (217 connections now open) 2015-10-05T14:12:40.086+0100 [conn306] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:12:40.090+0100 [conn306] end connection 127.0.0.1:62429 (216 connections now open) 2015-10-05T14:12:41.889+0100 [conn284] end connection 172.28.0.163:62287 (215 connections now open) 2015-10-05T14:12:49.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277510c340f2cfc30f134 2015-10-05T14:12:49.511+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:12:56.267+0100 [mongosMain] connection accepted from 172.28.0.164:63252 #307 (216 connections now open) 2015-10-05T14:12:56.270+0100 [conn307] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:13:02.528+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:13:02.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:13:08.353+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:13:07 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:13:08.658+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277640c340f2cfc30f2fc 2015-10-05T14:13:08.727+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:13:14.971+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:13:14.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:13:21.306+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:13:21.306+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:13:27.466+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277770c340f2cfc30f4a4 2015-10-05T14:13:27.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:13:28.590+0100 [mongosMain] connection accepted from 127.0.0.1:62511 #308 (217 connections now open) 2015-10-05T14:13:28.593+0100 [conn308] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:13:28.598+0100 [conn308] end connection 127.0.0.1:62511 (216 connections now open) 2015-10-05T14:13:31.783+0100 [conn294] end connection 172.28.0.163:62323 (215 connections now open) 2015-10-05T14:13:32.165+0100 [conn39] end connection 172.28.0.163:60138 (214 connections now open) 2015-10-05T14:13:32.166+0100 [mongosMain] connection accepted from 172.28.0.163:62512 #309 (215 connections now open) 2015-10-05T14:13:32.168+0100 [conn309] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:13:38.525+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:13:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:13:39.680+0100 [mongosMain] connection accepted from 127.0.0.1:62523 #310 (216 connections now open) 2015-10-05T14:13:39.686+0100 [conn310] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:13:39.697+0100 [conn310] end connection 127.0.0.1:62523 (215 connections now open) 2015-10-05T14:13:46.082+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277890c340f2cfc30f5fe 2015-10-05T14:13:46.389+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:13:52.644+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561277900c340f2cfc30f6a6 2015-10-05T14:13:52.779+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:13:56.290+0100 [mongosMain] connection accepted from 172.28.0.164:63304 #311 (216 connections now open) 2015-10-05T14:13:56.318+0100 [conn311] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:14:00.495+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:00.496+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:14:06.643+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:06.643+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:14:08.861+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:14:08 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:14:13.363+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:13.363+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:14:25.578+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:25.578+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:14:29.032+0100 [mongosMain] connection accepted from 127.0.0.1:62586 #312 (217 connections now open) 2015-10-05T14:14:29.036+0100 [conn312] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:14:29.052+0100 [conn312] end connection 127.0.0.1:62586 (216 connections now open) 2015-10-05T14:14:32.186+0100 [conn40] end connection 172.28.0.163:60139 (215 connections now open) 2015-10-05T14:14:32.193+0100 [mongosMain] connection accepted from 172.28.0.163:62592 #313 (216 connections now open) 2015-10-05T14:14:32.195+0100 [conn313] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:14:39.105+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:14:38 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:14:40.192+0100 [mongosMain] connection accepted from 127.0.0.1:62596 #314 (217 connections now open) 2015-10-05T14:14:40.198+0100 [conn314] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:14:40.202+0100 [conn314] end connection 127.0.0.1:62596 (216 connections now open) 2015-10-05T14:14:45.653+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:45.653+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:14:56.332+0100 [mongosMain] connection accepted from 172.28.0.164:63350 #315 (217 connections now open) 2015-10-05T14:14:56.335+0100 [conn315] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:14:58.498+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:14:58.498+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:15:05.021+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:15:05.021+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:15:09.393+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:15:09 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:15:11.166+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561277ddd5de43e0ed5d412e') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444050911046), why: "doing balance round", ts: ObjectId('561277df0c340f2cfc30fd06') } } gle1: { lastOp: Timestamp 1444050832000|12, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1444050911000|4, connectionId: 40376, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2015-10-05T14:15:11.170+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:15:11.170+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:15:17.351+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:15:17.351+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:15:28.269+0100 [mongosMain] connection accepted from 127.0.0.1:62668 #316 (218 connections now open) 2015-10-05T14:15:28.271+0100 [conn316] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:28.276+0100 [conn316] end connection 127.0.0.1:62668 (217 connections now open) 2015-10-05T14:15:32.236+0100 [conn41] end connection 172.28.0.163:60141 (216 connections now open) 2015-10-05T14:15:32.249+0100 [mongosMain] connection accepted from 172.28.0.163:62671 #317 (217 connections now open) 2015-10-05T14:15:32.299+0100 [conn317] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:40.180+0100 [mongosMain] connection accepted from 127.0.0.1:62674 #318 (218 connections now open) 2015-10-05T14:15:41.236+0100 [conn318] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:41.255+0100 [conn318] end connection 127.0.0.1:62674 (217 connections now open) 2015-10-05T14:15:42.442+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:15:39 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:15:42.442+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:15:42.443+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:15:42.443+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:15:42.606+0100 [LockPinger] handled late remove of old distributed lock with ts 561277df0c340f2cfc30fd06 2015-10-05T14:15:47.296+0100 [mongosMain] connection accepted from 172.28.0.163:62691 #319 (218 connections now open) 2015-10-05T14:15:47.296+0100 [conn319] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.297+0100 [mongosMain] connection accepted from 172.28.0.163:62693 #320 (219 connections now open) 2015-10-05T14:15:47.298+0100 [conn320] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.304+0100 [mongosMain] connection accepted from 172.28.0.163:62695 #321 (220 connections now open) 2015-10-05T14:15:47.304+0100 [mongosMain] connection accepted from 172.28.0.163:62696 #322 (221 connections now open) 2015-10-05T14:15:47.304+0100 [mongosMain] connection accepted from 172.28.0.163:62697 #323 (222 connections now open) 2015-10-05T14:15:47.304+0100 [conn321] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.304+0100 [conn322] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.305+0100 [conn323] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.305+0100 [mongosMain] connection accepted from 172.28.0.163:62698 #324 (223 connections now open) 2015-10-05T14:15:47.306+0100 [conn324] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.319+0100 [mongosMain] connection accepted from 172.28.0.163:62702 #325 (224 connections now open) 2015-10-05T14:15:47.319+0100 [mongosMain] connection accepted from 172.28.0.163:62703 #326 (225 connections now open) 2015-10-05T14:15:47.320+0100 [conn325] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.320+0100 [conn326] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.339+0100 [mongosMain] connection accepted from 172.28.0.163:62706 #327 (226 connections now open) 2015-10-05T14:15:47.340+0100 [conn327] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.340+0100 [mongosMain] connection accepted from 172.28.0.163:62707 #328 (227 connections now open) 2015-10-05T14:15:47.341+0100 [conn328] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:47.525+0100 [mongosMain] connection accepted from 172.28.0.163:62710 #329 (228 connections now open) 2015-10-05T14:15:47.526+0100 [conn329] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:15:49.399+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278040c340f2cfc31007a 2015-10-05T14:15:49.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:15:56.347+0100 [mongosMain] connection accepted from 172.28.0.164:63396 #330 (229 connections now open) 2015-10-05T14:15:56.350+0100 [conn330] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:02.115+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278110c340f2cfc3101d9 2015-10-05T14:16:02.422+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:06.367+0100 [conn170] end connection 172.28.0.163:61420 (228 connections now open) 2015-10-05T14:16:06.367+0100 [mongosMain] connection accepted from 172.28.0.163:62747 #331 (229 connections now open) 2015-10-05T14:16:06.368+0100 [conn331] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:08.717+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278180c340f2cfc310299 2015-10-05T14:16:08.923+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:11.640+0100 [conn180] end connection 172.28.0.163:61512 (228 connections now open) 2015-10-05T14:16:12.912+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:16:12 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:16:13.074+0100 [conn300] end connection 172.28.0.163:62412 (227 connections now open) 2015-10-05T14:16:13.515+0100 [conn282] end connection 172.28.0.163:62285 (226 connections now open) 2015-10-05T14:16:15.952+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612781e0c340f2cfc310369 2015-10-05T14:16:16.107+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:16.591+0100 [conn169] end connection 172.28.0.163:61419 (225 connections now open) 2015-10-05T14:16:16.633+0100 [mongosMain] connection accepted from 172.28.0.163:62762 #332 (226 connections now open) 2015-10-05T14:16:16.650+0100 [conn332] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:22.531+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278260c340f2cfc31045f 2015-10-05T14:16:22.633+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:26.816+0100 [conn168] end connection 172.28.0.163:61418 (225 connections now open) 2015-10-05T14:16:26.818+0100 [mongosMain] connection accepted from 172.28.0.163:62776 #333 (226 connections now open) 2015-10-05T14:16:26.818+0100 [conn333] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.953+0100 [mongosMain] connection accepted from 172.28.0.163:62777 #334 (227 connections now open) 2015-10-05T14:16:26.953+0100 [mongosMain] connection accepted from 172.28.0.163:62778 #335 (228 connections now open) 2015-10-05T14:16:26.953+0100 [mongosMain] connection accepted from 172.28.0.163:62779 #336 (229 connections now open) 2015-10-05T14:16:26.954+0100 [conn334] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.954+0100 [conn335] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.954+0100 [conn336] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.998+0100 [mongosMain] connection accepted from 172.28.0.163:62780 #337 (230 connections now open) 2015-10-05T14:16:26.998+0100 [mongosMain] connection accepted from 172.28.0.163:62781 #338 (231 connections now open) 2015-10-05T14:16:26.999+0100 [mongosMain] connection accepted from 172.28.0.163:62782 #339 (232 connections now open) 2015-10-05T14:16:26.999+0100 [mongosMain] connection accepted from 172.28.0.163:62783 #340 (233 connections now open) 2015-10-05T14:16:26.999+0100 [conn337] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.999+0100 [conn338] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.999+0100 [mongosMain] connection accepted from 172.28.0.163:62784 #341 (234 connections now open) 2015-10-05T14:16:26.999+0100 [conn339] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:26.999+0100 [conn340] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.000+0100 [conn341] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.045+0100 [mongosMain] connection accepted from 172.28.0.163:62785 #342 (235 connections now open) 2015-10-05T14:16:27.046+0100 [conn342] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.068+0100 [mongosMain] connection accepted from 172.28.0.163:62786 #343 (236 connections now open) 2015-10-05T14:16:27.069+0100 [conn343] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.083+0100 [mongosMain] connection accepted from 172.28.0.163:62787 #344 (237 connections now open) 2015-10-05T14:16:27.084+0100 [conn344] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.115+0100 [mongosMain] connection accepted from 172.28.0.163:62788 #345 (238 connections now open) 2015-10-05T14:16:27.116+0100 [conn345] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.147+0100 [mongosMain] connection accepted from 172.28.0.163:62789 #346 (239 connections now open) 2015-10-05T14:16:27.148+0100 [conn346] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.277+0100 [mongosMain] connection accepted from 172.28.0.163:62790 #347 (240 connections now open) 2015-10-05T14:16:27.278+0100 [conn347] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:27.281+0100 [mongosMain] connection accepted from 172.28.0.163:62791 #348 (241 connections now open) 2015-10-05T14:16:27.282+0100 [conn348] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:28.582+0100 [mongosMain] connection accepted from 127.0.0.1:62793 #349 (242 connections now open) 2015-10-05T14:16:28.585+0100 [conn349] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:28.591+0100 [conn349] end connection 127.0.0.1:62793 (241 connections now open) 2015-10-05T14:16:28.911+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612782c0c340f2cfc310522 2015-10-05T14:16:29.047+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:32.312+0100 [conn42] end connection 172.28.0.163:60142 (240 connections now open) 2015-10-05T14:16:32.314+0100 [mongosMain] connection accepted from 172.28.0.163:62795 #350 (241 connections now open) 2015-10-05T14:16:32.315+0100 [conn350] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:32.929+0100 [mongosMain] connection accepted from 172.28.0.163:62805 #351 (242 connections now open) 2015-10-05T14:16:32.930+0100 [conn351] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:35.342+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278330c340f2cfc3105bf 2015-10-05T14:16:35.477+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:36.760+0100 [conn167] end connection 172.28.0.163:61417 (241 connections now open) 2015-10-05T14:16:36.764+0100 [mongosMain] connection accepted from 172.28.0.163:62813 #352 (242 connections now open) 2015-10-05T14:16:36.766+0100 [conn352] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:40.173+0100 [mongosMain] connection accepted from 127.0.0.1:62818 #353 (243 connections now open) 2015-10-05T14:16:40.179+0100 [conn353] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:40.184+0100 [conn353] end connection 127.0.0.1:62818 (242 connections now open) 2015-10-05T14:16:40.575+0100 [conn188] end connection 172.28.0.163:61523 (241 connections now open) 2015-10-05T14:16:40.724+0100 [conn288] end connection 172.28.0.163:62292 (240 connections now open) 2015-10-05T14:16:40.817+0100 [conn337] end connection 172.28.0.163:62780 (239 connections now open) 2015-10-05T14:16:41.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278390c340f2cfc3106d1 2015-10-05T14:16:41.913+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:43.182+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:16:42 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:16:46.898+0100 [conn166] end connection 172.28.0.163:61414 (238 connections now open) 2015-10-05T14:16:46.899+0100 [mongosMain] connection accepted from 172.28.0.163:62828 #354 (239 connections now open) 2015-10-05T14:16:46.900+0100 [conn354] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:48.465+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612783f0c340f2cfc310733 2015-10-05T14:16:48.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:55.105+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278460c340f2cfc310773 2015-10-05T14:16:55.305+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:16:56.366+0100 [mongosMain] connection accepted from 172.28.0.164:63451 #355 (240 connections now open) 2015-10-05T14:16:56.370+0100 [conn355] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:56.631+0100 [mongosMain] connection accepted from 172.28.0.163:62857 #356 (241 connections now open) 2015-10-05T14:16:56.632+0100 [conn356] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:56.804+0100 [mongosMain] connection accepted from 172.28.0.163:62858 #357 (242 connections now open) 2015-10-05T14:16:56.805+0100 [conn357] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:56.817+0100 [mongosMain] connection accepted from 172.28.0.163:62859 #358 (243 connections now open) 2015-10-05T14:16:56.818+0100 [conn358] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:57.006+0100 [mongosMain] connection accepted from 172.28.0.163:62861 #359 (244 connections now open) 2015-10-05T14:16:57.008+0100 [conn359] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:58.212+0100 [mongosMain] connection accepted from 172.28.0.163:62876 #360 (245 connections now open) 2015-10-05T14:16:58.213+0100 [conn360] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:16:58.537+0100 [mongosMain] connection accepted from 172.28.0.163:62879 #361 (246 connections now open) 2015-10-05T14:16:58.537+0100 [conn193] end connection 172.28.0.163:61549 (245 connections now open) 2015-10-05T14:16:58.548+0100 [conn361] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:01.720+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612784d0c340f2cfc3107c1 2015-10-05T14:17:01.855+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:08.117+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278530c340f2cfc3108d6 2015-10-05T14:17:08.252+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:08.578+0100 [conn194] end connection 172.28.0.163:61551 (244 connections now open) 2015-10-05T14:17:08.584+0100 [mongosMain] connection accepted from 172.28.0.163:62956 #362 (245 connections now open) 2015-10-05T14:17:08.586+0100 [conn362] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:13.472+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:17:13 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:17:14.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612785a0c340f2cfc310992 2015-10-05T14:17:14.666+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:18.650+0100 [conn195] end connection 172.28.0.163:61553 (244 connections now open) 2015-10-05T14:17:18.675+0100 [mongosMain] connection accepted from 172.28.0.163:62969 #363 (245 connections now open) 2015-10-05T14:17:18.684+0100 [conn363] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:21.396+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278600c340f2cfc310a62 2015-10-05T14:17:21.464+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:28.473+0100 [mongosMain] connection accepted from 127.0.0.1:62986 #364 (246 connections now open) 2015-10-05T14:17:28.475+0100 [conn364] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:28.479+0100 [conn364] end connection 127.0.0.1:62986 (245 connections now open) 2015-10-05T14:17:28.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278670c340f2cfc310b35 2015-10-05T14:17:28.982+0100 [conn196] end connection 172.28.0.163:61554 (244 connections now open) 2015-10-05T14:17:28.983+0100 [mongosMain] connection accepted from 172.28.0.163:62988 #365 (245 connections now open) 2015-10-05T14:17:28.984+0100 [conn365] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:29.004+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:32.325+0100 [conn43] end connection 172.28.0.163:60144 (244 connections now open) 2015-10-05T14:17:32.326+0100 [mongosMain] connection accepted from 172.28.0.163:62992 #366 (245 connections now open) 2015-10-05T14:17:32.328+0100 [conn366] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:35.290+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612786f0c340f2cfc310c12 2015-10-05T14:17:35.458+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:39.638+0100 [mongosMain] connection accepted from 127.0.0.1:62997 #367 (246 connections now open) 2015-10-05T14:17:39.641+0100 [conn367] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:17:39.645+0100 [conn367] end connection 127.0.0.1:62997 (245 connections now open) 2015-10-05T14:17:41.739+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278750c340f2cfc310d23 2015-10-05T14:17:41.873+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:44.191+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:17:43 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:17:48.141+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612787b0c340f2cfc310dea 2015-10-05T14:17:48.277+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:54.418+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278820c340f2cfc310e73 2015-10-05T14:17:54.485+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:17:56.379+0100 [mongosMain] connection accepted from 172.28.0.164:63501 #368 (246 connections now open) 2015-10-05T14:17:56.393+0100 [conn368] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:18:00.662+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278880c340f2cfc310eba 2015-10-05T14:18:00.730+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:06.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612788e0c340f2cfc310f47 2015-10-05T14:18:06.955+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:13.232+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278940c340f2cfc310fb4 2015-10-05T14:18:13.370+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:14.495+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:18:14 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:18:19.528+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612789b0c340f2cfc31101c 2015-10-05T14:18:19.594+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:25.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278a10c340f2cfc31108e 2015-10-05T14:18:25.874+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:28.749+0100 [mongosMain] connection accepted from 127.0.0.1:63061 #369 (247 connections now open) 2015-10-05T14:18:28.751+0100 [conn369] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:18:28.756+0100 [conn369] end connection 127.0.0.1:63061 (246 connections now open) 2015-10-05T14:18:32.347+0100 [conn44] end connection 172.28.0.163:60146 (245 connections now open) 2015-10-05T14:18:32.358+0100 [mongosMain] connection accepted from 172.28.0.163:63063 #370 (246 connections now open) 2015-10-05T14:18:32.359+0100 [conn370] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:18:39.530+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278ad0c340f2cfc311140 2015-10-05T14:18:39.695+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:40.177+0100 [mongosMain] connection accepted from 127.0.0.1:63070 #371 (247 connections now open) 2015-10-05T14:18:40.181+0100 [conn371] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:18:40.187+0100 [conn371] end connection 127.0.0.1:63070 (246 connections now open) 2015-10-05T14:18:46.899+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:18:46.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:18:46.931+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:18:44 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:18:52.026+0100 [conn266] end connection 172.28.0.163:62223 (245 connections now open) 2015-10-05T14:18:53.137+0100 [conn325] end connection 172.28.0.163:62702 (244 connections now open) 2015-10-05T14:18:54.089+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278bc0c340f2cfc311248 2015-10-05T14:18:54.224+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:18:56.410+0100 [mongosMain] connection accepted from 172.28.0.164:63550 #372 (245 connections now open) 2015-10-05T14:18:56.414+0100 [conn372] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:00.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278c40c340f2cfc311273 2015-10-05T14:19:00.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:19:17.037+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:19:16 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:19:18.915+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:19:18.915+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:19:25.018+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:19:25.018+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:19:29.096+0100 [mongosMain] connection accepted from 127.0.0.1:63139 #373 (246 connections now open) 2015-10-05T14:19:29.099+0100 [conn373] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:29.105+0100 [conn373] end connection 127.0.0.1:63139 (245 connections now open) 2015-10-05T14:19:31.090+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:19:31.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:19:32.371+0100 [conn45] end connection 172.28.0.163:60147 (244 connections now open) 2015-10-05T14:19:32.372+0100 [mongosMain] connection accepted from 172.28.0.163:63142 #374 (245 connections now open) 2015-10-05T14:19:32.374+0100 [conn374] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:34.837+0100 [mongosMain] connection accepted from 172.28.0.164:63589 #375 (246 connections now open) 2015-10-05T14:19:34.921+0100 [conn375] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:34.993+0100 [mongosMain] connection accepted from 172.28.0.164:63592 #376 (247 connections now open) 2015-10-05T14:19:34.993+0100 [mongosMain] connection accepted from 172.28.0.164:63593 #377 (248 connections now open) 2015-10-05T14:19:34.994+0100 [mongosMain] connection accepted from 172.28.0.164:63591 #378 (249 connections now open) 2015-10-05T14:19:34.994+0100 [mongosMain] connection accepted from 172.28.0.164:63594 #379 (250 connections now open) 2015-10-05T14:19:34.995+0100 [conn376] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:34.995+0100 [conn377] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:34.996+0100 [conn378] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:34.997+0100 [conn379] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.021+0100 [mongosMain] connection accepted from 172.28.0.164:63596 #380 (251 connections now open) 2015-10-05T14:19:35.021+0100 [mongosMain] connection accepted from 172.28.0.164:63597 #381 (252 connections now open) 2015-10-05T14:19:35.022+0100 [mongosMain] connection accepted from 172.28.0.164:63599 #382 (253 connections now open) 2015-10-05T14:19:35.022+0100 [mongosMain] connection accepted from 172.28.0.164:63600 #383 (254 connections now open) 2015-10-05T14:19:35.022+0100 [mongosMain] connection accepted from 172.28.0.164:63598 #384 (255 connections now open) 2015-10-05T14:19:35.023+0100 [mongosMain] connection accepted from 172.28.0.164:63603 #385 (256 connections now open) 2015-10-05T14:19:35.023+0100 [conn380] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.023+0100 [mongosMain] connection accepted from 172.28.0.164:63604 #386 (257 connections now open) 2015-10-05T14:19:35.023+0100 [conn381] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.024+0100 [mongosMain] connection accepted from 172.28.0.164:63601 #387 (258 connections now open) 2015-10-05T14:19:35.024+0100 [conn383] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.024+0100 [conn382] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.024+0100 [mongosMain] connection accepted from 172.28.0.164:63602 #388 (259 connections now open) 2015-10-05T14:19:35.025+0100 [mongosMain] connection accepted from 172.28.0.164:63605 #389 (260 connections now open) 2015-10-05T14:19:35.025+0100 [mongosMain] connection accepted from 172.28.0.164:63606 #390 (261 connections now open) 2015-10-05T14:19:35.025+0100 [mongosMain] connection accepted from 172.28.0.164:63607 #391 (262 connections now open) 2015-10-05T14:19:35.026+0100 [conn385] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.026+0100 [conn384] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.026+0100 [mongosMain] connection accepted from 172.28.0.164:63608 #392 (263 connections now open) 2015-10-05T14:19:35.026+0100 [conn386] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.026+0100 [mongosMain] connection accepted from 172.28.0.164:63609 #393 (264 connections now open) 2015-10-05T14:19:35.027+0100 [conn389] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.029+0100 [conn391] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.029+0100 [conn393] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.029+0100 [conn390] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.029+0100 [conn392] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.036+0100 [conn388] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.039+0100 [conn387] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:35.048+0100 [mongosMain] connection accepted from 172.28.0.164:63616 #394 (265 connections now open) 2015-10-05T14:19:35.049+0100 [conn394] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:37.195+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:19:37.195+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:19:39.575+0100 [mongosMain] connection accepted from 127.0.0.1:63148 #395 (266 connections now open) 2015-10-05T14:19:39.577+0100 [conn395] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:39.582+0100 [conn395] end connection 127.0.0.1:63148 (265 connections now open) 2015-10-05T14:19:45.009+0100 [mongosMain] connection accepted from 172.28.0.164:63723 #396 (266 connections now open) 2015-10-05T14:19:45.013+0100 [conn396] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.014+0100 [mongosMain] connection accepted from 172.28.0.164:63724 #397 (267 connections now open) 2015-10-05T14:19:45.017+0100 [conn397] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.019+0100 [mongosMain] connection accepted from 172.28.0.164:63725 #398 (268 connections now open) 2015-10-05T14:19:45.021+0100 [conn398] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.023+0100 [mongosMain] connection accepted from 172.28.0.164:63726 #399 (269 connections now open) 2015-10-05T14:19:45.025+0100 [conn399] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.028+0100 [mongosMain] connection accepted from 172.28.0.164:63727 #400 (270 connections now open) 2015-10-05T14:19:45.029+0100 [conn400] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.031+0100 [mongosMain] connection accepted from 172.28.0.164:63728 #401 (271 connections now open) 2015-10-05T14:19:45.033+0100 [conn401] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.035+0100 [mongosMain] connection accepted from 172.28.0.164:63730 #402 (272 connections now open) 2015-10-05T14:19:45.037+0100 [conn402] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.038+0100 [mongosMain] connection accepted from 172.28.0.164:63732 #403 (273 connections now open) 2015-10-05T14:19:45.040+0100 [conn403] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.041+0100 [mongosMain] connection accepted from 172.28.0.164:63735 #404 (274 connections now open) 2015-10-05T14:19:45.043+0100 [conn404] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.045+0100 [mongosMain] connection accepted from 172.28.0.164:63740 #405 (275 connections now open) 2015-10-05T14:19:45.047+0100 [conn405] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.048+0100 [mongosMain] connection accepted from 172.28.0.164:63743 #406 (276 connections now open) 2015-10-05T14:19:45.051+0100 [conn406] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.053+0100 [mongosMain] connection accepted from 172.28.0.164:63748 #407 (277 connections now open) 2015-10-05T14:19:45.054+0100 [conn407] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.055+0100 [mongosMain] connection accepted from 172.28.0.164:63752 #408 (278 connections now open) 2015-10-05T14:19:45.056+0100 [mongosMain] connection accepted from 172.28.0.164:63753 #409 (279 connections now open) 2015-10-05T14:19:45.057+0100 [conn409] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.058+0100 [conn408] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.059+0100 [mongosMain] connection accepted from 172.28.0.164:63757 #410 (280 connections now open) 2015-10-05T14:19:45.060+0100 [mongosMain] connection accepted from 172.28.0.164:63758 #411 (281 connections now open) 2015-10-05T14:19:45.061+0100 [conn410] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.062+0100 [conn411] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.063+0100 [mongosMain] connection accepted from 172.28.0.164:63762 #412 (282 connections now open) 2015-10-05T14:19:45.063+0100 [mongosMain] connection accepted from 172.28.0.164:63764 #413 (283 connections now open) 2015-10-05T14:19:45.065+0100 [conn412] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.066+0100 [mongosMain] connection accepted from 172.28.0.164:63768 #414 (284 connections now open) 2015-10-05T14:19:45.066+0100 [conn413] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.068+0100 [conn414] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.068+0100 [mongosMain] connection accepted from 172.28.0.164:63770 #415 (285 connections now open) 2015-10-05T14:19:45.070+0100 [mongosMain] connection accepted from 172.28.0.164:63772 #416 (286 connections now open) 2015-10-05T14:19:45.070+0100 [conn415] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.071+0100 [conn416] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.072+0100 [mongosMain] connection accepted from 172.28.0.164:63775 #417 (287 connections now open) 2015-10-05T14:19:45.073+0100 [mongosMain] connection accepted from 172.28.0.164:63777 #418 (288 connections now open) 2015-10-05T14:19:45.073+0100 [conn417] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.074+0100 [conn418] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.075+0100 [mongosMain] connection accepted from 172.28.0.164:63780 #419 (289 connections now open) 2015-10-05T14:19:45.076+0100 [mongosMain] connection accepted from 172.28.0.164:63781 #420 (290 connections now open) 2015-10-05T14:19:45.077+0100 [conn419] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.078+0100 [conn420] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.079+0100 [mongosMain] connection accepted from 172.28.0.164:63785 #421 (291 connections now open) 2015-10-05T14:19:45.080+0100 [mongosMain] connection accepted from 172.28.0.164:63787 #422 (292 connections now open) 2015-10-05T14:19:45.081+0100 [conn422] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.081+0100 [conn421] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.083+0100 [mongosMain] connection accepted from 172.28.0.164:63791 #423 (293 connections now open) 2015-10-05T14:19:45.083+0100 [mongosMain] connection accepted from 172.28.0.164:63790 #424 (294 connections now open) 2015-10-05T14:19:45.084+0100 [conn423] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.085+0100 [conn424] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.086+0100 [mongosMain] connection accepted from 172.28.0.164:63792 #425 (295 connections now open) 2015-10-05T14:19:45.087+0100 [mongosMain] connection accepted from 172.28.0.164:63793 #426 (296 connections now open) 2015-10-05T14:19:45.088+0100 [conn425] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.088+0100 [conn426] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.090+0100 [mongosMain] connection accepted from 172.28.0.164:63794 #427 (297 connections now open) 2015-10-05T14:19:45.090+0100 [mongosMain] connection accepted from 172.28.0.164:63795 #428 (298 connections now open) 2015-10-05T14:19:45.091+0100 [conn427] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.092+0100 [conn428] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.093+0100 [mongosMain] connection accepted from 172.28.0.164:63796 #429 (299 connections now open) 2015-10-05T14:19:45.094+0100 [mongosMain] connection accepted from 172.28.0.164:63797 #430 (300 connections now open) 2015-10-05T14:19:45.095+0100 [conn429] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.095+0100 [conn430] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.097+0100 [mongosMain] connection accepted from 172.28.0.164:63798 #431 (301 connections now open) 2015-10-05T14:19:45.097+0100 [mongosMain] connection accepted from 172.28.0.164:63799 #432 (302 connections now open) 2015-10-05T14:19:45.098+0100 [conn432] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.098+0100 [conn431] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.100+0100 [mongosMain] connection accepted from 172.28.0.164:63800 #433 (303 connections now open) 2015-10-05T14:19:45.101+0100 [mongosMain] connection accepted from 172.28.0.164:63801 #434 (304 connections now open) 2015-10-05T14:19:45.102+0100 [conn433] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.102+0100 [conn434] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.104+0100 [mongosMain] connection accepted from 172.28.0.164:63802 #435 (305 connections now open) 2015-10-05T14:19:45.104+0100 [mongosMain] connection accepted from 172.28.0.164:63803 #436 (306 connections now open) 2015-10-05T14:19:45.105+0100 [conn435] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.106+0100 [conn436] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.108+0100 [mongosMain] connection accepted from 172.28.0.164:63804 #437 (307 connections now open) 2015-10-05T14:19:45.108+0100 [mongosMain] connection accepted from 172.28.0.164:63805 #438 (308 connections now open) 2015-10-05T14:19:45.109+0100 [conn437] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.110+0100 [conn438] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.111+0100 [mongosMain] connection accepted from 172.28.0.164:63806 #439 (309 connections now open) 2015-10-05T14:19:45.111+0100 [mongosMain] connection accepted from 172.28.0.164:63807 #440 (310 connections now open) 2015-10-05T14:19:45.112+0100 [conn439] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.113+0100 [conn440] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.115+0100 [mongosMain] connection accepted from 172.28.0.164:63808 #441 (311 connections now open) 2015-10-05T14:19:45.115+0100 [mongosMain] connection accepted from 172.28.0.164:63809 #442 (312 connections now open) 2015-10-05T14:19:45.117+0100 [conn442] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.117+0100 [conn441] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.118+0100 [mongosMain] connection accepted from 172.28.0.164:63811 #443 (313 connections now open) 2015-10-05T14:19:45.119+0100 [mongosMain] connection accepted from 172.28.0.164:63810 #444 (314 connections now open) 2015-10-05T14:19:45.121+0100 [conn443] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.121+0100 [conn444] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.123+0100 [mongosMain] connection accepted from 172.28.0.164:63812 #445 (315 connections now open) 2015-10-05T14:19:45.124+0100 [conn445] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.127+0100 [mongosMain] connection accepted from 172.28.0.164:63813 #446 (316 connections now open) 2015-10-05T14:19:45.129+0100 [conn446] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.130+0100 [mongosMain] connection accepted from 172.28.0.164:63814 #447 (317 connections now open) 2015-10-05T14:19:45.132+0100 [conn447] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.134+0100 [mongosMain] connection accepted from 172.28.0.164:63815 #448 (318 connections now open) 2015-10-05T14:19:45.135+0100 [conn448] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.137+0100 [mongosMain] connection accepted from 172.28.0.164:63816 #449 (319 connections now open) 2015-10-05T14:19:45.139+0100 [conn449] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.140+0100 [mongosMain] connection accepted from 172.28.0.164:63817 #450 (320 connections now open) 2015-10-05T14:19:45.142+0100 [conn450] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.145+0100 [mongosMain] connection accepted from 172.28.0.164:63818 #451 (321 connections now open) 2015-10-05T14:19:45.146+0100 [conn451] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.148+0100 [mongosMain] connection accepted from 172.28.0.164:63819 #452 (322 connections now open) 2015-10-05T14:19:45.150+0100 [conn452] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.152+0100 [mongosMain] connection accepted from 172.28.0.164:63820 #453 (323 connections now open) 2015-10-05T14:19:45.153+0100 [conn453] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.155+0100 [mongosMain] connection accepted from 172.28.0.164:63821 #454 (324 connections now open) 2015-10-05T14:19:45.157+0100 [conn454] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.159+0100 [mongosMain] connection accepted from 172.28.0.164:63822 #455 (325 connections now open) 2015-10-05T14:19:45.160+0100 [conn455] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.162+0100 [mongosMain] connection accepted from 172.28.0.164:63823 #456 (326 connections now open) 2015-10-05T14:19:45.164+0100 [conn456] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.166+0100 [mongosMain] connection accepted from 172.28.0.164:63824 #457 (327 connections now open) 2015-10-05T14:19:45.167+0100 [conn457] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.169+0100 [mongosMain] connection accepted from 172.28.0.164:63825 #458 (328 connections now open) 2015-10-05T14:19:45.171+0100 [conn458] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.172+0100 [mongosMain] connection accepted from 172.28.0.164:63826 #459 (329 connections now open) 2015-10-05T14:19:45.186+0100 [conn459] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.188+0100 [mongosMain] connection accepted from 172.28.0.164:63828 #460 (330 connections now open) 2015-10-05T14:19:45.189+0100 [conn460] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.191+0100 [mongosMain] connection accepted from 172.28.0.164:63829 #461 (331 connections now open) 2015-10-05T14:19:45.192+0100 [conn461] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.194+0100 [mongosMain] connection accepted from 172.28.0.164:63830 #462 (332 connections now open) 2015-10-05T14:19:45.195+0100 [conn462] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.197+0100 [mongosMain] connection accepted from 172.28.0.164:63831 #463 (333 connections now open) 2015-10-05T14:19:45.198+0100 [conn463] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.199+0100 [mongosMain] connection accepted from 172.28.0.164:63832 #464 (334 connections now open) 2015-10-05T14:19:45.201+0100 [conn464] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.204+0100 [mongosMain] connection accepted from 172.28.0.164:63833 #465 (335 connections now open) 2015-10-05T14:19:45.206+0100 [conn465] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.208+0100 [mongosMain] connection accepted from 172.28.0.164:63834 #466 (336 connections now open) 2015-10-05T14:19:45.215+0100 [conn466] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.217+0100 [mongosMain] connection accepted from 172.28.0.164:63835 #467 (337 connections now open) 2015-10-05T14:19:45.219+0100 [conn467] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.220+0100 [mongosMain] connection accepted from 172.28.0.164:63836 #468 (338 connections now open) 2015-10-05T14:19:45.222+0100 [conn468] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.223+0100 [mongosMain] connection accepted from 172.28.0.164:63837 #469 (339 connections now open) 2015-10-05T14:19:45.225+0100 [conn469] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.227+0100 [mongosMain] connection accepted from 172.28.0.164:63838 #470 (340 connections now open) 2015-10-05T14:19:45.234+0100 [conn470] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.236+0100 [mongosMain] connection accepted from 172.28.0.164:63839 #471 (341 connections now open) 2015-10-05T14:19:45.238+0100 [conn471] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.240+0100 [mongosMain] connection accepted from 172.28.0.164:63840 #472 (342 connections now open) 2015-10-05T14:19:45.251+0100 [conn472] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.253+0100 [mongosMain] connection accepted from 172.28.0.164:63841 #473 (343 connections now open) 2015-10-05T14:19:45.255+0100 [conn473] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.257+0100 [mongosMain] connection accepted from 172.28.0.164:63842 #474 (344 connections now open) 2015-10-05T14:19:45.259+0100 [conn474] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:45.261+0100 [mongosMain] connection accepted from 172.28.0.164:63843 #475 (345 connections now open) 2015-10-05T14:19:45.262+0100 [conn475] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:19:47.287+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:19:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:19:49.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561278f50c340f2cfc311431 2015-10-05T14:19:49.607+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:19:56.426+0100 [mongosMain] connection accepted from 172.28.0.164:63864 #476 (346 connections now open) 2015-10-05T14:19:56.431+0100 [conn476] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:20:07.922+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279070c340f2cfc311511 2015-10-05T14:20:08.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:20:17.545+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:20:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:20:21.160+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:20:21.160+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:20:27.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612791b0c340f2cfc31165c 2015-10-05T14:20:27.716+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:20:28.787+0100 [mongosMain] connection accepted from 127.0.0.1:63210 #477 (347 connections now open) 2015-10-05T14:20:28.789+0100 [conn477] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:20:28.795+0100 [conn477] end connection 127.0.0.1:63210 (346 connections now open) 2015-10-05T14:20:32.388+0100 [conn46] end connection 172.28.0.163:60149 (345 connections now open) 2015-10-05T14:20:32.389+0100 [mongosMain] connection accepted from 172.28.0.163:63214 #478 (346 connections now open) 2015-10-05T14:20:32.391+0100 [conn478] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:20:34.006+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279210c340f2cfc311704 2015-10-05T14:20:34.142+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:20:40.184+0100 [mongosMain] connection accepted from 127.0.0.1:63217 #479 (347 connections now open) 2015-10-05T14:20:40.187+0100 [conn479] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:20:40.191+0100 [conn479] end connection 127.0.0.1:63217 (346 connections now open) 2015-10-05T14:20:46.425+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612792e0c340f2cfc3117ee 2015-10-05T14:20:46.561+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:20:47.824+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:20:47 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:20:56.442+0100 [mongosMain] connection accepted from 172.28.0.164:63920 #480 (347 connections now open) 2015-10-05T14:20:56.445+0100 [conn480] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:21:00.100+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:00.100+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:12.322+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:12.322+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:18.086+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:21:17 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:21:18.463+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:18.463+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:24.568+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612794e38482111da12e4ec') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051284470), why: "doing balance round", ts: ObjectId('561279540c340f2cfc31183e') } } gle1: { lastOp: Timestamp 1444051284000|5, connectionId: 36801, updatedExisting: true, n: 1, syncMillis: 0, writtenTo: null, err: null, waited: 0, ok: 1.0 } gle2: { lastOp: Timestamp 1444051246000|12, connectionId: 40376, updatedExisting: false, n: 0, syncMillis: 0, writtenTo: null, err: null, waited: 0, ok: 1.0 } 2015-10-05T14:21:24.571+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:21:24.571+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:28.809+0100 [mongosMain] connection accepted from 127.0.0.1:63271 #481 (348 connections now open) 2015-10-05T14:21:28.812+0100 [conn481] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:21:28.817+0100 [conn481] end connection 127.0.0.1:63271 (347 connections now open) 2015-10-05T14:21:30.777+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612795a0c340f2cfc31183f 2015-10-05T14:21:30.845+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:21:32.407+0100 [conn47] end connection 172.28.0.163:60150 (346 connections now open) 2015-10-05T14:21:32.408+0100 [mongosMain] connection accepted from 172.28.0.163:63275 #482 (347 connections now open) 2015-10-05T14:21:32.409+0100 [conn482] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:21:39.487+0100 [mongosMain] connection accepted from 127.0.0.1:63278 #483 (348 connections now open) 2015-10-05T14:21:39.490+0100 [conn483] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:21:39.494+0100 [conn483] end connection 127.0.0.1:63278 (347 connections now open) 2015-10-05T14:21:44.084+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:44.084+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:48.383+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:21:48 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:21:48.383+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:21:48.519+0100 [LockPinger] handled late remove of old distributed lock with ts 561279540c340f2cfc31183e 2015-10-05T14:21:50.238+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:50.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:56.417+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:21:56.417+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:21:56.461+0100 [mongosMain] connection accepted from 172.28.0.164:63980 #484 (348 connections now open) 2015-10-05T14:21:56.464+0100 [conn484] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:22:02.553+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612797438482111da12e4f2') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051322424), why: "doing balance round", ts: ObjectId('5612797a0c340f2cfc311a3b') } } gle1: { lastOp: Timestamp 1444051322000|6, connectionId: 36801, updatedExisting: true, n: 1, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1444051290000|13, connectionId: 35263, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2015-10-05T14:22:02.556+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:22:02.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:22:08.660+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:22:08.660+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:22:16.045+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5612798121e099ca5fa0d20a') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051335122), why: "doing balance round", ts: ObjectId('561279870c340f2cfc311b69') } } gle1: { lastOp: Timestamp 1444051322000|6, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1444051335000|2, connectionId: 40376, updatedExisting: true, n: 1, syncMillis: 132, writtenTo: null, err: null, waited: 132, ok: 1.0 } 2015-10-05T14:22:16.048+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:22:16.048+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:22:19.728+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:22:18 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:22:19.728+0100 [LockPinger] trying to delete 2 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:22:19.864+0100 [LockPinger] handled late remove of old distributed lock with ts 5612797a0c340f2cfc311a3b 2015-10-05T14:22:20.001+0100 [LockPinger] handled late remove of old distributed lock with ts 561279870c340f2cfc311b69 2015-10-05T14:22:22.595+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 5612798e0c340f2cfc311c1c 2015-10-05T14:22:22.732+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:22:28.587+0100 [mongosMain] connection accepted from 127.0.0.1:63330 #485 (349 connections now open) 2015-10-05T14:22:28.589+0100 [conn485] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:22:28.595+0100 [conn485] end connection 127.0.0.1:63330 (348 connections now open) 2015-10-05T14:22:32.421+0100 [conn48] end connection 172.28.0.163:60152 (347 connections now open) 2015-10-05T14:22:32.422+0100 [mongosMain] connection accepted from 172.28.0.163:63333 #486 (348 connections now open) 2015-10-05T14:22:32.423+0100 [conn486] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:22:39.632+0100 [mongosMain] connection accepted from 127.0.0.1:63336 #487 (349 connections now open) 2015-10-05T14:22:39.634+0100 [conn487] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:22:39.639+0100 [conn487] end connection 127.0.0.1:63336 (348 connections now open) 2015-10-05T14:22:48.261+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:22:48.261+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:22:50.272+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:22:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:22:54.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279ae0c340f2cfc311dd1 2015-10-05T14:22:54.674+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:22:56.474+0100 [mongosMain] connection accepted from 172.28.0.164:64039 #488 (349 connections now open) 2015-10-05T14:22:56.483+0100 [conn488] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:11.782+0100 [conn233] end connection 172.28.0.163:61612 (348 connections now open) 2015-10-05T14:23:11.783+0100 [mongosMain] connection accepted from 172.28.0.163:63376 #489 (349 connections now open) 2015-10-05T14:23:11.783+0100 [conn489] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:16.527+0100 [conn319] end connection 172.28.0.163:62691 (348 connections now open) 2015-10-05T14:23:18.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279c60c340f2cfc311e93 2015-10-05T14:23:19.040+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:23:20.436+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:23:20 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:23:21.782+0100 [conn220] end connection 172.28.0.163:61592 (347 connections now open) 2015-10-05T14:23:21.783+0100 [mongosMain] connection accepted from 172.28.0.163:63387 #490 (348 connections now open) 2015-10-05T14:23:21.784+0100 [conn490] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:25.171+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279cd0c340f2cfc311ec5 2015-10-05T14:23:25.273+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:23:28.258+0100 [mongosMain] connection accepted from 127.0.0.1:63391 #491 (349 connections now open) 2015-10-05T14:23:28.260+0100 [conn491] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:28.265+0100 [conn491] end connection 127.0.0.1:63391 (348 connections now open) 2015-10-05T14:23:30.046+0100 [conn428] end connection 172.28.0.164:63795 (347 connections now open) 2015-10-05T14:23:30.050+0100 [mongosMain] connection accepted from 172.28.0.164:64070 #492 (348 connections now open) 2015-10-05T14:23:30.052+0100 [conn492] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:31.438+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279d30c340f2cfc311f29 2015-10-05T14:23:31.506+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:23:31.797+0100 [conn227] end connection 172.28.0.163:61603 (347 connections now open) 2015-10-05T14:23:31.798+0100 [mongosMain] connection accepted from 172.28.0.163:63392 #493 (348 connections now open) 2015-10-05T14:23:31.799+0100 [conn493] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:32.436+0100 [conn49] end connection 172.28.0.163:60154 (347 connections now open) 2015-10-05T14:23:32.437+0100 [mongosMain] connection accepted from 172.28.0.163:63394 #494 (348 connections now open) 2015-10-05T14:23:32.439+0100 [conn494] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:38.104+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:23:38.104+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:23:39.508+0100 [mongosMain] connection accepted from 127.0.0.1:63399 #495 (349 connections now open) 2015-10-05T14:23:39.511+0100 [conn495] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:39.516+0100 [conn495] end connection 127.0.0.1:63399 (348 connections now open) 2015-10-05T14:23:41.798+0100 [conn234] end connection 172.28.0.163:61613 (347 connections now open) 2015-10-05T14:23:41.799+0100 [mongosMain] connection accepted from 172.28.0.163:63402 #496 (348 connections now open) 2015-10-05T14:23:41.800+0100 [conn496] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:44.473+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('561279dbd5de43e0ed5d4165') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051424111), why: "doing balance round", ts: ObjectId('561279e00c340f2cfc31200a') } } gle1: { lastOp: Timestamp 1444051411000|8, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1444051424000|6, connectionId: 35263, updatedExisting: true, n: 1, syncMillis: 25, writtenTo: null, err: null, waited: 25, ok: 1.0 } 2015-10-05T14:23:44.475+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:23:44.475+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:23:49.796+0100 [conn267] end connection 172.28.0.163:62224 (347 connections now open) 2015-10-05T14:23:51.537+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:23:50 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:23:51.537+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:23:51.572+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 561279e60c340f2cfc31206a 2015-10-05T14:23:51.673+0100 [LockPinger] handled late remove of old distributed lock with ts 561279e00c340f2cfc31200a 2015-10-05T14:23:51.707+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:23:51.813+0100 [conn221] end connection 172.28.0.163:61593 (346 connections now open) 2015-10-05T14:23:51.814+0100 [mongosMain] connection accepted from 172.28.0.163:63415 #497 (347 connections now open) 2015-10-05T14:23:51.815+0100 [conn497] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:56.490+0100 [mongosMain] connection accepted from 172.28.0.164:64112 #498 (348 connections now open) 2015-10-05T14:23:56.508+0100 [conn498] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:23:58.053+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:23:58.053+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:24:01.821+0100 [conn215] end connection 172.28.0.163:61584 (347 connections now open) 2015-10-05T14:24:01.822+0100 [mongosMain] connection accepted from 172.28.0.163:63430 #499 (348 connections now open) 2015-10-05T14:24:01.823+0100 [conn499] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:05.259+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:24:05.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:24:11.468+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:24:11.468+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:24:11.838+0100 [conn206] end connection 172.28.0.163:61570 (347 connections now open) 2015-10-05T14:24:11.841+0100 [mongosMain] connection accepted from 172.28.0.163:63446 #500 (348 connections now open) 2015-10-05T14:24:11.842+0100 [conn500] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:17.574+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:24:17.574+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:24:21.803+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:24:21 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:24:21.845+0100 [conn211] end connection 172.28.0.163:61578 (347 connections now open) 2015-10-05T14:24:21.846+0100 [mongosMain] connection accepted from 172.28.0.163:63453 #501 (348 connections now open) 2015-10-05T14:24:21.847+0100 [conn501] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:23.850+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a070c340f2cfc31223e 2015-10-05T14:24:23.986+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:24:28.640+0100 [mongosMain] connection accepted from 127.0.0.1:63460 #502 (349 connections now open) 2015-10-05T14:24:28.643+0100 [conn502] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:28.649+0100 [conn502] end connection 127.0.0.1:63460 (348 connections now open) 2015-10-05T14:24:30.262+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a0d0c340f2cfc3122a4 2015-10-05T14:24:30.398+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:24:31.845+0100 [conn202] end connection 172.28.0.163:61564 (347 connections now open) 2015-10-05T14:24:31.846+0100 [mongosMain] connection accepted from 172.28.0.163:63461 #503 (348 connections now open) 2015-10-05T14:24:31.847+0100 [conn503] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:32.452+0100 [conn50] end connection 172.28.0.163:60155 (347 connections now open) 2015-10-05T14:24:32.453+0100 [mongosMain] connection accepted from 172.28.0.163:63463 #504 (348 connections now open) 2015-10-05T14:24:32.455+0100 [conn504] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:36.692+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a140c340f2cfc31231e 2015-10-05T14:24:36.828+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:24:39.888+0100 [mongosMain] connection accepted from 127.0.0.1:63467 #505 (349 connections now open) 2015-10-05T14:24:39.890+0100 [conn505] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:39.895+0100 [conn505] end connection 127.0.0.1:63467 (348 connections now open) 2015-10-05T14:24:41.860+0100 [conn203] end connection 172.28.0.163:61565 (347 connections now open) 2015-10-05T14:24:41.861+0100 [mongosMain] connection accepted from 172.28.0.163:63471 #506 (348 connections now open) 2015-10-05T14:24:41.862+0100 [conn506] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:42.969+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a1a0c340f2cfc3123a8 2015-10-05T14:24:43.037+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:24:49.445+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a210c340f2cfc312413 2015-10-05T14:24:49.569+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:24:51.894+0100 [conn216] end connection 172.28.0.163:61586 (347 connections now open) 2015-10-05T14:24:51.894+0100 [mongosMain] connection accepted from 172.28.0.163:63488 #507 (348 connections now open) 2015-10-05T14:24:51.894+0100 [conn507] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:52.097+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:24:51 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:24:56.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a270c340f2cfc31246a 2015-10-05T14:24:56.522+0100 [mongosMain] connection accepted from 172.28.0.164:64164 #508 (349 connections now open) 2015-10-05T14:24:56.530+0100 [conn508] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:24:56.719+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:01.876+0100 [conn205] end connection 172.28.0.163:61568 (348 connections now open) 2015-10-05T14:25:01.877+0100 [mongosMain] connection accepted from 172.28.0.163:63509 #509 (349 connections now open) 2015-10-05T14:25:01.878+0100 [conn509] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:03.038+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a2e0c340f2cfc3124ae 2015-10-05T14:25:03.238+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:09.405+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a350c340f2cfc312500 2015-10-05T14:25:09.472+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:11.885+0100 [conn214] end connection 172.28.0.163:61583 (348 connections now open) 2015-10-05T14:25:11.887+0100 [mongosMain] connection accepted from 172.28.0.163:63524 #510 (349 connections now open) 2015-10-05T14:25:11.888+0100 [conn510] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:15.753+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a3b0c340f2cfc312537 2015-10-05T14:25:15.888+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:21.891+0100 [conn209] end connection 172.28.0.163:61575 (348 connections now open) 2015-10-05T14:25:21.893+0100 [mongosMain] connection accepted from 172.28.0.163:63532 #511 (349 connections now open) 2015-10-05T14:25:21.894+0100 [conn511] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:22.065+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a410c340f2cfc31257d 2015-10-05T14:25:22.135+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:22.201+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:25:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:25:28.412+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a480c340f2cfc31259d 2015-10-05T14:25:28.491+0100 [mongosMain] connection accepted from 127.0.0.1:63535 #512 (350 connections now open) 2015-10-05T14:25:28.494+0100 [conn512] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:28.500+0100 [conn512] end connection 127.0.0.1:63535 (349 connections now open) 2015-10-05T14:25:28.616+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:31.378+0100 [conn328] end connection 172.28.0.163:62707 (348 connections now open) 2015-10-05T14:25:31.894+0100 [conn210] end connection 172.28.0.163:61576 (347 connections now open) 2015-10-05T14:25:31.895+0100 [mongosMain] connection accepted from 172.28.0.163:63538 #513 (348 connections now open) 2015-10-05T14:25:31.896+0100 [conn513] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:32.469+0100 [conn51] end connection 172.28.0.163:60157 (347 connections now open) 2015-10-05T14:25:32.470+0100 [mongosMain] connection accepted from 172.28.0.163:63541 #514 (348 connections now open) 2015-10-05T14:25:32.473+0100 [conn514] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:34.899+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a4e0c340f2cfc3125cb 2015-10-05T14:25:35.033+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:39.890+0100 [mongosMain] connection accepted from 127.0.0.1:63544 #515 (349 connections now open) 2015-10-05T14:25:39.893+0100 [conn515] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:39.898+0100 [conn515] end connection 127.0.0.1:63544 (348 connections now open) 2015-10-05T14:25:41.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a550c340f2cfc3125f1 2015-10-05T14:25:41.453+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:41.907+0100 [conn204] end connection 172.28.0.163:61567 (347 connections now open) 2015-10-05T14:25:41.908+0100 [mongosMain] connection accepted from 172.28.0.163:63549 #516 (348 connections now open) 2015-10-05T14:25:41.909+0100 [conn516] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:47.748+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a5b0c340f2cfc31262b 2015-10-05T14:25:47.882+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:51.923+0100 [conn207] end connection 172.28.0.163:61572 (347 connections now open) 2015-10-05T14:25:51.925+0100 [mongosMain] connection accepted from 172.28.0.163:63560 #517 (348 connections now open) 2015-10-05T14:25:51.926+0100 [conn517] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:25:52.391+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:25:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:25:54.029+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a610c340f2cfc312673 2015-10-05T14:25:54.097+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:25:56.539+0100 [mongosMain] connection accepted from 172.28.0.164:64223 #518 (349 connections now open) 2015-10-05T14:25:56.543+0100 [conn518] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:00.241+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a680c340f2cfc3126ad 2015-10-05T14:26:00.309+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:01.922+0100 [conn208] end connection 172.28.0.163:61573 (348 connections now open) 2015-10-05T14:26:01.923+0100 [mongosMain] connection accepted from 172.28.0.163:63575 #519 (349 connections now open) 2015-10-05T14:26:01.924+0100 [conn519] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:06.592+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a6e0c340f2cfc3126fe 2015-10-05T14:26:06.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:11.939+0100 [conn237] end connection 172.28.0.163:61618 (348 connections now open) 2015-10-05T14:26:11.940+0100 [mongosMain] connection accepted from 172.28.0.163:63588 #520 (349 connections now open) 2015-10-05T14:26:11.941+0100 [conn520] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:12.871+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a740c340f2cfc31274f 2015-10-05T14:26:12.938+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:19.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a7a0c340f2cfc31279e 2015-10-05T14:26:19.357+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:21.939+0100 [conn223] end connection 172.28.0.163:61596 (348 connections now open) 2015-10-05T14:26:21.940+0100 [mongosMain] connection accepted from 172.28.0.163:63600 #521 (349 connections now open) 2015-10-05T14:26:21.941+0100 [conn521] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:22.667+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:26:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:26:25.636+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a810c340f2cfc3127f2 2015-10-05T14:26:25.770+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:28.267+0100 [mongosMain] connection accepted from 127.0.0.1:63602 #522 (350 connections now open) 2015-10-05T14:26:28.269+0100 [conn522] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:28.275+0100 [conn522] end connection 127.0.0.1:63602 (349 connections now open) 2015-10-05T14:26:31.954+0100 [conn230] end connection 172.28.0.163:61607 (348 connections now open) 2015-10-05T14:26:31.955+0100 [mongosMain] connection accepted from 172.28.0.163:63603 #523 (349 connections now open) 2015-10-05T14:26:31.957+0100 [conn523] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:32.056+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a870c340f2cfc31283b 2015-10-05T14:26:32.192+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:32.484+0100 [conn52] end connection 172.28.0.163:60159 (348 connections now open) 2015-10-05T14:26:32.485+0100 [mongosMain] connection accepted from 172.28.0.163:63606 #524 (349 connections now open) 2015-10-05T14:26:32.487+0100 [conn524] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:38.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a8e0c340f2cfc312882 2015-10-05T14:26:38.610+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:39.238+0100 [mongosMain] connection accepted from 127.0.0.1:63609 #525 (350 connections now open) 2015-10-05T14:26:39.240+0100 [conn525] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:39.245+0100 [conn525] end connection 127.0.0.1:63609 (349 connections now open) 2015-10-05T14:26:41.955+0100 [conn218] end connection 172.28.0.163:61589 (348 connections now open) 2015-10-05T14:26:41.956+0100 [mongosMain] connection accepted from 172.28.0.163:63613 #526 (349 connections now open) 2015-10-05T14:26:41.957+0100 [conn526] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:45.410+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a940c340f2cfc3128c0 2015-10-05T14:26:45.546+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:51.829+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127a9b0c340f2cfc312911 2015-10-05T14:26:51.966+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:26:52.921+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:26:52 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:26:56.559+0100 [mongosMain] connection accepted from 172.28.0.164:64291 #527 (350 connections now open) 2015-10-05T14:26:56.562+0100 [conn527] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:26:58.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127aa10c340f2cfc312946 2015-10-05T14:26:58.188+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:01.456+0100 [conn293] end connection 172.28.0.163:62322 (349 connections now open) 2015-10-05T14:27:04.483+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127aa80c340f2cfc3129a0 2015-10-05T14:27:04.619+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:10.767+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127aae0c340f2cfc3129ee 2015-10-05T14:27:10.835+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:11.470+0100 [conn358] end connection 172.28.0.163:62859 (348 connections now open) 2015-10-05T14:27:11.986+0100 [conn229] end connection 172.28.0.163:61605 (347 connections now open) 2015-10-05T14:27:11.987+0100 [mongosMain] connection accepted from 172.28.0.163:63650 #528 (348 connections now open) 2015-10-05T14:27:11.989+0100 [conn528] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:17.121+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ab40c340f2cfc312a27 2015-10-05T14:27:17.256+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:21.471+0100 [conn356] end connection 172.28.0.163:62857 (347 connections now open) 2015-10-05T14:27:22.002+0100 [conn222] end connection 172.28.0.163:61595 (346 connections now open) 2015-10-05T14:27:22.004+0100 [mongosMain] connection accepted from 172.28.0.163:63661 #529 (347 connections now open) 2015-10-05T14:27:22.005+0100 [conn529] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:23.062+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:27:22 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:27:23.474+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127abb0c340f2cfc312a70 2015-10-05T14:27:23.609+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:29.064+0100 [mongosMain] connection accepted from 127.0.0.1:63666 #530 (348 connections now open) 2015-10-05T14:27:29.067+0100 [conn530] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:29.072+0100 [conn530] end connection 127.0.0.1:63666 (347 connections now open) 2015-10-05T14:27:29.460+0100 [conn432] end connection 172.28.0.164:63799 (346 connections now open) 2015-10-05T14:27:29.464+0100 [mongosMain] connection accepted from 172.28.0.164:64315 #531 (347 connections now open) 2015-10-05T14:27:29.469+0100 [conn531] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:29.858+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ac10c340f2cfc312ac5 2015-10-05T14:27:29.960+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:31.487+0100 [conn172] end connection 172.28.0.163:61503 (346 connections now open) 2015-10-05T14:27:32.002+0100 [conn198] end connection 172.28.0.163:61557 (345 connections now open) 2015-10-05T14:27:32.003+0100 [mongosMain] connection accepted from 172.28.0.163:63667 #532 (346 connections now open) 2015-10-05T14:27:32.004+0100 [conn532] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:32.501+0100 [conn53] end connection 172.28.0.163:60160 (345 connections now open) 2015-10-05T14:27:32.502+0100 [mongosMain] connection accepted from 172.28.0.163:63669 #533 (346 connections now open) 2015-10-05T14:27:32.504+0100 [conn533] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:36.283+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ac70c340f2cfc312b09 2015-10-05T14:27:36.419+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:39.748+0100 [mongosMain] connection accepted from 127.0.0.1:63676 #534 (347 connections now open) 2015-10-05T14:27:39.751+0100 [conn534] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:39.755+0100 [conn534] end connection 127.0.0.1:63676 (346 connections now open) 2015-10-05T14:27:41.488+0100 [conn271] end connection 172.28.0.163:62228 (345 connections now open) 2015-10-05T14:27:42.016+0100 [conn200] end connection 172.28.0.163:61560 (344 connections now open) 2015-10-05T14:27:42.017+0100 [mongosMain] connection accepted from 172.28.0.163:63679 #535 (345 connections now open) 2015-10-05T14:27:42.018+0100 [conn535] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:43.076+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ace0c340f2cfc312b5f 2015-10-05T14:27:43.213+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:49.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ad50c340f2cfc312bbc 2015-10-05T14:27:49.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:27:51.503+0100 [conn269] end connection 172.28.0.163:62226 (344 connections now open) 2015-10-05T14:27:52.018+0100 [conn197] end connection 172.28.0.163:61556 (343 connections now open) 2015-10-05T14:27:52.019+0100 [mongosMain] connection accepted from 172.28.0.163:63695 #536 (344 connections now open) 2015-10-05T14:27:52.020+0100 [conn536] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:27:53.217+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:27:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:27:56.571+0100 [mongosMain] connection accepted from 172.28.0.164:64346 #537 (345 connections now open) 2015-10-05T14:27:56.574+0100 [conn537] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:01.518+0100 [conn143] end connection 172.28.0.163:61382 (344 connections now open) 2015-10-05T14:28:01.750+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ae10c340f2cfc312c3a 2015-10-05T14:28:01.886+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:28:02.033+0100 [conn332] end connection 172.28.0.163:62762 (343 connections now open) 2015-10-05T14:28:02.034+0100 [mongosMain] connection accepted from 172.28.0.163:63712 #538 (344 connections now open) 2015-10-05T14:28:02.035+0100 [conn538] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:11.519+0100 [conn171] end connection 172.28.0.163:61502 (343 connections now open) 2015-10-05T14:28:12.034+0100 [conn231] end connection 172.28.0.163:61609 (342 connections now open) 2015-10-05T14:28:12.035+0100 [mongosMain] connection accepted from 172.28.0.163:63724 #539 (343 connections now open) 2015-10-05T14:28:12.036+0100 [conn539] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:14.055+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127aed0c340f2cfc312ce0 2015-10-05T14:28:14.123+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:28:21.533+0100 [conn283] end connection 172.28.0.163:62286 (342 connections now open) 2015-10-05T14:28:22.065+0100 [conn225] end connection 172.28.0.163:61600 (341 connections now open) 2015-10-05T14:28:22.067+0100 [mongosMain] connection accepted from 172.28.0.163:63734 #540 (342 connections now open) 2015-10-05T14:28:22.068+0100 [conn540] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:23.483+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:28:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:28:26.324+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:28:26.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:28:28.291+0100 [mongosMain] connection accepted from 127.0.0.1:63737 #541 (343 connections now open) 2015-10-05T14:28:28.293+0100 [conn541] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:28.299+0100 [conn541] end connection 127.0.0.1:63737 (342 connections now open) 2015-10-05T14:28:31.535+0100 [conn329] end connection 172.28.0.163:62710 (341 connections now open) 2015-10-05T14:28:32.471+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b000c340f2cfc312dc0 2015-10-05T14:28:32.517+0100 [conn54] end connection 172.28.0.163:60162 (340 connections now open) 2015-10-05T14:28:32.518+0100 [mongosMain] connection accepted from 172.28.0.163:63740 #542 (341 connections now open) 2015-10-05T14:28:32.519+0100 [conn542] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:32.538+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:28:38.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b060c340f2cfc312e03 2015-10-05T14:28:38.787+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:28:39.438+0100 [mongosMain] connection accepted from 127.0.0.1:63744 #543 (342 connections now open) 2015-10-05T14:28:39.440+0100 [conn543] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:28:39.445+0100 [conn543] end connection 127.0.0.1:63744 (341 connections now open) 2015-10-05T14:28:41.557+0100 [conn335] end connection 172.28.0.163:62778 (340 connections now open) 2015-10-05T14:28:51.551+0100 [conn146] end connection 172.28.0.163:61385 (339 connections now open) 2015-10-05T14:28:52.228+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56127b12d5de43e0ed5d418b') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051731882), why: "doing balance round", ts: ObjectId('56127b130c340f2cfc312e9d') } } gle1: { lastOp: Timestamp 1444051732000|1, connectionId: 36801, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1444051718000|11, connectionId: 35263, updatedExisting: false, n: 0, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2015-10-05T14:28:52.231+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:28:52.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:28:53.765+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:28:53 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:28:53.765+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:28:53.902+0100 [LockPinger] handled late remove of old distributed lock with ts 56127b130c340f2cfc312e9d 2015-10-05T14:28:56.587+0100 [mongosMain] connection accepted from 172.28.0.164:64395 #544 (340 connections now open) 2015-10-05T14:28:56.591+0100 [conn544] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:01.566+0100 [conn155] end connection 172.28.0.163:61395 (339 connections now open) 2015-10-05T14:29:05.556+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:29:05.556+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:29:11.567+0100 [conn189] end connection 172.28.0.163:61525 (338 connections now open) 2015-10-05T14:29:12.097+0100 [conn232] end connection 172.28.0.163:61610 (337 connections now open) 2015-10-05T14:29:12.098+0100 [mongosMain] connection accepted from 172.28.0.163:63789 #545 (338 connections now open) 2015-10-05T14:29:12.099+0100 [conn545] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:17.702+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:29:17.702+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:29:21.582+0100 [conn190] end connection 172.28.0.163:61527 (337 connections now open) 2015-10-05T14:29:22.097+0100 [conn212] end connection 172.28.0.163:61579 (336 connections now open) 2015-10-05T14:29:22.098+0100 [mongosMain] connection accepted from 172.28.0.163:63801 #546 (337 connections now open) 2015-10-05T14:29:22.099+0100 [conn546] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:23.844+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56127b3221e099ca5fa0d242') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051763709), why: "doing balance round", ts: ObjectId('56127b330c340f2cfc312f60') } } gle1: { lastOp: Timestamp 1444051732000|1, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1444051763000|4, connectionId: 40376, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2015-10-05T14:29:23.846+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:29:23.847+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:29:24.153+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:29:23 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:29:24.153+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:29:24.289+0100 [LockPinger] handled late remove of old distributed lock with ts 56127b330c340f2cfc312f60 2015-10-05T14:29:28.674+0100 [mongosMain] connection accepted from 127.0.0.1:63803 #547 (338 connections now open) 2015-10-05T14:29:28.676+0100 [conn547] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:28.683+0100 [conn547] end connection 127.0.0.1:63803 (337 connections now open) 2015-10-05T14:29:30.122+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b390c340f2cfc312fa5 2015-10-05T14:29:30.259+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:29:31.597+0100 [conn303] end connection 172.28.0.163:62415 (336 connections now open) 2015-10-05T14:29:32.532+0100 [conn55] end connection 172.28.0.163:60163 (335 connections now open) 2015-10-05T14:29:32.533+0100 [mongosMain] connection accepted from 172.28.0.163:63807 #548 (336 connections now open) 2015-10-05T14:29:32.535+0100 [conn548] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:37.220+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:29:37.220+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:29:39.877+0100 [mongosMain] connection accepted from 127.0.0.1:63808 #549 (337 connections now open) 2015-10-05T14:29:39.879+0100 [conn549] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:39.884+0100 [conn549] end connection 127.0.0.1:63808 (336 connections now open) 2015-10-05T14:29:40.411+0100 [conn380] end connection 172.28.0.164:63596 (335 connections now open) 2015-10-05T14:29:40.412+0100 [mongosMain] connection accepted from 172.28.0.164:64431 #550 (336 connections now open) 2015-10-05T14:29:40.414+0100 [conn550] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:41.597+0100 [conn268] end connection 172.28.0.163:62225 (335 connections now open) 2015-10-05T14:29:43.372+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:29:43.372+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:29:50.410+0100 [conn383] end connection 172.28.0.164:63600 (334 connections now open) 2015-10-05T14:29:50.411+0100 [mongosMain] connection accepted from 172.28.0.164:64442 #551 (335 connections now open) 2015-10-05T14:29:50.414+0100 [conn551] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:50.823+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b4d0c340f2cfc31309b 2015-10-05T14:29:50.878+0100 [conn411] end connection 172.28.0.164:63758 (334 connections now open) 2015-10-05T14:29:50.879+0100 [mongosMain] connection accepted from 172.28.0.164:64444 #552 (335 connections now open) 2015-10-05T14:29:50.881+0100 [conn552] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:50.959+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:29:51.618+0100 [conn148] end connection 172.28.0.163:61387 (334 connections now open) 2015-10-05T14:29:54.474+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:29:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:29:56.604+0100 [mongosMain] connection accepted from 172.28.0.164:64454 #553 (335 connections now open) 2015-10-05T14:29:56.607+0100 [conn553] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:29:57.520+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:29:57.520+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:30:00.425+0100 [conn382] end connection 172.28.0.164:63599 (334 connections now open) 2015-10-05T14:30:00.426+0100 [mongosMain] connection accepted from 172.28.0.164:64463 #554 (335 connections now open) 2015-10-05T14:30:00.428+0100 [conn554] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:00.895+0100 [conn408] end connection 172.28.0.164:63752 (334 connections now open) 2015-10-05T14:30:00.896+0100 [mongosMain] connection accepted from 172.28.0.164:64466 #555 (335 connections now open) 2015-10-05T14:30:00.898+0100 [conn555] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:01.614+0100 [conn160] end connection 172.28.0.163:61400 (334 connections now open) 2015-10-05T14:30:03.815+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56127b5926fd57ee99392e54') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444051803527), why: "doing balance round", ts: ObjectId('56127b5b0c340f2cfc31316d') } } gle1: { lastOp: Timestamp 1444051803000|4, connectionId: 36801, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } gle2: { lastOp: Timestamp 1444051790000|5, connectionId: 35263, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2015-10-05T14:30:03.818+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:30:03.819+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:30:09.979+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b610c340f2cfc313208 2015-10-05T14:30:10.046+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:30:10.441+0100 [conn385] end connection 172.28.0.164:63603 (333 connections now open) 2015-10-05T14:30:10.443+0100 [mongosMain] connection accepted from 172.28.0.164:64470 #556 (334 connections now open) 2015-10-05T14:30:10.445+0100 [conn556] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:10.909+0100 [conn392] end connection 172.28.0.164:63608 (333 connections now open) 2015-10-05T14:30:10.911+0100 [mongosMain] connection accepted from 172.28.0.164:64473 #557 (334 connections now open) 2015-10-05T14:30:10.913+0100 [conn557] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:11.632+0100 [conn162] end connection 172.28.0.163:61402 (333 connections now open) 2015-10-05T14:30:20.457+0100 [conn384] end connection 172.28.0.164:63598 (332 connections now open) 2015-10-05T14:30:20.459+0100 [mongosMain] connection accepted from 172.28.0.164:64482 #558 (333 connections now open) 2015-10-05T14:30:20.461+0100 [conn558] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:20.909+0100 [conn413] end connection 172.28.0.164:63764 (332 connections now open) 2015-10-05T14:30:20.910+0100 [mongosMain] connection accepted from 172.28.0.164:64485 #559 (333 connections now open) 2015-10-05T14:30:20.912+0100 [conn559] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:21.630+0100 [conn322] end connection 172.28.0.163:62696 (332 connections now open) 2015-10-05T14:30:23.375+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b6e0c340f2cfc313291 2015-10-05T14:30:23.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:30:24.746+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:30:24 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:30:24.746+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:30:24.882+0100 [LockPinger] handled late remove of old distributed lock with ts 56127b5b0c340f2cfc31316d 2015-10-05T14:30:29.214+0100 [mongosMain] connection accepted from 127.0.0.1:63876 #560 (333 connections now open) 2015-10-05T14:30:29.217+0100 [conn560] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:29.223+0100 [conn560] end connection 127.0.0.1:63876 (332 connections now open) 2015-10-05T14:30:29.696+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:30:29.696+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:30:30.474+0100 [conn386] end connection 172.28.0.164:63604 (331 connections now open) 2015-10-05T14:30:30.476+0100 [mongosMain] connection accepted from 172.28.0.164:64499 #561 (332 connections now open) 2015-10-05T14:30:30.478+0100 [conn561] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:30.925+0100 [conn415] end connection 172.28.0.164:63770 (331 connections now open) 2015-10-05T14:30:30.926+0100 [mongosMain] connection accepted from 172.28.0.164:64501 #562 (332 connections now open) 2015-10-05T14:30:30.927+0100 [conn562] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:31.645+0100 [conn149] end connection 172.28.0.163:61388 (331 connections now open) 2015-10-05T14:30:32.558+0100 [conn56] end connection 172.28.0.163:60165 (330 connections now open) 2015-10-05T14:30:32.559+0100 [mongosMain] connection accepted from 172.28.0.163:63879 #563 (331 connections now open) 2015-10-05T14:30:32.561+0100 [conn563] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:35.977+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b7b0c340f2cfc313322 2015-10-05T14:30:36.114+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:30:39.686+0100 [mongosMain] connection accepted from 127.0.0.1:63881 #564 (332 connections now open) 2015-10-05T14:30:39.689+0100 [conn564] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:39.696+0100 [conn564] end connection 127.0.0.1:63881 (331 connections now open) 2015-10-05T14:30:40.487+0100 [conn389] end connection 172.28.0.164:63605 (330 connections now open) 2015-10-05T14:30:40.488+0100 [mongosMain] connection accepted from 172.28.0.164:64514 #565 (331 connections now open) 2015-10-05T14:30:40.489+0100 [conn565] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:40.941+0100 [conn417] end connection 172.28.0.164:63775 (330 connections now open) 2015-10-05T14:30:40.942+0100 [mongosMain] connection accepted from 172.28.0.164:64517 #566 (331 connections now open) 2015-10-05T14:30:40.944+0100 [conn566] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:41.646+0100 [conn191] end connection 172.28.0.163:61528 (330 connections now open) 2015-10-05T14:30:48.481+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b880c340f2cfc3133ba 2015-10-05T14:30:48.684+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:30:50.505+0100 [conn391] end connection 172.28.0.164:63607 (329 connections now open) 2015-10-05T14:30:50.506+0100 [mongosMain] connection accepted from 172.28.0.164:64533 #567 (330 connections now open) 2015-10-05T14:30:50.508+0100 [conn567] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:50.956+0100 [conn419] end connection 172.28.0.164:63780 (329 connections now open) 2015-10-05T14:30:50.957+0100 [mongosMain] connection accepted from 172.28.0.164:64535 #568 (330 connections now open) 2015-10-05T14:30:50.959+0100 [conn568] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:30:51.660+0100 [conn178] end connection 172.28.0.163:61509 (329 connections now open) 2015-10-05T14:30:56.530+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:30:54 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:30:56.639+0100 [mongosMain] connection accepted from 172.28.0.164:64541 #569 (330 connections now open) 2015-10-05T14:30:56.639+0100 [conn569] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:00.505+0100 [conn393] end connection 172.28.0.164:63609 (329 connections now open) 2015-10-05T14:31:00.506+0100 [mongosMain] connection accepted from 172.28.0.164:64546 #570 (330 connections now open) 2015-10-05T14:31:00.509+0100 [conn570] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:00.972+0100 [conn421] end connection 172.28.0.164:63785 (329 connections now open) 2015-10-05T14:31:00.973+0100 [mongosMain] connection accepted from 172.28.0.164:64548 #571 (330 connections now open) 2015-10-05T14:31:00.974+0100 [conn571] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:01.113+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127b940c340f2cfc31344b 2015-10-05T14:31:01.215+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:01.677+0100 [conn278] end connection 172.28.0.163:62257 (329 connections now open) 2015-10-05T14:31:08.468+0100 [conn441] end connection 172.28.0.164:63808 (328 connections now open) 2015-10-05T14:31:08.470+0100 [conn390] end connection 172.28.0.164:63606 (327 connections now open) 2015-10-05T14:31:08.471+0100 [mongosMain] connection accepted from 172.28.0.164:64550 #572 (328 connections now open) 2015-10-05T14:31:08.472+0100 [conn572] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:08.474+0100 [mongosMain] connection accepted from 172.28.0.164:64551 #573 (329 connections now open) 2015-10-05T14:31:08.476+0100 [conn573] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:10.988+0100 [conn423] end connection 172.28.0.164:63791 (328 connections now open) 2015-10-05T14:31:10.990+0100 [mongosMain] connection accepted from 172.28.0.164:64555 #574 (329 connections now open) 2015-10-05T14:31:10.992+0100 [conn574] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:11.677+0100 [conn164] end connection 172.28.0.163:61411 (328 connections now open) 2015-10-05T14:31:12.193+0100 [conn354] end connection 172.28.0.163:62828 (327 connections now open) 2015-10-05T14:31:12.193+0100 [mongosMain] connection accepted from 172.28.0.163:63918 #575 (328 connections now open) 2015-10-05T14:31:12.195+0100 [conn575] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:13.550+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ba10c340f2cfc313537 2015-10-05T14:31:13.685+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:18.460+0100 [conn388] end connection 172.28.0.164:63602 (327 connections now open) 2015-10-05T14:31:18.461+0100 [mongosMain] connection accepted from 172.28.0.164:64560 #576 (328 connections now open) 2015-10-05T14:31:18.463+0100 [conn576] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:20.989+0100 [conn429] end connection 172.28.0.164:63796 (327 connections now open) 2015-10-05T14:31:20.990+0100 [mongosMain] connection accepted from 172.28.0.164:64567 #577 (328 connections now open) 2015-10-05T14:31:20.992+0100 [conn577] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:21.692+0100 [conn183] end connection 172.28.0.163:61516 (327 connections now open) 2015-10-05T14:31:22.207+0100 [conn331] end connection 172.28.0.163:62747 (326 connections now open) 2015-10-05T14:31:22.208+0100 [mongosMain] connection accepted from 172.28.0.163:63929 #578 (327 connections now open) 2015-10-05T14:31:22.209+0100 [conn578] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:25.869+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127bad0c340f2cfc3135e4 2015-10-05T14:31:25.936+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:27.049+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:31:26 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:31:28.476+0100 [conn387] end connection 172.28.0.164:63601 (326 connections now open) 2015-10-05T14:31:28.478+0100 [mongosMain] connection accepted from 172.28.0.164:64579 #579 (327 connections now open) 2015-10-05T14:31:28.479+0100 [conn579] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:28.539+0100 [mongosMain] connection accepted from 127.0.0.1:63931 #580 (328 connections now open) 2015-10-05T14:31:28.542+0100 [conn580] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:28.547+0100 [conn580] end connection 127.0.0.1:63931 (327 connections now open) 2015-10-05T14:31:31.004+0100 [conn431] end connection 172.28.0.164:63798 (326 connections now open) 2015-10-05T14:31:31.006+0100 [mongosMain] connection accepted from 172.28.0.164:64583 #581 (327 connections now open) 2015-10-05T14:31:31.008+0100 [conn581] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:31.724+0100 [conn246] end connection 172.28.0.163:61835 (326 connections now open) 2015-10-05T14:31:31.834+0100 [conn139] end connection 172.28.0.163:61378 (325 connections now open) 2015-10-05T14:31:31.835+0100 [conn142] end connection 172.28.0.163:61381 (324 connections now open) 2015-10-05T14:31:32.223+0100 [conn217] end connection 172.28.0.163:61587 (323 connections now open) 2015-10-05T14:31:32.224+0100 [mongosMain] connection accepted from 172.28.0.163:63936 #582 (324 connections now open) 2015-10-05T14:31:32.225+0100 [conn582] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:32.566+0100 [conn57] end connection 172.28.0.163:60167 (323 connections now open) 2015-10-05T14:31:32.567+0100 [mongosMain] connection accepted from 172.28.0.163:63937 #583 (324 connections now open) 2015-10-05T14:31:32.569+0100 [conn583] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:33.503+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127bb30c340f2cfc31363f 2015-10-05T14:31:33.639+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:38.492+0100 [conn376] end connection 172.28.0.164:63592 (323 connections now open) 2015-10-05T14:31:38.493+0100 [mongosMain] connection accepted from 172.28.0.164:64604 #584 (324 connections now open) 2015-10-05T14:31:38.495+0100 [conn584] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:39.397+0100 [mongosMain] connection accepted from 127.0.0.1:63942 #585 (325 connections now open) 2015-10-05T14:31:39.400+0100 [conn585] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:39.405+0100 [conn585] end connection 127.0.0.1:63942 (324 connections now open) 2015-10-05T14:31:41.354+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127bbb0c340f2cfc3136a1 2015-10-05T14:31:41.364+0100 [conn427] end connection 172.28.0.164:63794 (323 connections now open) 2015-10-05T14:31:41.366+0100 [mongosMain] connection accepted from 172.28.0.164:64608 #586 (324 connections now open) 2015-10-05T14:31:41.368+0100 [conn586] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:41.490+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:41.846+0100 [conn327] end connection 172.28.0.163:62706 (323 connections now open) 2015-10-05T14:31:42.237+0100 [conn228] end connection 172.28.0.163:61604 (322 connections now open) 2015-10-05T14:31:42.238+0100 [mongosMain] connection accepted from 172.28.0.163:63946 #587 (323 connections now open) 2015-10-05T14:31:42.239+0100 [conn587] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:47.904+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127bc30c340f2cfc3136f5 2015-10-05T14:31:47.971+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:31:48.492+0100 [conn394] end connection 172.28.0.164:63616 (322 connections now open) 2015-10-05T14:31:48.493+0100 [mongosMain] connection accepted from 172.28.0.164:64623 #588 (323 connections now open) 2015-10-05T14:31:48.495+0100 [conn588] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:51.363+0100 [conn434] end connection 172.28.0.164:63801 (322 connections now open) 2015-10-05T14:31:51.364+0100 [mongosMain] connection accepted from 172.28.0.164:64627 #589 (323 connections now open) 2015-10-05T14:31:51.365+0100 [conn589] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:51.853+0100 [conn156] end connection 172.28.0.163:61396 (322 connections now open) 2015-10-05T14:31:52.239+0100 [conn333] end connection 172.28.0.163:62776 (321 connections now open) 2015-10-05T14:31:52.240+0100 [mongosMain] connection accepted from 172.28.0.163:63968 #590 (322 connections now open) 2015-10-05T14:31:52.241+0100 [conn590] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:56.637+0100 [mongosMain] connection accepted from 172.28.0.164:64634 #591 (323 connections now open) 2015-10-05T14:31:56.638+0100 [conn9] end connection 172.28.0.164:62000 (322 connections now open) 2015-10-05T14:31:56.640+0100 [conn591] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:57.234+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:31:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:31:58.890+0100 [conn377] end connection 172.28.0.164:63593 (321 connections now open) 2015-10-05T14:31:58.891+0100 [mongosMain] connection accepted from 172.28.0.164:64637 #592 (322 connections now open) 2015-10-05T14:31:58.892+0100 [conn592] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:59.701+0100 [conn588] end connection 172.28.0.164:64623 (321 connections now open) 2015-10-05T14:31:59.703+0100 [conn381] end connection 172.28.0.164:63597 (320 connections now open) 2015-10-05T14:31:59.705+0100 [mongosMain] connection accepted from 172.28.0.164:64641 #593 (321 connections now open) 2015-10-05T14:31:59.706+0100 [conn593] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:31:59.707+0100 [mongosMain] connection accepted from 172.28.0.164:64642 #594 (322 connections now open) 2015-10-05T14:31:59.709+0100 [conn594] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:00.077+0100 [conn593] end connection 172.28.0.164:64641 (321 connections now open) 2015-10-05T14:32:00.078+0100 [conn375] end connection 172.28.0.164:63589 (320 connections now open) 2015-10-05T14:32:00.079+0100 [mongosMain] connection accepted from 172.28.0.164:64643 #595 (321 connections now open) 2015-10-05T14:32:00.080+0100 [conn595] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:00.082+0100 [mongosMain] connection accepted from 172.28.0.164:64644 #596 (322 connections now open) 2015-10-05T14:32:00.083+0100 [conn596] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:00.249+0100 [conn570] end connection 172.28.0.164:64546 (321 connections now open) 2015-10-05T14:32:00.251+0100 [conn379] end connection 172.28.0.164:63594 (320 connections now open) 2015-10-05T14:32:00.252+0100 [mongosMain] connection accepted from 172.28.0.164:64645 #597 (321 connections now open) 2015-10-05T14:32:00.254+0100 [conn597] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:00.255+0100 [mongosMain] connection accepted from 172.28.0.164:64646 #598 (322 connections now open) 2015-10-05T14:32:00.257+0100 [conn598] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:01.364+0100 [conn436] end connection 172.28.0.164:63803 (321 connections now open) 2015-10-05T14:32:01.365+0100 [mongosMain] connection accepted from 172.28.0.164:64648 #599 (322 connections now open) 2015-10-05T14:32:01.368+0100 [conn599] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:01.849+0100 [conn291] end connection 172.28.0.163:62320 (321 connections now open) 2015-10-05T14:32:02.239+0100 [conn226] end connection 172.28.0.163:61601 (320 connections now open) 2015-10-05T14:32:02.240+0100 [mongosMain] connection accepted from 172.28.0.163:63983 #600 (321 connections now open) 2015-10-05T14:32:02.241+0100 [conn600] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:06.246+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127bd50c340f2cfc3137c0 2015-10-05T14:32:06.313+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:32:10.255+0100 [conn378] end connection 172.28.0.164:63591 (320 connections now open) 2015-10-05T14:32:10.256+0100 [mongosMain] connection accepted from 172.28.0.164:64654 #601 (321 connections now open) 2015-10-05T14:32:10.258+0100 [conn601] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:11.387+0100 [conn438] end connection 172.28.0.164:63805 (320 connections now open) 2015-10-05T14:32:11.388+0100 [mongosMain] connection accepted from 172.28.0.164:64656 #602 (321 connections now open) 2015-10-05T14:32:11.395+0100 [conn602] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:11.864+0100 [conn348] end connection 172.28.0.163:62791 (320 connections now open) 2015-10-05T14:32:12.254+0100 [conn362] end connection 172.28.0.163:62956 (319 connections now open) 2015-10-05T14:32:12.255+0100 [mongosMain] connection accepted from 172.28.0.163:63996 #603 (320 connections now open) 2015-10-05T14:32:12.256+0100 [conn603] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:18.598+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127be20c340f2cfc313845 2015-10-05T14:32:18.734+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:32:20.352+0100 [conn396] end connection 172.28.0.164:63723 (319 connections now open) 2015-10-05T14:32:20.356+0100 [mongosMain] connection accepted from 172.28.0.164:64663 #604 (320 connections now open) 2015-10-05T14:32:20.360+0100 [conn604] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:21.396+0100 [conn442] end connection 172.28.0.164:63809 (319 connections now open) 2015-10-05T14:32:21.397+0100 [mongosMain] connection accepted from 172.28.0.164:64668 #605 (320 connections now open) 2015-10-05T14:32:21.399+0100 [conn605] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:21.864+0100 [conn145] end connection 172.28.0.163:61384 (319 connections now open) 2015-10-05T14:32:22.255+0100 [conn352] end connection 172.28.0.163:62813 (318 connections now open) 2015-10-05T14:32:22.256+0100 [mongosMain] connection accepted from 172.28.0.163:64005 #606 (319 connections now open) 2015-10-05T14:32:22.257+0100 [conn606] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:24.878+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127be80c340f2cfc31388c 2015-10-05T14:32:24.946+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:32:27.401+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:32:27 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:32:28.502+0100 [mongosMain] connection accepted from 127.0.0.1:64007 #607 (320 connections now open) 2015-10-05T14:32:28.505+0100 [conn607] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:28.509+0100 [conn607] end connection 127.0.0.1:64007 (319 connections now open) 2015-10-05T14:32:30.349+0100 [conn397] end connection 172.28.0.164:63724 (318 connections now open) 2015-10-05T14:32:30.350+0100 [mongosMain] connection accepted from 172.28.0.164:64683 #608 (319 connections now open) 2015-10-05T14:32:30.352+0100 [conn608] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:31.411+0100 [conn440] end connection 172.28.0.164:63807 (318 connections now open) 2015-10-05T14:32:31.412+0100 [mongosMain] connection accepted from 172.28.0.164:64686 #609 (319 connections now open) 2015-10-05T14:32:31.413+0100 [conn609] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:31.880+0100 [conn175] end connection 172.28.0.163:61506 (318 connections now open) 2015-10-05T14:32:32.270+0100 [conn361] end connection 172.28.0.163:62879 (317 connections now open) 2015-10-05T14:32:32.271+0100 [mongosMain] connection accepted from 172.28.0.163:64009 #610 (318 connections now open) 2015-10-05T14:32:32.272+0100 [conn610] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:32.581+0100 [conn58] end connection 172.28.0.163:60168 (317 connections now open) 2015-10-05T14:32:32.582+0100 [mongosMain] connection accepted from 172.28.0.163:64010 #611 (318 connections now open) 2015-10-05T14:32:32.585+0100 [conn611] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:37.817+0100 [conn179] end connection 172.28.0.163:61510 (317 connections now open) 2015-10-05T14:32:37.818+0100 [conn341] end connection 172.28.0.163:62784 (316 connections now open) 2015-10-05T14:32:39.672+0100 [mongosMain] connection accepted from 127.0.0.1:64017 #612 (317 connections now open) 2015-10-05T14:32:39.675+0100 [conn612] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:39.680+0100 [conn612] end connection 127.0.0.1:64017 (316 connections now open) 2015-10-05T14:32:40.350+0100 [conn398] end connection 172.28.0.164:63725 (315 connections now open) 2015-10-05T14:32:40.352+0100 [mongosMain] connection accepted from 172.28.0.164:64701 #613 (316 connections now open) 2015-10-05T14:32:40.353+0100 [conn613] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:41.451+0100 [conn444] end connection 172.28.0.164:63810 (315 connections now open) 2015-10-05T14:32:41.452+0100 [mongosMain] connection accepted from 172.28.0.164:64703 #614 (316 connections now open) 2015-10-05T14:32:41.454+0100 [conn614] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:42.286+0100 [conn201] end connection 172.28.0.163:61562 (315 connections now open) 2015-10-05T14:32:42.288+0100 [mongosMain] connection accepted from 172.28.0.163:64021 #615 (316 connections now open) 2015-10-05T14:32:42.289+0100 [conn615] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:47.809+0100 [conn334] end connection 172.28.0.163:62777 (315 connections now open) 2015-10-05T14:32:49.191+0100 [conn186] end connection 172.28.0.163:61521 (314 connections now open) 2015-10-05T14:32:49.192+0100 [conn285] end connection 172.28.0.163:62289 (313 connections now open) 2015-10-05T14:32:49.231+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c000c340f2cfc3139c5 2015-10-05T14:32:49.367+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:32:50.368+0100 [conn399] end connection 172.28.0.164:63726 (312 connections now open) 2015-10-05T14:32:50.369+0100 [mongosMain] connection accepted from 172.28.0.164:64716 #616 (313 connections now open) 2015-10-05T14:32:50.372+0100 [conn616] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:51.457+0100 [conn445] end connection 172.28.0.164:63812 (312 connections now open) 2015-10-05T14:32:51.458+0100 [mongosMain] connection accepted from 172.28.0.164:64719 #617 (313 connections now open) 2015-10-05T14:32:51.470+0100 [conn617] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:52.703+0100 [conn365] end connection 172.28.0.163:62988 (312 connections now open) 2015-10-05T14:32:52.709+0100 [mongosMain] connection accepted from 172.28.0.163:64046 #618 (313 connections now open) 2015-10-05T14:32:52.712+0100 [conn618] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:55.512+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c070c340f2cfc313a0e 2015-10-05T14:32:55.580+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:32:56.650+0100 [conn11] end connection 172.28.0.164:62004 (312 connections now open) 2015-10-05T14:32:56.652+0100 [mongosMain] connection accepted from 172.28.0.164:64726 #619 (313 connections now open) 2015-10-05T14:32:56.656+0100 [conn619] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:32:58.755+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:32:57 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:32:59.182+0100 [conn153] end connection 172.28.0.163:61393 (312 connections now open) 2015-10-05T14:33:00.381+0100 [conn400] end connection 172.28.0.164:63727 (311 connections now open) 2015-10-05T14:33:00.383+0100 [mongosMain] connection accepted from 172.28.0.164:64729 #620 (312 connections now open) 2015-10-05T14:33:00.384+0100 [conn620] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:01.481+0100 [conn446] end connection 172.28.0.164:63813 (311 connections now open) 2015-10-05T14:33:01.485+0100 [mongosMain] connection accepted from 172.28.0.164:64731 #621 (312 connections now open) 2015-10-05T14:33:01.486+0100 [conn621] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:02.176+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:33:02.176+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:33:02.692+0100 [conn236] end connection 172.28.0.163:61616 (311 connections now open) 2015-10-05T14:33:02.693+0100 [mongosMain] connection accepted from 172.28.0.163:64059 #622 (312 connections now open) 2015-10-05T14:33:02.694+0100 [conn622] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:08.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c140c340f2cfc313aa8 2015-10-05T14:33:08.427+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:33:09.182+0100 [conn287] end connection 172.28.0.163:62291 (311 connections now open) 2015-10-05T14:33:10.397+0100 [conn401] end connection 172.28.0.164:63728 (310 connections now open) 2015-10-05T14:33:10.398+0100 [mongosMain] connection accepted from 172.28.0.164:64734 #623 (311 connections now open) 2015-10-05T14:33:10.400+0100 [conn623] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:11.488+0100 [conn447] end connection 172.28.0.164:63814 (310 connections now open) 2015-10-05T14:33:11.490+0100 [mongosMain] connection accepted from 172.28.0.164:64736 #624 (311 connections now open) 2015-10-05T14:33:11.491+0100 [conn624] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:12.692+0100 [conn219] end connection 172.28.0.163:61590 (310 connections now open) 2015-10-05T14:33:12.693+0100 [mongosMain] connection accepted from 172.28.0.163:64074 #625 (311 connections now open) 2015-10-05T14:33:12.694+0100 [conn625] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:19.198+0100 [conn295] end connection 172.28.0.163:62324 (310 connections now open) 2015-10-05T14:33:20.397+0100 [conn402] end connection 172.28.0.164:63730 (309 connections now open) 2015-10-05T14:33:20.398+0100 [mongosMain] connection accepted from 172.28.0.164:64744 #626 (310 connections now open) 2015-10-05T14:33:20.400+0100 [conn626] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:20.583+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:33:20.583+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:33:21.503+0100 [conn448] end connection 172.28.0.164:63815 (309 connections now open) 2015-10-05T14:33:21.505+0100 [mongosMain] connection accepted from 172.28.0.164:64745 #627 (310 connections now open) 2015-10-05T14:33:21.507+0100 [conn627] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:22.707+0100 [conn213] end connection 172.28.0.163:61581 (309 connections now open) 2015-10-05T14:33:22.708+0100 [mongosMain] connection accepted from 172.28.0.163:64083 #628 (310 connections now open) 2015-10-05T14:33:22.710+0100 [conn628] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:26.728+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:33:26.728+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:33:28.892+0100 [mongosMain] connection accepted from 127.0.0.1:64091 #629 (311 connections now open) 2015-10-05T14:33:28.895+0100 [conn629] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:28.902+0100 [conn629] end connection 127.0.0.1:64091 (310 connections now open) 2015-10-05T14:33:28.983+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:33:28 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:33:29.197+0100 [conn289] end connection 172.28.0.163:62293 (309 connections now open) 2015-10-05T14:33:30.399+0100 [conn403] end connection 172.28.0.164:63732 (308 connections now open) 2015-10-05T14:33:30.400+0100 [mongosMain] connection accepted from 172.28.0.164:64758 #630 (309 connections now open) 2015-10-05T14:33:30.402+0100 [conn630] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:31.490+0100 [conn449] end connection 172.28.0.164:63816 (308 connections now open) 2015-10-05T14:33:31.490+0100 [mongosMain] connection accepted from 172.28.0.164:64764 #631 (309 connections now open) 2015-10-05T14:33:31.492+0100 [conn631] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:32.598+0100 [conn60] end connection 172.28.0.163:60171 (308 connections now open) 2015-10-05T14:33:32.599+0100 [mongosMain] connection accepted from 172.28.0.163:64093 #632 (309 connections now open) 2015-10-05T14:33:32.602+0100 [conn632] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:32.708+0100 [conn224] end connection 172.28.0.163:61598 (308 connections now open) 2015-10-05T14:33:32.709+0100 [mongosMain] connection accepted from 172.28.0.163:64095 #633 (309 connections now open) 2015-10-05T14:33:32.711+0100 [conn633] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:33.771+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:33:33.771+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:33:39.186+0100 [mongosMain] connection accepted from 127.0.0.1:64099 #634 (310 connections now open) 2015-10-05T14:33:39.189+0100 [conn634] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:39.193+0100 [conn634] end connection 127.0.0.1:64099 (309 connections now open) 2015-10-05T14:33:39.213+0100 [conn140] end connection 172.28.0.163:61379 (308 connections now open) 2015-10-05T14:33:40.414+0100 [conn404] end connection 172.28.0.164:63735 (307 connections now open) 2015-10-05T14:33:40.414+0100 [mongosMain] connection accepted from 172.28.0.164:64776 #635 (308 connections now open) 2015-10-05T14:33:40.416+0100 [conn635] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:41.505+0100 [conn450] end connection 172.28.0.164:63817 (307 connections now open) 2015-10-05T14:33:41.506+0100 [mongosMain] connection accepted from 172.28.0.164:64779 #636 (308 connections now open) 2015-10-05T14:33:41.508+0100 [conn636] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:42.723+0100 [conn199] end connection 172.28.0.163:61559 (307 connections now open) 2015-10-05T14:33:42.725+0100 [mongosMain] connection accepted from 172.28.0.163:64103 #637 (308 connections now open) 2015-10-05T14:33:42.726+0100 [conn637] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:46.057+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c390c340f2cfc313bf0 2015-10-05T14:33:46.193+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:33:49.218+0100 [conn165] end connection 172.28.0.163:61413 (307 connections now open) 2015-10-05T14:33:50.413+0100 [conn405] end connection 172.28.0.164:63740 (306 connections now open) 2015-10-05T14:33:50.415+0100 [mongosMain] connection accepted from 172.28.0.164:64797 #638 (307 connections now open) 2015-10-05T14:33:50.417+0100 [conn638] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:51.504+0100 [conn451] end connection 172.28.0.164:63818 (306 connections now open) 2015-10-05T14:33:51.505+0100 [mongosMain] connection accepted from 172.28.0.164:64803 #639 (307 connections now open) 2015-10-05T14:33:51.507+0100 [conn639] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:52.324+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c400c340f2cfc313c29 2015-10-05T14:33:52.392+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:33:52.724+0100 [conn363] end connection 172.28.0.163:62969 (306 connections now open) 2015-10-05T14:33:52.725+0100 [mongosMain] connection accepted from 172.28.0.163:64118 #640 (307 connections now open) 2015-10-05T14:33:52.726+0100 [conn640] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:56.666+0100 [conn18] end connection 172.28.0.164:62049 (306 connections now open) 2015-10-05T14:33:56.667+0100 [mongosMain] connection accepted from 172.28.0.164:64811 #641 (307 connections now open) 2015-10-05T14:33:56.671+0100 [conn641] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:33:58.656+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c460c340f2cfc313c50 2015-10-05T14:33:58.791+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:33:59.229+0100 [conn182] end connection 172.28.0.163:61514 (306 connections now open) 2015-10-05T14:33:59.602+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:33:58 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:34:00.427+0100 [conn406] end connection 172.28.0.164:63743 (305 connections now open) 2015-10-05T14:34:00.428+0100 [mongosMain] connection accepted from 172.28.0.164:64816 #642 (306 connections now open) 2015-10-05T14:34:00.430+0100 [conn642] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:01.521+0100 [conn452] end connection 172.28.0.164:63819 (305 connections now open) 2015-10-05T14:34:01.522+0100 [mongosMain] connection accepted from 172.28.0.164:64818 #643 (306 connections now open) 2015-10-05T14:34:01.523+0100 [conn643] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:02.739+0100 [conn490] end connection 172.28.0.163:63387 (305 connections now open) 2015-10-05T14:34:02.740+0100 [mongosMain] connection accepted from 172.28.0.163:64131 #644 (306 connections now open) 2015-10-05T14:34:02.741+0100 [conn644] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:09.245+0100 [conn324] end connection 172.28.0.163:62698 (305 connections now open) 2015-10-05T14:34:10.447+0100 [conn420] end connection 172.28.0.164:63781 (304 connections now open) 2015-10-05T14:34:10.448+0100 [mongosMain] connection accepted from 172.28.0.164:64820 #645 (305 connections now open) 2015-10-05T14:34:10.452+0100 [conn645] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:11.536+0100 [conn453] end connection 172.28.0.164:63820 (304 connections now open) 2015-10-05T14:34:11.536+0100 [mongosMain] connection accepted from 172.28.0.164:64822 #646 (305 connections now open) 2015-10-05T14:34:11.537+0100 [conn646] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:11.772+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:34:11.772+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:34:12.756+0100 [conn493] end connection 172.28.0.163:63392 (304 connections now open) 2015-10-05T14:34:12.757+0100 [mongosMain] connection accepted from 172.28.0.163:64146 #647 (305 connections now open) 2015-10-05T14:34:12.758+0100 [conn647] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:17.913+0100 [Balancer] warning: distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('56127c59d5de43e0ed5d41ab') } update: { $set: { state: 1, who: "402929-MYWAPP1:27017:1444049209:41:Balancer:18467", process: "402929-MYWAPP1:27017:1444049209:41", when: new Date(1444052057779), why: "doing balance round", ts: ObjectId('56127c590c340f2cfc313d35') } } gle1: { lastOp: Timestamp 1444052038000|11, connectionId: 36801, updatedExisting: false, n: 0, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } gle2: { lastOp: Timestamp 1444052057000|8, connectionId: 35263, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2015-10-05T14:34:17.916+0100 [Balancer] lock update lost, lock 'balancer/402929-MYWAPP1:27017:1444049209:41' not propagated. 2015-10-05T14:34:17.916+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:34:19.245+0100 [conn296] end connection 172.28.0.163:62325 (304 connections now open) 2015-10-05T14:34:20.460+0100 [conn416] end connection 172.28.0.164:63772 (303 connections now open) 2015-10-05T14:34:20.461+0100 [mongosMain] connection accepted from 172.28.0.164:64831 #648 (304 connections now open) 2015-10-05T14:34:20.463+0100 [conn648] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:21.537+0100 [conn455] end connection 172.28.0.164:63822 (303 connections now open) 2015-10-05T14:34:21.537+0100 [mongosMain] connection accepted from 172.28.0.164:64835 #649 (304 connections now open) 2015-10-05T14:34:21.539+0100 [conn649] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:21.798+0100 [conn579] end connection 172.28.0.164:64579 (303 connections now open) 2015-10-05T14:34:21.806+0100 [conn435] end connection 172.28.0.164:63802 (302 connections now open) 2015-10-05T14:34:21.807+0100 [mongosMain] connection accepted from 172.28.0.164:64836 #650 (303 connections now open) 2015-10-05T14:34:21.808+0100 [conn650] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:21.809+0100 [mongosMain] connection accepted from 172.28.0.164:64837 #651 (304 connections now open) 2015-10-05T14:34:21.811+0100 [conn651] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:22.755+0100 [conn496] end connection 172.28.0.163:63402 (303 connections now open) 2015-10-05T14:34:22.756+0100 [mongosMain] connection accepted from 172.28.0.163:64153 #652 (304 connections now open) 2015-10-05T14:34:22.757+0100 [conn652] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:24.090+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c5f0c340f2cfc313d7e 2015-10-05T14:34:24.158+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:34:29.236+0100 [mongosMain] connection accepted from 127.0.0.1:64160 #653 (305 connections now open) 2015-10-05T14:34:29.238+0100 [conn653] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:29.243+0100 [conn653] end connection 127.0.0.1:64160 (304 connections now open) 2015-10-05T14:34:29.260+0100 [conn151] end connection 172.28.0.163:61390 (303 connections now open) 2015-10-05T14:34:29.869+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:34:29 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:34:29.869+0100 [LockPinger] trying to delete 1 old lock entries for process 402929-MYWAPP1:27017:1444049209:41 2015-10-05T14:34:30.006+0100 [LockPinger] handled late remove of old distributed lock with ts 56127c590c340f2cfc313d35 2015-10-05T14:34:31.551+0100 [conn454] end connection 172.28.0.164:63821 (302 connections now open) 2015-10-05T14:34:31.553+0100 [mongosMain] connection accepted from 172.28.0.164:64850 #654 (303 connections now open) 2015-10-05T14:34:31.556+0100 [conn654] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:31.801+0100 [conn433] end connection 172.28.0.164:63800 (302 connections now open) 2015-10-05T14:34:31.802+0100 [mongosMain] connection accepted from 172.28.0.164:64853 #655 (303 connections now open) 2015-10-05T14:34:31.804+0100 [conn655] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:32.614+0100 [conn61] end connection 172.28.0.163:60173 (302 connections now open) 2015-10-05T14:34:32.615+0100 [mongosMain] connection accepted from 172.28.0.163:64162 #656 (303 connections now open) 2015-10-05T14:34:32.616+0100 [conn656] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:32.770+0100 [conn489] end connection 172.28.0.163:63376 (302 connections now open) 2015-10-05T14:34:32.772+0100 [mongosMain] connection accepted from 172.28.0.163:64164 #657 (303 connections now open) 2015-10-05T14:34:32.773+0100 [conn657] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:39.261+0100 [conn187] end connection 172.28.0.163:61522 (302 connections now open) 2015-10-05T14:34:39.262+0100 [mongosMain] connection accepted from 172.28.0.163:64173 #658 (303 connections now open) 2015-10-05T14:34:39.263+0100 [conn658] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:40.023+0100 [mongosMain] connection accepted from 127.0.0.1:64174 #659 (304 connections now open) 2015-10-05T14:34:40.026+0100 [conn659] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:40.030+0100 [conn659] end connection 127.0.0.1:64174 (303 connections now open) 2015-10-05T14:34:41.568+0100 [conn457] end connection 172.28.0.164:63824 (302 connections now open) 2015-10-05T14:34:41.569+0100 [mongosMain] connection accepted from 172.28.0.164:64870 #660 (303 connections now open) 2015-10-05T14:34:41.570+0100 [conn660] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:42.772+0100 [conn497] end connection 172.28.0.163:63415 (302 connections now open) 2015-10-05T14:34:42.773+0100 [mongosMain] connection accepted from 172.28.0.163:64179 #661 (303 connections now open) 2015-10-05T14:34:42.774+0100 [conn661] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:48.968+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:34:48.968+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:34:49.275+0100 [conn347] end connection 172.28.0.163:62790 (302 connections now open) 2015-10-05T14:34:49.276+0100 [mongosMain] connection accepted from 172.28.0.163:64191 #662 (303 connections now open) 2015-10-05T14:34:49.277+0100 [conn662] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:51.567+0100 [conn458] end connection 172.28.0.164:63825 (302 connections now open) 2015-10-05T14:34:51.577+0100 [mongosMain] connection accepted from 172.28.0.164:64885 #663 (303 connections now open) 2015-10-05T14:34:51.580+0100 [conn663] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:55.119+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:34:55.119+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:34:56.682+0100 [conn8] end connection 172.28.0.164:61999 (302 connections now open) 2015-10-05T14:34:56.688+0100 [mongosMain] connection accepted from 172.28.0.164:64894 #664 (303 connections now open) 2015-10-05T14:34:56.691+0100 [conn664] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:34:59.694+0100 [conn338] end connection 172.28.0.163:62781 (302 connections now open) 2015-10-05T14:34:59.710+0100 [mongosMain] connection accepted from 172.28.0.163:64205 #665 (303 connections now open) 2015-10-05T14:34:59.711+0100 [conn665] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:00.273+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:35:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:35:01.400+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c850c340f2cfc313f76 2015-10-05T14:35:01.533+0100 [conn665] end connection 172.28.0.163:64205 (302 connections now open) 2015-10-05T14:35:01.534+0100 [conn181] end connection 172.28.0.163:61513 (301 connections now open) 2015-10-05T14:35:01.536+0100 [mongosMain] connection accepted from 172.28.0.163:64211 #666 (302 connections now open) 2015-10-05T14:35:01.536+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:35:01.536+0100 [conn666] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:01.537+0100 [mongosMain] connection accepted from 172.28.0.163:64212 #667 (303 connections now open) 2015-10-05T14:35:01.538+0100 [conn667] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:01.589+0100 [conn456] end connection 172.28.0.164:63823 (302 connections now open) 2015-10-05T14:35:01.591+0100 [mongosMain] connection accepted from 172.28.0.164:64899 #668 (303 connections now open) 2015-10-05T14:35:01.593+0100 [conn668] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:06.178+0100 [conn297] end connection 172.28.0.163:62327 (302 connections now open) 2015-10-05T14:35:06.179+0100 [conn251] end connection 172.28.0.163:61853 (301 connections now open) 2015-10-05T14:35:06.180+0100 [mongosMain] connection accepted from 172.28.0.163:64219 #669 (302 connections now open) 2015-10-05T14:35:06.181+0100 [conn669] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:06.182+0100 [mongosMain] connection accepted from 172.28.0.163:64220 #670 (303 connections now open) 2015-10-05T14:35:06.183+0100 [conn670] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:11.585+0100 [conn459] end connection 172.28.0.164:63826 (302 connections now open) 2015-10-05T14:35:11.587+0100 [mongosMain] connection accepted from 172.28.0.164:64903 #671 (303 connections now open) 2015-10-05T14:35:11.589+0100 [conn671] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:12.802+0100 [conn500] end connection 172.28.0.163:63446 (302 connections now open) 2015-10-05T14:35:12.803+0100 [mongosMain] connection accepted from 172.28.0.163:64228 #672 (303 connections now open) 2015-10-05T14:35:12.804+0100 [conn672] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:12.814+0100 [conn642] end connection 172.28.0.164:64816 (302 connections now open) 2015-10-05T14:35:12.820+0100 [mongosMain] connection accepted from 172.28.0.164:64906 #673 (303 connections now open) 2015-10-05T14:35:12.822+0100 [conn673] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:16.187+0100 [conn298] end connection 172.28.0.163:62330 (302 connections now open) 2015-10-05T14:35:16.188+0100 [mongosMain] connection accepted from 172.28.0.163:64234 #674 (303 connections now open) 2015-10-05T14:35:16.188+0100 [conn674] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:16.548+0100 [conn247] end connection 172.28.0.163:61836 (302 connections now open) 2015-10-05T14:35:16.549+0100 [conn342] end connection 172.28.0.163:62785 (301 connections now open) 2015-10-05T14:35:16.550+0100 [mongosMain] connection accepted from 172.28.0.163:64235 #675 (302 connections now open) 2015-10-05T14:35:16.551+0100 [conn675] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:16.552+0100 [mongosMain] connection accepted from 172.28.0.163:64236 #676 (303 connections now open) 2015-10-05T14:35:16.553+0100 [conn676] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:19.663+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:35:19.663+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:35:21.599+0100 [conn460] end connection 172.28.0.164:63828 (302 connections now open) 2015-10-05T14:35:21.600+0100 [mongosMain] connection accepted from 172.28.0.164:64917 #677 (303 connections now open) 2015-10-05T14:35:21.602+0100 [conn677] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:22.808+0100 [conn501] end connection 172.28.0.163:63453 (302 connections now open) 2015-10-05T14:35:22.809+0100 [mongosMain] connection accepted from 172.28.0.163:64239 #678 (303 connections now open) 2015-10-05T14:35:22.811+0100 [conn678] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:25.808+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127c9d0c340f2cfc314100 2015-10-05T14:35:25.876+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:35:26.552+0100 [conn157] end connection 172.28.0.163:61397 (302 connections now open) 2015-10-05T14:35:26.552+0100 [mongosMain] connection accepted from 172.28.0.163:64241 #679 (303 connections now open) 2015-10-05T14:35:26.553+0100 [conn679] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:28.889+0100 [mongosMain] connection accepted from 127.0.0.1:64247 #680 (304 connections now open) 2015-10-05T14:35:28.892+0100 [conn680] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:28.898+0100 [conn680] end connection 127.0.0.1:64247 (303 connections now open) 2015-10-05T14:35:30.551+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:35:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:35:31.615+0100 [conn461] end connection 172.28.0.164:63829 (302 connections now open) 2015-10-05T14:35:31.616+0100 [mongosMain] connection accepted from 172.28.0.164:64929 #681 (303 connections now open) 2015-10-05T14:35:31.618+0100 [conn681] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:32.630+0100 [conn62] end connection 172.28.0.163:60175 (302 connections now open) 2015-10-05T14:35:32.631+0100 [mongosMain] connection accepted from 172.28.0.163:64249 #682 (303 connections now open) 2015-10-05T14:35:32.633+0100 [conn682] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:32.818+0100 [conn499] end connection 172.28.0.163:63430 (302 connections now open) 2015-10-05T14:35:32.820+0100 [mongosMain] connection accepted from 172.28.0.163:64251 #683 (303 connections now open) 2015-10-05T14:35:32.820+0100 [conn683] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:36.562+0100 [conn336] end connection 172.28.0.163:62779 (302 connections now open) 2015-10-05T14:35:36.563+0100 [mongosMain] connection accepted from 172.28.0.163:64254 #684 (303 connections now open) 2015-10-05T14:35:36.564+0100 [conn684] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:38.163+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:35:38.163+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:35:39.383+0100 [mongosMain] connection accepted from 127.0.0.1:64255 #685 (304 connections now open) 2015-10-05T14:35:39.385+0100 [conn685] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:39.391+0100 [conn685] end connection 127.0.0.1:64255 (303 connections now open) 2015-10-05T14:35:41.630+0100 [conn462] end connection 172.28.0.164:63830 (302 connections now open) 2015-10-05T14:35:41.631+0100 [mongosMain] connection accepted from 172.28.0.164:64945 #686 (303 connections now open) 2015-10-05T14:35:41.633+0100 [conn686] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:42.833+0100 [conn235] end connection 172.28.0.163:61615 (302 connections now open) 2015-10-05T14:35:42.835+0100 [mongosMain] connection accepted from 172.28.0.163:64258 #687 (303 connections now open) 2015-10-05T14:35:42.836+0100 [conn687] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:44.312+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cb00c340f2cfc3141f0 2015-10-05T14:35:44.379+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:35:46.577+0100 [conn340] end connection 172.28.0.163:62783 (302 connections now open) 2015-10-05T14:35:46.579+0100 [mongosMain] connection accepted from 172.28.0.163:64264 #688 (303 connections now open) 2015-10-05T14:35:46.580+0100 [conn688] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:46.844+0100 [conn321] end connection 172.28.0.163:62695 (302 connections now open) 2015-10-05T14:35:46.849+0100 [conn292] end connection 172.28.0.163:62321 (301 connections now open) 2015-10-05T14:35:46.850+0100 [mongosMain] connection accepted from 172.28.0.163:64265 #689 (302 connections now open) 2015-10-05T14:35:46.851+0100 [conn689] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:46.852+0100 [mongosMain] connection accepted from 172.28.0.163:64266 #690 (303 connections now open) 2015-10-05T14:35:46.852+0100 [conn690] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:50.564+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cb60c340f2cfc31423e 2015-10-05T14:35:50.632+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:35:51.646+0100 [conn463] end connection 172.28.0.164:63831 (302 connections now open) 2015-10-05T14:35:51.647+0100 [mongosMain] connection accepted from 172.28.0.164:64963 #691 (303 connections now open) 2015-10-05T14:35:51.649+0100 [conn691] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:52.834+0100 [conn511] end connection 172.28.0.163:63532 (302 connections now open) 2015-10-05T14:35:52.835+0100 [mongosMain] connection accepted from 172.28.0.163:64278 #692 (303 connections now open) 2015-10-05T14:35:52.836+0100 [conn692] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:54.635+0100 [conn666] end connection 172.28.0.163:64211 (302 connections now open) 2015-10-05T14:35:54.637+0100 [conn345] end connection 172.28.0.163:62788 (301 connections now open) 2015-10-05T14:35:54.638+0100 [mongosMain] connection accepted from 172.28.0.163:64281 #693 (302 connections now open) 2015-10-05T14:35:54.639+0100 [conn693] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:54.641+0100 [mongosMain] connection accepted from 172.28.0.163:64282 #694 (303 connections now open) 2015-10-05T14:35:54.642+0100 [conn694] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:35:56.702+0100 [conn19] end connection 172.28.0.164:62054 (302 connections now open) 2015-10-05T14:35:56.703+0100 [mongosMain] connection accepted from 172.28.0.164:64969 #695 (303 connections now open) 2015-10-05T14:35:56.706+0100 [conn695] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:00.803+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:36:00 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:36:01.647+0100 [conn464] end connection 172.28.0.164:63832 (302 connections now open) 2015-10-05T14:36:01.650+0100 [mongosMain] connection accepted from 172.28.0.164:64975 #696 (303 connections now open) 2015-10-05T14:36:01.651+0100 [conn696] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:02.849+0100 [conn503] end connection 172.28.0.163:63461 (302 connections now open) 2015-10-05T14:36:02.851+0100 [mongosMain] connection accepted from 172.28.0.163:64292 #697 (303 connections now open) 2015-10-05T14:36:02.851+0100 [conn697] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:04.657+0100 [conn249] end connection 172.28.0.163:61838 (302 connections now open) 2015-10-05T14:36:04.658+0100 [mongosMain] connection accepted from 172.28.0.163:64296 #698 (303 connections now open) 2015-10-05T14:36:04.659+0100 [conn698] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:11.671+0100 [conn468] end connection 172.28.0.164:63836 (302 connections now open) 2015-10-05T14:36:11.672+0100 [mongosMain] connection accepted from 172.28.0.164:64979 #699 (303 connections now open) 2015-10-05T14:36:11.675+0100 [conn699] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:12.850+0100 [conn510] end connection 172.28.0.163:63524 (302 connections now open) 2015-10-05T14:36:12.851+0100 [mongosMain] connection accepted from 172.28.0.163:64306 #700 (303 connections now open) 2015-10-05T14:36:12.852+0100 [conn700] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:14.646+0100 [conn154] end connection 172.28.0.163:61394 (302 connections now open) 2015-10-05T14:36:14.647+0100 [mongosMain] connection accepted from 172.28.0.163:64311 #701 (303 connections now open) 2015-10-05T14:36:14.648+0100 [conn701] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:15.120+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cce0c340f2cfc31436a 2015-10-05T14:36:15.255+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:36:17.678+0100 [conn150] end connection 172.28.0.163:61389 (302 connections now open) 2015-10-05T14:36:17.680+0100 [mongosMain] connection accepted from 172.28.0.163:64314 #702 (303 connections now open) 2015-10-05T14:36:17.681+0100 [conn702] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:18.282+0100 [conn163] end connection 172.28.0.163:61404 (302 connections now open) 2015-10-05T14:36:18.283+0100 [mongosMain] connection accepted from 172.28.0.163:64315 #703 (303 connections now open) 2015-10-05T14:36:18.285+0100 [conn703] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:21.411+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cd50c340f2cfc3143bd 2015-10-05T14:36:21.479+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:36:21.667+0100 [conn425] end connection 172.28.0.164:63792 (302 connections now open) 2015-10-05T14:36:21.669+0100 [mongosMain] connection accepted from 172.28.0.164:64997 #704 (303 connections now open) 2015-10-05T14:36:21.672+0100 [conn704] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:22.865+0100 [conn507] end connection 172.28.0.163:63488 (302 connections now open) 2015-10-05T14:36:22.866+0100 [mongosMain] connection accepted from 172.28.0.163:64322 #705 (303 connections now open) 2015-10-05T14:36:22.866+0100 [conn705] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:24.659+0100 [conn159] end connection 172.28.0.163:61399 (302 connections now open) 2015-10-05T14:36:24.665+0100 [mongosMain] connection accepted from 172.28.0.163:64325 #706 (303 connections now open) 2015-10-05T14:36:24.671+0100 [conn706] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:27.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cdb0c340f2cfc314404 2015-10-05T14:36:27.896+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:36:28.798+0100 [mongosMain] connection accepted from 127.0.0.1:64327 #707 (304 connections now open) 2015-10-05T14:36:28.800+0100 [conn707] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:28.806+0100 [conn707] end connection 127.0.0.1:64327 (303 connections now open) 2015-10-05T14:36:31.069+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:36:30 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:36:31.693+0100 [conn470] end connection 172.28.0.164:63838 (302 connections now open) 2015-10-05T14:36:31.705+0100 [mongosMain] connection accepted from 172.28.0.164:65014 #708 (303 connections now open) 2015-10-05T14:36:31.706+0100 [conn708] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:32.646+0100 [conn63] end connection 172.28.0.163:60176 (302 connections now open) 2015-10-05T14:36:32.647+0100 [mongosMain] connection accepted from 172.28.0.163:64329 #709 (303 connections now open) 2015-10-05T14:36:32.650+0100 [conn709] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:32.870+0100 [conn506] end connection 172.28.0.163:63471 (302 connections now open) 2015-10-05T14:36:32.871+0100 [mongosMain] connection accepted from 172.28.0.163:64332 #710 (303 connections now open) 2015-10-05T14:36:32.872+0100 [conn710] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:34.346+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:36:34.346+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:36:34.690+0100 [conn302] end connection 172.28.0.163:62414 (302 connections now open) 2015-10-05T14:36:34.691+0100 [mongosMain] connection accepted from 172.28.0.163:64336 #711 (303 connections now open) 2015-10-05T14:36:34.692+0100 [conn711] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:39.720+0100 [mongosMain] connection accepted from 127.0.0.1:64338 #712 (304 connections now open) 2015-10-05T14:36:39.723+0100 [conn712] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:39.728+0100 [conn712] end connection 127.0.0.1:64338 (303 connections now open) 2015-10-05T14:36:40.625+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127ce80c340f2cfc31448e 2015-10-05T14:36:40.761+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:36:41.680+0100 [conn471] end connection 172.28.0.164:63839 (302 connections now open) 2015-10-05T14:36:41.681+0100 [mongosMain] connection accepted from 172.28.0.164:65028 #713 (303 connections now open) 2015-10-05T14:36:41.683+0100 [conn713] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:43.454+0100 [conn651] end connection 172.28.0.164:64837 (302 connections now open) 2015-10-05T14:36:43.462+0100 [mongosMain] connection accepted from 172.28.0.164:65031 #714 (303 connections now open) 2015-10-05T14:36:43.465+0100 [conn714] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:43.590+0100 [conn595] end connection 172.28.0.164:64643 (302 connections now open) 2015-10-05T14:36:43.595+0100 [mongosMain] connection accepted from 172.28.0.164:65032 #715 (303 connections now open) 2015-10-05T14:36:43.597+0100 [conn715] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:44.706+0100 [conn357] end connection 172.28.0.163:62858 (302 connections now open) 2015-10-05T14:36:44.707+0100 [mongosMain] connection accepted from 172.28.0.163:64346 #716 (303 connections now open) 2015-10-05T14:36:44.708+0100 [conn716] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:54.985+0100 [conn147] end connection 172.28.0.163:61386 (302 connections now open) 2015-10-05T14:36:54.986+0100 [mongosMain] connection accepted from 172.28.0.163:64363 #717 (303 connections now open) 2015-10-05T14:36:54.988+0100 [conn717] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:55.129+0100 [conn161] end connection 172.28.0.163:61401 (302 connections now open) 2015-10-05T14:36:55.130+0100 [mongosMain] connection accepted from 172.28.0.163:64364 #718 (303 connections now open) 2015-10-05T14:36:55.131+0100 [conn718] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:56.715+0100 [conn22] end connection 172.28.0.164:62098 (302 connections now open) 2015-10-05T14:36:56.715+0100 [mongosMain] connection accepted from 172.28.0.164:65051 #719 (303 connections now open) 2015-10-05T14:36:56.718+0100 [conn719] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:57.487+0100 [conn141] end connection 172.28.0.163:61380 (302 connections now open) 2015-10-05T14:36:57.487+0100 [mongosMain] connection accepted from 172.28.0.163:64369 #720 (303 connections now open) 2015-10-05T14:36:57.487+0100 [conn720] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:36:59.031+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127cfa0c340f2cfc3145e3 2015-10-05T14:36:59.156+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:37:01.355+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:37:01 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:37:03.612+0100 [conn424] end connection 172.28.0.164:63790 (302 connections now open) 2015-10-05T14:37:03.613+0100 [mongosMain] connection accepted from 172.28.0.164:65053 #721 (303 connections now open) 2015-10-05T14:37:03.614+0100 [conn721] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:04.738+0100 [conn299] end connection 172.28.0.163:62338 (302 connections now open) 2015-10-05T14:37:04.739+0100 [mongosMain] connection accepted from 172.28.0.163:64382 #722 (303 connections now open) 2015-10-05T14:37:04.740+0100 [conn722] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:11.216+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:37:11.216+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:37:12.912+0100 [conn516] end connection 172.28.0.163:63549 (302 connections now open) 2015-10-05T14:37:12.913+0100 [mongosMain] connection accepted from 172.28.0.163:64392 #723 (303 connections now open) 2015-10-05T14:37:12.914+0100 [conn723] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:14.753+0100 [conn270] end connection 172.28.0.163:62227 (302 connections now open) 2015-10-05T14:37:14.754+0100 [mongosMain] connection accepted from 172.28.0.163:64398 #724 (303 connections now open) 2015-10-05T14:37:14.755+0100 [conn724] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:16.487+0100 [conn655] end connection 172.28.0.164:64853 (302 connections now open) 2015-10-05T14:37:16.493+0100 [mongosMain] connection accepted from 172.28.0.164:65058 #725 (303 connections now open) 2015-10-05T14:37:16.495+0100 [conn725] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:17.359+0100 [Balancer] could not acquire lock 'balancer/402929-MYWAPP1:27017:1444049209:41' (another update won) 2015-10-05T14:37:17.359+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' was not acquired. 2015-10-05T14:37:22.913+0100 [conn509] end connection 172.28.0.163:63509 (302 connections now open) 2015-10-05T14:37:22.914+0100 [mongosMain] connection accepted from 172.28.0.163:64405 #726 (303 connections now open) 2015-10-05T14:37:22.915+0100 [conn726] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:24.769+0100 [conn176] end connection 172.28.0.163:61507 (302 connections now open) 2015-10-05T14:37:24.770+0100 [mongosMain] connection accepted from 172.28.0.163:64408 #727 (303 connections now open) 2015-10-05T14:37:24.771+0100 [conn727] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:28.223+0100 [mongosMain] connection accepted from 127.0.0.1:64410 #728 (304 connections now open) 2015-10-05T14:37:28.225+0100 [conn728] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:28.231+0100 [conn728] end connection 127.0.0.1:64410 (303 connections now open) 2015-10-05T14:37:29.669+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' acquired, ts : 56127d190c340f2cfc31489f 2015-10-05T14:37:29.806+0100 [Balancer] distributed lock 'balancer/402929-MYWAPP1:27017:1444049209:41' unlocked. 2015-10-05T14:37:31.652+0100 [LockPinger] cluster mywdb7:27019,mywdb8:27019,mywdb9:27019 pinged successfully at Mon Oct 05 14:37:31 2015 by distributed lock pinger 'mywdb7:27019,mywdb8:27019,mywdb9:27019/402929-MYWAPP1:27017:1444049209:41', sleeping for 30000ms 2015-10-05T14:37:32.663+0100 [conn64] end connection 172.28.0.163:60178 (302 connections now open) 2015-10-05T14:37:32.664+0100 [mongosMain] connection accepted from 172.28.0.163:64414 #729 (303 connections now open) 2015-10-05T14:37:32.666+0100 [conn729] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:32.928+0100 [conn523] end connection 172.28.0.163:63603 (302 connections now open) 2015-10-05T14:37:32.929+0100 [mongosMain] connection accepted from 172.28.0.163:64416 #730 (303 connections now open) 2015-10-05T14:37:32.930+0100 [conn730] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:34.770+0100 [conn184] end connection 172.28.0.163:61517 (302 connections now open) 2015-10-05T14:37:34.771+0100 [mongosMain] connection accepted from 172.28.0.163:64418 #731 (303 connections now open) 2015-10-05T14:37:34.772+0100 [conn731] authenticate db: admin { authenticate: 1, user: "dbuser", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:39.457+0100 [mongosMain] connection accepted from 127.0.0.1:64421 #732 (304 connections now open) 2015-10-05T14:37:39.459+0100 [conn732] authenticate db: admin { authenticate: 1, user: "ma", nonce: "xxx", key: "xxx" } 2015-10-05T14:37:39.463+0100 [conn732] end connection 127.0.0.1:64421 (303 connections now open)